Unearthing Hidden Climate Tech with AI
Towards unearthing neglected climate innovations from scientific literature using Large Language Models
By
César Quilodrán-Casas|Christopher Waite|Nicole Alhadeff|Diyona Dsouza|Cathal Hughes|Larissa Kunstel-Tabet|Alyssa Gilbert

https://arxiv.org/abs/2411.10055v1
Summary
The fight against climate change demands innovative solutions, and what if many of those solutions are already hidden within the vast sea of scientific literature? Researchers are now turning to AI and large language models (LLMs) to unearth these neglected climate innovations. Imagine sifting through millions of research papers to find the needles in the haystack – the ones with the potential to revolutionize our approach to climate change. This is precisely what researchers are tackling using the power of LLMs. They've developed a system that analyzes title-abstract pairs from scientific papers, assessing their potential impact on climate change mitigation, technological readiness, and deployability. Focusing on UK-based research initially, they've built a region-agnostic workflow. They’ve trained LLMs to evaluate papers based on several key criteria, including emissions reduction potential, technology maturity, market need, and whether the research has been overlooked by traditional funding mechanisms. Surprisingly, the LLMs, especially when provided with relevant context, proved remarkably adept at identifying promising research, even outperforming human evaluators in some cases. For instance, the AI consistently identified research linked to successful climate-tech spin-out companies, often with greater certainty than human experts. However, the research also revealed that LLMs aren't perfect. They sometimes struggled to distinguish between fundamental research that could enable future technologies and research ready for immediate deployment. To refine the process, the team explored different prompting strategies and scoring systems, finding that giving the LLM more context and using a scalar scoring system (1-10 instead of yes/no) significantly improved its ability to pinpoint high-potential research. This allowed for a more nuanced ranking of research papers and helped avoid bottlenecks where numerous papers received identical scores. The initial results are promising. Applying the refined LLM approach to a larger dataset of 1000 abstracts, the AI again identified several potential game-changers, including research related to carbon capture, thermal hybrid technologies, and photovoltaics. While there's room for improvement, this research demonstrates the power of AI to accelerate the discovery of climate solutions hidden within existing scientific knowledge. Future work will focus on testing different LLMs, incorporating more sophisticated techniques like Retrieval-Augmented Generation (RAG) to give the AI access to even more context, and developing multi-agent approaches to evaluate the LLM’s outputs. They're even building a system to link research papers with the authors’ networks and social media presence to identify researchers with entrepreneurial potential. By combining the power of AI with human expertise, we can unlock the full potential of scientific research and accelerate the transition to a sustainable future.
🍰 Interesting in building your own agents?
PromptLayer provides the tools to manage and monitor prompts with your whole team.
Get started for free.Question & Answers
How does the LLM-based system evaluate scientific papers for climate tech potential?
The system analyzes title-abstract pairs using a multi-criteria evaluation framework. Technically, it assesses papers based on emissions reduction potential, technology maturity, market need, and funding history. The process involves: 1) Initial scanning of papers using contextual prompts, 2) Scoring on a 1-10 scale rather than binary yes/no responses, and 3) Evaluation against specific criteria like deployability and technological readiness. For example, when analyzing a carbon capture research paper, the system would evaluate both its theoretical potential and practical implementation feasibility, considering factors like current market demands and existing technological infrastructure.
What are the main benefits of using AI to discover climate solutions?
AI offers several key advantages in discovering climate solutions. It can rapidly process millions of research papers that would take humans years to review, identifying promising innovations that might otherwise go unnoticed. The technology excels at pattern recognition, helping connect related research across different fields that could combine to create effective climate solutions. For instance, AI can spot connections between energy storage research and building materials that humans might miss. This efficiency and comprehensive analysis capability helps accelerate the development of climate solutions while reducing the risk of overlooking valuable research.
How can AI help businesses find innovative solutions for sustainability?
AI helps businesses discover sustainable solutions by analyzing vast amounts of scientific research and identifying practical applications. It can scan through thousands of papers to find relevant technologies, evaluate their commercial viability, and assess implementation feasibility. For businesses, this means faster access to cutting-edge sustainable technologies and reduced research costs. For example, a manufacturing company could use AI to identify new energy-efficient materials or processes from academic research, potentially leading to both cost savings and reduced environmental impact. This approach makes sustainability innovation more accessible and practical for businesses of all sizes.
.png)
PromptLayer Features
- Testing & Evaluation
- The paper explores different prompting strategies and scoring systems to evaluate research papers, aligning with PromptLayer's testing capabilities
Implementation Details
1. Set up A/B tests comparing different prompt versions, 2. Create scoring templates for 1-10 scale evaluation, 3. Implement batch testing across paper datasets
Key Benefits
• Systematic comparison of prompt effectiveness
• Quantifiable performance metrics
• Reproducible evaluation framework
Potential Improvements
• Integration with multiple LLM providers
• Automated regression testing
• Custom scoring metric development
Business Value
.svg)
Efficiency Gains
Reduces manual evaluation time by 70% through automated testing
.svg)
Cost Savings
Optimizes prompt development costs by identifying most effective versions quickly
.svg)
Quality Improvement
Increases accuracy of technology assessment through standardized evaluation
- Analytics
- Workflow Management
- The paper's multi-step analysis process and RAG implementation plans align with PromptLayer's workflow orchestration capabilities
Implementation Details
1. Create reusable templates for paper analysis, 2. Set up RAG pipelines for context enhancement, 3. Implement version tracking for workflow iterations
Key Benefits
• Streamlined multi-stage processing
• Consistent evaluation methodology
• Traceable workflow evolution
Potential Improvements
• Enhanced RAG integration
• Multi-agent workflow support
• Advanced context management
Business Value
.svg)
Efficiency Gains
Reduces workflow setup time by 50% through templating
.svg)
Cost Savings
Minimizes resource usage through optimized processing pipelines
.svg)
Quality Improvement
Ensures consistent evaluation quality across large datasets