Published
Nov 26, 2024
Updated
Nov 26, 2024

Can AI Help Universities Achieve Global Goals?

Agentic AI for Improving Precision in Identifying Contributions to Sustainable Development Goals
By
William A. Ingram|Bipasha Banerjee|Edward A. Fox

Summary

Universities worldwide are increasingly focused on contributing to the United Nations’ Sustainable Development Goals (SDGs). But accurately measuring their impact is tricky. Traditional methods, relying on keyword searches, often misrepresent a university's true contribution. Think of it like searching for “climate change” and finding articles that mention the term but don’t actually advance climate solutions. This is where AI comes in. New research explores using “agentic AI” – essentially, AI agents acting as evaluators – to assess how research aligns with SDG targets. These AI agents, powered by locally hosted Large Language Models (LLMs), delve deeper than keywords. They analyze the context of research abstracts, differentiating between genuine contributions and mere mentions of SDG-related terms. The initial findings are promising, showing that LLMs can distinguish between impactful research and superficial connections. However, different LLMs have different “opinions” on what qualifies as relevant, highlighting the need for further refinement. Some are more inclusive, while others are incredibly selective. This raises an interesting question: could a team of these AI agents, working together like a panel of experts, provide the most accurate assessment? This research opens exciting possibilities. Imagine a future where AI helps universities not just track their progress toward global goals but also identify new opportunities to make a real difference. This approach could revolutionize how institutions measure their social impact and contribute to solving some of the world's most pressing challenges. While the research primarily focused on SDG 1 (ending poverty), future studies will explore its applicability across all 17 SDGs, potentially unlocking a powerful tool for positive change on a global scale.
🍰 Interesting in building your own agents?
PromptLayer provides the tools to manage and monitor prompts with your whole team. Get started for free.

Question & Answers

How do AI agents powered by LLMs analyze research abstracts differently from traditional keyword-based searches?
AI agents using LLMs perform contextual analysis rather than simple keyword matching. These agents analyze the semantic meaning and context of research abstracts, evaluating whether the content genuinely contributes to SDG targets. For example, while a keyword search might flag any paper mentioning 'poverty,' an LLM-powered agent can distinguish between a paper that merely references poverty and one that presents concrete solutions or insights for poverty reduction. The process involves: 1) Understanding the full context of the abstract, 2) Evaluating the research's actual contribution to SDG targets, and 3) Determining the depth and relevance of the contribution. This enables more accurate assessment of universities' impact on global sustainability goals.
What are the main benefits of using AI to track sustainability goals in organizations?
AI-powered sustainability tracking offers several key advantages for organizations. It provides more accurate and comprehensive assessment of sustainability initiatives compared to traditional methods. Organizations can benefit from automated real-time monitoring, reduced human bias in reporting, and the ability to identify previously overlooked opportunities for improvement. For example, a university could use AI to automatically evaluate thousands of research papers and projects, quickly identifying which ones truly contribute to sustainability goals. This saves time, improves accuracy, and helps organizations make more informed decisions about their sustainability strategies.
How can artificial intelligence help achieve global sustainability goals?
Artificial intelligence serves as a powerful tool for advancing global sustainability goals by providing more accurate measurement and assessment capabilities. AI can analyze vast amounts of data to identify patterns, evaluate impact, and suggest improvements in sustainability initiatives. It helps organizations move beyond surface-level metrics to understand their true contribution to global goals. For instance, AI can evaluate research projects, corporate initiatives, and policy outcomes to determine their real impact on sustainability targets. This enables better decision-making, more efficient resource allocation, and more effective strategies for achieving sustainable development objectives.

PromptLayer Features

  1. Testing & Evaluation
  2. The paper's focus on comparing different LLM evaluations of SDG alignment directly relates to prompt testing and evaluation capabilities
Implementation Details
Set up A/B testing between different LLM models evaluating the same research abstracts, track performance metrics, and establish ground truth datasets for validation
Key Benefits
• Systematic comparison of different LLM evaluation approaches • Reproducible assessment criteria across multiple models • Quantifiable performance metrics for SDG alignment scoring
Potential Improvements
• Integration with external validation datasets • Automated regression testing for model consistency • Enhanced scoring mechanisms for SDG relevance
Business Value
Efficiency Gains
Reduces manual review time by 70-80% compared to human-only evaluation
Cost Savings
Decreases resource allocation for impact assessment by automating initial screening
Quality Improvement
More consistent and objective evaluation criteria across all research submissions
  1. Workflow Management
  2. Multi-agent LLM evaluation system requires orchestrated workflows to manage different models and aggregate their assessments
Implementation Details
Create templated workflows for processing research abstracts through multiple LLMs, aggregating results, and generating consensus scores
Key Benefits
• Standardized evaluation process across different SDGs • Versioned evaluation criteria and scoring methods • Scalable processing of large research databases
Potential Improvements
• Dynamic workflow adjustment based on SDG context • Enhanced result aggregation methods • Automated report generation features
Business Value
Efficiency Gains
Streamlines multi-model evaluation process reducing processing time by 60%
Cost Savings
Reduces coordination overhead for large-scale research assessment
Quality Improvement
More comprehensive evaluation through systematic multi-model assessment

The first platform built for prompt engineering