Published
Dec 14, 2024
Updated
Dec 14, 2024

AI Generates ESG Reports: Meet SusGen-GPT

SusGen-GPT: A Data-Centric LLM for Financial NLP and Sustainability Report Generation
By
Qilong Wu|Xiaoneng Xiang|Hejia Huang|Xuan Wang|Yeo Wei Jie|Ranjan Satapathy|Ricardo Shirota Filho|Bharadwaj Veeravalli

Summary

The world of finance is increasingly focused on sustainability. But generating comprehensive ESG (Environmental, Social, and Governance) reports is a complex and time-consuming process. Now, a new AI model called SusGen-GPT aims to automate this, making it easier for companies to disclose their sustainability performance. Researchers at the National University of Singapore developed SusGen-GPT and a new dataset, SusGen-30K, specifically trained on financial and ESG data. This specialized training allows SusGen-GPT to perform multiple financial NLP tasks, including generating TCFD-compliant sustainability reports. Impressively, SusGen-GPT, with only 7-8 billion parameters, achieves near-GPT-4 performance on various financial benchmarks, even outperforming it in some areas like Relation Extraction. The researchers also created TCFD-Bench, a new benchmark designed to assess how well AI models generate accurate and concise ESG reports. While SusGen-GPT shows great promise, the researchers acknowledge limitations, including the model's performance being influenced by resource constraints and potential biases in the data. Future work will focus on expanding the dataset, improving model capabilities, and refining the benchmark for even more robust evaluation. SusGen-GPT offers a potential solution to the growing demand for advanced tools in the financial sector, particularly in the crucial area of climate-related financial disclosures.
🍰 Interesting in building your own agents?
PromptLayer provides the tools to manage and monitor prompts with your whole team. Get started for free.

Question & Answers

What technical architecture enables SusGen-GPT to achieve near-GPT-4 performance with only 7-8 billion parameters?
SusGen-GPT achieves high performance through specialized training on the SusGen-30K dataset, which contains carefully curated financial and ESG data. The model's architecture is optimized specifically for financial NLP tasks, with particular emphasis on TCFD-compliant report generation and relation extraction. This specialization allows it to match or exceed GPT-4's performance in specific domains despite having fewer parameters. In practice, this means the model can effectively process financial documents, extract relevant ESG information, and generate comprehensive sustainability reports while being more computationally efficient than larger models. For example, when analyzing a company's annual report, SusGen-GPT can efficiently identify and extract relevant ESG metrics and generate TCFD-compliant disclosures.
How is AI transforming sustainability reporting in business?
AI is revolutionizing sustainability reporting by automating and streamlining the traditionally manual process of ESG report creation. These AI systems can analyze vast amounts of corporate data, extract relevant environmental and social metrics, and generate comprehensive reports that comply with regulatory standards. The key benefits include significant time savings, increased accuracy, and more consistent reporting across organizations. For instance, what once took teams of analysts weeks to compile can now be generated in hours, allowing companies to focus more on implementing sustainability initiatives rather than just reporting them. This technology is particularly valuable for small and medium-sized businesses that may lack dedicated ESG reporting resources.
What are the main benefits of automated ESG reporting for companies?
Automated ESG reporting offers several key advantages for companies. First, it dramatically reduces the time and resources needed to create comprehensive sustainability reports, cutting down what could take weeks into a matter of hours. Second, it ensures consistency and accuracy in reporting by eliminating human error and maintaining standardized formats across different reporting periods. Third, it enables better compliance with regulatory requirements by automatically adhering to frameworks like TCFD. For businesses, this means lower operational costs, improved transparency for stakeholders, and better ability to track and improve their sustainability performance over time. Small to large companies can benefit from these tools to enhance their sustainability reporting practices.

PromptLayer Features

  1. Testing & Evaluation
  2. The paper's TCFD-Bench framework aligns with PromptLayer's testing capabilities for evaluating model outputs against specific benchmarks
Implementation Details
1. Create test suites matching TCFD-Bench criteria 2. Configure automated evaluation pipelines 3. Set up performance thresholds 4. Implement regression testing
Key Benefits
• Standardized evaluation across ESG report generation • Automated quality assurance for financial compliance • Reproducible benchmark testing
Potential Improvements
• Expand test coverage for different ESG frameworks • Add domain-specific evaluation metrics • Integrate external validation tools
Business Value
Efficiency Gains
Reduces manual review time by 70% through automated testing
Cost Savings
Cuts compliance verification costs by automating report validation
Quality Improvement
Ensures consistent adherence to TCFD reporting standards
  1. Analytics Integration
  2. The model's performance monitoring needs align with PromptLayer's analytics capabilities for tracking generation quality and resource usage
Implementation Details
1. Set up performance monitoring dashboards 2. Configure cost tracking metrics 3. Implement quality scoring systems
Key Benefits
• Real-time performance monitoring • Resource utilization optimization • Quality trend analysis
Potential Improvements
• Add ESG-specific metrics • Implement advanced anomaly detection • Create custom reporting templates
Business Value
Efficiency Gains
Optimizes model deployment through data-driven insights
Cost Savings
Reduces computational costs through resource optimization
Quality Improvement
Enables continuous quality monitoring and improvement

The first platform built for prompt engineering