Published
Jul 24, 2024
Updated
Aug 20, 2024

Can AI Build Ontologies? Exploring the Potential of GPTs

My Ontologist: Evaluating BFO-Based AI for Definition Support
By
Carter Benson|Alec Sculley|Austin Liebers|John Beverley

Summary

Imagine a world where building complex ontologies, those intricate maps of knowledge, is as simple as conversing with an AI. That's the tantalizing promise of using large language models (LLMs) like GPT-4 for ontology engineering. Researchers explored this very idea, testing whether an AI could grasp the nuances of the Basic Formal Ontology (BFO), a standard used in hundreds of projects worldwide. The goal was to create "My Ontologist," an AI assistant capable of building BFO-compliant ontologies. The journey was full of twists and turns. Early versions of My Ontologist struggled, getting lost in theoretical explanations instead of producing concrete definitions. Progress came with My Ontologist 3.0, which showed a marked improvement in following BFO's rules. But then came a new hurdle: the release of GPT-4. This more powerful model initially threw My Ontologist off balance, causing it to abandon its training and randomly search the web for answers. Though this was eventually fixed, new quirks arose, like the AI's tendency to invent its own terms and rules. Despite these setbacks, the research reveals a glimmer of hope. LLMs, when properly guided, have the potential to become powerful tools for ontology creation. The road ahead involves refining their training and keeping them grounded in the principles of established ontological standards. The dream of an AI-powered ontology builder isn't yet reality, but the possibility is closer than ever.
🍰 Interesting in building your own agents?
PromptLayer provides the tools to manage and monitor prompts with your whole team. Get started for free.

Question & Answers

What technical challenges did researchers face when developing My Ontologist with GPT-4?
The development of My Ontologist faced several technical hurdles during integration with GPT-4. Initially, the system struggled with maintaining consistency in BFO compliance, often deviating from established rules. The key challenges included: 1) The AI's tendency to abandon its training and randomly search the web, 2) Creation of non-standard terms and rules outside BFO framework, and 3) Initial difficulty in producing concrete definitions rather than theoretical explanations. For example, in a practical scenario where My Ontologist needed to classify medical conditions within the BFO framework, it might incorrectly invent new classification categories instead of using established BFO terms.
How can AI-powered ontology building benefit businesses?
AI-powered ontology building can significantly streamline knowledge management in businesses. It helps organizations create structured representations of their domain knowledge more efficiently and consistently. Key benefits include faster knowledge base creation, reduced manual effort in organizing information, and improved data interoperability across systems. For instance, a retail company could use AI ontology tools to automatically organize product catalogs, customer relationships, and market segments, making it easier to analyze data and make informed decisions. This technology can save significant time and resources compared to traditional manual ontology development.
What are the real-world applications of automated ontology creation?
Automated ontology creation has numerous practical applications across various industries. In healthcare, it can help organize medical knowledge and improve patient care by creating structured relationships between symptoms, diseases, and treatments. In e-commerce, it can enhance product categorization and search functionality. Educational institutions can use it to organize course materials and create learning pathways. The technology also benefits research institutions by helping them organize and connect complex scientific concepts. These applications demonstrate how automated ontology creation can transform raw information into structured, usable knowledge that drives better decision-making and efficiency.

PromptLayer Features

  1. Version Control
  2. Tracks evolution of My Ontologist prompts across versions 1.0 to 3.0 and adaptation to new GPT models
Implementation Details
Set up version-controlled prompt templates for ontology generation rules, maintain separate branches for different GPT model implementations, implement rollback capabilities for unstable versions
Key Benefits
• Historical tracking of prompt evolution • Easy comparison between versions • Quick recovery from problematic updates
Potential Improvements
• Automated version compatibility checking • Integration with ontology validation tools • Cross-version performance metrics
Business Value
Efficiency Gains
50% reduction in time spent managing prompt versions
Cost Savings
Reduced need for manual verification through automated version tracking
Quality Improvement
Better consistency in ontology generation across model updates
  1. Testing & Evaluation
  2. Validates ontology compliance with BFO standards and monitors AI assistant's adherence to rules
Implementation Details
Create test suites for BFO compliance, implement regression testing for new model versions, develop scoring metrics for ontology quality
Key Benefits
• Automated compliance verification • Early detection of rule violations • Quantitative performance tracking
Potential Improvements
• Real-time compliance checking • Enhanced error detection • Customizable validation rules
Business Value
Efficiency Gains
75% faster validation of generated ontologies
Cost Savings
Reduced expert review time through automated testing
Quality Improvement
Higher consistency in ontology output quality

The first platform built for prompt engineering