Unlocking Animal Health: AI Decodes Vet Records
Fine-tuning foundational models to code diagnoses from veterinary health records
By
Mayla R. Boguslav|Adam Kiehl|David Kott|G. Joseph Strecker|Tracy Webb|Nadia Saklou|Terri Ward|Michael Kirby

https://arxiv.org/abs/2410.15186v1
Summary
Imagine a world where AI can instantly diagnose illnesses from complex veterinary records, streamlining diagnoses and potentially saving lives. That's the promise of groundbreaking new research from Colorado State University (CSU). Traditionally, translating messy, free-text veterinary notes into standardized medical codes (SNOMED-CT) has been a laborious, manual task. This bottleneck hinders crucial research and the integration of animal health data into broader "One Health" initiatives, which recognize the interconnectedness of human, animal, and environmental health. The CSU team tackled this challenge by leveraging the power of large language models (LLMs), the same technology behind AI chatbots. They fine-tuned several freely available LLMs, including GatorTron (trained on a vast dataset of human medical records) and VetBERT (trained on veterinary records), to decode free-text veterinary notes into the 7,739 SNOMED-CT codes used by the CSU Veterinary Teaching Hospital. Remarkably, fine-tuning these models on a dataset of over 246,000 veterinary visits achieved impressive results, with GatorTron leading the pack with a 75% accuracy rate. What’s even more exciting? The study showed that even smaller, less computationally demanding models achieved comparable results, opening doors for wider implementation, even in resource-constrained settings. While the fully automated coding of medical records still requires human oversight, this research paves the way for significant improvements in veterinary care and research. Imagine AI assisting veterinary staff by suggesting diagnoses in real-time, freeing up valuable time and resources. This AI-powered approach could also empower clinicians by providing them with instant coding suggestions as they write notes, streamlining documentation. Looking ahead, the researchers are focused on building trust and transparency in these AI systems. Future studies will explore methods to explain how these models arrive at their diagnoses, ensuring greater confidence in their predictions. They'll also evaluate the models' generalizability across different veterinary practices and incorporate richer data sources, like histopathology reports, to paint a more complete picture of animal health. The ultimate goal? A future where AI helps us unlock a deeper understanding of animal health, leading to improved outcomes for our furry companions and contributing to a healthier planet.
🍰 Interesting in building your own agents?
PromptLayer provides the tools to manage and monitor prompts with your whole team.
Get started for free.Question & Answers
How did the CSU team fine-tune large language models to decode veterinary records into SNOMED-CT codes?
The team utilized pre-trained LLMs like GatorTron and VetBERT, fine-tuning them on a massive dataset of 246,000 veterinary visits. The technical process involved: 1) Pre-processing veterinary free-text notes to standardize format and terminology, 2) Training the models to recognize patterns between clinical narratives and corresponding SNOMED-CT codes from a set of 7,739 possible codes, and 3) Optimizing model performance through iterative training. For example, when a vet writes 'cat presenting with difficulty breathing,' the model can automatically suggest relevant respiratory disease codes, achieving up to 75% accuracy with GatorTron.
What are the main benefits of using AI in veterinary care?
AI in veterinary care offers several transformative benefits. It streamlines diagnosis processes by automatically analyzing clinical notes and suggesting potential conditions, saving valuable time for veterinary staff. The technology helps standardize medical record-keeping, making it easier to track patient histories and identify patterns across cases. For pet owners, this means potentially faster, more accurate diagnoses and better treatment outcomes. In practice, AI can assist vets during consultations by providing real-time suggestions based on symptoms, allowing them to focus more on patient care rather than administrative tasks.
How is AI changing the future of animal healthcare?
AI is revolutionizing animal healthcare by introducing smart diagnostic tools and automated data processing systems. These innovations help veterinarians make faster, more informed decisions about pet care while reducing administrative burden. The technology enables better tracking of disease patterns across different animal populations, contributing to more effective preventive care strategies. For instance, AI can analyze thousands of medical records to identify emerging health trends or predict potential outbreaks, leading to more proactive veterinary care. This digital transformation is making quality veterinary care more accessible and efficient.
.png)
PromptLayer Features
- Testing & Evaluation
- The paper's model evaluation across different LLMs and accuracy measurements aligns with PromptLayer's testing capabilities
Implementation Details
1. Set up A/B testing between different LLM models 2. Create evaluation metrics for SNOMED-CT code accuracy 3. Implement batch testing across veterinary record samples
Key Benefits
• Systematic comparison of model performance
• Automated accuracy tracking across versions
• Reproducible testing framework
Potential Improvements
• Add specialized medical coding metrics
• Implement domain-specific evaluation criteria
• Integrate expert validation workflows
Business Value
.svg)
Efficiency Gains
Reduces manual testing time by 70% through automated evaluation pipelines
.svg)
Cost Savings
Decreases validation costs by identifying optimal models earlier in development
.svg)
Quality Improvement
Ensures consistent accuracy benchmarking across model iterations
- Analytics
- Analytics Integration
- The need to monitor model performance and explain AI decisions aligns with PromptLayer's analytics capabilities
Implementation Details
1. Configure performance monitoring dashboards 2. Set up error analysis tracking 3. Implement explanation logging for model decisions
Key Benefits
• Real-time performance visibility
• Detailed error analysis
• Model behavior transparency
Potential Improvements
• Add specialized medical metrics tracking
• Implement confidence score visualization
• Create custom diagnostic reports
Business Value
.svg)
Efficiency Gains
Reduces troubleshooting time by 50% through centralized analytics
.svg)
Cost Savings
Optimizes resource allocation through usage pattern analysis
.svg)
Quality Improvement
Enables data-driven model refinement through detailed performance insights