Cydonia-24B-v2-GGUF
| Property | Value |
|---|---|
| Base Model | Mistral 2501 ('Small') |
| Context Length | Up to 24K tokens |
| Chat Template | Mistral v7 Tekken (recommended) |
| Model Format | GGUF |
What is Cydonia-24B-v2-GGUF?
Cydonia-24B-v2-GGUF is an advanced fine-tuned version of Mistral's latest 'Small' model (2501), optimized for enhanced detail retention and extended context handling. This GGUF implementation offers improved accessibility and deployment options while maintaining the model's core capabilities.
Implementation Details
The model has been extensively tested and optimized for various use cases, demonstrating stable performance across extended context lengths up to 24K tokens. It implements the Mistral v7 Tekken chat template as its primary interaction format, with additional support for Metharme templates (may require patching).
- Optimized for long-context interactions up to 24K tokens
- Enhanced vocabulary and semantic understanding
- Stable performance without requiring repetition penalties
- Improved detail retention in complex scenarios
Core Capabilities
- Extended context processing (up to 24K tokens)
- Enhanced detail and scene retention
- Robust vocabulary handling
- Stable long-form interactions
- Improved anatomical and contextual understanding
Frequently Asked Questions
Q: What makes this model unique?
The model's ability to handle extended context lengths while maintaining coherence and detail retention sets it apart. Its optimization for the Mistral v7 Tekken chat template and enhanced vocabulary processing make it particularly suitable for complex interactions.
Q: What are the recommended use cases?
The model excels in scenarios requiring extended context understanding, detailed scene retention, and complex vocabulary processing. It's particularly well-suited for applications requiring sustained coherence over longer interactions.
