MN-12B-Mag-Mell-R1

Maintained By
inflatebot

MN-12B-Mag-Mell-R1

PropertyValue
Parameter Count12.2B
Model TypeText Generation
ArchitectureMistral-based Merged Model
Tensor TypeBF16
Merge MethodDARE-TIES
PapersDARE Paper, TIES Paper

What is MN-12B-Mag-Mell-R1?

MN-12B-Mag-Mell-R1 is an advanced language model created through a sophisticated multi-stage SLERP merge process, combining seven different models into three specialized intermediate components (Hero, Monk, and Deity) before final integration. The model is specifically designed for creative writing and worldbuilding, drawing inspiration from legendary merges like Tiefighter and Umbral Mind.

Implementation Details

The model utilizes a complex merge architecture combining DARE and TIES methodologies, with ChatML formatting as the recommended approach. It's optimized for use with Temperature 1.25 and MinP 0.2 settings, though these can be adjusted based on specific needs.

  • Hero component: Focuses on RP and trope coverage using Chronos Gold and Sunrose
  • Monk component: Enhances intelligence and groundedness through Bophades and Wissenschaft
  • Deity component: Improves prose and stylistic flair via Gutenberg v4 and Magnum 2.5 KTO

Core Capabilities

  • Advanced worldbuilding capabilities comparable to classic adventuring models
  • High-quality prose generation with minimal artifacts
  • Creative metaphor generation
  • Balanced handling of both creative and grounded content

Frequently Asked Questions

Q: What makes this model unique?

The model's unique three-component architecture combines specialized abilities for roleplay, intelligence, and prose quality, making it particularly effective for creative writing and worldbuilding scenarios.

Q: What are the recommended use cases?

The model excels in fictional and creative use cases, particularly in scenarios requiring complex worldbuilding, character development, and sophisticated prose generation. It's ideal for creative writing, storytelling, and role-playing applications.

🍰 Interesting in building your own agents?
PromptLayer provides Huggingface integration tools to manage and monitor prompts with your whole team. Get started here.