lawyer-llama-13b-v2-Q4_K_M-GGUF
| Property | Value |
|---|---|
| Parameter Count | 13.3B |
| License | LLaMA 2 |
| Language | Chinese |
| Format | GGUF |
What is lawyer-llama-13b-v2-Q4_K_M-GGUF?
This is a specialized conversion of the lawyer-llama-13b-v2 model to the GGUF format, optimized for legal domain applications in Chinese. The model represents a significant advancement in making large language models more accessible for legal applications, featuring efficient quantization for improved performance while maintaining capability.
Implementation Details
The model utilizes the Q4_K_M quantization scheme in GGUF format, allowing for efficient deployment on both CPU and GPU systems through llama.cpp. It's based on the pkupie/lawyer-llama-13b-v2 architecture and has been specifically optimized for legal domain tasks.
- GGUF format optimization for efficient inference
- 13.3B parameter architecture
- Specialized Chinese legal domain focus
- Compatible with llama.cpp deployment
Core Capabilities
- Legal domain expertise in Chinese language
- Efficient CPU/GPU inference through llama.cpp
- Support for context window up to 2048 tokens
- Optimized memory usage through Q4_K_M quantization
Frequently Asked Questions
Q: What makes this model unique?
This model combines the power of the LLaMA 2 architecture with specialized legal domain knowledge in Chinese, while being optimized for efficient deployment through GGUF format and Q4_K_M quantization.
Q: What are the recommended use cases?
The model is particularly suited for Chinese legal document analysis, legal research assistance, and general legal domain tasks where efficient local deployment is required. It's optimized for both CPU and GPU inference through llama.cpp.
