Gandalf LoRA Adapter (GGUF)
LoRA adapter for character roleplay as Gandalf The Grey
Model Details
- Base Model: NousResearch/Hermes-3-Llama-3.2-3B
- Character: Gandalf the Grey
- Format: GGUF LoRA Adapter
- Size: 92.78 MB
- Training: Fine-tuned on Tolkien's works
Usage
With llama.cpp
# Download base model and adapter
huggingface-cli download gameversellc/hermes_3_tests_gv Hermes-3-Llama-3.2-3B_q4_0.gguf
huggingface-cli download gameversellc/hermes_3_adapter_tests_gv gandalf_Hermes-3-Llama-3.2-3B_adapter.gguf
# Run with adapter
./llama-cli \
-m Hermes-3-Llama-3.2-3B_q4_0.gguf \
--lora gandalf_Hermes-3-Llama-3.2-3B_adapter.gguf \
-p "Hello, who are you?" \
-n 200
Expected Output
The model will respond in Gandalf's characteristic voice:
I am Gandalf the Grey, a wizard of the old world. I have wandered
many paths and seen many wonders. What brings you to seek my counsel?
Character Traits
- Wise and ancient wizard
- Speaks in poetic, mystical language
- References Middle-earth lore
- Patient and thoughtful responses
Performance
- Character Consistency: 85-95%
- Factual Accuracy: 80-90% (from source material)
- Response Coherence: 90-95%
Compatibility
- โ llama.cpp
- โ llama-cpp-python
- โ Any GGUF-compatible inference engine
License
Apache 2.0
- Downloads last month
- 10
Hardware compatibility
Log In
to view the estimation
We're not able to determine the quantization variants.
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support