Gandalf LoRA Adapter (GGUF)

LoRA adapter for character roleplay as Gandalf The Grey

Model Details

  • Base Model: NousResearch/Hermes-3-Llama-3.2-3B
  • Character: Gandalf the Grey
  • Format: GGUF LoRA Adapter
  • Size: 92.78 MB
  • Training: Fine-tuned on Tolkien's works

Usage

With llama.cpp

# Download base model and adapter
huggingface-cli download gameversellc/hermes_3_tests_gv Hermes-3-Llama-3.2-3B_q4_0.gguf
huggingface-cli download gameversellc/hermes_3_adapter_tests_gv gandalf_Hermes-3-Llama-3.2-3B_adapter.gguf

# Run with adapter
./llama-cli \
  -m Hermes-3-Llama-3.2-3B_q4_0.gguf \
  --lora gandalf_Hermes-3-Llama-3.2-3B_adapter.gguf \
  -p "Hello, who are you?" \
  -n 200

Expected Output

The model will respond in Gandalf's characteristic voice:

I am Gandalf the Grey, a wizard of the old world. I have wandered 
many paths and seen many wonders. What brings you to seek my counsel?

Character Traits

  • Wise and ancient wizard
  • Speaks in poetic, mystical language
  • References Middle-earth lore
  • Patient and thoughtful responses

Performance

  • Character Consistency: 85-95%
  • Factual Accuracy: 80-90% (from source material)
  • Response Coherence: 90-95%

Compatibility

  • โœ… llama.cpp
  • โœ… llama-cpp-python
  • โœ… Any GGUF-compatible inference engine

License

Apache 2.0

Downloads last month
10
GGUF
Model size
24.3M params
Architecture
llama
Hardware compatibility
Log In to view the estimation

We're not able to determine the quantization variants.

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support