Uploaded model
- Developed by: cstr
- License: apache-2.0
- Finetuned from model : cstr/phi-3-orpo-v8_16
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
- Downloads last month
- -
Model tree for cstr/phi-3-orpo-v9_4
Base model
vonjack/Phi-3-mini-4k-instruct-LLaMAfied
Finetuned
cstr/phi-3-orpo-v8_16