ggml-org
/

gpt-oss-120b-GGUF

Model card Files Files and versions

ggerganov commited on Aug 22

Commit

0764c15

·

verified ·

1 Parent(s): 583c738

readme : update

Files changed (1) hide show

README.md +7 -3

README.md CHANGED Viewed

@@ -2,12 +2,16 @@
 base_model:
 - openai/gpt-oss-120b
 ---
-# GPT OSS 120B GGUF
-Recommended way to run this model:
 ```sh
-llama-server -hf ggml-org/gpt-oss-120b-GGUF -c 0 -fa --jinja --reasoning-format none
 # Then, access http://localhost:8080
 ```

 base_model:
 - openai/gpt-oss-120b
 ---
+# gpt-oss-120b
+Detailed guide for using this model with `llama.cpp`:
+https://github.com/ggml-org/llama.cpp/discussions/15396
+Quick start:
 ```sh
+llama-server -hf ggml-org/gpt-oss-120b-GGUF -c 0 -fa --jinja
 # Then, access http://localhost:8080
 ```