Hugging Face's logo

cortecs
/
EuroLLM-9B-Instruct-FP8-Dynamic

Safetensors
llama
compressed-tensors
Model card Files
xet
Community
Eva Jagodic commited on
Commit
847af4a
·
verified ·
1 Parent(s): 48f06f2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -53,7 +53,7 @@ Install **vLLM** and
53
  run the [server](https://docs.vllm.ai/en/latest/serving/openai_compatible_server.html#openai-compatible-server):
54
 
55
  ```
56
- python -m vllm.entrypoints.openai.api_server --model cortecs/EuroLLM-9B-Instruct-FP8-Dynamic
57
  ```
58
  Access the model:
59
  ```
 
53
  run the [server](https://docs.vllm.ai/en/latest/serving/openai_compatible_server.html#openai-compatible-server):
54
 
55
  ```
56
+ python -m vllm.entrypoints.openai.api_server --model cortecs/EuroLLM-9B-Instruct-FP8-Dynamic --gpu-memory-util 0.95
57
  ```
58
  Access the model:
59
  ```