Spaces:
Runtime error
Runtime error
add wizard vicuna 13b, update notes
Browse files
app.py
CHANGED
|
@@ -121,6 +121,7 @@ AVAILABLE_MODELS = {
|
|
| 121 |
"hermes-13b": ("p0zqb2gkcwp0ww", prompt_instruct),
|
| 122 |
"manticore-13b-chat": ("u6tv84bpomhfei", prompt_chat),
|
| 123 |
"airoboros-13b": ("rglzxnk80660ja", prompt_chat),
|
|
|
|
| 124 |
"supercot-13b": ("0be7865dwxpwqk", prompt_instruct, ["Instruction:"]),
|
| 125 |
"mpt-7b-instruct": ("jpqbvnyluj18b0", prompt_instruct),
|
| 126 |
}
|
|
@@ -265,8 +266,8 @@ with gr.Blocks() as arena:
|
|
| 265 |
### brought to you by OpenAccess AI Collective
|
| 266 |
- Checkout out [our writeup on how this was built.](https://medium.com/@winglian/inference-any-llm-with-serverless-in-15-minutes-69eeb548a41d)
|
| 267 |
- This Space runs on CPU only, and uses GGML with GPU support via Runpod Serverless.
|
| 268 |
-
-
|
| 269 |
-
-
|
| 270 |
- For now, this is single turn only
|
| 271 |
- [💵 Consider Donating on our Patreon](http://patreon.com/OpenAccessAICollective)
|
| 272 |
- Join us on [Discord](https://discord.gg/PugNNHAF5r)
|
|
|
|
| 121 |
"hermes-13b": ("p0zqb2gkcwp0ww", prompt_instruct),
|
| 122 |
"manticore-13b-chat": ("u6tv84bpomhfei", prompt_chat),
|
| 123 |
"airoboros-13b": ("rglzxnk80660ja", prompt_chat),
|
| 124 |
+
"wizard-vicuna-13b": ("9vvpikt4ttyqos", prompt_chat),
|
| 125 |
"supercot-13b": ("0be7865dwxpwqk", prompt_instruct, ["Instruction:"]),
|
| 126 |
"mpt-7b-instruct": ("jpqbvnyluj18b0", prompt_instruct),
|
| 127 |
}
|
|
|
|
| 266 |
### brought to you by OpenAccess AI Collective
|
| 267 |
- Checkout out [our writeup on how this was built.](https://medium.com/@winglian/inference-any-llm-with-serverless-in-15-minutes-69eeb548a41d)
|
| 268 |
- This Space runs on CPU only, and uses GGML with GPU support via Runpod Serverless.
|
| 269 |
+
- Responses may not stream immediately due to cold starts on Serverless.
|
| 270 |
+
- Some responses WILL take AT LEAST 20 seconds to respond
|
| 271 |
- For now, this is single turn only
|
| 272 |
- [💵 Consider Donating on our Patreon](http://patreon.com/OpenAccessAICollective)
|
| 273 |
- Join us on [Discord](https://discord.gg/PugNNHAF5r)
|