Spaces:

Steven10429
/

apply_lora_and_quantize

Paused

App Files Files Community

apply_lora_and_quantize / llama.cpp /examples /batched.swift /README.md

Steven10429's picture

llama.cpp

61b850a 9 months ago

|

history blame contribute delete

112 Bytes

A newer version of the Gradio SDK is available: 5.49.1

Upgrade

This is a swift clone of examples/batched.

$ make $ ./llama-batched-swift MODEL_PATH [PROMPT] [PARALLEL]