Spaces:

Steven10429
/

apply_lora_and_quantize

Running

App Files Files Community

apply_lora_and_quantize / llama.cpp /examples /parallel /README.md

Steven10429's picture

llama.cpp

61b850a about 1 month ago

|

93 Bytes

llama.cpp/example/parallel

Simplified simulation of serving incoming requests in parallel