pankajroark
/

llama-fp16-engine

Model card Files Files and versions Community

llama-fp16-engine / 7b-sq-int8kv-tp1 /model.cache

pankajroark's picture

inflight batching engine for 7b-sq-int8kv-tp1

2319002 over 1 year ago

history contribute delete

96.1 kB

This file contains binary data. It cannot be displayed, but you can still download it.