The biggest model ever to have been released. Has not been tested, nor do I have the compute to test it. If anyone is willing to host this to help me test, please share your results in the community tab.

Thank you for coming to my ted talk.

This is nearly 960GB of weights. It requires at least 8xA100 80gb to run it in 4 bits probably. probably

Downloads last month: 976

Safetensors

Model size

464B params

Tensor type

BF16

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for NobodyExistsOnTheInternet/Llama-2-70b-x8-MoE-clown-truck

Finetunes

2 models