mistralai/Mixtral-8x7B-Instruct-v0.1

#248 opened 3 months ago by

Fleicht

Issues Connecting to Model mistralai/Mixtral-8x7B-Instruct-v0.1 via WebSocket since October 14th

#245 opened 4 months ago by

Leri777

Checksum file

#244 opened 4 months ago by

acamu

batch inference scales linearly with batch size when input is long

#243 opened 5 months ago by

platypus1989

Mixtral only returns unk

#242 opened 6 months ago by

Thiloid

Trainer RuntimeError: The size of tensor a (32) must match the size of tensor b (8) at non-singleton dimension 0

#241 opened 6 months ago by

Salahedd

./manage.py docker MY_MODEL

#240 opened 6 months ago by

Tightleft

Delete generation_config.json

#239 opened 6 months ago by

Tightleft

120GB of VRAM enough to run this model?

8

#237 opened 7 months ago by

AIGUYCONTENT

Errors loading the Mixtral-8x7B-Instruct-v0.1 model

#236 opened 7 months ago by

fdzr

Request: DOI

#235 opened 7 months ago by

DantChokma

text-generation-inference: chaotic/unuseable answers.

#234 opened 7 months ago by

mortalcat

Download the model.

#233 opened 7 months ago by

Dharma0818

No longer able to access

#232 opened 7 months ago by

jujutech

Afzal Hosen

#231 opened 7 months ago by

advafzal

The Fine tume 8*7b model gets stuck.

#230 opened 8 months ago by

Saicy

Error while loading Mixtral-8x7B-Instruct-v0.1 tokenizer with AutoTokenizer.from_pretrained

#229 opened 8 months ago by

Amaia-C

Update to all readmes to be up to date

#228 opened 8 months ago by

pandora-s

Download the model

#227 opened 8 months ago by

rishabh27

Max Response Length

#219 opened 8 months ago by

LARRY-YIN

How much RAM is needed in AWS Dedicated Inference Endpoint Deployment?

5

#217 opened 8 months ago by

ramda1234786

A complex prompt resulted in an empty output.

4

#216 opened 8 months ago by

gostop

Python script running from VSCODE over WSL distro in Windows not finding this model

#215 opened 9 months ago by

hrighugging

Fine-tuning Mixtral with different types of datasets

#214 opened 9 months ago by

ziko11

Model Overloaded

#213 opened 9 months ago by

ramda1234786

ddddd

#212 opened 9 months ago by

bodaaaa

I want to make the chatbot using Mixtral-8x7B-Instruct-v0.1 model, but the inference speed is very slow, so I cannot use it as a chatbot. How can I fix this issue?

#211 opened 9 months ago by

rising620

create

#210 opened 9 months ago by

nour0234

Getting OS error.

#209 opened 9 months ago by

iffy

Addressing Incomplete Answers Generated from Large Contexts

#206 opened 10 months ago by

pooja03

Model gating?

#204 opened 10 months ago by

gawotik

Upload 2 files

#203 opened 10 months ago by

chakkakrishna

RAG, prompt and memory with Mixtral

8

#201 opened 10 months ago by

edoyen

Any Update on mistralai/Mixtral-8x7B-Instruct-v0.2 ?

#200 opened 10 months ago by

bayraktaroglu

Input validation error: `inputs` tokens + `max_new_tokens` must be <= 2048. on Mixtral8x7b 32K token

#199 opened 10 months ago by

sunnykusawa

Warning message for right side padding even after setting padding_side="left"

#198 opened 10 months ago by

mbismay

Input token size issue, does it realy supports 32k tokens?

#197 opened 10 months ago by

sunnykusawa

infinite carriage returns

#195 opened 10 months ago by

lowfreak

What is the stop token for this model please

#194 opened 10 months ago by

NigelTheMaker

[AUTOMATED] Model Memory Requirements

#193 opened 11 months ago by

model-sizer-bot

Problem while running on multiple GPUs

#192 opened 11 months ago by

venkilfc

Discrepancy between kv_proj in .safetensors and .pt?

#191 opened 11 months ago by

kolinko

Missing Output problem

4

#190 opened 11 months ago by

chaydaroglu

Instruct-finetuning dataset

#189 opened 11 months ago by

Andriy

when I run it in multi-gpus by accelerate, it has an AttributeError

#188 opened 11 months ago by

waleyWang

What is the actual context size of mistralai/Mixtral-8x7B-Instruct-v0.1 model