meta-llama/Llama-3.1-8B-Instruct

#62 opened 11 months ago by

Keertiraj

Meta-Llama-3.1-8B-Instruct deployment on AWS Sagemaker fails

#61 opened 11 months ago by

Keertiraj

Error Loading the original model file consolidated.00.pth from local

#60 opened 11 months ago by

chanduvkp

vdl

#59 opened 11 months ago by

danakin1

Unable to deploy Meta-Llama-3.1-8B-Instruct model on Sagemaker

#58 opened 11 months ago by

axs531622

CUDA out of memory on RTX A5000 inference.

#57 opened 11 months ago by

RoberyanL

Update README.md to reflect correct transformers version

#56 opened 11 months ago by

priyakhandelwal

Update README.md to reflect correct transformers version

#55 opened 11 months ago by

priyakhandelwal

NotImplementedError: Could not run 'aten::_local_scalar_dense' with arguments from the 'Meta' backend.

➕ 2

#54 opened 11 months ago by

duccio84

Some of you might be interested in my 'silly' experiment.

🧠 1

#52 opened 11 months ago by

ZeroWw

Updated config.json

#51 opened 11 months ago by

WestM

🚀 LMDeploy support Llama3.1 and its Tool Calling. An example of calling "Wolfram Alpha" to perform complex mathematical calculations can be found from here!

#50 opened 11 months ago by

vansin

HF pro subscription for llama 3.1-8b

#49 opened 11 months ago by

ostoslista

Significant bias

👍 👀 3

#48 opened 11 months ago by

stutteringp0et

`rope_scaling` must be a dictionary with two fields

🤝 ➕ 8

#46 opened 11 months ago by

thunderdagger

Unable to load Llama 3.1 to Text-Genration WebUI

#45 opened 11 months ago by

keeeeesz

BUG Chat template doesn't respect `add_generation_prompt`flag from transformers tokenizer

👍 3

#44 opened 11 months ago by

ilu000

How to use the ASR on LLama3.1

👀 🔥 1

#43 opened 11 months ago by

andrygasy

Tokenizer 'apply_chat_template' issue

#42 opened 11 months ago by

Ksgk-fy

Function Calling Evaluation bench Nexus (0-shot)

#41 opened 11 months ago by

WateBear

Error: json: cannot unmarshal array into Go struct field Params.eos_token_id of type int

❤️ 1

#40 opened 11 months ago by

SadeghPouriyanZadeh

ValueError: Pipeline with tokenizer without pad_token cannot do batching. You can try to set it with `pipe.tokenizer.pad_token_id = model.config.eos_token_id`.

👀 👍 2

#39 opened 11 months ago by

jsemrau

Run this on CPU and use tool calling

#38 opened 11 months ago by

J22

!!Access Problem

➕ 15

13

#37 opened 11 months ago by

minglingfeng

LLama-3.1-8B generates way to long answers!

👍 1

#36 opened 11 months ago by

ayyylemao

Tokenizer error and/or 'rope_scaling' problem

5

#35 opened 11 months ago by

fazayjo

Deployment to Inference Endpoints

➕ 🔥 3

#34 opened 11 months ago by

stcat

Best practice for tool calling with meta-llama/Meta-Llama-3.1-8B-Instruct

#33 opened 11 months ago by

zzclynn

The model often enters infinite generation loops

👍 5

13

#32 opened 11 months ago by

sszymczyk

unable to load 4-bit quantized varient with llama.cpp

#31 opened 11 months ago by

sunnykusawa

Garbage output ?

10

#30 opened 11 months ago by

danielus

Question about chat template and fine-tuning

👍 9

#23 opened 11 months ago by

tblattner

Issues loading model with ooabooga textgenwebui

👍 3

5

#20 opened 11 months ago by

Kenji776

what is the right tokenizer should I use for llama 3.1 8B?

#19 opened 11 months ago by

calebl

The sample code on the model card page is not right

#18 opened 11 months ago by

kmtao

My alternative quantizations.

7

#16 opened 11 months ago by

ZeroWw

ValueError: `rope_scaling` must be a dictionary with two fields

➕ 🔥 105

52

#15 opened 11 months ago by

jsemrau

Independently Benchmarked Humaneval and Evalplus scores

#13 opened 11 months ago by

VaibhavSahai

DO NOT MERGE v2 make sure vllm and transformers work

#12 opened 11 months ago by

ArthurZ

DO NOT MERGE test for vllm

#11 opened 11 months ago by

ArthurZ

Please do not include original PTH files.

❤️ 👍 5

#10 opened 11 months ago by

Qubitium

Utterly based

🚀 😎 8