Model Export to ONNX format

#32

by Desjajja - opened Aug 21, 2023

Aug 21, 2023

Is there any pipeline to export this model to ONNX (using torch.onnx/optimum, etc)? I intend to do further acceleration in inference and ONNX file is a must. However, none of the frameworks above support baichuan yet.

wuzhiying2023

Baichuan Intelligent Technology org Aug 22, 2023

I have no idea.Is there any framework supports llama?

Desjajja

Aug 22, 2023

Yes, HF optimum supports llama, but baichuan is not even in their plan LOL

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment