kaiyuyue's picture
update
96a3757 verified
metadata
base_model:
  - meta-llama/Llama-3.2-3B-Instruct
  - meta-llama/Llama-3.1-8B-Instruct
  - meta-llama/Llama-3.1-70B-Instruct
  - openai/clip-vit-large-patch14
library_name: transformers
license: cc
pipeline_tag: image-text-to-text
tags:
  - pytorch
  - llama-3
  - zero-shot-vision-encoder-grafting

Zero-Shot Vision Encoder Grafting via LLM Surrogates

This repository contains vision encoders and surrogate models, which are described in Zero-Shot Vision Encoder Grafting via LLM Surrogates.