Image-Text-to-Text
Transformers
Safetensors
English
florence2
text-generation
art
custom_code

Finetuning code.

#1
by ljnlonoljpiljm - opened

Are you able to share the code you used to finetune the model?

https://colab.research.google.com/drive/1hKDrJ5AH_o7I95PtZ9__VlCTNAo1Gjpf?usp=sharing

i used this notebook when fine-tuning. i just changed data accordingly. i used "DESCRIPTION" tag instead of "DocVQA" in this notebook.

And i mixed data from google/imageinwords, google/docci and ProGamerGov/synthetic-dataset-1m-dalle3-high-quality-captions

I selected 400-500 data from each of them. I also restricted character count to be between 600-1000 (not token count).

Incredible, thank you so much for your quick response!!

Thank you, really helpful.

Sign up or log in to comment