Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
microsoft
/
Phi-4-multimodal-instruct
like
1.43k
Follow
Microsoft
13.1k
Automatic Speech Recognition
Transformers
Safetensors
24 languages
phi4mm
text-generation
nlp
code
audio
speech-summarization
speech-translation
visual-question-answering
phi-4-multimodal
phi
phi-4-mini
custom_code
arxiv:
2503.01743
arxiv:
2407.13833
License:
mit
Model card
Files
Files and versions
Community
78
Train
Use this model
refs/pr/42
Phi-4-multimodal-instruct
Ctrl+K
Ctrl+K
13 contributors
History:
26 commits
freewym
fixes the asserion error when num_beams > 1
2258faa
verified
3 months ago
examples
Add examples
4 months ago
figures
Added model files
4 months ago
speech-lora
Added model files
4 months ago
vision-lora
Added model files
4 months ago
.gitattributes
1.61 kB
added technical report
4 months ago
CODE_OF_CONDUCT.md
444 Bytes
Added model files
4 months ago
LICENSE
1.14 kB
Added model files
4 months ago
README.md
64.3 kB
Update readme
3 months ago
SECURITY.md
2.66 kB
Added model files
4 months ago
SUPPORT.md
1.24 kB
Added model files
4 months ago
added_tokens.json
249 Bytes
Added model files
4 months ago
config.json
4.63 kB
Added model files
4 months ago
configuration_phi4mm.py
11 kB
Added model files
4 months ago
generation_config.json
190 Bytes
Added model files
4 months ago
merges.txt
2.42 MB
Added model files
4 months ago
model-00001-of-00003.safetensors
5 GB
LFS
Added model files
4 months ago
model-00002-of-00003.safetensors
4.95 GB
LFS
Added model files
4 months ago
model-00003-of-00003.safetensors
1.2 GB
LFS
Added model files
4 months ago
model.safetensors.index.json
240 kB
Added model files
4 months ago
modeling_phi4mm.py
116 kB
fixes the asserion error when num_beams > 1
3 months ago
phi_4_mm.tech_report.02252025.pdf
5.3 MB
LFS
added technical report
4 months ago
preprocessor_config.json
482 Bytes
Added model files
4 months ago
processing_phi4mm.py
32.8 kB
Added model files
4 months ago
processor_config.json
121 Bytes
Added model files
4 months ago
sample_finetune_speech.py
16.7 kB
Fix bug with safe suffix removal (#34)
4 months ago
sample_finetune_vision.py
19.6 kB
Added model files
4 months ago
sample_inference_phi4mm.py
10.5 kB
Added model files
4 months ago
special_tokens_map.json
473 Bytes
Added model files
4 months ago
speech_conformer_encoder.py
111 kB
Added model files
4 months ago
tokenizer.json
15.5 MB
LFS
Added model files
4 months ago
tokenizer_config.json
3.25 kB
Added model files
4 months ago
vision_siglip_navit.py
78.2 kB
Added model files
4 months ago
vocab.json
3.91 MB
Added model files
4 months ago
