Whisper openai vs hugging face question

#185
by Sin2pi - opened

https://github.com/openai/whisper/blob/main/whisper/model.py
https://github.com/huggingface/transformers/blob/main/src/transformers/models/whisper/modeling_whisper.py

The Hugging Face implementation, while undoubtedly valuable for accessibility and integration, diverges so significantly from the original OpenAI Whisper model that it raises the question if it should even be labeled as 'Whisper'?"

These are two entirely different architectural philosophies, differing even at the level of foundational components. I know that it is a common practice in the field and certainly within the scope of the open source community that models are adapted to fit the needs of a particular library or framework, but this is a bit of a stretch even for that isn't it?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment