what is the difference FP8 vs FP16 for text encoder ?
#2
by
sss251
- opened
What does it change to use FP8 or FP16 text encoder ? Is there an ability difference ?
Using an FP8 text encoder reduces memory usage and increases speed, but with lower precision. FP16 offers better accuracy and is generally more reliable for capturing subtle language patterns.