Hugging Face's logo

Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
Back to feed
not-lain 
posted an update Jan 30, 2025
ptrrrr

Very Interesting. What is the implication of cache memory in this method?

·
not-lain

the short version would be faster and consistent inference in the cost of more gpu consumption
yashman94

The link to Blog containing refresher on pre-requisites seems to be invalid.

·
not-lain

seems to be working on my side, you either can read the full blogpost at https://huggingface.co/blog/not-lain/tensor-dims
or you can click on this dropdown menu which will add more text to the current blogpost

image.png

In this post