If we don't store every chunk hash to block hash, how can we download a model file. For example if a model does not have a key chunk, the shard info only contains "file hash -> list of chunks", the CAS only has "block hash -> block content", how can we know which block is needed ?
liming
largegpt
ยท
AI & ML interests
None yet
Recent Activity
commented on
an
article
4 months ago
From Chunks to Blocks: Accelerating Uploads and Downloads on the Hub
commented on
an
article
4 months ago
From Chunks to Blocks: Accelerating Uploads and Downloads on the Hub
commented on
an
article
5 months ago
From Chunks to Blocks: Accelerating Uploads and Downloads on the Hub
Organizations
None yet