emin temiz's picture

8 3 13

emin temiz PRO

etemiz

·

AI & ML interests

None yet

Recent Activity

replied to jsulz's post 3 days ago

Something I love about working at Hugging Face is the opportunity to design and work in public. Right now, we’re redesigning the architecture that supports uploads and downloads on the Hub. Datasets and models are growing fast, and so are the challenges of storing and transferring them efficiently. To keep up, we're introducing a new protocol for uploads and downloads, supported by a content-addressed store (CAS). Here’s what’s coming: 📦 Smarter uploads: Chunk-level management enables advanced deduplication, compression, and reduces redundant transfers, speeding up uploads. ⚡ Efficient downloads: High throughput and low latency ensure fast access, even during high-demand model releases. 🔒 Enhanced security: Validate uploads before storage to block malicious or invalid data. We analyzed 24 hours of global upload activity in October (88 countries, 130TB of data!) to design a system that scales with your needs. The result? A proposed infrastructure with CAS nodes in us-east-1, eu-west-3, and ap-southeast-1. 🔗 Read the blog post for the full details: https://huggingface.co/blog/rearchitecting-uploads-and-downloads 🌟 Check out our interactive demo to explore the data yourself! https://huggingface.co/spaces/xet-team/cas-analysis We’d love to hear your feedback - let us know if you have questions or want to see more.

replied to jsulz's post 4 days ago

Something I love about working at Hugging Face is the opportunity to design and work in public. Right now, we’re redesigning the architecture that supports uploads and downloads on the Hub. Datasets and models are growing fast, and so are the challenges of storing and transferring them efficiently. To keep up, we're introducing a new protocol for uploads and downloads, supported by a content-addressed store (CAS). Here’s what’s coming: 📦 Smarter uploads: Chunk-level management enables advanced deduplication, compression, and reduces redundant transfers, speeding up uploads. ⚡ Efficient downloads: High throughput and low latency ensure fast access, even during high-demand model releases. 🔒 Enhanced security: Validate uploads before storage to block malicious or invalid data. We analyzed 24 hours of global upload activity in October (88 countries, 130TB of data!) to design a system that scales with your needs. The result? A proposed infrastructure with CAS nodes in us-east-1, eu-west-3, and ap-southeast-1. 🔗 Read the blog post for the full details: https://huggingface.co/blog/rearchitecting-uploads-and-downloads 🌟 Check out our interactive demo to explore the data yourself! https://huggingface.co/spaces/xet-team/cas-analysis We’d love to hear your feedback - let us know if you have questions or want to see more.

replied to jsulz's post 4 days ago

Something I love about working at Hugging Face is the opportunity to design and work in public. Right now, we’re redesigning the architecture that supports uploads and downloads on the Hub. Datasets and models are growing fast, and so are the challenges of storing and transferring them efficiently. To keep up, we're introducing a new protocol for uploads and downloads, supported by a content-addressed store (CAS). Here’s what’s coming: 📦 Smarter uploads: Chunk-level management enables advanced deduplication, compression, and reduces redundant transfers, speeding up uploads. ⚡ Efficient downloads: High throughput and low latency ensure fast access, even during high-demand model releases. 🔒 Enhanced security: Validate uploads before storage to block malicious or invalid data. We analyzed 24 hours of global upload activity in October (88 countries, 130TB of data!) to design a system that scales with your needs. The result? A proposed infrastructure with CAS nodes in us-east-1, eu-west-3, and ap-southeast-1. 🔗 Read the blog post for the full details: https://huggingface.co/blog/rearchitecting-uploads-and-downloads 🌟 Check out our interactive demo to explore the data yourself! https://huggingface.co/spaces/xet-team/cas-analysis We’d love to hear your feedback - let us know if you have questions or want to see more.

View all activity

Articles

Symbiotic Intelligence

Organizations

None yet

etemiz's activity

New activity in mradermacher/grok-1-GGUF 21 days ago

parts

#1 opened 21 days ago by

New activity in hilaltekgoz/whisper-large-tr about 2 months ago

nice

#1 opened about 2 months ago by

New activity in etemiz/Llama-3.1-405B-Inst-GGUF 4 months ago

Larger quants please

#1 opened 4 months ago by

New activity in DontPlanToEnd/UGI-Leaderboard 7 months ago

Llama3

#7 opened 7 months ago by

New activity in hiyouga/Llama-2-70b-AQLM-2Bit-QLoRA-function-calling 8 months ago

just for curiosity

#1 opened 8 months ago by

New activity in LiteLLMs/Mixtral-8x22B-v0.1-GGUF 8 months ago

ram usage

#1 opened 8 months ago by

Tom-Neverwinter

New activity in AlexWortega/miqu-1-70b-AQLM-2Bit-1x16-hf 8 months ago

Space before EOS

#3 opened 8 months ago by

New activity in ISTA-DASLab/Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf 8 months ago

One needs a Qwen 72B AQLM

#4 opened 8 months ago by

New activity in hiyouga/Llama-2-70b-AQLM-2Bit-QLoRA-function-calling 8 months ago

just for curiosity

#1 opened 8 months ago by

just for curiosity

#1 opened 8 months ago by