Huggingface's Xet storage seems broken, dumping debug logs, and running as root
Posted by __JockY__@reddit | LocalLLaMA | View on Reddit | 10 comments
I can't get Xet-backed models to download. For example, I'm trying get Unsloth's Deepseek-R1 Q8_0 GGUF. But any time I try to download from a Xet repo, I get an error like this:
Xet Storage is enabled for this repo. Downloading file from Xet Storage..
DeepSeek-R1-Q8_0/DeepSeek-R1.Q8_0-00001-(…): 12%|███████████▏ | 5.84G/47.8G [01:14<06:56, 101MB/s]{"timestamp":"2025-05-09T23:48:54.045497Z","level":"WARN","fields":{"message":"Reqwest(reqwest::Error { kind: Request, url: \"https://transfer.xethub.hf.co/xorbs/default/6a61e683095213f1a28887ab8725499cc70994d1397c91fb1e45440758ad62f9?X-Xet-Signed-Range=bytes%3D48769543-48777678&Expires=1746838078&Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly90cmFuc2Zlci54ZXRodWIuaGYuY28veG9yYnMvZGVmYXVsdC82YTYxZTY4MzA5NTIxM2YxYTI4ODg3YWI4NzI1NDk5Y2M3MDk5NGQxMzk3YzkxZmIxZTQ1NDQwNzU4YWQ2MmY5P1gtWGV0LVNpZ25lZC1SYW5nZT1ieXRlcyUzRDQ4NzY5NTQzLTQ4Nzc3Njc4IiwiQ29uZGl0aW9uIjp7IkRhdGVMZXNzVGhhbiI6eyJBV1M6RXBvY2hUaW1lIjoxNzQ2ODM4MDc4fX19XX0_&Signature=Xczl3fJEK0KwoNuzo0gjIipe9TzsBA0QsnwvQzeOq7jbRilxHB4Ur04t-gIcTSnodYN38zkpRJrplR-Dl8uuzMH0L-YB~R4YhL5VigXTLcn4uUyBahdcNTMLZu21D9zjaslDd8Z~tmKyO2J4jqusMxBq2DGIEzyL2vFwQ-LuxegxCTn87JBlZ9gf5Ivv5i~ATW9Vm-GdH~bXS3WytSfY0kXenTDt0pSRlMcAL8AumpXCENq9zS2yv7XtlR8su6GRe3myrQtMglphaJzypodbuYhg3gIyXixHtWagyfV33jyEQgtvlmu1lgbrjpkl7vPjFzBveL-820s09lkE3dpCuQ__&Key-Pair-Id=K2L8F4GPSG1IFC\", source: hyper_util::client::legacy::Error(Connect, ConnectError(\"tcp open error\", Os { code: 24, kind: Uncategorized, message: \"Too many open files\" })) }). Retrying..."},"filename":"/home/runner/work/xet-core/xet-core/cas_client/src/http_client.rs","line_number":164}
{"timestamp":"2025-05-09T23:48:54.045540Z","level":"WARN","fields":{"message":"Retry attempt #0. Sleeping 1.384510777s before the next attempt"},"filename":"/root/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/reqwest-retry-0.6.1/src/middleware.rs","line_number":166}
{"timestamp":"2025-05-09T23:48:54.045568Z","level":"WARN","fields":{"message":"Reqwest(reqwest::Error { kind: Request, url: \"https://transfer.xethub.hf.co/xorbs/default/6a61e683095213f1a28887ab8725499cc70994d1397c91fb1e45440758ad62f9?X-Xet-Signed-Range=bytes%3D49203567-49214372&Expires=1746838078&Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly90cmFuc2Zlci54ZXRodWIuaGYuY28veG9yYnMvZGVmYXVsdC82YTYxZTY4MzA5NTIxM2YxYTI4ODg3YWI4NzI1NDk5Y2M3MDk5NGQxMzk3YzkxZmIxZTQ1NDQwNzU4YWQ2MmY5P1gtWGV0LVNpZ25lZC1SYW5nZT1ieXRlcyUzRDQ5MjAzNTY3LTQ5MjE0MzcyIiwiQ29uZGl0aW9uIjp7IkRhdGVMZXNzVGhhbiI6eyJBV1M6RXBvY2hUaW1lIjoxNzQ2ODM4MDc4fX19XX0_&Signature=WrJcmDoFv9Cl5TgQ~gzHLopjkPV-RVLHey5AUwF5TAVoPz5GC-MdIfwRS2iNaI6rc7l~gXqrDsmXqH354c15FfLoRsIGqnPk9LFLQ0ckKYOcoi~84jY8BNN2O1KPWzQe6tppUMtBZp3HQ5ls9xqvqr~yXRs-ppKOJVL~hMssBEYNjseOSaRZjLHs7ucr6diwDxp4pceCTirKRM0~-4gnsAUYuOl2qpUYMUDrubVZoBPcW83laKyg25QQphqctmEoCFTKtdB4AN~41FJ9P2FpHgj-G4VkMLCm2iHf7qagBFh3joozh6bwtivlqv19SWG-dMF1ID-jI-WFWsIqXhOb2Q__&Key-Pair-Id=K2L8F4GPSG1IFC\", source: hyper_util::client::legacy::Error(Connect, ConnectError(\"tcp open error\", Os { code: 24, kind: Uncategorized, message: \"Too many open files\" })) }). Retrying..."},"filename":"/home/runner/work/xet-core/xet-core/cas_client/src/http_client.rs","line_number":164}
Look at this: `/root/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/reqwest-retry-0.6.1/src/middleware.rs`
Lolwat, they're running Xet services as root and dumping verbose errors with full paths? I think someone needs to fix their shit and turn off debugging in prod.
In the meantime... anyone know how to make Xet work reliably for downloads?
10 Comments
jsulz@reddit
__JockY__@reddit (OP)
jsulz@reddit
teilo@reddit
__JockY__@reddit (OP)
yukiarimo@reddit
__JockY__@reddit (OP)
R1skM4tr1x@reddit
yukiarimo@reddit
Cool-Chemical-5629@reddit