^CT16:52:02.995872Z INFO text_generation_launcher: Waiting for download process to gracefully shutdown T16:02:33.534401Z WARN download: text_generation_launcher: No safetensors weights found for model OpenAssistant/stablelm-7b-sft-v7-epoch-3 at revision None. T16:02:24.868614Z INFO text_generation_launcher: Starting download process. Sudo docker run -gpus all -shm-size 1g -p 8080:80 -v $volume:/data ghcr.io/huggingface/text-generation-inference:latest -model-id $model -num-shard $num_shard -quantize bitsandbytes It runs for a while and there is network traffic but afterwards it just hangs. For some models from the hub, I run consistently into this error - if HF_HUB_ENABLE_HF_TRANSFER is enabled, first one, if i disable it, download just gets stuck.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |