runtime error
Exit code: 1. Reason: 99M [00:01<00:00, 252MB/s][A model.safetensors: 100%|█████████▉| 499M/499M [00:01<00:00, 407MB/s] tokenizer_config.json: 0%| | 0.00/1.22k [00:00<?, ?B/s][A tokenizer_config.json: 100%|██████████| 1.22k/1.22k [00:00<00:00, 11.6MB/s] vocab.json: 0%| | 0.00/798k [00:00<?, ?B/s][A vocab.json: 100%|██████████| 798k/798k [00:00<00:00, 43.0MB/s] merges.txt: 0%| | 0.00/456k [00:00<?, ?B/s][A merges.txt: 100%|██████████| 456k/456k [00:00<00:00, 82.2MB/s] tokenizer.json: 0%| | 0.00/2.11M [00:00<?, ?B/s][A tokenizer.json: 100%|██████████| 2.11M/2.11M [00:00<00:00, 13.4MB/s] special_tokens_map.json: 0%| | 0.00/280 [00:00<?, ?B/s][A special_tokens_map.json: 100%|██████████| 280/280 [00:00<00:00, 2.91MB/s] Device set to use cpu Traceback (most recent call last): File "/home/user/app/app.py", line 22, in <module> from llamaModel.model import get_input_token_length, get_LLAMA_response_stream File "/home/user/app/llamaModel/model.py", line 13, in <module> bnb_config = BitsAndBytesConfig( File "/usr/local/lib/python3.10/site-packages/transformers/utils/quantization_config.py", line 438, in __init__ self.post_init() File "/usr/local/lib/python3.10/site-packages/transformers/utils/quantization_config.py", line 496, in post_init if self.load_in_4bit and not version.parse(importlib.metadata.version("bitsandbytes")) >= version.parse( File "/usr/local/lib/python3.10/importlib/metadata/__init__.py", line 996, in version return distribution(distribution_name).version File "/usr/local/lib/python3.10/importlib/metadata/__init__.py", line 969, in distribution return Distribution.from_name(distribution_name) File "/usr/local/lib/python3.10/importlib/metadata/__init__.py", line 548, in from_name raise PackageNotFoundError(name) importlib.metadata.PackageNotFoundError: No package metadata was found for bitsandbytes
Container logs:
Fetching error logs...