-
-
Notifications
You must be signed in to change notification settings - Fork 3.4k
Description
Hello, I tried running the Gemma 2 notebook on collab, but I get the following error. I get the same error when I try to run the script on my own server.
Link to notebook: https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Gemma2_(9B)-Alpaca.ipynb
🦥 Unsloth: Will patch your computer to enable 2x faster free finetuning.
🦥 Unsloth Zoo will now patch everything to make training faster!
RuntimeError Traceback (most recent call last)
/tmp/ipython-input-2-1447693541.py in <cell line: 0>()
24 ] # More models at https://huggingface.co/unsloth
25
---> 26 model, tokenizer = FastLanguageModel.from_pretrained(
27 model_name="unsloth/gemma-2-9b",
28 max_seq_length=max_seq_length,
/usr/local/lib/python3.11/dist-packages/unsloth/models/loader.py in from_pretrained(model_name, max_seq_length, dtype, load_in_4bit, load_in_8bit, full_finetuning, token, device_map, rope_scaling, fix_tokenizer, trust_remote_code, use_gradient_checkpointing, resize_model_vocab, revision, use_exact_model_name, fast_inference, gpu_memory_utilization, float8_kv_cache, random_state, max_lora_rank, disable_log_stats, *args, **kwargs)
238 f"PeftConfig error: {peft_error}\n\n"
239 )
--> 240 raise RuntimeError(combined_error)
241 pass
242
RuntimeError: Unsloth: Failed to load model. Both AutoConfig and PeftConfig loading failed.
AutoConfig error: name 'layer_type_validation' is not defined
PeftConfig error: Can't find 'adapter_config.json' at 'unsloth/gemma-2-9b-bnb-4bit'
Thanks in advance for the help!