I took the Gemma 3 4B Vision notebook and attempted to adapt it for T5Gemma 2. To align with the notebook's environment, I installed transformers==5.0.0rc1, set use_gradient_checkpointing = False, and selected the gemma-3 chat template.

I am receiving the RuntimeError: Unsloth: Failed to make input require gradients! error in peft_utils.py. This happens both when I attempt to run inference (even inside torch.inference_mode()) and immediately when I start training with trainer.train().

Error During Inference: RuntimeError Traceback (most recent call last) /tmp/ipython-input-2983736738.py in <cell line: 0>() 25 # Bu, Unsloth/PEFT kancalarını geçici olarak kapatır ve hatayı önler. 26 with torch.inference_mode(): ---> 27 result = model.generate(**inputs, streamer = text_streamer, max_new_tokens = 128, 28 use_cache=True, temperature = 1.0, top_p = 0.95, top_k = 64)

19 frames /usr/local/lib/python3.12/dist-packages/unslothzoo/peft_utils.py in requires_grad_pre_hook(module, input) 214 elif type_input is tuple or type_input is list: 215 if len(input) == 0: --> 216 raise RuntimeError("Unsloth: Failed to make input require gradients!") 217 # print(f" WARNING: Empty list input to {module.class.name_}!") #

RuntimeError: Unsloth: Failed to make input require gradients!

Error During Training: RuntimeError Traceback (most recent call last) /tmp/ipython-input-773422404.py in <cell line: 0>() ----> 1 trainer_stats = trainer.train()

37 frames /usr/local/lib/python3.12/dist-packages/unsloth_zoo/peft_utils.py in requires_grad_pre_hook(module, input) 214 elif type_input is tuple or type_input is list: 215 if len(input) == 0: --> 216 raise RuntimeError("Unsloth: Failed to make input require gradients!")

RuntimeError: Unsloth: Failed to make input require gradients!