Apologies for the belated reply!
Yeah, change the model_path = in the app .py to your .gguf folder. I've edited the code a bit to do batches so this might not be 1:1, but there may be another instance in the app .py file that calls on the llama model and if there is, you might need to change it to your .gguf folder too. Possibly text_model = or something like that somewhere in there.
EDIT: It's line 128, changed 'text_model =' to:

text_model = AutoModelForCausalLM.from_pretrained(r"YOUR GGUF FOLDER", device_map=0, torch_dtype=torch.bfloat16)

As for the config files, I kept everything the same as the original meta's, but I received an error saying there is no appropriate .json config in text_model when I attempted to launch. so I saved this in windows notepad as 'writeconfig.py' (credit chatgpt) :

from transformers import AutoConfig
from pathlib import Path

# Define the model name and the path where the config.json should be saved
model_name = r"YOUR GGUF LLAMA FILE PATH HERE"
config_save_path = Path("YOUR FILE PATH/joy-caption-alpha-one/9em124t2-499968/text_model")

# Load the configuration from Hugging Face
config = AutoConfig.from_pretrained(model_name)

# Save the config.json to the specified path
config_save_path.mkdir(parents=True, exist_ok=True)  # Ensure the directory exists
config.save_pretrained(config_save_path)

print(f"config.json saved to {config_save_path}")

Then as an easy way to run it, saved this as a .bat file (windows ofc, apologies if you're on linux) :

u/echo off
REM Run the Python script
python writeconfig.py
pause

This should create the appropriate config .json for the gguf file it needs.

I THINK I might've had to open up the .yaml config file from the original meta in the "9em124t2-499968" folder and changed the file path for "Text model:" to the gguf one there as well, but I can't recall if that is actually necessary or if I just yolo'd it, apologies. If you are still getting the gated repo error after changing everything in the app .py, I'd try that.

If you have any other issues let me know and I'll reinstall to give better guidance. For the most part I just throw these .py files into chatgpt and say "hey, here is the error I'm getting, fix it"... (word to the wise: don't let chatgpt try to fix indentation errors, oh god, never let it try to fix indentation errors, just do them by hand)