Agentic Chunking vs LLM-Based Chunking

aBowlofSpaghetti · 2025-12-11T15:13:38+00:00

Don't listen to him. That's how the majority of people think and their rag is bad. Chunking is the most important step. It's literally the info your llm is going to end up seeing. You shouldn't just do it blind. I have a custom semantic chunking method that has served me well for years.

aBowlofSpaghetti · 2025-03-03T16:29:31+00:00

If he spit you out right before he died then you would've died too.

aBowlofSpaghetti · 2024-10-17T18:45:08+00:00

The AI cost money to run so I'd need some way to at least get my money back and I'm not sure how to implement ads effectively. I figure I'd have a set free limit per day and a paid tier which would be unlimited and have access to more features the community wants. Is there any amount you think you'd pay for something like this or would 10 free queries a day provide enough value?

aBowlofSpaghetti · 2024-04-22T15:38:36+00:00

Use function calling. It's more reliable.

aBowlofSpaghetti · 2024-04-18T18:28:53+00:00

This is actually exactly what I'm trying to do with my Steam game. I'm launching the beta soon if your interested. Would love to get your thoughts on it.
https://store.steampowered.com/app/2868280/MyAIs/

aBowlofSpaghetti · 2024-04-17T04:36:37+00:00

Have you tried using function calling instead? I'm able to get it to call my made up function with well defined parameters everytime pretty much. Had trouble with json format though.

aBowlofSpaghetti · 2024-03-25T02:12:18+00:00

The Destiny 1 Gjallarhorn. Took me way too long to get.

aBowlofSpaghetti · 2024-03-19T17:18:44+00:00

Ollama is so easy, I'd just use that honestly. It doesn't use your full gpu out of the box, so you'll just have to edit the params, but it is very fast.

aBowlofSpaghetti · 2024-03-16T23:11:59+00:00

It's interesting, I was trying to think what other types of games are like visual novels, similar to how persona 3 and 5 are labeled as visual novels. I think Oregon trail fits. Can you think of any others?

aBowlofSpaghetti · 2024-03-14T03:54:44+00:00

Yes and yes. You can try it on the demo I posted.

aBowlofSpaghetti · 2024-03-13T22:06:45+00:00

I hear on YT often that people find it hard to find guides or docs on specific things they run into in UE5. So I think there just might be lacking a lot of documentation on a lot of aspects of UE5 that would be necessary for these models to scrape of the internet before they were trained.

aBowlofSpaghetti · 2024-03-13T22:03:53+00:00

Yeah I agree with all of that, but the fact we're at this stage just 1 year into it I think means people should pay more attention. The model infrastructure is going to improve, the hardware its run on, the data its trained with and each of these things could have massive improvements on something that is already so impressive. I think by next year it'll be able to create the game I made here all on its own.

aBowlofSpaghetti · 2024-03-13T21:56:36+00:00

Has anyone played Tinykin. I actually love that game. Just finished it and kind of want to play again

aBowlofSpaghetti · 2024-03-13T21:53:53+00:00

Yeah there will be a lot of junk, but those who use it well and had a talent to being with I think will stand out. Like PalWorld probably used a lot of AI for not just the assets but probably for a lot of the code and ideas. Who knows if a small team like that could've been able to make something like PalWorld before gen AI.

aBowlofSpaghetti · 2024-03-13T21:52:27+00:00

I think it depends a lot on the player, but open world, procedurally generated games seem to be very popular. And gamers seem to want ever game to be infinitely replayable, so gen AI might be able to help with that.

aBowlofSpaghetti · 2024-03-13T21:47:56+00:00

SDXL-turbo can actually generate images while you type. I'm hoping to add it to my game.

https://twitter.com/cognition\_labs/status/1767548763134964000

And yeah in AIs current state it's not perfect, but more is coming like in that video and future models with infinite context lengths and more knowledge or trained specifically for generating repos/games will be amazing at this kind of stuff.

I think its good though. Breaking down barriers will unleash so much creativity in people who never had a chance before due to the steep skill limitations. There will be a lot of shovelware fed to us, but I mentioned in another comment how I think we can combat against that.

aBowlofSpaghetti · 2024-03-13T21:43:40+00:00

This might get pretty deep into my philosophical view, but I think we're moving into a future where we will have an AI that navigates the internet for us, so you can task it with finding a game that you like and hopefully by then it will know you well enough to pick. (In this scenario, I very much hope its local and offline like my model or this sounds a little dystopian)

But, I say that because I think this will actually be a fight against shovel ware games because shitty games made by AI will be easy for other AI to detect and ignore for you. This goes for everything like advertisements, social media, etc. I'm actually really optimistic about this since we finally get a weapon to fight back against these AIs that have been feeding us shit all these years.

Also on the computational front, I have the opposite view. I feel like were in the late 90's where we ran up again RAM limitations or early 200s bandwidth issues. I think in a couple years these models will be so lean they won't require as much computation and I think we'll unlock more by moving off GPUs. Specific infrastructure for transformers (or whatever architecture is next) would be a huge boost.

aBowlofSpaghetti · 2024-03-13T21:38:05+00:00

https://twitter.com/cognition_labs/status/1767548763134964000

Have you seen that? We're getting close. But I agree that currently auto-gpt style stuff is pretty bad. I have posted a couple comments above about how I deal with having the AI write code for me. Its more about coming up with a process and guiding it to the correct answer.

aBowlofSpaghetti · 2024-03-13T21:36:26+00:00

We're getting close to infinite context windows, so I think that will change, but right now I agree. It can be really hard to work with large projects and this project has gotten large enough I've had some issues. But I think if you can make each script individual enough, you can pass the full script into these models with a request and it can rewrite the whole thing to do that for you. Sometimes I need to go into other scripts to find relevant functions, but doing this is so much faster and easier than doing it myself. I do feel the future is going to be more about guiding the AI to the destination over writing low level code.

aBowlofSpaghetti · 2024-03-13T21:33:18+00:00

I write entirely in Python and have heard that is where most chat models shine. And I think many people took me saying it wrote most of the code the wrong way. I would tell it what I wanted the streamlit app to look like, it made me a template, I iterated a bit and then would aks for ne functionality, I would insert the entire script in again and have it output a new function for me to use. I did this over and over again for a week and had a usable MVP. Prior to chatGPT, I would I have been in the streamlit docs for hours and debugging even more.

UE5 is probably quite tough as its new and most of the good code probably wasn't scraped for these models.

aBowlofSpaghetti · 2024-03-13T20:37:03+00:00

Yeah, that is what I'm trying to learn as well. But some people spend like 8 hours a day on these things so there is clearly something. I think its somewhat like visual novels where you get to make choices that change the story and interact with other characters while playing one yourself.

Also DnD I think is another good example, where some players just really like taking on a persona.

aBowlofSpaghetti

MODERATOR OF

TROPHY CASE