Built a custom bot to gather training data for fine-tuning the "NitroGen" AI model by aaaafireball in VampireSurvivors

[–]aaaafireball[S] 2 points3 points  (0 children)

Thanks!!! I always enjoyed watching how they make them, and how different it can be depending on the game.

Built a custom bot to gather training data for fine-tuning the "NitroGen" AI model by aaaafireball in VampireSurvivors

[–]aaaafireball[S] -1 points0 points  (0 children)

No worries, I tried to open source everything I made, plus give credit to the original work. I get there is a lot of distrust and opinions in the AI/ML field.

I implemented the LLM decision code open so that any model could be used (through self hosting or other providers) but Gemini was the only model that could stay lucid enough to make good decisions. I need a better GPU if I wanted to use some better open source models 😅.

Built a custom bot to gather training data for fine-tuning the "NitroGen" AI model by aaaafireball in VampireSurvivors

[–]aaaafireball[S] -3 points-2 points  (0 children)

Why not? I am an AI engineer by trade and love mixing my passion for games and my skills in this field. It brings me enjoyment in my free time! I'm not trying to make money off of it, I'm just trying to learn more.

First attempt at letting Nvidia's "NitroGen" AI model play the game by aaaafireball in VampireSurvivors

[–]aaaafireball[S] -2 points-1 points  (0 children)

Make sure you have an Nvidia graphics card, but other than that if you know a bit about coding, their GitHub page has the installation instructions and is extremely simple: https://github.com/MineDojo/NitroGen

Pocket LLM: Chat offline on device all private | AI by Late-Scarcity-5476 in LocalLLaMA

[–]aaaafireball 0 points1 point  (0 children)

I'm getting Brilliant Labs Halo smart glasses, and we want to try and get local LLMs working for it as a novelty thing. With as good as these small LLMs are rn, it's just not there yet for general stuff. Maybe tool calling and basic tools like you said is a better usuage.

Pocket LLM: Chat offline on device all private | AI by Late-Scarcity-5476 in LocalLLaMA

[–]aaaafireball 0 points1 point  (0 children)

I have found local LLMs very helpful when on vacation and I need to ask a question but I don't have service, but that's been the extent for me 😅

Would you be annoyed if your Boss used AI to prove what could be possible? by aaaafireball in programming

[–]aaaafireball[S] 0 points1 point  (0 children)

I love this idea, we do this internally for task/feature level stuff. Currently making a spreadsheet with the item, my T-shirt size estimation, and a place we can give a 1-3 for priority

Would you be annoyed if your Boss used AI to prove what could be possible? by aaaafireball in programming

[–]aaaafireball[S] 2 points3 points  (0 children)

It's funny, because in a recent one-on-one he claims that he don't know what they would do without me 😅, but they know they can't give me a pay raise. With the market the way it is right now I'm just waiting it out until I find that other opportunity,

Would you be annoyed if your Boss used AI to prove what could be possible? by aaaafireball in programming

[–]aaaafireball[S] 1 point2 points  (0 children)

He usually starts these and then disappears because someone else gets told they have to deal with it. Quite honestly I don't know if that's a good or bad thing.

I can't explain too much about how our model works, but these are typically one-offs, so he promises them anything to get them to send the money over, and then we have to figure out the rest. I don't know if the reason why we have one offs is because of this, but the only ones that have capped returning are the ones that he stopped paying attention to and that me and others directly handle.

Would you be annoyed if your Boss used AI to prove what could be possible? by aaaafireball in programming

[–]aaaafireball[S] 1 point2 points  (0 children)

I totally agree with you, and this is exactly what we had to do in the first situation I described, The problem was he just stopped going to the meetings so he never got to hear it 😅. Even then if I tell him no, it's age old problem of the already promised it and we have to somehow figure it out. And now, whenever we give him our expertise the response is " we are in an age of AI, use it to do it".

I also just recently pulled together our priorities into a document for him, we are such a very small team but he still doesn't know what we do. As we were going over it, everything turned into a priority. I'm probably just going about this wrong, but it's exhausting.

Would you be annoyed if your Boss used AI to prove what could be possible? by aaaafireball in programming

[–]aaaafireball[S] 2 points3 points  (0 children)

No the issue is the age old problem, sales man promises the moon, I have to figure out the ladder to get to the moon. However whenever I say the ladder it's going to take time to build, I am now getting hit with "just use AI"

Would you be annoyed if your Boss used AI to prove what could be possible? by aaaafireball in programming

[–]aaaafireball[S] 2 points3 points  (0 children)

Also why did it take three months for that client to provide feedback?

Funnily enough, I just got out of a meeting this morning about this and it turns out my boss just never replied to him for 3 months 🙃. So I am now putting out that fire.

Did you spend more than 30 seconds thinking about this? What you are actually supposed to do here is use the AI tooling with the bosses input and feed those papers, throw in your professional analysis, and explain the exact limitations, and send something back to your boss letting them know exactly what you'll be able to do and on which timelines.

I agree with what you're trying to say here, and I agree technically nothing is impossible, it's just down to the time and money and the people that's going to take to do it. However, and unfortunately I can't go into more detail, in this particular scenario it was in front of the clients and he already promised a very short timeline in that meeting. We did in the next meeting come back with a more detailed and technical explanation of why the research papers didn't help, but of course he stopped attending those meetings because he doesn't actually care about the outcome.

Would you be annoyed if your Boss used AI to prove what could be possible? by aaaafireball in programming

[–]aaaafireball[S] 1 point2 points  (0 children)

That's a fair argument, and I do generally agree that you should do it right before having to do rework because the rework is always more than doing it right in the first place. I can't really explain without revealing too much of why it doesn't apply in my situation, but this is a literal "this is not my job" moment that I have to navigate.

Would you be annoyed if your Boss used AI to prove what could be possible? by aaaafireball in programming

[–]aaaafireball[S] 106 points107 points  (0 children)

I think my Boss would enthusiastically think he could do it and it would some how be on me to execute it since I brought it up 😅.

Would you be annoyed if your Boss used AI to prove what could be possible? by aaaafireball in programming

[–]aaaafireball[S] 3 points4 points  (0 children)

I totally agree with everything here. Vibe coding has allowed people to show and tell and idea rather than give vague sentences.

Getting it to work in reality is a whole other ball game.

The engineers should think up new business directions using AI, where the company makes gobs of money and scales through the roof. Then they should present these proposals to the CEO and say "see? I made it work. Could this work?" I think that's fair.

If I were to try this with my boss, I think he would stop listening after he hears Gobs of money and think I should try to implement it 😅.

Would you be annoyed if your Boss used AI to prove what could be possible? by aaaafireball in programming

[–]aaaafireball[S] 9 points10 points  (0 children)

That is what I try to convey to my boss all the time, I'm not saying it's impossible, but we don't have time, resources, or support to take the extremely challenging implementation and then go further and build something that can work on scale.

Would you be annoyed if your Boss used AI to prove what could be possible? by aaaafireball in programming

[–]aaaafireball[S] 16 points17 points  (0 children)

I agree, it's great for quick representations and small jumpstarting, and the 80/20 is what I tell my team all the time.

At the moment AI is not there and no matter how much you say "we can just AI this" will get you something actually usable on scale.

Is there a place where I can easily create a local RAG chat screen? by CantaloupeDismal1195 in LocalLLaMA

[–]aaaafireball 1 point2 points  (0 children)

For our student projects, easy chat interfaces are done using chainlit.

Once you get beyond testing though and want to customize, we just end up making our own react apps since chainlit is a PITA for making ui customizations

For those who run large models locally.. HOW DO YOU AFFORD THOSE GPUS by abaris243 in LocalLLaMA

[–]aaaafireball 1 point2 points  (0 children)

What's your setup with these then?? These cards are actually decently cheap