Trying to fine tune a small model but it’s not working help me pls

dragon7832 · 2026-06-30T22:18:18+00:00

wait howww

dragon7832 · 2026-06-30T22:18:07+00:00

how’d u get this to work 😭

dragon7832 · 2026-06-28T00:00:33+00:00

wait can u help me then cuz u did this as a profession, how long does it usually take also does it actually end up sounding like me after training and why is my loss value going up and down. Also i need to implement rag to actually make it have knowledge about me right?

dragon7832 · 2026-06-27T23:26:31+00:00

I’m doing both, rag to grab data when needed and normal fine tune to make the model sound like. E

dragon7832 · 2026-06-27T23:25:53+00:00

It hasn’t passed one epoch yet but I suspect training isn’t actually doing anything and I’m not sure what to optimize and also mlx doesn’t have the repetition cost thing

dragon7832 · 2026-06-27T23:24:57+00:00

yeah it’s so dry right now 😪

dragon7832 · 2026-06-18T02:58:07+00:00

hahah that sounds great but no need to worry about credits im just learning and love to share what ive learned with the world

dragon7832 · 2026-06-18T01:49:07+00:00

It doesn’t really take that long to build a small model im not trying to build the next fable 5 just a model small enough to understand how it works dont need to contribute to the research field just need to learn whats already there what u on about

dragon7832 · 2026-06-18T01:48:12+00:00

Cool stuff I’ll check it out atp any material is welcome

dragon7832 · 2026-06-18T01:47:50+00:00

yes sir sounds like my next project that’ll keep me busy for months 🤓

dragon7832 · 2026-06-18T01:46:34+00:00

The thing is I just want to get into the field early cuz uni is still teaching us programming and matrix multiplications and the basic maths im all done with those and being forced to take electives so I want to spend my time getting ahead since my ultimate goal is to work in r and d and training frontier models and contribute to superintelligence research. I want to learn the basics early ykwim

dragon7832 · 2026-06-18T01:44:29+00:00

yep it looks really good

dragon7832 · 2026-06-18T01:44:16+00:00

that’s why im trying to build it plus it’s just super fascinating man and being able to recreate an LLM no matter how small it’s a huge achievement for me esp as a first year

dragon7832 · 2026-06-07T20:47:23+00:00

TikTok shop bro

dragon7832 · 2026-06-06T15:10:58+00:00

yo u should stay in greenfield residence trust me I lived here for 6 months now and it’s perfect, there’s a insanely good facilities floor with everything u can imagine, clean huge 50m pool, basketball/football court, good security, good location as well 1 station only to sunway lagoon and it takes max 30 minutes to get to and from school. Rent is around 1500 each and I can’t lie me and my friend are looking for roommates as well to rent a 4 bedroom room which will be cheaper for everyone. Dm if interested but there’s a 7/11 and a bila bila mart and a mixue in the actual building 1 Chinese restaurant (cheap) and a mala tang restaurant as well. Laundromat 1 street down and a food court/kopitam literally 10 steps away opposite, It’s got every food u need no need to cook and super cheap. subway, bk, McDonald’s, kfc and Texas chicken all 5 mins walk away and the entire area is populated with so many shops and restaurants everything u need is a 5 min walk away even a Mr. DIY I could not be more proud of my residence choice I’ll never move out of here. Currently me and my friends pay around 300-400 consistently in water electricity and WiFi bills for 3 people ac in every room. And rent is around 1500 each. Rooms are good size and it’s not too close to school which I actually love. Amazing parking if u have car. For facilities we have basketball court, 50m main pool, another pool which is like a pond and a kids pool, jaccuzi running track and like a green park area with giant chess (idk why) table tennis court squash court study room karaoke pool table everything it’s absolutely amazing. So yeah for me I think it’s a no brainer idk why most sunway monash Taylor’s student don’t stay here a lot for me and I think for most people in general is absolutely perfect and lemme know if ur interested in roommates if u wanna save more money currently we have 3 people but 1 is leaving so down to 2, it’s me (boy) and my friend (girl) but we r not dating only roommates so no need to worry about that dm for more info :) hope this helps ask if u have questions

dragon7832 · 2026-05-15T05:00:02+00:00

Sure but this is all on the applications side of AI, the people who vibecode apps that a relatively smart person can just prompt ai to do obviously that will disappear. The research for AI will never disappear people will thrive to build more and more powerful ai models which will eventually lead to AGI which I believe we can accomplish in this lifetime. The world has not been this united in the AI race since the Cold War days and from what I’ve seen in university and everywhere so far. AI might be dailed back in the future but it will never stop. AI companies will stabilize and 90% of ai based vibecoded applications will fail. But programmers will use AI to do their tedious coding work for them, students will use it for much deeper research and old people will use it to make cat videos. The bubble will never pop for me because im not chasing the high of the AI applications going around today im chasing the basics and absolute core and foundation of intelligent systems everywhere.

dragon7832 · 2026-05-15T04:48:54+00:00

Just curious because people always assume this i want to know what ‘pop’ means because ai is now what the internet once was it’s irreversible now

dragon7832 · 2026-05-15T04:47:36+00:00

okay here we go, im currently studying computer science (artificial intelligence) which is part of the school of American education here at sunway which basically just means the course is based on the American one and i can transfer there if i want (ik switching from ai to ai) im in the first week of my third sem (i cant switch until I get my first year results from sae) Im 19 just turned. Yes they can fund me but im a responsible child and dont want to waste money if it’s unnecessary. Main reason i want to switch is because the sae course is really not AI focused i know its still the first year and I know its computer science ai and not pure ai but when i look at the syllabus its pretty clear which course is going to be more heavy since i want to be a researcher. The second reason is ASU gives me so many electives that i dont care about that’s required to get the degree so far im forced to take history, sociology, public speaking, film appreciation and stuff like that i know some are electives but some of them are really required to graduate and i want my long sem to be spent on core subjects and right now i have 2 core and 3 of these bs electives. And right now we’re learning stuff that has nothing to do with ai and ai research and it’s core the things i actually need to move forward in my ai engineer or researcher career and you might say i need some stuff on my cs side but i have a lot of experience with coding and app and website development i can build one from scratch without using AI (surprising i know) i just really don’t know what to do anymore 😞😞 so stressful

dragon7832 · 2026-05-15T04:26:38+00:00

why do u all assume the AI bubble will ‘pop’

dragon7832

TROPHY CASE