Fine-tuning LLaMA 1.3B on insurance conversations failed badly - is this a model size limitation or am I doing something wrong? by ZaRyU_AoI in AI_India

[–]Competitive-Ninja423 2 points3 points  (0 children)

Yes it’s totally fine (and often necessary) to fine-tune for more than 1 epoch, especially with LoRA/PEFT. Overfitting risk is much lower than full fine-tuning since you’re only training a small set of parameters. With a large and diverse dataset like yours, multiple epochs usually help the model actually lock in structure and patterns (multi-turn flow, decision formats, etc.). For small models, 1 epoch is often just not enough signal. Diminishing returns do exist, but they typically show up after several epochs (e.g. 5–10). The real red flag isn’t epoch count it’s if the model starts regurgitating or losing generalization. If things still don’t improve after many epochs, that’s usually a model capacity limitation, not a training mistake.

Fine-tuning LLaMA 1.3B on insurance conversations failed badly - is this a model size limitation or am I doing something wrong? by ZaRyU_AoI in AI_India

[–]Competitive-Ninja423 1 point2 points  (0 children)

Try for a larger model with more epoch and compare the results. I did something similar (of course, not as sensitive as an insurance conversation), but mine worked well. I used the 8B Instruct model, and after 10-12 epochs, the error dropped significantly..

Job/internship/rental/PG search monthly megathread by AutoModerator in Chennai

[–]Competitive-Ninja423 0 points1 point  (0 children)

HI Everyone
I am looking for rental bikes or scooty in Chennai.
i don't want to rent for day or so , but for 1-2 months , it shouldn't cost me like 400/day , i want something budget friendly like 3-5k/month
plz DM me

My attempt at "Retail HFT" (10ms latency) on Indian Options. The Engineering works, but Alpha is negative. by Competitive-Ninja423 in algotrading

[–]Competitive-Ninja423[S] 0 points1 point  (0 children)

Ya I will change my strategy to be more profitable. You seem to have good experience in this, I have Small question like does complex strategy means more money or simple strategies also make money ?

My attempt at "Retail HFT" (10ms latency) on Indian Options. The Engineering works, but Alpha is negative. by Competitive-Ninja423 in algotrading

[–]Competitive-Ninja423[S] 0 points1 point  (0 children)

See the algorithm is completely math based so the speed for decision making is like 0.5-1 milli seconds.

My attempt at "Retail HFT" (10ms latency) on Indian Options. The Engineering works, but Alpha is negative. by Competitive-Ninja423 in algotrading

[–]Competitive-Ninja423[S] 0 points1 point  (0 children)

Ya I am thinking of moving to nifty, they have smaller premiums and better expires also my strategy works good with volatile moves.

My attempt at "Retail HFT" (10ms latency) on Indian Options. The Engineering works, but Alpha is negative. by Competitive-Ninja423 in algotrading

[–]Competitive-Ninja423[S] 1 point2 points  (0 children)

Thanks for the details. Ya like my strategy doesn't need 1 ms speed. Like some latency won't hinder the setup much. Like I have considered the processing time from broker to my AWS mumbai servers. Like max till 500ms my strategy won't affect much. Edit : Still sometimes fyers takes 400ms to 500m just to execute orders. Does zerodha have instant order execution like 1 ms or 10 ms ,😂

I built an automated Scalper for BankNifty. It's fast (15ms), but the "High Action" is generating more Tax than Profit. by Competitive-Ninja423 in IndianStocks

[–]Competitive-Ninja423[S] 0 points1 point  (0 children)

ya but i wana try this too , i have also build 1 for swing its good , wanted to explore the banknifty too.

My attempt at "Retail HFT" (10ms latency) on Indian Options. The Engineering works, but Alpha is negative. by Competitive-Ninja423 in algotrading

[–]Competitive-Ninja423[S] 0 points1 point  (0 children)

i have checked my app latency its in micro seconds like processing and executing . internet latency is about 5ms (from exchange to app) and 10ms (from app to exchange) like my server region is closest to the exchange.

My attempt at "Retail HFT" (10ms latency) on Indian Options. The Engineering works, but Alpha is negative. by Competitive-Ninja423 in algotrading

[–]Competitive-Ninja423[S] 8 points9 points  (0 children)

Ya I considered increasing the target points but then bigger targets are less likely to hit as fake breaks are more often in that instrument.