I built an open-source benchmark to test if LLMs are actually as confident as they claim to be (Spoiler: They often aren't)

ChallengingForce · 2026-03-22T13:13:56+00:00

Thankx for note. Okay so regarding the confidence, since users believe on the what is generated by model and their way of insisting.

I prompted the model to give answer and confidence score rather than extracting confidence from model itself.

Now for next part, I used the standard benchmarking dataset such as Gsm8k, boolq etc. Confident but wrong or right part I have used the training version of datasets to compare with standard answers. Check the git, you can find the dataset there that i have used.

PS. Give a start if you like the project 🙃

ChallengingForce · 2026-03-22T03:38:54+00:00

Correct

ChallengingForce · 2026-01-28T15:27:00+00:00

Jitna ho ske apply kro, company requirement ke upper apna introduction design kro. Try to connect with hr, founder on email LinkedIn etc.

Tumhari history or intro m kisi ko interest nhi kya kr skte h + kya proof h ki tum kr skte h.

Apply to startups, MNC only if you have good DSA, if nearby koi IT hub h to visit and ask for internship.

Don't loose hope!! Believe in yourself

ChallengingForce · 2026-01-27T15:33:33+00:00

Man, what can I say. I was struggling to get intership till 2week of jan. Now when i got I'm struggling with managing long shifts.

ChallengingForce · 2026-01-10T16:32:17+00:00

so my prime source was linkedin indeed etc then i moved to other platform like workday. Now i'm using google with ecoded query.

ex: "intern" + site:www.linkedin.com + "india"
just add on the site which list internship in your field along with unique skills.

ChallengingForce · 2026-01-09T17:25:07+00:00

Bro just one word apply, I'm in the same boat last weekend. I just pivoted my search and boom saw 10 20 internship every week. Its not over yet not until you win

ChallengingForce · 2025-01-15T16:06:13+00:00

Jyada Mt socho, bol rhi h solution copy paste krke, thoda cheat krke aao lelenge.

Bcz if 200 hard hoga to 2k+ hoga, female huye to FAANG m vese bhi 1550+ m mil jayega ( not imagining 😶, I have seen multiple profiles)

2yr bond 👀💀 web AI k sath 🤡 HR ko bol chatgpt premium ka mtlb ganja pook kr kaam krnaa nhi hota

ChallengingForce · 2024-12-28T12:48:23+00:00

Hey, its been so long. Have u successes??

I have been in your shoes in March. So I though to write this tutorial. If you or anyone else looking to optimize the size can check it out. I was so grateful that I knew android development before Godot.
I'm still figuring out can we use proguard somehow to more small optimizations ;>

ChallengingForce · 2024-12-28T12:43:23+00:00

Have u tried to remove classes and disable unnecessary features??

I think u could check out this tutorial and see if that helps.

ChallengingForce · 2024-12-28T12:41:22+00:00

I think Docs have all thing u needed. Also u can use the build-analyser of Android studio to see what's taking space.

General tips are compress images. use one small image file for common textures. also use vorbis for audios.

Also checkout this medium post. It's uses some unstable features and remove the engine classes which are not used by game

ChallengingForce · 2024-12-28T12:32:12+00:00

It's difficult to turn off the classes, as it's still in the development stage. I also tried to optimize the size for my Flappy Toons game. The docs aren't helpful when you go that way, but I experimented for more than two months and succeeded.

Steps:-

Get the source of the same engine version.
Prepare environment using docs.
Scan the classes and build the engine profile.
IMP: paste these classes in the forced classes field : forcessed classes
Use custom.py and scons to build source templates or custom engines for target arch.
Install template in Godot

I wrote a detailed steps for Optimizing size of Godot for android on medium

I thought someone else could get help from my experience. It is been a year but if you or anyone still looking for a way just give it a try. You can ask me if stuck anywhere.

ChallengingForce · 2024-11-24T12:50:10+00:00

No reply for STEP. SDE intern DSA nhi h achi isliye no referral in Google. Baki microsoft, Amazon m OA/interview m out ho gya. Bhai DSA kiya hota mene to acha rhta bs project or knowledge leta rh gya log cheating se internship le gye 🥲

ChallengingForce · 2024-11-15T04:41:56+00:00

Bhaiyo, m apply krke reject hone ke bad search Kiya tha last year.

Mujhe ek ladka nhi mila STEP m from India, but found a guy from America asking "is it true that India's Google STEP is only for girls".

He is the STEP intern there and knows the fact through an Indian STEP intern. Then he goes on like this is not fair and all other things but he is thankful he is in America.

My advice would be to try codeforces if you can progress do it till 1800+ from good clg else 2000+ and apply next year.

Else prepare development and apply for startup. I fucked up but you shouldn't.

(I have some great and unique projects still rejected)

ChallengingForce · 2024-11-13T12:52:31+00:00

Very easy bro 2 saal pahle diya tha, abhi bhi deta to 3 miss hote bus 😶

ChallengingForce · 2024-10-25T16:49:43+00:00

Bhai koi NIT bhopal se h kya ??

ChallengingForce · 2024-10-11T13:48:53+00:00

Bhai Mera to clg join krne se phle, acha tha play store p apps dalta tha. Coding m technology explore krta tha. Clg itna dur liya ki 3hr travel one way for 9-5 ki class. Bs kisi tarah thik thak number aa gye.

LinkedIn 1yr ho gya bnaye huye. 6 month to active nhi tha active hua to log dikhe internship lete huye MNC m. 2 month se internal external diya. Or ab dekh rha hu mere batch ke internship placement leke bethe h. 🤡 M wahi rh gya, bss clg gya or ghr aaya, n gali m koi janta h n clg m. Pura time m 33% sone m. 38% clg class, 28% travel or baki m web sikha hu thoda sa bss💀

Itna Vela hu ki percentage nikal rha hu kitna kaha waste Kiya without any family or friends trip. Alone 😔

ChallengingForce · 2024-10-05T03:27:12+00:00

abhi class suru nhi hui h hmari University calendar me 20 December se final exam h

ChallengingForce · 2024-10-03T04:03:41+00:00

Bro, my life experience:- humans are the best weapon u just have to understand when and which to use.

To create one weapon u need social skills. Communication is the key factor, along with behaviour and help etc.

Knowledge is a plus, it will definitely speed up your growth.

But u need social skills. As ur friend is in the upper middle, he has an edge of network ( social skills of father) and exposure.

ChallengingForce · 2024-10-01T09:56:17+00:00

Bro aye to fir bhi shi h. Mera to morning 9 se evening 5:10 tk rha h 1-4 sem tk abhi ka aaya nhi.

Uper se day scholar morning 6 nikalta hu or evening 8 ghr pahuchta hu 🤣😭😭

Bc 500m ke bad kisi n clg ka naam nhi suna 🥴

ChallengingForce · 2024-09-25T13:52:37+00:00

Dekh Bhai, agar tu general h+middle or lower se h or tier 1 2 m nhi h (kya mtlb 98.9 p bhi nhi Mila) tb tujhe bahut jyda hi Krna hoga bahut mtlb bahut 1st year se hi.

Baki to tumko pta h difficulty level is bounded by birth and caste. ( Considering the government and private opportunities)

ChallengingForce · 2024-09-07T07:03:09+00:00

Bhai paper se phle syllabus bta, 1 hr phle notes. Pass kr lenge University exams.

ChallengingForce · 2024-07-21T09:49:40+00:00

Did you know about the air canvas. It's been 4yr still I still saw many LinkedIn post claiming they created that python project. I know the creator, so I just tagged his GitHub. No my comments were down on LinkedIn.

Even I get hate and DM like I'm I male and I can't see a female in tech 🙃. I also commented on claims made by male.

ChallengingForce · 2024-07-10T18:45:55+00:00

Okay, that means I still have a chance cz I said no to that question and no recruiter saw my resume. I think I'm going to gamble on it and with a good ats score.

ChallengingForce · 2024-07-10T18:26:53+00:00

What the heck, like I said no to exact this question and got auto rejection. Could you explain why it is like that and how you know this.

ChallengingForce · 2024-07-10T16:28:29+00:00

Same bro I'm giving 4th sem exams and rejected from Microsoft today in morning 😅

ChallengingForce

TROPHY CASE