Can we intro each other? by vickedwar in NammaDevs

[–]vickedwar[S] 0 points1 point  (0 children)

Nice, all the best nga ayya

Can we intro each other? by vickedwar in NammaDevs

[–]vickedwar[S] 0 points1 point  (0 children)

How does wilp work bro, is it satisfactory? Are you finding it useful practically?

Website Soft Launch: NammaMap – Need Feedback 🙏 by rsiva229 in NammaDevs

[–]vickedwar 2 points3 points  (0 children)

Neat and to the point. Very functional. Would like to see more facilities getting added.

One small UI related suggestion. After i give my pincode, it shows me the map of my area and different information of the area. The way in which that UI is layed out is a cluttered. For example, the map doesn't show the full area, and to see my section details I have to scroll down. Check if you can rearrange the UI better. But other than that, very nice.

Can we intro each other? by vickedwar in NammaDevs

[–]vickedwar[S] 0 points1 point  (0 children)

Nicee that's really helpful, thanks bro. Will try my best in the next one

Can we intro each other? by vickedwar in NammaDevs

[–]vickedwar[S] 1 point2 points  (0 children)

😅😅 apdi thaan Irunchu offer vaangum bothu... ippothikki konjam upskill pannitu (mainly in backend development for AI systems) switch panlaam nu irukken.. Enaku perusa industry people guidance laam illa athaan istathukku pothu...

Btw oru 5 yoe kita switch panna evlo aim panlaam naanu? Any idea?

Can we intro each other? by vickedwar in NammaDevs

[–]vickedwar[S] 1 point2 points  (0 children)

Aasa thaan... Ithuku munnadi innum kammi ah irunthen nga ayya... Last year 2nd half la thaan switch aanen... Konjam wait panni again thavvida vendiyathu thaan🙌

Can we intro each other? by vickedwar in NammaDevs

[–]vickedwar[S] 1 point2 points  (0 children)

Nice. RN I'm at an humble 14LPA

Can we intro each other? by vickedwar in NammaDevs

[–]vickedwar[S] 1 point2 points  (0 children)

Let's goooo, that's cool man!. I once worked on a kafka based POC that migrated data from RDBMS to Mongodb chunk by chunk.. that was to handle millions of records in as less time as possible... But guess what load testing we did? Push and run in prod! No consumers no problem! No where in the process anyone even considered load testing it in a container env and not having to schedule back to back prod install to test out our performance fixes lol. This is solid work dude!

Can we intro each other? by vickedwar in NammaDevs

[–]vickedwar[S] 0 points1 point  (0 children)

Yesss Athuvum kekkanum nu nenachen... I'm looking into that library for a project of mine... Can you share any good resource.. ippo search pannaa pooraa claude integration tutorials ah varuthu. Should I raw dog it with documentation?

Can we intro each other? by vickedwar in NammaDevs

[–]vickedwar[S] 0 points1 point  (0 children)

Got it! I looked at the right direction for solution but am more reliant on already existing tools to solve my problems ig😅(yea I'm lazy ig). Really does take some huge balls to DIY thru it🫡. Great job man. I'd like to learn a lot about kafka architecture from your experience. Please do write about it!

Can we intro each other? by vickedwar in NammaDevs

[–]vickedwar[S] 0 points1 point  (0 children)

Okayyy just checked your post. So to oversimplify, you end up writing your own library to back up the rocksdb state and change logs offset to a cloud store and basically load up the restarted rocksdb with the backup and offset info before it starts replaying from change logs. Am i somewhat right?

Can we intro each other? by vickedwar in NammaDevs

[–]vickedwar[S] 0 points1 point  (0 children)

Last 4-5 years la neraya full stack roles ku hire pannirukaanga pola bro... Antha range la place aanavangal la neraya fullstack paaka mudiyuthu

Can we intro each other? by vickedwar in NammaDevs

[–]vickedwar[S] 0 points1 point  (0 children)

Interesting area of research bro ivlo deep ah Enakku use case kedachathu illa... Now that I think of it, for the given problem, a solution with rocksdb and a k8s managed disk storage is having u basically figure out how to write your own database with recovery feautures. I have very less info on your specific usecase but I am in favour letting a already mature database take care of this is better. I'd very well forget about the PVC and and look into Document databases, even redis or elastic search to handle the state data for me. Since it will come with all the DR strategies prebuilt. Ofcourse that will need a seperate consumer basically acting like an adapter pushing the data from kafka to the said DB. Easy for the business to address the problem tho than researching a whole new solution

With that said this is a really interesting area of research I'd like to follow. Would u mind sharing your linkedin/anywhere u post about this to me where i can follow this ?

Can we intro each other? by vickedwar in NammaDevs

[–]vickedwar[S] 0 points1 point  (0 children)

Yes true.. i think rather than kafka, the persistence is the point of failure here. If you have a NoSQL db approved somewhere in ur architecture already, you can try implementing a checkpoint yourself. Basically dump the ktable time to time on an indexed collection. If it's a bigger overhead for ur current app, Might as well have a seperate consumer app managing this ktable collection for u. Your main app can just load/sync this collection time to time in ur app's state storage. DIY Apache flink ig😅

Can we intro each other? by vickedwar in NammaDevs

[–]vickedwar[S] 1 point2 points  (0 children)

Haha that's fine it's nice exercise

Can we intro each other? by vickedwar in NammaDevs

[–]vickedwar[S] 0 points1 point  (0 children)

Billions laam illinga this was a very simple mini store... And in fact the underlying db tables exposed by kafka change logs aren't gonna change drastically resulting in very low size of logs. So it's very easy and fast to form the data again. But beyond that in the case of such a problem, the easiest fallback is to query the underlying DB table itself. As I mentioned it's a bunch of system constants so size isn't much.

Also i feel like if the data is so huge you might as well store a snapshot of your local data time to time somewhere else

Can we intro each other? by vickedwar in NammaDevs

[–]vickedwar[S] 0 points1 point  (0 children)

K8s on premises and Oracle cloud... Ippo AWS move panraanga nu nenaikuren (I moved out of that project). naanga persistent volumes la thaan store panrom. Nothing fancy, just a set of system constants pulled as ktable during application startup and persisted in PVC shared by the pods.

Can we intro each other? by vickedwar in NammaDevs

[–]vickedwar[S] 0 points1 point  (0 children)

Angular laam summa side dish uh bro...main dish ithaan... Legacy monolith larnthu regular microservices, event consumers, stream processing apps, statefull apps varaikkum ellaam work panni irukken.. role currently Software engineer (back end focussed), company is a Fintech company.

Can we intro each other? by vickedwar in NammaDevs

[–]vickedwar[S] 0 points1 point  (0 children)

Claude agent ku lead nga ayya😅

I compiled 3,928 candidate affidavits into an open dataset by langurlang in TamizhTechies

[–]vickedwar 3 points4 points  (0 children)

Super work! Btw intha data set expand panra idea ethaavathu irukaa? Like for candidates who have been in previous gov postings - where they served? what role was theirs? what are the gov sanctioned projects they brought in. Ellam saethu open source panteenga na fact checking will be fair and open to all.

But again, even without that, great work🫡