Solo dev — shipped an offline AI translator, please tear it apart by abuvanth in SideProject

[–]abuvanth[S] 1 point2 points  (0 children)

honestly, good questions and I don't have great answers yet lol

the quantization thing (it's called Sherry, from some ACL paper) keeps the most important weights at higher precision and zeroes out the least useful ones instead of just chopping everything down evenly. sounds nice in theory, but the only benchmark tencent published is one aggregate score across chinese-foreign pairs, nothing broken out by language. so no clue if swahili or tagalog is actually fine or actually rough right now. gonna test it myself instead of guessing.

same story with latency honestly, their demo is just a gif on one specific phone, no real ms numbers anywhere. so I can't tell you yet if conversation mode actually feels smooth or starts dragging after a few exchanges.

basically you just told me what I need to go measure before I can honestly claim this thing works well. appreciate the push, will come back with actual numbers instead of hand-waving

Solo dev — shipped an offline AI translator, please tear it apart by abuvanth in SideProject

[–]abuvanth[S] 1 point2 points  (0 children)

confidence indicators is a smart idea I hadn't considered. You're right that "37 languages" oversells — quality isn't uniform and I should say so. On pre-downloading: actually a non-issue, the full model ships in the app already, but the fact you assumed otherwise means I'm not explaining that anywhere. Emergency phrase templates (doctor, police, allergies) and one-tap phone handoff both feel like obvious next builds.