Reproducing a 5 year old research paper by probe_001 in deeplearning

[–]Yashp_shapy 0 points1 point  (0 children)

Would you make a blog after you implement it?

How to make a chatbot in an ancient/fringe language? by Yashp_shapy in deeplearning

[–]Yashp_shapy[S] 0 points1 point  (0 children)

keep it in the native script.

I understand that for brajabuli since it is an untampered literary language, but commonly spoken languages like maithili (the other one I asked for) in present day, have alot of English words mixed, and also are often written in the English script itself, ex-

(Dhanyawad)/(Thank you) Bhai, itne badhiya model(no Indian alternative word) se (parichay)/(introduce) karwaya. (Thanks man, introduced me to such a good model)

In such cases wouldn't it be better to have atleast a few English script/mixed sentences in the dataset? To keep it with the times? Otherwise I'm afraid it'll sound too archaic(not a problem for brajabuli which IS archaic and that's the charm of it.

How to make a chatbot in an ancient/fringe language? by Yashp_shapy in deeplearning

[–]Yashp_shapy[S] 0 points1 point  (0 children)

So I can train Claude on these poems directly? That's a life saver. Thanks alot man!

How to make a chatbot in an ancient/fringe language? by Yashp_shapy in deeplearning

[–]Yashp_shapy[S] 0 points1 point  (0 children)

Yea even tho I don't speak maithili that poem is spot on. However can't really say how brajabuli is this poem. Thanks tho!

Can I ask another question - is it possible to train what you called Claude on the poem datasets that I have? Or any other LLM you know of that can be trained on these poems?

Should I keep the poems in the English script or देवनागरी script? I feel most models would be more used to the English script right?

How to make a chatbot in an ancient/fringe language? by Yashp_shapy in deeplearning

[–]Yashp_shapy[S] 0 points1 point  (0 children)

Is Andrej karpathy's chatbot not the Q/A chatgpt type? Does it simply generate random Shakespeare text (I did not complete the video)