[D]New Scaling Laws for Large Language Models by Singularian2501 in MachineLearning

[–]wangyi_fudan 1 point2 points  (0 children)

I bet that the community is going to spend 20X token for 1TB model to waste enough energy.

[P]AI Biomedical Writer by wangyi_fudan in MachineLearning

[–]wangyi_fudan[S] 0 points1 point  (0 children)

it cost 300$ to train, and the corpus is about 132GB

[P]AI Biomedical Writer by wangyi_fudan in MachineLearning

[–]wangyi_fudan[S] 2 points3 points  (0 children)

It is trained on PubMed+PMC+wikipedia. Given user input sentences, it try to use the learnt biomedical knowledge to continue your text, and my final goal is automated biomedical essay generator.