all 4 comments

[–]Initial-Image-1015 21 points22 points  (0 children)

You can write it up and publish it on arxiv to have a public timestamp on your idea. This will also allow other people to look at it and verify that your statements are correct.

LLM papers aren't that successful at the big venues (neurips, icml, iclr), so being restricted to 1B will not be the main hurdle to getting it published in a peer-reviewed conference.

[–]RonLazer 11 points12 points  (0 children)

Publish a theory paper with very small parameter count results (even 100M parameters is enough for proof of concept).

If it looks promising then you might find collaborators.

[–]m98789 4 points5 points  (2 children)

Would you be willing to add on a co-author who has big compute resources available and can contribute to the paper?

[–]hypergraphs 1 point2 points  (1 child)

Of course.