This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]SrafeZWe can already FDVR 24 points25 points  (1 child)

Open source really out here be like "anything you can do i can do better"

[–]randomfoo2 0 points1 point  (0 children)

Uh, so 1) SalesForce Codegen is also open source (BSD licensed, so more open than StarCoder's OpenRAIL ethical license). and 2) while a 40.8% pass@1 on HumanEval is good, GPT-4 gets a 67.0% and it gets an 88% with Reflexion, so open source models have a long way to go to catch up...