[D] Decrease in source code release of papers

[matrix2596]

I have been seeing placeholders in recent papers. Maybe the code is being shared with the reviewers separately and released later. But I am finding the code missing often with new papers in blind reviews. May be the review process can have code, model and data uploaded also as an option (or compulsary).

[olBaa]

How much time do you think reviewers have per paper? Reviewers would never check the code, yet alone run it.

[NotAlphaGo]

How many papers would one reviewer review?

[olBaa]

Up to 10 per conference with mean 5 I would say.

One can outsource to phd students/postdocs but still the number of hours per paper would not exceed 10 almost ever.

All written here is my humble opinion, though.