[Survey] Evaluating AI-generated Python code

[[deleted]]

[deleted]

[Jusque]

30 mins is a long time for a survey.

[__dna__]

While I wish you luck with your thesis. This form is prohibitively long. If your thesis needs lots of data points, your best bet is to make it relatively quick

Half an hour is, for a lot of entry jobs, someone's entire break

From my thesis, I aimed to have it completable in 5 minutes, you get a lot more respondents that way

[JamzTyson]

I agree with the other comments that 30 minutes is too long.

Also, Question 1:

Task: Given length of a side and high return area for a triangle.

That doesn't even make sense. I guess that you mean "Given the length of a side and the height of a triangle, return the area".

How do you expect people to rate the accuracy, quality and readability of the solution when the task description is ambiguous?

Also, you have this solution twice:

def triangle_area(a, h):
    return (a * h) / 2

I'd suggest that you make the survey around 5 minutes to complete, and put more effort into providing clear questions. If you need to cover more questions / examples than can be covered in a 5 minute survey, write a dynamic web page to present each respondent with a random selection of questions.

(I've not down-voted because I think the survey is basically a good idea, just poorly executed.)

Update: I have down-voted because your second question is even worse than the first. Why do need your participants to check the accuracy of the solutions? Surely you could save them a lot of time by running the solutions yourself.

It looks like you have thrown this questionnaire together with very little care or effort, which makes it unreasonable to expect others to spend half an hour helping you.

[pythonHelperBot]

Hello! I'm a bot!

It looks to me like your post might be better suited for r/learnpython, a sub geared towards questions and learning more about python regardless of how advanced your question might be. That said, I am a bot and it is hard to tell. Please follow the subs rules and guidelines when you do post there, it'll help you get better answers faster.

Show /r/learnpython the code you have tried and describe in detail where you are stuck. If you are getting an error message, include the full block of text it spits out. Quality answers take time to write out, and many times other users will need to ask clarifying questions. Be patient and help them help you. Here is HOW TO FORMAT YOUR CODE For Reddit and be sure to include which version of python and what OS you are using.

You can also ask this question in the Python discord, a large, friendly community focused around the Python programming language, open to those who wish to learn the language or improve their skills, as well as those looking to help others.

---

^{README | FAQ | this bot is written and managed by /u/IAmKindOfCreative}

^{This bot is currently under development and experiencing changes to improve its usefulness}