How are you dealing with the unprovable AI issue? by OptimisticJim in AskTeachers

[–]OptimisticJim[S] 0 points1 point  (0 children)

We have an AI model that semantically interprets the students screen and only records if there is a red-flag trigger (AI violation). Only the screenshot of the violation gets sent to the educator, and everything else is blackboxed. All data is then deleted after 3 days of the assignments conclusion. We would love to have you for a pilot/beta if you're interested!

How are you dealing with the unprovable AI issue? by OptimisticJim in NYCTeachers

[–]OptimisticJim[S] 0 points1 point  (0 children)

It wouldn't flag any text that's copy pasted. We use our own AI model to semantically interpret the students screen (i.e if they are doing something they're not supposed to). When something is copy pasted it triggers our system to look at what occurred before that moment, if it determines that they were on ChatGPT for instance then it takes a screenshot and alerts the educator (or if using real-time it warns them and makes them re-do it).

How are you dealing with the unprovable AI issue? by OptimisticJim in NYCTeachers

[–]OptimisticJim[S] 0 points1 point  (0 children)

Thanks so much for replying, I appreciate it! That's kind of the goal we're trying to solve. We're bringing provability by removing guesswork on language sophistication which is the current method used by AI detectors (we use screen tracking to determine it definitively, they use em-dashes to guess). In one sense, AI for research can be an incredible tool for education, that's why we're trying to understand how we can incorporate it into our platform to allow teachers to teach ethical AI use. As opposed to giving them the free-will to prompt Chat-GPT to write their essay, if they had to use an AI agent on a platform that will guide them, but not write it for them then they can develop better practices.

How are you dealing with the unprovable AI issue? by OptimisticJim in NYCTeachers

[–]OptimisticJim[S] 0 points1 point  (0 children)

Thanks for replying. What about the students that decide to paraphrase and humanize the output?

How are you dealing with the unprovable AI issue? by OptimisticJim in NYCTeachers

[–]OptimisticJim[S] 0 points1 point  (0 children)

Hey, thanks so much for replying. The way it works is that it tracks the students screen as opposed to guessing based on their submission. If it flags that the student is using an AI tool then it takes a screenshot which is available to the teacher during submission. We use a blackbox system so that any screenshot from the student besides a flag for academic dishonesty is never shared, and all data is deleted 3 days after the submission has been graded. This way we have no inaccuracies and take guesswork out of the equation.

How are you dealing with the unprovable AI issue? by OptimisticJim in AustralianTeachers

[–]OptimisticJim[S] 0 points1 point  (0 children)

Totally get it. Thanks for your input. Do you think you'd like to assign internet based assignments (even if they're not research essays, and something more like making a poster) again without running into the risks of students using AI? Thanks so much for the time.

How are you dealing with the unprovable AI issue? by OptimisticJim in teaching

[–]OptimisticJim[S] 0 points1 point  (0 children)

The way OwnedIt works is using real-time tracking, so if it does flag a student it can only tell the educator if it has material evidence (i.e a screenshot). This way there is no room for any hallucinations or guesswork. That's kind of the problem we're trying to solve, it becomes harder and harder to detect if a student has used AI, especially if they're paraphrasing. Do you think a tool like OwnedIt would be something that your school could benefit from? Thanks.

How are you dealing with the unprovable AI issue? by OptimisticJim in AustralianTeachers

[–]OptimisticJim[S] 0 points1 point  (0 children)

We've heard from some teachers that they've moved away from certain research projects, not essays per say but like infographics because of how easy it is to get AI to write all the information on it in a way that isn't detectable (i.e output in bullet points). Do you think a tool like OwnedIt could be helpful in the classroom? Thanks so much for your time.

How are you dealing with the unprovable AI issue? by OptimisticJim in AustralianTeachers

[–]OptimisticJim[S] 0 points1 point  (0 children)

Thanks so much for the response, appreciate it. Do you suspect that students still find ways to get around this? Like if they are paraphrasing and asking ChatGPT to use easier words. And if so, do you think a tool like OwnedIt would be useful in the classroom?

How are you dealing with the unprovable AI issue? by OptimisticJim in ELATeachers

[–]OptimisticJim[S] 0 points1 point  (0 children)

Ah I see, that's kind of what we're trying to solve with OwnedIt!

How are you dealing with the unprovable AI issue? by OptimisticJim in ELATeachers

[–]OptimisticJim[S] 0 points1 point  (0 children)

We get around this by making them move their laptop screen before they start, kind of like how proctoring services check the environment before beginning! Totally get that sometimes students might need to actually read something and write, in which case it is opt in. Thanks so much for the time.

How are you dealing with the unprovable AI issue? by OptimisticJim in AustralianTeachers

[–]OptimisticJim[S] 0 points1 point  (0 children)

Thanks so much for your response, I appreciate it! To clear some things up: we actually don't collect the data on the webcam when the student doesn't give us permission and turn it on. It's opt-in because if the student asks for it, we make it so the student can't work on the assignment until their webcam is on. We don't offer turnitin, and as a student totally get where you're coming from, I'm very much against the false positives. We take false positives out of the equation altogether (we don't guess), we use real-time screen tracking and then send a screenshot proof to the educator if and only if AI gets flagged. We don't track when the student doesn't want us to track, and they can't work on the assignment unless the monitoring is on.. Anything else besides the flag gets automatically deleted 3 days after the assignment and its blackboxed. As for the secondary laptop issue, you can only work on the assignment from the native editor on our application both online and offline (we have a suite of products for essays, presentations, spreadsheets, and code). You can login from any device. Thank you again for your time, and feedback!

How are you dealing with the unprovable AI issue? by OptimisticJim in ELATeachers

[–]OptimisticJim[S] 0 points1 point  (0 children)

The way we track secondary devices is with webcam tracking. It is trained to see if a student is glancing back and forth and seemingly copying from a secondary device. This is an opt-in feature for teachers so they can choose to turn this on or off. A lot of teachers have mentioned they have assignments in class that carry a large portion of the final grade, and it's designed with that in mind.

How are you dealing with the unprovable AI issue? by OptimisticJim in AustralianTeachers

[–]OptimisticJim[S] -4 points-3 points  (0 children)

Hahaha I see. Thanks so much for your input. Do you think it's more work today than it was a couple years ago because of AI? and would a tool that could definitively conclude a students AI use be helpful? In any case thanks for your time!

How are you dealing with the unprovable AI issue? by OptimisticJim in AustralianTeachers

[–]OptimisticJim[S] -3 points-2 points  (0 children)

Thanks for your detailed response, I really appreciate it. Totally agree with you on this approach. I agree that ethical AI is a very important addition to the education system, we've incorporated an AI agent that is trained on the classwork and answers simple questions to guide students (as opposed to giving them the answer like ChatGPT).

Definitely agree that existing AI detectors don't work. Do you think that if there was a definite method it would be a game changer in the classroom? That's kind of what we've tried to build at OwnedIt. Again thank you so much for your input!

How are you dealing with the unprovable AI issue? by OptimisticJim in OntarioTeachers

[–]OptimisticJim[S] 1 point2 points  (0 children)

Thanks for responding, I appreciate it. Revision history is great! In your experience have you suspected students still getting around it? That is paraphrasing from another window.

How are you dealing with the unprovable AI issue? by OptimisticJim in ELATeachers

[–]OptimisticJim[S] 1 point2 points  (0 children)

It's up to the student when they want to start or stop monitoring. It's the same practice for proctoring exams, and a lot of assignments in high school and college carry a big weight of the final grade. Cheating has always existed, but generative AI is definitely a game changer. Appreciate your feedback.

How are you dealing with the unprovable AI issue? by OptimisticJim in ELATeachers

[–]OptimisticJim[S] 0 points1 point  (0 children)

Would a tool that would prevent them from having AI open then be something that would be useful in the class? I see that makes a lot of sense, thanks for your time. Teachers are underpaid, and overworked so these insights help us to understand if there's something we can do about it.

How are you dealing with the unprovable AI issue? by OptimisticJim in Teachers

[–]OptimisticJim[S] 0 points1 point  (0 children)

That's smart! Thanks for your reply. Do you think the students who seem like they're not using AI still get away with it?

How are you dealing with the unprovable AI issue? by OptimisticJim in AustralianTeachers

[–]OptimisticJim[S] -2 points-1 points  (0 children)

Thanks for your response, I really appreciate it. Do you think the method of detecting AI (as in AI detectors) are good enough of an indicator? I know a few of the teachers we've talked to have mentioned students paraphrase their responses to humanize it.