Self-hosted AI detector in text submissions
reddit / selfhosted

----------------------------------------------------------------------
scelifer · 2023-12-19 09:10

Any self-hosted projects that can help a school detect AI/LLM text
generation in student submissions?

----------------------------------------------------------------------
wakomorny · 2023-12-19 09:35

No there isnt. There is nothing that works reliably yet

----------------------------------------------------------------------
DNAblue2112 · 2023-12-19 11:09

Even the big products like Turn It In can't reliably do it yet. I
doubt we'll get anything reliable for a while.

----------------------------------------------------------------------
VoltageDolphin · 2023-12-19 11:28

You are going to get it wrong. Please do not do this. Use your own
discretion and mark your shit like you expect students to do their
work.

----------------------------------------------------------------------
ZAFJB · 2023-12-19 12:55

Whatever you use it will produce abysmal results, and wrongly penalise
innocent students.

The Internet is full of reports of students being unfairly penalised
for supposedly using AI/LLM generation when they didn't.

People marking submissions should do their job properly and actually
read the students submissions, and make their own value judgements. If
necessary talk to the student, in person. That way they can quickly
find out if the student actually knows the subject, or not.

TLDR: Don't use AI to solve the AI 'threat'.

----------------------------------------------------------------------
nonlinear_nyc · 2023-12-19 13:29

You'll end up accusing innocent people. Don't do it.

----------------------------------------------------------------------
Toutanus · 2023-12-19 15:25

Something like this ? https://g.co/kgs/3r4Xq9

----------------------------------------------------------------------
neozahikel · 2023-12-19 19:13

This is the wrong solution to a wrong problem. If what you want is
ensure that students are able to do something, just do exams in a
controlled environment and stop asking home work.

Home works are anyway an unfair grading system as someone rich enough
was already able to pay someone else to do it for themselves, ask
their parents, sibling, friends, etc.. and now ask an AI.

The fear of AI some teachers exhibit is a bit odd as it's just a clear
revelator of the weakness of a flawed system. Stop grading students
unfairly and do exams.

----------------------------------------------------------------------
Nintenuendo_ · 2023-12-19 20:01

Exactly, do not try this, you'll get false hits and make false
accusations.  One is too much.

Go through submissions like the expert you are