32
AI thinks the US Constitution was written by . . . an AI. -- "In essence, the Constitution's language is so ingrained in these models that they classify it as AI-generated, creating a false positive."
posted ago by Narg ago by Narg +32 / -0

https://arstechnica.com/information-technology/2023/07/why-ai-detectors-think-the-us-constitution-was-written-by-ai/

It's not just the Constitution. AI typically sees well-known Bible verses as being AI-generated.

Weird. And even in general, AI's ability to tell human-created from AI-created text is pretty shaky, so probably best to take assertions on the topic with a grain of salt.

"There is no tool that can reliably detect ChatGPT-4/Bing/Bard writing," Mollick tweeted recently. "The existing tools are trained on GPT-3.5, they have high false positive rates (10%+), and they are incredibly easy to defeat." Additionally, ChatGPT itself cannot assess whether text is AI-written or not, he added, so you can't just paste in text and ask if it was written by ChatGPT.

3 comments
3 comments share save hide report block hide replies