Spearhead AI consulting

Detection of Generative AI text output is hard even for AI

Even Generative AI cannot figure out if a piece of text was written by AI or a human.

I know, it sounds scary 🤯

OpenAI had developed an AI Classifier Tool designed to differentiate between human and AI-written text.

Last month, it shut it down: OpenAI ended its AI classifier on July 20th due to low accuracy. The tool was not effective at catching AI-generated text.

According to OpenAI: “In our evaluations on a “challenge set” of English texts, our classifier correctly identifies 26% of AI-written text (true positives) as ‘likely AI-written’, while incorrectly labeling human-written text as AI-written 9% of the time (false positives).”

Detection is challenging because there are so many permutations and combinations to validate; and thanks to prompt engineering, output created by human inputs and AI algorithms are making it increasingly undetectable.

Ability to detect AI generated information could improve over a period of time; however it could go one of two ways:

a) We successfully build better AI detection techniques that will help us better grade any work output based on whether it is human generated or AI generated.

b) We are not super success with AI detection which would mean AI becomes a de facto standard of how human beings will partner with AI to create text, images, video, and of course, code. This also raises questions about trust, ethics, and the future of AI.

What are your thoughts on this topic of ability or inability to differentiate between AI generated and human generated output?

#generativeai #ethicsinai #ethics #aigovernance

Related Posts

Maximizing Early AI Investments: Four Key Areas Showing Promising ROI

We are in early days of AI, here are four areas where we are seeing ROI indicators...so far.

The Shifting Landscape of Software Development: Overhiring and AI’s Impact on Jobs

Software developer employment is falling off a cliff. My take is that massive overhiring during the pandemic and AI is impacting software dev hiring.

Apple’s WWDC 2024 Announcements Spell the End for These 9 Apps and Software Tools

Apple killed a bunch of apps and software during its WWDC 2024 announcements.

The Future Is Now: Apple’s WWDC 2024 Featuring ‘Apple Intelligence’ and More

For Apple, AI = Apple Intelligence not Artificial Intelligence.

Revolutionary IntelliPhones Set to Debut at Apple’s 2024 WWDC

We are about to go from smartphones to 'intelliphones'.

Driving Business Evolution: The Impact of AI on Organizational Dynamics

Most people think AI is just a technology shift; however AI is fundamentally a business transformation.
Scroll to Top