OAKLAND, Calif. - February 13, 2023 - Turnitin has successfully developed an AI writing detector that, in its lab, identifies 97 percent of ChatGPT and GPT3 authored writing, with a very low less than 1/100 false positive rate. The company plans to add this functionality to its core writing integrity products as early as April 2023. The new functionality will operate within the existing Turnitin workflow so that educators will be able to analyze content and use feedback tools in the same user experience they have today.
Turnitin also published an AI writing resource page to support educators with teaching resources and to report its progress in developing AI writing detection features. The newly launched AI writing resource page is publicly available and will be updated regularly with information about Turnitin’s progress in bringing detection features to market including how they are performing in its research and development lab. Turnitin experts in pedagogy and instruction will also contribute to an expanded library of resources to help guide K-12 teachers and higher education faculty on how to adjust to an academic environment where AI writing is used. Additionally, demo and preview videos will be regularly posted.
“Based on how our detection technology is performing in our lab and with a significant number of test samples, we are confident that Turnitin’s AI writing detection capabilities will give educators information to help them decide how to best handle work that may have been influenced by AI writing tools,” said Annie Chechitelli, Chief Product Officer of Turnitin. “Equally important as our confidence in the technology is making the information usable and helpful and in a format that educators can use.”
She added, “We are being very deliberate in releasing a detector that is highly accurate and trained on the largest dataset of academic writing. It is essential that our detector and any others limit false positives that may impact student engagement or motivation.”
“We are very happy to see productive conversations taking place across the education community about academic integrity and tools to ensure the authenticity of authorship,” said Eric Wang, VP of AI for Turnitin. “Teachers should use Turnitin’s detector to have fulsome conversations with students about this technology. We will continue to develop and refine Turnitin’s detector and are confident that as AI writing evolves, our technology will keep pace with new developments and capabilities.”
Wang added, “We have developed state-of-the-art AI writing detection systems using recent advances in deep learning transformer architecture - the same technology that powers GPT-3 and other large language models (LLMs). Our AI writing preview has been trained on academic writing with high efficacy rates and can identify 97% of AI writing, with a very low 1/100 false positive rate. Launching it within our existing flagship products, allows us to provide AI writing detection within the existing workflows that our customers are accustomed to, without having to copy/paste text or upload papers to a new, unverified third party.”
“For over 20 years, Turnitin has been a trusted partner of educators, giving insights into student writing, and helping to uphold the standards of academic integrity,” said Chris Caren, CEO of Turnitin. “Detecting current AI-generated texts and those written by the next generation of AI writers is going to require constant evolution, working closely with educators while training on available, relevant datasets.”
Caren added, “We are reassured by the conversation around detection and other efforts to understand how AI writing impacts education, business, and every other aspect of society. There are risks to AI writing being used improperly, and it is essential that good detection technology is available across all sectors.”