Skip to main content

Precision Check: A Critical Look at the Reliability of AI Detection Tools

Debates concerning the creativity, ethics, and the changing nature of learning have undoubtedly been triggered by the expanding application of students using generative AI in academia to complete their assignments. These tools raise questions regarding academic integrity. Differentiating between human created assignments and AI written material has become a challenge for educators and institutions. An experiment was conducted to test the efficacy and validity of AI detecting tools. Three tools were tested, GPTZero, Quillbot, and Polygraf AI, using 100 samples that were written by a human, completely written using AI or a combination of both human and AI written material to determine the capability of tools AI detecting capabilities.

Karen Paullet
Robert Morris University
United States
paullet@rmu.edu

 

Jamie Pinchot
Robert Morris University
United States
pinchot@rmu.edu

 

Evan Kinney
Robert Morris University
United States
kinney@rmu.edu

 

Tyler Stewart
Robert Morris University
United States
stewartty@rmu.edu