Menu
Vice President – Operations
“Certainly, here’s a blog post highlighting the challenges a scholarly publisher could face if authors use GenAI to write research papers..”
I didn’t use ChatGPT to write this post, but I was most curious to see what it did say. And if I did use it and didn’t think to edit it, I’d be faced with an irked marketing team.
So what happens when authors writing research papers don’t remember to erase signs of AI help?
Over the last year or so, our copy editors have been finding an increasing amount of AI-generated content in the manuscripts that we receive from scholarly publishers. While it’s nearly impossible to tell exactly what was written by a human and what by ChatGPT or others (they are getting very good, very fast), certain phrases are dead giveaways.
When this problem began to come to light, we put a flagging process in place and began to highlight these AI-content-ridden papers to our customers, who then took the necessary action to ensure research integrity within their publication.
But we needed to make this more efficient and ensure nothing slipped through the cracks.
So we wrote a simple script.
Neel Sinha, our Head of Technology says “We built a script that plugs into our completeness and usability check tool, to scan for phrases that follow a repetitive pattern and are telltale signs of AI-generated content. The tool is already looking for missing details and checking the integrity of all elements in the manuscript; it now also gleans identifiable AI-generated copy.”
Examples of phrases that our script scans for:
We are following a three-step process in our efforts towards ensuring research integrity. And as we identify more phrases, we will continue to update the script. We also keep our teams updated on what to look out for through workshops and knowledge sharing.
Let’s face it, GenAI and all its trimmings are here to stay. One would hope that authors would be more mindful when using GenAI and remove obvious signs of having used it, but perhaps that is wishful thinking. While many people are working hard to solve problems of sophisticated AI manipulations, simple solutions such as our script can address some of the simpler challenges.
In our conversations with scholarly publishers, some common themes have emerged. Most publishers already have policies around GenAI which range from general statements about using AI in research, to separate policies for authors, peer reviewers, and editors. These policies are continuously evolving in order to keep up with advancements in AI. While there is no silver bullet, some simple and innovative tools can help introduce new layers of scrutiny. These tools can be placed throughout your publishing workflow – right from submission, all the way through to proofing and publication.
This is what ChatGPT thinks I should have included in the blog post (which I asked it to generate after I had already written it!)
TNQ Tech Pvt. Ltd.
