OpenAI has revolutionized the world of artificial intelligence since the inception of ChatGPT and keeps evolving to bring more advancements to user interaction with the AI tool and how information is accessed. There is no denying that the company has brought convenience and utility to users from varied fields. However, data misuse is very common, especially in workplaces and academic institutions. To deal with this problem, OpenAI has been working for the past year on a detection tool but is not releasing it yet, despite the growing concerns.
OpenAI has an AI text watermarking and detection tool that it is not rolling out due to taking a 'deliberate approach'
ChatGPT has changed the AI game and how content is generated and used. Like any AI tool, the language model has enhanced access to information and how it's presented. However, with the advancement came various threats regarding students misusing the tool for cheating and content creators presenting text generated through prompts as original.
To minimize this problem, OpenAI has been working on a tool to detect users who rely entirely on ChatGPT for content creation. However, despite how widespread the concern regarding the loopholes seems to be, the company has still not rolled out the tool and is still weighing the potential impact and outcomes, as per a Wall Street Journal report.
OpenAI updated its blog post regarding its tool for detecting AI-generated content and its watermarking method. It suggested that the technique is effective in localized tampering, such as paraphrasing, but would not be as accurate with globalized tampering that involves rewriting, for instance. Since the method can let bad actors find a workaround and potentially discourage non-native speakers from using the tool, OpenAI seems hesitant and is internally discussing whether to release the tool.
Even though OpenAI confirmed to TechCrunch that the method's accuracy is close to 99.9 percent, it will still go with a 'deliberate approach.' The company's spokesperson said that they are dealing with caution due to:
“The complexities involved and its likely impact on the broader ecosystem beyond OpenAI."
Another possible reason OpenAI seems reluctant to release the tool is the potential ChatGPT users it could lose due to the watermarking. About 30 percent of ChatGPT users mentioned that they might not use the tool as frequently once the watermarking system is intact.
OpenAI also mentioned in its blog post that they are exploring text metadata as an alternative approach since it is cryptographically signed, ensuring no false positives. However, it is still too early to know if this approach would be effective and what kind of impact it would have. We will keep an eye out for further developments, so stay tuned.
Follow Wccftech on Google to get more of our news coverage in your feeds.
