I’ve been constantly running into false positive issues lately with Codex, but today is particularly bad. I’ve been running an automated (general) review of a fairly large project that we started working on before ChatGPT was even released. I hadn’t even asked it to run a security audit (though that would be ideal).

It is frequently stopping work because it runs into the automated classifiers which trigger false positives. I’ve been able to get codex to verify that I’m the majority shareholder of the company via ISED, that we own the trademarks in ~3 dozen countries for the software we’re working on via WIPO, that the source code and all proprietary libraries (written by us as well) are available on my system, the website source code is available on my system, and that information about me owning the software/company are available on reputable websites.

It should have no issue verifying that a general audit is safe, but it still runs into false positives with the classifiers. We can’t even sign-up for basic TAC because we receive this message: “Your identity couldn’t be verified or your account is ineligible at this time”. I reached out to support and they said there’s nothing they can do. I suspect either account age or an abundance of false positives have contributed to this, but it’s truly just speculation on my part.

Conversely, Anthropic had no issue giving us significantly extended permissions in their CVP program beyond what their CVP would normally offer and let us verify who we are. We can’t even get to the point where we can verify ourselves with OpenAI, and we’re reaching a point where it might not be tenable to use Codex if this continues.

This is less of a request for support, and more general feedback as situations like this should allow developers to verify they are who they say they are, and that they’re authorized to do the work they’re attempting to do.