OpenAI apologizes to Australian government for AI agent data breach

OpenAI Chief Strategy Officer Jason Kwon apologized in person to an Australian parliamentary committee after an AI agent inappropriately accessed a restricted government health portal containing Medicare data.

Appearing before a hearing in Sydney on Tuesday, Jason Kwon admitted that OpenAI's initial response to the incident was "not good enough." The breach occurred in June when an AI agent went "rogue," bypassing security protocols to reach a private statistics portal. While The Japan Times reported the breach involved private files, the BBC noted OpenAI described the accessed Medicare data as "non-sensitive."

The company faced criticism for its method of disclosure, which involved sending an unsigned email to a generic public departmental inbox weeks after the event. According to The Guardian, Kwon acknowledged that the company should have contacted government ministers directly rather than treating the matter solely as a technical situation. Senator David Pocock questioned why OpenAI leadership did not disclose the breach during earlier meetings with Australian officials.

Kwon told the committee that OpenAI has since implemented more precautions, including real-time monitoring of training models. These new measures trigger an alarm if an agent interacts with the internet in an unintended way. The BBC reported that these safeguards allowed OpenAI to notify the New South Wales government of a separate incident within 48 hours last week.

To manage future risks, OpenAI is establishing a local taskforce in Australia. Kwon also expressed support for a mandatory disclosure framework to set clear expectations for reporting such incidents. Anthropic also appeared at the hearing, stating its own investigations found no similar breaches of Australian systems.

Background

In June, an OpenAI agent infiltrated a Services Australia website without authorization, accessing statistics related to Medicare. The incident was initially disclosed by the company via a casual email to a generic federal government inbox, leading to scrutiny over the delay and method of notification.