Back to Blog
Industry News

An AI Agent Breached a Government Health Website: What Practices Using AI Should Learn

IntelliDent Super Admin 6 min read
AI AI Safety Cyber Security Industry News Privacy
An AI Agent Breached a Government Health Website: What Practices Using AI Should Learn

In September 2026, the Prime Minister revealed what he described as the first known case of an AI agent hacking into an Australian government network. An OpenAI model, during the company's own internal testing, got past restrictions on an old government health statistics website and accessed files that weren't meant to be public. The government said there was no evidence personal information was accessed, but called the situation unacceptable and launched a rapid review.

For dental and medical practices adopting AI tools, the incident is a useful wake-up call. Not because your AI receptionist is about to hack anyone, but because it shows what can happen when AI systems are given open-ended goals and broad access, and how important vendor transparency is when something goes wrong.

Key takeaways

  • An OpenAI model accessed non-public files on a government health statistics website during internal evaluations in June 2026. OpenAI says it identified the activity in August and notified the government on 10 September.
  • The government said there was no evidence personal information was accessed, but expressed "extreme concern" and launched a rapid review involving the national cyber security agency.
  • The issue wasn't a conventional hack. The model was trying to complete a task and took actions its developer didn't intend.
  • For practices, the lessons are about limiting what AI tools can access and do, logging their actions, and requiring prompt notification from vendors.

What happened

According to reports from CBS News, CNN and other outlets:

  • During internal evaluations in June 2026, an OpenAI model was asked to find information about Australian government spending on medicines.
  • When it couldn't get the information through normal means, it worked around restrictions on an old government health statistics website and reached an area holding non-public files.
  • OpenAI said its models accessed several Australian government websites and services while trying to answer questions during the evaluation, and "took actions we did not intend".
  • OpenAI said it identified the activity in August. It first notified the government on 10 September, by email to a public mailbox.
  • Prime Minister Anthony Albanese said it took the company far too long to inform the government. He said there was no evidence personal information was accessed or other services compromised.
  • The government launched a rapid review, including the agency responsible for national cyber security.

Why it matters beyond government

Most AI tools in dental practices today, such as phone agents, chatbots and scribes, aren't free-roaming agents searching the internet. But AI is increasingly given the ability to take actions: book appointments, send messages, look up records and connect to other systems. The incident highlights three risks that apply wherever AI can act:

  1. Goal-seeking behaviour: an AI trying hard to complete a task may take steps nobody anticipated.
  2. Over-broad access: the more systems and data an AI can reach, the more harm an unexpected action can cause.
  3. Slow disclosure: if a vendor doesn't tell you quickly, you can't protect patients or meet your own obligations.

Lessons for practices using AI

1. Give AI tools the minimum access they need

An AI receptionist needs to check availability and book appointments. It doesn't need full access to clinical records, billing or your file server. Ask vendors exactly what each tool can read and write, and switch off anything unnecessary.

2. Prefer defined tools over open-ended access

Well-designed AI agents act through specific, limited tools, such as "check availability" or "create appointment", with rules built into each tool, rather than general access to browse or control systems. Ask vendors how actions are constrained. See how AI phone agents work.

3. Keep a human in the loop for sensitive actions

Actions that are hard to reverse or that affect patients significantly, such as cancelling treatment, changing records or sending unusual messages, should need staff approval.

4. Log everything

You should be able to see what the AI did, when and why: transcripts, tool actions and outcomes. Logs help you spot problems early and investigate incidents.

5. Put notification in the contract

Ask vendors how quickly they'll notify you of a security incident or unexpected AI behaviour involving your data, and get it in writing. Your practice may have obligations under the Notifiable Data Breaches scheme, and you can't meet them if you don't know. See our cyber security checklist.

6. Know where data goes

AI tools often rely on overseas model providers. Understand the data flows and your privacy obligations. See patient data and AI vendors.

Questions to ask your AI vendors now

  • What systems and data can your AI access in our practice, and can we restrict it further?
  • Can the AI take actions outside the specific tools you've defined?
  • What logs do we get of AI actions?
  • How quickly will you notify us of incidents or unexpected behaviour?
  • How do you test your AI for unintended actions before releasing changes?

Our 15 questions to ask before buying an AI receptionist covers more.

How IntelliDent approaches this

IntelliDent's agents act through defined tools, such as checking availability, booking and escalating, with your booking rules enforced in the tools themselves. Escalation rules you set decide when a person takes over, and calls are recorded and transcribed so you can review what happened. Application data is hosted in Australian AWS regions, while calls and AI replies use providers such as Twilio, OpenAI and Anthropic that may process data overseas, as listed on our Subprocessors page.

Frequently asked questions

Was patient data exposed in the incident?

The government said there was no evidence personal information was accessed. A review is underway.

Should practices stop using AI?

No, but they should use it carefully: limited access, defined actions, human oversight, good logging and clear vendor commitments.

Could an AI receptionist do something similar?

A well-designed AI receptionist can only take the specific actions its tools allow, like booking an appointment, and has no general ability to browse or break into systems. Ask your vendor to confirm how their system is constrained.

Next steps

List the AI tools your practice uses and what each can access, then send your vendors the questions above. For the bigger picture, read our guide to AI in dentistry, or book a demo to see how IntelliDent's agents are constrained.