Robodebt — what happens when accountability and audit fail

What Robodebt was. Between 2015 and 2019 the Australian government raised automated welfare debts against hundreds of thousands of people by averaging their reported annual income across fortnights they may never have earned it in. The system treated the average as the truth and asked the recipient to prove otherwise, often from payslips and bank records years old, or that had never existed. Notices went out without a case officer reading them. The basis on which a person was said to owe money was not recorded anywhere they could examine. When people rang to contest, the lines stayed engaged for hours and reviews ran for months. A Royal Commission later found the scheme unlawful and traced about $565 million in debts raised against people who, in many cases, owed nothing. It is the worst case this library measures itself against. The decisive failure was not that a computer made the decisions; it was that no one built the points at which a person could be told why, be heard, and be believed.

The Australian Robodebt scheme (2015-2019) is the most thoroughly documented case study of what happens when automated government decision-making operates without adequate accountability, audit, or recourse mechanisms.

The scheme replaced manual debt calculation with automated data-matching, comparing Centrelink welfare records with averaged income data from the ATO. It raised incorrect debts (often vastly larger than owed, or entirely non-existent) and reversed the onus of proof, requiring welfare recipients to disprove debts rather than requiring the government to prove them. Key accountability failures:

1. No meaningful human review. Notices were issued without case-officer review; the system operated as a fully automated decision-maker, not a decision-support tool.
2. No adequate audit trail. The basis for each debt was not recorded in a form the citizen could interrogate.
3. No accessible recourse. Call centers were overwhelmed and reviews took unreasonable periods, effectively denying the right to contest.
4. Concealment of unlawfulness. Senior officials took steps to prevent the unlawfulness being uncovered, per the Royal Commission finding.
5. No reversibility mechanism. Even identified-incorrect debts were protracted and burdensome to reverse.

The Royal Commission's report (Commissioner Catherine Holmes AC SC, tabled 7 July 2023) found the scheme unlawful; its 57 recommendations included: people must be told when subject to automated decision-making; a clear path must exist to review and challenge outcomes; business rules and algorithms must be available for independent scrutiny; a body should have power to monitor and audit automated decision-making; and a consistent legal framework should govern automation in government.

The Robodebt failure was also, first, an access failure: overwhelmed call centers and protracted reviews effectively denied the right to contest. The lesson the accountability patterns carry forward is that recourse must be genuinely accessible, with dispute affordances pre-populated from action records rather than gated behind permanently engaged phone lines.

The primary source is the Report of the Royal Commission into the Robodebt Scheme (Commissioner Catherine Holmes AC SC; three volumes; 57 recommendations; tabled 7 July 2023). See also iTnews — Robodebt report, Keypoint Law — Avoiding Robodebt 2.0, and UTS — Reflections on Government Robodebt response.