AI agents are coming, and one already tried to buy pavlova ingredients without asking

A pavlova order shows the powerful capabilities and dangers of agentic AI. (Image: NZME)

Tue, 22 Jul 2025

The general public will have greater access to artificial intelligence agents over the next few weeks, but you might also want to hear the tale of an aborted New World Pavlova order before sharing too much information with it.Deloitte NZ AI Institute generative lead Amanda Williamson tested the service over the weekend by having it order a pavlova for her. A few minutes later, the artificial intelligence (AI) had filled her shopping cart with ingredients and tried to charge it to an old credit card of hers. Welcome to the world of Agentic...

Subscribe to BusinessDesk

Stay informed on business, government and financial developments across New Zealand.

Deeply researched, twice-edited and fact-checked news
Annual subscribers also receive a complimentary subscription to The Wall Street Journal
Personalised email news alerts, plus gift up to 5 stories a month to non-subscribers

You can cancel anytime with two clicks, an email or a phone call.
Find out more.

We are serious about journalism.

Already a Subscriber ? Sign in here.

Name {{ registerForm.errors.get('name') }}

Email address {{ registerForm.errors.get('email') }}

Phone Number {{ registerForm.errors.get('phone') }}

Job Title {{ registerForm.errors.get('title') }}

Password Minimum password length of 8 characters.
Require at least one upper and lowercase, numeric, and special character. {{ registerForm.errors.get('password') }}

Repeat password {{ registerForm.errors.get('password_confirmation') }}

We had trouble validating your card. It's possible your card provider is preventing us from charging the card. Please contact your card provider or customer support.

Credit Card

Cardholder's name

{{ __(plans[index].name) | capitalize }} {{ plans[index].attributes.old_price | currency }} {{ plans[index].price | currency }}

All subscriptions auto renew but are easy to cancel.

I Accept The Terms Of Service

{{ registerForm.errors.get('terms') }}

Tax: {{ taxAmount(selectedPlan) | currency }}

Total Price Including Tax: {{ priceWithTax(selectedPlan) | currency }} {{ selectedPlan.type == 'user' && spark.chargesUsersPerSeat ? '/ '+ spark.seatName : '' }} {{ selectedPlan.type == 'user' && spark.chargesUsersPerTeam ? '/ '+ __('teams.team') : '' }} / {{ __(selectedPlan.interval) | capitalize }}