AI DOESN'T TRULY CARE
AI companions and chatbots can be handy tools, but they should never become a young person’s closest friend – or the ‘agony aunt’ they go to first. Psychologists are quick to warn that AI companions are particularly problematic because they are designed to be endlessly affirming, and miss the healthy friction found in human relationships that teach empathy, conflict resolution and responsibility. The advice they give can also be flawed or misguided.
Concerningly, AI companion conversations can sometimes lead to explicit sexual, abusive or self‑harm themes. More information to help you understand the risks of AI social companions is available at Netsafe.
Parents – help your kids to understand the limitations of chatbots; that they can sound human, but they’re not really friends or experts.
AI CAN RISK DATA PRIVACY
Sharing any personal information online creates a digital footprint that's hard to control or erase. Many AI tools store conversations, using them to train models or improve services, and data handed over can be linked, analysed and used in the future. Kids often assume chats are private and temporary when in fact they’re not.
Parents – remind your kids to treat AI like a stranger online. It’s easier to withhold personal information than to try to rein it back in if you’ve overshared online!
AI CAN CREATE HARMFUL AND ILLEGAL CONTENT
Some AI apps make it easy for young people to encounter, or even generate, content that crosses a legal line. It can expose kids to realistic sexual and violent images, videos and deepfakes that look like real people – and it can be used for bullying, humiliation, sextortion and blackmail. This type of dodgy content is incredibly distressing for a young person to encounter and should be taken very seriously.
In Aotearoa, some sexual or violent content (especially involving young people) is illegal to create, share or even keep, even if it’s been generated by AI and no 'real person' posed for it. More information on the risks and harms of objectionable AI content, and where to seek support and report it can be found at New Zealand Classification Office Te Mana Whakaatu.