HUMAN-IN-THE-LOOPSTRUCTURED POLICY INTELLIGENCEAI & BROKERS

Judgment in the Age of AI: Why Human Decisions Still Matter in Regulated Advice

Simon Archer
Simon Archer
Co-Founder, PolicyCheck
May 28, 2026 • 4 min read

Judgment in the Age of AI: Why Human Decisions Still Matter in Regulated Advice

A broker I know was asked by a client why their renewal premium had jumped 40%. The insurer’s schedule showed a higher sum insured, a new exclusion for coastal erosion, and a reduced business interruption period — all buried across different sections of a 90-page wording. The broker had twenty minutes before the client meeting. What happened next is, I think, the best argument for why human judgement isn’t going anywhere.

Reading versus understanding

The broker used a structured intelligence tool to surface the three material changes in seconds. The system read the wording, compared it to last year’s, and flagged the deltas with clause references. That’s the reading part — and it’s where AI genuinely helps. But here’s what the system couldn’t do: it couldn’t know that this particular client had just invested in a coastal development. It couldn’t weigh the commercial relationship, or judge that the erosion exclusion was the one change worth fighting on at renewal. It couldn’t read the room.

The line I keep coming back to

In my experience, the line between what AI should do and what the adviser should do is simpler than people make it: the system does the reading, the person does the thinking. That sounds obvious, but most AI tools blur it. They read and then recommend — skipping the part where a human weighs context, risk appetite, and commercial reality. When a system reads a policy and shows its working — here’s what changed, here’s the clause, here’s the evidence — the adviser can think faster and advise better. But the judgement stays with them. That’s not a limitation. It’s the design.

What I’d tell a broker starting out with AI

Don’t look for a tool that gives you answers. Look for one that does the reading and shows you what it found, with the evidence to check it. Your judgement is the product. The intelligence is just the preparation. The firms that understand this distinction will be the ones clients trust in ten years — because they’ll be the ones who can prove how every recommendation was formed.

PolicyCheck

About PolicyCheck

PolicyCheck is New Zealand's leading platform for tracking government promises and policy implementation. We believe democracy works best when citizens have access to clear, objective information about what their representatives promise and what they deliver.

Our team of researchers, policy analysts, and journalists work to provide accurate, non-partisan tracking of political commitments across all levels of government. We're committed to transparency, accountability, and empowering New Zealanders to make informed decisions about their democracy.

Explore PolicyCheck