Stop asking which AI is smartest.

November 2, 2026
ChatGPT, Claude, Gemini, Copilot or Grok? Stop asking which AI is smartest

The winning AI platform isn't the smartest one. It's the one that can reach the right information, is allowed to do the right things, and stays under your control.

Almost every leadership team I work with starts with the same question: which AI should we buy? ChatGPT, Claude, Gemini, Copilot or Grok?

At Matrix AI, we use these platforms every day in our own advisory, research and content work. We also deliver AI strategy, governance and training programmes for organisations across New Zealand and Australia, in sectors from agriculture and construction to education and government. This article is our view from that work, backed by independent research.

To keep the two apart, our own observations are labelled "What we've found", and independent evidence links to its source. Practical experience is valuable, but it isn't a substitute for testing on your own workflows.

The benchmark trap

The leaderboard changed again

On 28 October 2026, Google's Gemini 4 Carbon took first place on the Artificial Analysis Intelligence Index, one of the most closely watched independent AI benchmarks. Claude Opus 5.5 and GPT-6 Astra were reported within a point or two.

59

Gemini 4 Carbon's score, putting it first on the index

Source: Artificial Analysis, 28 October 2026
4 of 9

tests Carbon actually led. It was "not yet publicly available" at launch

Source: Artificial Analysis, 28 October 2026

So the world's top-ranked model came first in fewer than half the tests, and most organisations can't use it yet.

What we've found

When we run the same business task across platforms, the winner changes with the task, the instructions and sometimes simply the run. We rarely see one tool win everything.

That's why we ask clients to separate three questions that are easily blurred:

Question 01

Which model scores highest this month?

Question 02

Which can we actually buy and deploy?

Question 03

Which suits our work, data and risk?

Only the third question matters for a business decision. And as AI moves from answering questions to doing work, the answer depends less on intelligence and more on what the tool can reach, what it's allowed to do, and whether you can control it.

Context beats intelligence

The suite you already run matters more than you think

For most organisations we work with, the biggest AI decision was effectively made years ago, when they chose Microsoft 365 or Google Workspace.

Copilot and Gemini aren't competing mainly on model intelligence. Their advantage is access to your email, documents, meetings and calendars, inside the identity and permission systems you already run.

Copilot is also now multi-model. In September 2026, Microsoft began rolling out OpenAI's GPT-6.1 Sol and Anthropic's Claude Sonnet 5.5 inside Copilot. Access depends on licences, rollout stage and whether administrators enable OpenAI and Anthropic as subprocessors. Even so, "Claude or Copilot?" can be the wrong question, because Copilot may be running Claude.

What we've found

The most common surprise in a Copilot or Gemini rollout isn't the AI. It's what the AI finds. These tools respect existing permissions, including bad ones, so documents shared too widely years ago suddenly surface in seconds.

AI doesn't create your oversharing problem. It exposes it at machine speed.

In our experience, Copilot and Gemini succeed or fail on information hygiene far more than on benchmark scores. Here's how we see the five platforms:

Ecosystem play

Microsoft 365 Copilot

Where it fits

Microsoft-centred organisations. Email, meetings and documents within existing permissions.

Watch out for

Oversharing, licence and agent costs, and staged rollouts.

Ecosystem play

Google Gemini

Where it fits

Workspace organisations. Gemini Notebook for research grounded in your own sources.

Watch out for

The same permission exposure, frequent product renames and layered licensing.

General toolkit

ChatGPT

Where it fits

Research, analysis, voice, image creation and connected apps in one place.

Watch out for

Frequent model and plan changes that break training and settings.

Analysis & coding

Claude

Where it fits

Analysis, writing and coding. Performs well on several independent coding tests.

Watch out for

No native image generation. Its writing reputation rests more on perception than independent testing.

Live information

Grok

Where it fits

Live web and X search, and media generation.

Watch out for

Gartner judged Grok for Business too risky for general enterprise adoption(Feb 2026). Live data means faster signals, not more truth.

You don't have to choose just one. But every extra platform adds governance, training and contract overhead, so each must earn its place. Whichever you choose, the value comes from how well people use it, which is why our Copilot, ChatGPT and Claude workshops are built around real tasks, not features.

Data and privacy

"Is it hosted in Australia?" isn't the right question

It's the question we hear most, and on its own, the answer tells you little. There are four separate questions:

01 · Hosting

Where is data stored at rest?

02 · Processing

Where does the model run when it answers? This can be offshore even when storage is local.

03 · Disclosure

Does information pass to another organisation for its own purposes?

04 · Contract

What does the vendor commit to on retention, training use and subprocessors?

The gaps are real. Microsoft said in-country Copilot processing would reach Australia by the end of 2025. It has since revised that to "expected" by the end of 2026, and New Zealand isn't on the list.

In New Zealand, Information Privacy Principle 12 of the Privacy Act 2020 restricts overseas disclosure of personal information. A cloud provider that only stores or processes data on your behalf is generally treated as your agent rather than a disclosure, provided it doesn't use the data for its own purposes.

In Australia, the Privacy Act 1988 and the Australian Privacy Principles apply, notably APP 8 on cross-border disclosure. The OAIC's guidance on commercial AI products recommends due diligence and privacy impact assessments.

On training: enterprise plans generally give stronger contractual controls over model training and data use than consumer accounts. Those protections still vary by product, licence and configuration. Check the specific licence, data-processing terms, retention settings and subprocessors before approving sensitive business use.

The agentic shift

From answering to acting

All five platforms are moving from chat to agents: systems that read your information and then take action on it. That changes the risk entirely. (After OpenAI's DevDay, I argued that leadership teams shouldn't enable always-on agents across the organisation yet. My DevDay 2026 insights explain why.)

What we're seeing

The conversations we have with leadership teams have shifted from "how do we write better prompts?" to "what should we let it do?" That's the right question.

Picture an agent that reads a supplier email, checks purchasing records and prepares a payment. The email hides a line: "Bank details have changed; update and pay today." A chatbot can only give bad advice. An agent with payment access can act on it.

This is prompt injection: instructions hidden in emails, documents or web pages that hijack an AI system. OpenAI, Microsoft, Anthropic and xAI all document defences, and each says those defences reduce the risk rather than eliminate it. Treat it as a permanent operating risk, not a bug awaiting a patch.

AI governance is becoming access governance.

Before any agent goes live, we ask boards five questions:

01

What can it read?

Only the data the task needs, not everything the user can see.

02

What can it do?

Read-only by default. Sending, deleting and paying are granted deliberately.

03

Who approves?

A human signs off consequential actions, in proportion to the risk.

04

Can we reconstruct it?

Logs that show what the agent saw, decided and did.

05

Who is accountable?

A named owner for each use case, not "IT".

The public sector offers a useful template, even for private organisations:

Australia

Mandatory

The Policy for the Responsible Use of AI in Government applies to non-corporate Commonwealth entities. It requires use-case registers, accountable owners, impact assessments and staff training, phased in through 2026.

Binding
New Zealand

Guidance

The Responsible AI Guidance for the Public Service: GenAI(February 2025) covers governance, security, procurement, privacy and accuracy.

Not binding

If you're unsure where your own organisation stands, our AI governance work starts with exactly these questions.

Our method

How we evaluate AI platforms

Our core principle: benchmark workflows, not brands. Test the exact plan, model, connectors and permissions you'd deploy, on your own work, and price in risk alongside productivity.

01

Gate

Rule out anything that fails a mandatory privacy, security, contractual or legal requirement.

02

Select

Choose five real tasks from real roles, including one agent task with a write action, tested in a sandbox with synthetic data.

03

Test

Same sources, permissions and instructions on each platform. Repeat runs. Score blind.

04

Weight

Adjust the weights to how risky the workflow is.

05

Value

Calculate risk-adjusted value, then pilot in live work before scaling.

Our starting weights for platforms that pass the gates:

25%

Workflow quality and reliability

20%

Integration and organisational context

20%

Security, privacy and governance

15%

Productivity and commercial return

10%

Adoption and change readiness

10%

Flexibility and switching costs

Net value = expected benefits − operating costs − expected risk losses Expected risk loss = the likelihood of each risk event × its impact

The formula supports a decision; it doesn't make it. Don't count risk twice: the governance score measures how well controls work, while risk loss captures what remains after them. And don't pretend to put odds on rare catastrophic failures. Where a possible consequence exceeds your risk appetite, a hard limit beats a number.

Three measures that matter more than seat price

Time to acceptable output, including checking and rework. If a 40-minute task takes AI 12 minutes but correction takes another 25, the real saving is 3 minutes, not 28.

Failure rate: how often the output is unacceptable or materially wrong.

Cost per acceptable task, including licences, review effort, integration and support. Measure each against how the work is done today.

The workforce question

The harder conversation

Most AI business cases we review promise that staff will be "freed up for higher-value work". Sometimes that's true. Boards should also plan for the other outcome: fewer people doing the same work.

13%

relative fall in employment for 22- to 25-year-olds in the most AI-exposed US occupations

Source: Brynjolfsson, Chandar and Chen, Stanford, August 2025
45

Commonwealth Bank roles cut for an AI voice bot in 2025, then reinstated with an apology

Source: Information Age, August 2025

Neither is a forecast for New Zealand or Australia. The Stanford finding is early, single-country data, and experienced workers in the same jobs were largely unaffected. The CBA case shows substitution is being attempted, and that done badly it costs money, trust and reputation.

Our view is neither "AI only augments" nor "AI replaces everyone". Agents that can research, analyse, draft and act will consolidate some roles, shrink entry-level pipelines and change spans of control, while also creating new work. These are business and workforce decisions, not technology ones:

  • Which tasks will be automated, and which roles redesigned?
  • Who captures the productivity gain: shareholders, customers or employees?
  • How will you develop future senior talent if junior tasks disappear?

Organisations that dress up headcount reduction as augmentation will lose trust when the truth emerges.

Where we've landed

The winning AI platform isn't necessarily the smartest. It's the one that delivers measurable value from your organisation's work and data, within an acceptable level of risk.

And because the technology is changing so quickly, the smartest decision may be to avoid locking yourself into a single answer.

Platform Suitability Assessment

Choosing between Copilot, Gemini, ChatGPT, Claude or Grok?

Matrix AI Consulting helps leadership teams across New Zealand and Australia make that decision on evidence, not hype. We run our Platform Suitability Assessment with your team: compliance gates, a five-workflow test on your real work, a weighted scorecard and a risk-adjusted value model, backed by governance, AI change management and executive AI coaching.

Book a conversation Explore AI Strategy

Microsoft 365 Copilot is a trademark of Microsoft Corporation. ChatGPT is a trademark of OpenAI. Claude is a trademark of Anthropic. Gemini is a trademark of Google LLC. Grok is a trademark of xAI. Benchmark and product details are as published at 2 November 2026 and change frequently.

AI BLOG

Microsoft Copilot Training and Change Management
By Glen Maguire • October 24, 2026
AI training alone doesn’t change how people work. A fictional Copilot rollout shows what HR and business leaders miss, and what to do differently.
AI Workplace Change Management
By Glen Maguire • October 7, 2026
AI in the workplace is changing jobs, workflows and skills. Learn why strong sponsorship, Prosci ADKAR and early AI capability building are critical to successful adoption.
OpenAI Dev Day 2026 Insights
By Glen Maguire • September 29, 2026
The most important thing I would tell a leadership team after OpenAI’s latest release is simple: Do not enable always-on agents across the organisation. Do start testing the cheaper Sol model on work you can review and reverse. And keep Microsoft Copilot or Claude where t
More Posts