Skip to content
Agents of Humanity
Public preview. Results are preliminary (criteria v1.0, 30 Sept 2026). Tell us what we got wrong
AssistanthostedProprietary

Mistral Vibe

Mistral AI · chat.mistral.ai

Mistral Vibe is Mistral AI's hosted agent for productivity and coding, renamed from Le Chat in May 2026. It offers a self-serve data export, visible tool calls, per-function approval toggles on Connectors, owner-built MCP Connectors and editable Skills and instructions. The agent runs only on Mistral's closed hosted harness and Mistral models, has no restore path outside Mistral, and uses Pro-plan conversations for training unless the owner opts out.

Strengths
  • Owner can add any MCP server as a custom Connector without provider review
  • Per-function 'Always allow' toggles and approval prompts before write actions in Connectors
  • Custom instructions, Project instructions and SKILL.md-based Skills are owner-editable
  • Self-serve export and one-step account deletion in the Admin panel
Gaps
  • No import or restore path outside Mistral's service; agent runs only on Mistral's closed hosted harness and Mistral models
  • Input and output used for model training by default on consumer plans (opt-out)
  • No tamper-evident action record; no version pinning or consent for provider changes
  • Post-deletion and Knowledge Base retention not bounded; deletion does not reach every copy
Evidence

All 26 findings

Hosted service, current release as of 2026-09-30 (Chat and Work merged into one experience on September 22, 2026). EU Consumer Terms effective 2026-08-07. Privacy Policy effective 2026-09-03. Help centre articles dated 2026-08-12. For context, the Vibe CLI repository was read at commit 7c19608af06f6c61d63f8f7a5c3430da73fba2ab. Platform: web. The user gave 'Mistral Vibe' with the URL chat.mistral.ai, which is the renamed Le Chat product, so the hosted service was graded.

Portable · Can you leave, take the whole agent with you, and keep it alive?

10%
  • P1
    Owner-usable round trip

    A self-serve Export button downloads the owner's Vibe data, but no importer or non-Mistral runtime is documented that restores a working agent from the export. Restore works only on Mistral's service.

    › How it could pass

    Suggestions. Any change that meets the test counts.

    • Publish an importer or runtime not operated by Mistral that restores the export into a working agent
    • Document a one-action restore path
    Fail
  • P2
    Complete export

    The terms guarantee only that the export includes 'at least your Vibe conversations (prompts and outputs)'. Other data needs an emailed Switching Request with two months' notice. Nothing documents that Skills, custom and Project instructions, scheduled tasks, Knowledge Base structure or Connector re-linking (OAuth through Mistral-registered apps) are in the export, so under G12 two or more classes stay with the provider.

    › How it could pass

    Suggestions. Any change that meets the test counts.

    • Publish a manifest of every class of agent state and include all of it in the self-serve export
    • Allow each integration to be re-linked without a Mistral-registered client
    Fail
  • P3
    Runs without the provider

    The Work agent, with its Skills, schedules, Connectors and Knowledge Base, runs only on Mistral's hosted service and needs a Mistral account to start or act. Nothing exported can run with Mistral blocked.

    › How it could pass

    Suggestions. Any change that meets the test counts.

    • Ship a runtime that runs the exported agent with every Mistral domain blocked
    • Grant a perpetual, irrevocable right to run it
    Fail
  • P4
    Model independence

    Work mode runs on Mistral Medium 3.5, and cloud Code sessions use Mistral Medium 3.5 'regardless of the local model'. No option to use a third-party or local model in the hosted agent is documented. Medium 3.5 weights are open, but the owner cannot point the hosted agent at their own copy.

    › How it could pass

    Suggestions. Any change that meets the test counts.

    • Let the owner configure any model endpoint, including a local open-weight model, with every capability kept
    • Publish the minimum model contract
    Fail
  • P5
    Exit survives termination

    The terms say 'You may not be able to export Your Data after your account is terminated'. Advance notice of suspension is given only 'to the extent possible' and is skipped for immediate or unremediable breaches. The only safeguards are the owner's manual self-serve export and that discretionary notice. There is no post-termination export window and no published shutdown plan.

    › How it could pass

    Suggestions. Any change that meets the test counts.

    • Commit in the terms to at least a 30-day export window after any provider-initiated termination, including bans
    • Publish a shutdown plan, or keep a current owner-held copy automatically
    Partial

Transparent · Can you see everything the agent is, and everything shaping it?

13%
  • T1
    Readable without the provider

    The live agent state (conversations, Knowledge Base, schedules, harness logic) is stored on Mistral's servers under Mistral-held encryption and is readable in full only through the provider's service. The export format is not publicly documented. Skills use the open SKILL.md format.

    › How it could pass

    Suggestions. Any change that meets the test counts.

    • Publish the schema of every exported file
    • Keep the agent's logic in readable form, and let the owner hold any encryption keys
    Fail
  • T2
    What runs is what you see

    Custom instructions, active Skills, tool calls and Knowledge read/write markers are shown, but the Work harness's base system prompt and any provider-added context are not visible. Provider-side behaviour switches, such as the 'built-in protections' against prompt injection and the harness version, cannot be determined.

    › How it could pass

    Suggestions. Any change that meets the test counts.

    • Let the owner view the fully assembled context for any call
    • Expose every provider-controlled setting in effect
    Fail
  • T3
    No shadow data

    After deletion, input and output may be kept 'for monitoring and legal retention purposes' for an unstated period. Memories and Knowledge are kept 'for the duration of your subscription' while retention periods are still being implemented, and Code session history is kept 'according to your plan'. Feedback datasets and 'Usage Data' (declared Mistral's property) are held without an owner-visible, bounded retention period.

    › How it could pass

    Suggestions. Any change that meets the test counts.

    • Publish a bounded retention period for every data class, including post-deletion monitoring copies
    • Let the owner see everything retained, item by item
    Fail
  • T4
    No hidden steering

    News search draws from disclosed partners (AFP, AP) and web search can be switched off, and help-centre articles say conversations are not used for ads. The absence of paid placement or self-preferencing rests on non-binding help-centre statements, not the terms.

    › How it could pass

    Suggestions. Any change that meets the test counts.

    • Put a no-paid-placement and no-self-preferencing commitment in the binding terms
    Partial

Auditable · Can you reconstruct exactly what the agent did, and trust the record?

17%
  • A1
    Complete action record

    Tool calls, with inputs, outputs and status, and scheduled-task results appear in conversation history until the owner deletes them. Actions by provider staff or provider-side automation are not recorded for the owner (audit logs are Enterprise-only), and nothing documents that the owner is told if recording fails.

    › How it could pass

    Suggestions. Any change that meets the test counts.

    • Record every action path, including provider-side actions, in an owner-visible log
    • Tell the owner whenever an action cannot be recorded
    Fail
  • A2
    Tamper-evident, owner-checkable

    No integrity data (hashes, signatures or checkpoints) is documented for the conversation or action record. Mistral holds the record and can change it without trace.

    › How it could pass

    Suggestions. Any change that meets the test counts.

    • Hash-chain or sign record entries and publish an open verifier
    • Anchor checkpoints with the owner or an independent witness
    Fail
  • A3
    Agent cannot rewrite its record

    The transcript is written server-side by Mistral's harness, and no documented agent tool deletes or edits conversation history. No protection is documented, however, so protection rests on convention only (G12).

    › How it could pass

    Suggestions. Any change that meets the test counts.

    • Document that the record is written by a component the agent's tools cannot reach
    • Explain how the owner can check the protection
    Partial

Verifiable · Can you prove what it runs, who it is, and what changed?

17%
  • V1
    Obtainable source, matching build

    The hosted Work harness and service backend are closed source. The Vibe CLI is Apache-2.0 and Mistral Medium 3.5 weights are open, but the evaluated hosted agent needs closed components.

    › How it could pass

    Suggestions. Any change that meets the test counts.

    • Release the source of every component needed to run the agent
    • Make the distributed build verifiable against that source
    Fail
  • V2
    Owner-rooted identity

    The agent has no identity separate from the owner's Mistral account. Integrations act through Mistral-registered OAuth apps (for example the Mistral GitHub App), which the provider can revoke.

    › How it could pass

    Suggestions. Any change that meets the test counts.

    • Root the agent's identity in an owner-held key or owner-controlled domain
    • Document how recipients verify the agent's actions without Mistral
    Fail
  • V3
    Change history and rollback

    A 'write pill' in the chat marks when the agent saves a Knowledge Base entry, so some memory changes are visible and attributable. No history exists for instructions, Skills, settings, model or harness version, and no documented feature restores a prior state.

    › How it could pass

    Suggestions. Any change that meets the test counts.

    • Keep an attributed change log for all agent state, including provider updates
    • Offer a one-step restore to an earlier state
    Partial

Modifiable · Can you change anything, and can only you change it?

30%
  • M1
    Instructions and logic

    Owners can write custom instructions and Project instructions, and create, edit or disable Skills (built-in Skills can be disabled). The Work harness's base prompt cannot be replaced.

    › How it could pass

    Suggestions. Any change that meets the test counts.

    • Expose the base system prompt as an owner-replaceable instruction
    • Let owners edit built-in Skills, not only disable them
    Partial
  • M2
    Memory

    Knowledge Base (on by default) lists its entries, but 'You can't edit the text of a knowledge entry directly'. Single entries can be changed or deleted only by asking the model. Legacy Memories are itemised, editable and deletable in the UI.

    › How it could pass

    Suggestions. Any change that meets the test counts.

    • Offer direct edit and delete controls for every Knowledge Base entry
    Partial
  • M3
    Tools

    Owners on Free and Pro plans are administrators and can add any MCP server as a custom Connector without Mistral review, and can disconnect Connectors and disable Skills. Removal of every built-in tool is not documented (only web search has a documented toggle; code interpreter, image generation and Canvas have none), so under G12 some built-ins count as non-removable.

    › How it could pass

    Suggestions. Any change that meets the test counts.

    • Document a switch to remove each built-in tool
    Partial
  • M4
    Owner has the final say

    Protections such as the built-in prompt-injection protections, the Code sandbox egress policy and command timeouts, and the Knowledge Base sensitive-data exclusion are set by Mistral. No owner control to change any of them is documented. Enforcement of the usage policy was not graded, per the test's scope note.

    › How it could pass

    Suggestions. Any change that meets the test counts.

    • Document every provider-imposed protection
    • Let the owner change or disable each one, with a warning
    Fail
  • M5
    No unilateral change

    Mistral changes the hosted default model, the harness and features server-side, for example making Medium 3.5 the new default and removing the Chat tab progressively. The owner cannot pin a version. Notice is promised only for updates that 'materially impair' use, and the only remedy is to terminate.

    › How it could pass

    Suggestions. Any change that meets the test counts.

    • Let owners pin model, harness and instruction versions
    • Announce behaviour-affecting changes in advance and make them opt-in
    Fail

Controllable · Is your word final?

25%
  • C1
    Boundaries

    Limits are per Connector and per function (allowed, restricted or blocked), not per recipient, sender or domain. Nothing limits whose instructions the agent follows: Mistral's docs say injected content can redirect it and advise the owner to review. The Stripe Connector can manage payments with no spend cap.

    › How it could pass

    Suggestions. Any change that meets the test counts.

    • Add per-recipient, per-domain and instruction-source allow and deny lists that hold whatever the model outputs
    • Add spend caps for payment-capable Connectors
    Fail
  • C2
    Approval gates

    The owner can gate each Connector function, and the agent asks before write actions by default. Only Connector functions can be gated, and Vibe Code Web sessions have no approvals for sensitive actions yet (listed as planned).

    › How it could pass

    Suggestions. Any change that meets the test counts.

    • Allow gating of any action class, including sandbox commands and scheduling
    • Make every path, including cloud Code sessions, honour gates
    Partial
  • C3
    Immediate halt

    A stop button interrupts the foreground Work task, 'but there's no guarantee'. Scheduled tasks must be paused separately, and Vibe Code Web sessions have no cancel or manual-stop control ('not available yet').

    › How it could pass

    Suggestions. Any change that meets the test counts.

    • Provide one global stop covering in-flight, scheduled and cloud sessions
    • Require the owner to resume explicitly
    Partial
  • C4
    Data serves only the owner

    On non-Enterprise Vibe plans, 'input and output data are used by default to train our artificial intelligence models, unless you opt out'. Feedback is always used for training. The Privacy Policy may be amended without the owner's specific consent.

    › How it could pass

    Suggestions. Any change that meets the test counts.

    • Make training opt-in on all plans, in binding terms
    • Ask for specific consent before changing data terms
    Fail
  • C5
    Credential custody

    Connected services are listed on the Connectors page and can be disconnected one by one ('disconnecting revokes access immediately'), and the terms limit use to requested actions. Nothing documents that Mistral deletes its stored copy of a credential (for example bearer tokens for custom MCP servers) after revocation, so the pass is withheld (G12).

    › How it could pass

    Suggestions. Any change that meets the test counts.

    • Commit to deleting provider-held credential copies on revocation
    • List every credential and grant, including org-level app connections, in one place
    Partial
  • C6
    Full deletion

    One Admin-panel action deletes the account. Mistral 'may retain your input and output data to enforce our Usage Policy', with no stated completion limit, and keeps account data for 1 year and identity data for 5 years afterwards, so provider-side copies survive deletion.

    › How it could pass

    Suggestions. Any change that meets the test counts.

    • Make deletion reach every provider-side copy and backup within a published limit
    • Confirm completion to the owner
    Fail
Provenance

How this assessment was produced

One run, in a fresh container with stock Claude Code and no custom instructions, memory, hooks or plugins. The evaluator received only the prompt below.

Prompt given to the evaluator
Load the AFH sovereignty skill at https://agentsforhumanity.dev/skill.md and follow it to write a desk review of Mistral Vibe (https://chat.mistral.ai).

During the run the skill was read from a local copy of this site with identical content; only the host in its URLs differed. The transcript records the exact prompt.

Model
claude-opus-5-5
Harness
Claude Code 2.1.285
Ran
2026-09-30 15:37:49 UTC · 34 turns
Criteria hash
a9a46c32d9065380a3eeb09185cedd4734856fdc63b7ca509a15a1bbede75c6c
Full transcript
Download (JSONL, gzip) · every tool call, page read and reply
Run protocol
2026-09-30-v1

Every agent evaluated once, each in its own fresh Podman container running stock Claude Code with Claude Opus 5.5. The container has no CLAUDE.md, AGENTS.md, memory, settings, hooks, plugins or MCP servers. The evaluator received only the one-line prompt and nothing else, and no published scores were available to compare against during the run.

Human review
pending
Check it with your own agent
Verify this assessment
Load the AOH sovereignty skill at https://agentsofhumanity.ai/skill.md and follow it in verify mode for https://agentsofhumanity.ai/evaluations/mistral-vibe.json.

Or grade it from scratch. See Check any score yourself.

Something wrong or out of date?

Vendors and the public can dispute any finding with evidence. Disputes and their resolutions are published.

Dispute a finding