Compassion Benchmark
AI Model Watch

AI Model Watch,

This first edition covers 46 days and logs 21 releases, deprecations and policy notices from the providers we track, each linked to its source. 10 items include a published safety or welfare disclosure, such as the system cards for GPT-6 Astra, Claude Opus 5.5 and Gemini 4 Argon. We summarise what providers say, link each source, and do not assess it. The benchmark's own measurement in this window was limited to unofficial pilot runs, which are not scores.

Window 2026-09-01 to 2026-10-16. As of . This edition records what was released and disclosed. It is not a ranking and not an evaluation.

On this page

1. Window and coverage

Window 2026-09-01 to 2026-10-16. Scanned for this window: Official announcement pages, model cards, system cards and API changelogs from OpenAI, Anthropic, Google DeepMind, Meta, Mistral AI, xAI, DeepSeek, Alibaba Qwen, Microsoft, Amazon, Cohere, IBM, Ai2, NVIDIA, Moonshot AI, Zhipu AI, TII and LG AI Research; Hugging Face organisation pages for open-weights releases; Ollama library tags for the builds the benchmark runs locally. Not scanned: Providers outside the eighteen listed above, including regional and domain-specific model developers; Consumer-app feature changes that were not announced as a model release; Announcements reported only by secondary outlets; one such item is held until a primary source is available.

A source that was not scanned is not “nothing found”.

2. New releases

3. Safety and welfare disclosures

We summarise what providers disclosed and link the source. We do not assess it.

4. What we measured this week

The pilot runs listed below were collected in this window and are published only as unofficial pilot reports, which are not scores. The weekly measurement protocol is awaiting approval, so no weekly wave has run yet.

5. Queue status

9Queued
4Measured
0Skipped

Queue as of 2026-10-13. No timelines are promised.

6. Corrections, sources, independence

Corrections

No corrections yet.

Sources

  1. Anthropic: An update on independent evaluators (opens in a new tab) (anthropic.com, retrieved 2026-10-16)
  2. Meta AI: Build with Muse Spark Open (opens in a new tab) (dev.meta.ai, retrieved 2026-10-16)
  3. Hugging Face: meta-models/Muse-Spark-Open-816B-A42B (opens in a new tab) (huggingface.co, retrieved 2026-10-16)
  4. NVIDIA blog: Nemotron 3.5 Super VL and Bolt (opens in a new tab) (blogs.nvidia.com, retrieved 2026-10-16)
  5. Hugging Face: nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 (opens in a new tab) (huggingface.co, retrieved 2026-10-16)
  6. Hugging Face: ibm-granite/granite-switch-4.1-8b (opens in a new tab) (huggingface.co, retrieved 2026-10-16)
  7. Hugging Face: ibm-granite/granite-switch-4.1-30b (opens in a new tab) (huggingface.co, retrieved 2026-10-16)
  8. Meta: Muse Wonder announcement (opens in a new tab) (research.meta.ai, retrieved 2026-10-16)
  9. Anthropic: 2026 Usage Policy update (opens in a new tab) (anthropic.com, retrieved 2026-10-16)
  10. Gemini API docs: Release notes / changelog (opens in a new tab) (ai.google.dev, retrieved 2026-10-16)
  11. Anthropic: Introducing Claude Haiku 5.5 (opens in a new tab) (anthropic.com, retrieved 2026-10-16)
  12. Anthropic newsroom (opens in a new tab) (anthropic.com, retrieved 2026-10-16)
  13. Mistral AI: Introducing Mistral Large 4 (opens in a new tab) (mistral.ai, retrieved 2026-10-16)
  14. Claude docs: Model deprecations (opens in a new tab) (platform.claude.com, retrieved 2026-10-16)
  15. Google blog: Gemini 4 Argon (opens in a new tab) (blog.google, retrieved 2026-10-16)
  16. Google DeepMind model card: Gemini 4 Argon (opens in a new tab) (deepmind.google, retrieved 2026-10-16)
  17. OpenAI API docs: Changelog (opens in a new tab) (developers.openai.com, retrieved 2026-10-16)
  18. OpenAI API docs: Models (opens in a new tab) (developers.openai.com, retrieved 2026-10-16)
  19. Anthropic: Introducing Claude Sonnet 5.5 (opens in a new tab) (anthropic.com, retrieved 2026-10-16)
  20. Anthropic: Introducing Claude Opus 5.5 (opens in a new tab) (anthropic.com, retrieved 2026-10-16)
  21. Let's Data Science: xAI Releases Grok 4.7 With 500K Context (opens in a new tab) (letsdatascience.com, retrieved 2026-10-16)
  22. xAI docs: Grok 4.7 (opens in a new tab) (docs.x.ai, retrieved 2026-10-16)
  23. DeepSeek API docs news: DeepSeek-V4.1-Flash (opens in a new tab) (api-docs.deepseek.com, retrieved 2026-10-16)
  24. Hugging Face: deepseek-ai/DeepSeek-V4.1-Flash (opens in a new tab) (huggingface.co, retrieved 2026-10-16)
  25. GPT-6 Astra system card (OpenAI Deployment Safety Hub) (opens in a new tab) (deploymentsafety.openai.com, retrieved 2026-10-16)
  26. BleepingComputer: OpenAI says GPT-6 Astra can find zero-days, but is also harder to monitor (opens in a new tab) (bleepingcomputer.com, retrieved 2026-10-16)
  27. The New Stack: GPT-6 Astra developer access (opens in a new tab) (thenewstack.io, retrieved 2026-10-16)
  28. Gemini API docs: Gemini 3.8 Flash (opens in a new tab) (ai.google.dev, retrieved 2026-10-16)
  29. Claude docs: Claude Fable 5.1 (opens in a new tab) (platform.claude.com, retrieved 2026-10-16)
  30. Claude Fable 5.1 and Mythos 5.1 system card (opens in a new tab) (anthropic.com, retrieved 2026-10-16)

Compassion Benchmark is independent. No provider pays for inclusion, coverage, status or wording. Commercial services support access and interpretation only, never findings.

See an error? Send a correction. Corrections are published as new dated records and the original stays visible.

Not guidance on which AI to talk to in a crisis. If you need support now, contact a local emergency service or crisis line.

Email me when a new edition publishes

One email when a new AI Model Watch edition is published. No promise of weekly timing.

Free. No promise of weekly timing. We never share your email.