Canva Research
Canva Research’s image foundation model plans composition before rendering up to 2K images. The generation task returns an image and optional asset; Magic Layers conversion into an editable design is a separate task and credit use. Publisher language/rank claims are not our Chinese-text tests.
Evaluations & evolution →KRAFTON AI
A text-only 28.8B-total/4.3B-active MoE preview with native 262,144-token context and Apache 2.0 weights. Official 32GB NVFP4 use differs from MXFP8 offload; llama.cpp upstream support is pending. Publisher evaluations do not fill our three boards, and we have not run it.
Evaluations & evolution →Nanbeige LLM Lab / 南北阁
A 33B dense text teacher with 512K context and tool use for coding and cowork, under Apache 2.0. The planned 3B student is not this release. Publisher AA-LCR/Terminal-Bench results and simulated benchmark dollars are not our intelligence/Pi scores or revenue; we have not run it.
Evaluations & evolution →Meta
Meta’s roughly 30B dense open multimodal model accepts text/images and outputs text under Apache 2.0. The AA text index reads 6 (high) under the v5.0 caliber; the v4.3.2-era 17 stays in records — the two versions do not mix, and this site's Nov 16 recheck confirms the source row still displays 6. Quantized 24/32GB target configurations differ from full precision; this August release is not today’s launch, and text-index results do not establish all agent performance.
Evaluations & evolution →Block
Block’s full-duplex speech research demonstration claims audio-only training and local inference on MacBook Pro M4 Max or better. Download and waitlist remain prospective; the page does not specify public weights, model licensing or API terms, and the three boards have no comparable result.
Evaluations & evolution →NVIDIA
A text model post-trained from Gemma-4-E4B, with 8B total/4B effective parameters and BF16/Q4_K_M GGUF artifacts. 4GB names a target VRAM envelope; file size, cache and system memory differ. AA has no numeric result, Pi has no matching result, and Physics video does not apply.
Evaluations & evolution →NVIDIA
An open-weight speech-transcription SALM: 40 languages, recordings up to one hour, a 65,536-token context, 34B total / about 4.3B active including the audio encoder, BF16/FP8/NVFP4, servable on one H100 80GB under OpenMDW-1.1. Transcription is a specialist capability — the AA/Pi text indices and the Physics video board do not apply; the card's own benchmarks (multi-speaker cpWER 15.80, English WER 4.71 and more, captured October 12) read as vendor figures.
Evaluations & evolution →Liquid AI
Liquid AI's first full-modality model: about 2.2B parameters, taking image/video/audio/text in and text plus 24kHz speech out, 32K context per the model card, 16 text and 19 speech languages, LFM Open License v1.0, non-reasoning. The official family also spans Base/1.7B text (256K), VL-2B, Audio-2B and d1 decision variants. On-device full-modality is a specialist capability — the AA/Pi text indices and the Physics video board do not apply; card benchmarks (Daily-Omni 70.1 and more) and its Oct 31 HF trend popularity are recorded separately as vendor figures and popularity facts.
Evaluations & evolution →Moonshot AI / 月之暗面
A post-trained K3 model: Code rollout is dated October 23, the research index October 24. AA text index 55 is the v4.3.2 figure of October 23–24; after the v5.0 board switch the source row reads 46 (effort still unnamed; v4.3.2 and v5.0 scores are not mixed). Distinguish Highspeed access from weights: the full weights promised “by November 4” are now public at the wire — this site's Nov 5 re-check confirms 96 shards ≈1.56TB (MXFP4, single commit Nov 2); until now the model was reachable only via the OpenRouter/official APIs.
Evaluations & evolution →InclusionAI
A hosted reasoning version separately listed by AA at44, with no speed result. AA marks it proprietary; the MIT card for the similarly named open family does not establish identical weights or an inference recipe.
Evaluations & evolution →NVIDIA
A surgical world model generates video from an initial endoscopic frame and 28-dimensional two-arm actions for robotics simulation research. Model terms differ from Apache2 code. Training 10Hz, inference FPS and clinical validity are distinct; no generic Cosmos or Odyssey physics score is inherited.
Evaluations & evolution →NVIDIA
The GA base of the Cosmos 3 family (the largest of Super/Nano/Edge): open-weight HF repo created March 10, updated September 16, 38k downloads at observation. Physics-IQ rows Cosmos 3 Super (Astra) 65.47 (Astra prompt upsampling + BoN×8) and single-run 50.80 are board calibers; AA/Pi target language and coding models and do not apply.
Evaluations & evolution →NVIDIA
The 16B-trainable base of the Cosmos 3 family: 137k downloads on the GA repo at observation; four open-weight post-trained checkpoints (Transfer-Auto/Sim-Auto/Sim-Transfer/Sim-Bimanual) target 11-view + LiDAR driving simulation and bimanual robot actions to video, OpenMDW1.1, 32.4–34.5 GB per repo, vendor-reported wins over 14B teachers. Physics rows 61.83 (Astra + BoN×8) and single-run 43.00; AA/Pi do not apply.
Evaluations & evolution →Recursive
A 39.8B-total, roughly 2.5B-active local text coding model with Apache2 weights. rec requires supported hardware and at least 48GB unified memory. Publisher Terminal-Bench2.1/SWE results do not match the three existing boards.
Evaluations & evolution →Xiaomi MiMo / 小米
Flagship multimodal reasoning with 1M context; the published RL card lists 1.02T total, 42B active parameters and MIT licensing. AA records 46 in the same table; weights, hosted API and UltraSpeed serving are distinct runtime conditions.
Evaluations & evolution →Xiaomi MiMo / 小米
An efficiency-oriented multimodal model with 1M context; the published RL card lists 309B total, 15B active parameters and MIT licensing. Its AA score is 38, not Pro’s 46; Flash does not guarantee consumer-device deployment.
Evaluations & evolution →Tencent Hunyuan / 腾讯混元
A specialist long-term-memory writer with about 30B total and 3B active parameters, organizing and updating memory inside external frameworks. Retrieval and final answers remain separate. Vendor comparisons on fixed 20% subsamples across four harnesses differ from AA text intelligence, Pi coding and Physics video continuation; no same-identity score currently qualifies it for those boards.
Evaluations & evolution →Tencent Hunyuan / 腾讯混元
A specialist bidirectional Chinese-English simultaneous speech-translation model with about 30B total and 3B active parameters, open-sourced under Apache-2.0 (third-party components keep their terms) alongside Interleave and FP8/GGUF variants. Vendor results (~3-second RealSI lag, 85.8% against human interpreters) use GEMBA judged by GPT-6.1-Sol; speech output needs a separate TTS. Simultaneous interpreting differs from AA text intelligence, Pi coding and Physics video continuation, so no same-identity score currently qualifies it for those boards.
Evaluations & evolution →Tencent Hunyuan / 腾讯混元
The official version of Tencent Hunyuan's newest flagship: the API is live on Tencent Cloud and OpenRouter at preview prices (¥6 input / ¥0.3 cached / ¥18 output per million tokens), with first-time vision and computer use; officially “the strongest open models” ranking entry, yet the weights and system card remain under a due-course promise as of 2026-11-04 (only preview weights on GitHub/HF, re-checked here). On the November 5 full AA re-read, Hy4 joins the source table at 35 (reasoning version, effort not named in the source table). “Strongest open models” remains an official characterization; appendix and audit figures are official claims; nothing reproduced here.
Evaluations & evolution →NVIDIA
120B total and 12B active parameters, up to 1M context, with public weights under OpenMDW 1.1. The BF16 card gives 4×H100/2×GB200 examples; NVFP4 has separate conditions. AA26 does not name effort or establish customer outcomes after specialized post-training.
Evaluations & evolution →NVIDIA
74B total and 9B active parameters, up to 256K context, OpenMDW 1.1. The GGUF card lists 28GB/65,536 and 32GB/262,144-token single-sequence recipes; check vision components, drafter and hardware together. Not installed or tested here.
Evaluations & evolution →MiniMax
API access and five effort settings continue. Public weight shards, 428B total/23B active and the community license were checked October 24. Retain AA 43 with unnamed effort; serving recipes are not local performance tests.
Evaluations & evolution →MiniMax
An open-weights joint audio-video model: the official card puts the H3-Omni-Transformer at 33B dense single-stream (~13B AdaLN not loaded at inference), generating video with native 32 kHz stereo audio up to 15 seconds, 24 fps, up to 2K, plus an H3-Context-IR input-understanding module. The community license applies outside the US, EU, UK and South Korea. AA / Pi are text boards and do not apply; Physics-IQ scores video continuation (v2v), a different track from text- or image-to-video, and its rows read on 2026-11-07 contain no H3 — with no same-caliber score it stays off the boards and unrated.
Evaluations & evolution →PrismML
A Qwen3.5-2B-derived vision-language model. PTQ1_0 language weights are about 0.43GB, not peak RAM; check vision and runtimes separately. No matching AA/Pi result is inherited from the backbone; Physics video continuation does not apply.
Evaluations & evolution →PrismML
A Qwen3.5-4B-derived vision-language model. PTQ1_0 language weights are about 0.95GB, not peak RAM; check vision and runtimes separately. No matching AA/Pi result is inherited from the backbone; Physics video continuation does not apply.
Evaluations & evolution →PrismML
A Qwen3.5-9B-derived vision-language model. PTQ1_0 language weights are about 2.00GB, not peak RAM; check vision and runtimes separately. No matching AA/Pi result is inherited from the backbone; Physics video continuation does not apply.
Evaluations & evolution →PrismML
The earlier 27B Bonsai 2 model derives from Qwen3.8-27B. Keep its specifications and tests separate from the later Qwen3.5-based models. These ternary weights do not inherit backbone scores; no matching AA/Pi result, and Physics video continuation does not apply.
Evaluations & evolution →TypeSafe AI
A bounded decision model for text and structured text. jev-preview selects 1.14; stable jev-latest remains on 1.13. Defaults: 64k per request and 32k per question, with optional long context. No comparable result in our three boards; earlier game results concern another version.
Evaluations & evolution →Meta
816B total parameters and 42B active, with text, image, audio and video inputs and text output. Self-host under the Muse Model License; published quantized examples still occupy hundreds of GB of memory. AA at xhigh scores 39, separately from Spark 1.3 and Wonder.
Evaluations & evolution →Meta
The Full model in the Wonder series emphasizes memory, sustained execution and coding. Its AA max-setting text index is 56, separate from standard Wonder. Current access is through a Muse Code subscription; this score does not describe the standard API model.
Evaluations & evolution →Meta
The new series targets long-running tasks, computer use and coding, with Active Memory and Active Focus describing context and sustained work. Its AA max-setting text index is 52. Meta Model API and Muse Code access are open; personal Muse integration is a later rollout, and Full is a separate model.
Evaluations & evolution →Meta
Meta’s smallest and cheapest model yet, positioned for the volume work agents repeat all day — tool calls, coding subtasks, routing, extraction and long-document parsing; natively multimodal inputs (text, image, audio, video). Meta Model API pricing is $0.10 input / $0.50 output per million tokens (up to 200k input tokens; $0.30/$1.50 beyond); its AA intelligence index is 36 at max (34 at xhigh), with the official page reporting about $0.13 per task at max reasoning. Official benchmarks are strongest on automation and terminal execution, while FrontierCode 2.0-AA at 27.2 still trails Haiku 5.5’s 34.9; Meta pairs it with Wonder or Spark in a plan-then-execute split. Access runs through Muse Code subscriptions and the Meta Model API (model name muse-ember-1.0); the official page carries no date, so the release is recorded as November 9 per same-day coverage — this site read the official page on November 10.
Evaluations & evolution →Cactus Compute
A 16.9 MB CPU speech model with seven supported languages, excluding Chinese. It can share an engine with Needle 3 to return text and tool arguments. Speech error rates have a separate scope from our text, coding and physics boards.
Evaluations & evolution →Cactus Compute
A laddered small model with its own weights fills names and arguments for declared tools or schemas; SDK function execution is a later step. Our three boards have no comparable score, and its individual release date is not established by the official material.
Evaluations & evolution →TypeSafe AI
Bounded decisions from text or JSON state. Stable jev-latest still selects 1.13, with 1.14 in preview. Existing game results concern 1.13, not the newer version; its individual release date remains unestablished.
Evaluations & evolution →OpenAI
A GPT-6 model for focused, high-volume tasks. Its max-setting text index and dedicated Decisions endpoint have separate scopes, prices and output types.
Evaluations & evolution →Cloudflare
Bounded decisions from text, JSON, images or video on a 27B source architecture. Hosted limits and weights differ; no comparable score appears in our three boards.
Evaluations & evolution →Cloudflare
A decision model on a 9B source architecture. October 9 changes its hosted price/window, not the weights. No comparable score is in our three boards.
Evaluations & evolution →Cloudflare
A 30B-A3B source architecture scores options from audio and video. One scoring call is not a continuous agent. No comparable score is in our three boards; keep the model card distinct from service terms.
Evaluations & evolution →Odyssey
A world model for action-conditioned environments; the Flash preview is distinct from the standard evaluated configuration.
Evaluations & evolution →Odyssey
The Pro physical-video configuration: 66.10% uses custom prompts and best-of-eight, not the Flash browser result.
Evaluations & evolution →Mistral AI
A trillion-parameter multimodal model; weights opened as promised on October 29. Read the license, index score and security positioning separately — running it as a service needs a separate license.
Evaluations & evolution →Google DeepMind
An image-generation and conversational-editing model; follow official examples, local edits, subject consistency and tool access.
Evaluations & evolution →Google DeepMind
Create comparable representations of text, photos, audio and video for on-device media retrieval.
Evaluations & evolution →Reflection
The October 5 preview and October 6 record of a 256K beta connect to the astronaut-game demo. Formal 1.0 weights opened October 16; checkpoint identity is unconfirmed, so this preview does not inherit the later score.
Evaluations & evolution →Reflection
The open 501B/23B text model has Apache 2.0 main weights and a current API with 1M combined context and 128K maximum output. AA lists 30 without naming effort; keep it separate from the old preview identity and vendor scores.
Evaluations & evolution →Krea
An image-editing model: six references in the launch, eight in current API docs, with a 1536px longest-side limit from five references. App compute units and beta-workspace API access differ. Base 1K/2K rates are $0.03/$0.06, with reference and high-mode fees added. Sub-eight-second edits are a vendor claim; earlier platform jobs including queues are not our test.
Evaluations & evolution →Elorian
A visual-reasoning research preview offered through an API and chat. Listed rates are $0.60 per million input tokens and $3 per million output tokens; repeated inspection also takes time and tokens. In the robot example, Glimpse plans and π0.5 executes; this is not direct action generation or our test.
Evaluations & evolution →StepFun / 阶跃星辰
A 600B-total, 27B-active multimodal preview with hosted access and weights under StepFun Model License 1.0. Hosted docs specify 1M context and 64k maximum output; the model card's output ceiling has separate runtime conditions.
Evaluations & evolution →Anthropic
Connect complex-work capability with editable code animation, independent evaluations and real production choices.
Evaluations & evolution →Anthropic
Frequent smaller tasks: examine an independent score, drawing effort levels and the 100k-token price boundary.
Evaluations & evolution →Anthropic
A new everyday-work option; read scores together with effort, token use and whole-task cost.
Evaluations & evolution →Anthropic
The restricted model used in the quantum-circuit study. Results come from a model, coding environment and author-built evaluator loop, not Opus 5.5 or measured quantum-hardware acceleration. Current family access guidance covers the later 5.1, not general access to this older version.
Evaluations & evolution →Anthropic
A previous-generation reference: the same handwritten-edit sample exposes differences more concretely than an overall score.
Evaluations & evolution →Anthropic
Anthropic's strongest general model, first on the independent AA v5.0 board at 65 (max); one underlying model with Mythos 5.2 — Fable reaches everyone with cybersecurity/biology safeguards (blocked queries fall back to Opus), Mythos drops the layer for vetted organizations. $8/$40 per million tokens below 5.1, fast mode 2.5×; vendor-caliber FrontierCode 2.0 xhigh 49.1%, by their count the highest of any released model.
Evaluations & evolution →OpenAI
Connect materials, code and tools into longer work, with concrete comparisons in drawing, handwritten edits and furniture assembly.
Evaluations & evolution →Google DeepMind
Long-task access expands to Gemini, the paid API and development tools; compare specific tasks while checking shared context, access and cost.
Evaluations & evolution →Google DeepMind
Google's strongest model, announced October 28 (Pacific time): 60 (high) on AA v5.0 as of the November 4 full-board reread — it led alone until Fable 5.2 passed it — officially positioned for cybersecurity and long-horizon work. SEC-bench Pro 88.2%, ExploitGym 54.8% and CWE-bench 71.0% are vendor figures, with external benchmarks noted as unguarded. Cyber defenders got access first on October 28; general availability arrived November 10 — paying developers and enterprises via API, AI Ultra subscribers via Antigravity, the Gemini app and AI Mode in Search (GitHub Copilot the same day). Introductory pricing is $2/$10 per million tokens, later $4/$20.
Evaluations & evolution →Google DeepMind
Google's everyday-execution tier for the Gemini 4 family: while Carbon and Argon handle deep long-horizon reasoning, Hydrogen targets fast coding and agentic workflows, available to everyone on day one (all AI Studio tiers, the Gemini API, business surfaces, the Gemini app and Google Search; paid Pro/Ultra subscribers also get it in Antigravity and Sheets). Pricing is $1.5 input / $7.5 output per million tokens, flat across the 1M-token context, with 1M-token input, up to 1M-token output, and four thinking levels (low / medium / high default / new xhigh). The AA independent board lists four tiers — xhigh 54 / high 51 / medium 41 / low 27 (high above Argon's high 50) — with the high tier about $1.87 per task; Google's own comparison table trades wins and losses against Sonnet 5.5 and Terra (trailing on Terminal-Bench 4.1, OSWorld-2.1 and Terminal-Bench-Science). Antigravity ships Orchestrator, switching between Carbon and Hydrogen within a session: near-full-Carbon success on Terminal-Bench 4.0 with 24% less quota and 19% faster (vendor figures). This site read the official blog and AA's board via direct fetch on November 13.
Evaluations & evolution →Google DeepMind
The first real-time interactive world model to generate audio natively: walk with the keyboard, rewrite scenes by text, with Gemini 3.8 Flash as the guiding agent planning multi-step events; scenes hold together about two minutes, double Genie 3. A research preview reaches trusted testers first, then Project Genie for AI Ultra in coming weeks. No AA / Pi / Physics-IQ listing — world models sit outside those boards, so no ranking follows.
Evaluations & evolution →Google DeepMind
A vision-language-action model: official evaluations span 200 tasks with success rates 30–100% above the previous baseline (relative values) and tasks 20–30% faster; a kitting pilot on two active Mercedes lines reached 96% (proof-of-concept caliber), with Gemini Robotics ER tracking the workflow and this model controlling hands and arms. Safety adds inference-time guidance and the open-source ASIMOV-Jailbreak benchmark (Argon 99.5% versus 82% for the previous ER 2). Training was accelerated by Gemini 4 Argon acting as a simulation engine. Partner rollout only, no public access; not applicable to the AA / Pi / Physics boards — VLA task success sits outside those calibers, and no third-party benchmark exists yet.
Evaluations & evolution →OpenAI
The next Sol update; an independent side-by-side comparison places its capability and cost against Astra.
Evaluations & evolution →OpenAI
A fast, efficient computer-use model: vendor results show +15 points over GPT-5.6 Terra at about a third of the cost, matching Astra at roughly a tenth of the token price; standard API prices drop 50% and GitHub Copilot added it the same day. As of October 27 the AA board has no entry for it (the older GPT-5.6 Terra max sits at 42), so it joins the board only when a same-method score exists.
Evaluations & evolution →OpenAI
A dedicated cybersecurity model: finding and validating exploitable vulnerabilities within researcher-defined scope, covering exploit development, vulnerability research, code review and patching. 48.5% on ExploitGym (from 32.1%), officially Critical for cybersecurity under the Preparedness Framework (up from High); access starts with approved Daybreak Red customers, expanding progressively. Not applicable to the AA / Pi / Physics-IQ boards - specialized cyber capability sits outside those calibers, and the approval-only gate leaves no independent third-party readings yet; the gap stays stated.
Evaluations & evolution →Meta
A historical capability model behind Muse. AA marks it deprecated and removes it from the current table as checked October 22; 48 is a historical reference. This does not establish a Meta service shutdown.
Evaluations & evolution →SpaceXAI
The release emphasizes sustained coding, knowledge work and self-checking; distinguish announced changes from demonstrated results.
Evaluations & evolution →Alibaba / Qwen
Generation, transparent assets and multi-reference editing. Image-preference evaluation is distinct from the text, coding and physics boards. Weights are limited to non-commercial research/evaluation; commercial use needs separate permission.
Evaluations & evolution →Alibaba / Qwen
An eight-step checkpoint on the base 2.1 visual architecture, with regional hosted access. No separate comparable Turbo image evaluation was found; base-model scores do not transfer.
Evaluations & evolution →Alibaba / Qwen
A named snapshot of hosted Max, with reported coding, orchestration and vision improvements. A dedicated on-site evaluation has not yet been published.
Evaluations & evolution →Alibaba / Qwen
Qwen4's first flagship: 2.4T trunk parameters, 71B active per token, plus 328B N-gram Embedding parameters, with native vision input and 1M context. This site read the official blog body in full via browser render on the morning of November 17 (on November 16 only the title and release facts came through, and figures were first recorded from IT之家's relay): the three architecture items are GDN+QSA (three of every four layers are Gated DeltaNet compressing history into a fixed state, one is Qwen Sparse Attention picking context block by block), Gated Residual's four gated read/write branches, and a layer-two N-gram lookup; the vendor reports spike-free pretraining at 2.4T with base-model BPB about 5–13% below Qwen3.8-Max-Base at roughly 25% fewer active parameters per token. Capability and cost are vendor-reported: Work360 52.69 versus the predecessor's 47.74; token consumption down about 24%/35% (Xhigh/High) on Work360 and about 48%/49% on Terminal-Bench 4.0; API prices cut across the board with cache-hit pricing lowered the most, and Work360 per-task average cost 26.58→11.16 yuan (−58%) — the circulating "over 60% / 62%" relay wording does not match the official 58%, and the official figure stands. The official 16-panel chart is a clean sweep over the predecessor but tops only four panels against other models (Claude Opus 5.5 is higher on most knowledge-work panels). Weights are not open, with smaller series models promised for later open-sourcing; access runs through the Qwen platform (Token Plan or API) plus Qwen Work, Qoder CN, the Qwen app and Qwen Studio, after a limited qwen4-max-preview from November 11. The AA v5.0.1 source table showed a Qwen4 Max row at 43 on our November 16 evening read (effort not named), unchanged on the November 17 morning re-read; the 43 and the self-reported Work360 figures do not substitute for each other.
Evaluations & evolution →Google DeepMind
A previous-generation reference for Argon, retaining task-level comparisons within the same independent evaluation.
Evaluations & evolution →Alibaba / Qwen
Understand total versus active parameters, and distinguish downloadable weights from a hosted service.
Evaluations & evolution →DeepSeek
Retain September vision, file and effort references. AA/max was recorded at 39 on October 19; the October 20 source no longer lists the older name, so it leaves the current board. Its dated comparison remains in the topic; deepseek-flash now serves 1017.
Evaluations & evolution →DeepSeek
A new MIT-licensed V4.1 Flash weight snapshot keeps the configuration, image/text input and text output. The API retains deepseek-flash and its prices. Independent AA/max scores 45 and Pi/high scores 100% within the small suite; older AA39 and LiveBench results remain with the earlier model.
Evaluations & evolution →Alibaba / Qwen
A smaller model for text, image and video understanding; check reasoning controls, context and deployment materials.
Evaluations & evolution →Z.ai / 智谱
A text-input model for longer work, advancing complex engineering through post-training on the GLM-5.2 base; explore independent evaluations and a walkable 3D creation.
Evaluations & evolution →Z.ai / 智谱
Text and images connect to coding, browser and document work; this separate new base offers API and open-weight routes for exploring concrete uses.
Evaluations & evolution →Moonshot AI / 月之暗面
Native vision and long context support coding and knowledge work, with an SVG and image description making capabilities concrete; K3 and Code's K2.8 Preview are parallel paths.
Evaluations & evolution →