{
  "schemaVersion": "bitshovel-editorial-review-v1",
  "id": "content-lily-conditions-20260906",
  "signalId": "alphasignal-alphasignal-ai-news-perplexity-s-lily-beats-mlx",
  "originalUrl": "https://github.com/perplexityai/pplx-garden/tree/main/lily",
  "kind": "editorial-correction",
  "reviewedAt": "2026-09-06T10:29:33.637Z",
  "before": {
    "id": "alphasignal-alphasignal-ai-news-perplexity-s-lily-beats-mlx",
    "state": "new",
    "lane": "openSourceGrowth",
    "publishedAt": "2026-09-02T20:04:46.000Z",
    "observedAt": "2026-09-03T05:50:49.961Z",
    "originalUrl": "https://github.com/perplexityai/pplx-garden/tree/main/lily",
    "banner": {
      "url": "/card-art/alphasignal-alphasignal-ai-news-perplexity-s-lily-beats-mlx-official.png",
      "credit": "Perplexity AI",
      "license": "© Perplexity AI - editorial use with attribution"
    },
    "relatedSources": [
      {
        "label": {
          "zh": "r/LocalLLaMA 社区讨论",
          "en": "r/LocalLLaMA community thread"
        },
        "url": "https://www.reddit.com/r/LocalLLaMA/comments/1w5ozl4/perplexity_opensourced_their_mac_inference_server/"
      },
      {
        "label": {
          "zh": "AlphaSignal",
          "en": "AlphaSignal"
        },
        "url": "https://alphasignal.ai/news/perplexity-s-lily-beats-mlx-lm-by-1-35x-running-qwen3-6-on-apple-silicon"
      }
    ],
    "source": {
      "zh": "Perplexity 官方仓库，经 AlphaSignal 与 r/LocalLLaMA 进入视野",
      "en": "Perplexity's official repository, surfaced via AlphaSignal and r/LocalLLaMA"
    },
    "title": {
      "zh": "Perplexity 开源 Lily：只跑 Qwen3.6-35B-A3B 一个检查点的 Metal 推理服务器",
      "en": "Perplexity open-sources Lily, a Metal inference server for exactly one checkpoint"
    },
    "summary": {
      "zh": "Perplexity 在 pplx-garden 仓库以 Apache-2.0 协议开源了 Lily：一款基于 Rust+Metal 的 Mac 推理服务器，其载入期校验仅放行一个检查点——mlx-community/Qwen3.6-35B-A3B-4bit（HF revision 钉死、仅 affine 4bit group 64），其余架构与量化一律拒载。它暴露 OpenAI chat completions API 的最小子集、恒贪心解码、保留两槽 LRU 前缀缓存；要求 Apple GPU family 10+（M5 起）与 macOS 26+。收录时 704 stars。AlphaSignal 称其跑 Qwen3.6 比 MLX-LM 快 1.35×；README 未给该数字，但发布了带测量契约与复现步骤的日期版基准报告。",
      "en": "Perplexity open-sourced Lily (Apache-2.0) in the pplx-garden repo: a Rust+Metal Mac inference server whose load-time validation admits exactly one checkpoint — mlx-community/Qwen3.6-35B-A3B-4bit with the HF revision pinned; any other architecture or quantization is rejected. It exposes a minimal OpenAI chat-completions subset, decodes greedily, keeps a two-entry LRU prefix cache, and requires Apple GPU family 10+ with macOS 26+. 704 stars at capture. AlphaSignal reports 1.35x over MLX-LM; the README states no such number but ships dated benchmark reports with reproduction steps."
    },
    "why": {
      "zh": "官方开源工具链的新能力当天就能上手验证：单检查点加 fail-closed 载入校验是 Apple Silicon 本地推理路线上态度鲜明的工程取舍，Apache-2.0 加钉死的权重 revision 让任何人都能复现同一份基准；1.35× 虽是聚合媒体口径，仓库自带复现步骤，社区可以当天复核。",
      "en": "An official open-source capability teams can exercise the same day: one checkpoint plus fail-closed load validation is a pointed engineering bet for local inference on Apple Silicon, and the pinned weight revision under Apache-2.0 makes the benchmark reproducible by anyone. The 1.35x figure is aggregator-reported, but the repo ships reproduction steps to check it."
    },
    "caveat": {
      "zh": "证据来源为 Perplexity 官方仓库 README（自述）与 AlphaSignal、r/LocalLLaMA 聚合讨论（BitShovel 于 2026-09-03 抓取核对仓库）。1.35× 提速未见于 README、属聚合媒体口径且待独立复现；支持面窄——仅 M5 起的 Apple 芯片、macOS 26+、单一 4bit 检查点；stars 是注意力不是质量证明，上述内容不是独立评测。",
      "en": "Evidence: Perplexity's official repository README plus AlphaSignal and r/LocalLLaMA aggregation (BitShovel fetched and verified the repo on 2026-09-03). The 1.35x speedup does not appear in the README — it is an aggregator claim awaiting independent reproduction; the support surface is narrow (M5-and-newer Apple silicon, macOS 26+, a single 4-bit checkpoint); stars are attention, not proof of quality; this is not an independent review."
    },
    "timeline": [
      {
        "date": {
          "zh": "9 月 3 日",
          "en": "Sep 3"
        },
        "datetime": "2026-09-03T05:50:49.961Z",
        "summary": {
          "zh": "进入 BitShovel 雷达：AlphaSignal 每日 收录时可见 100 条。",
          "en": "Entered the BitShovel radar: 100 entries visible on AlphaSignal daily at collection."
        },
        "source": {
          "zh": "AlphaSignal 每日 快照",
          "en": "AlphaSignal daily snapshot"
        }
      },
      {
        "date": {
          "zh": "9 月 3 日",
          "en": "Sep 3"
        },
        "datetime": "2026-09-02T20:04:46.000Z",
        "summary": {
          "zh": "新增同题佐证：AlphaSignal 于本观察窗收录同一故事（标题匹配）。",
          "en": "Corroboration added: AlphaSignal carried the same story this window (title match)."
        },
        "source": {
          "zh": "AlphaSignal",
          "en": "AlphaSignal"
        },
        "kind": "corroboration-added",
        "discoveredAt": "2026-09-04T16:00:16.681Z"
      }
    ],
    "followTarget": {
      "id": "repository:github.com/perplexityai/pplx-garden-lily",
      "label": {
        "zh": "Perplexity Lily 官方仓库",
        "en": "the official Lily repository"
      },
      "scope": {
        "zh": "仓库的实质变化：新基准报告、支持范围扩展、许可变更",
        "en": "material repo changes: new benchmark reports, support-surface expansion, license changes"
      },
      "url": "https://github.com/perplexityai/pplx-garden/tree/main/lily",
      "updateMode": "verified-change"
    },
    "ingestion": {
      "mode": "editorial",
      "adapter": "syndication-feed",
      "evidenceClass": "official-repository",
      "observationRef": "source-observations/history/syndication-feeds.2026-09-03T05-50-49Z.snapshot.json#feed:alphasignal-daily",
      "changeRef": "source-observations/history/syndication-feed-changes.2026-09-03T05-50-49Z.snapshot.json#feed:alphasignal-daily"
    },
    "verifiedAt": "2026-09-05T16:05:43.235Z"
  },
  "after": {
    "source": {
      "zh": "Perplexity 官方 README；AlphaSignal 与社区讨论提供发现线索",
      "en": "Perplexity’s README; AlphaSignal and community discussion supplied discovery leads"
    },
    "title": {
      "zh": "Lily：只支持一个模型的 Mac 推理服务器",
      "en": "Lily: a Mac inference server for one model"
    },
    "summary": {
      "zh": "Perplexity 开源的 Lily 面向本地推理实现研究。它只接受指定的 Qwen3.6-35B-A3B 4bit 检查点，要求 M5 及更新芯片、macOS 26 及以上，并需自行编译。接口目前只处理文本，不支持流式输出、工具调用或多模态输入。",
      "en": "Perplexity’s open-source Lily is a narrow implementation for studying local inference. It accepts a specific Qwen3.6-35B-A3B 4-bit checkpoint, requires M5-or-newer hardware and macOS 26 or later, and must be built from source. Its text-only API does not support streaming, tool calls or multimodal inputs."
    },
    "digest": {
      "zh": "适合研究本地推理实现；先核对设备、指定模型和接口条件。",
      "en": "For studying local inference: check hardware, checkpoint and API requirements first."
    },
    "why": {
      "zh": "开发本地推理服务时，可以研究它怎样通过固定模型和严格接口缩小实现范围。仓库提供带条件的性能报告与复现步骤；是否值得试，应由自己的设备和任务决定。有复现步骤，并不意味着每位 Mac 用户都能直接运行。",
      "en": "Developers can examine how a fixed model and strict API reduce the implementation scope. The repository provides performance reports with conditions and reproduction steps. Whether to try it depends on your hardware and task; those steps do not make it runnable on every Mac."
    },
    "caveat": {
      "zh": "本文核对了官方 README，未安装或复现性能。原文还限定模型架构、量化布局与基准权重版本；不能换入任意模型，也不能把媒体提速数字当作所有 Mac 或任务的结果。",
      "en": "We reviewed the official README but did not install Lily or reproduce its performance. Architecture, quantization and benchmark weight revision are restricted. Arbitrary models are not supported, and reported speedups do not establish results across Macs or tasks."
    }
  },
  "editorialReadiness": "decision-brief",
  "withdrawnSources": [],
  "withdrawnTimeline": [],
  "evidence": [
    {
      "type": "retained-official-page",
      "label": {
        "zh": "Lily 固定版本 README：运行与接口条件",
        "en": "Pinned Lily README: runtime and API requirements"
      },
      "url": "https://github.com/perplexityai/pplx-garden/blob/1ed972ed3f0bd5616c997c9507c25616c63394fc/lily/README.md",
      "path": "app/_content/editorial-reviews/evidence/content-lily-readme-20260906.json",
      "bytes": 641,
      "sha256": "b30869411f781929053c7db6f9167eb02c9f8ace6e42c6b71fec23e7fe38cf97",
      "fetchedAt": "2026-09-06T10:28:00.586764Z"
    }
  ],
  "sourceAssessments": [
    {
      "url": "https://github.com/perplexityai/pplx-garden/tree/main/lily",
      "role": "direct-support",
      "scope": {
        "zh": "支持的硬件、系统、模型与接口范围，以及仓库提供的性能报告入口。",
        "en": "Supported hardware, operating system, checkpoint and API, plus links to repository performance reports."
      },
      "limitations": {
        "zh": "维护者功能说明，不是本站运行结果；本轮没有复核媒体提速数字或独立比较速度。",
        "en": "Maintainer documentation, not our runtime results. This review does not verify media speedup figures or independently compare performance."
      },
      "evidenceUrls": [
        "https://github.com/perplexityai/pplx-garden/blob/1ed972ed3f0bd5616c997c9507c25616c63394fc/lily/README.md"
      ]
    }
  ],
  "note": {
    "zh": "撤回“任何人都能复现”“当天就能上手验证”的过宽表述，明确设备、模型与接口条件。保留原事件和收录日期；此次为解读更正。",
    "en": "Retracted claims that anyone can reproduce or try it the same day. Clarified hardware, checkpoint and API requirements. Original event and discovery dates are retained; this is an editorial correction."
  },
  "integrity": "3ae09c6645b3c6f09dcfabdcadd5c82cf99ac0b66619a2aa2c53f88dc8a8878f"
}