BitShovel
中

Perplexity’s README; AlphaSignal and community discussion supplied discovery leads · Published 2026-09-03

Lily: a Mac inference server for one model

Lily explores running a specific Qwen checkpoint on supported Mac hardware in a text-inference research implementation.

Image accompanying “Lily: a Mac inference server for one model”
Image: Perplexity AI · Open full-size image

中文

Local inference for a specific model and Mac setup

Lily is a research implementation for local inference. It accepts only the specified Qwen3.6-35B-A3B 4-bit checkpoint and requires M5 or newer hardware, macOS 26 or later, and building from source.

Lily local inference setup: one specified Qwen checkpoint, M5 or newer, macOS 26+, a source build and a text-only API.
Based on Lily’s official README. Streaming, tool calls and multimodal input are not supported. · Open full-size image

中文

What the recorded interface supports

The retained interface is text-only, without streaming, tool calls or multimodal input. Compare these model, device and interface conditions with the intended task.

Important additions and corrections

Dates below mark changes to our coverage.

  • Correction ·

    Corrected Lily’s requirements: M5-or-newer hardware, macOS 26+ and a specific checkpoint. It cannot be reproduced directly on every Mac.

Sources and notes

sources中文

Sources and notes

Retained summary and context

For studying local inference: check hardware, checkpoint and API requirements first.

We reviewed the official README but did not install Lily or reproduce its performance. Architecture, quantization and benchmark weight revision are restricted. Arbitrary models are not supported, and reported speedups do not establish results across Macs or tasks.

Sources and evidence · 3 links

Each link has a purpose and scope. Link counts do not establish independent confirmation; direct support applies only to the statements specified below.

Source timeline
  1. · Found this reading link via AlphaSignal daily.
  2. · Corroboration added: AlphaSignal carried the same story this window (title match).
Collection record

First discovered:

Collection and source publication have distinct dates.

Editorial record

Corrected

· Beijing time (UTC+8)

Retracted claims that anyone can reproduce or try it the same day. Clarified hardware, checkpoint and API requirements. Original event and discovery dates are retained; this is an editorial correction.

Sources and full record

This dates our review of the wording and sources, not a project release or product update.

Full record: before, after and sources (JSON)

Corrections and feedback