ANE decode
17 tok/sQwen3 28-block layer-chunked chainhistoricalANE M8 Core ML Chain
This artifact maps the boundary between owning the model and using Apple’s acceleration stack. It is parked because capability comes from our model/eval loop; Core ML is a deployment target, not the product center.
Headline Numbers
Evidence class applies to each value: measured = retained evaluation or runtime result; historical = recorded result not freshly reproduced; derived = calculated or decided from records; observed = current artifact state; not-measured = an explicit evidence gap.
FoundationModels context
4096too small for real tool catalogshistoricalAction grounding
25%FoundationModels BFCL agentic full cataloghistoricalCompetitive Context
| System | Metric | Score | Size / Class | Comparable? | Readout |
|---|---|---|---|---|---|
| posttrainllm Qwen3 Core ML chain | ANE decode | 17 tok/s | 28-block Qwen3 path | Direct | Runtime experiment only; capability still comes from posttrainllm weights and evals. |
| Apple FoundationModels | action grounding / context | 25% / 4096 tokens | Apple on-device model | Directional | Useful as a free local floor, but too weak to be the specialist capability dependency. |
| posttrainllm active MLX path | specialist eval readiness | active | owned weights | Directional | Preferred competition lane: model quality first, runtime optimization second. |
Direct rows share this artifact's eval setup. Directional rows are useful market context but should not be read as leaderboard claims.
Platform stance
| Path | Decision | Reason |
|---|---|---|
| Apple FoundationModels | Routing floor only | Weak action grounding and short context |
| Our weights -> Core ML | Optional future | Battery/perf optimization if capability is already solved |
| MLX/posttrainllm runtime | Active | Own the model and eval gate |
Release Blockers
Capability dependency rejected
Apple's model cannot be the differentiator; it is a free local floor at best.
Unblock: Only revive Core ML when a shipped posttrainllm specialist needs a battery/runtime optimization.