gekro
GitHub LinkedIn
News

AI News

Perplexity open-sources Lily inference engine; Qwen releases local search layer

Perplexity released Lily, a Rust-Metal inference engine for Apple Silicon showing 1.35x decode speedup over MLX-LM; Qwen open-sourced zg, a unified local-first search combining ripgrep, BM25, and.

1 min read 3 sources

Perplexity has open-sourced Lily, a Rust-based inference engine with custom Metal kernels optimized for Qwen3.6-35B-A3B on Apple Silicon. The engine achieved 1.23x prefill throughput and 1.35x decode throughput compared to MLX-LM on a 40-core, 128 GB M5 Max, according to benchmarks reported by MarkTechPost. Lily powers Perplexity’s Hybrid Compute feature and is now available to the public (MarkTechPost).

Qwen Developers open-sourced zg (zvec-grep) under Apache 2.0, a local-first search layer that unifies ripgrep, BM25, and vector search behind a single interface. The tool allows agents to move from plain-language queries to exact line spans without switching tools, according to MarkTechPost reporting (MarkTechPost). Separately, MIT Technology Review reported that enterprise deployment of agentic AI requires coordination across multiple agents, systems, and data sources while maintaining safety and workflow integration (MIT Technology Review).

Compiled automatically from the linked sources and published without manual editing - a neutral summary of third-party reporting, for information only. Every claim links to its origin. Not original reporting.