K/20X LABS · AI_SETUP_FOUNDATIONS · DAILY RESEARCH BRIEF

Local AI and E2B research brief

Published , 04:44 Bogota (UTC-5) · 35 sourced items, 18 new since the previous edition · Read the foundations review · RSS

Laptop AI (MacBook, MLX)

System X: An LLM Decision Model That Replies from Its Own KV CacheNEW

arXiv · · Laptop AI (MacBook, MLX)

arXiv:2610.25456v1 Announce Type: cross Abstract: Decision models return probabilities over supplied options, but a deployed agent may also need to reply in words. The present study introduces System X, a large language model (LLM) decision...

PAGE404: Breaking GPU Isolation Through Hardware-assisted Page Migration

arXiv · · Laptop AI (MacBook, MLX)

arXiv:2610.20962v2 Announce Type: replace-cross Abstract: NVIDIA's Grace Hopper (GH200) superchip represents a new generation of heterogeneous computing, tightly integrating a 72-core Arm-based CPU with a Hopper GPU on a single module via a...

v0.32.2

mlx-lm releases · · Laptop AI (MacBook, MLX)

What's Changed Fix attention value scaling in MiMo-V2-Flash by @ricky-chaoju in #1971 Fix mask in SMM by @michalk8 in #1979 Muse spark hf names by @nastya236 in #1981 New Contributors @ricky-chaoju made their first contribution in #1971 Ful...

v0.32.1

mlx-lm releases · · Laptop AI (MacBook, MLX)

What's Changed fix muse template by @nastya236 in #1977

Local and Distributed Large LLM Inference with MLX and RDMA on Mac Studio

Apple Machine Learning Research · · Laptop AI (MacBook, MLX)

MLX on Mac with Apple silicon lets AI researchers and developers experiment locally with the latest models and methods in a private environment. The open-source array framework leverages the unified memory architecture of Apple silicon, ena...

v0.32.4

MLX releases · · Laptop AI (MacBook, MLX)

What's Changed Adding VJP for the scaled dot product attention. by @tpegolotti in #4563 python: Add pos support to array by @aaishwarymishra in #4488 Add Python 3.15 and 3.15t support by @XXXXRT666 in #4555 Add fixed size unique operation b...

Desk-side boxes (Mac Studio, DGX Spark, OEM)

Democratizing MoE inference on commodity GPUs with CoMoE

arXiv · · Desk-side boxes (Mac Studio, DGX Spark, OEM)

arXiv:2610.09424v3 Announce Type: replace-cross Abstract: Deploying Mixture-of-Experts (MoE) models relies heavily on Expert Parallelism, which generates intense inter-GPU communication. Consequently, state-of-the-art inference systems requ...

Phone and edge AI

0.19.0-nightly.20261019NEW

LiteRT-LM releases · · Phone and edge AI

[Nightly] Update Swift Package checksums for 2026-10-19 [skip ci]

DS-Net: A Dynamic Split Network for Edge-Cloud Collaborative InferenceNEW

arXiv · · Phone and edge AI

arXiv:2610.23949v1 Announce Type: new Abstract: Collaborative inference serves as a critical methodology in edge intelligence. Existing collaborative inference methods operate by splitting the deep neural network (DNN) model between edge de...

First-Order LoRA Training with Phone NPUsNEW

arXiv · · Phone and edge AI

arXiv:2610.24816v1 Announce Type: new Abstract: On-device fine-tuning lets a large language model (LLM) learn from its user's private data without uploading it. Low-rank adaptation (LoRA) reduces the trainable parameters, but each first-ord...

ATEST: Adaptive Resource-Aware Test-Time Scaling for LLM InferenceNEW

arXiv · · Phone and edge AI

arXiv:2610.25519v1 Announce Type: new Abstract: Test-time scaling (TTS) improves large language model (LLM) reasoning by sampling multiple answers, but fixed sampling budgets ignore both query difficulty and the changing energy cost of infe...

0.19.0-nightly.20261018

LiteRT-LM releases · · Phone and edge AI

[Nightly] Update Swift Package checksums for 2026-10-18 [skip ci]

Tree Appreciator

Simon Willison · · Phone and edge AI

Tool: Tree Appreciator Another game experiment with Claude. This one used the default Claude iPhone app (chat mode, not Claude Code mode), where I prompted Claude Opus 5.5 Max with: Build a three js game called "Tree appreciator" - it shows...

Runtimes and quantization

b11750NEW

llama.cpp releases · · Runtimes and quantization

sycl: fix compiler warnings - missing prototypes, dead code, extra semicolons ( #30271 ) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/57666056 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple...

PeekKV: The First Content Token Already Knows Which Heads MatterNEW

arXiv · · Runtimes and quantization

arXiv:2610.23939v1 Announce Type: new Abstract: The size of the KV cache grows linearly with context length, making it a major memory bottleneck in LLM serving. Motivated by recent progress in identifying the functional roles of attention h...

b11744NEW

llama.cpp releases · · Runtimes and quantization

server: add --connect, allow p2p access to server outside LAN ( #28277 ) init wip wire it up make it clear that it's experimental add props.connect_code nits fix windows build server: do not advertise a connect code without the tunnel --con...

v0.32.1rc0

vLLM releases · · Runtimes and quantization

[Doc][RL] Document the weight-transfer HTTP protocol for trainers wit…

v0.40.7

Ollama releases · · Runtimes and quantization

What's Changed openai: allow Responses effort on non-thinking models by @hoyyeva in #19010 llama-server: let llama-server infer the draft speculative type by @dhiltgen in #19064 mlx: add PPLX Decider v1.2 support by @dhiltgen in #19072 Full...

Agent sandboxes (E2B and peers)

Agent World Model in the Wild: Computer-Use Agent Environment SynthesisNEW

arXiv · · Agent sandboxes (E2B and peers)

arXiv:2610.26828v1 Announce Type: cross Abstract: Agent learning is shifting from learning from human data toward learning through interaction with the world. However, scaling such learning directly in real-world computer systems is challen...

Sandboxes are dead

E2B Blog · · Agent sandboxes (E2B and peers)

From code snippets to entire computers, agents have outgrown the sandbox. E2B's next chapter is an agent-driven private cloud that adapts to every task.

LaTeX renderer

Simon Willison · · Agent sandboxes (E2B and peers)

Tool: LaTeX renderer Inspired by Paul Ford and Aboard Foundary's new web app Tiny Little Office, which provides a suite of web app content editors (a Word Processor, Outliner, Presentation Builder, Spreadsheet, Calculator, Drawing Tool, Di...

Best Code Execution Sandboxes for AI Agents in 2026

E2B Blog · · Agent sandboxes (E2B and peers)

Compare the best 2026 code execution sandboxes for AI agents. See how E2B stacks up against alternatives for isolation, BYOC, billing, and open source.

Redesigning source control at Anthropic

Simon Willison · · Agent sandboxes (E2B and peers)

Redesigning source control at Anthropic Interesting piece from Anthropic describing why and how they built their own custom alternative to Git, based on the dramatic increase in rate of changes to their code after the past six months. In Ma...

e2b@2.56.0

E2B SDK releases · · Agent sandboxes (E2B and peers)

Minor Changes 6a74c39 : Require Node.js 22.19.0 or newer and depend on undici@^8 only (undici 7 is dropped). undici 8 respects the server's HTTP/2 SETTINGS_MAX_CONCURRENT_STREAMS and opens more connections when one is saturated. Breaking: t...

Open models for local use

ToolRosetta: Surface-Form Invariance of Tool-Call GuardsNEW

arXiv · · Open models for local use

arXiv:2610.24055v1 Announce Type: cross Abstract: Step-level guards for tool-using agents are evaluated on tidy JSON tool calls, but deployed coding agents act through execute_bash and execute_code tools whose payloads are strings. We intro...

Method

Sources: arXiv API, Apple Machine Learning Research, NVIDIA, Google Research, Google Developers, Microsoft Research, Hugging Face, MLCommons, MIT News, Nature Machine Intelligence, Communications of the ACM, and official GitHub release feeds (MLX, llama.cpp, Ollama, vLLM, MLC LLM, LiteRT-LM, E2B). Items are filtered by topic rules; summaries are AI-assisted (no model; source excerpts shown) and grounded only in each source's own abstract or post text. Always read the linked source before acting.

Archive