Techyon

Darwin-27B-ZTC-v2: VIDRAFT's Open-Weights Answer to the Typed Decision Model Problem in Agent Graphs

VIDRAFT released Darwin-27B-ZTC-v2, an Apache-2.0 open-weights model that occupies the #1 position on the System One Mosaic Benchmark decision-engine leaderboard among 102 contenders, achieving a Borda score of 89.58 and…

→ View original source

OpenMed 3.0 is out: Apache-2.0 clinical AI that runs fully local and never falls back to the cloud. 422 open issues if you want in on 3.1

OpenMed 3.0, an Apache‑2.0 licensed clinical AI toolkit, has been released, emphasizing fully local operation with no cloud fallback and support for offline use. It can run over 2,200 Hugging Face models via Transformers…

→ View original source

I trained a 102M recursive BitNet-v2 model from scratch: 64K context, trained on less than 5B tokens

The author trained a 102 M‑parameter recursive BitNet‑v2 model from scratch, employing ternary weights, shared transformer layers, and hashed n‑gram embeddings. The model handles a 64K token context and was trained on le…

→ View original source

What do you do with LLMs?

A Reddit user in r/LocalLLM observes that most discussions center on model setups and hardware, with few sharing concrete use‑cases for their LLMs, and asks the community to describe how they actually employ their models…

→ View original source

Using AI for just 10 minutes erodes your ability to persist at hard things

A peer-reviewed study co-authored by Brian Christian of UC Berkeley’s Center for Human-Compatible AI found that brief reliance on AI tools significantly impairs human focus and persistence on challenging tasks. The resea…

→ View original source

Nicolas Cage says he won't work with Amazon again over AI dispute

Nicolas Cage publicly rejected an AI waiver request for Amazon’s “Spider‑Noir,” a 1930s‑style crime‑thriller series produced by Sony Pictures Television and Amazon MGM Studios, where he played the lead character “The Spi…

→ View original source

S-Space: Exploring Spatial Workspace in Multimodal Language Models

The authors investigated how multimodal language models (MLLMs) internally represent spatial information by identifying a linear subspace, termed S‑Space, in which the activations of object‑token embeddings encode contin…

→ View original source

MixTok: Adaptive Visual Tokenization with Global 1D Tokens and Sparse 2D Refinement

MixTok introduces a hybrid visual tokenizer that merges a compact 1D global token stream with a set of sparse 2D tokens to refine locally complex image regions. A content‑adaptive router evaluates candidate spatial locat…

→ View original source

UPDATE: Qwen 3.8 27B 140 tok/s on single RTX 3090 Megakernel: KL divergence 0.0009 vs llama.cpp

The Qwen3.8-27B CUDA megakernel achieves ~140 tokens per second on a single RTX 3090, delivering 1.4–1.9× the speed of llama.cpp. Accuracy remains high, with a KL divergence of only 0.0009 relative to the llama.cpp bench…

→ View original source

Qualcomm CEO reveals AI companies want phones running 100-billion-parameter models continuously by 2028.

Qualcomm's CEO stated that AI firms aim for smartphones to continuously run 100‑billion‑parameter models by 2028. This reflects growing demand for on‑device AI capable of handling massive language models without offloadi…

→ View original source

I built an open-source GPU orchestrator that lets several local AI models share one GPU by loading/unloading them on demand (llama.cpp, Ollama, ComfyUI, TTS)

The open‑source GPUSymbiosis orchestrator lets a single GPU run multiple local AI tools—such as llama.cpp, Ollama, ComfyUI, and TTS—by dynamically loading the active workload and unloading idle ones, thereby avoiding VRA…

→ View original source

Benchmarking AI for Code Optimization: Which LLM Actually Writes the Most Efficient C/Rust Code?

The author benchmarked four large language models—DeepSeek‑Coder‑V2‑Instruct, Claude 3.5 Sonnet, GPT‑4o, and Gemini 1.5 Pro—on a suite of 15 low‑level programming tasks that involved complex pointer arithmetic, manual me…

→ View original source