1h ago
••
Latest News
Latest news from Subscribe to LocalLLaMA's sources
1h ago
First Kimi K3 results on home lab ~ 4t/s
2h ago
5060ti Chads, vllm updates and nvfp4
2h ago
Those who use many layers in CPU/RAM and some in GPU - what are your specs and speeds?
3h ago
I keep coming back to Qwen... Over and Over. Is there really nothing better under 120B?
4h ago
"Uncensored" LLMs are measurably more optimistic than their base models
4h ago
The idea: on a CPU the decode speed depends on the active params per token, not the total. My objective is trying to run a 10B at 100tok/s on a mid level PC (No GPU).
4h ago
Understand Kimi K3 from first principles: a recommended order for anyone trying to understand this beast
4h ago
A slide deck you can edit with a local model or in Chrome — the whole deck is a JSON block in one HTML file (~640KB with editor and viewer included)
5h ago
model: add NextN/MTP speculative decoding support for GLM_DSA (GLM-5.2)- #25980 MERGED!
6h ago
Microsoft did it .... again! (404 for their Mage-Flow models on HF)
8h ago
I built a GBNF grammar compiler that makes 8B models reliably call tools - here's how it works (deep dive)
10h ago
Is Laguna s2.1 fixed?
10h ago
Built and released BetterGPT-150M – A compact 150M parameter completion model (+ live HF Space demo)
12h ago
In-house LLM Inference on Kubernetes: A Production Runbook
13h ago
dropped 4k on a spark, am I crazy?
13h ago
Anyone tried the Q1 Kimi K3 yet? (555GB)
16h ago
A.X-K2 released
16h ago
I tried running a 1.56TB MoE model on a 6GB RTX 4050 Laptop, Here’s the result
16h ago
