1+ week, 5+ day ago   (332+ words) MarkTechPost Google Research has released TimesFM-3, a 330 million parameter time series foundation model that forecasts multiple related series in a single forward pass. Every TimesFM checkpoint through 2.5 was univariate: one series, its own history, nothing else. TimesFM-3 is pretrained natively…...

1+ mon, 2+ week ago   (445+ words) Most speculative-decoding work searches for one drafter that scores well on an averaged benchmark mixture. Real serving traffic does not look like that mixture. AngelSpec treats workload heterogeneity as a first-class design constraint, and specializes structure, training data, and verification…...

1+ mon, 2+ week ago   (245+ words) We clone the PrismML fork of llama.cpp, which provides the specialized kernels required for the model’s Q1_0_g128 quantization format. We configure a CUDA-enabled release build with CMake and compile the command-line, server, and benchmarking executables. We also reuse previously generated…...

1+ mon, 3+ week ago   (426+ words) Tokenization is the one part of the language modeling stack that almost nobody profiles. Gigatoken, released by Marcel Rød (a PhD student from Stanford) under an MIT license, argues that this was a mistake. The library encodes text at gigabytes…...

1+ mon, 3+ week ago   (288+ words) We import the core Python libraries required for file handling, process execution, path management, and formatted output. We define the repository, working, and checkpoint directories used throughout the workflow. We also create a reusable shell-command function that streams command output…...

1+ mon, 3+ week ago   (539+ words) Embedding models decide which passages an agent ever sees. NVIDIA released Nemotron 3 Embed model to work on that layer. It targets production-scale RAG, agentic retrieval, code retrieval, and agent memory. All three are transformer encoders trained with bidirectional attention masking....

1+ mon, 3+ week ago   (492+ words) Moonshot AI just released Kimi K3. It is a 2.8-trillion-parameter model with native vision and a 1-million-token context window. Moonshot calls it the world’s first open 3T-class model. Kimi K3 is a sparse Mixture-of-Experts (MoE) model built on two architectural updates. Those…...

1+ mon, 4+ week ago   (523+ words) Thinking Machines Lab just released Inkling, their first model trained from scratch, weights are open, fine-tunable on Tinker. The lab pitches it as a base for customization. Inkling is a Mixture-of-Experts transformer with 975B total parameters and 41B active. It supports a…...

1+ mon, 4+ week ago   (487+ words) Google's on-device inference runtime now targets the web. The same.tflite artifact used on Android and iOS runs locally through WebAssembly, WebGPU, and experimental WebNN. Google released LiteRT.js, a JavaScript binding of LiteRT. LiteRT is Google’s on-device inference library,…...

2+ mon, 2+ week ago   (964+ words) DeepSeek released DSpark, a speculative decoding framework, with open-source checkpoints and training code. It is a serving optimization, not a new model. The checkpoints DeepSeek-V4-Pro-DSpark and DeepSeek-V4-Flash-DSpark reuse the existing V4 weights, with a draft module attached. The DeepSeek…...