Someone apparently managed to kind of replicate what V4.1 flash does on KV for fast prefill on Qwen
r/LocalLLaMA
September 10, 2026 at 11:36 PM
📌 I wonder someone will figure out a way to do this with 27B? Throw Qwen3 on this page for demo https://kishida.github.io/webdemos/llkvapprox/ submitted by /u/T_rex2700 [link] [comments]
I wonder someone will figure out a way to do this with 27B?
Throw Qwen3 on this page for demo
https://kishida.github.io/webdemos/llkvapprox/
[link] [comments]
![[link]](https://i.redd.it/9kh3f6m0atoh1.png){kind=link}
Read the full article at
r/LocalLLaMA
More in Models & Releases
Models & Releases
Nvidia's RTX 5090 vanishes from online retail in the US — third-party sellers now demand as much as $9,500 for Nvidia's fastest GPU
submitted by /u/Norwood_Reaper_ [link] [comments]
Jensen Huang puts Trump on speakerphone onstage to announce robots won’t take over the world
Nvidia CEO Jensen Huang took a call from President Trump on Monday while onstage at the All-In Podcast's All-In Summit. It's not the first time Huang has taken a call from the president during work, but this time he put Trump on speakerp...
Models & Releases
Base-10's Charlie O'Neill on why Kimi and GLM are "almost objectively" better than Opus 5
Edit: Spelled Baseten not Base-10 Full episode of this available at https://www.youtube.com/watch?v=PrSf7IOYu-I It's interesting to see how Dwarkesh has had to come around to the evidence that we are well on our way to creating AGI and e...
Models & Releases
NVIDIA Unveils RTX PRO 5500 "Blackwell" Workstation GPU with 84 GB GDDR7 Memory
submitted by /u/Lumpy_Phase_9539 [link] [comments]