Mapping MoE models onto inference hardware: structure, flow, and efficient serving
Feed
All items · 260
Every item the pipeline kept, newest first.
81 items · page 7 of 7
Is the wall AI is hitting in the room with us right now?
New Model Architecture Implications for TAM of DRAM/NVMe, DeepSeek V4.1 Flash, AgentX, InferenceX, NVMe experiments
Jensen Sandbagging Performance Again, 2x more Annual Profit Per GigaWatt, The More you Buy, The More you Earn, AgentX, InferenceX, Extreme Co-Design
Robot Models, Silicon Efficiency, Jetson Thor vs. B300 TCO, Deployments, The Network Wall
Plus, a machine hermeneutics story
It’s very tempting to imagine that AI turns everyone into a tool-builder - now everyone can just ask the model to make the software they need, and apps as we know them are dead. I think that misunderstands how most people think and where software actually comes from, and more importantly, it isn’t a path to change how companies actually work.
Korea hosts a Squid Games, National AI Tournament, the best non-Chinese open source model gets eliminated, why Nvidia needs open source, implications for Hynix and Samsung
Plus, a live event with Robin Sloan!
