Kimi K4 is going to be bigger than K3, but Moonshot AI is already scrambling for chips. K3 just shipped, and the startup is already hunting for hardware for its next model. The new model will be significantly larger than K3's 2.8 trillion parameters, but there's no training or release timeline yet.
According to The Information, K3 used Nvidia's most advanced Blackwell chips, and some of the training actually happened in China — not entirely in the Thailand data center that US officials have cited. More critically, K3 never had a complete, massive training cluster. No Chinese cloud provider can supply enough Blackwell GPUs, so Moonshot AI connected at least two suppliers and linked together a bunch of eight-GPU servers.…