iCreatAI News
Skip to content
Latent Space· Gabriele Beltramo·· 5 days agoAI score60

NaiveAI Promises 2,100 Tokens per Second. How Well Does It Code?

NaiveAI Promises 2,100 Tokens per Second. How Well Does It Code?

AI summary

Latent Space benchmarks NaiveAI's open-weights Naive-N0.5-Flash, a MiMo-V2.5 derivative adapted to DeepSeek Sparse Attention with about 3.25T extra training tokens, against DeepSeek V4.1 Flash 1017 and GLM 5.3 Flash on speed, verbosity and three app-building prompts. It reports peak throughput near 2,100 tokens/s and a median response time of 3.1 seconds versus 5.3 and 10.1 seconds, but far higher thinking-token use on hard questions and mean times similar to DeepSeek. In the apps, Naive-N0.5-Flash produced the best solar system, tied DeepSeek on the tree model and trailed it on ray-tracer efficiency, while its no-thinking variant failed to build a usable tree app.

Source: Latent Space · latent.space