NVIDIA and IIT Madras announce 2.8 trillion tokens of open Indian-language data

NVIDIA, IIT Madras and its AI4Bharat lab have announced Nemotron-pretraining-Indic-v1, about 2.8 trillion tokens of training data across the 22 languages listed in India's Constitution, which they say will be released soon along with the open, GPU-accelerated pipeline used to make it. The data is built by translating curated English material, such as maths, code and question-answer content, into Indian languages, with native script for all 22 languages and romanised text for twelve, and each output checked against its source. Adding 10 billion Indic tokens from a twelve-language subset plus natural Indic text to Nemotron 3.5 Super VL improved its Indic benchmark scores by 4.98 to 9.82 percentage points, though the authors note this does not isolate the synthetic data's effect. Sorted take: if it ships as described, this is a large open boost for anyone building Indian-language models, but translated data still lacks local knowledge.