Research papers

Research paper by Zihan Liu and collaborators. Published 2025-06-16. Topics: supervised fine-tuning, reinforcement learning, reasoning models, sampling temperature, entropy.

Zihan Liu, Zhuolin Yang, Yang Chen, Chankyu Lee, Mohammad Shoeybi, Bryan Catanzaro, Wei Ping

CC BY 4.0View resource

Research paper

AceReason-Nemotron: Advancing Math and Code Reasoning through Reinforcement Learning

Research paper by Yang Chen and collaborators. Published 2025-05-22. Topics: reinforcement learning, RL, DeepSeek-R1, data curation, distillation.

Yang Chen, Zhuolin Yang, Zihan Liu, Chankyu Lee, Peng Xu, Mohammad Shoeybi, Bryan Catanzaro, Wei Ping

CC BY 4.0View resource

Research paper

An Open Recipe for IMO Gold: Training Nemotron for Olympiad Mathematics

Research paper by Ivan Moshkov and collaborators. Published 2026-09-09. Topics: supervised fine-tuning, reinforcement learning, verification, refinement, test-time compute.

Ivan Moshkov, Stephen Ge, George Armstrong, Wei Du, Sadegh Mahdavi, Igor Gitman

CC BY 4.0View resource

Research paper

Apriel-Nemotron-15B-Thinker

Research paper by Shruthan Radhakrishna and collaborators. arXiv record dated 2025-08-13. Research area: Machine learning.

Shruthan Radhakrishna, Soham Parikh, Gopal Sarda, Anil Turkkan, Quaizar Vohra, Raymond Li, Dhruv Jhamb, Kelechi Ogueji, Aanjaneya Shukla, Oluwanifemi Bamgbose, Toby Liang, Luke Kumar, Oleksiy Ostapenko, Shiva Krishna Reddy Malay, Aman Tiwari, Tara Bogavelli, Vikas Yadav, Jash Mehta, Saloni Mittal, Akshay Kalkunte, Pulkit Pattnaik, Khalil Slimi, Anirudh Sreeram, Jishnu Nair, Akintunde Oladipo, Shashank Maiya, Khyati Mahajan, Rishabh Maheshwary, Masoud Hashemi, Sai Rajeswar Mudumba, Sathwik Tejaswi Madhusudhan, Torsten Scholak, Sebastien Paquet, Sagar Davasam, Srinivas Sunkara

CC BY 4.0View resource

Research paper

AutoCompress: Automated Hardware-Guided Model Compression

Research paper by Sheldon Liang and collaborators. Published 2026-11-05. Topics: LLM pruning, hardware-guided compression, differentiable architecture search, global and per-layer structure, heterogeneous architectures.

Sheldon Liang, Ali Taghibakhshi, Saurav Muralidharan, Sharath Turuvekere Sreenivas, Ashwath Aithal, Pavlo Molchanov, Nima Tajbakhsh

Not specifiedView resource

Research paper

Beyond Benchmarks: Can Small Open-Weight Models Get Real Coding Work Done?

Research paper by Vaibhav Jain. Published 2026-10-25. Topics: vLLM, SGLang, llama.cpp, MLX, tool-call formatting.

Vaibhav Jain

Not specifiedView resource

Research paper

BeyondWeb: Lessons from Scaling Synthetic Data for Trillion-scale Pretraining

Research paper by Pratyush Maini and collaborators. Published 2025-08-14. Topics: large language model, LLM, synthetic data, pretraining, data wall.

Pratyush Maini, Vineeth Dorna, Parth Doshi, Aldo Carranza, Fan Pan, Jack Urbanek, Paul Burstein, Alex Fang, Alvin Deng, Amro Abbas, Brett Larsen, Cody Blakeney, Charvi Bannur, Christina Baek, Darren Teh, David Schwab, Haakon Mongstad, Haoli Yin, Josh Wills, Kaleigh Mentzer, Luke Merrick, Ricardo Monti, Rishabh Adiga, Siddharth Joshi, Spandan Das, Zhengping Wang, Bogdan Gaza, Ari Morcos, Matthew Leavitt

Not specifiedView resource

Research paper

Compact Language Models via Pruning and Knowledge Distillation

Research paper by Saurav Muralidharan and collaborators. Published 2024-07-19. Topics: pruning, depth pruning, width pruning, attention pruning, MLP pruning.

Saurav Muralidharan, Sharath Turuvekere Sreenivas, Raviraj Joshi, Marcin Chochowski, Mostofa Patwary, Mohammad Shoeybi, Bryan Catanzaro, Jan Kautz, Pavlo Molchanov

Not specifiedView resource

Research paper

Critical Evaluation and Augmentation of NVIDIA Nemotron 3: Efficiency, Benchmarks, and Algorithmic Insights in Open AI Models

Research paper by Syed Muntasir Mamun, published 2025 in Zenodo (CERN European Organization for Nuclear Research). Research area: Topic Modeling.

Syed Muntasir Mamun

Not specifiedView resource

Platform labels describe intended use. Read each resource's author credits, requirements and available access methods.

Resources

No matching resources