HelpSteer 2: Open-source dataset for training top-performing reward models. - Zhilin Wang; Yi Dong; Olivier Delalleau; Jiaqi Zeng; Gerald Shen; Daniel Egert; Jimmy Zhang; Makesh Narsimhan Sreedhar; Oleksii Kuchaiev (NeurIPS, 2024)

NeMo-Aligner: Scalable Toolkit for Efficient Model Alignment. - Gerald Shen; Zhilin Wang; Olivier Delalleau; Jiaqi Zeng; Yi Dong; Daniel Egert; Shengyang Sun; Jimmy J. Zhang; Sahil Jain; Ali Taghibakhshi; Markel Sanz Ausin; Ashwath Aithal; et al. (CoRR, 2024)

HelpSteer2: Open-source dataset for training top-performing reward models. - Zhilin Wang; Yi Dong; Olivier Delalleau; Jiaqi Zeng; Gerald Shen; Daniel Egert; Jimmy J. Zhang; Makesh Narsimhan Sreedhar; Oleksii Kuchaiev (CoRR, 2024)

Nemotron-4 340B Technical Report. - Bo Adler; Niket Agarwal; Ashwath Aithal; Dong H. Anh; Pallab Bhattacharya; Annika Brundyn; Jared Casper; Bryan Catanzaro; Sharon Clay; Jonathan M. Cohen; Sirshak Das; Ayush Dattagupta; et al. (CoRR, 2024)

Elucidating Optimal Reward-Diversity Tradeoffs in Text-to-Image Diffusion Models. - Rohit Jena; Ali Taghibakhshi; Sahil Jain; Gerald Shen; Nima Tajbakhsh; Arash Vahdat (CoRR, 2024)

HelpSteer2-Preference: Complementing Ratings with Preferences. - Zhilin Wang; Alexander Bukharin; Olivier Delalleau; Daniel Egert; Gerald Shen; Jiaqi Zeng; Oleksii Kuchaiev; Yi Dong (CoRR, 2024)

Reward-aware Preference Optimization: A Unified Mathematical Framework for Model Alignment. - Shengyang Sun; Yian Zhang; Alexander Bukharin; David Mosallanezhad; Jiaqi Zeng; Soumye Singhal; Gerald Shen; Adithya Renduchintala; Tugrul Konuk; Yi Dong; Zhilin Wang; Dmitry Chichkov; et al. (CoRR, 2025)