The NVIDIA NeMo team has released the HelpSteer open-source dataset, in collaboration with Scale AI, to enhance the factual accuracy and coherence of language model responses. The dataset includes 10,000 high-quality prompts, enabling greater controllability of large language model responses through NeMo SteerLM technology. By utilizing this dataset and technology, NVIDIA has trained the Llama270B foundational model, which outperforms the Llama2-70B. This open-source tool offers developers the flexibility and control to build custom LLMs, facilitating a better understanding and application of the SteerLM technology within the NVIDIA NeMo framework.