Pre-training and post-training advances that change the cost, speed and behavior of AI models.
Pre-training · Post-training
4 articles
TrainingLarge 4’s reinforcement-learning account highlights the work of keeping tasks useful as the learner improves. More generated attempts can otherwise repeat mastered skills or stale experience.
TrainingNemotron 3 Ultra uses four-bit training with higher-precision exceptions. The opportunity is more useful research per budget, provided stability and downstream quality survive.
TrainingExpensive GPUs can still spend time waiting on slower operations. Research from Together AI and five other organizations shows how better scheduling can turn more of that hardware into useful work.
TrainingReViSQL targets SQL queries that return the expected answer for the wrong reason. Its lesson for specialist models is to improve the definition of success, not simply expand the dataset.
Explore the other topics in this desk.
