TrainingFlashAttention-4: Faster GPUs need smarter software to speed up AI training
Expensive GPUs can still spend time waiting on slower operations. Research from Together AI and five other organizations shows how better scheduling can turn more of that hardware into useful work.