Skip to content
Hugging Face Blog·· 1 d agoAI score36

Why your fine-tuning job takes longer than the FLOPs say

Why your fine-tuning job takes longer than the FLOPs say

AI summary

A CatBoost regressor trained on 272 production SFT runs on NVIDIA H200 GPUs predicts end-to-end fine-tuning time with R² = 0.98 and MAE of 1.71 h, versus R² = 0.31 and MAE 12.41 h for the standard FLOP-based estimate. Using only pre-dispatch configuration features, it captures evaluation cadence, checkpoint I/O and per-GPU load that closed-form math misses.

Source:Hugging Face Blog · huggingface.co