Hugging Face explains decision models and their support in Transformers and llama.cpp

Hugging Face published an explainer on decision models, which take a state plus typed questions and return probabilities over predefined answers instead of generating text. The post details the choice, score and noul primitives, the confidence formula, and new support through Transformers' DecisionPipeline and AutoModelForDecision, a shared /v1/systemone endpoint in Transformers and llama.cpp, a Hub tag for discovery, and fine-tuning with the Trainer API. It notes that the same endpoint also works with compatible autoregressive LLMs by scoring answer logits in a batched forward pass.