TypeSafe AI scales Jev to trillions of tokens in three days on Modal
TypeSafe AI used Modal's serverless platform to train and deploy Jev, its first System One Model, and served over one trillion tokens within three days of launch. Jev is not an autoregressive LLM: it takes state and questions as input and outputs typed, structured values with probabilities in parallel, targeting low-latency workloads. A week after launching, it topped OpenRouter's leaderboard for 1K-10K token contexts, handling 15.1% of requests.