Skip to content
#Hugging Face
  1. Hacker News · AI88

    Edge0 open-sources Edge0-145B and Edge0-120B on-device models with inference framework

    Edge0 open-sourced Edge0-145B and Edge0-120B along with its unified inference framework and deployment tools, claiming Edge0-145B is the first open-source 145B-parameter on-device model. The company reports 29GB peak memory, 1,100+ tokens/s prefill, 80+ tokens/s decode and roughly 120W typical power on a compatible laptop, with 128K–256K context. It cites internal scores of 64.6 on DeepSWE 1.1, 86.52 on Terminal-Bench 2.1, 90.4 on GPQA-Diamond and 80.6 on IFBench, and says weights are on Hugging Face with day-one support for macOS, Windows and Linux.

    Why it matters: Edge0 open-sources a 145B on-device model that reports 29GB peak memory and 80+ tokens/s decode, offering a concrete data point on how far local inference can scale.

  2. Hugging Face Blog69

    IBM releases LLMON preview models built on Granite 4.1 3B and 8B

    IBM released two experimental preview models, granite-4.1-3b-LLMON-preview and granite-4.1-8b-LLMON-preview, derived from Granite 4.1 base checkpoints and trained to consume and generate LLMON, an LLM-native markup language that marks instructions, data and requirements with reserved special-token delimiters. On the OPI benchmark the models avoid 47% more indirect prompt injection attacks than the best frontier model tested and 95% more than the best open-source model, while performing on par with Granite 4.1 Instruct on standard benchmarks. The release includes a GitHub toolkit with lossless JSON-to-LLMON converters, and the authors note the preview is for exploration, not production.

    Why it matters: IBM trained a preview model on Granite 4.1 that can read and write LLMON tags, using explicit instruction-data separation to reduce the indirect prompt injection success rate on the OPI benchmark to near zero while maintaining general capabilities.

  1. TechCrunch · AI78

    Jensen Huang resigns as Nvidia CEO, raising doubts over Nvidia's open source support

    Nvidia CEO Jensen Huang resigned Thursday after admitting to an affair with an alleged Chinese spy, leaving open whether Nvidia will keep backing open-weight AI. Huang had pushed the Nemotron open-weight model family, backed startups like Reflection AI and Thinking Machines Lab, and organized an open letter signed by 25 companies urging Washington not to over-restrict open models. Nvidia has named CFO Colette Kress as interim CEO and has yet to finalize its $13 billion deal to acquire Hugging Face.

    Why it matters: Huang's resignation leaves open-weight AI advocacy without its most visible corporate backer, while Nvidia's pending Hugging Face deal and its own business incentives suggest the strategy may outlast him.

  1. Amazon Science62

    Amazon releases Mitra-v2 tabular foundation model with scaled synthetic pretraining

    Amazon introduced Mitra-v2, a second-generation tabular foundation model for classification and regression, released with fine-tuned models and inference and fine-tuning code under the Apache-2.0 license on Hugging Face. It is pretrained on synthetic tables with 10 times as many rows and roughly three times as many columns as Mitra-v1, using a new hybrid SCM prior and hybrid optimizer while keeping the Transformer architecture unchanged. On TabArena, a public benchmark of 51 real-world datasets, Mitra-v2 leads the single-model field, beats Mitra-v1 on 32 of the 33 datasets both run natively, and finishes all 51 within the one-hour budget; fine-tuned Mitra-v2 also ranks first on ScoringBench.

    Why it matters: Mitra-v2 shows that widening synthetic pretraining data, rather than deepening the network, lifts a tabular foundation model to the top of TabArena's single-model field.

  2. Hugging Face Blog60

    Hugging Face explains decision models and their support in Transformers and llama.cpp

    Hugging Face published an explainer on decision models, which take a state plus typed questions and return probabilities over predefined answers instead of generating text. The post details the choice, score and noul primitives, the confidence formula, and new support through Transformers' DecisionPipeline and AutoModelForDecision, a shared /v1/systemone endpoint in Transformers and llama.cpp, a Hub tag for discovery, and fine-tuning with the Trainer API. It notes that the same endpoint also works with compatible autoregressive LLMs by scoring answer logits in a batched forward pass.

    Why it matters: Hugging Face explains how decision models turn classification into a typed, non-generative interface and shows how to serve and fine-tune them with Transformers and llama.cpp.

  1. Modal Blog60

    Thinking Machines' Inkling multimodal model now available on Modal

    Thinking Machines released Inkling, a general-purpose multimodal model that takes text, image and audio inputs and outputs text, and Modal is offering it from day zero as a Managed Endpoint with token-based pricing. Inkling is a mixture-of-experts transformer with 975B total parameters, 41B active, a 1M token context window and native audio and vision, using five sliding-window attention layers for every full-attention layer. On agentic workloads with 8x B200s, Modal's custom DFlash speculator reached 250 tokens per second per user at 2.5M TPM of per-GPU throughput, 67% faster interactivity than the model's built-in speculative path at matched throughput.

    Why it matters: Modal's day-zero endpoint for Thinking Machines' 975B-parameter Inkling shows how a custom DFlash speculator lifts interactivity 67% over the model's built-in speculative path.

You are all caught up