Skip to content
Only Industry
August 6, 2024Tuesday
  1. Modal Blog42

    Modal cuts CPU and GPU prices by 15-30%

    Modal is cutting prices on CPUs and some of its most powerful GPUs by 15-30%, citing increased competition in the GPU supply pool and the launch of more powerful GPUs over the past year. The company is also changing CPU/memory billing to charge max(reservation, usage) per running container, with a minimum default reservation of 0.125 CPU cores for all Functions. The Team plan rises to $250/mo with unlimited seats and $100/mo in credits, with new pricing taking effect in September for affected Starter and Team/Enterprise users.

July 3, 2024Wednesday
  1. Modal Blog30

    Competitive prompt engineering: Basis runs the Prompt Olympics on Modal

    Basis organized the Prompt Olympics, a competitive programming-style prompt engineering contest with a $5,000 prize, and ran it on Modal's infrastructure. In one challenge, participants wrote prompts that steered LLaMA 3 70B, deployed on Modal, to generate code that had to pass tests inside Modal Sandboxes. The finale had players prompt a model to control the Crafter game agent; Basis found even capable open source models like LLaMA 3 70B hard to prompt effectively and switched to a proprietary model API for that component.

May 20, 2024Monday
  1. Modal Blog25

    Why Substack moved its AI and ML pipelines to Modal

    Substack has moved training and deployment for nearly all of its ML models—including spam detection, newsletter recommendations, audio transcription, sentiment analysis and image generation—from AWS SageMaker to Modal. Head of AI & ML Engineering Mike Cohen cited SageMaker's convoluted developer experience, hard-to-share code across notebooks and 5+ minute container startup times; on Modal, an inference endpoint took an hour to implement. Substack now runs a full fine-tune, validation and deployment workflow on Modal's storage primitives.

April 10, 2024Wednesday
  1. Modal Blog12

    Modal named to Wing's 2024 Enterprise Tech 30 list

    Modal, the serverless platform for AI and data teams, has been named to Wing's sixth annual Enterprise Tech 30 list, ranking No. 3 among ten companies in the early-stage category. The list was selected from nearly 600 venture-backed private enterprise tech companies by 112 venture capitalists and 36 corporate development teams.

February 21, 2024Wednesday
  1. Modal Blog22

    How Suno cut 4 months off its launch timeline with Modal

    Suno used Modal to scale inference and batch pre-processing across thousands of GPUs, bringing its music generation model to market four months early instead of hiring engineers to build and maintain infrastructure. The team ran batch pre-processing with a few short Python scripts and no config files, then expanded to model deployment with HTTP-exposed functions and chained inference across multiple models and containers. Modal's auto-scaling to thousands of GPUs handled holiday demand spikes without long-term GPU reservations.

October 10, 2023Tuesday
  1. Modal Blog58

    Modal 正式全面开放，并宣布 1600 万美元 A 轮融资

    Modal announced that its cloud function platform is now generally available, letting anyone sign up and run Python code in the cloud within minutes, after opening a waitlist in 2022. The platform offers serverless execution billed per second, autoscaling GPU inference endpoints on A100, A10G, T4, L4 and H100, and large-scale batch jobs across thousands of containers with no YAML configuration. Modal also raised a $16M Series A led by Redpoint Ventures, with Amplify Partners, which led the seed round, and plans to use the capital to accelerate its product roadmap.

  2. Modal Blog36

    Modal Labs Raises $16M Series A and Launches Its Cloud Infrastructure Platform

    Modal Labs has raised a $16 million Series A led by Redpoint Ventures, with existing investor Amplify Partners and new participants including Lux Capital and Definition Capital, bringing total funding to $23 million. The company also officially launched its cloud platform, previously in beta with early customers such as Ramp, Substack and SphinxBio, and will use the funds to accelerate product development and hire engineers at its New York City headquarters.