Product Updates: Rollbacks, batching, sandbox tunnels & more

Welcome to another round of Modal Product Updates! Here’s what’s new this month.

↩️ App rollbacks

Deployed something questionable? You can now instantly roll back your app to a previous version from the dashboard or the CLI.

📚 Dynamic batching

The @batched decorator accumulates requests into dynamically-sized batches. This lets you trade off latency for throughput and GPU utilization.

🏝️ Sandbox tunnels and exec

Sandbox objects can now forward TCP ports to the internet. This is useful if, for example, you want to connect to a web servers running inside them. You can also exec and interface with additional processes inside an existing Sandbox.

We’re interested in improving Sandboxes for agentic use cases. Please reach out to us if you have feedback or feature requests here!

🔭 OpenTelemetry integration

You can now export logs from Modal to your OpenTelemetry provider. If there are more integrations you would like to see, please let us know!

🤑 Pricing changes

CPU cores and higher end GPUs got cheaper! Read the announcement.

👩‍💻 Client Updates

Run pip install --upgrade modal to get the latest updates. Here are some of the highlights:

• Web endpoints can now be parametrized.
• Methods in a cls now share the same pool of containers.
• App deployments are now atomically applied.

For a complete list, check out the changelog.

🥑 Fresh posts

• Modal supports HIPAA compliance
• Inside the Modal Code Playground
• Beat GPT-4o at Python by searching with 100 dumb LLaMAs
• Publish custom metrics with Prometheus Pushgateway
• Custom Pet Art from Flux with Hugging Face and Gradio

As always, if you’ve built anything else using Modal, share it with us on the community Slack!