Welcome to another round of Modal Product Updates! Here’s what’s new this month.
↩️ App rollbacks
Deployed something questionable? You can now instantly roll back your app to a previous version from the dashboard or the CLI.
📚 Dynamic batching
The @batched decorator accumulates requests into dynamically-sized batches. This lets you trade off latency for throughput and GPU utilization.
🏝️ Sandbox tunnels and exec
Sandbox objects can now forward TCP ports to the internet. This is useful if, for example, you want to connect to a web servers running inside them. You can also exec and interface with additional processes inside an existing Sandbox.
We’re interested in improving Sandboxes for agentic use cases. Please reach out to us if you have feedback or feature requests here!
Read the docs🔭 OpenTelemetry integration
You can now export logs from Modal to your OpenTelemetry provider. If there are more integrations you would like to see, please let us know!
Read the docs🤑 Pricing changes
CPU cores and higher end GPUs got cheaper! Read the announcement.
👩💻 Client Updates
Run pip install --upgrade modal to get the latest updates. Here are some of the highlights:
- Web endpoints can now be parametrized.
- Methods in a
clsnow share the same pool of containers. - App deployments are now atomically applied.
For a complete list, check out the changelog.
🥑 Fresh posts
- Modal supports HIPAA compliance
- Scaling ComfyUI
- Inside the Modal Code Playground
- Beat GPT-4o at Python by searching with 100 dumb LLaMAs
- Publish custom metrics with Prometheus Pushgateway
- Custom Pet Art from Flux with Hugging Face and Gradio
As always, if you’ve built anything else using Modal, share it with us on the community Slack!
