Welcome to another round of Modal Product Updates! Here’s what’s new this month.
🌏 Region selection
You can now select which cloud region your function runs in. This is useful if, for example, you need to follow regulatory requirements, control egress fees, or locate your compute near your database.
🐶 Datadog integration
Our new integration with Datadog lets you forward application and audit logs to Datadog with a single click.
We’re looking into adding support for OpenTelemetry logs and metrics next. Please reach out to us if you’d be interested in beta testing this!
🌈 App details refresh
We’ve completely overhauled our app details page to make it easier to observe and debug production deployments. You can now zoom in on time intervals, view container status, explore your image file system, and much more.
🚀 Lower function latency
We’ve reworked our function call system to allow for higher throughputs with significantly lower overhead. This makes Modal better for serving low-latency, real-time production workloads. Please reach out if we can help optimize your workload further!
👩💻 Client Updates
pip install --upgrade modal to get the latest client features, including:
- modal deploy now accepts an optional —tag.
- Functions: new parameter to request more local disk.
- Images: support for entrypoint and shell in builder syntax.
- Queues: all new CLI for creation, deletion and inspection.
- Sandboxes: can now be created independent of apps.
- Web endpoints: allow exposing FastAPI docs with docs=True.
For a complete list, check out the changelog.
🥑 Fresh posts
- Run GPU jobs from Airflow with Modal
- Guide on using CUDA with Modal
- Why Substack moved their AI and ML pipelines to Modal
- How Hunch supercharged AI workflows with Modal Sandboxes
- Fine-tune Stable Diffusion to create infinite icons
- How we catch crypto miners using syscall signatures
As always, if you’ve built anything else using Modal, share it with us on the community Slack!