🪵 Logs refresh

Our logs dashboard has gotten a refresh! This includes interface improvements like being able to filter on inputs over a time range.

🔍 🕵️ Live profiling containers

We’ve added a container profiling feature that allows you to see what code is running in your container in real time. This is intended to help you debug when a container or input is stuck

To access this feature, head over to the Containers tab in your function, open a running container, and kick off a Live Profiling session.

🐚 Debug shells

Our new Debug Shells let you run commands inside a running container. They come preinstalled with tools such as vim, ps, and strace. To get started, run:

1. modal container list to get your container ID
2. modal shell [container-id] to launch a debug shell

🌎 Region selection available on all plans

Our region selection feature allows you to define which cloud region you’d like your function to run in. It’s helpful for reducing egress fees and complying with data residency requirements, and is now available on all plans! Usage is priced with a multiplier on top of our base prices.

👩‍💻 Client updates

Run pip install --upgrade modal to get the latest client updates:

• We’ve added OIDC authentication support for cloud bucket mounts via the new oidc_auth_role_arn field in CloudBucketMount.
• Modal functions, methods and entrypoints can now accept variable-length arguments to skip Modal’s default CLI parsing.

🧬 DeepSeek on Modal

Fresh off the DeepSeek launches, we have a new example on how to run DeepSeek-R1 (in ternary format) on Modal.

🖊️ New on our blog

• Sandboxes in GA - Sandboxes are the Modal primitive for safely running untrusted code, whether that code comes from LLMs, users, or other third-party sources. They are now generally available!
• Memory snapshotting - In this blog post, we share how a warmed up container can be saved and later restored for a 2.5x cold start performance boost. Restoring a Stable Diffusion container and getting the model into the GPU takes only 3.56s at p50!

🍭 March 6 developer event with Mistral

We’re hosting an open-source LLM demo night and happy hour with Mistral on March 6! RSVP here. If you use Mistral and Modal and are interested in demoing, fill out this form.