Welcome to another round of Modal Product Updates! Here’s what’s new this month.

🪣 Cloud bucket mounts

You can now mount AWS S3 and Cloudflare R2 buckets into your containers as writable file system volumes.

🌪️ @web_server

It is now much easier to host web servers that don’t speak the ASGI or WSGI protocols in Modal. The @web_server decorator lets you directly specify a port that is listening for HTTP requests inside the container.

🔑 Okta single sign-on

Okta is available as an authentication mechanism for enterprise plan users. Please reach out to us if you’re interested in this for your workspace!

📀 Volume viewer

You can explore volume file systems from the web dashboard. To do so, visit the Storage tab.

👩‍💻 Client Updates

pip install --upgrade modal to get the latest client features, including:

• Apps in multiple files can be composed using .include
• Dicts: keys, values and items can now be iterated over
• Functions: input cancellation no longer terminates the entire container
• Functions: now support hard memory limits
• Image.run_function now allows you to pass args and kwargs to the function.
• Queues can now have multiple partitions
• Sandboxes: now support writing to stdin
• modal.dict lets you manipulate Dicts from the CLI
• modal run -i brings back remote breakpoint support
• modal volume get and put support larger files

For a complete list, check out the changelog.

🥑 Fresh posts

• Get 4,500 tok/s on Lama 3 using TRT-LLM
• Beating Proprietary Embedding Models with a Quick Fine-Tune
• Why you should move your ETL stack to Modal
• Prototype to production with ComfyUI
• Render a video with Blender on many GPUs in parallel
• Run Gemma with vLLM

As always, if you’ve built anything else using Modal, share it with us on the community Slack!

You can reply to this email with thoughts and feedback, or join our Slack if you haven’t already. We’d love to hear from you.

Missed updates from the previous months? Find them here: February, November, August, July, May.