Modal logo
Guide Introduction to Modal Getting started Functions Functions Invocation methods Function lookups Container lifecycle management Parametrized Functions Dynamic configuration Sandboxes Sandboxes Running commands Networking and security File access Snapshots Pricing and resources Sidecars BetaSecret injection BetaEndpoints Endpoints Shared Endpoints Dedicated Endpoints Endpoint integrations Training Quickstart Tinker-compatible API BetaMulti-node training Images Defining Images Using existing container images Named images Fast pull from registry GPUs and other resources GPU acceleration Using CUDA on Modal Configuring CPU, memory, and disk Scaling out Scaling out Input concurrency Batch processing Job queues Dynamic batching Multi-node Clusters Deployment Apps, Functions, and entrypoints Managing deployments Continuous deployment Scheduled Functions HTTP Applications Servers Sticky Sessions Web Functions Streaming endpoints Web Function URLs Request timeouts Proxy Tokens Networking Tunnels Proxies BetaCluster networking Data sharing and storage Passing local data Volumes Storing model weights Cloud bucket mounts Dicts Queues Dataset ingestion Secrets and environment variables Secrets Environment variables Performance Cold start performance Memory Snapshots High-performance LLM inference Reliability and robustness Failures and retries Preemption Timeouts GPU health Troubleshooting Security and privacy Security and privacy Data residency Customer-supplied encryption keys AlphaAudit logs Integrations Using OIDC to authenticate with external services Connecting Modal to your Datadog account Connecting Modal to your OpenTelemetry provider Okta SSO Microsoft Entra SSO Custom SAML SSO SCIM Integration Slack notifications BetaWorkspace & account settings Workspaces Environments Service users User groups Role-Based Access Control (RBAC) Billing Network egress billing Budgets Other topics Feature maturity Notebooks Restricted Functions JavaScript/Go SDKs BetaModal 1.0 migration guide File and project structure Developing and debugging Jupyter notebooks Asynchronous API usage Global variables Region selection GPU Metrics

V2 Sandboxes

“V2” refers to Modal’s next-generation Sandbox backend, which creates Sandboxes with higher throughput, runs more of them concurrently, and gets them interactive faster. It is not a separate API: Sandboxes use it automatically.

Upgrading 

The new backend is the default in these SDK versions and later:

  • Python 1.6.0
  • JavaScript 0.11.0
  • Go 0.11.0

Sandbox.create(), Sandbox.from_name(), and Sandbox.list() (and their JavaScript and Go equivalents) use the new backend without any code changes. On earlier versions (from Python 1.5.4 and JavaScript and Go 0.10.1), the new backend is opt-in via the MODAL_SANDBOX_V2=1 environment variable or sandbox_v2 = true in your .modal.toml profile. You can drop that setting once you upgrade.

Sandboxes that use features the new backend does not support (such as GPUs) are created on the previous backend automatically.

Two things to be aware of:

  • The new backend does not support the legacy filesystem API (Sandbox.open, ls, mkdir, rm, and watch), which was removed in Python 1.6.0. Migrate any code that uses it before upgrading.
  • When Sandbox.create() returns, the Sandbox has already been scheduled onto a machine, so wait_until_ready() completes faster and more consistently.

If you hit a rough edge, please reach out via Slack or email us at support@modal.com.