CloudBucketMount
Mounts a cloud bucket to your container. Currently supports AWS S3 buckets.
S3 buckets are mounted using AWS S3 Mountpoint. S3 mounts are optimized for reading large files sequentially. It does not support every file operation; consult the AWS S3 Mountpoint documentation for more information.
Usage
S3:
import subprocess
app = modal.App()
secret = modal.Secret.from_name(
"aws-secret",
required_keys=["AWS_ACCESS_KEY_ID", "AWS_SECRET_ACCESS_KEY"]
# Note: providing AWS_REGION can help when automatic detection of the bucket region fails.
)
@app.function(
volumes={
"/my-mount": modal.CloudBucketMount(
bucket_name="s3-bucket-name",
secret=secret,
read_only=True
)
}
)
def f():
subprocess.run(["ls", "/my-mount"], check=True)R2:
Cloudflare R2 is S3-compatible so its setup looks
very similar to S3. But additionally the bucket_endpoint_url argument must be passed.
import subprocess
app = modal.App()
secret = modal.Secret.from_name(
"r2-secret",
required_keys=["AWS_ACCESS_KEY_ID", "AWS_SECRET_ACCESS_KEY"]
)
@app.function(
volumes={
"/my-mount": modal.CloudBucketMount(
bucket_name="my-r2-bucket",
bucket_endpoint_url="https://<ACCOUNT ID>.r2.cloudflarestorage.com",
secret=secret,
read_only=True
)
}
)
def f():
subprocess.run(["ls", "/my-mount"], check=True)GCS:
Google Cloud Storage (GCS) is S3-compatible. GCS Buckets also require a secret with Google-specific key names (see below) populated with a HMAC key.
import subprocess
app = modal.App()
gcp_hmac_secret = modal.Secret.from_name(
"gcp-secret",
required_keys=["GOOGLE_ACCESS_KEY_ID", "GOOGLE_ACCESS_KEY_SECRET"]
)
@app.function(
volumes={
"/my-mount": modal.CloudBucketMount(
bucket_name="my-gcs-bucket",
bucket_endpoint_url="https://storage.googleapis.com",
secret=gcp_hmac_secret,
)
}
)
def f():
subprocess.run(["ls", "/my-mount"], check=True)Attributes