Modal logo
FeaturedGetting started Hello, worldSimple web scraperServing web endpointsLarge language models (LLMs) Deploy an OpenAI-compatible LLM service with vLLMHigh-throughput serverless TensorRT-LLMRun Vision-Language Models with SGLangDeploy a Moshi voice chatbotRun a multimodal RAG chatbot to answer questions about PDFsFine-tune an LLM with AxolotlReplace your CEO with an LLMDiffusion models Run Flux fast with torch.compileFine-tune an image generator on your petGenerate video clips with MochiRun Stable Diffusion with a CLI, API, and web UIDeploy ControlNet demos with GradioRun a music-generating Discord botTraining models from scratch Train an SLM with early-stopping grid search over hyperparametersRun long, resumable training jobsSandboxed code execution Run a LangGraph agent's code in a secure GPU sandboxBuild a stateful, sandboxed code interpreterRun Node.js, Ruby, and more in a SandboxRun a sandboxed Jupyter notebookParallel processing and job scheduling Transcribe podcasts with WhisperDeploy a Hacker News SlackbotRun a Document OCR job queueServe a Document OCR web appHosting popular libraries FastHTML: Deploy 100,000 multiplayer checkboxesYOLO: Fine-tuning and serve computer vision modelsMultiOn: Create an agent for AI newsBlender: Build a 3D render farmStreamlit: Run and deploy Streamlit appsComfyUI: Run ComfyUI interactively and as an APISQLite: Publish explorable data with DatasetteY! Finance: Process stock prices in parallelAlgolia: Build docsearch with a crawlerConnecting to other APIs MongoDB: Vector and geospatial search over satellite imagesGoogle Sheets: Sync databases and APIs to a Google SheetLangChain: Run a RAG Q&A chatbotTailscale: Add Modal Apps to your VPNPrometheus: Publish custom metrics with PushgatewayManaging data Mount S3 buckets in Modal appsBuild your own data warehouse with DuckDB, DBT, and ModalCreate a LoRA Playground with Modal, Gradio, and S3Miscellaneous
View on GitHub

Add Modal Apps to Tailscale

This example demonstrates how to integrate Modal with Tailscale (https://tailscale.com). It outlines the steps to configure Modal containers so that they join the Tailscale network.

We use a custom entrypoint to automatically add containers to a Tailscale network (tailnet). This configuration enables the containers to interact with one another and with additional applications within the same tailnet.

import modal

Install Tailscale and copy custom entrypoint script (entrypoint.sh). The script must be executable.

image = (
    modal.Image.debian_slim(python_version="3.11")
    .apt_install("curl")
    .run_commands("curl -fsSL https://tailscale.com/install.sh | sh")
    .pip_install("requests==2.32.3", "PySocks==1.7.1")
    .copy_local_file("./entrypoint.sh", "/root/entrypoint.sh")
    .dockerfile_commands(
        "RUN chmod a+x /root/entrypoint.sh",
        'ENTRYPOINT ["/root/entrypoint.sh"]',
    )
)
app = modal.App(image=image)

Configure Python to use the SOCKS5 proxy globally.

with image.imports():
    import socket

    import socks

    socks.set_default_proxy(socks.SOCKS5, "0.0.0.0", 1080)
    socket.socket = socks.socksocket

Run your function adding a Tailscale secret. We suggest creating a reusable and ephemeral key.

@app.function(
    secrets=[
        modal.Secret.from_name(
            "tailscale-auth", required_keys=["TAILSCALE_AUTHKEY"]
        ),
        modal.Secret.from_dict(
            {
                "ALL_PROXY": "socks5://localhost:1080/",
                "HTTP_PROXY": "http://localhost:1080/",
                "http_proxy": "http://localhost:1080/",
            }
        ),
    ],
)
def connect_to_machine():
    import requests

    # Connect to other machines in your tailnet.
    resp = requests.get("http://my-tailscale-machine:5000")
    print(resp.content)

Run this script with modal run modal_tailscale.py. You will see Tailscale logs when the container start indicating that you were able to login successfully and that the proxies (SOCKS5 and HTTP) have created been successfully. You will also be able to see Modal containers in your Tailscale dashboard in the “Machines” tab. Every new container launched will show up as a new “machine”. Containers are individually addressable using their Tailscale name or IP address.