Modal logo
ExamplesDocsPricingCompany
Log in Sign Up
GuideReference

Overview

Introduction Example: Hello, world Tutorial: A simple web scraper

Custom container images

Custom container images Private registries

GPUs and other resources

GPU acceleration Reserving CPU and memory Example: Run a 40-billion parameter LLM (Falcon-40B)

Scaling out

Scaling out Example: Face detection on YouTube videos

Secrets and environment variables

Secrets Example: Write to Google Sheets

Deployment

Managing deployments Invoke deployed functions

Scheduling and cron jobs

Scheduling remote cron jobs Example: Hacker News Slackbot

Web endpoints

Web endpoints Streaming web endpoints Web endpoint URLs Request timeouts Example: Document OCR job queue Example: Document OCR web app

Sharing data

Passing local data Shared volumes

Deep learning and AI examples

Fast Stable diffusion Replace your CEO with an LLM Voice Chat with LLMs Parallel podcast transcription using Whisper Pet Art using Dreambooth Question-answering with LangChain Play with ControlNet Misc examples

Examples using popular libraries

DuckDB: Analyze NYC taxi data in parallel Blender: Distributed 3D rendering SQLite: Publish explorable data with Datasette Y! Finance: Stock prices in parallel

Reliability and robustness

Failures and retries Preemption Timeouts Troubleshooting

Security

Security at Modal

Other topics

Developing and debugging Cold start performance Workspaces Notebooks support Asynchronous usage Global variables Container lifecycle and parameters Apps, stubs, and entrypoints Useful snippets Example: Algolia docsearch crawler

Misc Machine Learning Examples

Looking for how to make a popular library work with Modal? There’s a guide for that:

  • Vision model training and deployment with FastAI, WandB and Gradio
  • Classifier training with TensorFlow and TensorBoard
  • Batch inference with a Huggingface model
  • Real-time object detection with webcam input
  • Generate synthetic data with Jsonformer
  • Stable Diffusion with AITemplate
  • Stable Diffusion with ONNX Runtime
  • Run OpenLLaMA-7B on an A100
  • Run Falcon-40B on an A100 with bitsandbytes quantization
Misc Machine Learning Examples
Modal logo
Company Examples Documentation Pricing
© 2023 Modal Labs, Inc.