Inference

Catalog

• Cached Resources

• Confidential Jobs

• Endpoints

• Examples

  • Hello World
  • Jupyter
  • LMDeploy
  • Multi Operation Job
  • Ollama
  • Open WebUI
  • Stable Diffusion WebUI
  • Tiny Llama
  • VLLM
  • Whisper

• Getting Started

• GPU Markets

• Health Checks

• HuggingFace Resources

• Inference Models

• Inference Models

• Job Definition

• Job Definition Schema

• Job Execution Flow

• Llama 2

• Multiple Services

• Request for Inference

• S3 Resources

• Stable Diffusion

• Tutorial Hub