Everinfer
Contact us
  • Introduction
  • Getting started
    • Basics
    • Model management
    • Limitations
    • Faster-RCNN example
  • Examples
    • GPT2: 900+RPS
    • BERT With Zero Overhead
    • Segformer from HuggingFace
    • Stable Diffusion: Decouple GPU Ops from Code
  • Essays
    • Our Vision for Serverless ML and Everinfer Internals
Powered by GitBook
On this page
  1. Examples

Stable Diffusion: Decouple GPU Ops from Code

PreviousSegformer from HuggingFaceNextOur Vision for Serverless ML and Everinfer Internals

Last updated 1 year ago

with an example of Stable Diffusion running on Everinfer in a decoupled fashion - U-net runs on remote serverless hardware, while everything else runs locally on a CPU with a 9.5s cold start time!

Check out Colab notebook