Containers

Docker Deployment

Package fine-tuned weights and high-throughput inference engines into self-contained Docker containers.

1. Build Container Image

moro release build --target docker --tag myorg/moro-model:v1
  

2. Run Container with GPU Passthrough

docker run -d --gpus all -p 8000:8000 myorg/moro-model:v1
  

The container exposes OpenAI-compatible /v1/chat/completions endpoints locally.