CosmicAC Logo

Managed Inference Job

Guides for creating Managed Inference Jobs and connecting clients to them.

Step-by-step guides for common tasks with a Managed Inference Job. These guides assume you have already installed CosmicAC. If you have not, follow the installation guide.

Guides

How to create a Managed Inference Job through the CosmicAC web interface

Create a Managed Inference Job in the web interface.

How to connect to a Managed Inference endpoint

Point a client at the endpoint and send requests.

Managed Inference Job

Understand what a Managed Inference Job is and when to use it.

Create a Managed Inference Job

Create a Managed Inference Job from the CLI.

Inference commands

CLI commands to run inference on a model.

Model commands

CLI commands to inspect deployed models.

How to set up SSH and Tailscale on a GPU Container Job

Previous Page

How to create a Managed Inference Job (CosmicAC web interface)

Next Page

On this page

GuidesRelated