Data management

STOIX consists of two components that interact with customers: a dashboard and a controller.

The customer interacts with the dashboard and provides information on clusters as well as jobs. This information is stored by STOIX and communicated to the controller whenever a job needs to be run.

The controller receives information on job runs from the dashboard, such as the Docker container image to run and any environment variables. The controller runs the job on the cluster and reports metadata around the job back to the dashboard. Metadata contains information such as “started”, “running”, “failed” as well as the reason for failure. The controller only interacts with metadata and never touches nor handles any of the customer’s data. See the Cluster controller section for more information on what the controller can access.

Logs sent to the dashboard have a 30 day retention period and are then removed.