Keyboard shortcuts

Press or to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Quickstart

This is the shortest install-and-run path from an empty shell to a submitted job.

1. Install a release binary

curl -fsSL https://raw.githubusercontent.com/NicolasSchuler/hpc-compose/main/install.sh | sh

The installer selects the newest published release for the current Linux or macOS machine and installs hpc-compose into ~/.local/bin by default. Check the Support Matrix before assuming that a platform can run full cluster workflows.

2. Initialize a starter spec

hpc-compose init \
  --template minimal-batch \
  --name my-app \
  --cache-dir /shared/$USER/hpc-compose-cache \
  --output compose.yaml

If you already know the closest shipped example, copy it directly instead. The Examples page is the fastest way to choose one.

3. Normal run

hpc-compose submit --watch -f compose.yaml

submit --watch is the normal run. It runs preflight, prepares missing artifacts, renders the batch script, submits it through sbatch, then follows scheduler state and tracked logs.

4. Debugging flow

hpc-compose validate -f compose.yaml
hpc-compose inspect --verbose -f compose.yaml
hpc-compose preflight -f compose.yaml
hpc-compose prepare -f compose.yaml

Use the debugging flow when you want to confirm:

  • service order
  • normalized image references
  • cache artifact paths
  • whether prepare steps will rebuild every submit

Warning

inspect --verbose prints resolved environment values and final mount mappings. Treat its output as sensitive when the spec contains secrets.

5. Revisit a tracked run later

hpc-compose status -f compose.yaml
hpc-compose stats -f compose.yaml
hpc-compose logs -f compose.yaml --follow

From a source checkout

If you are running from a local checkout instead of an installed binary:

cargo build --release
target/release/hpc-compose init --template minimal-batch --name my-app --cache-dir /shared/$USER/hpc-compose-cache --output compose.yaml
target/release/hpc-compose submit --watch -f compose.yaml
  • Use the Execution model page to understand what runs where and which paths must be shared.
  • Use the Support Matrix page to confirm what is officially supported versus only release-built.
  • Use the Task Guide page when you want a goal-oriented starting point.
  • Use the Runbook when adapting a real workload to a real cluster.
  • Use the Examples page when you want the closest known-good template.
  • Use the Spec Reference when changing fields or validation-sensitive values.