Evaluation Runners

Evaluation Runners are the worker nodes that perform on-device measurements. You must run at least one runner on your target hardware (GPU) to process compilation jobs.

The runner polls the yasp agent for candidate kernels, benchmarks them on your specific hardware, and returns the performance metrics to the optimizer.

Prerequisites

• Linux OS with a recent kernel.
• Hardware: An NVIDIA or AMD GPU.
• Docker: Installed with GPU support.
• NVIDIA: Container Toolkit Guide.
• AMD: ROCm Docker Guide.
• API Token: Get your Token.

---

NVIDIA

Run the evaluation runner

The Evaluation Runner is packaged as a Docker image and is available on Docker Hub. You can run it with the following command, providing it:

• Access to the target GPU
• The yasp API host
• The API token you defined earlier
• Optionally, a human-readable alias

docker run -d -e YASP_ALIAS=my-first-nvidia-runner -e YASP_API_HOST=$YASP_API_HOST -e YASP_API_TOKEN=$YASP_API_TOKEN --gpus device=0 yaspai/runner-nvidia:v1.6.2

AMD

Run the evaluation runner

The Evaluation Runner is packaged as a Docker image and is available on Docker Hub. You can run it with the following command, providing it:

• Access to the target GPU
• The yasp API host
• The API token you defined earlier
• Optionally, a human-readable alias

docker run -d -e YASP_ALIAS=my-first-amd-runner -e YASP_API_HOST=$YASP_API_HOST -e YASP_API_TOKEN=$YASP_API_TOKEN --device=/dev/kfd --device=/dev/dri yaspai/runner-amd:v1.6.2