Submission Guide

Platform
  1. 01

    Prepare the client

    git clone https://gitlab.qudeleap.com/qudeleap/mirrorq-cli.git
cd mirrorq-cli
cargo install --path . --locked
  2. 02

    Sign in

    Run mirrorq login and approve the request in your browser. If the browser cannot open, mirrorq prints the authorization URL and code. 

    export MIRRORQ_BASE_URL="http://8.163.30.176:8000"
mirrorq login
  3. 03

    View available tasks

    mirrorq list
  4. 04

    Implement the adapter

    Read the downloaded dataset directory, write the validator-defined result to the output path, and exit with code 0. 

    python adapter.py <dataset-dir> <output-file>
  5. 05

    Submit the benchmark

    mirrorq downloads fresh data, runs the adapter, and uploads its result. Runtime ends when the result upload completes.

  6. 06

    Review the leaderboard

Common errors

400 Invalid output: fix the adapter output and retry while the submission remains open.

409 Submission limit reached: wait for or cancel an outstanding run, then retry.

502 Validator failure: the server released the submission; register again.