Docker Submission Guidelines

Follow these steps to package, test, and submit your algorithm for the ISLES 2026 challenge.

Step 1: Create Your Docker Image

You can build your algorithm container using our official Docker Template Repository as your starting point.

Step 2: Mandatory Preliminary Evaluation (Sanity Check)

Before submitting to the final phase, you must successfully test your Docker container in the Preliminary Evaluation phase.

  • Submission Limit: You are allowed 2 submission attempts per day in this phase.
  • Evaluation Data: Your container will be evaluated on 2 MRI scans from the training set:
    • sub-r001s001
    • sub-soop0468
  • Verification: Check the generated outputs carefully to ensure your predictions match your expectations.

💡 Resource Consideration: CPU vs. GPU Requests

Running jobs on GPUs is expensive for our organization team. We kindly request and strongly encourage participants to test their algorithm on CPU first.

  • When to stick with CPU: If your algorithm succeeds (runs under 10 minutes on CPU) in the sanity phase, and produces correct predictions, please submit to the test phase without requesting a GPU.
  • When to request a GPU: You are fully welcome to request a GPU if:
    • Your algorithm takes longer than 10 minutes to run on CPU in the sanity phase.
    • Your code or dependencies (e.g., PyTorch, CUDA-specific libraries) fail, crash, or produce unexpected outputs on CPU.

Step 3: Final Test Phase Submission

Once your preliminary submission passes, you are ready for the final test phase.

  • Single Submission Policy: You are allowed only ONE submission to the final test phase.
  • Failure Exceptions:
    • If your container passed the preliminary phase but failed during the final test phase, we will provide error logs to help you fix the Docker container and resubmit.
    • If your preliminary sanity check succeeded on CPU, but the final test phase fails or behaves unexpectedly on CPU, we will allow a resubmission configured with a GPU.