Advanced submission evaluation (Docker)

For programming projects hosted on our platform that need to verify that the code compiles/runs/gives the correct output, we offer an advanced interface to run code on each submission the moment they're submitted using docker images.

The process of setting up an advanced evaluation test:

1. Write your tests and package them in a docker image.

• We offer an example docker image in examples/advanced-evaluation
• Receive the submission files in a volume under /usr/src/submission, output artifacts under /usr/out/artifacts and decide correctness with the exit code (0 succeeds, others fail).

2. Push your image to our private docker registry

• use the command docker push sel2-1.ugent.be:2002/[YOUR_IMAGE_NAME]

3. When creating or editing your project on the site, fill in the Evaluation docker image name in the text field and save.

You will be able to see the results and artifacts in the submission's page.