Hello,
It appears that when a submission reaches the computation budget limit, the error associated with the failure is not clear, and the logs of the submission cannot be shown. Here is an example with a specific submission (913840) :
No scoring output:
Then i inspected the logs from the codabench worker, and I saw that it reaches the computation time limit:
For such expected case, the error should be clearer. Also, it would be ideal if log updates were robust to worker interrupts.
Thanks.
Hello,
It appears that when a submission reaches the computation budget limit, the error associated with the failure is not clear, and the logs of the submission cannot be shown. Here is an example with a specific submission (913840) :
No scoring output:
Then i inspected the logs from the codabench worker, and I saw that it reaches the computation time limit:
For such expected case, the error should be clearer. Also, it would be ideal if log updates were robust to worker interrupts.
Thanks.