May 31, 2021

New video: Are you using the MNIST dataset to compare the algorithms?

Presenter: David Issa Mattos (PhD student, Chalmers) One of the most common tasks when developing a new tool is to benchmark it against competing tools. Both researchers and practitioners often look at the results of these benchmarks before selecting the appropriate tool. However, the quality of the benchmark greatly influences the results. In this presentation, we discuss how to evaluate if your benchmark has the appropriate difficulty level and is