Official evaluation of the private part of the test data is only possible via our public evaluation server. For local testing or initial performance estimation, you can use the public part of the test data.
A PyTorch dataset class for MVTec AD 2 is available for download, which can be easily integrated into a PyTorch dataloader and be used to store anomaly images in the correct structure for evaluation. Official evaluation is possible via our public evaluation server. Here, we provide a script that checks a submission for correctness and compresses it for you. The code utils further also include snippets to measure runtime and memory footprint of a method. For details on how to use the scripts, please take a look at the included readme file.
If you use this dataset in scientific work, please cite our paper:
Lars Heckler-Kram, Jan-Hendrik Neudeck, Ulla Scheler, Rebecca König, Carsten Steger: The MVTec AD 2 Dataset: Advanced Scenarios for Unsupervised Anomaly Detection; in: International Journal of Computer Vision 134(4), 2026, DOI: 10.1007/s11263-026-02743-0