Success Story

Revolutionizing cheese production with AI and machine vision

The food industry is experiencing a transformative shift in quality control, due in part to advances in artificial intelligence (AI). When combined with rule-based machine vision, AI is enabling automation of processes that were previously impossible, unlocking new levels of productivity and quality assurance.
HALCON
Food & Beverage
Robotics
Anomaly Detection
Deep Learning

One such breakthrough has been developed by Eberle Automatische Systeme, a leader in automation solutions, with a focus on the cheese-ripening process.

The Challenge: Rising Demand, Labor Shortages, and Sustainability

Cheese consumption is booming globally, and producers are facing increasing challenges as they scale production. Labor shortages, particularly in Europe, are pushing dairies to adopt automation to increase efficiency. Meanwhile, sustainability is becoming a central concern, with an increased focus on reducing waste and conserving resources. Additionally, consumers are demanding higher-quality products with more variety, further intensifying pressure on producers.

As Eberle's Machine Vision Engineer, Dorian Köpfle, explains: “The cheese-ripening process, which can last up to 14 months, requires constant monitoring to avoid mold and ensure quality. Manually inspecting thousands of cheese wheels is virtually impossible, which is why Gebr. Baldauf GmbH & Co. KG, a traditional dairy, turned to us for an automated solution.”

Eberle is a Austria-based company and a Certified Integration Partner of MVTec. It is specialized in automation solutions for the food industry, robotics and industrial image processing.

The Solution: Automation with Machine Vision and AI

The process begins with the inspection of cheese wheels for defects, such as mold spots or blemishes. A 4K camera captures high-resolution images, which are analyzed using advanced machine-vision algorithms from MVTec HALCON. The software uses deep-learning methods to detect anomalies earlier, minimizing process deviations and waste. The data is stored and made available via a web interface, enabling remote monitoring and control. Simultaneously, the mobile care robot performs its task of treating the cheese wheels, ensuring proper rind formation and removal of unwanted smear layers. This system not only increases efficiency by reducing manual inspection but also improves the consistency and quality of the final product.

Key Outcomes and Business Impact

The deployment of this automated system has provided several key benefits for Gebr. Baldauf, including:

  • Increased Efficiency: The mobile care robot operates autonomously, reducing manual labor while ensuring that each cheese wheel is inspected and treated thoroughly.
  • Waste Reduction: Early detection of mold or defects allows for timely intervention, preventing rejected cheese and minimizing waste.
  • Improved Quality Control: The system ensures more consistent and less subjective inspection results by replacing manual methods with AI. As a result, the process achieves a 100% inspection rate, applying the same inspection criteria throughout.
  • Full Traceability: The integration of industrial image processing ensures complete product traceability. All inspection results are stored digitally for easy access, enabling better decision-making and long-term process optimization.

Overcoming Technical Challenges with AI

A significant challenge in developing this system was the natural variability of cheese. Every wheel looks different and undergoes significant changes during the ripening process, which makes rule-based machine vision methods less effective. To overcome this, Eberle utilized AI and deep learning to create a system that could adapt to the unique characteristics of each cheese wheel.

The MVTec HALCON software was instrumental in this process. By training a deep-learning network with a large dataset of cheese images, the system is able to reliably detect defects such as cracks, mold, and discoloration, while ignoring the natural variations inherent to the process. This technology ensures that even subtle anomalies are spotted, allowing for earlier intervention and better quality control.

Visualization of inspected cheese wheels with heat map highlighting defects
Inspections - OK | Current inspection | Inspections - NOK

Enabling Full Automation: The Path Forward

Eberle’s goal was not only to automate the inspection process, but to fully integrate AI into the cheese-ripening workflow. Currently, the system is capable of performing real-time inspections and autonomous care, with minimal human involvement. However, the company is working on refining the system further to handle all types of cheese and stages of ripening, with the long-term goal of creating a fully automated, AI-driven system that requires no human input.
The system also provides a solid foundation for future digitalization efforts, with the potential for integration into larger digital platforms, such as ERP systems and the cloud, to further optimize the production process.

Looking Ahead: Scaling and Further Digitalization

Building on the success of this project, Eberle is now focused on scaling the solution to meet the needs of the entire cheese industry. The company plans to standardize the system and integrate it into both mobile and stationary care robots for cheese production worldwide.

Furthermore, the system’s AI capabilities are continually evolving. Eberle aims to refine the deep-learning models to handle different cheese types and ripening stages, enabling fully automated classification and inspection. This will allow producers to further reduce human involvement while maintaining the highest standards of quality.

As Christoph Muxel of Eberle summarizes, "Our machine vision-based solution demonstrates how automation can sustainably improve quality, efficiency, and competitiveness in the food industry. This project is just the beginning, and we're excited to take these innovations to a global scale."

Further articles

Visualize Object Model 3D
Improve your surface-based matching with two helpful features
Do you sometimes have objects, which have rather small symmetry-breaking elements (such as small boreholes on an object)? Does your surface-based 3D matching not find the correct orientation?
Read more
Developers Corner
Deep OCR Interface
Deep OCR recognition training – the next level
HALCON’s Deep OCR is very powerful and can detect and recognize text in various industrial scenes. However, what if you have a special font, or want to read foreign characters? With HALCON 22.05 it is possible to train the recognition model to read s…
Read more
Developers Corner
Fitted primitives distance threshold
Metrology Model – Quality of Fit
"For most applications, the standard parameter values are sufficient." This sentence is often read in the HALCON Solution Guide. But what if the results do not meet your expectations? The Metrology Model allows lightning-fast measurement of geometric…
Read more
Developers Corner
Review of Acquisition Modes
This article gives an overview of HALCON’s image acquisition modes, explaining how continuous, triggered, and synchronous acquisition work, and clarifying common misconceptions for practical applications.
Read more
Developers Corner
Deep OCR – Tips and Tricks
Have you already experienced the performance boost by using Deep OCR compared to the classical rule‑based approaches? In this article, we’ll show you practical tips and tricks to further improve your Deep OCR results.
Read more
Developers Corner
Easy text and code reading with MERLIC standard tools
If you want to build an MVApp that reads for example QR codes or bar codes you can do so with just a few clicks. You can even combine the tools to get all available information printed on a product in different formats without the need for programmin…
Read more
Developers Corner
About MVTec's Heatmap
Imagine you intend to deliver a HALCON deep-learning-based classification application. And you are about to evaluate a trained model. You are therefore looking for feedback about this model, i.e. about its performances, biases, and other possible def…
Read more
Developers Corner
Gabor filter: What is it for?
Gabor filters, which are well known in the realm of time series analyses, can also be used in HALCON for 2D image analysis. They are particularly useful for detecting textures, patterns, and orientations in complex images.
Read more
Developers Corner
Introduction to new sub-pixel feature of bar code reader
Do you have small resolution bar codes to read but don't get any good results? Then please try our new feature – the subpixel bar code reader.
Read more
Developers Corner
Introduction to XYZ-Mappings (part 2)
This technical article continues our introduction to XYZ-mappings. In the last article, we answered the question "What are XYZ-mappings?" and gave a short preview towards "Why is using XYZ-mappings beneficial for many 3D applications?". Today, we wil…
Read more
Developers Corner
Introduction to XYZ-Mappings (part 1)
This technical article explores the benefits of XYZ-mappings in HALCON, showing how they increase speed, flexibility, and ease of use for many 3D applications.
Read more
Developers Corner
Deep learning: Why is the dataset key for a success result?
Deep learning success starts with the dataset: Learn why acquiring high-quality, well-labeled training data is crucial for reliable classification, detection, segmentation, and anomaly detection in your machine vision applications.
Read more
Developers Corner
How to prepare 3D height images for further processing with MERLIC’s standard tools
Learn how to prepare 3D height images in MERLIC for further processing: convert non-byte images to byte images to enable alignment, embossed text reading, and defect detection with standard easyTouch tools.
Read more
Developers Corner
Deflectrometry demo HALCON
Inspection of specular surfaces with deflectometry in HALCON
Inspect flat and curved reflective surfaces quickly and reliably with HALCON deflectometry: detect scratches, dents, and other defects with synchronized image acquisition and flexible image processing.
Read more
Developers Corner
Deep Learning classifier HALCON
Training a deep learning classifier with HALCON on the embedded board Jetson TX2
Learn how to train a deep learning classifier with HALCON on both a PC and an embedded Jetson TX2 board, from image acquisition to model training and inference, for efficient machine vision applications.
Read more
Developers Corner
Add touch input to the HSmartWindowControlWPF
Learn how to easily add touch input, including pinch-to-zoom, to the HSmartWindowControlWPF in HALCON, leveraging WPF’s built-in multi-touch events for intuitive image control.
Read more
Developers Corner
Increasing Speed in Deflectometry Set-ups
Discover three approaches to increase speed in deflectometry setups, from simple software-based synchronization to hardware triggers and FPGA-based real-time control, enabling faster and more precise inspection of reflective surfaces.
Read more
Developers Corner
HDevelop matching assistant speedup greediness
Speeding up shape-based matching with "Greediness"
Learn how the 'Greediness' parameter in shape-based matching balances speed and detection completeness, enabling faster searches while maintaining robust results in HALCON.
Read more
Developers Corner
Best practice for classification and OCR
Discover best practices for setting up classification and OCR in HALCON using the HDevelop OCR Training File Browser – quickly review, correct, and optimize your training data to improve segmentation and classification results.
Read more
Developers Corner
Rejection all classes 1.5
How to use rejection classes in MVTec HALCON
Learn how to handle outlier samples in MVTec HALCON by using rejection classes in MLP classifiers – automatically generate samples outside the training classes to improve classification reliability.
Read more
Developers Corner
MVTec Software