Cost-effective and comprehensive inspection based on machine learning
Automating quality control with AI-based image processing requires a suitable network and automation concept. Phoenix Contact supports system evaluation and component selection, as shown in this example from an international automobile manufacturer.
The automobile manufacturer maintains high quality standards by inspecting and optimizing all car components. Automated quality inspection is crucial for cost-effective control, using sensors (like ultrasonic sensors or cameras) to detect defects, which are then evaluated and corrected by robots. In the body shop, weld quality is a major focus, as proper welding ensures vehicle stability and durability. Additionally, removing weld spatter is essential to prevent damage to cables laid later.
Previously, inspection involved manually swiveling car bodies and illuminating them with diffuse lighting, then removing weld spatter with a Dremel tool. To automate this, the manufacturer conducted a feasibility study using eight cameras for inspection and a robot-guided rotary tool to remove the weld spatter.
Flexible fields of application due to the generalization properties
Implementing automated weld spatter removal with cameras and robots requires additional software. Firstly, this software synchronizes cameras and lighting for brightness control. Next, it inspects images for weld spatter. Then, it converts the position into the robot’s coordinate system. Finally, it guides the robot to remove the spatter with its rotary tool.
In this system, industrial image processing detects weld spatter, implemented either rules-based or via machine learning (ML). The manufacturer chose ML for its flexibility with different component shapes. The pretrained ML model learns to detect weld spatter based on properties like shine, shadows, or shape, making it adaptable to various automotive parts and spatter appearances.
In the ML process, images of components with and without weld spatter are taken. The spatter is manually identified and described using coordinates or bounding boxes. This data trains the model, and the descriptions check recognition accuracy. The trained model is then tested on new images. Due to generalization, it can detect spatter on previously unprovided images, serving as an identifier for removal.
Joint evaluation of a coordinated automation and network concept
Besides the automated quality control solution, a coordinated automation concept is needed. This includes connecting and powering cameras and lighting, using a PLC to control the line and robots, execution units for ML processes, and a control station for human-machine interaction. Additionally, components must form an efficient, interference-free network. Phoenix Contact assisted in creating the concept and evaluating suitable ML hardware.
Proven systems from the Blomberg-based company, already in use at the automobile manufacturer, were utilized for automation, network connection, and control stations. For ML processes, the manufacturer provided pretrained models, which Phoenix Contact integrated into a machine learning runtime environment and tested on various industrial PCs (IPCs). CPU and RAM utilization were verified in endurance tests. The results helped select the most cost-effective hardware. Phoenix Contact also offers hardware, software, and services for other industries through its Digital Factory now campaign.
Future potential through virtualization, GPU extensions, and Time-Sensitive Networking
The chosen concept perfectly meets the automobile manufacturer’s current needs. Future ML technology developments will offer more optimization potential. Container virtualization will enable automation services and ML processes in IT or cloud environments. Model execution can be accelerated with industrial PCs using GPUs. Currently, automation and camera networks must be separate, but Time-Sensitive Networking (TSN) can combine them, reducing complexity. Phoenix Contact is working on TSN applications. Regular technology days and information exchanges help tailor these technologies to the automotive industry’s needs.
The automobile manufacturer already uses ML processes for automated quality control. Phoenix Contact supports evaluation, automation, and network concepts with its hardware, software, and services.
Read more about AI-based quality control in the body shop.