Application Case | Solution for 3D Machine Vision Guided Dismantling and Stacking Application

Project Background

With the rapid development of e-commerce and logistics industries, the innovation of sorting methods has become crucial.  Traditional manual sorting is not only inefficient and prone to errors, but also costly.  Especially in the process of unpacking and palletizing, due to the high workload and monotonous content, the effectiveness and speed of manual operations are often unsatisfactory.  Therefore, automated palletizing systems are highly anticipated.  However, traditional automated palletizing systems often only handle regular and single sized goods.  This limitation severely restricts the application of automation in a wider range of scenarios, especially in the case of completely random incoming materials, where traditional manual teaching methods are difficult and inefficient.

To address this issue, Fuwei Intelligent has launched a machine vision guided robotic arm palletizing solution.  This solution utilizes advanced machine vision technology to enable the robotic arm to accurately identify, grasp, and place goods of various shapes and sizes, enabling efficient and accurate palletizing operations regardless of whether the incoming materials are in order.

Scheme Introduction:

In the machine vision guided robotic arm palletizing solution developed by Fuwei Intelligence, 3D cameras play a crucial role.  It is responsible for capturing depth information and high-definition 2D images of boxes on pallets or conveyor belts within the scope of the task.  Subsequently, these depth information and 2D image data were quickly transmitted to the robot control platform software.  This platform software integrates advanced 3D vision algorithms and intelligent trajectory planning algorithms.  Among them, the 3D vision algorithm combines AI deep learning and 3D point cloud segmentation technology to accurately locate the exact position of the box on the pallet or conveyor belt in a very short time.  The efficiency and accuracy of this algorithm ensure the smooth progress of subsequent palletizing operations.  At the same time, the intelligent trajectory planning algorithm is responsible for calculating the optimal grasping point, placement point, and trajectory point.  It plans the fastest and safest gripping and stacking path for the robotic arm based on the shape, size, and position information of the box.  This not only improves the efficiency of palletizing operations, but also ensures the stability and safety of the operation process.

Advantages of the plan:

1. Flexible adaptation: The system can adapt to different types of goods according to different sizes, shapes, and stacking requirements, with strong flexibility and adaptability.

2. Improve efficiency: The robot cardboard box unpacking and palletizing system can achieve continuous and efficient work, greatly improving the speed and efficiency of cardboard box unpacking and palletizing.

3 Reduce labor intensity: Robots can replace manual operations, reduce workers' physical labor, lower labor intensity, and ensure workers' physical health.

4. Improve accuracy: 3D vision machine technology can accurately identify the position and size of cardboard boxes, reducing stacking errors and non-standard stacking, and improving operational accuracy.

5. Improve safety: Robot operation avoids the potential safety risks of manual operation and ensures the safety of the working environment.

The Fuwei intelligent robot 3D vision guided palletizing system aims to solve the problem of inability to grasp unknown shaped objects or low success rate in unstructured environments.  Based on high-precision 3D cameras to capture 2D color image information of the object and environment, combined with 3D point cloud data, accurately extract the edge contour of the object, rely on intelligent algorithms to screen the optimal capture point, and output the optimal trajectory point based on the environmental constraints set in the software, improving the accuracy and reliability of the overall system.  By using this system, users can easily cope with multi SKU and completely random material unpacking and palletizing scenarios, while meeting the needs of automated unpacking and palletizing, further improving production efficiency and reducing production costs.