IP Library › Granted Patent US 12,039,715
Granted Patent B2
US 12,039,715 · App. 17/545,552 · Granted Jul 16, 2024

System and method for verifying quality using arm robot

Inventor: Byoung Il Choi (Hwaseong-si, KR)
Assignees: Hyundai Motor Company; Kia Corporation
G06T7/001B25J9/1679B25J15/0019B25J19/00G06T7/70H04N23/695G06T2207/30164G06T2207/30244
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,039,715
App. No.
17/545,552
Granted
Jul 16, 2024
Kind
B2
Abstract

A system for verifying quality of a part using an arm robot includes an arm robot, which includes a camera to acquire image data of a part assembled in each manufacturing process of a vehicle, a carrier, which includes a sliding rail allowing the arm robot to be movable around the vehicle along the sliding rail to acquire the image data, and a server which receives the image data acquired by the camera, compares the image data with modeling data of the vehicle, which is stored in a database, and determines whether the assembled part satisfies a preset inspection item, to verify quality of the assembled part, verifying the quality of the part in each process before the vehicle is completely manufactured.

Claims (46)

1. A system for verifying quality of a part using an arm robot, the system comprising:

the arm robot, which includes a camera to acquire image data of the part assembled in each manufacturing process of a vehicle;

a carrier including a sliding rail allowing the arm robot to be movable around the vehicle along the sliding rail to acquire the image data; and

a server configured to receive the image data acquired by the camera, to compare the image data with modeling data of the vehicle, which is stored in a database (DB), and to determine whether the assembled part satisfies a preset inspection item, to verify the quality of the assembled part,

wherein the carrier further includes a hidden area formed at a front lower portion and a rear lower portion of the carrier and provided as a storage space storing the arm robot for a predetermined time period.

2. The system of claim 1 , wherein the arm robot includes:

a multi-axis arm robot to control rotation of each joint thereof,

wherein the camera is mounted on an end portion of the arm robot.

3. The system of claim 1 , wherein the carrier further includes:

an arm robot controller configured to control driving of the arm robot moving on the sliding rail and rotation of a joint of the arm robot.

4. The system of claim 3 , wherein the carrier further includes:

a current position monitoring device configured to monitor a current position of the carrier in real time, based on data detected by at least one sliding rail sensor mounted on the sliding rail.

5. The system of claim 1 , wherein the carrier further includes:

an extending rail extending from the sliding rail surrounding the vehicle, to the hidden area.

6. The system of claim 5 , wherein the carrier further includes:

a hidden area controller to control an upper cover covering an upper portion of the hidden area to be open so that the arm robot is introduced into the hidden area, when the arm robot arrives at an end portion of the extending rail, and to control the upper cover to be closed when the arm robot is withdrawn out of the hidden area.

7. The system of claim 5 , wherein the carrier further includes:

a sliding rail sensor to detect whether the arm robot arrives at an end portion of the extending rail to be introduced into the hidden area; and

a hidden area sensor to detect whether the arm robot is completely introduced into the hidden area or completely withdrawn out of the hidden area.

8. The system of claim 1 , wherein the server include:

an image data comparator configured to compare the image data acquired from the camera with three-dimensional (3D) modeling data of the vehicle, which is stored in the database, to specify the part to be verified in quality; and

a quality verifying device configured to determine whether the image data of the specified part satisfies a preset inspection item.

9. The system of claim 8 , wherein the server further includes:

an arm robot position determining device configured to determine a position of the arm robot moving around the carrier in each process, to acquire image data of a part additionally assembled in each process, and to determine a position of the camera, which is adjusted, as a joint of the arm robot is controlled at the determined position.

10. The system of claim 8 , wherein the server is configured to determine a relevant process as being finished and to perform a photographing operation by the camera, when determining that the carrier associated with the vehicle to be assembled passes a predetermined virtual point.

11. The system of claim 8 , wherein the image data comparator is configured to receive the image data acquired by photographing the assembled part, information on position coordinates of the camera at a moment that the image data is acquired, and information on a vector direction of a focus of the camera, when receiving the image data from the camera.

12. The system of claim 8 , wherein the quality verifying device is configured to set at least one inspection item in advance to verify quality of each part, to store the at least one inspection item in an individual part inspection item database (DB) of the DB provided in the server, to compare image data showing a current assembling status of the vehicle with the 3D modeling data of the vehicle, and to determine whether the at least one inspection item is satisfied.

13. A method for verifying quality of a part using an arm robot, the method comprising:

photographing a part assembled in each process by use of a camera to acquire image data, after moving the arm robot coupled to the camera onto a sliding rail of a carrier,

comparing, by a server having the image data received through a communication network, the image data with 3D modeling data of a vehicle, which is stored in a DB, to specify the part to be verified in quality; and

verifying the quality of the assembled part by determining whether a preset inspection item is satisfied while comparing image data of the specified part with the 3D modeling data of the vehicles,

wherein the carrier includes a sliding rail allowing the arm robot to be movable around the vehicle along the sliding rail to acquire the image data; and

wherein the carrier further includes a hidden area formed at a front lower portion and a rear lower portion of the carrier and provided as a storage space storing the arm robot for a predetermined time period.

14. The method of claim 13 , wherein the acquiring of the image data includes:

performing a control operation of separating the arm robot from the sliding rail and storing the arm robot in the hidden area of the carrier for the predetermined time period; and

controlling, by a hidden area controller, an upper cover covering an upper portion of the hidden area, to be open so that the arm robot is introduced into the hidden area, when determining that the arm robot moves to an end portion of an extending rail extending from the sliding rail to the hidden area.

15. The method of claim 14 , wherein the hidden area controller is configured to control the upper cover to be closed, when the arm robot is completely introduced into the hidden area or withdrawn out of the hidden area.

16. The method of claim 13 , wherein the acquiring of the image data includes:

determining a relevant process as being finished so that the photographing by the camera is performed, when determining that the carrier associated with the vehicle to be assembled passes a preset virtual point.

17. The method of claim 13 , wherein the specifying of the part includes:

detecting a part additionally assembled in an n-th process provided as a current process, when compared to a (n−1)-th process provided as a previous process, wherein the n is a natural number greater than or equal to 2.

18. The method of claim 13 , wherein the specifying of the part includes:

detecting a position and a direction that the image data is acquired through the photographing, by utilizing the image data which is received over the communication network and stored in an image data and camera data DB of the DB provided in the server, information on position coordinates of the camera, and information on a vector direction of a focus of the camera at a photographing time point for acquiring the image data.

19. The method of claim 13 , wherein the verifying of the quality of the assembled part includes:

comparing the image data with the 3D modeling data of the vehicle while determining whether an inspection item which is not satisfied is present; and

notifying the presence of the inspection item, which is not satisfied, to a worker around a field through a display device or an auditory device, when the inspection item, which is not satisfied, is present.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 8, 2021
From: CHOI, BYOUNG IL
To: HYUNDAI MOTOR COMPANY; KIA CORPORATION
Reel/Frame 058337/0889 →
Priority Claims (1)
KR 10-2021-0074849 · Jun 9, 2021 · national
Continuity (1)
Related Publication 20220398707A1 · Dec 15, 2022