IP Library Granted Patent US 12,325,981
Granted Patent B2
US 12,325,981 · App. 17/575,299 · Granted Jun 10, 2025

System and method of controlling construction machinery

Inventor: Cavin Lee (Yongin-si, KR)
Assignee: HD HYUNDAI INFRACORE CO., LTD.
E02F9/264E02F9/261
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,325,981
App. No.
17/575,299
Granted
Jun 10, 2025
Kind
B2
Abstract

A control system for construction machinery includes a camera installed in a work apparatus to photograph a working area in which the work apparatus works, an image processing device configured to recognize a shape of an attachment of the work apparatus in an image captured by the camera and perform a tracking image process on the image such that the attachment is displayed in a central region of the image, and a display device configured to display the tracking image-processed image.

Claims (32)

1. A control system for construction machinery, the control system comprising:

a camera installed in a work apparatus to photograph a working area in which the work apparatus works;

an image processing device configured to recognize a shape of an attachment of the work apparatus in an image captured by the camera and perform a tracking image process on the image such that the attachment is displayed in a central region of the image; and

a display device configured to display the tracking image-processed image,

wherein during the tracking image process, the image processing device is further configured to calculate a relative distance from a pixel position of the attachment of the work apparatus in the image to the central region, and to move a display position of the attachment of the work apparatus to the central region based on the relative distance,

wherein the image processing device is further configured to adjust a size of the attachment in the image according to a preset tracking image processing condition to match a resolution of the display device, to thereby resolve a visual distortion caused by a size difference due to a movement trajectory of the attachment, and

wherein the image processing device includes:

a shape recognizer configured to compare the actual image of the attachment in the image with a learning image of the attachment that is recognized and stored in advance by machine learning, and

a storage portion configured to store the learning image of the attachment by executing a deep learning algorithm using the actual image received from the shape recognizer as input data.

2. The control system of claim 1 , wherein the image processing device further includes:

a tracking image processor configured to track a movement trajectory of the attachment to process the image so that the attachment is located in the central region, and

wherein the shape recognizer is configured to recognize the shape of the attachment in the image.

3. The control system of claim 1 , further comprising:

an input portion configured to set a tracking image processing condition in the image processing device.

4. The control system of claim 3 , wherein the tracking image processing condition includes an area occupied by the central region of the entire display area of the display device and resolution thereof.

5. The control system of claim 1 , wherein the attachment includes a bucket.

6. The control system of claim 1 , wherein the camera is installed on a boom to face the working area under the work apparatus.

7. The control system of claim 1 , wherein the entire display area of the display device includes a tracking display region in which the attachment is displayed to be tracked and an external region of the tracking display region.

8. A method of controlling construction machinery, the method comprising:

obtaining an image of a working area in which a work apparatus works, from a camera installed in the work apparatus;

recognizing a shape of the attachment of the work apparatus in the image to detect a position of the attachment;

performing a tracking image process on the image such that the attachment is displayed in a central region of the image; and

displaying the tracking image-processed image through a display device,

wherein the tracking image process is performed by calculating a relative distance from a pixel position of the attachment of the work apparatus in the image to the central region, and moving a display position of the attachment of the work apparatus to the central region based on the relative distance,

wherein the tracking image process is performed by adjusting a size of the attachment in the image according to a preset tracking image processing condition to match a resolution of the display device, to thereby resolve a visual distortion caused by a size difference due to a movement trajectory of the attachment,

wherein detecting the position of the attachment in the image comprises comparing the actual image of the attachment in the image with a learning image of the attachment recognized and stored in advance by machine learning to determine the position of the attachment, and

wherein the method further comprises:

obtaining the learning image of the attachment by executing a deep learning algorithm using the actual image in the image as input data.

9. The method of claim 8 , further comprising:

setting a tracking image processing condition for tracking the position of the attachment.

10. The method of claim 9 , wherein the tracking image processing condition includes an area occupied by the central region of the entire display area of the display device and resolution thereof.

11. The method of claim 8 , wherein the attachment includes a bucket.

Assignments (3)
MERGER Recorded Jul 15, 2026
From: HD HYUNDAI INFRACORE CO., LTD.
To: HD CONSTRUCTION EQUIPMENT CO., LTD.
Reel/Frame 075281/0543 →
CHANGE OF NAME Recorded Dec 6, 2023
From: HYUNDAI DOOSAN INFRACORE CO., LTD.
To: HD HYUNDAI INFRACORE CO., LTD.
Reel/Frame 065794/0472 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2022
From: LEE, CAVIN
To: HYUNDAI DOOSAN INFRACORE CO., LTD.
Reel/Frame 058652/0173 →