IP Library Granted Patent US 11,514,601
Granted Patent B2
US 11,514,601 · App. 17/116,026 · Granted Nov 29, 2022

Working vehicle and traveling management system for the working vehicle

Inventor: Junichi Yuasa (Sakai, JP)
Assignee: KUBOTA CORPORATION
G06T7/73A01B76/00G06T2207/30204G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,514,601
App. No.
17/116,026
Granted
Nov 29, 2022
Kind
B2
Abstract

A working vehicle includes a traveling body including a coupler to which a working device is connected, a marker provided to the working device, a marker detector provided to the traveling body to detect the marker, and a status calculator to calculate a status of the working device based on a detection data detected by the marker detector.

Claims (68)

1. A working vehicle comprising:

a traveling body including a coupler to which a working device is connected;

a first marker and a second marker attached to the working device, the first marker and the second marker being identifiable as different markers from each other;

a marker detector provided to the traveling body to detect the first marker and the second marker; and

a status calculator to determine a position of the first marker in three dimensions and a position of the second marker in three dimensions based on detection data detected by the marker detector and calculate a posture and a position of the working device from the position of the first marker in three dimensions and the position of the second marker in three dimensions.

2. The working vehicle according to claim 1 , wherein the status calculator calculates a relative position between the traveling body and the working device.

3. The working vehicle according to claim 1 , wherein

the traveling body includes a position detector to obtain a vehicle position that is a position of the traveling body; and

the status calculator determines a latitude and a longitude of a position at which the working device is located based on the vehicle position obtained by the position detector and the position of the working device.

4. The working vehicle according to claim 1 , wherein

the first marker and the second marker are identifiable as visually different markers from each other;

the marker detector includes an imager to image the first marker and the second marker; and

the status calculator determines the position of the first marker in three dimensions and the position of the second marker in three dimensions based on an image captured by the imager.

5. The working vehicle according to claim 1 , wherein

the first marker and the second marker each include a frame and lines located in the frame; and

the first marker is colored with a first color in the frame, the second marker is colored with a second color in the frame, and the second color is different from the first color.

6. The working vehicle according to claim 1 , wherein

the working device is connected to a rear portion of the traveling body by the coupler;

the first marker is attached to an upper left-hand corner of a frame on a front surface of the working device; and

the second marker is attached to an upper right-hand corner of the frame.

7. The working vehicle according to claim 1 , wherein

the marker detector includes an imager to image the first marker and the second marker; and

the status calculator is configured or programmed to:

acquire a captured image from the marker detector;

obtain areas of predetermined portions in a frame of the first marker recognized from the captured image, determine a posture of the first marker from the areas of the predetermined portions, and determine the position of the first marker in three dimensions from the posture of the first marker and a focal distance from the marker detector to the first marker;

obtain areas of predetermined portions in a frame of the second marker recognized from the captured image, determine a posture of the second marker from the areas of the predetermined portions, and determine the position of the second marker in three dimensions from the posture of the second marker and a focal distance from the marker detector to the second marker; and

calculate the posture and the position of the working device in three dimensions from the position of the first marker in three dimensions and the position of the second marker in three dimensions.

8. A traveling management system for a working vehicle, the traveling management system comprising:

a first marker and a second marker attached to a working device, the first marker and the second marker being identifiable as different markers from each other;

a marker detector provided to a traveling body of the working vehicle to detect the first marker and the second marker, the traveling body including a coupler to connect the working device to the traveling body; and

a status calculator to determine a position of the first marker in three dimensions and a position of the second marker in three dimensions based on detection data detected by the marker detector and calculate a posture and a position of the working device from the position of the first marker in three dimensions and the position of the second marker in three dimensions.

9. The traveling management system according to claim 8 , wherein the status calculator calculates a relative position between the traveling body and the working device.

10. The traveling management system according to claim 8 , further comprising:

a position detector to obtain a vehicle position that is a position of the traveling body; wherein

the status calculator determines a latitude and a longitude of a position at which the working device is located based on the vehicle position obtained by the position detector and the position of the working device.

11. The traveling management system according to claim 8 , wherein

the first marker and the second marker are identifiable as visually different markers from each other;

the marker detector includes an imager to image the first marker and the second marker; and

the status calculator determines the position of the first marker in three dimensions and the position of the second marker in three dimensions based on an image captured by the imager.

12. The traveling management system according to claim 8 , wherein

the first marker and the second marker each include a frame and lines located in the frame; and

the first marker is colored with a first color in the frame, the second marker member is colored with a second color in the frame, and the second color is different from the first color.

13. The traveling management system according to claim 8 , wherein

the working device is connected to a rear portion of the traveling body by the coupler;

the first marker is attached to an upper left-hand corner of a frame on a front surface of the working device; and

the second marker is attached to an upper right-hand corner of the frame.

14. The traveling management system according to claim 8 , wherein

the marker detector includes an imager to image the first marker and the second marker; and

the status calculator is configured or programmed to:

acquire a captured image from the marker detector;

obtain areas of predetermined portions in a frame of the first marker recognized from the captured image, determine a posture of the first marker from the areas of the predetermined portions, and determine the position of the first marker in three dimensions from the posture of the first marker and a focal distance from the marker detector to the first marker;

obtain areas of predetermined portions in a frame of the second marker recognized from the captured image, determine a posture of the second marker from the areas of the predetermined portions, and determine the position of the second marker in three dimensions from the posture of the second marker and a focal distance from the marker detector to the second marker; and

calculate the posture and the position of the working device in three dimensions from the position of the first marker in three dimensions and the position of the second marker in three dimensions.

15. A method for determining a status of a working device connected to a coupler of a traveling body of a working vehicle, the method comprising:

attaching a first marker and a second marker to the working device, the first marker and the second marker being identifiable as different markers from each other;

causing a marker detector provided to the traveling body to detect the first marker and the second marker;

causing a status calculator to determine a position of the first marker in three dimensions and a position of the second marker in three dimensions based on detection data detected by the marker detector; and

causing the status calculator to calculate a posture and a position of the working device from the position of the first marker in three dimensions and the position of the second marker in three dimensions.

16. The method according to claim 15 , further comprising:

forming lines in a frame of the first marker and lines in a frame of the second marker; and

coloring the first marker with a first color in the frame and the second marker with a second color in the frame, the second color differing from the first color.

17. The method according to claim 15 , further comprising:

attaching the first marker to an upper left-hand corner of a frame on a front surface of the working device and the second marker to an upper right-hand corner of the frame.

18. The method according to claim 15 , further comprising:

causing the marker detector including an imager to image the first marker and the second marker;

causing the status calculator to obtain areas of predetermined portions in a frame of the first marker recognized from a captured image captured by the marker detector, determine a posture of the first marker from the areas of the predetermined portions, and determine the position of the first marker in three dimensions from the posture of the first marker and a focal distance from the marker detector to the first marker;

causing the status calculator to obtain areas of predetermined portions in a frame of the second marker recognized from the captured image, determine a posture of the second marker from the areas of the predetermined portions, and determine the position of the second marker in three dimensions from the posture of the second marker and a focal distance from the marker detector to the second marker; and

causing the status calculator to calculate the posture and the position of the working device in three dimensions from the position of the first marker in three dimensions and the position of the second marker in three dimensions.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 4, 2021
From: YUASA, JUNICHI
To: KUBOTA CORPORATION
Reel/Frame 054796/0655 →
Priority Claims (1)
JP JP2019-239899 · Dec 27, 2019 · national
Continuity (1)
Related Publication 20210201528A1 · Jul 1, 2021