IP Library › Granted Patent US 12,291,192
Granted Patent B2
US 12,291,192 · App. 18/092,585 · Granted May 6, 2025

Control apparatus, control method, and non-transitory computer readable media encoded with computer program

Inventor: Hiroya Chiba (Fuji Shizuoka-ken, JP)
Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA
B60W30/06G05D1/0234G05D1/0246G05D1/0274G06V10/141G06V10/60G06V20/586B60W2556/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,291,192
App. No.
18/092,585
Granted
May 6, 2025
Kind
B2
Abstract

A control apparatus for an object moving in a specific zone while recognizing one or more markers deployed in the specific zone by a camera. The control apparatus is configured to execute detecting whether or not that the specific zone or surroundings of the object is darker than a specified brightness, and when detecting that the specific zone or the surroundings of the object is darker than the specified brightness, operating a lighting device installed in the object to illuminate the one or more markers located around the object.

Claims (43)

1. A control apparatus for an object moving in a specific zone while recognizing one or more markers deployed in the specific zone by a camera, the control apparatus comprising:

one or more processors; and

a memory storing executable instructions that, when executed by the one or more processors, cause the one or more processors to execute:

acquiring a brightness information, a marker map information, and an object position information, the brightness information showing brightness in the specific zone, the marker map information showing positions of the one or more markers in the specific zone, the object position information showing a position of the object in the specific zone;

detecting whether or not that the specific zone or surroundings of the object is darker than a specified brightness based on the brightness information; and

when detecting that the specific zone or the surroundings of the object is darker than the specified brightness, operating a headlight installed in the object to illuminate the one or more markers located around the object based on the maker map information and the object position information, wherein

the brightness information includes a luminance value of the one or more markers on an image captured by the camera,

the detecting whether or not that the specific zone or the surroundings of the object is darker than the specified brightness includes detecting that the specific zone or the surroundings of the object is darker than the specified brightness when the luminance value is less than a predetermined threshold,

the operating of the headlight includes:

calculating relative positions of the one or more markers to the object based on the marker map information and the object position information; and

controlling, in response to the calculated positions of the one or more markers to the object, at least one of an irradiation range of the headlight and an irradiation direction of the headlight viewed from the object depending on the relative positions; and

the one or more processors are configured to perform localization of the object, and correct the localization of the object by sequentially recognizing the one or more markers based on the relative positions between the one or more markers and the object.

2. The control apparatus according to claim 1 , wherein

the operating the headlight includes controlling a luminous intensity of the headlight in response to acquiring the brightness information.

3. The control apparatus according to claim 1 , wherein

the one or more markers comprises a barcode, and

the brightness information is used to determine includes a time zone, an operation state of lights in a parking lot on a ground when the time zone is a sunset time zone, and detection information of a sensor installed in the vehicle.

4. A method for controlling an object moving in a specific zone while recognizing one or more markers deployed in the specific zone by a camera, the method including:

acquiring a brightness information, a marker map information, and an object position information, the brightness information showing brightness in the specific zone, the marker map information showing positions of the one or more markers in the specific zone, the object position information showing a position of the object in the specific zone;

detecting whether or not that the specific zone or surroundings of the object is darker than a specified brightness based on the brightness information; and

when detecting that the specific zone or the surroundings of the object is darker than the specified brightness, operating a headlight installed in the object to illuminate the one or more markers located around the object based on the maker map information and the object position information, wherein

the brightness information includes a luminance value of the one or more markers on an image captured by the camera, and

the detecting whether or not that the specific zone or the surroundings of the object is darker than the specified brightness includes detecting that the specific zone or the surroundings of the object is darker than the specified brightness when the luminance value is less than a predetermined threshold, wherein

the operating of the headlight includes:

calculating relative positions of the one or more markers to the object based on the marker map information and the object position information; and

controlling, in response to the calculated positions of the one or more markers to the object, at least one of an irradiation range of the headlight and an irradiation direction of the headlight viewed from the object depending on the relative positions; and

performing localization of the object, and correcting the localization of the object by sequentially recognizing the one or more markers based on the relative positions between the one or more markers and the object.

5. The method according to claim 4 , wherein

the one or more markers comprises a barcode, and

the brightness information is used to determine a time zone, an operation state of lights in a parking lot on a ground when the time zone is a sunset time zone, and detection information of a sensor installed in the vehicle.

6. A non-transitory computer readable medium storing a computer program, the computer program comprising instructions that, when executed by one or more processors, cause the one or more processors to perform operations for controlling an object moving in a specific zone while recognizing one or more markers deployed in the specific zone by a camera, the operations comprising:

acquiring a brightness information, a marker map information, and an object position information, the brightness information showing brightness in the specific zone, the marker map information showing positions of the one or more markers in the specific zone, the object position information showing a position of the object in the specific zone;

detecting whether or not that the specific zone or surroundings of the object is darker than a specified brightness based on the brightness information; and

when detecting that the specific zone or the surroundings of the object is darker than the specified brightness, operating a headlight installed in the object to illuminate the one or more markers located around the object based on the maker map information and the object position information, wherein

the brightness information includes a luminance value of the one or more markers on an image captured by the camera, and

the detecting whether or not that the specific zone or the surroundings of the object is darker than the specified brightness includes detecting that the specific zone or the surroundings of the object is darker than the specified brightness when the luminance value is less than a predetermined threshold, wherein

the operating of the headlight includes:

calculating relative positions of the one or more markers to the object based on the marker map information and the object position information; and

controlling, in response to the calculated positions of the one or more markers to the object, at least one of an irradiation range of the headlight and an irradiation direction of the headlight viewed from the object depending on the relative positions; and

performing localization of the object, and correcting the localization of the object by sequentially recognizing the one or more markers based on the relative positions between the one or more markers and the object.

7. The non-transitory computer readable medium according to claim 6 , wherein

the one or more markers comprises a barcode, and

the brightness information is used to determine a time zone, an operation state of lights in a parking lot on a ground when the time zone is a sunset time zone, and detection information of a sensor installed in the vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 4, 2023
From: CHIBA, HIROYA
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 062270/0607 →
Priority Claims (1)
JP 2022-020831 · Feb 14, 2022 · national
Continuity (1)
Related Publication 20230256959A1 · Aug 17, 2023
References Cited (17)
US 6079862A · Kawashima et al. · 2000 [cited by applicant]
US 20130141578A1 · Chundrlik, Jr. · 2013 [cited by examiner]
US 20140239848A1 · Bradford · 2014 [cited by applicant]
US 20160071415A1 · Maeda · 2016 [cited by examiner]
US 20180196442A1 · Wang · 2018 [cited by applicant]
US 20200074859A1 · Eshima · 2020 [cited by applicant]
US 20200207335A1 · Oh · 2020 [cited by applicant]
US 20200269748A1 · Mimura · 2020 [cited by examiner]
US 20210016705A1 · Hartisch · 2021 [cited by applicant]
US 20210183099A1 · Fujii et al. · 2021 [cited by applicant]
US 20210233404A1 · Matsuhana et al. · 2021 [cited by applicant]
US 20220277163A1 · Stenneth · 2022 [cited by examiner]
JP 2006031144A · 2006 [cited by applicant]
JP 2019098911A · 2019 [cited by applicant]
JP 202034472A · 2020 [cited by applicant]
Office Action dated Jul. 18, 2024, issued to U.S. Appl. No. 18/092,588. [cited by applicant]
Final Office Action dated Jan. 2, 2025 issued to U.S. Appl. No. 18/092,588. [cited by applicant]