IP Library Granted Patent US 11,532,157
Granted Patent B2
US 11,532,157 · App. 17/098,168 · Granted Dec 20, 2022

System, method and apparatus for object identification

Inventor: Nan Wu (Beijing, CN)
Assignee: BEIJING TUSEN ZHITU TECHNOLOGY CO., LTD.
G06V20/20G05D1/0212G06K9/6215G06V20/58G05D1/0231G05D2201/0213
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,532,157
App. No.
17/098,168
Granted
Dec 20, 2022
Kind
B2
Abstract

The present disclosure provides a system, a method and an apparatus for object identification, capable of solving the problem in the related art that a system for centralized control and management of unmanned vehicles may not be able to identify an object effectively. The system for object identification includes a sensing device, a control device and one or more unmanned vehicles. The control device is configured to determine an object not belonging to a predetermined category as an unknown object by performing object identification based on sensed data; mark the unknown object in the sensed data including the unknown object; determine an unmanned vehicle within a predetermined range from the unknown object; transmit the sensed data with the marked unknown object and an instruction to identify the unknown object to the determined unmanned vehicle; receive a feedback message from the unmanned vehicle, and when the feedback message carries information on an object category, save the information on the object category and mark a category of the unknown object as the saved object category.

Claims (61)

1. A system for object identification, comprising a sensing device, a control device and one or more unmanned vehicles, wherein

the sensing device is configured to sense a vehicle running condition and a road condition to obtain sensed data;

the control device is configured to:

determine an object not belonging to a predetermined category as an unknown object by performing object identification based on the sensed data;

mark the unknown object in the sensed data that include the unknown object;

determine an unmanned vehicle within a predetermined range from the unknown object;

transmit the sensed data with the marked unknown object and an instruction to identify the unknown object to the determined unmanned vehicle; and

receive a feedback message from the unmanned vehicle; and

the unmanned vehicle is configured to:

receive the instruction and the sensed data from the control device;

identify an object based on sensed data obtained at the unmanned vehicle;

compare the object in the sensed data from the control device with the identified object to determine whether the unknown object marked in the sensed data has been identified, and if so, transmit to the control device the feedback message carrying the information on the object category of the identified unknown object.

2. The system of claim 1 , wherein the unmanned vehicle is further configured to:

mark an object corresponding to the unknown object in the sensed data obtained at the unmanned vehicle, and

when determining that the unknown object has not been identified, transmit to the control device a feedback message carrying identification failure information and the sensed data obtained at the unmanned vehicle with the marked object.

3. The system of claim 1 , wherein the control device is further configured to:

transmit the sensed data obtained at the unmanned vehicle with an object marked by the unmanned object that corresponds to the object to a human identification process when the feedback message from the unmanned vehicle carries the identification failure information;

receive a feedback message from the human identification process; and

when the feedback message carries information on an object category, save the information on the object category and mark the category of the unknown object as the saved object category.

4. The system of claim 3 , wherein the control device is further configured to:

when the feedback message from the human identification process carries identification failure information, transmit to a human control process the received sensed data obtained at the unmanned vehicle and a human processing request for requesting the human control process to perform an object identification based vehicle control process.

5. The system of claim 1 , wherein the control device is further configured to, subsequent to marking the unknown object in the sensed data including the unknown object: transmit the sensed data with the marked unknown object to a human identification process.

6. The system of claim 5 , wherein said determining the unmanned vehicle within the predetermined range from the unknown object comprises:

receiving a feedback message from the human identification process, and

when the feedback message carries information on an object category, saving the information on the object category and marking the category of the unknown object as the object category; and

when the feedback message carries identification failure information, determining the unmanned vehicle within the predetermined range from the unknown object.

7. The system of claim 1 , wherein the control device is further configured to perform a vehicle control process based on the identified object, the vehicle control process comprising route planning or driving policy decision.

8. A method for object identification, comprising:

determining, by a control device, an object not belonging to a predetermined category as an unknown object by performing object identification based on sensed data from a sensing device, the sensed data being obtained by the sensing device sensing a vehicle running condition and a road condition;

marking, by the control device, the unknown object in the sensed data including the unknown object;

determining, by the control device, an unmanned vehicle within a predetermined range from the unknown object;

transmitting, by the control device, the sensed data with the marked unknown object and an instruction to identify the unknown object to the determined unmanned vehicle; and

receiving, by the control device, a feedback message from the unmanned vehicle, and when the feedback message carries information on an object category, saving the information on the object category and marking a category of the unknown object as the saved object category.

9. The method of claim 8 , wherein the information on the object category carried in the feedback information is the information on the object category of the unknown object identified by the unmanned vehicle and is included in the feedback information by the unmanned vehicle in response to identifying an object based on sensed data obtained at the unmanned vehicle, comparing the object in the sensed data from the control device with the identified object and determining that the unknown object has been identified.

10. The method of claim 8 , further comprising:

receiving, by the control device, the sensed data obtained at the unmanned vehicle from the unmanned vehicle, the sensed data obtained at the unmanned vehicle including a marked object corresponding to the unknown object determined by the control device;

transmitting, by the control device, the sensed data obtained at the unmanned vehicle with the marked object to a human identification process when the feedback message from the unmanned vehicle carries identification failure information; and

receiving, by the control device, a feedback message from the human identification process, and when the feedback message carries information on an object category, saving the information on the object category and marking the category of the unknown object as the saved object category.

11. The method of claim 10 , further comprising:

transmitting, when the feedback message from the human identification process carries identification failure information, to a human control process the received sensed data obtained at the unmanned vehicle and a human processing request for requesting the human control process to perform an object identification based vehicle control process.

12. The method of claim 8 , wherein the control device is further configured to, subsequent to marking the unknown object in the sensed data including the unknown object: transmit the sensed data with the marked unknown object to a human identification process, and

wherein said determining the unmanned vehicle within the predetermined range from the unknown object comprises:

receiving a feedback message from the human identification process, and when the feedback message carries information on an object category, saving the information on the object category and marking the category of the unknown object as the object category; or when the feedback message carries identification failure information, determining the unmanned vehicle within the predetermined range from the unknown object.

13. The method of claim 8 , further comprising:

performing, by the control device, a vehicle control process based on the identified object, the vehicle control process comprising route planning or driving policy decision.

14. An apparatus for object identification, comprising:

a first determining module configured to determine an object not belonging to a predetermined category as an unknown object by performing object identification based on sensed data from a sensing device, the sensed data being obtained by the sensing device sensing a vehicle running condition and a road condition;

a marking module configured to mark the unknown object in the sensed data including the unknown object;

a second determining module configured to determine an unmanned vehicle within a predetermined range from the unknown object;

a transceiving module configured to transmit the sensed data with the marked unknown object and an instruction to identify the unknown object to the determine unmanned vehicle and receive a feedback message from the unmanned vehicle, the feedback information carrying information on an object category which is information on an object category of the unknown object identified by the unmanned vehicle and is included in the feedback information by the unmanned vehicle in response to identifying an object based on sensed data obtained at the unmanned vehicle, comparing the object in the sensed data from the control device with the identified object and determining that the unknown object has been identified; and

a saving module configured to save, when the feedback message carries the information on the object category, the information on the object category and mark a category of the unknown object as the saved object category.

15. The apparatus of claim 14 , further comprising a human interface module, the human interface module configured to transmit the sensed data obtained at the unmanned vehicle with the marked object to a human identification process when the feedback message from the unmanned vehicle carries identification failure information and receive a feedback message from the human identification process; and

the saving module is further configured to save, when the feedback message from the human identification process carries information on an object category, the information on the object category and mark the category of the unknown object as the saved object category.

16. The apparatus of claim 15 , wherein the human interface module is further configured to:

transmit, when the feedback message from the human identification process carries identification failure information, to a human control process the received sensed data obtained at the unmanned vehicle and a human processing request for requesting the human control process to perform an object identification based vehicle control process.

17. The apparatus of claim 14 , further comprising a human interface module configured to transmit the sensed data with the unknown object marked by the marking module to a human identification process and receive a feedback message from the human identification process, wherein:

the saving module is configured to save, when the feedback message carries information on an object category, the information on the object category and mark the category of the unknown object as the object category, and

the second determining module is configured to determine the unmanned vehicle within the predetermined range from the unknown object when the feedback message carries identification failure information.

18. The apparatus of claim 14 , further comprising a control module configured to perform a vehicle control process based on the identified object, the vehicle control process comprising route planning.

19. The apparatus of claim 14 , further comprising a control module configured to perform a vehicle control process based on the identified object, the vehicle control process comprising driving policy decision.

20. The apparatus of claim 14 , wherein the transceiving module is further configured to receive the sensed data obtained at the unmanned vehicle from the unmanned vehicle, the sensed data obtained at the unmanned vehicle including a marked object corresponding to the unknown object determined by the control device.

Assignments (5)
CHANGE OF NAME Recorded Dec 9, 2025
From: TUSIMPLE, INC.
To: CREATEAI, INC.
Reel/Frame 073158/0715 →
CHANGE OF NAME Recorded Dec 9, 2025
From: BEIJING TUSEN ZHITU TECHNOLOGY CO., LTD.
To: BEIJING OCGEN TECHNOLOGY CO., LTD.
Reel/Frame 073916/0416 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 26, 2022
From: TUSIMPLE, INC.
To: BEIJING TUSEN ZHITU TECHNOLOGY CO., LTD.
Reel/Frame 058779/0374 →
CHANGE OF NAME Recorded Nov 13, 2020
From: TUSIMPLE
To: TUSIMPLE, INC.
Reel/Frame 054414/0980 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 13, 2020
From: WU, NAN
To: TUSIMPLE
Reel/Frame 054941/0605 →
Priority Claims (1)
CN 201810142084.0 · Feb 11, 2018 · national
Continuity (2)
Continuation 16272918 · Feb 11, 2019
Related Publication 20210064878A1 · Mar 4, 2021