IP Library Granted Patent US 12,050,464
Granted Patent B2
US 12,050,464 · App. 17/010,606 · Granted Jul 30, 2024

Robot paired with user to perform specific task

Inventor: Dongeun Lee (Seoul, KR)
Assignee: LG ELECTRONICS INC.
G05D1/0088G06K19/06028G06K19/06037G06K19/0723G06N3/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,050,464
App. No.
17/010,606
Granted
Jul 30, 2024
Kind
B2
Abstract

A robot including an input interface configured to receive a service identifier in response to a service request; a camera configured to capture a video of a user who has presented the service identifier; a transceiver configured to receive service information associated with the service identifier; and a processor configured to identify the user who has presented the service identifier from the video using an artificial neural network based learning model; and in response to successfully identifying the user, perform a task corresponding to the service request for the user based on the service information.

Claims (73)

1. A robot comprising:

an input interface configured to receive a service identifier in response to a service request of a user;

a camera;

a transceiver configured to receive service information associated with the service identifier; and

a processor configured to:

determine whether the service identifier is valid, when the service information is received,

identify the user who has presented the service identifier from a video using an artificial neural network based learning model, when the service identifier is valid,

in response to successfully identifying the user, control the camera to capture a user video of the user who has presented the service identifier,

register, in a memory associated with the robot, the user in the user video as being paired with the robot, and

perform a task corresponding to the service request for the user based on the service information when the user is paired with the robot,

wherein the task comprises a route guide task and the service information comprises destination information,

wherein the processor is further configured to control the robot to guide the user to a place indicated by the destination information,

wherein the task comprises a route guide task and the service information comprises a guide request time and departure information,

wherein the processor is further configured to control the robot to move to a place indicated by the departure information on the guide request time,

wherein the task further comprises an autonomous driving task, and the service information comprises destination information of at least one article stored in a container of the robot, and

wherein the processor is further configured to control the robot to deliver the at least one article by autonomous driving to a place indicated by the destination information in response to the user not successfully being identified during a predetermined amount of time.

2. The robot of claim 1 , wherein the processor is further configured to:

output a message informing that the service identifier is invalid, when the service identifier is invalid.

3. The robot of claim 1 , wherein the processor is further configured to control the robot to perform the task by using route information created based on map data stored in a memory associated with the robot.

4. The robot of claim 1 , wherein the processor is further configured to control the robot to enter a security mode in response to the user not being successfully identified from the video.

5. The robot of claim 1 , wherein the processor is further configured to control the robot to perform at least one additional task necessary to complete the task according to whether or not the user is successfully identified.

6. The robot of claim 1 , wherein the task comprises a storage task and the service information comprises destination information of at least one article stored in a container of the robot, and

wherein the processor is further configured to control the robot to enter a security mode in response to the user not successfully being identified from the video before the robot reaches a place indicated by the destination information.

7. The robot of claim 1 , wherein the task comprises a follow up task and the service information comprises route information from a departure to a destination, and

wherein the processor is further configured to control the robot to follow the user based on the route information.

8. The robot of claim 7 , wherein the processor is further configured to control the robot to follow a candidate moving in a movement direction according to the route information among at least one candidate identified from the video, in response to the user not successfully being identified from the video.

9. The robot of claim 1 , wherein the task comprises a notification task, and

wherein the processor is further configured to control the robot to transmit a notification message indicating status information of the robot to the user in response to the user not successfully being identified from the video.

10. The robot of claim 1 , wherein the task comprises a reservation task and the service information comprises a reservation time and reservation place information, and

wherein the processor is further configured to control the robot to transmit a reservation request including the reservation time and reservation place information to a server.

11. The robot of claim 1 , wherein the task comprises a call task and the service information comprises server information, and

wherein the processor is further configured to control the robot to transmit a call message including current location information to the server based on the server information, the server having the server information as an address.

12. The robot of claim 1 , wherein the task comprises a plurality of tasks, and

wherein the processor is further configured to control the robot to perform the plurality of tasks simultaneously.

13. A method of controlling a robot, the method comprising:

receiving, via an input interface of the robot, a service identifier in response to a service request of a user;

receiving, via a transceiver of the robot, service information associated with the service identifier;

capturing, via a camera of the robot, a video including the user who has presented the service identifier;

determining, via a processor of the robot, whether the service identifier is valid;

identifying, the processor, the user who has presented the service identifier from the video using an artificial neural network based learning model, when the service identifier is valid;

in response to successfully identifying the user, controlling the camera to capture a user video of the user who has presented the service identifier;

registering, in a memory associated with the robot, the user in the user video as being paired with the robot;

performing, via the processor, a task corresponding to the service request for the user based on the service information when the user is paired with the robot,

wherein the task comprises a route guide task and the service information comprises destination information,

wherein the method further comprises, controlling, via the processor, the robot to guide the user to a place indicated by the destination information,

wherein the task comprises a route guide task and the service information comprises a guide request time and departure information,

wherein the method further comprises, controlling, via the processor, the robot to move to a place indicated by the departure information on the guide request time,

wherein the task further comprises an autonomous driving task, and the service information comprises destination information of at least one article stored in a container of the robot, and

wherein the method further comprises, controlling, via the processor, the robot to deliver the at least one article by autonomous driving to a place indicated by the destination information in response to the user not successfully being identified during a predetermined amount of time.

14. The method of claim 13 , further comprising:

outputting a message informing that the service identifier is invalid, when the service identifier is invalid.

15. The method of claim 13 , further comprising:

controlling, via the processor, the robot to enter a security mode in response to the user not being successfully identified from the video.

16. The method of claim 13 , wherein the service information comprises route information from a departure to a destination, and

wherein the identifying of the user comprises estimating, as the user, a candidate moving in a movement direction according to the route information among at least one candidate identified from the video, in response to the user not being identified from the video.

17. A robot control system, comprising:

a server configured to assign a robot to process a service request; and

a robot configured to perform a task corresponding to the service request,

wherein the robot comprises:

an input interface configured to receive a service identifier in response to a service request of a user;

a camera;

a transceiver configured to receive service information associated with the service identifier; and

a processor configured to:

determine whether the service identifier is valid, when the service information is received, identify the user who has presented the service identifier from a video using an artificial neural network based learning model, when the service identifier is valid,

in response to successfully identifying the user, control the camera to capture a user video of the user who has presented the service identifier,

register, in a memory associated with the robot, the user in the user video as being paired with the robot, and

perform a task corresponding to the service request for the user based on the service information when the user is paired with the robot,

wherein the task comprises a route guide task and the service information comprises destination information,

wherein the processor is further configured to control the robot to guide the user to a place indicated by the destination information,

wherein the task comprises a route guide task and the service information comprises a guide request time and departure information,

wherein the processor is further configured to control the robot to move to a place indicated by the departure information on the guide request time,

wherein the task further comprises an autonomous driving task, and the service information comprises destination information of at least one article stored in a container of the robot, and

wherein the processor is further configured to control the robot to deliver the at least one article by autonomous driving to a place indicated by the destination information in response to the user not successfully being identified during a predetermined amount of time.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 3, 2020
From: LEE, DONGEUN
To: LG ELECTRONICS INC.
Reel/Frame 053686/0136 →
Priority Claims (1)
WO PCT/KR2019/011491 · Sep 5, 2019 · international
Continuity (1)
Related Publication 20210072750A1 · Mar 11, 2021
Cited By (1)
US 12,694,876