IP Library › Granted Patent US 11,423,877
Granted Patent B2
US 11,423,877 · App. 16/621,960 · Granted Aug 23, 2022

Robot for providing guidance service using artificial intelligence and method of operating the same

Inventors: Wonho Shin (Seoul, KR); Jichan Maeng (Seoul, KR)
Assignee: LG Electronics Inc.
G10L15/005G05D1/0088G06N3/04G06N3/08G06V20/10G06V40/172G10L15/26
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,423,877
App. No.
16/621,960
Granted
Aug 23, 2022
Kind
B2
Abstract

A robot for providing a guidance service in a first language using artificial intelligence includes a microphone configured to receive voice data, a camera configured to acquire image data, an output unit, and a processor configured to determine a second language used to provide the guidance service based on one or more of the voice data or the image data, change the language used to provide the guidance service from the first language to the second language when the determined second language is different from the first language and output the guidance service through the output unit in the changed second language.

Claims (39)

1. A robot for providing a guidance service in a first language using artificial intelligence, the robot comprising:

a microphone configured to receive voice data;

a camera configured to acquire image data;

an output unit; and

a processor configured to:

determine, based on one or more of the voice data or the image data, a second language used to provide the guidance service,

change the language used to provide the guidance service from the first language to the second language, based on a determination that the second language is different from the first language, and

output the guidance service through the output unit in the changed second language,

wherein the processor is further configured to:

give a first priority to a first language candidate recognized based on the voice data;

give a second priority to a second language candidate recognized based on a passport recognized from the image data;

give a third priority to a third language candidate recognized through a face of a user recognized from the image data; and

determine one among the first language candidate, the second language candidate, and the third language candidate as the second language according to a priority.

2. The robot according to claim 1 , further comprising a memory configured to store a language recognition model,

wherein the processor is further configured to convert the voice data into text data and determine the second language corresponding to the voice data using the converted text data and the language recognition model, and

wherein the language recognition model is an artificial neural network based model supervised-learned by a deep learning algorithm or a machine learning algorithm.

3. The robot according to claim 1 , wherein determining the second language comprises:

recognizing a language based on a shape of the recognized passport or text described on the passport, and determining the recognized language as the second language.

4. The robot according to claim 3 , further comprising a memory configured to store an object recognition model for recognizing an object using a deep learning algorithm or a machine learning algorithm,

wherein the processor is further configured to recognize the passport from the image data using the object recognition model.

5. A method of operating a robot for providing a guidance service in a first language using artificial intelligence, the method comprising:

acquiring one or more of voice data or image data;

determining, based on one or more of the voice data or the image data, a second language used to provide the guidance service;

changing the language used to provide the guidance service from the first language to the second language, based on a determination that the second language is different from the first language; and

outputting the guidance service in the changed second language,

wherein determining the second language comprises:

giving a first priority to a first language candidate recognized based on the voice data;

giving a second priority to a second language candidate recognized based on a passport recognized from the image data;

giving a third priority to a third language candidate recognized through a face of a user recognized from the image data; and

determining one among the first language candidate, the second language candidate, and the third language candidate as the second language according to a priority.

6. The method according to claim 5 , further comprising converting the voice data into text data,

wherein determining the second language comprises determining the second language corresponding to the voice data using the converted text data and a language recognition model that is stored in a memory, and

wherein the language recognition model is an artificial neural network based model supervised-learned by a deep learning algorithm or a machine learning algorithm.

7. The method according to claim 5 , wherein determining the second language comprises:

recognizing a language based on a shape of the recognized passport or text described on the passport, and

determining the recognized language as the second language.

8. The method according to claim 7 ,

wherein the recognizing of the passport comprises recognizing the passport from the image data using an object recognition model,

wherein the object recognition model is an artificial neural network based algorithm for recognizing an object using a deep learning algorithm or a machine learning algorithm.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 12, 2020
From: SHIN, WONHO; MAENG, JICHAN
To: LG ELECTRONICS INC.
Reel/Frame 052640/0549 →
Continuity (1)
Related Publication 20210295821A1 · Sep 23, 2021