IP Library › Granted Patent US 12,300,235
Granted Patent B2
US 12,300,235 · App. 18/227,729 · Granted May 13, 2025

Information processing system, information processing method, and storage medium

Inventor: Masamichi Tanabe (Tokyo, JP)
Assignee: NEC CORPORATION
G10L15/22G06Q30/0613G06V40/10G10L15/063G10L15/08G10L15/24G10L15/30G10L2015/088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,300,235
App. No.
18/227,729
Granted
May 13, 2025
Kind
B2
Abstract

Provided is an information processing system including: a voice information acquisition unit that acquires voice information including an utterance made by a person; a status acquisition unit that acquires status information related to status of the person; and a support information generation unit that generates support information used for supporting operation of the person based on the voice information and the status information.

Claims (29)

1. An information processing method executed by a computer, the information processing method comprising:

extracting a keyword from an utterance of a salesclerk or a customer;

if the extracted keyword indicates a severe trouble, generating appropriate support information indicating a method for coping with the severe trouble;

if the extracted keyword indicates a non-severe trouble, generating simple support information indicating a method for coping with the non-severe trouble; and

outputting generated support information to an output device used by the salesclerk,

wherein an amount of the support information output to the output device and the output device selected as a notified target differ according to a severity of the extracted keyword.

2. The information processing method according to claim 1 , wherein the severe trouble is a system trouble of a store.

3. The information processing method according to claim 2 , wherein generating appropriate support information indicating the method for coping with the severe trouble is based on the keyword including the system trouble.

4. The information processing method according to claim 1 , wherein outputting generated support information includes outputting the appropriate support information to a display device in writing.

5. The information processing method according to claim 1 , further comprising:

detecting status of the salesclerk, from an image capturing the salesclerk; and

wherein outputting generated support information includes outputting the simple support information to a store computer in backyard of the store, or an ordering terminal when the salesclerk is in the backyard.

6. The information processing method according to claim 1 , further comprising:

detecting status of the salesclerk, from an image capturing the salesclerk; and

wherein outputting generated support information includes outputting the simple support information by voice when and the salesclerk is serving the customer.

7. The information processing method according to claim 1 ,

wherein the output device is one of a terminal apparatus, a register, a headset, or a store computer, and

wherein when the trouble is severe, one of the terminal apparatus, the register, the headset, or the store computer is determined as the notified target, and when the trouble is not severe, a device different from the terminal apparatus, the register, the headset, and the store computer is determined as the notified target.

8. An information processing apparatus comprising:

one or more memories storing instructions; and

one or more processors configured to execute the instructions to:

extract a keyword from an utterance of a salesclerk or a customer;

if the extracted keyword indicates a severe trouble, generate appropriate support information indicating method for coping with the severe trouble;

if the extracted keyword does not indicate the severe trouble, generate simple support information indicating a method for coping with a non-severe trouble; and

output generated support information to an output device used by the salesclerk,

wherein an amount of the support information output to the output device and the output device selected as a notified target differ according to a severity of the extracted keyword.

9. The information processing apparatus according to claim 8 ,

wherein the output device is one of a terminal apparatus, a register, a headset, or a store computer, and

wherein when the trouble is severe, one of the terminal apparatus, the register, the headset, or the store computer is determined as the notified target, and when the trouble is not severe, a device different from the terminal apparatus, the register, the headset, and the store computer is determined as the notified target.

Priority Claims (1)
JP 2018-134759 · Jul 18, 2018 · national
Continuity (2)
Continuation 17258960
Related Publication 20230368793A1 · Nov 16, 2023
References Cited (31)
US 9313332B1 · Kumar et al. · 2016 [cited by applicant]
US 9911290B1 · Zalewski · 2018 [cited by applicant]
US 10922738B2 · Swierk et al. · 2021 [cited by applicant]
US 20040128196A1 · Shibuno · 2004 [cited by examiner]
US 20080040113A1 · Onodera et al. · 2008 [cited by applicant]
US 20110282662A1 · Aonuma · 2011 [cited by examiner]
US 20140019311A1 · Tanaka · 2014 [cited by examiner]
US 20140032261A1 · Kotak · 2014 [cited by examiner]
US 20140222479A1 · Hirakawa et al. · 2014 [cited by applicant]
US 20150195406A1 · Dwyer · 2015 [cited by examiner]
US 20150213396A1 · Iwai · 2015 [cited by applicant]
US 20150281436A1 · Kumar et al. · 2015 [cited by applicant]
US 20170286940A1 · Clark et al. · 2017 [cited by applicant]
US 20170300990A1 · Tanaka · 2017 [cited by examiner]
US 20180261203A1 · Zoller · 2018 [cited by examiner]
US 20190272547A1 · Coman · 2019 [cited by examiner]
US 20190340658A1 · Udupa · 2019 [cited by examiner]
US 20200412521A1 · Shi · 2020 [cited by applicant]
US 20210158813A1 · Sivasubramanian · 2021 [cited by examiner]
JP 2002366621A · 2002 [cited by applicant]
JP 2014149685A · 2014 [cited by applicant]
JP 2015141563A · 2015 [cited by applicant]
JP 2015149089A · 2015 [cited by applicant]
JP WO2015092861A1 · 2017 [cited by applicant]
JP 2018156522A · 2018 [cited by applicant]
JP 2019029984A · 2019 [cited by applicant]
JP Office Action for JP Application No. 2020-531246, mailed on Jun. 29, 2023 with English Translation. [cited by applicant]
International Search Report for PCT Application No. PCT/JP2019/026861, mailed on Oct. 1, 2019. [cited by applicant]
U.S. Office Action for U.S. Appl. No. 17/258,960, mailed on Oct. 12, 2023. [cited by applicant]
U.S. Office Action for U.S. Appl. No. 18/227,716, mailed on Sep. 3, 2024. [cited by applicant]
U.S. Office Action for U.S. Appl. No. 18/227,741, mailed on Sep. 4, 2024. [cited by applicant]