IP Library › Granted Patent US 12,272,359
Granted Patent B2
US 12,272,359 · App. 18/227,716 · Granted Apr 8, 2025

Information processing system, information processing method, and storage medium

Inventor: Masamichi Tanabe (Tokyo, JP)
Assignee: NEC CORPORATION
G10L15/22G06Q30/0613G06V40/10G10L15/063G10L15/08G10L15/24G10L15/30G10L2015/088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,272,359
App. No.
18/227,716
Granted
Apr 8, 2025
Kind
B2
Abstract

Provided is an information processing system including: a voice information acquisition unit that acquires voice information including an utterance made by a person; a status acquisition unit that acquires status information related to status of the person; and a support information generation unit that generates support information used for supporting operation of the person based on the voice information and the status information.

Claims (27)

1. An information processing method executed by a computer, the information processing method comprising:

correlating support information and a notified target for each of a keyword and status of a salesclerk;

extracting a keyword from an utterance of a salesclerk or a customer;

detecting, from an image capturing the salesclerk, a status of the salesclerk;

generating specific support information from a plurality of the support information using the extracted keyword and the detected status;

determining an output device of the notified target using the extracted keyword and the detected status; and

outputting the specific support information to the determined output device used by the salesclerk.

2. The information processing method according to claim 1 , wherein the status includes information distinguishing whether the salesclerk is responding to an inquiry from the customer, selling a product at a sales counter, or standing by in the backyard.

3. The information processing method according to claim 1 , wherein the status includes an information representing whether the salesclerk is serving the customer.

4. The information processing method according to claim 3 , further comprising:

controlling a timing of generating the support information or a timing of outputting the support information in accordance with the keyword, and the information representing whether the salesclerk is serving the customer.

5. The information processing method according to claim 3 , further comprising:

detecting the information representing whether the salesclerk is serving the customer, from a tone of a voice of the salesclerk, wherein the voice includes the utterance.

6. The information processing method according to claim 3 , further comprising:

detecting the information representing whether the salesclerk is serving the customer, from microphones which acquired a voice of the salesclerk when a plurality of microphones is installed in respective different places in a store, wherein the voice includes the utterance.

7. The information processing method according to claim 1 , wherein the utterance includes a conversation between the salesclerk and the customer.

8. The information processing method according to claim 1 , wherein the output device is one of a terminal apparatus, a register, a headset, or a store computer.

9. An information processing apparatus comprising:

one or more memories storing instructions; and

one or more processors configured to execute the instructions to:

correlate support information and a notified target for each of a keyword and status of a salesclerk;

extract a keyword from an utterance of a salesclerk or a customer;

detect, from an image capturing the salesclerk, a status of the salesclerk;

generate specific support information from a plurality of the support information using the extracted keyword and the detected status;

determine an output device of the notified target using the extracted keyword and the detected status; and

output the specific support information to the determined output device used by the salesclerk.

10. The information processing apparatus according to claim 9 , wherein the output device is one of a terminal apparatus, a register, a headset, or a store computer.

Priority Claims (1)
JP 2018-134759 · Jul 18, 2018 · national
Continuity (2)
Continuation 17258960
Related Publication 20230368792A1 · Nov 16, 2023
References Cited (31)
US 9313332B1 · Kumar · 2016 [cited by examiner]
US 9911290B1 · Zalewski · 2018 [cited by applicant]
US 10922738B2 · Swierk · 2021 [cited by examiner]
US 20040128196A1 · Shibuno · 2004 [cited by applicant]
US 20080040113A1 · Onodera · 2008 [cited by examiner]
US 20110282662A1 · Aonuma · 2011 [cited by examiner]
US 20140019311A1 · Tanaka · 2014 [cited by applicant]
US 20140032261A1 · Kotak · 2014 [cited by applicant]
US 20140222479A1 · Hirakawa et al. · 2014 [cited by applicant]
US 20150195406A1 · Dwyer et al. · 2015 [cited by applicant]
US 20150213396A1 · Iwai · 2015 [cited by applicant]
US 20150281436A1 · Kumar · 2015 [cited by examiner]
US 20170286940A1 · Clark et al. · 2017 [cited by applicant]
US 20170300990A1 · Tanaka · 2017 [cited by examiner]
US 20180261203A1 · Zoller · 2018 [cited by examiner]
US 20190272547A1 · Coman · 2019 [cited by examiner]
US 20190340658A1 · Udupa · 2019 [cited by examiner]
US 20200412521A1 · Shi · 2020 [cited by applicant]
US 20210158813A1 · Sivasubramanian et al. · 2021 [cited by applicant]
JP 2002366621A · 2002 [cited by applicant]
JP 2014149685A · 2014 [cited by applicant]
JP 2015141563A · 2015 [cited by applicant]
JP 2015149089A · 2015 [cited by applicant]
JP WO2015092861A1 · 2017 [cited by applicant]
JP 2018156522A · 2018 [cited by applicant]
JP 201929984A · 2019 [cited by applicant]
U.S. Office Action for U.S. Appl. No. 17/258,960, mailed on Oct. 12, 2023. [cited by applicant]
JP Office Action for JP Application No. 2020-531246, mailed on Jun. 29, 2023 with English Translation. [cited by applicant]
International Search Report for PCT Application No. PCT/JP2019/026861, mailed on Oct. 1, 2019. [cited by applicant]
U.S. Office Action for U.S. Appl. No. 18/227,729 mailed on Mar. 13, 2024. [cited by applicant]
U.S. Office Action for U.S. Appl. No. 18/227,729, mailed on Sep. 4, 2024. [cited by applicant]