IP Library › Granted Patent US 12,288,557
Granted Patent B2
US 12,288,557 · App. 18/227,741 · Granted Apr 29, 2025

Information processing system, information processing method, and storage medium

Inventor: Masamichi Tanabe (Tokyo, JP)
Assignee: NEC CORPORATION
G10L15/22G06Q30/0613G06V40/10G10L15/063G10L15/08G10L15/24G10L15/30G10L2015/088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,288,557
App. No.
18/227,741
Granted
Apr 29, 2025
Kind
B2
Abstract

Provided is an information processing system including: a voice information acquisition unit that acquires voice information including an utterance made by a person; a status acquisition unit that acquires status information related to status of the person; and a support information generation unit that generates support information used for supporting operation of the person based on the voice information and the status information.

Claims (24)

1. An information processing method executed by a computer, the information processing method comprising:

correlating support information and a notified target for each of a keyword and status of a salesclerk;

extracting a keyword from an utterance of the salesclerk or a customer;

detecting, from an image capturing the salesclerk, a status of the salesclerk,

wherein the status includes position information representing whether the salesclerk is located in a sales area or in an area other than the sales area;

generating specific support information from a plurality of the support information using the extracted keyword and the detected status;

determining an output device of the notified target using the extracted keyword and the detected status; and

outputting the specific support information to the determined output device used by the salesclerk.

2. The information processing method according to claim 1 , wherein the position information further includes information representing where the salesclerk is located in the sales area.

3. The information processing method according to claim 1 , wherein the status further includes information as to whether the customer is present near the salesclerk.

4. The information processing method according to claim 1 , wherein the status further includes information as to whether another salesclerk is present near the salesclerk.

5. The information processing method according to claim 1 , wherein the status further includes information as to whether a predetermined article is present near the salesclerk.

6. The information processing method according to claim 5 , wherein the predetermined article is at least one of a sales counter, a register, a terminal apparatus, a product shelf, and a store computer in the backyard.

7. The information processing method according to claim 1 , wherein the output device is one of a terminal apparatus, a register, a headset, or a store computer.

8. An information processing apparatus comprising:

one or more memories storing instructions; and

one or more processors configured to execute the instructions to:

correlate support information and a notified target for each of a keyword and status of a salesclerk;

extract a keyword from an utterance of a salesclerk or a customer;

detect a status of the salesclerk, from an image capturing the salesclerk, wherein the status includes position information representing whether the salesclerk is located in a sales area or in an area other than the sales area;

generate specific support information using the extracted keyword and the detected status;

determine an output device of the notified target using the extracted keyword and the detected status; and

output the support information to the determined output device used by the salesclerk.

9. The information processing apparatus according to claim 8 , wherein the output device is one of a terminal apparatus, a register, a headset, or a store computer.

Priority Claims (1)
JP 2018-134759 · Jul 18, 2018 · national
Continuity (2)
Continuation 17258960
Related Publication 20230410802A1 · Dec 21, 2023
References Cited (31)
US 9313332B1 · Kumar · 2016 [cited by examiner]
US 9911290B1 · Zalewski · 2018 [cited by applicant]
US 10922738B2 · Swierk · 2021 [cited by examiner]
US 20040128196A1 · Shibuno · 2004 [cited by applicant]
US 20080040113A1 · Onodera · 2008 [cited by examiner]
US 20110282662A1 · Aonuma · 2011 [cited by examiner]
US 20140019311A1 · Tanaka · 2014 [cited by applicant]
US 20140032261A1 · Kotak · 2014 [cited by applicant]
US 20140222479A1 · Hirakawa et al. · 2014 [cited by applicant]
US 20150195406A1 · Dwyer et al. · 2015 [cited by applicant]
US 20150213396A1 · Iwai · 2015 [cited by applicant]
US 20150281436A1 · Kumar · 2015 [cited by examiner]
US 20170286940A1 · Clark et al. · 2017 [cited by applicant]
US 20170300990A1 · Tanaka · 2017 [cited by examiner]
US 20180261203A1 · Zoller · 2018 [cited by examiner]
US 20190272547A1 · Coman · 2019 [cited by examiner]
US 20190340658A1 · Udupa · 2019 [cited by examiner]
US 20200412521A1 · Shi · 2020 [cited by applicant]
US 20210158813A1 · Sivasubramanian et al. · 2021 [cited by applicant]
JP 2002366621A · 2002 [cited by applicant]
JP 2014149685A · 2014 [cited by applicant]
JP 2015141563A · 2015 [cited by applicant]
JP 2015149089A · 2015 [cited by applicant]
JP WO2015092861A1 · 2017 [cited by applicant]
JP 2018156522A · 2018 [cited by applicant]
JP 201929984A · 2019 [cited by applicant]
International Search Report for PCT Application No. PCT/JP2019/026861, mailed on Oct. 1, 2019. [cited by applicant]
US Office Action for U.S. Appl. No. 17/258,960, mailed on Oct. 12, 2023. [cited by applicant]
JP Office Action for JP Application No. 2020-531246, mailed on Jun. 29, 2023 with English Translation. [cited by applicant]
US Office Action for U.S. Appl. No. 18/227,729 mailed on Mar. 13, 2024. [cited by applicant]
US Office Action for U.S. Appl. No. 18/227,729, mailed on Sep. 4, 2024. [cited by applicant]