IP Library Granted Patent US 10,635,152
Granted Patent B2
US 10,635,152 · App. 15/584,330 · Granted Apr 28, 2020

Information processing apparatus, information processing system, and information processing method

Inventors: Ryu Aoyama (Kanagawa, JP); Tomoo Mizukami (Tokyo, JP); Yoji Hirose (Kanagawa, JP); Kei Takahashi (Tokyo, JP); Ikuo Yamano (Tokyo, JP)
Assignee: SONY CORPORATION
G06F1/3206G06F1/3234G06F3/017G06F3/038G06F3/0346G06F3/0488G06F3/04883G06F3/162G06F3/167H04W52/0254G06F1/1605G06F1/32G06F1/3215G06F2203/0381Y02D70/00Y02D70/1262Y02D70/142Y02D70/144Y02D70/162Y02D70/26
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,635,152
App. No.
15/584,330
Granted
Apr 28, 2020
Kind
B2
Abstract

There is provided an information processing apparatus including: a process execution unit configured to execute processes relating to voice operations recognized by a voice operation recognition unit configured to recognize the voice operations on a basis of information from a voice receiving unit and gesture operations recognized by a gesture recognition unit configured to recognize user's gestures recognized on a basis of information from a sensor. The voice operation recognition unit enters a voice operation waiting state in parallel with a gesture waiting state of the gesture recognition unit.

Claims (46)

1. An information processing apparatus comprising:

processing circuitry configured to

transition to a voice operation waiting state and a gesture operation waiting state in parallel in response to receiving a message,

determine whether a gesture is recognized,

in response to a determination that the gesture is recognized, temporarily store the recognized gesture, and

in response to receiving one or more of a voice operation and a gesture operation, execute processes relating to voice operations or gesture operations based on which of the operations are performed and which of the performed operations is performed earlier.

2. The information processing apparatus according to claim 1 , wherein the processing circuitry is further configured to

executes an application, and

enter the voice operation waiting state based on a notification from the application being executed.

3. The information processing apparatus according to claim 1 , wherein the processing circuitry is further configured to

execute a process relating to a voice operation in preference to a gesture operation.

4. The information processing apparatus according to claim 1 , wherein the processing circuitry is further configured to

recognize a user's operation, and

enter an operation-unit-operation waiting state in parallel with the gesture operation waiting state and the voice operation waiting state.

5. The information processing apparatus according to claim 4 , wherein the processing circuitry is further configured to

execute a process relating to an operation-unit operation in preference to the voice operation.

6. The information processing apparatus according to claim 4 , wherein

weighting is performed on each of the voice operation, the gesture operation, and the operation-unit operation, and

the processing circuitry is further configured to determine a process to be executed preferentially in consideration of the weighting.

7. The information processing apparatus according to claim 4 , wherein the processing circuitry is further configured to

execute a process combining at least two of a gesture operation, a voice operation, and an operation-unit operation.

8. The information processing apparatus according to claim 2 , wherein

a mode of a sensor to be activated is selected in accordance with a notification from the application or a type of the application.

9. The information processing apparatus according to claim 2 , wherein

the sensor includes a plurality of sensors, and

a sensor to be activated is selected in accordance with a notification from the application or a type of the application.

10. The information processing apparatus according to claim 1 , wherein

the sensor is an acceleration sensor or a gyro sensor, and

the processing circuitry is further configured to recognize a first gesture when acceleration or angular velocity which is smaller than a predetermined value is detected, and recognizes a second gesture when acceleration or angular velocity which is larger than the predetermined value is detected.

11. The information processing apparatus according to claim 1 , wherein

the processing circuitry is further configured to recognize a first gesture when a same gesture is recognized a smaller number of times than a predetermined number of times, and recognizes a second gesture when a same gesture is recognized a larger number of times than the predetermined number of times.

12. The information processing apparatus according to claim 1 , wherein the processing circuitry is further configured to

recognize the gesture based on machine learning, and

recognize the gesture based on a predetermined rule, and

recognize the gesture when the gesture is recognized based on the machine learning and the predetermined rule.

13. An information processing system comprising:

processing circuitry configured to

transition to a voice operation waiting state and a gesture operation waiting state in parallel in response to receiving a message,

determine whether a gesture is recognized,

in response to a determination that the gesture is recognized, temporarily store the recognized gesture, and

in response to receiving one or more of a voice operation and a gesture operation, execute processes relating to voice operations or gesture operations based on which of the operations are performed and which of the performed operations is performed earlier.

14. An information processing method comprising:

transitioning to a voice operation waiting state and a gesture operation waiting state in parallel in response to receiving a message,

determining whether a gesture is recognized,

in response to a determination that the gesture is recognized, temporarily storing the recognized gesture, and

in response to receiving one or more of a voice operation and a gesture operation, executing processes relating to voice operations or gesture operations based on which of the operations are performed and which of the performed operations is performed earlier.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 26, 2019
From: SONY MOBILE COMMUNICATIONS, INC.
To: SONY CORPORATION
Reel/Frame 049404/0887 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2017
From: AOYAMA, RYU; MIZUKAMI, TOMOO; HIROSE, YOJI; TAKAHASHI, KEI; YAMANO, IKUO
To: SONY MOBILE COMMUNICATIONS INC.; SONY CORPORATION
Reel/Frame 042210/0284 →
Priority Claims (1)
JP 2016-099394 · May 18, 2016 · national
Continuity (1)
Related Publication 20170336848A1 · Nov 23, 2017