IP Library › Granted Patent US 11,209,908
Granted Patent B2
US 11,209,908 · App. 16/468,466 · Granted Dec 28, 2021

Information processing apparatus and information processing method

Inventors: Hiroyuki Mizunuma (Tokyo, JP); Ikuo Yamano (Tokyo, JP)
Assignee: SONY CORPORATION
G06F3/017G06K9/00335
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,209,908
App. No.
16/468,466
Granted
Dec 28, 2021
Kind
B2
Abstract

Provided are an information processing apparatus, an information processing method, and a program capable of further improving gesture recognition accuracy. There is provided an information processing apparatus including a context recognition unit that recognizes a context related to a user, a gesture recognition unit that recognizes a gesture of a user, and a setting change unit that dynamically changes a recognition setting of the gesture recognition unit based on recognition result of the context recognition unit.

Claims (68)

1. An information processing apparatus, comprising:

a plurality of first sensors including:

a pressure sensor configured to detect a pressure applied by the information processing apparatus on a wrist of a user; and

a motion sensor configured to detect a movement of the user; and

a processor configured to:

recognize one of a first worn state or a second worn state of the information processing apparatus based on the detection of the pressure applied by the information processing apparatus on the wrist of the user, wherein

the one of the first worn state or the second worn state is recognized as a context related to the user,

the first worn state indicates an application of a first pressure by the information processing apparatus on the wrist of the user,

the second worn state indicates an application of a second pressure by the information processing apparatus on the wrist of the user, and

the first pressure is different from the second pressure;

change a detection setting of the motion sensor for recognition of a gesture of the user, wherein the change in the detection setting of the motion sensor is based on the recognition of the one of the first worn state or the second worn state of the information processing apparatus on the wrist of the user; and

recognize the gesture of the user based on the change in the detection setting of the motion sensor.

2. The information processing apparatus according to claim 1 , wherein

the processor is further configured to acquire a plurality of sensing results from the plurality of first sensors,

and

the processor is further configured to recognize the gesture of the user based on at least one sensing result of the plurality of sensing results by the motion sensor.

3. The information processing apparatus according to claim 2 , wherein the motion sensor includes at least one of an acceleration sensor worn on the user, a gyro sensor worn on the user, or an imaging device configured to capture an image of the user.

4. The information processing apparatus according to claim 2 , wherein the processor is further configured to recognize the context related to the user based on the at least one sensing result of the plurality of sensing results by the motion sensor.

5. The information processing apparatus according to claim 4 , wherein the processor is further configured to recognize the context related to the user based on the at least one sensing result by the motion sensor in which the detection setting is changed.

6. The information processing apparatus according to claim 2 , wherein the processor is further configured to change a type of the at least one sensing result of the plurality of sensing results.

7. The information processing apparatus according to claim 2 , wherein the processor is further configured to change a weightage for each of the plurality of sensing results.

8. The information processing apparatus according to claim 1 , wherein

the processor is further configured to change parameters related to a plurality of recognition settings for the recognition of the gesture, and

the parameters related to the plurality of recognition settings are changed based on whether the motion sensor is on one of a right hand or a left hand of the user.

9. The information processing apparatus according to claim 8 , wherein the change in the parameters related to the plurality of recognition settings includes a change in a type of a sensor of the plurality of first sensors used for the recognition of the gesture, a threshold value for the recognition of the gesture by the sensor, and types of gestures to be recognized.

10. The information processing apparatus according to claim 1 , wherein the processor is further configured to:

recognize the gesture of the user based on a recognition algorithm of a plurality of recognition algorithms; and

change the detection setting in the recognition algorithm, at a time of the recognition of the gesture, based on the context of the user.

11. The information processing apparatus according to claim 1 , wherein the processor is further configured to change a type of the gesture to be recognized based on a behavior of the user.

12. The information processing apparatus according to claim 1 , wherein the processor is further configured to recognize the context related to the user based on a state of a user terminal of the user.

13. The information processing apparatus according to claim 12 , wherein the processor is further configured to recognize the context related to the user based on at least one of a type of the user terminal, a type of an application activated in the user terminal, or a type of a device connected to the user terminal.

14. The information processing apparatus according to claim 1 , wherein

the plurality of first sensors further includes a biological sensor, and

the processor is further configured to:

acquire biological information of the user from the biological sensor; and

recognize the context related to the user based on the biological information.

15. The information processing apparatus according to claim 1 , wherein

the processor is further configured to change parameters related to a plurality of recognition settings based on attribute information and a behavior schedule of the user, and

the parameters related to the plurality of recognition settings are for the recognition of the gesture of the user.

16. The information processing apparatus according to claim 15 , wherein the processor is further configured to:

acquire the attribute information including an age of the user; and

change the parameters related to the plurality of recognition settings based on the age of the user.

17. The information processing apparatus according to claim 1 , wherein the processor is further configured to issue a command to process information based on the recognized gesture.

18. The information processing apparatus according to claim 1 , wherein the information processing apparatus is one of a mobile terminal carried by the user, a wearable terminal worn on a body of the user, or an implant terminal inserted into the body of the user.

19. The information processing apparatus according to claim 1 , wherein

the motion sensor includes a plurality of second sensors, and

the change in the detection setting of the motion sensor includes a change in a threshold of each sensor of the plurality of second sensors of the motion sensor.

20. The information processing apparatus according to claim 1 , wherein

the processor is further configured to change a recognition engine among a plurality of recognition engines for the recognition of the gesture, and

the change in the recognition engine among the plurality of recognition engines includes a concurrent change in parameters related to a plurality of recognition settings for the recognition of the gesture.

21. An information processing method, comprising:

in an information processing apparatus comprising a processor, a pressure sensor configured to detect a pressure applied by the information processing apparatus on a wrist of a user, and a motion sensor configured to detect a movement of the user:

recognizing one of a first worn state or a second worn state of the information processing apparatus based on the detection of the pressure applied by the information processing apparatus on the wrist of the user, wherein

the one of the first worn state or the second worn state is recognized as a context related to the user,

the first worn state indicates an application of a first pressure by the information processing apparatus on the wrist of the user,

the second worn state indicates an application of a second pressure by the information processing apparatus on the wrist of the user, and

the first pressure is different from the second pressure;

changing a detection setting of the motion sensor for recognition of a gesture of the user, wherein the change in the detection setting of the motion sensor is based on the recognition of the one of the first worn state or the second worn state of the information processing apparatus on the wrist of the user; and

recognizing the gesture of the user based on the change in the detection setting of the motion sensor.

22. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a processor, cause the processor to execute operations, the operations comprising:

in an information processing apparatus comprising the processor, a pressure sensor configured to detect a pressure applied by the information processing apparatus on a wrist of a user, and a motion sensor configured to detect a movement of the user:

recognizing one of a first worn state or a second worn state of the information processing apparatus based on the detection of the pressure applied by the information processing apparatus on the wrist of the user, wherein

the one of the first worn state or the second worn state is recognized as a context related to the user,

the first worn state indicates an application of a first pressure by the information processing apparatus on the wrist of the user,

the second worn state indicates an application of a second pressure by the information processing apparatus on the wrist of the user, and

the first pressure is different from the second pressure;

changing a detection setting of the motion sensor for recognition of a gesture of the user, wherein the change in the detection setting of the motion sensor is based on the recognition of the one of the first worn state or the second worn state of the information processing apparatus on the wrist of the user; and

recognizing the gesture of the user based on the change in the detection setting of the motion sensor.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 11, 2019
From: MIZUNUMA, HIROYUKI; YAMANO, IKUO
To: SONY CORPORATION
Reel/Frame 049433/0927 →
Priority Claims (1)
JP 2017-003421 · Jan 12, 2017 · national
Continuity (1)
Related Publication 20200073481A1 · Mar 5, 2020