IP Library Granted Patent US 9,014,754
Granted Patent B2
US 9,014,754 · App. 13/882,479 · Granted Apr 21, 2015

Information processing system and information processing method

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,014,754
App. No.
13/882,479
Granted
Apr 21, 2015
Kind
B2
Abstract

An information processing system includes a mobile equipment and an information processing apparatus. The mobile equipment includes a sensor for acquiring biological information, a camera for acquiring an image corresponding to a visual field of a user, and a first communication means. The information processing apparatus includes a second communication unit and computing unit. The computing unit determines whether to activate the camera based on the biological information acquired by the sensor. Further, the computing unit extracts a feature from the image acquired by the camera and transmits information regarding the extracted feature to a public network using the second communication unit to acquire a searched result regarding the extracted feature.

Claims (109)

1. An information processing system comprising a mobile equipment and an information processing apparatus, wherein

the mobile equipment comprises:

a sensor for acquiring biological information;

a camera for acquiring an image corresponding to a visual field of a user; and

a first communication unit for performing radio communication with the information processing apparatus,

the information processing apparatus comprises:

a second communication unit for performing radio communication with the mobile equipment and a public network; and

computing unit,

the first communication unit wirelessly transmits the biological information acquired by the sensor to the information processing apparatus,

the computing unit determines whether to activate the camera based on the biological information that is acquired, and upon determination that the camera is to be activated, the computing unit transmits an instruction to activate the camera to the mobile equipment by using the second communication unit,

after the camera is activated, the first communication unit wirelessly transmits the image acquired by the camera to the information processing apparatus, and

the computing unit extracts a feature from the image that is acquired and transmits information regarding the extracted feature to the public network using the second communication unit, and performs search using the information regarding the extracted feature to acquire a searched result regarding the extracted feature,

wherein the computing unit varies the feature to be extracted from the image acquired by the camera based on the biological information acquired by the sensor, and

wherein the sensor comprises a brain wave sensor, and the computing unit varies the feature to be extracted from the image acquired by the camera between a case in which the brain waves acquired by the brain wave sensor indicate a positive feeling and a case in which the brain waves indicate a negative feeling.

2. The information processing system according to claim 1 , wherein the computing unit registers the searched result regarding the extracted feature in association with an image including the feature.

3. The information processing system according to claim 1 , wherein

the mobile equipment further comprises a display unit; and

the display unit displays the searched result regarding the extracted feature transmitted from the second communication unit in association with a real image seen by the user.

4. The information processing system according to claim 1 , wherein the computing unit determines that the camera is to be activated when the biological information indicates at least one of a state in which user's concentration is increased, a state in which the user is reacting to a target object, a state in which the user is stimulated, and a state in which the user is surprised.

5. The information processing system according to claim 1 , wherein the computing unit extracts the feature from the image acquired by the camera using information categorized into a positive feature and a negative feature registered in advance.

6. The information processing system according to claim 1 , wherein the computing unit identifies an individual that uses the mobile equipment based on the brain waves acquired by the brain wave sensor and information registered in advance in which an individual and brain waves of the individual are associated with each other.

7. The information processing system according to claim 1 , wherein

the mobile equipment further comprises voice input unit, and

the computing unit transmits the information regarding the extracted feature and information input from the voice input unit to the public network using the second communication unit, and performs search using the information regarding the extracted feature and the information input from the voice input unit to acquire the searched result regarding the extracted feature.

8. The information processing system according to claim 1 , wherein the computing unit acquires additional information from the extracted feature, transmits the information regarding the extracted feature and the additional information to the public network using the second communication unit, and performs search using the information regarding the extracted feature and the additional information, to acquire the searched result regarding the extracted feature.

9. The information processing system according to claim 8 , wherein the additional information acquired by the computing unit from the feature comprises at least one of character information displayed in the feature, size of the feature, information indicating whether the feature comprises a face, and a detailed feature of the feature.

10. The information processing system according to claim 1 , wherein the computing unit corrects the image acquired by the camera to an image seen from a front side before extracting at least one of the feature and the additional information.

11. An information processing system comprising a mobile equipment and an information processing apparatus, wherein

the mobile equipment comprises:

a sensor for acquiring biological information;

a camera for acquiring an image corresponding to a visual field of a user; and

a first communication unit for performing radio communication with the information processing apparatus,

the information processing apparatus comprises:

a second communication unit for performing radio communication with the mobile equipment and a public network; and

computing unit,

the first communication unit wirelessly transmits the biological information acquired by the sensor to the information processing apparatus,

the computing unit determines whether to activate the camera based on the biological information that is acquired, and upon determination that the camera is to be activated, the computing unit transmits an instruction to activate the camera to the mobile equipment by using the second communication unit,

after the camera is activated, the first communication unit wirelessly transmits the image acquired by the camera to the information processing apparatus, and

the computing unit extracts a feature from the image that is acquired and transmits information regarding the extracted feature to the public network using the second communication unit, and performs search using the information regarding the extracted feature to acquire a searched result regarding the extracted feature, wherein

the mobile equipment further comprises a display unit; and

the display unit displays the searched result regarding the extracted feature transmitted from the second communication unit in association with a real image seen by the user, and

wherein the computing unit varies the searched result displayed in association with the real image using the display unit based on the biological information acquired by the sensor.

12. The information processing system according to claim 11 , wherein the sensor comprises a brain wave sensor, and the computing unit varies the searched result displayed in association with the real image using the display unit between a case in which the brain waves acquired by the brain wave sensor indicate a positive feeling and a case in which the brain waves indicate a negative feeling.

13. An information processing system comprising:

a sensor for acquiring biological information;

a camera for acquiring an image corresponding to a visual field of a user;

communication unit for performing radio communication with a public network, and

computing unit, wherein:

the computing unit determines whether to activate the camera based on the biological information that is acquired,

upon determination that the camera is to be activated, the computing unit activates the camera to extract a feature from an image acquired by the camera, and

the computing unit transmits information regarding the extracted feature to the public network using the communication unit, and performs search using the information regarding the extracted feature, to acquire a searched result regarding the extracted feature,

wherein the sensor comprises a brain wave sensor, and the computing unit varies the feature to be extracted from the image acquired by the camera between a case in which the brain waves acquired by the brain wave sensor indicate a positive feeling and a case in which the brain waves indicate a negative feeling.

14. The information processing system according to claim 13 , wherein the computing unit registers the searched result regarding the extracted feature in association with an image including the feature.

15. The information processing system according to claim 13 , wherein:

the information processing system further comprises a display unit, and

the display unit displays the searched result regarding the extracted feature in association with a real image seen by the user.

16. An information processing method in an information processing system, the information processing system comprising:

a brain wave sensor for acquiring biological information;

a camera for acquiring an image corresponding to a visual field of a user; and

communication unit for performing radio communication with a public network, the method comprising:

determining whether to activate the camera based on the biological information that is acquired;

upon determination that the camera is to be activated, activating the camera to extract a feature from an image acquired by the camera; and

transmitting information regarding the extracted feature to the public network using the communication unit, and performing search using the information regarding the extracted feature, to acquire a searched result regarding the extracted feature,

wherein when extracting the feature from the image acquired by the camera, the feature to be extracted from the image acquired by the camera is varied between a case in which the brain waves acquired by the brain wave sensor indicate a positive feeling and a case in which the brain waves indicate a negative feeling.

17. The information processing method according to claim 16 , further comprising registering the searched result regarding the extracted feature in association with an image including the feature.

18. The information processing method according to claim 16 , further comprising displaying the searched result regarding the extracted feature in association with a real image seen by the user.

19. An information processing system comprising a mobile equipment and an information processing apparatus, wherein

the mobile equipment comprises:

a sensor for acquiring biological information;

a camera for acquiring an image corresponding to a visual field of a user; and

a first communication means for performing radio communication with the information processing apparatus,

the information processing apparatus comprises:

a second communication means for performing radio communication with the mobile equipment and a public network; and

computing means,

the first communication means wirelessly transmits the biological information acquired by the sensor to the information processing apparatus,

the computing means determines whether to activate the camera based on the biological information that is acquired, and upon determination that the camera is to be activated, the computing means transmits an instruction to activate the camera to the mobile equipment by using the second communication means,

after the camera is activated, the first communication means wirelessly transmits the image acquired by the camera to the information processing apparatus, and

the computing means extracts a feature from the image that is acquired and transmits information regarding the extracted feature to the public network using the second communication means, and performs search using the information regarding the extracted feature to acquire a searched result regarding the extracted feature,

wherein the sensor comprises a brain wave sensor, and the computing means varies the feature to be extracted from the image acquired by the camera between a case in which the brain waves acquired by the brain wave sensor indicate a positive feeling and a case in which the brain waves indicate a negative feeling.

20. An information processing system comprising:

a sensor for acquiring biological information;

a camera for acquiring an image corresponding to a visual field of a user;

communication means for performing radio communication with a public network, and

computing means, wherein:

the computing means determines whether to activate the camera based on the biological information that is acquired,

upon determination that the camera is to be activated, the computing means activates the camera to extract a feature from an image acquired by the camera, and

the computing means transmits information regarding the extracted feature to the public network using the communication means, and performs search using the information regarding the extracted feature, to acquire a searched result regarding the extracted feature,

wherein the sensor comprises a brain wave sensor, and the computing means varies the feature to be extracted from the image acquired by the camera between a case in which the brain waves acquired by the brain wave sensor indicate a positive feeling and a case in which the brain waves indicate a negative feeling.

21. An information processing system comprising:

a sensor for acquiring biological information;

a camera for acquiring an image corresponding to a visual field of a user;

communication unit for performing radio communication with a public network;

a display unit; and

a computing unit, wherein:

the computing unit determines whether to activate the camera based on the biological information that is acquired,

upon determination that the camera is to be activated, the computing unit activates the camera to extract a feature from an image acquired by the camera, and

the computing unit transmits information regarding the extracted feature to the public network using the communication unit, and performs search using the information regarding the extracted feature, to acquire a searched result regarding the extracted feature,

wherein the display unit displays the searched result regarding the extracted feature in association with a real image seen by the user, and

wherein the computing unit varies the searched result displayed in association with the real image using the display unit based on the biological information acquired by the sensor.

22. An information processing method in an information processing system, the information processing system comprising:

a sensor for acquiring biological information;

a camera for acquiring an image corresponding to a visual field of a user;

a display unit, and

a communication unit for performing radio communication with a public network, the method comprising:

determining whether to activate the camera based on the biological information that is acquired;

upon determination that the camera is to be activated, activating the camera to extract a feature from an image acquired by the camera;

transmitting information regarding the extracted feature to the public network using the communication unit, and performing search using the information regarding the extracted feature, to acquire a searched result regarding the extracted feature; and

displaying the searched result regarding the extracted feature in association with a real image seen by the user,

wherein the searched result displayed in association with the real image using the display unit is varied based on the biological information acquired by the sensor.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2015
From: NEC MOBILE COMMUNICATIONS, LTD.
To: NEC CORPORATION
Reel/Frame 036037/0476 →
CHANGE OF NAME Recorded Jun 9, 2015
From: NEC CASIO MOBILE COMMUNICATIONS, LTD.
To: NEC MOBILE COMMUNICATIONS, LTD.
Reel/Frame 035866/0495 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 1, 2013
From: KITATANI, KENICHI; ISHIDA, SHINJIRO
To: NEC CASIO MOBILE COMMUNICATIONS, LTD.
Reel/Frame 030361/0266 →