IP Library Granted Patent US 10,019,058
Granted Patent B2
US 10,019,058 · App. 14/915,209 · Granted Jul 10, 2018

Information processing device and information processing method

Inventors: Koichi Kawana (Chiba, JP); Noboru Murabayashi (Saitama, JP)
Assignee: SONY CORPORATION
G06F3/013G06F3/04842G06F17/30256G06F17/30268G06F17/30967G06K9/00671G06K9/34G06T7/11G06T7/73H04N5/765H04N5/91
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,019,058
App. No.
14/915,209
Granted
Jul 10, 2018
Kind
B2
Abstract

An information processing apparatus includes: a gaze position detection section that detects a gaze position of a user with respect to a display screen; a position information acquisition section that acquires position information of the user; and a control section that judges, based on the detected gaze position, a scene and an object in the scene that the user focuses in a content displayed on the display screen, and generates search information from the judged object and the acquired position information.

Claims (47)

1. An information processing apparatus, comprising:

circuitry configured to:

detect a gaze position of a first user with respect to a display screen;

acquire position information of the first user;

determine, based on the detected gaze position, a scene and an object in the scene that the first user focuses in a content displayed on the display screen;

segment an image of the determined scene into one or more areas based on a feature amount;

determine a first area of the one or more areas having a highest gaze frequency based on the detected gaze position;

determine the object based on the feature amount of the determined first area; and

generate search information from the determined object and the acquired position information.

2. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to search a storage device that stores contents to be searched, for a recommended content based on the search information.

3. The information processing apparatus according to claim 2 , wherein the storage device is a device that executes a synchronization process with the storage device of a recorder via a network.

4. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to control a recorder connected thereto via a network to set a timer recording operation based on the search information.

5. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to determine the object while taking into account priority levels among genres based on viewing locations and viewing times of the first user.

6. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to:

determine the object in the determined scene based on statistical information indicating which object has collected most gazes in the scene in mobile terminals of a plurality of second users.

7. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to:

determine the object in the determined scene based on a feature spectrum of a second area of the one or more areas that has collected most gazes in the scene by a plurality of second users.

8. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to determined the object while taking into account metadata related to the determined scene, which is allocated to the scene.

9. The information processing apparatus according to claim 1 , further comprising:

a first sensor configured to detect whether there is the first user using the information processing apparatus; and

a second sensor configured to detect a movement of the information processing apparatus,

wherein the circuitry is further configured to determine the object when it is detected that there is the first user using the information processing apparatus based on an output of the first sensor and the movement of the information processing apparatus takes a value that is one of equal to or smaller than a threshold value based on an output of the second sensor.

10. An information processing apparatus, comprising:

circuitry configured to:

acquire, from an information processing apparatus of a user, a result of detection of a gaze position of the user with respect to a display screen of the information processing apparatus of the user, position information of the information processing apparatus of the user, and identification information of a content being viewed on the display screen;

determine, based on the acquired gaze position, a scene and an object in the scene that the user focuses in the content specified based on the acquired identification information of the content;

segment an image of the determined scene into one or more areas based on a feature amount;

determine an area of the one or more areas having a highest gaze frequency based on the detected gaze position;

determine the object based on the feature amount of the determined area;

generate search information from the determined object and the acquired position information; and

transmit the generated search information to the information processing apparatus of the user.

11. An information processing method, comprising:

detecting, by circuitry, a gaze position of a user with respect to a display screen;

acquiring, by the circuitry, position information of the user;

determining, by the circuitry, based on the detected gaze position, a scene and an object in the scene that the user focuses in a content displayed on the display screen;

segmenting, by the circuitry, an image of the scene into one or more areas based on a feature amount;

determining, by the circuitry, an area of the one or more areas having a highest gaze frequency based on the detected gaze position;

determining, by the circuitry, the object based on the feature amount of the determined area; and

generating search information from the determined object and the acquired position information.

12. An information processing method, comprising:

acquiring, by circuitry, from an information processing apparatus of a user, a result of detecting a gaze position of the user with respect to a display screen of the information processing apparatus of the user, position information of the information processing apparatus of the user, and identification information of a content being viewed on the display screen;

determining, by the circuitry, based on the acquired gaze position, a scene and an object in the scene that the user focuses in the content specified based on the acquired identification information of the content;

segmenting, by the circuitry, an image of the scene into one or more areas based on a feature amount;

determining, by the circuitry, an area of the one or more areas having a highest gaze frequency based on the detected gaze position;

determining, by the circuitry, the object based on the feature amount of the determined area;

generating search information from the determined object and the acquired position information; and

transmitting the generated search information to the information processing apparatus of the user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 22, 2021
From: SONY CORPORATION
To: SATURN LICENSING LLC
Reel/Frame 057876/0012 →
Priority Claims (1)
JP 2013-177745 · Aug 29, 2013 · national
Continuity (1)
Related Publication 20160209919A1 · Jul 21, 2016