IP Library Granted Patent US 11,094,097
Granted Patent B2
US 11,094,097 · App. 16/628,300 · Granted Aug 17, 2021

Information processing apparatus and information processing method

Inventors: Tsuyoshi Ishikawa (Kanagawa, JP); Kei Takahashi (Tokyo, JP); Daisuke Sasaki (Saitama, JP)
Assignee: SONY CORPORATION
G06T11/60G06T2200/24G06T2210/22
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,094,097
App. No.
16/628,300
Granted
Aug 17, 2021
Kind
B2
Abstract

The present technique relates to an information processing apparatus, an information processing method, and a program that can make an improvement in terms of communication regarding a plurality of users viewing the same content. Data of content is acquired, and a first visual field image corresponding to a visual field of a first user is cut out from a content image based on the data of the content. In addition, visual field information representing a visual field of a second user viewing the content image is acquired. Furthermore, in a display apparatus, the first visual field image is displayed, and the visual field of the second user is displayed based on the visual field information of the second user. The present technique can be applied to, for example, a case where a plurality users views content, such as a spherical image and a free viewpoint image.

Claims (58)

1. An information processing apparatus, comprising:

circuitry configured to:

acquire data of content;

acquire, based on the data of the content, first visual field information that represents a visual field of a first user who views a content image;

acquire, based on the data of the content, second visual field information that represents a visual field of a second user who views the content image; and

control a display apparatus to:

display a first visual field image to the first user based on the first visual field information;

display the visual field of the second user to the first user based on the second visual field information; and

display at least a wide area image to the first user based on a detection of a specific trigger, wherein the wide area image is generated from one of all or a part of the data of the content.

2. The information processing apparatus according to claim 1 , wherein the visual field of the second user includes a visual field position instruction image that indicates a position of the visual field of the second user.

3. The information processing apparatus according to claim 2 , wherein

the visual field position instruction image includes the wide area image, and

the wide area image includes the first visual field image and a second visual field image corresponding to the visual field of the second user.

4. The information processing apparatus according to claim 2 , wherein

the visual field position instruction image includes a symbol image superimposed on the first visual field image, and

the symbol image indicates the position of the visual field of the second user.

5. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to control the display apparatus to concurrently display the first visual field image and the wide area image to the first user.

6. The information processing apparatus according to claim 1 , wherein the specific trigger includes at least one of a key operation, a voice command, a motion of a head, or a gesture operation by the first user.

7. The information processing apparatus according to claim 1 , wherein the wide area image includes at least one of an equirectangular projection, a Mercator projection, a bird's eye view, an aerial view, or a two-dimensional map.

8. The information processing apparatus according to claim 1 , wherein

the circuitry is further configured to determine the first visual field image to be cut out from the content image, and

the first visual field image is cut out from the content image based on at least one of a movement of a line of sight of the first user or a movement of a head of the first user.

9. The information processing apparatus according to claim 8 , wherein a movement of the first visual field image is based on the line of sight of the first user and approach of the line of sight of the first user to an edge of the first visual field image.

10. The information processing apparatus according to claim 8 , wherein an angle of rotation of the first visual field image is larger than an angle of rotation of the head of the first user based on an angle of rotation of the line of sight of the first user and the angle of rotation of the head of the first user.

11. The information processing apparatus according to claim 8 , wherein

the circuitry is further configured to determine an initial position of the first visual field image based on the second visual field information of the second user, and

the initial position of the first visual field image corresponds to timing at which the first user has substantially started to view the content.

12. The information processing apparatus according to claim 8 , wherein

the display apparatus includes a head mounted display, and

the circuitry is further configured to determine the first visual field image based on at least one of the movement of the line of sight of the first user or the movement of the head of the first user associated with the head mounted display.

13. The information processing apparatus according to claim 1 , wherein

the second user corresponds to a plurality of users, and

the circuitry is further configured to:

control the display apparatus to superimpose, on the first visual field image, at least one of a plurality of user images corresponding to the plurality of users; and

control superimposition of each of the plurality of user images on the first visual field image based on a positional relationship between the first visual field image and a visual field of each of the plurality of users.

14. The information processing apparatus according to claim 13 , wherein

the circuitry is further configured to control the display apparatus to superimpose, on the first visual field image, a specific user image of the plurality of user images, and

the visual field of the specific user image is relatively close to the first visual field image among the plurality of user images.

15. The information processing apparatus according to claim 13 , wherein

the circuitry is further configured to control the display apparatus to superimpose, on the first visual field image, part of the plurality of user images based on a history of communication between the first user and the plurality of users.

16. The information processing apparatus according to claim 1 , wherein the content image includes one of a spherical image or a free viewpoint image.

17. The information processing apparatus according to claim 1 , further comprising the display apparatus.

18. An information processing method, comprising:

acquiring data of content;

acquiring, based on the data of the content, first visual field information representing a visual field of a first user who views a content image;

acquiring, based on the data of the content, second visual field information representing a visual field of a second user who views the content image; and

controlling a display apparatus to:

display a first visual field image to the first user based on the first visual field information;

display the visual field of the second user to the first user based on the second visual field information; and

display at least a wide area image to the first user based on a detection of a specific trigger, wherein the wide area image is generated from one of all or a part of the data of the content.

19. A non-transitory computer-readable medium having stored thereon computer-executable instructions which, when executed by circuitry of an information processing apparatus, cause the circuitry to execute operations, the operations comprising:

acquiring data of content;

acquiring, based on the data of the content, first visual field information representing a visual field of a first user who views a content image;

acquiring, based on the data of the content, second visual field information representing a visual field of a second user who views the content image; and

controlling a display apparatus to:

display a first visual field image to the first user based on the first visual field information;

display the visual field of the second user to the first user based on the second visual field information; and

display at least a wide area image to the first user based on a detection of a specific trigger, wherein the wide area image is generated from one of all or a part of the data of the content.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 23, 2020
From: ISHIKAWA, TSUYOSHI; TAKAHASHI, KEI; SASAKI, DAISUKE
To: SONY CORPORATION
Reel/Frame 052204/0676 →
Priority Claims (1)
JP JP2017-137027 · Jul 13, 2017 · national
Continuity (1)
Related Publication 20200219300A1 · Jul 9, 2020