IP Library Granted Patent US 9,865,094
Granted Patent B2
US 9,865,094 · App. 15/377,093 · Granted Jan 9, 2018

Information processing apparatus, display control method, and program

Inventor: Seiji Suzuki (Kanagawa, JP)
Assignee: SONY CORPORATION
G06T19/006G06T2210/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,865,094
App. No.
15/377,093
Granted
Jan 9, 2018
Kind
B2
Abstract

There is provided an information processing apparatus including a judgment unit for judging an anteroposterior relationship between a shot actual object and a virtual object for each part by use of depth information, and a display control unit for displaying a virtual image in which the virtual object is projected to be overlapped on a shot image in which the actual object is shot based on the anteroposterior relationship judged by the judgment unit.

Claims (26)

1. An information processing apparatus comprising: circuitry configured to:

acquire actual object depth information of different portions of an actual object based on an actual distance of respective portions of the actual object from an object imaging device which acquires a shot image of the actual object;

determine virtual object depth information of different portions of a virtual object based on a virtual distance of respective portions of the virtual object from a virtual imaging device at a location corresponding to the object imaging device;

acquire pixels of a respective portion of the shot image, the acquired shot image pixels being a function of the actual distance to the corresponding portion of the actual object from the object imaging device;

acquire pixels of a respective portion of an image of the virtual object, the acquired virtual object image pixels being a function of the virtual distance to the corresponding portion of the virtual object from the virtual imaging device;

determine an anteroposterior relationship between the actual object within the shot image obtained by the object imaging device and the virtual object for each of the portions of the actual object and the corresponding portions of the virtual object by comparing values of the actual distance of a respective portion of the actual object and the virtual object distance of the corresponding portion of the virtual object from their respective object imaging device and virtual imaging device; and

control a display to display the pixels of the portions of the virtual object image pixels and not the shot image pixels of the corresponding portions of the shot image when the portions of the virtual object are determined to be located in front of the actual object or display the shot image pixels of the portions of the shot image and not the virtual object image pixels of the corresponding portions of the virtual image when the portions of the virtual object are determined to be located behind the actual object so that the objects are displayed in accordance with the determined anteroposterior relationship.

2. The information processing apparatus of claim 1 wherein the actual object is a part of body of a human.

3. The information processing apparatus of claim 2 wherein the actual object is a hand.

4. The information processing apparatus of claim 1 wherein the display is controlled on the basis of pixels of the actual object and pixels of the virtual object.

5. The information processing apparatus of claim 1 wherein the display is controlled to display the portions of the virtual object when the portions of the virtual object are determined to be closer to the virtual imaging device than the distance of the portions of the actual object from the object imaging device.

6. The information processing apparatus of claim 1 wherein the display is controlled to display the portions of the shot image when the portions of the actual object corresponding to the portions of the shot image are determined to be closer to the object imaging device than the distance of the portions of the virtual object from the virtual imaging device.

7. A display control method comprising the steps of:

acquiring actual object depth information of different portions of an actual object based on an actual distance of respective portions of the actual object from an object imaging device which acquires a shot image of the actual object;

determining virtual object depth information of different portions of a virtual object based on a virtual distance of respective portions of the virtual object from a virtual imaging device at a location corresponding to the object imaging device;

acquiring pixels of a respective portion of the shot image, the acquired shot image pixels being a function of the actual distance to the corresponding portion of the actual object from the object imaging device;

acquiring pixels of a respective portion of an image of the virtual object, the acquired virtual object image pixels being a function of the virtual distance to the corresponding portion of the virtual object from the virtual imaging device;

determining an anteroposterior relationship between the actual object within Hall the shot image obtained by the object imaging device and the virtual object for each of the portions of the actual object and the corresponding portions of the virtual object by comparing values of the actual distance of a respective portion of the actual object and the virtual object distance of the corresponding portion of the virtual object from their respective object imaging device and virtual imaging device; and

displaying the pixels of the portions of the virtual object image pixels and not the shot image pixels of the corresponding portions of the shot image when the portions of the virtual object are determined to be located in front of the actual object or displaying the shot image pixels of the portions of the shot image and not the virtual object image pixels of the corresponding portions of the virtual image when the portions of the virtual object are determined to be located behind the actual object so that the objects are displayed in accordance with the determined anteroposterior relationship.

8. A non-transitory computer readable medium on which is stored a program for causing a computer to control a display by:

acquiring actual object depth information of different portions of an actual object based on an actual distance of respective portions of the actual object from an object imaging device which acquires a shot image of the actual object;

determining virtual object depth information of different portions of a virtual object based on a virtual distance of respective portions of the virtual object from a virtual imaging device at a location corresponding to the object imaging device;

acquiring pixels of a respective portion of the shot image, the acquired shot image pixels being a function of the actual distance to the corresponding portion of the actual object from the object imaging device;

acquiring pixels of a respective portion of an image of the virtual object, the acquired virtual object image pixels being a function of the virtual distance to the corresponding portion of the virtual object from the virtual imaging device;

determining an anteroposterior relationship between the actual object within flail the shot image obtained by the object imaging device and the virtual object for each of the portions of the actual object and the corresponding portions of the virtual object by comparing values of the actual distance of a respective portion of the actual object and the virtual object distance of the corresponding portion of the virtual object from their respective object imaging device and virtual imaging device; and

displaying the pixels of the portions of the virtual object image pixels and not the shot image pixels of the corresponding portions of the shot image when the portions of the virtual object are determined to be located in front of the actual object or displaying the shot image pixels of the portions of the shot image and not the virtual object image pixels of the corresponding portions of the virtual image when the portions of the virtual object are determined to be located behind the actual object so that the objects are displayed in accordance with the determined anteroposterior relationship.

Assignments (1)
CHANGE OF NAME Recorded Dec 17, 2025
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 073986/0571 →
Priority Claims (1)
JP 2011-245304 · Nov 9, 2011 · national
Continuity (2)
Continuation 14356008
Related Publication 20170148220A1 · May 25, 2017