IP Library Granted Patent US 11,297,296
Granted Patent B2
US 11,297,296 · App. 17/050,283 · Granted Apr 5, 2022

Display control apparatus, program, and display control method

Inventor: Daiki Yamanaka (Tokyo, JP)
Assignee: SONY CORPORATION
H04N13/122G06T7/73G06T19/006G06T19/20G06T2207/10028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,297,296
App. No.
17/050,283
Granted
Apr 5, 2022
Kind
B2
Abstract

Unnatural display is reduced by changing the appearance of a real space. A display control apparatus includes: an information acquisition unit that acquires reliability information indicating reliability of each of element data constituting three-dimensional data of a real space; a region specification unit that specifies a region corresponding to element data of which the reliability does not meet a criterion; and a display control unit that performs display control for changing the appearance of the region specified by the region specification unit.

Claims (32)

1. A display control apparatus comprising:

an information acquisition unit configured to acquire reliability information indicating reliability of each of element data constituting three-dimensional data of a real space;

a region specification unit configured to specify a region corresponding to element data of which the reliability does not meet a criterion; and

a display control unit configured to

perform display control for changing an appearance of the region specified by the region specification unit, and

replace display of the region with display of a substitute object,

wherein the information acquisition unit, the region specification unit, and the display control unit are each implemented via at least one processor.

2. The display control apparatus according to claim 1 , wherein the display control unit is further configured to perform display control for reducing visibility of the region in an image.

3. The display control apparatus according to claim 2 , wherein the display control unit is further configured to set transparency to the region in the image.

4. The display control apparatus according to claim 2 , wherein the display control unit is further configured to arrange another display in the region in the image.

5. The display control apparatus according to claim 1 ,

wherein the region specified by the region specification unit includes a three-dimensional region, and

the display control unit is further configured to arrange an object at a position corresponding to the three-dimensional region.

6. The display control apparatus according to claim 5 , wherein the position corresponding to the three-dimensional region is located at a same position as the three-dimensional region, or is located on a viewpoint position side of the three-dimensional region.

7. The display control apparatus according to claim 1 , wherein the three-dimensional data is obtained by integrating a plurality of depth maps obtained at a plurality of viewpoint positions.

8. The display control apparatus according to claim 7 , wherein the reliability is associated with each of voxels or each of polygon meshes that is each of the element data that constitutes the three-dimensional data.

9. The display control apparatus according to claim 8 , wherein the display control apparatus further comprises a reliability calculation unit configured to calculate the reliability of each voxel or a polygon mesh corresponding to each voxel on a basis of a sum of numbers of times each voxel is observed in the plurality of depth maps,

wherein the reliability calculation unit is implemented via at least one processor.

10. The display control apparatus according to claim 8 ,

wherein in respective depth maps, individual reliability is set for a voxel observed in the respective depth maps, and

the display control apparatus further comprises a reliability calculation unit configured to calculate the reliability of each voxel or a polygon mesh corresponding to each voxel on a basis of a sum of individual reliabilities set for each voxel in the plurality of depth maps,

wherein the reliability calculation unit is implemented via at least one processor.

11. A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer causes the computer to execute a display control method, the method comprising:

acquiring reliability information indicating reliability of each of element data constituting three-dimensional data of a real space;

specifying a region corresponding to element data of which the reliability does not meet a criterion;

performing display control for changing an appearance of the region; and

replacing display of the region with display of a substitute object.

12. A display control method comprising:

acquiring reliability information indicating reliability of each of element data constituting three-dimensional data of a real space;

specifying a region corresponding to element data of which the reliability does not meet a criterion;

performing, by a processor, display control for changing an appearance of the region that has been specified; and

replacing display of the region with display of a substitute object.

Assignments (2)
CHANGE OF NAME Recorded Dec 17, 2025
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 073986/0571 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 23, 2020
From: YAMANAKA, DAIKI
To: SONY CORPORATION
Reel/Frame 054152/0296 →