IP Library Granted Patent US 9,838,669
Granted Patent B2
US 9,838,669 · App. 13/592,963 · Granted Dec 5, 2017

Apparatus and method for depth-based image scaling of 3D visual content

Inventor: Eduardo R. Corral-Soto (Toronto, CA)
Assignee: STMICROELECTRONICS (CANADA), INC.
H04N13/026G06T3/40G06T3/4007G06T15/00G06T15/405G06T2207/10028H04N13/0275
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,838,669
App. No.
13/592,963
Granted
Dec 5, 2017
Kind
B2
Abstract

A system for performing depth-based scaling of 3D content. The system comprises: 1) a content source configured to provide an input image comprising a plurality of input image objects; and 2) a processor configured to receive the input image and to receive a depth map comprising depth data associated with each of the plurality of input image objects. The processor generates an output image comprising a plurality of output image objects, wherein each of the plurality of output image objects corresponding to one of the plurality of input image objects. The processor scales a size of a first output image object relative to the size of a second output image object based on depth data associated with the first output image object and the second output image object.

Claims (31)

1. A system configured to perform depth-based scaling of 3D content based on user input, the system comprising:

a content source configured to provide an input image comprising a plurality of input image objects;

a user input configured to receive a user input control signal that control an amount of change in a perceived depth of at least one of the plurality of input image objects; and

a processor configured to receive the user input control signal, to receive the input image, and to receive a depth map comprising depth data associated with each of the plurality of input image objects, wherein the processor generates therefrom an output image comprising a plurality of output image objects, each of the plurality of output image objects corresponding to one of the plurality of input image objects, and wherein the processor scales a size of a first output image object in cooperation with scaling a size of a second output image object based on first selected depth data associated with the first output image object and based on second selected depth data associated with the second output image object, wherein at least one of the first and second selected depth data is selected in response to the user input control signal, wherein the first output image object is processed before the second output image object, and wherein the first output image object has a greater assigned depth than the second output image object.

2. The system as set forth in claim 1 , wherein the first output image object is closer to a viewer of the 3D content than the second output image object and the processor scales the size of the first output image object by a larger factor than the size of the second output image object.

3. The system as set forth in claim 1 , wherein the processor is configured to quantize the depth map into a plurality of layers, where each layer of the plurality of layers is associated with one of the plurality of input image objects of the input image.

4. The system as set forth in claim 3 , wherein the processor is further configured to perform individual spatial two-dimensional scaling of each of the input image objects.

5. The system as set forth in claim 4 , wherein the processor is further configured to horizontally and vertically scale each of the input image objects by a corresponding scaling factor.

6. The system as set forth in claim 5 , wherein the corresponding scaling factor is one of a set of scaling factors, the set of scaling factors defined by means of a one dimensional function.

7. The system as set forth in claim 6 , wherein the one dimensional function is a monotonically increasing function.

8. An integrated circuit configured to perform depth-based scaling of 3D content in response to a viewer input control signal, wherein the integrated circuit is configured to:

receive an input image comprising a plurality of input image objects;

receive the viewer input control signal that directs a change in perceived depth of at least one of the plurality of input image objects;

receive a depth map comprising depth data associated with each of the plurality of input image objects; and

generate from the viewer input control signal, the input image, and the depth map an output image comprising a plurality of output image objects, each of the plurality of output image objects corresponding to one of the plurality of input image objects, and wherein the integrated circuit scales a size of a first output image object in cooperation with scaling a size of a second output image object based on first selected depth data associated with the first output image object and based on second selected depth data associated with the second output image object, wherein at least one of the first and second selected depth data is selected in response to the viewer input control signal, wherein the first output image object is processed before the second output image object, and wherein the first output image object has a greater assigned depth than the second output image object.

9. The integrated circuit as set forth in claim 8 , wherein the first output image object is closer to a viewer of the 3D content than the second output image object and the integrated circuit scales the size of the first output image object by a larger factor than the size of the second output image object.

10. The integrated circuit as set forth in claim 8 , wherein the integrated circuit is configured to quantize the depth map into a plurality of layers, where each layer of the plurality of layers is associated with one of the plurality of input image objects of the input image.

11. The integrated circuit as set forth in claim 10 , wherein the integrated circuit is further configured to perform individual spatial two-dimensional scaling of each of the input image objects.

12. The integrated circuit as set forth in claim 11 , wherein the integrated circuit is further configured to horizontally and vertically scale each of the input image objects by a corresponding scaling factor.

13. The integrated circuit as set forth in claim 12 , wherein the corresponding scaling factor is one of a set of scaling factors, the set of scaling factors defined by means of a one-dimensional function.

14. The integrated circuit as set forth in claim 13 , wherein the one-dimensional function is a monotonically increasing function.

15. A method for performing depth-based scaling of 3D content in response to a viewer input control signal, the method comprising:

receiving an input image comprising a plurality of input image objects;

receiving the viewer input control signal, the viewer input control signal arranged to direct a change in perceived depth of at least one of the plurality of input image objects;

receiving a depth map comprising depth data associated with each of the plurality of input image objects; and

generating from the viewer input control signal, the input image, and the depth map, an output image comprising a plurality of output image objects, each of the plurality of output image objects corresponding to one of the plurality of input image objects, and wherein a size of a first output image object is scaled in cooperation with scaling a size of a second output image object based on first selected depth data associated with the first output image object and based on second selected depth data associated with the second output image object, wherein at least one of the first and second selected depth data is selected in response to the viewer input control signal, wherein the first output image object is processed before the second output image object, and wherein the first output image object has a greater assigned depth than the second output mage object.

16. The method as set forth in claim 15 , wherein the first output image object is closer to a viewer of the 3D content than the second output image object, and wherein generating the output image comprises scaling the size of the first output image object by a larger factor than the size of the second output image object.

17. The method as set forth in claim 15 , wherein generating the output image comprises quantizing the depth map into a plurality of layers, where each layer of the plurality of layers is associated with one of the plurality of input image objects of the input image.

18. The method as set forth in claim 17 , wherein generating the output image comprises performing individual spatial two-dimensional scaling of each of the input image objects.

19. The method as set forth in claim 18 , wherein generating the output image comprises horizontally and vertically scaling each of the input image objects by a corresponding scaling factor.

20. The method as set forth in claim 19 , wherein the corresponding scaling factor is one of a set of scaling factors, the set of scaling factors defined by means of a one dimensional function.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 7, 2024
From: STMICROELECTRONICS (CANADA), INC.
To: STMICROELECTRONICS INTERNATIONAL N.V.
Reel/Frame 068814/0748 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 23, 2012
From: CORRAL-SOTO, EDUARDO R.
To: STMICROELECTRONICS (CANADA), INC.
Reel/Frame 028837/0754 →
Continuity (1)
Related Publication 20140055446A1 · Feb 27, 2014