IP Library Granted Patent US 9,723,289
Granted Patent B2
US 9,723,289 · App. 14/671,953 · Granted Aug 1, 2017

Dynamic adjustment of predetermined three-dimensional video settings based on scene content

Inventors: Barry M. Genova (Kenmore, WA); Michael Gutmann (Duvall, WA)
Assignee: Sony Interactive Entertainment America LLC
H04N13/0018H04N13/0011H04N13/0022H04N13/0029H04N13/0278H04N13/0296
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,723,289
App. No.
14/671,953
Granted
Aug 1, 2017
Kind
B2
Abstract

Predetermined three-dimensional video parameter settings may be dynamically adjusted based on scene content. One or more three-dimensional characteristics associated with a given scene may be determined. One or more scale factors may be determined from the three-dimensional characteristics. The predetermined three-dimensional video parameter settings can be adjusted by applying the scale factors to the predetermined three-dimensional video parameter settings. The scene may be displayed on a three-dimensional display using the resulting adjusted set of predetermined three-dimensional video parameters.

Claims (37)

1. A method for dynamic adjustment of a set of predetermined three-dimensional stereo video parameter settings, comprising:

a) determining one or more scale factors from one or more three-dimensional depth characteristics of a particular scene content depicted within a given scene selected from a plurality of scenes in which the three-dimensional depth characteristics for different scenes of the plurality varies according to the scene content, wherein the one or more three dimensional characteristics include a rate of change of a three-dimensional depth characteristic of the one or more three-dimensional depth characteristics of the particular scene content;

b) adjusting the set of predetermined three-dimensional stereo video parameter settings for the given scene by applying the one or more scale factors to the predetermined three-dimensional stereo video parameter settings thereby producing an adjusted set of predetermined three-dimensional stereo video parameters, wherein applying the one or more scale factors includes applying a default scale factor if the rate of change of the three-dimensional characteristic of the one or more three-dimensional depth characteristics of the particular scene content exceeds a threshold; and

c) filtering out one or more negligible pixels associated with a given scene by analyzing pixel depth values for the given scene and tagging one or more pixels as unimportant based on their pixel depth values;

d) displaying the given scene on a three-dimensional stereo display using the adjusted set of predetermined three-dimensional stereo video parameters.

2. The method of claim 1 , wherein the one or more three-dimensional characteristics include a near plane and a far plane of the given scene.

3. The method of claim 1 , wherein the one or more three-dimensional characteristics include an average depth value for the given scene.

4. The method of claim 2 , wherein the near plane is determined by subtracting a scene pixel depth standard deviation from a scene pixel depth mean.

5. The method of claim 2 , wherein the far plane is determined by adding a scene pixel depth standard deviation to a scene pixel depth mean.

6. The method of claim 2 , wherein b) includes adjusting a shift amount (for convergence) for each pixel in an image of the scene according to a corresponding one of the one or more scale factors.

7. The method of claim 1 , further comprising weighting each pixel associated with a given scene.

8. The method of claim 1 , further comprising determining one or more targets associated with a given scene.

9. The method of claim 1 , wherein c) includes determining a rate factor to control a rate at which the predetermined three-dimensional video parameters are adjusted.

10. The method of claim 1 , wherein the one or more scale factors are transmitted as metadata associated with the given scene in a stream of one or more scenes.

11. The method of claim 1 , further comprising determining the rate of change of the three-dimensional characteristic.

12. The method of claim 1 , wherein the set of predetermined three-dimensional scene settings includes a boundary of three-dimensional projection.

13. The method of claim 1 , further comprising determining a rate at which the three-dimensional characteristics change and wherein b) includes applying a default scale factor if the rate exceeds a threshold.

14. The method of claim 1 , wherein the predetermined three-dimensional video settings include stereopsis, convergence, or shadow stereopsis, inter-camera spacing, convergence distance, toe-in angle, or focal length.

15. The method of claim 1 , wherein b) includes providing signals for adjusting one or more parameters of a virtual camera used to generate one or more views of the scene.

16. The method of claim 1 , wherein b) includes providing signals for adjusting one or more parameters of a physical camera used to generate the one or more views of the scene.

17. An apparatus for dynamic adjustment of three-dimensional settings, comprising:

a processor;

a memory; and

computer coded instructions embodied in the memory and executable by the processor, wherein the computer coded instructions are configured to implement a method for dynamic adjustment of a set of user-determined three-dimensional scene settings, the method comprising:

a) determining one or more scale factors from one or more three-dimensional depth characteristics of particular scene content depicted within a given scene selected from a plurality of scenes in which the three-dimensional depth characteristics for different scenes of the plurality varies according to the scene content, wherein the one or more three dimensional characteristics include a rate of change of a three-dimensional depth characteristic of the one or more three-dimensional depth characteristics of a particular scene content;

b) adjusting the set of predetermined three-dimensional video parameter settings for the given scene by applying the one or more scale factors to the predetermined three-dimensional video parameter settings thereby producing an adjusted set of predetermined three-dimensional video parameters, wherein applying the one or more scale factors includes applying a default scale factor if the rate of change of the three-dimensional depth characteristic of the one or more three-dimensional depth characteristics of a particular scene content change exceeds a threshold; and

c) filtering out one or more negligible pixels associated with a given scene by analyzing pixel depth values for the given scene and tagging one or more pixels as unimportant based on their pixel depth values;

d) displaying the given scene on a three-dimensional display using the adjusted set of predetermined three-dimensional video parameters.

18. The apparatus of claim 17 , further comprising a three-dimensional visual display configured to display the given scene according to the adjusted user-determined three-dimensional settings.

19. The apparatus of claim 17 , wherein b) includes providing signals configured to adjust one or more parameters of a virtual camera used to generate one or more views of the scene.

20. The apparatus of claim 17 , wherein b) includes providing signals configured to adjust one or more parameters of a physical camera used to generate the one or more views of the scene.

21. A computer program product comprising:

a non-transitory, computer-readable storage medium having computer readable program code embodied in said medium for dynamic adjustment of a set of predetermined three-dimensional stereo video parameter settings, said computer program product having:

a) computer readable program code configured to determine one or more scale factors from one or more three-dimensional depth characteristics of a particular scene content depicted within a given scene selected from a plurality of scenes in which the three-dimensional depth characteristics for different scenes of the plurality varies according to the scene content, when executed, wherein the one or more three dimensional characteristics include a rate of change of a three-dimensional depth characteristic of the one or more three-dimensional depth characteristics of a particular scene content;

b) computer readable program code configured to adjust the set of predetermined three-dimensional stereo video parameter settings for the given scene by applying the one or more scale factors to the predetermined three-dimensional stereo video parameter settings thereby producing an adjusted set of predetermined three-dimensional stereo video parameters, when executed, wherein applying the one or more scale factors includes applying a default scale factor if the rate of change of the three-dimensional depth characteristic of the one or more three-dimensional depth characteristics of a particular scene content exceeds a threshold; and

c) filtering out one or more negligible pixels associated with a given scene by analyzing pixel depth values for the given scene and tagging one or more pixels as unimportant based on their pixel depth values;

d) computer readable program code means for displaying the given scene on a three-dimensional stereo display using the adjusted set of predetermined three-dimensional stereo video parameters, when executed.

Assignments (3)
MERGER Recorded Mar 30, 2020
From: SONY INTERACTIVE ENTERTAINMENT AMERICA LLC
To: SONY INTERACTIVE ENTERTAINMENT LLC
Reel/Frame 053323/0567 →
CHANGE OF NAME Recorded May 5, 2016
From: SONY COMPUTER ENTERTAINMENT AMERICA LLC
To: SONY INTERACTIVE ENTERTAINMENT AMERICA LLC
Reel/Frame 038626/0637 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2015
From: GENOVA, BARRY M; GUTMANN, MICHAEL
To: SONY COMPUTER ENTERTAINMENT AMERICA LLC
Reel/Frame 035524/0103 →
Continuity (2)
Continuation 12986814 · Jan 7, 2011
Related Publication 20150208055A1 · Jul 23, 2015