IP Library Granted Patent US 9,191,649
Granted Patent B2
US 9,191,649 · App. 13/208,838 · Granted Nov 17, 2015

Systems and methods to capture a stereoscopic image pair

Inventors: Szepo Robert Hung (Carlsbad, CA); Ruben M. Velarde (Chula Vista, CA); Thomas Wesley Osborne (San Diego, CA); Liang Liang (San Diego, CA)
Assignee: QUALCOMM Incorporated
H04N13/0221G06T7/0075H04N13/0022H04N13/0271H04N13/0296G06T2207/20068
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,191,649
App. No.
13/208,838
Granted
Nov 17, 2015
Kind
B2
Abstract

Described are a system, apparatus, and method to capture a stereoscopic image pair using an imaging device with a single imaging sensor. Particularly, discussed are systems and methods for capturing a first and second image through an image sensor, determining a vertical and horizontal disparity between the two images, and applying corrections for geometric distortion, vertical disparity, and convergence between the two images. Some embodiments contemplate displaying a directional indicator before the second image of the stereoscopic image pair is captured. By displaying a directional indicator, a more optimal position for the second image of the stereoscopic image pair may be found, resulting in a higher quality stereoscopic image pair.

Claims (101)

1. A method of capturing a stereoscopic image, comprising:

capturing a first image through an imaging sensor;

displaying a horizontal displacement of the first image relative to a live preview image from the imaging sensor, by displaying an upper half of the first image on an upper half of an electronic display, while simultaneously displaying a lower half of a live preview image captured from the same imaging sensor on a lower half of the electronic display;

displaying, simultaneous with the display of the upper half of the first image, a line between the bottom of the upper half of the first image and the top of the lower half of the preview image;

displaying a directional indicator on the electronic display wherein the directional indicator indicates a direction to move the imaging sensor;

capturing a second image through the imaging sensor; and

generating a stereoscopic image based on the first image and the second image.

2. The method of claim 1 , further comprising displaying a first indication on the electronic display of the horizontal shift required to capture a high quality image.

3. The method of claim 2 , wherein the first indication is a gridline or a ruler.

4. The method of claim 1 , further comprising displaying a dynamically estimated quality indicator.

5. The method of claim 2 , wherein the first indications' color is based on the horizontal disparity between the first image and a preview image.

6. An imaging device configured to capture stereoscopic images, comprising:

an imaging sensor;

an electronic display;

a processor, configured to control the imaging sensor and the electronic display and

a control module configured to

capture a first image using the imaging sensor,

display a horizontal displacement of the first image relative to a live preview image from the imaging sensor, by displaying an upper half of the first image on an upper half of an electronic display, displaying, simultaneous with the display of the upper half of the first image, a lower half of a live preview image captured from the same imaging sensor on a lower half of the electronic display, and

display, simultaneous with the display of the upper half of the first image, a line between the bottom of the upper half of the first image and the top of the lower half of the preview image;

display a directional indicator on the electronic display, wherein the directional indicator indicates a direction to move the imaging sensor,

capture a second image using the imaging sensor, and

generate a stereoscopic image based on the first image and the second image.

7. The imaging device of claim 6 , wherein the control module is further configured to determine a horizontal disparity between the first image and the second image, and the display of the directional indicator is based on the determined horizontal disparity.

8. The imaging device of claim 6 , further comprising an accelerometer, wherein the display of the directional indicator is based on input from the accelerometer.

9. A non-transitory computer-readable medium containing processor executable first instructions that when executed perform a method comprising:

capturing a first image using an imaging sensor;

displaying a horizontal displacement of the first image relative to a live preview image from the imaging sensor, by displaying an upper half of the first image on an upper half of an electronic display, while simultaneously displaying a lower half of a live preview image captured from the same imaging sensor on a lower half of the electronic display;

displaying, simultaneous with the display of the upper half of the first image, a line between the bottom of the upper half of the first image and the top of the lower half of the preview image;

displaying a directional indicator that indicates a direction to move the imaging sensor;

capturing a second image using the imaging sensor; and

generating a stereoscopic image based on the first image and the second image.

10. An imaging device comprising:

means for capturing a first image through an imaging sensor;

means for displaying a horizontal displacement of the first image relative to a live preview image from the imaging sensor, comprising:

means for displaying an upper half of the first image on an upper half of an electronic display,

means for displaying a lower half of a live preview image from the imaging sensor on a lower half of the electronic display simultaneous with the display of the upper half of the first image, and

means for displaying a line between the bottom of the upper half of the first image and the top of the lower half of the preview image simultaneous with the display of the upper half of the first image;

means for displaying a directional indicator that indicates a direction to move the imaging sensor;

means for capturing a second image through the imaging sensor; and

means for generating a stereoscopic image based on the first image and the second image.

11. The imaging device of claim 6 , wherein the control module is configured to display the directional indicator as an arrow, and wherein the arrow may change color to indicate a stereoscopic quality achieved if the second image is captured at the current imaging device position.

12. The imaging device of claim 6 , wherein the control module is configured to display the directional indicator as an arrow, and wherein a length of the arrow is based on an amount of imaging sensor displacement needed to achieve an optimal horizontal disparity.

13. The imaging device of claim 6 , wherein the control module is configured to transition the directional indicator from an arrow to another symbol when horizontal disparity between the first image and the preview image reaches an optimal position.

14. The imaging device of claim 6 , wherein the control module is configured to display the directional indicator as a gridline, wherein the gridline indicates a maximum amount of horizontal shift between the first image and the preview image.

15. The computer readable medium of claim 9 , wherein the directional indicator is an arrow, and wherein the method further comprising changing a color of the arrow to indicate a stereoscopic quality achieved if the second image is captured at the current imaging device position.

16. The computer readable medium of claim 9 , wherein the directional indicator is an arrow, and wherein a length of the arrow is based on an amount of imaging sensor displacement needed to achieve an optimal horizontal disparity.

17. The computer readable medium of claim 9 , further comprising transitioning the directional indicator from an arrow to another symbol when horizontal disparity between the first image and the preview image reaches an optimal position.

18. The computer readable medium of claim 9 , wherein the directional indicator is a gridline, and wherein the gridline indicates a maximum amount of horizontal shift between the first image and the preview image.

19. The imaging device of claim 10 , wherein the means for displaying a directional indicator is configured to display the directional indicator as an arrow, and wherein the arrow may change color to indicate a stereoscopic quality achieved if the second image is captured at the current imaging device position.

20. The imaging device of claim 10 , wherein the means for displaying a directional indicator is configured to display the directional indicator as an arrow, and wherein a length of the arrow is based on an amount of imaging sensor displacement needed to achieve an optimal horizontal disparity.

21. The imaging device of claim 10 , wherein the means for displaying a directional indicator is configured to transition the directional indicator from an arrow to another symbol when horizontal disparity between the first image and the preview image reaches an optimal position.

22. The imaging device of claim 10 , wherein the means for displaying a directional indicator is configured to display the directional indicator as a gridline, wherein the gridline indicates a maximum amount of horizontal shift between the first image and the preview image.

23. A method of capturing a stereoscopic image, comprising:

capturing a first image through an imaging sensor;

displaying a horizontal displacement of the first image relative to a live preview image from the imaging sensor, by displaying an upper half of a live preview image captured from the same imaging sensor on an upper half of an electronic display, while simultaneously displaying a lower half of the first image on a lower half of the electronic display,

displaying, simultaneous with the display of the upper half, a line between the bottom of the upper half of the preview image and the top of the lower half of the first image;

displaying a directional indicator on the electronic display wherein the directional indicator indicates a direction to move the imaging sensor;

capturing a second image through the imaging sensor; and

generating a stereoscopic image based on the first image and the second image.

24. The method of claim 23 , further comprising displaying a first indication on the electronic display of the horizontal shift required to capture a high quality image.

25. The method of claim 24 , wherein the first indication is a gridline or a ruler.

26. The method of claim 24 , further comprising displaying a dynamically estimated quality indicator.

27. The method of claim 24 , wherein the first indications' color is based on the horizontal disparity between the first image and a preview image.

28. An imaging device configured to capture stereoscopic images, comprising:

an imaging sensor;

an electronic display;

a processor, configured to control the imaging sensor and the electronic display and

a control module configured to

capture a first image using the imaging sensor,

display a horizontal displacement of the first image relative to a live preview image from the imaging sensor, by displaying an upper half of a live preview image captured by the same imaging sensor on an upper half of an electronic display, displaying, simultaneous with the display of the upper half of the live preview image, a lower half of the first image on a lower half of the electronic display, and

display, simultaneous with the display of the upper half of the live preview image, a line between the bottom of the upper half of the preview image and the top of the lower half of the first image;

display a directional indicator on the electronic display, wherein the directional indicator indicates a direction to move the imaging sensor,

capture a second image using the imaging sensor, and

generate a stereoscopic image based on the first image and the second image.

29. The imaging device of claim 28 , wherein the control module is further configured to determine a horizontal disparity between the first image and the second image, and the display of the directional indicator is based on the determined horizontal disparity.

30. The imaging device of claim 28 , further comprising an accelerometer, wherein the display of the directional indicator is based on input from the accelerometer.

31. The imaging device of claim 28 , wherein the control module is configured to display the directional indicator as an arrow, and wherein the arrow may change color to indicate a stereoscopic quality achieved if the second image is captured at the current imaging device position.

32. The imaging device of claim 28 , wherein the control module is configured to transition the directional indicator from an arrow to another symbol when horizontal disparity between the first image and the preview image reaches an optimal position.

33. The imaging device of claim 28 , wherein the control module is configured to display the directional indicator as a gridline, wherein the gridline indicates a maximum amount of horizontal shift between the first image and the preview image.

34. An imaging device comprising:

means for capturing a first image through an imaging sensor;

means for displaying a horizontal displacement of the first image relative to a live preview image from the imaging sensor, comprising:

means for displaying an upper half of a live preview image captured with the same imaging sensor on an upper half of an electronic display;

means for displaying a lower half of the first image from the imaging sensor on a lower half of the electronic display simultaneous with the display of the upper half of the live preview image; and

means for displaying a line between the bottom of the upper half of the preview image and the top of the lower half of the first image simultaneous with the display of the upper half of the first image;

means for displaying a directional indicator that indicates a direction to move the imaging sensor;

means for capturing a second image through the imaging sensor; and

means for generating a stereoscopic image based on the first image and the second image.

35. A non-transitory computer-readable medium containing processor executable first instructions that when executed perform a method comprising:

capturing a first image using an imaging sensor;

displaying a horizontal displacement of the first image relative to a live preview image from the imaging sensor, by displaying an upper half of a live preview image captured by the same imaging sensor on an upper half of an electronic display, while simultaneously displaying a lower half of the first image on a lower half of the electronic display;

displaying, simultaneous with the display of the upper half, a line between the bottom of the upper half of the preview image and the top of the lower half of the first image;

displaying a directional indicator that indicates a direction to move the imaging sensor;

capturing a second image using the imaging sensor; and

generating a stereoscopic image based on the first image and the second image.

36. The computer readable medium of claim 35 , further comprising displaying the directional indicator as an arrow.

37. The computer readable medium of claim 35 , further comprising changing a color of the arrow to indicate a stereoscopic quality achieved if the second image is captured at the current imaging device position.

38. The computer readable medium of claim 36 , further comprising displaying the arrow with a length based on an amount of imaging sensor displacement needed to achieve an optimal horizontal disparity.

39. The computer readable medium of claim 36 , the method further comprising transitioning the directional indicator from an arrow to another symbol when horizontal disparity between the first image and the preview image reaches an optimal position.

40. The computer readable medium of claim 35 , wherein the directional indicator is a gridline, and wherein the gridline indicates a maximum amount of horizontal shift between the first image and the preview image.

41. The method of claim 1 , further comprising displaying the upper and lower halves non-transparently.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE NAME OF SECOND ASSIGNOR PREVIOUSLY RECORDED ON REEL 026747, FRAME 0567. Recorded Oct 12, 2011
From: HUNG, SZEPO ROBERT; VELARDE, RUBEN M.; OSBORNE, THOMAS WESLEY; LIANG, LIANG
To: QUALCOMM INCORPORATED
Reel/Frame 027065/0760 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 12, 2011
From: HUNG, SZEPO ROBERT; VELARDE, ROBERT M.; OSBORNE, THOMAS WESLEY; LIANG, LIANG
To: QUALCOMM INCORPORATED
Reel/Frame 026747/0567 →
Continuity (1)
Related Publication 20130038701A1 · Feb 14, 2013