IP Library Granted Patent US 11,558,557
Granted Patent B2
US 11,558,557 · App. 17/239,589 · Granted Jan 17, 2023

Generation of enhanced panoramic visual content

Inventor: Guillaume Matthieu Guérin (Chatillon, FR)
Assignee: GoPro, Inc.
H04N5/2355G06T3/0062G06T3/4038H04N5/2353H04N5/23238
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,558,557
App. No.
17/239,589
Granted
Jan 17, 2023
Kind
B2
Abstract

An image capture device may capture two hemispherical views of a scene. The two hemispherical view of the scene may be stitched along a stitch line. The image capture device may be rotated to align the stitch line with a mid-line of a panoramic field of view of the scene. Separate exposure settings may be used to capture the two hemispherical views of the scene, with the exposure settings increasing the dynamic range of the scene depicted within the panoramic field of view of the scene. The panoramic field of view of the scene may be punched out as panoramic visual content.

Claims (56)

1. An image capture device for generating enhanced panoramic visual content, the image capture device comprising:

a housing;

a first image sensor carried by the housing and configured to generate a first visual output signal conveying first visual information based on light that becomes incident thereon, the first visual information defining first visual content;

a second image sensor carried by the housing and configured to generate a second visual output signal conveying second visual information based on light that becomes incident thereon, the second visual information defining second visual content;

a first optical element carried by the housing and configured to guide light within a first field of view to the first image sensor, the first field of view being greater than 180 degrees;

a second optical element carried by the housing and configured to guide light within a second field of view to the second image sensor, the second field of view being greater than 180 degrees, wherein:

the first optical element and the second optical element are carried by the housing such that a peripheral portion of the first field of view and a peripheral portion of the second field of view overlap;

the overlap of the peripheral portion of the first field of view and the peripheral portion of the second field of view enables spherical capture of visual content based on stitching of the first visual content and the second visual content; and

a stitch line for stitching of the first visual content and the second visual content is positioned within the overlap; and

one or more physical processors carried by the housing, the one or more physical processors configured by machine-readable instructions to:

determine a first exposure setting to capture the first visual content, the first exposure setting determined based on a first luminance of a scene included within the first field of view;

determine a second exposure setting to capture the second visual content, the second exposure setting determined based on a second luminance of the scene included within the second field of view, the first exposure setting being different from the second exposure setting based on the first luminance of the scene being different from the second luminance of the scene;

capture the first visual content by applying the first exposure setting to the first image sensor;

capture the second visual content by applying the second exposure setting to the second image sensor; and

generate panoramic visual content based on stitching and cropping of the first visual content and the second visual content, the panoramic visual content having a panoramic field of view, wherein the panoramic visual content includes the enhanced panoramic visual content based on capture of the first visual content and the second visual content with the housing rotated into an enhanced panoramic rotational position.

2. The image capture device of claim 1 , wherein the enhanced panoramic rotational position of the housing causes alignment of the stitch line with a mid-line of the panoramic field of view of the scene.

3. The image capture device of claim 2 , wherein the mid-line of the panoramic field of view of the scene divides the scene into a bright scene portion and a dark scene portion.

4. The image capture device of claim 2 , wherein the mid-line of the panoramic field of view includes a vertical mid-line of the panoramic field of view.

5. The image capture device of claim 2 , wherein the mid-line of the panoramic field of view includes a horizontal mid-line of the panoramic field of view.

6. The image capture device of claim 2 , wherein the mid-line of the panoramic field of view includes a slanted mid-line of the panoramic field of view.

7. The image capture device of claim 1 , wherein the first exposure setting and the second exposure setting are determined to increase dynamic range of the scene depicted within the panoramic visual content.

8. The image capture device of claim 1 , further comprising a display carried by the housing, the display presenting at least a portion of the panoramic field of view of the scene as a preview of the panoramic visual content, the preview including a visual indicator representing the stitch line.

9. The image capture device of claim 1 , further comprising a display carried by the housing, the display presenting a difference between the first exposure setting and the second exposure setting or a difference between the first luminance of the scene and the second luminance of the scene.

10. A method for generating enhanced panoramic visual content, the method performed by an image capture device including one or more processors, a first image sensor, a second image sensor, a first optical element, and a second optical element, the first image sensor configured to generate a first visual output signal conveying first visual information based on light that becomes incident thereon, the first visual information defining first visual content, the second image sensor configured to generate a second visual output signal conveying second visual information based on light that becomes incident thereon, the second visual information defining second visual content, the first optical element configured to guide light within a first field of view to the first image sensor, and the second optical element configured to guide light within a second field of view to the second image sensor, an overlap of a peripheral portion of the first field of view and a peripheral portion of the second field of view overlap enabling spherical capture of visual content based on stitching of the first visual content and the second visual content, a stitch line for stitching of the first visual content and the second visual content positioned within the overlap, the method comprising:

determining, by the image capture device, a first exposure setting to capture the first visual content, the first exposure setting determined based on a first luminance of a scene included within the first field of view;

determining, by the image capture device, a second exposure setting to capture the second visual content, the second exposure setting determined based on a second luminance of the scene included within the second field of view, the first exposure setting being different from the second exposure setting based on the first luminance of the scene being different from the second luminance of the scene;

capturing, by the image capture device, the first visual content by applying the first exposure setting to the first image sensor;

capturing, by the image capture device, the second visual content by applying the second exposure setting to the second image sensor; and

generating, by the one or more processors, panoramic visual content based on stitching and cropping of the first visual content and the second visual content, the panoramic visual content having a panoramic field of view, wherein the panoramic visual content includes the enhanced panoramic visual content based on capture of the first visual content and the second visual content with the image capture device rotated into an enhanced panoramic rotational position.

11. The method of claim 10 , wherein the enhanced panoramic rotational position of the image capture device causes alignment of the stitch line with a mid-line of the panoramic field of view of the scene.

12. The method of claim 11 , wherein the mid-line of the panoramic field of view of the scene divides the scene into a bright scene portion and a dark scene portion.

13. The method of claim 11 , wherein the mid-line of the panoramic field of view includes a vertical mid-line of the panoramic field of view.

14. The method of claim 11 , wherein the mid-line of the panoramic field of view includes a horizontal mid-line of the panoramic field of view.

15. The method of claim 11 , wherein the mid-line of the panoramic field of view includes a slanted mid-line of the panoramic field of view.

16. The method of claim 10 , wherein the first exposure setting and the second exposure setting are determined to increase dynamic range of the scene depicted within the panoramic visual content.

17. The method of claim 10 , wherein at least a portion of the panoramic field of view of the scene is presented on a display as a preview of the panoramic visual content, the preview including a visual indicator representing the stitch line.

18. The method of claim 10 , wherein a difference between the first exposure setting and the second exposure setting or a difference between the first luminance of the scene and the second luminance of the scene is presented on a display.

19. An image capture device for generating enhanced panoramic visual content, the image capture device comprising:

a housing;

a first image sensor carried by the housing and configured to generate a first visual output signal conveying first visual information based on light that becomes incident thereon, the first visual information defining first visual content;

a second image sensor carried by the housing and configured to generate a second visual output signal conveying second visual information based on light that becomes incident thereon, the second visual information defining second visual content;

a first optical element carried by the housing and configured to guide light within a first field of view to the first image sensor, the first field of view being greater than 180 degrees;

a second optical element carried by the housing and configured to guide light within a second field of view to the second image sensor, the second field of view being greater than 180 degrees, wherein:

the first optical element and the second optical element are carried by the housing such that a peripheral portion of the first field of view and a peripheral portion of the second field of view overlap;

the overlap of the peripheral portion of the first field of view and the peripheral portion of the second field of view enables spherical capture of visual content based on stitching of the first visual content and the second visual content; and

a stitch line for stitching of the first visual content and the second visual content is positioned within the overlap; and

one or more physical processors carried by the housing, the one or more physical processors configured by machine-readable instructions to:

determine a first exposure setting to capture the first visual content, the first exposure setting determined based on a first luminance of a scene included within the first field of view;

determine a second exposure setting to capture the second visual content, the second exposure setting determined based on a second luminance of the scene included within the second field of view, the first exposure setting being different from the second exposure setting based on the first luminance of the scene being different from the second luminance of the scene, wherein the first exposure setting and the second exposure setting are determined to increase dynamic range of the scene depicted within panoramic visual content;

capture the first visual content by applying the first exposure setting to the first image sensor;

capture the second visual content by applying the second exposure setting to the second image sensor; and

generate the panoramic visual content based on stitching and cropping of the first visual content and the second visual content, the panoramic visual content having a panoramic field of view, wherein the panoramic visual content includes the enhanced panoramic visual content based on capture of the first visual content and the second visual content with the housing rotated into an enhanced panoramic rotational position, wherein the enhanced panoramic rotational position of the housing causes alignment of the stitch line with a mid-line of the panoramic field of view of the scene.

20. The image capture device of claim 19 , further comprising a display carried by the housing, the display presenting:

at least a portion of the panoramic field of view of the scene as a preview of the panoramic visual content, the preview including a visual indicator representing the stitch line;

a difference between the first exposure setting and the second exposure setting; or

a difference between the first luminance of the scene and the second luminance of the scene.

Assignments (3)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 25, 2021
From: GUERIN, GUILLAUME MATTHIEU
To: GOPRO, INC.
Reel/Frame 056030/0528 →
Continuity (2)
Continuation 16971850 · Feb 14, 2020
Related Publication 20210258468A1 · Aug 19, 2021
Cited By (1)
US 12,206,997