IP Library Granted Patent US 12,206,997
Granted Patent B2
US 12,206,997 · App. 18/154,305 · Granted Jan 21, 2025

Generation of enhanced panoramic visual content

Inventor: Guillaume Matthieu Guerin (Renens, CH)
Assignee: GoPro, Inc.
H04N23/741G06T3/12G06T3/4038H04N23/698H04N23/73
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,206,997
App. No.
18/154,305
Granted
Jan 21, 2025
Kind
B2
Abstract

An image capture device may capture two hemispherical views of a scene. The two hemispherical view of the scene may be stitched along a stitch line. The image capture device may be rotated to align the stitch line with a mid-line of a panoramic field of view of the scene. Separate exposure settings may be used to capture the two hemispherical views of the scene, with the exposure settings increasing the dynamic range of the scene depicted within the panoramic field of view of the scene. The panoramic field of view of the scene may be punched out as panoramic visual content.

Claims (40)

1. A system for generating enhanced panoramic visual content, the system comprising:

one or more physical processors configured by machine-readable instructions to:

determine a first exposure setting to capture first visual content using a first image sensor of an image capture device based on light that becomes incident on the first image sensor via a first optical element, the first exposure setting determined based on a first luminance of a scene included within a first field of view of the first optical element, the first field of view being greater than 180 degrees;

determine a second exposure setting to capture second visual content using a second image sensor of the image capture device based on light that becomes incident on the second image sensor via a second optical element, the second exposure setting determined based on a second luminance of the scene included within a second field of view of the second optical element, the second field of view being greater than 180 degrees, a peripheral portion of the first field of view and a peripheral portion of the second field of view having an overlap, a stitch line for stitching of the first visual content and the second visual content positioned within the overlap, the first exposure setting being different from the second exposure setting based on the first luminance of the scene being different from the second luminance of the scene;

apply the first exposure setting to the first image sensor to capture the first visual content;

apply the second exposure setting to the second image sensor to capture the second visual content; and

generate panoramic visual content based on stitching and cropping of the first visual content and the second visual content, the panoramic visual content having a panoramic field of view, wherein the panoramic visual content includes the enhanced panoramic visual content based on capture of the first visual content and the second visual content with the image capture device rotated into an enhanced panoramic rotational position.

2. The system of claim 1 , wherein the enhanced panoramic rotational position of the image capture device causes alignment of the stitch line with a mid-line of the panoramic field of view of the scene.

3. The system of claim 2 , wherein the mid-line of the panoramic field of view of the scene divides the scene into a bright scene portion and a dark scene portion.

4. The system of claim 2 , wherein the mid-line of the panoramic field of view includes a vertical mid-line of the panoramic field of view, a horizontal mid-line of the panoramic field of view, or a slanted mid-line of the panoramic field of view.

5. The system of claim 2 , wherein the alignment of the stitch line with the mid-line of the panoramic field of view of the scene includes the stich line running along the mid-line, the stitch line running parallel to the mid-line, or the stitch line being within a threshold distance from the mid-line.

6. The system of claim 2 , wherein the alignment of the stitch line with the mid-line of the panoramic field of view of the scene includes an angular deviation of the stitch line from the mid-line being within a threshold angle.

7. The system of claim 1 , wherein the first exposure setting and the second exposure setting are determined to increase dynamic range of the scene depicted within the panoramic visual content.

8. The system of claim 1 , further comprising a display, the display presenting at least a portion of the panoramic field of view of the scene as a preview of the panoramic visual content, the preview including a visual indicator representing the stitch line.

9. The system of claim 1 , further comprising a display, the display presenting a difference between the first exposure setting and the second exposure setting or a difference between the first luminance of the scene and the second luminance of the scene.

10. A method for generating enhanced panoramic visual content, the method performed by a system including one or more processors, the method comprising:

determining, by the system, a first exposure setting to capture first visual content using a first image sensor of an image capture device based on light that becomes incident on the first image sensor via a first optical element, the first exposure setting determined based on a first luminance of a scene included within a first field of view of the first optical element, the first field of view being greater than 180 degrees;

determining, by the system, a second exposure setting to capture second visual content using a second image sensor of the image capture device based on light that becomes incident on the second image sensor via a second optical element, the second exposure setting determined based on a second luminance of the scene included within a second field of view of the second optical element, the second field of view being greater than 180 degrees, a peripheral portion of the first field of view and a peripheral portion of the second field of view having an overlap, a stitch line for stitching of the first visual content and the second visual content positioned within the overlap, the first exposure setting being different from the second exposure setting based on the first luminance of the scene being different from the second luminance of the scene;

applying, by the system, the first exposure setting to the first image sensor to capture the first visual content;

applying, by the system, the second exposure setting to the second image sensor to capture the second visual content; and

generating, by the system, panoramic visual content based on stitching and cropping of the first visual content and the second visual content, the panoramic visual content having a panoramic field of view, wherein the panoramic visual content includes the enhanced panoramic visual content based on capture of the first visual content and the second visual content with the image capture device rotated into an enhanced panoramic rotational position.

11. The method of claim 10 , wherein the enhanced panoramic rotational position of the image capture device causes alignment of the stitch line with a mid-line of the panoramic field of view of the scene.

12. The method of claim 11 , wherein the mid-line of the panoramic field of view of the scene divides the scene into a bright scene portion and a dark scene portion.

13. The method of claim 11 , wherein the mid-line of the panoramic field of view includes a vertical mid-line of the panoramic field of view, a horizontal mid-line of the panoramic field of view, or a slanted mid-line of the panoramic field of view.

14. The method of claim 11 , wherein the alignment of the stitch line with the mid-line of the panoramic field of view of the scene includes the stich line running along the mid-line, the stitch line running parallel to the mid-line, or the stitch line being within a threshold distance from the mid-line.

15. The method of claim 11 , wherein the alignment of the stitch line with the mid-line of the panoramic field of view of the scene includes an angular deviation of the stitch line from the mid-line being within a threshold angle.

16. The method of claim 10 , wherein the first exposure setting and the second exposure setting are determined to increase dynamic range of the scene depicted within the panoramic visual content.

17. The method of claim 10 , wherein at least a portion of the panoramic field of view of the scene is presented on a display as a preview of the panoramic visual content, the preview including a visual indicator representing the stitch line.

18. The method of claim 10 , wherein a difference between the first exposure setting and the second exposure setting or a difference between the first luminance of the scene and the second luminance of the scene is presented on a display.

19. A system for generating enhanced panoramic visual content, the system comprising:

one or more physical processors configured by machine-readable instructions to:

determine a first exposure setting to capture first visual content using a first image sensor of an image capture device based on light that becomes incident on the first image sensor via a first optical element, the first exposure setting determined based on a first luminance of a scene included within a first field of view of the first optical element, the first field of view being greater than 180 degrees;

determine a second exposure setting to capture second visual content using a second image sensor of the image capture device based on light that becomes incident on the second image sensor via a second optical element, the second exposure setting determined based on a second luminance of the scene included within a second field of view of the second optical element, the second field of view being greater than 180 degrees, a peripheral portion of the first field of view and a peripheral portion of the second field of view having an overlap, a stitch line for stitching of the first visual content and the second visual content positioned within the overlap, the first exposure setting being different from the second exposure setting based on the first luminance of the scene being different from the second luminance of the scene, wherein the first exposure setting and the second exposure setting are determined to increase dynamic range of the scene depicted within panoramic visual content;

apply the first exposure setting to the first image sensor to capture the first visual content;

apply the second exposure setting to the second image sensor to capture the second visual content; and

generate the panoramic visual content based on stitching and cropping of the first visual content and the second visual content, the panoramic visual content having a panoramic field of view, wherein the panoramic visual content includes the enhanced panoramic visual content based on capture of the first visual content and the second visual content with the image capture device rotated into an enhanced panoramic rotational position, wherein the enhanced panoramic rotational position of the image capture device causes alignment of the stitch line with a mid-line of the panoramic field of view of the scene.

20. The system of claim 19 , further comprising a display, the display presenting:

at least a portion of the panoramic field of view of the scene as a preview of the panoramic visual content, the preview including a visual indicator representing the stitch line;

a difference between the first exposure setting and the second exposure setting; or

a difference between the first luminance of the scene and the second luminance of the scene.

Assignments (3)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2023
From: GUERIN, GUILLAUME MATTHIEU
To: GOPRO, INC.
Reel/Frame 062371/0262 →
Continuity (3)
Continuation 17239589 · Apr 24, 2021
Continuation 16791850 · Feb 14, 2020
Related Publication 20230164449A1 · May 25, 2023
References Cited (39)
US 10194097B2 · Abbas · 2019 [cited by applicant]
US 10462466B2 · Abbas · 2019 [cited by examiner]
US 10469744B2 · Yim · 2019 [cited by applicant]
US 10587855B1 · Chinnaiyan · 2020 [cited by examiner]
US 10614553B1 · Wang · 2020 [cited by applicant]
US 10643303B1 · Cotoros · 2020 [cited by examiner]
US 10848731B2 · Simek · 2020 [cited by examiner]
US 10887570B2 · Chinnaiyan · 2021 [cited by examiner]
US 10893218B1 · Douady · 2021 [cited by examiner]
US 10917565B1 · Gilmour · 2021 [cited by examiner]
US 10999527B1 · Guérin · 2021 [cited by examiner]
US 11323603B2 · Guérin · 2022 [cited by examiner]
US 11388332B2 · Watanabe · 2022 [cited by examiner]
US 11393070B2 · Kawaguchi · 2022 [cited by examiner]
US 11558557B2 · Guérin · 2023 [cited by applicant]
US 20120206565A1 · Villmer · 2012 [cited by applicant]
US 20180144520A1 · Forutanpour · 2018 [cited by applicant]
US 20180276800A1 · Abbas · 2018 [cited by examiner]
US 20180374192A1 · Kunkel · 2018 [cited by applicant]
US 20190014350A1 · Wang · 2019 [cited by applicant]
US 20190347863A1 · Sanguinetti · 2019 [cited by examiner]
US 20200128280A1 · Han · 2020 [cited by applicant]
US 20200204778A1 · Chinnaiyan · 2020 [cited by examiner]
US 20200219300A1 · Ishikawa · 2020 [cited by applicant]
US 20200273149A1 · Qin · 2020 [cited by examiner]
US 20200304751A1 · Katoh · 2020 [cited by applicant]
US 20200358944A1 · Douady · 2020 [cited by examiner]
US 20200366842A1 · Oulès · 2020 [cited by examiner]
US 20210084205A1 · Guérin · 2021 [cited by examiner]
US 20210144293A1 · Shibagami · 2021 [cited by examiner]
US 20210233209A1 · Yoshida · 2021 [cited by examiner]
US 20210258468A1 · Guérin · 2021 [cited by applicant]
US 20220006949A1 · Watanabe · 2022 [cited by examiner]
US 20220078328A1 · Kazama · 2022 [cited by examiner]
US 20220198605A1 · Pitts · 2022 [cited by examiner]
US 20220224831A1 · Yoshida · 2022 [cited by examiner]
JP 6541327B2 · 2019 [cited by applicant]
Aggarwal et al.; “High Dynamic Range Panoramic Imaging”; Jan. 2001; Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 (vol. 1, pp. 2-9 vol. 1) (Year: 2001). [cited by applicant]
Jusof et al.; “Revealing visual details via high dynamic range gigapixels spherical panorama photography: The Tempurung Cave natural heritage site”; Dec. 2014; 2014 International Conference on Virtual Systems & Multimed… [cited by applicant]