Granted Patent B2

US 12,423,936 · App. 17/941,115 · Granted Sep 23, 2025

Inventors: Yoël Taïeb (Paris, FR); Thomas Crozier (Vanves, FR)

Assignee: GoPro, Inc.

G06V10/141G06T5/94G06V10/60G06T2207/10016G06T2207/10144G06T2207/10152

Abstract

Claims (106)

1. A method comprising:

obtaining target scene exposition data including a target gain value and a target exposure duration value, wherein obtaining the target scene exposition data includes:

obtaining a current scene luminance value;

obtaining a current maximum exposure duration;

obtaining a current maximum gain using the current scene luminance value, wherein obtaining the current maximum gain includes:

in response to a determination that the current scene luminance value is less than or equal to a first defined luminance threshold, using a first defined gain as the current maximum gain;

in response to a determination that the current scene luminance value is equal to or greater than a second defined luminance threshold, using a second defined gain as the current maximum gain; and

in response to a determination that the current scene luminance value is greater than the first defined luminance threshold and is less than the second defined luminance threshold, interpolating the current maximum gain between the first defined gain and the second defined gain;

obtaining a current angular speed value;

obtaining a current interpolated gain-exposure duration curve using the current angular speed value and the current maximum gain; and

obtaining the target gain value and the target exposure duration value from the current interpolated gain-exposure duration curve in accordance with the current maximum exposure duration;

obtaining a frame of a video in accordance with the target scene exposition data; and

outputting the video.

2. The method of claim 1 , wherein obtaining the current maximum exposure duration includes:

obtaining the current maximum exposure duration in accordance with a current defined frame rate defined for the video.

3. The method of claim 2 , wherein obtaining the current maximum gain includes:

determining that the current defined frame rate differs from a defined reference frame rate; and

in response to determining that the current defined frame rate differs from the defined reference frame rate:

obtaining, as a normalized first defined luminance threshold, a product of multiplying the first defined luminance threshold by a result of dividing the defined reference frame rate by the current defined frame rate;

using the normalized first defined luminance threshold as the first defined luminance threshold;

obtaining, as a normalized second defined luminance threshold, a product of multiplying the second defined luminance threshold by the result of dividing the defined reference frame rate by the current defined frame rate; and

using the normalized second defined luminance threshold as the second defined luminance threshold.

4. The method of claim 1 , wherein obtaining the target scene exposition data includes:

obtaining a product of multiplying the target gain value by the target exposure duration value as a target scene exposition value.

5. The method of claim 1 , wherein obtaining the current interpolated gain-exposure duration curve includes:

obtaining the current interpolated gain-exposure duration curve based on at least one of a first previously defined gain-exposure duration curve, a second previously defined gain-exposure duration curve, or a third previously defined gain-exposure duration curve.

6. The method of claim 5 , wherein obtaining the current interpolated gain-exposure duration curve includes:

obtaining the current interpolated gain-exposure duration curve using the current angular speed value by:

in response to a determination that the current angular speed value is less than or equal to a defined low angular speed threshold, obtaining the current interpolated gain-exposure duration curve by using the first previously defined gain-exposure duration curve as the current interpolated gain-exposure duration curve;

in response to a determination that the current angular speed value is greater than the defined low angular speed threshold and less than a defined medium angular speed threshold, obtaining the current interpolated gain-exposure duration curve by interpolating between the first previously defined gain-exposure duration curve and the second previously defined gain-exposure duration curve;

in response to a determination that the current angular speed value is equal to the defined medium angular speed threshold, obtaining the current interpolated gain-exposure duration curve by using the second previously defined gain-exposure duration curve as the current interpolated gain-exposure duration curve;

in response to a determination that the current angular speed value is greater than the defined medium angular speed threshold and less than a defined high angular speed threshold, obtaining the current interpolated gain-exposure duration curve by interpolating between the second previously defined gain-exposure duration curve and the third previously defined gain-exposure duration curve; and

in response to a determination that the current angular speed value is equal to or greater than the defined high angular speed threshold, obtaining the current interpolated gain-exposure duration curve by using the third previously defined gain-exposure duration curve as the current interpolated gain-exposure duration curve.

7. The method of claim 5 , wherein obtaining the current interpolated gain-exposure duration curve includes:

obtaining the current interpolated gain-exposure duration curve using the current maximum gain, wherein obtaining the current interpolated gain-exposure duration curve using the current maximum gain includes:

subsequent to obtaining the current interpolated gain-exposure duration curve using the current angular speed value:

generating an updated current interpolated gain-exposure duration curve using the current maximum gain as a maximum gain for the updated current interpolated gain-exposure duration curve; and

using the updated current interpolated gain-exposure duration curve as the current interpolated gain-exposure duration curve.

8. The method of claim 1 , further comprising:

obtaining, by a target exposure component of an image capture apparatus, a target exposure value for processing the frame;

obtaining, by an aggregate gain component of the image capture apparatus, a target aggregate gain value and a remaining gain value for processing the frame;

obtaining, by an auto-exposure compensation component of the image capture apparatus, an auto-exposure compensation tone curve and an auto-exposure compensation gain value for processing the frame, in accordance with the target scene exposition data;

obtaining, by a contrast control component of the image capture apparatus, a contrast control tone curve and a contrast control black point value for processing the frame;

obtaining, by a tone control driver of the image capture apparatus, a tone control tone curve and a tone control black point value for processing the frame, in accordance with the target scene exposition data;

processing the frame in accordance with the tone control tone curve and the tone control black point value to obtain a processed frame; and

including the processed frame in the video.

9. A method comprising:

obtaining, by a target exposure component of an image capture apparatus, a target gain value and a target exposure duration value by:

obtaining a current scene luminance value;

obtaining a current maximum gain using the current scene luminance value;

obtaining a current interpolated gain-exposure duration curve using the current maximum gain and a current angular speed value; and

obtaining the target gain value and the target exposure duration value from the current interpolated gain-exposure duration curve in accordance with a current maximum exposure duration;

obtaining a frame of a video in accordance with the target gain value and the target exposure duration value; and

outputting the video.

10. The method of claim 9 , wherein obtaining the current maximum gain includes:

in response to a determination that the current scene luminance value is less than or equal to a first defined luminance threshold, using a first defined gain as the current maximum gain;

in response to a determination that the current scene luminance value is equal to or greater than a second defined luminance threshold, using a second defined gain as the current maximum gain; and

in response to a determination that the current scene luminance value is greater than the first defined luminance threshold and is less than the second defined luminance threshold, interpolating the current maximum gain between the first defined gain and the second defined gain.

11. The method of claim 10 , wherein obtaining the target gain value and the target exposure duration value includes:

obtaining the current maximum exposure duration.

12. The method of claim 11 , wherein obtaining the current maximum exposure duration includes:

obtaining the current maximum exposure duration in accordance with a current defined frame rate defined for the video.

13. The method of claim 12 , wherein obtaining the current maximum gain includes:

determining that the current defined frame rate differs from a defined reference frame rate; and

in response to determining that the current defined frame rate differs from the defined reference frame rate:

obtaining, as a normalized first defined luminance threshold, a product of multiplying the first defined luminance threshold by a result of dividing the defined reference frame rate by the current defined frame rate;

using the normalized first defined luminance threshold as the first defined luminance threshold;

obtaining, as a normalized second defined luminance threshold, a product of multiplying the second defined luminance threshold by the result of dividing the defined reference frame rate by the current defined frame rate; and

using the normalized second defined luminance threshold as the second defined luminance threshold.

14. The method of claim 9 , wherein obtaining the target gain value and the target exposure duration value includes:

obtaining, as a target scene exposition value, a product of multiplying the target gain value by the target exposure duration value.

15. The method of claim 9 , wherein obtaining the current interpolated gain-exposure duration curve includes:

obtaining the current interpolated gain-exposure duration curve based on at least one of a first previously defined gain-exposure duration curve, a second previously defined gain-exposure duration curve, or a third previously defined gain-exposure duration curve.

16. The method of claim 15 , wherein obtaining the current interpolated gain-exposure duration curve includes:

obtaining the current interpolated gain-exposure duration curve using the current angular speed value by:

in response to a determination that the current angular speed value is less than or equal to a defined low angular speed threshold, obtaining the current interpolated gain-exposure duration curve by using the first previously defined gain-exposure duration curve as the current interpolated gain-exposure duration curve;

in response to a determination that the current angular speed value is greater than the defined low angular speed threshold and less than a defined medium angular speed threshold, obtaining the current interpolated gain-exposure duration curve by interpolating between the first previously defined gain-exposure duration curve and the second previously defined gain-exposure duration curve;

in response to a determination that the current angular speed value is equal to the defined medium angular speed threshold, obtaining the current interpolated gain-exposure duration curve by using the second previously defined gain-exposure duration curve as the current interpolated gain-exposure duration curve;

in response to a determination that the current angular speed value is greater than the defined medium angular speed threshold and less than a defined high angular speed threshold, obtaining the current interpolated gain-exposure duration curve by interpolating between the second previously defined gain-exposure duration curve and the third previously defined gain-exposure duration curve; and

in response to a determination that the current angular speed value is equal to or greater than the defined high angular speed threshold, obtaining the current interpolated gain-exposure duration curve by using the third previously defined gain-exposure duration curve as the current interpolated gain-exposure duration curve.

17. The method of claim 15 , wherein obtaining the current interpolated gain-exposure duration curve includes:

obtaining the current interpolated gain-exposure duration curve using the current maximum gain, wherein obtaining the current interpolated gain-exposure duration curve using the current maximum gain by:

subsequent to obtaining the current interpolated gain-exposure duration curve using the current angular speed value:

generating an updated current interpolated gain-exposure duration curve using the current maximum gain as a maximum gain for the updated current interpolated gain-exposure duration curve; and

using the updated current interpolated gain-exposure duration curve as the current interpolated gain-exposure duration curve.

18. The method of claim 9 , further comprising:

obtaining, by a target exposure component of an image capture apparatus, a target exposure value for processing the frame;

obtaining, by an aggregate gain component of the image capture apparatus, a target aggregate gain value and a remaining gain value for processing the frame;

obtaining, by an auto-exposure compensation component of the image capture apparatus, an auto-exposure compensation tone curve and an auto-exposure compensation gain value for processing the frame, in accordance with the target gain value and the target exposure duration value;

obtaining, by a contrast control component of the image capture apparatus, a contrast control tone curve and a contrast control black point value for processing the frame;

obtaining, by a tone control driver of the image capture apparatus, a tone control tone curve and a tone control black point value for processing the frame, in accordance with the target gain value and the target exposure duration value;

processing the frame in accordance with the tone control tone curve and the tone control black point value to obtain a processed frame; and

including the processed frame in the video.

19. A method comprising:

obtaining, by a target exposure component of an image capture apparatus, first target scene exposition data including a first target exposure duration value and a first target sensor gain value;

accessing, by the target exposure component, a first input frame of a video captured by an image sensor of the image capture apparatus in accordance with a defined frame rate, an adaptive acquisition control sample rate that is one third of the defined frame rate, and the first target scene exposition data;

obtaining, by the target exposure component, in accordance with the first target scene exposition data and the first input frame, second target scene exposition data including a second target exposure duration value and a second target sensor gain value, wherein obtaining the second target scene exposition data includes:

obtaining a current scene luminance value in accordance with the first input frame;

obtaining a current maximum gain using the current scene luminance value;

obtaining a current interpolated gain-exposure duration curve using the current maximum gain and angular speed data corresponding to capturing the first input frame; and

obtaining the second target sensor gain value and the second target exposure duration value from the current interpolated gain-exposure duration curve in accordance with a current maximum exposure duration; and

accessing, by the target exposure component, a second input frame of the video captured by the image sensor of the image capture apparatus in accordance with the defined frame rate, the second target exposure duration value, and the second target sensor gain value.

20. The method of claim 19 , wherein obtaining the current maximum gain includes:

in response to a determination that the current scene luminance value is less than or equal to a first defined luminance threshold, using a first defined gain as the current maximum gain;

in response to a determination that the current scene luminance value is equal to or greater than a second defined luminance threshold, using a second defined gain as the current maximum gain; and

in response to a determination that the current scene luminance value is greater than the first defined luminance threshold and is less than the second defined luminance threshold, interpolating the current maximum gain between the first defined gain and the second defined gain.

Assignments (3)

Continuity (1)

References Cited (48)