IP Library › Granted Patent US 11,153,485
Granted Patent B2
US 11,153,485 · App. 16/561,811 · Granted Oct 19, 2021

Automated camera mode selection using local motion vector

Inventors: Eva Coupeté (Paris, FR); Etienne Terree (Paris, FR); Adrien Cariou (Paris, FR)
Assignee: GoPro, Inc.
H04N5/23245G06T7/246H04N5/145H04N5/2258H04N5/23251
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,153,485
App. No.
16/561,811
Granted
Oct 19, 2021
Kind
B2
Abstract

Automated camera mode selection using local motion vectors is described. An image capture device includes an image metric estimation unit to detect a presence or level of an image metric in a scene of an image to capture based on image metric inputs, a motion estimation unit to determine a level of movement within the scene using ratios of histograms based on local motion vectors, a mode selection unit to select a camera mode for capturing the image based on outputs of the image metric estimation unit and the motion estimation unit, and an image sensor to capture the image according to the selected camera mode. The motion estimation unit computes a norm for each local motion vector, generates a histogram from the computed norms, determines movement metrics based on the ratios of histograms associated with different norm thresholds, and identifies the level of movement based on the movement metrics.

Claims (56)

1. An image capture device with automated image acquisition mode selection, the image capture device comprising:

one or more image metric estimation units configured to detect a presence or level of an image metric in a scene of an image to capture based on one or more image metric inputs;

a motion estimation unit configured to:

compute norms, a norm corresponding to a local motion vector;

generate a data bin from the computed norms, the data bin including bins;

determine different movement metrics based on computing different ratios of all bins in the data bin associated with different norm thresholds and all bins in the data bin; and

determine a level of movement within the scene based on the determined different movement metrics;

a mode selection unit configured to select a camera mode to use for capturing the image based on outputs of the one or more image metric estimation units and the motion estimation unit; and

an image sensor configured to capture the image according to the selected camera mode.

2. The image capture device of claim 1 , wherein the motion estimation unit is further configured to:

determine a movement metric for all movements by using a first norm threshold; and

compute a ratio between all bins in the data bin meeting or exceeding the first norm threshold and all bins in the data bin.

3. The image capture device of claim 2 , wherein the motion estimation unit is further configured to:

determine a second movement metric for all medium movements by using a second norm threshold; and

compute a second ratio between all bins in the data bin meeting or exceeding the second norm threshold and all bins in the data bin.

4. The image capture device of claim 3 , wherein the motion estimation unit is further configured to:

determine a third movement metric for all big movements by using a third norm threshold; and

compute a third ratio between all bins in the data bin meeting or exceeding the third norm threshold and all bins in the data bin.

5. The image capture device of claim 1 , wherein the motion estimation unit is further configured to:

apply a weight vector to the data bin to generate a weighted data bin to favor defined movement metrics.

6. The image capture device of claim 5 , wherein the defined movement metrics have a norm threshold greater than unity.

7. The image capture device of claim 5 , wherein the weight vector has increasingly greater weight values for increasingly higher valued norms.

8. The image capture device of claim 1 , wherein the image metric is one of high dynamic range and light intensity.

9. A method for automated camera mode selection, the method comprising:

receiving local motion vectors corresponding to motion or movement in a scene of an image to capture;

computing a norm for each local motion vector;

generating a histogram from the computed norms;

determining movement metrics based on ratios of the histograms for different norm thresholds, wherein the determining comprising:

setting a defined norm threshold for each movement metric; and

computing a ratio between all bins in the histogram meeting or exceeding the defined norm threshold and all bins in the histogram;

identifying a level of movement in the scene based on the movement metrics; and

applying the identified level of movement to select a camera mode for a camera for capturing the image.

10. The method of claim 9 , further comprising:

multiplying the histogram with a weight vector to generate a weighted histogram which favors movement metrics having norm thresholds greater than unity.

11. The method of claim 10 , wherein the weight vector has increasingly greater weight values for increasingly higher valued defined norm thresholds.

12. The method of claim 10 , wherein the weight vector has a non-unitary weight for each defined norm threshold greater than unity.

13. The method of claim 9 , further comprising:

skewing the histogram with a weight vector toward certain defined movement metric thresholds.

14. A method for automated camera mode selection, the method comprising:

determining, for a scene of an image to capture, at least one image metric based on an associated image metric input;

computing norms, a norm corresponding to a local motion vector;

producing a data bin from the computed norms, the data bin including bins;

determining different movement metrics based on computing different ratios of all bins in the data bin associated with different norm thresholds and all bins in the data bin;

determining, for the scene, a motion level based on the determined different movement metrics;

selecting a camera mode to use for capturing the image based on each determined image metric and the motion level; and

capturing the image according to the selected camera mode.

15. The method of claim 14 , wherein the determining different movement metrics further comprises:

providing a set of defined movement metric thresholds;

computing ratios of data bins for each defined movement metric threshold; and

establishing the motion level in the scene based on the computed ratios.

16. The method of claim 15 , further comprising:

skewing the data bins with a weight vector toward certain defined movement metric thresholds.

17. The method of claim 16 , wherein the certain defined movement metric thresholds are greater than one.

18. The method of claim 16 , wherein increasingly greater weights are applied to increasingly higher defined movement metric thresholds.

19. The method of claim 16 , wherein the weight vector has a non-unitary weight for each defined movement metric threshold greater than unity.

20. The method of claim 16 , wherein at least one image metric is one of high dynamic range and light intensity.

Assignments (5)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Oct 19, 2020
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054113/0594 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 27, 2020
From: COUPETÉ, EVA; TERREE, ETIENNE; CARIOU, ADRIEN
To: GOPRO, INC.
Reel/Frame 051629/0487 →
Continuity (1)
Related Publication 20210075965A1 · Mar 11, 2021
Cited By (1)
US 12,406,330