IP Library Granted Patent US 11,290,639
Granted Patent B2
US 11,290,639 · App. 17/234,257 · Granted Mar 29, 2022

Enhanced image capture

Inventors: Doina I. Petrescu (Vernon Hills, IL); Thomas T. Lay (Highland Park, IL); Steven R. Petrie (Grayslake, IL); Bill Ryan (Libertyville, IL); Snigdha Sinha (Brookfield, WI); Jeffrey S. Vanhoof (Gurnee, IL)
Assignee: Google LLC
H04N5/23222H04N1/00H04N1/00244H04N1/21H04N1/212H04N1/215H04N1/2145H04N5/232H04N5/23216H04N5/23218H04N5/23219H04N5/23229H04N5/23254H04N5/23258H04N5/23267H04N5/23293H04N5/232933H04N5/23245H04N2201/3247
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,290,639
App. No.
17/234,257
Granted
Mar 29, 2022
Kind
B2
Abstract

Disclosed are techniques that provide a “best” picture taken within a few seconds of the moment when a capture command is received (e.g., when the “shutter” button is pressed). In some situations, several still images are automatically (that is, without the user's input) captured. These images are compared to find a “best” image that is presented to the photographer for consideration. Video is also captured automatically and analyzed to see if there is an action scene or other motion content around the time of the capture command. If the analysis reveals anything interesting, then the video clip is presented to the photographer. The video clip may be cropped to match the still-capture scene and to remove transitory parts. Higher-precision horizon detection may be provided based on motion analysis and on pixel-data analysis.

Claims (40)

1. A method comprising:

capturing, simultaneously by an image-capture device, a video segment and a sequence of still images;

determining, by the image-capture device, that the video segment is of interest to a user of the image-capture device;

determining, by the image-capture device, that a first score of a quality characteristic for a first still image from the sequence of still images is greater than a second score of the quality characteristic for a second still image from the sequence of still images; and

presenting, by the image-capture device, the video segment and the first still image.

2. The method of claim 1 , wherein capturing the video segment and the sequence of still images is in temporal proximity to a capture command received by the image-capture device.

3. The method of claim 1 , wherein determining that the video segment is of interest is based, at least in part, on motion content of the video segment.

4. The method of claim 3 , further comprising processing the video segment using image-stabilization techniques.

5. The method of claim 3 , further comprising processing the video segment to remove transitory portions of the video segment.

6. The method of claim 1 , wherein determining that the video segment is of interest to the user is based, at least in part, on a region of interest within the video segment.

7. The method of claim 1 , wherein determining that the first score is greater than the second score is based, at least in part, on face detection information.

8. The method of claim 1 , wherein determining that the first score is greater than the second score is based, at least in part, on a past behavior of the user.

9. The method of claim 1 , wherein determining that the first score is greater than the second score is based, at least in part, on motion-sensor data recorded by the image-capture device.

10. The method of claim 1 , wherein presenting the first still image includes presenting the first still image using a gallery mode.

11. The method of claim 10 , wherein presenting the first still image includes surrounding the first still image with a border to highlight the first still image.

12. The method of claim 1 , wherein the sequence of still images corresponds to frames of the video segment.

13. The method of claim 12 , further comprising:

receiving, from the user of the image-capture device, a selection of the first still image; and

transmitting, to a server, metadata associated with the selection of the first still image.

14. An image-capture device comprising:

a display; and

a processing system configured to direct the image-capture device to:

capture, simultaneously, a video segment and a sequence of still images;

determine that the video segment is of interest to a user of the image-capture device;

determine that a first score of a quality characteristic of a first still image from the sequence of still images is greater than a second score of the quality characteristic for a second still image from the sequence of still images; and

present, using the display, the video segment and the first still image.

15. The image-capture device of claim 14 , wherein the image-capture device is a cellphone, a camera, or a tablet.

16. The image-capture device of claim 14 , further comprising:

a communication interface operatively connected to the processing system and configured to communicate with a server that is remote from the image-capture device.

17. The image-capture device of claim 16 , wherein the processing system is further configured to direct the image-capture device to:

receive a recommendation from the server; and

determine that the first score is greater than the second score based, least in part, on the recommendation.

18. The image-capture device of claim 16 , wherein the processing system is further configured to direct the image-capture device to:

transmit, to the server, metadata associated with the capture of the video segment and the sequence of still images.

19. The image-capture device of claim 14 , further comprising:

a motion-detection sensor to detect a movement or a position of the image-capture device and wherein the processing system is further configured to direct the image-capture device to:

determine that the video segment is of interest based, at least in part, on a detected movement or position of the image-capture device.

20. The image capture device of claim 14 , further comprising:

a motion-detection sensor to detect a movement or a position of the image-capture device and wherein the processing system is further configured to direct the image-capture device to:

determine that the first score is greater than a second score based, at least in part, on a detected movement or position of the image-capture device.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 19, 2021
From: PETRESCU, DOINA I.; LAY, THOMAS T.; PETRIE, STEVEN R.; RYAN, BILL; SINHA, SNIGDHA; VANHOOF, JEFFREY S.
To: MOTOROLA MOBILITY LLC
Reel/Frame 055961/0306 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 19, 2021
From: MOTOROLA MOBILITY LLC
To: GOOGLE TECHNOLOGY HOLDINGS LLC
Reel/Frame 055971/0001 →
Continuity (4)
Continuation 16289050 · Feb 28, 2019
Continuation 14450492 · Aug 4, 2014
Provisional Application 62001327 · May 21, 2014
Related Publication 20210243363A1 · Aug 5, 2021