IP Library › Granted Patent US 11,509,817
Granted Patent B2
US 11,509,817 · App. 16/448,804 · Granted Nov 22, 2022

Autonomous media capturing

Inventor: Robert John Gove (Los Gatos, CA)
H04N5/23222G01B11/00G03B15/006G06F3/01G06F3/04883G06T1/00G06T1/0007H04N5/23206H04N5/23216H04N5/23218H04N5/23219H04N5/23238H04N5/232411G01S17/89G03B37/00G03B2215/00G06V40/174
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,509,817
App. No.
16/448,804
Granted
Nov 22, 2022
Kind
B2
Abstract

A media capture device (MCD) that provides a multi-sensor, free flight camera platform with advanced learning technology to replicate the desires and skills of the purchaser/owner is provided. Advanced algorithms may uniquely enable many functions for autonomous and revolutionary photography. The device may learn about the user, the environment, and/or how to optimize a photographic experience so that compelling events may be captured and composed into efficient and emotional sharing. The device may capture better photos and videos as perceived by one's social circle of friends, and/or may greatly simplify the process of using a camera to the ultimate convenience of full autonomous operation.

Claims (55)

1. An autonomous media capture device (AMCD), comprising:

a media capturing apparatus;

a flight apparatus that houses the media capturing apparatus; and

at least one controller coupled to the media capturing apparatus and the flight apparatus, the at least one controller operative to:

identify, via the media capture apparatus, a subject or group of subjects for media capture, the subject or group of subjects located in a permitted space;

determine environmental conditions within the permitted space that affect composition quality of a media capture event of the subject;

autonomously position the AMCD in an optimal free space location within the permitted space such that the composition quality of a media capture event of the subject or group of subjects satisfies a minimum quality metric based on an orientation of the subject or the group of subjects within the permitted space and the determined environmental conditions; and

instruct the media capturing apparatus to execute the media capture event when social media composition criteria are satisfied and the AMCD has been positioned in the optimal free space location, wherein the social media composition criteria comprises:

social media feedback on previously posted media that has been provided to a learning algorithm that is used by the at least one controller for executing media capture events; and

scoring metrics characterizing a scene comprising the subject or group of subjects and the determined environmental conditions, wherein the scoring metrics are continuously evaluated to determine when a scene score meets or exceeds an optimal socially-appealing score threshold that triggers execution of the media capture event.

2. The autonomous media capture device of claim 1 , wherein the at least one controller is further operative to transmit the captured media event to a server.

3. The autonomous media capture device of claim 1 , wherein the at least one controller is further operative to:

receive feedback based on the captured media event; and

adjust at least one rule in a set of rules that controls operation of the media capturing apparatus based on the received feedback.

4. The autonomous media capture device of claim 1 , wherein the at least one controller is further operative to maintain a set of rules that control how the media apparatus captures media.

5. The autonomous media capture device of claim 4 , wherein the set of rules comprises:

user preference data;

object recognition data;

emotion detection data; and

environmental data.

6. The autonomous media capture device of claim 1 , wherein the flight apparatus is an autonomous flying machine.

7. The autonomous media capture device of claim 1 , further comprising a skin that at least partially covers the flight apparatus.

8. The autonomous media capture device of claim 1 , wherein the flight apparatus functions as an air-tripod.

9. The autonomous media capture device of claim 1 , wherein the at least one controller is further operative to direct a subject to a location suitable for taking the best picture for an observed set of conditions.

10. A media capture device (MCD) comprising:

a flight platform capable of sustained flight within a designated airspace;

a camera; and

a processor operative to:

autonomously control flight of the flight platform within the designated airspace with respect to a human subject;

evaluate a composition potential of the human subject for a media capture event by monitoring predefined criteria comprising environmental data surrounding the human subject;

adjust a position of the flight platform with respect to the human subject such that composition potential of a media capture event of the human subject satisfies a minimum quality metric based on orientation of the human subject and the environmental data; and

use the camera to take pictures or videos of the human subject when social media composition criteria are satisfied for the media capture event while the flight platform has been positioned such that composition quality of the media capture event satisfies the minimum quality metric based on orientation of the human subject and the environmental data, wherein the social media composition criteria comprises:

social media feedback on previously posted media that has been provided to a learning algorithm that is used by the processor for executing media capture events; and

scoring metrics characterizing a scene comprising the subject or group of subjects and the determined environmental conditions, wherein the scoring metrics are continuously evaluated to determine when a scene score meets or exceeds an optimal socially-appealing score threshold that triggers execution of the media capture event, and wherein evaluation of the composition potential, position adjustments of the flight platform, and execution of the media capture event are all performed autonomously.

11. The MCD of claim 10 , wherein the processor is operative to automatically compose the picture or video.

12. The MCD of claim 10 , wherein the processor is operative to:

construct a 3D model of a scene within the designated airspace;

use the 3D model as a map for positioning the flight platform at specific locations within the designated airspace; and

execute media capture events at one or more of the specific locations.

13. The MCD of claim 12 , wherein the processor is operative to:

capture a time lapse photography at one or more of the specific locations.

14. The MCD of claim 10 , wherein the processor is operative to:

detect when the MCD is tossed into the designated airspace by a user of the MCD;

engage flight control of the flight platform in response to a detected toss event; and

perform a selfie photograph of the user after the detected toss event.

15. The MCD of claim 10 , wherein the processor is operative to:

launch the flight platform from a user;

control the flight platform to follow the user; and

execute media capture events with the camera as the MCD follows the user.

16. The MCD of claim 10 , further comprising:

at least two image sensors;

a propulsion system; and

a housing.

17. The MCD of claim 10 , wherein the processor is operative to:

execute anti-collision algorithms to avoid interference with objects within the designated space.

Continuity (3)
Continuation 14931755 · Nov 3, 2015
Provisional Application 62074442 · Nov 3, 2014
Related Publication 20200014848A1 · Jan 9, 2020
Cited By (2)
US 12,432,443 US 12,720,187