IP Library › Granted Patent US 10,334,158
Granted Patent B2
US 10,334,158 · App. 14/931,755 · Granted Jun 25, 2019

Autonomous media capturing

Inventor: Robert John Gove (Los Gatos, CA)
H04N5/23222G01B11/00G03B15/006G06F3/01G06F3/04883G06T1/00G06T1/0007H04N5/23206H04N5/23216H04N5/23219H04N5/23238H04N5/23241G01S17/89G03B37/00G03B2215/00G06K9/00302
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,334,158
App. No.
14/931,755
Filed
Nov 3, 2015
Granted
Jun 25, 2019
Kind
B2
Art Unit
2663
USPC
382/100
Abstract

A media capture device (MCD) that provides a multi-sensor, free flight camera platform with advanced learning technology to replicate the desires and skills of the purchaser/owner is provided. Advanced algorithms may uniquely enable many functions for autonomous and revolutionary photography. The device may learn about the user, the environment, and/or how to optimize a photographic experience so that compelling events may be captured and composed into efficient and emotional sharing. The device may capture better photos and videos as perceived by one's social circle of friends, and/or may greatly simplify the process of using a camera to the ultimate convenience of full autonomous operation.

Claims (48)

1. A system comprising:

at least one situation sensor operative to capture situation data with respect to a subject situation; and

at least one processor operative to:

determine with the electronic device a plurality of scene attributes associated with the subject situation by analyzing the captured situation data;

generate coaching cues based on the plurality of scene attributes, wherein the coaching cues assist a user of the system to compose one of a photograph and a video of the subject situation that emulates a style of a professional photographer or videographer;

if the plurality of scene attributes are characterized to be unsatisfactory for a media capture event, provide the coaching cues as an output operative to instruct the user to adjust a characteristic of the subject situation or a position of the electronic device relative to the subject situation such that the media capture event complies with the style;

instruct the at least one situation sensor to autonomously execute the media capture event to compose one of the photograph and the video of the subject situation without user input when the plurality of scene attributes are characterized to be satisfactory for the media capture event; and

share one of the photograph and the video with at least a subset of an Internet based social network such that the one of the photograph and the video is available for viewing via the Internet based social network.

2. The system of claim 1 , wherein the plurality of scene attributes comprise lighting environment of the subject situation and a pose position of the subject situation.

3. The system of claim 1 , wherein the plurality of scene attributes comprise at least four of lighting, rule of thirds, emotion-based facial expressions, emotion-based body exoskeleton expressions, audio events of emotion expression, frame composition percentage of a face versus a surrounding environment, blemish avoidance, head tilt, head rotation, and inertia sensing of the electronic device.

4. The system of claim 1 , wherein the plurality of scene attributes comprise analytics evaluated by a plurality of photography rules.

5. The system of claim 1 , further comprising an output component operative to present the output to the system user.

6. The system of claim 5 , wherein the output component comprises at least one of an audio output component, a visual output component, and a haptic output component.

7. The system of claim 1 , wherein the coaching cues comprise an instruction operative to instruct the system user to change a characteristic of a facial feature of the subject situation.

8. The system of claim 1 , wherein the coaching cues comprise an instruction operative to instruct the system user to change a characteristic of an exoskeletal feature of the subject situation.

9. The system of claim 1 , wherein the coaching cues comprise an instruction operative to instruct the system user to change a lighting element of the subject situation.

10. The system of claim 1 , wherein the at least one processor is operative to:

determine an emotion associated with the subject situation by analyzing the captured situation data; and

automatically share at least a portion of the captured situation data with at least a subset of a social network based on the determined emotion.

11. The system of claim 10 , wherein:

the at least one processor is operative to share the at least a portion of the capture situation data with a first subset of the social network when the determined emotion is a first type of emotion;

the at least one processor is operative to share the at least a portion of the capture situation data with a second subset of the social network when the determined emotion is a second type of emotion;

the first subset of the social network is different than the second subset of the social network; and

the first type of emotion is different than the second type of emotion.

12. The system of claim 10 , wherein the processor is further operative to:

receive feedback from the social network based on the shared at least a portion of the captured situation data; and

adjust the determined emotion based on the received feedback.

13. The system of claim 1 , wherein the at least one processor is further operative to:

obtain feedback from the Internet based social network; and

incorporate the feedback into the coaching cues.

14. The system of claim 1 , wherein the captured situation data comprises audio data.

15. The system of claim 1 , wherein the captured situation data further comprises image data.

16. The system of claim 1 , further comprising:

a drone capable of flying, the drone housing the at least one situation sensor and the at least one processor, wherein the drone is operative to reposition itself with respect to the subject situation in response to the coaching cues.

17. A method comprising:

capturing situation data with respect to a subject situation using at least one sensor component of an electronic device;

determining with the electronic device a plurality of scene attributes associated with the subject situation by analyzing the captured situation data;

generating coaching cues based on the plurality of scene attributes, wherein the coaching cues assist a user of the electronic device to compose one of a photograph and a video of the subject situation that emulates a style of a professional photographer or videographer;

if the plurality of scene attributes are characterized to be unsatisfactory for a media capture event, providing the coaching cues as an output operative to instruct the user to adjust a characteristic of the subject situation or a position of the electronic device relative to the subject situation such that the media capture event complies with the style;

instructing the at least one sensor component to autonomously execute the media capture event to compose one of the photograph and the video of the subject situation without user input when the plurality of scene attributes are characterized to be satisfactory for the media capture event; and

sharing one of the photograph and the video with at least a subset of an Internet based social network such that the one of the photograph and the video is available for viewing via the Internet based social network.

18. A non transitory computer readable medium comprising computer readable instructions recorded thereon for:

capturing situation data with respect to a subject situation using at least one sensor component of an electronic device;

determining with the electronic device a plurality of scene attributes associated with the subject situation by analyzing the captured situation data;

generating coaching cues based on the plurality of scene attributes, wherein the coaching cues assist a user of the electronic device to compose one of a photograph and a video of the subject situation that emulates a style of a professional photographer or videographer;

if the plurality of scene attributes are characterized to be unsatisfactory for a media capture event, providing the coaching cues as an output operative to instruct the user to adjust a characteristic of the subject situation or a position of the electronic device relative to the subject situation such that the media capture event complies with the style;

instructing the at least one sensor component to autonomously execute the media capture event to compose one of the photograph and the video of the subject situation without user input when the plurality of scene attributes are characterized to be satisfactory for the media capture event; and

sharing one of the photograph and the video with at least a subset of an Internet based social network such that the one of the photograph and the video is available for viewing via the Internet based social network.

Continuity (2)
Provisional Application 62074442 · Nov 3, 2014
Related Publication 20160127641A1 · May 5, 2016
Cited By (6)
US 12,223,653 US 12,256,143 US 12,316,957 US 12,328,497 US 12,395,729 US 12,694,875