IP Library Granted Patent US 9,418,705
Granted Patent B2
US 9,418,705 · App. 14/801,631 · Granted Aug 16, 2016

Sensor and media event detection system

Inventors: Ryan Kaps (Mesa, AZ); Michael Bentley (Carlsbad, CA); Bhaskar Bose (Carlsbad, CA)
Assignee: BLAST MOTION INC.
G11B27/17G06K9/00342G06K9/00711G06T7/20G11B27/031H04N7/181A63F2300/105A63F2300/69G06K2009/00738G06T2207/30221G08B21/043
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,418,705
App. No.
14/801,631
Granted
Aug 16, 2016
Kind
B2
Abstract

Enables detection of events using motion capture sensors and potentially other sensors electromagnetic field, temperature, humidity, wind, pressure, elevation, light, sound, or heart rate sensors to confirm and post events, differentiate similar types of motion events to determine the type of equipment or activity or quality of the event, such proficiency. Enables motion capture data and other sensor data to be utilized to curate text, images, video, sound and post the results to social networks, for example in a dedicated feed. Embodiments of the system also may post or filter to social media sites using any other filter besides location and time and the text in the social media posts for example. May use motion or other sensor data to define and event, eliminate false positive events, post true events, and/or correlate the events with social media to confirm the events, or post the events in a particular channel.

Claims (104)

1. A sensor and media event detection system comprising:

a computer comprising

a computer memory; and,

a first communication interface configured to obtain data, or event data comprising one or more values associated with an orientation, position, velocity, acceleration, angular velocity, angular acceleration, electromagnetic field, temperature, humidity, wind, pressure, elevation, light, sound, or heart rate associated with a user or piece of equipment or mobile device coupled with the user;

wherein said computer is coupled with said computer memory and is coupled with said first communication interface, wherein said computer is configured to

receive

said data from said first communication interface and analyze said data and recognize an event within said data to determine said event data,

or

said event data from said first communication interface,

or

both said data and said event data from said first communication interface;

store said event data in said computer memory;

obtain an event start time and an event stop time from said event data;

confirm said event for a particular location and time by analyzing one or more of text, audio, image, and video from a server to create a confirmed event, wherein said one or more of said text, audio, image, and video comprise one or more of email messages, voice calls, voicemails, audio recordings, video calls, video messages, video recordings, text messages, chat messages, postings on social media sites, postings on blogs, or postings on wikis; and,

publish said confirmed event.

2. The system of claim 1 , further comprising:

at least one sensor element configured to couple with said user or said piece of equipment or said mobile device coupled with the user, wherein said at least one sensor element comprises

a sensor data memory;

at least one sensor configured to capture said one or more values associated with an orientation, position, velocity, acceleration, angular velocity, angular acceleration, electromagnetic field, temperature, humidity, wind, pressure, elevation, light, sound, or heart rate;

a second communication interface; and,

a microprocessor coupled with said sensor data memory, said at least one sensor and said second communication interface, wherein said microprocessor is configured to

collect data that comprises sensor values from said at least one sensor;

store said data in said sensor data memory;

optionally analyze said data and recognize an event within said data to determine said event data; and,

transmit said data or said event data associated with said event or both said data and said event data to said computer via said second communication interface.

3. The system of claim 1 , wherein said server comprises one or more of an email server, a social media site, a photo sharing site, a video sharing site, a blog, a wiki, a database, a newsgroup, an RSS server, a multimedia repository, a document repository, and a text message server.

4. The system of claim 1 , wherein said analyzing one or more of said text, audio, image, and video comprises searching said text for key words or key phrases related to said confirmed event.

5. The system of claim 1 , wherein said analyzing one or more of said text, audio, image, and video comprises image analysis to search for images related to said confirmed event.

6. The system of claim 1 , wherein said computer obtains one or more additional sensor values associated with an orientation, position, velocity, acceleration, angular velocity, angular acceleration, electromagnetic field, temperature, humidity, wind, pressure, elevation, light, sound, or heart rate from a second sensor or second computer or from a plurality of other sensors or other computers to perform said confirm said event.

7. The system of claim 6 wherein said recognize an event comprises

determining a prospective event based on said data;

correlating said data with said one or more additional sensor values to determine if said prospective event is a valid event or a false positive event.

8. The system of claim 6 wherein said computer correlates said data or said event data with one or more of said one or more additional sensor values to determine a type of equipment that is coupled with said second sensor, said second computer or said plurality of other sensors or computers.

9. The system of claim 6 wherein said computer correlates said data or said event data with one or more of said one or more additional sensor values to determine a type of activity for said event.

10. The system of claim 9 wherein said computer determines said type of activity for said event through a comparison of said one or more additional sensor values to typical sensor values for a first type of activity and for at least one second type of activity.

11. The system of claim 10 wherein

said first type of activity is surfing;

said at least one second type of activity is snowboarding;

said one or more additional sensor values comprise temperature, elevation, or both temperature and elevation;

wherein said typical sensor values comprise temperature associated with snowboarding that are below said temperature associated with surfing; and,

wherein said typical sensor values comprise elevation associated with surfing that are below said elevation associated snowboarding.

12. The system of claim 1 , wherein said computer is further configured to obtain a plurality of instances of said event data from a plurality of other sensors or other computers;

correlate said plurality of instances of said event data based on a time and a location of each of said instances of said event data; and,

perform said confirm said event if the number of said plurality of instances of said event data occurring within a time range and a location range exceeds an event count threshold.

13. The system of claim 1 , wherein said computer is further configured to

obtain a plurality of instances of said data or said event data or both said data and said event data from a plurality of other sensors or other computers;

correlate said plurality of instances of said data or said event data or both said data and said event data based on a time and a location of each of said plurality of instances of said data or said event data or both said data and said event data;

calculate an aggregate metric from said plurality of instances of said data or said event data or both said data and said event data for the plurality of instances of said data or said event data or both said data and said event data occurring within a time range and a location range; and,

perform said confirm said event if said aggregate metric exceeds an aggregate metric threshold.

14. The system of claim 2 wherein said microprocessor is further configured to recognize a location of said at least one sensor on said piece of equipment or said user based on said data or said event data.

15. The system of claim 2 wherein said microprocessor is further configured to collect data that comprises sensor values from said at least one sensor based on a sensor personality selected from a plurality of sensor personalities, wherein the sensor personality is configured to control sensor settings to collect the data in an optimal manner with respect to a specific type of movement or a type of activity associated with a specific piece of equipment or type of clothing.

16. The system of claim 2 wherein said microprocessor is further configured to recognize said event within said data as

detect a first value from said sensor values having a first threshold value and

detect a second value from said sensor values having a second threshold value within a time window;

signify a prospective event;

compare said prospective event to a characteristic signal associated with a typical event and eliminate any false positive events;

signify a valid event if said prospective event is not a false positive event; and,

save said valid event in said memory comprising information within an event time window as said data.

17. The system of claim 2 , wherein said microprocessor is further configured to recognize said at least one sensor element with newly assigned locations after said at least one sensor element is removed from said piece of equipment and coupled with a second piece of equipment of a different type based on said data or said event data.

18. The system of claim 1 wherein said computer further comprises at least one processor in said mobile device, a mobile phone, a smart phone, a smart watch, a camera, a laptop computer, a notebook computer, a tablet computer, a desktop computer, a server computer or any combination of any number of said mobile device, said mobile phone, said smart phone, said smart watch, said camera, said laptop computer, said notebook computer, said tablet computer, said desktop computer and said server computer.

19. The system of claim 1 , wherein said computer is further configured to

obtain at least one video from one or more of

a camera associated with said user,

said computer,

said mobile device,

said server, and

another server;

obtain at least one video start time and at least one video stop time associated with said at least one video;

synchronize said event data with said at least one video based on

an event start time associated with said data or said event data obtained from said at least one sensor element,

an event stop time associated with said data or said event data obtained from said at least one sensor element,

at least one time associated said at least one video, to

create at least one synchronized event video comprising both of

said event data that occurs during a timespan from said event start time to said event stop time;

and,

said at least one video captured during said timespan from said event start time to said event stop time.

20. The system of claim 19 wherein said computer is further configured to display said at least one synchronized event video.

21. The system of claim 19 wherein said computer is further configured to discard or instruct another computer to discard or instruct a camera to discard at least a portion of said at least one video outside of said event start time to said event stop time.

22. The system of claim 19 wherein said computer is further configured to

send a control message local to said computer or external to said computer to at least one camera to modify video recording parameters of said at least one video based on said data or said event data;

wherein said video recording parameters comprise one or more of frame rate, resolution, color depth, color or grayscale, compression method, compression quality, and recording on or off.

23. The system of claim 19 wherein said computer is further configured to transmit said at least one synchronized event video or a portion of said at least one synchronized event video to one or more of a repository, a viewer, a server, another computer, a social media site, said mobile device, a network, and an emergency service.

24. The system of claim 19 wherein said computer is further configured to

accept a metric associated with said at least one synchronized event video;

accept selection criteria for said metric;

determine a matching set of synchronized event videos that have values associated with said metric that pass said selection criteria; and,

display said matching set of synchronized event videos or corresponding thumbnails thereof along with said values associated with said metric for each of said matching set of synchronized event videos or said corresponding thumbnails.

25. The system of claim 24 wherein said computer is further configured to generate a highlight reel or fail reel of said matching set of synchronized event videos.

26. The system of claim 1 wherein said computer is further configured to

access previously stored event data associated with said user or piece of equipment;

display information comprising a presentation of said event data associated with said user on a display based on

said event data associated with said user or piece of equipment;

and,

said previously stored event data associated with said user or piece of equipment.

27. The system of claim 1 wherein said computer is further configured to

access previously stored event data associated with at least one other user or at least one other piece of equipment;

display information comprising a presentation of said event data associated with said user on a display based on

said event data associated with said user or piece of equipment;

and,

said previously stored event data associated with said at least one other user or said at least one other piece of equipment.

28. The system of claim 2 wherein said microprocessor in said at least one sensor element is further configured to transmit said event to at least one other sensor element or other computer, and wherein said at least one other sensor element or other computer is configured to save data or transmit data or both save data and transmit data associated with said event even if said at least one sensor element has not detected said event.

29. The system of claim 1 wherein said computer is further configured to

request or broadcast a request for camera locations proximal to said event or oriented to view said event or both proximal to and oriented to view said event; and,

request at least one video from said at least one camera proximal to said event wherein said at least one video contains said event without at least a portion of said at least one video outside of said event start time to said event stop time.

Assignments (10)
ASSET PURCHASE AGREEMENT Recorded Apr 28, 2026
From: BM LIQUIDATION, LLC
To: WIN REALITY, LLC
Reel/Frame 075492/0289 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2026
From: BLAST MOTION, INC.
To: BM LIQUIDATION, LLC
Reel/Frame 075494/0137 →
RELEASE OF SECURITY INTEREST Recorded Mar 7, 2025
From: GALLAGHER IP SOLUTIONS LLC
To: BLAST MOTION INC.
Reel/Frame 070441/0945 →
CHANGE OF NAME Recorded Jan 23, 2025
From: BLAST MOTION INC.
To: MFBM INVESTMENT HOLDINGS INC.
Reel/Frame 069997/0961 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 22, 2024
From: BLAST MOTION INC.
To: BLAST MOTION INC.
Reel/Frame 069217/0303 →
SECURITY INTEREST Recorded Aug 5, 2024
From: NEWLIGHT CAPITAL, LLC
To: GALLAGHER IP SOLUTIONS LLC
Reel/Frame 068328/0534 →
CHANGE OF ADDRESS Recorded Mar 15, 2022
From: BLAST MOTION INC.
To: BLAST MOTION INC.
Reel/Frame 059366/0333 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 22, 2022
From: BLAST MOTION INC.,
To: NEWLIGHT CAPITAL LLC
Reel/Frame 059208/0958 →
SECURITY INTEREST Recorded Feb 2, 2021
From: BLAST MOTION INC.
To: NEWLIGHT CAPITAL LLC, INDIVIDUALLY AND FOR THE BENEFIT OF AND AS COLLATERAL AGENT FOR THE BENEFIT OF UMB BANK, NATIONAL ASSOCIATION, AS TRUSTEE
Reel/Frame 055207/0913 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2015
From: KAPS, RYAN; BENTLEY, MICHAEL; BOSE, BHASKAR
To: BLAST MOTION INC.
Reel/Frame 036116/0386 →
Continuity (14)
Continuation In Part 14549422 · Nov 20, 2014
Continuation In Part 14257959 · Apr 21, 2014
Continuation In Part 13914525 · Jun 10, 2013
Continuation In Part 13679879 · Nov 16, 2012
Continuation In Part 13298158 · Nov 16, 2011
Continuation In Part 13267784 · Oct 6, 2011
Continuation In Part 13219525 · Aug 26, 2011
Continuation In Part 13191309 · Jul 26, 2011
Continuation In Part 13048850 · Mar 15, 2011
Continuation In Part 12901806 · Oct 11, 2010
Continuation In Part 12868882 · Aug 26, 2010
Continuation In Part 14801631
Continuation In Part 13757029 · Feb 1, 2013
Related Publication 20150348591A1 · Dec 3, 2015