IP Library Granted Patent US 9,940,508
Granted Patent B2
US 9,940,508 · App. 15/590,511 · Granted Apr 10, 2018

Event detection, confirmation and publication system that integrates sensor data and social media

Inventors: Ryan Kaps (Mesa, AZ); Michael Bentley (Carlsbad, CA); Bhaskar Bose (Carlsbad, CA)
Assignee: BLAST MOTION INC.
G06K9/00342A63B24/0062G06K9/00711G06K9/00724G06K9/00751G06T7/20G08B21/043G11B27/022G11B27/031G11B27/17G11B31/006H04N7/18H04N7/181A63B71/06G06K2009/00738G06T2207/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,940,508
App. No.
15/590,511
Granted
Apr 10, 2018
Kind
B2
Abstract

Enables integration of sensor data with other information on servers such as social media sites to detect, confirm and/or publish events. Sensors may measure values such as motion, temperature, humidity, wind, pressure, elevation, light, sound, or heart rate, etc. Sensor data and event tags may be utilized to curate text, images, video, sound and post the results to social networks, for example in a dedicated feed. Event tags generated by the system may represent for example activity types, players, performance levels, or scoring results. The system may analyze social media postings to confirm or augment event tags. Users may filter and analyze saved events based on the assigned tags. The system may create highlight and fail reels filtered by metrics and by tags. Recommendations may be provided to a user based on analysis of sensor data and other information; recommendations may include for example recommended friends, purchases, or activities.

Claims (120)

1. A system that integrates sensor data and social media comprising:

a computer comprising

a computer memory; and,

a first communication interface configured to obtain data, or event data comprising one or more values from at least one sensor configured to measure a property of an object wherein said one or more values are associated with

one or more of

an inertial sensor value associated with an orientation, position, velocity, acceleration, angular velocity, angular acceleration,

a physical value,

an environmental value,

a physiological value

associated with a user or piece of equipment or mobile device associated with the user;

wherein said computer is coupled with said computer memory and is coupled with said first communication interface, wherein said computer is configured to

receive

said data from said first communication interface and analyze said data and recognize an event within said data to determine said event data,

or

said event data from said first communication interface,

or

both said data and said event data from said first communication interface;

store said event data in said computer memory;

obtain an event start time and an event stop time from said event data;

confirm said event recognized by said computer or obtained from said first communication interface for a particular location and time by analyzing one or more of text, audio, image, and video from a server to create a confirmed event, wherein said one or more of said text, audio, image, and video comprise one or more of email messages, voice calls, voicemails, audio recordings, video calls, video messages, video recordings, text messages, chat messages, postings on social media sites, postings on blogs, and postings on wikis; and,

wherein said computer is further configured to

generate a suggestion or alert based on analysis of said data, said event data, or both said data and said event data;

transmit said suggestion or said alert to said user;

wherein said suggestion comprises

a second user or a group of users having associated data, associated event data, or both associated data and associated event data that is similar to said data, said event data, or both said data and said event data, or

a recommended product or a recommended piece of equipment that is appropriate for a performance level determined from said data, from said event data, or from both said data and said event data, or

a recommended activity that is appropriate for a performance level determined from said data, from said event data, or from both said data and said event data.

2. The system of claim 1 , wherein said computer is further configured to publish said confirmed event to a social media site or a social media service.

3. The system of claim 2 , wherein said server comprises said social media site or said social media service.

4. The system of claim 2 , wherein said computer is further configured to generate a curated event record of said confirmed event; and, publish said curated event record to said social media site or said social media service.

5. The system of claim 4 , wherein said generate said curated event record comprises:

obtain a media capture;

select a portion of said media capture occurring between said event start time and said event stop time; and,

include said portion of said media capture in said curated event record.

6. The system of claim 5 , wherein said select a portion of said media capture occurring between said event start time and said event stop time comprises:

identify one or more highlights based on one or both of said data and said event data; and,

select said portion of said media capture to include said one or more highlights.

7. The system of claim 5 , wherein said media capture comprises one or more of an image, a video, and an audio.

8. The system of claim 5 , wherein said computer is further configured to

discard or

instruct another computer to discard or

instruct a media capture device to discard

at least a second portion of said media capture that occurs outside of a timespan from said event start time to said event stop time.

9. The system of claim 7 , wherein said media capture comprises one or more of a panoramic image and a panoramic video.

10. The system of claim 7 , wherein said media capture comprises one or more of a virtual reality display, a virtual reality presentation, a virtual reality recording, an augmented reality display, an augmented reality presentation, and an augmented reality recording.

11. The system of claim 2 , wherein said computer is further configured to

obtain one or more additional sensor values associated with one or more of an orientation, position, velocity, acceleration, angular velocity, angular acceleration, electromagnetic field, temperature, humidity, wind, pressure, elevation, light, sound, and heart rate from a second sensor or second computer or from a plurality of other sensors or other computers to perform said confirm said event.

12. The system of claim 2 , wherein said computer is further configured to

obtain one or more additional sensor values from a second sensor to perform said confirm said event, wherein said second sensor comprises one or more of a video camera, a light gate, a radar, or an inertial sensor.

13. The system of claim 2 , wherein

said computer is further configured to

determine one or more tags for said event by analyzing one or more of

said data,

said event data, and

said one or more of said text, audio, image, and video from said server; and,

publish said one or more tags for said event to said social media site or said social media service; and,

said one or more tags represent one or more of

an activity type of said event;

a location of said event;

a timestamp of said event;

a stage of an activity associated with said event;

a player identity associated with said event;

a performance level associated with said event; and,

a scoring result associated with said event.

14. The system of claim 2 , wherein said suggestion comprises recommended friends.

15. The system of claim 2 , wherein said alert comprises an indication of an emergency.

16. The system of claim 2 , wherein said suggestion comprises an indication of fake news.

17. The system of claim 2 , wherein said computer is further configured to

obtain a plurality of instances of said data or said event data or both said data and said event data from a plurality of other sensors or other computers;

correlate said plurality of instances of said data or said event data or both said data and said event data based on a time and a location of each of said plurality of instances of said data or said event data or both said data and said event data; and,

perform said confirm said event when

the number of said plurality of instances of said data or said event data or both said data and said event data occurring within a time range and a location range exceeds an event count threshold, or,

an aggregate metric calculated from said plurality of instances of said data or said event data or both said data and said event data for the plurality of instances of said data or said event data or both said data and said event data occurring within said time range and said location range exceeds an aggregate metric threshold.

18. The system of claim 2 , wherein said computer is further configured to

detect a first value from said one or more values having a first threshold value and

detect a second value from said one or more values having a second threshold value within a time window;

signify a prospective event;

compare said prospective event to a characteristic signal associated with a typical event and eliminate any false positive events;

signify a valid event if said prospective event is not a false positive event; and,

save said valid event in said memory comprising information within an event time window as said data.

19. The system of claim 2 , wherein said computer is further configured to

obtain at least one video from one or more of

a camera or smart glasses associated with said user,

said computer,

said mobile device,

said server, and

another server;

obtain at least one video start time and at least one video stop time associated with said at least one video; and,

synchronize said event data with said at least one video based on

said event start time and said event stop time, and

at least one time associated with said at least one video, to

create at least one synchronized event video comprising both of

said event data that occurs during a timespan from said event start time to said event stop time;

and,

said at least one video captured during said timespan from said event start time to said event stop time.

20. The system of claim 19 , wherein said computer is further configured to

accept a metric or one or more tags associated with said at least one synchronized event video;

accept selection criteria for said metric or said one or more tags;

determine a matching set of synchronized event videos that have a value or values associated with said metric or with said one or more tags that pass said selection criteria; and,

display said matching set of synchronized event videos or corresponding thumbnails thereof along with said value or values associated with said metric or with said one or more tags for each of said matching set of synchronized event videos or said corresponding thumbnails.

21. A sensor and social media integration system comprising:

a computer comprising

a computer memory; and,

a first communication interface configured to obtain data from at least one sensor configured to measure a property of an object;

wherein said computer is coupled with said computer memory and is coupled with said first communication interface, wherein said computer is configured to

receive

said data from said first communication interface and analyze said data and recognize an event within said data to determine event data,

or

said event data from said first communication interface,

or

both said data and said event data from said first communication interface;

store said event data in said computer memory;

obtain an event start time and an event stop time from said event data;

confirm said event recognized by said computer or obtained from said first communication interface for a particular location and time by analyzing one or more of text, audio, image, and video from a server to create a confirmed event, wherein said one or more of said text, audio, image, and video comprise one or more of email messages, voice calls, voicemails, audio recordings, video calls, video messages, video recordings, text messages, chat messages, postings on social media sites, postings on blogs, and postings on wikis; and,

publish said confirmed event.

22. The system of claim 21 , wherein said object comprises one or more of

a person, a group of people, a body part of said person or of said group of people, a food, a drink, a plant, an animal, a piece of equipment, a machine, an automobile, a vehicle, an engine, a building, a room, an area, and a body of water.

23. The system of claim 21 , wherein said property comprises one or more of

acoustic pressure, acoustic power, acoustic frequency, sound, vibration, seismic activity, air flow, fluid flow, mass flow, oxygen level, hydrogen level, ozone level, pH, smoke level, carbon dioxide level, carbon monoxide level, chemical composition, ionization level, chemical reaction rate, radiation level, charge, electric current, electric potential, resistance, conductance, capacitance, inductance, impedance, electromagnetic field, electromagnetic frequency, wavelength, Doppler shift, light level, particle count, photon count, amplitude, temperature, moisture, humidity, barometric pressure, pollution level, precipitation level, tide level, wind velocity, mass, weight, density, position, depth, altitude, displacement, proximity, presence, orientation, angle, inclination, tilt, shock, strain, mileage, velocity, speed, angular velocity, acceleration, angular acceleration, force, torque, momentum, revolutions per minute, heart rate, blood pressure, body temperature, blood composition, body fluid composition, tissue composition, oxygen saturation, and respiration rate.

24. The system of claim 1 , wherein said least one sensor configured to measure said property of said object wherein said one or more values are associated with a chemical value.

Assignments (10)
ASSET PURCHASE AGREEMENT Recorded Apr 28, 2026
From: BM LIQUIDATION, LLC
To: WIN REALITY, LLC
Reel/Frame 075492/0289 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2026
From: BLAST MOTION, INC.
To: BM LIQUIDATION, LLC
Reel/Frame 075494/0137 →
RELEASE OF SECURITY INTEREST Recorded Mar 7, 2025
From: GALLAGHER IP SOLUTIONS LLC
To: BLAST MOTION INC.
Reel/Frame 070441/0945 →
CHANGE OF NAME Recorded Jan 23, 2025
From: BLAST MOTION INC.
To: MFBM INVESTMENT HOLDINGS INC.
Reel/Frame 069997/0961 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 22, 2024
From: BLAST MOTION INC.
To: BLAST MOTION INC.
Reel/Frame 069217/0303 →
SECURITY INTEREST Recorded Aug 5, 2024
From: NEWLIGHT CAPITAL, LLC
To: GALLAGHER IP SOLUTIONS LLC
Reel/Frame 068328/0534 →
CHANGE OF ADDRESS Recorded Mar 15, 2022
From: BLAST MOTION INC.
To: BLAST MOTION INC.
Reel/Frame 059366/0333 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 22, 2022
From: BLAST MOTION INC.,
To: NEWLIGHT CAPITAL LLC
Reel/Frame 059208/0958 →
SECURITY INTEREST Recorded Feb 2, 2021
From: BLAST MOTION INC.
To: NEWLIGHT CAPITAL LLC, INDIVIDUALLY AND FOR THE BENEFIT OF AND AS COLLATERAL AGENT FOR THE BENEFIT OF UMB BANK, NATIONAL ASSOCIATION, AS TRUSTEE
Reel/Frame 055207/0913 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 19, 2017
From: KAPS, RYAN; BENTLEY, MICHAEL; BOSE, BHASKAR
To: BLAST MOTION INC.
Reel/Frame 043908/0329 →
Continuity (18)
Continuation In Part 15184949 · Jun 16, 2016
Continuation In Part 14801631 · Jul 16, 2015
Continuation In Part 14549422 · Nov 20, 2014
Continuation In Part 14257959 · Apr 21, 2014
Continuation In Part 13914525 · Jun 10, 2013
Continuation In Part 13679879 · Nov 16, 2012
Continuation In Part 13298158 · Nov 16, 2011
Continuation In Part 13267784 · Oct 6, 2011
Continuation In Part 13219525 · Aug 26, 2011
Continuation In Part 13191309 · Jul 26, 2011
Continuation In Part 13048850 · Mar 15, 2011
Continuation In Part 12901806 · Oct 11, 2010
Continuation 12868882 · Aug 26, 2010
Continuation 15590511
Continuation In Part 15184949 · Jun 16, 2016
Continuation In Part 14801631 · Jul 16, 2015
Continuation In Part 13757029 · Feb 1, 2013
Related Publication 20170262697A1 · Sep 14, 2017