IP Library Granted Patent US 12,413,813
Granted Patent B2
US 12,413,813 · App. 18/654,205 · Granted Sep 9, 2025

Systems and methods for real-time generation of live event audience analytics

Inventors: John Denton Vars (San Francisco, CA); Vikram Singh (San Francisco, CA)
Assignee: Mixhalo Corp.
H04N21/44218
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,413,813
App. No.
18/654,205
Granted
Sep 9, 2025
Kind
B2
Abstract

A method for real-time generation of live event audience behavioral data includes receiving a data representation of a live audio signal corresponding to the live event via a wireless network and processing the data representation of the live audio signal into a live audio stream. The method also includes calculating a first location of a mobile computing device with respect to a reference point based on first location data. The method also includes generating sensor data based on one or more sensors of the mobile computing device. The method also includes calculating a second location of the mobile computing device with respect to the first location based on second location data. The method also includes determining an audience member behavior based on the sensor data and the second location, and determining a corresponding event based on the live audio stream and a time stamp associated with the audience member behavior.

Claims (65)

1. A computerized method for real-time generation of live event audience behavioral data, the method comprising:

receiving, by a mobile computing device at a live event, a data representation of a live audio signal corresponding to the live event via a wireless network;

processing, by the mobile computing device at the live event, the data representation of the live audio signal into a live audio stream;

calculating, by the mobile computing device at the live event, a first location of the mobile computing device with respect to a reference point at the live event based on first location data;

generating, by the mobile computing device at the live event, sensor data based on one or more sensors of the mobile computing device at the live event;

calculating, by the mobile computing device at the live event, a second location of the mobile computing device with respect to the first location based on second location data;

determining, by the mobile computing device at the live event, an audience member behavior based on the generated sensor data and the calculated second location; and

determining, by the mobile computing device at the live event, a corresponding event based on the live audio stream and a time stamp associated with the audience member behavior.

2. The computerized method of claim 1 , wherein the mobile computing device at the live event is configured to receive the data representation of the live audio signal corresponding to the live event from an audio server computing device via the wireless network.

3. The computerized method of claim 1 , wherein the mobile computing device at the live event is configured to:

determine the first location data based on first audio captured by a microphone of the mobile computing device; and

determine the second location data based on second audio captured by the microphone of the mobile computing device.

4. The computerized method of claim 3 , wherein the first location data comprises a first distance from the reference point at the live event and the second location data comprises a second distance from the first location.

5. The computerized method of claim 1 , wherein the mobile computing device at the live event is configured to receive at least one of the first location data or the second location data from a second mobile computing device at the live event.

6. The computerized method of claim 1 , wherein the mobile computing device at the live event is configured to receive at least one of the first location data or the second location data from an access point at the live event.

7. The computerized method of claim 1 , where the one or more sensors of the mobile computing device at the live event comprise at least one of:

a camera;

an accelerometer;

an ambient light sensor;

an ambient temperature sensor;

an air humidity sensor;

a barometer sensor;

a fingerprint sensor;

a gyroscope sensor;

a magnetometer;

a near-field communication sensor;

a Bluetooth communication sensor;

a proximity sensor; or

a pedometer sensor.

8. The computerized method of claim 1 , wherein the audience member behavior comprises at least one of sitting, standing, dancing, cheering, using a bathroom at a venue associated with the live event, making a purchase at a concession stand of the venue, making a purchase at a merchandise stand of the venue, or leaving the venue.

9. The computerized method of claim 1 , wherein the corresponding event comprises a musical track performed at the live event.

10. The computerized method of claim 1 , wherein the corresponding event comprises a sport-related event performed at the live event.

11. A system for real-time generation of live event audience behavioral data, the system comprising:

a mobile computing device communicatively coupled to an audio server computing device over a wireless network, the mobile computing device configured to:

receive a data representation of a live audio signal corresponding to the live event via the wireless network;

process the data representation of the live audio signal into a live audio stream;

calculate a first location of the mobile computing device with respect to a reference point at the live event based on first location data;

generate sensor data based on one or more sensors of the mobile computing device at the live event;

calculate a second location of the mobile computing device with respect to the first location based on second location data;

determine an audience member behavior based on the generated sensor data and the calculated second location; and

determine a corresponding event based on the live audio stream and a time stamp associated with the audience member behavior.

12. The system of claim 11 , wherein the mobile computing device at the live event is configured to receive the data representation of the live audio signal corresponding to the live event from the audio server computing device via the wireless network.

13. The system of claim 11 , wherein the mobile computing device at the live event is configured to:

determine the first location data based on first audio captured by a microphone of the mobile computing device; and

determine the second location data based on second audio captured by the microphone of the mobile computing device.

14. The system of claim 13 , wherein the first location data comprises a first distance from the reference point at the live event and the second location data comprises a second distance from the first location.

15. The system of claim 11 , wherein the mobile computing device at the live event is configured to receive at least one of the first location data or the second location data from a second mobile computing device at the live event.

16. The system of claim 11 , wherein the mobile computing device at the live event is configured to receive at least one of the first location data or the second location data from an access point at the live event.

17. The system of claim 11 , where the one or more sensors of the mobile computing device at the live event comprise at least one of:

a camera;

an accelerometer;

an ambient light sensor;

an ambient temperature sensor;

an air humidity sensor;

a barometer sensor;

a fingerprint sensor;

a gyroscope sensor;

a magnetometer;

a near-field communication sensor;

a Bluetooth communication sensor;

a proximity sensor; or

a pedometer sensor.

18. The system of claim 11 , wherein the audience member behavior comprises at least one of sitting, standing, dancing, cheering, using a bathroom at a venue associated with the live event, making a purchase at a concession stand of the venue, making a purchase at a merchandise stand of the venue, or leaving the venue.

19. The system of claim 11 , wherein the corresponding event comprises a musical track performed at the live event.

20. The system of claim 11 , wherein the corresponding event comprises a sport-related event performed at the live event.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 1, 2025
From: SINGH, VIKRAM
To: MIXHALO CORP.
Reel/Frame 071913/0352 →
Continuity (2)
Provisional Application 63463595 · May 3, 2023
Related Publication 20240373091A1 · Nov 7, 2024
References Cited (19)
US 11461070B2 · Einziger et al. · 2022 [cited by applicant]
US 11625213B2 · Einziger et al. · 2023 [cited by applicant]
US 20150058129A1 · Nevid · 2015 [cited by examiner]
US 20160027209A1 · Demirli · 2016 [cited by examiner]
US 20160173927A1 · de Sa · 2016 [cited by examiner]
US 20160192156A1 · Freeman · 2016 [cited by examiner]
US 20160360377A1 · Lovich · 2016 [cited by examiner]
US 20170124578A1 · Bennett · 2017 [cited by examiner]
US 20180096367A1 · Zamer · 2018 [cited by examiner]
US 20190304216A1 · Mendelson · 2019 [cited by examiner]
US 20200320592A1 · Soule · 2020 [cited by examiner]
US 20200351321A1 · Lueth · 2020 [cited by examiner]
US 20220030214A1 · Sinharoy · 2022 [cited by examiner]
US 20230020399A1 · Singh et al. · 2023 [cited by applicant]
US 20240021218A1 · Singh et al. · 2024 [cited by applicant]
US 20240022769A1 · Singh · 2024 [cited by examiner]
US 20240276075A1 · Miller · 2024 [cited by examiner]
A. Alruban et al., Physical Activity Recognition by Utilising Smartphone Sensor Signals, Jan. 20, 2022, 10 pages, arxiv.org/pdf/2201.08688. [cited by applicant]
J. Rabbi et al., Human Activity Analysis and Recognition from Smartphones using Machine Learning Techniques, Mar. 30, 2021, arXiv:2103.16490. [cited by applicant]