IP Library Granted Patent US 9,830,395
Granted Patent B2
US 9,830,395 · App. 14/461,266 · Granted Nov 28, 2017

Spatial data processing

Inventors: Brian Mullins (Sierra Madre, CA); Matthew Kammerait (West Hollywood, CA); Frank Chester Irving, Jr. (Woodland Hills, CA)
Assignee: DAQRI, LLC
G06F17/3087
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,830,395
App. No.
14/461,266
Granted
Nov 28, 2017
Kind
B2
Abstract

A system and method for spatial data processing are described. Path bundle data packages from a viewing device are accessed and processed. The path bundle data packages identify a user interaction of the viewing device with an augmented reality content relative to and based on a physical object captured by the viewing device. The path bundle data packages are generated based on the sensor data using a data model comprising a data header and a data payload. The data header comprises a contextual header having data identifying the viewing device and a user of the viewing device. A path header having data identifies the path of the interaction with the augmented reality content. A sensor header having data identifies the plurality of sensors. The data payload comprises dynamically sized sampling data from the sensor data. The path bundle data packages are normalized and aggregated. Analytics computation is performed on the normalized and aggregated path bundle data packages.

Claims (48)

1. A method comprising:

receiving, by a computing server, path bundle data packages from a head mounted viewing device, each path bundle data package including sensor data describing an orientation of the head mounted viewing device in relation to a physical object and indicating a portion of the physical object that is in a line of sight of a user wearing the head mounted viewing device;

determining, based on an aggregation of the path bundle data packages, a viewing pattern of the user wearing the viewing device in relation to the physical object, the viewing pattern indicating a sequential order in which portions of the physical object were in the line of sight of the user during a period of time;

comparing the viewing pattern of the user to a set of previously detected viewing patterns that preceded detected errors, yielding a comparison, the set of previously detected viewing patterns determined based on path bundle data packages received from a plurality of other users, and each previously detected viewing pattern indicating a detected sequential order in which portions of the physical object were in a line of sight of a respected other user during a previous period of time;

determining, based on the comparison, that the viewing pattern of the user matches a first previously detected viewing pattern, the first previously detected viewing pattern having preceded a first error; and

transmitting, to the viewing device, data causing the head mounted viewing device to display a message warning the user of the first error.

2. The method of claim 1 , further comprising:

normalizing the path bundle data packages.

3. The method of claim 1 , wherein the head mounted viewing device comprises a plurality of sensors, including an optical sensor and an inertia sensor.

4. The method of claim 1 , wherein each path bundle data package comprises a viewing device identifier, a session identifier, a physical location, a viewing device type, and a time.

5. The method of claim 1 , wherein the message warning the user of the first error comprises a visual indicator that redirects the user to an identified focus point of the physical object.

6. The method of claim 1 , further comprising:

prior to receiving the path bundle data packages from the head mounted viewing device, receiving, from at least two other head mounted viewing devices, previously received path bundle data packages; and

determining, based on an aggregation of the previously received path bundle data packages, the set of previously detected viewing patterns.

7. The method of claim 6 , wherein the previously received path bundle data packages include sensor data describing an orientation of the at least two other head mounted viewing devices in relation to the physical object.

8. A system comprising:

one or more computer processors; and

one or more computer readable mediums storing instructions that, when executed by the one or more computer processors, cause the system to perform operations comprising:

receiving path bundle data packages from a head mounted viewing device, each path bundle data package including sensor data describing an orientation of the head mounted viewing device in relation to a physical object and indicating a portion of the physical object that is in a line of sight of a user wearing the head mounted viewing device;

determining, based on an aggregation of the path bundle data packages, a viewing pattern of the user wearing the viewing device in relation to the physical object, the viewing pattern indicating a sequential order in which portions of the physical object were in the line of sight of the user during a period of time;

comparing the viewing pattern of the user to a set of previously detected viewing patterns that preceded detected errors, yielding a comparison, the set of previously detected viewing patterns determined based on path bundle data packages received from a plurality of other users, and each previously detected viewing pattern indicating a detected sequential order in which portions of the physical object were in a line of sight of a respected other user during a previous period of time;

determining, based on the comparison, that the viewing pattern of the user matches a first previously detected viewing pattern, the first previously detected viewing pattern having preceded a first error; and

transmitting, to the viewing device, data causing the viewing to display a message warning the user of the first error.

9. The system of claim 8 , the operations further comprising:

normalizing the path bundle data packages.

10. The system of claim 8 , wherein the head mounted viewing device comprises a plurality of sensors, including an optical sensor and an inertia sensor.

11. The system of claim 8 , wherein each path bundle data package comprises a viewing device identifier, a session identifier, a physical location, a viewing device type, and a time.

12. The system of claim 8 , wherein the message warning the user of the first error comprises a visual indicator that redirects the user to an identified focus point of the physical object.

13. The system of claim 8 , the operations further comprising:

prior to receiving the path bundle data packages from the head mounted viewing device, receiving, from at least two other head mounted viewing devices, previously received path bundle data packages; and

determining, based on an aggregation of the previously received path bundle data packages, the set of previously detected viewing patterns.

14. The system of claim 13 , wherein the previously received path bundle data packages include sensor data describing an orientation of the at least two other head mounted viewing devices in relation to the physical object.

15. A non-transitory computer readable medium storing instructions that, when executed by one or more computer processors of a computing server, cause the computing server to perform operations comprising:

receiving path bundle data packages from a head mounted viewing device, each path bundle data package including sensor data describing an orientation of the head mounted viewing device in relation to a physical object and indicating a portion of the physical object that is in a line of sight of a user wearing the head mounted viewing device;

determining, based on an aggregation of the path bundle data packages, a viewing pattern of the user wearing the viewing device in relation to the physical object, the viewing pattern indicating a sequential order in which portions of the physical object were in the line of sight of the user during a period of time;

comparing the viewing pattern of the user to a set of previously detected viewing patterns that preceded detected errors, yielding a comparison, the set of previously detected viewing patterns determined based on path bundle data packages received from a plurality of other users, and each previously detected viewing pattern indicating a detected sequential order in which portions of the physical object were in a line of sight of a respected other user during a previous period of time;

determining, based on the comparison, that the viewing pattern of the user matches a first previously detected viewing pattern, the first previously detected viewing pattern having preceded a first error; and

transmitting, to the viewing device, data causing the viewing to display a message warning the user of the first error.

16. The non-transitory computer readable medium of claim 15 , the operations further comprising:

normalizing the path bundle data packages.

17. The non-transitory computer readable medium of claim 15 , wherein the head mounted viewing device comprises a

plurality of sensors, including an optical sensor and an inertia sensor.

18. The non-transitory computer readable medium of claim 15 , wherein each path bundle data package comprises a viewing device identifier, a session identifier, a physical location, a viewing device type, and a time.

19. The non-transitory computer readable medium of claim 15 , wherein the message warning the user of the first error comprises a visual indicator that redirects the user to an identified focus point of the physical object.

20. The non-transitory computer readable medium of claim 15 , the operations further comprising:

prior to receiving the path bundle data packages from the head mounted viewing device, receiving, from at least two other head mounted viewing devices, previously received path bundle data packages; and

determining, based on an aggregation of the previously received path bundle data packages, the set of previously detected viewing patterns.

21. The non-transitory computer readable medium of claim 20 , wherein the previously received path bundle data packages include sensor data describing an orientation of the at least two other head mounted viewing devices in relation to the physical object.

Assignments (12)
CHANGE OF NAME Recorded Aug 3, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060936/0494 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 2, 2021
From: RPX CORPORATION
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 056777/0588 →
RELEASE OF SECURITY INTEREST Recorded Oct 26, 2020
From: JEFFERIES FINANCE LLC
To: RPX CORPORATION
Reel/Frame 054486/0422 →
PATENT SECURITY AGREEMENT Recorded Oct 23, 2020
From: RPX CLEARINGHOUSE LLC; RPX CORPORATION
To: BARINGS FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 054198/0029 →
PATENT SECURITY AGREEMENT Recorded Oct 23, 2020
From: RPX CLEARINGHOUSE LLC; RPX CORPORATION
To: BARINGS FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 054244/0566 →
RELEASE OF SECURITY INTEREST Recorded Aug 14, 2020
From: AR HOLDINGS I, LLC
To: DAQRI, LLC
Reel/Frame 053498/0580 →
PATENT SECURITY AGREEMENT Recorded Aug 14, 2020
From: RPX CORPORATION
To: JEFFERIES FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 053498/0095 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 5, 2020
From: DAQRI, LLC
To: RPX CORPORATION
Reel/Frame 053413/0642 →
RELEASE OF SECURITY INTEREST Recorded Oct 23, 2019
From: SCHWEGMAN, LUNDBERG & WOESSNER, P.A.
To: DAQRI, LLC
Reel/Frame 050805/0606 →
LIEN Recorded Oct 8, 2019
From: DAQRI, LLC
To: SCHWEGMAN, LUNDBERG & WOESSNER, P.A.
Reel/Frame 050672/0601 →
SECURITY INTEREST Recorded Jun 26, 2019
From: DAQRI, LLC
To: AR HOLDINGS I LLC
Reel/Frame 049596/0965 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 16, 2015
From: MULLINS, BRIAN; KAMMERAIT, MATTHEW; IRVING, FRANK CHESTER, JR.
To: DAQRI, LLC
Reel/Frame 035171/0277 →
Continuity (1)
Related Publication 20160048515A1 · Feb 18, 2016