IP Library Granted Patent US 9,978,174
Granted Patent B2
US 9,978,174 · App. 15/393,257 · Granted May 22, 2018

Remote sensor access and queuing

Inventors: Brian Mullins (Altadena, CA); Matthew Kammerait (Studio City, CA); Christopher Broaddus (Santa Clara, CA)
Assignee: DAQRI, LLC
G06T17/00G06F3/011G06T19/006H04Q9/00G06T2215/16H04Q2209/84
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,978,174
App. No.
15/393,257
Granted
May 22, 2018
Kind
B2
Abstract

An application generates instructions to a wearable device to remotely activate a sensor in the wearable device and to receive sensor data from the sensor. A query related to a physical object is received. Instructions to wearable devices are generated to remotely activate at least one sensor of the wearable devices in response to the query. Sensor data is received from at least one of the wearable devices in response to that wearable device being within a range of the physical object.

Claims (43)

1. A device comprising:

one or more hardware processors;

a memory storing instructions that, when executed by the one or more hardware processors, configure the device to perform operations comprising:

receiving a query to identify a physical object and a sensor reading from a sensor of the physical object;

identifying a first wearable device from a plurality of wearable devices, the first wearable device being within a detection range of the physical object in response to the query;

generating instructions to the first wearable device to extract the sensor reading from the sensor of the physical object;

receiving sensor data from the first wearable device in response to the instructions, the sensor data comprising the sensor reading; and

building a three-dimensional model of the physical object based on the sensor data.

2. The device of claim 1 , wherein the first wearable device comprises a camera, a depth sensor, an inertial sensor, and a transparent display that displays augmented reality content based on the sensor data.

3. The device of claim 2 , wherein the operations further comprise:

remotely activating the camera, the depth sensor, and the inertial sensor of the first wearable device.

4. The device of claim 1 , wherein the sensor data further comprises a video feed from the first wearable device, depth sensor data from the first wearable device, an orientation of the first wearable device, and a location of the first wearable device.

5. The device of claim 1 , wherein the query further identifies a location of the physical object.

6. The device of claim 1 , wherein the operations further comprise:

generating analytics data processed by a server to provide an information including one of a location of the physical object being detected, a location of the three-dimensional model of the physical object being detected, a location of the physical object being triggered, a location of the three-dimensional model of the physical object being triggered, a duration of the physical object being detected, a duration of the three-dimensional model of the physical object being detected and a combination thereof.

7. The device of claim 1 , wherein the operations further comprise:

determining whether the first wearable device is within the detection range of the physical object based on a distance between the first wearable device and the physical object.

8. The device of claim 7 , wherein the detection range corresponds to a threshold range within where the three-dimensional model of the physical object is built based on the sensor data.

9. The device of claim 1 , wherein the sensor data from the first wearable device is generated at a rate that is based on at least the relative distance between the plurality of wearable devices or the distances between each of the wearable devices and the physical object.

10. The device of claim 9 , wherein the rate increases in response to the distance between the first wearable device and the physical object decreasing.

11. A method comprising:

receiving a query to identify a physical object and a sensor reading from a sensor of the physical object;

identifying a first wearable device from a plurality of wearable devices, the first wearable device being within a detection range of the physical object in response to the query;

generating instructions to the first wearable device to extract the sensor reading from the sensor of the physical object;

receiving sensor data from the first wearable device in response to the instructions, the sensor data comprising the sensor reading; and

building a three-dimensional model of the physical object based on the sensor data.

12. The method of claim 11 , wherein the first wearable device comprises a camera, a depth sensor, an inertial sensor, and a transparent display that displays augmented reality content based on the sensor data.

13. The method of claim 12 , further comprising:

remotely activating the camera, the depth sensor, and the inertial sensor of the first wearable device.

14. The method of claim 11 , wherein the sensor data further comprises a video feed from the first wearable device, depth sensor data from the first wearable device, an orientation of the first wearable device, and a location of the first wearable device.

15. The method of claim 11 , wherein the query further identifies a location of the physical object.

16. The method of claim 11 , further comprising:

generating analytics data processed by a server to provide an information including one of a location of the physical object being detected, a location of the three-dimensional model of the physical object being detected, a location of the physical object being triggered, a location of the three-dimensional model of the physical object being triggered, a duration of the physical object being detected, a duration of the three-dimensional model of the physical object being detected and a combination thereof.

17. The method of claim 11 , further comprising:

determining whether the first wearable device is within the detection range of the physical object based on a distance between the first wearable device and the physical object.

18. The method of claim 17 , wherein the detection range corresponds to a threshold range within where the three-dimensional model of the physical object is built based on the sensor data.

19. The method of claim 11 , wherein the sensor data from the first wearable device is generated at a rate that is based on at least the relative distance between the plurality of wearable devices or the distances between each of the wearable devices and the physical object.

20. A non-transitory machine-readable medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

receiving a query to identify a physical object and a sensor reading from a sensor of the physical object;

identifying a first wearable device from a plurality of wearable devices, the first wearable device being within a detection range of the physical object in response to the query;

generating instructions to the first wearable device to extract the sensor reading from the sensor of the physical object;

receiving sensor data from the first wearable device in response to the instructions, the sensor data comprising the sensor reading; and

building a three-dimensional model of the physical object based on the sensor data.

Assignments (12)
CHANGE OF NAME Recorded Aug 3, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060936/0494 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 2, 2021
From: RPX CORPORATION
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 056777/0588 →
RELEASE OF SECURITY INTEREST Recorded Oct 26, 2020
From: JEFFERIES FINANCE LLC
To: RPX CORPORATION
Reel/Frame 054486/0422 →
PATENT SECURITY AGREEMENT Recorded Oct 23, 2020
From: RPX CLEARINGHOUSE LLC; RPX CORPORATION
To: BARINGS FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 054198/0029 →
PATENT SECURITY AGREEMENT Recorded Oct 23, 2020
From: RPX CLEARINGHOUSE LLC; RPX CORPORATION
To: BARINGS FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 054244/0566 →
RELEASE OF SECURITY INTEREST Recorded Aug 14, 2020
From: AR HOLDINGS I, LLC
To: DAQRI, LLC
Reel/Frame 053498/0580 →
PATENT SECURITY AGREEMENT Recorded Aug 14, 2020
From: RPX CORPORATION
To: JEFFERIES FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 053498/0095 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 5, 2020
From: DAQRI, LLC
To: RPX CORPORATION
Reel/Frame 053413/0642 →
RELEASE OF SECURITY INTEREST Recorded Oct 23, 2019
From: SCHWEGMAN, LUNDBERG & WOESSNER, P.A.
To: DAQRI, LLC
Reel/Frame 050805/0606 →
LIEN Recorded Oct 8, 2019
From: DAQRI, LLC
To: SCHWEGMAN, LUNDBERG & WOESSNER, P.A.
Reel/Frame 050672/0601 →
SECURITY INTEREST Recorded Jun 26, 2019
From: DAQRI, LLC
To: AR HOLDINGS I LLC
Reel/Frame 049596/0965 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 29, 2016
From: MULLINS, BRIAN; KAMMERAIT, MATTHEW; BROADDUS, CHRISTOPHER
To: DAQRI, LLC
Reel/Frame 040791/0889 →
Continuity (2)
Continuation 14467700 · Aug 25, 2014
Related Publication 20170109923A1 · Apr 20, 2017