IP Library Granted Patent US 9,578,399
Granted Patent B2
US 9,578,399 · App. 14/467,700 · Granted Feb 21, 2017

Remote sensor access and queuing

Inventors: Brian Mullins (Sierra Madre, CA); Matthew Kammerait (West Hollywood, CA); Christopher Broaddus (Mountain View, CA)
Assignee: DAQRI, LLC
H04Q9/00G02B27/017G06T11/60G08C17/00H04Q2209/47H04Q2209/75H04Q2209/84
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,578,399
App. No.
14/467,700
Granted
Feb 21, 2017
Kind
B2
Abstract

An application generates instructions to a wearable device to remotely activate a sensor in the wearable device and to receive sensor data from the sensor. A query related to a physical object is received. Instructions to wearable devices are generated to remotely activate at least one sensor of the wearable devices in response to the query. Sensor data is received from at least one of the wearable devices in response to that wearable device being within a range of the physical object.

Claims (34)

1. A server comprising:

a hardware processor comprising a remote sensor application, the remote sensor application comprising:

a queuing module configured to receive a query to identify a physical object, a location of the physical object, a three-dimensional model of the physical object, and a sensor reading from a sensor of the physical object, to generate instructions to a plurality of wearable devices to remotely activate at least one sensor of the plurality of wearable devices in response to the query, and to receive sensor data from at least one of the plurality of wearable devices in response to the at least one of the plurality of wearable devices being within a range of the physical object;

an object recognition module configured to build the three-dimensional model of the physical object based on the sensor data; and

a data extraction module configured to optically extract the sensor reading of the sensor of the physical object in response to the query.

2. The server of claim 1 , wherein the at least one wearable device comprises a helmet comprising at least one camera, at least one depth sensor, at least one inertial sensor, and a visor comprising a transparent display that displays augmented reality content based on the sensor data.

3. The server of claim 2 , wherein the remote access module is further configured to remotely activate at least one of the camera, depth sensor, and inertial sensor of the at least one wearable device.

4. The server of claim 1 , wherein the sensor data comprise a video feed from a corresponding wearable device, depth sensor data from the corresponding wearable device, an orientation of the corresponding wearable device, and a location of the corresponding wearable device.

5. The server of claim 1 , wherein the queuing module is configured to determine whether at least one of the wearable devices is within the range of the physical object based on at least one of the identification of the physical object and the location of the physical object.

6. The server of claim 5 , wherein the range corresponds to a threshold sensor range within which a three-dimensional model of the physical object is built based on the sensor data.

7. The server of claim 1 , wherein the at least one sensor is configured to generate sensor data at a rate that is based on at least the relative distance between the plurality of wearable devices or the distances between each of the wearable devices and the physical object.

8. The server of claim 1 , wherein the hardware processor further comprises:

a remote access module configured to generate instructions to remotely activate at least one sensor of at least one wearable device and to receive sensor data from the at least one sensor of the at least one wearable device.

9. A method comprising:

receiving a query to identify a physical object, a location of the physical object, a three-dimensional model of the physical object, and a sensor reading from a sensor of the physical object;

generating, implemented by a hardware processor, instructions to the plurality of wearable devices to remotely activate at least one sensor of the plurality of wearable devices in response to the query;

receiving sensor data from at least one of the plurality of wearable devices in response to the at least one of the plurality of the wearable devices being within a range of the physical object;

building the three-dimensional model of the physical object based on the sensor data; and

optically extracting the sensor reading of the sensor of the physical object in response to the query.

10. The method of claim 9 , wherein the at least one wearable device comprises a helmet comprising at least one camera, at least one depth sensor, at least one inertial sensor, and a visor comprising a transparent display that displays augmented reality content based on the sensor data.

11. The method of claim 10 , further comprising:

remotely activating at least one of the camera, depth sensor, and inertial sensor of the at least one wearable device.

12. The method of claim 9 , wherein the sensor data comprise a video feed from a corresponding wearable device, depth sensor data from the corresponding wearable device, an orientation of the corresponding wearable device, and a location of the corresponding wearable device.

13. The method of claim 9 , further comprising:

determining whether at least one of the wearable devices is within the range of the physical object based on at least one of the identification of the physical object and the location of the physical object.

14. The method of claim 13 , wherein the range corresponds to a threshold sensor range within which a three-dimensional model of the physical object is built based on the sensor data.

15. The method of claim 9 ,

wherein the at least one sensor is configured to generate sensor data at a rate that is based on at least the relative distance between the plurality of wearable devices or the distances between each of the wearable devices and the physical object.

16. A non-transitory machine-readable medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

receiving a query to identify a physical object, a location of the physical object, a three-dimensional model of the physical object, and a sensor reading from a sensor of the physical object;

generating instructions to the plurality of wearable devices to remotely activate at least one sensor of the plurality of wearable devices in response to the query;

receiving sensor data from at least one of the plurality of wearable devices in response to the at least one of the plurality of the wearable devices being within a range of the physical object;

building the three-dimensional model of the physical object based on the sensor data; and

optically extracting the sensor reading of the sensor of the physical object in response to the query.

Assignments (12)
CHANGE OF NAME Recorded Aug 3, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060936/0494 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 2, 2021
From: RPX CORPORATION
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 056777/0588 →
RELEASE OF SECURITY INTEREST Recorded Oct 26, 2020
From: JEFFERIES FINANCE LLC
To: RPX CORPORATION
Reel/Frame 054486/0422 →
PATENT SECURITY AGREEMENT Recorded Oct 23, 2020
From: RPX CLEARINGHOUSE LLC; RPX CORPORATION
To: BARINGS FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 054198/0029 →
PATENT SECURITY AGREEMENT Recorded Oct 23, 2020
From: RPX CLEARINGHOUSE LLC; RPX CORPORATION
To: BARINGS FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 054244/0566 →
RELEASE OF SECURITY INTEREST Recorded Aug 14, 2020
From: AR HOLDINGS I, LLC
To: DAQRI, LLC
Reel/Frame 053498/0580 →
PATENT SECURITY AGREEMENT Recorded Aug 14, 2020
From: RPX CORPORATION
To: JEFFERIES FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 053498/0095 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 5, 2020
From: DAQRI, LLC
To: RPX CORPORATION
Reel/Frame 053413/0642 →
RELEASE OF SECURITY INTEREST Recorded Oct 23, 2019
From: SCHWEGMAN, LUNDBERG & WOESSNER, P.A.
To: DAQRI, LLC
Reel/Frame 050805/0606 →
LIEN Recorded Oct 8, 2019
From: DAQRI, LLC
To: SCHWEGMAN, LUNDBERG & WOESSNER, P.A.
Reel/Frame 050672/0601 →
SECURITY INTEREST Recorded Jun 26, 2019
From: DAQRI, LLC
To: AR HOLDINGS I LLC
Reel/Frame 049596/0965 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 8, 2015
From: MULLINS, BRIAN; KAMMERAIT, MATTHEW; BROADDUS, CHRISTOPHER
To: DAQRI, LLC
Reel/Frame 035357/0001 →
Continuity (1)
Related Publication 20160057511A1 · Feb 25, 2016