IP Library Granted Patent US 11,327,150
Granted Patent B2
US 11,327,150 · App. 16/545,426 · Granted May 10, 2022

Mobile device based control device locator

Inventors: Gregory Mack Garner (Los Gatos, CA); Patrick Alan Brouillette (Los Gatos, CA)
Assignee: Roku, Inc.
G01S5/18G01S3/80G01S3/801G01S3/802G01S3/8083G01S5/28H04W4/02H04W64/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,327,150
App. No.
16/545,426
Granted
May 10, 2022
Kind
B2
Abstract

Disclosed herein are system, apparatus, article of manufacture, method, and/or computer program product embodiments for a mobile device based control device locator. An embodiment operates by receiving a request to locate a control device, transmitting acoustic token transmission information to the control device to activate an electroacoustic transducer on the control device, receiving an acoustic signal including an acoustic token signal from the control device via a plurality of acoustic sensors, and determining distance information of the control device based on the received acoustic token signal generated by the electroacoustic transducer of the control device.

Claims (59)

1. A mobile device comprising:

at least one processor; and

a memory operatively coupled to the at least one processor, wherein the at least one processor is configured to:

generate acoustic token transmission information based at least on frequency information, in response to a request to locate a control device,

transmit the acoustic token transmission information to the control device via a radio frequency circuit to activate an electroacoustic transducer on the control device,

receive acoustic input information for a plurality of acoustic sensors configured to receive an acoustic token signal generated and emitted by the control device based at least partially on the acoustic token transmission information, and

determine direction information and distance information of the control device based at least on the received acoustic input information.

2. The mobile device of claim 1 , further comprising:

a touch sensitive display component operatively coupled to the at least one processor, wherein the touch sensitive display component is configured to visually present, on a display of the mobile device, the direction information of the control device as a first graphical UI element and the distance information of the control device as a second graphical UI element.

3. The mobile device of claim 2 , wherein

the first graphical UI element and the second graphical UI element are visually presented on the display of the mobile device and continuously updated based at least on the control device direction information and/or orientation information associated with the mobile device.

4. The mobile device of claim 1 , further comprising:

a communications component comprising the radio frequency circuit operatively coupled to the at least one processor, wherein the communications component is configured to at least encode the acoustic token transmission information as radio signals in at least one frequency associated with at least one wireless communications standard.

5. The mobile device of claim 1 , further comprising:

an acoustic information component comprising the plurality of acoustic sensors operatively coupled to the at least one processor, wherein the acoustic information component is configured to receive and store acoustic signals including the acoustic token signal generated and emitted by the control device as the acoustic input information.

6. The mobile device of claim 1 , wherein the at least one processor is further configured to:

receive touch input information indicating the request to locate the control device via a graphical UI element visually presented on a display of the mobile device, and

initiate a high resolution timer substantially contemporaneous with a transmission of the acoustic token transmission information to the control device.

7. The mobile device of claim 1 , wherein the acoustic token transmission information further comprises at least one of: waveform information, phase information, power information, or any combination thereof.

8. A computer-implemented method, comprising:

generating, by a mobile device, acoustic token transmission information based at least on frequency information, in response to a request to locate a control device,

transmitting, by the mobile device, the acoustic token transmission information to the control device via a radio frequency circuit to activate an electroacoustic transducer on the control device,

receiving, by the mobile device, acoustic input information for a plurality of acoustic sensors configured to receive an acoustic token signal generated and emitted by the control device based at least partially on the acoustic token transmission information, and

determining, by the mobile device, direction information and distance information of the control device based at least on the received acoustic input information.

9. The computer-implemented method of claim 8 , further comprising:

visually presenting, by the mobile device, the direction information of the control device as a first graphical UI element and the distance information of the control device as a second graphical UI element on a display of the mobile device.

10. The computer-implemented method of claim 8 , further comprising:

receiving, by the mobile device, touch input information indicating the request to locate the control device via a graphical UI element visually presented on a display of the mobile device; and

initiating, by the mobile device, a high resolution timer substantially contemporaneous with a transmission of the acoustic token transmission information to the control device.

11. The computer-implemented method of claim 10 , further comprising:

determining, by the mobile device, acoustic sensor information based at least on the acoustic input information and corresponding values generated by the high resolution timer;

storing, by the mobile device, the acoustic sensor information for each of the plurality of acoustic sensors; and

determining, by the mobile device, aggregate acoustic delay information for each of the plurality of acoustic sensors, wherein the aggregate acoustic delay information for an acoustic sensor represents a time indicative of when the acoustic token signal is received by the acoustic sensor.

12. The computer-implemented method of claim 11 , wherein the determining of the aggregate acoustic delay information further comprises:

determining, by the mobile device, the time indicative of when the acoustic token signal is received for each of the plurality of acoustic sensors based at least on the acoustic sensor information and the acoustic token transmission information.

13. The computer-implemented method of claim 11 , further comprising:

receiving, by the mobile device, control device acknowledgement information via the radio frequency circuit from the control device; and

determining, by the mobile device, network and computation delay information between the mobile device and the control device based at least on a current value of the high resolution timer upon receiving the control device acknowledgement information.

14. The computer-implemented method of claim 13 , further comprising:

determining, by the mobile device, acoustic delay information, for each of the plurality of acoustic sensors based at least on a difference between the aggregate acoustic delay information for each of the plurality of acoustic sensors and the network and computation delay information between the mobile device and the control device, wherein the determining of the direction information further comprises comparing acoustic delay information between at least two of the plurality of acoustic sensors.

15. A tangible computer-readable device having instructions stored thereon that, when executed by a computing device, cause the computing device to perform operations comprising:

generating, by the computing device, acoustic token transmission information based at least on frequency information, in response to a request to locate a control device,

transmitting, by the computing device, the acoustic token transmission information to the control device via a radio frequency circuit to activate an electroacoustic transducer on the control device,

receive acoustic input information for a plurality of acoustic sensors configured to receive an acoustic token signal generated and emitted by the control device based at least partially on the acoustic token transmission information, and

determine direction information and distance information of the control device based at least on the received acoustic input information.

16. The tangible computer-readable device of claim 15 , wherein the operations further comprise:

visually presenting, by the computing device, the direction information of the control device as a first graphical UI element and the distance information of the control device as a second graphical UI element on a display of the computing device.

17. The tangible computer-readable device of claim 16 , wherein the operations further comprise:

determining, by the computing device, acoustic sensor information based at least on the acoustic input information and corresponding values generated by a high resolution timer;

storing, by the computing device, the acoustic sensor information for each of the plurality of acoustic sensors; and

determining, by the computing device, aggregate acoustic delay information for each of the plurality of acoustic sensors, wherein the aggregate acoustic delay information for an acoustic sensor represents a time indicative of when the acoustic token signal is received by the acoustic sensor.

18. The tangible computer-readable device of claim 17 , wherein the operations further comprise:

determining, by the computing device, the time indicative of when the acoustic token signal is received for each of the plurality of acoustic sensors based at least on the acoustic sensor information and the acoustic token transmission information.

19. The tangible computer-readable device of claim 18 , wherein the operations further comprise:

receiving, by the computing device, control device acknowledgement information via the radio frequency circuit from the control device;

determining, by the computing device, network and computation delay information between the computing device and the control device based at least on a current value of the high resolution timer upon receiving the control device acknowledgement information; and

determining, by the computing device, acoustic delay information for each of the plurality of acoustic sensors based at least on a difference between the aggregate acoustic delay information for each of the plurality of acoustic sensors and the network and computation delay information between the computing device and the control device.

20. The tangible computer-readable device of claim 19 , wherein the operation for determining the distance information further comprises:

calculating, by the computing device, the distance information based at least on the acoustic delay information for at least one acoustic sensor of the plurality of acoustic sensors and sound speed information representative of speed of sound.

Assignments (4)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 051300/0931) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0205 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 25, 2022
From: GARNER, GREGORY MACK; BROUILLETTE, PATRICK ALAN
To: ROKU, INC.
Reel/Frame 059703/0048 →
SECURITY INTEREST Recorded Dec 16, 2019
From: ROKU, INC.; ROKU DX HOLDINGS, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051300/0931 →
Continuity (2)
Continuation 14813766 · Jul 30, 2015
Related Publication 20190369206A1 · Dec 5, 2019