IP Library Granted Patent US 9,729,227
Granted Patent B2
US 9,729,227 · App. 15/140,319 · Granted Aug 8, 2017

Coordinating devices to estimate distance, relative position, and device attitude

Inventors: Stanislav Vonog (San Francisco, CA); Tara Lemmey (San Francisco, CA); Maxim Bykov (San Francisco, CA); Nikolay Surin (San Francisco, CA)
Assignee: Wickr Inc.
H04B7/26G01S5/0247G01S5/0289G01S5/18G01S5/186
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,729,227
App. No.
15/140,319
Granted
Aug 8, 2017
Kind
B2
Abstract

The present invention contemplates a variety of improved techniques including methods and apparatus for coordinating a plurality of devices, and more specifically, a method and apparatus for coordinating a plurality of devices to estimate or calculate various distances, relative positions, device attitudes, and other absolute and/or relative kinematic data.

Claims (54)

1. A method comprising:

defining a first audio signal having specific signal characteristics making the first audio signal recognizable by at least another user device;

causing a first user device to broadcast the first audio signal according to the defined signal characteristics, while the first user device is in motion;

receiving, via a computer network, data associated with a first identifiable version of the first audio signal having the specific signal characteristics as received at a second user device in audible proximity to the first user device;

receiving, via the computer network, data associated with a second identifiable version of the first audio signal having the specific signal characteristics as received at a third user device in audible proximity to the first user device;

estimating a position and orientation of the first user device relative to the second user device and the third user device based on a detected difference in the first and second identifiable versions of the first audio signal as received at the second user device and the third user device; and

generating, while the first user device is in motion, a spatial model that tracks a motion of the first user device relative to the second user device and the third user device based on a plurality of estimated positions and orientations of the first user device over a period of time.

2. The method according to claim 1 , further comprising:

applying a gesture recognition process to the tracked motion of the first user device in the generated spatial model to recognize a gesture performed by a user of the first user device.

3. A method according to claim 1 , further comprising:

causing display of content at any of the first user device, the second user device, or the third user device based on the recognized gesture performed by the user of the first user device.

4. The method according to claim 1 , wherein the detected difference in the first and second versions of the first audio signal include a detected difference in the amplitude of the first audio signal as received at the second user device and the third user device.

5. The method according to claim 1 , further comprising:

recording the first identifiable version of the first audio signal having the specific signal characteristics as received at the second user device; and

recording the second identifiable version of the first audio signal having the specific signal characteristics as received at the third user device.

6. The method according to claim 1 , further comprising:

causing a change in display of a user interface at the first user device based on the estimated a position or orientation of the first user device relative to the second user device or the third user device.

7. An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs,

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following,

define a first audio signal having specific signal characteristics making the first audio signal recognizable by at least another user device;

cause a first user device to broadcast the first audio signal according to the defined specific signal characteristics, while the first user device is in motion;

receive, via a computer network, data associated with a first identifiable version of the first audio signal having the specific characteristics as received at a second user device in audible proximity to the first user device;

receive, via the computer network, data associated with a second identifiable version of the first audio signal having the specific signal characteristics as received at a third user device in audible proximity to the first user device;

estimate a position and orientation of the first user device relative to the second user device and the third user device based on a detected differences in the first and second identifiable versions of the first audio signal as received at the second user device and the third user device; and

generate, while the first user device is in motion, a spatial model that tracks a motion of the first user device relative to the second user device and the third user device based on a plurality of estimated positions and orientations of the first user device over a period of time.

8. The apparatus according to claim 7 , wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to further:

apply a gesture recognition process to the tracked motion of the first user device in the generated spatial model to recognize a gesture performed by a user of the first user device.

9. The apparatus according to claim 7 , wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to further:

cause display of content at any of the first user device, the second user device, or the third user device based on the recognized gesture performed by the user of the first user device.

10. The apparatus according to claim 7 , wherein the detected difference in the first and second versions of the first audio signal include a detected difference in the amplitude of the first audio signal as received at the second user device and the third user device.

11. The apparatus according to claim 7 , wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to further:

record the first identifiable version of the first audio signal having the specific signal characteristics as received at the second user device; and

record the second identifiable version of the first audio signal having the specific signal characteristics as received by the third user device.

12. The apparatus according to claim 7 , further comprising:

causing a change in display of a user interface at the first user device based on the estimated a position or orientation of the first user device relative to the second user device or the third user device.

13. A non-transient computer readable medium comprising instructions for causing a computer system to:

define a first audio signal having specific signal characteristics making the first audio signal recognizable by at least another user device;

cause a first user device to broadcast the first audio signal according to the defined signal characteristics, while the first user device is in motion;

receiving, via a computer network, data associated with a first identifiable version of the first audio signal having the specific signal characteristics as received at a second user device in audible proximity to the first user device;

receive, via the computer network, data associated with a second identifiable version of the first audio signal having the specific signal characteristics as received at a third user device in audible proximity to the first user device;

estimate a position and orientation of the first user device relative to the second user device and the third user device based on a detected difference in the first and second identifiable versions of the first audio signal as received at the second user device and the third user device; and

generate, while the first user device is in motion, a spatial model that tracks a motion of the first user device relative to the second user device and the third user device based on a plurality of estimated positions and orientations of the first user device over a period of time.

14. The non-transient computer readable medium of claim 13 , further comprising instructions for causing the computer system to further:

apply a gesture recognition process to the tracked motion of the first user device in the generated spatial model to recognize a gesture performed by a user of the first user device.

15. The non-transient computer readable medium of claim 13 , further comprising instructions for causing the computer system to further:

cause display of content at any of the first user device, the second user device, or the third user device based on the recognized gesture performed by the user of the first user device.

16. The non-transient computer readable medium of claim 13 , wherein the detected difference in the first and second versions of the first audio signal include a detected difference in the amplitude of the first audio signal as received at the second user device and the third user device.

17. The non-transient computer readable medium of claim 13 , further comprising instructions for causing the computer system to further:

record the first identifiable version of the first audio signal having the specific signal characteristics as received at the second user device; and

record the second identifiable version of the first audio signal having the specific signal characteristics as received by the third user device.

18. The non-transient computer readable medium of claim 13 , further comprising instructions for causing the computer system to further:

causing a change in display of a user interface at the first user device based on the estimated a position or orientation of the first user device relative to the second user device or the third user device.

Assignments (7)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2021
From: WICKR LLC
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 057366/0573 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jun 25, 2021
From: SILICON VALLEY BANK
To: WICKR INC.
Reel/Frame 056684/0366 →
SECURITY AGREEMENT Recorded Dec 12, 2017
From: WICKR INC.
To: SILICON VALLEY BANK
Reel/Frame 044872/0729 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 25, 2017
From: VONOG, STANISLAV; LEMMEY, TARA; SURIN, NIKOLAY; BYKOV, MAXIM
To: NET POWER AND LIGHT, INC.
Reel/Frame 041082/0632 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ADDRESS FROM 71 S. WACKER DR. SUITE 2385 CHICAGO, ILLINOIS 60606 TO 459 18TH ST., #313, SAN FRANCISCO, CALIFORNIA 94107 PREVIOUSLY RECORDED ON REEL 039810 FRAME 0277. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER. Recorded Oct 24, 2016
From: NET POWER AND LIGHT, INC.
To: WICKR INC.
Reel/Frame 040267/0459 →
MERGER Recorded Aug 25, 2016
From: NET POWER AND LIGHT, INC.
To: WICKR INC.
Reel/Frame 039810/0277 →
MERGER Recorded Aug 24, 2016
From: NET POWER AND LIGHT, INC.
To: NET POWER AND LIGHT, INC.
Reel/Frame 039809/0346 →
Continuity (3)
Continuation 13815918 · Mar 15, 2013
Provisional Application 61665857 · Jun 28, 2012
Related Publication 20160241329A1 · Aug 18, 2016