IP Library Granted Patent US 11,307,045
Granted Patent B2
US 11,307,045 · App. 16/720,336 · Granted Apr 19, 2022

Method and system to determine navigation actions based on instructions from a directional dialogue

Inventors: Russell Speight VanBlon (Raleigh, NC); Timothy Winthrop Kingsbury (Cary, NC); Scott Wentao Li (Cary, NC); Robert James Kapinos (Durham, NC)
Assignee: LENOVO (SINGAPORE) PTE. LTD.
G01C21/3608G01C21/3623
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,307,045
App. No.
16/720,336
Granted
Apr 19, 2022
Kind
B2
Abstract

A computer implemented method, system and computer program product are provided that obtain a directional dialogue comprising a series of instructions that at least partially defines a pathway through an environment, determine navigation actions associated with the pathway based on the series of instructions, track movement of an electronic device (ED) based on one or more of GPS data and non-GPS data; and present the navigation actions based on the movement.

Claims (36)

1. A computer implemented method, comprising:

under the direction of one or more processors,

obtaining a directional dialogue provided by a third party to a user of a portable first electronic device (ED), the directional dialogue comprising a series of instructions that at least partially defines a pathway for the user to follow through an environment;

determining navigation actions associated with the pathway for the user to follow based on the series of instructions;

tracking movement of the first ED based on one or more of GPS data and non-GPS data; and

presenting the navigation actions based on the movement.

2. The method of claim 1 , wherein the determining comprises identifying a present location of the user along the pathway based on the movement of the first ED and, based on the present location, identifying a corresponding one of the navigation actions.

3. The method of claim 1 , wherein the obtaining comprises recording the directional dialogue as an audio recording and parsing the audio recording to identify segments associated with verbal instructions that at least partially define the pathway for the user to follow.

4. The method of claim 1 , wherein the obtaining comprises recording the directional dialogue as a video recording and parsing the video recording to identify segments associated with gesture-based instructions that at least partially define the pathway for the user to follow.

5. The method of claim 1 , wherein the obtaining comprises recording the directional dialogue as audio and video recordings, parsing the audio and video recordings to identify segments associated with verbal and gesture-based instructions, identifying a combination of a verbal based instruction and a gesture-based instruction that collectively define a single navigation action.

6. The method of claim 1 , wherein the determining the navigation actions further comprises comparing one or more of verbal and gesture-based instructions in the directional dialogue to one or more of a template and a machine learning-based model to identify the corresponding navigation action.

7. The method of claim 1 , wherein the directional dialogue comprises verbal statements corresponding to the series of instructions, the presenting comprises replaying a select one of the verbal statements as the navigation action.

8. The method of claim 1 , wherein the presenting comprises displaying an augmented reality view of the environment in combination with one or more of an audible, visual and tactile output indicative of the navigation action.

9. The method of claim 1 , wherein the tracking comprises one or more of:

a) collecting the GPS data indicative of a present location of the ED and analyzing the GPS data with respect to when to present the corresponding navigation action; and

b) collecting ERDC data from the ED indicative of a feature of interest from the environment and analyzing the ERDC data with respect to when to present the corresponding navigation action.

10. A system, comprising:

a first electronic device (ED) configured to be portable, the first ED comprising: a user interface that includes an input configured to obtain a directional dialogue provided by a third party to a user of the first ED, the directional dialogue comprising a series of instructions that at least partially defines a pathway for the user to follow through an environment;

a processor;

a memory storing program instructions accessible by the processor, wherein, responsive to execution of the program instructions, the processor to perform the following:

determine navigation actions associated with the pathway for the user to follow based on the series of instructions; and

track movement of) the first ED based on one or more of GPS data and non-GPS data; and

the user interface of the first ED configured to present the navigation actions based on the movement.

11. The system of claim 10 , wherein, responsive to execution of the program instructions, the processor to identify a present location of the user along the pathway based on the movement of the first ED and, based on the present location, identify a corresponding one of the navigation actions.

12. The system of claim 10 , wherein, responsive to execution of the program instructions, the processor to record the directional dialogue as an audio recording and parsing the audio recording to identify segments associated with verbal instructions that at least partially define the pathway for the user to follow, the processor housed within at least one of the first ED, a second ED or a remote server.

13. The system of claim 10 , wherein, responsive to execution of the program instructions, the processor to record the directional dialogue as a video recording and parsing the video recording to identify segments associated with gesture-based instructions that at least partially define the pathway for the user to follow, the processor housed within at least one of the first ED, a second ED or a remote server.

14. The system of claim 10 , wherein, responsive to execution of the program instructions, the processor to record the directional dialogue as audio and video recordings, parsing the audio and video recordings to identify segments associated with verbal and gesture-based instructions, identifying a combination of a verbal based instruction and a gesture-based instruction that collectively define a single navigation action, the processor housed within at least one of the first ED, a second ED or a remote server.

15. The system of claim 10 , wherein, responsive to execution of the program instructions, the processor to determine the navigation actions by comparing one or more of verbal and gesture-based instructions in the directional dialogue to one or more of a template and a machine learning-based model to identify the corresponding navigation action.

16. The system of claim 10 , wherein the user interface of the first ED includes one or more of a microphone and camera that, under direction of a first processor, obtains the directional dialogue, the system further comprising one or more of a second ED and a remote server, having a second processor, to perform one or more of the determining the navigation actions and tracking the movement.

17. A computer program product comprising a non-signal computer readable storage medium comprising computer executable code to perform:

obtaining a directional dialogue provided by a third party to a user of a portable first electronic device (ED), the directional dialogue comprising a series of instructions that at least partially defines a pathway for the user to follow through an environment;

determining navigation actions associated with the pathway for the user to follow based on the series of instructions;

tracking movement of the first ED based on one or more of GPS data and non-GPS data; and

presenting the navigation actions, at a user interface of the first ED, based on the movement.

18. The computer program product of claim 17 , wherein the determining comprises identifying a present location of the user along the pathway based on the movement of the first ED and, based on the present location, identifying a corresponding one of the navigation actions.

19. The computer program product of claim 17 , further comprising a navigation log to record timestamps, verbal-based instructions, gesture-based instructions, and navigation actions associated with the verbal-based instructions and gesture-based instructions.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 20, 2025
From: LENOVO PC INTERNATIONAL LIMITED
To: LENOVO SWITZERLAND INTERNATIONAL GMBH
Reel/Frame 070269/0092 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 19, 2025
From: LENOVO (SINGAPORE) PTE LTD.
To: LENOVO PC INTERNATIONAL LIMITED
Reel/Frame 070266/0821 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 19, 2019
From: VANBLON, RUSSELL SPEIGHT; KINGSBURY, TIMOTHY WINTHROP; LI, SCOTT WENTAO; KAPINOS, ROBERT JAMES
To: LENOVO (SINGAPORE) PTE. LTD.
Reel/Frame 051330/0522 →
Continuity (1)
Related Publication 20210190527A1 · Jun 24, 2021