IP Library Granted Patent US 8,554,464
Granted Patent B2
US 8,554,464 · App. 12/433,846 · Granted Oct 8, 2013

Navigation using portable reading machine

Inventor: Rafael Maya Zetune (Chestnut Hill, MA)
Assignee: K-NFB Reading Technology, Inc.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,554,464
App. No.
12/433,846
Granted
Oct 8, 2013
Kind
B2
Abstract

Navigation techniques including map based and object recognition based and especially adapted for use in a portable reading machine are described.

Claims (54)

1. A device comprising:

one or more processing devices;

memory to store instructions that are executable by the one or more processing devices to:

capture images of physical scenes containing at least one or more objects, a first one of the images taken in a first direction from a first object to a next object in the physical scene, and a subsequent one of the images taken in a second direction from a subsequent object back to the first object;

record distance from where each image was taken to each object, and when the images are taken;

associate the objects, contained in the images to nodes that correspond to the objects;

associate, with the nodes, parameters relating to the objects; and

generate a construct relating the objects to each other, the objects being related based, at least in part, on the parameters.

2. The device of claim 1 , wherein to generate a construct comprises generating an edge between the nodes representing relationships between the corresponding objects.

3. The device of claim 1 , wherein to generate a construct comprises generating an edge between the nodes containing information about connectedness of the corresponding objects.

4. The device of claim 1 , wherein to generate a construct comprises generating an edge between the nodes containing information about proximity of the corresponding objects.

5. The device of claim 1 , wherein the nodes and the construct relating objects to each another are incorporated in a map for use in navigation.

6. The device of claim 1 , wherein the construct comprises an un-directed edge between the nodes and the nodes and the corresponding un-directed edge are incorporated in an un-directed map.

7. The device of claim 1 , wherein the construct comprises an edge between the nodes and the nodes and the corresponding edge are incorporated in a directed map.

8. The device of claim 1 , wherein the construct comprises edges having different directions between one pair of nodes.

9. The device of claim 1 , wherein the construct comprises navigation instructions.

10. The device of claim 1 , wherein the construct comprises description of the objects.

11. The device of claim 1 , wherein at least some of the nodes each comprises more than one edge connected to another node.

12. The device of claim 1 , wherein the objects comprise first and second sets, the second set objects each is accessible only from one of the second set of objects.

13. The device of claim 12 ,wherein each of the objects in the second set corresponds to a node that is connected to a node representing a corresponding object in the first set using one edge.

14. The device of claim 12 , wherein the first set of objects are incorporated in a first layer of a map and the second set of objects are incorporated in a second layer of the map.

15. The device of claim 14 , further comprising providing a user navigation instructions to reach an object in the first layer of the map and providing to the user information about objects in the second layer of the map and each corresponding to a node having connectedness to a node corresponding to the object in the first layer.

16. The device of claim 1 , wherein the construct comprises a list that associates at least one node to one or more other nodes to which the at least one node is connected.

17. The device of claim 1 , wherein the construct comprises a matrix that associates at least one node to one or more other nodes to which the at least one node is connected by the generated construct.

18. The device of claim 17 , wherein the matrix stores the parameters, the parameters corresponding to distances between nodes.

19. The device of claim 17 , wherein the construct comprises one of an incidence list, or an adjacency list, or an incidence matrix, or an adjacency matrix, or a distance matrix.

20. The device of claim 1 , wherein the parameters comprise distances between adjacent nodes.

21. The device of claim 1 , further comprising using the construct to generate searchable paths each from any node to any other node.

22. The device of claim 1 , further comprising using the construct to generate a route among the objects.

23. The device of claim 1 , further comprising instructions that are executable by the one or more processing devices to:

perform a process to identify the route among the objects, the process identifying a path among the objects, the path having a predefined characteristic.

24. The device of claim 1 , wherein the process comprises a shortest path algorithm, and wherein the predefined characteristic comprises a length of the path.

25. The device of claim 1 , wherein the parameters relate to objects that are encountered along the route.

26. The device of claim 1 , further comprising upon receiving starting and ending positions, processing information about the nodes and construct to select correct paths or sub paths between the starting and ending positions.

27. The device of claim 1 , further comprising instructions that are executable by the one or more processing devices to:

extract features from the images;

produce an array of n features having values for the n features, with the values representing the objects in the images;

represent the array as a point in n-dimensional space, where n corresponds to the number of features in the array; and

compare the point in n-dimensional space to a centroid that represents a cluster of points in the n-dimensional space corresponding to a class of objects to determine whether the point belongs in the class of objects corresponding to the centroid.

28. The device of claim 27 , further comprising instructions that are executable by the one or more processing devices to:

use the class to identify the object; and

communicate an identity of the object when the object is encountered along the route.

29. A computer program product tangibly embodied on a computer readable medium for navigation of a physical environment, comprises instructions for causing a computer device to:

capture images of physical scenes containing at least one or more of objects, a first one of the images taken in a first direction from a first object to a next object in the physical scene, and a subsequent one of the images taken in a second direction from a subsequent object back to the first object;

record distance from where each image was taken to each object, and when the images are taken;

associate the objects contained in the images to nodes that correspond to the objects;

associate, with the nodes, parameters relating to the objects; and

generate a construct relating the objects to each other, the objects being related based, at least in part, on the parameter.

30. A computer implement method for navigation of a physical environment, comprises:

capturing images of physical scenes using an image input device, the physical scene containing at least one or more of objects, a first one of the images taken in a first direction from a first object to a next object in the physical scene, and a subsequent one of the images taken in a second direction from a subsequent object back to the first object;

recording distance from where each image was taken to each object, and when the images are taken;

associating by a computing device the objects, contained in the images to nodes that correspond to the objects;

associating with the nodes in the computing device, parameters relating to the objects; and

generating by the computing device a construct relating the objects to each other, the objects being related based, at least in part, on the parameter.

Assignments (8)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 6, 2022
From: KNFB READER, LLC
To: THE NATIONAL FEDERATION OF THE BLIND
Reel/Frame 058577/0914 →
RELEASE AND TERMINATION OF LIENS Recorded Jan 27, 2016
From: FISH & RICHARDSON P.C.
To: KNFB READER, LLC
Reel/Frame 037603/0342 →
LICENSE Recorded May 1, 2015
From: KNFB READER, LLC
To: DIMENSIONAL STACK ASSETS LLC
Reel/Frame 035546/0143 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2015
From: K-NFB READING TECHNOLOGY, INC.
To: KNFB READER, LLC
Reel/Frame 035522/0289 →
LIEN Recorded Dec 30, 2014
From: K-NFB HOLDING TECHNOLOGY, IMC.
To: FISH & RICHARDSON P.C.
Reel/Frame 034599/0860 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2013
From: ZETUNE, RAFAEL MAYA
To: K-NFB READING TECHNOLOGY, INC.
Reel/Frame 030945/0693 →
CHANGE OF NAME Recorded Mar 21, 2013
From: K-NFB READING TECHNOLOGY, INC.
To: K-NFB HOLDING TECHNOLOGY, INC.
Reel/Frame 030058/0669 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 21, 2013
From: K-NFB HOLDING TECHNOLOGY, INC.
To: K-NFB READING TECHNOLOGY, INC.
Reel/Frame 030059/0351 →
Continuity (2)
Provisional Application 61049311 · Apr 30, 2008
Related Publication 20100049431A1 · Feb 25, 2010