IP Library Granted Patent US 8,355,533
Granted Patent B2
US 8,355,533 · App. 12/529,825 · Granted Jan 15, 2013

Method for providing photographed image-related information to user, and mobile system therefor

Inventors: Adi Pinhas (Hod Hasharon, IL); Michael Chertok (Petach Tikva, IL)
Assignee: Superfish Ltd.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,355,533
App. No.
12/529,825
Granted
Jan 15, 2013
Kind
B2
Abstract

System for providing a mobile user, object related information related to an object visible thereto, the system including a camera directable toward the object, a local interest points and semi global geometry (LIPSGG) extraction processor, and a remote LIPSGG identifier, the camera acquiring an image of at least a portion of the object, the LIPSGG extraction processor being coupled with the camera, the LIPSGG extraction processor extracting an LIPSGG model of the object from the image, remote LIPSGG identifier being coupled with the LIPSGG extraction processor via a network, the remote LIPSGG identifier receiving the LIPSGG model from the LIPSGG extraction processor, via the network, the remote LIPSGG identifier identifying the object according to the LIPSGG model, the remote LIPSGG identifier retrieving the object related information, the remote LIPSGG identifier providing the object related information to the mobile user operating the camera.

Claims (56)

1. System for providing a mobile user, object related information related to an object visible thereto, the system comprising:

an image source, said image source including at least one image of at least a portion of said object;

a local-interest-points and semi-global geometry (LIPSGG) extraction processor coupled with said image source, said LIPSGG extraction processor extracting an LIPSGG model of said object from said at least one image, said LIPSGG model including data respective of a plurality of feature vectors of said object and respective of semi-global geometry of said object, each of said feature vectors determining variations in a plurality of pixel values at a region surrounding a local-interest-point of said object, said semi-global geometry determining a plurality of relative distances and a plurality of relative angles between the local-interest-points of said object; and

a remote LIPSGG identifier, coupled with said LIPSGG extraction processor via a network, said remote LIPSGG identifier receiving said LIPSGG model from said LIPSGG extraction processor via said network, said remote LIPSGG identifier identifying said object according to said LIPSGG model, said remote LIPSGG identifier retrieving said object related information, said remote LIPSGG identifier providing said object related information to said mobile user.

2. The system of claim 1 , wherein said image source is a camera, directable toward said object, said camera acquiring said at least one image of at least a portion of said object.

3. The system according to claim 1 , wherein said network is selected from the list consisting of:

wired network; and

wireless network.

4. The system according to claim 1 , wherein said network includes links selected from the list consisting of:

wired internet;

Wi-Fi;

WiMax;

Zigbee;

Bluetooth;

Cellular;

free air optic;

satellite; and

wireless Internet.

5. The system according to claim 1 , wherein said remote LIPSGG identifier comprises a database, and wherein said database includes data respective of a plurality of LIPSGG models of each of a plurality of objects, and respective of said object related information.

6. The system according to claim 5 , wherein said remote LIPSGG identifier further comprises an image processor, and wherein said image processor identifies said object, according to said LIPSGG model and said LIPSGG models.

7. The system according to claim 1 , further comprising:

a mobile processor, coupled with said LIPSGG extraction processor; and

a user interface, coupled with said mobile processor,

wherein said mobile processor directs said user interface to present said object related information, to said mobile user.

8. The system according to claim 1 , further comprising a Global Positioning System (GPS) receiver, coupled with said LIPSGG extraction processor,

wherein said GPS receiver determines a set of GPS coordinates of said object, and

wherein said remote LIPSGG identifier identifies said object according to said LIPSGG model and according to said set of GPS coordinates of said object.

9. System for providing a mobile user, object related information related to an object visible thereto, the system comprising:

an image source, said image source including at least one image of at least a portion of said object;

a local-interest-points and semi-global geometry (LIPSGG) extraction processor, coupled with said image source, for extracting an LIPSGG model of said object from said at least one image, said LIPSGG model including data respective of a plurality of feature vectors of said object and respective of semi-global geometry of said object, each of said feature vectors determining variations in a plurality of pixel values at a region surrounding a local-interest-point of said object, said semi-global geometry determining a plurality of relative distances and a plurality of relative angles between the local-interest-points of said object; and

a mobile communication interface coupled with said LIPSGG extraction processor,

wherein said mobile communication interface transmits said LIPSGG model to a remote LIPSGG identifier via a network, and

wherein said mobile communication interface receives said object related information from said remote LIPSGG identifier.

10. System for providing a mobile user, object related information related to an object visible thereto, the system comprising:

a remote local-interest-points and semi-global geometry (LIPSGG) identifier, said remote LIPSGG identifier including:

a remote LIPSGG identifier communication interface for receiving at least one image of at least a portion of said object; and

an LIPSGG extraction processor for extracting an LIPSGG model from said at least one image, said LIPSGG model including data respective of a plurality of feature vectors of said object and respective of semi-global geometry of said object, each of said feature vectors determining variations in a plurality of pixel values at a region surrounding a local-interest-point of said object, said semi-global geometry determining a plurality of relative distances and a plurality of relative angles between the local-interest-points of said object;

wherein said remote LIPSGG identifier identifies said object, according to said LIPSGG model, and retrieves said object related information, and

wherein said remote LIPSGG identifier communication interface transmits said object related information to said mobile user via a network.

11. Method for providing a mobile user, object related information related to an object visible thereto, the method comprising the procedures of:

extracting an LIPSGG model, of said object, from at least one image, of at least a portion of said object, said LIPSGG model including data respective of a plurality of feature vectors of said object and respective of semi-global geometry of said object, each of said feature vectors determining variations in a plurality of pixel values at a region surrounding a local-interest-point of said object, said semi-global geometry determining a plurality of relative distances and a plurality of relative angles between the local-interest-points of said object;

transmitting LIPSGG model data, respective of said LIPSGG model, to an LIPSGG identifier via a network;

identifying said object, according to said LIPSGG model data;

retrieving said object related information, respective of said object, from a database; and

transmitting said object related information, to said mobile user, via said network.

12. The method according to claim 11 , further comprising the preliminary procedure of acquiring said at least one image.

13. The method according to claim 11 , further comprising the procedure of storing said LIPSGG model data in said database, after performing said procedure of identifying.

14. The method according to claim 11 , further comprising the procedure of reconstructing a three-dimensional LIPSGG model data in said database, after performing said procedure of two-dimensional LIPSGG models.

15. The method according to claim 11 , further comprising the procedures of:

acquiring a set of GPS coordinates, respective of the location of said object;

transmitting data respective of said set of GPS coordinates to said LIPSGG identifier, via said network; and

identifying said object, according to said set of GPS coordinates.

16. The system according to claim 2 , wherein said camera acquires said at least one image on a medium selected from the list consisting of:

light-sensitive material;

charge-coupled device; and

complementary metal oxide semiconductor.

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded May 12, 2016
From: VENTURE LENDING & LEASING VI, INC.
To: SUPERFISH LTD.
Reel/Frame 038693/0526 →
SECURITY AGREEMENT Recorded Oct 23, 2012
From: SUPERFISH LTD.
To: VENTURE LENDING & LEASING VI, INC.
Reel/Frame 029178/0234 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 10, 2010
From: PINHAS, ADI; CHERTOK, MICHAEL
To: SUPERFISH LTD.
Reel/Frame 023920/0181 →
Continuity (2)
Provisional Application 60893034 · Mar 5, 2007
Related Publication 20100142758A1 · Jun 10, 2010