IP Library Granted Patent US 9,959,467
Granted Patent B2
US 9,959,467 · App. 15/592,746 · Granted May 1, 2018

Image processing client

Inventors: Bradford A. Folkens (Los Angeles, CA); Dominik K. Mazur (Los Angeles, CA)
Assignee: CLOUDSIGHT, INC.
G06K9/00684G06F17/30256G06F17/30268G06K9/00288G06K9/4604G06K9/6201G06Q30/0251
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,959,467
App. No.
15/592,746
Granted
May 1, 2018
Kind
B2
Abstract

An image recognition approach employs both computer generated and manual image reviews to generate image tags characterizing an image. The computer generated and manual image reviews can be performed sequentially or in parallel. The generated image tags may be provided to a requester in real-time, be used to select an advertisement, and/or be used as the basis of an internet search. In some embodiments generated image tags are used as a basis for an upgraded image review. A confidence of a computer generated image review may be used to determine whether or not to perform a manual image review.

Claims (46)

1. A method of processing an image, the method comprising:

receiving an image using a portable device;

identifying features of the image using a processor of the portable device;

deriving image descriptors based on the identified features, wherein deriving the image descriptors includes generating a 3-D shape descriptor from a plurality of edge features;

comparing the image descriptors with a set of image descriptors previously stored on the portable device to determine if there is a match between the image descriptors and the stored set of image descriptors;

if there is a match between the image descriptors and the stored set of image descriptors retrieving one or more image tags associated with the set of image descriptors;

displaying the retrieved one or more image tags on a display of the portable device.

2. The method of claim 1 , wherein the stored set of image descriptors are store in memory of the portable device.

3. The method of claim 1 , further comprising providing the image to an image processing server.

4. The method of claim 1 , further comprising classifying the image based on the image descriptors and providing both the classification and the image to the image processing server.

5. A method of processing an image, the method comprising:

receiving an image using a portable device;

identifying features of the image using a processor of the portable device;

deriving image descriptors based on the identified features;

comparing the image descriptors with a set of image descriptors previously stored on the portable device to determine if there is a match between the image descriptors and the stored set of image descriptors;

classifying the image based on the match between the image descriptors and the stored set of image descriptors;

sending the image and the classification of the image to a remote image processing server;

receiving one or more image tags based on the image; and

displaying the one or more image tags on a display of the portable device.

6. The method of claim 5 , wherein deriving image descriptors includes generating a 3-D shape descriptor from a plurality of edge features.

7. A mobile device comprising:

a camera configured to capture an image;

a display configured to display the image;

image processing logic configured to generate data characterizing the image, the data characterizing the image including image descriptors or image features;

a digital I/O configured to communicate the data characterizing the image to a remote image processing server and to receive one or more image tags from the image processing server, the one or more image tags being based on the data characterizing the image;

a memory configured to store the image;

display logic configured to present the one or more image tags on the image;

logic configured to determine that the identified features include a minimum feature set needed to generate descriptors of the image, and if the identified features do not include the minimum feature set, providing the image to the image processing server; and

a microprocessor configured to execute at least the image processing logic.

8. The mobile device of claim 7 wherein the data characterizing the image includes image features.

9. The mobile device of claim 7 , wherein the data characterizing the image includes image descriptors.

10. The mobile device of claim 7 , wherein the display logic is configured to display an advertisement selected using the one or more image tags.

11. A mobile device comprising:

a camera configured to capture an image;

a display configured to display the image;

image processing logic configured to generate data characterizing the image, the data characterizing the image including image descriptors or image features;

a digital I/O configured to communicate the data characterizing the image to a remote image processing server and to receive one or more image tags from the image processing server, the one or more image tags being based on the data characterizing the image;

a memory configured to store the image;

display logic configured to present the one or more image tags on the image;

logic configured to compare the image descriptors with a set of image descriptors previously stored on the portable device to determine if there is a match between the image descriptors and the stored set of image descriptors, and

if there is a match between the image descriptors and the stored set of image descriptors retrieving one or more image tags associated with the set of image descriptors from memory of the portable device; and

a microprocessor configured to execute at least the image processing logic.

12. The mobile device of claim 11 wherein the data characterizing the image includes image features.

13. The mobile device of claim 11 , wherein the data characterizing the image includes image descriptors.

14. The mobile device of claim 11 , wherein the display logic is configured to display an advertisement selected using the one or more image tags.

15. The mobile device of claim 11 , further comprising logic configured to determine that the identified features include a minimum feature set needed to generate descriptors of the image, and if the identified features do not include the minimum feature set, provide the image to the image processing server.

Assignments (4)
SECURITY AGREEMENT Recorded Jan 11, 2019
From: CLOUDSIGHT, INC.
To: S.A.W. CAPITAL PARTNERS, LLC
Reel/Frame 048692/0226 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 11, 2017
From: FOLKENS, BRADFORD A; MAZUR, DOMINIK K
To: IMAGE SEARCHER, INC.
Reel/Frame 042345/0925 →
CHANGE OF NAME Recorded May 11, 2017
From: IMAGE SEARCHER, INC.
To: CAMFIND INC.
Reel/Frame 042447/0095 →
CHANGE OF NAME Recorded May 11, 2017
From: CAMFIND INC.
To: CLOUDSIGHT, INC.
Reel/Frame 042447/0107 →
Continuity (10)
Continuation 14592764 · Jan 8, 2015
Continuation In Part 14267840 · May 1, 2014
Provisional Application 61956927 · May 1, 2013
Provisional Application 61975691 · Apr 4, 2014
Provisional Application 61976494 · Apr 7, 2014
Provisional Application 61987156 · May 1, 2014
Provisional Application 62031397 · Jul 31, 2014
Provisional Application 62069160 · Oct 27, 2014
Provisional Application 62084509 · Nov 25, 2014
Related Publication 20170249514A1 · Aug 31, 2017