IP Library Granted Patent US 9,830,522
Granted Patent B2
US 9,830,522 · App. 14/592,709 · Granted Nov 28, 2017

Image processing including object selection

Inventors: Dominik K. Mazur (Los Angeles, CA); Bradford A. Folkens (Los Angeles, CA)
Assignee: CloudSight, Inc.
G06K9/2063G06F3/013G06F3/017G06F3/04842G06K9/00671G06K9/2081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,830,522
App. No.
14/592,709
Granted
Nov 28, 2017
Kind
B2
Abstract

An image recognition approach employs both computer generated and manual image reviews to generate image tags characterizing an image. The computer generated and manual image reviews can be performed sequentially or in parallel. The generated image tags may be provided to a requester in real-time, be used to select an advertisement, and/or be used as the basis of an internet search. In some embodiments generated image tags are used as a basis for an upgraded image review. A confidence of a computer generated image review may be used to determine whether or not to perform a manual image review.

Claims (77)

1. An image source comprising:

a camera configured to capture an image;

a display configured to present the image to a user;

eye tracking logic configured to detect an action of one or more eyes of the user;

display logic configured to display a mark on the image in real time;

an I/O configured to provide the image to a computer network;

logic configured to display image tags to the user, the image tags characterizing contents of the image and being received via the computer network in response to the image;

a processor configured to execute at least the display logic; and

image marking logic configured to place the mark on the image, the mark being configured to indicate a particular subset of the image and being responsive to the detected action, wherein the marking logic is further configured to highlight an object within the image in response to the placement of the mark.

2. The image source of claim 1 , further comprising confirmation logic configured for the user to confirm the highlighted object prior to provision of the image to the computer network.

3. The image source of claim 1 , further comprising confirmation logic configured for the user to confirm the location of the mark prior to provision of the image to the computer network.

4. The image source of claim 3 , wherein the confirmation logic is responsive to a verbal command or a blink.

5. The image source of claim 1 , wherein the display is configured to present the image to the user while the user also views a direct view of the real world.

6. The image source of claim 1 , wherein the action of the one or more eyes of the user includes a blink.

7. The image source of claim 1 , wherein the action of the one or more eyes of the user include movement of an eyeball.

8. The image source of claim 1 , wherein the action of the one or more eyes includes a direction of an eyeball.

9. The image source of claim 1 , wherein the action of the one or more eyes includes the focus of the one or more eyes.

10. The image source of claim 1 , wherein the action of the one or more eyes includes an intersection of the directions of two eyes.

11. An image source comprising:

a camera configured to capture an image;

a display configured to present the image to a user;

eye tracking logic configured to detect an action of one or more eyes of the user;

image marking logic configured for a user to indicate a particular subset of the image and to highlight an object within the subset, the indication being responsive to the detected action;

display logic configured to display the highlighted object on the image in real time;

an I/O configured to provide the image and the indication of the particular subset to a computer network;

logic configured to display image tags to the user, the image tags characterizing contents of the image and being received via the computer network in response to the image; and

a processor configured to execute at least the display logic.

12. The image source of claim 11 , further comprising tracking logic configured to track the object after the object has been highlighted.

13. The image source of claim 11 , wherein highlighting the object includes changing a characteristic of pixels of the object.

14. The image source of claim 11 , wherein highlighting the object includes changing a characteristic of pixels around the object.

15. The image source of claim 11 , wherein highlighting the object includes applying a filter to the object.

16. The image source of claim 11 , wherein highlighting the object includes changing a color of the object.

17. An image source comprising:

a camera configured to capture an image;

a display configured to present the image to a user, the image including a finger of the user;

selection logic configured for detecting a position of the finger within the image;

image marking logic configured for a user to indicate a particular subset of the image and to highlight an object within the subset, the indication being responsive to the position of the finger;

an I/O configured to provide the image and the indication of the particular subset to a computer network;

display logic configured to display the image in real time and to display image tags received from the computer network in response to the image, the image tags characterizing contents of the image; and

a processor configured to execute at least the display logic.

18. The image source of claim 17 , wherein the selection logic includes finger tracking logic configured to detect a pointing finger of the user.

19. An image processing system comprising:

an I/O configured to communicate an image sequence and image tags over a communication network;

destination logic configured to determine a first destination to send the image sequence to, for a manual review of the image sequence by a first human reviewer;

image posting logic configured to post the image sequence to the first destination;

review logic configured to receive the manual review of the image sequence from the destination, the manual review including one or more image tags characterizing an action that occurs within of the image sequence;

response logic configured to provide the image tags of the manual review to the communication network;

memory configured to store the image sequence; and

a microprocessor configured to execute at least the destination logic.

20. The image processing system of claim 19 , further comprising an automatic identification interface configured to communicate the image sequence to an automatic identification system and to receive a computer generated review of the image from the automatic identification system, the computer generated review including one or more image tags identifying contents of the image.

21. The image processing system of claim 20 , wherein the automatic identification system is configured to identify a sport including the action.

22. The image processing system of claim 21 , wherein the sport is one of ice skating, diving, swimming, American football, European football, basketball, baseball and tennis.

23. The image processing system of claim 19 , wherein the image sequence is limited to being less than 10 seconds in length.

24. The image processing system of claim 19 , wherein the first destination is one of a plurality of destinations, each of the plurality of destinations being associated with a different human image reviewer and being geographically remote from each other.

25. An image source comprising:

a camera configured to capture an image;

a display configured to present the image to a user;

eye tracking logic configured to detect an action of one or more eyes of the user;

display logic configured to display a mark on the image in real time;

an I/O configured to provide the image to a computer network;

confirmation logic configured for the user to confirm the highlighted object prior to provision of the image to the computer network;

a processor configured to execute at least the display logic; and

image marking logic configured to place the mark on the image, the mark being configured to indicate a particular subset of the image and being responsive to the detected action, wherein the marking logic is further configured to highlight an object within the image in response to the placement of the mark.

26. The image source of claim 25 , wherein the action of the one or more eyes of the user includes a blink.

27. The image source of claim 25 , wherein the action of the one or more eyes includes the focus of the one or more eyes.

28. An image source comprising:

a camera configured to capture an image;

a display configured to present the image to a user;

eye tracking logic configured to detect an action of one or more eyes of the user;

display logic configured to display a mark on the image in real time;

an I/O configured to provide the image to a computer network;

confirmation logic configured for the user to confirm the location of the mark prior to provision of the image to the computer network;

a processor configured to execute at least the display logic; and

image marking logic configured to place the mark on the image, the mark being configured to indicate a particular subset of the image and being responsive to the detected action, wherein the marking logic is further configured to highlight an object within the image in response to the placement of the mark.

29. The image source of claim 28 , wherein the confirmation logic is responsive to a verbal command or a blink.

30. The image source of claim 28 , wherein the action of the one or more eyes of the user includes a blink.

31. The image source of claim 28 , wherein the action of the one or more eyes includes the focus of the one or more eyes.

Assignments (5)
SECURITY AGREEMENT Recorded Jan 11, 2019
From: CLOUDSIGHT, INC.
To: S.A.W. CAPITAL PARTNERS, LLC
Reel/Frame 048692/0226 →
CHANGE OF NAME Recorded Oct 13, 2016
From: CAMFIND INC.
To: CLOUDSIGHT, INC.
Reel/Frame 040349/0682 →
CHANGE OF NAME Recorded Oct 29, 2015
From: IMAGE SEARCHER, INC.
To: CAMFIND INC.
Reel/Frame 036992/0234 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2015
From: FOLKENS, BRADFORD A; MAZUR, DOMINIK K
To: IMAGE SEARCHER, INC.
Reel/Frame 036902/0365 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 21, 2015
From: FOLKENS, BRADFORD A.; MAZUR, DOMINIK K.
To: IMAGE SEARCHER, INC.
Reel/Frame 034772/0409 →
Continuity (9)
Continuation In Part 14267840 · May 1, 2014
Provisional Application 61956927 · May 1, 2013
Provisional Application 61975691 · Apr 4, 2014
Provisional Application 61976494 · Apr 7, 2014
Provisional Application 61987156 · May 1, 2014
Provisional Application 62031397 · Jul 31, 2014
Provisional Application 62069160 · Oct 27, 2014
Provisional Application 62084509 · Nov 25, 2014
Related Publication 20150220802A1 · Aug 6, 2015