IP Library › Granted Patent US 9,360,945
Granted Patent B2
US 9,360,945 · App. 14/569,766 · Granted Jun 7, 2016

Object information derived from object images

Inventors: Wayne C. Boncyk (Evergreen, CO); Ronald H. Cohen (Pasadena, CA)
Assignee: Nant Holdings IP LLC
G06F3/017G06F17/3087G06F17/30244G06F17/30247G06F17/30256G06F17/30259G06F17/30277G06F17/30831G06F17/30864G06F17/30994G06K9/00221G06K9/00523G06K9/00577G06K9/00597G06K9/00624G06K9/00664G06K9/00671G06K9/00744G06K9/3241G06K9/72G06K9/78G06Q20/10G06Q30/0261G06Q30/0267G06Q30/0269G06Q30/0601G06Q30/0613G06Q30/0623G06Q30/0625G06T7/00H04N5/23229
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,360,945
App. No.
14/569,766
Granted
Jun 7, 2016
Kind
B2
Abstract

Search terms are derived automatically from images captured by a camera equipped cell phone, PDA, or other image capturing device, submitted to a search engine to obtain information of interest, and at least a portion of the resulting information is transmitted back locally to, or nearby, the device that captured the image.

Claims (80)

1. A method of enabling an interaction with on-screen video content, comprising:

obtaining, via a mobile device, image data associated with on-screen video content;

deriving a search term from the image data;

recognizing at least a portion of the on-screen video content as including a representation of a target object via a query of a data set indexing a collection of data associated with known target objects using the search term;

obtaining, via an address, content information corresponding to the target object; and

enabling, via a second mobile device, an interaction associated with the content information based on at least one of the address and the content information.

2. The method of claim 1 , wherein the second mobile device comprises the first mobile device.

3. The method of claim 1 , wherein the on-screen video content includes a representation of an object comprising a tag.

4. The method of claim 3 , wherein the tag comprises at least one of a code, an image, a pattern, a logo and a sign.

5. The method of claim 4 , wherein the tag is time varying.

6. The method of claim 1 , wherein the on-screen video content lacks a representation of a tag.

7. The method of claim 1 , wherein the target object comprises television programming.

8. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling a changing of a channel of a television.

9. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling a purchase associated with the target object.

10. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling a streaming of a sample of a video related to the on-screen video content.

11. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling the second mobile device to display showtimes related to the on-screen video content.

12. The method of claim 11 , wherein enabling the interaction associated with the content information comprises enabling a purchase of a ticket related to the showtimes.

13. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling the second mobile device to make a telephone call related to the on-screen video content.

14. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling a real time interaction with the on-screen video content.

15. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling a purchase associated with the target object at a reduced price.

16. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling a vote registration related to the on-screen content.

17. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling an indication of an action.

18. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling obtaining a television listing corresponding to the target object.

19. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling obtaining a telephone number relating to the target object.

20. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling obtaining audio content relating to the target object.

21. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling obtaining text content relating to the target object.

22. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling obtaining video content relating to the target object.

23. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling obtaining graphics content relating to the target object.

24. The method of claim 1 , wherein the on-screen video content comprises television programming.

25. The method of claim 1 , wherein the on-screen video content comprises an advertisement.

26. The method of claim 1 , wherein the on-screen video content represents a promotion.

27. The method of claim 1 , wherein the on-screen video content is associated with a game.

28. The method of claim 1 , wherein the on-screen video content comprises symbolic content.

29. The method of claim 1 , further comprising obtaining at least one of a position, a location and an orientation related to the on-screen video content.

30. The method of claim 1 , further comprising obtaining a time of capture of the on-screen video content.

31. The method of claim 1 , further comprising obtaining non-visual information, and wherein deriving the search term further comprises deriving the search term from at least a portion of the non-visual information.

32. The method of claim 31 , wherein the non-visual information comprises audio.

33. The method of claim 1 , wherein the search term comprises a portion of the image data.

34. An on-screen content interaction system comprising:

a device interface configured to receive a digital representation of on-screen video content from a mobile device; and

a processing platform communicatively coupled with the device interface and configured to:

obtain the digital representation via the device interface;

derive a search term from the digital representation;

recognize at least a portion of the on-screen video content as the target object via a query of a data set indexing a collection of data associated with known target objects using the search term;

obtain, via an address, content information corresponding to the target object; and

enable, via a second device, an interaction associated with the content information based on at least one of the address and the content information.

35. The system of claim 34 , wherein the on-screen video content comprises television programming.

36. The system of claim 34 , wherein the target object comprises television programming.

37. The system of claim 34 , wherein the interaction comprises a changing of a channel of a television.

38. The system of claim 34 , wherein the interaction comprises a streaming of a sample of a video related to the target object.

39. The system of claim 34 , wherein the interaction comprises a purchase related to the target object.

40. The system of claim 34 , wherein the interaction comprises an indication of an action.

41. The system of claim 34 , wherein the content information comprises a television listing corresponding to the target object.

42. The system of claim 34 , wherein the content information comprises text content relating to the target object.

43. A portable imaging device, comprising:

a sensor configured to acquire a digital representation of on-screen video content; and

a computing platform coupled with the sensor and including an identification server configured to:

obtain the digital representation via the sensor;

derive a search term from the digital representation;

recognize at least a portion of the on-screen video content as including a target object via a query of a data set indexing a collection of data associated with known target objects using the search term;

obtain, via an address, content information corresponding to the target object; and

enable, via a second device, an interaction associated with the target object based on at least one of the address and the content information.

44. The device of claim 43 , wherein the second device comprises the portable imaging device.

45. The device of claim 43 , wherein the on-screen video content includes a representation of an object comprising a tag.

46. The device of claim 45 , wherein the tag comprises at least one of a code, an image, a pattern, a logo and a sign.

47. The device of claim 46 , wherein the tag is time varying.

48. The device of claim 43 , wherein the on-screen video content lacks a representation of a tag.

49. The device of claim 43 , wherein the target object comprises television programming.

50. The device of claim 43 , wherein the interaction associated with the target object comprises a purchase associated with the target object.

51. The device of claim 43 , wherein the interaction associated with the target object comprises a streaming of a sample of a video related to the on-screen video content.

52. The device of claim 43 , wherein the interaction associated with the target object comprises displaying showtimes related to the on-screen video content.

53. The device of claim 43 , wherein the interaction associated with the target object comprises a real time interaction with the on-screen video content.

54. The device of claim 43 , wherein the interaction associated with the target object comprises an indication of an action.

55. The device of claim 43 , wherein the on-screen video content comprises an advertisement.

56. The device of claim 43 , wherein the on-screen video content is associated with a game.

57. The device of claim 43 , wherein the on-screen video content represents a promotion.

58. The device of claim 43 , wherein the identification server is further configured to obtain non-visual information, and derive the search term from at least a portion of the non-visual information.

59. The device of claim 58 , wherein the non-visual information comprises audio.

60. The device of claim 43 , wherein the identification server is further configured to obtain at least one of a position, a location and an orientation related to the on-screen video content, and derive the search term from the at least one of the position, the location and the orientation.

61. The device of claim 43 , wherein the identification server is further configured to obtain a time of capture of the on-screen video content, and derive the search term from the time of capture.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 9, 2015
From: EVRYX ACQUISITION, LLC
To: NANT HOLDINGS IP, LLC.
Reel/Frame 036524/0276 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 9, 2015
From: EVRYX TECHNOLOGIES, INC.
To: EVRYX ACQUISITION LLC.
Reel/Frame 036524/0342 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 9, 2015
From: BONCYK, WAYNE C.; COHEN, RONALD H.
To: EVRYX TECHNOLOGIES
Reel/Frame 036524/0365 →
Continuity (15)
Division 14187717 · Feb 24, 2014
Division 13858897 · Apr 8, 2013
Division 13705071 · Dec 4, 2012
Continuation 13207230 · Aug 10, 2011
Division 13037330 · Feb 28, 2011
Division 12568130 · Sep 28, 2009
Division 11204901 · Aug 15, 2005
Continuation In Part 09992942 · Nov 5, 2001
Continuation In Part 10492243
Continuation In Part 09992942 · Nov 5, 2001
Provisional Application 60630524 · Nov 22, 2004
Provisional Application 60625526 · Nov 4, 2004
Provisional Application 60317521 · Sep 5, 2001
Provisional Application 60246295 · Nov 6, 2000
Related Publication 20150302087A1 · Oct 22, 2015