IP Library Granted Patent US 9,538,216
Granted Patent B1
US 9,538,216 · App. 14/981,219 · Granted Jan 3, 2017

System for taking action with respect to a media work

Inventor: Ingemar J. Cox (Copenhagen, DK)
Assignee: NETWORK-1 TECHNOLOGIES, INC.
H04N21/2407G06F17/30023G06F17/30864H04H60/37H04H60/58H04H60/59H04N21/4394H04N21/44008H04N21/812
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,538,216
App. No.
14/981,219
Granted
Jan 3, 2017
Kind
B1
Abstract

A computer system comprising one or more electronic communications devices, one or more processors, and one or more computer readable media having stored thereon computer instructions for carrying out the steps of: maintaining one or more databases comprising first electronic data comprising digitally created reference compact electronic representations for each of a plurality of reference electronic works and second electronic data associated with the reference electronic works and related to action information; obtaining a first digitally created compact electronic representation comprising one or more extracted feature vectors of a first electronic work; identifying a matching reference electronic work comparing the first digitally created compact electronic representation of the first electronic work with the first electronic data using an approximate nearest neighbor search; determining the action information corresponding to the matching reference electronic work based on the second electronic data; and associating the determined action information with the first electronic work.

Claims (30)

1. A computer system of one or more computers comprising:

(a) one or more electronic communications devices;

(b) one or more processors operatively connected to the one or more electronic communications devices; and

(c) one or more computer readable media operatively connected to the one or more processors and having stored thereon computer instructions for carrying out the steps of:

(1) maintaining, by the computer system, one or more databases stored on the one or more computer-readable media comprising:

(i) first electronic data comprising one or more digitally created reference compact electronic representations for each of a plurality of reference electronic works, wherein each digitally created reference compact electronic representations comprises one or more extracted feature vectors of at least one of the plurality of reference electronic works; and

(ii) second electronic data associated with one or more of the reference electronic works and related to action information corresponding to each of the one or more reference electronic works;

(2) obtaining, by the computer system, a first digitally created compact electronic representation comprising one or more extracted feature vectors of a first electronic work;

(3) identifying, by the computer system, a matching reference electronic work that matches the first electronic work by comparing the first digitally created compact electronic representation of the first electronic work with the first electronic data using an approximate nearest neighbor search, which is a sub-linear search of the first electronic data that identifies a match to the first digitally created compact electronic representation within a threshold but does not guarantee to identify the closest match to the first digitally created compact electronic representation;

(4) determining, by the computer system, the action information corresponding to the matching reference electronic work based on the second electronic data; and

(5) associating, by the computer system, the determined action information with the first electronic work.

2. The computer system of claim 1 , wherein the first electronic work comprises a digital representation of a video signal.

3. The computer system of claim 1 , wherein the first electronic work comprises a digital representation of an audio signal.

4. The computer system of claim 2 , wherein each of the one or more extracted feature vectors may be extracted from pseudo-random locations in a frame of the digital representation of the video signal.

5. The computer system of claim 1 , wherein each of the one or more extracted feature vectors may be extracted using frequency decomposition of the digital representation of the audio signal.

6. The computer system of claim 1 , wherein the first digitally created compact electronic representation comprises a temporal sequence of extracted feature vectors.

7. The computer system of claim 1 , wherein each of the one or more digitally created reference compact electronic representations comprises a temporal sequence of extracted feature vectors.

8. The computer system of claim 1 , wherein the second electronic data further comprises a URL.

9. The computer system of claim 1 , wherein the one or more computer-readable media further have stored thereon instructions for carrying out the steps of:

(6) generating, at the computer system, machine-readable instructions to be executed by a first electronic media device in performing the determined action; and

(7) providing, from the computer system to the first electronic media device, the machine-readable instructions in response to a query received from the first electronic media device related to the first electronic work.

10. The computer system of claim 9 , wherein the machine-readable instructions are further based on device information relating to the first electronic media device at which the first electronic work is rendered.

11. The computer system of claim 9 , wherein the device information comprises a geographic location of the first electronic media device.

12. The computer system of claim 9 , wherein the first electronic media device is at least one of a computer, television, set-top box, remote control, wireless phone, or a portable device.

13. The computer system of claim 2 , wherein the video signal is from at least one of a live television broadcast, a commercial, or a recorded program.

14. The computer system of claim 2 , wherein the associated action comprises presenting a user associated with the first user electronic device with additional information about the digital representation of the video signal.

15. The computer system of claim 1 , wherein the one or more computer-readable media further have stored thereon instructions for carrying out the steps of:

(6) obtaining, by the computer system, a second digitally created compact electronic representation comprising one or more extracted feature vectors of a second electronic work;

(7) searching, by the computer system, for a matching reference electronic work that matches the second electronic work by comparing the second digitally created compact electronic representation of the second electronic work with the first electronic data using an approximate nearest neighbor search, which is a sub-linear search of the first electronic data that identifies a match to the second digitally created compact electronic representation within the threshold but does not guarantee to identify the closest match to the second digitally created compact electronic representation; and

(8) determining, by the computer system, that as a result of the search no reference electronic work was identified matching the second electronic work.

Assignments (5)
CHANGE OF ADDRESS Recorded Sep 10, 2025
From: NETWORK-1 TECHNOLOGIES, INC.
To: NETWORK-1 TECHNOLOGIES, INC.
Reel/Frame 072827/0540 →
CHANGE OF NAME Recorded Mar 15, 2016
From: NETWORK-1 SECURITY SOLUTIONS, INC.
To: NETWORK-1 TECHNOLOGIES, INC.
Reel/Frame 038087/0009 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 4, 2016
From: COX, INGEMAR J., DR.
To: NETWORK-1 SECURITY SOLUTIONS, INC.
Reel/Frame 037890/0746 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 29, 2016
From: COX, INGEMAR J., DR.
To: NETWORK-1 SECURITY SOLUTIONS, INC.
Reel/Frame 037956/0779 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 24, 2016
From: NEC CORPORATION
To: DR. INGEMAR J. COX
Reel/Frame 037902/0756 →
Continuity (7)
Continuation 13830986 · Mar 14, 2013
Continuation 13800573 · Mar 13, 2013
Continuation 13338079 · Dec 27, 2011
Continuation 11977202 · Oct 23, 2007
Continuation 11445928 · Jun 2, 2006
Continuation In Part 09950972 · Sep 13, 2001
Provisional Application 60232618 · Sep 14, 2000