IP Library Granted Patent US 8,917,908
Granted Patent B2
US 8,917,908 · App. 13/548,092 · Granted Dec 23, 2014

Distributed object tracking for augmented reality application

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,917,908
App. No.
13/548,092
Granted
Dec 23, 2014
Kind
B2
Abstract

One embodiment of the present invention provides a system for tracking and distributing annotations for a video stream. During operation, the system receives, at an annotation server, the video stream originating from a remote field computer, extracts a number of features from the received video stream, and identifies a group of features that matches a known feature group, which is associated with an annotation. The system further associates the identified group of features with the annotation, and forwards the identified group of features and the annotation to the remote field computer, thereby facilitating the remote field computer to associate the annotation with a group of locally extracted features and display the video stream with the annotation placed in a location based at least on locations of the locally extracted features.

Claims (45)

1. A computer-executable method for tracking and distributing annotations for a video stream, the method comprising:

receiving, at an annotation server, the video stream originating from a remote field computer;

extracting a number of features from the received video stream;

identifying a group of features that matches a known feature group, wherein the known feature group is associated with an annotation;

associating the identified group of features with the annotation;

forwarding the identified group of features and the annotation to the remote field computer, thereby facilitating the remote field computer to associate the annotation with a group of locally extracted features and display the video stream with the annotation placed in a location based at least on locations of the locally extracted features;

receiving, from a client computer, a video frame extracted from the video stream, wherein the video frame includes annotations added by a user of the client computer;

attaching the annotations to corresponding features within the video frame based on one or more user-definable rules associated with the annotations; and

in response to receiving, from the user, updates to the user-definable rules, reattaching the annotations to features within the video frame based on the updated user-definable rules.

2. The method of claim 1 , further comprising:

receiving, from the user, updates to the annotations; and

reattaching the updated annotations to features within the video frame.

3. The method of claim 1 , further comprising storing the corresponding features and the attached annotations as known features in a database.

4. The method of claim 1 , further comprising tracking the identified group of features frame by frame in the received video stream.

5. The method of claim 1 , wherein receiving the video stream involves a video reflector, which reflects the video stream originating from a remote field computer to the annotation server and at least one other client computer.

6. A non-transitory computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method for tracking and distributing annotations for a video stream, the method comprising:

receiving the video stream originating from a remote field computer;

extracting a number of features from the received video stream;

identifying a group of features that matches a known feature group, wherein the known feature group is associated with an annotation;

associating the identified group of features with the annotation;

forwarding the identified group of features and the annotation to the remote field computer, thereby facilitating the remote field computer to associate the annotation with a group of locally extracted features and display the video stream with the annotation placed in a location based at least on locations of the locally extracted features;

receiving, from a client computer, a video frame extracted from the video stream, wherein the video frame includes annotations added by a user of the client computer;

attaching the annotations to corresponding features within the video frame based on one or more user-definable rules associated with the annotations; and

in response to receiving, from the user, updates to the user-definable rules, reattaching the annotations to features within the video frame based on the updated user-definable rules.

7. The computer-readable storage medium of claim 6 , wherein the method further comprises:

receiving, from the user, updates to the annotations; and

reattaching the updated annotations to features within the video frame.

8. The computer-readable storage medium of claim 6 , wherein the method further comprises storing the corresponding features and the attached annotations as known features in a database.

9. The computer-readable storage medium of claim 6 , wherein the method further comprises tracking the identified group of features frame by frame in the received video stream.

10. The computer-readable storage medium of claim 6 , wherein receiving the video stream involves a video reflector, which reflects the video stream originating from a remote field computer to the annotation server and at least one other client computer.

11. An annotation server, comprising:

a processor; and

a storage device coupled to the processor and storing instructions which when executed by the processor cause the processor to perform a method, the method comprising:

receiving a video stream originating from a remote field computer;

extracting a number of features from the received video stream;

identifying a group of features that matches a known feature group, wherein the known feature group is associated with an annotation;

associating the identified group of features with the annotation;

forwarding the identified group of features and the annotation to the remote field computer, thereby facilitating the remote field computer to associate the annotation with a group of locally extracted features and display the video stream with the annotation placed in a location based at least on locations of the locally extracted features:

receiving, from a client computer, a video frame extracted from the video stream, wherein the video frame includes annotations added by a user of the client computer;

attaching the annotations to corresponding features within the video frame based on one or more user-definable rules associated with the annotations; and

in response to receiving, from the user, updates to the user-definable rules, reattaching the annotations to features within the video frame based on the updated user-definable rules.

12. The annotation server of claim 11 , wherein the method further comprises receiving, from the user, updates to the annotations, and reattaching the updated annotations to features within the video frame.

13. The annotation server of claim 11 , wherein the method further comprises storing the corresponding features and the attached annotations as known features in a database.

14. The annotation server of claim 11 , wherein the method further comprises tracking the identified group of features frame by frame in the received video stream.

15. The annotation server of claim 11 , wherein receiving the video stream involves a video reflector, which reflects the video stream originating from a remote field computer to the annotation server and at least one other client computer.

Assignments (10)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 6, 2025
From: XEROX CORPORATION
To: GENESEE VALLEY INNOVATIONS, LLC
Reel/Frame 073842/0479 →
SECOND LIEN NOTES PATENT SECURITY AGREEMENT Recorded Jul 2, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 071785/0550 →
FIRST LIEN NOTES PATENT SECURITY AGREEMENT Recorded Apr 11, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 070824/0001 →
SECURITY INTEREST Recorded Feb 13, 2024
From: XEROX CORPORATION
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 066741/0001 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS RECORDED AT RF 064760/0389 Recorded Feb 13, 2024
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: XEROX CORPORATION
Reel/Frame 068261/0001 →
SECURITY INTEREST Recorded Nov 20, 2023
From: XEROX CORPORATION
To: JEFFERIES FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 065628/0019 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVAL OF US PATENTS 9356603, 10026651, 10626048 AND INCLUSION OF US PATENT 7167871 PREVIOUSLY RECORDED ON REEL 064038 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jun 28, 2023
From: PALO ALTO RESEARCH CENTER INCORPORATED
To: XEROX CORPORATION
Reel/Frame 064161/0001 →
SECURITY INTEREST Recorded Jun 22, 2023
From: XEROX CORPORATION
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 064760/0389 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 20, 2023
From: PALO ALTO RESEARCH CENTER INCORPORATED
To: XEROX CORPORATION
Reel/Frame 064038/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 13, 2012
From: ROBERTS, MICHAEL; KLETTER, DORON; HOOK, ANSELM; BEGOLE, JAMES M.A.
To: PALO ALTO RESEARCH CENTER INCORPORATED
Reel/Frame 028549/0030 →