IP Library Granted Patent US 8,625,845
Granted Patent B2
US 8,625,845 · App. 12/706,206 · Granted Jan 7, 2014

Overlaying virtual content onto video stream of people within venue based on analysis of the people within the video stream

Inventor: Mitchell M. Rohde (Saline, MI)
Assignee: Quantum Signal, LLC
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,625,845
App. No.
12/706,206
Granted
Jan 7, 2014
Kind
B2
Abstract

A video stream of people within a venue like a movie theater is received. The people within the video stream are analyzed. Based on analysis of the people within the video stream, virtual content is overlaid onto the video stream. The video stream, with the virtual content overlaid thereon, is then displayed onto a screen within the venue. As such, the virtual content and one or more of the people within the venue can appear to be interacting with one another as if the virtual content were real and present within the venue.

Claims (41)

1. A method comprising:

receiving a video stream of a plurality of people within a venue;

analyzing, by a processor of a computing device, the people within the video stream;

overlaying, by the processor of the computing device, virtual content onto the video stream based on analysis of the people within the video stream; and,

displaying the video stream, with the virtual content overlaid thereon, onto a screen within the venue.

2. The method of claim 1 , wherein the virtual content is overlaid onto the video stream such that upon display of the video stream, the virtual content and one or more of the people within the venue appear to be interacting with one another as if the virtual content were real and present within the venue.

3. The method of claim 1 , wherein the virtual content comprises a moving object, wherein analyzing the people within the video stream comprises detecting a given person to which the moving object is close and detecting motion of the given person, and wherein overlaying the virtual content onto the video stream comprises overlaying the moving object onto the video stream such that the moving object appears to bounce off or be hit by the given person as if the moving object were real and present within the venue.

4. The method of claim 1 , wherein the virtual content comprises an object, wherein analyzing the people within the video stream comprises detecting a given person to which the object is close and detecting motion of the given person, and wherein overlaying the virtual content onto the video stream comprises overlaying the object onto the video stream such that the object appears to be caught by the given person as if the object were real and present within the venue.

5. The method of claim 1 , wherein analyzing the people within the video stream and wherein overlaying the virtual content onto the video stream result in one or more of the people playing a game in relation to the virtual content.

6. The method of claim 1 , wherein analyzing the people within the video stream and wherein overlaying the virtual content onto the video stream result in one or more of the people answering a question in relation to the virtual content.

7. The method of claim 1 , wherein analyzing the people within the video stream comprises logically dividing the people into a plurality of groups and detecting motion of the people within each group, and wherein overlaying the virtual content onto the video stream comprises overlaying the virtual content based on the motions of the people within the groups.

8. The method of claim 1 , wherein the virtual content comprises a character, wherein analyzing the people within the video stream comprises locating an empty seat within the venue, and wherein overlaying the virtual content onto the video stream comprises overlaying the character onto the empty seat such that the character appears to be sitting in the empty seat as if the character were real and present within the venue.

9. The method of claim 1 , wherein analyzing the people within the video stream comprises selecting a given person within the venue, and wherein overlaying the virtual content onto the video stream comprises overlaying the virtual content to call attention to the given person.

10. A system comprising:

a video camera to generate a video stream of a plurality of people within a venue;

a processor; and,

a computer-readable storage medium to store a computer program that is executed by the processor to analyze the people within the video stream, to overlay virtual content onto the video stream based on analysis of the people within the video stream, and to transmit the video stream with the virtual content overlaid thereon for display onto a screen within the venue.

11. The system of claim 10 , further comprising one or more of:

one or more light sources to illuminate the people within the venue; and,

a projector to display the video stream, with the virtual content overlaid thereon, on a screen.

12. The system of claim 10 , wherein the virtual content is overlaid onto the video stream such that upon display of the video stream, the virtual content and one or more of the people within the venue appear to be interacting with one another as if the virtual content were real and present within the venue.

13. The system of claim 10 , wherein the virtual content comprises a moving object, wherein the computer program is to analyze the people within the video stream by detecting a given person to which the moving object is close and by detecting motion of the given person, and wherein the computer program is to overlay the virtual content onto the video stream by overlaying the moving object onto the video stream such that the moving object appears to bounce off or be hit by the given person as if the moving object were real and present within the venue.

14. The system of claim 10 , wherein the virtual content comprises an object, wherein the computer program is to analyze the people within the video stream by detecting a given person to which the object is close and by detecting motion of the given person, and wherein the computer program is to overlay the virtual content onto the video stream by overlaying the object onto the video stream such that the object appears to be caught by the given person as if the object were real and present within the venue.

15. The system of claim 10 , wherein the computer program is to analyze the people within the video stream and is to overlay the virtual content onto the video stream to result in one or more of the people playing a game in relation to the virtual content.

16. The system of claim 10 , wherein the computer program is to analyze the people within the video stream and is to overlay the virtual content onto the video stream to result in one or more of the people answering a question in relation to the virtual content.

17. The system of claim 10 , wherein the computer program is to analyze the people within the video stream by logically dividing the people into a plurality of groups and by detecting motion of the people within each group, and wherein the computer program is to overlay the virtual content onto the video stream by overlaying the virtual content based on the motions of the people within the groups.

18. The system of claim 10 , wherein the virtual content comprises a character, wherein the computer program is to analyze the people within the video stream by locating an empty seat within the venue, and wherein the computer program is to overlay the virtual content onto the video stream by overlaying the character onto the empty seat such that the character appears to be sitting in the empty seat as if the character were real and present within the venue.

19. The system of claim 10 , wherein the computer program is to analyze the people within the video stream by selecting a given person within the venue, and wherein the computer program is to overlay the virtual content onto the video stream by overlaying the virtual content to call attention to the given person.

20. A non-transitory computer-readable storage medium having a computer program stored thereon, wherein execution of the computer program by a processor of a computing device causes a method to be performed, the method comprising:

receiving a video stream of a plurality of people within a venue;

analyzing the people within the video stream;

overlaying virtual content onto the video stream based on analysis of the people within the video stream; and,

causing the video stream, with the virtual content overlaid thereon, to be displayed onto a screen within the venue.

21. The non-transitory computer-readable storage medium of claim 20 , wherein the virtual content is overlaid onto the video stream such that upon display of the video stream, the virtual content and one or more of the people within the venue appear to be interacting with one another as if the virtual content were real and present within the venue.

22. The non-transitory computer-readable storage medium of claim 20 , wherein the virtual content comprises a moving object, wherein analyzing the people within the video stream comprises detecting a given person to which the moving object is close and detecting motion of the given person, and wherein overlaying the virtual content onto the video stream comprises overlaying the moving object onto the video stream such that the moving object appears to bounce off or be hit by the given person as if the moving object were real and present within the venue.

23. The non-transitory computer-readable storage medium of claim 20 , wherein the virtual content comprises an object, wherein analyzing the people within the video stream comprises detecting a given person to which the object is close and detecting motion of the given person, and wherein overlaying the virtual content onto the video stream comprises overlaying the object onto the video stream such that the object appears to be caught by the given person as if the object were real and present within the venue.

24. The non-transitory computer-readable storage medium of claim 20 , wherein analyzing the people within the video stream and wherein overlaying the virtual content onto the video stream result in one or more of the people playing a game in relation to the virtual content.

25. The non-transitory computer-readable storage medium of claim 20 , wherein analyzing the people within the video stream and wherein overlaying the virtual content onto the video stream result in one or more of the people answering a question in relation to the virtual content.

26. The non-transitory computer-readable storage medium of claim 20 , wherein analyzing the people within the video stream comprises logically dividing the people into a plurality of groups and detecting motion of the people within each group, and wherein overlaying the virtual content onto the video stream comprises overlaying the virtual content based on the motions of the people within the groups.

27. The non-transitory computer-readable storage medium of claim 20 , wherein the virtual content comprises a character, wherein analyzing the people within the video stream comprises locating an empty seat within the venue, and wherein overlaying the virtual content onto the video stream comprises overlaying the character onto the empty seat such that the character appears to be sitting in the empty seat as if the character were real and present within the venue.

28. The non-transitory computer-readable storage medium of claim 20 , wherein analyzing the people within the video stream comprises selecting a given person within the venue, and wherein overlaying the virtual content onto the video stream comprises overlaying the virtual content to call attention to the given person.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 16, 2010
From: ROHDE, MITCHELL M.
To: QUANTUM SIGNAL, LLC
Reel/Frame 023939/0730 →
Continuity (3)
Continuation In Part 11460981 · Jul 29, 2006
Provisional Application 60705746 · Aug 6, 2005
Related Publication 20100142928A1 · Jun 10, 2010