IP Library Granted Patent US 9,993,733
Granted Patent B2
US 9,993,733 · App. 14/327,404 · Granted Jun 12, 2018

Infrared reflective device interactive projection effect system

Inventors: Meghan Jennifer Athavale (Toronto, CA); Chris Iverach-Brereton (Winnipeg, CA); Curtis Wachs (Winnipeg, CA)
Assignee: Lumo Interactive Inc.
A63F13/65A63F13/213A63F13/25
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,993,733
App. No.
14/327,404
Granted
Jun 12, 2018
Kind
B2
Abstract

Some embodiments herein include systems, methods, and software for IR object identification and motion detection. Consumers may project an interactive projection surface on the wall or floor of any room, and when IR object motion is detected, the interactive projection may update in response to the motion. A newly introduced IR object may be identified, and an effect specific to the IR object may be projected into the IR object.

Claims (62)

1. A method of providing a virtual environment, the method comprising:

detecting a first ambient infra-red (IR) light level;

projecting a first IR light pattern onto an upper side of a target surface and onto an IR object positioned above the upper side of the target surface, the first IR light pattern having an associated first intensity level selected according to the detected first ambient IR light level;

capturing a first IR image, the first IR image including the IR object and at least a portion of the upper side of the target surface; and

identifying the IR object and identifying an IR object location within the first IR image;

generating an animated graphical effect based on the IR object identification and the IR object location; and

projecting the animated graphical effect onto the upper side of the target surface.

2. The method of claim 1 , the method further including:

detecting a second ambient IR light level;

comparing the detected second ambient IR light level with the detected first ambient IR light level, the second ambient IR light level being different from the first ambient IR light level; and

projecting a second IR light pattern onto the IR object, the second IR light pattern having an associated second intensity level selected according to the comparing of the first and second detected ambient IR light levels.

3. The method of claim 1 , the method further including:

identifying a non-IR object and non-IR object location within the captured first IR image;

wherein generating the animated graphical effect is further based on identifying the non-IR object and the non-IR object location; and

wherein projecting the animated graphical effect onto the upper side of the target surface includes projecting the animated graphical effect onto the non-IR object to interact with the non-IR object.

4. The method of claim 1 , the method further including:

capturing a second IR image, the second IR image being different from the first IR image;

comparing the first IR image to the second IR image, the comparison identifying an IR object motion and an updated location of the IR object;

generating a second animated graphical effect in response to the comparison; and

projecting the second animated graphical effect onto the upper side of the target surface, the second animated graphical effect providing a displayed motion effect adjacent to the IR object to interact with the IR object.

5. A method of providing a virtual environment, the method comprising:

capturing a first IR image and a second IR image of an upper side of a target surface, the first IR image being different from the second IR image;

comparing the first IR image to the second IR image, the comparison identifying movement of a persistent IR object present in both images and introduction of an introduced IR object in the second image;

generating an animated graphical effect in response to the comparison; and

projecting the animated graphical effect onto the upper side of the target surface, the animated graphical effect providing a displayed motion effect adjacent to the IR object.

6. The method of claim 5 , further including projecting an IR light onto the upper side of the target surface and onto the IR object.

7. The method of claim 6 , wherein projecting the IR light onto the IR object includes projecting an IR pattern.

8. The method of claim 6 , further including detecting an IR object signature reflected by the IR object.

9. The method of claim 5 , further including detecting an IR object signature generated by the IR object.

10. The method of claim 5 , wherein identifying the IR image of an IR object includes identifying a motion of the IR object.

11. The method of claim 10 , wherein updating the animated graphical effect includes updating a location of a virtual object within the animated graphical effect in response to the motion of the IR object.

12. The method of claim 10 , further including predicting a future motion of the IR object.

13. The method of claim 5 , wherein:

updating the animated graphical effect includes adding an object-specific graphical component in response to identifying the IR image of the IR object; and

projecting the animated graphical effect onto the upper side of the target surface includes projecting the object-specific graphical component onto the IR object.

14. The method of claim 13 , wherein projecting the object-specific graphical component onto the IR object includes adding an appearance of an object to the the IR object.

15. An infrared reflective device interactive projection effect system, the system comprising:

an ambient IR light level detector;

an IR pattern projector configured to vary a projected IR pattern according to an ambient IR light level detected by the ambient IR light level detector;

an IR image sensor configured to capture a first IR image, the first IR image including a IR object positioned above an upper side of a target surface and including at least a portion of the upper side of the target surface;

a processor configured to:

identify the IR object and an IR object location within the first IR image; and

generate a first animated graphical effect based on identifying the IR object and the IR object location; and

a visible light projector configured to project the first animated graphical effect onto the upper side of the target surface in response to the captured first IR image.

16. The system of claim 15 , wherein the visible light projector changes the appearance of the IR object by projecting the first animated graphical effect onto the IR object.

17. The system of claim 15 , the processor further configured to:

identify a non-IR object and non-IR object location within the first IR image; and

generate the first animated graphical effect based on identifying the non-IR object and the non-IR object location.

18. The system of claim 17 , wherein:

the IR image sensor is further configured to capture a second IR image, the second IR image being different from the first IR image, the second IR image including the IR object and at least a portion of the upper side of the target surface;

the processor is further configured to:

compare the first IR image to the second IR image, the comparison identifying an IR object motion and an updated location of the IR object; and

generate a second animated graphical effect in response to the comparison; and

the visible light projector is further configured to project the second animated graphical effect onto the upper side of the target surface, the second animated graphical effect providing a displayed motion effect adjacent to the IR object to interact with the IR object.

19. The system of claim 18 , wherein:

the second animated graphical effect includes a projected object in a first projected object location;

the second animated graphical effect includes a projected object in a second projected object location, the second projected object location being different from the first projected object location; and

the visible light projector is configured to project the second animated graphical effect after projecting the first animated graphical effect to provide an appearance of motion of the projected object.

20. The system of claim 18 , wherein the processor is further configured to:

identify, using the updated location of the IR object, a predicted motion of the IR object; and

generate a third animated graphical effect in response to identifying the predicted motion; and

cause the visible light projector to project the third animated graphical effect.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 12, 2018
From: IVERACH-BRERETON, CHRIS
To: LUMO INTERACTIVE INC.
Reel/Frame 045522/0144 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 12, 2018
From: WACHS, CURTIS
To: LUMO INTERACTIVE INC.
Reel/Frame 045522/0218 →
CHANGE OF NAME Recorded Nov 18, 2016
From: LUMO PLAY, INC.
To: LUMO INTERACTIVE INC.
Reel/Frame 040647/0445 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2015
From: SCHAERER, SHAWN; ATHAVALE, MEGHAN JENNIFER
To: LUMO PLAY, INC.
Reel/Frame 036063/0540 →
Continuity (1)
Related Publication 20160008718A1 · Jan 14, 2016