IP Library Granted Patent US 9,201,501
Granted Patent B2
US 9,201,501 · App. 13/726,129 · Granted Dec 1, 2015

Adaptive projector

Inventors: Aviad Maizels (Ramat Hasharon, IL); Alexander Shpunt (Tel Aviv, IL); Tamir Berliner (Beit Hashmonay, IL)
Assignee: APPLE INC.
G06F3/013G06F3/011G06F3/017G06T19/006H04N13/0055H04N13/0468H04N13/044H04N13/0459H04N13/0484
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,201,501
App. No.
13/726,129
Granted
Dec 1, 2015
Kind
B2
Abstract

An apparatus for processing data includes a projector, which is configured to project content onto at least a part of a scene. A processor is configured to detect a location of an eye of a person in the scene and to control the projector so as to reduce an intensity of the projected content in an area of the eye.

Claims (49)

1. A method for augmented interaction with a data processing system, comprising the steps of:

receiving a depth map of a scene containing 3-dimensional objects meeting first criteria for projection of images thereon;

receiving a 2-dimensional image of the scene;

using a digital processor, processing the depth map to locate the 3-dimensional objects;

executing a computer application to analyze the 2-dimensional image to identify a most suitable one of the 3-dimensional objects according to second criteria;

projecting a user interface to the computer application as a content-containing image onto the most suitable one of the 3-dimensional objects;

using the digital processor, recognizing a gesture;

interpreting the gesture as an interaction with the user interface; and

controlling the computer application responsively to the interaction.

2. The method according to claim 1 , wherein processing the depth map comprises identifying a position of the most suitable one of the 3-dimensional objects with six degrees of freedom with respect to a reference system of coordinates, and projecting a user interface comprises compensating for scale, pitch, yaw and angular rotation thereof.

3. The method according to claim 1 , wherein processing the depth map comprises referencing a database of 3-dimensional object definitions and comparing the 3-dimensional objects with the definitions in the database.

4. The method according to claim 1 , wherein one of the 3-dimensional objects in the depth map is a portion of a humanoid form.

5. A method for augmented interaction with a data processing system, comprising the steps of:

receiving a depth map of a scene containing 3-dimensional objects meeting first criteria for projection of images thereon;

using a digital processor, processing the depth map to locate the 3-dimensional objects;

executing a computer application to identify a most suitable one of the 3-dimensional objects according to second criteria;

projecting an image of the most suitable one of the 3-dimensional objects onto a virtual surface;

using the digital processor, recognizing a gesture;

interpreting the gesture as an interaction with the image of the one object; and

controlling the computer application responsively to the interaction.

6. The method according to claim 5 , wherein processing the depth map comprises identifying a position of the most suitable one of the 3-dimensional objects with six degrees of freedom with respect to a reference system of coordinates, and projecting the image of the one object comprises compensating for scale, pitch, yaw and angular rotation of the one object.

7. The method according to claim 5 , wherein processing the depth map comprises referencing a database of 3-dimensional object definitions and comparing the 3-dimensional objects in the depth map with the definitions in the database.

8. The method according to claim 5 , wherein the image of the most suitable one of the 3-dimensional objects further comprises a user interface for control of the computer application.

9. A method for augmented interaction with a data processing system, comprising the steps of:

receiving a depth map of a scene containing 3-dimensional objects meeting first criteria for projection of images thereon;

using a digital processor, processing the depth map to locate the 3-dimensional objects;

executing a computer application to identify a most suitable one of the 3-dimensional objects according to second criteria;

projecting an image of the one object onto a wearable monitor;

using the digital processor, recognizing a gesture of a user;

interpreting the gesture as an interaction with the image of the most suitable one of the 3-dimensional objects; and

controlling the computer application responsively to the interaction.

10. The method according to claim 9 , wherein processing the depth map comprises identifying a position of the one object with six degrees of freedom with respect to a reference system of coordinates, and projecting the image of the most suitable one of the 3-dimensional objects comprises compensating for scale, pitch, yaw and angular rotation of the one object.

11. The method according to claim 9 , wherein processing the depth map comprises referencing a database of 3-dimensional object definitions and comparing the 3-dimensional objects with the definitions in the database.

12. The method according to claim 9 , wherein the image of the most suitable one of the 3-dimensional objects further comprises a user interface for control of the computer application.

13. An apparatus for processing data, comprising:

a projector, which comprises:

a first radiation source, which emits a beam of infrared radiation;

a second radiation source, which emits a visible light beam, which is modulated to form content for projection onto at least a part of a scene; and

scanning optics configured to project both the infrared beam and the visible light beam onto the scene simultaneously;

a sensing device, which is configured to capture the infrared radiation returned from the scene and output a signal in response to the captured radiation; and

a processor, which is configured to process the signal in order to generate a 3-dimensional map of the scene and to process the 3-dimensional map in order to detect a location of an eye of a person in the scene and to control the projector so as to reduce an intensity of the projected content in an area of the eye.

14. The apparatus according to claim 13 , wherein the first radiation source is controlled to create a pattern of spots on the scene, and wherein the processor is configured to derive a 3-dimensional map of the scene from the pattern of the spots and to process the 3-dimensional map in order to identify the area of the eye.

15. The apparatus according to claim 13 , wherein the sensing device has a field of view that is scanned so as to coincide with projection of the infrared beam and the visible light beam onto the scene.

16. A method for processing data, comprising:

projecting content onto at least a part of a scene by scanning a visible light beam over the scene, while modulating the visible light beam to form the content that is projected onto at least the part of the scene;

scanning a beam of infrared radiation over the scene simultaneously with the visible light beam, capturing the infrared radiation returned from the scene, processing the captured radiation to generate a 3-dimensional map of the scene, and processing the 3-dimensional map in order to detect a location of an eye of a person in the scene; and

controlling projection of the content so as to reduce an intensity of the projected content in an area of the eye.

17. The method according to claim 16 , wherein scanning the beam of the infrared radiation comprises controlling the beam of the infrared radiation to create a pattern of spots on the scene, and wherein processing the captured radiation comprises deriving a 3-dimensional map of the scene from the pattern of the spots, and processing the 3-dimensional map in order to identify the area of the eye.

18. The method according to claim 16 , wherein capturing the infrared radiation comprises scanning a field of view of a sensing device, which senses the infrared radiation, so as to coincide with projection of the infrared beam and the visible light beam onto the scene.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION # 13840451 AND REPLACE IT WITH CORRECT APPLICATION # 13810451 PREVIOUSLY RECORDED ON REEL 034293 FRAME 0092. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded May 11, 2015
From: PRIMESENSE LTD.
To: APPLE INC.
Reel/Frame 035624/0091 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 19, 2014
From: PRIMESENSE LTD.
To: APPLE INC.
Reel/Frame 034293/0092 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 23, 2012
From: MAIZELS, AVIAD; SHPUNT, ALEXANDER; BERLINER, TAMIR
To: PRIMESENSE LTD.
Reel/Frame 029523/0724 →
Continuity (3)
Continuation In Part PCTIB2011053192 · Jul 18, 2011
Provisional Application 61365788 · Jul 20, 2010
Related Publication 20130106692A1 · May 2, 2013