IP Library Granted Patent US 9,033,516
Granted Patent B2
US 9,033,516 · App. 13/246,424 · Granted May 19, 2015

Determining motion of projection device

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,033,516
App. No.
13/246,424
Granted
May 19, 2015
Kind
B2
Abstract

Example embodiments disclosed herein relate to determining a motion based on projected image information. Image information is projected onto an external surface from a device. Sensor information about the external surface and/or projection is received. Motion of the device is determined based on the sensor information.

Claims (64)

1. A method comprising:

projecting image information onto an external surface from a mobile device;

detecting information about the external surface using a sensor on the mobile device;

determining distortion information based on the detected information;

determining a gesture associated with the distortion information; and

executing a command associated with the gesture.

2. The method of claim 1 , further comprising:

correcting a distortion of the projection on the external surface based on the distortion information.

3. The method of claim 2 , wherein the distortion is corrected based on keystone correction technology.

4. The method of claim 1 , further comprising:

receiving, via the sensor, image information about the external surface; and

comparing the image information to a set of reference patterns, wherein the gesture is determined to be intentional if the image information matches at least one of the reference patterns of the set.

5. The method of claim 1 ,

wherein the sensor includes an image sensor,

wherein the detected information includes image information about the projected image information, and

wherein the method further comprises:

comparing the image information to a set of reference patterns; and

determining whether the image information is associated with intentional movement based on the comparison.

6. The method of claim 5 , wherein the image information is used to determine egomotion of the mobile device.

7. The method of claim 1 , wherein the sensor includes at least one of: a camera sensor facing the external surface or a depth sensor.

8. A device comprising:

a projection module to project image information onto an external surface;

a sensor module to receive sensor information based on at least one of: the projected image information or the external surface;

a projection correction module to stabilize the projected image information on the external surface based on the sensor information;

an egomotion detection module to detect egomotion data from the sensor information;

a motion determination module to determine whether the egomotion data is associated with a motion pattern and to determine a gesture based on the motion pattern; and

a control module configured to execute a command associated with the gesture.

9. The device of claim 8 , wherein the motion determination module compares the egomotion data to the motion pattern to determine whether the egomotion data is associated with the pattern.

10. The device of claim 8 , wherein the projection module includes a structured light emitter on a first face of the device, wherein the sensor module includes a camera sensor on the first face of the device, and wherein the egomotion data is determined, at least in part, by a correlation of information projected by the structured light emitter and the sensor information.

11. A non-transitory machine-readable storage medium storing instructions that, if executed by a processor of a mobile device, cause the processor to:

cause a projector to project image information onto an external surface;

receive sensor information describing at least one of: the projected image information or the external surface;

determine spatial data from the sensor information;

correct the projection based on the spatial data;

determine a gesture from the spatial data; and

execute a command associated with the gesture.

12. The non-transitory machine-readable storage medium of claim 11 , wherein the correction of the projection includes at least one of drift correction or jitter correction.

13. The non-transitory machine-readable storage medium of claim 11 , wherein the spatial data includes six degrees of freedom information.

14. The method of claim 1 , wherein the command comprises one of a scroll command or a zoom command.

15. The device of claim 8 , wherein the command comprises one of a scroll command or a zoom command.

16. The non-transitory machine-readable storage medium of claim 11 , wherein the command comprises one of a scroll command or a zoom command.

17. The method of claim 2 , wherein correcting the distortion of the projection comprises virtual panning of the projection.

18. The device of claim 8 , wherein projection correction module employs virtual panning of the projection to stabilize the projected image information.

19. The non-transitory machine-readable storage medium of claim 11 , wherein correcting the projection comprises virtual panning of the projection.

20. A system comprising:

means for projecting image information onto an external surface from a mobile device;

means for detecting information about the external surface using a sensor on the mobile device;

means for determining distortion information based on the detected information;

means for determining a gesture associated with the distortion information; and

means for executing a command associated with the gesture.

21. The system of claim 20 , further comprising:

means for correcting a distortion of the projection on the external surface based on the distortion information.

22. The system of claim 21 , wherein the means for correcting the distortion is adapted to correct the correction based on keystone correction technology.

23. The system of claim 20 , further comprising:

means for receiving, via the sensor, image information about the external surface; and

means for comparing the image information to a set of reference patterns, wherein the gesture is determined to be intentional if the image information matches at least one of the reference patterns of the set.

24. The system of claim 20 ,

wherein the sensor includes an image sensor,

wherein the detected information includes image information about the projected image information, and

wherein the system further comprises:

means for comparing the image information to a set of reference patterns; and

means for determining whether the image information is associated with intentional movement based on the comparison.

25. The system of claim 24 , further comprising means for using the image information to determine egomotion of the mobile device.

26. The system of claim 20 , wherein the sensor includes at least one of: a camera sensor facing the external surface or a depth sensor.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 28, 2014
From: HEWLETT-PACKARD COMPANY; HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.; PALM, INC.
To: QUALCOMM INCORPORATED
Reel/Frame 032177/0210 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2013
From: PALM, INC.
To: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
Reel/Frame 031837/0239 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2013
From: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
To: PALM, INC.
Reel/Frame 031837/0544 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2013
From: PALM, INC.
To: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
Reel/Frame 031837/0659 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 3, 2013
From: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
To: PALM, INC.
Reel/Frame 030341/0459 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 27, 2011
From: MARTI, STEFAN J.; LIU, ERIC; KIM, SEUNG WOOK
To: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
Reel/Frame 026976/0750 →