Using natural movements of a hand-held device to manipulate digital content
A mobile device, such as a smart phone, is provided with a camera. Digital content displayed on display screen of the mobile device may be manipulated in response to natural movements of the mobile device by a user. Motion of the mobile device is detected relative to a nearby textured surface by analyzing images of the textured surface. The displayed digital content is manipulated in response to the detected motion of the mobile device.
1. A mobile device comprising:
processing logic encased in a housing;
a user input device coupled to the processing logic;
a display screen on a surface of the housing coupled to the processing logic; and
a camera mounted to the housing, coupled to the processing logic, and operable to receive an image of a textured surface located nearby to the mobile device,
wherein the processing logic is operable to:
display digital content on the display screen of the mobile device;
receive the image of the textured surface from the camera;
define a virtual world coordinate system that is referenced to the image of the textured surface;
transform digital content to the virtual world coordinate system;
determine a camera pose of the camera in relationship to the textured surface;
track the camera pose periodically as the camera is moved relative to the textured surface to detect motion of the mobile device relative to the textured surface; and
display on a display screen of the mobile device a rendered version of the transformed digital content responsive to the camera pose, such that the digital content displayed on the display screen is manipulated in response to the detected motion of the mobile device.
2. The mobile device of claim 1 , wherein the digital content displayed on the display screen is manipulated by zooming inward in response to the mobile device moving closer to the textured surface and zooming outward in response to mobile device moving further from the textured surface.
3. The mobile device of claim 1 , wherein the digital content displayed on the display screen is manipulated by zooming inward in response to the mobile device being rotated in a first direction relative to the textured surface and zooming outward in response to mobile device being rotated in a different direction relative to the textured surface.
4. The mobile device of claim 1 , wherein the digital content displayed on the display screen is manipulated by extending a window that holds the digital content, such that the window is extended in a direction corresponding to motion of the mobile device relative to the textured surface.
5. The mobile device of claim 1 , wherein the digital content displayed on the display screen is manipulated by warping the perspective view of the digital content in response to rotating the mobile device relative to the textured surface.
6. The mobile device of claim 1 , wherein the digital content displayed on the display screen is manipulated by selecting a window for display from a plurality of windows in response to pointing the mobile device at a particular region of the textured surface.
7. The mobile device of claim 6 , further comprising indentifying the particular region based on surface parameters of the textured surface.