IP Library Granted Patent US 11,340,709
Granted Patent B2
US 11,340,709 · App. 17/052,145 · Granted May 24, 2022

Relative gestures

Inventors: Mithra Vankipuram (Palo Alto, CA); Craig Peter Sayers (Palo Alto, CA)
Assignee: Hewlett-Packard Development Company, L.P.
G06F3/017G06F3/016G06F3/0346G06F3/04883G06K7/1413G06K7/1417
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,340,709
App. No.
17/052,145
Granted
May 24, 2022
Kind
B2
Abstract

In an example method, a target object is detected via a camera in a mobile device based on an embedded identifier on the target object. Sensor data of the mobile device is tracked to estimate a relative location or a relative orientation of the mobile device in relation to the target object. A relative gesture is detected via the mobile device based on the relative location or the relative orientation of the mobile device. One or more actions are performed in response to detecting the relative gesture.

Claims (38)

1. A method, comprising:

detecting a target object via a camera in a mobile device based on an embedded identifier on the target object;

tracking sensor data of the mobile device to estimate a relative location or a relative orientation of the mobile device in relation to the target object;

detecting a relative gesture via the mobile device based on the relative location or the relative orientation of the mobile device; and

performing an action in response to detecting the relative gesture;

wherein detecting the relative gesture comprises detecting a shake of the mobile device in a direction of the target object.

2. The method of claim 1 , comprising performing audio, visual, tactile or haptic feedback in response to detecting the relative gesture.

3. The method of claim 1 , wherein performing an action comprises associating or disassociating additional media with the target object having the embedded identifier.

4. The method of claim 1 , wherein performing an action comprises automatically playing back media, the media associated with the target object having the embedded identifier.

5. The method of claim 1 , further comprising:

distinguishing between a low-intensity version and a high-intensity version of the gesture, wherein performing an action comprises performing a different action in response to the low-intensity version of the gesture than in response to the high-intensity version of the gesture.

6. The method of claim 1 , wherein detecting the relative gesture comprises detecting a flip of the mobile device displaying the media onto the target object.

7. The method of claim 1 , wherein detecting the relative gesture comprises detecting a pulling motion at the mobile device from a position within a threshold range of the target object.

8. The method of claim 1 , wherein the target object is an image comprising the embedded identifier, the method further comprising:

with the mobile device, identifying media to be associated with the target object; and

in response to a gesture performed by moving the mobile device relative to the target object, associating the identified media with the target object.

9. The method of claim 1 , wherein the embedded identifier is a group of printed dots formed on the target object.

10. The method of claim 1 , wherein the gesture comprises a movement across a touch screen of the mobile device in a direction toward the target object, the method comprising tracking relative location of the mobile device with respect to the target object.

11. The method of claim 1 , further comprising downloading media to the mobile device in response to a pulling gesture of the mobile device being moved away from the target object, the media for download being associated with the target object.

12. The method of claim 11 , further comprising:

distinguishing between a lighter-intensity pull gesture and a heavier-intensity pull gesture; and

downloading first media in response to the lighter-intensity pull gesture or downloading different, second media in response to the heavier-intensity pull gesture.

13. An apparatus, comprising a processor to:

detect a target object via a camera in a mobile device based on an embedded identifier on the target object;

track sensor data of the mobile device to estimate a relative location or a relative orientation of the mobile device in relation to the target object;

detect a relative gesture via the mobile device based on the relative location or the relative orientation of the mobile device; and

download, upload, or transfer a file associated with the target object in response to detecting the relative gesture;

wherein the relative gesture comprises a shake of the mobile device in a direction of the target object.

14. The apparatus of claim 13 , the processor further to, based on tracking relative location or orientation of the mobile device relative to the target object, detect the relative gesture comprising a touch and swipe gesture on a touchscreen of the mobile device, where the swipe is in a direction of the target object.

15. The apparatus of claim 13 , wherein the relative gesture comprises a flip gesture onto the target object.

16. The apparatus of claim 13 , wherein the relative gesture comprises a pull gesture at the mobile device from within a threshold distance of the target object.

17. A non-transitory machine-readable storage medium encoded with instructions executable by a processor, the non-transitory machine-readable storage medium comprising instructions to:

detect a target object via a camera in a mobile device and based on an embedded identifier on the target object;

track sensor data of the mobile device to estimate a relative location or a relative orientation of the target object in relation to the mobile device;

detect a relative gesture via the mobile device based on the relative location or the relative orientation of the mobile device; and

associate or disassociate a file with the target object in response to detecting the detected relative gesture;

wherein detecting the relative gesture comprises detecting a shake of the mobile device in a direction of the target object.

18. The machine-readable storage medium of claim 17 , comprising instructions to automatically play back media associated with the embedded identifier in response to detecting the relative gesture.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 9, 2026
From: HP INC.
To: GENERAL VIDEO, LLC
Reel/Frame 073414/0224 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 26, 2021
From: VANKIPURAM, MITHRA; SAYERS, CRAIG PETER
To: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
Reel/Frame 055026/0603 →