IP Library Granted Patent US 11,740,694
Granted Patent B2
US 11,740,694 · App. 17/327,615 · Granted Aug 29, 2023

Managing and mapping multi-sided touch

Inventors: Robyn Teresa Oliver (Highland Park, IL); Robert Tartz (San Marcos, CA); Douglas Brems (San Diego, CA); Suhail Jalil (San Diego, CA); Jonathan Kies (Encinitas, CA)
Assignee: QUALCOMM Incorporated
G06F3/013G06F1/3231G06F3/017G06F3/03547G06F3/041G06F3/044G06F3/048G06F3/0412G06F3/0488G06F3/04166G06F3/04883H03K17/9622G06F2203/04104G06F2203/04106
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,740,694
App. No.
17/327,615
Granted
Aug 29, 2023
Kind
B2
Abstract

Various embodiments include processing devices and methods for managing multisensor inputs on a mobile computing device. Various embodiments may include receiving multiple inputs from multiple touch sensors, identifying types of user interactions with the touch sensors from the multiple inputs, identifying sensor input data in a multisensor input data structure corresponding with the types of user interactions, and determining whether the multiple inputs combine as a multisensor input in an entry in the multisensor input data structure having the sensor input data related to a multisensor input response. Various embodiments may include detecting a trigger for a multisensor input mode, entering the multisensor input mode in response to detecting the trigger, and enabling processing of an input from a touch sensor.

Claims (97)

1. A method of integrating multi-touch inputs across multiple distinct surfaces of a mobile computing device, the method comprising:

receiving, in a processor of the mobile computing device, a first multisensor input from at least one touch sensor on the mobile computing device distinct from a touchscreen of the mobile computing device;

determining, by the processor, an operational context of the mobile computing device using contextual awareness data, wherein the determined operational context identifies an external environment that influences an operation of a software application operating on the mobile computing device;

determining, by the processor, a multisensor input data structure based on the received first multisensor input;

determining, by the processor, a first function associated with the received first multisensor input and the determined operational context from the multisensor input data structure; and

executing a first operation configured to cause the mobile computing device to perform the determined first function.

2. The method of claim 1 , wherein:

the received first multisensor input represents a first touch movement detected on a first touch sensor of the at least one touch sensor,

executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to perform a first virtual movement of an active element on the touchscreen of the mobile computing device analogous to the first touch movement.

3. The method of claim 2 , further comprising:

receiving, by the processor, a second multisensor input representing a second touch movement detected on a second touch sensor of the at least one touch sensor;

determining, by the processor, a second function associated with the received second multisensor input being received during the determined operational context; and

executing a second operation configured to cause the mobile computing device to perform the determined second function, wherein the determined second function comprises performing a second virtual movement of the active element on the touchscreen of the mobile computing device analogous to the second touch movement and different in scale from the first virtual movement.

4. The method of claim 2 , wherein executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to scale the first virtual movement relative to the first touch movement.

5. The method of claim 2 , wherein executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to scale the first virtual movement relative to the first touch movement based on a speed of the first touch movement.

6. The method of claim 1 , wherein:

the received first multisensor input represents a first touch movement detected on a first touch sensor of the at least one touch sensor,

executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to alter at least one of a background and a foreground of an image on an active display of the touchscreen.

7. The method of claim 1 , wherein executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to control a background application distinct from an active application functioning as a primary control of an active display of the touchscreen.

8. The method of claim 1 , wherein the at least one touch sensor is disposed on at least one of a front surface of the mobile computing device at which the touchscreen is located, a back surface of the mobile computing device behind the touchscreen, a bottom surface of the mobile computing device between the front and back surfaces, a top surface of the mobile computing device between the front and back surfaces and opposite the bottom surface, or a side surface of the mobile computing device between the front and back surfaces and between the top and bottom surfaces.

9. The method of claim 1 , wherein the contextual awareness data includes at least one element of state information selected from the group consisting of an application active on the mobile computing device and a component of the mobile computing device.

10. The method of claim 1 , wherein:

determining the multisensor input data structure based on the received first multisensor input includes determining a select multisensor translation table applicable to the received first multisensor input and the determined operational context; and

determining the first function associated with the received first multisensor input and the determined operational context from the multisensor input data structure includes looking up the received first multisensor input on the select multisensor translation table.

11. A mobile computing device, comprising:

a plurality of touch sensors, wherein the plurality of touch sensors includes a touchscreen disposed on a front surface of the mobile computing device and at least one other touch sensor disposed along at least one of the front surface, a back surface of the mobile computing device, behind the touchscreen, and one or more sides of the mobile computing device between the front and back surfaces; and

a processor coupled to the plurality of touch sensors, wherein the processor is configured with processor-executable instructions to cause the processor to execute operations comprising:

receiving a first multisensor input from at least one of the plurality of touch sensors distinct from the touchscreen;

determining an operational context of the mobile computing device using contextual awareness data, wherein the determined operational context identifies an external environment that influences an operation of a software application operating on the mobile computing device;

determining a multisensor input data structure based on the received first multisensor input;

determining a first function associated with the received first multisensor input and the determined operational context from the multisensor input data structure; and

executing a first operation configured to cause the mobile computing device to perform the determined first function.

12. The mobile computing device of claim 11 , wherein:

the received first multisensor input represents a first touch movement detected on a first touch sensor of the at least one of the plurality of touch sensors,

the processor is configured with processor-executable instructions to perform operations such that executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to perform a first virtual movement of an active element on the touchscreen of the mobile computing device analogous to the first touch movement.

13. The mobile computing device of claim 12 , wherein the processor is configured with processor-executable instructions to perform operations further comprising:

receiving a second multisensor input representing a second touch movement detected on a second touch sensor of the at least one of the plurality of touch sensors;

determining a second function associated with the received second multisensor input being received during the determined operational context; and

executing a second operation configured to cause the mobile computing device to perform the determined second function, wherein the determined second function comprises performing a second virtual movement of the active element on the touchscreen of the mobile computing device analogous to the second touch movement and different in scale from the first virtual movement.

14. The mobile computing device of claim 12 , wherein the processor is configured with processor-executable instructions to perform operations such that executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to scale the first virtual movement relative to the first touch movement.

15. The mobile computing device of claim 12 , wherein the processor is configured with processor-executable instructions to perform operations such that executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to scale the first virtual movement relative to the first touch movement based on a speed of the first touch movement.

16. The mobile computing device of claim 11 , wherein:

the received first multisensor input represents a first touch movement detected on a first touch sensor of the at least one of the plurality of touch sensors,

the processor is configured with processor-executable instructions to perform operations such that executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to alter at least one of a background and a foreground of an image on an active display of the touchscreen.

17. The mobile computing device of claim 11 , wherein the processor is configured with processor-executable instructions to perform operations such that executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to control a background application distinct from an active application functioning as a primary control of an active display of the touchscreen.

18. The mobile computing device of claim 11 , wherein the contextual awareness data includes at least one element of state information selected from the group consisting of an application active on the mobile computing device and a component of the mobile computing device.

19. The mobile computing device of claim 11 , wherein the processor is configured with processor-executable instructions to perform operations such that:

determining the multisensor input data structure based on the received first multisensor input includes determining a select multisensor translation table applicable to the received first multisensor input and the determined operational context; and

determining the first function associated with the received first multisensor input and the determined operational context from the multisensor input data structure includes looking up the received first multisensor input on the select multisensor translation table.

20. A mobile computing device, comprising:

means for receiving a first multisensor input from at least one touch sensor on the mobile computing device distinct from a touchscreen of the mobile computing device;

means for determining an operational context of the mobile computing device using contextual awareness data, wherein the determined operational context identifies an external environment that influences an operation of a software application operating on the mobile computing device;

means for determining a multisensor input data structure based on the received first multisensor input;

means for determining a first function associated with the received first multisensor input and the determined operational context from the multisensor input data structure; and

means for executing a first operation configured to cause the mobile computing device to perform the determined first function.

21. The mobile computing device of claim 20 , wherein:

the received first multisensor input represents a first touch movement detected on a first touch sensor of the at least one touch sensor,

means for executing a first operation configured to cause the mobile computing device to perform the determined first function comprises means for executing the first operation configured to cause the mobile computing device to perform a first virtual movement of an active element on the touchscreen of the mobile computing device analogous to the first touch movement.

22. The mobile computing device of claim 21 , further comprising:

means for receiving a second multisensor input representing a second touch movement detected on a second touch sensor of the at least one touch sensor;

means for determining a second function associated with the received second multisensor input being received during the determined operational context; and

means for executing a second operation configured to cause the mobile computing device to perform the determined second function, wherein the determined second function comprises performing a second virtual movement of the active element on the touchscreen of the mobile computing device analogous to the second touch movement and different in scale from the first virtual movement.

23. The mobile computing device of claim 21 , wherein means for executing a first operation configured to cause the mobile computing device to perform the determined first function comprises means for executing the first operation configured to cause the mobile computing device to scale the first virtual movement relative to the first touch movement.

24. The mobile computing device of claim 21 , wherein means for executing a first operation configured to cause the mobile computing device to perform the determined first function comprises means for executing the first operation configured to cause the mobile computing device to scale the first virtual movement relative to the first touch movement based on a speed of the first touch movement.

25. The mobile computing device of claim 20 , wherein:

the received first multisensor input represents a first touch movement detected on a first touch sensor of the at least one touch sensor,

means for executing a first operation configured to cause the mobile computing device to perform the determined first function comprises means for executing the first operation configured to cause the mobile computing device to alter at least one of a background and a foreground of an image on an active display of the touchscreen.

26. The mobile computing device of claim 20 , wherein means for executing a first operation configured to cause the mobile computing device to perform the determined first function comprises means for executing the first operation configured to cause the mobile computing device to control a background application distinct from an active application functioning as a primary control of an active display of the touchscreen.

27. The mobile computing device of claim 20 , wherein the at least one touch sensor is disposed on at least one of a front surface of the mobile computing device at which the touchscreen is located, a back surface of the mobile computing device behind the touchscreen, a bottom surface of the mobile computing device between the front and back surfaces, a top surface of the mobile computing device between the front and back surfaces and opposite the bottom surface, or a side surface of the mobile computing device between the front and back surfaces and between the top and bottom surfaces.

28. The mobile computing device of claim 20 , wherein the contextual awareness data includes at least one element of state information selected from the group consisting of an application active on the mobile computing device and a component of the mobile computing device.

29. The mobile computing device of claim 20 , wherein:

means for determining the multisensor input data structure based on the received first multisensor input includes means for determining a select multisensor translation table applicable to the received first multisensor input and the determined operational context; and

means for determining the first function associated with the received first multisensor input and the determined operational context from the multisensor input data structure includes means for looking up of the received first multisensor input on the select multisensor translation table.

30. A non-transitory processor-readable storage medium having stored thereon processor-executable instructions configured to cause a processor of a mobile computing device to perform operations comprising:

receiving a first multisensor input from at least one touch sensor on the mobile computing device distinct from a touchscreen of the mobile computing device;

determining an operational context of the mobile computing device using contextual awareness data, wherein the determined operational context identifies an external environment that influences an operation of a software application operating on the mobile computing device;

determining a multisensor input data structure based on the received first multisensor input;

determining a first function associated with the received first multisensor input and the determined operational context from the multisensor input data structure; and

executing a first operation configured to cause the mobile computing device to perform the determined first function.

31. The non-transitory processor-readable storage medium of claim 30 , wherein:

the received first multisensor input represents a first touch movement detected on a first touch sensor of the at least one touch sensor,

the stored processor-executable instructions are configured to cause the processor of the mobile computing device to perform operations such that executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to perform a first virtual movement of an active element on the touchscreen of the mobile computing device analogous to the first touch movement.

32. The non-transitory processor-readable storage medium of claim 31 , wherein the stored processor-executable instructions are configured to cause the processor of the mobile computing device to perform operations further comprising:

receiving a second multisensor input representing a second touch movement detected on a second touch sensor of the at least one touch sensor;

determining a second function associated with the received second multisensor input being received during the determined operational context; and

executing a second operation configured to cause the mobile computing device to perform the determined second function, wherein the determined second function comprises performing a second virtual movement of the active element on the touchscreen of the mobile computing device analogous to the second touch movement and different in scale from the first virtual movement.

33. The non-transitory processor-readable storage medium of claim 31 , wherein the stored processor-executable instructions are configured to cause the processor of the mobile computing device to perform operations such that executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to scale the first virtual movement relative to the first touch movement.

34. The non-transitory processor-readable storage medium of claim 31 , wherein the stored processor-executable instructions are configured to cause the processor of the mobile computing device to perform operations such that executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to scale the first virtual movement relative to the first touch movement based on a speed of the first touch movement.

35. The non-transitory processor-readable storage medium of claim 30 , wherein:

the received first multisensor input represents a first touch movement detected on a first touch sensor of the at least one touch sensor,

the stored processor-executable instructions are configured to cause the processor of the mobile computing device to perform operations such that executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to alter at least one of a background and a foreground of an image on an active display of the touchscreen.

36. The non-transitory processor-readable storage medium of claim 30 , wherein the stored processor-executable instructions are configured to cause the processor of the mobile computing device to perform operations such that executing a first operation configured to cause the mobile computing device to perform the determined first function comprises executing the first operation configured to cause the mobile computing device to control a background application distinct from an active application functioning as a primary control of an active display of the touchscreen.

37. The non-transitory processor-readable storage medium of claim 30 , wherein the at least one touch sensor is disposed on at least one of a front surface of the mobile computing device at which the touchscreen is located, a back surface of the mobile computing device behind the touchscreen, a bottom surface of the mobile computing device between the front and back surfaces, a top surface of the mobile computing device between the front and back surfaces and opposite the bottom surface, or a side surface of the mobile computing device between the front and back surfaces and between the top and bottom surfaces.

38. The non-transitory processor-readable storage medium of claim 30 , wherein the contextual awareness data includes at least one element of state information selected from the group consisting of an application active on the mobile computing device and a component of the mobile computing device.

39. The non-transitory processor-readable storage medium of claim 30 , wherein the stored processor-executable instructions are configured to cause the processor of the mobile computing device to perform operations such that:

determining the multisensor input data structure based on the received first multisensor input includes determining a select multisensor translation table applicable to the received first multisensor input and the determined operational context; and

determining the first function associated with the received first multisensor input and the determined operational context from the multisensor input data structure includes looking up of the received first multisensor input on the select multisensor translation table.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 9, 2021
From: OLIVER, ROBYN TERESA; TARTZ, ROBERT; BREMS, DOUGLAS; JALIL, SUHAIL; KIES, JONATHAN
To: QUALCOMM INCORPORATED
Reel/Frame 056809/0515 →
Continuity (7)
Division 16003487 · Jun 8, 2018
Provisional Application 62572471 · Oct 14, 2017
Provisional Application 62572460 · Oct 14, 2017
Provisional Application 62572455 · Oct 14, 2017
Provisional Application 62572453 · Oct 14, 2017
Provisional Application 62572465 · Oct 14, 2017
Related Publication 20210278897A1 · Sep 9, 2021