IP Library › Granted Patent US 12,189,857
Granted Patent B2
US 12,189,857 · App. 17/821,100 · Granted Jan 7, 2025

Adjusting haptic rendering based on contextual awareness

Inventors: Muhua Li (San Diego, CA); Wesley James Holland (Encinitas, CA); Ajit Chourasia (San Diego, CA); An Chen (San Diego, CA); Vijaya Datta Mayyuri (San Diego, CA)
Assignee: QUALCOMM Incorporated
G06F3/016G06F3/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,189,857
App. No.
17/821,100
Granted
Jan 7, 2025
Kind
B2
Abstract

Disclosed are systems, apparatuses, processes, and computer-readable media to provide haptic feedback in electronic devices based on contextual awareness. According to some aspects, a method of controlling haptic feedback includes obtaining environmental information indicative of an environment of a computing device from at least one sensor and determining a context associated with the mobile device based on the environmental information. The method may include determining haptic feedback for output by the mobile device based on the context.

Claims (73)

1. An apparatus for controlling haptic feedback, the apparatus comprising:

at least one memory; and

at least one processor coupled to the at least one memory and configured to:

obtain environmental information indicative of an environment of the apparatus from at least one sensor, wherein the environmental information comprises at least one of ambient audio information of the environment, device information that identifies other wireless devices proximate to the apparatus, luminance information, information indicating that at least one person has entered or exited the environment, or image data;

determine a context associated with the apparatus based on the environmental information; and

determine haptic feedback for output by the apparatus based on the context.

2. The apparatus of claim 1 , wherein, to determine the haptic feedback of the apparatus based on the context, the at least one processor is configured to:

determine an amount of noise associated with the haptic feedback based on a surface in contact with the apparatus.

3. The apparatus of claim 1 , wherein, to determine the haptic feedback of the apparatus based on the context, the at least one processor is configured to:

determine an amount of noise associated with haptic feedback that an application will emit during execution of the application.

4. The apparatus of claim 3 , wherein the amount of noise associated with the haptic feedback that the application will emit is further based on at least one setting associated with the application.

5. The apparatus of claim 1 , wherein the at least one processor is configured to:

identify applications that are configured to output notifications with haptic feedback; and

adjust haptic feedback associated with notifications of at least a portion of the applications.

6. The apparatus of claim 1 , wherein, to determine the context, the at least one processor is configured to at least one of:

determine whether the ambient audio information is below a threshold for a period of time;

determine a quantity of acoustic devices for outputting audio within a particular distance of the apparatus;

determine a spectral quality of the ambient audio information;

determine a quantity of computing devices that are within a particular distance of the apparatus; or

determine a number of people that are within a particular distance of the apparatus.

7. The apparatus of claim 1 , wherein the at least one processor is configured to:

obtain a location of the apparatus using a location sensor.

8. The apparatus of claim 1 , wherein the at least one processor is configured to:

determine a maximum noise level associated with the haptic feedback based on the context associated with the apparatus.

9. The apparatus of claim 8 , wherein the at least one processor is configured to decrease the haptic feedback of the apparatus to reduce noise associated with the haptic feedback to be less than the maximum noise level associated with the haptic feedback.

10. The apparatus of claim 1 , wherein the at least one processor is configured to:

determine a minimum noise level associated with the haptic feedback based on the context associated with the apparatus.

11. The apparatus of claim 10 , wherein the at least one processor is configured to increase the haptic feedback of the apparatus to increase noise associated with the haptic feedback to be more than the minimum noise level associated with the haptic feedback.

12. The apparatus of claim 1 , wherein the at least one processor is configured to:

adjust an audio volume output of an audio device based on the context and the haptic feedback.

13. The apparatus of claim 1 , wherein the at least one processor is configured to:

based on a determination of the haptic feedback for output by the apparatus based on the context, obtain additional environmental information from the at least one sensor indicating a change associated with the environment of the apparatus;

determine a second context associated with the apparatus based on the additional environmental information; and

determine a second haptic feedback for output by the apparatus based on the second context.

14. The apparatus of claim 1 , wherein the apparatus includes a plurality of feedback events, wherein a first feedback event of the plurality of feedback events comprises activating one or more haptic actuators based on a first parameter of the haptic feedback, and wherein a second feedback event of the plurality of feedback events comprises activating the one or more haptic actuators based on a second parameter of the haptic feedback.

15. The apparatus of claim 14 , wherein the at least one processor is configured to at least one of:

modify the first parameter of the haptic feedback associated with the first feedback event based on the context; or

modify the second parameter of the haptic feedback associated with the second feedback event based on the context.

16. The apparatus of claim 14 , wherein the first parameter of the haptic feedback is associated with at least one of a magnitude of the haptic feedback, a duty cycle of the haptic feedback, a duration of the haptic feedback, or a period of the haptic feedback.

17. The apparatus of claim 14 , wherein the second parameter of the haptic feedback is associated with preventing actuation of at least one haptic actuator of the one or more haptic actuators.

18. The apparatus of claim 1 , wherein the apparatus is a mobile device.

19. The apparatus of claim 1 , wherein the image data is an image.

20. A method for controlling haptic feedback, comprising:

obtaining environmental information indicative of an environment of a computing device from at least one sensor, wherein the environmental information comprises at least one of ambient audio information of the environment, device information that identifies other wireless devices proximate to the computing device, luminance information, information indicating that at least one person has entered or exited the environment, or image data;

determining a context associated with the computing device based on the environmental information; and

determining haptic feedback for output by the computing device based on the context.

21. The method of claim 20 , wherein determining the haptic feedback of the computing device based on the context comprises:

determining an amount of noise associated with the haptic feedback based on a surface in contact with the computing device.

22. The method of claim 20 , wherein determining the haptic feedback of the computing device based on the context comprises:

determining an amount of noise associated with haptic feedback that an application will emit during execution of the application.

23. The method of claim 20 , further comprising:

identifying applications that are configured to output notifications with haptic feedback; and

adjusting haptic feedback associated with notifications of at least a portion of the applications.

24. The method of claim 20 , wherein determining the context comprises at least one of:

determining whether the ambient audio information is below a threshold for a period of time;

determining a quantity of acoustic devices for outputting audio within a particular distance of the computing device;

determining a spectral quality of the ambient audio information;

determining a quantity of computing devices that are within a particular distance of the computing device; or

determining a number of people that are within a particular distance of the computing device.

25. The method of claim 20 , further comprising:

determining a maximum noise level associated with the haptic feedback based on the context associated with the computing device; and

decreasing the haptic feedback of the computing device to reduce noise associated with the haptic feedback to be less than the maximum noise level associated with the haptic feedback.

26. The method of claim 20 , further comprising:

determining a minimum noise level associated with the haptic feedback based on the context associated with the computing device; and

increasing the haptic feedback of the computing device to increase noise associated with the haptic feedback to be more than the minimum noise level associated with the haptic feedback.

27. The method of claim 20 , further comprising:

adjusting an audio volume output of an audio device based on the context and the haptic feedback.

28. The method of claim 20 , further comprising:

after determining the haptic feedback for output by the computing device based on the context, obtaining additional environmental information from the at least one sensor indicating a change associated with the environment of the computing device;

determining a second context associated with the computing device based on the additional environmental information; and

determining a second haptic feedback for output by the computing device based on the second context.

29. The method of claim 20 , wherein the computing device includes a plurality of feedback events, wherein a first feedback event of the plurality of feedback events comprises activating one or more haptic actuators based on a first parameter of the haptic feedback, and wherein a second feedback event of the plurality of feedback events comprises activating the one or more haptic actuators based on a second parameter of the haptic feedback.

30. The method of claim 20 , wherein the image data is an image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2022
From: LI, MUHUA; HOLLAND, WESLEY JAMES; CHOURASIA, AJIT; CHEN, AN; MAYYURI, VIJAYA DATTA
To: QUALCOMM INCORPORATED
Reel/Frame 061418/0609 →
Continuity (1)
Related Publication 20240061505A1 · Feb 22, 2024
References Cited (6)
US 9963068B2 · Hada · 2018 [cited by examiner]
US 10059228B1 · Aikin · 2018 [cited by examiner]
US 10377307B2 · Hada · 2019 [cited by examiner]
US 10586369B1 · Roche · 2020 [cited by examiner]
US 20160062466A1 · Moussette et al. · 2016 [cited by applicant]
International Search Report and Written Opinion—PCT/US2023/071917—ISA/EPO—Oct. 25, 2023. [cited by applicant]