IP Library › Granted Patent US 12,093,524

Granted Patent B2

US 12,093,524 · App. 17/451,319 · Granted Sep 17, 2024

Multifunction device control of another electronic device

Inventors: Michael S. Smochko (San Jose, CA); Justin T. Voss (Santa Clara, CA); Eliza J. Von Hagen (Campbell, CA)

Assignee: Apple Inc.

G06F3/04883 G06F3/03547 G06F3/038 G06F3/0482 G06F3/04842 G06F2203/04105

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 12,093,524
App. No.: 17/451,319
Granted: Sep 17, 2024
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

Some embodiments described in this disclosure are directed to one or more input devices that simulate dedicated remote control functionality for navigating and playing content items available on other electronic devices, and one or more operations related to the above that the input devices and other electronic devices optionally perform. Some embodiments described in this disclosure are directed to one or more multifunction devices via which keyboard input to electronic devices is provided, and one or more operations related to the above that the multifunction devices and the electronic devices optionally perform. Some embodiments described in this disclosure are directed to one or more multifunction devices via which control and/or navigational inputs to electronic devices is provided, and one or more operations related to the above that the multifunction devices and the electronic devices optionally perform.

Claims (144)

1. A method comprising:

at an electronic device with one or more processors and memory:

detecting a touch input on a touch-sensitive surface of an input device that controls a user interface displayed by a display, wherein detecting the touch input includes detecting touchdown of a contact, movement of the contact, and an increase in a characteristic intensity of the contact to a respective intensity, wherein the characteristic intensity corresponds to force with which the contact is touching the touch-sensitive surface of the input device; and

in response to detecting the touch input:

in accordance with a determination that the movement of the contact meets first movement criteria when the increase in the characteristic intensity of the contact to the respective intensity is detected, wherein the first movement criteria include a criterion that is met when the contact has a first speed during the touch input, generating a selection input that corresponds to the increase in intensity of the contact to the respective intensity;

in accordance with a determination that the respective intensity is less than a first intensity threshold and that the movement of the contact meets second movement criteria when the increase in the characteristic intensity of the contact to the respective intensity is detected, wherein the second movement criteria include a criterion that is met when the contact has a second speed during the touch input that is greater than the first speed, forgoing generation of the selection input that corresponds to the increase in intensity of the contact to the respective intensity; and

in accordance with a determination that the respective intensity is greater than the first intensity threshold and that the movement of the contact meets the second movement criteria, generating the selection input that corresponds to the increase in the intensity of the contact to the respective intensity.

2. The method of claim 1 , wherein generating the selection input that corresponds to the increase in intensity of the contact to the respective intensity comprises initiating an operation to provide haptic feedback at the input device in response to generating the selection input.

3. The method of claim 1 , further comprising:

in accordance with a determination that the movement of the contact meets the first movement criteria, and, after the increase in the characteristic intensity of the contact to the respective intensity is detected, the movement of the contact is less than a movement threshold, generating a click-and-hold input that corresponds to the contact.

4. The method of claim 3 , further comprising:

in accordance with a determination that the movement of the contact meets the first movement criteria, and, after the increase in the characteristic intensity of the contact to the respective intensity is detected, the movement of the contact is greater than the movement threshold, generating a click-and-drag input that corresponds to the movement of the contact.

5. The method of claim 1 , further comprising:

in accordance with a determination that the movement of the contact meets the second movement criteria, and the movement of the contact is less than a movement threshold, generating a tap input that corresponds to the contact.

6. The method of claim 5 , further comprising:

in accordance with a determination that the movement of the contact meets the second movement criteria, and the movement of the contact is greater than the movement threshold, generating a swipe input that corresponds to the movement of the contact.

7. The method of claim 1 , wherein:

the electronic device comprises the input device and the touch-sensitive surface, and

generating the selection input comprises transmitting, by the electronic device, a corresponding first event to a second electronic device, different from the electronic device, to select a currently-selected user interface element displayed by the second electronic device.

8. The method of claim 7 , wherein the electronic device comprises a mobile telephone.

9. The method of claim 7 , further comprising:

in response to detecting the touchdown of the contact, transmitting, by the electronic device, a simulated touchdown event to the second electronic device.

10. The method of claim 7 , further comprising:

in accordance with the determination that the movement of the contact meets the first movement criteria, transmitting, by the electronic device, a simulated button press event to the second electronic device.

11. The method of claim 7 , wherein:

the electronic device comprises a multifunction device running a remote control application, and

the remote control application causes the electronic device to transmit events, including the corresponding first event, to the second electronic device, the transmitted events corresponding to events transmitted to the second electronic device by a dedicated remote control device of the second electronic device, the dedicated remote control device having a trackpad that includes button click functionality.

12. The method of claim 1 , further comprising:

detecting a second touch input on the touch-sensitive surface of the input device, wherein detecting the second touch input includes detecting touchdown of a second contact, movement of the second contact, and an increase in a characteristic intensity of the second contact to a second respective intensity, greater than the respective intensity; and

in response to detecting the second touch input:

in accordance with a determination that the movement of the second contact meets the second movement criteria when the increase in the characteristic intensity of the second contact to the second respective intensity is detected, wherein the second movement criteria include a criterion that is met when the second contact has the second speed during the touch input that is greater than the first speed, generating a selection input that corresponds to the increase in intensity of the second contact to the second respective intensity; and

in accordance with a determination that the movement of the second contact meets third movement criteria when the increase in the characteristic intensity of the second contact to the second respective intensity is detected, wherein the third movement criteria include a criterion that is met when the second contact has a third speed during the second touch input that is greater than the second speed, forgoing generation of the selection input that corresponds to the increase in intensity of the second contact to the second respective intensity.

13. The method of claim 1 , wherein the movement of the contact meets the second movement criteria, and the method further comprises:

detecting a second touch input on the touch-sensitive surface of the input device after detecting liftoff of the contact in the touch input, wherein detecting the second touch input includes detecting touchdown of a second contact, movement of the second contact, and an increase in a characteristic intensity of the second contact to the respective intensity; and

in response to detecting the second touch input, the movement of the second contact meeting the first movement criteria, wherein the first movement criteria includes a criterion that is met when the second contact has the first speed during the second touch input:

in accordance with a determination that the touchdown of the second contact is detected after a time threshold of the liftoff of the contact, generating a second selection input that corresponds to the increase in intensity of the second contact to the respective intensity; and

in accordance with a determination that the touchdown of the second contact is detected within the time threshold of the liftoff of the contact, forgoing generation of the second selection input that corresponds to the increase in intensity of the second contact to the respective intensity.

14. The method of claim 1 , wherein the movement of the contact meets the second movement criteria, and the method further comprises:

before detecting liftoff of the contact, detecting a slowdown of the contact from the second speed; and

in response to detecting the slowdown of the contact from the second speed, in accordance with a determination that the movement of the contact after detecting the slowdown of the contact meets the first movement criteria, wherein the first movement criteria include the criterion that is met when the contact has the first speed during the touch input, generating the selection input that corresponds to the increase in intensity of the contact to the respective intensity.

15. The method of claim 14 , wherein the first movement criteria include a criterion that is met when, after detecting the slowdown of the contact from the second speed, the contact has the first speed for longer than a time threshold.

16. The method of claim 1 , further comprising:

after generating the selection input that corresponds to the increase in intensity of the contact to the respective intensity, initiating an operation to select an item in the user interface corresponding to a respective location at which the contact is positioned touching the touch-sensitive surface of the input device.

17. The method of claim 1 , wherein the selection input that corresponds to the increase in intensity of the contact to the respective intensity is associated with an intensity threshold greater than a respective intensity threshold required to generate a selection input prior to the movement of the contact meeting the first movement criteria.

18. The method of claim 1 , wherein:

generating the selection input that corresponds to the increase in the intensity of the contact to the respective intensity in accordance with the determination that the movement of the contact meets the first movement criteria is in accordance with a determination that the respective intensity is greater than a second intensity threshold required to generate a selection input, and

the second intensity threshold is less than the first intensity threshold.

19. An electronic device, comprising:

one or more processors;

memory;

a display device;

one or more input devices; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

in response to detecting the touch input:

20. The electronic device of claim 19 , wherein generating the selection input that corresponds to the increase in intensity of the contact to the respective intensity comprises initiating an operation to provide haptic feedback at the input device in response to generating the selection input.

21. The electronic device of claim 19 , the one or more programs further including instructions for:

22. The electronic device of claim 21 , the one or more programs further including instructions for:

in accordance with a determination that the movement of the contact meets the first movement criteria, and, after the increase in the characteristic intensity of the contact to the respective intensity is detected, the movement of the contact is greater than the movement threshold, generating a click-and-drag input that corresponds to the movement of the contact.

23. The electronic device of claim 19 , the one or more programs further including instructions for:

24. The electronic device of claim 23 , the one or more programs further including instructions for:

25. The electronic device of claim 19 , wherein:

the electronic device comprises the input device and the touch-sensitive surface, and

26. The electronic device of claim 25 , wherein the electronic device comprises a mobile telephone.

27. The electronic device of claim 25 , the one or more programs further including instructions for:

in response to detecting the touchdown of the contact, transmitting, by the electronic device, a simulated touchdown event to the second electronic device.

28. The electronic device of claim 25 , the one or more programs further including instructions for:

29. The electronic device of claim 25 , wherein:

the electronic device comprises a multifunction device running a remote control application, and

30. The electronic device of claim 19 , the one or more programs further including instructions for:

in response to detecting the second touch input:

31. The electronic device of claim 19 , wherein the movement of the contact meets the second movement criteria, and the one or more programs further including instructions for:

32. The electronic device of claim 19 , wherein the movement of the contact meets the second movement criteria, and the one or more programs further including instructions for:

before detecting liftoff of the contact, detecting a slowdown of the contact from the second speed; and

33. The electronic device of claim 32 , wherein the first movement criteria include a criterion that is met when, after detecting the slowdown of the contact from the second speed, the contact has the first speed for longer than a time threshold.

34. The electronic device of claim 19 , the one or more programs further including instructions for:

35. The electronic device of claim 19 , wherein the selection input that corresponds to the increase in intensity of the contact to the respective intensity is associated with an intensity threshold greater than a respective intensity threshold required to generate a selection input prior to the movement of the contact meeting the first movement criteria.

36. The electronic device of claim 19 , wherein:

the second intensity threshold is less than the first intensity threshold.

37. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device with a display device and one or more input devices, cause the electronic device to:

detect a touch input on a touch-sensitive surface of an input device that controls a user interface displayed by a display, wherein detecting the touch input includes detecting touchdown of a contact, movement of the contact, and an increase in a characteristic intensity of the contact to a respective intensity, wherein the characteristic intensity corresponds to force with which the contact is touching the touch-sensitive surface of the input device; and

in response to detecting the touch input:

in accordance with a determination that the movement of the contact meets first movement criteria when the increase in the characteristic intensity of the contact to the respective intensity is detected, wherein the first movement criteria include a criterion that is met when the contact has a first speed during the touch input, generate a selection input that corresponds to the increase in intensity of the contact to the respective intensity;

in accordance with a determination that the respective intensity is less than a first intensity threshold and that the movement of the contact meets second movement criteria when the increase in the characteristic intensity of the contact to the respective intensity is detected, wherein the second movement criteria include a criterion that is met when the contact has a second speed during the touch input that is greater than the first speed, forgo generation of the selection input that corresponds to the increase in intensity of the contact to the respective intensity; and

38. The non-transitory computer readable storage medium of claim 37 , wherein generating the selection input that corresponds to the increase in intensity of the contact to the respective intensity comprises initiating an operation to provide haptic feedback at the input device in response to generating the selection input.

39. The non-transitory computer readable storage medium of claim 37 , the one or more programs further comprising instructions for:

40. The non-transitory computer readable storage medium of claim 39 , the one or more programs further comprising instructions for:

in accordance with a determination that the movement of the contact meets the first movement criteria, and, after the increase in the characteristic intensity of the contact to the respective intensity is detected, the movement of the contact is greater than the movement threshold, generating a click-and-drag input that corresponds to the movement of the contact.

41. The non-transitory computer readable storage medium of claim 37 , the one or more programs further comprising instructions for:

42. The non-transitory computer readable storage medium of claim 41 , the one or more programs further comprising instructions for:

43. The non-transitory computer readable storage medium of claim 37 , wherein:

the electronic device comprises the input device and the touch-sensitive surface, and

44. The non-transitory computer readable storage medium of claim 43 , wherein the electronic device comprises a mobile telephone.

45. The non-transitory computer readable storage medium of claim 43 , the one or more programs further comprising instructions for:

in response to detecting the touchdown of the contact, transmitting, by the electronic device, a simulated touchdown event to the second electronic device.

46. The non-transitory computer readable storage medium of claim 43 , the one or more programs further comprising instructions for:

47. The non-transitory computer readable storage medium of claim 43 , wherein:

the electronic device comprises a multifunction device running a remote control application, and

48. The non-transitory computer readable storage medium of claim 37 , the one or more programs further comprising instructions for:

in response to detecting the second touch input:

49. The non-transitory computer readable storage medium of claim 37 , wherein the movement of the contact meets the second movement criteria, and the one or more programs further comprising instructions for:

50. The non-transitory computer readable storage medium of claim 37 , wherein the movement of the contact meets the second movement criteria, and the one or more programs further comprising instructions for:

before detecting liftoff of the contact, detecting a slowdown of the contact from the second speed; and

51. The non-transitory computer readable storage medium of claim 50 , wherein the first movement criteria include a criterion that is met when, after detecting the slowdown of the contact from the second speed, the contact has the first speed for longer than a time threshold.

52. The non-transitory computer readable storage medium of claim 37 , the one or more programs further comprising instructions for:

53. The non-transitory computer readable storage medium of claim 37 , wherein the selection input that corresponds to the increase in intensity of the contact to the respective intensity is associated with an intensity threshold greater than a respective intensity threshold required to generate a selection input prior to the movement of the contact meeting the first movement criteria.

54. The non-transitory computer readable storage medium of claim 37 , wherein:

the second intensity threshold is less than the first intensity threshold.

Assignments (1)

ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 25, 2022

From: SMOCHKO, MICHAEL S.; VOSS, JUSTIN T.; VON HAGEN, ELIZA J.

To: APPLE INC.

Reel/Frame 061534/0084 →

Continuity (7)

Continuation 16067511

Continuation In Part 15272405 · Sep 21, 2016

Provisional Application 62314342 · Mar 28, 2016

Provisional Application 62348700 · Jun 10, 2016

Provisional Application 62369174 · Jul 31, 2016

Provisional Application 62476778 · Mar 25, 2017

Related Publication 20220035521A1 · Feb 3, 2022