IP Library › Granted Patent US 12,268,955
Granted Patent B2
US 12,268,955 · App. 18/510,381 · Granted Apr 8, 2025

Context-sensitive remote eyewear controller

Inventors: Simon Nielsen (Beverly Hills, CA); Jonathan Rodriguez (La Habra, CA); Yu Jiang Tham (Seattle, WA)
Assignee: Snap Inc.
A63F13/22A63F13/211A63F13/2145A63F13/24A63F13/327A63F13/40A63F13/92G06F3/0346G06F3/038G06F3/04842G06F3/04886G06F2203/0384
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,268,955
App. No.
18/510,381
Granted
Apr 8, 2025
Kind
B2
Abstract

Context-sensitive remote controls for use with electronic devices (e.g., eyewear device). The electronic device is configured to perform activities (e.g., email, painting, navigation, gaming). The context-sensitive remote control includes a display having a display area, a display driver coupled to the display, and a transceiver. The remote control additionally includes memory that stores controller layout configurations for display in the display area of the display by the display driver. A processor in the context-sensitive remote control is configured to establish, via the transceiver, communication with an electronic device, detect an activity currently being performed by the electronic device, select one of the controller layout configurations responsive to the detected activity, and present, via the display driver, the selected controller layout configuration in the display area of the display.

Claims (65)

1. A remote control for use with an electronic device, the remote control comprising:

a display having a display area;

a first transceiver;

a second transceiver;

a memory storing at least one controller layout configurations for presentation in the display area;

a processor coupled to the first and second transceivers and the memory; and

programming in the memory, wherein execution of the programming by the processor configures the processor to perform functions, including functions to:

monitor availability of wireless networks;

monitor communication requirements for the remote control to communicate with the electronic device;

select the first transceiver or the second transceiver for communication between the remote control and the electronic device responsive to the availability of the wireless networks and the communication requirements;

receive an activity indicator associated with a current activity being performed by the electronic device via the selected transceiver;

determine the current activity being performed by the electronic device from the activity indicator;

determine a controller layout configuration for the current activity; and

present the controller layout configuration on the display in the display area.

2. The remote control of claim 1 , wherein the first transceiver is configurable to communicate via Bluetooth™ and the second transceiver is configurable to communication via WiFi.

3. The remote control of claim 2 , wherein the remote control is configurable to communicate via the first transceiver directly with the electronic device and to communicate via the second transceiver indirectly with the electronic device.

4. The remote control of claim 1 , wherein the function to select comprises the functions to:

establish communication with the electronic device via the first transceiver, the first transceiver associated with a bandwidth threshold; and

transition communication from the first transceiver to the second transceiver when the second transceiver is available and the monitored communication requirements exceed the bandwidth threshold.

5. The remote control of claim 1 , wherein the function to monitor comprises the functions to:

monitor the second transceiver to determine if a particular connection is available to the remote control;

receive identification information from the electronic device that the particular connection is available to the electronic device; and

determine that the particular connection is available when the particular connection is available to both the remote control and the electronic device.

6. The remote control of claim 5 , wherein the function to monitor the second transceiver comprises the function to:

periodically request signal strength information from the second transceiver.

7. The remote control of claim 1 , wherein the first transceiver is selected for text communications and the second transceiver is selected for steaming video communications.

8. The remote control of claim 1 , wherein the first transceiver has lower power consumption than the second transceiver.

9. A method for use with a remote controller, the method comprising:

monitoring availability of wireless networks;

monitoring communication requirements for the remote control to communicate with an electronic device;

selecting a first transceiver or a second transceiver of the remote control for communication between the remote control and the electronic device responsive to the availability of the wireless networks and the communication requirements;

receiving an activity indicator associated with a current activity being performed by the electronic device via the selected transceiver;

determining the current activity being performed by the electronic device from the activity indicator;

determining a controller layout configuration for the current activity; and

presenting the controller layout configuration on a display of the remote control in a display area.

10. The method of claim 9 , wherein the first transceiver is configurable to communicate via Bluetooth™ and the second transceiver is configurable to communication via WiFi and wherein the remote control is configurable to communicate via the first transceiver directly with the electronic device and to communicate via the second transceiver indirectly with the electronic device.

11. The method of claim 9 , wherein the selecting comprises:

establishing communication with the electronic device via the first transceiver, the first transceiver associated with a bandwidth threshold; and

transitioning communication from the first transceiver to the second transceiver when the second transceiver is available and the monitored communication requirements exceed the bandwidth threshold.

12. The method of claim 9 , wherein the monitoring comprises:

monitoring the second transceiver to determine if a particular connection is available to the remote control;

receiving identification information from the electronic device that the particular connection is available to the electronic device; and

determining that the particular connection is available when the particular connection is available to both the remote control and the electronic device.

13. The method of claim 12 , wherein the monitoring the second transceiver comprises:

periodically requesting signal strength information from the second transceiver.

14. The method of claim 9 , wherein the first transceiver is selected for text communications and the second transceiver is selected for steaming video communications.

15. The method of claim 9 , wherein the first transceiver has lower power consumption than the second transceiver.

16. A non-transitory computer-readable medium storing program code that, when executed, is operative to cause an electronic processor of a remote control to perform steps of:

monitoring availability of wireless networks;

monitoring communication requirements for the remote control to communicate with an electronic device;

selecting a first transceiver or a second transceiver of the remote control for communication between the remote control and the electronic device responsive to the availability of the wireless networks and the communication requirements;

receiving an activity indicator associated with a current activity being performed by the electronic device via the selected transceiver;

determining the current activity being performed by the electronic device from the activity indicator;

determining a controller layout configuration for the current activity; and

presenting the controller layout configuration on a display of the remote control in a display area.

17. The non-transitory computer-readable medium of claim 16 , wherein the first transceiver is configurable to communicate via Bluetooth™ and the second transceiver is configurable to communication via WiFi and wherein the remote control is configurable to communicate via the first transceiver directly with the electronic device and to communicate via the second transceiver indirectly with the electronic device.

18. The non-transitory computer-readable medium of claim 16 , wherein the selecting comprises:

establishing communication with the electronic device via the first transceiver, the first transceiver associated with a bandwidth threshold; and

transitioning communication from the first transceiver to the second transceiver when the second transceiver is available and the monitored communication requirements exceed the bandwidth threshold.

19. The non-transitory computer-readable medium of claim 16 , wherein the monitoring comprises:

monitoring the second transceiver to determine if a particular connection is available to the remote control;

receiving identification information from the electronic device that the particular connection is available to the electronic device; and

determining that the particular connection is available when the particular connection is available to both the remote control and the electronic device.

20. The non-transitory computer-readable medium of claim 19 , wherein the monitoring the second transceiver comprises:

periodically requesting signal strength information from the second transceiver.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 15, 2023
From: NIELSEN, SIMON; RODRIGUEZ, JONATHAN; THAM, YU JIANG
To: SNAP INC.
Reel/Frame 065576/0308 →
Continuity (3)
Continuation 18076486 · Dec 7, 2022
Continuation 17034700 · Sep 28, 2020
Related Publication 20240082697A1 · Mar 14, 2024
References Cited (21)
US 9782673B2 · Takagi et al. · 2017 [cited by applicant]
US 9937415B1 · Makuch · 2018 [cited by examiner]
US 11541305B2 · Nielsen et al. · 2023 [cited by applicant]
US 20100220064A1 · Griffin et al. · 2010 [cited by applicant]
US 20110285636A1 · Howard et al. · 2011 [cited by applicant]
US 20120154108A1 · Sugaya · 2012 [cited by applicant]
US 20130162411A1 · Moses et al. · 2013 [cited by applicant]
US 20130174079A1 · Morley et al. · 2013 [cited by applicant]
US 20130205206A1 · Hawver et al. · 2013 [cited by applicant]
US 20140132514A1 · Kuzara et al. · 2014 [cited by applicant]
US 20140184524A1 · Schiefer et al. · 2014 [cited by applicant]
US 20140315636A1 · Zarfati et al. · 2014 [cited by applicant]
US 20150077364A1 · Parthasarathy et al. · 2015 [cited by applicant]
US 20150199899A1 · Tanaka et al. · 2015 [cited by applicant]
US 20150378459A1 · Sawada · 2015 [cited by applicant]
US 20160155321A1 · Adams, III · 2016 [cited by examiner]
US 20170011624A1 · Guihot · 2017 [cited by applicant]
US 20190227908A1 · Munafo et al. · 2019 [cited by applicant]
US 20210252387A1 · Spofford · 2021 [cited by applicant]
EP 2667583A2 · 2013 [cited by applicant]
International Search Report and Written Opinion received in Patent Cooperation Treaty Application No. PCT/US2021/051674, dated Jan. 4, 2022, 13 pages. [cited by applicant]