IP Library Granted Patent US 11,770,501
Granted Patent B2
US 11,770,501 · App. 17/374,047 · Granted Sep 26, 2023

Remote state following devices

Inventors: William Glaser (Berkeley, CA); Brian Van Osdol (Piedmont, CA)
Assignee: Grabango Co.
H04N7/18G06F18/213G06V10/245G06V20/52G06V40/10G06V40/20G08B13/196H04L12/282H04L12/2809H04L12/2814H04L67/12H04N7/183H04N23/51H04N23/57H05B47/105H05B47/125H05B47/19G06V20/63
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,770,501
App. No.
17/374,047
Granted
Sep 26, 2023
Kind
B2
Abstract

A system and method for a remote state following device that includes an electronic device with a controllable operating state; an imaging device; and control system that when targeted at a control interface interprets a visual state from the control interface, and modifies the operating state in coordination with the visual state.

Claims (34)

1. A system comprising:

an imaging device that captures image data of an environment;

a control system communicatively coupled to the imaging device and an electronic device, the control system comprising a visually monitored interface control mode with configuration to:

detect a control interface through identification of a pairing identifier of the control interface in the image data,

interpret a visual state of the control interface, and

modulate an operating state of the electronic device in coordination with the visual state.

2. The system of claim 1 ,

wherein configuration to modulate the operating state in coordination with the visual state is restricted to modulate the operating state during detection of the control interface.

3. The system of claim 1 , wherein there are at least two types of detectable control interfaces, and wherein a first type of control interface has a first set of visual states that are mapped to two distinct operating states and a second type of control interface that has a second set of visual states that are mapped to a range of operating states.

4. The system of claim 1 , wherein the control interface is a non-electric element.

5. The system of claim 1 , wherein the control interface comprises at least one interaction region, wherein the interpretation of visual state comprises configuration to detect a user gesture within the interaction region, and wherein the detected gesture and the interaction region map to a targeted operating state.

6. The system of claim 1 , wherein the control system further comprises a pairing mode, wherein during a pairing mode, the control system is configured to detect the pairing identifier in a sub-region of the image data, and upon detection of the pairing identifier, register that sub-region for detection of a control interface.

7. The system of claim 1 , further comprising an ambient activity sensor, and wherein the control system comprises activating the visually monitored interface control mode upon activation of the ambient activity sensor.

8. The system of claim 1 , further comprising a directable housing that at least partially encases the imaging device and couples to the electronic device.

9. The system of claim 1 , wherein the visually monitored interface control mode further comprises configuration to:

detect a second control interface through identification of a second pairing identifier of the control interface in the image data,

interpret a second visual state of the second control interface, and

modulate the operating state of the electronic device in coordination with the visual state and the second visual state.

10. The system of claim 1 , wherein the control interface is a thermometer meter.

11. The system of claim 10 , wherein the configuration to modulate the operating state of the electronic device_in coordination with the visual state modifies a temperature setting of the electronic device.

12. The system of claim 1 , wherein the control interface is graphical display of a user interface.

13. The system of claim 1 , wherein the control interface is a mechanical mechanism with two or more physical states.

14. The system of claim 1 , wherein the interface control mode further comprises configuration to trigger an alert based on the visual state.

15. A method for control of an electronic device comprising:

capturing, using an imaging device, image data of an environment;

at a control system communicatively coupled to the imaging device and the electronic device, detecting a control interface through identification of a pairing identifier of the control interface in the image date;

interpreting a visual state of the control interface; and

modulating an operating state of the electronic device in coordination with the visual state.

16. The method of claim 15 , wherein detecting the control interface through identification of a pairing identifier of the control interface comprises: detecting the pairing identifier in a sub-region of the image data, and upon detecting of the pairing identifier, registering that sub-region for detection of a control interface.

17. The method of claim 15 , wherein the control interface is a thermometer meter; and wherein modulating the_operating state of the electronic device in coordination with the visual state comprises modifying a temperature setting of the electronic device.

18. The method of claim 15 , wherein the control interface is graphical display of a user interface.

19. The method of claim 15 , wherein the control interface is a mechanical mechanism with two or more physical states.

20. The method of claim 15 , wherein interpreting a visual state of the control interface comprises detecting a set of visual physical states of the control interface.

21. The method of claim 15 , wherein interpreting a visual state of the control interface comprises detecting a visual gesture with an interaction region of the control interface.

Assignments (4)
SECURITY INTEREST Recorded Sep 9, 2024
From: GRABANGO CO.
To: GLICKBERG, DANIEL
Reel/Frame 068901/0799 →
SECURITY INTEREST Recorded Jun 5, 2024
From: GRABANGO CO.
To: FIRST-CITIZEN BANK & TRUST COMPANY
Reel/Frame 067637/0231 →
SECURITY INTEREST Recorded Jun 4, 2024
From: GRABANGO CO.
To: GLICKBERG, DANIEL
Reel/Frame 067611/0150 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 21, 2022
From: GLASER, WILLIAM; VAN OSDOL, BRIAN
To: GRABANGO CO.
Reel/Frame 058729/0389 →
Continuity (5)
Continuation 16358014 · Mar 19, 2019
Continuation 15644803 · Jul 9, 2017
Provisional Application 62360369 · Jul 9, 2016
Provisional Application 62360366 · Jul 9, 2016
Related Publication 20220004743A1 · Jan 6, 2022