Home automation control using context sensitive menus

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 9,824,578
App. No.: 14/476,377
Granted: Nov 21, 2017
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

Various arrangements for presenting contextual menus are presented. A mobile device may be configured to provide contextual menus for control or monitoring of components. Different menus and interfaces are presented based the position of the mobile device or objects being pointed at using the mobile device. Specific objects may be designated as control markers. The objects may be recognized using a camera of the mobile device. When a control marker is recognized a specific menu or interface that is associated with the control marker may be presented to the user.

Claims (79)

1. A method for automation control using a mobile device, comprising:

receiving, using an input interface, input corresponding to selection of a remote controlled home automation device;

capturing, using an image sensor, an image of a house-hold object to designate as a control marker for the remote controlled home automation device;

capturing, using a position sensor, a position of the mobile device to associate with control marker;

generating a template for the control marker using the position and the image;

determining a relative position of the mobile device in relation to the house-hold object designated as a control marker for the remote controlled home automation device;

capturing, using the image sensor, a second image of the house-hold object;

determining that the mobile device is pointing at the control marker by analyzing the second image, the relative position, and the template;

providing an indication that the mobile device is pointing at the control marker;

determining a user interface for the remote controlled home automation device; and

providing the user interface on the mobile device for interacting with the remote controlled home automation device;

wherein the user interface includes features specific to the remote controlled home automation device.

2. The method of claim 1 , further comprising:

establishing a communication channel with the remote controlled home automation device;

receiving, via the communication channel, data related to a state of the remote controlled home automation device; and

transmitting, via the communication channel, a control command to the remote controlled home automation device.

3. The method of claim 1 , further comprising:

determining a change in the relative position of the mobile device;

determining that the mobile device is pointing at a second control marker associated with a second remote controlled home automation device; and

modifying the user interface on the mobile device for interacting with the second remote controlled home automation device associated with the second control marker.

4. The method of claim 1 , wherein position includes an orientation and a location of the mobile device.

5. The method of claim 1 , further comprising:

receiving input corresponding to selection of a custom interface design including one or more features specific to the remote controlled home automation device to include in the user interface; and

modifying the user interface to include the custom interface design.

6. The method of claim 5 , wherein the custom interface design includes a subset of available features specific to the remote controlled home automation device.

7. The method of claim 1 , wherein determining the relative position of the mobile device comprises:

receiving data from a sensor attached to the mobile device; and

tracking movement of the mobile device by analyzing changes in data from the sensor.

8. A non-transitory processor-readable medium for automation control using a mobile device, the medium comprising processor-readable instructions that, when executed by one or more processors, cause the one or more processors to perform operations including: