IP Library Patent Application 16797662
Patent Application
App. No. 16/797,662

USER INTERFACE CONTROLLED BY ENVIRONMENTAL CUES

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
16/797,662
Abstract

A method comprises receiving a signal containing an environmental cue; correlating the environmental cue to a user interface control element; and generating a user interface control command based on the environmental cue, A device may be controlled by receiving a visual image, processing the image to identify a visual cue, correlating the visual cue with a user interface control, and controlling the device using the user interface control. The visual image may be received from a camera that is part of an automobile, and the user interface control may include a control for a radio to tune to a radio station; a speed control for controlling a speed of the automobile corresponding to a speed sign visual cue; or a navigation system control for controlling a navigation system based on traffic signs. Other variations include an apparatus and computer-readable media including instructions for performing the methods.

Claims (36)

1 . A method on a mobile device, comprising:

receiving a visual image of a sign captured by a camera module of the mobile device;

obtaining position information of said mobile device;

processing said visual image to identify an information element contained on said visual image; and

accessing a timetable when said information element relates to a transportation service, wherein said timetable is relative to said position information.

2 . The method of claim 1 , further comprising:

dialing a phone number when said information element relates to a phone number.

3 . The method of claim 1 , further comprising:

accessing a web page when said information element relates to a website address.

4 . The method of claim 1 , wherein processing said visual image to identify said information element comprises:

storing a cue database; and

correlating said visual image to one or more cues of said activated cue database.

5 . A mobile device, comprising:

a display configured to display a graphical user interface;

a camera module configured to capture visual images;

a GPS receiver configured to determine a current geographic location of said mobile device; and

a processor configured to:

receive a visual image of a sign captured by said camera module of said mobile device;

obtain said current geographic location of said mobile device from said GPS receiver;

process said visual image to identify an information element contained on said visual image; and

access a timetable when said information element relates to a transportation service, wherein said timetable is relative to said current geographic position.

6 . The mobile device of claim 5 , wherein said processor is further configured to dial a phone number when said information element relates to a phone number.

7 . The mobile device of claim 5 , wherein said processor is further configured to access a web page when said information element relates to a website address.

8 . The mobile device of claim 5 , further comprising a storage device, wherein said processor is further configured to, when processing said visual image to identify said information element:

store a cue database in the storage device; and

correlate the visual image to one or more cues of said cue database.

9 . A non-transitory computer-readable medium storing executable instructions configured to, when executed, cause a processor to:

receive a visual image of a sign captured by a camera module of a mobile device;

obtain position information of said mobile device;

process said visual image to identify an information element contained on said visual image; and

access a timetable when said information element relates to a transportation service, wherein said timetable is relative to said position information.

10 . The computer-readable medium of claim 9 , wherein said executable instructions are further configured to cause said processor to dial a phone number when said information element relates to a phone number.

11 . The computer-readable medium of claim 9 , wherein the executable instructions are configured to cause said processor to access a web page when said information element relates to a website address.

12 . The computer-readable medium of claim 9 , wherein for processing said visual image to identify said information element, the executable instructions further cause said processor to:

store a cue database; and

correlate said visual image to one or more cues of said activated cue database.