IP Library › Granted Patent US 9,858,676
Granted Patent B2
US 9,858,676 · App. 14/592,333 · Granted Jan 2, 2018

Displaying location-based rules on augmented reality glasses

Inventors: James E. Bostick (Cedar Park, TX); John M. Ganci, Jr. (Cary, NC); Sarbajit K. Rakshit (Kolkata, IN); Craig M. Trim (Sylmar, CA)
Assignee: International Business Machines Corporation
G06T7/20G02B27/017G02B2027/014G02B2027/0138
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,858,676
App. No.
14/592,333
Filed
Jan 8, 2015
Granted
Jan 2, 2018
Kind
B2
Art Unit
2617
USPC
345/619
Abstract

Augmented reality glasses include: a wearable frame; a lens attached to the wearable frame; a positioning device for determining a physical location and a field of view of a user of the augmented reality glasses; a rule retrieval device that retrieves one or more rules that pertain to the physical location and field of view of the user; a graphical information generator that generates graphical information that delineates an area in the field of view and describes a rule that is related to an environment of the delineated area; and a display coupled to the wearable frame, where the display overlays the graphical information onto the lens of the wearable frame according to the field of view of the user.

Claims (62)

1. Augmented reality glasses comprising:

a wearable frame;

a lens attached to the wearable frame;

a positioning device for determining a physical location and a field of view of a user of the augmented reality glasses;

a rule retrieval device, wherein the rule retrieval device retrieves one or more rules that pertain to the physical location and the field of view of the user, wherein the one or more rules identify one or more interests that have been identified by the user;

a receiver for receiving the one or more rules from a mapping service, wherein the mapping service identifies which prohibited activities are prohibited from being performed by the user at the physical location of the field of view, and wherein a graphical information generator generates icon representations describing the prohibited activities;

a display coupled to the wearable frame, wherein the display displays one or more of the icon representations associated with the one or more rules pertaining to the one or more environments within the field of view and the prohibited activities, wherein one or more of the icon representations are overlaid over images of the one or more environments presented on a lens of the wearable augmented reality eyeglasses;

a user input device for receiving a user input that defines the one or more rules, wherein the user input is from the user generating a signal that removes one or more of the icon representations from the display coupled to the wearable frame; and

one or more processors for:

determining that a vehicle within the field of view for the user at the physical location is transporting a particular person;

determining, based on a profile of the particular person, that photographing the particular person is unauthorized; and

in response to determining that photographing the particular person is unauthorized, overlaying a “no photography” icon over an image of the vehicle as presented on the lens of the wearable augmented reality eyeglasses.

2. The augmented reality glasses of claim 1 , wherein the positioning device comprises a 3-axis positioning device and a geographical positioning device.

3. The augmented reality glasses of claim 1 , wherein the user input is from the user selecting the one or more rules from a list of rules on a user interface of a smart phone.

4. The augmented reality glasses of claim 1 , further comprising:

a receiver for receiving the one or more rules from a weather service, wherein the weather service identifies current real-time weather conditions beyond the physical location of the field of view.

5. The augmented reality glasses of claim 1 , further comprising:

a receiver for receiving the one or more rules from a social media service, wherein the social media service provides a recommendation review of facilities within the physical location of the field of view.

6. The augmented reality glasses of claim 1 , wherein the activities that are prohibited are from a group consisting of photography, smoking, and pet accompaniment.

7. The augmented reality glasses of claim 1 , wherein the rule retrieval device retrieves the one or more rules from a smart phone being carried by the user.

8. A method for alerting a user of wearable augmented reality eyeglasses of rules pertaining to an environment within a prescribed field of view, the method comprising:

determining, by a positioning device, a physical location of a user;

determining, by the positioning device, a field of view for the user at the physical location;

retrieving, by a rule retrieval device, one or more rules pertaining to one or more environments within the field of view, wherein the one or more rules identify one or more interests that have been identified by the user;

receiving, by a receiver associated with a computing device, the one or more rules from a mapping service, wherein the mapping service identifies which prohibited activities are prohibited at the physical location of the field of view, and wherein the graphical information generator generates icon representations describing the prohibited activities;

displaying, by a display on wearable augmented reality eyeglasses, one or more of the icon representations associated with the one or more rules pertaining to the one or more environments within the field of view and the prohibited activities, wherein one or more of the icon representations are overlaid over images of the one or more environments presented on a lens of the wearable augmented reality eyeglasses;

receiving, by a user input device, a user input that defines the one or more rules, wherein the user input is from the user generating a signal on the display that removes one or more of the icon representations from the display coupled to the wearable frame;

determining, by one or more processors, that a vehicle within the field of view for the user at the physical location is transporting a particular person;

determining, by one or more processors, and based on a profile of the particular person, that photographing the particular person is unauthorized; and

in response to determining that photographing the particular person is unauthorized, overlaying a “no photography” icon over an image of the vehicle as presented on the lens of the wearable augmented reality eyeglasses.

9. The method of claim 8 , wherein the display is a projector, and wherein the projector overlays the images on the lens.

10. The method of claim 8 , wherein the display is a video screen, wherein the images are overlaid directly onto the video screen.

11. The method of claim 8 , further comprising:

receiving, by a rules receiving device, a user input that defines the one or more rules.

12. The method of claim 8 , further comprising:

receiving, by the rules receiving device, the one or more rules from a mapping service, wherein the mapping service identifies which activities are allowed at the physical location of the field of view.

13. The method of claim 8 , further comprising:

receiving, by the rules receiving device, the one or more rules from a weather service, wherein the weather service identifies current real-time weather conditions beyond the physical location of the field of view.

14. The method of claim 8 , further comprising:

determining, by an integration web application server, that the user has low vision; and

in response to determining that the user has low vision, magnifying the images of the one or more environments that are of interest to the user that has low vision.

15. The method of claim 8 , wherein an image presented on the lens of the wearable augmented reality eyeglasses is a retail establishment, and wherein the method further comprises:

receiving, by the receiver on the wearable augmented reality glasses, a plurality of favorable reports about the retail establishment, wherein the plurality of favorable reports are from a social media service; and

in response to receiving the plurality of favorable reports about the retail establishment, overlaying a “favorable icon” over an image of the retail establishment as presented on the lens of the wearable augmented reality eyeglasses.

16. A system comprising:

an integration web application server, wherein the integration web application server has access to rules related to fields of view; and

one or more augmented reality glasses, wherein each of the one or more augmented reality glasses comprises:

a wearable frame;

a lens attached to the wearable frame;

a positioning device for determining a physical location and a field of view of a user of the augmented reality glasses;

a rule retrieval device, wherein the rule retrieval device retrieves one or more rules that pertain to the physical location and the field of view of the user, wherein the one or more rules identify one or more interests that have been identified by the user;

a receiver for receiving the one or more rules from a mapping service, wherein the mapping service identifies which prohibited activities are prohibited at the physical location of the field of view, and wherein a graphical information generator generates icons describing the prohibited activities;

a display coupled to the wearable frame, wherein the display displays one or more of the icon representations associated with the one or more rules pertaining to the one or more environments within the field of view and the prohibited activities, wherein one or more of the icon representations are overlaid over images of the one or more environments presented on a lens of the wearable augmented reality eyeglasses;

a user input device for receiving a user input that defines the one or more rules, wherein the user input is from the user generating a signal on the display that removes one or more of the icon representations from the display coupled to the wearable frame; and

one or more processors for:

determining that a vehicle within the field of view for the user at the physical location is transporting a particular person;

determining, based on a profile of the particular person, that photographing the particular person is unauthorized; and

in response to determining that photographing the particular person is unauthorized, overlaying a “no photography” icon over an image of the vehicle as presented on the lens of the wearable augmented reality eyeglasses.

17. The system of claim 16 , wherein at least one of the one or more augmented reality glasses further comprises:

a user input device for receiving a user input that defines the one or more rules.

18. The system of claim 16 , further comprising:

a services server, wherein the services server provides a mapping service to at least one of the one or more augmented reality glasses, and wherein the mapping service identifies which activities are allowed and which activities are prohibited at the physical location of the field of view.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 8, 2015
From: BOSTICK, JAMES E.; GANCI, JOHN M., JR.; RAKSHIT, SARBAJIT K.; TRIM, CRAIG M.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 034665/0707 →
Continuity (1)
Related Publication 20160203639A1 · Jul 14, 2016