IP Library › Granted Patent US 10,983,593
Granted Patent B2
US 10,983,593 · App. 16/381,203 · Granted Apr 20, 2021

Wearable glasses and method of displaying image via the wearable glasses

Inventor: Kyung-Ho Jeong (Seoul, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06F3/013G02B27/0093G02B27/017G02B27/0172G02B27/0179G06K9/0061G06T19/006G02B2027/014G02B2027/0138G02B2027/0178G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,983,593
App. No.
16/381,203
Granted
Apr 20, 2021
Kind
B2
Abstract

Provided are wearable glasses including a display and a method of operating the same. The wearable glasses include: a display configured to display an image; a sensor configured to acquire wear state information representing a state in which a user currently wears the wearable glasses, while the image is being displayed on the display; and a processor configured to determine an inclination of the wearable glasses with respect to the user based on the acquired wear state information, and to adjust, based on the determined inclination, the image that is displayed on the display.

Claims (103)

1. Wearable glasses comprising:

a display configured to display an image;

a sensor configured to acquire information about an eye of a user wearing the wearable glasses while the image is displayed on the display; and

a processor configured to:

determine at least one of a movement direction and a movement distance of the wearable glasses with respect to the eye of the user based on the information about the eye of the user,

detect a change in a size of a pupil of the user based on the information about the eye of the user,

adjust a size of the image, based on at least one of the movement direction and the movement distance of the wearable glasses with respect to the eye of the user,

adjust brightness of the image based on the change in the size of the pupil, and

control the display to display the image of which both the brightness and the size are adjusted based on a movement of the wearable glasses and the change in the size of the pupil.

2. The wearable glasses of claim 1 , wherein:

the sensor is configured to acquire information about a body part of the user,

wherein the processor is configured to determine an inclination of the wearable glasses with respect to the user by comparing the information about the body part of the user with predetermined reference wear state information.

3. The wearable glasses of claim 2 , wherein:

the sensor is configured to acquire an image of the body part; and

the processor is configured to:

detect an area corresponding to the body part from the image of the body part,

acquire a property value from the detected area, and

compare the property value with a reference value included in the predetermined reference wear state information in order to determine the inclination.

4. The wearable glasses of claim 1 , wherein:

the information about the eye of the user comprises an image of the eye, and

the processor is configured to:

acquire at least one value from among a length of a major axis of the eye, a length of a minor axis of the eye, an angle of the major axis of the eye, an angle of the minor axis of the eye, and a location value of an iris of the user from the image of the eye,

compare the at least one value with at least one predetermined reference value, and

determine an inclination of the wearable glasses with respect to the user based on a result of comparing the at least one value with the at least one predetermined reference value.

5. The wearable glasses of claim 1 , wherein:

the display is configured to display a test image;

the sensor is configured to acquire an image of the eye on which the test image is reflected; and

the processor is configured to:

detect an area corresponding to the eye of the user from the image of the eye,

obtain a reflection image which is formed by reflection of the test image on the eye of the user within the detected area corresponding to the eye,

compare the at least one of a size and a shape of the reflection image with predetermined reference wear state information, and

determine an inclination of the wearable glasses with respect to the user based on a result of comparing the at least one of the size and the shape of the reflection image with the predetermined reference wear state information.

6. The wearable glasses of claim 1 , wherein

the sensor is configured to obtain a state value representing a movement state of the wearable glasses, and

the processor is configured to determine an inclination of the wearable glasses with respect to the user when the state value is equal to or greater than a predetermined value.

7. The wearable glasses of claim 1 , wherein the processor is configured to:

determine whether an inclination of the wearable glasses with respect to the user is equal to or greater than a predetermined value,

control the display to adjust the image based on the inclination if the inclination is less than the predetermined value, and

control the display to display an image informing the user to adjust a position of the wearable glasses if the inclination is equal to or greater than the predetermined value.

8. A method of displaying an image via wearable glasses, the method comprising:

displaying, on a display of the wearable glasses, an image;

acquiring information about an eye of a user wearing the wearable glasses while the image is displayed on the display;

determining at least one of a movement direction and a movement distance of the wearable glasses with respect to the eye of the user based on the information about the eye of the user;

detecting a change in a size of a pupil of the user based on the information about the eye of the user;

adjusting a size of the image, based on at least one of the movement direction and the movement distance of the wearable glasses with respect to the eye of the user;

adjusting brightness of the image based on the change in the size of the pupil; and

displaying the image of which both the brightness and the size are adjusted based on a movement of the wearable glasses and the change in the size of the pupil.

9. The method of claim 8 , further comprising:

acquiring information about a body part of the user; and

determining an inclination of the wearable glasses with respect to the user by comparing the information about the body part with predetermined reference wear state information.

10. The method of claim 9 , wherein:

the information about the body part comprises an image of the body part; and

the determining the inclination comprises:

detecting an area corresponding to the body part from the image of the body part,

acquiring a property value from the detected area, and

comparing the property value with a reference value included in the predetermined reference wear state information in order to determine the inclination.

11. The method of claim 8 , further comprising:

displaying a test image;

acquiring an image of the eye of the user on which the test image is reflected;

detecting an area corresponding to the eye of the user from the image of the eye,

obtaining a reflection image which is formed by reflection of the test image on the eye of the user within the detected area corresponding to the eye,

comparing the at least one of a size and a shape of the reflection image with predetermined reference wear state information, and

determining an inclination of the wearable glasses with respect to the user based on a result of the comparing.

12. The method of claim 8 , further comprising:

obtaining a state value representing a movement state of the wearable glasses; and

determine an inclination of the wearable glasses with respect to the user when the state value is equal to or greater than a predetermined value.

13. The method of claim 8 , further comprising:

determining whether an inclination of the wearable glasses with respect to the user is equal to or greater than a predetermined value;

if the inclination is equal to or greater than the predetermined value according to the determining, displaying an image informing the user to adjust a position of the wearable glasses; and

if the inclination is less than the predetermined value according to the determining, adjusting the displayed image, based on the inclination.

14. The wearable glasses of claim 1 , wherein the processor is configured to:

increase the brightness when the size of the pupil increases, and

decrease the brightness when the size of the pupil decreases.

15. The wearable glasses of claim 1 , wherein, the processor is configured to:

adjust a location of the image such that the image is moved in a direction opposite to the movement direction of the wearable glasses and by a distance corresponding to the movement distance of the wearable glasses.

16. The wearable glasses of claim 1 , wherein the processor is configured to:

in response to a distance from the eye of the user to the image being increased according to the movement distance of the wearable glasses, increase the size of the image based on the increased distance.

17. A non-transitory computer-readable storage medium having embodied thereon at least one program including commands for performing a method of displaying an image via wearable glasses, wherein the method comprises:

displaying an image that is provided by the wearable glasses;

acquiring information about an eye of a user wearing the wearable glasses while the image is displayed on the display;

determining at least one of a movement direction and a movement distance of the wearable glasses with respect to the eye of the user based on the information about the eye of the user;

detecting a change in a size of a pupil of the user based on the information about the eye of the user;

adjusting a size of the image, based on at least one of the movement direction and the movement distance of the wearable glasses with respect to the eye of the user;

adjusting brightness of the image based on the change in the size of the pupil; and

display the image which both the brightness and the size are adjusted based on a movement of the wearable glasses and the change in the size of the pupil.

18. The non-transitory computer-readable storage medium of claim 17 , wherein the method further comprises:

acquiring information about a body part of the user; and

determining an inclination of the wearable glasses with respect to the user by comparing, the information about the body part with predetermined reference wear state information.

19. The non-transitory computer-readable storage medium of claim 18 , wherein the information about the body part comprises an image of the body part of the user; and

the determining the inclination comprises:

detecting an area corresponding to the body part from the image of the body part,

acquiring a property value from the detected area, and

comparing the property value with a reference value included in the predetermined reference wear state information in order to determine the inclination.

20. The non-transitory computer-readable storage medium of claim 17 , wherein the method further comprises:

displaying a test image;

acquiring an image of the eye of the user on which the test image is reflected;

detecting an area corresponding to the eye of the user from the image of the eye,

obtaining a reflection image which is formed by reflection of the test image on the eye of the user within the detected area corresponding to the eye,

comparing the at least one of a size and a shape of the reflection image with predetermined reference wear state information, and

determining an inclination of the wearable glasses with respect to the user based on a result of the comparing.

21. The non-transitory computer-readable storage medium of claim 17 , wherein the method further comprises:

determining whether an inclination of the wearable glasses with respect to the user is equal to or greater than a predetermined value; and

based on the inclination being less than the predetermined value according to the determining, adjusting the displayed image, based on the inclination.

Priority Claims (2)
KR 10-2014-0098630 · Jul 31, 2014 · national
KR 10-2015-0020288 · Feb 10, 2015 · national
Continuity (3)
Continuation 15941069 · Mar 30, 2018
Continuation 14810652 · Jul 28, 2015
Related Publication 20190235625A1 · Aug 1, 2019
Cited By (1)
US 12,277,269