IP Library › Granted Patent US 12,003,697
Granted Patent B2
US 12,003,697 · App. 17/747,089 · Granted Jun 4, 2024

Wearable electronic device and method of outputting three-dimensional image

Inventor: Sungbin Hong (Gyeonggi-do, KR)
Assignee: Samsung Electronics Co., Ltd.
H04N13/398H04N13/128H04N13/139H04N13/15H04N13/156H04N13/324H04N13/344H04N2013/0077H04N2013/0081H04N2013/0092H04N2013/0096
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,003,697
App. No.
17/747,089
Granted
Jun 4, 2024
Kind
B2
Abstract

A wearable electronic device includes a left-eye display configured to output light of a first color corresponding to a 3D left-eye image, a right-eye display configured to output light of a second color corresponding to a 3D right-eye image, a left-eye optical waveguide configured to adjust a path of the light of the first color and output the light of the first color, a right-eye optical waveguide configured to adjust a path of the light of the second color and output the light of the second color, a left-eye display control circuit configured to supply a driving power and a control signal to the left-eye display, a right-eye display control circuit configured to supply a driving power and a control signal to the right-eye display, a communication module configured to communicate with a mobile electronic device, and a second control circuit configured to supply a driving power and a control signal to the communication module.

Claims (92)

1. A wearable electronic device comprising:

a left-eye display configured to output light of a first color corresponding to a three-dimensional (3D) left-eye image;

a right-eye display configured to output light of a second color corresponding to a 3D right-eye image;

a left-eye optical waveguide configured to adjust a path of the light of the first color and output the light of the first color;

a right-eye optical waveguide configured to adjust a path of the light of the second color and output the light of the second color;

a left-eye display control circuit configured to supply a driving power and a control signal to the left-eye display;

a right-eye display control circuit configured to supply a driving power and a control signal to the right-eye display;

a communication module configured to communicate with a mobile electronic device; and

a second control circuit configured to supply a driving power and a control signal to the communication module,

wherein the mobile electronic device is configured to extract depth information from a two-dimensional (2D) left-eye image and a 2D right-eye image, generate a converted left-eye image and a converted right-eye image by converting the 2D left-eye image and the 2D right-eye image based on the depth information, generate an aligned left-eye image and an aligned right-eye image by performing vertical alignment on the converted left-eye image and the converted right-eye image, generate a 3D left-eye image and a 3D right-eye image by performing color anaglyph with the first color on the aligned left-eye image and performing color anaglyph with the second color on the aligned right-eye image, and display the 3D left-eye image and the 3D right-eye image using a display of the mobile electronic device, and

wherein the communication module is configured to receive information about the first color and information about the second color from the mobile electronic device.

2. The wearable electronic device of claim 1 , wherein:

the left-eye display further comprises a left-eye auxiliary light source,

the right-eye display further comprises a right-eye auxiliary light source,

the left-eye display is configured to output the light of the first color using the left-eye auxiliary light source, and

the right-eye display is configured to output the light of the second color using the right-eye auxiliary light source.

3. The wearable electronic device of claim 1 , wherein:

the left-eye display and the right-eye display are each a self-luminous display, and

the left-eye display is configured to output the light of the first color using a micro light-emitting diode (LED) of the left-eye display, and

the right-eye display is configured to output the light of the second color using a micro-LED of the right-eye display.

4. The wearable electronic device of claim 1 , wherein the communication module is configured to receive the information about the first color and the information about the second color from the mobile electronic device, using a wired communication scheme.

5. The wearable electronic device of claim 1 , wherein the communication module is configured to receive the information about the first color and the information about the second color from the mobile electronic device, using a wireless communication scheme.

6. The wearable electronic device of claim 1 , wherein the mobile electronic device is configured to:

superimpose the converted left-eye image and the converted right-eye image to generate a composite image;

divide the composite image into one or more window areas;

calculate a sum of absolute differences (SAD) in each of the one or more window areas; and

align the converted left-eye image and the converted right-eye image such that an SAD for at least one of the one or more window areas is minimized to generate the aligned left-eye image and the aligned right-eye image.

7. A wearable electronic device comprising:

a left-eye display configured to output light of a first color corresponding to a three-dimensional (3D) left-eye image;

a right-eye display configured to output light of a second color corresponding to a 3D right-eye image;

a left-eye optical waveguide configured to adjust a path of the light of the first color and output the light of the first color;

a right-eye optical waveguide configured to adjust a path of the light of the second color and output the light of the second color;

a left-eye display control circuit configured to supply a driving power and a control signal to the left-eye display;

a right-eye display control circuit configured to supply a driving power and a control signal to the right-eye display;

a communication module configured to communicate with a mobile electronic device; and

a second control circuit configured to supply a driving power and a control signal to the communication module,

wherein the second control circuit is configured to extract depth information from a two-dimensional (2D) left-eye image and a 2D right-eye image, generate a converted left-eye image and a converted right-eye image by converting the 2D left-eye image and the 2D right-eye image based on the depth information, generate an aligned left-eye image and an aligned right-eye image by performing vertical alignment on the converted left-eye image and the converted right-eye image, and generate a 3D left-eye image and a 3D right-eye image by performing color anaglyph with the first color on the aligned left-eye image and performing color anaglyph with the second color on the aligned right-eye image, and

wherein the communication module is configured to transmit the 3D left-eye image and the 3D right-eye image to the mobile electronic device.

8. The wearable electronic device of claim 7 , wherein:

the left-eye display further comprises a left-eye auxiliary light source,

the right-eye display further comprises a right-eye auxiliary light source,

the left-eye display is configured to output the light of the first color using the left-eye auxiliary light source, and

the right-eye display is configured to output the light of the second color using the right-eye auxiliary light source.

9. The wearable electronic device of claim 7 , wherein:

the left-eye display and the right-eye display are each a self-luminous display, and

the left-eye display is configured to output the light of the first color using a left-eye auxiliary light source of the left-eye display, and

the right-eye display is configured to output the light of the second color using a right-eye auxiliary light source of the right-eye display.

10. The wearable electronic device of claim 7 , wherein the second control circuit is configured to:

superimpose the converted left-eye image and the converted right-eye image to generate a composite image;

divide the composite image into one or more window areas;

calculate a sum of absolute differences (SAD) in each of the one or more window areas; and

align the converted left-eye image and the converted right-eye image such that an SAD for at least one of the one or more window areas is minimized to generate the aligned left-eye image and the aligned right-eye image.

11. A method of outputting a three-dimensional (3D) image, the method comprising:

extracting, by a mobile electronic device, depth information from a two-dimensional (2D) left-eye image and a 2D right-eye image;

generating, by the mobile electronic device, a converted left-eye image and a converted right-eye image by converting the 2D left-eye image and the 2D right-eye image based on the depth information;

generating, by the mobile electronic device, an aligned left-eye image and an aligned right-eye image by performing vertical alignment on the converted left-eye image and the converted right-eye image;

generating, by the mobile electronic device, a 3D left-eye image and a 3D right-eye image by performing color anaglyph with a first color on the aligned left-eye image and performing color anaglyph with a second color on the aligned right-eye image;

receiving, by a wearable electronic device, information about the first color and information about the second color from the mobile electronic device;

outputting light of the first color using a left-eye display of the wearable electronic device; and

outputting light of the second color using a right-eye display of the wearable electronic device.

12. The method of claim 11 , wherein:

the outputting of the light of the first color further comprises outputting the light of the first color using a left-eye auxiliary light source of the left-eye display, and

the outputting of the light of the second color further comprises outputting the light of the second color using a right-eye auxiliary light source of the right-eye display.

13. The method of claim 11 , wherein:

The outputting of the light of the first color further comprises outputting the light of the first color using a micro light-emitting diode (LED) of the left-eye display, and

the outputting of the light of the second color further comprises outputting the light of the second color using a micro-LED of the right-eye display.

14. The method of claim 11 , wherein the receiving of the information about the first color and the information about the second color further comprises receiving the information about the first color and the information about the second color from the mobile electronic device, using a wired communication scheme.

15. The method of claim 11 , wherein the receiving of the information about the first color and the information about the second color further comprises receiving the information about the first color and the information about the second color from the mobile electronic device, using a wireless communication scheme.

16. The method of claim 11 , wherein the generating of the aligned left-eye image and the aligned right-eye image further comprises:

superimposing, by the mobile electronic device, the converted left-eye image and the converted right-eye image to generate a composite image;

dividing, by the mobile electronic device, the composite image into one or more window areas;

calculating, by the mobile electronic device, a sum of absolute differences (SAD) in each of the one or more window areas; and

aligning, by the mobile electronic device, the converted left-eye image and the converted right-eye image such that an SAD for at least one of the one or more window areas is minimized to generate the aligned left-eye image and the aligned right-eye image.

17. A method of outputting a three-dimensional (3D) image, the method comprising:

extracting, by a wearable electronic device, depth information from a two-dimensional (2D) left-eye image and a 2D right-eye image;

generating, by the wearable electronic device, a converted left-eye image and a converted right-eye image by converting the 2D left-eye image and the 2D right-eye image based on the depth information;

generating, by the wearable electronic device, an aligned left-eye image and an aligned right-eye image by performing vertical alignment on the converted left-eye image and the converted right-eye image;

generating, by the wearable electronic device, a 3D left-eye image and a 3D right-eye image by performing color anaglyph with a first color on the aligned left-eye image and performing color anaglyph with a second color on the aligned right-eye image;

transmitting, by the wearable electronic device, the 3D left-eye image and the 3D right-eye image to a mobile electronic device;

outputting light of the first color using a left-eye display of the wearable electronic device; and

outputting light of the second color using a right-eye display of the wearable electronic device.

18. The method of claim 17 , wherein:

the outputting of the light of the first color further comprises outputting the light of the first color using a left-eye auxiliary light source of the left-eye display, and

the outputting of the light of the second color further comprises outputting the light of the second color using a right-eye auxiliary light source of the right-eye display.

19. The method of claim 17 , wherein:

the outputting of the light of the first color further comprises outputting the light of the first color using a micro light-emitting diode (LED) of the left-eye display, and

the outputting of the light of the second color further comprises outputting the light of the second color using a micro-LED of the right-eye display.

20. The method of claim 17 , wherein the generating of the aligned left-eye image and the aligned right-eye image comprises:

superimposing, by the wearable electronic device, the converted left-eye image and the converted right-eye image to generate a composite image;

dividing, by the wearable electronic device, the composite image into one or more window areas;

calculating, by the wearable electronic device, a sum of absolute differences (SAD) in each of the one or more window areas; and

aligning, by the wearable electronic device, the converted left-eye image and the converted right-eye image such that an SAD for at least one of the one or more window areas is minimized to generate the aligned left-eye image and the aligned right-eye image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 18, 2022
From: HONG, SUNGBIN
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 059942/0510 →
Priority Claims (1)
KR 10-2021-0058648 · May 6, 2021 · national
Continuity (2)
Continuation PCTKR2022003822 · Mar 18, 2022
Related Publication 20220360764A1 · Nov 10, 2022
Cited By (2)
US 12,518,307 US 12,626,470