IP Library Granted Patent US 10,951,878
Granted Patent B2
US 10,951,878 · App. 16/041,194 · Granted Mar 16, 2021

Mobile terminal and method for controlling the same

Inventors: Ayoung Cho (Seoul, KR); Yunsup Shin (Seoul, KR); Salkmann Ji (Seoul, KR); Jinwon Kang (Seoul, KR)
Assignee: LG ELECTRONICS INC.
H04N13/254G01S7/4815G01S17/89G06T7/521H04N5/2256H04N5/2351H04N5/2354H04N5/23245H04N13/128H04N13/221H04N13/239H04N13/271H04N13/296H04N13/302H04N13/332G06T2207/10028H04N2013/0081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,951,878
App. No.
16/041,194
Granted
Mar 16, 2021
Kind
B2
Abstract

There are provided a mobile terminal including light emitting devices and a method for controlling the same. A mobile terminal includes a camera, a light emitting unit including a plurality of light emitting devices, the light emitting unit emitting light toward a space corresponding to an image received through the camera, and a controller for controlling light emitting devices, which emit light toward a space corresponding to a portion of the image among the plurality of light emitting devices, to be used in extracting depth information of the portion.

Claims (49)

1. An electronic device comprising:

a light emitting unit comprising a plurality of light generating elements, wherein the plurality of light generating elements are grouped into a plurality of groups;

a camera;

a controller operably connected to the light emitting unit and the camera and configured to:

control at least one of the plurality of groups to emit light to an object, and

determine depth information of the object using the at least one image captured via the camera based on the light emitted from the at least one of the plurality of groups to the object,

wherein the plurality of light generating elements included in each of the plurality of groups are arranged to form different patterns such that all of the plurality of groups emit different light patterns,

wherein the plurality of light generating elements included in each of the plurality of groups generate light to form the different patterns while at least one image of the object is received from the camera,

wherein each pattern of the different patterns is formed based on arrangement of the plurality of light generating elements included in a corresponding group of the plurality of groups, and

wherein the controller is further configured to control the at least one of the plurality of groups to emit light in a predetermined order.

2. The electronic device of claim 1 , wherein a peak power of the at least one of the plurality of groups to emit light in the predetermined order is lower than a peak power of the plurality of groups emitting light simultaneously.

3. The electronic device of claim 1 , wherein the controller is further configured to control the at least one of the plurality of groups to sequentially emit light in the predetermined order during a predetermined time.

4. The electronic device of claim 1 , wherein the plurality of light generating elements are configured to generate light having a predetermined brightness.

5. The electronic device of claim 1 , wherein each of the plurality of groups are configured to emit light having a predetermined brightness.

6. The electronic device of claim 1 , wherein the controller is further configured to control a light emitting time of each the plurality of groups and a light emitting intensity of each the plurality of groups, wherein the light emitting time and the light emitting intensity are controlled independently.

7. The electronic device of claim 6 , wherein at least one of the light emitting time or the light emitting intensity is set by a user.

8. The electronic device of claim 1 , wherein the controller is further configured to determine the depth information of the object based on at least a stereo vision method, a structure light method, or a time of flight method.

9. The electronic device of claim 8 , wherein a pattern formed by light emitted by the plurality of light generating elements is used for the stereo vision method or the structure light method and a time for which light emitted by the light generating elements is reflected and returned is used for the time of flight method.

10. The electronic device of claim 1 , further comprising a lens corresponding to the light emitting unit.

11. The electronic device of claim 1 , further comprising a plurality of lenses configured to respectively correspond to the plurality of light generating elements included in the light emitting unit.

12. The electronic device of claim 1 , further comprising a plurality of lenses configured to respectively correspond to the plurality of groups of light generating elements.

13. The electronic device of claim 1 , wherein the controller is further configured to control the plurality of groups to sequentially emit light such that light is not simultaneously emitted by two or more of the plurality of groups.

14. The electronic device of claim 1 , wherein the predetermined order comprises a time period during which two or more of the plurality of groups emit light simultaneously.

15. The electronic device of claim 1 , further comprising a memory, wherein the controller is further configured to store the at least one image captured via the camera in the memory.

16. An electronic device comprising:

a light emitting unit comprising a plurality of light generating elements, wherein the plurality of light generating elements are grouped into a plurality of groups;

a camera;

a controller operably connected to the light emitting unit and the camera and configured to:

control the plurality of groups to emit light to an object in a predetermined order, and

determine depth information of the object using at least one image captured via the camera based on the light emitted from the at least one of the plurality of groups to the object,

wherein the plurality of light generating elements included in each of the plurality of groups are arranged to form different patterns such that all of the plurality of groups emit different light patterns,

wherein the plurality of light generating elements included in each of the plurality of groups generate light to form the different patterns while at least one image of the object is received from the camera,

wherein each pattern of the different patterns is formed based on arrangement of the plurality of light generating elements included in a corresponding group of the plurality of groups.

17. The electronic device of claim 16 , wherein a peak power of the at least one of the plurality of groups to emit light in the predetermined order is lower than a peak power of the plurality of groups emitting light simultaneously.

18. The electronic device of claim 16 , wherein the controller is further configured to control the at least one of the plurality of groups to sequentially emit light in the predetermined order during a predetermined time.

19. The electronic device of claim 16 , wherein the plurality of light generating elements are configured to generate light having a predetermined brightness.

20. The electronic device of claim 16 , wherein each of the plurality of groups are configured to emit light having a predetermined brightness.

21. The electronic device of claim 16 , wherein the controller is further configured to control a light emitting time of each the plurality of groups and a light emitting intensity of each the plurality of groups, wherein the light emitting time and the light emitting intensity are controlled independently.

22. The electronic device of claim 21 , wherein at least one of the light emitting time or the light emitting intensity is set by a user.

23. The electronic device of claim 16 , wherein the controller is further configured to determine the depth information of the object based on at least a stereo vision method, a structure light method, or a time of flight method.

24. The electronic device of claim 23 , wherein a pattern formed by light emitted by the plurality of light generating elements is used for the stereo vision method or the structure light method and a time for which light emitted by the light generating elements is reflected and returned is used for the time of flight method.

25. The electronic device of claim 16 , further comprising a lens corresponding to the light emitting unit.

26. The electronic device of claim 16 , further comprising a plurality of lenses configured to respectively correspond to the plurality of light generating elements included in the light emitting unit.

27. The electronic device of claim 16 , further comprising a plurality of lenses configured to respectively correspond to the plurality of groups of light generating elements.

28. The electronic device of claim 16 , wherein the controller is further configured to control the plurality of groups to sequentially emit light such that light is not simultaneously emitted by two or more of the plurality of groups.

29. The electronic device of claim 16 , wherein the predetermined order comprises a time period during which two or more of the plurality of groups emit light simultaneously.

30. The electronic device of claim 16 , further comprising a memory, wherein the controller is further configured to store the at least one image captured via the camera in the memory.

31. The electronic device of claim 1 , wherein the plurality of light generating elements of each of the plurality of groups are located in a separate region from light generating elements of other groups of the plurality of groups.

32. The electronic device of claim 16 , wherein the plurality of light generating elements of each of the plurality of groups are located in a separate region from light generating elements of other groups of the plurality of groups.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 20, 2018
From: CHO, AYOUNG; SHIN, YUNSUP; JI, SALKMANN; KANG, JINWON
To: LG ELECTRONICS INC.
Reel/Frame 046417/0618 →
Priority Claims (1)
KR 10-2015-0086077 · Jun 17, 2015 · national
Continuity (3)
Continuation 15448423 · Mar 2, 2017
Continuation 14970065 · Dec 15, 2015
Related Publication 20180332273A1 · Nov 15, 2018