IP Library › Granted Patent US 9,467,648
Granted Patent B2
US 9,467,648 · App. 14/212,207 · Granted Oct 11, 2016

Mobile terminal and controlling method thereof

Inventors: Yunmi Kwon (Seoul, KR); Hyemi Jung (Seoul, KR); Arim Kwon (Seoul, KR)
Assignee: LG Electronics Inc.
H04N7/142H04N5/272H04N7/147
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,467,648
App. No.
14/212,207
Granted
Oct 11, 2016
Kind
B2
Abstract

A mobile terminal and controlling method thereof are disclosed, by which a video merging can be performed in the course of a video call to a counterpart terminal. The present invention includes a camera configured to create a first video having a user of the mobile terminal taken therein, a wireless communication unit configured to receive a second video taken by the counterpart terminal, a controller configured to extract a user display region from the first video, and merge the user display region and the second video, and a display unit configured to display the merged video.

Claims (45)

1. A mobile terminal to perform a video call with a counterpart terminal, the mobile terminal comprising:

a camera to create a first video having a user within the first video;

a wireless communication unit to receive a second video from the counterpart terminal;

a controller configured to extract a user display region from the first video and to merge the user display region and the second video; and

a display unit to display the merged video of the user display region and the second video,

wherein when the mobile terminal is set to share, with the counterpart terminal, the merged video of the user display region and the second video, the controller is configured to control the merged video of the user display region and the second video to be sent to the counterpart terminal,

wherein when the mobile terminal is set not to share the merged video with the counterpart terminal, the controller is configured to control the first video to be sent to the counterpart terminal, and

wherein when a plurality of first people are in the first video, the controller is configured to select a largest one of display regions of the plurality of first people as the user display region.

2. The mobile terminal of claim 1 , wherein the controller is configured to extract the user display region from the first video based on an outline of the user in the first video.

3. The mobile terminal of claim 1 , wherein when a plurality of second people are included in the second video, the controller is configured to delete display regions of the remainder of the second people other than a display region of the person determined as a true counterpart from the second video.

4. The mobile terminal of claim 3 , wherein the controller is configured to select a largest one of display regions of the plurality of second people as the true counterpart.

5. The mobile terminal of claim 1 , wherein the camera includes a front camera to photograph from a front of the mobile terminal and a rear camera to photograph from a rear of the mobile terminal, and

wherein the first video includes at least one of a first front video from the front camera and a first rear video from the rear camera.

6. The mobile terminal of claim 5 , wherein the merged video represents the user display region extracted from the first video and a counterpart display region extracted from the second video, wherein the first rear video is used as a background for the user display region and the counterpart display region.

7. The mobile terminal of claim 1 , wherein the second video includes at least one of a second front video from a front camera of the counterpart terminal and a second rear video from a rear camera of the counterpart terminal.

8. The mobile terminal of claim 7 , wherein when the second video includes one of the second front video and the second rear video, the controller is configured to request the counterpart terminal to provide the other one of the second front video and the second rear video in response to a user input.

9. The mobile terminal of claim 7 , wherein when both of the second front video and the second rear video are received from the counterpart terminal, the merged video represents the user display region extracted from the first video and a counterpart display region extracted from the second front video, wherein the second rear video is used as a background for the user display region and the counterpart display region in the merged video.

10. The mobile terminal of claim 9 , wherein the controller is configured to adjust an arrangement order of the user display region and the counterpart display region based on a user input.

11. The mobile terminal of claim 1 , wherein the user display region is displayed in a front layer and the second video is displayed in a rear layer behind the front layer in the merged video, and

wherein the controller is further configured to reduce or enlarge the second video in the rear layer without reducing or enlarging the user display region of the first video in the front layer in the merged video, in response to a pinch-in or pinch-out input to the second video in the merged video.

12. A method of controlling a mobile terminal during a video call with a counterpart terminal, the method comprising:

receiving a first video through a camera of the mobile terminal;

receiving a second video from the counterpart terminal;

extracting a user display region from the first video;

merging the user display region and the second video;

displaying the merged video of the user display region and the second video on a display of the mobile terminal;

sending the merged video to the counterpart terminal when the mobile terminal is set to share the merged video with the counterpart terminal;

sending the first video to the counterpart terminal when the mobile terminal is set not o share the merged video with the counterpart terminal; and

selecting a largest one of display regions of a plurality of first people as user display region when the plurality of first people are in the first video.

13. The method of claim 12 , wherein the extracting of the user display region from the first video is based on an outline of the user in the first video.

14. The method of claim 12 , further comprising:

when a plurality of second people are in the second video, removing display regions of the remainder of the second people other than a display region of the person determined as a true counterpart from the second video.

15. A mobile terminal comprising:

a camera to provide a first video that includes a person;

a wireless communication unit to receive a signal from a counterpart terminal;

a controller configured to extract a user display region from the first video that includes the person, and to combine features of the user display region and a second video; and

a display to display the combined features of the user display region and the second video,

wherein when the mobile terminal is set to share the combined features with the counterpart terminal, the controller is configured to control the combined features to be sent to the counterpart terminal,

wherein when the mobile terminal is set not to share the combined features with the counterpart terminal, the controller is configured to control the first video to be sent to the counterpart terminal, and

wherein when a plurality of people are in the first video, the controller is configured to select a largest one of display regions of the plurality of people as the user display region.

16. The mobile terminal of claim 15 , wherein the wireless communication unit to receive the second video from the counterpart terminal.

17. The mobile terminal of claim 15 , wherein the controller is configured to extract thedisplay region from the first video based on a shape of the person in the first video.

18. The mobile terminal of claim 15 , wherein the camera includes a front camera and a rear camera, and

wherein the first video includes at least one of a first front video from the front camera and a first rear video from the rear camera.

19. The mobile terminal of claim 18 , wherein the combined features represents the user display region extracted from the first video and a counterpart display region extracted from the second video, wherein the first rear video is used as a background for the combined features.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 14, 2014
From: KWON, YUNMI; JUNG, HYEMI; KWON, ARIM
To: LG ELECTRONICS INC.
Reel/Frame 032442/0637 →
Priority Claims (1)
KR 10-2013-0028066 · Mar 15, 2013 · national
Continuity (1)
Related Publication 20140267546A1 · Sep 18, 2014