IP Library Granted Patent US 9,619,019
Granted Patent B2
US 9,619,019 · App. 14/275,082 · Granted Apr 11, 2017

Display apparatus with a plurality of screens and method of controlling the same

Inventors: Joon-ho Phang (Seoul, KR); Nam-hyun Park (Suwon-si, KR); Do-sung Jung (Seoul, KR); Joo-sun Moon (Seoul, KR); Yi-sak Park (Seoul, KR); Sue-young Chung (Seoul, KR); Christopher E. Bangle (Clavesana, IT)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06F3/012G06F3/017H04N21/4223H04N21/42203H04N21/42222H04N21/4316H04N21/4438H04N21/44218H04N21/440263H04N21/4622H04N21/4852H04N21/4858
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,619,019
App. No.
14/275,082
Granted
Apr 11, 2017
Kind
B2
Abstract

A display apparatus and a control method thereof are provided. The display apparatus includes a display configured to display a plurality of images received from a plurality of sources on each of a first screen, a second screen, and a third screen of a display screen, a user interface configured to detect a user interaction, and a controller configured to control the display to move locations of the first to third screens in accordance with a detected rotation interaction in response to the rotation interaction being detected through the user interface.

Claims (64)

1. A display apparatus, the display apparatus comprising:

a display;

an audio output; and

a controller configured to control the display to display a first moving image on a main screen, a second moving image on a left sub-screen, and a third moving image on a right sub-screen, and control the audio output to output audio associated with the first moving image being displayed on the main screen,

wherein the controller is further configured to, in response to receiving user input, control the display to move the first moving image from the main screen to the left sub-screen and move the third moving image from the right sub-screen to the main screen and control the audio output to output audio associated with the third moving image being displayed on the main screen.

2. The display apparatus of claim 1 , wherein the left sub-screen is disposed at a left side of the main screen and has a trapezoid shape configured to display an image thereon at a first inclined viewing angle, and

the right sub-screen is disposed at a right side of the main screen and has a trapezoid shape configured to display an image thereon at a second inclined viewing angle different from the first inclined viewing angle.

3. The display apparatus of claim 2 , wherein the controller is further configured to, in response to the user input being a user's head rotation interaction, control the display by detecting the user's head rotation and moving the first, second, and third moving images in accordance with a direction of the detected user's head rotation.

4. The display apparatus of claim 3 , wherein the controller is further configured to control the display to:

increase a ratio of the third moving image on the display which is located on a right side among the first, second, and third moving images by moving the first, second, and third moving images in a left direction in response to detecting that the user's head rotates in a right direction, and

increase a ratio of the first moving image on the display which is located on a left side among the first, second, and third moving images by moving the first, second, and third moving images in a right direction in response to detecting that the user's head rotates in a left direction.

5. The display apparatus of claim 4 , wherein the controller is further configured to perform a control operation to move the first, second, and third moving images on a real-time basis in accordance with an angle of the user's detected head rotation.

6. The display apparatus of claim 5 , wherein the controller is further configured to:

set the third moving image which is moved in a left direction as the main screen in response to detecting that the user's head rotation angle is greater than a predetermined value while the user's head moves in a right direction, and

sets the first moving image which is moved in a right direction as the main screen in response to detecting that the user's head rotation angle is greater than the predetermined value while the user's head moves in a left direction.

7. The display apparatus of claim 2 , wherein the controller is further configured to, in response to the user input being an interaction to rotate a remote controller after pressing a button on the remote controller, control the display to move a moving image which corresponds to a rotation direction of the remote controller in a direction towards a center of the display.

8. The display apparatus of claim 1 , wherein the user input is received via a remote controller being moved in a first rotational direction.

9. The display apparatus of claim 8 , wherein the controller is further configured to, in response to receiving another user input via moving the remote controller in a second rotational direction opposite to the first rotational direction, control the display to move the first moving image from the main screen to the right sub-screen and move the second moving image from the left sub-screen to the main screen and control the audio output to output audio associated with the second moving image being displayed on the main screen.

10. The display apparatus of claim 1 , wherein the user input comprises a user gesture moving in a first rotational direction determined based on processing of images obtained via a camera.

11. The display apparatus of claim 10 , wherein, the controller is further configured to, in response to receiving another user input via moving the user gesture in a second rotational direction opposite to the first rotational direction, control the display to move the first moving image from the main screen to the right sub-screen and move the second moving image from the left sub-screen to the main screen and control the audio output to output audio associated with the second moving image being displayed on the main screen.

12. The display apparatus of claim 1 , wherein the controller is further configured to control the audio output to output only an audio of a moving image displayed on the main screen which takes up a largest ratio of the display, among the first, second, and third moving images.

13. The display apparatus of claim 12 , wherein the controller is further configured to, in response to the user input being a user's head rotation interaction, control the audio output to increase an audio output of a moving image having a ratio on the display that increases in response to the user's head rotation being detected.

14. The display apparatus of claim 13 , wherein the controller is further configured to:

set the third moving image which is located on a right side as a new main screen and to control the audio output to output only an audio of content displayed on the third moving image in response to detecting that an angle of the user's head rotation is greater than a predetermined value while the user's head moves in a right direction, and

set the first moving image which is located on a left side as a new main screen and to control the audio output to output only an audio of content displayed on the first moving image in response to detecting that the user's head rotation angle is greater than the predetermined value while the user's head moves in a left direction.

15. The display apparatus of claim 13 , wherein the controller is further configured to control the audio output to increase an audio output of a moving image having a ratio on the display that increases, among the first, second, and third moving images, in accordance with a moving image ratio of the display.

16. The display apparatus of claim 13 , wherein the controller is further configured to:

increase an audio output of the third moving image in response to detecting that the user's head rotates in a right direction, and

increase an audio output of the first moving image in response to detecting that the user's head rotates in a left direction.

17. The apparatus of claim 1 , wherein the user input comprises a user's eye movement interaction in which a movement of the user's eye is detected.

18. The apparatus of claim 1 , further comprising a storage configured to store a plurality of modules for operating the display apparatus.

19. The apparatus of claim 18 , wherein the modules include at least one of a voice recognition module, a touch recognition module, and a gesture module.

20. The apparatus of claim 1 , wherein the controller is further configured to control the display to display information related to the first, second, and third moving images.

21. A method for controlling a display apparatus, the method comprising:

displaying a first moving image on a main screen, a second moving image on a left sub-screen, and a third moving image on a right sub-screen;

outputting audio associated with the first moving image being displayed on the main screen; and

in response to receiving user input, moving the first moving image from the main screen to the left sub-screen and moving the third moving image from the right sub-screen to the main screen, and changing the output audio to audio associated with the third moving image being displayed on the main screen.

22. The method of claim 21 , wherein the left sub-screen is disposed at a left side of the main screen and has a trapezoid shape configured to display an image thereon at a first inclined viewing angle, and

the right sub-screen is disposed at a right side of the main screen and has a trapezoid shape configured to display an image thereon at a second inclined viewing angle different from the first inclined viewing angle.

23. The method of claim 22 , further comprising detecting a user's head rotation interaction as the user input,

wherein the moving further comprises moving the first, second, and third moving images in accordance with a direction of the user's detected head rotation.

24. The method of claim 23 , wherein the moving further comprises:

increasing a ratio of the third moving image which is located on a right side of a display among the first, second, and third moving images by moving the first, second, and third moving images in a left direction in response to detecting that the user's head rotates in a right direction; and

increasing a ratio of the first moving image which is located on a left side of the display among the first, second, and third moving images by moving the first, second, and third moving images in a right direction in response to detecting that the user's head rotates in a left direction.

25. The method of claim 24 , wherein the moving further comprises moving the first, second, and third moving images on a real-time basis in accordance with an angle of the user's detected head rotation.

26. The method of claim 25 , wherein the moving further comprises:

determining the third moving image which is moved in a left direction as the main screen in response to detecting that the user's head rotation angle is greater than a predetermined value while the user's head moves in a right direction; and

determining the first moving image which is moved in a right direction as the main screen in response to detecting that the user's head rotation angle is greater than the predetermined value while the user's head moves in a left direction.

27. The method of claim 21 , wherein the user input is received via a remote controller being moved in a first rotational direction.

28. The method of claim 27 , wherein the moving further comprises, in response to receiving another user input via moving the remote controller in a second rotational direction opposite to the first rotational direction, moving the first moving image from the main screen to the right sub-screen and moving the second moving image from the left sub-screen to the main screen, and changing the output audio to audio associated with the second moving image being displayed on the main screen.

29. The method of claim 21 , wherein the user input comprises a user gesture moving in a first rotational direction determined based on processing of images obtained via a camera.

30. The method of claim 29 , wherein the moving further comprises, in response to receiving another user input via moving the user gesture in a second rotational direction opposite to the first rotational direction, moving the first moving image from the main screen to the right sub-screen and moving the second moving image from the left sub-screen to the main screen, and changing the output audio to audio associated with the second moving image being displayed on the main screen.

31. The method of claim 21 , wherein the changing further comprises outputting audio related to a moving image displayed on the main screen which takes up a largest ratio of a display, among the first, second, and third moving images.

32. The method of claim 31 , wherein the method further comprises detecting a user's head rotation interaction as the user input, and

wherein the changing further comprises increasing an audio output of a moving image having a ratio on the display that increases in accordance with a direction of the detected user's head rotation among the first, second, and third moving images.

33. The method of claim 32 , wherein the changing further comprises:

increasing an audio output of a moving image in response to detecting that the user's head is rotated in a right direction, and

increasing an audio output of a moving image in response to detecting that the user's head is rotated in a left direction.

34. The method of claim 32 , wherein the changing further comprises increasing an audio output of a moving image having a ratio on the display that increases in accordance with a ratio of the display, among the first, second, and third moving images.

35. The method of claim 32 , wherein the changing further comprises:

determining the third moving image located on a right side among the first, second, and third moving images as a new main screen in response to detecting that the user's head rotation angle is greater than a predetermined value while the user's head moves in a right direction, and outputting an audio of content displayed on the third moving image, and

determining a first moving image located on a left side among the first, second, and third moving images as a new main screen in response to detecting that the user's head rotation angle is greater than the predetermined value while the user's head moves in a left direction, and outputting an audio of content displayed on the first moving image.

36. The method of claim 32 , wherein the detecting comprises detecting a user interaction which rotates a remote controller after pressing a button on the remote controller as the user input, and

wherein the moving comprises moving a moving image which corresponds to a direction of a rotation of the remote controller in a direction towards a center of the display.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 10, 2014
From: PHANG, JOON-HO; PARK, NAM-HYUN; JUNG, DO-SUNG; MOON, JOO-SUN; PARK, YI-SAK; CHUNG, SUE-YOUNG; BANGLE, CHRISTOPHER E
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 033288/0041 →
Priority Claims (1)
KR 10-2013-0053401 · May 10, 2013 · national
Continuity (1)
Related Publication 20140333531A1 · Nov 13, 2014