IP Library › Granted Patent US 10,522,111
Granted Patent B2
US 10,522,111 · App. 15/606,518 · Granted Dec 31, 2019

Method and electronic apparatus for providing composition screen by composing execution windows of plurality of operating systems

Inventors: Sung-min Lee (Seoul, KR); Jae-yong Yoo (Yongin-si, KR); Min Kang (Seongnam-si, KR); Byung-chul So (Seoul, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G09G5/14G06T11/001G09G5/001G09G5/005G09G5/363G09G5/37G09G2330/026G09G2340/14G09G2354/00G09G2360/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,522,111
App. No.
15/606,518
Granted
Dec 31, 2019
Kind
B2
Abstract

An electronic apparatus and method of operating the electronic apparatus, to simultaneously display execution screen images of a first OS and a second OS are provided. The method includes obtaining screen image data of the second OS based on graphic data processed by the second OS; obtaining, by the first OS, at least one of control information related to the screen image data of the second OS and memory mapping information of the second OS; converting the screen image data of the second OS into graphic data of the first OS based on the at least one of the control information and the memory mapping information; generating screen image data of the first OS based on the graphic data of the first OS, the screen image data of the first OS including the screen image data of the second OS; and displaying the screen image data of the first OS.

Claims (47)

1. A method of simultaneously displaying execution screen images of a plurality of operating systems (OSs) executed by an electronic apparatus, the method comprising:

obtaining screen image data of at least one guest OS among the plurality of OSs based on graphic data of the at least one guest OS processed by the at least one guest OS;

obtaining, by a host OS among the plurality of OSs, at least one of control information related to the screen image data of the at least one guest OS or memory mapping information of the at least one guest OS;

converting the screen image data of the at least one guest OS into graphic data of the host OS based on the at least one of the control information or the memory mapping information;

generating screen image data of the host OS based on the graphic data of the host OS, the screen image data of the host OS comprising the screen image data of the at least one guest OS, wherein the host OS determines a location and a size of the screen image data of the at least one guest OS to be displayed in the screen image data of the host OS using the control information; and

displaying the screen image data of the host OS comprising the screen image data of the at least one guest OS based on the determined location and the determined size,

wherein the screen image data of the at least one guest OS and the screen image data of the host OS are stored in a frame buffer and the frame buffer identifies a region for storing the screen image data of the host OS as a first region and a region for storing the screen image data of the at least one guest OS as a second region, and

wherein the host OS has authorization information for accessing the second region of the frame buffer and copies the screen image data of the at least one guest OS stored in the second region of the frame buffer to the first region to generate screen image data of the host OS comprising the screen image data of the at least one guest OS.

2. The method of claim 1 , wherein the converting the screen image data of the at least one guest OS comprises:

obtaining address information of the second region for storing the screen image data of the at least one guest OS based on the at least one of the control information or the memory mapping information; and

generating a texture object of the host OS, the texture object corresponding to the second region for storing the screen image data of the at least one guest OS based on the obtained address information.

3. The method of claim 2 , wherein the converting the screen image data of the at least one guest OS further comprises:

transforming a format of the texture object in response to a data format of the second region for storing the screen image data of the at least one guest OS being different from a data format of the first region for storing the screen image data of the host OS.

4. The method of claim 2 , wherein the texture object is generated after the host OS receives a signal indicating that the screen image data of the at least one guest OS is completely stored in the second region.

5. The method of claim 1 , wherein the at least one of the control information or the memory mapping information is provided from the at least one guest OS to the host OS through a hypervisor.

6. The method of claim 1 , wherein the screen image data of the host OS and the screen image data of the at least one guest OS are renewed at different refresh rates based on at least one of a workload of each of the plurality of OSs or a user input value.

7. The method of claim 1 , wherein the displaying the screen image data of the host OS comprises displaying the screen image data of the host OS by using a sub-window.

8. The method of claim 1 , wherein the control information related to the screen image data of the at least one guest OS is for at least one of generating the screen image data of the at least one guest OS or outputting the screen image data of the at least one guest OS.

9. The method of claim 1 , wherein the memory mapping information comprises at least one of a whole or a part of a page table of the at least one guest OS.

10. An electronic apparatus for executing a plurality of operating systems (OSs), the electronic apparatus comprising:

a display;

a graphics processor configured to generate screen image data of at least one guest OS based on graphic data of the at least one guest OS processed by the at least one guest OS among the plurality of OSs; and

a processor configured to:

provide a host OS among the plurality of OSs with at least one of control information related to the screen image data of the at least one guest OS or memory mapping information of the at least one guest OS, and

convert the screen image data of the at least one guest OS into graphic data of the host OS based on the at least one of the control information or the memory mapping information,

wherein the graphics processor is further configured to generate screen image data of the host OS based on the graphic data of the host OS, the screen image data of the host OS comprising the screen image data of the at least one guest OS,

wherein the host OS determines a location and a size of the screen image data of the at least one guest OS to be displayed in the screen image data of the host OS using the control information,

wherein the display is configured to display the screen image data of the host OS comprising the screen image data of the at least one guest OS based on the determined location and the determined size,

wherein the graphics processor further comprises a frame buffer and the frame buffer identifies a region for storing the screen image data of the host OS as a first region and a region for storing the screen image data of the at least one guest OS as a second region, and

wherein the graphics processor has authorization information for accessing the second region of the frame buffer and copies the screen image data of the at least one guest OS stored in the second region of the frame buffer to the first region to generate screen image data of the host OS comprising the screen image data of the at least one guest OS.

11. The electronic apparatus of claim 10 , wherein the processor is further configured to:

obtain address information of the second region for storing the screen image data of the at least one guest OS based on the at least one of the control information or the memory mapping information; and

generate a texture object of the host OS, the texture object corresponding to the second region for storing the screen image data of the at least one guest OS based on the obtained address information.

12. The electronic apparatus of claim 11 , wherein the processor is further configured to transform a format of the texture object in response to a data format of the second region for storing the screen image data of the at least one guest OS being different from a data format of the first region for storing the screen image data of the host OS.

13. The electronic apparatus of claim 11 , wherein the texture object is generated after the host OS receives a signal indicating that the screen image data of the at least one guest OS is completely stored in the second region.

14. The electronic apparatus of claim 10 , wherein the processor further comprises a hypervisor,

wherein the at least one of the control information or the memory mapping information is provided from the at least one guest OS to the host OS through the hypervisor.

15. The electronic apparatus of claim 10 , wherein the screen image data of the at least one guest OS is pixel data stored in the frame buffer.

16. The electronic apparatus of claim 10 , wherein the processor is further configured to renew the screen image data of the host OS and the screen image data of the at least one guest OS at different refresh rates based on at least one of a workload of each of the plurality of OSs or a user input value.

17. A non-transitory computer-readable recording medium having recorded thereon a computer program, which, when executed by a processor, performs a method of simultaneously displaying execution screen images of a plurality of operating systems (OSs) executed by an electronic apparatus, the method comprising:

obtaining screen image data of at least one guest OS among the plurality of OSs based on graphic data of the at least one guest OS processed by the at least one guest OS;

obtaining, by a host OS among the plurality of OSs, at least one of control information related to the screen image data of the at least one guest OS or memory mapping information of the at least one guest OS;

converting the screen image data of the at least one guest OS into graphic data of the host OS based on the at least one of the control information or the memory mapping information;

generating screen image data of the host OS based on the graphic data of the host OS, the screen image data of the host OS comprising the screen image data of the at least one guest OS, wherein the host OS determines a location and a size of the screen image data of the at least one guest OS to be displayed in the screen image data of the host OS using the control information; and

displaying the screen image data of the host OS comprising the screen image data of the at least one guest OS based on the determined location and the determined size,

wherein the screen image data of the at least one guest OS and the screen image data of the host OS are stored in a frame buffer and the frame buffer identifies a region for storing the screen image data of the host OS as a first region and a region for storing the screen image data of the at least one guest OS as a second region, and

wherein the host OS has authorization information for accessing the second region of the frame buffer and copies the screen image data of the at least one guest OS stored in the second region of the frame buffer to the first region to generate screen image data of the host OS comprising the screen image data of the at least one guest OS.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 26, 2017
From: LEE, SUNG-MIN; YOO, JAE-YONG; KANG, MIN; SO, BYUNG-CHUL
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 042516/0829 →
Priority Claims (1)
KR 10-2016-0070980 · Jun 8, 2016 · national
Continuity (1)
Related Publication 20170358278A1 · Dec 14, 2017