Method and apparatus for processing screen using device
A method and an apparatus for processing a screen by using a device are provided. The method includes obtaining, at the second device, a display screen displayed on the first device and information related to the display screen according to a screen display request regarding the first device, determining, at the second device, an additional screen based on the display screen on the first device and the information related to the display screen, and displaying the additional screen near the display screen on the first device.
1. A method of displaying a virtual screen, performed by a glass type head-mounted display (HMD) device, the method comprising:
obtaining, through a camera of the HMD device, an image of an object in an actual space;
identifying the object in the actual space based on the obtained image;
outputting, through a projector of the HMD device, light related to a virtual screen including a plurality of virtual objects based on the identified object such that, in a user's view, the virtual screen is displayed on the identified object;
obtaining an input for selecting a virtual object among the plurality of virtual objects included in the virtual screen, the input including at least one of a gesture or a voice; and
based on the obtained input, outputting, through the projector of the HMD device, light for information related to the selected virtual object.
2. The method of claim 1 , wherein the identifying the object in the actual space comprises obtaining information related to the object in the actual space from an electronic device and identifying the object in the actual space based on the obtained information.
3. The method of claim 2 , wherein the electronic device comprises the object in the actual space.
4. The method of claim 2 , wherein the electronic device is a cloud.
5. The method of claim 2 , wherein the electronic device is the HMD device.
6. The method of claim 1 , wherein the object in the actual space is either a wrist band or a sticker having limited functions or having no function.
7. The method of claim 1 , wherein the object in the actual space is a nature object.
8. The method of claim 1 , wherein the virtual screen comprises a virtual watch image.
9. The method of claim 1 , wherein the virtual object comprises at least one icon.
10. The method of claim 9 , wherein the input comprises an input for selecting the at least one icon.
11. The method of claim 1 , further comprising:
obtaining a screen display request in response to the identifying of the object in the actual space,
wherein the outputting of the light for information related to the selected virtual object comprises outputting the light in response to obtaining the screen display request.
12. A glass type head-mounted display (HMD) device for displaying a virtual screen, the HMD device comprising:
a camera;
a projector;
a waveguide to deliver light output from the projector toward an eye of a user of the HMD device; and
at least one processor configured to:
control to obtain, through the camera of the HMD device, an image of an object in an actual space,
identify the object in the actual space based on the obtained image,
control to output, through a projector of the HMD device, light related to a virtual screen including a plurality of virtual objects based on the identified object such that, in a user's view, the virtual screen is displayed on the identified object,
obtain an input for selecting a virtual object among the plurality of virtual objects included in the virtual screen, the input including at least one of a gesture or a voice, and
based on the obtained input, control to output, through the projector of the HMD device, light for information related to the selected virtual object.
13. The HMD device of claim 12 , wherein the at least one processor is further configured to obtain information related to the object from an electronic device and identify the object based on the obtained information.
14. The HMD device of claim 13 , wherein the electronic device comprises the object in the actual space.
15. The HMD device of claim 13 , wherein the electronic device is a cloud.
16. The HMD device of claim 13 , wherein the electronic device is the HMD device.
17. The HMD device of claim 12 , wherein the object in the actual space is either a wrist band or a sticker having limited functions or having no function.
18. The HMD device of claim 12 , wherein the object in the actual space is a nature object.
19. The HMD device of claim 12 , wherein the virtual screen comprises a virtual watch image.
20. A non-transitory computer-readable recording medium having recorded thereon at least one program including instructions for performing a method of displaying a virtual screen, performed by a glass type head-mounted display (HMD) device, the method comprising:
obtaining, through a camera of the HMD device, an image of an object in an actual space;
identifying the object in the actual space based on the obtained image;
outputting, through a projector of the HMD device, light related to a virtual screen including a plurality of virtual objects based on the identified object such that, in a user's view, the virtual screen is displayed on the object;
obtaining an input for selecting a virtual object included in the virtual screen, the input including at least one of a gesture or a voice; and
based on the obtained input, outputting, through the projector of the HMD device, light for information related to the selected virtual object.