IP Library Granted Patent US 12693746
Granted Patent B2
US 12693746 · App. 19/040,485 · Granted Jul 28, 2026

Method and device for outputting drawing data on a virtual/augmente reality device using an input device

Inventors: Jungjik Lee (Suwon-si, KR); Dasom Lee (Suwon-si, KR); Sungoh Kim (Suwon-si, KR); Hyungsok Yeo (Suwon-si, KR); Donghyun Yeom (Suwon-si, KR); Youngjoon Oh (Suwon-si, KR); Hyuntaek Woo (Suwon-si, KR); Sanghun Lee (Suwon-si, KR); Junsik Jeong (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06F3/033G06F3/011
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12693746
App. No.
19/040,485
Granted
Jul 28, 2026
Kind
B2
Abstract

A method for outputting drawing data according to an embodiment may comprise the operations of: outputting image data to an image area object in virtual reality or augmented reality, the image area object being an object determined on the basis of a user input among a plurality of real objects; generating a virtual input device object corresponding to an input device in relation to the input area object; receiving at least one of location information about the input device, state information about the input device, or drawing data which includes information input to a second electronic device using the input device; updating the input device object on the basis of the received location information and state information, and outputting the updated device object; and updating the image data, output to the input area object, on the basis of the received drawing data.

Claims (42)

1 . A method for a first electronic device outputting virtual reality or augmented reality, the method comprising:

outputting image data onto an input region object in the virtual reality or the augmented reality, wherein the input region object is an object determined based on a user input from among a plurality of actual objects;

generating an input device object corresponding to an input device in relation to the input region object;

receiving a detachment signal of the input device from a second electronic device connected to the input device, wherein the second electronic device is connected to the first device to communicate with an application included in the first electronic device;

deactivating, based on the detachment signal of the input device from the second electronic device, at least one input function of the first electronic device, wherein the at least one input function corresponds to at least one user motion;

receiving, based on the detachment signal of the input device from the second electronic device, at least one of position information of the input device, state information of the input device, and drawing data, the drawing data comprising information input to the second electronic device using the input device;

updating and outputting the input device object based on the position information and the state information; and

updating the image data output onto the input region object, based on the drawing data.

2 . The method of claim 1 , wherein the generating of the input region object comprises determining the input region object based on at least one of a user selection input, a hand tracking function, a head gaze function, and an eye gaze function.

3 . The method of claim 1 , further comprising:

outputting a candidate object identifier, which is to become the input region object, onto at least some of the plurality of actual objects existing in the virtual reality or the augmented reality.

4 . The method of claim 1 , further comprising:

transmitting the image data that is updated to the second electronic device such that the image data updated based on the drawing data is output on a screen of the second electronic device.

5 . The method of claim 1 , wherein the position information is data generated in real time according to movement of the input device and received to update a position of the input device object in real time.

6 . The method of claim 1 , wherein the state information is data generated when an event related to the input device occurs and comprises at least one of data on whether the input device is detached from the second electronic device, zoom level data, distance data between the input device and the second electronic device, click data, drawing-type data, relative tilt data of the second electronic device with respect to the first electronic device, and reference point data of a drawing target region coordinate system, which is at least a portion of the image data.

7 . The method of claim 1 , wherein the deactivating comprises:

deactivating at least one of a hand tracking function, a head gaze function, and an eye gaze function of the first electronic device based on the detachment signal.

8 . The method of claim 1 , further comprising:

receiving an attachment signal of the input device from the second electronic device connected to the input device;

activating at least one at least one input function of the first electronic device, wherein the at least one input function corresponds to at least one user motion; and

stopping output of the input device object.

9 . The method of claim 1 , further comprising:

adjusting transparency of the input device object, based on distance data between the input device and the second electronic device.

10 . The method of claim 9 , wherein the adjusting of the transparency of the input device object comprises adjusting the transparency to increase as a distance between the input device and the second electronic device increases or adjusting the transparency to decrease as the distance between the input device and the second electronic device decreases.

11 . The method of claim 1 , further comprising one of:

changing a drawing target region, which is at least a portion of the image data, based on at least one of click data and the position information; and

enlarging or reducing the drawing target region, based on zoom level data.

12 . The method of claim 1 , further comprising:

when the input region object is a same as a screen of the second electronic device, adjusting transparency of the image data output onto the input region object, based on relative tilt data of the second electronic device with respect to the first electronic device.

13 . The method of claim 12 , wherein the adjusting of the transparency of the image data output onto the input region object comprises increasing the transparency of the image data output onto the input region object as the screen of the second electronic device has a tilt perpendicular to a viewpoint of the first electronic device or decreasing the transparency of the image data output onto the input region object as the screen of the second electronic device has a tilt horizontal to the viewpoint of the first electronic device.

14 . The method of claim 12 , further comprising:

when the input region object is the same as the screen of the second electronic device, adjusting the transparency of the second electronic device, based on the relative tilt data of the second electronic device with respect to the first electronic device.

15 . An electronic device for outputting virtual reality or augmented reality, the electronic device comprising:

at least one processor; and

a memory storing instructions that, when executed by the at least one processor individually or collectively, cause the electronic device to:

output image data onto an input region object in the virtual reality or the augmented reality, wherein the input region object is an object determined based on a user input from among a plurality of actual objects;

generate a virtual input device object corresponding to an input device in relation to the input region object;

receive a detachment signal of the input device from a second electronic device connected to the input device, wherein the second electronic device is connected to the first device to communicate with an application included in the first electronic device;

deactivate, based on the detachment signal of the input device from the second electronic device, at least one input function of the first electronic device, wherein the at least one input function corresponds to at least one user motion;

receive, based on the detachment signal of the input device from the second electronic device, at least one of position information of the input device, state information of the input device, and drawing data, the drawing data comprising information input to the second electronic device using the input device;

update and output the virtual input device object, based on the position information and the state information; and

update the image data output onto the input region object, based on the drawing data.