IP Library Granted Patent US 12710687
Granted Patent B2
US 12710687 · App. 18/437,741 · Granted Aug 18, 2026

Electronic device and image mapping method

Inventors: Yejin Kim (Suwon-si, KR); Pius Lee (Suwon-si, KR); Chaebin Lee (Suwon-si, KR)
Assignee: Samsung Electronics Co., Ltd.
G06T15/10G03B21/14G06T19/006G06T19/20G06T2200/04G06T2207/10028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12710687
App. No.
18/437,741
Granted
Aug 18, 2026
Kind
B2
Abstract

An electronic device according to an embodiment of the disclosure may be configured to: obtain a raster image including one or more real objects using one or more cameras, generate a vector image by vectorizing the raster image, generate an edit screen by superposing the vector image and the raster image, display a user interface representation including the edit screen on a display, generate a projection screen in response to one or more inputs to the user interface representation, and transmit the projection screen to an external electronic device connected to the electronic device.

Claims (73)

1 . An electronic device, comprising:

a display;

a transceiver;

one or more memories; and

at least one processor, comprising processing circuitry, electrically connected to the display, the transceiver and the one or more memories, wherein the at least one processor, individually or collectively is configured to:

obtain, using at least one camera, a captured image including one or more captured objects corresponding respectively to one or more real objects;

identify a projection area included as at least part of the captured image based on feature information included in the captured image, wherein the feature information indicates that the projection area is where a standby screen is projected;

obtain a raster image corresponding to the projection area from the captured image, wherein the raster image includes the one or more captured objects where the standby screen is projected;

generate a vector image including one or more vector objects corresponding respectively to the one or more captured objects by vectorizing the raster image;

generate an edit screen by superposing the vector image and the raster image;

control the display to display a user interface representation including the edit screen;

process the one or more vector objects as one or more content mapping areas;

determine one or more contents mapped respectively to the one or more content mapping areas through the user interface representation;

generate one or more content lavers corresponding respectively to the one or more content mapping areas in response to at least one input to the user interface representation, wherein the one or more content mapping layers include the one or more contents respectively;

generate a projection screen including the one or more content layers by superposing the one or more content layers; and

control the transceiver to transmit the projection screen to an external electronic device connected to the electronic device.

2 . The electronic device of claim 1 ,

wherein the at least one processor is configured to:

receive a focusing input to a content mapping area among the one or more content mapping areas, wherein the content mapping area is switched to a focusing state; and

receive a selection input to a corresponding content among the one or more contents while the content mapping area is in the focusing state, wherein the corresponding content is mapped to the content mapping area.

3 . The electronic device of claim 1 , wherein the one or more vector objects include one or more vector lines or one or more vector planes.

4 . The electronic device of claim 1 , wherein the feature information includes at least one of a brightness difference, a visible marker, a non-visible marker or a stripe pattern.

5 . The electronic device of claim 1 , wherein the user interface representation includes a drawing area and a content selection area, and

wherein the edit screen is displayed in the drawing area, and a plurality of content options mappable to a content mapping area are displayed in the content selection area.

6 . The electronic device of claim 5 , wherein the at least one processor, individually or collectively, is configured to generate a content layer where content associated with at least one of the plurality of content options is mapped to the content mapping area in response to receiving an input for mapping the content to the content mapping area.

7 . The electronic device of claim 6 , wherein the at least one processor, individually or collectively, is configured to generate the content layer whenever receiving the input for mapping the content associated with at least one of the plurality of content options to the content mapping area.

8 . The electronic device of claim 6 , wherein the at least one processor, individually or collectively, is configured to:

generate a new projection screen by adding the generated content layer to a pre-generated projection screen; and

control the transceiver to transmit the new projection screen to the external electronic device in response to the generation of the new projection screen.

9 . The electronic device of claim 1 , wherein the at least one processor, individually or collectively, is configured to control the transceiver to transmit a message for controlling the external electronic device to output the standby screen.

10 . The electronic device of claim 9 , wherein the standby screen comprises a stripe-pattern screen.

11 . The electronic device of claim 10 , wherein the at least one processor, individually or collectively, is configured to:

obtain three-dimensional (3D) depth information based on a stripe pattern represented in the captured image;

detect a 3D vector object based on the 3D depth information; and

process the 3D vector object as a content mapping area.

12 . The electronic device of claim 1 , wherein an entire frame of the projection screen is configured by synthesizing respective frames of one or more content layers of the projection screen, and

wherein the entire frame of the projection screen is reproduced based on the respective frames of the one or more content layers.

13 . An electronic device, comprising:

a display;

one or more image projectors;

one or more memories; and

at least one processor, comprising processing circuitry, electrically connected to the display, the one or more image projectors and the one or more memories, wherein at least one processor, individually or collectively, is configured to:

obtain, using at least one camera, a captured image including one or more captured objects corresponding respectively to one or more real objects;

identify a projection area included as at least part of the captured image based on feature information included in the captured image, wherein the feature information indicates that the projection area is where a standby screen is projected;

obtain a raster image corresponding to the projection area from the captured image, wherein the raster image includes the one or more captured objects where the standby screen is projected;

generate a vector image including one or more vector objects corresponding respectively to the one or more captured objects by vectorizing the raster image;

generate an edit screen by superposing the vector image and the raster image;

control the display to display a user interface representation including the edit screen;

process the one or more vector objects as one or more content mapping areas;

determine one or more contents mapped respectively to the one or more content mapping areas through the user interface representation;

generate one or more content layers corresponding respectively to the one or more content mapping areas in response to at least one input to the user interface representation, wherein the one or more content mapping layers include the one or more contents respectively;

generate a projection screen including the one or more content layers by superposing the one or more content layers; and

project the projection screen through the one or more image projectors.

14 . An image mapping method performed by an electronic device, comprising:

obtaining, using at least one camera, a captured image including one or more captured objects corresponding respectively to one or more real objects;

identifying a projection area included as at least part of the captured image based on feature information included in the captured image, wherein the feature information indicates that the projection area is where a standby screen is projected;

obtaining a raster image corresponding to the projection area from the captured image, wherein the raster image includes the one or more captured objects where the standby screen is projected;

generating a vector image including one or more vector objects corresponding respectively to the one or more captured objects by vectorizing the raster image;

generating an edit screen by superposing the vector image and the raster image;

displaying a user interface representation including the edit screen on a display;

processing the one or more vector objects as one or more content mapping areas;

determining one or more contents mapped respectively to the one or more content mapping areas through the user interface representation;

generating one or more content lavers corresponding respectively to the one or more content mapping areas in response to at least one input to the user interface representation, wherein the one or more content mapping lavers include the one or more contents respectively;

generating a projection screen including the one or more content layers by superposing the one or more content layers; and

transmitting the projection screen to an external electronic device connected to the electronic device.

15 . The image mapping method of claim 14 ,

wherein the determining of the one or more contents comprises:

receiving a focusing input to a content mapping area among the one or more content mapping areas, wherein the content mapping area is switched to a focusing state; and

receiving a selection input to a corresponding content among the one or more contents while the content mapping area is in the focusing state, wherein the corresponding content is mapped to the content mapping area.

16 . The image mapping method of claim 15 , wherein the one or more vector objects include one or more vector lines or one or more vector planes.

17 . The image mapping method of claim 15 , wherein the feature information includes at least one of a brightness difference, a visible marker, a non-visible marker or a stripe pattern.

18 . The image mapping method of claim 14 , wherein the user interface representation includes a drawing area and a content selection area, and

wherein the edit screen is displayed in the drawing area, and content options mappable to a content mapping area are displayed in the content selection area.