IP Library Granted Patent US 12705841
Granted Patent B2
US 12705841 · App. 18/757,865 · Granted Aug 11, 2026

Mobile device and mobile device control method

Inventors: Ji Youn Han (Suwon-si, KR); Min Sun Park (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06T19/006G06F3/0482G06F3/04845G06T19/20G06V20/20H04N23/64G06T2200/24G06T2219/2016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12705841
App. No.
18/757,865
Granted
Aug 11, 2026
Kind
B2
Abstract

A mobile device includes a display, a camera to capture an image of a space in which an image device can be installed, a user interface, and a controller. The controller can identify a plane from the image captured by the camera, control the display so as to display a grid on a virtual plane corresponding to the plane, adjust the grid based on an input of a user received via the user interface, and control the display so as to display, on the grid, the virtual image of the image device.

Claims (44)

1 . A mobile device, comprising:

a display;

a camera configured to capture an image of a space;

a user interface; and

a controller configured to:

control the display to display a grid on a plane identified from the image captured by the camera,

adjust the displayed grid, based on a user input received via the user interface to adjust a starting line of the grid corresponding to a boundary of the identified plane, and control the display to display a virtual image of a device on the adjusted grid.

2 . The mobile device of claim 1 , wherein the controller is configured to adjust the displayed grid based on the user input received via the user interface, by moving a location of the displayed grid.

3 . The mobile device of claim 1 , wherein the controller is configured to:

control the display to display the image of the space captured by the camera together with a guide line, and

identify the plane based on the displayed guide line.

4 . The mobile device of claim 3 , wherein the controller is configured to control the display to display the guide line as a base guide line or a corner guide line.

5 . The mobile device of claim 1 , wherein the controller is configured to control the display to display the virtual image of the device in a specified area of the adjusted grid based on a user input received via the user interface to select the specified area of the adjusted grid.

6 . The mobile device of claim 1 , wherein the controller is configured to control the display to rotate the displayed virtual image of the device based on a user input received via the user interface to rotate the displayed virtual image of the device.

7 . The mobile device of claim 1 , wherein the controller is configured to control the display to further display text including at least one of a model name, a size, a resolution, and a distance from a floor of the device corresponding to the displayed virtual image of the device.

8 . The mobile device of claim 1 , wherein the controller is configured to:

display a menu bar, which enables a selection of at least one of a category, a model, and a size of the displayed virtual image of the device, and

control the display to display the virtual image of the device based on a user input received via the user interface to select the virtual image of the device from the displayed menu bar.

9 . The mobile device of claim 1 , wherein, when a plurality of virtual images corresponding to a plurality of devices are displayed, the controller is configured to entirely or partially delete one or more virtual images of the plurality of virtual images based on a user input received via the user interface to delete the one or more virtual images of the plurality of virtual images.

10 . The mobile device of claim 1 , wherein the controller is configured to:

control the display to display at least one virtual content around the displayed virtual image of the device, and

based on a user input received via the user interface to select a virtual content from among the at least one virtual content, control the display to display the selected virtual content within an area on which the displayed virtual image of the device is displayed.

11 . The mobile device of claim 1 , wherein the controller is configured to store a simulation result related to an installation of the displayed virtual image of the device in the space as at least one of a video and a screenshot image.

12 . A method of controlling a mobile device, the method comprising:

capturing an image of a space by a camera;

displaying, by a display, a grid on a plane identified from the image captured by the camera;

adjusting the displayed grid based on a user input received via a user interface to adjust a starting line of the grid corresponding to a boundary of the identified plane; and

displaying a virtual image of a device on the adjusted grid.

13 . The method of claim 12 , wherein the adjusting the displayed grid includes moving a location of the displayed grid based on the user input received via the user interface.

14 . The method of claim 12 , further comprising:

displaying, by the display, the image of the space captured by the camera together with a guide line,

wherein the identifying the plane includes identifying the plane based on the displayed guide line.

15 . The method of claim 14 , wherein the displaying, by the display, the image of the space captured by the camera together with the guide line includes displaying the guide line as a base guide line or a corner guide line.

16 . The method of claim 12 , wherein the displaying the virtual image of the device includes displaying the virtual image of the device in a specified area of the adjusted grid based on a user input received via the user interface to select the specified area of the adjusted grid.

17 . The method of claim 12 , further comprising:

receiving a user input via the user interface to rotate the virtual image of the device;

rotating the virtual image of the device based on the user input received via the user interface to rotate the virtual image of the device; and

displaying the rotated virtual image of the device on the adjusted grid.

18 . The method of claim 12 , further comprising:

displaying text including at least one of a model name, a size, a resolution, and a distance from a floor of the device corresponding to the displayed virtual image of the device.

19 . The method of claim 12 , further comprising displaying a menu bar which enables a selection of at least one of a category, a model, and a size of the displayed virtual image of the device,

wherein the displaying the virtual image of the device includes displaying the virtual image of the device based on a user input received via the user interface to select the virtual image of the device from the displayed menu bar.

20 . The method of claim 12 , further comprising:

when a plurality of virtual images corresponding to a plurality of devices are displayed, entirely or partially deleting one or more virtual images of the plurality of virtual images based on a user input received via the user interface to delete the one or more virtual images of the plurality of virtual images.