IP Library › Granted Patent US 10,681,287
Granted Patent B2
US 10,681,287 · App. 16/121,133 · Granted Jun 9, 2020

Apparatus and method for displaying AR object

Inventors: Yerin Park (Seoul, KR); Hyunjoo Kang (Suwon-si, KR); Jiyeon Kwak (Seoul, KR); Yeo-Jun Yoon (Seoul, KR)
Assignee: Samsung Electronics Co., Ltd.
H04N5/272G06K9/00221G06K9/00671H04N5/232H04N5/23293H04N5/247H04N5/2621H04N5/2723G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,681,287
App. No.
16/121,133
Filed
Sep 4, 2018
Granted
Jun 9, 2020
Kind
B2
Art Unit
2696
USPC
348/239
Abstract

A method and electronic device for displaying an augmented reality (AR) object recognized by the electronic device are provided. The electronic device includes a display, a memory including stored instructions, and at least one processor. The at least one processor is coupled with the memory and the display. The at least one processor is configured to execute the stored instructions so as to identify a first object on a preview acquired from a first camera, and display a first AR object related with the first object on the preview, and in response to obtaining an input for converting from the first camera to a second camera, store information about the first AR object, and display a second AR object which is related with a second object comprised in a preview of the second camera and the information about the first AR object, on the preview of the second camera.

Claims (67)

1. An electronic device comprising:

a display;

a memory comprising instructions stored thereon; and

at least one processor coupled with the memory and the display,

wherein the at least one processor is configured to execute the stored instructions so as to:

identify a first object on a preview acquired from a first camera,

display a first augmented reality (AR) object related with the first object on the preview,

in response to obtaining an input for converting from the first camera to a second camera, store information about the first AR object, and

display a second AR object which is related with a second object comprised in a preview of the second camera and the information about the first AR object, on the preview of the second camera.

2. The electronic device of claim 1 , wherein the at least one processor is further configured to execute the stored instructions so as to:

in response to obtaining an input of converting from the second camera to the first camera, store information about the second AR object; and

display a third AR object which is related with a third object comprised in the preview of the first camera and the stored information about the second AR object on the preview of the first camera, based on the stored information about the second AR object.

3. The electronic device of claim 2 , wherein the third object corresponds to the first object.

4. The electronic device of claim 1 , wherein the at least one processor is further configured to execute the stored instructions so as to display a plurality of AR objects on a preview image of the first camera, based on comprising the plurality of AR objects related with the first object.

5. The electronic device of claim 4 , wherein the at least one processor is further configured to execute the stored instruction so as to, in response to identifying an input for selecting one of the plurality of AR objects, identify the selected AR object as the first AR object.

6. The electronic device of claim 4 , wherein the at least one processor is further configured to execute the stored instructions so as to:

in response to obtaining the input for converting from the first camera to the second camera, identify an AR object related with a user of the electronic device among the plurality of AR objects;

store information about the identified AR object; and

display the identified AR object on the preview of the second camera.

7. The electronic device of claim 4 , wherein the at least one processor is further configured to execute the stored instructions so as to:

in response to obtaining the input of converting from the first camera to the second camera, identify an AR object related with a user of the electronic device among the plurality of AR objects;

store information about the identified AR object, and display a third AR object for indicating the identified AR object on the preview of the second camera; and

in response to obtaining an input to the third AR object, display the identified AR object on the preview of the second camera.

8. The electronic device of claim 1 , wherein the at least one processor is further configured to execute the stored instructions so as to:

in response to obtaining a user's input for execution of an application related with the first AR object and the second AR object, execute the first camera and the second camera;

while the preview of the second camera is displayed, refine the first AR object through the first camera;

store information about the refined first AR object; and

refine the second AR object, based on the stored information.

9. The electronic device of claim 1 , wherein the at least one processor is further configured to execute the stored instructions so as to:

identify whether a plurality of cameras comprised in the electronic device have been formerly used;

in response to at least one camera among the plurality of cameras has been formerly used, identify, as the first camera, the most recently used camera among the plurality of cameras; and

in response to the at least one camera among the plurality of cameras has not been formerly used, identify, as the first camera, a camera disposed in a rear surface of the electronic device.

10. The electronic device of claim 1 ,

wherein the first camera comprises a camera comprised in another electronic device, based on that the electronic device is wiredly or wirelessly connected with the other electronic device, and

wherein the first AR object is related with an object identified through the camera comprised in the other electronic device.

11. A method for an electronic device, comprising:

identifying a first object on a preview acquired from a first camera;

displaying a first augmented reality (AR) object related with the first object on the preview;

in response to obtaining an input for converting from the first camera to a second camera, storing information about the first AR object; and

displaying a second AR object which is related with a second object comprised in a preview of the second camera and the information about the first AR object, on the preview of the second camera.

12. The method of claim 11 , further comprising:

in response to obtaining an input of converting from the second camera to the first camera, storing information about the second AR object; and

displaying a third AR object which is related with a third object comprised in the preview of the first camera and the stored information about the second AR object on the preview of the first camera, based on the stored information about the second AR object.

13. The method of claim 12 , wherein the third object corresponds to the first object.

14. The method of claim 11 , further comprising displaying a plurality of AR objects on a preview image of the first camera, based on comprising the plurality of AR objects related with the first object.

15. The method of claim 14 , further comprising, in response to identifying an input for selecting one of the plurality of AR objects, identifying the selected AR object as the first AR object.

16. The method of claim 14 , further comprising:

in response to obtaining the input for converting from the first camera to the second camera, identifying an AR object related with a user of the electronic device among the plurality of AR objects;

storing information about the identified AR object; and

displaying the identified AR object on the preview of the second camera.

17. The method of claim 14 , further comprising:

in response to obtaining the input of converting from the first camera to the second camera, identifying an AR object related with a user of the electronic device among the plurality of AR objects;

storing information about the identified AR object;

displaying a third AR object for indicating the identified AR object on the preview of the second camera; and

in response to obtaining an input to the third AR object, displaying the identified AR object on the preview of the second camera.

18. The method of claim 11 , further comprising:

in response to obtaining a user's input for execution of an application related with the first AR object and the second AR object, executing the first camera and the second camera;

while the preview of the second camera is displayed, refining the first AR object through the first camera;

storing information about the refined first AR object; and

refining the second AR object, based on the stored information.

19. The method of claim 11 , further comprising:

identifying whether a plurality of cameras comprised in the electronic device have been formerly used;

in response to at least one camera among the plurality of cameras has been formerly used, identifying, as the first camera, the most recently used camera among the plurality of cameras; and

in response to the at least one camera among the plurality of cameras has not been formerly used, identifying, as the first camera, a camera disposed in a rear surface of the electronic device.

20. The method of claim 11 ,

wherein the first camera comprises a camera comprised in another electronic device, based on that the electronic device is wiredly or wirelessly connected with the other electronic device, and

wherein the first AR object is related with an object identified through the camera comprised in the other electronic device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 4, 2018
From: PARK, YERIN; KANG, HYUNJOO; KWAK, JIYEON; YOON, YEO-JUN
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 046780/0989 →
Priority Claims (1)
KR 10-2017-0123973 · Sep 26, 2017 · national
Continuity (1)
Related Publication 20190098227A1 · Mar 28, 2019
Cited By (4)
US 12,192,426 US 12,406,406 US 12,488,547 US 12,513,254