IP Library › Granted Patent US 12,056,286
Granted Patent B2
US 12,056,286 · App. 17/985,776 · Granted Aug 6, 2024

Electronic device for providing augmented reality service and operating method thereof

Inventors: Jieun Kim (Suwon-si, KR); Jongwoo Jung (Suwon-si, KR); Inyoung Choi (Suwon-si, KR)
Assignee: Samsung Electronics Co., Ltd.
G06F3/017G06T7/11G06T7/70G06V10/22G06V40/20G06T2207/20021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,056,286
App. No.
17/985,776
Granted
Aug 6, 2024
Kind
B2
Abstract

An apparatus and/or method for providing an augmented reality service in an electronic device. The electronic device may include a memory configured to store first gesture information and second gesture information, a camera, a display, and a processor, wherein the processor may be configured to detect a gesture on the basis of image information obtained via the camera, identify the gesture on the basis that a detection location of the gesture is included in a first region different from a second region corresponding to a viewing angle of a user wearing the electronic device, from among the image information obtained via the camera, output a first visual effect related to the gesture via the display when the gesture corresponds to the first gesture information, and output guide information related to the gesture via the display when the gesture corresponds to the second gesture information. Other embodiments may also be possible.

Claims (36)

1. An electronic device comprising:

a memory;

a camera;

a display; and

processing circuitry operatively connected to the memory, the display, and the camera,

wherein the processing circuitry is configured to:

detect a gesture using image information obtained via the camera while a virtual object is displayed on the display;

identify whether the gesture is detected in a second region corresponding to a region outside of a first region corresponding to a region inside of a field of view of a user wearing the electronic device, among the image information obtained via the camera;

in response to detecting the gesture in the first region, output a first visual effect related to the virtual object based on the gesture via the display;

in response to detecting the gesture in the second region, identify a function mapped to the detected gesture;

in response to the detected gesture being mapped to a first function related to the virtual object, output guide information related to the gesture via the display; and

in response to the detected gesture being mapped to a second function not related to the virtual object, output a second visual effect related to the second function.

2. The electronic device of claim 1 , wherein the processing circuitry is configured to divide the image information obtained via the camera into the first region corresponding to the region inside of the field of view of the user wearing the electronic device and the second region corresponding to the region outside of the field of view of the user wearing the electronic device.

3. The electronic device of claim 1 , wherein the processing circuitry is configured so that the first visual effect is to be displayed on at least a portion adjacent to the detection location of the gesture within a region corresponding to the user's field of view in a display region of the display, and

wherein the guide information comprises information related to a change in the location of an external object related to the gesture.

4. The electronic device of claim 1 , wherein the processing circuitry is configured to:

execute an application program related to the second function based on mapping of the second function not related to the virtual object to the gesture identified to be in the second region, and

output the second visual effect related to the executed application program.

5. The electronic device of claim 1 , wherein the processing circuitry is further configured to:

based on the gesture detected in the second region is related to motions of a plurality of external objects, identify detection locations of the plurality of external objects, and

output the guide information related to the gesture via the display, based on the detection of locations of the plurality of external objects are included in the first region.

6. The electronic device of claim 5 , wherein the processing circuitry is further configured to output guide information related to the gesture via the display, based on the detection of a location of at least one external object among the plurality of external objects is included in the second region.

7. A method of operating an electronic device, the method comprising:

detecting a gesture using image information obtained via a camera of the electronic device while a virtual object is displayed on a display of the electronic device;

identifying whether the gesture is detected in a second region corresponding to a region outside of the first region corresponding to a region inside of a field of view of a user wearing the electronic device, among the image information obtained via the camera;

in response to detecting the gesture in the first region, outputting a visual effect related to the gesture;

in response to detecting the gesture in the second region, identifying a function mapped to the detected gesture;

in response to the detected gesture being mapped to a first function related to the virtual object, outputting guide information related to the gesture; and

in response to the detected gesture being mapped to a second function not related to the virtual object, outputting a second visual effect related to the second function.

8. The method of claim 7 , wherein the first visual effect is displayed on at least a portion adjacent to the detection location of the gesture within a region corresponding to the user's field of view in a display region of the electronic device, and

wherein the first region comprises at least a portion configured based on a region corresponding to the user's field of view of the display region, among the image information obtained via the camera.

9. The method of claim 7 , wherein the guide information comprises information related to a change in the location of an external object related to the gesture.

10. The method of claim 7 , further comprising dividing the image information obtained via the camera into the first region corresponding to the region inside of the field of view of the user wearing the electronic device and the second region corresponding to the region outside of the field of view of the user wearing the electronic device.

11. The method of claim 7 , wherein the outputting the second visual effect comprises:

executing an application program related to second function based on mapping of the second function not related to the virtual object to the gesture identified to be in the second region; and

outputting the second visual effect related to the executed application program.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 11, 2022
From: KIM, JIEUN; JUNG, JONGWOO; CHOI, INYOUNG
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 062319/0782 →
Priority Claims (1)
KR 10-2020-0056985 · May 13, 2020 · national
Continuity (2)
Continuation PCTKR2021005688 · May 6, 2021
Related Publication 20230074380A1 · Mar 9, 2023
Cited By (1)
US 12,518,502