IP Library Granted Patent US 10,957,022
Granted Patent B2
US 10,957,022 · App. 15/986,438 · Granted Mar 23, 2021

Electronic device for processing image acquired by using camera and method for operating the same

Inventors: Sung-Oh Kim (Suwon-si, KR); Seong-Woon Kim (Seongnam-si, KR); Jae-Gon Kim (Hwaseong-si, KR); Hyun-Hee Park (Seoul, KR); Yung-Mok Yu (Seongnam-si, KR); Sang-Hyeon Lim (Hwaseong-si, KR); Jong-Bum Choi (Yongin-si, KR); Il-Do Kim (Suwon-si, KR); Kwang-Tai Kim (Yongin-si, KR); Ha-Joong Park (Suwon-si, KR); Ki-Huk Lee (Suwon-si, KR)
Assignee: Samsung Electronics Co., Ltd.
G06T5/005G06T3/40G06T5/50G06T7/40G06T7/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,957,022
App. No.
15/986,438
Granted
Mar 23, 2021
Kind
B2
Abstract

An electronic device is disclosed. The electronic device includes a camera, a communication module, and a processor. The processor is operably coupled with the camera and the communication module. The processor is configured to obtain a first image corresponding to an external object using the camera. The processor is also configured to generate a second image smaller in data size than the first image using the first image. The processor is further configured to transmit the second image to an external electronic device through the communication module. The processor is also configured to receive correction area information from the external electronic device through the communication module. The correction area information is based on information associated with an image area identified from the second image. The processor is further configured to perform correction using the first image based on at least part of the correction area information.

Claims (74)

1. An electronic device, comprising:

a camera;

a communication module; and

a processor operably coupled with the camera and the communication module, wherein the processor is configured to:

obtain a first image corresponding to an external object using the camera,

generate metadata associated with the first image and generate a second image smaller in data size than the first image using the first image,

transmit the second image and the metadata to an external electronic device through the communication module,

receive correction area information from the external electronic device through the communication module, wherein the correction area information is based on the metadata and information associated with an image area identified from the second image and wherein the correction area information comprises a plurality of maps, and

perform correction using the first image based on at least part of the correction area information,

wherein the plurality of maps are related to a result of object recognition of at least one object in the second image and a result of texture recognition in the second image.

2. The electronic device of claim 1 , wherein the processor is configured to generate the second image by performing at least one of:

adjusting a resolution of the first image,

selecting at least some of a plurality of frequency bands of the first image, or

selecting at least one of a plurality of bit plain levels of the first image.

3. The electronic device of claim 1 , wherein the processor is configured to transmit the first image through the communication module to the external electronic device so that the external electronic device generates other correction area information using the first image and the correction area information.

4. The electronic device of claim 1 , wherein the correction area information associated with the image area includes at least one of:

a position of a first object included in the second image,

a result of object recognition of the first object,

a reliability of the result of the object recognition of the first object,

a position of a second object included in the second image,

a result of texture recognition of the second object, or

an accuracy of the texture recognition of the second object.

5. The electronic device of claim 1 , wherein the processor is configured to:

receive the correction area information that includes image classification information from the external electronic device through the communication module; and

correct the first image using at least one of the image classification information or the correction area information associated with the image area.

6. The electronic device of claim 1 , wherein the processor is configured to receive, through the communication module, the correction area information generated by the external electronic device using the metadata and the second image.

7. The electronic device of claim 1 , wherein the processor is configured to perform at least one of:

applying a first effect corresponding to a result of recognition of an object for a pixel of the first image corresponding to a position of the object included in the correction area information; or

applying a second effect corresponding to classification information for the first image.

8. The electronic device of claim 1 , wherein the processor is configured to generate the corrected first image using a format different from a format of the first image, as part of the correction.

9. The electronic device of claim 1 , wherein the processor is configured to:

generate the second image and a fifth image, that together with the second image constitutes the first image, using the first image; and

transmit the fifth image through the communication module to the external electronic device so that the external electronic device constitutes the first image with the second image and the fifth image and generates other correction area information using the correction area information and the first image.

10. The electronic device of claim 9 , wherein the processor is configured to:

select some of a plurality of frequency bands of the first image to generate the second image;

select others of the plurality of frequency bands to generate the fifth image, and select some of a plurality of bit plains of the first image to generate the second image and select others of the plurality of bit plains to generate the fifth image; or

down-scale the first image to generate the second image, up-scale the second image into a resolution of the first image, and obtain a difference between the up-scaled second image and the first image to generate the fifth image.

11. An electronic device, comprising:

a communication module; and

a processor operably coupled with the communication module, wherein the processor is configured to:

obtain a first image and metadata associated with a second image through the communication module from another electronic device,

identify at least one image area from the first image based on first image recognition,

generate correction area information corresponding to the first image based on, at least, information associated with the at least one image area and the metadata, and

transmit the correction area information through the communication module to an external electronic device,

wherein the correction area information comprises a plurality of maps, and

wherein the plurality of maps are related to a result of object recognition of at least one object in the first image and a result of texture recognition in the first image.

12. The electronic device of claim 11 , wherein the processor is configured to:

generate classification information corresponding to the first image based on second image recognition; and

generate the correction area information based on at least one of the classification information or the information associated with the at least one image area.

13. The electronic device of claim 11 , wherein the processor is configured to receive the first image through the communication module from the external electronic device.

14. The electronic device of claim 11 , wherein the processor is configured to:

identify at least one area corresponding to an object from the at least one image area; and

generate the correction area information using information related to the object.

15. The electronic device of claim 11 , wherein the processor is configured to:

identify at least one area corresponding to a texture from the at least one image area; and

generate the correction area information using information related to the texture.

16. The electronic device of claim 11 , wherein the processor is configured to:

determine at least one reliability corresponding to splitting or classifying the at least one image area; and

generate the correction area information using the at least one reliability.

17. The electronic device of claim 11 , wherein the processor is configured to:

receive the second image different in size from the first image from the external electronic device through the communication module; and

generate other correction area information using the second image and the correction area information.

18. The electronic device of claim 17 , wherein the processor is configured to generate a third image corrected using the second image based on at least part of the other correction area information.

19. The electronic device of claim 17 , wherein the processor is configured to:

identify a first area and a second area of the second image for the correction based on at least part of the other correction area information,

correct the first area using first correction information designated corresponding to the first area; and

correct the second area using second correction information designated corresponding to the second area.

20. A method for operating an electronic device, comprising:

obtaining a first image corresponding to an external object using a camera,

generating metadata associated with the first image and generating a second image smaller in data size than the first image using the first image,

transmitting the second image and the metadata to an external electronic device,

receiving correction area information from the external electronic device through a communication module, wherein the correction area information is based on the metadata and information associated with an image area identified from the second image and wherein the correction area information comprises a plurality of maps, and

performing correction using the first image based on at least part of the correction area information,

wherein the plurality of maps are related to a result of object recognition of at least one object in the second image and a result of texture recognition in the second image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 22, 2018
From: KIM, SUNG-OH; KIM, SEONG-WOON; KIM, JAE-GON; PARK, HYUN-HEE; YU, YUNG-MOK; LIM, SANG-HYEON; CHOI, JONG-BUM; KIM, IL-DO; KIM, KWANG-TAI; PARK, HA-JOONG; LEE, KI-HUK
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 045875/0448 →
Priority Claims (1)
KR 10-2017-0062956 · May 22, 2017 · national
Continuity (1)
Related Publication 20180336666A1 · Nov 22, 2018