Granted Patent B2

US 12,328,498 · App. 18/211,821 · Granted Jun 10, 2025

Inventors: Jyoti Johri (Bengaluru, IN); Mayukh Das (Bengaluru, IN); Pradeep Nelahonne Shivamurthappa (Bengaluru, IN)

Assignee: SAMSUNG ELECTRONICS CO., LTD.

H04N23/632H04N5/2628H04N23/617H04N23/635

Abstract

Claims (34)

1. A method performed by an object cropping system of an electronic device, the method comprising:

receiving, from a camera, a preview image comprising a plurality of objects;

determining outline boundaries of the plurality of objects;

determining a relevance score between the plurality of objects based on context of the plurality of objects and relationship between the plurality of objects;

generating a plurality of boundary suggestions comprising the plurality of objects, based on the relevance score;

receiving a user input indicating a selection of one of the plurality of boundary suggestions or a selection of at least one object from the plurality of objects present in the plurality of boundary suggestions, wherein the relevance score is updated for the at least one object based on the user input; and

cropping the at least one object from the preview image based on the user input and the updated relevance score using the outline boundaries determined for the plurality of objects.

2. The method of claim 1 , wherein the outline boundaries of the plurality of objects are determined by using at least one first type Artificial Intelligence (AI) based model.

3. The method of claim 2 , wherein the at least one first type AI based model comprises enhanced Region Proposal Network (RPN) for outline boundary determination, and

wherein the enhanced RPN is integrated with an instance segmentation Deep Neural Network (DNN).

4. The method of claim 1 , wherein the plurality of objects have at least one of a polygonal and a non-polygonal shape.

5. The method of claim 3 , wherein the relevance score between the plurality of objects based on context of the plurality of objects and relationship between the plurality of objects are determined by using at least one second type AI based model.

6. The method of claim 1 , wherein the outline boundaries determined for the plurality of objects are visualized by using borders drawn by a border-line construction model associated with the object cropping system.

7. The method of claim 5 , the at least one second type AI based model comprises a Neuro-symbolic model for determining the context of the plurality of objects and the relationship between the plurality of objects.

8. The method of claim 1 , wherein the relationship between the plurality of objects is determined based on scene description and the context of the plurality of objects.

9. The method of claim 1 , further comprising pre-processing the preview image to eliminate at least one of redundant image frames and irrelevant image frames.

10. The method of claim 1 , further comprising storing the cropped at least one object in a single image or in multiple images.

11. The method of claim 2 , further comprising, based on the preview image including a single object having one of a polygonal and a non-polygonal shape:

determining an outline boundary of the single object using the at least one first type AI based model;

generating at least one boundary suggestion including the single object;

receiving the user input indicating a selection of one of the at least one boundary suggestion; and

cropping the single object from the preview image based on the user input using the outline boundary determined for the single object.

12. An electronic device comprising:

a memory storing instructions; and

a processor configured to execute the instructions to:

receive a preview image comprising a plurality of objects;

determine outline boundaries of the plurality of objects;

determine a relevance score between the plurality of objects based on context of the plurality of objects and relationship between the plurality of objects;

generate a plurality of boundary suggestions comprising the plurality of objects, based on the relevance score;

receive a user input indicating a selection of one of the plurality of boundary suggestions or a selection of at least one object from the plurality of objects present in the plurality of boundary suggestions, wherein the relevance score is updated for the at least one object based on the user input; and

crop the at least one object from the preview image based on the user input and the updated relevance score using the outline boundaries determined for the plurality of objects.

13. The electronic device of claim 12 , wherein the processor is further configured to execute the instructions to determine the outline boundaries of the plurality of objects by using at least one first type Artificial Intelligence (AI) based model.

14. The electronic device of claim 13 , wherein the at least one first type AI based model comprises enhanced Region Proposal Network (RPN) for outline boundary determination, wherein the enhanced RPN is integrated with an instance segmentation Deep Neural Network (DNN).

15. The electronic device of claim 12 , wherein the plurality of objects have at least one of a polygonal and a non-polygonal shape.

Assignments (1)

Priority Claims (1)

Continuity (2)

References Cited (23)