IP Library › Granted Patent US 12,394,189
Granted Patent B2
US 12,394,189 · App. 18/416,462 · Granted Aug 19, 2025

Data recognition model construction apparatus and method for constructing data recognition model thereof, and data recognition apparatus and method for recognizing data thereof

Inventors: Ji-man Kim (Suwon-si, KR); Chan-jong Park (Seoul, KR); Do-jun Yang (Yongin-si, KR); Hyun-woo Lee (Seoul, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06V10/776G06F18/214G06F18/217G06N3/04G06N3/045G06V10/774G06V10/95G06V20/41G06V20/42
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,394,189
App. No.
18/416,462
Granted
Aug 19, 2025
Kind
B2
Abstract

Disclosed is a data recognition model construction apparatus. The data recognition model construction apparatus includes a video inputter configured to receive a video, an image composition unit configured to, based on a common area included in each of a plurality of images that form at least a portion of the video, generate a composition image by overlaying at least a portion of the plurality of images, a learning data inputter configured to receive the generated composition image, a model learning unit configured to make a data recognition model learn using the generated composition image, and a model storage configured to store the learnt data recognition model.

Claims (25)

1. A data recognition model construction apparatus comprising:

a video inputter configured to receive a video;

an image composition unit configured to obtain at least one common object included in each of a plurality of images that form at least a portion of the video, and obtain a composition image by overlaying a plurality of common areas corresponding to the at least one common object with each other, each of the plurality of common areas being included in a corresponding image among the plurality of images and including the at least one common object, and each of the plurality of images including a common area and a background;

a model learning unit configured to make a data recognition model learn using the obtained composition image; and

a model storage configured to store the learnt data recognition model,

wherein the image composition unit is further configured to, based on an attribute of the background, selectively perform either a first operation of overlaying only the plurality of common areas or a second operation of overlaying the plurality of common areas and a plurality of backgrounds corresponding to the plurality of common areas, the first operation or the second operation being selected based on the attribute of the background.

2. The apparatus as claimed in claim 1 , wherein the attribute of the background includes relevance between the common area and the background, and a ratio of an area corresponding to the background in the plurality of images.

3. The apparatus as claimed in claim 2 , wherein the image composition unit is further configured to:

based on the relevance between the common area and the background being greater than a first predetermined value, perform the second operation of overlaying the plurality of common areas and the plurality of backgrounds corresponding to the plurality of common areas,

based on the relevance between the common area and the background being less than the first predetermined value, perform the first operation of overlaying only the plurality of common areas.

4. The apparatus as claimed in claim 2 , wherein the image composition unit is further configured to:

based on the ratio of the area corresponding to the background in the plurality of images being greater than a second predetermined value, perform the first operation of overlaying only the plurality of common areas,

based on the ratio of the area corresponding to the background in the plurality of images being less than the second predetermined value, perform the second operation of overlaying the plurality of common areas and the plurality of backgrounds corresponding to the plurality of common areas.

5. The apparatus as claimed in claim 1 , wherein the model learning unit further configured to obtain learning data comprising the composition image and a classification result corresponding to the composition image, the model learning unit being further configured to make a data recognition model learn using the obtained composition image and the classification result.

6. A method for constructing a data recognition model by a data recognition model construction apparatus, the method comprising:

receiving a video;

obtaining at least one common object included in each of a plurality of images that form at least a portion of the video;

obtaining a composition image by overlaying a plurality of common areas corresponding to the at least one common object with each other, each of the plurality of common areas being included in a corresponding image among the plurality of images and including the at least one common object, and each of the plurality of images including a common area and a background;

learning a data recognition model using the obtained composition image; and

storing the learnt data recognition model,

wherein the obtaining the composition image comprises, based on an attribute of the background, selectively performing either a first operation of overlaying only the plurality of common areas or a second operation of overlaying the plurality of common areas and a plurality of backgrounds corresponding to the plurality of common areas, the first operation or the second operation being selected based on the attribute of the background.

7. The method as claimed in claim 6 , wherein the attribute of the background includes relevance between the common area and the background, and a ratio of an area corresponding to the background in the plurality of images.

8. The method as claimed in claim 6 , wherein the obtaining the composition image comprises:

based on the relevance between the common area and the background being greater than a first predetermined value, performing the second operation of overlaying the plurality of common areas and the plurality of backgrounds corresponding to the plurality of common areas,

based on the relevance between the common area and the background being less than the first predetermined value, performing the first operation of overlaying only the plurality of common areas.

Priority Claims (2)
KR 10-2016-0145748 · Nov 3, 2016 · national
KR 10-2017-0104312 · Aug 17, 2017 · national
Continuity (3)
Continuation 17246147 · Apr 30, 2021
Continuation 15802661 · Nov 3, 2017
Related Publication 20240185584A1 · Jun 6, 2024
References Cited (39)
US 8300924B2 · Eaton et al. · 2012 [cited by applicant]
US 8345984B2 · Ji et al. · 2013 [cited by applicant]
US 8477998B1 · Kim et al. · 2013 [cited by applicant]
US 8620028B2 · Eaton et al. · 2013 [cited by applicant]
US 8705861B2 · Eaton et al. · 2014 [cited by applicant]
US 8923609B2 · Eaton et al. · 2014 [cited by applicant]
US 9094615B2 · Aman et al. · 2015 [cited by applicant]
US 9843724B1 · Brailovskiy · 2017 [cited by applicant]
US 20120141094A1 · Ryoo et al. · 2012 [cited by applicant]
US 20130301876A1 · Hugosson · 2013 [cited by applicant]
US 20140093122A1 · Rabinowitz · 2014 [cited by applicant]
US 20150019214A1 · Wang et al. · 2015 [cited by applicant]
US 20150324655A1 · Chalasani · 2015 [cited by applicant]
US 20160034748A1 · Wang et al. · 2016 [cited by applicant]
US 20160124513A1 · Dal Zot et al. · 2016 [cited by applicant]
US 20160133254A1 · Vogel et al. · 2016 [cited by applicant]
US 20160217387A1 · Okanohara et al. · 2016 [cited by applicant]
US 20160300111A1 · Cosatto · 2016 [cited by applicant]
US 20160328643A1 · Liu · 2016 [cited by applicant]
CN 105912999A · 2016 [cited by applicant]
JP 2005267407A · 2005 [cited by applicant]
KR 1020160096460A · 2016 [cited by applicant]
WO 2011159258A1 · 2011 [cited by applicant]
Guo, K. et al., “Action Recognition in Video by Covariance Match of Silhouette Tunnels”, Oct. 11-15, 2009, IEE Xplore, INSPEC Accession No. 11134017, 9 Pages total. [cited by applicant]
Communication dated Dec. 6, 2021, issued by the India Intellectual Property Office in Indian Patent Application No. 201917021798. [cited by applicant]
Communication dated Jan. 28, 2022, issued by the Korean Intellectual Property Office in Korean Patent Application No. 10-2017-0104312. [cited by applicant]
Communication dated Jul. 13, 2021, issued by the Korean Intellectual Property Office in Korean Application No. 10-2017-0104312. [cited by applicant]
Communication dated Mar. 24, 2022 issued by the European Patent Office in European Patent Application No. 17867457.8. [cited by applicant]
Communication dated Oct. 9, 2019, issued by the European Patent Office in counterpart European Application No. 17867457.8. [cited by applicant]
Communication dated Sep. 16, 2020 issued by the European Patent Office in application No. 17867457.8. [cited by applicant]
Communication issued on Dec. 5, 2023 by the European Patent Office in European Patent Application No. 17867457.8. [cited by applicant]
Communication issued on Nov. 10, 2023 by the China National Intellectual Property Administration in Chinese Patent Application No. 201780067877.4. [cited by applicant]
Madan, Visualizing and quantifying movement from pre-recorded videos: The spectral time-lapse (STL) algorithm, F1000 Research. [cited by applicant]
Office Action issued Nov. 1, 2022 by the Chinese Patent Office for Chinese Patent Application No. 201780067877.4. [cited by applicant]
Office Action dated Jun. 2, 2023, issued by Chinese Patent Office for Chinese Patent Application No. 201780067877.4. [cited by applicant]
Written Opinion issued by the International Searching Authority in corresponding International Application No. PCT/KR2017/012275, on Mar. 9, 2018. [cited by applicant]
International Search Report, issued by International Searching Authority in corresponding International Application No. PCT/KR2017/012275, on Mar. 9, 2018 (PCT/ISA/210). [cited by applicant]
Guo, K. et al., “Action Recognition in Video by Covariance Matching of Silhouette Tunnels”, Oct. 11, 2009, XXII Brazilian Symposium on Computer Graphics and Image Processing, XP031616889, p. 299-306, 8 pages total. [cited by applicant]
Communication dated Feb. 7, 2025 issued by Intellectual Property India in Indian Patent Application No. 201917021798. [cited by applicant]