IP Library Granted Patent US 12,499,474
Granted Patent B2
US 12,499,474 · App. 18/610,775 · Granted Dec 16, 2025

Method of deriving quality improvement requirements

Inventors: Su Min Seo (Seoul, KR); Jeong Eun Byun (Seoul, KR); Kuk Jin Bae (Seongnam-si, KR); Yun Jeong Choi (Seoul, KR); Eun Sun Kim (Seoul, KR); Min Je Cho (Seoul, KR); Sung Jin Kim (Incheon, KR); Ju Yeon Shin (Yongin-si, KR); Ji Min Kim (Yongin-si, KR); Min Ju Kim (Seoul, KR)
Assignee: KOREA INSTITUTE OF SCIENCE & TECHNOLOGY INFORMATION
G06Q30/0282G06F16/951G06F40/289
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,499,474
App. No.
18/610,775
Granted
Dec 16, 2025
Kind
B2
Abstract

The present disclosure relates to a method of deriving quality improvement requirements. The method according to some embodiments may include receiving a plurality of evaluation information for a first product from an evaluation information database, inputting the plurality of evaluation information into a key phrase extraction model and determining key phrases for the plurality of evaluation information based on an output of the key phrase extraction model, grouping some of the key phrases for the plurality of evaluation information into multiple groups and storing information on each of the multiple groups in a memory, ranking the key phrases included in each of the multiple groups and storing information associated with the ranks of the key phrases included in each of the multiple groups in the memory and determining top n key phrases from each of the multiple groups as quality improvement requirements.

Claims (25)

1 . A method of deriving quality improvement requirements, performed by a computing system, the method comprising:

receiving a plurality of evaluation information for a first product from an evaluation information database;

inputting the plurality of evaluation information into a key phrase extraction model and determining key phrases for the plurality of evaluation information based on an output of the key phrase extraction model;

grouping some of the key phrases for the plurality of evaluation information into multiple groups and storing information on each of the multiple groups in a memory;

ranking the key phrases included in each of the multiple groups and storing information associated with the ranks of the key phrases included in each of the multiple groups in the memory; and

determining top n key phrases from each of the multiple groups as quality improvement requirements, based on ranking results for the key phrases included in each of the multiple groups.

2 . The method of claim 1 , further comprising:

crawling the plurality of evaluation information for the first product from the Internet.

3 . The method of claim 1 , wherein the key phrase extraction model includes a transformer model trained based on evaluation information for multiple products.

4 . The method of claim 1 , wherein the determining the key phrases for the plurality of evaluation information, comprises extracting n candidate phrases from each of the plurality of evaluation information, ranking the candidate phrases based on weighted averages and weighted sums of the candidate phrases and a number of times each of the candidate phrases is included in the plurality of evaluation information, and determining the key phrases for the plurality of evaluation information based on ranking results for the candidate phrases.

5 . The method of claim 1 , further comprising determining key words for the key phrases for the plurality of evaluation information, based on the key phrases for the plurality of evaluation information.

6 . The method of claim 5 , wherein the determining the key words for the key phrases for the plurality of evaluation information, comprises extracting nouns and roots contained in each of the key phrases for the plurality of evaluation information.

7 . The method of claim 5 , wherein the grouping some of the key phrases for the plurality of evaluation information, comprises extracting topic words for a plurality of topics from the plurality of evaluation information, and grouping some of the key phrases for the plurality of evaluation information into multiple groups based on similarities between the key words and the topic words.

8 . The method of claim 1 , wherein the ranking the key phrases included in each of the multiple groups, comprises ranking key phrases included in a first group, among the multiple groups, based on weighted averages and weighted sums of the corresponding key phrases and a number of times each of the corresponding key phrases is included in the first group.

9 . A computing system comprising:

at least one processor; and

a memory storing one or more instructions,

wherein by executing the stored instructions, the at least one processor performs operations of: receiving a plurality of evaluation information for a first product from an evaluation information database; inputting the plurality of evaluation information into a key phrase extraction model and determining key phrases for the plurality of evaluation information based on an output of the key phrase extraction model; grouping some of the key phrases for the plurality of evaluation information into multiple groups and storing information on each of the multiple groups in a memory; ranking the key phrases included in each of the multiple groups and storing information associated with the ranks of the key phrases included in each of the multiple groups in the memory; and determining top n key phrases from each of the multiple groups as quality improvement requirements, based on ranking results for the key phrases included in each of the multiple groups.

10 . The computing system of claim 9 , wherein the operation of determining the key phrases for the plurality of evaluation information, comprises operations of: extracting n candidate phrases from each of the plurality of evaluation information; ranking the candidate phrases based on weighted averages and weighted sums of the candidate phrases and a number of times each of the candidate phrases is included in the plurality of evaluation information; and determining the key phrases for the plurality of evaluation information based on ranking results for the candidate phrases.

11 . The computing system of claim 9 , wherein the at least one processor further performs an operation of determining key words for the key phrases for the plurality of evaluation information, based on the key phrases for the plurality of evaluation information.

12 . The computing system of claim 11 , wherein the operation of determining the key words for the key phrases for the plurality of evaluation information, comprises an operation of extracting nouns and roots contained in each of the key phrases for the plurality of evaluation information.

13 . The computing system of claim 11 , wherein the operation of grouping some of the key phrases for the plurality of evaluation information, comprises operations of: extracting topic words for a plurality of topics from the plurality of evaluation information; and grouping some of the key phrases for the plurality of evaluation information into multiple groups based on similarities between the key words and the topic words.

14 . The computing system of claim 9 , wherein the operation of ranking the key phrases included in each of the multiple groups, comprises an operation of ranking key phrases included in a first group, among the multiple groups, based on weighted averages and weighted sums of the corresponding key phrases and a number of times each of the corresponding key phrases is included in the first group.

15 . The computing system of claim 9 , wherein the at least one processor further performs an operation of crawling the plurality of evaluation information for the first product from the Internet.

16 . The computing system of claim 9 , wherein the key phrase extraction model includes a transformer model trained based on evaluation information for multiple products.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 20, 2024
From: SEO, SU MIN; BYUN, JEONG EUN; BAE, KUK JIN; CHOI, YUN JEONG; KIM, EUN SUN; CHO, MIN JE; KIM, SUNG JIN; SHIN, JU YEON; KIM, JI MIN; KIM, MIN JU
To: KOREA INSTITUTE OF SCIENCE & TECHNOLOGY INFORMATION
Reel/Frame 066843/0720 →
Priority Claims (2)
KR 10-2023-0038017 · Mar 23, 2023 · national
KR 10-2023-0170130 · Nov 29, 2023 · national
Continuity (1)
Related Publication 20240320716A1 · Sep 26, 2024
References Cited (15)
US 9600560B2 · Hirate · 2017 [cited by examiner]
US 9747342B2 · Hirate · 2017 [cited by examiner]
US 11010828B2 · Watanabe · 2021 [cited by examiner]
US 11531944B2 · Lapierre · 2022 [cited by examiner]
US 11699177B1 · Alexandrov · 2023 [cited by examiner]
US 11915173B2 · Lapierre · 2024 [cited by examiner]
US 20210264480A1 · Silverstein · 2021 [cited by examiner]
JP 2016139216A · 2016 [cited by applicant]
KR 1020180080492A · 2018 [cited by applicant]
KR 1020210023452A · 2021 [cited by applicant]
KR 1020210044017A · 2021 [cited by applicant]
KR 1020210082880A · 2021 [cited by applicant]
KR 1020220025540A · 2022 [cited by applicant]
KR 1020220086932A · 2022 [cited by applicant]
KR 102505204B1 · 2023 [cited by applicant]