IP Library › Granted Patent US 12,670,208
Granted Patent B2
US 12,670,208 · App. 18/009,361 · Granted Jun 30, 2026

Lifelog device utilizing audio recognition, and method therefor

Inventors: Ilyoung Jeong (Seoul, KR); Hyungui Lim (Seoul, KR); Yoonchang Han (Seoul, KR); Subin Lee (Seoul, KR); Jeongsoo Park (Yongin-si, KR); Donmoon Lee (Suwon-si, KR)
Assignee: Cochl Inc.
G06F16/64G06F16/638G06F16/65G06F16/686
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,670,208
App. No.
18/009,361
Filed
Dec 9, 2022
Granted
Jun 30, 2026
Kind
B2
Art Unit
2692
USPC
700/94
Abstract

The present invention relates to a lifelog device utilizing audio recognition and a method therefor, and to a device capable of recording and classifying audio lifelogs by means of an artificial intelligence algorithm. To this end, the lifelog device of the present invention comprises: an input unit for inputting lifelog data including an audio signal; and analysis unit for analyzing the inputted data; a determination unit for classifying the class of the data on the basis of the analyzed analysis value; and a recording unit for recording the inputted data and the classified class of the data.

Claims (20)

1 . A lifelog device comprising:

an ear equipment configured to be worn by a user, the equipment including:

an input unit to which lifelog data including an audio signal and biological information including at least one of a user's pulse rate or a user's body temperature is input through a sensor;

a time setting unit configured to set a time for which the lifelog data is input to the input unit;

an analysis unit configured to extract an analysis value from the input lifelog data;

a determination unit configured to classify a class of the lifelog data on the basis of the extracted analysis value;

a recording unit configured to record data including the input lifelog data and the classified class of the lifelog data; and

a search unit configured to search for the recorded data,

wherein the search unit extracts the recorded data which matches keyword information input by the search unit,

wherein the search unit provides at least one of a number or a time of the recorded data corresponding to the classified class,

wherein the lifelog data is input for a time preset by the time setting unit,

wherein the analysis unit transmits the analysis value extracted from the audio signal and the biological information included in the input lifelog data to the determination unit,

wherein the determination unit classifies the class of the lifelog data on the basis of a combination of the analysis value of the audio signal and an analysis value of the biological information using an artificial intelligence algorithm which is installed in advance,

wherein the artificial intelligence algorithm is trained with a user's feedback on a determination value determined by the determination unit,

wherein the determination unit matches the determination value for the lifelog data with information related to a place in which the lifelog data is input, and transmits the determination value and the information matching each other to the recording unit, and

wherein the recording unit records the determination value for the lifelog data determined by the determination unit and removes data determined to be a noise class.

2 . The lifelog device of claim 1 , wherein the search unit is provided through a screen of a user terminal,

when the user selects a classified class of the lifelog data, a list of the lifelog data classified into the class is extracted, and

when any one piece of the lifelog data in the extracted list is selected, an audio signal of the selected piece of the lifelog data is played.

3 . The lifelog device of claim 2 , wherein, when the user additionally inputs arbitrary tag information to the selected piece of the lifelog data, the input tag information is matched to the selected piece of the lifelog data with the input tag information.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2023
From: COCHL,INC.
To: COCHL INC
Reel/Frame 066073/0076 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 9, 2022
From: JEONG, ILYOUNG; LIM, HYUNGUI; HAN, YOONCHANG; LEE, SUBIN; PARK, JEONGSOO; LEE, DONMOON
To: COCHL,INC.
Reel/Frame 062036/0338 →
Priority Claims (1)
KR 10-2020-0075196 · Jun 19, 2020 · national
Continuity (1)
Related Publication 20230222158A1 · Jul 13, 2023
References Cited (25)
US 20100142715A1 · Goldstein et al. · 2010 [cited by applicant]
US 20100274774A1 · Son · 2010 [cited by examiner]
US 20150043737A1 · Abe · 2015 [cited by examiner]
US 20160026873A1 · Wexler · 2016 [cited by examiner]
US 20160150333A1 · Goldstein · 2016 [cited by examiner]
US 20160364963A1 · Matsuoka · 2016 [cited by examiner]
US 20170154638A1 · Hwang · 2017 [cited by examiner]
US 20180078188A1 · Kaneko · 2018 [cited by examiner]
US 20190115045A1 · Jarvis · 2019 [cited by examiner]
US 20190259378A1 · Khadloya · 2019 [cited by examiner]
US 20190318033A1 · Ganadas · 2019 [cited by examiner]
US 20200125952A1 · Mosayyebpour · 2020 [cited by examiner]
JP 2013162277A · 2013 [cited by applicant]
JP 2015152948A · 2015 [cited by applicant]
JP 2018013857A · 2018 [cited by applicant]
JP 2018093503A · 2018 [cited by applicant]
JP 2019091486A · 2019 [cited by applicant]
KR 1020110125431A · 2011 [cited by applicant]
KR 1020150046818A · 2015 [cited by applicant]
KR 1020170034260A · 2017 [cited by applicant]
KR 102260466B1 · 2021 [cited by applicant]
Mohit Shah et al. “Lifelogging: Archival and retrieval of continuously recorded audio using wearable devices” SenSIP Center, School of ECEE, Arisona State University, ESPA 2012, pp. 99-102. [cited by applicant]
Yali Zheng et al. “Speech/Music Indexing for Audio Life-Logs from Portable Device Record” College of Information and Engineering, Guilin University of Technology, China and Graduate School of Science and Technology, Kum… [cited by applicant]
Taro Tezuka et al. “Audio Lifelog Search System Using a Topic Model for Reducing Recognition Errors”, College of Information Science and Engineering, Ritsumeikan University, pp. 73-82, 2011. [cited by applicant]
Masayuki Ono et al., Structuring of life logs by various sensors using a neural network Electronic Information and Communication Society Technical Research Report, Electronic Information and Communication Society, Japan… [cited by applicant]