IP Library Granted Patent US 10,339,176
Granted Patent B2
US 10,339,176 · App. 14/898,343 · Granted Jul 2, 2019

Device for providing image related to replayed music and method using same

Inventor: Min-Soeng Kim (Seoul, KR)
Assignee: GROOVERS INC.
G06F16/58G06F16/583G06F16/5838G06F16/5866G06F16/683G06K9/6201H04N21/42202H04N21/4394H04N21/44218H04N21/44222H04N21/8113H04N21/8153
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,339,176
App. No.
14/898,343
Granted
Jul 2, 2019
Kind
B2
Abstract

Disclosed are a device and method for providing an image related to playing music. Information about the mood of the playing music and information about the state of the user listening to the music are collected, and one or more relevant images corresponding to at least one of the mood information and the state information may be extracted from a user image source pool and may be output to the terminal of the user. Because background images matching the mood of the music to which the user is listening or the environment of the user listening to the music are provided, the user may recall the memory related to the image and the situation when the image was stored while listening to the music, whereby the corresponding music may sound more familiar to the user.

Claims (57)

1. A terminal device for providing an image related to playing music, the terminal device comprising a processor, wherein said processor comprises:

an information collection unit configured to collect information about a mood of playing music and information about a state of a user;

a pool generation unit configured to generate a user image source pool by acquiring a first plurality of images stored in the terminal device and a second plurality of images extracted from an Social Networking Service (SNS) of a user's account;

an image extraction unit configured to:

extract a relevant image corresponding to the information about the mood of playing music and the information about the state of the user from the user image source pool;

determine whether an environment of the user is a public place or a private place using an ambient noise;

extract the relevant image from the first plurality of images when the environment of the user is the private place;

extract the relevant image from the second plurality of images when the environment of the user is the public place; and

an image output unit configured to:

output the relevant image to be displayed on the terminal device to provide as a background image while music is playing;

output, when the environment of the user is the private place, the relevant image extracted from the first plurality of images stored in the terminal device including private images; and

output, when the environment of the user is the public place, the relevant image extracted from the second plurality of images extracted from the Social Networking Service (SNS) including revealed images.

2. The terminal device of claim 1 , wherein the second plurality of images includes images uploaded to the SNS and images for which the user performed an activity on the SNS,

wherein the image output unit is configured to provide the relevant image as the background image while music is playing, the terminal device performs (i) first operations corresponding to the first plurality of images extracted from the terminal device and (ii) second operations corresponding to the second plurality of images extracted from the Social Networking Service (SNS) separately based on sources of images.

3. The terminal device of claim 1 , wherein the pool generation unit is configured to store a first time at which each of the first plurality of images stored in the terminal device was stored and a second time at which each of the second plurality of images extracted from the SNS was posted on the SNS in the user image source pool in association with a corresponding image.

4. The terminal device of claim 3 , wherein the pool generation unit is configured to:

acquire past weather data corresponding to the first time at which each of the first plurality of images was stored and the second time at which each of the second plurality of images was posted on the SNS, and

store the past weather data in the user image source pool in association with a corresponding image,

wherein the image extraction unit configured to extract the relevant image based on at least an image corresponding to the information about the state of the user among past weather data linked with a plurality of images stored in the user image source pool,

wherein the image output unit configured to output the relevant image, wherein the relevant image is an image stored and uploaded based on past weather corresponding to the information about the state of the user.

5. The terminal device of claim 4 , wherein the image extraction unit is configured to

determine a tempo of the music, and

extract the relevant image corresponding to a clear day using the past weather data when the tempo is equal to or faster than a predetermined tempo.

6. The terminal device of claim 4 , wherein the image extraction unit is configured to extract the relevant image using past weather data corresponding to current weather among the past weather data and using chroma and brightness of images included in the user image source pool.

7. The terminal device of claim 6 , wherein said processor further comprises:

a manipulation information collection unit configured to collect user manipulation information, which is information indicating that the user manipulates the terminal device of the user to change an image output to the terminal device.

8. The terminal device of claim 7 , wherein the image extraction unit is configured to extract the relevant image from among images preferred by the user and images preferred according to music using the user manipulation information.

9. The terminal device of claim 1 , wherein said processor further comprises:

a product recommendation unit configured to recommend at least one of a tour package, a product targeted at an age range, a gift product, and a real product including an object related product corresponding to an image, according to image types of the relevant image.

10. A method for providing an image related to playing music, the method performed by a processor of a terminal device, the method comprising:

collecting information about a mood of playing music and information about a state of a user;

generating a user image source pool by acquiring a first plurality of images stored in the terminal device and a second plurality of images extracted from an Social Networking Service (SNS) of a user's account;

extracting a relevant image corresponding to the information about the mood and the information about the state of the user from the user image source pool;

determining whether an environment of the user is a public place or a private place using an ambient noise;

extracting the relevant image from the first plurality of images when the environment of the user is the private place;

extracting the relevant image from the second plurality of images when the environment of the user is the public place;

extracting the relevant image based on at least an image corresponding to the information about the state of the user among past weather data linked with a plurality of images stored in the user image source pool;

outputting the relevant image on the terminal device to provide as a background image while music is playing;

outputting, when the environment of the user is the private place, the relevant image extracted from the first plurality of images stored in the terminal device including private images; and

outputting, when the environment of the user is the public place, the relevant image extracted from the second plurality of images extracted from the Social Networking Service (SNS) including revealed images.

11. The method of claim 10 , wherein the user image source pool includes a first time at which each of the first plurality of images stored in the terminal device was stored and a second time at which each of the second plurality of images extracted from the SNS was posted on the SNS in the user image source pool in association with a corresponding image.

12. The method of claim 10 , further comprising,

recommending at least one of a tour package, a product targeted at an age range, a gift product, and a real product including an object-related product corresponding to an image, according to image types of the relevant image.

13. A non-transitory computer-readable medium storing a program causing a computer to execute an image providing process, the image providing process comprises:

collecting information about a mood of playing music and information about a state of a user;

generating a user image source pool by acquiring a first plurality of images stored in a terminal device and a second plurality of images extracted from an Social Networking Service (SNS) of a user's account;

extracting a relevant image corresponding to the information about the mood and the information about the state of the user from the user image source pool;

determining whether an environment of the user is a public place or a private place using an ambient noise;

extracting the relevant image from the first plurality of images when the environment of the user is the private place;

extracting the relevant image from the second plurality of images when the environment of the user is the public place;

extracting the relevant image based on at least an image corresponding to the information about the state of the user among past weather data linked with a plurality of images stored in the user image source pool;

outputting the relevant image on a terminal device to provide as a background image while music is playing;

outputting, when the environment of the user is the private place, the relevant image extracted from the first plurality of images stored in the terminal device including private images; and

outputting, when the environment of the user is the public place, the relevant image extracted from the second plurality of images extracted from the Social Networking Service (SNS) including revealed images.

14. The terminal device of claim 2 , wherein the image output unit is configured to provide the relevant image as the background image while music is playing,

when the user clicks the relevant image extracted from the first plurality of images extracted from the terminal device, a date and a place at which the clicked image was taken are displayed via an image viewer installed in the terminal device, and

when the user clicks the relevant image extracted from the second plurality of images extracted from the Social Networking Service (SNS), the user's activities on the SNS at a time at which the image was extracted are shown.

Assignments (5)
MERGER Recorded Nov 22, 2019
From: GROOVERS INC.
To: DREAMUS COMPANY
Reel/Frame 051087/0323 →
MERGER Recorded Nov 2, 2018
From: SK TECHX CO., LTD.
To: SK PLANET CO., LTD.
Reel/Frame 047396/0110 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 2, 2018
From: SK PLANET CO., LTD.
To: GROOVERS INC.
Reel/Frame 047398/0115 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 23, 2017
From: SK PLANET CO., LTD.
To: SK TECHX CO., LTD.
Reel/Frame 043925/0772 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 14, 2015
From: KIM, MIN-SOENG
To: SK PLANET CO., LTD.
Reel/Frame 037285/0076 →
Priority Claims (1)
KR 10-2014-0048057 · Apr 22, 2014 · national
Continuity (1)
Related Publication 20160132533A1 · May 12, 2016