IP Library Granted Patent US 11,645,301
Granted Patent B2
US 11,645,301 · App. 16/749,622 · Granted May 9, 2023

Cross media recommendation

Inventor: Brian Whitman (Cambridge, MA)
Assignee: Spotify AB
G06F16/26G06F16/24578G06F16/435G06F16/635G06F16/68G06F16/735G06N5/003G06N7/005G06N20/00G06N20/10G06N5/025
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,645,301
App. No.
16/749,622
Granted
May 9, 2023
Kind
B2
Abstract

Methods, systems and computer program products are provided for cross-media recommendation by store a plurality of taste profiles corresponding to a first domain and a plurality of media item vectors corresponding to a second domain. An evaluation taste profile in the first domain is applied to a plurality of models that have been generated based on relationship among the plurality of taste profiles and the plurality of media item vectors, and obtain a plurality of resulting codes corresponding to at least one of the plurality of media item vectors in the second domain.

Claims (43)

1. A system for cross-media recommendation, comprising:

a first database operable to store a plurality of user taste profiles corresponding to a first domain;

a second database operable to store a plurality of media item vectors corresponding to a second domain; and

at least one processor configured to:

generate a plurality of weighted term vectors by multiplying, for each term in a user taste profile of the plurality of user taste profiles, an affinity by a probability that the term is associated with a media item;

generate vector quantized media data by vector quantizing the plurality of media item vectors;

map the weighted term vectors to the vector quantized media data to form relationships between the user taste profiles and one or more media items;

train a model based on the map to learn the relationships between the user taste profiles and the one or more media items; and

apply an evaluation taste profile in the first domain to the model to obtain a media item corresponding to the second domain.

2. The system according to claim 1 , wherein the first domain is music and the second domain is any one, or a combination, of books, movies, or games.

3. The system according to claim 1 , wherein the at least one processor is further configured to:

generate a training set based on the plurality of user taste profiles and the plurality of media item vectors, wherein at least a portion of the training set includes ground truths across the first domain and the second domain; and

train the model with the training set.

4. The system according to claim 1 , wherein the at least one processor is further configured to:

obtain a confidence interval indicating an amount of confidence in a relation between the evaluation taste profile and the media item vector of the media item corresponding to the second domain.

5. A computer-implemented method for cross-media recommendation, comprising:

storing a plurality of user taste profiles corresponding to a first domain;

storing a plurality of media item vectors corresponding to a second domain;

generating a plurality of weighted term vectors by multiplying, for each term in a user taste profile of the plurality of user taste profiles, an affinity by a probability that the term is associated with a media item;

generating vector quantized media data by vector quantizing the plurality of media item vectors;

mapping the weighted term vectors to the vector quantized media data to form relationships between the user taste profiles and one or more media items;

training a model based on the map to learn the relationships between the user taste profiles and the one or more media items; and

applying an evaluation taste profile in the first domain to the model to obtain a media item corresponding to the second domain.

6. The computer-implemented method according to claim 5 , wherein the first domain is music and the second domain is any one, or a combination, of books, movies, or games.

7. The computer-implemented method according to claim 5 , further comprising the step of:

generating a training set based on the plurality of user taste profiles and the plurality of media item vectors, wherein at least a portion of the training set includes ground truths across the first domain and second domain; and

training the model with the training set.

8. The computer-implemented method according to claim 5 , further comprising the step of:

obtaining a confidence interval indicating an amount of confidence in a relation between the evaluation taste profile and the media item vector of the media item corresponding to the second domain.

9. A non-transitory computer-readable medium having stored thereon one or more sequences of instructions for causing one or more processors to perform:

storing a plurality of user taste profiles corresponding to a first domain;

storing a plurality of media item vectors corresponding to a second domain;

generating a plurality of weighted term vectors by multiplying, for each term in a user taste profile of the plurality of user taste profiles, an affinity by a probability that the term is associated with a media item;

generating vector quantized media data by vector quantizing the plurality of media item vectors;

mapping the weighted term vectors to the vector quantized media data to form relationships between the user taste profiles and one or more media items;

training a model based on the map to learn the relationships between the user taste profiles and the one or more media items; and

applying an evaluation taste profile in the first domain to the model to obtain a media item corresponding to the second domain.

10. The non-transitory computer-readable medium of claim 9 , wherein the first domain is music and the second domain is any one, or a combination, of books, movies, or games.

11. The non-transitory computer-readable medium of claim 9 , further having stored thereon a sequence of instructions for causing the one or more processors to perform:

generating a training set based on the plurality of user taste profiles and the plurality of media item vectors, wherein at least a portion of the training set includes ground truths across the first domain and second domain; and

training the model with the training set.

12. The non-transitory computer-readable medium of claim 9 , further having stored thereon a sequence of instructions for causing the one or more processors to perform:

obtaining a confidence interval indicating an amount of confidence in a relation between the evaluation taste profile and the media item vector of the media item corresponding to the second domain.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 3, 2023
From: WHITMAN, BRIAN
To: THE ECHO NEST CORPORATION
Reel/Frame 063203/0296 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 3, 2023
From: THE ECHO NEST CORPORATION
To: SPOTIFY AB
Reel/Frame 063203/0412 →
Continuity (4)
Continuation 15420311 · Jan 31, 2017
Continuation 14213749 · Mar 14, 2014
Provisional Application 61802971 · Mar 18, 2013
Related Publication 20200159744A1 · May 21, 2020