IP Library › Granted Patent US 10,628,432
Granted Patent B2
US 10,628,432 · App. 15/898,985 · Granted Apr 21, 2020

Personalized deep models for smart suggestions ranking

Inventors: Qi Guo (Sunnyvale, CA); Xianren Wu (San Jose, CA); Bo Hu (Mountain View, CA); Shan Zhou (San Jose, CA); Lei Ni (Belmont, CA); Erik Eugene Buchanan (Mountain View, CA)
Assignee: Microsoft Technology Licensing, LLC
G06F16/24578G06F16/9024G06F16/9535G06N20/00G06Q50/01H04L67/306
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,628,432
App. No.
15/898,985
Filed
Feb 19, 2018
Granted
Apr 21, 2020
Kind
B2
Art Unit
2165
USPC
707/734
Abstract

In an example, a deep learning network is used to calculate a similarity score between a first query in a social networking service and each of one or more suggestable entities in the social networking service. The suggestable entities are determined via a first machine learned model. The deep learning network takes as input the suggestable entities as well as a history of interactions with a graphical user interface of a social networking service by a first member of the social networking service, a history of queries performed via the graphical user interface by the first member, and the first query itself.

Claims (55)

1. A system comprising:

one or more processors;

a computer-readable medium having instructions stored thereon, which, when executed by the one or more processors, cause the system to:

obtain a history of interactions with a graphical user interface of a social networking service by a first member of the social networking service;

obtain a history of queries performed via the graphical user interface by the first member;

receive a first query initiated by the first member, the first query identifying a first set of one or more entities in the social networking service;

form a query facet entities vector from the first set of the one or more entities;

submit the query facet entities vector to a first machine learned model to identity a set of one or more suggestable entities, each of the one or more suggestable entities being an entity similar to, but not identical to, an entity in the first set of the one or more entities, based on embeddings learned by the first machine learned model;

form a set of suggestable entities vectors from the set of the one or more suggestable entities;

form a set of history of interactions vectors from the history of interactions;

form a set of history of queries vectors from the history of queries;

pass the query facet entities vector, the set of suggestable entities vectors, the set of history of interactions vectors, and the set of history of queries vectors into a deep learning network to calculate a similarity score between the first query and each suggestable entity in the set of the one or more suggestable entities;

rank the set of the one or more suggestable entities based on the similarity scores; and

cause display of one or more of the suggestable entities based on the ranking.

2. The system of claim 1 , wherein the deep learning network includes an aggregation layer that aggregates the history of interactions vectors and the history of queries vectors separately.

3. The system of claim 2 , wherein the aggregation layer includes one or more long short term memories (LSTMs).

4. The system of claim 2 , wherein the aggregation layer includes one or more gated recurrent units.

5. The system of claim 1 , wherein the first machine learned model calculates, based on co-occurrence counts reflecting a number of user profiles in a plurality of user profiles in which corresponding nodes co-occurred, a similarity score between a first node and second node by computing distance between the first node and the second node in a d-dimensional space on which a plurality of entities are mapped.

6. The system of claim 5 , wherein the similarity score is generated using a generalized linear mixed model having a global coefficient vector applied to global function pertaining to the co-occurrence counts and a first random effects coefficient vector applied to a random effects per-country function.

7. The system of claim 1 , wherein the deep learning network is a deep and wide model.

8. A computerized method comprising:

obtaining a history of interactions with a graphical user interface of a social networking service by a first member of the social networking service;

obtaining a history of queries performed via the graphical user interface by the first member;

receiving a first query initiated by the first member, the first query identifying a first set of one or more entities in the social networking service;

forming a query facet entities vector from the first set of the one or more entities,

submitting the query facet entities vector to a first machine learned model to identify a set of one or more suggestable entities, each of the one or more suggestable entities being an entity similar to, but not identical to, an entity in the first set of the one or more entities, based on embeddings learned by the first machine learned model;

forming a set of suggestable entities vectors from the set of the one or more suggestable entities,

forming a set of history of interactions vectors from the history of interactions,

forming a set of history of queries vectors from the history of queries;

passing the query facet entities vector, the set of suggestable entities vectors, the set of history of interactions vectors, and the set of history of queries vectors into a deep learning network to calculate a similarity score between the first query and each suggestable entity in the set of the one or more suggestable entities,

ranking the set of the one or more suggestable entities based on the similarity scores; and

causing display of one or more of the suggestable entities based on the ranking.

9. The method of claim 8 , wherein the deep learning network includes an aggregation layer that aggregates the history of interactions vectors and the history of queries vectors separately.

10. The method of claim 9 , wherein the aggregation layer includes one or more long short term memories (LSTMs).

11. The method of claim 9 , wherein the aggregation layer includes one or more gated recurrent units.

12. The method of claim 8 , wherein the first machine learned model calculates, based on co-occurrence counts reflecting a number of user profiles in a plurality of user profiles in which corresponding nodes co-occurred, a similarity score between a first node and second node by computing distance between the first node and the second node in a d-dimensional space on which a plurality of entities are mapped.

13. The method of claim 12 , wherein the similarity score is generated using a generalized linear mixed model having a global coefficient vector applied to global function pertaining to the co-occurrence counts and a first random effects coefficient vector applied to a random effects per-country function.

14. The method of claim 8 , wherein the deep learning network is a deep and wide model.

15. A non-transitory machine-readable storage medium comprising instructions, which when implemented by one or more machines, cause the one or more machines to perform operations comprising:

obtaining a history of interactions with a graphical user in of a social networking service by a first member of the social networking service;

obtaining a history of queries performed via the graphical user interface by the first member;

receiving a first query initiated by the first member, the first query identifying a first set of one or more entities in the social networking service;

forming a query facet entities vector from the first set of the one or more entities,

submitting the query facet entities vector to a first machine learned model to identify a set of one or more suggestable entities, each of the one or more suggestable entities being an entity similar to, but not identical to, an entity in the first set of the one or more entities, based on embeddings learned by the first machine learned model;

forming a set of suggestable entities vectors from the set of the one or more suggestable entities;

forming a set of history of interactions vectors from the history of interactions;

forming a set of history of queries vectors from the history of queries;

passing the query facet entities vector the set a suggestable entities vectors the set of history of interactions vectors, and the set of history of queries vectors into a deep learning network to calculate a similarity score between th first query and each suggestable entity in the set of the one or more suggestable entities;

ranking the set of the one or more suggestable entities based on the similarity scores; and

causing display of one or more of the suggestable entities based on the ranking.

16. The non-transitory machine-readable storage medium of claim 15 , wherein the deep learning network includes an aggregation layer that aggregates the history of interactions vectors and the history of queries vectors separately.

17. The non-transitory machine-readable storage medium of claim 16 , wherein the aggregation layer includes one or more long short term memories (LSTMs).

18. The non-transitory machine-readable storage medium of claim 16 , wherein the aggregation layer includes one or more gated recurrent units.

19. The non-transitory machine-readable storage medium of claim 15 , wherein the first machine learned model calculates, based on co-occurrence counts reflecting a number of user profiles in a plurality of user profiles in which corresponding nodes co-occurred, a similarity score between a first node and second node by computing distance between the first node and the second node in a d-dimensional space on which a plurality of entities are mapped.

20. The non-transitory machine-readable storage medium of claim 19 , wherein the similarity score is generated using a generalized linear mixed model having a global coefficient vector applied to global function pertaining to the co-occurrence counts and a first random effects coefficient vector applied to a random effects per-country function.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 31, 2018
From: GUO, QI; WU, XIANREN; HU, BO; ZHOU, SHAN; NI, LEI; BUCHANAN, ERIK EUGENE
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 045952/0757 →
Continuity (1)
Related Publication 20190258722A1 · Aug 22, 2019
Cited By (18)
US 12,198,396 US 12,216,610 US 12,223,428 US 12,236,689 US 12,307,350 US 12,346,816 US 12,367,405 US 12,455,739 US 12,462,575 US 12,522,243 US 12,536,131 US 12,554,467 US 12,591,240 US 12,618,976 US 12,623,691 US 12,646,628 US 12,709,294 US 12,730,852