IP Library Granted Patent US 12,026,166
Granted Patent B2
US 12,026,166 · App. 17/383,121 · Granted Jul 2, 2024

Method and system for determining rank positions of elements by a ranking system

Inventors: Ilya Vladimirovich Katsev (Saint-Petersburg, RU); Valeriya Dmitrievna Tsoy (Novosibirsk, RU)
Assignee: Direct Cursus Technology L.L.C
G06F16/24578G06F16/9538G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,026,166
App. No.
17/383,121
Granted
Jul 2, 2024
Kind
B2
Abstract

A method and system for determining rank positions of elements displayed on a search engine results page (SERP) by a ranking system. During a training phase of the ranking system, an indication of user interactions associated with a first ranked list of elements is acquired. The elements of the first ranked list were visually displayed on a first SERP. A score for a first content element is determined based on a size of the first content element and a ranking of the first content element. The ranking system is trained, based on the score, to predict a predicted usefulness score for the first content element. During an in-use phase of the ranking system, a ranked list of elements is determined based on a query. The ranking system determines a ranked position for a content element in the ranked list. A SERP based on the ranked list is output.

Claims (75)

1. A method of determining rank positions of elements displayed on a search engine results page (SERP) by a ranking system, the ranking system having been trained to rank elements based on previous user interactions, the method executable by a server, the method comprising:

during a training phase of the ranking system:

acquiring, by the server, an indication of user interactions associated with a first ranked list of elements, elements of the first ranked list of elements having been visually displayed on a first SERP to a user in response to a training query, wherein the first ranked list of elements comprises a first content element;

determining, by the server, a score for the first content element based at least in part on:

comparing a size of the first content element on the first SERP and a size of a second content element on the first SERP,

a ranking, in the first ranked list of elements, of the first content element, and

an amount of time that a user viewed content associated with the first content element; and

training, by the server, the ranking system to predict the score for the first content element, wherein training the ranking system comprises determining a difference between a predicted usefulness score output by the ranking system and the score, and adjusting the ranking system based on the difference; and

during an in-use phase of the ranking system:

receiving, by the server, an in-use query from a user;

generating, by the ranking system based on the in-use query, a second ranked list of elements;

determining, by the ranking system, a ranked position for a second content element in the second ranked list of elements based at least in part on a size of the second content element and a distance between the second content element and a top-ranked element of the second ranked list of elements;

placing, by the server, the second content element in the second ranked list of elements at the ranked position; and

generating, based on the second ranked list of elements, a second SERP.

2. The method of claim 1 , wherein determining the score for the first content element comprises:

after determining that the user selected an element displayed above the first content element on the first SERP, setting the score to zero.

3. The method of claim 1 , wherein determining the score for the first content element comprises:

after determining that the user selected the first content element on the first SERP, setting the score to one.

4. The method of claim 1 , wherein determining the score for the first content element comprises, after determining that the user selected an element displayed below the first content element on the first SERP:

determining a first height of the first content element;

determining a second height of the element displayed below the first content element; and

subtracting the first height divided by the second height from the score.

5. The method of claim 1 , wherein determining the ranked position for the second content element comprises determining, for each position in the ranked list, a predicted usefulness score of the second content element.

6. The method of claim 5 , wherein the ranked position for the second content element has a highest predicted usefulness score of the predicted usefulness scores.

7. The method of claim 1 , wherein determining the amount of time that the user viewed content associated with the first content element comprises determining an amount of time that the user viewed a video associated with the first content element.

8. The method of claim 1 , wherein the second content element comprises one or more images or videos.

9. The method of claim 1 , wherein determining the score for the first content element comprises determining the score based at least in part on a horizontal position of the first content element.

10. The method of claim 1 , wherein determining the score for the first content element comprises:

determining a distance on the SERP of the first content element from a highest ranked element; and

determining, based at least in part on the distance, the score.

11. The method of claim 1 , wherein determining the score for the first content element comprises, after determining that the user selected an element displayed below the first content element on the first SERP:

determining a first number of pixels of a height of the first content element;

determining a second number of pixels of a height of the element displayed below the first content element; and

subtracting, from the score, the first number of pixels divided by the second number of pixels.

12. A method of determining rank positions of elements displayed on a search engine results page (SERP) by a ranking system, the ranking system having been trained to rank elements based on previous user interactions, the method executable by a server, the method comprising:

during a training phase of the ranking system:

acquiring, by the server, an indication of user interactions associated with a first ranked list of elements, elements of the first ranked list of elements having been visually displayed on a first SERP to a user in response to a training query;

determining, by the server, a score for each element of the first ranked list of elements based at least in part on:

comparing a size of the respective element on the first SERP and a size of another element on the first SERP,

a ranking, in the first ranked list of elements, of the respective element, and

an amount of time that a user viewed content associated with the respective element; and

training, by the server, the ranking system to predict the score for each element, wherein training the ranking system comprises determining a difference between a predicted usefulness score output by the ranking system for each element and the score for the respective element, and adjusting the ranking system based on the difference; and

during an in-use phase of the ranking system:

receiving, by the server, an in-use query from a user;

generating, by the ranking system based on the in-use query, a set of elements;

determining, by the ranking system, a ranked position for each element of the set of elements based at least in part on a size of each respective element, thereby generating a second ranked list of elements; and

generating, based on the second ranked list of elements, a second SERP.

13. The method of claim 12 , wherein determining the score for each element of the first ranked list of elements comprises:

after determining that the user selected an element displayed above a respective element on the first SERP, setting the score of the respective element to zero.

14. The method of claim 12 , wherein determining the score for each element of the first ranked list of elements comprises:

after determining that the user selected an element displayed below a respective element on the first SERP:

determining a first height of the respective element;

determining a second height of the element displayed below the respective element; and

subtracting the first height divided by the second height from the score of the respective element.

15. The method of claim 12 , wherein determining the ranked position for each element of the set of elements comprises determining, for each element of the set of elements, a predicted usefulness score for each available ranking of the respective element.

16. The method of claim 15 wherein determining the ranked position for each element of the set of elements comprises selecting, for each element of the set of elements, a ranking having a highest predicted usefulness score.

17. The method of claim 12 , further comprising triggering a visual display of the second SERP.

18. The method of claim 12 , wherein the indication of user interactions comprise an indication of: a selection of an item in the first SERP, a long selection of the item, the selection of the item followed by a web resource transition, playing audio corresponding to the item, or a hovering action over the item.

19. A system comprising:

at least one processor, and

memory storing a plurality of executable instructions which, when executed by the at least one processor, cause the system to:

during a training phase of a ranking system:

acquire an indication of user interactions associated with a first ranked list of elements, elements of the first ranked list of elements having been visually displayed on a first search engine results page (SERP) to a user in response to a training query, wherein the first ranked list of elements comprises a first content element;

determining a score for the first content element based at least in part on:

comparing a size of the first content element on the first SERP and a size of a second content element on the first SERP,

a ranking, in the first ranked list of elements, of the first content element, and

an amount of time that a user viewed content associated with the first content element; and

training the ranking system to predict the score for the first content element, wherein training the ranking system comprises determining a difference between a predicted usefulness score output by the ranking system and the score and adjusting the ranking system based on the difference; and

during an in-use phase of the ranking system:

receiving an in-use query from a user;

generating, by the ranking system based on the in-use query, a second ranked list of elements;

determining, by the ranking system, a ranked position for a second content element in the second ranked list of elements based at least in part on a size of the second content element and a distance between the second content element and a top-ranked element of the second ranked list of elements;

placing, by the server, the second content element in the second ranked list of elements at the ranked position; and

generating, based on the second ranked list of elements, a second SERP.

20. The system of claim 19 , wherein the instructions that cause the system to determine the score for the first content element comprises instructions that cause the system to compare the size of the first content element on the first SERP to a size of a selected element on the first SERP.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 9, 2024
From: DIRECT CURSUS TECHNOLOGY L.L.C
To: Y.E. HUB ARMENIA LLC
Reel/Frame 068534/0687 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 15, 2023
From: YANDEX EUROPE AG
To: DIRECT CURSUS TECHNOLOGY L.L.C
Reel/Frame 065692/0720 →
LICENSE Recorded Sep 2, 2022
From: YANDEX EUROPE AG
To: ZEN.PLATFORMA, LIMITED LIABILITY COMPANY
Reel/Frame 060979/0040 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 10, 2021
From: KATSEV, ILYA VLADIMIROVICH; TSOY, VALERIYA DMITRIEVNA
To: YANDEX.TECHNOLOGIES LLC
Reel/Frame 058363/0135 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 10, 2021
From: YANDEX.TECHNOLOGIES LLC
To: YANDEX LLC
Reel/Frame 058363/0191 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 10, 2021
From: YANDEX LLC
To: YANDEX EUROPE AG
Reel/Frame 058363/0272 →
Priority Claims (1)
RU RU2020139194 · Nov 30, 2020 · national
Continuity (1)
Related Publication 20220171782A1 · Jun 2, 2022