IP Library Granted Patent US 11,863,839
Granted Patent B2
US 11,863,839 · App. 17/632,465 · Granted Jan 2, 2024

Personalized sensitivity measurements and playback factors for adaptive and personalized media coding and delivery

Inventors: Doh-Suk Kim (Cupertino, CA); Sean Thomas McCarthy (San Francisco, CA); Scott Daly (Kalama, WA); Jeffrey Riedmiller (Novato, CA); Ludovic Christophe Malfait (Belmont, CA); Raphael Marc Ullmann (Basel, CH); Jason Michael Cloud (Clayton, CA)
Assignee: Dolby Laboratories Licensing Corporation
H04N21/64769H04L65/80H04N21/2668H04N21/4532
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,863,839
App. No.
17/632,465
Granted
Jan 2, 2024
Kind
B2
Abstract

A method for delivering media to a playback device including outputting first test media to be viewed by a first user. The method further includes receiving a first user input related to a first perception of the first test media by the first user and indicating a first personalized quality of experience of the first user with respect to the first test media. The method further includes generating a first personalized sensitivity profile including one or more viewing characteristics of the first user based on the first user input, and determining, based at least in part on the first personalized sensitivity profile, a first media parameter. The first media parameter is determined in order to increase an efficiency of media delivery to the first playback device over a network while preserving the first personalized quality of experience of the first user.

Claims (54)

1. A method for delivering media to a playback device, the method comprising:

outputting, by a first playback device and during a first test measurement session, first test media to be viewed by a first user;

receiving a first user input from the first user, the first user input related to a first perception of the first test media by the first user and indicating a first personalized quality of experience of the first user with respect to the first test media;

generating, with one or more electronic processors, a first personalized sensitivity profile including one or more viewing characteristics of the first user and/or of an environment in which the first user is viewing the first playback device based on the first user input;

determining, with the one or more electronic processors and based at least in part on the first personalized sensitivity profile, a first media parameter for increasing an efficiency of media delivery to the first playback device over a network while preserving the first personalized quality of experience of the first user; and

providing, by a media server over the network, first output media to the first playback device in accordance with the first media parameter, the first output media configured to be output with the first playback device,

wherein the first test media includes a plurality of hybrid images and the first user input includes a plurality of user inputs, each of the first user inputs being received in response to a respective hybrid image of the plurality of hybrid images, and

wherein determining the first media parameter includes:

retrieving, with the one or more electronic processors and from a memory, a generic objective model configured to control media streaming based on at least one of resource availability of the network and playback system parameters;

transforming, with the one or more electronic processors, the generic objective model into a personalized objective model using the first personalized sensitivity profile; and

providing, by the media server over the network, the first output media to the first playback device in accordance with the personalized objective model.

2. The method of claim 1 , wherein providing the first output media to the first playback device in accordance with the first media parameter results in the network using decreased bandwidth to provide the first output media to the first playback device without reducing the first personalized quality of experience of the first user.

3. The method of claim 1 , further comprising:

outputting, by a second playback device and during a second test measurement session, second test media to be viewed by a second user;

receiving a second user input from the second user, the second user input related to a second perception of the second test media by the second user and indicating a second personalized quality of experience of the second user with respect to the second test media, wherein the second personalized quality of experience indicates that the second user is more sensitive to decreases in quality of media than the first user of the first playback device;

generating, with the one or more electronic processors, a second personalized sensitivity profile of one or more viewing characteristics of the second user and/or of an environment in which the second user is viewing the second playback device based on the second user input;

determining, with the one or more electronic processors, a second media parameter for the second playback device based at least in part on the second personalized sensitivity profile;

providing, with the one or more electronic processor and over the network, second output media to the second playback device in accordance with the second media parameter, the second output media configured to be output with the second playback device;

wherein the first media parameter and the second media parameter are determined such that providing of the first output media to the first playback device decreases a first usage of resources of the network to be lower than a second usage of resources of the network with respect to providing of the second output media to the second playback device; and

wherein a first percentage of the first personalized quality of experience of the first user is maintained at approximately the same level as a second percentage of the second personalized quality of experience of the second user.

4. The method of claim 3 , wherein the one or more electronic processors includes at least one of a first electronic processor of the first playback device, a second electronic processor of the second playback device, and a third electronic processor associated with the network or the media server.

5. The method of claim 1 , further comprising:

generating, with the one or more electronic processors, each hybrid image by low-pass filtering a first source image to create a low-pass filtered source image, high-pass filtering a second source image to create a high-pass filtered source image, and

overlaying the low-pass filtered source image and the high-pass filtered source image on top of each other to create the hybrid image;

wherein either the low-pass filtered source image or the high-pass filtered source image is perceived by the first user as dominant depending on the one or more viewing characteristics of the first user and/or of the environment.

6. The method of claim 5 , wherein outputting the first test media includes:

outputting, by the first playback device, a first hybrid image to be viewed by the first user;

receiving the first user input from the first user, the first user input related to the first perception of the first hybrid image by the first user; and

outputting, by the first playback device, a second hybrid image to be viewed by the first user, wherein a cutoff frequency of at least one of the low-pass filtering and the high-pass filtering used to create the second hybrid image is based on the first user input related to the first perception of the first hybrid image by the first user.

7. The method of claim 1 , wherein outputting the first test media includes:

retrieving, with the one or more electronic processors and from a memory, a previously-stored personalized sensitivity profile; and

generating, with the one or more electronic processors, the first test media based on one or more viewing characteristics included in the previously-stored personalized sensitivity profile.

8. The method of claim 7 , wherein retrieving the previously-stored personalized sensitivity profile includes:

determining, with the one or more electronic processors, a characteristic of the first test measurement session including at least one of a characteristic of the first user, a characteristic of the first playback device, and a characteristic of the environment in which the first user is viewing the first playback device; and

identifying, with the one or more electronic processors, the previously-stored personalized sensitivity profile from a plurality of previously stored personalized sensitivity profiles based on the previously-stored personalized sensitivity profile including one or more of the same characteristics as the characteristic of the first test measurement session.

9. The method of claim 1 , wherein transforming the generic objective model into the personalized objective model includes at least one of translating and scaling an ideal contrast sensitivity function (CSF) used by the generic objective model to create a personalized CSF based on the first personalized sensitivity profile.

10. The method of claim 1 , wherein the one or more viewing characteristics of the first user and/or of the environment include at least one of a viewing distance between the first user and a display of the first playback device, lighting in the environment in which the first user is viewing the display, and vision sensitivity of eyes of the first user.

11. The method of claim 1 , further comprising:

determining, with an environmental sensor in the environment where the playback device is located, an environmental condition;

wherein generating the first personalized sensitivity profile including the one or more viewing characteristics of the first user and/or the environment includes generating, with the one or more electronic processors, the first personalized sensitivity profile such that first sensitivity profile includes the environmental condition.

12. An electronic computing device comprising:

a first playback device including a display, wherein the display is configured to output media to a first user; and

one or more electronic processors communicatively coupled to the display, the one or more electronic processors configured to

output, by the first playback device and during a first test measurement session, first test media to be viewed by the first user,

receive a first user input from the first user, wherein the first user input is related to a first perception of the first test media by the first user and indicates a first personalized quality of experience of the first user with respect to the first test media,

generate a first personalized sensitivity profile including one or more viewing characteristics of the first user and/or an environment in which the first user is viewing the first playback device based on the first user input,

determine, based at least in part on the first personalized sensitivity profile, a first media parameter for increasing an efficiency of media delivery to the first playback device over a network while preserving the first personalized quality of experience of the first user, and

provide, by a media server over the network, first output media to the first playback device in accordance with the first media parameter, wherein the first output media is configured to be output with the first playback device,

wherein the first test media includes a plurality of hybrid images and the first user input includes a plurality of user inputs, each of the first user inputs being received in response to a respective hybrid image of the plurality of hybrid images, and

wherein determining the first media parameter includes:

retrieving, with the one or more electronic processors and from a memory, a generic objective model configured to control media streaming based on at least one of resource availability of the network and playback system parameters;

transforming, with the one or more electronic processors, the generic objective model into a personalized objective model using the first personalized sensitivity profile; and

providing, by the media server over the network, the first output media to the first playback device in accordance with the personalized objective model.

13. The electronic computing device of claim 12 , wherein the one or more electronic processors include at least one of a first electronic processor of the first playback device and a second electronic processor associated with the network or the media server.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 4, 2022
From: KIM, DOH-SUK; MCCARTHY, SEAN THOMAS; DALY, SCOTT; REIDMILLER, JEFFREY; MALFAIT, LUDOVIC CHRISTOPHE; ULLMANN, RAPHAEL MARC; CLOUD, JASON MICHAEL
To: DOLBY LABORATORIES LICENSING CORPORATION
Reel/Frame 059818/0292 →
Continuity (3)
Provisional Application 63056942 · Jul 27, 2020
Provisional Application 62882068 · Aug 2, 2019
Related Publication 20230111900A1 · Apr 13, 2023