IP Library Granted Patent US 10,154,429
Granted Patent B1
US 10,154,429 · App. 15/621,476 · Granted Dec 11, 2018

Method and system for user experience event processing and analysis

Inventors: Liran Sharoni (Kfar Saba, IL); Ido Shilo (Kfar Saba, IL); Miki Sapir (Nes Ziona, IL); Alon Marcu (Tel Mond, IL)
Assignee: Western Digital Technologies, Inc.
H04W24/08H04H60/64H04H60/85
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,154,429
App. No.
15/621,476
Granted
Dec 11, 2018
Kind
B1
Abstract

A method and system for user experience event processing and analysis are provided. In one embodiment, a method is provided comprising: receiving a recorded video of a display of the host device and a reference video; comparing the recorded video with the reference video to identify differences, wherein the recorded video and the reference video are synchronized based on content rather than time; receiving data indicating activity of a storage device of the host device; correlating the differences with the data indicating activity of the storage device; and generating an analysis of the correlation. Other embodiments are possible, and each of the embodiments can be used alone or together in combination.

Claims (35)

1. A method for analyzing user experience events, the method comprising:

performing the following in a computing device in communication with a host device:

receiving a recorded video of a display of the host device and a reference video;

comparing the recorded video with the reference video to identify dropped and/or duplicate frames, wherein the recorded video and the reference video are synchronized based on content rather than time;

receiving data indicating activity of a storage device of the host device, wherein the activity of the storage device comprises one or more of the following: an input/output operation, processor utilization, memory usage, a kernel event, and an operating system event; and

generating an analysis of a correlation between dropped and/or duplicate frames and the data indicating activity of the storage device to indicate what activity of the storage device occurred when a dropped and/or duplicate frame occurred.

2. The method of claim 1 , wherein the input/output operation comprises one or more of the following: a read operation, a write operation, an erase operation, a move operation, a trim operation, and a discard operation.

3. The method of claim 1 , wherein the video of the display of the host device is recorded using a camera.

4. The method of claim 1 , wherein the video of the display of the host device is recorded using an application in the host device.

5. The method of claim 1 , wherein the analysis comprises at least one of a report and a graph.

6. The method of claim 1 , wherein the recorded video is synchronized with the reference video based on content rather than time by separating the two videos into frames, numbering each frame, and then rebuilding the numbered frames into new videos.

7. The method of claim 1 , further comprising filtering the recorded video to account for one or more of the following: video compression and quality degradation.

8. The method of claim 1 , wherein the storage device comprises a three-dimensional memory.

9. A system comprising:

a storage device configured to:

store a recorded video of a display of a host device;

store a reference video; and

store data indicating activity of a storage device of the host device, wherein the activity of the storage device comprises one or more of the following: an input/output operation, processor utilization, memory usage, a kernel event, and an operating system event; and

a visualizer module configured to:

compare the recorded video and the reference video to identify dropped and/or duplicate frames; and

generate an analysis of a correlation between dropped and/or duplicate frames and the data indicating activity of the storage device to indicate what activity of the storage device occurred when a dropped and/or duplicate frame occurred, wherein the recorded video and the reference video are synchronized based on content rather than time.

10. The system of claim 9 , wherein the input/output operation comprises one or more of the following: a read operation, a write operation, an erase operation, a move operation, a trim operation, and a discard operation.

11. The system of claim 9 , wherein the video of the display of the host device is recorded using a camera.

12. The system of claim 9 , wherein the video of the display of the host device is recorded using an application on the host device.

13. The system of claim 9 , wherein the analysis comprises at least one of a report and a graph.

14. The system of claim 9 , wherein the recorded video is synchronized with the reference video based on content rather than time by separating the recorded video and the reference video into frames, numbering each frame, and then rebuilding the numbered frames into new videos.

15. The system of claim 9 , further comprising an image processing module configured to filter at least one of the recorded video and the reference video to account for one or more of the following: video compression and quality degradation.

16. The system of claim 9 , wherein the storage device comprises a three-dimensional memory.

17. A system comprising:

means for receiving a recorded video of a display of a host device and a reference video;

means for comparing the recorded video with the reference video to identify dropped and/or duplicate frames, wherein the recorded video and the reference video are synchronized based on content rather than time;

means for receiving data indicating activity of a storage device of the host device, wherein the activity of the storage device comprises one or more of the following: an input/output operation, processor utilization, memory usage, a kernel event, and an operating system event; and

means for generating an analysis of a correlation between dropped and/or duplicate frames and the data indicating activity of the storage device to indicate what activity of the storage device occurred when a dropped and/or duplicate frame occurred.

18. The system of claim 17 , wherein the storage device comprises a three-dimensional memory.

19. The system of claim 17 , wherein the input/output operation comprises one or more of the following: a read operation, a write operation, an erase operation, a move operation, a trim operation, and a discard operation.

Assignments (10)
PARTIAL RELEASE OF SECURITY INTERESTS Recorded Apr 25, 2025
From: JPMORGAN CHASE BANK, N.A., AS AGENT
To: SANDISK TECHNOLOGIES, INC.
Reel/Frame 071382/0001 →
SECURITY AGREEMENT Recorded Apr 25, 2025
From: SANDISK TECHNOLOGIES, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 071050/0001 →
PATENT COLLATERAL AGREEMENT Recorded Aug 23, 2024
From: SANDISK TECHNOLOGIES, INC.
To: JPMORGAN CHASE BANK, N.A., AS THE AGENT
Reel/Frame 068762/0494 →
CHANGE OF NAME Recorded Jun 27, 2024
From: SANDISK TECHNOLOGIES, INC.
To: SANDISK TECHNOLOGIES, INC.
Reel/Frame 067982/0032 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 29, 2024
From: WESTERN DIGITAL TECHNOLOGIES, INC.
To: SANDISK TECHNOLOGIES, INC.
Reel/Frame 067567/0682 →
PATENT COLLATERAL AGREEMENT - DDTL LOAN AGREEMENT Recorded Aug 21, 2023
From: WESTERN DIGITAL TECHNOLOGIES, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 067045/0156 →
PATENT COLLATERAL AGREEMENT - A&R LOAN AGREEMENT Recorded Aug 21, 2023
From: WESTERN DIGITAL TECHNOLOGIES, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 064715/0001 →
RELEASE OF SECURITY INTEREST AT REEL 052915 FRAME 0566 Recorded Feb 8, 2022
From: JPMORGAN CHASE BANK, N.A.
To: WESTERN DIGITAL TECHNOLOGIES, INC.
Reel/Frame 059127/0001 →
SECURITY INTEREST Recorded Feb 6, 2020
From: WESTERN DIGITAL TECHNOLOGIES, INC.
To: JPMORGAN CHASE BANK, N.A., AS AGENT
Reel/Frame 052915/0566 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 22, 2017
From: SHARONI, LIRAN; SHILO, IDO; SAPIR, MIKI; MARCU, ALON
To: WESTERN DIGITAL TECHNOLOGIES, INC.
Reel/Frame 042787/0692 →