IP Library Granted Patent US 10,581,938
Granted Patent B2
US 10,581,938 · App. 15/838,786 · Granted Mar 3, 2020

Systems and methods for multi-modal synchronization and interaction

Inventors: Sridhar Leekkala (Bentonville, AR); Nanda Kishore Reddy (Bengaluru, IN)
Assignee: WALMART APOLLO, LLC
H04L65/403G06F16/00G06F16/9535H04L51/043H04L67/26G06F3/01H04L29/06047H04L67/10H04W4/50H04W4/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,581,938
App. No.
15/838,786
Granted
Mar 3, 2020
Kind
B2
Abstract

Embodiments relate to multi-modal synchronization and interaction systems and methods. In a system that includes a plurality of display devices, web applications (“apps”) can synchronize filters and therefore views on the devices. Embodiments of the systems and methods thereby provide synchronization not just of a display but also of user interaction with the display.

Claims (33)

1. A multi-modal interaction system comprising:

a plurality of display devices, each display device comprising a web application and a screen on which information accessed via the web application is displayed, wherein the information displayed on the screen is customized by a plurality of user selectable filters that affect at least one of a source or type of data displayed as the information;

a web application server communicatively coupled with the web application of each of the plurality of display devices; and

a content broadcasting server communicatively coupled with the web application of each of the plurality of display devices, wherein the content broadcasting server is configured to

receive a subscription request from at least one of the plurality of display devices for another one of the plurality of display devices,

receive information related to ones of the plurality of user selectable filters selected on the another one of the plurality of display devices, and

broadcast the received information for application to the information on the at least one of the plurality of display devices,

wherein both the ones of the plurality of user selectable filters selected on the another one of the plurality of display devices and the received information applied to the information on the at least one of the plurality of display devices are independently customizable by the plurality of user selectable filters.

2. The system of claim 1 , wherein each of the plurality of display devices is selected from the group consisting of: a TV, a computer, a laptop, a tablet, a smart phone, a mobile phone, and a smart watch.

3. The system of claim 1 , wherein the web application server comprises an Apache Tomcat server.

4. The system of claim 1 , wherein the content broadcasting server comprises a JavaScript server.

5. The system of claim 4 , wherein the JavaScript server comprises a Node.js server.

6. The system of claim 1 , wherein at least one of the plurality of user selectable filters relates to retail market information.

7. The system of claim 1 , wherein at least one of the plurality of user selectable filters relates to merchandizing information.

8. The system of claim 1 , wherein the web application on each of the plurality of display devices is an independent instance of the web application installed on one of the plurality of display devices.

9. The system of claim 1 , wherein the content broadcasting server is configured to broadcast changes to the received information in real time.

10. A method of providing multi-modal interaction in a system comprising a plurality of display devices, the method comprising:

receiving, by a content broadcasting server, a subscription request from at least one of a plurality of display devices for another one of the plurality of display devices;

receiving, by the content broadcasting server, information related to ones of the plurality of user selectable filters selected on the another one of the plurality of display devices, wherein the plurality of user selectable filters relate to at least one of a source or type of data displayed; and

broadcasting the received information for application to information on the at least one of the plurality of display devices, wherein both the ones of the plurality of user selectable filters selected on the another one of the plurality of display devices and the received information applied to the information on the at least one of the plurality of display devices are independently customizable by the plurality of user selectable filters.

11. The method of claim 10 , further comprising installing an independent instance of a web application on each of the plurality of display devices, wherein displaying information on the screen of each of the plurality of display devices and facilitating use of the plurality of user selectable filters are implemented by the web application on each of the plurality of display devices.

12. The method of claim 11 , further comprising facilitating communication with the web application of each of the plurality of display devices by a web application server.

13. The method of claim 10 , wherein each of the plurality of display devices is selected from the group consisting of: a TV, a computer, a laptop, a tablet, a smart phone, a mobile phone, and a smart watch.

14. The method of claim 10 , wherein the web application server comprises an Apache Tomcat server.

15. The method of claim 10 , wherein the content broadcasting server comprises a Node.js JavaScript server.

16. The method of claim 10 , wherein at least one of the plurality of user selectable filters relates to retail market information.

17. The method of claim 10 , wherein at least one of the plurality of user selectable filters relates to merchandizing information.

18. The method of claim 10 , further comprising:

receiving, by the content broadcasting server, updated information from the another one of the plurality of display devices; and

broadcasting the received updated information for application to the information on the at least one of the plurality of display devices.

19. The method of claim 10 , further comprising:

receiving, by the content broadcasting server, different information from a different one of the plurality of display devices; and

broadcasting the received different information for application on ones of the plurality of display devices that are subscribed to the different one of the plurality of display devices.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 21, 2019
From: WM GLOBAL TECHNOLOGY SERVICES INDIA PVT LTD
To: WAL-MART STORES, INC.
Reel/Frame 048391/0880 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 30, 2018
From: WAL-MART STORES, INC.
To: WALMART APOLLO, LLC
Reel/Frame 045949/0126 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 26, 2018
From: REDDY, NANDA KISHORE
To: WM GLOBAL TECHNOLOGY SERVICES INDIA PVT LTD
Reel/Frame 044741/0621 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 26, 2018
From: LEEKKALA, SRIDHAR
To: WAL-MART STORES, INC.
Reel/Frame 044741/0860 →
Continuity (2)
Provisional Application 62432995 · Dec 12, 2016
Related Publication 20180167425A1 · Jun 14, 2018