Systems and methods for shared mixed reality experiences using digital, physical, temporal or spatial discovery services
View Patent ↗Systems and methods allow for devices, such as sensory systems and mixed reality content consuming systems installed within a vehicle, to discover each other, share multidimensional realities, inherit context for mixed reality content, and/or coordinate whilst providing a mixed reality user experience. A discovery service can receive information from multiple devices and correlate digital and physical characteristics thereof to enable devices to discover each other. Characteristics of a device that may be used for pairing may include its orientation physically, the observable reality of a device, the state-machine of the device, the intentions of the device whilst operating autonomously or with external assistance, the location of a device, the temporal/spatial information describing the device's movement over time in a multi-dimensional reality or any unique identifiers contained within or generated by the device.
1. A method for a network-connected server to facilitate sharing of mixed reality services amongst a plurality of vehicles, each vehicle containing one or more mixed reality service offering devices and/or one or more mixed reality service seeking devices communicating via a common digital communications network, the method comprising:
receiving via the digital communications network, from each of one or more service offering devices, one or more announcements comprising identification of services provided by the service offering device and a location associated with the service offering device;
receiving via the digital communications network, from a service seeking device, a request for services;
publishing, to the service seeking device, identification of one or more service offering devices and services provided thereby, wherein the service seeking device may pair with, and receive mixed reality services from, one or more of the service offering devices;
maintaining a queue of tasks to be completed by service offering devices; and
for each task in the queue of tasks: (a) identifying one or more qualified service offering devices satisfying task-specific criteria; and (b) dispatching the task to the qualified service offering devices via the digital communications network;
collecting, by the server, responses to a task from a plurality of qualified service offering devices; and
aggregating the responses to develop a shared model responsive to the task.
2. The method of claim 1 , in which the task comprises observing a roadway lane centerline; and the shared model comprises a model of the roadway lane centerline formed based on a plurality of task responses received by the server.
3. The A method for a network-connected server to facilitate sharing of mixed reality services amongst a plurality of vehicles, each vehicle containing one or more mixed reality service offering devices and/or one or more mixed reality service seeking devices communicating via a common digital communications network, the method comprising:
receiving via the digital communications network, from each of one or more service offering devices, one or more announcements comprising identification of services provided by the service offering device and a location associated with the service offering device;
receiving via the digital communications network, from a service seeking device, a request for services; and
publishing, to the service seeking device, identification of one or more service offering devices and services provided thereby, wherein the service seeking device may pair with, and receive mixed reality services from, one or more of the service offering devices;
pairing the service seeking device and a service offering device for direct communications there between;
sharing mixed reality content from a first one of said service offering devices, to the service seeking device; and
applying a spatial transform to the shared mixed reality content prior to use of the shared mixed reality content by the service seeking device, in which the step of applying a spatial transform to the shared mixed reality content comprises compensating for changes in translation and/or rotation between the service offering device and the service seeking device.
4. The method of claim 3 , further comprising applying a temporal transform to the shared mixed reality content prior to use of the shared mixed reality content by the service seeking device, in order to map the shared mixed reality content and the locally-sourced mixed reality content into a common temporal space.
5. A method for a network-connected server to facilitate sharing of mixed reality services amongst a plurality of vehicles, each vehicle containing one or more mixed reality service offering devices and/or one or more mixed reality service seeking devices communicating via a common digital communications network, the method comprising:
receiving via the digital communications network, from each of one or more service offering devices, one or more announcements comprising identification of services provided by the service offering device and a location associated with the service offering device;
receiving via the digital communications network, from a service seeking device, a request for services;
publishing, to the service seeking device, identification of one or more service offering devices and services provided thereby, wherein the service seeking device may pair with, and receive mixed reality services from, one or more of the service offering devices;
transmitting mixed reality content from one or more of said service offering devices, to a mixed reality aggregation server; and
generating, by the mixed reality aggregation server, aggregate mixed reality content derived from the mixed reality content received from the one or more of said service offering devices, in which the step of generating aggregate mixed reality content comprises: weighting, by the mixed reality aggregation server, mixed reality content contributions from each service offering device based at least in part on a level of trust associated with the service offering device, in which the level of trust associated with the service offering device is based at least in part upon a sensor capability level associated with the service offering device.
6. A method for a network-connected server to facilitate sharing of mixed reality services amongst a plurality of vehicles, each vehicle containing one or more mixed reality service offering devices and/or one or more mixed reality service seeking devices communicating via a common digital communications network, the method comprising:
receiving via the digital communications network, from each of one or more service offering devices, one or more announcements comprising identification of services provided by the service offering device and a location associated with the service offering device;
receiving via the digital communications network, from a service seeking device, a request for services; and
publishing, to the service seeking device, identification of one or more service offering devices and services provided thereby, wherein the service seeking device may pair with, and receive mixed reality services from, one or more of the service offering devices;
transmitting mixed reality content from one or more of said service offering devices, to a mixed reality aggregation server;
generating, by the mixed reality aggregation server, aggregate mixed reality content derived from the mixed reality content received from the one or more of said service offering devices;
determining, by the mixed reality aggregation server, that an aggregate confidence level in a prior observation falls below a threshold value;
identifying a select service offering device having sensory systems capable of replicating the prior observation;
transmitting, from the server to the select service offering device, a request to replicate the prior observation;
receiving, from the select service offering device, a measurement of the prior observation; and
updating the prior observation based at least in part on the measurement from select service offering device.