IP Library Granted Patent US 11,323,657
Granted Patent B2
US 11,323,657 · App. 17/001,084 · Granted May 3, 2022

Initiation of two-way AR sessions using physical markers

Inventors: Ryan R. Fink (Vancouver, WA); Sean M. Adkinson (North Plains, OR)
Assignee: STREEM, INC.
H04N7/147G01S19/01G06K9/46G06K19/06028G06K19/06037G06K19/0723H04L67/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,323,657
App. No.
17/001,084
Granted
May 3, 2022
Kind
B2
Abstract

Methods and systems for the remote delivery of professional services, using augmented reality (AR), are disclosed. In embodiments, a user scans or acquires a physical marker, such as an optical code or radio beacon. The physical marker provides information to the user's device to allow it to connect to a server. The physical marker may also provide contextual data, possibly in conjunction with contextual data from the user's device. The server then provides a list of professionals on the basis of the contextual data. The user selects a professional, and the server initiates a video session between a user device and a professional device, where the professional can superimpose one or more AR objects on the video, to be displayed on the user device.

Claims (35)

1. A method comprising:

extracting, by a computing device, from a read-only physical marker, information to connect with a remote server;

capturing, by the computing device, one or more pictures or video of the physical marker's context;

connecting, by the computing device using the extracted information, to the remote server;

transmitting, by the computing device, the one or more pictures or video to the remote server;

receiving, from the remote server, a list of one or more persons to communicate with a user of the computing device, each of the one or more persons relevant to at least one aspect of the physical marker and the one or more pictures or video; and

initiating, by the computing device, a two-way communications session between the remote server and the computing device, the two-way communications session with a person selected from the list of one or more persons.

2. The method of claim 1 , wherein the physical marker is a visual marker, and the information is extracted using one or more optical sensors coupled to the computing device.

3. The method of claim 2 , wherein the physical marker is a QR code, a bar code, text, or an object.

4. The method of claim 1 , wherein the information is extracted from the physical marker using radio frequency emissions.

5. The method of claim 4 , wherein the physical marker is an RFID tag, an NFC tag, or a Bluetooth device.

6. The method of claim 1 , wherein the information to connect with the remote server comprises executable code, and the method further comprises executing, by the computing device, the executable code.

7. The method of claim 1 , further comprising:

determining, by the computing device, a physical location of the computing device; and

transmitting, by the computing device, the physical location to the remote server; and

wherein each person on the list of one or more persons is relevant to the physical location.

8. The method of claim 7 , wherein the computing device determines the physical location at least in part using satellite location information.

9. The method of claim 7 , further comprising:

determining, by the computing device, with the physical location, whether the computing device has crossed a geofence; and

transmitting, by the computing device to the remote server, whether the computing device has crossed the geofence; and

wherein each person on the list of one or more persons is relevant to whether the computing device has crossed the geofence.

10. The method of claim 1 , further comprising transmitting at least part of the extracted information to the remote server.

11. A non-transitory computer-readable medium (CRM) comprising instructions that, when executed by an apparatus, cause the apparatus to:

extract, from a read-only physical marker, information to connect to a remote server;

capture one or more pictures or video of the physical marker's context;

determine a physical location of the apparatus;

connect, using the information extracted from the read-only physical marker, to the remote server;

transmit the physical location and the one or more pictures or video to the remote server;

receive, from the remote server, a list of one or more persons to communicate with a user of the apparatus, each of the one or more persons relevant to the physical location of the apparatus and the one or more pictures or video; and

initiate a two-way communications session between the remote server and the apparatus.

12. The CRM of claim 11 , wherein the instructions are further to cause the apparatus to determine the physical location using satellite location.

13. The CRM of claim 11 , wherein the instructions are further to cause the apparatus to determine whether the physical location is within a geofence.

14. The CRM of claim 13 , wherein the geofence defines a physical area, and the list of one or more persons are relevant to the physical area.

15. The CRM of claim 14 , wherein the physical area is a building or a portion of a building.

16. The CRM of claim 11 , wherein the communications session allows insertion of one or more augmented reality objects received from the remote server that are displayed on the first device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 13, 2020
From: FINK, RYAN R.; ADKINSON, SEAN M
To: STREEM, INC.
Reel/Frame 054358/0604 →
Continuity (3)
Continuation In Part 16195595 · Nov 19, 2018
Provisional Application 62588612 · Nov 20, 2017
Related Publication 20200396418A1 · Dec 17, 2020