IP Library › Granted Patent US 12,299,831
Granted Patent B2
US 12,299,831 · App. 18/419,264 · Granted May 13, 2025

Collaborative augmented reality

Inventors: Sean Blanchflower (Cambridge, GB); Timothy Halbert (Cambridge, GB)
Assignee: CrowdStrike, Inc.
G06T19/006A63F13/50A63F13/65A63F13/655G06F3/1438G06F3/1462G06T15/20G06V10/751G06V20/80A63F2300/1093A63F2300/5533A63F2300/69G06T2219/024G06V10/40G06V20/46
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,299,831
App. No.
18/419,264
Granted
May 13, 2025
Kind
B2
Abstract

Augmented reality presentations are provided at respective electronic devices. A first electronic device receives information relating to modification made to an augmented reality presentation at a second electronic device, and the first electronic device modifies the first augmented reality presentation in response to the information.

Claims (50)

1. A method, comprising:

capturing, by an electronic device through a camera, at least one of an image or a video of a physical object;

obtaining, by the electronic device, augmented reality triggering information;

determining, by the electronic device, whether to start an augmented reality presentation based on comparing the image or the video of the physical object and with the augmented reality triggering information;

responsive to a determination to start the augmented reality presentation, preparing, by the electronic device, a visual output of the physical object or a portion thereof, the preparing comprising:

retrieving additional information corresponding to the physical object from a database; and

augmenting the visual output with the additional information corresponding to the physical object; and

starting, by the electronic device, the augmented reality presentation comprising the visual output of at least one of the physical object or the portion thereof augmented with the additional information corresponding to the physical object.

2. The method according to claim 1 , wherein the additional information corresponding to the physical object comprises audio data, video data, image data, text data, or a combination thereof.

3. The method according to claim 1 , wherein the physical object comprises at least one of a printed game character or a print advertisement associated with an electronic game and wherein starting the augmented reality presentation comprises starting the electronic game on the electronic device.

4. The method according to claim 1 , wherein the physical object comprises a landmark, wherein the additional information comprises image data, video data, audio data, text data, or a combination thereof that describe the landmark, and wherein starting the augmented reality presentation comprises starting a virtual tour of the landmark.

5. The method according to claim 1 , wherein determining whether to start the augmented reality presentation comprises:

extracting features of the physical object from the image or the video of the physical object; and

matching the features of the physical object extracted from the image or the video of the physical object with features of candidate trigger items contained in the augmented reality triggering information, wherein the determination to start the augmented reality presentation is based on whether a match to a candidate trigger item is found.

6. The method according to claim 1 , wherein the augmented reality triggering information is obtained from a server computer, from a data storage local to the electronic device, or from both the server computer and the data storage local to the electronic device.

7. The method according to claim 1 , wherein the additional information corresponding to the physical object is retrieved from the database that is local to the electronic device or that is located at a remote system.

8. An apparatus, comprising:

one or more processors;

a camera;

a non-transitory computer-readable medium storing instructions that, when executed by the one or more processors, cause the one or more processors to:

capture, through the camera, at least one of an image or a video of a physical object;

obtain augmented reality triggering information;

determine whether to start an augmented reality presentation based on comparing the image or the video of the physical object with the augmented reality triggering information;

responsive to a determination to start the augmented reality presentation, prepare a visual output of the physical object or a portion thereof, the one or more processors further to:

retrieve additional information corresponding to the physical object from a database; and

augment the visual output with the additional information corresponding to the physical object; and

start the augmented reality presentation comprising the visual output of at least one of the physical object or the portion thereof augmented with the additional information corresponding to the physical object.

9. The apparatus of claim 8 , wherein the additional information corresponding to the physical object comprises audio data, video data, image data, text data, or a combination thereof.

10. The apparatus of claim 8 , wherein the physical object comprises at least one of a printed game character or a print advertisement associated with an electronic game and wherein starting the augmented reality presentation comprises starting the electronic game on the apparatus.

11. The apparatus of claim 8 , wherein the physical object comprises a landmark, wherein the additional information comprises image data, video data, audio data, text data, or a combination thereof that describe the landmark, and wherein starting the augmented reality presentation comprises starting a virtual tour of the landmark.

12. The apparatus of claim 8 , wherein determining whether to start the augmented reality presentation comprises:

extracting features of the physical object from the image or the video of the physical object; and

matching the features of the physical object extracted from the image or the video of the physical object with features of candidate trigger items contained in the augmented reality triggering information, wherein the determination to start the augmented reality presentation is based on whether a match to a candidate trigger item is found.

13. The apparatus of claim 8 , wherein the augmented reality triggering information is obtained from a server computer, from a data storage local to the apparatus, or from both the server computer and the data storage local to the apparatus.

14. The apparatus of claim 8 , wherein the additional information corresponding to the physical object is retrieved from the database that is local to the apparatus or that is located at a remote system.

15. A computer program product comprising a non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to:

capture, through a camera, at least one of an image or a video of a physical object;

obtain augmented reality triggering information;

determine whether to start an augmented reality presentation based on comparing the image or the video of the physical object with the augmented reality triggering information;

responsive to a determination to start the augmented reality presentation, prepare a visual output of the physical object or a portion thereof, the one or more processors further to:

retrieve additional information corresponding to the physical object from a database; and

augment the visual output with the additional information corresponding to the physical object; and

start the augmented reality presentation comprising the visual output of at least one of the physical object or the portion thereof augmented with the additional information corresponding to the physical object.

16. The computer program product of claim 15 , wherein the additional information corresponding to the physical object comprises audio data, video data, image data, text data, or a combination thereof.

17. The computer program product of claim 15 , wherein the physical object comprises at least one of a printed game character or a print advertisement associated with an electronic game and wherein starting the augmented reality presentation comprises starting the electronic game on the electronic device.

18. The computer program product of claim 15 , wherein the physical object comprises a landmark, wherein the additional information comprises image data, video data, audio data, text data, or a combination thereof that describe the landmark, and wherein starting the augmented reality presentation comprises starting a virtual tour of the landmark.

19. The computer program product of claim 15 , wherein determining whether to start the augmented reality presentation comprises:

extracting features of the physical object from the image or the video of the physical object; and

matching the features of the physical object extracted from the image or the video of the physical object with features of candidate trigger items contained in the augmented reality triggering information, wherein the determination to start the augmented reality presentation is based on whether a match to a candidate trigger item is found.

20. The computer program product of claim 15 , wherein the augmented reality triggering information is obtained from a server computer, from a data storage local to the electronic device, or from both the server computer and the data storage local to the electronic device, and wherein the additional information corresponding to the physical object is retrieved from the database that is local to the electronic device or that is located at a remote system.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 31, 2024
From: OPEN TEXT CORP.
To: CROWDSTRIKE, INC.
Reel/Frame 068131/0348 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 29, 2024
From: LONGSAND LIMITED
To: AURASMA LIMITED
Reel/Frame 066283/0044 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 29, 2024
From: AURASMA LIMITED
To: OPEN TEXT CORPORATION
Reel/Frame 066283/0055 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 29, 2024
From: BLANCHFLOWER, SEAN; HALBERT, TIMOTHY
To: LONGSAND LIMITED
Reel/Frame 066378/0515 →
Continuity (7)
Continuation 17971848 · Oct 24, 2022
Continuation 17355159 · Jun 22, 2021
Continuation 16732673 · Jan 2, 2020
Continuation 16056074 · Aug 6, 2018
Continuation 15430143 · Feb 10, 2017
Continuation 14437165
Related Publication 20240161426A1 · May 16, 2024
References Cited (65)
US 6349337B1 · Parsons et al. · 2002 [cited by applicant]
US 7283671B2 · Hiroi et al. · 2007 [cited by applicant]
US 8493353B2 · Blanchflower · 2013 [cited by examiner]
US 8601379B2 · Marks et al. · 2013 [cited by applicant]
US 8738754B2 · Windell · 2014 [cited by examiner]
US 8902254B1 · Laughlin et al. · 2014 [cited by applicant]
US 9066200B1 · Loxam · 2015 [cited by examiner]
US 9105011B2 · Calman · 2015 [cited by examiner]
US 9361729B2 · Narayanan · 2016 [cited by applicant]
US 9384395B2 · Ryu · 2016 [cited by examiner]
US 9384588B2 · Liu · 2016 [cited by examiner]
US 9484588B2 · Kim et al. · 2016 [cited by applicant]
US 9607438B2 · Blanchflower et al. · 2017 [cited by applicant]
US 10068381B2 · Blanchflower et al. · 2018 [cited by applicant]
US 10535200B2 · Blanchflower et al. · 2020 [cited by applicant]
US 11074758B2 · Blanchflower et al. · 2021 [cited by applicant]
US 20080074424A1 · Carignano · 2008 [cited by examiner]
US 20110293140A1 · Wagner et al. · 2011 [cited by applicant]
US 20110310120A1 · Narayanan · 2011 [cited by applicant]
US 20120001832A1 · Braghis et al. · 2012 [cited by applicant]
US 20120025974A1 · Richey et al. · 2012 [cited by applicant]
US 20120038668A1 · Kim · 2012 [cited by examiner]
US 20120078667A1 · Denker et al. · 2012 [cited by applicant]
US 20120105447A1 · Kim · 2012 [cited by examiner]
US 20120162207A1 · Hwang et al. · 2012 [cited by applicant]
US 20120162254A1 · Anderson · 2012 [cited by examiner]
US 20120194548A1 · Ahn · 2012 [cited by applicant]
US 20120232966A1 · Calman · 2012 [cited by examiner]
US 20120242842A1 · Yoshigahara · 2012 [cited by examiner]
US 20120263154A1 · Blanchflower et al. · 2012 [cited by applicant]
US 20130050258A1 · Liu · 2013 [cited by examiner]
US 20130135180A1 · Mcculloch et al. · 2013 [cited by applicant]
US 20130135295A1 · Li et al. · 2013 [cited by applicant]
US 20130155106A1 · Rolleston · 2013 [cited by examiner]
US 20130182858A1 · You · 2013 [cited by examiner]
US 20130234933A1 · Reitan · 2013 [cited by examiner]
US 20130249948A1 · Reitan · 2013 [cited by examiner]
US 20130335303A1 · Maciocci · 2013 [cited by examiner]
US 20140002444A1 · Bennett et al. · 2014 [cited by applicant]
US 20140028712A1 · Keating · 2014 [cited by examiner]
US 20140225924A1 · Loxam · 2014 [cited by examiner]
US 20150070347A1 · Hofmann · 2015 [cited by examiner]
US 20150109339A1 · Jin · 2015 [cited by examiner]
US 20150178567A1 · Baek et al. · 2015 [cited by applicant]
US 20150279106A1 · Blanchflower et al. · 2015 [cited by applicant]
US 20170154242A1 · Blanchflower et al. · 2017 [cited by applicant]
US 20180350144A1 · Rathod · 2018 [cited by applicant]
US 20180357830A1 · Blanchflower et al. · 2018 [cited by applicant]
US 20200134928A1 · Blanchflower et al. · 2020 [cited by applicant]
EP 2400464A2 · 2011 [cited by applicant]
International Search report and Written Opinion issued for PCT Application No. PCT/EP2012/070893, mailed Sep. 2, 2013, 8 pages. [cited by applicant]
International Preliminary Report on Patentability issued for PCT Application No. PCT/EP2012/070893, mailed May 7, 2015, 6 pages. [cited by applicant]
Zhong et al., “Designing a Vision-Based Collaborative Augmented Reality Application For Industrial Training [Entwurf einer kollaborativen Augmented-Reality-Anwendung für industrielles Training (Designing a Vision-based … [cited by applicant]
Montoya et al., “Remote Collaboration With Augmented And Virtual Reality Interfaces,” 2007 International Conference On Computer Graphics & Virtual Reality, CSREA Press, Las Vegas. NV, Jan. 1, 2007, pp. 81-86, XP00816232… [cited by applicant]
Ajaj et al., “User Collaboration for 3D Manipulation through Multiple Shared 2D and 3D Views,” (Research Paper), In Proceedings, Virtual Reality International Conference, Apr. 18-20, 2007, pp. 245-253. [cited by applicant]
Office Action issued for U.S. Appl. No. 14/437,165, mailed Jun. 24, 2016, 11 pages. [cited by applicant]
Office Action issued for Chinese Patent Application No. 201280077916.6, mailed Jan. 3, 2017, 18 pages. [cited by applicant]
Office Action issued for U.S. Appl. No. 15/430,143, mailed Sep. 19, 2017, 14 pages. [cited by applicant]
Office Action issued for U.S. Appl. No. 15/430,143, mailed Mar. 13, 2018, 10 pages. [cited by applicant]
Notice of Allowance issued for U.S. Appl. No. 15/430,143, mailed May 2, 2018, 7 pages. [cited by applicant]
Examination Report issued for European Patent Application No. 12 791 112.1, mailed Sep. 10, 2018, 8 pages. [cited by applicant]
Oshima et al., “AR2Hockey: A Case Study of Collaborative Augmented Reality”, IEEE 1998, XP010268738, pp. 268-275. [cited by applicant]
Notice of Allowance issued for U.S. Appl. No. 16/056,074, mailed Sep. 6, 2019, 16 pages. [cited by applicant]
Office Action issued for U.S. Appl. No. 16/732,673, mailed Oct. 7, 2020, 9 pages. [cited by applicant]
Notice of Allowance issued for U.S. Appl. No. 16/732,673, mailed Mar. 8, 2021, 11 pages. [cited by applicant]