IP Library › Granted Patent US 12,394,164
Granted Patent B2
US 12,394,164 · App. 18/762,589 · Granted Aug 19, 2025

Interaction analysis systems and methods

Inventor: Patrick Soon-Shiong (Los Angeles, CA)
Assignee: Nant Holdings IP, LLC
G06T19/006G06F3/002G06F3/0481G06T7/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,394,164
App. No.
18/762,589
Granted
Aug 19, 2025
Kind
B2
Abstract

Interaction-based ecosystems are presented. Interaction analysis engine analyze media content to derive a set of media features. The engine can then identify one or more interaction objects (e.g., transactions, searches, game play, etc.) based on the set of media features. Relevant interaction objects can then be instantiated as persistent available or active points of interaction readily accessed by a consumer. The consumer need only capture a digital representation of the content via a user device, a smart phone for example. A second set of media features can be derived from the digital representation and the second set of media features can then be used to find the instantiated interactions.

Claims (43)

1. A computer-based interaction object management system comprising:

an interaction object database storing interaction objects where each interaction object comprises at least one interaction template and where each interaction object is indexed by at least one relevancy requirement, including an object location;

at least one non-transitory computer readable memory storing software instructions; and

at least one processor coupled with the interaction object database and with the at least one memory, and that performs the following operations upon execution of the software instructions:

capturing a digital representation, including a current device location, via at least one computing device associated with a user;

generating a set of requirements from the digital representation, including at least one location requirement that depends on the current device location;

obtaining at least one interaction template of an interaction object from the interaction object database where the at least one interaction template of the interaction object comprises at least one relevancy requirement, including a location of the interaction object, wherein the at least one interaction template satisfies the set of requirements, including the at least one location requirement;

instantiating the interaction object from the at least one interaction template as a purchase-based interaction object by populating at least one transaction property of the at least one interaction template with at least one value, the at least one value comprising one or more virtual objects associated with a persistent interaction instance;

enabling the at least one computing device to conduct a transaction according to the purchase-based interaction object and the at least one transaction property having the at least one value; and

authorizing the at least one computing device to complete the transaction as a purchase by binding the persistent interaction instance to the user when the transaction is initiated by the user of the at least one computing device when the device location associated with the at least one computing device satisfies the at least one relevancy requirement comprising the location of the instantiated purchase-based interaction object and the persistent interaction instance is accessible to the user at a subsequent time, at locations other than the current device location, based on past interactions of the user.

2. The system of claim 1 , wherein the at least one transaction property comprises at least one price as the at least one value.

3. The system of claim 1 , wherein the at least one transaction property comprises an inventory listing as the at least one value.

4. The system of claim 1 , wherein the at least one transaction property comprises an account as the at least one value.

5. The system of claim 1 , wherein the instantiated purchase-based interaction object comprises an instance identifier.

6. The system of claim 5 , wherein the instance identifier comprises at least one of the following identifiers: a hash, a Universally Unique Identifier (UUID), and a Globally Unique Identifier (GUID).

7. The system of claim 1 , wherein the instantiated purchase-based interaction object is accessible by multiple devices, including the at least one computing device.

8. The system of claim 1 , wherein the set of requirements further comprises at least one time requirement.

9. The system of claim 8 , wherein the at least one time requirement depends on a specified time, relative time, or an absolute time.

10. The system of claim 1 , wherein the instantiated purchase-based interaction object comprises a transient point of interaction based on the set of requirements.

11. The system of claim 10 , wherein the transient point of interaction is limited based on time or the device location.

12. The system of claim 1 , wherein the at least one relevancy requirement of the interaction objects in the interaction object database adheres to a namespace.

13. The system of claim 12 , wherein the namespace comprises a multi-dimensional namespace.

14. The system of claim 1 , wherein the instantiated purchase-based interaction object maps to a real-world object.

15. The system of claim 14 , wherein the real-world object includes at least one of the following: a poster, a billboard, a media screen, and a kiosk.

16. The system of claim 1 , wherein the instantiated purchase-based interaction object comprises a virtual reality object.

17. The system of claim 1 , wherein the instantiated purchase-based interaction object comprises an augmented content object.

18. The system of claim 1 , wherein the at least one computing device comprises a smart phone.

19. The system of claim 1 , wherein the set of requirements comprises multi-modal requirements.

20. The system of claim 1 , wherein the instantiated purchase-based interaction object comprises an instance of a game object.

21. A method of managing interaction objects comprising:

capturing a digital representation, including a current device location, via at least one computing device associated with a user;

generating a set of requirements from the digital representation, including at least one location requirement that depends on the current device location;

obtaining at least one interaction template of an interaction object from an interaction object database comprising a plurality of interaction objects, wherein each interaction object is indexed by at least one relevancy requirement, including an object location, the at least one interaction template of the interaction object comprising at least one relevancy requirement, including a location of the interaction object, wherein the at least one interaction template satisfies the set of requirements, including the at least one location requirement;

instantiating the interaction object from the at least one interaction template as a purchase-based interaction object by populating at least one transaction property of the at least one interaction template with at least one value, the at least one value comprising one or more virtual objects associated with a persistent interaction instance;

enabling the at least one computing device to conduct a transaction according to the purchase-based interaction object and the at least one transaction property having the at least one value; and

authorizing the at least one computing device to complete the transaction as a purchase by binding the persistent interaction instance to the user when the transaction is initiated by the user of the at least one computing device when the device location associated with the at least one computing device satisfies the at least one relevancy requirement comprising the location of the instantiated purchase-based interaction object and the persistent interaction instance is accessible to the user at a subsequent time, at locations other than the current device location, based on past interactions of the user.

22. A non-transitory computer readable medium configured for storing one or more computer readable instructions, which upon execution by at least one processor, perform the following operations:

capturing a digital representation, including a current device location, via at least one computing device associated with a user;

generating a set of requirements from the digital representation, including at least one location requirement that depends on the current device location;

obtaining at least one interaction template of an interaction object from the interaction object database where the at least one interaction template of the interaction object comprises at least one relevancy requirement, including a location of the interaction object, wherein the at least one interaction template satisfies the set of requirements, including the at least one location requirement;

instantiating the interaction object from the at least one interaction template as a purchase-based interaction object by populating at least one transaction property of the at least one interaction template with at least one value, the at least one value comprising one or more virtual objects associated with a persistent interaction instance;

enabling the at least one computing device to conduct a transaction according to the purchase-based interaction object and the at least one transaction property having the at least one value; and

authorizing the at least one computing device to complete the transaction as a purchase by binding the persistent interaction instance to the user when the transaction is initiated by the user of the at least one computing device when the device location associated with the at least one computing device satisfies the at least one relevancy requirement comprising the location of the instantiated purchase-based interaction object and the persistent interaction instance is accessible to the user at a subsequent time, at locations other than the current device location, based on past interactions of the user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2024
From: SOON-SHIONG, PATRICK
To: NANT HOLDINGS IP, LLC
Reel/Frame 068295/0090 →
Continuity (7)
Division 18217942 · Jul 3, 2023
Continuation 18079799 · Dec 12, 2022
Continuation 16914242 · Jun 26, 2020
Continuation 16119857 · Aug 31, 2018
Continuation 15648411 · Jul 12, 2017
Continuation 13709618 · Dec 10, 2012
Related Publication 20240355074A1 · Oct 24, 2024
References Cited (93)
US 6711293B1 · Lowe · 2004 [cited by applicant]
US 7016532B2 · Boncyk et al. · 2006 [cited by applicant]
US 7685023B1 · Abraham · 2010 [cited by examiner]
US 7775437B2 · Cohen · 2010 [cited by applicant]
US 7899252B2 · Boncyk et al. · 2011 [cited by applicant]
US 7953219B2 · Freedman et al. · 2011 [cited by applicant]
US 8224077B2 · Boncyk et al. · 2012 [cited by applicant]
US 8224078B2 · Boncyk et al. · 2012 [cited by applicant]
US 8683386B2 · Shuster · 2014 [cited by applicant]
US 8687021B2 · Bathiche et al. · 2014 [cited by applicant]
US 8810598B2 · Soon-Shiong · 2014 [cited by applicant]
US 9384594B2 · Maciocci et al. · 2016 [cited by applicant]
US 9728008B2 · Soon-Shiong · 2017 [cited by applicant]
US 10068384B2 · Soon-Shiong · 2018 [cited by applicant]
US 10699487B2 · Soon-Shiong · 2020 [cited by applicant]
US 11551424B2 · Soon-Shiong · 2023 [cited by applicant]
US 11741681B2 · Soon-Shiong · 2023 [cited by applicant]
US 20040002937A1 · Jones et al. · 2004 [cited by applicant]
US 20040205715A1 · Taylor · 2004 [cited by applicant]
US 20050175970A1 · Dunlap et al. · 2005 [cited by applicant]
US 20060041891A1 · Aaron · 2006 [cited by applicant]
US 20060047704A1 · Gopalakrishnan · 2006 [cited by applicant]
US 20060059033A1 · Wagner et al. · 2006 [cited by applicant]
US 20060190812A1 · Ellenby et al. · 2006 [cited by applicant]
US 20070191111A1 · Sylla et al. · 2007 [cited by applicant]
US 20070226751A1 · Brendle et al. · 2007 [cited by applicant]
US 20080070689A1 · Van et al. · 2008 [cited by applicant]
US 20080070690A1 · Van et al. · 2008 [cited by applicant]
US 20080081701A1 · Shuster · 2008 [cited by applicant]
US 20080177793A1 · Epstein et al. · 2008 [cited by applicant]
US 20080200253A1 · Van et al. · 2008 [cited by applicant]
US 20080207327A1 · Van et al. · 2008 [cited by applicant]
US 20080214262A1 · Phillips et al. · 2008 [cited by applicant]
US 20090013052A1 · Robarts et al. · 2009 [cited by applicant]
US 20090017886A1 · Mcgucken · 2009 [cited by applicant]
US 20090238460A1 · Funayama et al. · 2009 [cited by applicant]
US 20090291755A1 · Walker et al. · 2009 [cited by applicant]
US 20090304267A1 · Tapley · 2009 [cited by examiner]
US 20100017722A1 · Cohen · 2010 [cited by examiner]
US 20100023878A1 · Douris et al. · 2010 [cited by applicant]
US 20100030578A1 · Siddique et al. · 2010 [cited by applicant]
US 20100034468A1 · Boncyk · 2010 [cited by examiner]
US 20100063892A1 · Keronen et al. · 2010 [cited by applicant]
US 20100070276A1 · Wasserblat et al. · 2010 [cited by applicant]
US 20100177194A1 · Huang et al. · 2010 [cited by applicant]
US 20100177969A1 · Huang et al. · 2010 [cited by applicant]
US 20100275267A1 · Walker et al. · 2010 [cited by applicant]
US 20110047251A1 · Seo · 2011 [cited by applicant]
US 20110053688A1 · Crawford et al. · 2011 [cited by applicant]
US 20110078602A1 · Gammon et al. · 2011 [cited by applicant]
US 20110206198A1 · Freedman et al. · 2011 [cited by applicant]
US 20110214082A1 · Osterhout et al. · 2011 [cited by applicant]
US 20110244798A1 · Daigle et al. · 2011 [cited by applicant]
US 20110279445A1 · Murphy et al. · 2011 [cited by applicant]
US 20110307257A1 · Pereg et al. · 2011 [cited by applicant]
US 20110319148A1 · Kinnebrew et al. · 2011 [cited by applicant]
US 20120032977A1 · Kim et al. · 2012 [cited by applicant]
US 20120078882A1 · Boldyrev et al. · 2012 [cited by applicant]
US 20120097151A1 · Matsuno et al. · 2012 [cited by applicant]
US 20120122570A1 · Baronoff · 2012 [cited by applicant]
US 20120142428A1 · Wilson et al. · 2012 [cited by applicant]
US 20120162255A1 · Ganapathy et al. · 2012 [cited by applicant]
US 20120208592A1 · Davis et al. · 2012 [cited by applicant]
US 20120233032A1 · Calman et al. · 2012 [cited by applicant]
US 20120244939A1 · Braun · 2012 [cited by applicant]
US 20120246581A1 · Engestrom et al. · 2012 [cited by applicant]
US 20120256954A1 · Soon-Shiong · 2012 [cited by applicant]
US 20120287122A1 · Nadar et al. · 2012 [cited by applicant]
US 20120299961A1 · Ramkumar et al. · 2012 [cited by applicant]
US 20120327117A1 · Weller · 2012 [cited by examiner]
US 20130176202A1 · Gervautz · 2013 [cited by applicant]
US 20130178257A1 · Langseth · 2013 [cited by applicant]
US 20130215116A1 · Siddique et al. · 2013 [cited by applicant]
US 20130222381A1 · Di et al. · 2013 [cited by applicant]
US 20130342564A1 · Kinnebrew et al. · 2013 [cited by applicant]
US 20130342571A1 · Kinnebrew et al. · 2013 [cited by applicant]
US 20140002496A1 · Lamb et al. · 2014 [cited by applicant]
US 20140063054A1 · Osterhout et al. · 2014 [cited by applicant]
US 20140063055A1 · Osterhout et al. · 2014 [cited by applicant]
US 20140081777A1 · Mastrodonato et al. · 2014 [cited by applicant]
US 20140108979A1 · Davidson et al. · 2014 [cited by applicant]
US 20140129393A1 · Soon-Shiong · 2014 [cited by examiner]
US 20200327739A1 · Soon-Shiong · 2020 [cited by applicant]
US 20230351709A1 · Soon-Shiong · 2023 [cited by applicant]
KR 1020120019153A · 2012 [cited by applicant]
Designboom, “Tesco Virtual Supermarket in a Subway Station,” DesignBoom online newsletter, downloaded at http://www.designboom.com/weblog/cat/16/view/15557/tesco-virtual-supermarket-in-a-subway-station.html on Sep. 5, 2… [cited by applicant]
Gionis et al., “Similarity Search in High Dimensions Via Hashing,” Proceedings of the 25th VLDB Conference, Sep. 7-10, 1999, pp. 518-529. [cited by applicant]
Google, Inc., “The New Multi-Screen World: Understanding Cross-Platform Consumer Behavior,” https://www.thinkwithgoogle.com/_qs/documents/861/au-new-multi-screen-world.pdf, Aug. 2012, 42 pages. [cited by applicant]
International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2013/074199, mailed on Jun. 25, 2015, 5 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2013/074199 dated Apr. 1, 2014, 8 pages. [cited by applicant]
Leutenegger et al., “BRISK: Binary Robust Invariant Scalable Keypoints,” 2011 IEEE International Conference on Computer Vision (ICCV), Nov. 6-13, 2011, 8 pages. [cited by applicant]
Lowe, “Object Recognition from Local Scale-Invariant Features”, Proc. of the International Conference on Computer Vision, Corfu, Sep. 1999, 8 pages. [cited by applicant]
Rouse, “What is Instantiation,” http://whatis.techtarget.com/definition/instantiation, Techtarget.com, 2016, 8 pages. [cited by applicant]