IP Library › Granted Patent US 12,373,783
Granted Patent B2
US 12,373,783 · App. 18/540,715 · Granted Jul 29, 2025

Virtual planogram management systems and methods

Inventor: Patrick Soon-Shiong (Los Angeles, CA)
Assignee: Nant Holdings IP, LLC
G06Q10/087G06F3/0484G06Q30/06G06Q30/0633G06Q30/0643G06T19/006G06V20/00G06V20/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,373,783
App. No.
18/540,715
Granted
Jul 29, 2025
Kind
B2
Abstract

Systems and methods of constructing and managing virtual planograms are presented. Contemplated systems allow for construction of a virtual planogram, which can be used to present consumers virtual inventory items as being available for purchase via a display device. The display device can include an electronic billboard within an establishment, a mall for example, or include a user's smart device, a cell phone or tablet for example.

Claims (38)

1. A computer-based virtual marketplace system, comprising:

at least one sensor;

at least one display;

at least one computer readable non-transitory memory storing software instructions; and

at least one processor coupled with the at least one sensor, the at least one display, and the at least one computer readable non-transitory memory, and performs, upon execution of the software instructions, the operations of:

obtaining, from the at least one sensor, a digital representation of a physical environment, including a geo-location associated with the physical environment;

instantiating a virtual planogram based on features from the digital representation, including at least the geo-location;

generating a virtual store space from the virtual planogram and having at least one virtual product display fixture rendered relative to the features from the digital representation, wherein the at least one virtual product display fixture includes virtual inventory items from at least one vendor and wherein the virtual inventory items are rendered according to the virtual planogram; and

causing a device to present on the at least one display the virtual store space by superimposing at least a portion of the virtual store space on at least part of an image from the digital representation relative to the features from the digital representation.

2. The system of claim 1 , wherein the virtual store space is superimposed on a real-world scene rendered on the at least one display.

3. The system of claim 1 , wherein the virtual store space is rendered based on at least a position or orientation relative to a display field-of-view.

4. The system of claim 1 , wherein the virtual store space comprises an augmented reality space rendered at least in part according to the virtual planogram.

5. The system of claim 4 , wherein the virtual planogram is selected based at least in part on the geo-location.

6. The system of claim 1 , wherein the virtual planogram is selected based on a geo-location protocol using the geo-location.

7. The system of claim 6 , wherein the virtual planogram is selected from a virtual planogram database storing the virtual planogram.

8. The system of claim 7 , further comprising the virtual planogram database.

9. The system of claim 8 , wherein the operations further include initiating a transaction related to at least one of the virtual inventory items.

10. The system of claim 1 , wherein the virtual planogram includes rules governing a rendered arrangement of the virtual inventory items in the at least one virtual product display fixture based on at least one of the following factors: a relative position, an absolute position, a location, a user preference, a vendor preference, an establishment attribute, a virtual element, a time, or an event.

11. The system of claim 1 , wherein the virtual inventory items change according to at least one of the following: a user preference, a proximity to other users, the geo-location, a time, or a news event.

12. The system of claim 1 , wherein the geo-location is based on a GPS location.

13. The system of claim 1 , wherein the geo-location comprises at least one of the following: a zip code, a store, a bus station, an airport, a subway station, a mall, a publication location, or a home.

14. The system of claim 1 , wherein the virtual inventory items include at least one of the following: a video game weapon, a video game tool, a digital song, a digital album, or a digital video.

15. The system of claim 1 , wherein the virtual inventory items include at least one virtual product.

16. The system of claim 1 , wherein the virtual inventory items include a representation of at least one physical item.

17. The system of claim 16 , wherein the at least one physical item includes at least one of the following: a toy, an item of clothing, an item of food, or a service.

18. The system of claim 16 , wherein the operations further include initiating delivery of the at least one physical item to a user.

19. The system of claim 1 , wherein the virtual planogram comprises a dynamic planogram capable of changing.

20. The system of claim 19 , wherein the dynamic planogram includes rules to change based on at least one of the following: a time, a trigger, an event, a deletion of a virtual inventor item, a move of a virtual inventory items, or a replacement of a virtual inventory item.

21. A method comprising:

obtaining, from at least one sensor, a digital representation of a physical environment, including a geo-location associated with the physical environment;

instantiating a virtual planogram based on features from the digital representation, including at least the geo-location;

generating a virtual store space from the virtual planogram and having at least one virtual product display fixture rendered relative to the features from the digital representation, wherein the at least one virtual product display fixture includes virtual inventory items from at least one vendor and wherein the virtual inventory items are rendered according to the virtual planogram; and

causing a device to present on at least one display the virtual store space by superimposing at least a portion of the virtual store space on at least part of an image from the digital representation relative to the features from the digital representation.

22. A non-transitory computer-readable medium including instructions thereon, which, when executed by at least one processor, cause the at least one processor to perform one or more operations comprising:

obtaining, from at least one sensor, a digital representation of a physical environment, including a geo-location associated with the physical environment;

instantiating a virtual planogram based on features from the digital representation, including at least the geo-location;

generating a virtual store space from the virtual planogram and having at least one virtual product display fixture rendered relative to the features from the digital representation, wherein the at least one virtual product display fixture includes virtual inventory items from at least one vendor and wherein the virtual inventory items are rendered according to the virtual planogram; and

causing a device to present on at least one display the virtual store space by superimposing at least a portion of the virtual store space on at least part of an image from the digital representation relative to the features from the digital representation.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 13, 2024
From: SOON-SHIONG, PATRICK
To: NANT HOLDINGS IP. LLC
Reel/Frame 066751/0819 →
Continuity (9)
Continuation 17955308 · Sep 28, 2022
Continuation 16994355 · Aug 14, 2020
Continuation 16226494 · Dec 19, 2018
Continuation 15918976 · Mar 12, 2018
Division 15213154 · Jul 18, 2016
Continuation 14528852 · Oct 30, 2014
Division 13667988 · Nov 2, 2012
Division 13667965 · Nov 2, 2012
Related Publication 20240112137A1 · Apr 4, 2024
References Cited (89)
US 6026376A · Kenney · 2000 [cited by examiner]
US 7016532B2 · Boncyk et al. · 2006 [cited by applicant]
US 7266511B2 · Teshima · 2007 [cited by applicant]
US 7657457B2 · Razumov · 2010 [cited by applicant]
US 7685023B1 · Abraham et al. · 2010 [cited by applicant]
US 7707073B2 · Bloebaum et al. · 2010 [cited by applicant]
US 7734495B2 · Klaubauf et al. · 2010 [cited by applicant]
US 7881529B2 · Boncyk et al. · 2011 [cited by applicant]
US 7899243B2 · Boncyk et al. · 2011 [cited by applicant]
US 7899252B2 · Boncyk et al. · 2011 [cited by applicant]
US 8049621B1 · Egan · 2011 [cited by applicant]
US 8229800B2 · Trotman et al. · 2012 [cited by applicant]
US 8606642B2 · Siounis et al. · 2013 [cited by applicant]
US 9336508B2 · Soon-Shiong · 2016 [cited by applicant]
US 9430752B2 · Soon-Shiong · 2016 [cited by applicant]
US 9536218B2 · Soon-Shiong · 2017 [cited by applicant]
US 9953288B2 · Soon-Shiong · 2018 [cited by applicant]
US 9984408B1 · Wong et al. · 2018 [cited by applicant]
US 10198712B2 · Soon-Shiong · 2019 [cited by applicant]
US 10762470B2 · Soon-Shiong · 2020 [cited by applicant]
US 11488104B2 · Soon-Shiong · 2022 [cited by applicant]
US 11887054B2 · Soon-Shiong · 2024 [cited by applicant]
US 20030154141A1 · Capazario et al. · 2003 [cited by applicant]
US 20050177463A1 · Crutchfield et al. · 2005 [cited by applicant]
US 20070050235A1 · Ouimet · 2007 [cited by applicant]
US 20080162262A1 · Perkins · 2008 [cited by applicant]
US 20080208715A1 · Hod et al. · 2008 [cited by applicant]
US 20090059270A1 · Opalach et al. · 2009 [cited by applicant]
US 20090149199A1 · Maghoul · 2009 [cited by applicant]
US 20090281903A1 · Blatstein · 2009 [cited by applicant]
US 20100070365A1 · Siotia et al. · 2010 [cited by applicant]
US 20100114726A1 · Lee et al. · 2010 [cited by applicant]
US 20100205043A1 · Edwards · 2010 [cited by applicant]
US 20110015966A1 · Wasco · 2011 [cited by applicant]
US 20110125614A1 · Dollens · 2011 [cited by applicant]
US 20110313878A1 · Norman · 2011 [cited by applicant]
US 20120022913A1 · Volkmann et al. · 2012 [cited by applicant]
US 20120095853A1 · von Bose et al. · 2012 [cited by applicant]
US 20120195460A1 · Lawrence Ashok Inigo · 2012 [cited by examiner]
US 20120233015A1 · Calman et al. · 2012 [cited by applicant]
US 20120249588A1 · Tison · 2012 [cited by examiner]
US 20120310727A1 · Bradley et al. · 2012 [cited by applicant]
US 20130030915A1 · Statler et al. · 2013 [cited by applicant]
US 20130041706A1 · Joshi et al. · 2013 [cited by applicant]
US 20130097050A1 · Soracco · 2013 [cited by examiner]
US 20130317950A1 · Abraham et al. · 2013 [cited by applicant]
US 20140003729A1 · Auclair et al. · 2014 [cited by applicant]
US 20140085333A1 · Pugazhendhi et al. · 2014 [cited by applicant]
US 20140201040A1 · Birch · 2014 [cited by applicant]
GB 2444743A · 2008 [cited by applicant]
JP 2001265957A · 2001 [cited by applicant]
JP 2004234600A · 2004 [cited by applicant]
JP 2005031961A · 2005 [cited by applicant]
JP 2005099956A · 2005 [cited by applicant]
JP 2009277224A · 2009 [cited by applicant]
JP 2011253324A · 2011 [cited by applicant]
KR 1020010079194A · 2001 [cited by applicant]
KR 1020010093985A · 2001 [cited by applicant]
KR 1020020007584A · 2002 [cited by applicant]
KR 1020040011056A · 2004 [cited by applicant]
KR 1020110136029A · 2011 [cited by applicant]
KR 1020120104713A · 2012 [cited by applicant]
WO 0122308A2 · 2001 [cited by applicant]
WO 0137540A2 · 2001 [cited by applicant]
WO 0227582A1 · 2002 [cited by applicant]
WO 2009027839A2 · 2009 [cited by applicant]
WO 2010110977A2 · 2010 [cited by applicant]
WO 2012075589A1 · 2012 [cited by applicant]
International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2013/068160, mailed on Feb. 11, 2015, 28 pages. [cited by applicant]
Lo, “Shop Multiple Retailers in One Place Online With Suddenlee—A Service That Sends People to Stores to Shop for You”, Racked.com, Jun. 27, 2011, 2 pages. [cited by applicant]
Duffy, “Slotting Fees”, OLR Research Report, http://www.cga.ct.gov/2007/rpt/2007-R-0667.htm, Nov. 20, 2007, 3 pages. [cited by applicant]
Zhu et al., “Design of the PromoPad: an Automated Augmented Reality Shopping Assistant”, 12th Americas Conference on Information Systems, Aug. 4-6, 2006, Acapulco, Mexico, 16 pages. [cited by applicant]
International Search Report and Written Opinion issued in International Application No. PCT/US2013/068160 dated Feb. 26, 2014, 17 pages. [cited by applicant]
Van Camp, “South Korean Supermarket chain Opens Virtual Grocery Stores In Subways”, Digital Trends, http://www.digitaltrends.com/cool-tech/south-korean-supermarket-chain-opens-virtual-grocery-stores-in-subways/, Jul. 7,… [cited by applicant]
Riedl, “Poshmark Opens the Door to Real-Time Curation With Showrooms”, PRNewswire, Aug. 8, 2012, 2 pages. [cited by applicant]
Karlsson et al., “The vSLAM Algorithm for Robust Localization and Mapping”, Proc. of Int. Conf. on Robotics and Automation (ICRA), 2005, 6 pages. [cited by applicant]
Swartz, “Shopping will never be the same Digital fitting rooms, 3-D printers and businesses mining your data? Yes, the future of retail is upon us”, USA Today, Aug. 9, 2012, 3 pages. [cited by applicant]
Malcolm, “Touch-Screens Create Online Shopping Experiences at Stores”, USA Today/ Money, Feb. 8, 2012, 6 pages. [cited by applicant]
Strother, “Shopping by Phone at South Korea's Virtual Grocery”, BBC News, PRI's The World, Oct. 21, 2011, 11 pages. [cited by applicant]
Owen et al., “What is the best fiducial?”, Michigan State University, Media and Entertainment Technologies Lab Media Interface and Network Design Lab, Sep. 9, 2002, 8 pages. [cited by applicant]
Extended European Search Report issued in European Patent Application No. 13852221.4 dated Mar. 1, 2016, 7 pages. [cited by applicant]
Office Action issued in Korean Patent Application No. 10-2015-7014550 dated Jan. 4, 2017, 17 pages. [cited by applicant]
“Planogram,” Wikipedia, https://en.wikipedia.org/w/index.php?title=Planogram&oldid=S19349857, Oct. 23, 2012, 4 pages. [cited by applicant]
Office Action issued in European Patent Application No. 13 852 221.4 dated Jul. 12, 2017, 8 pages. [cited by applicant]
Office Action issued in Japanese Application No. 2015-541827 mailed Oct. 24, 2017, 12 pages. [cited by applicant]
Office Action issued in Japanese Application No. 2015-541827 mailed Apr. 10, 2018, 5 pages. [cited by applicant]
Office Action issued in Korean Patent Application No. 10-2017-7024558 dated Nov. 1, 2018, 19 pages. [cited by applicant]
Office Action issued in Japanese Patent Application No. 2018-166635 mailed Dec. 18, 2019, 10 pages. [cited by applicant]
Notice of Reasons for Rejection, Japanese Patent Application No. 2018-166635, mailed Jun. 16, 2020, 7 pages. [cited by applicant]