IP Library › Granted Patent US 12,307,197
Granted Patent B2
US 12,307,197 · App. 18/607,340 · Granted May 20, 2025

Systems and methods for generating social assets from electronic publications

Inventors: Alette Holmberg-Nielsen (Palo Alto, CA); John Sturino (Palo Alto, CA); Joe Hyrkin (Palo Alto, CA); Slavko Krucaj (Palo Alto, CA); Slawomir Smiechura (Palo Alto, CA); Erik Juhl (Palo Alto, CA); Erika Fogarty (Palo Alto, CA)
Assignee: ISSUU, INC.
G06F40/186G06F16/345G06F40/103G06F40/114G06T11/60G06V30/413G06V30/416G06V30/414
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,307,197
App. No.
18/607,340
Granted
May 20, 2025
Kind
B2
Abstract

Systems and techniques are provided for generating a social asset from an electronic publication. The system includes providing a template having a set of reserve spaces for elements. The system receives an electronic publication containing elements including images and text passages. The system assigns images from the publication to each of the reserve spaces for images including assigning a first image from the publication to a first reserve space of the reserve spaces for an image. The system chooses a first text passage of the text passages for associating with the first image. The system selects a portion of less than all of the first text passage. The system generates a social asset by processing the set of reserve spaces to automatically move forward in an animated manner wherein the selected portion of the first text passage superimposes a portion of the first image.

Claims (53)

1. A method of selecting portions from an electronic publication including images and a plurality of text passages for generating a social asset, the method including:

assigning images from the electronic publication to each of a set of reserve spaces for images in a page having a defined number of reserve spaces for images, including assigning a first image from the electronic publication to a first reserve space of the reserve spaces for an image;

choosing a first text passage of the plurality of text passages for associating with the first image by inferring association in the electronic publication between the first text passage of the plurality of text passages and the first image, including:

calculating distances of each of the plurality of text passages in the electronic publication to the first image;

filtering out and removing the text passages in captions of images;

selecting, as the first text passage, from among remaining text passages not filtered out, a selected text passage with a shortest distance to the first image and inferring the association between the selected text passage and the first image; and

selecting a portion of the first text passage which is less than all of the first text passage, to provide to a process for generating a social asset.

2. The method of claim 1 , wherein the selected portion of the first text passage, and not portions of the first text passage other than the selected portion of the first text passage, superimposes a portion of the first image.

3. The method of claim 1 , wherein the set of reserve spaces further includes at least one reserve space for text, the reserve space for text being associated in a template with a second reserve space of the reserve spaces for an image;

assigning a second image from the electronic publication to the second reserve space for an image;

choosing a second text passage of the text passages for associating with the second image;

selecting a portion of the second text passage which is less than all of the second text passage to fit within the second reserve space for text; and

assigning the portion of the second text passage to the second reserve space for text; and

wherein the social asset, when moving forward in an animated manner, maintains the second reserve space for text in visible association with the second reserve space for an image.

4. The method of claim 1 , wherein the page is from a template that comprises of a plurality of pages.

5. The method of claim 1 , wherein generating the social asset by processing the set of reserve spaces to automatically move forward in an animated manner further includes moving forward the social asset, page by page.

6. The method of claim 1 , wherein assigning images from the electronic publication to each of the reserve spaces for images further includes assigning images from the electronic publication to reserve spaces in a first pass by inferred reading order.

7. The method of claim 6 , wherein assigning images from the electronic publication to each of the reserve spaces for images further includes enabling a user to modify the assignment of images from the electronic publication to reserve spaces in a second pass following the first pass.

8. The method of claim 1 , wherein inferring association in the electronic publication between the first text passage of the text passages and the first image further includes:

using an image classification service to determine keywords representing the first image; and

selecting as the first text passage a text passage in dependence upon the determined keywords.

9. The method of claim 1 , wherein selecting a portion of the first text passage which is less than all of the first text passage further includes selecting a subset of fewer than all sentences of the first text passage.

10. The method of claim 1 , wherein selecting a portion of the first text passage which is less than all of the first text passage further includes enabling a user to select a subset of fewer than all sentences of the first text passage.

11. A system including one or more processors coupled to a memory, the memory loaded with computer instructions to select portions from an electronic publication including images and a plurality of text passages in order to generate a social asset, which instructions, when executed on the processors, implement actions comprising:

assigning images from the electronic publication to each of a set of reserve spaces for images in a page having a defined number of reserve spaces for images, including assigning a first image from the electronic publication to a first reserve space of the reserve spaces for an image;

choosing a first text passage of the plurality of text passages for associating with the first image by inferring association in the electronic publication between the first text passage of the plurality of text passages and the first image, including:

calculating distances of each of the plurality of text passages in the electronic publication to the first image;

filtering out and removing the text passages in captions of images;

selecting, as the first text passage, from among remaining text passages not filtered out, a selected text passage with a shortest distance to the first image and inferring the association between the selected text passage and the first image; and

selecting a portion of the first text passage which is less than all of the first text passage, to provide to a process for generating a social asset.

12. The system of claim 11 , wherein the selected portion of the first text passage, and not portions of the first text passage other than the selected portion of the first text passage, superimposes a portion of the first image.

13. The system of claim 11 , wherein the set of reserve spaces further includes at least one reserve space for text, the reserve space for text being associated in a template with a second reserve space of the reserve spaces for an image, further implementing actions comprising:

assigning a second image from the electronic publication to the second reserve space for an image;

choosing a second text passage of the text passages for associating with the second image;

selecting a portion of the second text passage which is less than all of the second text passage to fit within the second reserve space for text; and

assigning the portion of the second text passage to the second reserve space for text;

wherein the social asset, when moving forward in an animated manner, maintains the second reserve space for text in visible association with the second reserve space for an image.

14. The system of claim 11 , wherein the page is from a template that comprises of a plurality of pages.

15. The system of claim 11 , wherein generating the social asset by processing the set of reserve spaces to automatically move forward in an animated manner further includes moving forward the social asset, page by page.

16. The system of claim 11 , wherein assigning images from the electronic publication to each of the reserve spaces for images further implements actions comprising, assigning images from the electronic publication to reserve spaces in a first pass by inferred reading order.

17. The system of claim 16 , wherein assigning images from the electronic publication to each of the reserve spaces for images further implements actions comprising, enabling a user to modify the assignment of images from the electronic publication to reserve spaces in a second pass following the first pass.

18. The system of claim 11 , wherein inferring association in the electronic publication between the first text passage of the text passages and the first image further implements actions comprising:

using an image classification service to determine keywords representing the first image; and

selecting as the first text passage a text passage in dependence upon the determined keywords.

19. The system of claim 11 , wherein selecting a portion of the first text passage which is less than all of the first text passage further includes selecting a subset of fewer than all sentences of the first text passage.

20. The system of claim 11 , wherein selecting a portion of the first text passage which is less than all of the first text passage further includes enabling a user to select a subset of fewer than all sentences of the first text passage.

21. A non-transitory computer readable storage medium impressed with computer program instructions to select portions from an electronic publication including images and a plurality of text passages in order to generate a social asset, which instructions, when executed on a processor, implement a method comprising:

assigning images from the electronic publication to each of a set of reserve spaces for images in a page having a defined number of reserve spaces for images, including assigning a first image from the electronic publication to a first reserve space of the reserve spaces for an image;

choosing a first text passage of the plurality of text passages for associating with the first image by inferring association in the electronic publication between the first text passage of the plurality of text passages and the first image, including:

calculating distances of each of the plurality of text passages in the electronic publication to the first image;

filtering out and removing the text passages in captions of images;

selecting, as the first text passage, from among remaining text passages not filtered out, a selected text passage with a shortest distance to the first image and inferring the association between the selected text passage and the first image; and

selecting a portion of the first text passage which is less than all of the first text passage, to provide to a process for generating a social asset.

Assignments (3)
MERGER Recorded Apr 24, 2026
From: ISSUU, INC.
To: BENDING SPOONS US INC.
Reel/Frame 074469/0246 →
PATENT SECURITY AGREEMENT Recorded Dec 30, 2024
From: ISSUU, INC.
To: INTESA SANPAOLO S.P.A., AS SECURITY AGENT
Reel/Frame 069813/0611 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 13, 2024
From: HOLMBERG-NIELSEN, ALETTE; STURINO, JOHN; HYRKIN, JOE; KRUCAJ, SLAVKO; SMIECHURA, SLAWOMIR; JUHL, ERIK; FOGARTY, ERIKA
To: ISSUU, INC.
Reel/Frame 067720/0867 →
Continuity (4)
Continuation 17586426 · Jan 27, 2022
Continuation 16572525 · Sep 16, 2019
Provisional Application 62775300 · Dec 4, 2018
Related Publication 20240303428A1 · Sep 12, 2024
References Cited (89)
US 5892843A · Zhou et al. · 1999 [cited by applicant]
US 6169998B1 · Iwasaki et al. · 2001 [cited by applicant]
US 6219679B1 · Brisebois et al. · 2001 [cited by applicant]
US 6976210B1 · Silva et al. · 2005 [cited by applicant]
US 7130861B2 · Bookman et al. · 2006 [cited by applicant]
US 7519573B2 · Helfman et al. · 2009 [cited by applicant]
US 7912705B2 · Wasson et al. · 2011 [cited by applicant]
US 7962846B2 · Lerner et al. · 2011 [cited by applicant]
US 8255820B2 · Rivlin et al. · 2012 [cited by applicant]
US 8332424B2 · Flynn et al. · 2012 [cited by applicant]
US 8558808B2 · Forstall et al. · 2013 [cited by applicant]
US 8582801B2 · Goto et al. · 2013 [cited by applicant]
US 8799273B1 · Chang et al. · 2014 [cited by applicant]
US 20050021754A1 · Alda et al. · 2005 [cited by applicant]
US 20050055632A1 · Schwartz et al. · 2005 [cited by applicant]
US 20070044013A1 · Hyatt · 2007 [cited by applicant]
US 20070217701A1 · Liu et al. · 2007 [cited by applicant]
US 20080077847A1 · Dejean · 2008 [cited by applicant]
US 20080162356A1 · Parket et al. · 2008 [cited by applicant]
US 20080201452A1 · Athas et al. · 2008 [cited by applicant]
US 20080294981A1 · Balzano et al. · 2008 [cited by applicant]
US 20080307297A1 · Ohlenbusch et al. · 2008 [cited by applicant]
US 20090172517A1 · Kalicharan · 2009 [cited by applicant]
US 20090187535A1 · Warnock et al. · 2009 [cited by applicant]
US 20100005387A1 · Toki · 2010 [cited by applicant]
US 20110099071A1 · Johnson · 2011 [cited by applicant]
US 20110117971A1 · Kim et al. · 2011 [cited by applicant]
US 20110125512A1 · Huang · 2011 [cited by applicant]
US 20110184960A1 · Delpha et al. · 2011 [cited by applicant]
US 20120005567A1 · Burckart et al. · 2012 [cited by applicant]
US 20120030553A1 · Delpha et al. · 2012 [cited by applicant]
US 20120137200A1 · Shar et al. · 2012 [cited by applicant]
US 20120144292A1 · Lee · 2012 [cited by applicant]
US 20120151383A1 · Kazan et al. · 2012 [cited by applicant]
US 20120311509A1 · Maggiotto et al. · 2012 [cited by applicant]
US 20130014007A1 · Kopp et al. · 2013 [cited by applicant]
US 20130042200A1 · Armitage · 2013 [cited by applicant]
US 20130054613A1 · Bishop · 2013 [cited by applicant]
US 20130247221A1 · Mctor · 2013 [cited by applicant]
US 20130259377A1 · Goktekin · 2013 [cited by applicant]
US 20140006982A1 · Wabyick et al. · 2014 [cited by applicant]
US 20140250371A1 · Wabyick et al. · 2014 [cited by applicant]
US 20140250372A1 · Slembrouck · 2014 [cited by applicant]
US 20140282069A1 · Canetti et al. · 2014 [cited by applicant]
US 20150007104A1 · Zhu · 2015 [cited by applicant]
US 20150220490A1 · Barber · 2015 [cited by applicant]
US 20150254213A1 · McGushion et al. · 2015 [cited by applicant]
US 20160147713A1 · Ni et al. · 2016 [cited by applicant]
US 20160357717A1 · Metz et al. · 2016 [cited by applicant]
US 20170147544A1 · Modani et al. · 2017 [cited by applicant]
US 20180129634A1 · Sivaji et al. · 2018 [cited by applicant]
US 20180196804A1 · Mani et al. · 2018 [cited by applicant]
US 20180276296A1 · Gerlach · 2018 [cited by applicant]
DE 102012216165A1 · 2013 [cited by applicant]
WO 2010078475A2 · 2010 [cited by applicant]
U.S. Appl. No. 16/572,525—Office Action dated Jan. 25, 2021, 14 pages. [cited by applicant]
Rodriguez et al., “The convergence of digital libraries and the peer-review process.” Journal of Information Science 32.2 (2006), 12 pages. [cited by applicant]
Phelps et al., “Multivalent documents: Inducing structure and behaviors in online digital documents.” In System Sciences, 1996., Proceedings of the Twenty-Ninth Hawaii International Conference on,, vol. 5, pp. 144-152. … [cited by applicant]
Jäschke et al., “Organizing Publications and Bookmarks in BibSonomy.” In CKC. 2007, 4 pages. [cited by applicant]
Dudchuk et al., “Ontos clip and share,” Proceedings of the 6th International Conference on Semantic Systems. ACM, 2010, 2 pages. [cited by applicant]
U.S. Appl. No. 14/657,831—Office Action dated Jan. 26, 2017, 60 pages. [cited by applicant]
U.S. Appl. No. 14/657,831—Final Office Action dated Jun. 30, 2017, 57 pages. [cited by applicant]
Google, definition of the word “specify”, retrieved on Jan. 24, 2018, available at <https://www.google.com/search?q=define%3A+specifying&rlz=1C1GGRV_enUS768US768&oq=define%3A+specifying&aqs=chrome . . . 69i57j69i58.7733… [cited by applicant]
U.S. Appl. No. 14/657,831—Final Office Action dated Feb. 8, 2018, 59 pages. [cited by applicant]
Walsh, “Facebook Open Graph META Tags,” https://web.archive.org/web/20110429065857/https:/davidwalsh.name/facebook-meta-tags, accesed May 4, 2018, 2 pages. [cited by applicant]
U.S. Appl. No. 15/415,693—Office Action dated Aug. 16, 2018, 18 pages. [cited by applicant]
PCT/US2017/040264—International Search Report and Written Opinion dated Mar. 29, 2018, 8 pages. [cited by applicant]
U.S. Appl. No. 15/415,693—Final Office Action dated Mar. 14, 2019, 16 pages. [cited by applicant]
U.S. Appl. No. 15/415,693—Reply to Final Office Action dated Mar. 14, 2019 filed Jun. 10, 2019, 16 pages. [cited by applicant]
PCT/US2017/040264—International Prelimianry Report on Patentabilty dated Jan. 9, 2020, 7 pages. [cited by applicant]
U.S. Appl. No. 15/415,693—Office Action dated Mar. 12, 2020, 20 pages. [cited by applicant]
Adobe.com, Adobe Acrobat 5.0, Reflow the contents of Adobe PDF, Mar. 2012, 2 pages (retreived from hhttps://web.archive.org/web/20120312080826/http://www.adobe.com/uk/epaper/tips/acr5reflow/pdfs/acr5reflow.pdf). [cited by applicant]
Adobe.com, Liquid layouts and Alternate layouts, CC, CS6, Mar. 16, 2017, 11pagtes (retreived from https://helpx.adobe.com/indesign/using/alternate-layouts-liquid-layouts.html). [cited by applicant]
U.S. Appl. No. 15/415,693—Response to Office Action dated Mar. 12, 2020, filed Jun. 18, 2020, 34 pages. [cited by applicant]
U.S. Appl. No. 15/415,693—Office Action dated May 14, 2021, 21 pages. [cited by applicant]
U.S. Appl. No. 15/415,693—Response to Final Office Action dated Aug. 11, 2020 filed Feb. 11, 2021, 20 pages. [cited by applicant]
U.S. Appl. No. 15/415,693—Final Office Action dated Aug. 11, 2020, 22 pages. [cited by applicant]
U.S. Appl. No. 15/415,693—Response to Office Action dated Aug. 16, 2018 filed Dec. 14, 2018, 21 pages. [cited by applicant]
U.S. Appl. No. 14/657,831—Notice of Allowance dated May 23, 2018, 28 pages. [cited by applicant]
U.S. Appl. No. 14/657,831—Response to Final Office Action dated Feb. 8, 2018 filed Apr. 12, 2018, 15 pages. [cited by applicant]
U.S. Appl. No. 14/657,831—Response to Final Office Action dated Jun. 30, 2017 filed Dec. 21, 2017, 21 pages. [cited by applicant]
U.S. Appl. No. 14/657,831—Response to Final Office Action dated Jun. 30, 2017 filed Oct. 25, 2017, 24 pages. [cited by applicant]
U.S. Appl. No. 14/657,831—Response to Office Action dated Jan. 26, 2017 filed May 19, 2017, 24 pages. [cited by applicant]
U.S. Appl. No. 16/572,525—Response to Office Action dated Jan. 25, 2021, filed Apr. 26, 2021, 15 pages. [cited by applicant]
U.S. Appl. No. 16/572,525—Notice of Allowance dated May 4, 2021, 28 pages. [cited by applicant]
U.S. Appl. No. 16/572,525—Notice of Allowance dated Sep. 14, 2021, 26 pages. [cited by applicant]
U.S. Appl. No. 15/415,693—Response to Office Action dated May 14, 2021 filed Nov. 15, 2021, 15 pages. [cited by applicant]
U.S. Appl. No. 15/415,693—Response to Office Action dated Mar. 12, 2020, filed Jun. 18, 2020, 10 pages. [cited by applicant]
U.S. Appl. No. 14/657,831—Response to Office Action dated Jan. 26, 2017 filed May 19, 2019, 24 pages. [cited by applicant]