IP Library Granted Patent US 12,443,974
Granted Patent B2
US 12,443,974 · App. 18/654,791 · Granted Oct 14, 2025

Informational and advertiser links for use in web mapping services

Inventors: Yushi Jing (Mountain View, CA); Shumeet Baluja (Leesburg, VA)
Assignee: GOOGLE LLC
G06Q30/0257G06Q30/02G06Q30/0201G06Q30/0259G06Q30/0261G06Q30/0269G06Q30/0275G06Q30/0277G06Q30/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,443,974
App. No.
18/654,791
Granted
Oct 14, 2025
Kind
B2
Abstract

Techniques for identifying groups of local features in an image and presenting advertisement information associated with stored images that match one or more features within the group of local features are described. The techniques include providing an image, identifying a region of interest in the image, providing a user-selectable link associated with the region of interest in the image, receiving a request for the region of interest in the image via the user-selectable link, and presenting advertisement information associated with a stored image that matches one or more features within the requested region of interest.

Claims (47)

1. A computer-implemented method, comprising:

providing, by a mobile device comprising one or more processor devices, to a server system:

information indicative of a particular geographic location; and

an image that depicts the particular geographic location;

wherein the information indicative of the particular geographic location comprises Global Positioning System (GPS) coordinates for the mobile device obtained via a GPS sensor of the mobile device;

responsive to providing the information indicative of the particular geographic location, receiving, by the mobile device from the server system:

an image depicting a street view of the particular geographic location, wherein a portion of the image comprises a region of interest depicting a group of features associated with an object located within the particular geographic location; and

contextual information that is pertinent to the object, wherein the contextual information comprises a description of the object;

displaying, by the mobile device, the image via a display device of the mobile device, wherein the image is displayed with a user-selectable element overlaid on the portion of the image comprising the region of interest, and wherein the user-selectable element comprises a first portion of the contextual information;

receiving, by the mobile device, a touch input from a user of the mobile device, wherein the touch input selects the user-selectable element overlaid on the portion of the image comprising the region of interest; and

responsive to receiving the touch input, causing, by the mobile device, display of a second portion of the contextual information alongside display of the image via the display device of the mobile device, the second portion comprising the description of the object.

2. The computer-implemented method of claim 1 , wherein the object depicted within the particular geographic location is a car or a building.

3. The computer-implemented method of claim 1 , wherein the contextual information comprises an interactive link overlaid on a logo associated with the object.

4. The computer-implemented method of claim 3 , wherein the logo comprises a logo for an entity that provides the object.

5. The computer-implemented method of claim 3 , wherein the interactive link links to a first resource to obtain the object.

6. A non-transitory computer-readable storage device storing instructions, that when executed by one or more processors of a mobile device, cause performance of operations that comprise:

providing to a server system:

information indicative of a particular geographic location; and

an image that depicts the particular geographic location;

wherein the information indicative of the particular geographic location comprises Global Positioning System (GPS) coordinates for the mobile device obtained via a GPS sensor of the mobile device;

responsive to providing the information indicative of the particular geographic location, receiving, from the server system:

an image depicting a street view of the particular geographic location, wherein a portion of the image comprises a region of interest depicting a group of features associated with an object located within the particular geographic location; and

contextual information that is pertinent to the object, wherein the contextual information comprises a description of the object;

displaying the image via a display device of the mobile device, wherein the image is displayed with a user-selectable element overlaid on the portion of the image comprising the region of interest, and wherein the user-selectable element comprises a first portion of the contextual information;

receiving a touch input from a user of the mobile device, wherein the touch input selects the user-selectable element overlaid on the portion of the image comprising the region of interest; and

responsive to receiving the touch input, causing display of a second portion of the contextual information alongside display of the image via the display device of the mobile device, the second portion comprising the description of the object.

7. The non-transitory computer-readable storage device of claim 6 , wherein the object depicted within the particular geographic location is a car or a building.

8. The non-transitory computer-readable storage device of claim 6 , wherein the contextual information comprises an interactive link overlaid on a logo associated with the object.

9. The non-transitory computer-readable storage device of claim 8 , wherein the logo comprises a logo for an entity that provides the object.

10. The non-transitory computer-readable storage device of claim 8 , wherein the interactive link links to a first resource to obtain the object.

11. A mobile device, comprising:

one or more processing devices; and

one or more storage devices storing instructions that are executable by the one or more processing devices to perform operations comprising:

providing to a server system:

information indicative of a particular geographic location; and

an image that depicts the particular geographic location;

wherein the information indicative of the particular geographic location comprises Global Positioning System (GPS) coordinates for the mobile device obtained via a GPS sensor of the mobile device;

responsive to providing the information indicative of the particular geographic location, receiving, from the server system:

an image depicting a street view of the particular geographic location, wherein the image comprises a region of interest depicting a group of features associated with an object located within the particular geographic location; and

contextual information that is pertinent to the object, wherein the contextual information comprises a description of the object;

displaying the image via a display device of the mobile device, wherein a portion of the image is displayed with a user-selectable element overlaid on the region of interest, and wherein the user-selectable element comprises a first portion of the contextual information;

receiving a touch input from a user of the mobile device, wherein the touch input selects the user-selectable element overlaid on the portion of the image comprising the region of interest; and

responsive to receiving the touch input, causing display of a second portion of the contextual information alongside display of the image via the display device of the mobile device, the second portion comprising the description of the object.

12. The mobile device of claim 11 , wherein the object depicted within the particular geographic location is a car or a building.

13. The mobile device of claim 11 , wherein the contextual information comprises an interactive link overlaid on a logo associated with the object.

14. The mobile device of claim 13 , wherein the logo comprises a logo for an entity that provides the object.

15. The mobile device of claim 13 , wherein the interactive link links to a first resource to obtain the object.

Assignments (2)
CHANGE OF NAME Recorded Sep 18, 2024
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 068979/0813 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 17, 2024
From: JING, YUSHI; BALUJA, SHUMEET
To: GOOGLE INC.
Reel/Frame 068602/0886 →
Continuity (4)
Continuation 16183175 · Nov 7, 2018
Continuation 14836287 · Aug 26, 2015
Continuation 12025862 · Feb 5, 2008
Related Publication 20240289842A1 · Aug 29, 2024
References Cited (34)
US 7599938B1 · Harrison, Jr. · 2009 [cited by applicant]
US 7777648B2 · Smith et al. · 2010 [cited by applicant]
US 20050021387A1 · Gottfurcht · 2005 [cited by applicant]
US 20050273458A1 · Adams · 2005 [cited by applicant]
US 20060241859A1 · Kimchi · 2006 [cited by examiner]
US 20070027765A1 · Collins et al. · 2007 [cited by applicant]
US 20070130129A1 · Wagle · 2007 [cited by applicant]
US 20070210937A1 · Smith et al. · 2007 [cited by applicant]
US 20070264987A1 · Gupta et al. · 2007 [cited by applicant]
US 20080086356A1 · Glassman et al. · 2008 [cited by applicant]
US 20080126206A1 · Jarrell · 2008 [cited by applicant]
US 20080143727A1 · Oh et al. · 2008 [cited by applicant]
US 20080215415A1 · Willms · 2008 [cited by applicant]
US 20090083815A1 · McMaster · 2009 [cited by examiner]
US 20100004995A1 · Hickman · 2010 [cited by applicant]
US 20100034466A1 · Jing et al. · 2010 [cited by applicant]
US 20100118025A1 · Smith · 2010 [cited by examiner]
JP H11296540 · 2011 [cited by applicant]
KR 20000072571 · 2000 [cited by applicant]
KR 20010105634 · 2001 [cited by applicant]
KR 20030069950 · 2003 [cited by applicant]
KR 20050094557 · 2005 [cited by applicant]
KR 20050116963 · 2005 [cited by applicant]
Sheltrown, Nicholas Joel. Follow the link: Critical narratives of the Internet. Michigan State University ProQuest Dissertations & Theses, 2007.3264230. (Year: 2007). [cited by examiner]
Hristova, N. et al. Ad-me: wireless advertising adapted to the user location, device and emotions. 37th Annual Hawaii International Conference on System Sciences, 2004. (Year: 2004). [cited by examiner]
Authorized officer Dorothee Miilhausen, International Preliminary Report on Patentability in PCT/US2009/049700, mailed Jan. 20, 2011, 7 pages. [cited by applicant]
Authorized officer Gijsbertus Beijer, International Preliminary Report on Patentability in PCT/US2009/053353, mailed Feb. 24, 2011, 9 pages (16113-1198WO1). [cited by applicant]
Ball, John. Architectural Street Credibility: Reframing Contemporary Architecture to Sidewalk Level with Images from Google Street View. Arizona State University, ProQuest Dissertations Publishing, 2014. [cited by applicant]
Becker, Leslie F. University of California, Berkeley. Design and Ethics: Rationalizing Consumption through the Graphic Image. ProQuest Dissertations Publishing, 2008. (Year: 2008). [cited by applicant]
Gilbert, Jeffrey Michael. Text /graphics and image transmission over bandlimited lossy links. University of California, Berkeley. ProQuest Dissertations Publishing, 2000. (Year: 2000). [cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US2009/049700 dated Jan. 29, 2010, 12 pages. [cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US2009/053353 dated Feb. 24, 2010, 14 pages. (16113-1198WO1). [cited by applicant]
Schmid, C., et al., “Evaluation of Interest Point Detectors,” International Journal of Computer Vision, 37(2): 151-172, 2000. [cited by applicant]
Young, Ha; Kwon, Wi-Suk; Lennon, Sharron J. Online visual merchandising (VMD) of apparel web sites. Journal of Fashion Marketing and Management; Bradford vol. 11, Iss. 4, (2007): 477-493. (Year: 2007). [cited by applicant]