IP Library Granted Patent US 9,836,867
Granted Patent B2
US 9,836,867 · App. 14/934,724 · Granted Dec 5, 2017

Photograph augmentation with garment overlay

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,836,867
App. No.
14/934,724
Granted
Dec 5, 2017
Kind
B2
Abstract

Systems and methods for rendering an image of a selected garment on a photograph containing a selected individual are disclosed. A computer-implemented method includes: analyzing and tagging, by a computing device, a plurality of photographs stored in a repository; receiving, by the computing device, an indication of a selected garment and a selected individual; determining, by the computing device, a selected photograph from the plurality of photographs based on at least one of: appropriateness of outfit; appropriateness of environment; and usage patterns; generating, by the computing device, an augmented photograph by superimposing an image of the selected garment on the selected photograph; and transmitting, by the computing device, the augmented photograph to a client device.

Claims (62)

1. A computer-implemented method comprising:

analyzing and tagging, by a computing device, a plurality of photographs stored in a repository,

wherein the analyzing includes determining identified types of environment in each of the plurality of photographs based on a combination of an image analysis of each the plurality of photographs and geolocation metadata of each the plurality of photographs, and

wherein the tagging includes: tagging each of the plurality of photographs with identities of individuals in the plurality of photographs, tagging each of the plurality of photographs with identified types of garments in the plurality of photographs, and tagging each of the plurality of photographs with the identified types of environment in the plurality of photographs;

receiving, by the computer device, an augment to the tagging of each of the plurality of photographs via a graphical user interface;

receiving, by the computing device, an indication of a selected garment and a selected individual,

wherein the analyzing includes determining a photograph from the plurality of photographs on which to render an image of the selected garment based on: the selected individual being in the photograph, a garment position in the photograph, appropriateness of the selected garment with other clothing worn by the selected individual in the photograph;

determining, by the computing device, the selected photograph from the plurality of photographs based on a score of the appropriateness of outfit, appropriateness of environment, and usage patterns for each of the plurality of photographs;

generating, by the computing device, an augmented photograph by superimposing an image of the selected garment on the selected photograph; and

transmitting, by the computing device, the augmented photograph to a client device.

2. The method of claim 1 , wherein the analyzing comprises facial recognition, garment recognition, and environment recognition.

3. The method of claim 1 , further comprising:

determining a cumulative score for each of the plurality of photographs based on a sum of the score of the appropriateness of outfit, appropriateness of environment, and usage patterns for each of the plurality of photographs; and

determining a subset of the plurality of photographs that include the selected individual.

4. The method of claim 3 , wherein the selected photograph is determined from the subset of the plurality of photographs, and

wherein determining the subset of the plurality of photographs is based on comparing a name of the selected individual with identities of individuals defined in the tagging.

5. The method of claim 4 , wherein the superimposing the image of the selected garment on the selected photograph comprises superimposing the image of the selected garment over an image of the selected individual in the selected photograph such that the selected individual in the selected photograph appears to be wearing the selected garment.

6. The method of claim 1 , wherein the appropriateness of outfit is based on comparing the selected garment to garments in the plurality of photographs using tags of the selected garment, tags of the plurality of photographs, and predefined rules, and

wherein the appropriateness of the outfit is based on comparing tags of the selected garment to tags of the plurality of photographs, employing the pre-defined rules to determine an appropriateness of the selected garment matches clothing worn by the selected individual, and scoring the plurality of photographs based on the appropriateness of the selected garment and the pre-defined rules.

7. The method of claim 1 , wherein the appropriateness of environment is based on comparing the selected garment to environments in the plurality of photographs using tags of the selected garment, tags of the plurality of photographs, and predefined rules, and

wherein the appropriateness of environment is based on comparing tags of the selected garment to tags of the plurality of photographs, employing the pre-defined rules that define matching types of garments and environments to determine an appropriateness of the selected garment in the environment, and scoring the plurality of photographs based on the appropriateness of the selected garment in the environment and the pre-defined rules.

8. The method of claim 1 , wherein determining the usage patterns is based on using tags of the plurality of photographs and analytics to determine patterns of the selected individual in the plurality of photographs, wherein the patterns of the selected individual include favoring wearing a particular type of tagged garment in a particular tagged environment.

9. The method of claim 1 , wherein a service provider at least one of creates, maintains, deploys and supports the computing device.

10. The method of claim 1 , wherein steps of claim 1 are provided by a service provider on a subscription, advertising, and/or fee basis.

11. The method of claim 1 , wherein the computing device includes software provided as a service in a cloud environment.

12. The method of claim 1 , wherein:

the computing device comprises a first node in a cloud computing environment;

the repository comprises a second node in the cloud computing environment; and

the computing device is accessible by the client device accesses via network communication in the cloud computing environment.

13. A computer program product for rendering an image of a selected garment on a photograph containing a selected individual, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computing device to cause the computing device to:

analyze and tag a plurality of photographs stored in a repository, wherein the tagging includes: tagging each of the plurality of photographs with identities of individuals in the plurality of photographs, tagging each of the plurality of photographs with identified types of garments in the plurality of photographs, and tagging each of the plurality of photographs with identified types of environment in the plurality of photographs;

receive an augment to the tagging of each of the plurality of photographs via a graphical user interface;

receive an indication of the selected garment and the selected individual,

wherein the analyzing includes determining a photograph from the plurality of photographs on which to render an image of a selected garment based on: the selected individual being in the photograph, a garment position in the photograph, appropriateness of the selected garment with other clothing worn by the selected individual in the photograph, appropriateness of the selected garment with the environment included in the photograph, and usage patterns of the selected individual;

determine the selected photograph from the plurality of photographs based on a score of the appropriateness of the selected garment to other garments in the plurality of photographs, appropriateness of the selected garment to environments in the plurality of photographs, and determined usage patterns of the selected individual in the plurality of photographs;

generate an augmented photograph by superimposing the image of the selected garment on the selected photograph; and

transmit the augmented photograph over a network to a client device.

14. The computer program product of claim 13 , wherein the analyzing comprises facial recognition, garment recognition, and environment recognition.

15. The computer program product of claim 13 , wherein:

the determining comprises determining a cumulative score for each of the plurality of photographs based on a sum of the score of the appropriateness of outfit, appropriateness of environment, and usage patterns for each of the plurality of photographs;

the determining comprises determining a subset of the plurality of photographs that include the selected individual; and

the selected photograph is determined from the subset of the plurality of photographs.

16. The computer program product of claim 13 , wherein the appropriateness of outfit is based on comparing the selected garment to garments in the plurality of photographs using tags of the selected garment, tags of the plurality of photographs, and predefined rules, and

wherein the appropriateness of the outfit is based on comparing tags of the selected garment to tags of the plurality of photographs, employing the pre-defined rules to determine an appropriateness of the selected garment matches clothing worn by the selected individual, and scoring the plurality of photographs based on the appropriateness of the selected garment and the pre-defined rules.

17. The computer program product of claim 13 , wherein the appropriateness of environment is based on comparing the selected garment to environments in the plurality of photographs using tags of the selected garment, tags of the plurality of photographs, and predefined rules, and

wherein the appropriateness of the environment is based on comparing tags of the selected garment to tags of the plurality of photographs, employing the pre-defined rules that define matching types of garments and environments to determine an appropriateness of the selected garment in the environment, and scoring the plurality of photographs based on the appropriateness of the selected garment in the environment and the pre-defined rules.

18. The computer program product of claim 13 , wherein the usage patterns are determined based on using tags of the plurality of photographs and analytics to determine patterns of the selected individual in the plurality of photographs, wherein the patterns of the selected individual include favoring wearing a particular type of tagged garment in a particular tagged environment.

19. A system for rendering an image of a selected garment on a photograph containing a selected individual, comprising:

a CPU, a computer readable memory and a computer readable storage medium associated with a computing device;

program instructions to analyze and tag a plurality of photographs stored in a repository using facial recognition, garment recognition, and environment recognition,

wherein the analyzing includes determining identified types of environment in each of the plurality of photographs based on a combination of an image analysis of each the plurality of photographs and geolocation metadata of each the plurality of photographs, and

wherein the tagging includes: tagging each of the plurality of photographs with identities of individuals in the plurality of photographs, tagging each of the plurality of photographs with identified types of garments in the plurality of photographs, and tagging each of the plurality of photographs with the identified types of environment in the plurality of photographs;

program instructions to receive an indication of the selected garment and the selected individual,

wherein the analyzing includes determining a photograph from the plurality of photographs on which to render an image of a selected garment based on: the selected individual being in the photograph, a garment position in the photograph, appropriateness of the selected garment with other clothing worn by the selected individual in the photograph, appropriateness of the selected garment with the environment included in the photograph, and usage patterns of the selected individual;

program instructions to determine the selected photograph from the plurality of photographs based on a score of the appropriateness of the selected garment to other garments in the plurality of photographs, appropriateness of the selected garment to environments in the plurality of photographs, and determined usage patterns of the selected individual in the plurality of photographs;

program instructions to generate an augmented photograph by superimposing the image of the selected garment on the selected photograph; and

program instructions to transmit the augmented photograph over a network to a client device,

wherein the program instructions are stored on the computer readable storage medium for execution by the CPU via the computer readable memory.

20. The system of claim 19 , wherein:

the determining comprises determining a cumulative score for each of the plurality of photographs based on a sum of the score of the appropriateness of outfit, appropriateness of environment, and usage patterns for each of the plurality of photographs;

the determining comprises determining a subset of the plurality of photographs that include the selected individual; and

the selected photograph is determined from the subset of the plurality of photographs.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 3, 2024
From: BEIJING PIANRUOJINGHONG TECHNOLOGY CO., LTD.
To: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 066565/0952 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 4, 2023
From: AWEMANE LTD.
To: BEIJING PIANRUOJINGHONG TECHNOLOGY CO., LTD.
Reel/Frame 064501/0498 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 2, 2021
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: AWEMANE LTD.
Reel/Frame 057991/0960 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 6, 2015
From: BOSTICK, JAMES E.; GANCI, JOHN M., JR.; KEEN, MARTIN G.; RAKSHIT, SARBAJIT K.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 036980/0729 →