Granted Patent B2

US 12,288,274 · App. 18/097,546 · Granted Apr 29, 2025

Inventors: Kristyna Brittanny Theresa Mason (West Chester, OH); Nicole Ashley Rizzo (Cincinnati, OH); Scott Kendyl Stanley (Mason, OH); William Henry Truran (Franklin, NJ)

Assignee: The Procter & Gamble Company

G06T11/00G06T7/20G06T7/70G06T2200/24

Abstract

Claims (75)

1. An environmental imaging and graphical mapping method for tracking cleaning activity in a physical environment, the environmental imaging and graphical mapping method comprising:

obtaining one or more environmental images as captured by a sensor, each of the one or more environmental images depicting at least a portion of a target area in the physical environment;

generating, by one or more processors, a graphical mapping of the target area based on the one or more environmental images, the graphical mapping comprising one or more regions defining the target area;

detecting, by the one or more processors, a position value corresponding to a physical position of a cleaning implement within the target area;

updating, by the one or more processors, the graphical mapping to indicate that a region of the one or more regions has a clean status; and

displaying, on a graphical user interface (GUI), the graphical mapping of the target area, the graphical mapping visually indicating that the region has the clean status;

receiving, via the GUI, a selection indicating one or more activity regions, the one or more activity regions selected from the one or more regions of the graphical mapping; and

receiving, via the GUI, a second selection indicating a virtual incentive provided upon achieving the clean status for at least a portion of the one or more activity regions;

receiving, at a second GUI, an indication to accept the virtual incentive; and

displaying, on the second GUI, the graphical mapping upon selection from the second GUI to accept the virtual incentive.

2. The environmental imaging and graphical mapping method of claim 1 ,

wherein a mobile device includes at least one of the one or more processors,

wherein the cleaning implement is configured to receive the mobile device as an attachment, and

wherein the mobile device generates the position value as the cleaning implement moves within the target area.

3. The environmental imaging and graphical mapping method of claim 1 ,

wherein a wearable device includes at least one of the one or more processors,

wherein the wearable device generates the position value as the cleaning implement moves within the target area.

4. The environmental imaging and graphical mapping method of claim 1 further comprising:

detecting, by the one or more processors, a second position value corresponding to a second physical position of the cleaning implement within the target area; and

updating, by the one or more processors, the graphical mapping to indicate that a second region of the one or more regions has a clean status,

wherein the graphical mapping visually indicates on the GUI that the second region has the clean status, and

wherein the GUI further visually indicates a tracking trail indicating movement of the cleaning implement from the physical position to the second physical position.

5. The environmental imaging and graphical mapping method of claim 1 further comprising:

updating, by the one or more processors, at least one of the graphical mapping or the GUI to include the virtual incentive within at least a portion of the one or more activity regions.

6. The environmental imaging and graphical mapping method of claim 1 further comprising:

updating, by the one or more processors, the graphical mapping to indicate a completeness status based on a count of the one or more activity regions updated with the clean status.

7. The environmental imaging and graphical mapping method of claim 1 ,

wherein the sensor comprises one or more of: (a) a light-detection-and-ranging (LiDAR) sensor wherein at least one of the one or more environmental images comprises LiDAR data as captured by the LiDAR sensor; (b) a radio-detection-and-ranging (RADAR) sensor wherein at least one of the one or more environmental images comprises RADAR data as captured by the RADAR sensor; (c) a camera sensor wherein at least one of the one or more environmental images comprises pixel-based data as captured by the camera sensor; or (d) an ultrasonic sensor wherein the one or more environmental images are correlated with sound data of the target area in the physical environment.

8. The environmental imaging and graphical mapping method of claim 1 ,

wherein the graphical mapping is generated and displayed on the GUI in real time or near real time.

9. The environmental imaging and graphical mapping method of claim 1 ,

wherein the one or more environmental images depict an object in the target area, and

wherein generation of the graphical mapping comprises removing the object such that the graphical mapping is rendered on the GUI without the object.

10. The environmental imaging and graphical mapping method of claim 1 , wherein the clean status is further determined by the sensor being positioned within the target area based on a known distance or positional offset between the sensor and at least a portion of the cleaning implement.

11. The environmental imaging and graphical mapping method of claim 1 , wherein the clean status is further determined by a first image and a second image as captured by the sensor, wherein the first image defines a pre-cleaning image and the second image comprises a post-cleaning image, and wherein imaging artifacts that differ in the second image compared to the first image indicate that cleaning has occurred or is occurring in the target area.

12. The environmental imaging and graphical mapping method of claim 1 further comprising: determining health related data of a user.

13. The environmental imaging and graphical mapping method of claim 1 , wherein a progress status or incentive received for a task associated with the target area is transmitted to a social media platform for sharing with one or more social media users of the social media platform.

14. An environmental imaging and graphical mapping system configured to track cleaning activity in a physical environment, the environmental imaging and graphical mapping system comprising:

a sensor configured to obtain environmental images;

a cleaning implement; and

an environmental imaging application (app) comprising computing instructions and configured for execution on one or more processors, wherein the computing instructions when executed by the one or more processors, cause the one or more processors to:

obtain one or more environmental images as captured by the sensor, each of the one or more environmental images depicting at least a portion of a target area in the physical environment;

generate a graphical mapping of the target area based on the one or more environmental images, the graphical mapping comprising one or more regions defining the target area;

detect a position value corresponding to a physical position of the cleaning implement within the target area;

update the graphical mapping to indicate that a region of the one or more regions has a clean status; and

display, on a graphical user interface (GUI), the graphical mapping of the target area, the graphical mapping visually indicating that the region has the clean status;

wherein the computing instructions when executed by the one or more processors, further cause the one or more processors to:

receive, via the GUI, a selection indicating one or more activity regions, the one or more activity regions selected from the one or more regions of the graphical mapping; and

receive, via the GUI, a second selection indicating a virtual incentive provided upon achieving the clean status for at least a portion of the one or more activity regions;

wherein the computing instructions when executed by the one or more processors, further cause the one or more processors to:

receive, at a second GUI, an indication to accept the virtual incentive; and

display, on the second GUI, the graphical mapping upon selection from the second GUI to accept the virtual incentive.

15. The environmental imaging and graphical mapping system of claim 14 ,

wherein a mobile device includes at least one of the one or more processors,

wherein the cleaning implement is configured to receive the mobile device as an attachment, and

wherein the mobile device generates the position value as the cleaning implement moves within the target area.

16. The environmental imaging and graphical mapping system of claim 14 ,

wherein a wearable device includes at least one of the one or more processors,

wherein the wearable device generates the position value as the cleaning implement moves within the target area.

17. The environmental imaging and graphical mapping system of claim 14 , wherein the computing instructions when executed by the one or more processors, further cause the one or more processors to:

detect, by the one or more processors, a second position value corresponding to a second physical position of the cleaning implement within the target area; and

update, by the one or more processors, the graphical mapping to indicate that a second region of the one or more regions has a clean status,

wherein the graphical mapping visually indicates on the GUI that the second region has the clean status, and

wherein the GUI further visually indicates a tracking trail indicating movement of the cleaning implement from the physical position to the second physical position.

18. The environmental imaging and graphical mapping system of claim 17 , wherein the computing instructions when executed by the one or more processors, further cause the one or more processors to:

update, by the one or more processors, at least one of the graphical mapping or the GUI to include the virtual incentive within at least a portion of the one or more activity regions.

19. The environmental imaging and graphical mapping system of claim 17 , wherein the computing instructions when executed by the one or more processors, further cause the one or more processors to:

update, by the one or more processors, the graphical mapping to indicate a completeness status based on a count of the one or more activity regions updated with the clean status.

20. The environmental imaging and graphical mapping system of claim 14 ,

wherein the sensor comprises one or more of: (a) a light-detection-and-ranging (LiDAR) sensor wherein at least one of the one or more environmental images comprises LiDAR data as captured by the LiDAR sensor; (b) a radio-detection-and-ranging (RADAR) sensor wherein at least one of the one or more environmental images comprises RADAR data as captured by the RADAR sensor; (c) a camera sensor wherein at least one of the one or more environmental images comprises pixel-based data as captured by the camera sensor; or (d) an ultrasonic sensor wherein the one or more environmental images are correlated with sound data of the target area in the physical environment.

21. The environmental imaging and graphical mapping system of claim 14 ,

wherein the graphical mapping is generated and displayed on the GUI in real time or near real time.

22. The environmental imaging and graphical mapping system of claim 14 ,

wherein the one or more environmental images depict an object in the target area, and

wherein generation of the graphical mapping comprises removing the object such that the graphical mapping is rendered on the GUI without the object.

Assignments (1)

Continuity (2)

References Cited (16)