Granted Patent E1

US 50,340 · App. 17/357,106 · Granted Mar 18, 2025

Inventors: Rajiv Kumar Dwivedi (Bartlett, IL); Christopher Heistad (Cedar Falls, IA); Bikramjit Singh (Carlsbad, CA); Karl Felix Medina (Oceanside, CA); Ram Mohan Reddy (Irving, TX); Jonathan Brian Chinn (Arcadia, CA); Rebekah Jane Griffiths (North Tustin, CA); Satish G. Nair (Naperville, IL); Biju Nair (Long Grove, IL)

Assignee: ASSURANT, INC.

G06T7/0008G06F3/00G06F3/0346G06F11/00G06Q30/0278G06Q50/00G06T7/0004G06T7/11G06T7/13G06T2207/10016G06T2207/20021G06T2207/20081G06T2207/20084G06T2207/30121G06T2207/30164G06T2207/30204

Abstract

Claims (101)

1. A method to identify a condition of one or more screens of an electronic device, the method comprising:

receiving a request for evaluation of a condition of a screen of a first device or portion thereof via a return application on the first device;

allowing presentation of a first graphic on the screen of the first device, wherein the first graphic comprises a first identification code;

capturing at least a portion of a first image of the first graphic via a camera of the first device, wherein the first image comprises a reflection of the first graphic on a reflective surface;

allowing presentation of one or more second graphics on the screen of the first device;

capturing at least a portion of one or more of second images of at least one of the second graphics via a camera of the first device, wherein each of the second images comprises a reflection of at least one of the second graphics on the reflective surface; and

processing one or more of the second images to determine a condition of the screen of the first device, wherein processing one of the second images comprises:

dividing the second image into parts;

determining whether one or more of the parts of the second image include damage;

identifying parts adjacent to one or more of the parts that include damage;

determining a condition of the screen of the first device based on whether one or more of the parts of one or more of the second images are determined to include damage and whether one or more of the parts adjacent to one of the parts determined to include damage also includes damage;

identifying the screen or portion thereof of the first device in the second image;

generating a third image in which portions of the second image that are not identified as a screen or portion thereof in the second image are restricted from inclusion in the third image;

dividing the third image into parts;

determining whether one or more of the parts of the third image include damage; and

identifying parts adjacent to one or more of the parts that include damage,

wherein determining a condition of the screen of the first device is based on whether one or more of the parts of the third image are determined to include damage and whether one or more of the adjacent parts includes damage.

2. The method of claim 1 further comprising verifying an identity of a first device based on an analysis of the first identification code.

3. The method of claim 1 wherein capture at least a portion of one or more of second images of at least one of the second graphics comprises:

determining an orientation of the device based on the captured image of the first graphic; and

providing guidance to adjust an orientation of the device based on the determined orientation.

4. The method of claim 3 further comprising capturing at least a portion of an additional image of the first graphic via the camera of the first device.

5. The method of claim 3 further comprising:

determining an orientation of the device based on the captured image of the first graphic;

providing guidance to adjust an orientation of the device based on the determined orientation;

capture at least a portion of one or more of additional images of at least one of the second graphics via the camera of the first device, wherein each of the additional images comprises a reflection of at least one of the second graphics on the reflective surface.

6. The method of claim 3 further comprising determining that at least one of the captured first image or one or more of the captured second images is not a processable image; and allowing the first device to be reoriented to capture a processable image by:

determining an orientation of the device based on the captured first image or one or more of the captured second images; and

providing guidance to adjust an orientation of the device based on the determined orientation.

7. The method of claim 1 further comprising tagging one or more of the captured second images with at least a portion of the captured first image.

8. The method of claim 1 further comprising restricting one or more processes of the first device.

9. The method of claim 1 wherein identifying a screen or portion thereof of the first device in the second image comprises utilizing at least one of corner detection or edge detection to identify a screen of the first device in the second image.

10. The method of claim 1 wherein generating a third image comprises altering the second image such that portions of the second image that are not identified as the screen or portion thereof are removed.

11. The method of claim 1 wherein identifying a screen or portion thereof comprises identifying the active area of the screen of the first device.

12. A method to identify a condition of one or more screens of an electronic a first device, the method comprising:

receiving a request for evaluation of a condition of a screen of a first device or portion thereof via a return application on a second device, wherein the first device includes the return application;

allowing causing presentation of a first graphic on the screen of the first device via the return application on the first device, wherein the first graphic comprises a first identification code;

capturing at least a portion of a first image of the first graphic presented on the first device via a camera of the second device;

allowing causing presentation of one or more second graphics on the screen of the first device by allowing causing presentation of a set of burst images on the first device, wherein the set of burst images includes at least one of the second graphics at multiple luminosity levels;

capturing at least a portion of one or more of second images of at least one of the second graphics presented on the first device via a camera of the second device by:

capturing the set of burst images presented on the first device;

selecting one of the captured burst images by determining which of the captured set of burst images is most similar in color to a reference color; and

identifying the selected captured burst image as one of the captured second graphics;

processing one or more of the second images to determine a condition of the screen of the first device, wherein processing one of the one or more second images comprises:

dividing the second image into parts;

determining whether one or more of the parts of the second image include damage;

identifying parts of the second image adjacent to one or more of the parts that include damage; and

determining a condition of the screen of the first device based on whether one or more of the parts of the second image are determined to include damage and whether one or more of the parts adjacent to one of the parts determined to include damage also includes damage.

13. The method of claim 12 further comprising if a determination is made that the condition of the first device is damaged, determining damage information; and generating flags to identify one or more of the parts of the second image that are determined to include damage based on the determined damage information.

14. The method of claim 12 further comprising testing the a touchscreen of the first device if a determination is made that the condition of the first device is damaged.

15. The method of claim 12 further comprising calibrating brightness of the screen of the first device based on the captured first image.

16. The method of claim 12 wherein capturing at least a portion of one or more of second images of at least one of the second graphics comprises:

determining an orientation of the first device based on the captured first image of the first graphic;

providing guidance to adjust an orientation of the first device based on the determined orientation; and

capturing at least a portion of an additional image of the first graphic via the camera of the first device.

17. The method of claim 12 wherein allowing causing presentation of one or more second graphics on the screen of the first device comprises allowing causing sequential presentation of more than one second graphic on the screen of the first device, and wherein capturing at least a portion of one or more of the second graphics comprises capturing at least one image of each of the second graphics sequentially presented on the screen of the first device.

18. The method of claim 12 wherein allowing causing presentation of one or more second graphics on the screen of the first device comprises allowing causing concurrent presentation of more than one second graphic on the screen of the first device.

19. A non-transitory computer readable medium comprising instructions that, when executed by a computer processor, perform operations comprising:

receiving a request for evaluation of a condition of a screen of a first device or portion thereof via a return application on the first device;

allowing presentation of a first graphic on the screen of the first device, wherein the first graphic comprises a first identification code;

capturing at least a portion of a first image of the first graphic via a camera of the first device, wherein the first image comprises a reflection of the first graphic on a reflective surface;

allowing presentation of one or more second graphics on the screen of the first device;

capturing at least a portion of one or more of second images of at least one of the second graphics via a camera of the first device, wherein each of the second images comprises a reflection of at least one of the second graphics on the reflective surface; and

processing one or more of the second images to determine a condition of the screen of the first device, wherein processing one of the second images comprises:

dividing the second image into parts;

determining whether one or more of the parts of the second image include damage;

identifying parts adjacent to one or more of the parts that include damage;

determining a condition of the screen of the first device based on whether one or more of the parts of one or more of the second images are determined to include damage and whether one or more of the parts adjacent to one of the parts determined to include damage also includes damage;

identifying the screen or portion thereof of the first device in the second image;

generating a third image in which portions of the second image that are not identified as a screen or portion thereof in the second image are restricted from inclusion in the third image;

dividing the third image into parts;

determining whether one or more of the parts of the third image include damage; and

identifying parts adjacent to one or more of the parts that include damage, wherein determining a condition of the screen of the first device is based on whether one or more of the parts of the third image are determined to include damage and whether one or more of the adjacent parts includes damage.

20. A method to identify a condition of a screen of a first electronic device, the method comprising:

causing display of one or more graphics on a screen of a first electronic device by causing presentation of a set of burst images on the first electronic device;

capturing, via a camera of the first electronic device, an image comprising a reflection of at least a portion of the one or more graphics presented on the first electronic device by:

capturing the set of burst images presented on the first electronic device;

selecting one of the captured burst images; and

identifying the selected captured burst image as the image; and

processing the image to determine a condition of at least a portion of the screen of the first electronic device.

21. The method of claim 20 , further comprising:

in an instance wherein a determination is made that the condition of the at least the portion of the screen of the first electronic device is damaged, determining damage information; and

generating one or more flags to identify one or more of the parts of the image that are determined to include damage based on the determined damage information.

22. The method of claim 20 , further comprising:

in an instance wherein a determination is made that the condition of the at least the portion of the screen of the first electronic device is damaged, causing testing of a touchscreen of the first electronic device.

23. The method of claim 20 , further comprising causing display of a first graphic on the screen of the electronic device, wherein the first graphic comprises a first identification code; and

analyzing a reflection of the first graphic captured via the camera.

24. The method of claim 23 , wherein analyzing the reflection of the first graphic comprises capturing a first image of at least a portion of the first graphic and analyzing the first image.

25. The method of claim 24 , further comprising calibrating a brightness of the screen of the first electronic device based on the first image.

26. The method of claim 24 , wherein capturing via the camera of the first electronic device, the image comprising the reflection on the reflective surface of the at least the portion of the one or more graphics comprises:

determining an orientation of the first electronic device based on the first image of the first graphic;

providing guidance to adjust the orientation of the first electronic device based on the determined orientation; and

capturing an additional image of at least a portion of the first graphic via the camera of the first electronic device.

27. The method of claim 20 , wherein causing display of the one or more graphics on the screen of the first electronic device by causing presentation of the set of burst images on the first electronic device comprises causing sequential presentation of more than one graphic on the screen of the first electronic device, and wherein capturing an image comprising a reflection of the at least the portion of the one or more graphics presented on the first electronic device comprises capturing one or more images of the graphics sequentially presented on the screen of the first electronic device.

28. The method of claim 20 , wherein causing display of the one or more graphics on the screen of the first electronic device by causing presentation of the set of burst images on the first electronic device comprises causing concurrent presentation of more than one graphic on the screen of the first electronic device.

29. The method of claim 20 , wherein processing the image to determine the condition of the at least a portion the screen of the first electronic device comprises:

dividing the image into parts;

determining whether one or more of the parts of the image include damage;

identifying parts adjacent to one or more of the parts that include damage; and

determining the condition of the at least the portion of the screen of the first electronic device based on whether one or more of the parts of the image are determined to include damage and whether one or more of the parts adjacent to one of the parts determined to include damage also includes damage.

30. The method of claim 20 , wherein selecting one of the captured burst images comprises determining which image of the captured set of burst images is most similar in color to a reference color.

Assignments (3)

Continuity (2)

References Cited (124)