IP Library Granted Patent US 8,571,888
Granted Patent B2
US 8,571,888 · App. 13/342,048 · Granted Oct 29, 2013

Real-time image analysis for medical savings plans

Inventors: Matthew A. Calman (Charlotte, NC); Erik Stephen Ross (Charlotte, NC); Alfred Hamilton (Charlotte, NC)
Assignee: Bank of America Corporation
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,571,888
App. No.
13/342,048
Granted
Oct 29, 2013
Kind
B2
Abstract

In general terms, embodiments of the present invention relate to methods, apparatuses, and computer program products for providing health or flexible spending account information in association with products identified in an augmented reality environment. In some embodiments, a method is provided that includes: (a) receiving information associated with an image, where the image was captured by a mobile device; (b) determining, based at least partially on the information associated with the image, that the image shows a product that qualifies for purchase under a medical savings plan; and (c) presenting, via the mobile device, information that indicates that the product qualifies for purchase under the medical savings plan.

Claims (56)

1. A method implemented by a computing device, wherein the computing device determines whether a product qualifies under a medical savings plan, the method comprising:

receiving information associated with an image of the product, wherein the image is part of a real-time video stream captured by a mobile device;

determining, via a processor, based at least partially on the information associated with the image, if the image shows a product that qualifies for purchase under the medical savings plan, wherein determining if the image shows a product that qualifies for purchase under the medical savings plan comprises (i) identifying the product based at least partially on the information associated with the image and (ii) determining if the product qualifies for purchase under the medical savings plan by comparing information about the product to information about a known set of products that qualify for purchase under a medical savings plan;

displaying the real-time video stream on a display of the mobile device;

determining, via a processor, that the real-time video stream being displayed on the display of the mobile device shows the product; and

based upon determining that the real-time video stream being displayed on the display of the mobile device shows the product, displaying on the display of the mobile device a graphical indication that the product qualifies for purchase under the medical savings plan, the graphical indication being superimposed over the real-time video stream being displayed on the display of the mobile device.

2. The method of claim 1 , wherein determining if the image shows a product that qualifies for purchase under a medical savings plan comprises determining if the product qualifies for purchase under a health savings account or flexible spending account.

3. The method of claim 1 , wherein receiving information associated with the image of the product comprises receiving an image of the product.

4. The method of claim 1 , further comprising: displaying, on the display of the mobile device, a review of the product.

5. The method of claim 1 , further comprising: displaying, on the display of the mobile device, a contraindication of the product.

6. The method of claim 1 , further comprising: displaying, on the display of the mobile device, a recommended use of the product.

7. The method of claim 1 , further comprising: displaying, on the display of the mobile device, an ingredient of the product.

8. The method of claim 1 , further comprising: displaying, on the display of the mobile device, a price of the product.

9. The method of claim 1 , further comprising: displaying, on the display of the mobile device, a link to a website where the product can be purchased.

10. The method of claim 1 , further comprising: displaying, on the display of the mobile device, a balance of the medical savings plan.

11. The method of claim 1 , wherein presenting, via the mobile device, the indication of whether the product qualifies for purchase under the medical savings plan comprises presenting an indication in the image proximate to the product shown in the image.

12. The method of claim 1 , wherein presenting, via the mobile device, the indication of whether the product qualifies for purchase under the medical savings plan comprises presenting an indication that can be selected by a user of the mobile device to output information about the product.

13. The method of claim 1 , wherein the presenting, via the mobile device, an indication of whether the product qualifies for purchase under the medical savings plan comprises notifying the mobile device that the product qualifies for purchase under the medical savings plan.

14. An apparatus for determining whether a product qualifies under a medical savings plan, wherein the apparatus comprises:

a communication device; and

a processing device communicably coupled to the communication device, wherein the processing device is configured to:

receive information associated with an image of the product, wherein the image is part of a real-time video stream captured by a mobile device;

determine, based at least partially on the information associated with the image, if the image shows a product that qualifies for purchase under a medical savings plan, wherein determining if the image shows a product that qualifies for purchase under the medical savings plan comprises (i) identifying the product based at least partially on the information associated with the image and (ii) determining if the product qualifies for purchase under the medical savings plan by comparing information about the product to information about a known set of products that qualify for purchase under a medical savings plan;

display the real-time video stream on a display of the mobile device;

determine that the real-time video stream being displayed on the display of the mobile device shows the product; and

based upon determining that the real-time video stream being displayed on the display of the mobile device shows the product, display on the display of the mobile device a graphical indication that the product qualifies for purchase under the medical savings plan, the graphical indication being superimposed over the real-time video stream being displayed on the display of the mobile device.

15. The apparatus of claim 14 , wherein the medical savings plan comprises a health savings account or flexible spending account.

16. The apparatus of claim 14 , wherein the information associated with the image of the product is an image of the product.

17. The apparatus of claim 14 , wherein the processor is further configured to display, on the display of the mobile device, a review of the product.

18. The apparatus of claim 14 , wherein the processor is further configured to display, on the display of the mobile device, a contraindication of the product.

19. The apparatus of claim 14 , wherein the processor is further configured to display, on the display of the mobile device, a recommended use of the product.

20. The apparatus of claim 14 , wherein the processor is further configured to display, on the display of the mobile device, information that identifies an ingredient of the product.

21. The apparatus of claim 14 , wherein the processor is further configured to display, on the display of the mobile device, a price of the product.

22. The apparatus of claim 14 , wherein the processor is further configured to display, on the display of the mobile device, a link to a website where the product can be purchased.

23. The apparatus of claim 14 , wherein the processor is further configured to display, on the display of the mobile device, a balance of the medical savings plan.

24. The apparatus of claim 14 , wherein the indication of whether the product qualifies for purchase under the medical savings plan comprises an indication that is presented in the image and proximate to the product shown in the image.

25. The apparatus of claim 14 , wherein the indication of whether the product qualifies for purchase under the medical savings plan can be selected by a user of the mobile device to output information about the product.

26. The apparatus of claim 14 , wherein the indication of whether the product qualifies for purchase under the medical savings comprises a notification that the product qualifies for purchase under the medical savings plan.

27. A computer program product for determining whether a product qualifies under a medical savings plan, the computer program product comprising a non-transitory computer-readable medium, wherein the non-transitory computer-readable medium comprises computer executable program code stored therein, the computer-executable program code being configured to cause a processor to:

receive information associated with an image of the product, wherein the image was part of a real-time video stream captured by a mobile device;

determine, based at least partially on the information associated with the image, if the image shows a product that qualifies for purchase under a medical savings plan, wherein determining if the image shows a product that qualifies for purchase under the medical savings plan comprises (i) identifying the product based at least partially on the information associated with the image and (ii) determining if the product qualifies for purchase under the medical savings plan by comparing information about the product to information about a known set of products that qualify for purchase under a medical savings plan;

display the real-time video stream on a display of the mobile device;

determine that the real-time video stream being displayed on the display of the mobile device shows the product; and

based upon determining that the real-time video stream being displayed on the display of the mobile device shows the product, display on the display of the mobile device a graphical indication that the product qualifies for purchase under the medical savings plan, the graphical indication being superimposed over the real-time video stream being displayed on the display of the mobile device.

28. The computer program product of claim 27 , wherein determining if the image shows a product that qualifies for purchase under a medical savings plan comprises determining if the product qualifies for purchase under a health savings account or flexible spending account.

29. The computer program product of claim 27 , wherein the information associated with an image of the product is an image of the product.

30. The computer program product of claim 27 , wherein the computer-executable program code is configured to cause a processor to display, on the display of the mobile device, a review of the product.

31. The computer program product of claim 27 , wherein the computer-executable program code is configured to cause a processor to display, on the display of the mobile device, a contraindication of the product.

32. The computer program product of claim 27 , wherein the computer-executable program code is configured to cause a processor to display, on the display of the mobile device, a recommended use of the product.

33. The computer program product of claim 27 , wherein the computer-executable program code is configured to cause a processor to display, on the display of the mobile device, an ingredient of the product.

34. The computer program product of claim 27 , wherein the computer-executable program code is configured to cause a processor to display, on the display of the mobile device, a price of the product.

35. The computer program product of claim 27 , wherein the computer-executable program code is configured to cause a processor to display, on the display of the mobile device, a link to a website where the product can be purchased.

36. The computer program product of claim 27 , wherein the computer-executable program code is configured to cause a processor to display, on the display of the mobile device, a balance of the medical savings plan.

37. The computer program product of claim 27 , wherein the presenting, via the mobile device, the indication of whether the product qualifies for purchase under the medical savings plan comprises presenting the indication in the image proximate to the product shown in the image.

38. The computer program product of claim 27 , wherein the presenting, via the mobile device, the indication of whether the product qualifies for purchase under the medical savings plan comprises presenting an indication that can be selected by a user of the mobile device to output information about the product.

39. The computer program product of claim 27 , wherein the presenting, via the mobile device, the indication of whether the product qualifies for purchase under the medical savings plan comprises notifying the mobile device that the product qualifies for purchase under the medical savings plan.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 27, 2012
From: CALMAN, MATTHEW A.; ROSS, ERIK STEPHEN; HAMILTON, ALFRED
To: BANK OF AMERICA CORPORATION
Reel/Frame 027611/0177 →
Continuity (30)
Provisional Application 61450213 · Mar 8, 2011
Provisional Application 61478393 · Apr 22, 2011
Provisional Application 61478409 · Apr 22, 2011
Provisional Application 61478412 · Apr 22, 2011
Provisional Application 61478394 · Apr 22, 2011
Provisional Application 61478399 · Apr 22, 2011
Provisional Application 61478402 · Apr 22, 2011
Provisional Application 61478405 · Apr 22, 2011
Provisional Application 61478397 · Apr 22, 2011
Provisional Application 61478408 · Apr 22, 2011
Provisional Application 61478400 · Apr 22, 2011
Provisional Application 61478411 · Apr 22, 2011
Provisional Application 61478403 · Apr 22, 2011
Provisional Application 61478407 · Apr 22, 2011
Provisional Application 61478415 · Apr 22, 2011
Provisional Application 61478419 · Apr 22, 2011
Provisional Application 61478417 · Apr 22, 2011
Provisional Application 61508985 · Jul 18, 2011
Provisional Application 61508946 · Jul 18, 2011
Provisional Application 61508980 · Jul 18, 2011
Provisional Application 61508821 · Jul 18, 2011
Provisional Application 61508850 · Jul 18, 2011
Provisional Application 61508966 · Jul 18, 2011
Provisional Application 61508969 · Jul 18, 2011
Provisional Application 61508971 · Jul 18, 2011
Provisional Application 61508764 · Jul 18, 2011
Provisional Application 61508973 · Jul 18, 2011
Provisional Application 61508976 · Jul 18, 2011
Provisional Application 61508944 · Jul 18, 2011
Related Publication 20120232937A1 · Sep 13, 2012