Multimodal context marketplace

1. A method of associating a multimodal context with one or more transaction values, the method comprising:

making a multimodal context available for display at one or more service provider computer systems over a computer network by a marketplace computer, wherein the multimodal context is generated from multimodal information comprising at least two multimedia data types, the multimodal information comprising metadata and information extracted from the at least two multimedia data types;

receiving by the marketplace computer from the one or more service providers an indication associated with the multimodal context, said indication comprising:

a provider's fixed price value, or

a provider's maximum value willing to pay and the provider's auction incrementing value, or

a provider's minimum value willing to accept and the provider's auction decrementing value;

determining a transaction value, associated with the multimodal context, by the marketplace computer for each service provider comprising:

for each received indication being a fixed price value, setting the provider's transaction value to the provider's fixed price value;

for each received indication being a maximum value and auction incrementing value for a sponsorship model, executing an automatic auction, wherein the automatic auction determines a transaction value for each provider further comprising:

for conditions that apply, setting the provider's transaction value to the provider's maximum value; and

for conditions that apply, setting the provider's transaction value to a current iterative value; and

for each received indication being a minimum value and auction decrementing value for a reverse auction model, executing an automatic auction, wherein the automatic auction determines a transaction value for each respective provider further comprising:

for conditions that apply, setting the provider's transaction value to the respective provider's minimum value; and

for conditions that apply, setting the provider's transaction value to a current iterative value;

when the sponsorship model is indicated, displaying all transaction values associated with the multimodal context for the sponsorship model, and not the reverse auction model; and

when the reverse auction is indicated, displaying all transaction values associated with the multimodal context for the reverse auction model, and not the sponsorship model.

2. The method of claim 1 wherein the multimodal information comprises information extracted from a visual image.

3. The method of claim 1 wherein the multimodal information comprises information extracted from a video.

4. The method of claim 1 wherein the multimodal information comprises information extracted from an audio track.

5. The method of claim 1 wherein the multimodal information comprises information extracted from a video and an audio track associated with the video.

6. The method of claim 1 wherein the metadata extracted comprises a time stamp.

7. The method of claim 1 wherein one of the at least two multimedia data types which can be being handled comprises an image.

8. The method of claim 1 wherein one of the at least two multimedia data types which can be handled comprises an audio type.

9. The method of claim 1 wherein one of the at least two multimedia data types which can be handled comprises a video type.

10. The method of claim 1 comprising:

generating a graphical user interface on a computer screen comprising:

a first portion of a window to display on a computer screen context information extracted from an image, the context information comprising text identifying an object in the image,

a first input box of the window to input a URL of an information service to be associated with the context information,

a second input box of the window to input a price to pay for associating the information service to the context information, and

a button to submit the URL and the price to the marketplace system.

11. The method of claim 1 wherein the at least two multimedia data types which can be handled comprise at least audio and visual information.

12. The method of claim 1 wherein the at least two multimedia data types which can be handled comprise at least still image and video sequence information.

13. The method of claim 1 wherein the at least two multimedia data types which can be handled comprise at least graphical and textual information.

14. The method of claim 1 wherein the at least two multimedia data types which can be handled comprise at least still image and audio speech information.

15. The method of claim 1 wherein the at least two multimedia data types which can be handled comprise at least audio and textual information.

16. The method of claim 1 wherein the at least two multimedia data types which can be handled comprise at least visual and textual information.

17. The method of claim 1 wherein the multimodal context generated at a server.

18. The method of claim 1 wherein the multimodal information is submitted via a mobile phone.

19. The method of claim 1 wherein the multimedia data types are submitted via a mobile phone.

20. The method of claim 1 wherein the multimodal information comprises visual data submitted via a mobile phone.