Capturing color information from a physical environment

1. A system comprising:

a processor; and

memory including instructions that, when executed by the processor, cause the system to:

determine image data that includes a representation of a physical environment from a sensor;

determine color information from the image data using a first neural network comprising first layers of nodes, the color information describing colors in the physical environment according to the sensor;

determine scene information from the image data using a second neural network comprising second layers of nodes, the scene information describing a feature of the physical environment;

determine colors responsive to the image data, the colors including at least a portion of the colors in the scene information; and

display the image data and an item that is associated with a modification of the color from the colors responsive to the image data.

2. The system of claim 1 , wherein the instructions when executed by the processor further enable the system to:

provide one or more of:

a selectable option to procure the item;

information associated with the item;

advertisement associated with the item; or

location information associated with stores that provide the item.

3. The system of claim 1 , wherein the instructions when executed by the processor further enable the system to:

generate a palette of colors that includes at least a portion of the plurality of colors;

modify the palette of colors according to the modification of the color;

receive a selection of a color from the palette of colors; and

overlay the item in a live camera view to provide an augmented reality view of the physical environment.

4. The system of claim 3 , wherein the instructions when executed by the processor further enable the system to:

receive an input for adjusting a zoom for a portion of the live camera view;

update the image data to the portion of the live camera view, the update to the image data including the color information with a degree of separation in the colors higher than the image data obtained without the zoom; and

update the palette of colors in response to the zoom.

5. The system of claim 3 , wherein the instructions when executed by the processor further enable the system to:

compare a first color of the colors with a stored color from a database to determine a visual similarity score between the first color and the stored color;

determine that the visual similarity score satisfies a threshold score; and

provide the stored color with a modification as part of the palette of colors.

6. The system of claim 1 , wherein the instructions when executed by the processor further enable the system to:

generate a color temperature slider that is configured to adjust the modification of the color from the colors responsive to the image data;

generate color temperatures associated with the adjustment; and

generate an updated item listing for the image data.

7. A computer-implemented method comprising:

receiving image data of a physical environment;

determining color information of colors in the physical environment from the image data using a first neural network comprising first layers of nodes;

determining scene information describing a feature of the physical environment from the image data using a second neural network comprising second layers of nodes; and

providing, for an electronic catalog, the image data and an item that is associated with a modification of a color from the colors in response to the image data.

8. The computer-implemented method of claim 7 , further comprising:

sending the color information to a server; and

providing, on a display screen of a computing device, the item as an overlay over the image data, the image data further comprising a live camera view.

9. The computer-implemented method of claim 7 , further comprising:

providing a live camera view from the image data;

displaying items in an item listing on the live camera view;

receiving a selection of the item from the item listing; and

overlaying the item over an area of the live camera view.

10. The computer-implemented method of claim 7 , further comprising:

providing a live camera view from the image data;

receiving a selection of a portion of the live camera view; and

providing the color information as describing a subset of the colors for the selection of the portion of the live camera view.

11. The computer-implemented method of claim 10 , further comprising:

receiving a selection of a lighting model to identify a selected lighting model, the selected lighting model calibrated to lighting conditions existing at a time the image data is captured;

adjusting, based at least in part on the selected lighting model, color settings of the colors; and

updating the item to reflect adjustments to the color settings of the colors.

12. The computer-implemented method of claim 7 , wherein the item is provided in accordance with a popularity measure for either the color or items in an item listing.

13. The computer-implemented method of claim 7 , wherein the color corresponds to a sponsored color, provided by a curator or an item sponsor of the item, the sponsor colors being complementary or contrasting colors to the color from the colors.

14. The computer-implemented method of claim 7 , wherein the color or the item corresponds to one of a particular brand of product preferred by a user, a complementary color to the color from the colors, or a contrasting color to the color from the colors.

15. The computer-implemented method of claim 7 , further comprising:

generating visual similarity scores between the color information and stored color information for the colors in a database of color samples;

comparing the visual similarity scores against a threshold; and

identifying the color based at least in part on the comparing of the visual similarity scores against the threshold.

16. The computer-implemented method of claim 15 , wherein generating the visual similarity scores further comprises:

associating first color values to the color samples in the database of color samples;

associating second color values to pixels providing the image data from the physical environment, the second color values forming the color information; and

comparing each of the second color values to each of the first color values to provide the visual similarity scores.

17. The computer-implemented method of claim 7 , further comprising:

determining that a first color value of the color information (a) satisfies a threshold value and (b) is associated with a first item of the item listing;

determining that a second color value of the color information (c) satisfies the threshold value and (d) is associated with a second item of the item listing;

modifying a first color and a second color associated with the first color value and the second color value respectively based in part on temperature in the color information; and

displaying the item in an order in the first color or the second color.

18. A non-transitory computer-readable storage medium including instructions that, when executed by at least one processor, cause the at least one processor to:

receive image data of a physical environment;

determine color information of colors in the physical environment from the image data using a first neural network comprising first layers of nodes;

determine scene information describing a feature of the physical environment from the image data using a second neural network comprising second layers of nodes; and

provide, for an electronic catalog, the image data and an item that is associated with a modification of a color from the colors in response to the image data.

19. The non-transitory computer-readable storage medium of claim 18 , wherein the instructions when executed further cause the at least one processor to:

send the color information to a server; and

provide, on a display screen of a computing device, the item as an overlay over the image data, the image data further comprising a live camera view.

20. The non-transitory computer-readable storage medium of claim 19 , wherein the instructions when executed further cause the at least one processor to:

save the live camera view as an original version and an augmented reality view having the item and the image data as an augmented version; and

display the original version and the augmented version, either concurrently or separately.