Methods and apparatus for detecting objects in proximity to a viewer and presenting visual representations of objects in a simulated environment

1. A method of operating an interactive system, comprising:

storing, in memory, mapping information indicating a mapping between different predetermined symbols and different types of physical objects, said mapping information including a first predetermined symbol used to identify a first type of physical object and a second predetermined symbol used to identify a second type of physical object;

operating a sensor on a head mounted device to capture an image of a physical environment in which a user is located;

detecting one or more physical objects in the physical environment where the user of said interactive system is physically located, said detecting including recognizing the first predetermined symbol in the captured image indicating the presence of a first physical object of the first type in the physical environment and recognizing the second predetermined symbol in the captured image indicating the presence of a second physical object of the second type in the physical environment; and

displaying a simulated environment to said user, displaying a simulated environment including displaying, on a display, a visual representation of at least the first physical object and a visual representation of the second physical object.

2. The method of claim 1 , wherein said

sensor is a camera of a cell phone which includes said display.

3. The method of claim 1 , further comprising:

determining a location of the first physical object relative to the user in the physical environment; and

wherein displaying the visual representation of at least the first physical object includes presenting the visual representation of the first physical object in the simulated environment at a location determined based on the location of said first physical object relative to the user in the physical environment.

4. The method of claim 3 , wherein determining a location of the first physical object relative to the user includes determining an angle between the first physical object and a forward viewing direction of the user in the physical environment.

5. The method of claim 3 , wherein determining a location of the first physical object relative to the user further includes determining a distance from the user to the first physical object.

6. The method of claim 1 , wherein each predetermined symbol has a predetermined shape, size or color; and

wherein said first predetermined symbol corresponds to a first type of beverage container and said second predetermined symbol corresponds to a second type of beverage container.

7. The method of claim 6 ,

further comprising:

storing in memory a list of objects that have been indicated by the user as being of interest to the user;

prior to said step of displaying a visual representation of at least the first physical object, determining if the detected first physical and second physical objects are included in the stored list of objects that have been indicated by the user as being of interest, said determining indicating that said first detected physical object is included in said stored list of objects; and

wherein said step of displaying, on a display, a visual representation of at least the first physical object includes excluding, from being displayed, visual representations of objects which are not on said list of objects, a visual representation of at least one detected physical object which is not on the list of objects that have been indicated by the user as being of interest not being displayed.

8. The method of claim 7 , further comprising:

prior to said step of displaying a visual representation of at least the first physical object, determining if any parental control restrictions apply to said user; and

wherein said step of displaying, on a display, a visual representation of at least the first physical object includes excluding from said display a visual representation of at least one detected physical object due to said parental control restrictions.

9. The method of claim 6 , wherein said first predetermined symbol corresponds to a soda can and said second predetermined symbol corresponds to a beer can.

10. The method of claim 1 , further comprising:

receiving mapping information from said user of said interactive system, said mapping information indicating a mapping between each of said predetermined symbols and corresponding physical object types, said predetermined symbols being included on labels placed on physical objects of the corresponding type in said physical environment.

11. The method of claim 1 , further comprising:

receiving user information corresponding to said user of the interactive system, said user information including age of the user and optionally parental control information applicable to the user; and

storing the received user information in memory.

12. An interactive system, comprising:

memory including stored mapping information indicating a mapping between different predetermined symbols and different types of physical objects, said mapping information including a first predetermined symbol used to identify a first type of physical object and a second predetermined symbol used to identify a second type of physical object;

a sensor on a head mounted device configured to capture an image of a physical environment in which a user is located;

an object detector configured to detect one or more physical objects in the physical environment where the user of said interactive system is physically located, said detecting including recognizing the first predetermined symbol in the captured image indicating the presence of a first physical object of the first type in the physical environment and recognizing the second predetermined symbol in the captured image indicating the presence of a second physical object of the second type in the physical environment;

a display device; and

a display controller configured to control displaying of a simulated environment to said user on said display device, said display controller being configured to control displaying of a visual representation of at least the first physical object and a visual representation of the second physical object on said display device as part of controlling displaying of the simulated environment to said user.

13. The system of claim 12 ,

wherein the sensor is a camera of a cell phone which includes said display device.

14. The system of claim 13 , wherein said controller is configured to control said camera to capture said image of the environment as part of being configured to control said sensor to capture information corresponding to the physical environment.

15. The system of claim 12 , further comprising:

a location determinator configured to determine a location of the first physical object relative to the user in the physical environment; and

wherein said display controller is further configured to present the visual representation of the first physical object in the simulated environment at a location determined based on the location of said first physical object relative to the user in the physical environment, as part of being configured to control displaying of the visual representation of at least the first physical object.

16. The system of claim 12 , wherein said object detector includes: a symbol recognizer configured to recognize a first predetermined symbol on at least said first physical object using an optical recognition technique, different predetermined symbols being used for different types of objects in said physical environment, each symbol having a predetermined shape, size or color; and wherein said object detector is further configured to identify said first physical object in said environment based on the recognized first predetermined symbol on said first physical object.

17. The system of claim 12 ,

wherein the system further comprises a determiner configured to determine if the first and second detected physical objects are included in a list of objects that have been indicated by the user as being of interest; and

wherein said display controller is further configured to exclude, from being displayed, visual representations of objects which are not on said list of objects.

18. The system of claim 17 , wherein said determiner is further configured to determine if any parental control restrictions apply to said user.

19. The system of claim 12 , further comprising:

a receiver configured to receive said mapping information, from said user of said interactive system.

20. A non-transitory computer readable medium including processor executable instructions which when executed by a processor control an interactive system to:

store, in memory, mapping information indicating a mapping between different predetermined symbols and different types of physical objects, said mapping information including a first predetermined symbol used to identify a first type of physical object and a second predetermined symbol used to identify a second type of physical object;

operate a sensor on a head mounted device to capture an image of a physical environment in which a user is located;

detect one or more physical objects in the physical environment where the user of said interactive system is physically located, said detecting including recognizing the first predetermined symbol in the captured image indicating the presence of a first physical object of the first type in the physical environment and recognizing the second predetermined symbol in the captured image indicating the presence of a second physical object of the second type in the physical environment; and

display a simulated environment to said user, displaying a simulated environment including displaying, on a display, a visual representation of at least the first physical object and a visual representation of the second physical object.