IP Library Granted Patent US 10,726,266
Granted Patent B2
US 10,726,266 · App. 15/908,807 · Granted Jul 28, 2020

Virtualization of tangible interface objects

Inventors: Pramod Kumar Sharma (San Jose, CA); Jerome Scholler (San Francisco, CA)
Assignee: Tangible Play, Inc.
G06K9/00671G06F1/1632G06F1/1686G06F3/017G06F3/0304G06F3/0317G06F3/0346G06F3/0425G06F3/04883G06K9/00355H04N5/2252H04N5/23296
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,726,266
App. No.
15/908,807
Granted
Jul 28, 2020
Kind
B2
Abstract

An example system includes a computing device located proximate to a physical activity surface, a video capture device, and a detector. The video capture device is coupled for communication with the computing device and is adapted to capture a video stream that includes an activity scene of the physical activity surface and one or more interface objects physically intractable with by a user. The detector processes the video stream to detect the one or more interface objects included in the activity scene, to identify the one or more interface objects that are detectable, to generate one or more events describing the one or more interface objects, and to provide the one or more events to an activity application configured to render virtual information on the one or more computing devices based on the one or more events.

Claims (49)

1. A camera adapter comprising:

a housing configured to retain and position an optical element; and

a connector configured to detachably connect the housing to a computing device situated on an activity surface such that the housing covers at least a portion of a field of view of a video capture device of the computing device that is facing forward and the optical element adapts at least a portion of the field of view of the video capture device to face downward toward the activity surface.

2. The camera adapter of claim 1 , wherein the optical element is positioned at an angle within the housing to redirect the field of view of the video capture device toward the activity surface and the activity surface is located proximate to the computing device.

3. The camera adapter of claim 1 , wherein

the optical element redirects light reflected from the activity surface into the video capture device to capture at least a portion of the activity surface by the video capture device, the optical element having an optical effect that modifies the portion of the activity surface being captured by the video capture device.

4. The camera adapter of claim 3 , wherein:

the optical element is a convex mirror having a fisheye effect that enlarges the portion of the activity surface being captured by the video capture device.

5. The camera adapter of claim 1 , wherein the optical element includes one or more optical components that adapt a first portion of the field of view of the video capture device and leave a second portion of the field of view of the video capture device unaltered.

6. The camera adapter of claim 5 , wherein:

the optical element redirects the first portion of the field of view of the video capture device toward the activity surface to capture an activity scene of the activity surface; and

the optical element leaves the second portion of the field of view of the video capture device unaltered to capture a user scene of a user facing the computing device.

7. The camera adapter of claim 1 , wherein:

the optical element includes a mirror, the mirror including a reflective layer positioned on a front side of a base surface, the reflective layer substantially reflecting light off the reflective layer without passing the light through the base surface.

8. The camera adapter of claim 7 , wherein:

the mirror includes a coating layer positioned on a front side of the reflective layer, the coating layer having a thickness satisfying a thickness threshold.

9. The camera adapter of claim 1 , wherein:

the camera adapter is compatibly placeable in a channel that is formed in a stand configured to receive and retain the computing device.

10. The camera adapter of claim 9 , wherein:

the camera adapter and the stand include compatible magnets to magnetically secure the camera adapter in the channel of the stand when the camera adapter is placed in the channel.

11. The camera adapter of claim 1 , wherein:

the video capture device is located on a rear surface of the computing device; and

the optical element is positioned at an angle within the housing to redirect light reflected from the activity surface located in front of the computing device into the video capture device.

12. A camera adapter comprising:

a housing configured to retain and position an optical element; and

a slot in a bottom side of the housing, the slot being configured to detachably connect to an edge of a computing device such that the housing covers at least a portion of a video capture device of the computing device and the optical element splits a field of view of the video capture device into a first portion of the field of view and a second portion of the field of view and redirects the first portion of the field of view toward an activity surface.

13. The camera adapter of claim 12 , wherein

the optical element redirects the first portion of the field of view of the video capture device downward to capture an activity scene of the activity surface located proximate to the computing device; and

the optical element leaves the second portion of the field of view of the video capture device unaltered to capture a user scene of a user facing the computing device.

14. The camera adapter of claim 12 , wherein

the optical element has an optical effect that modifies a portion of the activity surface being captured by the video capture device.

15. The camera adapter of claim 12 , wherein

the optical element redirects the first portion of the field of view of the video capture device to a first portion of the activity surface to capture a first activity scene of the activity surface; and

the optical element redirects the second portion of the field of view of the video capture device to a second portion of the activity surface to capture a second activity scene of the activity surface.

16. A camera adapter comprising:

an optical element housing including

a front portion connected to a first side portion and a second side portion to form a recession space in the optical element housing; and

a slot formed on the first side portion and the second side portion of the optical element housing to receive an edge of a computing device such that a video capture device of the computing device faces the recession space and the video capture device is covered by the optical element housing; and

an optical element positioned at an angle in the recession space of the optical element housing to adapt a field of view of the video capture device.

17. The camera adapter of claim 16 , wherein:

the optical element redirects at least a portion of the field of view of the video capture device toward an activity surface located proximate to the computing device.

18. The camera adapter of claim 16 , wherein:

the slot includes a first edge resting on a front surface of the computing device and a second edge resting on a back surface of the computing device when the optical element housing is situated on the edge of the computing device.

19. The camera adapter of claim 18 , wherein:

the first edge of the slot is flat;

the back surface of the computing device is curved; and

the second edge of the slot is curved to be compatible with the curved back surface of the computing device.

20. The camera adapter of claim 18 , wherein:

the second edge of the slot includes a retaining element to securely retain the optical element housing against the back surface of the computing device when the optical element housing is situated on the edge of the computing device.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 30, 2026
From: TANGIBLE PLAY, INC.
To: PLAY OSMO INC.
Reel/Frame 074224/0665 →
RELEASE OF SECURITY INTEREST Recorded May 30, 2025
From: GLAS TRUST COMPANY LLC
To: CLAUDIA Z. SPRINGER, AS CHAPTER 11 TRUSTEE OF TANGIBLE PLAY, INC., ON BEHALF OF THE ESTATE OF DEBTOR TANGIBLE PLAY, INC.
Reel/Frame 071473/0897 →
SECURITY INTEREST Recorded Nov 1, 2024
From: CLAUDIA Z. SPRINGER, AS CHAPTER 11 TRUSTEE OF EPIC! CREATIONS, INC., ON BEHALF OF THE ESTATE OF DEBTOR EPIC! CREATIONS, INC.; CLAUDIA Z. SPRINGER, AS CHAPTER 11 TRUSTEE OF NEURON FUEL, INC., ON BEHALF OF THE ESTATE OF DEBTOR NEURON FUEL, INC.; CLAUDIA Z. SPRINGER, AS CHAPTER 11 TRUSTEE OF TANGIBLE PLAY, INC., ON BEHALF OF THE ESTATE OF DEBTOR TANGIBLE PLAY, INC.
To: GLAS TRUST COMPANY LLC
Reel/Frame 069290/0456 →
SECURITY INTEREST Recorded May 16, 2022
From: TANGIBLE PLAY, INC.
To: GLAS TRUST COMPANY LLC
Reel/Frame 060257/0811 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 26, 2018
From: SHARMA, PRAMOD KUMAR; SCHOLLER, JEROME
To: TANGIBLE PLAY, INC.
Reel/Frame 045352/0440 →
Continuity (6)
Continuation 15384075 · Dec 19, 2016
Continuation 15151213 · May 10, 2016
Continuation 14842777 · Sep 1, 2015
Continuation 13928111 · Jun 26, 2013
Provisional Application 61714138 · Oct 15, 2012
Related Publication 20190156119A1 · May 23, 2019
Cited By (2)
US 12,468,379 US 12,663,874