IP Library › Granted Patent US 12,213,747
Granted Patent B2
US 12,213,747 · App. 17/581,933 · Granted Feb 4, 2025

Optical communication system

Inventors: Joel Zuhars (Fremont, CA); Saleh Tabandeh (Fremont, CA)
Assignee: Think Surgical, Inc.
A61B34/20A61B90/39H04B10/116A61B2017/00221A61B2034/2055A61B90/30A61B2090/3937A61B2090/3945A61B2090/397A61B2090/3983H04B10/112
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,213,747
App. No.
17/581,933
Granted
Feb 4, 2025
Kind
B2
Abstract

An optical tracking system includes at least one tracking array for generating and optically transmitting data between 1 and 2,000 MB/s. At least one tracker for optically receiving the optically transmitted data between 1 and 2,000 MB/s is also provided. The tracking system is used not only for tracking objects and sending tracking information quickly but also providing the user or other components in an operating room with additional data relevant to an external device such as a computer assisted device. Orthopedic surgical procedures such as total knee arthroplasty (TKA) are performed more efficiently and with better result with the optical tracking system.

Claims (26)

1. A surgical device for operating a tool, comprising:

three or more first light emitting diodes (LEDs), wherein at least one of the three or more first LEDs is configured to both emit a tracking signal for a tracker to determine a position of the surgical device and transmit data associated with the surgical device;

a photosensor for receiving positional data from a second LED coupled to a tracker, wherein the positional data includes a position of the surgical device relative to a position of a patient;

a processor for receiving and processing the data from the photosensor to create instructions; and

a controller for moving a position of the tool relative to the position of the patient in response to the instructions received from the processor.

2. The surgical device of claim 1 wherein a tracker tracks at least one of: i) the position of the surgical device; ii) the position of the tool; or iii) the position of the patient.

3. The surgical device of claim 2 wherein the tracker communicates position information to the second LED for transmission of the positional data to the photosensor.

4. The surgical device of claim 2 wherein the tracker comprises a processor and two or more tracker photosensors in communication with the tracker processor.

5. The surgical device of claim 4 wherein the tracker photosensors comprise a photodiode, CCD, CMOS camera, or a combination thereof.

6. The surgical device of claim 1 wherein the second LED emits light for data transmission to the photosensor.

7. The surgical device of claim 6 wherein the light is visible light or infrared light.

8. The surgical device of claim 1 wherein the data associated with the surgical device comprises at least one of: i) an operating status of the surgical device; ii) data logged by the surgical device; or iii) a battery life of the surgical device.

9. The surgical device of claim 1 further comprising at least one of: i) a hand-held drill; ii) a robot; or a hand-held saw.

10. A surgical system, comprising:

the surgical device of claim 1 ; and

a tracker for tracking at least one of the position of the surgical device, the position of the tool, or the position of the patient, wherein the tracker communicates position information to the second LED for transmission of the positional data to the photosensor.

11. The system of claim 10 wherein the data associated with the surgical device comprises at least one of: i) an operating status of the surgical device; ii) data logged by the surgical device; or iii) a battery life of the surgical device.

12. The system of claim 10 wherein the second LED emits light for data transmission to the photosensor.

13. The system of claim 12 wherein the light is visible light or infrared light.

14. The system of claim 10 wherein the tracker comprises a processor and two or more tracker photosensors in communication with the tracker processor.

15. The system of claim 14 wherein the tracker photosensors comprise a photodiode, CCD, CMOS camera, or a combination thereof.

16. The system of claim 10 wherein the surgical device further comprises at least one of: i) a hand-held drill; ii) a robot; or iii) a hand-held saw.

17. The surgical device of claim 1 wherein the at least one of the three LEDs is modulated to transmit data at different data rates.

18. The surgical device of claim 1 wherein the at least one of the three LEDs is modulated to transmit a first type of data at a first data rate and a second type of data at a second data rate.

19. The surgical device of claim 18 wherein the at least one of the three LEDs is modulated to transmit the first type of data and the second type of data in parallel.

20. The surgical device of claim 1 wherein the positional data is pre-processed or processed by the process prior to receipt by the photosensor.

Assignments (2)
SECURITY INTEREST Recorded Jun 12, 2026
From: THINK SURGICAL, INC.
To: SYMBIOTIC CAPITAL AGENCY LLC, AS COLLATERAL AGENT
Reel/Frame 075736/0843 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 23, 2022
From: ZUHARS, JOEL; TABANDEH, SALEH
To: THINK SURGICAL, INC.
Reel/Frame 058733/0445 →
Continuity (4)
Continuation 16695990 · Nov 26, 2019
Continuation 15505167
Provisional Application 62083052 · Nov 21, 2014
Related Publication 20220142717A1 · May 12, 2022
References Cited (141)
US 4396945A · DiMatteo · 1983 [cited by applicant]
US 4971069A · Gracovetsky · 1990 [cited by applicant]
US 5198877A · Schulz · 1993 [cited by applicant]
US 5617857A · Chader · 1997 [cited by applicant]
US 5622170A · Schulz · 1997 [cited by applicant]
US 5662111A · Cosman · 1997 [cited by applicant]
US 5921992A · Costales · 1999 [cited by applicant]
US 5961456A · Gildenberg · 1999 [cited by applicant]
US 6061644A · Leis · 2000 [cited by applicant]
US 6273896B1 · Franck · 2001 [cited by applicant]
US 6324296B1 · McSheery · 2001 [cited by applicant]
US 6390982B1 · Bova · 2002 [cited by applicant]
US 6437820B1 · Josefsson · 2002 [cited by applicant]
US 6608688B1 · Faul · 2003 [cited by applicant]
US 6630915B1 · Flood · 2003 [cited by applicant]
US 6725080B2 · Melkent · 2004 [cited by applicant]
US 6801637B2 · Voronka et al. · 2004 [cited by applicant]
US 6892090B2 · Verard · 2005 [cited by applicant]
US RE39102E · Schulz · 2006 [cited by applicant]
US 7166114B2 · Moctezuma De La Barrera et al. · 2007 [cited by applicant]
US 7256899B1 · Faul · 2007 [cited by applicant]
US 7294106B2 · Birkenbach · 2007 [cited by applicant]
US 7309965B2 · Dowling et al. · 2007 [cited by applicant]
US 7415212B2 · Matsushita · 2008 [cited by applicant]
US 7491165B2 · Kogasaka · 2009 [cited by applicant]
US 7583901B2 · Nakagawa et al. · 2009 [cited by applicant]
US 7725162B2 · Malackowski et al. · 2010 [cited by applicant]
US 7771436B2 · Moctezuma De La Barrera et al. · 2010 [cited by applicant]
US 7869861B2 · Moctezuma de la Barrera · 2011 [cited by applicant]
US 7889906B2 · Smith · 2011 [cited by applicant]
US 8082064B2 · Kay · 2011 [cited by examiner]
US 8188878B2 · Pederson et al. · 2012 [cited by applicant]
US 8702592B2 · Langlois · 2014 [cited by applicant]
US 8942571B2 · Chen · 2015 [cited by applicant]
US 20010034530A1 · Malackowski · 2001 [cited by examiner]
US 20010037064A1 · Shahidi · 2001 [cited by examiner]
US 20020065461A1 · Cosman · 2002 [cited by applicant]
US 20020131121A1 · Jeganathan · 2002 [cited by applicant]
US 20030004518A1 · Perren · 2003 [cited by applicant]
US 20030043435A1 · Oettinger · 2003 [cited by applicant]
US 20030163142A1 · Paltieli · 2003 [cited by examiner]
US 20040097952A1 · Sarin · 2004 [cited by applicant]
US 20040138556A1 · Cosman · 2004 [cited by applicant]
US 20040243148A1 · Wasielewski · 2004 [cited by applicant]
US 20050041980A1 · Ueyanagi · 2005 [cited by applicant]
US 20050116821A1 · Wilsey et al. · 2005 [cited by applicant]
US 20060067707A1 · Maniam · 2006 [cited by applicant]
US 20060142657A1 · Quaid · 2006 [cited by applicant]
US 20070081695A1 · Foxlin et al. · 2007 [cited by applicant]
US 20070137372A1 · Devengenzo · 2007 [cited by examiner]
US 20070225595A1 · Malackowski · 2007 [cited by examiner]
US 20070239153A1 · Hodorek · 2007 [cited by applicant]
US 20070268363A1 · Raskar et al. · 2007 [cited by applicant]
US 20070270685A1 · Kang · 2007 [cited by applicant]
US 20080009697A1 · Haider · 2008 [cited by applicant]
US 20080027464A1 · Moll · 2008 [cited by applicant]
US 20080039717A1 · Frigg · 2008 [cited by applicant]
US 20080051910A1 · Kammerzell · 2008 [cited by applicant]
US 20080119727A1 · Barbagli · 2008 [cited by applicant]
US 20080135733A1 · Feilkas · 2008 [cited by applicant]
US 20080147089A1 · Loh · 2008 [cited by applicant]
US 20080200794A1 · Teichman · 2008 [cited by applicant]
US 20080218770A1 · Moll · 2008 [cited by applicant]
US 20090297166A1 · Nakagawa · 2009 [cited by applicant]
US 20100168562A1 · Zhao · 2010 [cited by applicant]
US 20100272442A1 · Lechner · 2010 [cited by applicant]
US 20110015521A1 · Faul · 2011 [cited by applicant]
US 20110164884A1 · Yamada · 2011 [cited by applicant]
US 20120155889A1 · Kim · 2012 [cited by applicant]
US 20120308239A1 · Sheth · 2012 [cited by applicant]
US 20130006120A1 · Druse · 2013 [cited by applicant]
US 20130029682A1 · Ganick et al. · 2013 [cited by applicant]
US 20130033700A1 · Hallil · 2013 [cited by applicant]
US 20130060146A1 · Yang et al. · 2013 [cited by applicant]
US 20130060278A1 · Bozung · 2013 [cited by examiner]
US 20130064427A1 · Picard · 2013 [cited by applicant]
US 20130184571A1 · Wilkening · 2013 [cited by applicant]
US 20130211419A1 · Jensen · 2013 [cited by examiner]
US 20130236183A1 · Chao · 2013 [cited by applicant]
US 20130251374A1 · Chen · 2013 [cited by applicant]
US 20130266314A1 · Lee · 2013 [cited by applicant]
US 20140039517A1 · Bowling · 2014 [cited by applicant]
US 20140039520A1 · Haider et al. · 2014 [cited by applicant]
US 20140058556A1 · Kawano · 2014 [cited by applicant]
US 20140088410A1 · Wu · 2014 [cited by applicant]
US 20140161466A1 · Riza · 2014 [cited by applicant]
US 20140206990A1 · Epstein · 2014 [cited by examiner]
US 20140235976A1 · Bresch · 2014 [cited by applicant]
US 20140248058A1 · Simpson · 2014 [cited by applicant]
US 20150094736A1 · Malackowski · 2015 [cited by applicant]
US 20150215040A1 · Dickson · 2015 [cited by applicant]
US 20160020855A1 · Guetta · 2016 [cited by applicant]
US 20160081753A1 · Kostrzewski · 2016 [cited by applicant]
US 20160119060A1 · Byers · 2016 [cited by examiner]
US 20160314710A1 · Jarc · 2016 [cited by applicant]
US 20160359560A1 · Baggen · 2016 [cited by applicant]
US 20170007328A1 · Cattin · 2017 [cited by applicant]
US 20170104532A1 · Stout · 2017 [cited by applicant]
US 20170105713A1 · Frimer · 2017 [cited by applicant]
US 20170245946A1 · Tabandeh · 2017 [cited by applicant]
US 20180132946A1 · Kao · 2018 [cited by applicant]
CN 103117802A · 2013 [cited by applicant]
CN 203167127U · 2013 [cited by applicant]
DE 102009002677A1 · 2010 [cited by applicant]
GB 2484979A · 2012 [cited by applicant]
JP 2002510803A · 2002 [cited by applicant]
JP 2007131213A · 2007 [cited by applicant]
WO 9830978A1 · 1998 [cited by applicant]
WO 9938449A1 · 1999 [cited by applicant]
WO 0154558A2 · 2001 [cited by applicant]
WO 2011154949A2 · 2011 [cited by applicant]
WO 2016049180A1 · 2016 [cited by applicant]
U.S. Appl. No. 16/695,990, filed Nov. 26, 2019. [cited by applicant]
U.S. Appl. No. 15/505,167, filed Feb. 20, 2017. [cited by applicant]
First Office Action issued in corresponding Korean Patent Appln. No. 10-2017-7013544, dated Feb. 15, 2022. [cited by applicant]
Madritsch, Franz, “CCD-Camera Based Optical Tracking for Human-Computer Interaction”, Inst. f. Computer Grphics, Graz Univ. of Technology, Munzgrabenstr. 11, A-8010, Graz, Austria, the International Journal of Virtual R… [cited by applicant]
Welch, Greg et al., “High-Performance Wide-Area Optical Tracking, the HiBall Tracking System”, Presence: Teleoperators and Virtual Environments, Feb. 2001, pp. 1-21, vol. 10, Issue 1, © 2001 by the Massachusetts Institu… [cited by applicant]
Pang, Grantham, K.H. et al., “LED Location Beacon System Based on Processing of Digital Images”, IEEE Transactions on Intelligent Transportation Systems, Sep. 2001, pp. 135-150, vol. 2, Issue 3, © 2001 IEEE; DOI: 10.110… [cited by applicant]
Liu, Hugh Sing and Pang, Grantham, “Positioning Beacon System Using Digital Camera and LEDs”, IEEE Transactions on Vehicular Technology, Mar. 2003, pp. 406-419, vol. 52, Issue 2, © 2003 IEEE; DOI: 10.1109/TVT.2003.80880… [cited by applicant]
Kishino, Y. et al., “Realizing a Visual Marker using LEDs for Wearable Computing Environment”, 23rd International Conference on Distributed Computing Systems Workshops, 2003, Proceedings, May 2003, 6 pages, © 2003 IEEE;… [cited by applicant]
Naimark, Leonid and Foxlin, Eric, “Encoded LED System for Optical Trackers”, Proceedings of the International Symposium on Mixed and Augmented Reality, Oct. 2005, 4 pages, © 2005 IEEE; DOI: 10.1109/ISMAR.2005.28. [cited by applicant]
Cassinis, Riccardo et al., “Active markers for outdoor and indoor robot localization”, Department of Electronics for Automation, University of Brescia, via Branze 38, I-25123, Brescia, Italy, 2005, 8 pages. [cited by applicant]
Oggier, T. et al., “Miniaturized all-solid-state 3D camera for real-time range imaging”, CSEM SA, Swiss Center for Electronics and Microtechnology, Badenerstrasse 569, CH 8048 Zurich, Switzerland, 2005, 7 pages. [cited by applicant]
MacLachlan, Robert and Riviere, Cameron, “Optical Tracking for Performance Testing of Microsurgical Instruments”, Robotics Institute, School of Computer Science, Carnegie Mellon University, Pittsburgh, Pennsylvania 1521… [cited by applicant]
Raskar, R. et al., “Prakash: Lighting Aware Motion Capture using Photosensing Markers and Multiplexed Illuminators”, ACM Trans. Graph., Jul. 2007, 11 pages, vol. 26, Issue 3; DOI: 10.1145/1276377.1276422. [cited by applicant]
Maclachlan, Robert A. and Riviere, Cameron N., “High-Speed Microscale Optical Tracking Using Digital Frequency-Domain Multiplexing”, IEEE Transactions on Instrumentation and Measurement, Jun. 2009, pp. 1991-2001, vol. 5… [cited by applicant]
Chinthaka, H. et al., “High-speed-camera Image Processing Based LED Traffic Light Detection for Road-to-vehicle Visible Light Communication”, 2010 IEEE Intelligent Vehicles Symposium, University of California, San Diego… [cited by applicant]
Kumar, Neelesh et al., “Active marker based kinematic and spatio-temporal gait measurement system using LabView vision”, Journal of Scientific & Industrial Research, Aug. 2010, pp. 600-605, vol. 69, Issue 8. [cited by applicant]
Ladha, Cassim et al., “TouchBridge: Augmenting Active Tangibles for Camera-based Multi-touch Surfaces”, ITS 2010 ACM International Conference on Interactive Tabletops and Surfaces, Nov. 2010, 2 pages, © 2010 ACM; DOI: 1… [cited by applicant]
Hofstetter, Matthias, “Temporal Pattern-Based Active Marker Identification and Tracking Using a Dynamic Vision Sensor”, Master Thesis, Swiss Federal Institute of Technology Zurich, Jan. 2012, 107 pages. [cited by applicant]
Electrical Engineering Stack Exchange, “Any ideas to make IR LEDs identifiable during position-tracking?”, Aug. 2012, 4 pages, Retrieved from the Internet on Jul. 3, 2014; https://electronics.stackexchange.com/questions… [cited by applicant]
ART GmbH, “System user manual, ARTtrack®, Trackpack & DTrack®”, ART GmbH, Am Öferl 6, D-82362 Weilheim i. OB, Germany, May 2013, 185 pages, Version 2.9, © 2013 by ART GmbH; https://www.ar-tracking.de. [cited by applicant]
Kasashima, T. et al., “Interpixel Interference Cancellation Method for Road-to-Vehicle Visible Light Communication”, 2013 IEEE 5th International Symposium on Wireless Vehicular Communications (WiVeC), Jun. 2013, 5 pages… [cited by applicant]
Takai, I. et al., “LED and CMOS Image Sensor Based Optical Wireless Communication System for Automotive Applications”, IEEE Photonics Journal, Oct. 2013, 19 pages, vol. 5, Issue 5, © 2013 IEEE; DOI: 10.1109/JPHOT.2013.2… [cited by applicant]
Xiao, Robert et al., “Lumitrack: Low Cost, High Precision, High Speed Tracking with Projected m-Sequences”, Proceedings of the 26th annual ACM symposium on User interface software and technology, Oct. 2013, 10 pages, © … [cited by applicant]
Censi, Andrea et al., “Low-latency localization by Active LED Markers tracking using a Dynamic Vision Sensor”, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, Nov. 2013, 8 pages, © 2013 IEEE; D… [cited by applicant]
Rajagopal, N. et al., “Visual Light Landmarks for Mobile Devices”, IPSN-14 Proceedings of the 13th International Symposium on Information Processing in Sensor Networks, Apr. 2014, 12 pages, © 2014 IEEE; DOI: 10.1109/IPS… [cited by applicant]
Extended European Search Report dated Apr. 20, 2018 for European Application No. 15861363.8 filed Nov. 23, 2015. [cited by applicant]
Minh et al, High Speed Visible Light Communications Using Multiple Resonant Equalization, Jul. 2008, IEEE, Pages All Document. [cited by applicant]
Chen, Hsueh-Shih et al., “InGaN—CdSe—ZnSe Quantum Dots White LEDs”, IEEE Photonics Technology Letters, Jan. 1, 2006, pp. 193-195, vol. 18, issue 1, Copyright IEEE (2005). [cited by applicant]
International Search Report dated Feb. 29, 2016 for International Application No. PCT/US2015/062107 filed Nov. 23, 2015. [cited by applicant]