Welcome back to Beyond the Patterns. So today I have the great pleasure to welcome back
one of our former graduates of the lab, Professor Matthias Unberald. So he is now an assistant
professor in the Department of Computer Science at Johns Hopkins University with affiliations
to the Laboratory for Computational Sensing and Robotics and the Malone Center for Engineering
in Healthcare. He has created and is leading the Advanced Robotics and Computationally
Augmented Environments Lab, Arcade, that conducts research at the intersection of computer vision,
machine learning, augmented reality, robotics and medical imaging to develop collaborative
systems that assist clinical professionals across the healthcare spectrum. Previously,
Matthias was an assistant research professor in computer science and postdoctoral fellow
in the Laboratory for Computational Sensing and Robotics at Hopkins and completed his
PhD in computer science at the Friedrich-Alexander-Universität in Nuremberg in Germany from which he graduated
summa cum laude in 2017. While completing a bachelor's in physics and a master's in
optical technologies at FAU, Matthias studied at the University of Eastern Finland as an
Erasmus scholar in 2011 and joined Stanford University as a DAAD fellow throughout 2014.
Matthias has published more than 80 journal and conference articles and has received numerous
awards, grants and fellowships including the NIH NIBIB R21 Trey Blazer Award. It's a great
pleasure to have him back here at our university and today he will be presenting Bridging Domains
in Medical Imaging – Differential Mappings between Two- and Three-dimensional Data Domains.
Matthias, it's a great pleasure to have you back and the stage is yours.
Thank you, Andreas, for the kind introduction and more importantly for the wonderful invitation.
It's always a pleasure to be back in Erlangen this year. Unfortunately, virtually I would
have loved to visit you in person and appreciate the Christmas spirit that is, it just feels
so much more like Christmas if you're in Germany, not in Baltimore, although they tried
to emulate it here in the inner harbor as well with the Christmas market. It just doesn't
feel the same. So I've decided today to talk about some of our recent work that plays a
role in between 2D and 3D data domains because we all know that medical imaging data lives
in between these domains. We have 2D data, we have 3D data and connecting these domains
seems to play an important role and I will give you a better introduction to that topic
in a little bit. It's a pleasure for me to see some of the familiar faces back from the
time when I was with the LME in Erlangen and for everyone else. Matthias, I graduated from
the same lab in 2017 and you have a great advisor Andreas. I'm sure you'll be very successful
in the future. So before starting the actual content of my talk, I want to mention that
this is the work of many people. We have collaborators within my group of course we have collaborators
within the Department of Computer Science, but more importantly also with hospitals,
with the Johns Hopkins Hospital that is a leader in many regards where we get to talk
and inform our method development by the problems that they encounter in their everyday practice.
And working together with them on the problems is great because it allows us to shape a way
forward together so that the solutions that we develop neatly fit into their surgical
workflows. And then there are some collaborations of course also with this group in fact. So
thank you for that. It's always been great. All right. So bridging domains and medical
imaging. Why do we need this? So I think you probably all know that medical imaging is
an enabling technology. And when I say enabling technology, then I mean that quite broadly
because what we're seeing now is that with the medical imaging modalities that are deployed
all across the hospital, we are now able to perform non-invasive diagnosis, which allows
us to investigate certain disease patterns without having to biopsy for example. And
it allows us to perform procedural planning and map out the steps that will need to be
performed intraoperatively. And then we have other modalities that are deployed intraoperatively,
which allow us to rethink surgery and develop less invasive surgical approaches that are
now guided by imaging technology. And this is really the focus of today's talk, which
is image guided interventions. Now, while these approaches now are less invasive, they
Presenters
Zugänglich über
Offener Zugang
Dauer
01:08:12 Min
Aufnahmedatum
2020-12-14
Hochgeladen am
2020-12-15 00:48:41
Sprache
en-US
It’s a great pleasure to welcome Prof. Dr. Mathias Unberath back to FAU.
Abstract: Differentiably connecting 2- and 3-dimensional domains is of substantial interest in medical imaging as it enables transformational image processing techniques that substantially add value without disrupting clinical workflow. In this talk, I will introduce our recent advances in dense 3D reconstruction and differentiable rendering using examples in endoscopic and X-ray-guided surgery.
Short Bio: Mathias Unberath is an Assistant Professor in the Department of Computer Science at Johns Hopkins University with affiliations to the Laboratory for Computational Sensing and Robotics and the Malone Center for Engineering in Healthcare. He has created and is leading the Advanced Robotics and Computationally AugmenteD Environments (ARCADE) Lab that conducts research at the intersection of computer vision, machine learning, augmented reality, robotics, and medical imaging to develop collaborative systems that assist clinical professionals across the healthcare spectrum.
Previously, Mathias was an Assistant Research Professor in Computer Science and postdoctoral fellow in the Laboratory for Computational Sensing and Robotics at Hopkins and completed his Ph.D. in Computer Science at the Friedrich-Alexander-Universität Erlangen-Nürnberg from which he graduated summa cum laude in 2017. While completing a Bachelor’s in Physics and Master’s in Optical Technologies at FAU Erlangen, Mathias studied at the University of Eastern Finland as an ERASMUS scholar in 2011 and joined Stanford University as a DAAD fellow throughout 2014.
Mathias has published more than 80 journal and conference articles and has received numerous awards, grants, and fellowships, including the NIH NIBIB R21 Trailblazer Award.
References
- Gao, C., Liu, X., Gu, W., Killeen, B., Armand, M., Taylor, R., & Unberath, M. (2020). Generalizing Spatial Transformers to Projective Geometry with Applications to 2D/3D Registration. MICCAI 2020.
- Gu, W., Gao, C., Grupp, R., Fotouhi, J., & Unberath, M. (2020, October). Extended Capture Range of Rigid 2D/3D Registration by Estimating Riemannian Pose Gradients. In International Workshop on Machine Learning in Medical Imaging (pp. 281-291). Springer, Cham.
- Grupp, R. B., Unberath, M., Gao, C., Hegeman, R. A., Murphy, R. J., Alexander, C. P., ... & Taylor, R. H. (2020). Automatic annotation of hip anatomy in fluoroscopy for robust and efficient 2D/3D registration. International Journal of Computer Assisted Radiology and Surgery, 1-11.
- Liu, X., Sinha, A., Ishii, M., Hager, G. D., Reiter, A., Taylor, R. H., & Unberath, M. (2019). Dense depth estimation in monocular endoscopy with self-supervised learning methods. IEEE transactions on medical imaging, 39(5), 1438-1447.
- Liu, X., Zheng, Y., Killeen, B., Ishii, M., Hager, G. D., Taylor, R. H., & Unberath, M. (2020). Extremely Dense Point Correspondences using a Learned Feature Descriptor. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 4847-4856).
- Liu, X., Stiber, M., Huang, J., Ishii, M., Hager, G. D., Taylor, R. H., & Unberath, M. (2020). Reconstructing Sinus Anatomy from Endoscopic Video--Towards a Radiation-free Approach for Quantitative Longitudinal Assessment. MICCAI 2020.
This video is released under CC BY 4.0. Please feel free to share and reuse.
For reminders to watch the new video follow on Twitter or LinkedIn. Also, join our network for information about talks, videos, and job offers in our Facebook and LinkedIn Groups.
Music Reference:
Damiano Baldoni - Thinking of You (Intro)
Damiano Baldoni - Poenia (Outro)