8 - Beyond the Patterns - Mathias Unberath - Bridging Domains in Medical Imaging — Differentiable Mappings Between 2- and 3-Dimensional Data Domains [ID:26549]
50 von 676 angezeigt

Welcome back to Beyond the Patterns. So today I have the great pleasure to welcome back

one of our former graduates of the lab, Professor Matthias Unberald. So he is now an assistant

professor in the Department of Computer Science at Johns Hopkins University with affiliations

to the Laboratory for Computational Sensing and Robotics and the Malone Center for Engineering

in Healthcare. He has created and is leading the Advanced Robotics and Computationally

Augmented Environments Lab, Arcade, that conducts research at the intersection of computer vision,

machine learning, augmented reality, robotics and medical imaging to develop collaborative

systems that assist clinical professionals across the healthcare spectrum. Previously,

Matthias was an assistant research professor in computer science and postdoctoral fellow

in the Laboratory for Computational Sensing and Robotics at Hopkins and completed his

PhD in computer science at the Friedrich-Alexander-Universität in Nuremberg in Germany from which he graduated

summa cum laude in 2017. While completing a bachelor's in physics and a master's in

optical technologies at FAU, Matthias studied at the University of Eastern Finland as an

Erasmus scholar in 2011 and joined Stanford University as a DAAD fellow throughout 2014.

Matthias has published more than 80 journal and conference articles and has received numerous

awards, grants and fellowships including the NIH NIBIB R21 Trey Blazer Award. It's a great

pleasure to have him back here at our university and today he will be presenting Bridging Domains

in Medical Imaging – Differential Mappings between Two- and Three-dimensional Data Domains.

Matthias, it's a great pleasure to have you back and the stage is yours.

Thank you, Andreas, for the kind introduction and more importantly for the wonderful invitation.

It's always a pleasure to be back in Erlangen this year. Unfortunately, virtually I would

have loved to visit you in person and appreciate the Christmas spirit that is, it just feels

so much more like Christmas if you're in Germany, not in Baltimore, although they tried

to emulate it here in the inner harbor as well with the Christmas market. It just doesn't

feel the same. So I've decided today to talk about some of our recent work that plays a

role in between 2D and 3D data domains because we all know that medical imaging data lives

in between these domains. We have 2D data, we have 3D data and connecting these domains

seems to play an important role and I will give you a better introduction to that topic

in a little bit. It's a pleasure for me to see some of the familiar faces back from the

time when I was with the LME in Erlangen and for everyone else. Matthias, I graduated from

the same lab in 2017 and you have a great advisor Andreas. I'm sure you'll be very successful

in the future. So before starting the actual content of my talk, I want to mention that

this is the work of many people. We have collaborators within my group of course we have collaborators

within the Department of Computer Science, but more importantly also with hospitals,

with the Johns Hopkins Hospital that is a leader in many regards where we get to talk

and inform our method development by the problems that they encounter in their everyday practice.

And working together with them on the problems is great because it allows us to shape a way

forward together so that the solutions that we develop neatly fit into their surgical

workflows. And then there are some collaborations of course also with this group in fact. So

thank you for that. It's always been great. All right. So bridging domains and medical

imaging. Why do we need this? So I think you probably all know that medical imaging is

an enabling technology. And when I say enabling technology, then I mean that quite broadly

because what we're seeing now is that with the medical imaging modalities that are deployed

all across the hospital, we are now able to perform non-invasive diagnosis, which allows

us to investigate certain disease patterns without having to biopsy for example. And

it allows us to perform procedural planning and map out the steps that will need to be

performed intraoperatively. And then we have other modalities that are deployed intraoperatively,

which allow us to rethink surgery and develop less invasive surgical approaches that are

now guided by imaging technology. And this is really the focus of today's talk, which

is image guided interventions. Now, while these approaches now are less invasive, they

Teil einer Videoserie :

Zugänglich über

Offener Zugang

Dauer

01:08:12 Min

Aufnahmedatum

2020-12-14

Hochgeladen am

2020-12-15 00:48:41

Sprache

en-US

It’s a great pleasure to welcome Prof. Dr. Mathias Unberath back to FAU.

Abstract: Differentiably connecting 2- and 3-dimensional domains is of substantial interest in medical imaging as it enables transformational image processing techniques that substantially add value without disrupting clinical workflow. In this talk, I will introduce our recent advances in dense 3D reconstruction and differentiable rendering using examples in endoscopic and X-ray-guided surgery.

Short Bio: Mathias Unberath is an Assistant Professor in the Department of Computer Science at Johns Hopkins University with affiliations to the Laboratory for Computational Sensing and Robotics and the Malone Center for Engineering in Healthcare. He has created and is leading the Advanced Robotics and Computationally AugmenteD Environments (ARCADE) Lab that conducts research at the intersection of computer vision, machine learning, augmented reality, robotics, and medical imaging to develop collaborative systems that assist clinical professionals across the healthcare spectrum.

Previously, Mathias was an Assistant Research Professor in Computer Science and postdoctoral fellow in the Laboratory for Computational Sensing and Robotics at Hopkins and completed his Ph.D. in Computer Science at the Friedrich-Alexander-Universität Erlangen-Nürnberg from which he graduated summa cum laude in 2017. While completing a Bachelor’s in Physics and Master’s in Optical Technologies at FAU Erlangen, Mathias studied at the University of Eastern Finland as an ERASMUS scholar in 2011 and joined Stanford University as a DAAD fellow throughout 2014.

Mathias has published more than 80 journal and conference articles and has received numerous awards, grants, and fellowships, including the NIH NIBIB R21 Trailblazer Award.

References

  • Gao, C., Liu, X., Gu, W., Killeen, B., Armand, M., Taylor, R., & Unberath, M. (2020). Generalizing Spatial Transformers to Projective Geometry with Applications to 2D/3D Registration. MICCAI 2020.
  • Gu, W., Gao, C., Grupp, R., Fotouhi, J., & Unberath, M. (2020, October). Extended Capture Range of Rigid 2D/3D Registration by Estimating Riemannian Pose Gradients. In International Workshop on Machine Learning in Medical Imaging (pp. 281-291). Springer, Cham.
  • Grupp, R. B., Unberath, M., Gao, C., Hegeman, R. A., Murphy, R. J., Alexander, C. P., ... & Taylor, R. H. (2020). Automatic annotation of hip anatomy in fluoroscopy for robust and efficient 2D/3D registration. International Journal of Computer Assisted Radiology and Surgery, 1-11.
  • Liu, X., Sinha, A., Ishii, M., Hager, G. D., Reiter, A., Taylor, R. H., & Unberath, M. (2019). Dense depth estimation in monocular endoscopy with self-supervised learning methods. IEEE transactions on medical imaging39(5), 1438-1447.
  • Liu, X., Zheng, Y., Killeen, B., Ishii, M., Hager, G. D., Taylor, R. H., & Unberath, M. (2020). Extremely Dense Point Correspondences using a Learned Feature Descriptor. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 4847-4856).
  • Liu, X., Stiber, M., Huang, J., Ishii, M., Hager, G. D., Taylor, R. H., & Unberath, M. (2020). Reconstructing Sinus Anatomy from Endoscopic Video--Towards a Radiation-free Approach for Quantitative Longitudinal Assessment. MICCAI 2020.

This video is released under CC BY 4.0. Please feel free to share and reuse.

For reminders to watch the new video follow on Twitter or LinkedIn. Also, join our network for information about talks, videos, and job offers in our Facebook and LinkedIn Groups.

Music Reference: 
Damiano Baldoni - Thinking of You (Intro)
Damiano Baldoni - Poenia (Outro)

 

Tags

beyond the patterns
Einbetten
Wordpress FAU Plugin
iFrame
Teilen