Explainable Medical Artificial Intelligence (XAI in healthcare) is the focus of an organized, multidisciplinary research training program at Ulm University in Germany that offers fully financed PhD seats. The goal of this program is to teach PhD researchers how to create AI systems that are not only strong but also transparent, understandable, moral, and clinically dependable, guaranteeing their safe application in actual medical settings.