Senior Research Engineer Vision-Language Modeling for Radiology

We’re seeking a highly skilled and experienced ML Research Engineer with a proven track record in building advanced Vision-Language Models (VLMs) or Large Language Models (LLMs). 

Floy is supporting radiologists by boosting their diagnostics efforts with unconventional AI products focused on overlooked diseases. You will join an R&D team dedicated to pushing the frontier of multimodal AI, from initial concept to clinical release. Publications and patents are highly encouraged and actively supported.

• Design, implement, and optimize cutting-edge Vision-Language and LLM architectures tailored for radiology reports.

• Generate IP by pushing beyond published SOTA in computer vision, medical imaging, and LLMs.

• Curate, preprocess, and manage complex radiological datasets (DICOM, NIFTI, etc.) at scale, ensuring reproducibility and regulatory compliance.

• Employ best practices in MLOps for seamless data pipelines, experiment tracking, and continuous model delivery.

• Remain up-to-date on the latest breakthroughs in multimodal learning, large-scale language modeling, and medical image processing.

• Translate emerging academic research into robust, real-world clinical applications.

• Lead cross-functional initiatives with radiologists, biologists, and software engineers, ensuring research is clinically relevant and deployed effectively.

• Mentor junior team members and foster a culture of scientific rigor, creativity, and relentless curiosity.

• PhD in Computer Science, Machine Learning, or a related field or Master’s with significant industry experience.

• Must have built, deployed, or significantly contributed to LLM or Vision-Language architectures in production (e.g., GPT-based models, BLIP, CLIP, RAG pipelines).

• Strong grasp of attention mechanisms, Transformers, and multimodal fusion methods.

• Proven expertise in Python with deep proficiency using PyTorch or TensorFlow.

• Solid understanding of distributed training, GPU acceleration, and HPC environments.

• Track record of peer-reviewed publications at renowned ML/CV/NLP conferences (NeurIPS, ICLR, ICML, CVPR, ICCV, ECCV, ACL, EMNLP, NAACL) or leading scientific journals.

• Experience working with large and uncleaned data.

• Strong written and verbal communication skills in English, capable of translating complex research.

Good-to-have: 

• Experience with volumetric medical imaging (CT/MRI) and biological contexts to interpret organ pathologies.

• Experience working with medical experts and medical background knowledge.

• Basic German skills to understand radiology reports.

• Exposure to data engineering and MLOps

We are looking for brilliant, hard-working people who strive to become recognised thought leaders in their domain. If you enjoy learning new things and thrive in a fast-paced environment, we would love to meet you. Together, we will continuously tailor the role to your strengths and development goals.

Pioneer medical AI to maximize human health. Become part of an ambitious team valuing individuals, dedication and a joyful work experience. Solve novel challenges with life-saving implications:

• High-Impact Research: See your work transition from cutting-edge prototypes into life-saving clinical tools.

• Publication and Patent Opportunities: We encourage you to publish in top venues and generate patents that push the field forward.

• Collaborative Environment: Engage with a world-class team of ML engineers, radiologists, data scientists, and product managers.

• Mission-Driven Culture: Contribute to improving patient outcomes on conditions often overlooked by mainstream research.