Language Data Scientist II, AWS AI Data | Transcribe

The Language AI Services Team in Amazon Web Services (AWS) is seeking a Language Data Scientist to join our data team focused on Health AI. In this role, you will curate, engineer, and analyze natural language datasets in the medical domain, as well as design experiments and surveys to elicit human-in-the-loop insights for developing AI-powered language applications. You will partner with language engineers, program managers, clinical experts, applied scientists, engineers, and product managers to deliver data solutions that meet customer needs.

Key responsibilities include:

• Translating business, modeling, and ethical requirements in Health AI into executable data collection projects
• Designing human-in-the-loop evaluation tasks for model performance and usability in the medical domain
• Developing materials for data collection efforts (guidelines, annotation interfaces, quality assurance workflows)
• Supporting the sourcing and creation of high-quality language datasets for feature and language expansion
• Analyzing data to provide actionable recommendations for improving data quality and model performance
• Innovating on data collection methodologies to improve turnaround time and reliability
• Incorporating LLMs, prompt engineering, and ML techniques to automate annotation and data creation workflows
• Staying updated with AI developments, focusing on model fine-tuning and evaluation data needs

You will lead critical data projects related to AWS HealthScribe and Amazon Transcribe Medical, propose data collection and annotation strategies, and design experiments for human-in-the-loop insights. You'll also work on optimizing data workflows and processes, leveraging ML and Generative AI techniques to improve data sourcing and metric generation.

The team is part of AWS Language AI Services, developing cutting-edge services across various industries. We prioritize customer obsession and delivering high-quality, integrity-driven solutions.

AWS values diverse experiences and encourages candidates from all backgrounds to apply. We offer inclusive team culture, mentorship, career growth opportunities, and strive for work-life harmony. The position allows for flexible, hybrid work options near U.S. Amazon offices.