Taro Logo

Software Engineering SMTS (Salesforce AI Quality Engineer)

World's #1 AI CRM platform helping companies connect with customers and drive digital transformation.
Staff Software Engineer
In-Person
5,000+ Employees
7+ years of experience
AI · Enterprise SaaS

Job Description

Salesforce, the world's leading AI CRM platform, is seeking an experienced Quality Engineer for their Agentforce team within Digital Success Engineering. This role combines traditional software quality engineering with cutting-edge AI testing expertise, focusing on Retrieval-Augmented Generation (RAG) and Agentic technologies. The position requires a unique blend of Salesforce platform knowledge and AI testing capabilities.

The successful candidate will join a diverse, distributed team of engineers and architects working to build Unified Experiences for Salesforce Trailblazers. As customer zero, the team drives innovation by leveraging Salesforce technology to create seamless self-service experiences. The role involves developing comprehensive testing strategies for AI-powered features, including RAG, Agentic workflows, and Large Language Models.

Key responsibilities include designing automated test frameworks, managing test data for AI model evaluation, and ensuring quality across UI and API implementations. The position requires collaboration with cross-functional teams and strong communication skills to work effectively with both technical and non-technical stakeholders.

This is an excellent opportunity for an experienced quality engineer looking to work at the intersection of enterprise software and artificial intelligence. The role offers the chance to impact how Salesforce delivers innovative AI-driven customer experiences while working with cutting-edge technologies in a collaborative environment.

Ideal candidates will bring 7+ years of quality engineering experience, strong programming skills in Python or Java, and demonstrated expertise in AI/ML testing. The position offers the opportunity to work with industry-leading AI technologies while contributing to Salesforce's mission of helping companies connect with customers in revolutionary ways.

Last updated 5 days ago

Responsibilities For Software Engineering SMTS (Salesforce AI Quality Engineer)

  • Define and execute quality engineering testing strategy for Salesforce Agentforce
  • Design and maintain automated test scripts for Agent UI and APIs
  • Develop specialized testing strategies for AI features
  • Build and maintain datasets for AI model evaluation
  • Execute functional test plans for Salesforce applications
  • Manage CI/CD pipelines for quality control
  • Identify and manage defects
  • Collaborate with Product Managers and Developers
  • Establish quality standards and best practices
  • Assess and optimize Agentforce performance

Requirements For Software Engineering SMTS (Salesforce AI Quality Engineer)

Java
JavaScript
Python
React
  • 7+ years of experience in Software Quality Engineering
  • 2+ years hands-on experience with Salesforce platform
  • 3+ years experience testing ML/AI systems
  • Strong proficiency in Python or Java
  • Experience with LLMs and prompt engineering testing
  • Knowledge of RAG and Agentic technologies
  • Proficiency in JavaScript and modern UI frameworks
  • Experience with WebDriver and Selenium
  • Strong analytical mindset
  • Experience with Salesforce DevOps and CI/CD
  • Bachelor's or Master's degree in Computer Science, Software Engineering, or equivalent

Benefits For Software Engineering SMTS (Salesforce AI Quality Engineer)

Medical Insurance
401k
  • Medical Insurance
  • 401k