Taro Logo

Software Engineer - RAG

Global leader in CRM and enterprise cloud solutions, pioneering AI-powered customer success platforms.
$157,600 - $236,500
Backend
Senior Software Engineer
In-Person
5,000+ Employees
5+ years of experience
AI · Enterprise SaaS

Description For Software Engineer - RAG

Salesforce is seeking a talented Senior Software Engineer to join their Einstein Foundations team, focusing on building cutting-edge Retrieval-Augmented Generation (RAG) systems. This role sits at the intersection of distributed systems and artificial intelligence, working on technology that powers AI-driven customer success platforms used by millions globally.

The position offers an opportunity to work with a diverse team of software engineers, machine learning engineers, and data scientists, building next-generation AI infrastructure that powers everything from knowledge-grounded agents to large-scale enterprise search. You'll be responsible for designing and implementing large-scale distributed systems that integrate deep learning models, retrieval pipelines, and enterprise data.

As a key member of the Einstein RAG team, you'll work across the entire AI stack—from building microservices and data pipelines to enabling real-time inference and document retrieval. The role requires expertise in distributed systems, with a focus on building scalable, reliable solutions that can serve thousands of tenants. You'll be working with cutting-edge technologies including LLMs, vector databases, and modern ML techniques.

The ideal candidate brings 5+ years of experience in building large-scale distributed systems, strong programming skills in Python and/or Java, and deep understanding of system-level performance. Knowledge of cloud-native tools, microservices architecture, and data pipeline frameworks like Kafka and Spark is essential. Experience with LLMs, embeddings, and retrieval-based architectures is highly valued.

This is an exceptional opportunity to shape the future of enterprise AI at one of the world's leading technology companies. You'll be working on challenging technical problems while collaborating with top talent in the field. The role offers exposure to cutting-edge AI technologies and the chance to impact millions of users through your work on Salesforce's AI infrastructure.

Last updated 9 minutes ago

Responsibilities For Software Engineer - RAG

  • Design and build robust, scalable RAG systems that serve thousands of tenants
  • Develop high-performance distributed systems for knowledge retrieval and document ranking
  • Build scalable APIs, microservices, and orchestration layers
  • Drive automation for deployment, monitoring, and performance tuning
  • Collaborate with ML and AI platform teams to productionize retrieval services
  • Ensure reliability, security, and performance of AI-backed systems
  • Participate in on-call rotations and debug live issues

Requirements For Software Engineer - RAG

Python
Java
Kafka
Redis
Cassandra
  • 5+ years of experience building large-scale distributed systems
  • Proficiency in system design, microservices architecture, and cloud-native tools
  • Strong programming skills in Python and/or Java
  • Experience building scalable data pipelines
  • Deep understanding of modern data storage and retrieval frameworks
  • Familiarity with LLMs, embeddings, and retrieval-based architectures
  • Proven ability to take projects from ideation to production
  • Solid understanding of API design and deployment

Interested in this job?

Jobs Related To Salesforce Software Engineer - RAG

Senior Signature Support Engineer - Industry Cloud

Senior Signature Support Engineer role at Salesforce, focusing on Industry Cloud products, offering $162K-164K salary with hybrid work options in Bellevue, WA.

Performance Engineer - IP Telephony and VoIP

Senior Performance Engineer role at Salesforce focusing on IP Telephony and VoIP systems optimization and scalability testing.

Senior Account Solution Engineer - MuleSoft

Senior Account Solution Engineer position at MuleSoft (Salesforce) focusing on pre-sales engineering, technical advisory, and solution architecture for enterprise integration platforms.

Senior Software Engineering - Backend Distributed Systems (LMTS/SMTS)

Senior Software Engineering role at Salesforce focusing on backend distributed systems for security infrastructure, processing millions of events per second using modern cloud technologies.

Strategic Solutions Engineer, Financial Services - Thailand

Senior Strategic Solutions Engineer role at Salesforce focusing on Financial Services in Thailand, combining technical expertise with industry knowledge to drive digital transformation.