Taro Logo

Senior Software Engineer- OCI AI Services

A world leader in cloud solutions, using tomorrow's technology to tackle today's challenges, partnering with industry-leaders for over 40+ years.
United States
$79,800 - $178,100
Backend
Senior Software Engineer
In-Person
5,000+ Employees
3+ years of experience
AI · Enterprise SaaS · Cloud

Job Description

At Oracle Cloud Infrastructure (OCI), we are building the future of cloud computing—designed for enterprises, engineered for performance, and optimized for AI at scale. The Generative AI Service team focuses on developing infrastructure and tools to operationalize Large Language Models (LLMs) and agentic AI systems.

As a Senior Software Engineer, you will contribute to the design and implementation of scalable, distributed systems that serve LLMs and support agent-based workflows. You'll work in a collaborative environment with applied scientists, ML engineers, and software teams to deliver performant and reliable AI infrastructure.

Key Qualifications:

  • BS in Computer Science or related technical field
  • 3+ years of experience in backend software development
  • Strong proficiency in Go, Java, Python, or C++
  • Experience with distributed services and cloud infrastructure
  • Knowledge of Kubernetes and CI/CD practices

Preferred Qualifications:

  • MS in Computer Science
  • Experience with LLM serving frameworks
  • Knowledge of cloud-native observability tools
  • Interest in compiler or systems-level software design

We offer competitive compensation ($79,800-$178,100), comprehensive benefits including medical/dental/vision insurance, 401(k) matching, flexible vacation, and opportunities for professional growth in one of Oracle's most innovative initiatives.

Join us to build mission-critical AI infrastructure with real-world impact, working alongside a collaborative global team while expanding your expertise in AI, cloud computing, and distributed systems.

Last updated 4 hours ago

Responsibilities For Senior Software Engineer- OCI AI Services

  • Contribute to the development and optimization of distributed systems for model inference and agent execution
  • Implement features and enhancements in LLM service infrastructure using modern cloud technologies
  • Collaborate with cross-functional teams to support scalable and secure deployment pipelines
  • Assist in diagnosing and resolving production issues, improving observability and reliability
  • Write maintainable, well-tested code and contribute to documentation and design discussions

Requirements For Senior Software Engineer- OCI AI Services

Go
Java
Python
Kubernetes
  • BS in Computer Science or related technical field
  • 3+ years of experience in backend software development with cloud infrastructure
  • Strong proficiency in at least one language such as Go, Java, Python, or C++
  • Experience building and maintaining distributed services in a production environment
  • Familiarity with Kubernetes, container orchestration, and CI/CD practices
  • Solid understanding of computer science fundamentals such as algorithms, operating systems, and networking

Benefits For Senior Software Engineer- OCI AI Services

Medical Insurance
Dental Insurance
Vision Insurance
401k
Parental Leave
  • Medical, dental, and vision insurance
  • Short term disability and long term disability
  • Life insurance and AD&D
  • Health care and dependent care Flexible Spending Accounts
  • 401(k) Savings and Investment Plan with company match
  • Flexible Vacation
  • 11 paid holidays
  • 72 hours of paid sick leave
  • Paid parental leave
  • Adoption assistance
  • Employee Stock Purchase Plan

Related Jobs

Senior Full Stack Developer

Senior Full Stack Developer position at Oracle, focusing on building talent acquisition technology solutions using Oracle Full Stack technologies.

Software Developer 4

Senior Software Developer position at Oracle in Austin, TX, focusing on backend development, distributed systems, and machine learning with competitive compensation and benefits.

Software Developer 4

Senior Software Developer role at Oracle focusing on cloud solutions and distributed systems, offering competitive compensation and comprehensive benefits.

Sr Production Software Engineer

Senior Production Software Engineer role at Oracle Health & Analytics, focusing on client-facing technical investigation and issue resolution for healthcare software products.

Software Engineer (Java Backend)

Senior Backend Software Engineer role at Oracle Health & AI, building scalable healthcare platforms using Java and cloud technologies. 5+ years experience required.