Taro Logo

Senior Software Engineer, Infrastructure

Together AI is a research-driven artificial intelligence company focused on open and transparent AI systems, aiming to lower the cost of modern AI systems through co-designing software, hardware, algorithms, and models.
$160,000 - $230,000
Senior Software Engineer
Hybrid
5+ years of experience
This job posting may no longer be active. You may be interested in these related jobs instead:

Description For Senior Software Engineer, Infrastructure

Together AI is seeking a Senior Infrastructure Software Engineer to join their team in San Francisco. This role focuses on automating infrastructure installations and decommissions at scale, building tools to improve deployment speed and scale. The ideal candidate will have a passion for an "automate everything" approach, making systems failure-resistant and ready-to-scale.

Key responsibilities include:

  • Automating infrastructure installations and decommissions
  • Building tools to improve deployment speed and scale
  • Enabling partners to bring up new data centers for AI
  • Replacing servers and networking in existing data centers efficiently
  • Reviewing hardware changes and planning deployments
  • Expanding the network aggressively

The role requires:

  • 5+ years of relevant development experience
  • Strong coding ability in Python, Go, or similar languages
  • Deep technical understanding of datacenter infrastructure
  • Knowledge of physical and logical networking
  • Linux systems administration experience
  • Experience with project management

Together AI offers a competitive compensation package, including:

  • Base salary range: $160,000 - $230,000
  • Startup equity
  • Health insurance and other competitive benefits

This is an excellent opportunity for a passionate engineer interested in AI infrastructure and cutting-edge technology. The role offers the chance to work on decentralized AI workloads, collaborate with partners on hardware strategy, and contribute to the advancement of open and transparent AI systems.

Together AI is an Equal Opportunity Employer, committed to diversity and inclusion in the workplace. Join a team that has contributed to leading open-source research, models, and datasets, advancing the frontier of AI with innovations like FlashAttention, Hyena, FlexGen, and RedPajama.

If you're excited about lowering the cost of modern AI systems and building the next generation of AI infrastructure, this role at Together AI could be your next career move.

Last updated a year ago

Responsibilities For Senior Software Engineer, Infrastructure

  • Introduce cutting-edge technology and automation solutions for global infrastructure
  • Provisioning, monitoring, and maintaining hardware, software, and network in new data centers
  • Perform architecture and research work for decentralized AI workloads
  • Work with vendors on next-generation hardware and software
  • Collaborate with partners on hardware strategy
  • Plan and implement network and server installations
  • Provide technical leadership during deployment activities
  • Create and maintain documentation, plans, SOPs, MOPs, etc.
  • Communicate results through blog posts, internal talks, and tickets

Requirements For Senior Software Engineer, Infrastructure

Python
Go
Linux
Kubernetes
  • 5 years of relevant Development experience
  • Intermediate level software development skills in Python, Go, or similar
  • Linux systems administration experience
  • Strong skills in network services, including REST APIs and HTTP
  • Strong tooling and automations development experience
  • Network fundamentals DHCP, ARP, subnetting, routing, firewalls, IPv6
  • Experience with configuration management and infrastructure-as-code systems
  • Experience with continuous / rapid release engineering
  • Experience working in a 24/7/365 service environment
  • Familiarity with day-to-day tasks and projects common in Data Center Operations
  • Excellent understanding of low level operating systems concepts

Benefits For Senior Software Engineer, Infrastructure

Medical Insurance
  • Health insurance
  • Startup equity
  • Competitive benefits