Taro Logo

Staff Platform Engineer - Big Data Platform Management

CSIT develops products to advance the national security interests of Singapore, focusing on Counter-terrorism and Computer Network Defence.
Data
Staff Software Engineer
In-Person
8+ years of experience
Cybersecurity · Enterprise SaaS

Job Description

The Centre for Strategic Infocomm Technologies (CSIT) is seeking a Staff Platform Engineer to join their Big Data Platform Management team in Singapore. This role is crucial for advancing Singapore's national security interests through Counter-terrorism and Computer Network Defence initiatives.

The position requires an experienced professional with at least 8 years of experience in managing Big Data Platforms. As a Staff Platform Engineer, you'll be responsible for designing, implementing, and maintaining the organization's Big Data infrastructure platform, ensuring high availability, scalability, and performance. The role involves working with cutting-edge technologies including Hadoop, Spark, NoSQL databases, and various data lake solutions.

Key responsibilities include managing Big Data clusters, implementing storage solutions, ensuring platform security, and collaborating with data engineers and scientists. You'll be working with technologies like Spark, Kafka, Hadoop, Elastic Stack, and more. The ideal candidate should have strong expertise in distributed systems, DevOps practices, and experience leading engineering teams.

CSIT offers an excellent environment for professional growth, working alongside top engineers in the field. The organization promotes a strong engineering culture with a focus on work-life balance and operational excellence. You'll have the opportunity to work on meaningful projects that directly impact national security while using modern technology stacks.

The position requires a Bachelor's degree in Computer Science, Engineering, or a related field. Experience with cloud platforms, containerization, and machine learning frameworks is a plus. As CSIT is an agency under the Ministry of Defence, this position is only open to Singapore Citizens.

Join CSIT to be part of a team that values innovation, continuous learning, and technical excellence. You'll work in an environment that combines cutting-edge technology with meaningful impact, all while contributing to Singapore's national security infrastructure. The role offers the perfect blend of technical challenges, leadership opportunities, and the chance to work on projects with significant national importance.

Last updated 3 months ago

Responsibilities For Staff Platform Engineer - Big Data Platform Management

  • Design, implement, and manage the Big Data infrastructure platform, including Hadoop, Spark, NoSQL databases, and data lakes
  • Manage Big Data clusters, including monitoring, troubleshooting, and optimizing cluster performance
  • Design and implement storage solutions for Big Data workloads, including HDFS, S3, and other object storage systems
  • Ensure the security and governance of the Big Data infrastructure platform
  • Collaborate with data engineers and data scientists to optimize Big Data application performance
  • Plan and manage Big Data resource capacity, including forecasting, procurement, and deployment

Requirements For Staff Platform Engineer - Big Data Platform Management

Python
Java
Kafka
MongoDB
Kubernetes
  • Bachelor's degree in Computer Science, Engineering, or a related field
  • At least 8 years of experience in managing Big Data Platforms
  • Proven experience with technologies like Spark, Kafka, Hadoop, Elastic Stack, Kudu, NiFi and Kafka
  • Strong knowledge of Big Data architectures, including data lakes, data warehouses, and data pipelines
  • Experience in troubleshooting and resolving issues of the Big Data stack
  • Strong understanding of data storage systems, including HDFS, S3, and other object storage systems
  • Experience with scripting languages, such as Python, Scala, or Java
  • Experience in managing physical and virtual infrastructures
  • Experience in supporting search workloads in multi-terabytes and billions of records
  • Experience in distributed systems
  • Proven experience in using DevOps tools and CI/CD pipelines effectively
  • Experience in leading engineering teams

Benefits For Staff Platform Engineer - Big Data Platform Management

  • Work with modern technologies and tech stacks
  • Excellent engineering culture and work-life balance
  • Engineering and operational excellence
  • Empowerment to innovate
  • Growth opportunities
  • Meaningful and purposeful work

Related Jobs

Staff Platform & SRE Engineer (Workplace Technology)

Lead platform architecture and SRE initiatives for Singapore's defence technology agency, focusing on secure and scalable workplace technology solutions.

Staff Software Engineer - Full Stack

Staff Software Engineer position at Illumina, developing full-stack applications for genomics data visualization and analysis, combining web technologies with biotechnology innovation.

Staff Software Engineer - Full Stack

Staff Software Engineer position at Illumina developing full-stack applications for genomic data visualization and analysis, combining web technologies with scientific computing.

Staff Software Engineer - Full Stack

Staff Software Engineer position at Illumina developing full-stack applications for genomic data visualization and analysis, combining web technologies with scientific computing.

Staff Software Engineer - Full Stack

Staff Software Engineer position at Illumina developing full-stack applications for genomic data visualization, combining React, WebGL, and backend technologies to advance healthcare research.