Senior Data Platform Engineer
Parafin is dedicated to empowering small businesses by providing them with the financial tools they need through partnerships with platforms like DoorDash and Amazon. As a Series C company backed by leading VCs, Parafin has raised over $194M in equity and
Peregrine Technologies, backed by leading Silicon Valley investors, supports public safety agencies across the country by providing technology solutions that improve operations and decision-making. They serve over 80 million Americans, focusing on creating
Peregrine Technologies, backed by Silicon Valley investors, empowers public safety agencies across the US with technology that improves operations and decision-making. Serving over 80 million Americans, the company partners closely with customers to develo
Parafin is dedicated to empowering small businesses by providing seamless access to essential financial tools through their existing platforms. By partnering with companies like DoorDash, Amazon, Worldpay, and Mindbody, Parafin delivers fast and flexible f
Peregrine Technologies is dedicated to supporting public safety agencies nationwide, empowering them with cutting-edge technology to improve operations and make critical decisions. Trusted by customers serving over 80 million Americans, they collaborate cl
Parafin is dedicated to empowering small businesses by providing them with the financial tools they need through partnerships with platforms like DoorDash and Amazon. As a Series C company backed by leading VCs, Parafin has raised over $194M in equity and
Peregrine Technologies, backed by leading Silicon Valley investors, supports public safety agencies across the country by providing technology solutions that improve operations and decision-making. They serve over 80 million Americans, focusing on creating
Peregrine Technologies, backed by Silicon Valley investors, empowers public safety agencies across the US with technology that improves operations and decision-making. Serving over 80 million Americans, the company partners closely with customers to develo
Parafin is dedicated to empowering small businesses by providing seamless access to essential financial tools through their existing platforms. By partnering with companies like DoorDash, Amazon, Worldpay, and Mindbody, Parafin delivers fast and flexible f
Peregrine Technologies is dedicated to supporting public safety agencies nationwide, empowering them with cutting-edge technology to improve operations and make critical decisions. Trusted by customers serving over 80 million Americans, they collaborate cl
Crustdata
Job Description
Crustdata, a Y Combinator-backed company, is building the gateway to the internet for AI agents by creating APIs for accessing real-time data from sources of truth. They serve dozens of enterprise customers, are profitable, and growing rapidly with backing from top Silicon Valley investors.
They are seeking a Senior Data Platform Engineer to be a foundational member of their engineering team. This role involves owning the design, creation, and evolution of Crustdata’s data platform, including data ingestion and management infrastructure. Responsibilities include architecting and building the core data infrastructure (data warehouse and data lake) using cloud technologies (AWS, GCP, or Azure). The engineer will develop and scale robust data pipelines (ETL/ELT), support data scientists and ML engineers, implement workflow orchestration for daily data jobs using tools like Airflow, and build real-time data streaming pipelines using technologies like Kafka. The engineer will also champion data quality and governance.
This is a great opportunity to work directly with the founders on a new core product and influence customers directly in a profitable, fast-growing company.
Responsibilities
- Design, build, and maintain core data infrastructure, including data warehouse and data lake, using modern cloud technologies (AWS, GCP, or Azure)
- Develop and scale robust, fault-tolerant data pipelines (ETL/ELT) to ingest and process massive volumes of structured and unstructured data from diverse sources
- Create the foundational platform to support data scientists and ML engineers. This includes building systems for feature engineering, model training, and deploying ML models into production
- Implement and manage workflow orchestration for hundreds of daily data jobs, ensuring reliability, monitorability, and efficiency using tools like Airflow, Dagster, or Prefect
- Build and manage real-time data streaming pipelines using technologies like Kafka or Flink to power live dashboards and time-sensitive product features
- Implement frameworks for data validation, testing, and monitoring to ensure our data is accurate and trustworthy
Requirements
- Relevant professional experience
Visa Policy
Crustdata isn't offering any visa sponsorship support at this time.
Benefits
- Competitive salary
- Equity package
- Work directly with founders
