Company Overview:

Atreides helps organizations transform large and complex multi-modal datasets into information-rich, geo-spatial and digital data subscriptions used across various use cases. We focus on providing defense intelligence professionals with high-fidelity data solutions to derive insights quickly. As a fast-growing, high-performance early-stage company, we value diversity and inclusion, trust, and autonomy. A mission-driven mindset and entrepreneurial spirit are essential as we work to unlock the power of massive-scale data for a safer, stronger, and more prosperous world.

Team Overview:

We are a passionate team of technologists, data scientists, and analysts with backgrounds in operational intelligence, law enforcement, large multinationals, and cybersecurity operations. We obsess about designing products that will change the way global companies, governments and nonprofits protect themselves from external threats and global adversaries.

Position Overview:

We are seeking a Remote Staff Data Platform Engineer to transform and elevate our cloud data infrastructure. In this role, you will architect, build, and maintain scalable, secure, and high-performing data platforms powered by Kubernetes on Azure or AWS. Leveraging Infrastructure as Code (IaC) tools—such as Pulumi, Terraform, or CloudFormation, you will design innovative solutions that support complex application requirements and petabyte-scale data processing.

As a key technical leader, you will collaborate with cross-functional software engineering teams to drive the development and optimization of internal platform tooling and engineering workflows. Your responsibilities will include managing Kubernetes clusters and containerized applications in dynamic environments, troubleshooting challenging platform issues, and ensuring the seamless orchestration of data pipelines using modern cloud-native tools. In addition, you will document operational specifications and provide mentorship and strategic guidance across the organization, helping to shape a robust, agile, and future-ready data platform.

Team Principles:

At Atreides, we believe that teams work best when they:

• Remain curious and passionate in all aspects of our work
• Promote clear, direct, and transparent communication
• Embrace the 'measure twice, cut once' philosophy
• Value and encourage diverse ideas and technologies
• Lead with empathy in all interactions

Responsibilities:

• Drive the development and optimization of internal platform tooling and engineering workflows.
• Provision and maintain secure, scalable infrastructure on Azure or AWS using Infrastructure as Code (Pulumi, Terraform, or CloudFormation)
• Manage Kubernetes clusters that host both application workloads and data processing frameworks
• Deploy, configure, and monitor distributed data systems, including Spark clusters, Dask, Presto, or Trino
• Set up and maintain logging, monitoring, and alerting systems to ensure application and infrastructure health
• Troubleshoot performance and reliability issues across infrastructure and deployment pipelines
• Build and improve CI/CD pipelines to automate testing and deployment of cloud-native applications
• Collaborate with software engineering teams to support deployment workflows, configuration, and environment setup
• Write and maintain technical documentation and standard operating procedures
• Contribute to a culture of automation, observability, and operational excellence
• Provide engineering leadership, peer mentorship, strategy, and influence across the company.

Desired Qualifications:

• 5+ years of experience in a DevOps or infrastructure engineering role.
• Strong experience with AWS, Azure, or GCP cloud platforms.
• Hands-on experience managing Kubernetes clusters and container-based deployments.
• Strong proficiency in Infrastructure as Code tools (Terraform, Pulumi, or CloudFormation).
• Strong Proficiency in Python is required; Go is a plus.
• Experience in using modern cloud native tools such as ArgoCD/FluxCD, Helm, etc.
• Familiarity with monitoring and logging tools (e.g., Prometheus, Grafana, CloudWatch, Loki)
• Experience maintaining infrastructure for data pipelines, including Apache Spark, Spark clusters, Dask, Presto, or Trino, etc.
• Experience building or maintaining CI/CD pipelines using tools like GitHub Actions, GitLab CI, Jenkins, or similar
• Strong initiative in working cross-functionally to design and implement platform solutions.
• Ability to communicate technical details effectively with peers and stakeholders
• Experience with Spark on Kubernetes is a plus.
• Experience with orchestration platforms like Dagster, Prefect, Airflow or Temporal is a plus.

Compensation and Benefits:

● Competitive salary

● Comprehensive health, dental, and vision insurance plans

● Flexible hybrid work environment

● Additional benefits like flexible hours, work travel opportunities, competitive vacation time and parental leave

While meeting all of these criteria would be ideal, we understand that some candidates may meet most, but not all. If you're passionate, curious and ready to "work smart and get things done," we'd love to hear from you.