Senior Data Platform Engineer

Role Description

About the company: Damia Group is an international tech recruitment agency with 3 decades of experience. Our arrival in Portugal, 7 years later, was set on a mission to transform IT recruitment experiences and, through them, achieve better results. We believe in long-term relationships with a transparent and relaxed mindset. In a short period, we have reached the hearts of both scale-ups and larger organisations by delivering spot-on curated candidate shortlists, increased job offer acceptance rates and shorter time-to-fill.

Main Requirements

About the role: We're looking for a talented multi-disciplinary Senior Data Platform Engineer with a passion for infrastructure, who will be responsible for the performance, scale, and stability of their core data platform products. They are a data-driven organization, ingesting data at high rates, with demands increasing each day.

As a Senior Data Platform Engineer, you will be part of the Data Platform group and will be responsible for a large-scale production data platform that serves as the core infrastructure of their products. You'll develop self-service tools that support the accessibility of their platform for the use of their users from R&D and Analytics departments. They will look to you to be a center of knowledge, consult, and share your expertise with others.

What you'll be doing

- Lead the development of AI-ready data platform foundations, including data quality, contracts, observability, and self-service tooling that power machine learning and AI-driven products

- Administer, provision, and monitor their different platform products

- Develop, maintain, and enhance the application infrastructure that works tightly with their Data Platform infrastructure tools

- Guide development teams and mentor other team members

- Use your creativity to resolve complex and high-scale data-related issues

- Research new technologies, starting from POC level to production-grade systems

Requirements

- 6+ years of prior experience as a Data Platform Engineer / Big Data Infrastructure engineer or equivalent

- Deep understanding of distributed systems, in terms of ingestion, storage, and access

- Hands-on experience with Data Streaming technologies: Apache Kafka / Apache Pulsar / Spark Streaming / Kstream / Apache Flink

- B.Sc. in Computer Science (or equivalent)

- Experience working on large-scale, production-grade projects

Nice to Have

- Experience with tools like Apache Spark and Databricks.

- Experience with the Cloud Native stack( Kubernetes / Prometheus/Istio etc.)

- Experience with a cloud provider (AWS, Google etc.)

- Experience with Infrastructure tools (Helm, Ansible, Terraform etc.)

- Experience with Scala

Perks