Data engineer

Sobre a vaga

Design, develop, and maintain scalable data pipelines and integration frameworks across multiple enterprise data sources. You will build and optimize ETL/ELT processes and implement the Medallion Architecture within a Databricks Lakehouse environment. The role involves collaborating with stakeholders to translate requirements into technical solutions and mentoring junior engineers.

O que vais fazer

• Design, develop, and maintain scalable data pipelines and integration frameworks across multiple enterprise data sources
• Build and optimize ETL/ELT processes using Informatica, Azure Data Factory, and Databricks
• Develop data ingestion, transformation, and orchestration workflows, and implement the Medallion Architecture (Bronze, Silver, Gold) within a Databricks Lakehouse environment
• Design data infrastructure with scalability, performance, security, and cost optimization in mind
• Build and optimize databases and data warehouses for performance and reliability
• Collaborate with business stakeholders, data scientists, and analysts to translate requirements into technical solutions, including support for planning and forecasting initiatives
• Lead troubleshooting of production data issues, perform root cause analysis, and monitor systems for performance and data quality
• Write scripts and automate workflows to reduce manual intervention
• Mentor junior engineers and provide technical leadership across delivery teams

O que é pedido

• Several years of Data Engineering experience, including hands-on with Databricks (Delta Lake, Databricks Workflows, Spark SQL, PySpark, Unity Catalog, Lakehouse Architecture)
• Strong experience with Informatica PowerCenter, ETL/ELT design, data integration patterns, and data migration & modernization
• Solid experience with Azure services: ADF, Data Lake Storage (ADLS Gen2), SQL Database, Key Vault, and Azure DevOps
• Strong programming skills in SQL, Python, and PySpark, with experience in API integration, data modeling, and data warehousing
• Comfortable working with both relational (SQL) and NoSQL databases
• Experience supporting large-scale enterprise data platforms
• Strong problem-solving and analytical skills
• Excellent stakeholder communication and collaboration abilities
• Fluent in written and spoken English
• Degree in Computer Science, Engineering, Data Science, or a related field (or equivalent professional experience)

Valorizado

• Experience leading initiatives that modernize legacy ETL (Informatica) solutions into cloud-native architectures
• Hands-on experience implementing Medallion Architecture end to end
• Experience with CI/CD and DevOps practices
• Knowledge of big data frameworks such as Apache Hadoop, Apache Spark, or Apache Kafka
• Experience with cloud data warehousing platforms such as Amazon Redshift, Google BigQuery, or Snowflake
• Experience with additional database technologies (e.g., Oracle databases & Exadata, Cosmos DB, Cassandra, MongoDB)
• Familiarity with Infrastructure as Code, containerization, and orchestration (Docker, Kubernetes)
• Exposure to more than one major cloud provider
• Domain knowledge in supply chain planning processes (e.g., demand and supply planning)

O que é oferecido

• Permanent contract with long-term career prospects
• Competitive salary aligned with your experience and expertise
• Annual target bonus based on performance
• Daily meal allowance
• Health insurance and Life insurance
• Access to Employee Assistance Program for well-being and support
• A hybrid remote work model

Investimento de tempo

Processo de entrevista

1. O processo de recrutamento inicia com uma entrevista com Talent Acquisition, o Hiring Manager e um especialista técnico da empresa. Este momento procura clarificar quaisquer questões que o candidato possa ter e compreender o seu percurso profissional, sendo um momento de perguntas técnicas e de fit cultural.
2. De seguida, o candidato poderá ter a oportunidade de escolher entre realizar um Live Code um desafio técnico offline.
3. Após o desafio, existe uma entrevista final com o Hiring Manager e um especialista técnico da equipa onde o candidato poderá ser integrado e podem ser colocadas questões sobre o desafio realizado na fase anterior.

Quanto paga este cargo

Este anúncio paga 133% acima da mediana

Benefícios e vantagens (8)

• Apoio ao home-office
• Flexibilidade de horário
• Ginásio & atividades desportivas
• Mais de 22 dias de férias
• Paga o passe
• Plafond certificações e conferências
• Prémios de performance
• Seguro de saúde