Senior Data Engineer

Senior Portugal Full-time Publicado hace 2 meses

Regístrate para postularte Iniciar sesión

Habilidades y stack

Languages

Scala

Tools & Infra

Kafka Kubernetes

Skills

Spark

Sobre el puesto

Senior Data Engineer at Talkdesk, based in Portugal. You will expand data pipeline infrastructure and oversee lakehouse governance, working with engineering teams on data-driven solutions.

Work format

This is a full-time position. The stated English level is B2, with strong English communication expected.

Skills and tools

Kafka
Spark
Scala
Kubernetes

What to prepare

Prepare a walkthrough of a batch or streaming pipeline you built, including ingestion, processing and storage decisions.
Choose an example of lakehouse governance work and explain how you handled real-time data integration.
Prepare a Scala code sample using Kafka or Spark, with notes on scalability and reliability.

Responsabilidades

Build and maintain systems that ingest, process and store business-critical data.
Design batch and streaming dataflows for large volumes of unstructured data.
Monitor dataflows and systems, making changes to improve scalability and reliability.
Oversee lakehouse governance as the data pipeline infrastructure expands.
Partner with engineering teams to develop data-driven solutions.

Requisitos

At least 4 years of professional experience.
Expertise in distributed computing and distributed systems.
Experience with datalake or lakehouse architecture and real-time data integration.
Proficiency in Scala, with experience using Kafka and Spark.
Experience with Kubernetes is required for this position.
Experience with Trino, Dremio or Impala for data querying.
Experience with table formats such as Hive, Iceberg, Delta Lake or Hudi.
Cloud platform experience with AWS, Azure or GCP.

Nice to have

Experience with NoSQL databases is nice to have.
A computer science or engineering degree is nice to have.
Agile or Scrum experience is nice to have.
Experience with Docker is nice to have.

Postúlate a este puesto

Envía una breve presentación: el equipo de contratación la revisará y responderá.

Crear cuenta de candidato Iniciar sesión

Talkdesk

Product

Cloud contact-center software company founded in 2011 by Tiago Paiva and Cristina Fonseca, with major engineering offices in Lisbon and Porto alongside its US headquarters. Talkdesk's AI-powered CX Cl

Ubicación: Lisbon, Portugal
Tamaño del equipo: 1500+
Política de trabajo remoto: Hybrid

View company profile