Senior Data Engineer

Senior Portugal Full-time Опубликовано 2 месяца назад

Зарегистрируйтесь, чтобы откликнуться Войти

Навыки и стек

Languages

Scala

Tools & Infra

Kafka Kubernetes

Skills

Spark

О роли

Senior Data Engineer at Talkdesk, based in Portugal. You will expand data pipeline infrastructure and oversee lakehouse governance, working with engineering teams on data-driven solutions.

Work format

This is a full-time position. The stated English level is B2, with strong English communication expected.

Skills and tools

Kafka
Spark
Scala
Kubernetes

What to prepare

Prepare a walkthrough of a batch or streaming pipeline you built, including ingestion, processing and storage decisions.
Choose an example of lakehouse governance work and explain how you handled real-time data integration.
Prepare a Scala code sample using Kafka or Spark, with notes on scalability and reliability.

Обязанности

Build and maintain systems that ingest, process and store business-critical data.
Design batch and streaming dataflows for large volumes of unstructured data.
Monitor dataflows and systems, making changes to improve scalability and reliability.
Oversee lakehouse governance as the data pipeline infrastructure expands.
Partner with engineering teams to develop data-driven solutions.

Требования

At least 4 years of professional experience.
Expertise in distributed computing and distributed systems.
Experience with datalake or lakehouse architecture and real-time data integration.
Proficiency in Scala, with experience using Kafka and Spark.
Experience with Kubernetes is required for this position.
Experience with Trino, Dremio or Impala for data querying.
Experience with table formats such as Hive, Iceberg, Delta Lake or Hudi.
Cloud platform experience with AWS, Azure or GCP.

Nice to have

Experience with NoSQL databases is nice to have.
A computer science or engineering degree is nice to have.
Agile or Scrum experience is nice to have.
Experience with Docker is nice to have.

Откликнуться на вакансию

Отправьте короткое сообщение о себе — команда найма рассмотрит его и ответит.

Создать аккаунт кандидата Войти

Talkdesk

Product

Cloud contact-center software company founded in 2011 by Tiago Paiva and Cristina Fonseca, with major engineering offices in Lisbon and Porto alongside its US headquarters. Talkdesk's AI-powered CX Cl

Локация: Lisbon, Portugal
Размер команды: 1500+
Формат работы: Hybrid

View company profile