174
Senior Data Engineer with Databricks
EPAM
Senior Data Engineer with Databricks
EPAM
Senior Data Engineer with Databricks
EPAM

Senior Data Engineer with Databricks

EPAM

Requirements for candidates

Background in Apache Spark along with Spark streaming
Hands-on experience with Databricks
Expert knowledge in Scala programming language
Expertise in GitHub + CI/CD
Fluency in English, both written and verbal  


Nice to have
Knowledge in Delta-Lake
Expertise in SQL
Fluency working with AWS landscape
Ability to build Apache Airflow pipelines
Experience in Presto, Superset, Starburst, Oracle & Exasol

Job description

Looking for an opportunity to get into a diverse team and work with a leading retail client in Europe with ongoing businesses in numerous countries? Join our community of Data professionals and take part in Data Products pipelines migration from Oracle workloads to Databricks.

In this role, you will assess and implement new database technologies: from hybrid cloud and local infrastructures to replication, scalability, resiliency & redundancy.

Take the freedom to work remotely from anywhere across the country or meet with teammates in our office.


What You’ll Do
Develop, monitor and operate the most used and critical curated data pipeline - Sales Order Data (with Post-order information: shipment, return, payment)
Work closely with engineering teams to build and improve "Single Source of Truth" KPI for business steering (central Profit Contribution measurement)
Redevelop old legacy pipelines to new, advanced and standard versions that are easy to maintain and scalable for future demands
Leverage and improve a cloud-based tech stack (AWS, Databricks, Kubernetes, Spark, Airflow, Python, and Scala)

What we offer

Outstanding career development roadmap to accelerate your journey
Engineering community of 59,250+ industry’s top professionals
Certification and mentoring programs, training, and unlimited access to LinkedIn Learning
Innovative solutions delivery to the world’s industry leaders
Regular assessments and salary reviews
Bonuses for participating in the referral program
Participation in the Employee Stock Purchase Plan
Flexible schedule and opportunity to work remotely from any place in Lithuania
Friendly team and enjoyable working environment
Relocation within offices in 50+ countries with throughout support for you and your family
Three additional vacation days and four trust days a year (sick leave without a medical certificate)
Private health insurance and corporate discounts for family members

Mėnesinis bruto atlyginimasBruto/mėn.  € 4200 - 5700

Papildoma informacija:  In addition to the salary, annual bonuses are rewarded for achieving goals as well as for showing outstanding results.

Vietovė

    Lietuva
  • Nuotolinio darbo galimybė

Laikas

  • Visa darbo diena

Įgūdžiai

 Apache Spark Spark Streaming Databricks Scala (programming) GitHub CI/CD Delta-Lake SQL AWS

Kalbos

  •  Anglų
Kontaktinis asmuo
Halina Kazhara

Since 1993, EPAM has leveraged its advanced software engineering heritage to become the foremost global digital transformation services provider – leading the industry in digital & physical product development and digital platform engineering services.

Through its unique Engineering DNA, EPAM’s globally deployed hybrid teams help make the future real for clients and communities worldwide by powering better enterprise, education and health platforms that connect people, optimize experiences, and improve people’s lives.

With offices in 45+ countries across the globe and 60,250+ talented professionals, EPAM is constantly growing and opening new locations. Two years ago, we landed in Baltics, and today there are more than 1.5K EPAMers in our office in Lithuania.