Skip navigation EPAM

Senior Data Engineer Slovakia or Remote

  • hot

Senior Data Engineer Description

Job #: 91074
EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

DESCRIPTION


We are looking for a Senior Data Engineer to make a team even stronger.

Responsibilities

  • Develop, monitor, and operate the most used and most critical curated data pipeline - Sales Order Data (incl. Post-order information, e.g. shipment, return, payment). This pipeline is processing hundreds of millions of records to provide high-quality datasets for analytical and machine learning use-cases
  • Consulting with analysts, data scientists, and product managers to build and continuously improve "Single Source of Truth" KPI for business steering such as the central Profit Contribution measurement (PC II)
  • Leverage and improve a cloud-based tech stack that includes AWS(Azure), Databricks, Kubernetes, Spark, Airflow, Python, and Scala

Requirements

  • Expertise in Apache Spark along with Spark streaming & Spark SQL
  • Good hands on experience with Databricks and delta-lake
  • Fluency in Scala programming language
  • Good understanding & hands-on experience with CI/CD
  • Rich working experience with Github
  • Fluency working with any cloud (AWS, Azure, GCP) landscape
  • Ability to build Apache Airflow pipelines

We Offer

  • We offer the possibility to work on full product lifecycle – from concept to delivery into production
  • Opportunity to work on leading edge platforms, working in a fast-paced, agile, software engineering culture
  • Using English on a daily basis
  • Unlimited access to LinkedIn learning solutions
  • Benefit program (5 weeks of vacation, 5 paid sick days, meal vouchers, reimbursement of glasses, contribution to pension fund)
  • Rotation program - possibility to relocate for short and long-term projects within 30 countries

在亿磐成长

周剑
解决方案架构师
苏州

朱晓华
首席软件测试工程师
苏州

金秋
首席软件工程师
苏州

我们在世界其他地方。。。