Senior / Lead Data Software Engineer Georgia or Remote
Senior / Lead Data Software Engineer Description
Job #: 86080DESCRIPTION
We are looking for an open-minded Senior / Lead Data Engineer to develop and maintain data-driven architecture. On our projects, we are developing pipelines to build business-related data products and design cloud-based platform solutions to support DataHub functionality.
What You’ll Do
- Design and implement data pipelines
- Perform data ingestion processes to include existing data sources in the new platform
- Participate in platform engineering, including cloud-based solutions to support solution architecture, such as Ingestion Frameworks, Platform Orchestrators, Exploratory environments etc
- Conduct MLOps activities to build production-ready cloud-based solutions to support existing ML pipelines
- Take part in the design of on-prem to cloud migration activities
What You Have
- Solid experience in Java, Python or Scala
- Proficiency in SQL
- Understanding of common Big Data problems (splitability, massive parallel processing, load-balancing, data locality, streaming, etc.) and related technologies (Apache Spark, Map-Reduce, HDFS)
- Acquaintance with data modeling: relational/dimensional data, SCD, snowflaking, etc
- English level – B1+, both written and spoken
Nice to have
- Familiarity with common data-related architectures such as Data-Hub/Data Lake
- Experience in cloud-based solutions, GCP, Terraform, Kubernetes
Technologies
- Apache Spark, Kubernetes, Hadoop, Cloud Storage (S3, ADLS, GS, etc.), Cloud Functions, Airflow, Apache Kafka, Jenkins, Terraform, Avro, Parquet
We Offer
- Outstanding career development opportunities with a transparent roadmap to accelerate your journey
- Knowledge sharing within the community of the industry’s top professionals worldwide
- Various opportunities for self-development: hard & soft skills internal training courses, mentoring programs, and unlimited access to 8,000+ LinkedIn Learning courses
- Free English classes with certified teachers
- Competitive compensation, regular assessments, and salary reviews
- Participation in the Employee Stock Purchase Plan
- Flexible working schedule
- Friendly team, and enjoyable working environment
- Relocation opportunities within our offices in 50+ countries
- Social package – medical & family care
- Five trust days a year (sick leave without a medical certificate)
About EPAM
- EPAM Georgia is a team of innovators united by a passion for technology. The dynamic and inclusive culture we embrace helps positively impact our communities, customers, and employees. Here you will collaborate with multi-national teams, contribute to numerous cutting-edge projects, deliver the most creative solutions, and have an opportunity to learn. Our people are at the heart of our success, and we are proud to provide talents with a solid ground to develop and grow
