Skip navigation EPAM

Lead Data Software Engineer - Remote Remote Canada

  • hot

Lead Data Software Engineer - Remote Description

Job #: 74626
EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

Description


You are curious, persistent, logical and clever – a true techie at heart. You enjoy living by the code of your craft and developing elegant solutions for complex problems. If this sounds like you, this could be the perfect opportunity to join EPAM as a Lead Data Software Engineer. Scroll down to learn more about the position’s responsibilities and requirements.


Req. #301411132

What You’ll Do

  • Lead a team of Data Engineers to solve technical solutions and build collaborative partnerships with Data Architects, Data Technology Consultants and Data Delivery Managers
  • Create and maintain optimal on-prem and cloud-based data pipeline architectures capable of ingesting structured and unstructured data using both batch & streaming methods
  • Assemble large, complex data sets that meet functional and technical requirements
  • Identify, design, and implement internal process improvements by automating manual processes, optimizing data delivery and re-designing infrastructure for greater scalability
  • Build Infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources
  • Develop data flows that can leverage both on premise and cloud architectures
  • Work with stakeholders including the business analytics teams and IS architecture teams to assist with data-related technical issues and support their data infrastructure needs

Requirements

  • Extensive experience working within Core Data Software Engineering
  • Experience building Data Management solutions on Azure or AWS
  • Experience working with Databricks
  • Advanced working knowledge of cloud-based data pipeline development
  • Extensive experience with an object-oriented/object function scripting language: Python, Java
  • Experience building and optimizing data pipelines for acquisition and management of data including data security, metadata capture, data cataloging & classification
  • Working knowledge of message queuing, stream processing and Change Data Capture mechanisms
  • Any object-oriented/object function scripting language: Python, Java, Node.js

Nice to have

  • Solid Cloud experience with Azure: Storage, Compute, Networking, Identity and Security
  • Queues and Stream Processing: Serverless, Data Analysis and Visualization
  • ML as a Service
  • Experience with Spark Streaming

What We Offer

  • Extended Healthcare with Prescription Drugs, Dental and Vision Insurance (Company Paid)
  • Life and AD&D Insurance (Company Paid)
  • Employee Assistance Program (Company Paid)
  • Long-Term Disability
  • Registered Retirement Savings Plan (RRSP) with company match
  • Paid Time Off
  • Critical Illness Insurance
  • Employee Discounts
  • Unlimited access to LinkedIn learning solutions

在亿磐成长

周剑
解决方案架构师
苏州

朱晓华
首席软件测试工程师
苏州

金秋
首席软件工程师
苏州

我们在世界其他地方。。。