Lead Big Data Developer (Spark, Python, Databricks) London, UK
Lead Big Data Developer (Spark, Python, Databricks) Description
Job #: 92113
Are you passionate about big data development? Do you enjoy working with both technical and business stakeholders to translate vision and designs into sustainable, customer-focused solutions?
Can you communicate efficiently, and influence quicker deliveries? If yes, we have new position just opened up for a Lead Data Developer with expertise in Spark and Databricks to join our Data Practice team and work with EPAM strategic clients. As Lead Data Engineer you will be building data systems and applications to support decision making. You will focus on developing and maintaining data pipelines in Microsoft Azure. You will be participating in data migration from on-premise to Azure and building components for central enterprise data platforms.
This position will require advanced technical depth and experience, technical leadership, and multi-faceted communication skills.
Can you communicate efficiently, and influence quicker deliveries? If yes, we have new position just opened up for a Lead Data Developer with expertise in Spark and Databricks to join our Data Practice team and work with EPAM strategic clients. As Lead Data Engineer you will be building data systems and applications to support decision making. You will focus on developing and maintaining data pipelines in Microsoft Azure. You will be participating in data migration from on-premise to Azure and building components for central enterprise data platforms.
This position will require advanced technical depth and experience, technical leadership, and multi-faceted communication skills.
What You’ll Do
- Contributing to the success of our customer projects
- Lead and coach team members, including communicating team goals and identifying areas for growth
- Provide technology solutions that will solve business problems and strengthen our position as digital leaders
- Design, plan and deliver sustainable solutions using modern programming languages
- Help us in our journey as we move to Azure and build a new Azure-native application
- Help lead our growing team of analysts and engineers to build a new application
- Provide technical expertise and recommendations in assessing requirements and initiatives to support and enhance our existing applications
- Conduct code reviews and test software as needed, along with participating in application architecture and design and other phases of SDLC
- See that proper operational controls and procedures are implemented
Requirements
- 5+ years of experience in data development using Spark, preferably in an enterprise environment on Microsoft Azure
- 8+ years of experience in building enterprise big data / data engineering applications using continuous integration tools like Azure DevOps
- Extensive knowledge and experience with Databricks
- Strong understanding of reusable software design patterns
- Experience in Azure Data Factory, Azure Data Lake and Azure Log Analytics, Azure KeyVault and Git
- Design and implementation of production-grade solutions
- Delivering high-quality code, focusing on simplicity, performance, maintainability and scalability
- Practical experience in applying an agile way of working and in applying DevOps methodologies
- Excellent analytical and conceptual skills to understand complex technology stacks and their dependencies
Nice to have
- Expert knowledge of Python and Spark
- Enterprise system integration experience
- Expert knowledge of Databricks
- Docker
We Offer
- We offer a range of benefits including
- A competitive group pension plan, life assurance and income protection
- Private medical insurance, private dental care and critical illness cover
- Cycle scheme Tech scheme and season ticket loan
- Employee assistance program
- Unlimited access to LinkedIn learning solutions
- EPAM Employee Stock Purchase Plan (ESPP) (subject to certain eligibility requirements)
- Various perks such as Gym discount, Friday lunch, on-site massage and regular social events
- Some of these benefits may be available only after you have passed your probationary period
About EPAM
- EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential
