Lead Big Data Engineer Serbia
Lead Big Data Engineer Description
#Not found
Responsibilities
- Lead, design and implement innovative analytical solution using Hadoop, NoSQL and other Big Data related technologies, evaluating new features and architecture in Cloud/ on premise/ Hybrid solutions
- Work with product and engineering teams to understand requirements, evaluate new features and architecture to help drive decisions
- Build collaborative partnerships with architects and key individuals within other functional groups
- Perform detailed analysis of business problems and technical environments and use this in designing quality technical solution
- Actively participate in code review and test solutions to ensure it meets best practice specifications
- Build and foster a high performance engineering culture, mentor team members and provide team with the tools and motivation
- Write project documentation
Requirements
- Wide experience in analysis, design, implementation, deployment as well as troubleshooting and rebuilding distributed Linux based platforms and Big Data solutions on premises and in Cloud
- Experience in Big Data technologies - including Hadoop Core, Apache HBase, Airflow, MapReduce, Spark, SolR
- Solid Cloud experience with 2 or more leading cloud providers (AWS/Azure/GCP): Storage; Compute; Networking; Identity and Security; NoSQL; RDBMS and Cubes; Big Data Processing; Queues and Stream Processing; Serverless; Data Analysis and Visualization; ML as a service (SageMaker; Tensorflow)
- 5+ years' experience in software development with Big Data technologies (e.g. administration, configuration management, monitoring, debugging and performance tuning) and Java/Scala or Python
- Engineering experience and practice in Data Management, Data Storage, Data Visualization, Disaster Recovery, Integration, Operation, Security
- Strong experience building data ingestion pipelines (simulating Extract, Transform, Load workload), Data Warehouse or Database architecture
- Strong experience with data modeling; hands-on development experience with modern Big Data components
- Cloud: experience in designing, automation, provisioning, deploying and administering scalable, available and fault tolerant systems
- Good understanding of CI/CD principles and best practices
- Analytical approach to problem-solving with an ability to work at an abstract level and gain consensus; excellent interpersonal, leadership and communication skills
- Data-oriented personality and possessing compliance awareness, such as PI, GDPR, HIPAA
- Motivated, independent, efficient and able to handle several projects; work under pressure with a solid sense for setting priorities
- Ability to work in a fast-paced (startup like) agile development environment
- Strong experience in high load and IoT Data Platform architectures and infrastructures
- Vast experience with Containers and Resource Management systems: Docker, Kubernetes, Yarn
- Experience in direct customer communications
- Experience in technology/team leading of data oriented projects
- English proficiency – B2 and higher
We offer
- Diverse multicultural, multi-functional, and multilingual work environment
- Global scope, international projects in different business domains: life sciences and healthcare, retail, and distribution, software and hi-tech, etc
- Outstanding career development opportunities with a transparent career path and a roadmap to accelerate your journey
- Numerous opportunities for self-development: hard & soft skills internal training courses, mentoring programs, and unlimited access to LinkedIn Learning courses
- Knowledge-sharing with colleagues from EPAM's global tech communities
- English language courses
- 25 days holiday per annum
- 5 days of sick leave without medical certification
- Private health insurance for employees and discount for private health insurance for family members
- Discount for Fit Pass program
- Comfortable modern offices in Belgrade and Novi Sad or remote work from any location in Serbia
- Regular corporate and social events (parties, sport events, advanced CSR programs etc.)
- Learning programs for kids (eKids)
EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, diverse community to help you discover your fullest potential.
No less important is our applicants' safety, well-being, and experience. Therefore, until further notice, all EPAM employment interviews will be conducted remotely. Our recruitment professionals and hiring managers are standing by to ensure a robust and engaging virtual candidate experience. We look forward to speaking with you!