Senior Data Engineer Australia or Remote
Senior Data Engineer Description
We are looking for an experienced Senior Data Engineer to join our team and play a critical role in designing and optimizing scalable data solutions.
The ideal candidate has extensive experience with cloud platforms, data processing frameworks, and ETL/ELT pipelines and is passionate about solving complex data challenges.
#LI-DNI
Responsibilities
- Design, develop, and optimize ETL/ELT pipelines for seamless data integration and transformation
- Build and maintain scalable data architectures to support analytics and business intelligence
- Work with large-scale data processing frameworks to ensure efficient and secure data handling
- Manage and process structured and unstructured data using various file formats
- Develop robust pipelines and workflows for high-performance data solutions
- Implement and maintain CI/CD pipelines to support efficient development and deployment
- Collaborate with stakeholders to align technical solutions with business goals and requirements
- Create datasets, reports, and dashboards to deliver actionable insights
Requirements
- Strong expertise in cloud platforms, specifically Azure (e.g., Synapse, Data Factory, Databricks, Data Lake)
- Proficiency in Python, SQL, and Apache Spark for data processing and pipeline development
- Experience with scalable data architectures, including file formats such as Parquet, Delta, and JSON
- Solid understanding of modern data processing frameworks and distributed systems
- Practical experience with CI/CD practices and version control tools like Git
- Excellent problem-solving skills and the ability to communicate technical concepts effectively
Nice to have
- Knowledge of Azure Fabric components, including Lakehouse, Workspace, and SQL Endpoint
- Experience in the development and management of Power BI datasets and reports
- Familiarity with DAX for sophisticated data analysis
We offer
- By choosing EPAM, you're getting a job at Great Place To Work-Certified™ in 2024, Glassdoor’s Top 100 Best Places to Work in 2023 & one of Most Loved Workplace, as recognized by Newsweek, 2021 - 2023
- Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters
- You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices
- We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
- At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us
Life at EPAM
- We are a leading global provider of digital platform engineering and development services that has rapidly grown in Australia since 2013.
- We adopt a global growth strategy, thinking and acting like start-ups, working in multi-disciplinary teams, and delivering results. With a multinational talented team, we have been delivering innovative solutions for cloud migration, cyber security, digital transformation, etc.
- You will work in an open and friendly work environment where your professional skills and experience can stand out.
How We Hire
• Here, we summarize the typical journey to finding a job within EPAM.
• Apply and tell us about yourself!
• Go through some standard interviews:
- - General interview with a recruiter
- - Technical interview with our technology experts
- - Manager interview or Offer interview with a hiring manager
• Get ready to join the team!
• Not sure if you meet all the requirements? No problem. Let's talk anyway and find out more!
• It takes 1 min of application to start the journey with us. Apply now!
