Data DevOps - Databricks Remote
Data DevOps - Databricks Description
We are excited to announce an opening for a Data DevOps Engineer specializing in Databricks at our dynamic IT company. This role is perfect for a seasoned engineer with a strong background in the AWS tech stack, Terraform, and Python scripting. You will play a crucial role in our Databricks Unity Cloud Migration project on AWS, focusing on deploying Databricks Jobs, Pipelines, and Compute, as well as optimizing cloud storage and automating security.If you are a proactive, detail-oriented professional with a passion for cloud technologies and a desire to play a pivotal role in a dynamic, fast-paced environment, we would love to hear from you. Join us and contribute to exciting projects that shape the future of IT.
#LI-DNI#LI-YE1
#LI-DNI#LI-YE1
Responsibilities
- Deploy Databricks Jobs, Pipelines, and Compute on AWS
- Utilize Terraform for automating security groups and compute
- Assist in migrating existing workloads and optimizing cloud storage
- Adapt client job definitions using Python scripting
- Understand and implement the Databricks Object Model, particularly Unity Catalog
- Collaborate with cross-functional teams to ensure smooth migration and deployment processes
Requirements
- Proven experience as a DevOps engineer with a focus on the AWS tech stack
- Strong knowledge of Terraform and Python scripting
- Understanding of containers and the Databricks Object Model
- Experience in deploying Databricks Jobs, Pipelines, and Compute
- Cloud storage optimization experience
- Experience in AWS is required
We offer
- Career plan and real growth opportunities
- Unlimited access to LinkedIn learning solutions
- International Mobility Plan within 25 countries
- Constant training, mentoring, online corporate courses, eLearning and more
- English classes with a certified teacher
- Support for employee’s initiatives (Algorithms club, toastmasters, agile club and more)
- Enjoyable working environment (Gaming room, napping area, amenities, events, sport teams and more)
- Flexible work schedule and dress code
- Collaborate in a multicultural environment and share best practices from around the globe
- Hired directly by EPAM & 100% under payroll
- Law benefits (IMSS, INFONAVIT, 25% vacation bonus)
- Major medical expenses insurance: Life, Major medical expenses with dental & visual coverage (for the employee and direct family members)
- 13 % employee savings fund, capped to the law limit
- Grocery coupons
- 30 days December bonus
- Employee Stock Purchase Plan
- 12 vacations days plus 4 floating days
- Official Mexican holidays, plus 5 extra holidays (Maundry Thursday and Friday, November 2nd, December 24th & 31st)
- Monthly non-taxable amount for the electricity and internet bills
EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.
By applying to our role, you are agreeing that your personal data may be used as in set out in EPAM´s Privacy Notice and Policy.
