Data Integration Engineer Ensenada, Mexico
Data Integration Engineer Description
Job #: 86987
You will join an established team that is responsible for the rapid and systematic onboarding and curation of data to meet the needs of the investment desk. The team leverages vendor-sourced and self-developed tools and frameworks to rapidly deliver data pipelines that are reliable, scalable and that form a critical part of the investment data universe for the client.
#REF_BMENS_MX
#REF_BMENS_MX
Responsibilities
- Data pipeline creation:
- Create data pipelines to onboard a variety of new datasets using your technical skillset
- Improve existing processes to reduce data pipeline error counts and increase automation of data onboarding processes
- Data curation:
- Create data quality scripts to identify and remediate poor quality data
- Wrangle / manipulate data to make datasets fit for usage by client’s front office teams
- Curate disparate datasets into well-defined and cross-mapped datasets
Requirements
- Sound SQL skillset for data interrogation and manipulation
- Expert Python skillset for data analysis and automation – experience pandas, numpy, etc
- Code management tools and experience of working from a checked-in code base
- Industry knowledge / experience
- Experience in the financial market (nice to have)
- Knowledge of Apache Spark
- Experience working with Microsoft Azure
- Data engineering / data wrangling / data cleaning / data architecture experience
- Experience with industry vendors e.g., Bloomberg, Refinitiv, IHS Markit
- Experience in Agile projects, working knowledge of Jira and Confluence
- The right attitude to navigate uncertainty and / or complexity whilst retaining a positive outlook
- Clear and concise communication skills, and the ability to transfer knowledge efficiently
- Attention to detail and strive for continual improvement
- Ability to form sound, honest, and mutually respectful relationships with the key client, visiting their London office as required
- Data Lake / Delta Lake / Data Mesh methodologies. Inmon vs Kimball, Staging areas, SCD and other dimension types, advanced and hybrid-data modeling approaches: Data Vault, NoSQL structures
- Advanced knowledge of Data Integration tools (Azure Data Factory, AWS Glue, GCP Dataflow, Talend, Informatica, Pentaho, Apache NiFi, KNIME, SSIS, etc.)
- Advanced knowledge of Relational Databases SQL
We offer
- Career plan and real growth opportunities
- Unlimited access to LinkedIn learning solutions
- International Mobility Plan within 25 countries
- Constant training, mentoring, online corporate courses, eLearning and more
- English classes with a certified teacher
- Support for employee’s initiatives (Algorithms club, toastmasters, agile club and more)
- Enjoyable working environment (Gaming room, napping area, amenities, events, sport teams and more)
- Flexible work schedule and dress code
- Collaborate in a multicultural environment and share best practices from around the globe
- Hired directly by EPAM & 100% under payroll
- Law benefits (IMSS, INFONAVIT, 25% vacation bonus)
- Major medical expenses insurance: Life, Major medical expenses with dental & visual coverage (for the employee and direct family members)
- 13 % employee savings fund, capped to the law limit
- Grocery coupons
- 30 days December bonus
- Employee Stock Purchase Plan
- 12 vacations days plus 3 floating days
- Official Mexican holidays, plus 5 extra holidays (Maundry Thursday and Friday, November 2nd, December 24th & 31st)
- Relocation bonus: transportation, 2 weeks of accommodation for you and your family and more
- Monthly non-taxable amount for the electricity and internet bills
Conditions
- By applying to our role, you are agreeing that your personal data may be used as in set out in EPAM´s Privacy Notice (https://www.epam.com/applicant-privacy-notice) and Policy (https://www.epam.com/privacy-policy)
