Lead Software Engineer (Big Data) Chengdu, China
Lead Software Engineer (Big Data) Description
Job #: 62820DESCRIPTION
We are looking for an experienced Lead Software Engineer (specializing in Big Data) in Chengdu to make the team stronger.
Responsibilities
- Fulfil the roles of key developer and software architect, and usually also roles of a development team lead, project coordinator, reviewer or auditor as well
- Be a role model for colleagues, e.g. create high quality deliverables and technical documentation
- Be in charge of backlog creation, design development of end to end pipelines of data loading, create data schema validation checks
- Understand, follow and enhance defined software development process and introduce engineering practices
- Provide input on, follow and evangelize code quality guidelines and standards, assist other developers and conduct code reviews
- Develops proposals for implementation and designs scalable Big Data architecture
- Participate in customer’s workshops and present designed solutions
- Design, implement, and deploy high-performance, custom applications at scale on Cloud
- Define and develop network infrastructure solutions to enable partners and clients to scale Big Data architecture for growing demands and traffic
- Define common business and development processes, platform and tools usage for data acquisition, storage, transformation, and analysis
- Develop roadmaps and implementation strategy around data science initiatives including recommendation engines, predictive modeling, and machine learning
- Perform reviews and audits of existing solution, design and system architecture
- Perform profiling, troubleshooting of existing solutions
- Create technical documentation
- Lead the strategic planning, development and implementation of medium-to-large Big Data solutions or a component of a larger solution. Lead on all stages of presales activities for such projects. Works on architectural POCs, where required
- Interact with clients, advise and lead the translation of business requirements and models into appropriate architectural designs to ensure that business needs are met
Requirements
- Bachelor's degree or above in Computer Science, Software Engineering or related majors
- Minimum 7 years of relevant development experience
- Minimum 2 years of experience with at least 3 major big data technologies and frameworks including but not limited to Spark/Databricks, Sreamsets, AWS S3, Glue, and Redshift to create end to end pipelines
- Minimum 1 year as Solution Architect, doing solution architecture design and architecture review for small-to-medium size solutions with business use-cases based on familiar technology stack
- Good understanding of data modelling and able to design with standards
- Able to translate functional and non-functional requirements into development tasks and architecture design
- Strong knowledge of at least one programming language such as Scala, Python
- Expert in designing high quality solutions using OOP, TDD/BDD, Design Patterns and SOLID principles
- Excellent interpersonal skills, analytical mind, conscientious attitude, and passion for engineering excellence
- Mandarin speaker, upper intermediate (CEFR B2) or higher level of spoken and written English
- Good communication and presentation skills
- Self-management and strong prioritization skills
- Understanding of code quality measurements and able to implement efficient Unit Tests
- In depth understanding of different phases of software development lifecycle and understanding of Agile Scrum processes
- Ability to analyze and evaluate engineering problems in order to find the best possible solution
- Willingness to adapt to changing requirements and ability to prioritize accordingly
- Possess strong SQL knowledge and general knowledge of data management
- Practical expertise in performance tuning and optimization, bottleneck problems analysis
- Demonstrated experience in solution cost estimation (including tools, tasks, complexity, labor & time) at coarse grain levels, with supporting material evidence
- Ability to work with Linux console and write bash/shell scrips
- Ability to provide technical solutions from an architect perspective
- Ability to provide realistic estimation on required effort and manage to complete tasks in accordance with estimation
Nice to have
- Experience with big data solutions developed in large cloud computing infrastructures such as Amazon Web Services, Microsoft Azure or Google Cloud
- Experience in design of one or more of the following: Master Data Management, Data Governance, Advanced Analytics / Data Science, Big Data solutions
- Certification in Big Data field (i.e. one of Spark, Databricks)
- Data Science and Analytics experience is a plus (Machine Learning, Recommendation Engines, Search Personalization)
- Knowledge of one additional programming language as Java, Scala, R, Python or C#
- Ability to analyze and propose to customer cross-industry or cross-platform solutions
- Runs technology community or technical talks series
We offer
- Experience exchange with colleagues all around the world
- International projects
- Opportunities for self-realization
- Friendly team and enjoyable working environment
- Engineering, corporate and social events
- Professional & soft skills trainings, medical & family care programs, and forums to explore beyond work passion (CSR, photography, painting, sports, etc.)
- Free English classes
- Online training course library, mentoring, career development and potential partial grant of certification
- Flexible working schedule
- Compensation for sick leave and paid time off
- Tech talks and hackathons
- Referral bonuses