Platform Operations Engineer
Responsibilities
The Asia Data Office is looking for an experienced Platform Operations Engineer to join our team to support our regional partners. If you have passion for data and a desire to drive quality data solutions within a data driven culture, then read on to learn more about this opportunity!
We are looking for the right individual who would be interested and enjoy the opportunity to support data operations, strong willingness to learn and build data operations skills through team collaboration, desire to drive and execute on our data strategy, willing to help mature our agile practices, and is looking for an opportunity to embrace technical, operational and informal leadership roles on the team.
Duties
- Support business users in use of the Enterprise Data Lake (EDL) as part of BAU
- Maintain and monitor platform stability and performance of EDL
- Attends to Incidents and change requests
- Maintains the current data processes with in the EDL and issue notifications if there are incidents
- Write and maintain technical documentation
- Executes and reports on data quality metrics
- Executes updates, patches, and other activities required to maintain and enhance the operations of the EDL
- Supports the Agile delivery squads when required
Qualifications
Skills
- Linux System Administrator background: install and configure software using package management, diagnose and optimise operating system performance through identifying resource contention for I/O, CPU, Memory, managing identity management and access control at the operating system level..
- Integrating Linux systems with Microsoft Active Directory
- Shell commands and shell scripting
- Hadoop Experience: Decommissioning and recommissioning worker nodes, keeping track of jobs, monitoring critical components of the cluster, configure name-node high availability.
- Backup and disaster recovery design and implementation
- Running, tuning and troubleshooting Java applications
- Network configuration and understanding of the TCP/IP stack
- Configuration management and deployment tools such as Ansible, Puppet or Chef and Kickstart.
- Experience performing problem diagnostic and root cause analysis to identify targets for improvement.
- Experience on Azure Cloud and/or other Cloud platforms
- Experience implementing data governance and security for data platforms on Azure and/or other Cloud platforms
- Open Source RDBMS management including MariaDB/MySQL and PostgreSQL.
- Experience in managing Zeppelin, JupyterHub, R Studio is/are definitely added advantage
- Knowledge in data streaming (e.g. Kafka)
- Knowledge in any server-side programming languages (e.g. Java, Python, Spark, R…etc)
Education and experience
- Bachelor's degree preferably in Operations Management, Business or Data/Engineering related courses
- Recognized qualification in Service Management helpful
- ITIL certification helpful
- 3+ years in one or more of the following
- Data Engineer
- Platform Engineer
- DevOps Engineer
- Systems Engineer
- Systems Administrator
- Project management experience is an advantage
- Understanding of the insurance and/or financial industry is an asset
职能类别: 高级软件工程师
关键字: Hadoop Oracle Linux
联系方式
上班地址:高新区天府软件园C11 六楼
Get email alerts for the latest"大数据运维工程师 jobs in Chengdu"