Job Description

Key Responsibilities

Lead the architecture design and implementation of big data platform components including storage, compute, scheduling, security and governance. Work with Product, R&D, BI and Business teams to translate business requirements into practical data platform use cases and capabilities. Optimise platform performance and improve overall efficiency of compute and storage usage. Ensure high availability, observability, security and regulatory compliance of the big data platform. Provide technical guidance and mentorship to data engineers and ETL developers. Drive technical knowledge sharing, documentation standards and best practice adoption across the team.

Requirements

Bachelor's Degree in Computer Science, Software Engineering, Data Science or a related field. Minimum 5 years' experience in big data platform development, with at least 3 years in architecture design. Proficient in English (spoken and written) and able to use it as a working language. Strong hands-on experience with Hadoop ecosystem (HDFS, Hive, YARN, MapReduce), Spark, Flink and Kafka. Solid knowledge of data warehouse modelling and ability to abstract complex business requirements into architecture designs. Good understanding of distributed systems principles and experience in performance tuning, high availability and elastic scaling. Familiar with data lake technologies; experience in cloud-native big data platform implementation will be an added advantage. Excellent system analysis, communication and stakeholder management skills. Experience in large-scale internet/tech or fintech companies is preferred.
Job Types: Full-time, Permanent

Pay: RM15,000.00 - RM25,000.00 per month

Work Location: In person