Data Engineer
Kuala Lumpur, M14, MY, Malaysia
Job Description
Role : Data Engineer
Work Location: Kuala Lumpur
Contract Duration: 12 Months Extendable
Data
Engineer
(Data Lake Direction)Job Responsibilities:
Responsible for the daily operation, monitoring, and troubleshooting of the data lake on the big data platform, ensuring system stability;
Design, develop, and optimize ETL processes for data lakes, supporting efficient storage and processing of PB level volumn data;
Manage data lake metadata, permission control, and lifecycle to ensure data security and compliance;
Optimize data platform performance, including resource scheduling, storage cost control, and query efficiency improvement;
Collaborate with other teams to provide reliable data access and computing services.
Job requirements:
Bachelor's degree or above, major in computer related field;
Understand Hadoop/Spark/Live/Link and other ecological components, familiar with data lake architecture and technology stack;
Proficient in using SQL/Python, with ETL development and performance tuning capabilities;
Familiar with Linux system, storage (HDFS/S3), and containerization technology (Docker/K8s);
Having strong problem-solving skills, a strong sense of responsibility, and a good sense of teamwork.
Job Types: Full-time, Contract
Contract length: 12 months
Pay: RM4,517.97 - RM7,000.00 per month
Benefits:
Health insurance Maternity leave Opportunities for promotion
Work Location: In person
Beware of fraud agents! do not pay money to get a job
MNCJobz.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.
Related Jobs
Job Detail
-
Job IdJD1410093
-
IndustryNot mentioned
-
Total Positions1
-
Job Type:Full Time
-
Salary:Not mentioned
-
Employment StatusPermanent
-
Job LocationKuala Lumpur, M14, MY, Malaysia
-
EducationNot mentioned