Job Description

Responsibilities

Design, implement and validate Hadoop solutions. Troubleshoot MapReduce/Spark Jobs and do performance tuning in production environments. Independently develop and sustain technical knowledge, certifications, and skills. Effectively handling day-to-day assignments given moderate directions and supervision. Analyzing the data requirements across various entities, develop and maintain data ingestion pipelines. Automating data validation steps and report generation. Automating codes/ scripts that can be repeatedly used across similar analytics and reporting requirements. Managing and ensuring accuracy and timeliness and automation solution in end to end data extraction and integration with analytics and management reporting system. Designing the jobs schedule in scheduling tools and developing the configuration files for job schedulers. Performing L2 batch production support.

Requirements

ANALYTICAL SKILLS: To work with large amounts of data. Ability to collect, organize, analyse. COMMUNICATION SKILLS: Write and Speak Clearly with business users o ATTENTION TO DETAIL: Data needs to be accurate. Should be able to spot discrepancies, trends and be vigilant on data analysis. DOMAIN SKILLS: Experience in Financial reporting or Insurance domain - advantage. BS/MS in Computer Science, Engineering, or similar relevant field. Previous working experience as a Hadoop Developer for 5+ years. Proficient with Java and Scala. Hands-on experience on Spark framework and other distributed data processing frameworks like Hadoop Map-Reduce, Hive etc. Proficient in ETL tools like Talend, Datastage. Proficient in RDBMS databases such as Oracle, MySQL, MSSqlServer. Good to have working experience with one of the cloud platforms like AWS (Amazon Web Services). Microsoft Azure or Google Cloud Platform. o Hands-on experience with Linux system administration. Strong communication skills to collaborate with distributed teams. Analytical thinker with problem solving aptitude.
Job Type: Full-time

Pay: RM4,742.17 - RM5,900.00 per month

Benefits:

Health insurance Maternity leave Opportunities for promotion Professional development
Work Location: In person