Job Description

The Data Engineer will support the technology department in developing and implementing data solutions to enhance business operations in the energy and natural resources industry. This role is based in Kuala Lumpur and involves working with cutting-edge technologies to process and manage large datasets effectively.

• Design, develop, and maintain data pipelines and ETL workflows using AWS services.
• Implement orchestration and automation for data workflows.
• Work with large datasets to ensure data integrity, scalability, and performance.
• Collaborate with stakeholders to understand data requirements and deliver solutions.
• Deploy changes directly to production environments with confidence and accountability.
• Support migration efforts to Databricks and optimize workflows for performance.

Opportunity to work on large scale global projectsOpportunity to work with international cross functional teams
A successful Data Engineer should have:

• Experience with data lake architectures, big data technologies, and data pipeline orchestration.
• Familiarity with CI/CD practices for data engineering.
• AWS Certification (e.g., AWS Certified Data Analytics - Specialty or Solutions Architect) is a plus.
• Strong problem-solving skills and attention to detail.
• Expert-level fluency in AWS services relevant to data engineering, including Glue, S3, Lambda, Step Functions, and other related services.
• Strong proficiency in PySpark for distributed data processing.
• Advanced SQL skills for querying and optimizing data operations.
• Comfortable with pushing changes live without formal review, ensuring quality through self-validation.
• Databricks experience is a plus.
• Ability to work independently and manage tasks in a siloed environment.

The employer is a large organization within the energy and natural resources industry, offering a professional environment and opportunities for technological innovation. The company is committed to leveraging advanced data solutions to improve its operations and services.

• Contract: 1 year (extendable)
• Medical Benefits
• Hybrid Working Arrangement
• Opportunities to work with the latest technologies in the industry.
• Opportunity to work on large scale project with big international teams

This is an excellent opportunity for a Data Engineer based in Kuala Lumpur to contribute to impactful projects within the energy and natural resources industry. Apply now!

Skills Required