Data Engineer (Databricks), , Oxydata Software Sdn Bhd is a local 100% Malaysian-owned MSC status company established in 2006. Our core competencies are in IT Managed Services, Dev/Ops, Outsourcing, Microsoft Platform development services such as Microsoft Azure, SharePoint, Power Platform, Dynamics CRM, PowerBI, and . NET/Mobile Application development and using Microsoft SureStep methodologies. REQUIREMENTS
Minimum 3 years of being in a data engineer role.
Provide data integration (including cloud) following standards and architecture in a standardized manner.
Provide data ETL/ELT between multiple data layers in Enterprise Data Hub (EDH)
Develop, construct, test, and maintain data architectures, set or model based on business requirement
Support and solve integration issues, either at the application level or infra and network level
Identify the bottlenecks in the existing data pipelines, propose and lead the efforts to optimize and automate the data pipeline works
Leverages a variety of programming languages & data crawling/processing tools to ensure data reliability, quality & efficiency.
Ensure lake architecture is following the company\'s approved architecture.
Experience in Data Transformation using ETL/ELT tools such as AWS Glue, Factory, Talend, EAI
Experience in database queries using SQL.
Experience in Cloud Data-related tool(Microsoft Azure,AmazonS3