Key Responsiblities:
Requirements
Collects and understand the requirements
Documents the data sources and maps to target structures
Creates mappings documentation for pipelines and data requirements.
Development
Build and design the data model following pre determine principals and in a way that easily usable by Consumers (AI/BI)
Develops, unit tests and deploys DDL Scripts.
Develops, unit tests and deploys data fixes.
Ensures Non Functional Requirements can be met within the proposed solution.
Performance testing - SQL query tuning
Develops good relationships with technical stakeholders and peers.
Follows Pipeline Development Standards.
Develops ETL pipelines and transformation logic.
Organises code review and pull request of own code.
Manages their code in Version Management Tool (Bitbucket)
Raises Pull Requests and ensure timely code merge
Follows db design and coding standards
Testing
Creates test cases and ensures code quality is meeting expectations
Reviews test results and provides updates and reports on any issues.
Ensures data quality is in accordance with the SLAs.
Ensures all code is of high quality and adheres to standards and best practices.
Reviews code changes of peers and ensures all code is of high quality.
Technologies
Datawarehouse Concepts and SQL queries preferably in MS Synapse and MS Transact SQL
Ensures that DDL meets Schema Version Tool requirements
Expands the ETL frameworks in line with the architecture requirements.
Operational
Performs rostered operational monitoring and system checks (rotational system across the team, generally one week every 4-6 weeks)
o Ensures system health checks are performed and any issues identified.
o Performs error triage during operational monitoring and manages any operational issue to conclusion
Ensures Regression Test Cases are developed and available in Operation Monitoring Dashboard/email.
Ensures data quality is maintained at all times.
Ensures excellent Security processes and standards are in place and well maintained.
Ensures pipelines and ETL processes are up and running within the agreed SLAs.
Resolves System Errors in a timely manner and ensures any issues are resolved with the SLAs.
Direct Reports
Nil
Key Working Relationships
Internal Relationships
Datium Insights team
Marketing team
Sales Team
Tech team
External Relationships
Key customers
Key Experience, Skills and Education
Key Experience
Translate source data into business-driven models in the warehouse with the ability to transform the source into abstract concepts in the warehouse.
Demonstrated experience in modelling large data warehouses or parts of a larger data model. (both star and snowflake)
Excellent ability in using adhoc analytics to provide valuable insights from Source Data and Datawarehouse.
Strong analytical skills, problem-solving and critical thinking skills
Familiarity of ETL processing, data transformation and data modelling techniques.
Ability to work with large amounts of data and information and see the 'bigger picture'.
Able to articulate data issues clearly and be a good communicator with excellent oral/written communication skills.
Expertise in data warehousing, dimensional modelling, and the ability to drive standard methodologies in data management and governance.
Avid-learner, flexible, self-motivated, and forward-thinking
High level of accuracy and excellent attention to detail
Good organisational and time management skills
Ability to work in a team and with little supervision
Strong verbal and written communication skills in English, including proficiency in MS Excel, MS PowerPoint and MS Word.
Desirable Skills
Experience within the Auction industry and/or Automotive retail industry is highly desirable.
Bachelor's Degree or higher, ideally specialising in Finance, Marketing, Statistics, Mathematics, Data
Science, Data Engineering or equivalent.
Experience in Python or similar a plus.
Job Type: Full-time
Pay: RM12,000.00 - RM13,500.00 per month
Work Location: In person
MNCJobz.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.