Job Description

Key Responsibilities
Data Platform Development
? Build scalable data pipelines that extract, transform, and load data from retail, warehouse, point-of-sale, and e-commerce systems
? Develop ETL/ELT workflows that handle diverse data formats and sources including APIs, database replication, and file imports
? Implement data models optimized for analytical queries and reporting requirements
? Create data processing jobs that efficiently handle large volumes of transactions and product data
? Build data quality validation checks to ensure accuracy and completeness
? Contribute to data platform architecture decisions and technical design discussions

API Development & System Integration
? Build RESTful APIs that expose data and analytics capabilities to business applications
? Develop integration connectors for systems that lack modern API capabilities
? Create middleware services that handle data transformation and format conversion
? Implement authentication, error handling, and logging for API services
? Work with message queues and event-driven patterns for data synchronization
? Document API specifications and integration procedures

Data Quality & Pipeline Reliability
? Implement automated data validation and quality checks within pipelines
? Build monitoring and alerting for data pipeline health and failures
? Develop reconciliation scripts that verify data accuracy across systems
? Create error handling and retry logic for robust pipeline execution
? Write unit and integration tests for data transformations
? Debug and resolve data quality issues reported by business users

Analytics Support & ML Workflows
? Prepare datasets for analytical use cases and reporting requirements
? Build feature engineering pipelines to support machine learning models
? Develop batch processing workflows for scheduled analytics tasks
? Create data export utilities for business intelligence tools
? Work with Python data libraries (pandas, NumPy) for data manipulation
? Support deployment of analytical models using established ML libraries

Collaboration & Documentation
? Work with business stakeholders to understand data requirements and use cases
? Participate in code reviews and provide constructive feedback to team members
? Create technical documentation for data pipelines and integration processes
? Collaborate with Full-Stack Engineers on system integration requirements
? Participate in sprint planning, daily stand-ups, and retrospectives
? Share knowledge and learnings with the broader team

Software Engineering Foundation
? Experience: 3-5 years of software development experience with at least 2 years focused on backend systems, data engineering, or API development
? Programming: Strong Python proficiency with experience writing production-quality code including proper error handling, logging, and testing
? System Understanding: Good grasp of backend architecture concepts, API design patterns, and database interactions
? Code Quality: Solid software engineering practices including version control (Git), code review participation, testing, and basic CI/CD
? Problem-Solving: Ability to debug issues across systems and optimize code performance

Data Engineering Skills
? Data Pipelines: 2+ years building and maintaining ETL/ELT pipelines; exposure to orchestration tools (Airflow, Prefect, or similar)
? SQL Proficiency: Strong SQL skills including joins, aggregations, window functions, and query optimization
? Data Modeling: Understanding of database design, normalization, and creating schemas for reporting
? Cloud Experience: Hands-on experience with at least one cloud platform (GCP, AWS, or Azure); familiarity with cloud data services
? Data Processing: Experience with batch data processing and working with large datasets

Integration & API Skills
? API Development: Experience building RESTful APIs using frameworks like FastAPI, Flask, or similar
? Integration Work: Practical experience integrating different systems via APIs, databases, or file-based methods
? Data Formats: Comfortable working with JSON, CSV, XML, and other common data formats
? Debugging: Ability to troubleshoot integration issues and trace data flow across systems

Technical Requirements
? Version Control: Proficient with Git including branching, merging, and pull requests
? Linux/Unix: Comfortable working in Linux environments; basic bash scripting
? Development Tools: Experience with modern IDEs and development workflows
? Testing: Understanding of testing practices (unit tests, integration tests)

Domain & Business Skills
? Retail Context: Basic understanding of retail operations (sales, inventory, products) or willingness to learn quickly
? Data Awareness: Understanding of how data flows through business systems
? Stakeholder Communication: Ability to communicate technical concepts to non-technical users
? Requirements Translation: Can translate business needs into technical specifications

Job Type: Contract
Contract length: 12 months

Pay: RM2,945.54 - RM10,904.33 per month

Benefits:

Health insurance Maternity leave Opportunities for promotion Professional development
Work Location: In person