Job Description

Data Engineer Skills: 5+ years of experience in large-scale data warehouse and lakehouse design, implementation, and maintenance. - Experience with big data management and processing tools like Hadoop and Apache Spark. - Experience with data transformation tools such as AWS Glue, Talend, and Databrick (SQL, Python, and Scala). - Experience with SQL and NOSQL databases such as MS SQL, AWS DynamoDB, Redshift, Synapse, Cosmos, Neo4J, and others. - Knowledge of data/delta lake architecture and technology, such as databricks lakehouse, object storage, and so on. Data Modeling and Analysis(Requirement Gathering) skills: - Experience with data modeling solutions, including tools, industry data models, data warehouse approaches, data modeling approaches (relational, dimensional, and NOSQL) or equivalent knowledge is required. - Experience with data modeling tools such as ERWIN data modeler or equivalent knowledge is required. - Define and apply standards, tools, best practices, and related development methodologies for data modeling and design. - Creates, reviews, and updates data models. - Perform preliminary analysis and collaborate with the project team and delivery team to develop a business solution. - Gathering and analysing business requirements, as well as being able to translate business requirements into technical requirements. - Carry out data analysis tasks in order to capture data requirements and represent them in data model visualization. - Identify areas for improvement in the data model in order to improve business operations. - Data extraction, analysis, interpretation, and pattern recognition from various tables and reports. - Assess data quality and filter/clean data by reviewing the business rules or requirements.

foundit