Data Engineer
KEY RESPONSIBILITIES
Design, build and maintain scalable ETL/ELT data pipelines for structured and unstructured data from various data sources.
Develop and maintain central data warehouses, data lakes and other data storage solutions.
Work with business stakeholders in Asia-Pacific (Australia) and North America to design, build and maintain data products for business use-cases.
Develop and implement advanced analytical solutions including machine learning models and predictive analytics.
Integrate data from a variety of internal and external sources to support analytics, reporting and operational processes.
Collaborate with Data Architect, Analysts and business stakeholders to understand requirements and translate them into technical solutions.
Monitor, troubleshoot and optimise data pipelines for performance and reliability.
Ensure data quality, security, integrity and consistency across systems through effective governance practices.
Document technical processes, data flow, and design decisions.
Support data migrations and modernisations from legacy systems to cloud or modern platforms and other projects.
Follow best practices in data engineering, including automation, version control and CI/CD for pipelines.
Promote knowledge sharing and best practices across the data and analytics function
QUALIFICATION REQUIREMENTS
Education and Experience
Bachelor's or Master's degree in Computer Science, MIS, or a related field or an equivalent combination of diploma, certifications and relevant experience.
Minimum of 5 years of experience in data engineering, analytics engineering or a similar role.
Proven experience designing and deploying ETL/ELT pipelines in production environments.
Strong understanding of data warehousing concepts and data modelling.
Technical Skills
Strong proficiency with SQL and data transformation tools.
Experience with ETL tools (e.g. Informatica, Databricks, DBT etc.)
Familiarity with cloud platforms (AWS, Azure, GCP) and data storage services (S3, BigQuery, Snowflake etc.) and formats (Parquet, Blob Storage etc.)
