Full job description

Responsibilities:

Design, build, and maintain robust and scalable data pipelines to collect, process, and store structured and unstructured data from various sources.
Develop and optimize database schemas, tables, and queries to support data storage, retrieval, and analysis.
Implement ETL processes to integrate data from various sources, ensuring data quality, consistency, and integrity.
Monitor and troubleshoot data pipelines and infrastructure issues and provide timely resolutions.
Develop real-time reports and dashboards using BI tools (e.g., Tableau, Power BI, Looker).
Collaborate with Business Insights Analyst and other cross-functional team members to understand data requirements, perform data profiling, and implement data transformation and cleaning processes

Requirements:

Proven experience as a data pipeline engineer in various functional teams such as Business Intelligence, Data Analytics, or a similar role.
Advanced Excel skills (such as VBA scripting, macros, array formulas, pivot tables, power queries, multi-data source integration, data cleansing methods, text and data manipulation functions, charting and dashboarding) and seasoned in large data validation, reconciliation, and management.
Strong Relational Database and SQL Scripting and skills with the ability to extract and manipulate large data sets.
Proficiency in BI tools (Tableau, Power BI, Looker, or similar) is an advantage.
Experience with real-time data processing and streaming technologies (e.g., Apache Flink, Kafka Streams) is not required but a strong advantage.
Skilled in automation, scripting or data manipulation languages such as Python, JavaScript, Bash/Shell,

Benefits:

Job Type: Full-time

Pay: RM7000-RM10000 per month

Data Engineer