Data Engineer
Job Details
Job Title:
Data Engineer
Department:
Engineering
Location:
Dubai, UAE
Job Type:
Contract
Salary:
TBD
Job Description of Data Engineer
✅ The Data Engineer will be responsible develop semantic models on top of Data lake/ Data warehouse to fulfill the self-service BI foundation requirements. Data extraction from the various data sources and integration into the central data lake / data warehouse using enterprise platform like Informatica iPaaS.
Key Responsibilities of Data Engineer
✅ Designing data warehouse data model based on the business requirements
✅ Designing, developing, and testing both batch and real-time Extract, Transform and Load (ETL) processes required for the data integration
✅ Ingesting of both structured and unstructured data into SMBU data lake / data warehouse system
✅ Designing and Developing Semantic Models/Self Service Cubes.
✅ Performing BI administration and access management to make sure access and reports are properly governed.
✅ Performing Unit Testing and Data Validation to ensure Business UAT are successful
✅ Performing ad-hoc data analysis and presenting results in a clear manner
✅ Assessing data quality of the source systems and proposing required enhancements to achieve satisfying level of the data accuracy
✅ Optimizing ETL processes to ensure execution time is meeting the requirements
✅ Maintaining and architecting ETL pipelines to make sure data is loaded on time on regular basis.
Qualification Required for Data Engineer
✅ 5 to 8 years of overall experience.
✅ Proven experience in development of the dimensional models in Azure Synapse with strong SQL knowledge
✅ Minimum of 3 years working as a Data Engineer in Azure ecosystem specifically using Synapse, ADF & Data bricks.
✅ Preferable 3 year of experience with data warehousing, ETL development, SQL Queries, Synapse, ADF, PySpark, Informatica iPaaS for data ingestion & data modeling.