Azure Data Engineer Required in Dubai - Dubai
Azure Data Engineer Required in Dubai
Job Description
Summary:
We are seeking a Data Engineer with deep expertise in ETL/ELT, PySpark, Databricks, Azure
ecosystem, and experience with Enterprise Systems like Oracle ERP, ERP Fusion, and Salesforce. Thesuccessful candidate will play a key role in designing and implementing complex data pipelines,handling both structured and unstructured datasets, and optimizing our Azure-based data systems.
The successful candidate will have a strong foundation in data warehousing concepts and database design. Additionally, this individual will work closely with other data engineers & the data science team to support their analytics needs and improve the performance of our data products.
Key Responsibilities:
· Design, construct, install, test, and maintain highly scalable and robust data management
systems.
· Understand and apply data warehousing concepts to design and implement robust data
warehouse tables in line with business requirements.
· Build complex ETL/ELT processes for large-scale data migration and transformation across
platforms and Enterprise systems such as: Oracle ERP, ERP Fusion, and Salesforce.
· Ability & expertise to extract data from several sources like APIs, Jsons, Databases etc
· Leverage PySpark and Databricks within the Azure ecosystem to manipulate large datasets,
improve the performance, and enhance scalability of our data operations.
· Develop and implement Azure-based data architectures consistent across multiple projects
while adhering to best practices and standards.
· Lead initiatives for data integrity and normalization within Azure data storage and processing
environments.
· Evaluate and optimize Azure-based database systems for performance efficiency, reusability,
reliability, and scalability.
· Troubleshoot complex data-related issues within Azure and provide expert guidance and
support to the team.
· Ensure all data processes adhere to governance, data security, and privacy regulations.
Required Qualifications:
· Bachelor's degree in Computer Science, Information Technology, Engineering, or a related
field.
· 8+ years of experience in a Data Engineer role, with at least 3 years as an Azure data
engineer.
· Expertise in Python, SQL, and deep understanding of PySpark.
· Proficient in Databricks or similar big data solutions.
· Strong knowledge of ETL/ELT frameworks, data structures, and software architecture.
Proven experience in designing and deploying high-performance data processing systems on.
· Extensive experience with Azure cloud data platforms, including Azure Data Factory, Azure
SQL Data Warehouse, Azure Databricks.
· Ability to design and implement data schemas, data models, and database designs in
accordance with business requirements.
Preferred Qualifications:
· Databricks certification or equivalent big data technology certification.
· Exceptional analytical and problem-solving abilities.
· Excellent communication skills.
interested candidates please share your updated CV to [email protected]
