Azure Data Engineer

Requirements* The successful candidate will be responsible for - Design, build, and maintain data transformation pipelines using AZURE services (Azure Functions, Step Functions .. ) in Python. - Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine. - Manage efficiently large dataset. - Manage SQL database - Postgresql or MongoDB. - Implement and maintain complex data calculation formula. - Open to collaborate with Software Engineers. - Participate in code reviews, design discussions, and software planning. - Contribute to automation, testing, and deployment processes.

Key Responsibilities* · Design, build, and maintain data transformation pipelines using AZURE services (Azure Functions, Step Functions .. ) in Python. · Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine. · Manage effeciently large dataset. · Manage SQL database - Postgresql or MongoDB. · Implement and maintain complex data calculation formula. · Open to collaborate with Software Engineers. · Participate in code reviews, design discussions, and software planning. · Contribute to automation, testing, and deployment processes.