Key Responsibilities:
• Design, implement, and maintain scalable data storage solutions using Azure SQL Database, Azure Data Lake, and Azure Blob Storage.
• Develop and maintain data pipelines for data ingestion, processing, and transformation using Azure technologies.
• Build and manage ETL processes utilizing Azure Data Factory (ADF) and related tools.
• Leverage Databricks and ADF to process and manage large, complex datasets.
• Ensure data quality through validation, cleansing, and governance practices.
• Optimize Azure SQL databases for performance and reliability.
• Collaborate with data engineers, business stakeholders, and cross-functional teams to deliver scalable data solutions.
• Participate in Agile/Scrum ceremonies and contribute to continuous improvement initiatives.
Required Skills:
• Strong experience in Azure Data Engineering
• SQL, Python/PySpark, and Apache Spark
• Azure Databricks and Azure Data Factory (ADF)
• Data modeling and ETL development
• Data warehousing concepts and big data technologies
• Azure DevOps
• Data governance and data quality principles
• Strong analytical, problem-solving, and stakeholder management skills