Examples of Flink on Azure

Local SQL Database ---> Azure ---> Power BI

Project Y is a straightforward Landing Zones automated deployment tool dedicated to data processing.

Everything you need to know about cloning, importing and using the Profisee Azure Data Factory templates.

Transform data from on-premises SQL Server to Azure Delta Lake Storage for Analytics and Visualization

This solution performs analytics and outlier detections on Apache compliant web server logs. This is based on Microsoft Azure technologies & PowerBI.

Code samples as published on blog

A Re-do of Perth City Properties project using Azure Data Engineering technologies such as Azure Data Factory (ADF), Azure Data Lake Storage Gen2, Azure Blob Storage, Azure Databricks.

This repository is designed for a data science project aimed to education, wich uses a public database from brazilian educational research institute about the nationam highschool exam and applies ETL and datamining association rules to this dataset.

Framework de ingestão de dados com Azure Data Factory, compatível com Synapse Analytics e Microsoft Fabric

This project extracts data having 800k records from CSV in the data factory and convert it to parquet based data and finally create a PowerBI report of that parquet based data.

Springboard Open Ended Capstone

This project builds an End-to-End Azure Data Engineering Pipeline, performing ETL and Analytics Reporting on the AdventureWorks2022LT Database.

This project exemplifies a robust Azure streaming data solution tailored for fitness data analysis, leveraging Azure's powerful ecosystem to deliver actionable insights and drive informed decisions in health and wellness management.

Tokyo Olympics Analysis Using AZURE platform

Practice with Azure Synapse Analytics/Databricks Pipeline

To establish a robust data engineering pipeline that leverages rigorous data quality checks to deliver timely, accurate, and reliable data-driven insights for healthcare revenue cycle management (RCM). The pipeline will produce fact and dimension tables to empower reporting teams in generating critical KPIs.

Ingested Tokyo Olympic data into Azure Data Lake using Azure Data Factory. Enhanced data quality with Apache Spark on Azure Databricks. Optimized SQL queries on Synapse Analytics, reducing execution time. Developed engaging Power BI dashboards, boosting user engagement creating KPI's with DAX.

This repository contains resources for mastering Azure Data Factory from scratch, specifically designed for data engineers. The repository includes pipelines, datasets, linked services, data flows, and an input file that can be used as a practical guide to understand and implement various data engineering tasks in Azure Data Factory.