Realtime Fraud Detection Platform
Sub-second fraud scoring across 2M events/day using Flink and a feature store.
FlinkKafkaFeastBigQuery
180ms p99 latency
Data Engineering · Cloud Architecture
Cloud Data EngineerAzure, Databricks& Microsoft Fabric
I'm Syed Moiz - a Data Engineer & Cloud Architect building reliable, scalable data platforms with Azure, Databricks, Microsoft Fabric, Snowflake, Spark, Kafka and Airflow.
40+
Pipelines shipped
3
Cloud platforms
8
Certifications
3+
Years experience
Selected Work
Data Engineering Projects & Architecture
Production-grade cloud data pipelines, ETL systems, lakehouses and architectures built on Azure Data Factory, Microsoft Fabric, Databricks, Snowflake and Apache Spark.
Data Engineering Portfolio — Azure Data Factory, Microsoft Fabric, Databricks & Snowflake Projects
Architecture Gallery
Cloud Data Architecture & System Designs
Reference architectures for ETL pipelines, lakehouse deployments, and data warehouse systems. Real diagrams from production Azure, Databricks, Snowflake and Apache Spark deployments.
Data Pipeline Architecture — Azure Data Factory, Microsoft Fabric, Databricks Lakehouse
Skills Network
A connected toolset
The technologies I reach for, grouped by where they live in the data lifecycle. Hover a node to trace its connections.
IngestionTransformationStorageOrchestrationServing
Certification Wall
Credentialed across every cloud
Validated expertise spanning Azure, AWS, GCP and the modern data stack.
2025
Azure Solutions Architect Expert
Microsoft Azure
AZ-305
2024
Azure Data Engineer Associate
Microsoft Azure
DP-203
2024
AWS Data Engineer Associate
Amazon Web Services
DEA-C01
2023
AWS Solutions Architect Associate
Amazon Web Services
SAA-C03
2024
Professional Data Engineer
Google Cloud
GCP-PDE
2023
Professional Cloud Architect
Google Cloud
GCP-PCA
2024
Databricks Data Engineer Pro
Microsoft Azure
DB-DEP
2023
SnowPro Core
Amazon Web Services
SNOW-CORE
Writing
Data Engineering Blog & Tutorials
In-depth guides and insights on building data pipelines, ETL/ELT systems, lakehouse architecture, and running data platforms on Azure Data Factory, Microsoft Fabric, Databricks, Snowflake and Apache Spark.
Data Engineering Blog — Azure, Microsoft Fabric, Databricks Tutorials & Guides
StreamingKafkaSpark
Designing Idempotent Streaming Pipelines
Exactly-once is a lie you tell your stakeholders. Here is how to build effectively-once pipelines with checkpoints, watermarks, and deterministic keys.
Sep 20258 min
LakehouseDatabricksCost
Lakehouse vs. Warehouse: A Cost Model
A practical framework for choosing between Delta Lakehouse and a cloud warehouse based on query patterns, concurrency, and storage economics.
Jul 202511 min
dbtMulti-cloudSQL
Running dbt at Scale Across Three Clouds
How we standardized transformation logic across Synapse, Redshift, and BigQuery with a single dbt project and provider-aware macros.
Apr 20259 min