Posted inAzure Microsoft Fabric
Unraveling the Limitations of Microsoft Fabric:
An honest look at Microsoft Fabric's limitations: gaps, workarounds and what to consider before adopting it for your data platform.
Posted inAzure Microsoft Fabric
Unleashing the Power of mssparkutils in Microsoft Fabric Notebooks
Use mssparkutils in Microsoft Fabric notebooks to work with files, secrets, notebooks and environment utilities, with practical code examples.
Posted inAzure Microsoft Fabric tenant settings
Microsoft Fabric Tenant Settings Deep Guide
A deep guide to Microsoft Fabric tenant settings: what the key settings control, how access is layered, and the safest defaults for production.
Posted inAzure DevOps Big data CI/CD
Mastering Branch Management in Microsoft Fabric with Azure DevOps
Manage branches in Microsoft Fabric with Azure DevOps Git integration: workspace setup, branching strategy and safe deployment workflows.
AWS serverless streaming analytics
A fully serverless streaming analytics pipeline on AWS using Kinesis Data Streams, Lambda, S3 and QuickSight, from ingestion to dashboards.
Posted inAzure Microsoft Fabric
Microsoft Fabric Spark Diagnostic Emitter for Logs and Metrics
Send Microsoft Fabric Spark logs and metrics to Azure Log Analytics, Storage or Event Hubs with the Spark diagnostic emitter, step by step.
How to Install Apache Spark on Windows
Install Apache Spark on Windows for local development: Java, Spark and Hadoop winutils setup, environment variables and a first PySpark test.
Exploring AWS Glue with Real-Time Integrative Examples
Explore AWS Glue with practical examples: crawlers, the Data Catalog, ETL jobs and real-time style integrations for serverless data pipelines.
Posted inBig data SQL Uncategorized
Optimizing Database Performance with Materialized Views
Speed up slow, repeated queries with materialized views: how they work, when to use them, refresh strategies and trade-offs, with SQL examples.
Introduction to Git and GitLab
Git and GitLab for data engineers: version control for code and pipelines, branching, merge requests and CI/CD automation explained simply.