Smart Data Warehouse Limited

Fabric Makes Big Data Simple — But What Happens When the Data Isn’t Big?

One thing that keeps impressing new learners is how Microsoft Fabric quietly absorbs everything we used to build manually in SSAS Tabular.

All the VertiPaq compression, all the in‑memory speed, all the analytical power… now sits natively on top of your Lakehouse Delta tables.

No separate SSAS server.
No complex refresh pipelines.
No scattered security layers.
Just one workspace, one engine, one flow.
That’s the big‑data story everyone knows.

But during a recent class, a student asked a question that stopped the room for a moment:

“If my dataset is small — maybe just a thousand rows — do I still need a Semantic Model?

Does it matter when compression and in‑memory storage won’t make a big difference?”

It’s a thoughtful question, and it opens up a bigger conversation about modeling discipline, governance, and how analytics evolve as organizations grow.

I’m curious to hear how other professionals in the Fabric ecosystem think about this.

Your insights will help our students see the wider landscape and understand how different teams approach the same challenge.

For organizations exploring Fabric or preparing their teams for this new architecture, Smart Data Warehouse Limited provides hands‑on training and consulting to help you understand not just the tools — but the thinking behind them.

🎓 Mastering ADF Best Practices: Dynamic File Movement Using the GetMetadata Approach.

As we continue demonstrating to our students how to efficiently and economically move multiple files at once using the GetMetadata approach, we focused on one technical area many learners often find challenging to implement correctly.

In today’s session, we walked through our clean, production‑ready method that uses two different source datasets—one parameterized and one non‑parameterized—alongside a parameterized destination dataset.

This pattern is a best practice for any ADF data engineer who wants to confidently handle dynamic file ingestion using the GetMetadata + ForEach method.

I’m glad to see our students now understand not only when to use each approach, but how to implement them successfully inside real pipelines.

Because of the high number of requests from our Data Engineering community, we’ll be revisiting both approaches again this Saturday during our community session.

If you’d like to join the community or be part of our next cohort at Smart Data Warehouse Limited, feel free to reach out.

THE QUESTION THAT GOT OUR RECENT DATA ENGINEERING STUDENT A SNOWFLAKE DATA ENGINEERING ROLE.

“If my SQL pipeline already does MERGE INTO for Silver, captures metadata with Streams, and handles SCD Type 2 for Gold…

why do I need dbt at all?

Isn’t my SQL pipeline already doing everything?”

This question is not just technical —
it’s architectural, and it reveals a mindset shift every modern Data Engineer must make.

This Saturday, as we resume our Data Engineering Discussion Community, Henry will break this down properly and demonstrate how to implement the full workflow efficiently.

If you’re serious about Data Engineering, this is one conversation you shouldn’t miss.

Want to understand the real answer?

Join the community session.

Ask your questions live.

See the architecture behind the tools.

🚀 Subsidized Master Data Engineering Class — Registration Still Open!

We’re excited to announce our Subsidized Master Data Engineering Program starting at the end of this month — designed for professionals who want real, practical mastery without the heavy price tag.

For only $500, you get a powerful weekend‑only learning experience (Saturdays & Sundays) focused on the skills that matter most in today’s data engineering world.

🔥 What You’ll Learn

1️⃣ Simplifying Azure Data Factory (ADF) for SCD Type 1 & Type 2
We break down complex concepts into clear, actionable steps:

How to design SCD Type 1 and Type 2 pipelines
How to implement change tracking cleanly
How to build reusable, scalable ADF patterns
How to structure lookup logic and effective dating

2️⃣ Fabric Notebook Parameterization for Medallion Architecture
Hands‑on guidance for building:
Bronze (raw ingestion)
Silver (cleaned & conformed)
Gold (business-ready analytics)
All using Fabric notebooks, parameterization, and modular ETL design.

📸 Bonus
You can also check out an image showing how a simplified ADF pipeline implements SCD Type 2 using the link below.

📩 Registration
We are still accepting registrations.

If you’d like to join, simply reach out — we’ll get you onboarded.