Blog – Page 13 – Prologika

Not Your Kimball’s DW

August 13, 2022 / No Comments »

BI practitioners, myself included, have been following the Kimbal tenets for dimensional schema design for years. In fact, it's a second nature to dimensionalize every BI project the "proper" way. You identify fact tables, grain, dimensions, etc. Dimensions of course would have surrogate keys – your insurance against weird things happening down the road, such as tracking Type 2 changes, unreliable business keys, acquisitions, and what not. Of course, there are downsides. A lot of time is spent on the dimension design – regular dimensions, junk dimensions, mini dimensions... Your ETL process must load these dimensions. And there are dependencies. You can't just truncate and reload a dimension because the surrogate keys in the fact tables will be invalidated. But here comes a project that throws everything off. Don't you love projects like these? I'm designing a data warehouse solution for small financial company, where I model financial loans. The...
Atlanta MS BI and Power BI Group Meeting on August 1st (Power BI Automation)

July 25, 2022 / No Comments »

Please join us online for the next Atlanta MS BI and Power BI Group meeting on Monday, August 1st, at 6:30 PM ET. We'll have two presentations by 3Cloud. For more details and sign up, visit our group page. Presentation: 1. “Power BI Meets Programmability – TOM, XMLA, and C#” by Kristyna Hughes 2. “Automation Using Tabular Editor Advanced Scripting” by Tim Keeler Date: August 1st Time: 6:30 – 8:30 PM ET Place: Click here to join the meeting Overview: Power BI Meets Programmability – TOM, XMLA, and C# Tune in to learn how to programmatically add columns and measures to Power BI data models using TOM, XMLA, and C#! XMLA is a powerful tool available in the online Power BI service that allows report developers to connect to their data model and adjust a variety of entities outside the Power BI Desktop application. Combined with a .NET application, this...
Datasets vs Datamarts

July 18, 2022 / No Comments »

I sent a proposal for implementing a classic BI solution: Azure SQL-based datamart (not Power BI datamart please), ETL, semantic model, and reports. The client had a sticker shock. Return to sender … as other BI companies that quoted can do it for half! Upon digging, it turned out the other companies would build the semantic model (aka Power BI dataset) directly on top of the data source. On a Time&Materials (T&M) basis and charge by the hour, of course, what else? By contrast, I give fixed-price milestone-driven proposals and I don't get paid unless I deliver and meet written and agreed upon success criteria, but that's a different story. So, let me count the ways as the poet would say. It's certainly technically possible to slap a dataset on top of the data source(s). That's what self-service BI is all about right … until it doesn't serve anymore. Check...
Atlanta MS BI and Power BI Group Meeting on July 11th (Pushing the Query Folding limits with Power Query)

July 2, 2022 / No Comments »

Please join us online for the next Atlanta MS BI and Power BI Group meeting on Monday, July 11th, at 6:30 PM ET. For more details and sign up, visit our group page. Presentation: Pushing the Query Folding limits with Power Query Date: July 11th Time: 6:30 – 8:30 PM ET Place: Click here to join the meeting Overview: One of Power Query’s most powerful features is its ability to translate the Power Query formula language (M) back to a source systems native language and in this session, we’ll push the limits and possibilities to avoid “breaking the fold” and explore some potential dark magic with List functions. A base understanding of T-SQL is helpful though not required for this session. Speaker: From financial services to felines, the World Wide Web to professional wrestling - Alex Powers has an affinity for the conventional and unconventional when it comes to information....
Power BI Field Parameters

June 7, 2022 / No Comments »

Coming back from a long vacation and I almost missed this new Power BI killer feature: Field Parameters! Not to be confused with Dynamic M Query Parameters that I ranted about here, field parameters solve a long-standing limitation of Power BI that prevents binding dynamically fields to a visual. Dynamic binding isn't an issue with measures because they are dynamic and can evaluate runtime conditions, such as slicer selection, but dimensions are a different story. Once they are bound to a category bucket in a visual, you couldn't change them on the fly. Yet, one common scenario was to let the user control which fields will be used for slicing the measure(s) in a visual. I've seen rather convoluted implementations to get around this limitation. Field parameters to the rescue. Now once you create a field parameter and bind it to the visual, the user can simply select which field...
Power BI Datamarts: the Good, the Bad, and the Ugly

June 6, 2022 / No Comments »

As Microsoft announced here, Power BI datamarts are upon us. I can almost see an important enterprise client demanding "self-service datamarts me now or else… ", thus inspiring an opportunity for another premium feature, spearheaded with great vision and effort, but questionable practical value. In a nutshell, a Power BI datamart is a combo of Power BI Premium and a Microsoft-hosted Azure SQL Database aiming to simplify the implementation of a departmental datamart. The Good Unlike other vendors, such as Domo and their proprietary and overly expensive stack, Microsoft has decided to go with somewhat open solution consisting of tools that Power BI users already know: Power Query, Power BI Desktop (for the first time some of its modeling features, such as relationships and DAX measures, made it to the cloud), and SQL Server. Microsoft provisions the database for you although surrounds it with some red tape (more on this...
A Case for Azure Analysis Services

June 5, 2022 / No Comments »

Microsoft BI practitioners have three options for hosting semantic models: SSAS (on prem), Azure Analysis Services (cloud), and Power BI (cloud). AAS is somewhat caught between a rock and a hard place. Given that Power BI gets the most attention for cloud deployment, why would you consider AAS at all? There are two main reasons: Cost – Organizational semantic models might require a lot of memory and crunching power. Hosting them on AAS might be more cost effective. For example, AAS S4 runs at around $5,000 which at the same price point as Power BI Premium P1. However, it gives you 100 GB of RAM and 20 cores, whereas P1 has only 25 GB and 8 cores. Scaling out – A feature unique to AAS is ability to scale out to multiple query replicas. This is not an option with Power BI Premium, and it requires quite a bit of...
Atlanta MS BI and Power BI Group Meeting on June 6th (How Power Query Thinks)

June 2, 2022 / No Comments »

Please join us online for the next Atlanta MS BI and Power BI Group meeting on Monday, June 6th, at 6:30 PM ET. For more details and sign up, visit our group page. Presentation: How Power Query Thinks: Taking the Mystery Out of Streaming and Query Folding Date: June 6th Time: 6:30 – 8:30 PM ET Place: Click here to join the meeting Overview: How does Power Query produce the table data your expressions ask it to output? Query folding is one key concept—where behind the scenes, part or all of your M code may be rewritten into the data source’s native query language then offloaded to the source for execution. Streaming, though perhaps a less familiar term, is even more fundamental, as it describes how table data (as well as list and binary data) flows between functions in M. Understand these concepts, and you'll be better positioned to...
Power BI Dataflows vs ADF Mapping Data Flows

April 15, 2022 / No Comments »

An enterprise client wants to migrate many Alteryx workflows created over years by smart business users to the Microsoft ecosystem. During the initial intake, we discussed Power BI dataflows vs Azure Data Factory mapping data flows. Yep, Microsoft loves to confuse us, but these technologies have nothing to do with each other. Power BI Dataflows ADF mapping data flows Target audience Business users Professionals Availability Power BI Service Azure Data Factory and Synapse Studio Underlying technology Power Query Spark Expression language M Language Expression functions evaluated to Spark data types Computation Engine Power BI Compute Engine Spark clusters Output Azure Data Lake Storage (CSV files in CDM folders) Many sinks Debugging N/A Debug mode Monitoring Very basic (refresh failures) Detail output In a nutshell, Power BI dataflows are meant for self-service ETL, where the business users would be responsible for creating and managing the ETL flows. By contrast, ADF mapping...
FastTrack Recognized Solution Architect 2022

April 7, 2022 / No Comments »

Microsoft re-awarded me as a FastTrack Recognized Solution Architect - Power BI for 2022! This prestigious recognition is conferred by the Power Platform product engineering team for consistently exhibiting deep architecture expertise and creating high quality solutions for customers during project engagements. I'm one of the 36 individuals worldwide who met the following criteria: Must have a minimum of 2 years of experience with Power BI and a minimum of 5 years of experience with Enterprise BI solutions Must have a minimum of 2 years of experience as an Enterprise BI architect Must be working for a partner with Gold certification in Data Analytics MPN competency Must have been lead architect for at least 2 Power BI in-production implementations with at least 200 active users (Preferably for CAT managed customers)