Following on from my last post on checking whether query folding is taking place in a Power BI/Power Query query, I’ve just stumbled on another way of doing this – by looking at metadata. I blogged about M metadata and Power Query some time ago (you might want to read the post to get some background), but it seems like metadata is used more widely than I thought in M…
Take the following query, as used in my previous blog post:
let Source = Sql.Database("localhost", "adventure works dw"), dbo_DimDate = Source{[Schema="dbo",Item="DimDate"]}[Data], #"Removed Other Columns" = Table.SelectColumns( dbo_DimDate, {"DateKey", "FullDateAlternateKey", "DayNumberOfWeek"}), #"Filtered Rows" = Table.SelectRows( #"Removed Other Columns", each ([DayNumberOfWeek] = 1)) in #"Filtered Rows"
As shown in that post this query connects to the Adventure Works DW database in SQL Server and gets a few columns plus some filtered rows from the DimDate table, and most importantly query folding takes place for all of these transformations.
It turns out that each of the variables used as steps in the query can have metadata automatically assigned to them, some of which is relevant to query folding, and we can use the Value.Metadata() function to get this metadata. So, taking the previous query, we can add two extra steps:
let Source = Sql.Database("localhost", "adventure works dw"), dbo_DimDate = Source{[Schema="dbo",Item="DimDate"]}[Data], #"Removed Other Columns" = Table.SelectColumns( dbo_DimDate, {"DateKey", "FullDateAlternateKey", "DayNumberOfWeek"}), #"Filtered Rows" = Table.SelectRows( #"Removed Other Columns", each ([DayNumberOfWeek] = 1)), GetMetadata = Value.Metadata(#"Filtered Rows"), QueryFolding = GetMetadata[QueryFolding] in QueryFolding
The GetMetadata step gets the metadata associated with the #”Filtered Rows” step, and that metadata comes back in the form of a record with a single field called QueryFolding. The next step gets the data from that field, which is again in the form of a record:
So we can see quite clearly that this step is being folded and that SQL is being generated in the background. It doesn’t seem to be possible to get the SQL query generated here though.
One last thing to note: while all of this works for SQL Server, when I tested it on an SSAS data source where query folding is also definitely taking place the metadata told me – incorrectly – that there was no query folding happening (I couldn’t see the MDX query generated using the View Native Query menu option either). Maybe this is all still a work in progress?