<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>Power Query &#8211; DataMartIn</title>
	<atom:link href="https://datamartin.ca/category/power-query/feed/" rel="self" type="application/rss+xml" />
	<link>https://datamartin.ca</link>
	<description>We Know Data</description>
	<lastBuildDate>Tue, 30 Jul 2024 13:22:40 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=6.1.1</generator>
	<item>
		<title>Essential checklist to keep your Power BI Solutions optimized. Part I: Optimizing the Data source</title>
		<link>https://datamartin.ca/2022/09/18/essential-checklist-to-keep-your-power-bi-solutions-optimized-part-i-optimizing-the-data-source-2/</link>
		
		<dc:creator><![CDATA[Nuric Ugarte]]></dc:creator>
		<pubDate>Sun, 18 Sep 2022 20:35:52 +0000</pubDate>
				<category><![CDATA[Performance]]></category>
		<category><![CDATA[Power BI]]></category>
		<category><![CDATA[Power Query]]></category>
		<guid isPermaLink="false">https://site1668528124.mywhc.ca/?p=400</guid>

					<description><![CDATA[This is a series of articles about the most important practices at every step of your solution to get scalable data models and faster reports: At the end of this series of articles, you will be able to download the summary checklist in Excel format, I recommend you keep it handy to review it every [&#8230;]]]></description>
										<content:encoded><![CDATA[<p>This is a series of articles about the most important practices at every step of your solution to get scalable data models and faster reports:</p>
<p><img decoding="async" class="wp-image-320 aligncenter" src="https://datamartin.ca/wp-content/uploads/2022/09/steps-300x40.jpg" alt="" width="623" height="83" srcset="https://datamartin.ca/wp-content/uploads/2022/09/steps-300x40.jpg 300w, https://datamartin.ca/wp-content/uploads/2022/09/steps-1024x136.jpg 1024w, https://datamartin.ca/wp-content/uploads/2022/09/steps-768x102.jpg 768w, https://datamartin.ca/wp-content/uploads/2022/09/steps.jpg 1082w" sizes="(max-width: 623px) 100vw, 623px" /></p>
<p>At the end of this series of articles, you will be able to download the summary checklist in Excel format, I recommend you keep it handy to review it every time you build a Power BI solution from scratch or need to improve the performance of your existing developments.</p>
<h4><strong>Part I. Optimizing</strong><strong> the Data source</strong></h4>
<p>This includes the source, connections, and power query transformations performed prior to loading a table to the data model.</p>
<p><strong>&#8211; Ensuring </strong><a title="Folding Importance" href="https://datamartin.ca/2022/09/19/importance-of-query-folding-and-good-practices/#QueryFolding" data-anchor="#QueryFolding"><strong><u>query </u></strong><strong><u>folding</u></strong></a> <strong>occurs whenever possible: Applying query folding in your power query tables could exponentially reduce resource utilization and refresh time.</strong></p>
<p>When you are working with a relational data source (such as SQL Server) always check the query folding. If most of the steps do not support it, consider applying transformations on the data source using a database view or by physically preparing and materializing the data.</p>
<p>You must have the query folding enabled, to check it right-click on the last applied step in Power Query:</p>
<p><img decoding="async" class="wp-image-586 aligncenter" src="https://datamartin.ca/wp-content/uploads/2022/09/native-query-160x300.jpg" alt="" width="238" height="446" srcset="https://datamartin.ca/wp-content/uploads/2022/09/native-query-160x300.jpg 160w, https://datamartin.ca/wp-content/uploads/2022/09/native-query.jpg 387w" sizes="(max-width: 238px) 100vw, 238px" /></p>
<p>If the “View Native Query” option is grayed out, it means that this specific step or transformation is executed with local resources.</p>
<p><strong>&#8211; Minimize the Power Query steps:</strong> Consolidate repeated steps, put all &#8220;remove columns&#8221; together, all &#8220;rename columns” together and so on. This change will improve the execution performance of the query.</p>
<p><strong><img decoding="async" class="wp-image-587 aligncenter" src="https://datamartin.ca/wp-content/uploads/2022/09/query-steps-300x207.jpg" alt="" width="520" height="359" srcset="https://datamartin.ca/wp-content/uploads/2022/09/query-steps-300x207.jpg 300w, https://datamartin.ca/wp-content/uploads/2022/09/query-steps-768x531.jpg 768w, https://datamartin.ca/wp-content/uploads/2022/09/query-steps.jpg 869w" sizes="(max-width: 520px) 100vw, 520px" /></strong></p>
<p><strong>&#8211; If your source is an Excel File, you could convert it to CSV before importing it into Power BI:</strong> The performance of reading data from a CSV is better.</p>
<p>To convert the Excel files, you could use the <a href="https://cloudconvert.com">CloudConvert</a> API to CSV files, and then save them to Azure Blob storage.</p>
<p>However, the recommendation for big projects is always to move the data to a database.</p>
<p><strong>&#8211; Disable Power Query background refresh: </strong>By default, when Power Query imports data it retrieves and stores 1000 rows of preview data for each query.</p>
<p>If your Power BI Desktop file contains many queries, this option could extend the time it takes to complete a refresh, in these cases it is convenient to disable it.</p>
<p><img decoding="async" class="wp-image-588 aligncenter" src="https://datamartin.ca/wp-content/uploads/2022/09/background-data-300x286.jpg" alt="" width="496" height="473" srcset="https://datamartin.ca/wp-content/uploads/2022/09/background-data-300x286.jpg 300w, https://datamartin.ca/wp-content/uploads/2022/09/background-data-768x733.jpg 768w, https://datamartin.ca/wp-content/uploads/2022/09/background-data.jpg 825w" sizes="(max-width: 496px) 100vw, 496px" /></p>
<p><strong>&#8211; If safe, Ignore the Privacy levels or set both sources to Organizational: </strong>This setting can potentially improve performance and functionality, however, Power BI Desktop cannot ensure the privacy of data merged into the Power BI Desktop file.</p>
<p>Don´t deactivate this option in the following scenarios:</p>
<ul>
<li>If the data source contains sensitive data.</li>
<li>Queries that accept query folding like SQL.</li>
<li>If the dataset will be published.</li>
</ul>
<p><strong><img decoding="async" class="wp-image-589 aligncenter" src="https://datamartin.ca/wp-content/uploads/2022/09/privacy-levals-300x286.jpg" alt="" width="503" height="480" srcset="https://datamartin.ca/wp-content/uploads/2022/09/privacy-levals-300x286.jpg 300w, https://datamartin.ca/wp-content/uploads/2022/09/privacy-levals-768x732.jpg 768w, https://datamartin.ca/wp-content/uploads/2022/09/privacy-levals.jpg 816w" sizes="(max-width: 503px) 100vw, 503px" /></strong></p>
<p><strong>&#8211; Use <a href="https://datamartin.ca/2022/09/29/tools-to-analyze-the-performance-of-your-power-bi-solution/">Query Diagnostics </a></strong>to analyze the query performance and identify the bottlenecks exist while loading and transforming your data and refreshing your data in Power Query.</p>
<p><img decoding="async" class="wp-image-590 aligncenter" src="https://datamartin.ca/wp-content/uploads/2022/09/query-disgnostics-300x83.jpg" alt="" width="632" height="175" srcset="https://datamartin.ca/wp-content/uploads/2022/09/query-disgnostics-300x83.jpg 300w, https://datamartin.ca/wp-content/uploads/2022/09/query-disgnostics-1024x285.jpg 1024w, https://datamartin.ca/wp-content/uploads/2022/09/query-disgnostics-768x213.jpg 768w, https://datamartin.ca/wp-content/uploads/2022/09/query-disgnostics.jpg 1083w" sizes="(max-width: 632px) 100vw, 632px" /></p>
<p>Click <a href="https://datamartin.ca/2022/09/29/essential-checklist-to-keep-your-power-bi-solutions-optimized-part-ii-data-model-good-practices/"><span style="text-decoration: underline;">here</span></a> for part 2 of this series.</p>
<p>&nbsp;</p>
]]></content:encoded>
					
		
		
			</item>
	</channel>
</rss>
