HdInsight.Containers

What is Power Query M?

Power Query M is a powerful tool that allows you to transform and clean data before importing it into Excel or Power BI. Power Query M is based on a functional programming language called “M”. M is used to define queries in Power Query and is a powerful language that allows you to manipulate and transform data in many ways.

What is HdInsight.Containers Function?

HdInsight.Containers is a Power Query M function that allows you to access data stored in Azure Blob Storage, Azure Data Lake Storage, and Hadoop Distributed File System (HDFS) through the HDInsight cluster. The function provides a simple way to import external data into Power Query and perform ETL processes on it. The function requires authentication to access the data source, which can be done through Azure Active Directory or key-based authentication.

The M Code Behind the HdInsight.Containers Function

When you use the HdInsight.Containers function, Power Query generates M code behind the scenes. The M code generated by Power Query defines the steps required to access the external data source and transform it as required. Here is an example of the M code generated by Power Query when using the HdInsight.Containers function:

let

Source = HdInsight.Containers(“storageaccount.blob.core.windows.net”, “containername”, [HierarchicalNavigation=true]),

#”blobname.csv” = Source{[Name=”blobname.csv”]}[Content],

#”Imported CSV” = Csv.Document(#”blobname.csv”,[Delimiter=”,”, Columns=7, Encoding=1252, QuoteStyle=QuoteStyle.None]),

#”Promoted Headers” = Table.PromoteHeaders(#”Imported CSV”, [PromoteAllScalars=true]),

#”Changed Type” = Table.TransformColumnTypes(#”Promoted Headers”,{{“Column1”, type text}, {“Column2”, type text}, {“Column3”, type text}, {“Column4”, type text}, {“Column5”, type text}, {“Column6”, type text}, {“Column7”, type text}})

in

#”Changed Type”

let

Source = HdInsight.Containers(“storageaccount.blob.core.windows.net”, “containername”, [HierarchicalNavigation=true]),

#”blobname.csv” = Source{[Name=”blobname.csv”]}[Content],

#”Imported CSV” = Csv.Document(#”blobname.csv”,[Delimiter=”,”, Columns=7, Encoding=1252, QuoteStyle=QuoteStyle.None]),

#”Promoted Headers” = Table.PromoteHeaders(#”Imported CSV”, [PromoteAllScalars=true]),

#”Changed Type” = Table.TransformColumnTypes(#”Promoted Headers”,{{“Column1”, type text}, {“Column2”, type text}, {“Column3”, type text}, {“Column4”, type text}, {“Column5”, type text}, {“Column6”, type text}, {“Column7”, type text}})

in

#”Changed Type”