Skip to main content
Microsoft Idea

Power BI

Completed

"Folder" connector for Dataflows

Vote (79) Share
EightySix's profile image

EightySix on 08 Nov 2018 20:39:02

I would like to be able to create an entity by combining multiple flat files (i.e. csv) in a folder located on a local network.

Administrator on 14 Jun 2021 18:06:07

SharePoint folder exists in dataflows - https://docs.microsoft.com/en-us/power-query/connectors/sharepointfolder

Comments (12)
EightySix's profile image Profile Picture

Sarah Griffin on 06 Jul 2020 00:17:24

RE: "Folder" connector for Dataflows

We need the ability to combine multiple files (with transform sample file) into a query.

EightySix's profile image Profile Picture

Frank Preusker on 05 Jul 2020 23:59:41

RE: "Folder" connector for Dataflows

I'm following the way explained by Curbal (https://www.youtube.com/watch?v=qdcAoZU8B8Q) and this works equally well in Power Query as in Dataflow.

EightySix's profile image Profile Picture

Power BI Ideas Admin on 05 Jul 2020 23:56:35

RE: "Folder" connector for Dataflows

Anton Fritz's solution is a perfect workaround. Copy M query into a blank query works a treat. Thanks
https://docs.microsoft.com/en-us/power-bi/service-dataflows-data-sources#connecting-to-additional-data-sources

EightySix's profile image Profile Picture

Chris Morath on 05 Jul 2020 23:52:54

RE: "Folder" connector for Dataflows

'@Anton Fritz that solution does not solve the problem because its missing the steps to combine and transform; and since the transformation is a separate object it doesn't really seem possible to do it this way

We really need folder connector added

EightySix's profile image Profile Picture

Dirk Groen on 05 Jul 2020 23:49:00

RE: "Folder" connector for Dataflows

With a blank query we get the same errors as EightySix

EightySix's profile image Profile Picture

Sally Sproat on 05 Jul 2020 23:48:05

RE: "Folder" connector for Dataflows

I also am getting a credentials error when pasting a functioning query (for combining files in a folder) into the Blank Query editor.

EightySix's profile image Profile Picture

Hachi Adachi on 05 Jul 2020 23:48:04

RE: "Folder" connector for Dataflows

My M query that is as simple as:

let
Source = Folder.Files("\\fileserver\public\folder\")
in
Source

would not be accepted. The folder location is registered in our On-premise Data Gateway with exact spelling and cases. Could those of you who have succeeded in connecting to a folder advise if this is how you connected?

EightySix's profile image Profile Picture

Antony Fox on 05 Jul 2020 23:47:56

RE: "Folder" connector for Dataflows

This can be done via the blank query option, it takes a little doing but essentially copying the Transform queries from a PBI desktop query group (using advanced editor 1 query at a time, manually naming them the exact same as they are in PBI desktop) allows for this (there may be some tweaking required and columns name may need changing if they contain special characters (LF etc) but it seems to be working flawlessly for me

EightySix's profile image Profile Picture

Rony Layme on 05 Jul 2020 23:46:03

RE: "Folder" connector for Dataflows

Dear Anton, even though we can copy and paste the M query, whenever I reach to the part that I want to combine several files in a folder to apply a common query to all of them...data flow won’t allow me to save the query and go on with refresh settings.

EightySix's profile image Profile Picture

Hachi Adachi on 05 Jul 2020 23:43:40

RE: "Folder" connector for Dataflows

When I paste an M query with Folder.Files () function, the dataflow Power Query would not accept the credentials and not allow me to proceed. Same credentials DO work correctly when I use them on a single csv file in the same folder.