Skip to main content
Microsoft Idea

Power BI

Needs Votes

PQ Remove duplicates in sequence

Vote (2) Share
mathew's profile image

mathew on 18 May 2018 19:31:07

Power Query remove duplicates in sequence.

Currently PQ does not honor the sorted data to sequence the removal of duplicates.

Instead you have to use Table.Buffer which has performance impacts, this seems rather crazy.

I was unaware of the issue till I was tasked with producing a report that required exactly this.

this issue has caused lots of problems now. Can we please have a solution!

Comments (1)
mathew's profile image Profile Picture

Joe Cole on 14 Mar 2023 11:52:11

RE: PQ Remove duplicates in sequence

Agreed - when assessing a query plan containing a sort prior to a remove duplicates operation Power Query should ensure that they are executed in the given order