Rob on 04 Apr 2016 21:22:21
Would be great if there was a way to append data to an existing data model ; without the table having to completely refresh. As data is loaded into the model iteratively it would be good if you can update the DM and for power query not having to completely reload the entire set.
Refer to post: http://forum.powerpivotpro.com/forums/topic/append-to-existing-data-model/#post-4064
Administrator on 06 Apr 2016 07:11:50
In Excel/PQ you can achieve this by loading your Jan data, Feb data, etc. queries into the Excel worksheet, then have your "All Data" query append data from multiple spreadsheet tables, rather than appending the source queries themselves.
- Comments (2)
RE: Append data to existing data model
Has there been any progress on this request? I have looked through the discussions on this topic. I have the same issue with years of data with each year being over 1 million rows. I only need the current year to refresh and leave prior year queries alone. Updating remotely takes forever.
RE: Append data to existing data model
Thanks Miguel - the challenge I have is each months rowcount is in excess of 1.2 million rows - therefore the excel worksheet gets maxed out.
I give a bit of background on the design;
We use Oracle Data Integrator to ETL the data from source into Oracle Exadata, we have built an Oracle repository (business meta data layer) on the back of the data and we connect to the OBIEE instance through ODBC to pull the data through. Each months data is stored in a separate catalogue within OBIEE (ie: Jan 2016, Feb 2016, Mar 2016)
So I have created ower query connections to each month but need to perform the append in the same excel data model.
I have worked out a workaround by manually downloading the data from OBIEE into a csl file on my local laptop, wrote a batch file to combine the files then I load and refresh this straight into powerpivot as we also had a challenge with the time it took to bring 1.2million + data cross the network so I thought if I bring local then it would process quicker.