on 11 Jul 2018 15:44:57
Notice that you will still received an email notification even no data value has been updated in your dataset.
This is due for during the scheduled refresh, I think the data in the dataset at Power BI Service will still get "refresh" (Import and overwritten), so to the 'alerts's, it is seems that the data has been updated.
So i think currently it won't work for imported dataset but direct query / live connection only.
Please fix this as there are customers who would like to have this feature to work for imported dataset.
Will post the feedback to Microsoft.