That unfortunately is a characteristic of Pivot tables. Nothing can be done, except recreate the Pivot table from scratch.
If this becomes a regular/daily problem, then it might be worth checking into VBA code to construct the Pivot when needed, which avoids this problem. And VBA code with Pivots, if designed correctly, can be quite fast.