Help, shuffle civilizations makes it like i occupied a province

[Ass 1]

And later they go back to their original provinces, how do i fix this?