In the "Synchronize" feature for editing audio and video together, make an option where you can choose one of the tracks as a reference point.

Often when syncing multiple clips to one audio track, it will move the main audio to sync to the clip, thereby un-syncing the track from all of the other clips.