guide coat

I have my car finished in 320 grit, and I plan on going over with 400 dry prior to epoxy as a sealer...my question is, is it super difficult to remove all prior scratches when going to the next grit, or am I over thinking it? I usually try to throw a few coats of epoxy over the car, give it a...