Replacing Images in

I have a scenario where I’ve used an image in multiple posts. If, later, I want to swap out that image with another, it would be convenient if I could replace the image on rather than manually doing it for each occurrence. Not sure how this might affect image captions, though.