I live opposite the "other" Sutton line, which is just freight (and once the Flying Scotsman). The trains are very noisy outside, but not so much inside. The really big heavy ones do shake the house a bit. But interestingly they relaid the track a few weeks ago and the vibrations have dropped notably.
Either way, you get used to it very quickly. And it has the advantage of me not having any buildings opposite, instead I have an unobstructed view across parkland.