gravity - Do all atoms in the universe gravitate each other?

I understand that matter will gravitate toward matter. (ex: Earth gravitates a satellite toward it, and the satellite toward Earth.)

Does this always apply, regardless of distance? 

Take two atoms, the farthest apart in the universe. Do they gravitate toward each other, but at an infinitesimal rate? (And actual position displacement is likely in a different direction, due to stronger/closer forces)