general relativity - How can anything ever fall into a black hole as seen from an outside observer?

The event horizon of a black hole is where gravity is such that not even light can escape. This is also the point I understand that according to Einstein time dilation will be infinite for a far-away-observer.

If this is the case how can anything ever fall into a black hole. In my thought experiment I am in a spaceship with a powerful telescope that can detect light at a wide range of wavelengths. I have it focused on the black hole and watch as a large rock approaches the event horizon.

Am I correct in saying that from my far-away-position the rock would freeze outside the event horizon and would never pass it? If this is the case how can a black hole ever consume any material, let alone grow to millions of solar masses. If I was able to train the telescope onto the black hole for millions of years would I still see the rock at the edge of the event horizon?

I am getting ready for the response of the object would slowly fade. Why would it slowly fade and if it would how long would this fading take? If it is going to red shift at some point would the red shifting not slow down to a standstill? This question has been bugging me for years!

OK - just an edit based on responses so far. Again, please keep thinking from an observers point of view. If observers see objects slowly fade and slowly disappear as they approach the event horizon would that mean that over time the event horizon would be "lumpy" with objects invisible, but not passed through? We should be able to detect the "lumpiness" should we not through?

Answer

Indeed, nothing can get under the horizon. The stuff close to the event horizon does move outwards as the BH radius increases. Even more with any BH deformations such as waves on its surface, the tidal deformations or the change of the rotation speed, all the oblects close enough to the horizon remain "sticked" to it and follow all the changes of the BH form. All objects close enough to a rotating BH horizon, rotate with it at the same speed. If a BH moves, so does everything close enough to its surface, including the things located on the side of the direction of the move. If anyone interested what mechanism make such sticking possible, it is called frame-dragging.

You may ask then, how a black hole can appear then and the horizon form. It is conjectured that they cannot, and the only possible black holes are the hypothetical primordial black holes that existed from the very beginning of the universe.

The objects that can be very similar to black holes are called collapsars. They are virtually indistinguishable from actual black holes after a very short time of the formation. They consist only of matter outside the radius of the event horizon of a BH with the same mass. This matter is virtually frozen on the surface like with actual BH, due to high gravity level.

Such collapsars possibly can become BHs for a short time due to quantum fluctuations and thus emit hawking radiation.

Astrophysicists do not separate such collapsars from actual black holes and call all them BHs due to practical reasons because of their actual indistinguishability.

Here is a quote from one paper that supports such point of view:

Our primary result, that no event horizon forms in gravitational collapse as seen by an asymptotic observer is suggestive of the possibility of using the number of local event horizons to classify and divide Hilbert space into superselection sectors, labeled by the number of local event horizons. Our result suggests that no operator could increase the number of event horizons, but the possibility of reducing the number of pre-existing primordial event horizons is not so clear and would require that Hawking radiation not cause any primordial black hole event horizons to evaporate completely.

source