rotational dynamics - Why do we use the whole radius vector in the angular momentum, and not just the unit vector?

Why don't we only use the unit vector of the radius? I was thinking that, all we need to know is the component of the linear momentum, perpendicular to it, so why use the magnitude of the radius vector too?