i'm going to guess andy's presence on the show was probably initially a function of conan's low self-esteem, and feeling he needed some help, but that was like 20 some years ago and now it's just a tradition.

https://www.youtube.com/watch?v=tW4KWPLrnZI