My '96 Jetta is making a persistent knocking sound! What is it?

It makes the knocking sound only when my clutch is not in. As soon as I push the clutch pedal down, the sound stops. It doesn't change speed or loudness, it's the same sound every time. Anyone know why it is doing this??? IT'S DRIVING ME INSANE!