I have something called floating patellas, which could be similar to what you're experiencing... I feel more of a sliding sometimes, where I can literally feel the kneecap going in & out of the "socket." I'm supposed to have surgery in the near future, but have been putting it off for a few reasons.

Anyway, I would suggest seeing a doctor if this is hindering your activities - at the very least, they can recommend some stretching/strengthening exercises, or better ways to work out. In the meantime, it's probably good to avoid anything that aggravates it, like the bike, squats & rowing machines.
Btw, my Uncle is an orthopedic surgeon, and he has a knee exercise that he swears by. I'll try to explain... basically lay on your back with legs straight out, then lift them about 1-2 inches off the ground and hold it for 5 seconds. Do that a few times, and then increase the length & repetitions every day. He claims that if you eventually do this for 10 minutes twice a day, it will cure almost any general knee ailments. I keep promising to do it myself, but motivation isn't my strong point - LOL. Hope you feel better!