Brandon -
Yes, adjust the distributor while the motor is running. Back off the clamp-nut just a small bit so that when you move the distributor by hand, it sticks in place when you let go. It is a good idea to wear a glove when you are doing this because you can get a stray spark in there and shock yourself (don't ask how I know this!).
/bcforum/images/%%GRAEMLIN_URL%%/driving.gif