Get it all started with a long finishing nail of the appropriate diameter (head nipped off, if you have to) then use a pair of needle-nosed pliers__if you have to__to put the right pin in, as you draw the nail out.
I've done it with long pin-punches before, so if they're part of your tool arsenal, then by all means, they're better than the nail...