Have you removed the vacuum retard? If so, the linkage to the float bowl vent valves may be holding the throttle open. Another place to check would be the throttle bypass valve; a cracked diaphragm will allow lots of extra air in.
Yes, a crack in the booster line, or in the booster diaphragm, will have a large effect on idle. It creates a huge vacuum leak.