No, no, no... I have to disagree here. If the brake pad material has been contaminated, throw them out. There is no good way to draw oil out of brake pad material, and they will re-contaminate your drum surface. Brake cleaner will clean oil off non-porous metal surfaces, not fibrous and porous brake pad material.
That $12 part is NOT the place to try to save a few bucks. Cheap out on anything except brakes and steering - they are the two things that you cannot afford to have fail.
If it means 3 extra days while you wait for parts... well, that's three days to pull & clean the axles, degrease & repaint the backing plates, make up new gaskets, remove & clean & repack the bearings. Maybe have your drums machined, or R&R the fluid in your rear shocks.