The black primer on the panals is a rust preventative. It can be removed but it dosen't need to be.
The above mentioned washing is a great idea, then use a red scotch-brite pad to scuff the primer. make sure to get all of it, don't leave any shiny spots(or anything you spray over it will not adhere and will eventually peel). Blow, or wipe it clean, then clean it with a wax and grease remover like PPGs "DX 330" and let it air dry. From there you treat it like a bare metal panal. start with your primer or sealer etc....
This is how most body shops will prepare a replacement panal for paint
A good rule of thumb when prepping anything for paint is, The harder it is to sand , the more important it is to sand!
All those corners and cracks are where you have the most problems getting the paint to stick in the first place, and if they don't get prepped then that's where the paint will fail first.
It WILL get tedious but stick with it so you won't have to do it again.
A paint job is only as good as the prep job.