At 650 rpm, your alternator will hardly be outputting anything - and so the battery is having to supply most if not all of the required voltage. Added to this are voltage drops due to the natural attrition of tired wiring and long wire lengths.
If you measured the voltage at your headlights in this scenario, it's likely to be 12V at optimal best (given you're runing a 12V battery), which results in dim light, as most bulbs have optimal voltage ratings at 13 volts and above. This extra voltage is usually mostly supplied via the alternator's continuous output. It is a common misconception that the battery supplies the electrical equipment on your car - this is mostly the job of the alternator when the engine is running (and whose job is also to maintain the battery charge).
The battery's main job on the other hand is to store charge for when the alternator is either inadequate (e.g. at low revs and when providing the massive starting crank) or not on (running your hazard lights etc.).
So, to summarise, at low revs, it is normal, even with a modern alternator, to experience slight dimming of lights. This will be made more noticable if you're using high power bulbs designed to operate above the 12V output of the battery, and/or have less than perfect wiring.
Hope this helps!
EDIT: notwithstanding the other good points made above about making sure grounds, fanbelt and wiring are in good condition, and battery terminals are clean and tight.