I think you have some leeway with its use. While my car doesn't currently have overdrive fitted, it used to (and I've had several MGBs with ovd).
I treat it just like another gear, let the RPMs drop on the upshift, and goose the throttle to raise the RPMs on downshifts.
I didn't use the overdrive until I was upwards of 50 MPH (and expecting sustained speeds), but would occaisionally run 3rd/3rd ovd on curvy mountain roads, instead of shifting 3rd/4th (I didn't always live in flat Ohio/flat Louisiana, I bought the car when I lived in San Francisco).
I suppose the most important thing, is not to disengage overdrive at a speed that exceeds the RPM limit in the direct gear (be it either 3rd or 4th), and to let up on the throttle slightly upon overdrive engagement.
While they're robust, for the most part, you shouldn't put undue strain on the unit.
Above all else, DO NOT EVER attempt to drive in reverse if there's any doubt that the overdrive has not disengaged. Make certain that the gear-selector switch that only allows overdrive use on 3rd/4th is operational.
Little known fact: if the 3rd/4th selector switch is getting worn out, you can put some pressure on the shift lever (pulling it towards the driver in a LHD car) and get a "temporary" kickdown, or passing gear.
Sometime in the near future, I'll be rebuilding my side-shift/ovd xmsn (all the gearbox internals are already prepared with polymer dry-film lubricants & thermal barrier/thermal dispersant coatings), so expect a pictorial essay on the subject.