I was just going through some old TSOA newsletters and spotted this advice:
Springiness of the brake pedal can have other causes than air in the system. Flexing of the pedal lever, of the pedal mounting, or of the master cylinder mounting is not uncommon and can be seen if looked for.
Other causes not so readily seen are: badly fitted linings, warped or otherwise distorted shoes, maladjusted shoe steady posts [these were only on a few TR3s, not TR4 AFAIK], and deflection of the brake drum. This last fault is uncommon although still not unknown.