Most often, the first sign is leaking water.
But if it's making noise, you should be able to disconnect the fan belt, turn the pump by hand, and feel the roughness in the bearings. Repeat the check with the generator/alternator while you're in there.
My fan belt has starting making noises that could easily be interpreted as bearing noises. I wasn't certain myself until I demonstrated that the noise goes away temporarily if I spray a little belt dressing on the belt.