You should be worried enough that you replace the drive.
If this sort of thing (re Medum Error that md could correct) occurred once, it probably isn't a big problem. If it occurred every few months, you would want to look at replacing your drive. If it occurs several times during a rebuild, then it is definitely time that the drive was retired.
