A high voltage transformer bushing should be replaced when testing reveals signs of significant degradation, such as high partial discharge levels, reduced insulation resistance, increased capacitance, or abnormal oil analysis results. Visible signs like oil leaks, cracks in the insulation, or unexplained temperature rises also indicate the need for replacement. Regular monitoring and testing can provide early warnings.