To amplify on what Valveman is saying, if you remove or disable the check valve before the pressure tank, the leakage out of the bleeder may be negligible. So in that case, you could leave the bleeder in place until you are pulling the pump at some point.
The reason is that the bleeder would be designed to only open if the pressure in the pipe at that point is below 10 psi or some other pressure. The pressure tank, together with the pump, would keep the pressure well above 10 PSI. They don't always use a bleeder valve, and sometimes just put in a small hole. Or there could be a bleeder valve, but it does not hold sufficiently. The pump would cycle. Once every 10 minutes? Every hour? It depends on your pressure tank and how much leakage there is from the bleeder.