You should clean them with a rust remover, such as “Iron Out” or “Yellow Out” which are available at most home improvement stores.

Yes, if the water would be unsafe for any reason to drink, a boil alert would be issued.