That seems far more logical to me or possibly if he had to go into hiding or something. Since I can't see Charles choosing to wear that unless he had to.

I personally always like James with facial hair and longer hair, its how I make him work for Will but its not Charles.