You can certainly ask although members report varying degrees of success. You are more likely to succeed if you back up your request with a letter from a medic stating why you would not be able to attend an assessment centre.
Nothing on this board constitutes legal advice - always consult a professional about specific problems