I know someone who applied for PIP who argued this and it was accepted by the assessor that they had cognitive difficulties and this was one of the adjustments they had to make. I'm not sure that it will always be accepted, (I'm not an assessor) but it's a valid point to make.
BIS
Nothing on this board constitutes legal advice - always consult a professional about specific problems
