Because they were both black and female. They were bigger targets to the bigots since they were a two in one. Also back then it was REALLY hard for a woman to get a job. No income + Huge targets to bigots = Not gonna last long in a depression. At least the black men could get a job more easily and were a little less of a target for the bigots.