does stress have a direct impact on fertility