That might happen. The altered sperm may have genetic abnormalities that make it difficult or impossible for the embryo to form or develop, so it may not be viable and may stop growing, causing a miscarriage.
Depending on the gene or genes affected, embryonic development would stop at one point or another, depending on when they have to start expressing themselves; in other words, if the gene that is defective is very important in the first few weeks of pregnancy, an early abortion would occur because it does not contain adequate information for its development.
Suggested for you: What Is Sperm Morphology? – Meaning & Normal Range.