I had quite a write up for you but it got out of hand. The better question might be is it safer Not to take it?

I'm not a doctor and there are limited studies of the effects the drug has on fetal development.

It would appear many women around the world took the drug when they didn't know they were pregnant and the babies all came out fine.

During a 3-year study, ivermectin was distributed to the population of a rubber plantation (14,000 people) in Liberia. Only 31% of women were aware of their pregnancy status during the first month; it was calculated that about half of women in the first trimester of pregnancy are likely to be treated inadvertently. 203 children born to women inadvertently treated during pregnancy were identified. In this limited sample, there was no significant difference in birth defects between treated and untreated mothers in the same population or compared with a reference population. Children of treated and untreated mothers showed no difference in developmental status or disease patterns.

I did find one article regarding a drug interaction with Verapamil...

...while ivermectin alone show some genotoxic effect on somatic cells of dams and the embryos. Verapamil induced reduction of embryonic mitotic index. We concluded combined treatment of ivermectin and verapamil severely affect fetal genetic material and development and induced genotoxic effect in somatic cells of the dams.

The advice I have for you is to find a doctor you trust and discuss it with them.