Technically, it is an explosive (https://en.wikipedia.org/wiki/ANFO) but yes you need something better than a blasting cap to knock it, a substantial explosion, like a stick of dynamite. Maybe a hand grenade would be sufficient.

If you use Nitromethane instead of diesel it's even better (Oklahoma city) and you can add aluminium powder to make it more sensitive.