You're falling for the false promises. The false promise of the FDA is that only safe food and drugs make it to market, but what we actually see is harmful products make it to market, and lifesaving food and drugs are held back. Similarly, the false promise of the EPA is that they'll protect the environment, but they push hybrid and electric cars which are much worse.

Abolish both FDA and EPA. Push food safety requirements onto the supermarkets and let them do quality control. Also let people buy prescription drugs over the counter like they do in other countries (keep narcotics and other addictive drugs behind the counter).

If you want to protect natural forests, etc. then zone them as parks and let the free market take over with private ownership. Private owners can charge a fee for entry, and they have a financial incentive to keep the place clean and the flora & fauna healthy. (Read about "Tragedy of the Commons" for more info on this.)

Government does a terrible job regulating these things, so it's often better to just let the free market handle them.