Apparently it can be done. After D-Day and just before the attempt on Hitler's life, a German Wehrmacht general ordered the arrest of 1600 SS and Gestapo members in Paris. Hitler himself couldn't be arrested because he was surrounded by SS guards away from the front, where there were very few troops. In areas like France where troops and Nazis were all mixed together, it wouldn't have been a problem.

After the plot failed, General von Kluge backed off, but it would have been fairly easy to take out the Nazi Deep State in France.