Names for patriots included Sons of Liberty, Rebels, Whigs, and Colonials. Other names for loyalists included Tories, Royalists, and the King's Friends. Many loyalists lived in New York City. It was known as the Tory capital of America. Not everyone picked a side. Many people tried to remain neutral so they could avoid conflict and the war. Patriot towns created juries of men called "committees of safety". Patriots would swear an oath to these men in order to get a pass to travel freely through patriot controlled land. Members of the Sons of Liberty wore a medal with a picture of a tree on it.