Completely wrong and dangerous line of thinking. That line of thinking is what got us income tax to begin with.

Income tax started out as a 1% tax on the top 1% of society. Sounds reasonable - its just the richest of the rich getting taxed. Thats why people voted for it

Fast forward to today - and even the poorest people in the nation are being taxed on their income. Every single person is taxed on their income.