Just a clarification OP..
I find it difficult NOT to pay taxes.. and go through great lengths to avoid them.
paying them would be far easier..
but to answer your question, its because the larger government gets, the more incentive special interest groups have to create carve outs for their supporters, thus making taxes more and more difficult.