The problem is you're trying to maintain a lifestyle. You can't be a farmer, and jet set around the world. You may love being a farmer, but it won't put out that kind of money. I own my own fish store, because it is what I wanted to do. I could easily make more money working for someone else running their business.
I'd bet if you looked at it enough you'd realize it was your lifestyle you didn't like. A job is the means to pay for what you like to do outside of work. I see a lot of people who maintain a lifestyle to keep a job. You need the luxury car, because your commute sucks, you need the retarded expensive house/rent because of the city you live in that pays you well.
Whats your dream? If you don't have one, that's your problem. My dream is to have a job that requires no physical location, that means I'd make the same money whether I'm in Seattle, or Africa, or Germany etc. The way I see this happening for me is owning my own business then leveraging that. Using that to start up an online business or real estate that can be managed by someone else.
Now, to make that dream happen, working for someone else would make it nearly impossible. I'd say most dreams can be done in different places, If you wanted to go camping every weekend, you could live in many states working a 30-40k job and you'd be "well off" etc.