That's where you should start mate to get a feel if it's for you. You don't have to buy a kit though, you can get it separately so it fits your needs better.
The next step up from there is roughly a $1200 setup for making "real" beer.
I've got a couple of hundred long necks and some other bottles to help you get started if you want.
I've been making some good stuff lately I'll bring you some of mine to try one day.
Edit: Lol the "bananas" taste is a common infection that happens mainly to lager beers.