I hate capitalism as much as the next lemming but banks and insurance companies, at their base level, definitely provides a service. Banks help you spread the cost of things over time at the expense of interest, and insurance companies do something similar with risk.
Its only when they do warped shit like lend money at zero interest or force consumers to pay for insurance (thereby negating the need to be competitive) that they start to leech off the system.