Would you rather everyone can just walk into your house and take whatever they want? I for one am quite happy with the rules and morals we keep.
Those flags put up are often there to keep different cultures with different rules apart. It’s not as easy as erasing borders to have a free world. People are too selfish for that.
Sure, governments still steal all the time. Things are definitely not perfect, but that’s not related to someone stealing your lighter.