These pronouns adress the other person directly but the moment I have to ask or say something connected to said person I have to start using gendered words
And numbers can be gendered.
Two girls, two boys.
Duas raparigas, dois rapazes.
And things only get weirder from this point forward. It is possible to have a somewhat genderless conversation but it requires a good degree of effort and it is not a common form of speech.