Inference. Being invisible to us and complex is going to take a lot of effort to deceive us. You can’t see with an invisible eye. You can’t avoid sinking into the core of the earth unless you have some density, which makes you wonder why we never see their footprints. So if all our senses and technology has failed to find them they must be actively working towards that goal.