Given how curious we are, I think being scared of aliens is odd. I would assume that a civilization capable of interstellar travel is fairly chill.
And a sufficiently advanced alien civilization could sterilise earth from the comfort of their home star system, so if advanced aliens wanted us dead, it would not be hard, we wouldn’t even see it coming.