The issue is that you can’t detect photons without interacting with them.
Can’t…So far, right? Like there hasn’t been a method developed to somehow detect indirectly without interaction? I don’t know enough about this to know how one might go about that, but I imagine those that know more might love to given whatever knowledge may be gained.