It may depends on your rom/os brand. On my device (oxygen os 13.x), I can restrict access somewhere deep into mobile network settings (the translation may not be good as I have it in French) :
Settings > mobile network > data consumption > network access.
And here I see all apps. I can restrict mobile network, WiFi or both.