I have often wondered if you can take an android phone, drill and rip out all the sensors and radio transmitters, and use wired Ethernet through a VPN router and still be able to use just banking apps as that seems to be one thing I keep a proprietary phone around for.
Edit: I forgot the speaker and the mic though the mic could be classed as a sensor