I don’t think broad brushstrokes are helpful here - regular people can be real assholes, and we need to balance a public servant’s individual right to privacy with the public’s right to transparency.
Some jobs such as Police Officers, I have no qualms with filming while they’re in uniform or otherwise on-the-job. But I can also see how a blanket approval could backfire, e.g. some aggrieved person decides to stalk some poor guy who’s only job is to center divs on some government website, just because they find out he’s a government worker.