When I worked outdoors in the winter, I ended getting a higher-end breathable fishing gear. It created an external layer that stopped the wind. It took very few layers underneath to keep me warm. Often just a T-shirt and a light fleece was enough to keep me warm down to 0F. In colder temps a wool sweater and pants did the trick underneath.
I also combined it with neoprene skii mask and a wool beanie. For gloves I went with a thick wool knit over thinsulate when it was really cold.