How did you enter the church? You can sneak in the right hand side and avoid two of the fights. You only have to fight the skeletons (which you can disarm).
Also you can talk your way out of the first fight at the church. Or you can kill half the guys there by shooting the giant block hanging over their heads.
Don’t be scared of combat, just use quicksave liberally until you feel more confident. There is almost always a shortcut or easy way out of combat in BG3. My current run i’m trying to solo tactician so you gotta skip as much as you can. I’m at several hundred hours in the game so if you have more specific questions don’t hesitate to ask.