I think I know exactly what choice you are talking about. I felt the same way to a certain extent. Let me use a level one or two spell slot to cast a glamour or something.
HOWEVER: What you get out of it in my opinion is worth it 100% also if you are on Pc there is a mod that takes care of the main problem with this gift. It’s the only mod I’ve got running at the moment.