You still need your chatbot to stick to business rules and act like a real customer service rep, and that’s incredibly hard to accomplish with generative models where you cannot be there to evaluate the generated answers and where the chatbot can go on a tangent and suddenly start to give you free therapy when you originally went in to order pizza.
Don’t get me wrong, they’re great for many applications within the manual loop. They can help customer service reps (as one example) function better, provide more help to users, and dedicate more time to those who still need a human to solve their issues.
Companies are already replacing some workforce with LLMs.
My opinion right now is that companies want you to believe they are 100% capable of replacing humans, but that’s because people in upper management never listen to the damn developers down in the basement (aka me), so they have an unrealistic expectation of AI coupled with an unending desire for money and success.
They are replacing them because they are greedy cunts, not because they are replaceable.