Brains love reducing effort, and when you have an incredibly quick way of producing any reasoning, redaction, or calculation, you will most likely end up reverting to it for pretty much everything.
The problem is that if we don't use our brains anymore, they will become stunted. We will become poorer at creating text, slower at math, and less bright at finding answers.
We're already seeing the effects of AI usage in our daily lives. We go out on the streets, and many signs are AI-made; many 'pictures' of people are not actually people, and we're increasingly dependent on it for any daily answers we might need.
We have to remember AI still makes mistakes and invents sources, even though it will soon be more developed. We definitely have to keep an eye on the rapid, huge effect it is having on learning, socialization, and people's minds in general.
It would be great if it were mostly used for practical tasks and to make our jobs easier, but many people are using it as a confidant, as a replacement for a friend, a therapist, or even a lover. Do we really prefer a condescending 'relationship' with an LLM that isn't actually thinking over a real-life relationship? Is the world going that way?
We have to keep an eye on what people working in tech are saying about these fast-evolving models, because many declarations are very alarming. I hope we can, as a society, use the tool wisely and that it doesn't completely take over our lives or stunt our human capacity for learning, socializing, loving and even listening.