It’s not, it’s not having to do the math or the remembering. The brain is a muscle, when you have your phone doing all the hard work it doesn’t need to be as buff. LLMs will worsen this problem even more. Microplastics? Maybe single digit consequences.
The answer depends on the responsibilities you have.