I even hate calling someone when I am driving. The voice control on my dumbphone sucks, and scrolling through a contact list is not conducive to being aware of what is going on around me.
I would have to be moving to worry about it. Most of my driving is sitting. It takes me almost three hours to do a one and a half hour drive every day. Where do people go at 4am?