I have the same problem, but on my scalp!!!
I think that area is just drier, but I make it worse because I don't rise that area as well. Often I will get out of the shower and I still haev suds in that area, or I failed to get the conditioner all the way in there. I really have to be mindful of it and clean/rinse that area well.
Then Ihave to make sure I put moisturizer/oil in there.