I use it almost everyday with my JVC KD-BT-1 for music and phone without problem. I had trips that use it for couple hours continuously (from San Francisco to Los Angeles).
Maybe make a full backup and factory reset to try again?
My SE X1 rom-> http://forum.xda-developers.com/forumdisplay.php?f=471