I'm also having this issue. It wasn't a problem for me, actually, until the move to CC 2014. I have my cache files on my SSD system drive, and all my media on a fast USB 3 SSD external. Still this issue. Rendering audio doesn't help. I just increased by audio buffer from 512 to 1024. Hopefully that will help somewhat. Will report if it does.
Also, I should say, it doesn't do this all the time. Just at random. It has, however, gotten progressively worse.