The panics I get are related to Thunderbolt, so I suspect it's an issue with the Thunderbolt kernel drivers. I run two external Apple Thunderbolt monitors and that's at the core of most of my issues.
This could very well be it. I was about to comment that I've been using OS X for about 10 years and I'm pretty sure I can count the number of kernel panics I've had on my fingers. Most of those happened a long time ago.