Anecdote: I tried a buckwheat pillow and couldn't even make it through one night due to how much noise they make. Every time you roll over or even move your head a little bit it sounds like you're rustling through a pile of dry leaves.
I use one too and that was an adjustment when first getting it, but once I got used to it, the fact that it can be adjusted to fit wherever my neck wants to lay and stay there more than made up for it. Now that it's been a few years I don't even notice it anymore. I have however started buying the hulls and zip-up pillow cases to start making my own for half the cost though. I've had my cat accidentally rip one or two open while careening through the place at 3am. You do have to eventually replace or replenish the hulls regardless though, they break apart and get smaller so provide less support.