You're confusing aggressive with experienced. People with well-trained reflexes and good foresight will be able to avoid some accidents. But experienced drivers span the whole "docile-aggressive" range.

And yes aggressive driving causes a lot more accidents. What you are doing is blaming defensive drivers for the accidents caused by others. If I overtake a slow car the responsibility for the outcome is solely on me. Don't blame people "for being there".