Great idea! One recommendation: Currently, your site loads a complete instance of the audio player for each track, which causes Flash's memory usage to shoot up by a couple hundred MB (Chrome on Windows). Might I suggest something like Yahoo's WebPlayer instead? It handles long lists of audio files more gracefully, with a single Flash object. That alone should greatly impact your page load times and responsiveness.

http://webplayer.yahoo.com/