See below for more details, but in brief:

This version - sort of, last 50 or so songs should work offline

Planned for update - more control over caching, better view of which songs are available offline.