Thank you! Please give it a try and let us know if you have any feedback.

One of the features we added is to do make the "magic" replicable (or deployable in production). So we keep track of processing steps and let you export Python code that that applies those same processing steps. This could be used to run the exact same steps in a larger version of that dataset later.

"mounting" CSVs is something sqlite can do, sqlite.org/csv.html

If you're open to PHP, I found the perfect tool for myself. The Laravel framework has an ORM called Eloquent. Usually it maps models to database tables (hence ORM) but you can also bring it to get its rows from a CSV which it then maps into an in-memory sqlite database.

You can then work with it through the ORMs methods, with regular SQL or with external tools like Tinkerwell that just displays them in a tabular fashion.

For future reference: sqlite can do this import field record files (like csv) and do quires on them.

Perl’s DBD::CSV can do this. I would be surprised if Python didn’t have something similar.

This reminds me of @BrandonM's famous reply to Drew Houston[1] :) Of course there are ways of doing it. But sticking something in a folder and stuff just automagically "working" is a much more pleasant workflow -- and more importantly, how you create value. Jimmy, I'd say you're in good company!

[1] https://news.ycombinator.com/item?id=8863

Thank you. That comment is legendary!

Please don't forget about BrandonM's follow up comment though!

I've seen the thread linked as a 'tech people don't appreciate simplicity' but he actually acknowledges Dropbox could be very useful and wishes success.

The other criticisms were also very valid at the time, and were acted upon.

csvkit, you can sql query and much more from the command line.