My main fear here is using any sort of centralized/cloud system for any portion of this. Facial recognition against a small corpus can be done fairly easily off the shelf.

Everyone wants to sell me something at a huge discount because they know that the enhancements to their own database will pay for the difference. I just want the basic version of this for my own personal use, preferably with no online use at all short of maybe encrypted backups (maybe).