Yup. I did something similar with a RasPi camera and OpenCV. On my house it store and record every license plate that drives by and/or stops. It certainly leads to some ethical questions (not that you couldn't record this data going all "Rear Window" on the neighborhood but it's quite easy to understand all the coming and goings of your neighbors.