I second this! I took on learning OpenCV and writing an object recognition program for my independent study in college. It's nothing spectacular, but if you 'get' the basics, you can do some pretty crazy stuff with combinations of the primitive operations.
It's one of the classes I regret not taking in college, so I signed up. But I remember hardly anything from my Linear Algebra -- and I never really developed an intuition for the grand significance of, say, eigenvalues.
Are other people in this "want to know more, but forgot most of the base material" level? I've been working on an education project that'll get you from probability and statistics through linear algebra up to machine intelligence and computer vision. It'll also have "normal people" tracks like nutrition/fitness and understanding happiness in our mad, mad world.
Think of it as those stanford courses, but more organized, better produced, less transient, and with in person office hours (weekly in palo alto and SF).
If you'd like details, or a trial, or if you're brilliant and want to help or make course materials, email me. The more people bug me about finishing it, the quicker it'll get finished.