The location based reminders use cell phone tower-based location, not GPS. Since your phone is constantly polling cell phone towers anyway, it shouldn't use more battery than usual, unless it forces the phone to poll towers more frequently. (I'm not sure of the implementation details)
I personally have not noticed more battery drain than normal on my 4S.
Yeah - lots of people are saying they're having worse battery performance on the 4S or iOS 5 (lots of people aren't, too), and then lots of those people are claiming lots of different things such as turning off various features (and also not doing anything different at all!) has dramatically helped. In other words, essentially no science is being done and no one to my knowledge can say anything definitively yet, but lots of folk remedies are being tweeted. Assuming there's not a bug in the geofencing code, it shouldn't use too much more battery at all because it only goes out to the GPS when available cell towers—which are being constantly communicated with anyway—change.
Doesn't iOS now have a location service that will update apps of your location without running the app constantly in the background?