For some reason I just feel icky using Microsoft products when there's a fine/better alternative.

It is all in your head, my friend :). Bing is actually pretty good.

I'd love for Google to have some serious competition... just not from Microsoft. I feel like Microsoft has had their turn.

I just want some unknown startup to come out of nowhere and take a bite out of Google.

Well, a startup is doing this. Powerset is supposedly behind Bing.

Do you honestly think an unknown startup can take a bite out of Google and not get acquired in the process?

It probably is, but Google is at least on par, and that's why I feel "icky".