Build your own Speech Recognition circuit

I know this stuff is available, and think it is artificially inflated in price. I mean even my "free" cell-phone can recognize "yes" and "no" from any voice. It just seems that it shouldn't be so hard to have a system that is voice agnostic and can recognize a few defined commands.