Before I write my views about this, let me clarify, I have nothing against the language. I use it to communicate with others. I love reading English books, watching English movies and tv shows. I am writing my blog in English for god's sake. So no problems with the language. I love it as much as I love my mother tongue.
I get upset when English is used as a measure for someone's ability. Growing up in India, I have noticed that as soon as a person starts speaking in English he/she is considered smart and if they use fancy words then they are the smartest. Although the person who is listening to those fancy words have no clue what they mean. Then what is the point of that conversation if one of them has no clue what the other person is saying.Also I think that not everyone who speaks English is intelligent. I have read about and seen some people who are so fluent in the English but lack basic common sense. They are clueless in handling some situations.
I agree that learning any language is not that easy. So if your mother tongue is not English then you are putting a lot of effort in learning it and to understand it you need to use your brain just like you do when you are learning a new skill. Some might take too much interest in it and some don't. But that doesn't make them less smart.
Since English is the most spoken language in the world, a lot of information you can find in the world is in English. So if you know English you have more exposure and more information. But there are few countries in this world who only speak their local languages and very rarely or never use English but they are equally smart as other English speaking countries.
Anyways to conclude, all I want to say is English is just a language not knowledge. Just like we have so many languages in this world that we use to communicate with others, we have English too. It is not a symbol of intelligence or social status. Learn it and use it if you love the language but don't judge others if they don't. Just the other day someone posted this pic in Facebook as though they read my mind: