My 4 month bottle fed son is refusing bottles?

I have been supplementing with formula since birth, he is totally on bottles since 2 months. Now he does not take bottles when he is awake. He would suck on pacifier and put both his hands in his mouth. But he screams crazily as soon as we put bottle in his mouth. He has been doing this for 3 weeks now. I have read that babies at this age get very distracted. Is there something which we can do? I am really worried for him, is this just a phase when will it go away?