Hi Akash,
Shouldn't happed can you try gently cleaning the side port? 
Also, if it still occurs factory reset once. 
Last step would be to visit service center. 
I will check if the service centers can provide the side rubber, its not sold separately still will check if it can be arranged,