Unity Box Colliders Getting Caught On Each Other [SOLVED]

I've recently noticed that when my character lands next to a box with a box collider attached if he lands at a very specific y position even though there is no place for him to land on he gets stuck there and won't fall. I was wondering if this is a bug with Unity or if there is something I could do to fix it. So far I've removed colliders while he was stuck and he then seems to fall, but I need the colliders so I can't just remove them. He is somehow caught on this collider. And yes I have removed the collider on his hand, but then he just gets caught with his foot

EDIT: I have tried giving him a circle collider already it doesn't work.

 

Try making the colliders round so he will slide down.

 

That didn't work

 

Try creating a Physics2D material and setting the friction low, then assigning that to the colliders.

 

The colliders on the walls have a friction material attached already.

 

Here is a post that may be of help

http://forum.unity3d.com/threads/box-collider-collision-catching-on-edges.222809/