2D Physics material not bouncing right.

I am attempting a pong type game. I have the ball with a bouncy material (0 friction and 1 bounciness) For the most part it works fine but when it hits the walls with a small angle (less then 10 degrees it seems) it doesn't bounce off the wall, instead it just follows the wall it hit parallel to it and never comes of the wall. Any idea on why this is happening?

 

I just had the same problem. After changing the mass of the ball it worked properly.

 

I tried that, even used auto mass but all that seemed to do was alter the speed of the ball. The ball also seems to be slowing down even with no friction on.