How to prevent scroll from affecting rigidbody

I have a GameObject 2D circle with a rigidbody and a collider rolling down a hill (another object with an edge collider). Both objects are children of a scrollrect. All is well until the user scrolls. If the user scrolls down, the hill suddenly moves away away from the ball. So instead of rolling down the hill, the ball is free falling to the hill. My goal is to have scrolling not impact physics. So if the user scrolls, both objects scroll together (no physics required) with the ball still rolling down the hill. How is this accomplished? Is there a way to make physics only occur in a local space (not effected by the scroll parent)?

 

Got it. I was moving the ball with velocity. Everything works as desired with AddForce.