How to allow a rigidbody to pass through a collider without losing velocity

When a bullet hit's a wall calls OnCollisionEnter that calls CalcImpact method and when OnCollisionEnter called, bullet's velocity is wrong. How can I detect a collision before(I know only one way - short raycast) or do not change a velocity?