From Breakable to Unbreakable

I have a building set up with several combined meshes that can be knocked down.
My issue it what settings or code/system if any to make it be knocked down depending on the force of the object striking it. Right now I can knock it down just as easily with the player as a rocket launcher.
Will it require me to code something instead? Something that is enabled or disabled in the breakable object?
Not sure either way. (Inspector settings or code)
I want the player to be able to collide with it but not smash through it.

I ask here because I am using Dots Physics but actually don't know how regardless of the system.

Thanks!