[2D] How to have rigidbody and collider on object, but rigidbody is not effected by some object

I was trying to make my player can walk through in front of an npc but npc still have rigidbody and collider, i want this npc to have rigidbody on all object except player but still count as collided.

i've tried use istrigger on boxcollider = the rigidbody physic is not being applied, and if i put in other layer and make it ignore in physic setting = the collision didnt happen.

How do i achieve this, hopefully you guys can understand what i mean
Thankyou