Refraction falling back to transparent instead of reflection probe

TLDR: Would it be possible to have the option of setting the refraction fall back to pure transparency in an object instead of how it currently falls back to a reflection probe?

We have a large interior space with glass everywhere and have attempted using refractions. An issue arises at the edge of the screen where screen space data is unavailable and falls back to the reflection probe. Given the glass is still at a direct enough angle to be mostly transparent, this looks far less natural than falling back to a simple transparent material:


On the very left of the image in the window, notice how it sharply transitions from transparent to reflecting a light in the background.