The Old Refraction/Reflection Issue

A couple of years ago I posted this issue but it has not been resolved (or maybe I am missing something).
How do you make something truly invisible in refraction but not reflections?
It works fine until you have a refraction object in-between the two which cancels out the reflection element.

Example:
Background image on plane outside of the apartment and set to be invisible to camera:

Now set the plane oblect to be invisble to refractions:

The circled area is the where the reflection has dis-appeared because this is the reflection of the refractive glass balustrade so its Not reflecting the plane object in this area(make sense).
Can someone help, is this a bug???


By now V-Ray has gotten the VRayOverrideMtl, which allows you to define what material objects have when seen in reflections or refractions, or what material is used to have them cast shadows or GI.

Maybe that might work?