Well if you try to illuminate the interior scene with dome light or env gi light from outside, using purely hdr, the sampling of that will be extremely difficult, hence the splotchy result and long render time to clean it up.
What would be the point of illuminating an interior with env hdr anyway? the light that comes through the windows can just be simple color, since the samples probably only hit very small areas of the hdr.