One idea would be to lower the albedo (brightness) of the white paint material, however you will probably always end up with some light being bounced.
Another would be to lower the max sample intensity in performance tab to 10 or 5, but not lower - this will help, but will affect the global illumination in the whole scene.
Last resort is using the rayswitch material as already suggested. So you use the bright material for direct visibility, reflections, and refractions, and something darker or purely black for the GI.