not sure if this is how it should be, i always just saw cameras in the scene in this section but am seeing lights also and cameras, is this normal?
This is a Autodesk issue, non-VRay lights are also accessible from that menu and the issue exists even if V-Ray is uninstalled.
aha! i saw it in a few scenes, especially ones with many lights, thanks @svetlozar