Possible Xref/displacement bug

You might be able to add the displacement through the object’s material.

Best regards,
Vlado