Can you provide some more information? Processor generation, MacOS, and the rendering settings that your attempting to run the sim at?
As a general rule, XPlane is extremely poorly optimised, and it sounds like you may not have quite enough Vram... Are you using any custom plugins, scenery etc? If so it may be a good idea to remove them and see if that solves the problem :)