@JonesSeitz
I recommend opening Stage Setup, and setting each o your Stages to use a Display that is not attached... so for instance, assign Displays 16, 15 etc...
Then ensure the resolutions are what they were before. (they default to 1920x1080)
Open stages, and position the preview windows that open.
Why? This removes any bottleneck that might exist in the output hardware. I don't know the inner configuration of your Mac, but if it works similarly to my PC it is possible one of the USB-C outputs runs thru an onboard GPU, while the others run thru a dedicated GPU. If that is the case, Isadora will have to transfer video textures between the GPU units, which is a slow process and will bring down the framerate.
If your project runs at the correct FPS when the displays are routed to non-existing displays, you can then connect each one at a time (the Display Port will be fine I am sure) to determine which port is causing you trouble.
as @Woland noted, the Video Delay will eat up Video ram, so you should also check that you have not used all your video ram.. if you have it will start using swap ram for video which is also very slow.