@vidasonik

Could it be a case of Ableton not sharing the device? (I know this can occur with Asio in PCs).
It can get a little complex once you have a number of Multi-output and/or aggregate devices. 
A screenshot of your Audio MIDI setup would be helpful since I need to walk through the signal flow.

When all of my macs site untouched for 15sec or more then I trigger an audio sound effect it is late. If the mac stays active the sound effect is accurate.