Fix cycle checking when calculating min delay from nearest physical action

Fix cycle checking when calculating min delay from nearest physical action #4067