I live in the area and used to work in the port on both sides. I know there's no restriction on the amount of times the drawbridge has to open up. Plus the fact that it might just take a long time to get out of the terminal because there's not enough people working. For peace of mind you'd be better off getting one of the last flights out to your destination after 3:00 p.m. and then just hanging out in Cape Canaveral Cocoa Beach area or near the airport in Orlando to go shopping or something.