@ady23 

Found the root cause.

I have reviewed the pfsense rules and turn off the internet access for the subnet that controller is part of and pointed the controller to get the NTP from pfsense directly. As soon I allow access to internet the system time was set correctly almost immediately. Disappointed in such behavior that actually is constraining users to allow internet to get the features that should work fine without it.

Does anybody know why the controller needs  access to internet to work the system time correctly and could not get the time from local NTP server?

@Virgo 

Thanks for response.

I use pfsense NTP server, and I created a rule for OC200 and I can see some traffic for that rule, so I would assume the controller is accessing pfsense on port 123 for NTP.

Don't know how else to verify.