Extremely accurate system time: Chrony (not cron), PTP NIC clock and NIST (atomic clock based) time servers

That is NOT how NTP works.

Chrony isn’t unique in doing that. Since the mid-1990s, ntpd has done just that:

ntpd learns and remembers the clock drift and corrects it autonomously, even if there is no reachable server. Therefore large clock steps can be avoided while the machine is synchronized to some reference clock. In addition ntpd will maintain error estimates and statistics, and can offer NTP service for other machines.
https://www.ntp.org/ntpfaq/ntp-s-config/#611-cant-i-just-run-ntpdate