Counter losing time?

Ah, this dear App Nap strikes again, it seems…

Probably what you’re seeing is Apple’s behaviour of apps put in the background (which is what a screen saver does to other apps) being suspended (or slowed down) to preserve CPU/battery.
Look there:

and:

and tell us whether that solves your issue.