This issue has been officially named as "rubberbanding" by S8 and is something you see in practically all of their Story games.
S8's stand, apparently, is that we need to check with our Internet Service Providers. The following is a reply taken from the Bugs & Issues forum over at DS concerning an issue just like this.
It's things like this that make you wonder whether you should laugh or cry