That’s when you say “jumping back a minute to subject X for a bit,” then say what you wanted to say. If it spurs further conversation on that subject, great. Otherwise you still leave an opportunity for the conversation to go back to where it had already gone.