Well, I'm guessing, but I think you were in the garden contemplating before Vytanni left.
And then you found Starflame and Firefly looking for Vytanni and you decided to help them out.
And after that Nola went and did something else.
And quite a bit of time has passed since then, so you could really be anywhere.
Take that explanation with a grain of salt.
I hope it helped! 