Switch to Join Displays to do use memorized layout for displays

I use to switch between External Only and Join Displays with my dual-monitor setup, using Meta+p.

When changing to Join Displays it doesn’t remember the previous layout, so it’s like this:

And then I change it to:

Instead when I connect the laptop to the external monitor it goes directly to the saved status with the built-in display on the left.

Is this a bug? I think it should use the memorized configuration like when attaching the monitor.