Copy file to local machine *after* Enter-PSSession

I know that I can use Copy-Item with -ToSession or -FromSession to transfer a file using WinRM. But my Use-Case is, that I have already used Enter-PSSession REMOTEPC to work on another PC and now (inside of this session) I want to copy a file from the REMOTEPC back to my local PC using WinRM. Is this possible with -ToSession ? And what would I have to specify as argument?