Supposedly you can do that separately from the naughty yt-dlp run with https://developers.google.com/youtube/v3/docs/playlistItems/...

(I don't know what the playlist id for your Watch Later would be, and the API for listing playlists doesn't seem to work either. Fun.)