I remember pipenv used to support this pretty well but it was out if scope for poetry.
Edit: there's a 'poetry run' command now so it might be fixed. Don't remember what was broken.