Had the same thing happen to me with a friend (me on iOS, him on iOS->Android) - it seemed to me that the trick was to press 'Send as Text Message' when the message fails to deliver. From then, it seems to work fine, as that probably forces a check on the Apple ID validity.