The system needs to know its limitations and divert packages that cannot be handled automatically to manual handling.

It is too complicated to design a system that handles 100% of cases, better aim for like 90% with well integrated fallback for the edgecases.