Moreover, you can fine-tune model for your specific tasks and you need fewer resources to fine tune a smaller model.

However, fine tuned small models can outperform general purpose large models on specific tasks.

There are also many lightweight tasks like basic sentiment analysis where the correctness of small models can be good enough to point of being indistinguishable from large models.