If it's only a cache it should be on EBS, which is still way faster and 2x less expensive.
I started a migration to s3 for such a project (container image caching) but then stopped when I realized what I was doing.
Yes, EBS is the gold standard but managing a EBS to scale up and down instantly, be available to multiple instances, lifecycle management, managing replica, switchover etc. are definitely not easy. And EBS are bad choice when throughput needed is very spiky.