When you create an AAAA alias record in Route 53 and point it to a VPC load balancer, it gives out an IPv6 address. It does only mention A record in the load balancer description's DNS Name field, so I don't know what to make of it.
Yes, this is very confusing. It assigns the IPv6 address but that does not actually work as the LB is in the VPC which does not support IPv6. Lesson I learned: testing whether IPv6 actually works is worthwile.