Yes, you typically cook the custard before freezing it.

You can also make ice cream what's called "Philadelphia-Style" which doesn't have eggs and requires no cooking before churning/freezing.

But the custard method is more typical.