If you have an iPhone, it seems like the best way to create a "dumb phone" is to set it up as a supervised[0] device, which allows you to pick and choose which apps are allowed on the phone, or to disable the app store altogether. It's intended for enterprise use, but seems like it would also be useful for self control.

[0]: https://support.apple.com/en-us/HT202837