> Most of the modern "dumbphones" (or "feature phones") would do this just fine for you.

Assuming you use something like WhatsApp, Facebook or something alike. Modern "feature phones" include built-in applications for messaging and calling, and you generally can't install anything custom on them.