Buy an old Thinkpad, put NixOS + Renoise on it (without a browser and with a very primitive WM), and build a QMK/Vial keyboard with encoders. It'll cost you $200 and get you everything it sounds like you want.