Look at dietpi. There is a regular pc version (x86).
Their own “we do it for you” software choice is somewhat limited, but everything is really easy imo. You can always install other things they don’t offer, with apt or docker or … But the basic dietpi system is a super reliable, super lightweight, easy to manage OS.
For the music: dietpi+jellyfin+ tailscale+finamp on phone. Tailscale on phone, point it to only use VPN for finamp. It works incredibly stable and reliable for me. I tried many other “make it work remotely” options first, tailscale is just magic. If it’s only for streaming music to your phone, I don’t consider tailscale a privacy issue at all.