So apparently Plex has designed their iOS and tvOS apps to make it impossible to delete a playlist within them. I had to use the web interface. That was unexpected.