Glad I’m not crazy. I chatted with Woo support and they told me it should have never worked, but I’ve been doing it for months! I know tracking numbers are optional for first class USPS if you’re ordering direct, but there is no option in Woo to enable/disable this option. It’s just “off” now.