Can I Set Lead Time by Product Category?

Yes. WC Lead Time Manager supports category-level lead time.

Edit any product category and you’ll find a lead time section. Products within that category will display this message unless they have an individual lead time configured.