Should I track what’s being automated and what isn’t?

Yes. As well as knowing what’s being automated, you need to know the coverage achieved. That way you can identify what you need to test by other means.