As this is a soft-question related to books, it will be based on the recollection of my past experiences and from the experiences of people I know.
To start off, a brief opinion on the books:
I think M. Spivak's Calculus on Manifolds is one of the worst mathematics textbooks. It's too dense with superficial information, it has too many rough proofs, ill-defined concepts and ill-stated theorem. When I read it as a undergrad, I would get so confused on the results that I would constantly be forced to check other textbooks, to the point that I was just reading Spivak's textbook because it was a shorter introduction. I also got some wrong ideas about concepts such as chains, which I had trouble fixing later on.
I would only ever recommend this book to an engineer that wants to get a brief taste of Advanced Calculus, without mathematical technicalities. I don't think it's a useful book for a mathematician of physicist. But I've heard good opinions on Spivak's other Calculus textbooks, but I never engaged with them.
On the other hand, I think J. M. Lee's Introduction to Smooth Manifolds is a wonderful book for undergraduate students. Sometimes it takes longer to explain some concepts, but I think all discussions have a role in creating a strong intuition and good motivation for definitions and theorems that follow. I really like how he chooses some definitions, and how the topics are organized. But I would not recommend it to a graduate student that already has a good background on these topics, and wants a more dense and in-depth book. Also, I think his Riemannian Manifolds: An introduction to Curvature is also well-written.
I think most math/physics students which I had contact would agree with my opinions here.
Comments aside, they also have different roles:
J. M. Lee has a more geometrical take on Introduction to Smooth Manifolds. Another popular book with a similar take is Loring W. Tu's An introduction to Manifolds, I much prefer Lee's textbook but some of my colleges preferred Tu's textbook. I also have some good recommendations that are exclusively in Portuguese...
On the other hand M. Spivak has a more analysis take on the topic. There are other textbooks with a similar take, such as W. Rudin's Principles of Mathematical Analysis and Munkres' Analysis on Manifolds. I think Munkres' is a much better alternative then Spivak's. But these kind of books almost do not talk about important topics of topological/smooth manifolds as much, so it depends on what you're interested in.
In conclusion:
I believe you should go straight to Lee's, and not read Spivak's. Maybe look into Tu's if you get confused at some parts, to see how things are done there, or just for a comparison. Maybe read Munkres' if that fits better with your intentions.