Short answer: We do need to look at all verses describing creation. But we need to know when creation 'the process' is being talked about and when creation as in 'the physical universe' is being talked about. I encourage you to search the scripture for the phrase "since the beginning of creation" and you will always find human observers being talked about.
Besides the clear progression of Genesis ... we know that it is meant to be the historical account by the verse Genesis 2:4
"This is the account of the heavens and the earth when they were
created, when the LORD God made the earth and the heavens."
So at the very least, we know with certainty that the purpose of the verses in Genesis was to give the account of creation.
Long Answer:
I've seen several debates between Ham and Ross, Hovind and Ross, and Several Others with Ross. If you're referring to the recent TBN debate I could see how you get that idea, they have already debated thoroughly before that though so they were each familiar with the others reasons. But just to clarify the problem is not using other passages, Ham and us all would encourage reading all passages related to creation. The problem is using other passages to try to contradict what Genesis said about creation week. The Bible is full of verses that support a young earth view. And Ken Ham would never suggest otherwise . But the point is that for the most part Ross tries to create a moving target nit picking verses that were not talking about creation week, and proving his(and yes other respected christian leaders) position that we can agree with secular 'science' about the age of the earth. As R.C. Sproul put's it, it's "Hermeneutic Gymnastics". And I would say it's an example of what Jesus said "You strain at a gnat but swallow a camel" , Or Peter "Twisting the scriptures"
Genesis is clearly written in the language of Historical account, Psalms are contemplation and praises to God, not written in a way that says "a happened, then b , then C". So to get historical information out of them is reading something into the text that it does not claim. Job has a written record of conversations that happened, but the content of those conversations where not meant to contradict what Genesis already said.
So the point is we do take the whole Bible to look at creation, but when you find something that seems to contradict and warrant a re-interpretation of what was already plainly spelled out, you need to see what the context is. Is it poetic, is it prophetic, is it just recording what men said, How much do you really have to read into the text to make it say something other than what we already know?
Ross says one thing that is a kind of psychological convincer to make it seem like he's telling the truth, but I encourage you to take it to heart anyway. "It's not enough to take the scriptures literally, we must take them consistently." Which for him includes his interpretation of the "book of nature". I encourage you don't let Ross lead you into what that means, but let the Holy Spirit guide you into understanding what is consistent.
Also there is no YEC speaker that I am aware of that denies the expanding universe. The problem is trying to cram the big bang theory into the verses speaking about God stretching out the heavens.