The Scots suffered defeat away from home in their last outing to the Georgians and will be aiming to make amends when they meet again in Paisley.
But, despite not being one of the more "fashionable" names in world football, Stark believes Thursday's opponents are a nation with plenty of quality in their ranks.
He said: "I don't think anyone should be fooled by them being 'wee Georgia' - I think Georgia has a bigger population than us.
"Their coach, Aleksandr Chivadze, played 60 or 70 times for the USSR and was part of that great Dinamo Tbilisi team.
"They've got a pedigree in terms of producing players. We never underestimate them.
"Because they don't have the most fashionable name, we have a tendency in this country to write them off but they deservedly beat us over there."
Victory would put the Scots right back in the mix in Group Three.
Stark added: "We deservedly beat Slovakia who are a good side. That's the way I said the group would pan out, that we would be capable of taking points off each other.
"Holland, obviously, are beating everybody in sight just now.
"I think, now we are in this position, we would quite like them to keep beating everybody - apart from ourselves. That would give us a wee shout."
Stark would love to see Stevie May take his blistering goalscoring form into the clash with Georgia.
The St Johnstone forward has netted 11 goals for his club so far this term, including three in the last two games.
Stark said: "Stevie is a young lad who has done exceptionally well. He was asked to go on loan to Alloa in the Second Division and he scored 20-odd goals.
"He then went out on loan to Hamilton in the First Division and scored 20-odd goals there. Now, the mantle has been thrown down for doing it in the Premier League.
"He's into double figures and we are only in November. He is consistently proving to people that he can handle it.
"His first international goal against Slovakia for us was a big thing as well. We are hoping he can keep going.
"We've got a lot of players who are scoring. If you look at the weekend, Andy Robertson, Callum Paterson, Stevie May and Ryan Gauld all scored.
"That gives you a lift. Scoring certainly doesn't do you any harm and it's good for the confidence. We've come to expect it from Stevie, that's the sort of spell he's having just now.
"We are hopeful he will continue that all season, particularly on Thursday night."
- Sports & Recreation
- Aleksandr Chivadze