He mentioned it in the Wealth of Nations once briefly and it had nothing to do with markets and competition.
This is a good summary with more detail:
https://aeon.co/essays/we-should-look-closely-at-what-adam-smith-actually-believed
[Adam Smith] is "usually portrayed as not only an early champion of economic theory, but of the superiority of markets over government planning. In other words, Smith is now known both as the founder of economics, and as an ideologue for the political Right.
...
Yet, despite being widely believed, both these claims are at best misleading, and at worst outright false.
...
The context of Smith’s intervention in The Wealth of Nations was what he called ‘the mercantile system’. By this Smith meant the network of monopolies that characterised the economic affairs of early modern Europe.
Under such arrangements, private companies lobbied governments for the right to operate exclusive trade routes, or to be the only importers or exporters of goods, while closed guilds controlled the flow of products and employment within domestic markets."
Sound familiar?
"As a result, Smith argued, ordinary people were forced to accept inflated prices for shoddy goods, and their employment was at the mercy of cabals of bosses.
Smith saw this as a monstrous affront to liberty "
Re the invisible hand:
"Indeed, Smith’s single most famous idea – that of ‘the invisible hand’ as a metaphor for uncoordinated market allocation – was invoked in precisely the context of his blistering attack on the merchant elites. It is certainly true that Smith was skeptical of politicians’ attempts to interfere with, or bypass, basic market processes, in the vain hope of trying to do a better job of allocating resources than was achievable through allowing the market to do its work. But in the passage of The Wealth of Nations where he invoked the idea of the invisible hand, the immediate context was not simply that of state intervention in general, but of state intervention undertaken at the behest of merchant elites who were furthering their own interests at the expense of the public."
"It is an irony of history that Smith’s most famous idea is now usually invoked as a defence of unregulated markets in the face of state interference, so as to protect the interests of private capitalists.
For this is roughly the opposite of Smith’s original intention, which was to advocate for restrictions on what groups of merchants could do."
And by restrictions, he meant government regulation (only not the type designed by corporate lobbyists: see below). See, the problem is that those who are most likely to invoke Adam Smith are also those most likely to be not just totally ignorant of what he said but to be actively perverting it.
From Adam Smith on corporate lobbyists:
"To widen the market and to narrow the competition, is always the interest of the dealers…The proposal of any new law or regulation of commerce
which comes from this order, ought always to be listened to with great precaution, and ought never to be adopted till after having been long and carefully examined, not only with the most scrupulous, but with the most suspicious attention. It comes from an order of men, whose interest is never exactly the same with that of the public, who have generally an interest to deceive and even oppress the public, and who accordingly have, upon many occasions, both deceived and oppressed .' [my bolding]
Link
I'll get more Smith quotes if you need them.