>>>Am I wrong for having them in my yard?
What's wrong and right is subjective. For the most part people want to do what's best. What's best is clearly defined by many things and not everyone is going to agree on those defining characteristics.
If we really wanted to be earth friendly we'd give up our cars (or at least our SUVs) and walk or ride bicycles or drive more economical vehicles. However the reality is that there are limits to how far individuals can go in not hurting the environment.
I do my best to leave a small footprint. I don't go so far as become a vegetarian (much less a vegan), but I do buy grass fed and low environmental impact meat. For some, even that is not an option for a variety of reasons, or is not going far enough.
Gardening with native species is an ideal. It works for a variety of reasons and is recommended and promoted by this forum. HOWEVER, just like all ideals there are going to be variations and limits to how far anyone can take it, and for some it's not that far. And I think that's ok.
With that in mind, it's probably helpful to be aware of what species are considered a threat in any particular state. Conveniently there's a government site that has a [url=https://www.invasivespeciesinfo.gov/unitedstates/state.shtml]list by state of invasive species information[/url].
There is also [url=https://www.invasivespeciesinfo.gov/international/canada.shtml]invasive plant information for Canada[/url] and [url=https://www.invasivespeciesinfo.gov/international/europe.shtml]Europe[/url], including links to this website about [url=https://www.nonnativespecies.org/]non-native species affecting Great Britain[/url], [url=https://www.invasivespeciesireland.com/]Ireland[/url] (Ooooo! What a cool looking website!
), [url=https://www.invasivespeciesinfo.gov/international/australia.shtml]Australia[/url], and [url=https://www.invasivespeciesinfo.gov/international/nz.shtml]New Zealand[/url].