Eric is probably right. When I first looked at it, I was thinking japanese honeysuckle bush:
you can see they look a bit similar. Here's the elaeagnus umbellata (autumn-olive):
https://www.missouriplants.com/Whitealt/ ... fruits.jpg
but your plant doesn't have the pointed tips on the leaves, as the honeysuckle does. And the autumn-olive has wavy leaf margins and "commonly bears sharp thorns in the form of spur branches" (wiki)
Both of them are Asian natives and are aggressive invasives here. Re autumn-olive wiki says:
Because it fixes atmospheric nitrogen in its roots, it often grows vigorously and competitively in infertile soils. ... In some parts of North America where it has become naturalized,Elaeagnus umbellata is considered an invasive species. It is considered a "prohibited noxious weed" under the Alberta Weed Control Act 2010.
May 23, 2013 The Michigan House today overwhelmingly approved legislation to prohibit the sale of the Autumn Olive, an invasive plant species that is quickly making its way across the state, disrupting some farming operations and testing the patience of land owners. https://gophouse.org/michigan-house-appr ... umn-olive/
Although beautiful and fragrant, autumn oliveâ€™s aggressive proliferation negatively affects natural areas throughout Indiana. https://www.nature.org/ourinitiatives/re ... -olive.xml
If it were me, I would work on getting rid of it, just as I am constantly in a fight against my Japanese honeysuckle.....