If Golovkin spent his prime competing at 168lbs?

Did Gennadiy Golovkin have the ability to unify the Super Middleweight division if that were his mission, gunning for title shots starting at somewhere around 2010? Let's say with no political hold ups.
Here is a reference as to who were the Champions during this period.
IBF
2007-2012 /Lucian Bute
2012-2015 / Carl Froch
2015 -2017/ James Degale
2017-2018 / Caleb Truax
2018-2018/ James Degale
WBC
2010 -2010/ Mikkel Kessler
2010 -2011/ Carl Froch
2011 -2013/ Andre Ward
2013 -2014/ Sakio Bika
2014- 2015/ Anthony Dirrell
2015 -2017/ Badou Jack
2017 -2018/ David Benavidez
WBA
2009 -2015/ Andre Ward Super Champ
2009 -2011/ Dimitri Sartson ( regular)
2011-2012 / Karoly Balzay regular
2012 -2012/ Brian McGee regular
2012 -2013/ Mikkel Kessler regular
2013 -2015/ Carl Froch regular
2015 - 2016/ Fedor Chudinov Super
2015 -2016/ Felix Sturm Super
2016 -2016 /Giovanni De Carolis regular
2016 -2018 / Tyron Zeuge regular
2017 -2018 / George Groves Super
2018 -2018 / Rocky Fielding regular
WBO
2009 -2012 / Robert Stieglitz
2012 - 2013 / Arthur Abraham
2013 -2014 / Robert Stieglitz
2014 -2016 / Arthur Abraham
2016 -2019 / Gilbert Ramirez
2019 -2021 / Billy Joe Saunders
Golovkin was a natural middleweight but he competed in the amateurs at 165lbs so he could have done it. Imagine all the great fights that could have been made. How do you think it would have went if GGG'S primary goal was unification of the 168lb division?

 

For me, if Golovkin was already fighting at 168lbd for a few years and used to the weight, fight for Stieglitz WBO title in 2011. Then go after his old opponent from the amateurs Lucien Bute's IBF title in 2012. Then Andre Ward in 2013 for his WBA super and WBC titles. How do you think GGG fares in these endeavors?