You are describing a system in which authority is transferred from person to person. In the Bible, authority comes from God. All those that are faithful in submitting to God's will have authority to represent Him to some degree, although I do believe that God also puts people into positions. But just because, for example, Nebuchadnezzar was put into a position by God, doesn't mean Nebuchadnezzar was cooperating with God, which is the prerequisite for being anointed (Acts 5:32).
The Holy Spirit can grant authority to someone through a human, but it's the Holy Spirit that is the one granting the authority, not the person. People can fall out of ministerial (but not salvific) favor with the Holy Spirit if they fail to cooperate with Him.
The Apostles were apostles because of the level at which they were influenced by God Himself on a daily basis for 3 years. Authority in the church comes from God Himself, and those that are considered leaders should be so because of their contact with God Himself, whether through the Son or the Holy Spirit. We can experience the Holy Spirit through people, but some people who were once anointed can fall out of that anointing through their disobedience.
Obedience is the primary cause of ongoing anointing. This is how I see Acts 5:32. People can experience the Holy Spirit through their leaders, but if they don't continue on in obedience then they will lose contact with that anointing and the ability to successfully anoint others.
So, while, ideally, apostolic succession is possible, it is far from a guarantee if you are relying on who someone was anointed by 50 years ago, because the amount of opportunity for disobedience in a 50 year period is high.
The Bible says that those that are faithful in small will be given much. In the end, laying on of hands can provide genuine power, but if that power is not demonstrated to be in use in someone's life through a faithfulness in obedience to God and practicing all that the Bible commands, a person is not qualified for promotion.
Acts 5:32 says, among other things, that God gives the Holy Spirit to those that obey Him. The way I have been taught and the way I understand this is that, while all believers have been born again, not all believers are walking in unison with the Holy Spirit. To the degree that we are living in accordance with our freedom from sin, as well as obeying everything we hear from the Holy Spirit and are practicing everything we see in scripture, is the degree to which we are walking in unison with the Holy Spirit.
All believers have access to such freedom, but not all of us are accessing it, often times out of ignorance that such a freedom is available to us.
I have heard multiple Bible teachers say, "It's not about how much of the Holy Spirit you have, but how much of you the Holy Spirit has". I heard this, among others at a church that describes themselves as "Evangelical in belief and Pentecostal in practice".
I believe in the power of an anointed person laying hands on. I have experienced the power of the Holy Spirit at the laying on of hands of particular ministers that are anointed. I believe they are anointed, not because of their position, but because of their prayer life and life of obedience to God.
However, at times, I walked away from that nearness to God and wandered back into a lack of anointing in my own life. They gave me a boost, but I didn't stay living in accordance with that boost for the rest of my life (Luke 8:13).