The Rev Matthew Ineson, who was ordained in 2000 and practised as a vicar in Rotherham for more than 10 years, criticised the archbishops as he gave evidence to the Independent Inquiry into Child Sexual Abuse investigation into the Anglican Church.
He called for changes to the way the church investigates safeguarding issues and complaints about clerics, describing the current system as "totally unsuitable."
The witness told the inquiry how he suffered abuse at the hands of priest Trevor Devamanikkam, who took his own life on the day he was due to appear in court accused of sexual offences against Mr Ineson.
He said he made his first disclosures between 2012 and 2013 to the Bishop of Doncaster Peter Burrows, the then bishop of Sheffield Steven Croft, and the then archdeacon of Rotherham Martyn Snow, but that nothing came of his reports.
Rev Ineson told the hearing no further action was taken by the Archbishop of Canterbury Justin Welby when he made complaints.
He told the inquiry: "Bishops sit on thrones. They live in fine palaces and houses, they wear the finest robes and garments, they bully people. People literally kneel down and kiss the ring on their finger,” adding: “I don't think those people are fit for office."
Mr Ineson said he met the Archbishop of York Dr John Sentamu at a meeting for survivors of clerical abuse at a General Synod in York and asked him for an apology for his failure to act on his disclosures but Dr Sentamu replied: "Apologies mean different things to different people."
Mr Ineson went on to make two written disclosures to Mr Croft, now the Bishop of Oxford, and sent copies to the Bishop of Beverley and Dr Sentamu.
He said he wrote in his second letter: "You will never know what it took to tell you but you will also never know of the hurt that you and your suffragan have caused me by doing absolutely nothing about it."
The witness told the inquiry that the only person to reply was Dr Sentamu, who wrote: "Please be assured of my prayers and best wishes at this difficult time."
He said he submitted complaints about the clerics under the clergy discipline measure but was told that the complaints fell outside of the church's one-year rule.
Mr Ineson said he believed that safeguarding should be taken out of the hands of the church so that complaints are investigated by an independent body and that clerical sexual abuse should be the subject of mandatory reporting.
Mr Ineson continued: "The church is not going to change unless they are made to. They can't be trusted."
Giving evidence on Wednesday afternoon, Dr Sentamu said he did not believe he had made personal mistakes in the course of responding to disclosures of clerical abuse.
He said: "Hand on heart, I don't think so. Where there have been disclosures, I have been willing to apologise to the person, trying to do the best I can to support them."
When asked about the case of Mr Ineson, Dr Sentamu said he received a copy of the cleric's letter but assumed the Bishop of Sheffield would deal with it because it was his responsibility.
He said that, if he had behaved at the General Synod in the way described by Mr Ineson, that behaviour would have been "totally inappropriate."
Dr Sentamu agreed Mr Ineson's treatment by the Church had been "shabby and shambolic" and said he should have received more support.
He added the police investigation and the complaints issued under the clergy discipline measure meant it took too long to set up an inquiry into his abuse.