A person’s authority unexercised and undeclared causes followers and observers to err.
When a person practically and functionally exercises their authority, they realise that they cannot effectively do so without taking up the accompanying responsibility as well.
When people see you taking responsibility, they respect your authority; they recognise their boundaries, they take up their responsibilities and there is progress and cohesion all round.
It is false humility and punishment both to your yourself and to those assigned to you if you refuse to take your place of authority, to make it clear and to exercise it. You will be disrespected and disregarded and that my friend is your own fault.
On the other hand, a person without authority who tries to forcefully exercise it becomes a burden to himself / herself and to others.