Guard: I assume you seek that wisdom from The Elders? If I let you in, The Elders would be vulnerable to anything funny you would try. No, I couldn't escort you. That way I would leave my post.
(This guard is obviously stubborn. You will need to find some way to stealthily get past him.)

Avaliable Actions:
Slip in between his legs.
Push him away and make your way in.