That will be the anal gland, quite normal. If we take our two to the groomers, for a small extra charge they will see to emptying the anal glands for us. Quite a straightforward thing to do. I know it's possible to do it oneself, but we prefer to leave it to the pro's. Did your vet not offer to do it for you?
Stuart