So sorry you're feeling like this and I really do identify with what you're saying. It's so hard when everyone seems to think you're just fine and you feel like you still need some recovery time. Sometimes people seem to act like they think you're better because it's the only way they know how to act. They say, "Oh, you look well!" because they think that's what you want to hear. I met a group of people recovering from cancer a couple of months ago and they all said the same thing, "Everyone thinks I should feel fine now but I don't feel fine and I'm worried they'll think I'm a wimp." They all said that! It made me feel so much better. I know there are some people who seem to bounce back quickly but we're all bringing different things to this experience and it's okay not to be all perky and back to normal just yet.
I'm having anxiety problems too but I have found some strategies since doing a Stress Management course that have helped me feel more in control. If you've got a Maggie's Centre, that's great. That's where I did my course, had some reflexology and generally got permission to be kind to myself. And you do need to be kind to yourself! I had a bit of a set-back a couple of weeks ago when someone upset me and I couldn't deal with it. It knocked my confidence so much and I became hugely anxious again after thinking I was on the mend. I don't think I realised quite how fragile I was. (Feeling a bit better now! :) ) If you are entitled to have more time off work and are able to then I would urge you to take it. It sounds like you need a bit more time to recover emotionally. I still have times when I don't feel able to see other people. A crowded event freaks me out and seeing lots of people I know, all at once, panics me. It's taking me much longer to get over this than I thought - 5 mnths after the op! I also get tired very easily and my pelvis still aches regularly. Added to that, I have post-operative nerve damage in my thigh meaning it feels like a real effort to walk sometimes. (Moan, moan, moan! ;))
It's such a roller-coaster! We will all get there and do feel free to sound off to me. I do know how you feel and I send you a huge virtual hug! Take care and be kind to yourself!