I know it has been mentioned previously but you really cannot go wrong with Konditor and Cook for cakes. They even have wonderful hot food during lunch time. Borough Market is a vibrant place to be and actually find it to be my favourite market in London.
You cant go wrong with the sausages either...