I personally like hearing a British accent, and I always think that the fact that you are making the effort to actually speak another language earns you brownie points anyway. I guess maybe that's why French people tend to have good things to say about your accent. I am a native French speaker and I lived all my adult life in English speaking countries. I am normally told that my accent when I speak English is cute too but, like you, I always hate knowing that I have an accent. But despite my efforts, it's still there. The only good thing for me is that a lot of people don't recognize right away that I am French. But they always know I am foreign, and sometimes it only takes a hello (still now after about 3 decades) for people to ask where I am from... Whatever the perception or others, or yourself, I think you need to praise yourself for speaking at least 2 languages! :-)