How to let my boss know about a mistake she made without causing any tension?

You have to address this by telling her what happened, but it sounds to me like you'd be better off finding another job, this b*tch is going to continue making your life miserable as long as you stay there. And try to get a job with a male boss, the females are almost always dreadful.