Excuse My French

When I was a kid, my parents would always say,"Excuse my French" just after a swear word. I'll never forget my first day at school when my teacher asked if any of us knew any French.