The aggressive "excuse me"

I was a little surprised this morning when a coworker, who I met in a narrow hallway, said "Excuse me" and I responded "Okay." Wouldn't it have made more sense for me to say "Oh no problem", or "No, excuse me!"?

When I thought about it more, I realized that I've always used the phrase "Excuse me" in an agressive way. I use it to politely say "Get out of my way", as in, "Excuse me! Pardon me! Coming through!"

I presume that my coworker was using the phrase in the more common sense of "I'm sorry that I'm in your way. Please don't think badly of me." Interesting that my personality chooses the more agressive interpretation.