It's only semi-automatic, but not much effort...

In the elevation window: select all doors or windows, check "Label Elements" in the Info Box (or Settings Dialog).

This does depend on having labels that function as you want for your door and window tags, and setting them as the door and window defaults in the label tool.

It would be nice though to make this fully automatic by a setting in the elevation tool, and shouldn't be difficult since the bits are already there.