Yes Agnes, they are windowed.
Crasru I do like the tiny alexandrite. It has very good color change and the stone is so small that the window is not noticeable. I got it to be an accent stone for my vanadium chrysoberyl.
Crazy as it may sound, Im thinking of mounting the tanzanite rectangle upside-down just like in my picture. Think: faceted sugarloaf!