That's how joint textures work. Otherwise you could just have a joint texture that is any color you want (void, elf, other high Qi items etc) and effectively render all joint colors useless.
Like Rotten said, get a very light color joint if you want it to show (almost) properly.