I probably should explain that I like to suggest the stitch filter, because it works under many different circumstance. But overlapping the objects by a couple of pixels is probably the best solution.
Or the other thing you could easily do, given the simplicity of those particular artworks, is use the Pen/Bezier tool, perhaps with guidance from grid or guides, and snapping; draw a diamond shape as a whole, rather than make it out of 2 or several triangles. In my opinion, that is the best solution, in this case.