Since our natural vision is horizontal, a square cropped image gives an extra dimension to the picture, because in the imagination the image tends to continue further than the frame.
This format is particularly useful for symmetrical images, especially where there is a central point of interest (of course there’s no rule on this and unsymmetrical images can also work nicely too.