X-Plane only saves movie recordings as .avi. You can also save situations (.sit) and replays (.rep) to share with other X-Plane users. Double check your movie recording settings and make sure they are set high enough to get a quality file, and look for a program to convert the file type.