Here is the description of the first report from wikipedia:
"At 7:15 PM on September 12, 1952, two brothers, Edward and Fred May, and their friend Tommy Hyer (ages 13, 12, and 10 respectively) witnessed a bright object cross the sky. The object appeared to come to rest on land belonging to local farmer G. Bailey Fisher.Upon witnessing the object, the boys went to the home of the May brothers' mother, Kathleen May, where they reported seeing a UFO crash land in the hills. From there, Mrs. May accompanied by the three boys, local children Neil Nunley (14) and Ronnie Shaver (10), and 17-year-old West Virginia National Guardsman Eugene 'Gene' Lemon, traveled to the Fisher farm in an effort to locate whatever it was that the boys had seen.
Lemon's dog ran ahead out of sight and suddenly began barking, and moments later ran back to the group with its tail between its legs. After traveling about ¼ of a mile (400 m) the group reached the top of a hill, where they reportedly saw a large pulsating "ball of fire" about 50 feet (15 m) to their right. They also detected a pungent mist that made their eyes and noses burn. Lemon then noticed two small lights over to the left of the object, underneath a nearby oak tree and directed his flashlight towards them, revealing the creature, which was reported to have emitted a shrill hissing noise before gliding towards them, changing direction and then heading off towards the red light. At this point the group fled in panic."
When the group returned to their home Mrs. May contacted the local Sheriff and a reporter Mr A. Lee Stewart. Stewart conducted many interviews and examined the woods in the area with Eugene Lemon. The reporter said that "there was a sickening, burnt, metallic odor still prevailing."
Many other people were interviewed after the event and reported similar experiences. The creatures description again from wiki:
"Various descriptions of the entity exist. Most agree that it was at least 7 feet (2.1 m) tall and that it had a black face which appeared to glow from within, and a black body. Witnesses described the creature's head as elongated, non-human eyes and as either being shaped like a sideways diamond, or as having a large circle shaped cowling behind it. The creature's body was described as being inhumanly-shaped and clad in a dark pleated exoskeleton ; later being described as a shadow. Some accounts record that the creature appeared to have "no visible arms" due to its incredible speed. Others describe it as having long, stringy arms ending in long, claw-like fingers, which protruded from the front of its body"
There are many possible explanations for what the witnesses encountered. Most of the experts seem to suggest that a combination of an owl, a meteor and aircraft beacons combined together to form a whole scenario in which a gaggle of witnesses mistook for an alien.
Here's a video from a man who thinks that there was an air war between US jets and UFO's during 1952. While the documentary is sometimes funny (unintentionally), sometimes cheesy and sometimes hard to believe, it does bring together a lot of this info. It also raises some interesting questions.