How did the Arabs know what was going on in Ghana? Arabs didn't travel so far, most of the larger ones towards the middle East, but few traveled to Africa, especially the western part of it. Also, they may be skeptical, if the accounts were conflicting about the same place, and if it sounds fairly "made-up" (such as exaggerated, etc)
hope this helps