Saudi sources said on Friday that strong winds and storm had brought the crane down, Press TV reported.
At least 30 people are also reported injured.
The Saudi Civil Defense authority confirmed the incident on Twitter, but did not give any details on casualties.