My view on it is pretty easy - Do you trust the site that you are getting the module for? Are you getting it from a reputable site (either their own site or here)? If the answer to both of those is "yes", then what's the problem? If the answer to
either of them is "no", then why the hell are you downloading and installing it in the first place?
If you do a search for a module and see "WoWInterface Minion Module" on ihaxoru.com, it might not be the best place to get it from.
Only use modules from sites you trust. Only get modules from official sites. In three simple words: "Don't be dumb."