It's ElvUI. Tried Carbonite without any addons and there's no problem at all. When I use ElvUI again, the error is back. When I enable everything except for ElvUI, no errors occur as well.
Strange, since I disabled every minimap setting in ElvUI I could find. Bummer
Will let the authors of ElvUI know about this as well, because I can't do without neither
