Should I be afraid?

A little bit, it is one of the more serious issues that Apple has had with macOS. Anybody who has physical access to your Mac or can get to it through via screen sharing, VNC, or remote desktop can gain complete access to the machine.