Is it sketchy to work a side gig without telling your full-time employer?

Some people see side hustles as personal freedom; others think your employer deserves to know where your energy and focus actually go.