Here is a workaround :

  • Click the Start or Search icon in the Taskbar
  • Type cmd, right-click on Command Prompt, and then click Run as administrator
  • Copy and paste the following: explorer shell:::{05d7b0f4-2121-4eff-bf6b-ed3f69b894d9}
  • Press Enter
  • Select "Always show all icons and notifications on the taskbar"
  • Click OK

If the checkbox "Always show all icons ..." is greyed out, I'm not totally sure what fixed it yet but it appears that changing the EnableAutoTray value in the Regedit helped.

To do so, open Regedit, go here:

[HKEY_CURRENT_USER\SOFTWARE\Microsoft\Windows\CurrentVersion\Explorer]

Then set EnableAutoTray to 1