I'd like to permanently see a clickable list of windows I have open, in the same way that the taskbar allows in Windows. Can I do this on Mac?

Some details:

• i have many virtual desktops (spaces), so often a single application has windows on many of them.
• I often have multiple windows of each application, such as the terminal or browser, on the same virtual desktop
• I have multiple monitors, if it matters.

Edit: When I say 'permanently see a clickable list of windows I have open' I mean that I want to see every window I have open, and I'd like to be able to click on each one to open that window. I'm not looking for the newer behaviour where tasks are clustered by application.