Can I debug libraries (DLLs) directly using CLion?

I'm using CLion IDE to work on multiple CMake projects which have libraries as output target (in my special case DLLs as I'm on Windows). Now it would be extremely handy to directly Debug/Run certain methods, using e.g. using CLion's Configurations. Is this possible? If not, what's the best way to debug such libraries?