I am trying to visualize decision tree structure in pyspark. But all the tools are for data. I could not find any for visualizing tree structure. Or is there a way I can visualize using the rules from toDebugString?
I am trying to visualize decision tree structure in pyspark. But all the tools are for data. I could not find any for visualizing tree structure. Or is there a way I can visualize using the rules from toDebugString?
I'm also a bigdata/ml engineer and I had many time the need to visualize the decision trees from Spark.
We've just released dtreeviz 1.1 , which includes support for Spark. You can now visualize the tree structure, leaf information, prediction path and more. Just check this notebook for more examples.