This node uses the model as generated by a Correlation node to determine which columns are redundant (i.e. correlated) and filters them out. The output table will contain the reduced set of columns.
\n \nThe filtering step works roughly as follows: For each column in the correlation model the count of correlated columns is determined given a threshold value for the correlation coefficient (specified in the dialog). The column with the most correlated columns is chosen to "survive" and all correlated columns are filtered out. This procedure is repeated until no more columns can be identified. The problem of finding a minimum set of columns to satisfy the constraints is difficult to solve analytically. This method applied here is known to be good approximation, however.
\n \n \n ","shortDescription":"Filters out correlated columns.","keywords":[],"deprecated":false,"streamable":false,"tags":["Analytics","Mining","Feature Selection"],"icon":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAAGXRFWHRTb2Z0d2FyZQBBZG9iZSBJbWFnZVJlYWR5ccllPAAAA3BpVFh0WE1MOmNvbS5hZG9iZS54bXAAAAAAADw/eHBhY2tldCBiZWdpbj0i77u/IiBpZD0iVzVNME1wQ2VoaUh6cmVTek5UY3prYzlkIj8+IDx4OnhtcG1ldGEgeG1sbnM6eD0iYWRvYmU6bnM6bWV0YS8iIHg6eG1wdGs9IkFkb2JlIFhNUCBDb3JlIDUuNi1jMDY3IDc5LjE1Nzc0NywgMjAxNS8wMy8zMC0yMzo0MDo0MiAgICAgICAgIj4gPHJkZjpSREYgeG1sbnM6cmRmPSJodHRwOi8vd3d3LnczLm9yZy8xOTk5LzAyLzIyLXJkZi1zeW50YXgtbnMjIj4gPHJkZjpEZXNjcmlwdGlvbiByZGY6YWJvdXQ9IiIgeG1sbnM6eG1wTU09Imh0dHA6Ly9ucy5hZG9iZS5jb20veGFwLzEuMC9tbS8iIHhtbG5zOnN0UmVmPSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvc1R5cGUvUmVzb3VyY2VSZWYjIiB4bWxuczp4bXA9Imh0dHA6Ly9ucy5hZG9iZS5jb20veGFwLzEuMC8iIHhtcE1NOk9yaWdpbmFsRG9jdW1lbnRJRD0ieG1wLmRpZDowYjM2YWM5Ny01ZWJhLTQwZTctOTE4OS1iYmU4ZDdkMGYyNGUiIHhtcE1NOkRvY3VtZW50SUQ9InhtcC5kaWQ6NzlGQTQ4Nzg4N0M1MTFFNUIyNjBENUZBOEI3RjgwMEUiIHhtcE1NOkluc3RhbmNlSUQ9InhtcC5paWQ6NzlGQTQ4Nzc4N0M1MTFFNUIyNjBENUZBOEI3RjgwMEUiIHhtcDpDcmVhdG9yVG9vbD0iQWRvYmUgUGhvdG9zaG9wIENDIDIwMTUgKE1hY2ludG9zaCkiPiA8eG1wTU06RGVyaXZlZEZyb20gc3RSZWY6aW5zdGFuY2VJRD0ieG1wLmlpZDo0MzBENDc1RjM4NEUxMUU1OTk3MThDMzA3QzdERDI0QyIgc3RSZWY6ZG9jdW1lbnRJRD0ieG1wLmRpZDo0MzBENDc2MDM4NEUxMUU1OTk3MThDMzA3QzdERDI0QyIvPiA8L3JkZjpEZXNjcmlwdGlvbj4gPC9yZGY6UkRGPiA8L3g6eG1wbWV0YT4gPD94cGFja2V0IGVuZD0iciI/PiSqEJ4AAADBSURBVHjaYjQt8v3PQDxgPN23GUWABURI2mqgCD4/fAOrGDL4//8/AyMjIwMTA4WAbAOAtv8n2wCQ8yl2AUogogcQLjEQEBMTwzCAkZhYgIl/+vSJMhf8+PEDHoCg4GAJ3/+StIQEoRuBuB5EM/YYmv2PkpVEUbXs8XMGbGIgA5ru3GT49Pkj2HYQn+RYUFVUhbuGrGj88OkDSjpgIdWAuw/uIAci6S5gZmaGOR+MwYFISizM/PCB4fb9W3ABgAADAJ3HTWCqXIfKAAAAAElFTkSuQmCC","views":[],"inPorts":[{"objectClass":"org.knime.base.node.preproc.correlation.pmcc.PMCCPortObjectAndSpec","color":"9b9b9b","dataType":"Correlation","optional":false,"name":"Correlation model","description":"The model from the correlation node."},{"objectClass":"org.knime.core.node.BufferedDataTable","color":"000000","dataType":"Table","optional":false,"name":"Input data","description":"Numeric input data to filter. It must contain the set of columns that were used to create the correlation model. (Typically you connect the input data from the correlation node here.)"}],"outPorts":[{"objectClass":"org.knime.core.node.BufferedDataTable","color":"000000","dataType":"Table","optional":false,"name":"Filtered data from input","description":"Filtered data from input."}],"dynInPorts":[],"dynOutPorts":[],"additionalSiteInformation":{"url":"https://update.knime.com/analytics-platform/5.12","trusted":true,"enabledByDefault":true,"name":"KNIME Analytics Platform 5.12 Update Site","version":"5.12.0"},"dialog":[{"sectionName":"Options","fields":[{"name":"Correlation threshold","description":"Choose the correlation threshold. The higher the value, the fewer columns get filtered out.","optional":false},{"name":"Included columns","description":"Shows the columns which will be included or excluded in the output table. The list is updated based on the correlation model and the chosen correlation threshold. This list cannot be edited.","optional":false}]}],"links":[],"kudos":[{"accountId":"account:user:552210dd-3dfc-4b47-bbe6-477d972e6b9e","user":"nilotpalc","date":"2025-01-04T10:02:07+00:00"},{"accountId":"account:user:299df9d9-2ae6-400e-8752-869a73beaa8b","user":"raph0007","date":"2020-08-28T08:03:41+00:00"}],"kudosCount":2,"bundleInformation":{"bundleVersion":"5.12.0.v202606261225","bundleName":"KNIME Base Nodes","bundleSymbolicName":"org.knime.base","bundleVendor":"KNIME AG, Zurich, Switzerland","featureSymbolicName":"org.knime.features.base","featureName":"KNIME Base nodes","featureVersion":"5.12.0.v202606261225","featureVendor":"KNIME AG, Zurich, Switzerland","extensionId":"*bjR3r1yWOznPIEXS"},"frequentSuccessors":[{"id":"*T0AhxSe0Yi42rQK8","factoryName":"org.knime.base.node.preproc.partition.PartitionNodeFactory","probability":0.0998389694041868},{"id":"*0J-YQquqjxfH58Jk","factoryName":"org.knime.base.node.preproc.lowvarfilter2.LowVarFilter2NodeFactory","probability":0.04508856682769726},{"id":"*LBLxD9VX3jSsQcU1","factoryName":"org.knime.base.node.preproc.filter.columnref.ColumnFilterRefNodeFactory","probability":0.04508856682769726},{"id":"*XSCKH1I1S2QiA5_-","factoryName":"org.knime.base.node.preproc.normalize.NormalizerDeNodeFactory","probability":0.040257648953301126},{"id":"*ZgYyOm1P9VJVBE9e","factoryName":"org.knime.base.node.preproc.joiner.Joiner2NodeFactory","probability":0.037037037037037035},{"id":"*oluxz9j9RhfJY3E0","factoryName":"org.knime.base.node.preproc.correlation.compute.CorrelationComputeNodeFactory","probability":0.03542673107890499},{"id":"*DOkyMaii62U05xZ1","factoryName":"org.knime.base.node.preproc.filter.column.DataColumnSpecFilterNodeFactory","probability":0.03542673107890499},{"id":"*BKpS2Ow-rnvw2TSf","factoryName":"org.knime.base.node.meta.xvalidation.XValidatePartitionerFactory","probability":0.028985507246376812},{"id":"*7isNz6mji9l5c7Iv","factoryName":"org.knime.base.node.preproc.normalize3.Normalizer3NodeFactory","probability":0.027375201288244767},{"id":"*eAyyc-wmeLvvI3j1","factoryName":"org.knime.base.node.mine.regression.linear2.learner.LinReg2LearnerNodeFactory2","probability":0.024154589371980676}]}