{"title":"Duplicate Row Filter","nodeType":"Manipulator","id":"*SQUECT-F0VhUjdbf","factoryName":"org.knime.base.node.preproc.duplicates.DuplicateRowFilterNodeFactory","factoryId":"org.knime.base.node.preproc.duplicates.DuplicateRowFilterNodeFactory","path":["Manipulation","Row","Filter"],"owner":"knime","ownerAccountId":"account:team:b5f0848f-496d-4e6a-b869-fa3532248db7","description":"<p>This node identifies duplicate rows. Duplicate rows have identical values in certain columns. The node chooses a single row for each set of duplicates (&#34;chosen&#34;). You can either remove all duplicate rows from the input table and keep only unique and chosen rows or mark the rows with additional information about their duplication status.</p>\n        ","shortDescription":"Removes or marks duplicate rows.","keywords":["Unique"],"deprecated":false,"streamable":false,"tags":["Manipulation","Row","Filter"],"icon":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAACXBIWXMAAAsSAAALEgHS3X78AAAAl0lEQVQ4jb2TgQ1CIRBDe8YBHMWR3KR2E0dyE92ghsj/ASGI+eY3IeEKeRxwFwCuAIi3ZDvFkFT5JLt+AhiFbIekE4BH6ZPs+gdsVAKoQCif9pz1w/amFIZXkOQ0moVZwOYMdgF0H/GjWFZ7KaavgAw5A7jl8ELy3mwaAWZ1rGgRP/VFlUFENHU+6otl/r9vtD1d/+sMwAuye1fOvLvNBgAAAABJRU5ErkJggg==","views":[],"inPorts":[{"objectClass":"org.knime.core.node.BufferedDataTable","color":"000000","dataType":"Table","optional":false,"name":"Input Data","description":"The data table containing potential duplicates."}],"outPorts":[{"objectClass":"org.knime.core.node.BufferedDataTable","color":"000000","dataType":"Table","optional":false,"name":"Filtered/Labeled Data","description":"Either the input data without duplicates or the input data with additional columns identifying duplicates."}],"dynInPorts":[],"dynOutPorts":[],"additionalSiteInformation":{"url":"https://update.knime.com/analytics-platform/5.12","trusted":true,"enabledByDefault":true,"name":"KNIME Analytics Platform 5.12 Update Site","version":"5.12.0"},"dialog":[{"sectionName":"Duplicate detection","fields":[{"name":"Choose columns for duplicates detection","description":"Allows the selection of columns identifying the duplicates. Columns not selected are handled under &#34;Row selection&#34; in the &#34;Advanced&#34; tab.","optional":false}]},{"sectionName":"Duplicate handling","fields":[{"name":"Duplicate rows","description":"<ul><li><b>Remove duplicate rows:</b> Removes duplicate rows and keeps only unique and chosen rows.</li><li><b>Keep duplicate rows:</b> Appends columns with additional information to the input table.</li></ul>","optional":false},{"name":"Row chosen in case of duplicate","description":"<ul><li><b>First:</b> The first row in sequence is chosen.</li><li><b>Last:</b> The last row in sequence is chosen.</li><li><b>Minimum of:</b> The first row with the minimum value in the selected column is chosen. In case of strings, the row will be chosen following lexicographical order. Missing values are sorted after the maximum value.</li><li><b>Maximum of:</b> The first row with the maximum value in the selected column is chosen. In case of strings, the row will be chosen following lexicographical order. Missing values are sorted before the minimum value.</li></ul>","optional":false}]},{"sectionName":"Performance","fields":[{"name":"Compute in memory","description":"Advanced setting that, if selected, computation is sped up by utilizing working memory (RAM). The amount of required memory is higher than for a regular computation and also depends on the amount of input data.","optional":false},{"name":"Retain row order","description":"Advanced setting that, if selected, the rows in the output table are guaranteed to have the same order as in the input table.","optional":false},{"name":"Update domains of all columns","description":"Advanced setting to enable recomputation of the domains of all columns in the output tables such that the domains&#39; bounds exactly match the bounds of the data in the output tables.","optional":false}]}],"links":[],"kudos":[{"accountId":"account:user:3784265b-0f76-45f2-9a61-e472e4206f70","user":"nimantha","date":"2021-02-08T07:35:47+00:00"},{"accountId":"account:user:353f2acb-42bd-4f6e-93ba-89634d350167","user":"fsjorgensen","date":"2022-01-27T21:41:53+00:00"}],"kudosCount":2,"bundleInformation":{"bundleVersion":"5.12.0.v202606261225","bundleName":"KNIME Base Nodes","bundleSymbolicName":"org.knime.base","bundleVendor":"KNIME AG, Zurich, Switzerland","featureSymbolicName":"org.knime.features.base","featureName":"KNIME Base nodes","featureVersion":"5.12.0.v202606261225","featureVendor":"KNIME AG, Zurich, Switzerland","extensionId":"*bjR3r1yWOznPIEXS"},"frequentSuccessors":[]}