Data deduplication via Automation?

[Soonimproveduser]

Hey,

the Data deduplication plugin works fine. However, is there any chance to do this via automation?

Has someone an idea?

Best regards

[cdb]

This question was already answered in the past:

Tutorial: Python-Script to find and remove duplicates

Do you want an automation that finds and removes duplicated rows in one of your bases? Then try this python-code. This code loops through all the rows in your base. It finds duplicates and leaves only the newest or the oldest entries. You can decide which rows should be kept. You can either run this script manually or create an automation (Enterprise only) that is executed every time a row is updated. And here is the code that should be self-explanatory: # This python script searches for sim…

[Soonimproveduser]

Works perfect!!!

Thank you for the assistants.

[webdienste]

I would so love to have this python automation if it could do the following:

• Find duplicate rows on the basis of a “name” column
• Copy information from selected columns in the duplicate row(s) into the original (i.e. first) row
• Delete the duplicate row(s) to leave only the original first row

My use case: I have a table that should contain only one copy per registered person. Every time a user signs up for a course, a new row is created. I then have to manually merge the information from the new row into the original to leave only one row per person. The information I have to copy is only ever the course they are signed up for. However, this course is linked from a “courses” table.

[Soonimproveduser]

I had a similar problem and fixed it like this:

I had a date and a Used ID in one table.
I created a table in which I had summaries, e.g. the link was to the date column in my case, in your case it could be the course to which you link. Leading to many rows of the same date for the same user. However, through the link column each row for the date had all the links for the user in it. So I created a formula column in which I combined {date}+{id}, which I had like three or four per day per person. The phyton script only controlled the formula column of {date}+{id} and deleted the extra rows via automation.

In your case {course name/id}+{user id} as formula column for the phyton script could be the solution.