Data migration and avoiding duplication of records

For general questions and discussions specific to the AbleCommerce 7.0 Asp.Net product.
Post Reply
amandanelson
Ensign (ENS)
Ensign (ENS)
Posts: 2
Joined: Thu Oct 02, 2008 9:36 am

Data migration and avoiding duplication of records

Post by amandanelson » Thu Oct 02, 2008 9:46 am

We need to import CSV of 16000 records into Able Commerce and I wondered if anyone has used this utitlity....my main question is not on data mapping but whether there is provision within the utility that recognises duplicate records/details and allows us to choose or specify which ones to retain or delete. Thanks

User avatar
AbleMods
Master Yoda
Master Yoda
Posts: 5170
Joined: Wed Sep 26, 2007 5:47 am
Location: Fort Myers, Florida USA

Re: Data migration and avoiding duplication of records

Post by AbleMods » Sat Oct 04, 2008 8:29 pm

You haven't specifically mentioned a particular data import utility, so I assume you're referring to the Able Dataport utility.

So far as I know, the only duplication check performed is based on the ProductId field value. If you are uploading new products without any existing products loaded in the AC7 store catalog, no duplicate-checking will be performed since no ProductId values exist.

I recommend that you clean the data prior to importing into the store.
Joe Payne
AbleCommerce Custom Programming and Modules http://www.AbleMods.com/
AbleCommerce Hosting http://www.AbleModsHosting.com/
Precise Fishing and Hunting Time Tables http://www.Solunar.com

amandanelson
Ensign (ENS)
Ensign (ENS)
Posts: 2
Joined: Thu Oct 02, 2008 9:36 am

Re: Data migration and avoiding duplication of records

Post by amandanelson » Sun Oct 05, 2008 3:38 am

Thanks for that. We have customers that have elected NOT to have an account but we have their details so it is possible for one customer to have purchased from us numerous times. Appreciate the response though and yes it looks like we'll ned to clean by hand or use ACT or something similar as I believe you can elect to clear duplicates in that programme though don't know yet how sphisticated it is. If I find a great tool to achieve this I'll let you know!

User avatar
AbleMods
Master Yoda
Master Yoda
Posts: 5170
Joined: Wed Sep 26, 2007 5:47 am
Location: Fort Myers, Florida USA

Re: Data migration and avoiding duplication of records

Post by AbleMods » Sun Oct 05, 2008 7:55 am

Excel is actually quite clever at it.

Just set it up like a data spreadsheet and then sort/group the data on the primary key you want to be unique.

Then copy/paste the summarized (grouped) result into a new sheet and export that sheet. Should give you a nice, clean unique list based on your primary key and it's exportable to CSV for import.
Joe Payne
AbleCommerce Custom Programming and Modules http://www.AbleMods.com/
AbleCommerce Hosting http://www.AbleModsHosting.com/
Precise Fishing and Hunting Time Tables http://www.Solunar.com

Post Reply