3/10 AbleCommerce Data Client Utility 7.0.2

Post by **Shopping Cart Admin** » Tue Mar 10, 2009 10:40 am

Hello Everyone,

WARNING: Backup your database before using this tool !

The AbleCommerce data port utility greatly reduces the time to upload large catalogs into AbleCommerce.

1. Download your entire store as an XML package.
2. Upload your entire store as an XML package.
3. Download Products, Categories, Users and Order in CSV or XML format.
4. Upload Products, Categories, Users and Orders in CSV or XML format.
5. Create templates to map CSV data from other sources to the AbleCommerce fields and save the template for later.
6. Upload AbleCommerce 5.5 XML data to AbleCommerce 7.2

---------------------------------------------------------------------------------------
WARNING: BACKUP YOUR DATABASE BEFORE USING THIS TOOL !
---------------------------------------------------------------------------------------

Download AbleCommerce Data Client 7.0.2:
ftp://ftp.ablecommerce.com/evals/AbleCo ... _7.0.2.zip

BUG REPORTING:
---------------------------------------------------------------------------------------
Report bugs by at the following URL by clicking the need help icon at the bottom of the page.

http://help.ablecommerce.com/report_bug.htm

mfreeze · Post by **mfreeze** » Wed Mar 11, 2009 8:38 am

Does this version only work with 7.0.2?

I have clients with sites at different levels and either need a release that will work with multiple levels or the ability to run multiple releases of the dataport on one desktop.

rseavey · Post by **rseavey** » Wed Mar 11, 2009 9:11 am

Ok, new user. Evaluated AC, then just bit the bulllet. Have 7.0.2 running fine in development, glad to see the DataPort as I need to begin work on migrating from my old cart to this database. Cannot connect with the utility. My user has "super user", I've tried to make sure I had the proper DLL's. When trying to connect, I just get the Authentication Failed. Invalid or empty request. Where to start troubleshooting?

PLATFORM: ASP.NET
VERSION: 7.0.2
BUILD: 11659

AjaxControlToolkit: 1.0.10618.0
AtlasControlToolkit: 1.0.60731.0
CommerceBuilder: 7.2.11602.0
CommerceBuilder.AbleCommerceTax: 7.2.11310.0
CommerceBuilder.AcTestProvider: 1.0.0.0
CommerceBuilder.AustraliaPost: 7.1.0.0
CommerceBuilder.AuthorizeNet: 7.0.9764.0
CommerceBuilder.CanadaPost: 7.0.0.0
CommerceBuilder.CCH: 7.0.0.0
CommerceBuilder.Configuration: 7.2.11602.0
CommerceBuilder.CyberSource: 7.0.9310.0
CommerceBuilder.Data: 7.2.11602.0
CommerceBuilder.DataClient.Api: 7.0.2.1
CommerceBuilder.DataClient.Csv: 7.0.34.0
CommerceBuilder.DHL: 7.2.11307.0
CommerceBuilder.DHLInternational: 7.2.11307.0
CommerceBuilder.ECB: 7.0.0.0
CommerceBuilder.FedEx: 7.0.9725.0
CommerceBuilder.FRBNY: 7.0.0.0
CommerceBuilder.GoogleCheckout: 7.0.10052.0
CommerceBuilder.InternetSecure: 7.0.9764.0
CommerceBuilder.LinkPoint: 7.0.9764.0
CommerceBuilder.Paradata: 7.0.9764.0
CommerceBuilder.PayFlowPro: 7.0.10061.0
CommerceBuilder.PayJunction: 7.2.11284.0
CommerceBuilder.PayPal: 7.2.10840.0
CommerceBuilder.Protx: 7.1.10124.0
CommerceBuilder.Services: 7.2.11602.0
CommerceBuilder.SkipJack: 7.0.9764.0
CommerceBuilder.UPS: 7.0.10041.0
CommerceBuilder.USPS: 7.0.9728.0
CommerceBuilder.Web: 7.2.11602.0
ComponentArt.Web.UI: 2008.2.1204.35
CyberSource.Base: 2.0.0.0
CyberSource.Clients: 5.0.2.0
CyberSource.Clients.XmlSerializers: 5.0.2.0
CyberSource.WSSecurity: 2.0.0.0
CybsWSSecurityIOP: 1.0.0.0
eWorld.UI: 1.9.0.0
FredCK.FCKeditorV2: 2.5.2912.21007
FreeTextBox: 3.1.6.34851
ICSharpCode.SharpZipLib: 0.85.5.452
LinkPointTransaction: 1.0.1797.29766
log4net: 1.2.10.0
MagicAjax: 0.2.1.23059
Microsoft.AtlasControlExtender: 1.0.60726.0
Microsoft.Practices.EnterpriseLibrary.Caching: 2.0.0.0
Microsoft.Practices.EnterpriseLibrary.Common: 2.0.0.0
Microsoft.Practices.EnterpriseLibrary.Data: 2.0.0.0
Microsoft.Practices.EnterpriseLibrary.ExceptionHandling: 2.0.0.0
Microsoft.Practices.EnterpriseLibrary.ExceptionHandling.Logging: 2.0.0.0
Microsoft.Practices.EnterpriseLibrary.Logging: 2.0.0.0
Microsoft.Practices.EnterpriseLibrary.Logging.Database: 2.0.0.0
Microsoft.Practices.ObjectBuilder: 1.0.51205.0
Microsoft.Web.Atlas: 2.0.50727.0
Microsoft.Web.Preview: 1.2.61025.0
NVelocity: 7.2.0.0
PaygatewayNET: 3.0.0.0
paypal_base: 4.2.1.0
PFProCOMLib: 1.0.0.0
PFProdotNET: 0.0.0.0
SubSonic: 1.0.5.0
Validators: 1.0.0.0
WebChart: 1.1.1.6
wwHoverPanel: 1.85.0.0
Xpdt.Web.UI.Ratings: 1.0.0.0

Post by **Naveed** » Thu Mar 12, 2009 7:45 am

mfreeze wrote:Does this version only work with 7.0.2?

I have clients with sites at different levels and either need a release that will work with multiple levels or the ability to run multiple releases of the dataport on one desktop.

Yes this version will work only for 7.2, however you can install multiple versions of DataPort side by side on a single PC. Only restriction is to install the old builds Like 7.0.34 first and latest builds after that,otherwise you will not be able to install 7.0.34 when a higher version is already installed.

bemara579 · Post by **bemara579** » Thu Mar 12, 2009 6:11 pm

Is the source code available for this? I would love to modify it to make ad-hoc integration and custom migration painless as possible - I promise I'll share

. Thanks for the great work!!

Post by **Naveed** » Fri Mar 13, 2009 4:25 am

DataPort source code is not open. However we will discuss your proposal.

Anyhow, thanks for the appreciation!

Post by **Naveed** » Fri Mar 13, 2009 5:15 am

rseavey wrote:Ok, new user. Evaluated AC, then just bit the bulllet. Have 7.0.2 running fine in development, glad to see the DataPort as I need to begin work on migrating from my old cart to this database. Cannot connect with the utility. My user has "super user", I've tried to make sure I had the proper DLL's. When trying to connect, I just get the Authentication Failed. Invalid or empty request. Where to start troubleshooting?

File list seems to be OK. Not sure why this happening....
Is there any trace in Log file? If Able Store is installed on your local system you can access the log file manually at:
~/Website/App_Data/Logs/app.log

Otherwise using the web interface:
Admin -> Help -> Error Log

bemara579 · Post by **bemara579** » Fri Mar 13, 2009 5:37 am

Thanks again Naveed... even an DataPort API would awesome! Such as allowing us to pass delegates to the method calls so we can pre/post process the import records one by one.

rseavey · Post by **rseavey** » Fri Mar 13, 2009 10:20 am

Naveed, there are the 2 FK warnings below.

WARN 2009-03-09 10:20:51,080 218ms Object a - Error running SQL: INSERT INTO ac_ErrorMessages (EntryDate, StoreId, MessageSeverityId, Text, DebugData) VALUES (@EntryDate, @StoreId, @MessageSeverityId, @Text, @DebugData); SELECT @@IDENTITY
System.Data.SqlClient.SqlException: The INSERT statement conflicted with the FOREIGN KEY constraint "ac_Stores_ac_ErrorMessages_FK1". The conflict occurred in database "smc20", table "dbo.ac_Stores", column 'StoreId'.
The statement has been terminated.
at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection)
at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection)
at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj)
at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj)
at System.Data.SqlClient.SqlDataReader.ConsumeMetaData()
at System.Data.SqlClient.SqlDataReader.get_MetaData()
at System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOptionsString)
at System.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, Boolean async)
at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method, DbAsyncResult result)
at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method)
at System.Data.SqlClient.SqlCommand.ExecuteScalar()
at Microsoft.Practices.EnterpriseLibrary.Data.Database.DoExecuteScalar(DbCommand command)
at Microsoft.Practices.EnterpriseLibrary.Data.Database.ExecuteScalar(DbCommand command)
at CommerceBuilder.Data.Database.ExecuteScalar(DbCommand command)
WARN 2009-03-09 10:20:51,127 265ms Object a - Error running SQL: INSERT INTO ac_ErrorMessages (EntryDate, StoreId, MessageSeverityId, Text, DebugData) VALUES (@EntryDate, @StoreId, @MessageSeverityId, @Text, @DebugData); SELECT @@IDENTITY
System.Data.SqlClient.SqlException: The INSERT statement conflicted with the FOREIGN KEY constraint "ac_Stores_ac_ErrorMessages_FK1". The conflict occurred in database "smc20", table "dbo.ac_Stores", column 'StoreId'.
The statement has been terminated.
at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection)
at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection)
at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj)
at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj)
at System.Data.SqlClient.SqlDataReader.ConsumeMetaData()
at System.Data.SqlClient.SqlDataReader.get_MetaData()
at System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOptionsString)
at System.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, Boolean async)
at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method, DbAsyncResult result)
at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method)
at System.Data.SqlClient.SqlCommand.ExecuteScalar()
at Microsoft.Practices.EnterpriseLibrary.Data.Database.DoExecuteScalar(DbCommand command)
at Microsoft.Practices.EnterpriseLibrary.Data.Database.ExecuteScalar(DbCommand command)
at CommerceBuilder.Data.Database.ExecuteScalar(DbCommand command)
INFO 2009-03-09 16:14:38,018 21227156ms Object a - Running maintenance routines
INFO 2009-03-09 16:14:38,143 21227281ms Object a - Catalog maintenance removed 1 invalid catalog nodes
INFO 2009-03-09 16:14:38,189 21227328ms Object a - Maintenance routines complete
INFO 2009-03-09 22:14:38,002 42827140ms Object a - Running maintenance routines
INFO 2009-03-09 22:14:38,002 42827140ms Object a - Maintenance routines complete
INFO 2009-03-10 04:14:38,002 64427140ms Object a - Running maintenance routines
INFO 2009-03-10 04:14:38,018 64427156ms Object a - Maintenance routines complete
INFO 2009-03-10 10:14:38,002 86027140ms Object a - Running maintenance routines
INFO 2009-03-10 10:14:38,002 86027140ms Object a - Maintenance routines complete
INFO 2009-03-10 16:14:38,018 107627156ms Object a - Running maintenance routines
INFO 2009-03-10 16:14:38,018 107627156ms Object a - Maintenance routines complete
INFO 2009-03-10 22:14:38,018 129227156ms Object a - Running maintenance routines
INFO 2009-03-10 22:14:38,033 129227171ms Object a - Maintenance routines complete
INFO 2009-03-11 04:14:38,018 150827156ms Object a - Running maintenance routines
INFO 2009-03-11 04:14:38,080 150827218ms Object a - Maintenance routines complete
INFO 2009-03-11 07:30:22,125 187ms Object a - Running maintenance routines
INFO 2009-03-11 07:30:23,375 1437ms Object a - Maintenance routines complete
INFO 2009-03-11 08:44:35,578 0ms Object a - Running maintenance routines
INFO 2009-03-11 08:44:35,687 109ms Object a - Maintenance routines complete
INFO 2009-03-11 08:46:36,593 0ms Object a - Running maintenance routines
INFO 2009-03-11 08:46:36,734 140ms Object a - Maintenance routines complete
INFO 2009-03-11 13:59:31,500 125ms Object a - Running maintenance routines
INFO 2009-03-11 13:59:32,046 671ms Object a - Maintenance routines complete
INFO 2009-03-11 19:59:30,218 21598843ms Object a - Running maintenance routines
INFO 2009-03-11 19:59:30,218 21598843ms Object a - Maintenance routines complete
INFO 2009-03-12 01:59:30,218 43198843ms Object a - Running maintenance routines
INFO 2009-03-12 01:59:30,234 43198859ms Object a - Maintenance routines complete
INFO 2009-03-12 07:59:30,218 64798843ms Object a - Running maintenance routines
INFO 2009-03-12 07:59:30,218 64798843ms Object a - Maintenance routines complete
INFO 2009-03-12 13:59:30,234 86398859ms Object a - Running maintenance routines
INFO 2009-03-12 13:59:30,234 86398859ms Object a - Maintenance routines complete
INFO 2009-03-12 19:59:30,218 107998843ms Object a - Running maintenance routines
INFO 2009-03-12 19:59:30,218 107998843ms Object a - Maintenance routines complete
INFO 2009-03-13 01:59:30,218 129598843ms Object a - Running maintenance routines
INFO 2009-03-13 01:59:30,234 129598859ms Object a - Maintenance routines complete
INFO 2009-03-13 07:59:30,218 151198843ms Object a - Running maintenance routines
INFO 2009-03-13 07:59:30,234 151198859ms Object a - Maintenance routines complete

rseavey · Post by **rseavey** » Mon Mar 16, 2009 1:38 pm

Naveed, any other suggestions? I've tried to create another site, and the problem still occurs.

I won't have any use for this cart if I can't migrate my data to it. Thanks for your help.

mfreeze · Post by **mfreeze** » Mon Mar 16, 2009 2:12 pm

I downloaded Dataport 7.02 from the link above and the replacement DLLs are not in the zip file.

Post by **Naveed** » Tue Mar 17, 2009 6:21 am

rseavey wrote:Naveed, any other suggestions? I've tried to create another site, and the problem still occurs.

It is looking quite strange!
No other user have similar issues or at least no one else have yet reported. The file list for your store Bin directory also seems to be fine.

Please post the issue on Able CRM, so that we can proceed on it further. We might need need your store admin user name and password for verification and debugging. And the suitable location to handle all this is Able CRM.

Please have a look at the following thread that how you can post bugs/issues on CRM:
viewtopic.php?f=42&t=6073

Post by **Naveed** » Tue Mar 17, 2009 6:26 am

mfreeze wrote:I downloaded Dataport 7.02 from the link above and the replacement DLLs are not in the zip file.

Thanks for pointing out. We will update the zip file soon.

However there is a possible workaround. Please install the Dataport using the installer provided. Now open the DataPort installation directory. Path might be something similar to "C:\Program Files\AbleCommerce\AbleCommerce DataPort 7.0.2". Use/upload the dll files in the installation directory:

CommerceBuilder.DataClient.Api.dll
CommerceBuilder.DataClient.Csv.dll

rseavey · Post by **rseavey** » Tue Mar 17, 2009 6:43 am

Naveed, I HAVE posted this on Able CRM!!! Case #4023. Mike R. told me it was not appropriate for CRM and to post it on the forums!

Now there's a week gone by that I've now lost with no help.

Post by **Naveed** » Tue Mar 17, 2009 6:46 am

rseavey wrote:Naveed, I HAVE posted this on Able CRM!!! Case #4023. Mike R. told me it was not appropriate for CRM and to post it on the forums!

I am sorry for the delayed responses. I am sending you my email address in a private message. Please email me the store url, admin user name and password.

Post by **Naveed** » Tue Mar 17, 2009 9:09 am

Hello rseavey,

Every thing on your local system install was OK. The only problem was the in-correct Client API service Url. I have sent the correct service URL for your store in a private message.

I hope your problem is solved.

mfreeze · Post by **mfreeze** » Tue Mar 17, 2009 10:00 am

I copied the dlls from the program and connected fine. Most of the errors I received with the .34 version of the dataport are no longer an issue. There are a couple that I would like to resolve if possible.

The following I assume are caused by a difference in the length of a field the Name field in the KitComponents table. I am going to restore the DB, change the length of the field and try again.

Error: Kit Component Import, KitComponentID:58 , Name:PDF Files , String or binary data would be truncated.
The statement has been terminated.
at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection)
at System.Data.(for more details check server log)...

I am still getting a lot of the following errors which I don't understand since I am importing into an empty database with only my user ID defined.

A User with the same ID already exists, saving it with new ID.
Old User ID=142
User Name=larry.b.shutt@cummins.com

Warning: A User with the same ID already exists, saving it with new ID.
Old User ID=143
User Name=joe.shields@astrazeneca.com

Warning: A User with the same ID already exists, saving it with new ID.
Old User ID=144
User Name=jforbes@jensen-ind.com

Post by **Naveed** » Tue Mar 17, 2009 10:11 am

mfreeze wrote: I am still getting a lot of the following errors which I don't understand since I am importing into an empty database with only my user ID defined.

A User with the same ID already exists, saving it with new ID.
Old User ID=142
User Name=larry.b.shutt@cummins.com

These are not errors but warning messages. It just notifies that UserId field value for these users will not be preserved. Although you have just one user in database but it is causing to shift all user ID's one ahead.

If you select the preserve id option to delete the existing object then only a single user record will be skipped( the currently logged in user), and for all other users the ID will be preserved.

However if you are not cautious about preserving user id's then you can safely ignore these warning messages.

mfreeze · Post by **mfreeze** » Tue Mar 17, 2009 11:38 am

The following I assume are caused by a difference in the length of a field the Name field in the KitComponents table. I am going to restore the DB, change the length of the field and try again.

Error: Kit Component Import, KitComponentID:58 , Name:PDF Files , String or binary data would be truncated.
The statement has been terminated.
at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection)
at System.Data.(for more details check server log)...

FYI. I had to change the name field in both the KitComponents table and the KitProducts table to nvarchar(255) to correct this error.

Also, by selecting 'preserve ID' on the import, I just changed the warning message from the on in my previous post to :

Warning: Found a User with same ID, the existing User is deleted and this one successfully saved with old ID.
User ID=89057
User Name=d.hansen@unifiedalloys.com

So I guess the choice is which warning I want to receive in the import. I still don't understand how there could be duplicate users imported into a blank database but if this is the way it works, so be it. I think we can live with this.

mfreeze · Post by **mfreeze** » Wed Mar 18, 2009 8:30 am

I found one problem with the import that I had also noticed in the .34 dataport but had not yet reported.

After you import the 5.5 XML, go to Manage/Digital Goods/Manage Digital Goods. You will see under the column file all files are marked as (MISSING). If you then edit one of the Digital Goods, you will see in the resulting screen that the fields File Name and Save as Name are reversed; checking the DigitalGoods table in the database confirms this. I checked the 5.5 XML file and the fields are marked correctly so this occurred during the import of the file.

We ran a custom SQL script to correct the error but I am sure we will run into the same issue with future 5.5 imports. If you need the XML that produced the error, I can zip it and send it to you.

Post by **Naveed** » Wed Mar 18, 2009 9:11 am

Hello Mary E Freeze,

I am not able to understand the issue you are pointing out. Please explain in more details with the help of some sample data.

mfreeze · Post by **mfreeze** » Wed Mar 18, 2009 9:54 am

Sorry. I thought I was clear but maybe it was only clear to me because I experienced the problem. Let's see if I can explain better.

When importing a 5.5 XML file with ESD information, the fields file name and save as name are reversed. In the database table ac_DigitalGoods, these would be the rows for FileName and ServerFileName. In other words, the data that should be imported into FileName is being placed into ServerFileName and vice versa.

I emailed you the XML I imported. I tried to attach it here but, even zipped, it is too large and it won't upload.

I can't show you on the site because I've already fixed it since I need to meet a deadline for finishing the site.

Post by **Naveed** » Wed Mar 18, 2009 11:24 am

Thanks for reporting the issue, I am going to report a new bug for this.

calvis · Post by **calvis** » Wed Mar 18, 2009 3:35 pm

I am getting duplicated users when doing my import of a 5.5 store.
The duplicate users are disabled with no user details.

How to fix, or prevent?

Post by **Naveed** » Thu Mar 19, 2009 2:42 am

Hello calvis,

Please confirm that your AC55 xml data does not contain the duplicate records? Are you sure that the users are duplicated and disabled when importing?

Any symptoms which users got duplicated? I mean is there any pattern?

AbleCommerce Shopping Cart Software

3/10 AbleCommerce Data Client Utility 7.0.2

3/10 AbleCommerce Data Client Utility 7.0.2

Re: 3/10 AbleCommerce Data Client Utility 7.0.2

Re: 3/10 AbleCommerce Data Client Utility 7.0.2

Re: 3/10 AbleCommerce Data Client Utility 7.0.2

Re: 3/10 AbleCommerce Data Client Utility 7.0.2

Re: 3/10 AbleCommerce Data Client Utility 7.0.2

Re: 3/10 AbleCommerce Data Client Utility 7.0.2

Re: 3/10 AbleCommerce Data Client Utility 7.0.2

Re: 3/10 AbleCommerce Data Client Utility 7.0.2

Re: 3/10 AbleCommerce Data Client Utility 7.0.2

Re: 3/10 AbleCommerce Data Client Utility 7.0.2

Re: 3/10 AbleCommerce Data Client Utility 7.0.2

Re: 3/10 AbleCommerce Data Client Utility 7.0.2

Re: 3/10 AbleCommerce Data Client Utility 7.0.2

Re: 3/10 AbleCommerce Data Client Utility 7.0.2

Re: 3/10 AbleCommerce Data Client Utility 7.0.2

Re: 3/10 AbleCommerce Data Client Utility 7.0.2

Re: 3/10 AbleCommerce Data Client Utility 7.0.2

Re: 3/10 AbleCommerce Data Client Utility 7.0.2

Re: 3/10 AbleCommerce Data Client Utility 7.0.2

Re: 3/10 AbleCommerce Data Client Utility 7.0.2

Re: 3/10 AbleCommerce Data Client Utility 7.0.2

Re: 3/10 AbleCommerce Data Client Utility 7.0.2

Re: 3/10 AbleCommerce Data Client Utility 7.0.2

Re: 3/10 AbleCommerce Data Client Utility 7.0.2