When trying to upload a CSV database file, the Form and List module only allows import of around 2,000 rows. I have databases with between 250K to 300K rows. How do I overcome this limitation?

Thanks..Mike

My guess is that your larger files exceed the maximum file size permitted by the setting in web.config.

Here is a nice explanation: http://www.datasprings.com/resource...-framework

Find the discussion of maxRequestLength.

Thanks for the response. Looks like I need to check the following in the web.config file:
1) Set maxRequestLength value to no less than the number of records in the database
2) Set requestLengthDiskThreshold equal to adjusted maxRequestLength
3) Verify executionTimeout is no less than 1800

I will check this as soon as I get home

Mike

The maxRequestLength is related to the maximum file size upload that you want to allow. It has nothing to do with records in the database.

Good day Joe,
One problem we found was that we are currently using a virtual dedicated server that does not have the CPU capacity to handle MSSQL. For that, we are moving to a dedicated server with that capacity. Once that is done, is it your opinion that the Form and List module will handle a 15-20 field, >400K record, 300MB db file?

If not, we will need to find a module for DNN that will or move to another platform.

Thanks, Mike

Good day Joe,
We uploaded the CSV file via ftp. Now, when trying to import from the root directory to the Form and List module the process times out and not all of the records are imported. we changed the maxRequestLength and other settings as you had noted. Any ideas?

Thanks, Mike

That will certainly help with performance. You'll still have the issue with loading the data if you don't change web.config.

For big things like that, it might be easier to upload your data to a file on the server via FTP and load the data into the database using MS SQL Server Management Studio.

(You might also think about having that data in a database that is separate from the DotNetNuke database. F&L, the Reports module and others (like SGSV from Tressleworks) do have the capability of interacting with external databases. Analyzing your use case will help you determine if a separate database makes sense.

We did change the web.config file. Can you recommend someone to contract with to get us past this hurdle? I am under a time constraint. Thanks.

Please contact me privately using the contact form at patapscorg.com.

the contact form requires your email address

Yes, your email address. Not mine. I'll send a separate email to the Percy Patrick email address.