Slow Processing of CSV, EXCEL and TXT files
I'm using AA because it is user friendly and will leave my client with tasks that they can edit themselves. I use it to integrate data I scrape from the web. Sometimes I get csv files from the web and integrate them into SQL server.
Going through each row of a csv files is extremely slow when compared to other options out there. It takes me nearly 5 minutes to go through a file with about 5,000 records. If I were to use SQL Server Integrations Services it would integrate the entire file in less than 1 second.
I'd like to see some major performance improvements. Without speeding it up, I think a lot of people will not consider using AA, despite it's user friendly interface.
I am currently investigating other options for processing of CSV files, as I cannot use up 5 minutes of processing to integrate 15,000 records. I expect others will do the same.
|