Date: 05/09/05 (SQL Server)    Keywords: sql

...in SQL Server 2000.

I'm not sure what I want to do can actually be done, and my leafing through VBScript books/searching on the Internet has not brought me any closer to figuring it out. Hoping someone here may have an answer. (If there's a non-scripting solution, I'd certainly be open to that-- in fact, I'd prefer it.)

I'm reading in a text file. Each line of the file must go into one of a number of different tables based on certain criteria contained within the line itself. What I'm wondering is if there's a way to structure the data pump (or a different type of task) to read the line, look for the necessary criterion, and then shunt the line off into a table.

The way I'm doing it now has the text file going into a staging table, then parsing it from there. It seems to me that parsing the text file as it comes in would make for a pretty serious speed increase. As the package I have in place now takes approx. seven hours to run (and over half of that importing/parsing/getting stuff to tables), any increase in speed would be very welcome...

thanks.

Source: http://www.livejournal.com/community/sqlserver/26295.html