View Single Post

  #1 (permalink)  
Old 05-08-2008
Ted
 
Posts: n/a
Default How can I learn what lines, in a csv file, were skipped by a LOADDATA LOCAL INFILE?

I am working on a script to process a data feed and load it into a
MySQL DB. It mostly works, except that for almost 20,000 lines of
data, I get 25 lines of data skipped, and about 1,500 warnings. I
need to know first what those warnings are, and whether or not they
affected the data being loaded. Second, I need to know what lines
were skipped, and why.

If it matters, the table, and data file, has several dozen fields.

The nature of this data is sensitive and it is important that none of
the data is lost, or altered in a way that changes its meaning, during
this process.

So, how can I find out about all these warnings that came from a
single load statement, and how can I find out the details of what
lines were skipped?

Thanks

Ted
Reply With Quote