What would you consider as a large table?

Is 2.5 million rows (about 400 MB CSV file size, has 25 about columns
which probably average 10 characters per column) large? How long
would it take to import this file? I know it is 2.5 million rows
because I counted the rows (using unix's wc -l filename).

I tried importing it but gave up after it imported only 800K plus
records in about 24 hours using an Athlon 3200, lots of disk space
and, 2 GB's of memory.

Pete <johnsp@joand.com> wrote:
> Is 2.5 million rows (about 400 MB CSV file size, has 25 about columns
> which probably average 10 characters per column) large? How long
> would it take to import this file? I know it is 2.5 million rows
> because I counted the rows (using unix's wc -l filename).

This is not large. Ten times that size is largish. Hundred times that
size is large ;-)

> I tried importing it but gave up after it imported only 800K plus
> records in about 24 hours using an Athlon 3200, lots of disk space
> and, 2 GB's of memory.

Probably a misconfigured MySQL and/or wrong usage. The default MySQL
configuration uses only very little memory, so most of your shiny 2GB
of memory will be unused. One very common error is to bulk load data
into InnoDB table with AUTO_COMMIT turned on.

I suggest you read here first:
http://dev.mysql.com/doc/refman/5.0/...ert-speed.html

Then tune your my.cnf and try again. Since your data is CSV, I suggest
using LOAD DATA INFILE.


XL
--
Axel Schwenke, Support Engineer, MySQL AB

Online User Manual: http://dev.mysql.com/doc/refman/5.0/en/
MySQL User Forums: http://forums.mysql.com/