MySql Import speed(Was mysql version OSX)

David Swain dataguru at polymath-bus-sys.com
Mon Dec 20 13:23:49 EST 2010


Mike,

Yes, I agree with Andy - IF what you have is a SQL script file rather than a true "import" file. Reading in and executing a SQL script is NOT the same as "importing data", although both will lead to adding data to your database (at least, if the script contains INSERT statements, among other things). Reading and executing a script will always be much slower than a true import.

If you have a comma- or tab-delimited file (a file that can actually be imported from), you can either use the mysqlimport command line tool or log into the mysql interactive command line client and issue a LOAD DATA INFILE command with appropriate parameters.

I can help you with any of these if you need.

(Sorry I wasn't here sooner - had to step out for a doctor appointment.)

Regards,
David

On Dec 20, 2010, at 1:06 PM, Andy Hilton wrote:

> Mike
> 
> yes the workbench gui import is pretty dreadful - switch to a command line interface and try something like :
> 
> mysql --user=root --password=mypassword mynewdbname < c:pathtomydumpfile.sql
> 
> That will go quite fast !
> 
> Andy
> 
> 
> On Dec 20, 2010, at 1:00 PM, Mike Matthews wrote:
> 
>> Hello Bruno,
>> 
>> Bang on the nail with that answer.  Quite why this error is in the installer, just beats me, but going now.  Now for part 2, always is a part 2 of course.  Sorry, but I know nothing of MySql, just Frontbase.
>> 
>> I want to import a customers current dump file, so I can look and see if I want to use the data and move it to our systems, so a speculative day so far.  The data is a huge 48.0 GB file, yup, quite big.  And it is a single file that came from a Linux box called a BigRedBox.  The company has gone kaput, hence my interest.
>> 
>> The import speed is very slow, how can I get it faster please?
>> 
>> I am using the Workbench GUI to import from a single file, I have turned off the log file by setting log-error=NONE, but painfully slow.  It seems to be making a single DB file again, how can I make it go faster, it will take about 3 days currently.
>> 
>> The throughput according to the Workbench is a poor 60kbs.
>> 
>> Thanks
>> 
>> Mike
>> 
>> 
>> 
>> Mike Matthews
>> Managing Director 
>> Lineal Software Solutions Ltd
>> 
>> Past Authorised Apple Reseller,  Omnis Business Partner
>> 
>> Tel: 01271 850 550 
>> 
>> Email: mike.matthews at lineal.co.uk
>> 
>> Web: www.lineal.co.uk
>> 
>> 
>> On 20 Dec 2010, at 14:11, Bruno Del Sol wrote:
>> 
>>> Hi Mike,
>>> 
>>> The "server won't start" issue is on all 5.5.x version on Mac os. There is a documented workaround which involves editing the mysql.server file, read this for instance :
>>> 
>>> http://www.rickwargo.com/2010/12/16/installing-mysql-5-5-on-os-x-10-6-snow-leopard-and-rails-3/
>>> 
>>> I'm not aware of any reason you shouldn't use the 64 bit version.
>>> 
>>> If you prefer to be more conservative, the latest 5.1.x should be fine also.
>>> 
>>> RegARDS
>>> BRUNO
>>> 
>>> By Design
>>> http://www.bydesign.fr
>>> Bruno Del Sol
>>> bruno.delsol at bydesign.fr
>>> tel (33) 01 48 78 47 37
>>> 46, rue de La Tour d'Auvergne
>>> 75009 Paris (France)
>>> 
>>> 
>>> Le 20/12/10 14:33, Mike Matthews a écrit :
>>>> Thanks David,
>>>> 
>>>> I have the 32 bit version installed today, but the sever won't start.  The conf file won't write or be created, that is why I asked about 32/64 bit.  Downloading the 64 bit version.....
>>>> 
>>>> I have also installed the Workbench app, but not installed any connectors.  Are these needed as well, if I am just using the WorkBench?
>>>> 
>>>> Thanks
>>>> 
>>>> Mike
>>>> 
>>>> 
>>>> 
>>>> 
>>>> On 20 Dec 2010, at 13:28, David Swain wrote:
>>>> 
>>>>> Hi Mike,
>>>>> 
>>>>> Version 5.5.8 has just been released as GA. It has significant performance enhancements over previous versions, among other things. I have not had a chance to test it with Omnis Studio yet as I was teaching a private MySQL bootcamp class (8am - 6pm each day) for a dozen sysadmins at eBay all last week, but hope to get to it before the year ends. I'm sure Mitford House has kept up with it, though.
>>>>> 
>>>>> Regards,
>>>>> 
>>>>> David
>>>>> 
>>>>> On Dec 20, 2010, at 8:16 AM, Mike Matthews wrote:
>>>>> 
>>>>>> Hello All,
>>>>>> 
>>>>>> Which version of MySql should I download please?
>>>>>> 
>>>>>> MacBook Pro, OSX 10.6.5 workstation
>>>>>> 
>>>>>> Thanks
>>>>>> 
>>>>>> Mike Matthews
>>>>>> Managing Director
>>>>>> Lineal Software Solutions Ltd
>>>>>> 
>>>>>> Past Authorised Apple Reseller,  Omnis Business Partner
>>>>>> 
>>>>>> Tel: 01271 850 550
>>>>>> 
>>>>>> Email: mike.matthews at lineal.co.uk
>>>>>> 
>>>>>> Web: www.lineal.co.uk
>>>>>> 
>>>>>> 
>>>>>> _____________________________________________________________
>>>>>> Manage your list subscriptions at http://lists.omnis-dev.com
>>>>> _____________________________________________________________
>>>>> Manage your list subscriptions at http://lists.omnis-dev.com
>>>> _____________________________________________________________
>>>> Manage your list subscriptions at http://lists.omnis-dev.com
>>>> 
>> 
>> _____________________________________________________________
>> Manage your list subscriptions at http://lists.omnis-dev.com
> 
> _____________________________________________________________
> Manage your list subscriptions at http://lists.omnis-dev.com




More information about the omnisdev-en mailing list