Reply to topic
Import file too big?
kirkdickinson


Joined: 08 Nov 2008
Posts: 2
Reply with quote
I am trying to import some file based database tables to mySQL. I exported each table to csv and have been importing them.

One table has 9000 records and 30 fields. The CSV is 2.6 MB

When I try to import it, I get this message:

No data was received to import. Either no file name was submitted, or the file size exceeded the maximum size permitted by your PHP configuration. See FAQ 1.16.

I looked in the FAQ and the first line says:
Starting with version 2.7.0, the import engine has been re–written and these problems should not occur. If possible, upgrade your phpMyAdmin to the latest version to take advantage of the new import features.

Looks like HMS is running 2.11.1, I assume that is newer than 2.7.0

There are some other things mentioned to try, some of them involve the host changing settings. I don't know if HMS will or not.

Any recomendations?

Thanks,

Kirk
darnold


Joined: 17 Mar 2005
Posts: 30
Reply with quote
PhpMyAdmin may not be the best way to import a data. While the application itself has been modified you still have the limitations of PHP on the hosting server. If you PM me your domain name I can look into requesting a small increase in the max_upload_size of PHP for you.

Imports can be done a few ways. MySql Gui Tools is free software that can assist you. Navicat is also very good program although it's about a hundred bucks.

You can also do this with load data [local] infile. See http://dev.mysql.com/doc/refman/5.0/en/load-data.html
tedjtw


Joined: 08 Feb 2005
Posts: 103
Location: Connecticut
Reply with quote
We import large record sets to HMS using third party tools.

Try using MyManager for MySQL (works with millions of records) or SQLYOG. Both have free and paid versions. I think the import functions are in the free.

Each month we append 20,000 + records. We import into a temporary table, then run an insert statement. In 3 years we have never had a failure. The database tables each have between 1 and 3 million records.

HTH
Josh
Forum Regular

Joined: 01 Apr 2004
Posts: 1047
Location: Felton, Delaware
Reply with quote
I'm gonna add a "**** yeah" to SQLYog. Been using it for years, and love it so much that I'm too good for the free version Wink I pay those wonderful developers, now.
tedjtw


Joined: 08 Feb 2005
Posts: 103
Location: Connecticut
Reply with quote
Josh,

If you like YOG give MySQL Manager a try http://sqlmanager.net/products/mysql/manager/

We use both paid versions but everyone here likes MyManager.

Ted
Josh
Forum Regular

Joined: 01 Apr 2004
Posts: 1047
Location: Felton, Delaware
Reply with quote
Will Do Smile Thanks
nathacof
Forum Admin

Joined: 24 Oct 2006
Posts: 192
Location: Dover, DE
Reply with quote
I'm a big fan of the MySQ GUI Tools. Free, and official. That's always good.

As for large imports I believe LOAD DATA INFILE is disabled on our shared servers due to security concerns. But if you have the MySQL client on your machine you can still import the data remotely.
Code:

$ mysql -u username -p -h server.example.com databasename < backup.sql
darnold


Joined: 17 Mar 2005
Posts: 30
Reply with quote
load data local infile should work the local key word means the file is local to the script (on the web server not the db server). This is a very efficient way to import from CSV file. I've used it on more than 20,000 rows without a hiccup several times.
nathacof
Forum Admin

Joined: 24 Oct 2006
Posts: 192
Location: Dover, DE
Reply with quote
Ah, now I see the optional [local] flag in your previous post. Silly me Smile
Import file too big?
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
All times are GMT  
Page 1 of 1  

  
  
 Reply to topic