131

I'm attempting to copy my mysql database from an Amazon EC2 to an RDS:

I successfully did a mysqldump of my database into my root folder using this:

root@ip-xx-xx-xx-xx:~# mysqldump my_database -u my_username -p > my_database.sql

Then I tried to transfer this .sql file to my new RDS database:

root@ip-xx-xx-xx-xx:~# mysql my_database -u my_username -p -h  
my_new_database.xxxxxxxxx.us-east-1.rds.amazonaws.com < my_database.sql

Unfortunately, I get following error message:

You do not have the SUPER privilege and binary logging is enabled 
(you *might* want to use  the less safe log_bin_trust_function_creators variable)

I tried to GRANT SUPER.. in a variety of ways but I'm getting errors when I try to do that too. Typing mysql > FLUSH privileges; doesn't work either.

I'm a mysql beginner so sorry for such an easy question. Thoughts?

Joundill
  • 6,828
  • 12
  • 36
  • 50
tim peterson
  • 23,653
  • 59
  • 177
  • 299
  • 10
    You can't `GRANT SUPER` on RDS. RDS offers no way to get SUPER privileges. – ceejayoz Jul 22 '12 at 21:47
  • 1
    Use same MySQL username for creating dump and restoring it (For connection and DEFINER keyword in the dump). Changing log_bin_trust_function_creators is not the desired solution. The worst thing is to use -f parameter in this case – ad4s Jan 16 '17 at 11:51

9 Answers9

201
  1. Open the RDS web console.
  2. Open the “Parameter Groups” tab.
  3. Create a new Parameter Group. On the dialog, select the MySQL family compatible to your MySQL database version, give it a name and confirm. Select the just created Parameter Group and issue “Edit Parameters”.
  4. Look for the parameter log_bin_trust_function_creators and set its value to 1.
  5. Save the changes.
  6. Open the “Instances” tab. Expand your MySQL instance and issue the “Instance Action” named “Modify”.
  7. Select the just created Parameter Group and enable “Apply Immediately”.
  8. Click on “Continue” and confirm the changes.
  9. Wait for the "Modifying" operation to be completed.
  10. Again, open the “Instances” tab. Expand your MySQL instance and expand “Instance Action” tab and select "Reboot".

A reboot isn't necessary since log_bin_trust_function_creators has apply type = dynamic. At least this is true if your RDS already has an attached parameter group and you edit it, as opposed to creating a new parameter group. Merely save the parameter edit and you're good to go.

Machavity
  • 30,841
  • 27
  • 92
  • 100
arun-r
  • 3,104
  • 2
  • 22
  • 20
84

Per http://getasysadmin.com/2011/06/amazon-rds-super-privileges/, you need to set log_bin_trust_function_creators to 1 in AWS console, to load your dump file without errors.

If you want to ignore these errors, and load the rest of the dump file, you can use the -f option:

mysql -f my_database -u my_username -p -h  
my_new_database.xxxxxxxxx.us-east-1.rds.amazonaws.com < my_database.sql

The -f will report errors, but will continue processing the remainder of the dump file.

Ondrej Tokar
  • 4,898
  • 8
  • 53
  • 103
Ross Smith II
  • 11,799
  • 1
  • 38
  • 43
  • hi @Ross, thanks for this. Unfortunately, using `-f` didn't help. I got the same error. Using your link, i'm having trouble with the RDS Cli tools syntax. Meaning, when I go to change the privileges I get the following error: `rds-modify-db-parameter-group: Malformed input-Unrecognized option: -–parameters=name=log_bin_trust_function_creators, Usage: rds-modify-db-parameter-group DBParameterGroupName --parameters "name=value, value=value, method=value" [ --parameters "name=value, value=value, method=value" ...] [General Options] ` – tim peterson Jul 22 '12 at 22:17
  • here's my command that gives me the above error: `./rds-modify-db-parameter-group mygroup -–parameters "name=log_bin_trust_function_creators, value=on, method=immediate" –I="accesskeyxxxxxx" –S="secretkeyxxxxxxxx"` I know it has to be a quotation or double-dash issue i but none of those types of changes is working so far, ugh! – tim peterson Jul 22 '12 at 22:31
  • 4
    The `-f` option will not make the errors go away, it will just allow the non-offending SQL statements in the file to be processed. From what I've read, RDS is choking on stored procedures in the dump file. Try creating a dump file without store procedures and see if that loads OK: `mysqldump --routines=0 --triggers=0 --events=0 my_database -u my_username -p` – Ross Smith II Jul 22 '12 at 22:36
  • At least I can load all the data with the `-f` option. Second phase might be to dump only routines/stred proc, etc separately – Kaymaz Nov 29 '17 at 09:22
  • I have updated the parameter group of the Master node with log_bin_trust_function_creators = 1; I have run a ```sed -ie "s/DEFINER=\`a-z0-9A-Z*\`@\`a-z0-9A-Z*\`/DEFINER=CURRENT_USER /g" localsqlfile```; But I am still getting the same error of ```Access denied; you need (at least one of) the SUPER privilege(s) for this operation``` and ```Access denied for user 'username'@'%' to database 'mysql'``` when running with the -f command. – lft93ryt Nov 28 '18 at 12:24
34

The problem with triggers and stored procedures in the dump file is that these definitions include the user who the stored procedure should be created by, the DEFINER. The user most likely doesn't exist in the RDS so a error is then raised. To be able to load the dump file you can remove the DEFINER using sed or Perl and create the stored procedure/trigger with the user who is performing the import.

perl -pe 's/\sDEFINER=`[^`]+`@`[^`]+`//' < mysqldump.sql > mysqldump.fixed.sql

Now you should be able to load the fixed dump file

mysql my_database -u my_username -p -h rds_host < mysqldump.fixed.sql

As said in earlier answer, you should set the DB Parameter:

log_bin_trust_function_creators = 1
anders
  • 814
  • 7
  • 12
  • 1
    Cleaning up definers can also be accomplished with sed: sed -i 's/DEFINER=`OldDefiner`@`localhost`/DEFINER=`NewDefiner`@`localhost`/g' ./TargetSqlFile.sql – siliconrockstar Jun 24 '15 at 20:07
33

For me, there was only 2 commands in my dump file which required SUPER privileges:

  • SET @@GLOBAL.gtid_purged
  • SET @@SESSION.SQL_LOG_BIN

According to the mysqldump docs you can disable these with --set-gtid-purged=OFF.

Then looking at man mysqldump:

Use ON if the intention is to deploy a new replication slave using only some of the data from the dumped server. Use OFF if the intention is to repair a table by copying it within a topology. Use OFF if the intention is to copy a table between replication topologies that are disjoint and will remain so.

So I decided to add --set-gtid-purged=OFF to my mysqldump command and then I could successfully import the resulting dump file.

Yep_It's_Me
  • 4,494
  • 4
  • 43
  • 66
6

As defined in AWS documentation triggers, procedures, and functions are disabled by default because binary logging is enabled by default. Disabling basically makes your db more secure, but if you have properly secured through the network it won't matter.

Follow these steps and your problem will be fixed https://aws.amazon.com/premiumsupport/knowledge-center/rds-mysql-functions/

Also you shouldn't use definers when creating procedures. A simple sed command can remove it.

Josh Woodcock
  • 2,683
  • 1
  • 22
  • 29
5

In addition to editing

log_bin_trust_function_creators = 1

you need to remove all DEFINER from your dump file, check the following link for SED command that can help cleaning your sql dump file.

https://www.percona.com/blog/2014/07/02/using-mysql-triggers-and-views-in-amazon-rds/#comment-10968243

Jubba Smail
  • 1,201
  • 11
  • 15
4

To complete @arun-r's answer, a reboot is necessary when you create a new parameter group.

enter image description here

jeremy
  • 904
  • 7
  • 15
1

After used arun-r answer, if the problem is not solved you need to modify your dump file. It is simple.

In the dump file you will find lines like :

DELIMITER ;;
CREATE DEFINER=`username_from_dumped_database`@`host_from_dumped_database` PROCEDURE `procedure_or_function_name`()
BEGIN

You have to replace :

  • username_from_dumped_database by your username on rds database.
  • host_from_dumped_databse by %

I don't know why but this trick worked for me. A simple text editor is enough to do this.

1

The right way to set up a parameter in AWS/RDS is by creating a parameter group just like the other responses mentioned here.

For this particular case, set the variable log_bin_trust_function_creators to 1 in the parameters section when creating a new parameter group.

Modify your database, and then select your new parameter group at DB parameter group under the Additional configuration section.

Despite I enabled Apply Immediately, it didn't work for me (MySQL v8). It worked after rebooting!

etlapa
  • 31
  • 3