DevHeads.net

Cluster

Problem restoring mysqldump

Hello to all,

I'm having trouble returning a backup made by mysqldump into a two-node
cluster.
The dumpfile size is 177M and execute the command for its restoration
received the error "ERROR 1297 (HY000) at line 251: Got temporary error
1234 'REDO log files overloaded (Increase disk hardware)' from NDBCLUSTER."

The cluster contains two nodes each with two cores and Xeon 2.0Ghz 2Gb RAM
on a VMware Storage SATA disks in Raid 5.

Already changed NoOfFragmentLogFiles, RedoBuffer, LongMessageBuffer and
error persists.

Cluster configuration was made with the tool Severalnines.

connect to data node

Hi,

New to MySql Cluster - how can I connect to the data node to see what's on
there? I want to visually see the partitions data. Or can one query MySql
somehow so that it shows you from which data node each row originated?

Many thanks,
Serdyn du Toit

Possible to auto-restart ndbd after network disconnection ?

Hi,

Assume the following scenario:
-2 ndb nodes, and one management node each on separate machines.
-I unplug node 2: It detects that it cannot reach node 1 and tries to contact the management node.

Re:is there anyway to auto_extend a datafile?

here is my config.ini

[TCP DEFAULT]
SendBufferMemory=4M
ReceiveBufferMemory=4M

[NDB_MGMD DEFAULT]
PortNumber=1186
Datadir=/data/mysqlcluster/

[NDB_MGMD]
NodeId=1
Hostname=192.168.200.21
LogDestination=FILE:filename=ndb_1_cluster.log,maxsize=10000000,maxfiles=6
ArbitrationRank=0

[NDBD DEFAULT]
NoOfReplicas=2
ServerPort=2200
Datadir=/data/mysqlcluster/
FileSystemPathDD=/data/mysqlcluster/
BackupDataDir=/data/mysqlcluster/backup/
#FileSystemPathUndoFiles=/data/mysqlcluster/
#FileSystemPathDataFiles=/data/mysqlcluster/
DataMemory=4520M
IndexMemory=565M
LockPagesInMainMemory=1

MaxNoOfConcurren

is there anyway to auto_extend a datafile?

hi,

i am a newbie of mysql cluster.
i set up a cluter from "mysql-cluster-gpl-7.2.10-debian6.0-x86_64.deb"

here is the problem when i tested the 'disk data table'.
i dump a database named 'news' from my standard sqlserver,it only contained one table named 'news_cr_news' and its size is 2.4G
-rw-rw---- 1 mysql mysql 2.4G 2011-02-26 news_cr_news.MYD.
so i create a tablespace that contained two datafiles,one's size is 1G,the other 2G, and i thought that was enough.
when i loaded data into the cluster, i got an error as follow:
ERROR 1114 (HY000): The table

ERROR 1528 (HY000): Failed to create UNDOFILE

Hello,

I have mysqlcluster setup and when I try to run the following command:

create logfile group log_group add undofile 'log_group1.log'
initial_size=1073741824 undo_buffer_size=31457280 engine=ndbcluster;

It throws up this error:

*ERROR 1528 (HY000): Failed to create UNDOFILE *
*
*
and the warnings are:

-> ;
+---------+------+----------------------------------------------------------------------------+
| Level | Code | Message
|
+---------+------+----------------------------------------------------------------------------+
| Warning | 1296 | Got error 1509 'Fil

Threads_connected

Hello,

Is it possible to actually monitor number of connected clients on your
mysql cluster when you have cluster connection pooling enabled?

For example, in our case we have a MySQL Cluster node with 32 cores, which
we've allocated 30 to use ndb connection pooling. When running a mysqlslap
with a concurrency of, say, 60, I do not see that value show in
threads_connected. Nor, do I see it show processlist.

When I remove the ndb connection pooling, I accurately see the processlist
showing all connected clients.

ERROR 1005 (HY000): Can't create table 'user_database.user_table' (errno: 157)

Hello Guys,

I am trying to setup a mysql-cluster with two data nodes and one management
node.

The sequence of step I followed are:

Ran *'ndb_mgmd' *on management node
Ran '*ndbd --initial' *on both the data nodes
Ran '*mysqld' *on both the data nodes

Then the status of the cluster on management node is:

[ndbd(NDB)] 2 node(s)
id=2 @10.252.151. <http://10.252.151.67/>xx (Version: 5.1.68,
Nodegroup: 0, Master)
id=3 @10.253.4. <http://10.253.4.143/>xx (Version: 5.1.68,
Nodegroup: 0)

[ndb_mgmd(MGM)] 1 node(s)
id=1 @10.253.19.

can't find bzr repo for target mysql-cluster target 7.3.1

Hi,

After the bug #68224 that I've submitted, mysql developper Jonathan Stephens told me that I could get the bug fix by checking out the dev tree. Unfortunately:
-the provided link does not work
-I did find a bazaar repo, with branches for cluster-7.2 (not 7.3).
-Anyway all logs I found were older than the bug fix date (23/02/2013).

Anyone can help me on where I can find the development source tree ?
btw, any idea on when release 7.3.1 will be made available for download ?

Thanks !

Sébastien.

ndb_log_bin and sql_log_bin

Hello,

I am using NDB cluster and confused with two variables ndb_log_bin and
sql_log_bin.

I think both variables can be used to enable/disable the binlog when log_bin
is ON. But, what's difference?

If I want to pause binlog for a while, which one should I use?

Thanks

Alex

Surge 2013 CFP Open

The Surge 2013 CFP is open. For details or to submit a paper, please visit
<a href="http://surge.omniti.com/2013" title="http://surge.omniti.com/2013">http://surge.omniti.com/2013</a>

Re: Alternative to BLOBs in disk based tables.

Unfortunately there is no alternative to this yet with MySQL Cluster. I
believe there is work in progress to improve blob handling but I cannot
say whether this would help in your application. I would recommend
alternative methods such as storing the blobs as files on SAN/NFS and
the filenames for the blobs in the database. If you really need the
data to come via.

problem with one of our cluster servers

Hi

We have problem with one of our cluster servers,(501a/b), if 501a is active
, then 501b should be in passive state ,
if we have any fail over occurs in 501a it should automatically shifts to
501 b , the problem we are facing is their is fail over in 501a server , &
automatically the services has pointed to 501 b, everything is fine .
But when we are trying to connect to mysql on 501b server it is throwing an
error "Need to change mysql permissions", again on 501b server we are
changing the mysql permissions using chown -R , then we are able to connect
to msql on 501 b server .

My questi

Rows Read confusion

The documentation lists the exact same (unless I missed something) wording
for the status variables:

Ndb_api_read_row_count

and

Ndb_api_trans_local_read_row_count

What is the actual difference between these two? I do see a difference in
values returned.

Active/Passive MYSQLSQL Cluster, setup using Pacemaker with Corosync and DRBD.please share some more points here.

Hi All,

Article on Active/Passive MYSQLSQL Cluster, setup using Pacemaker with
Corosync and DRBD

Introduction:

We use two nodes, one active (that answers requests from apps) and the
other on passive mode.

Changes from Procedure Not Replicating?

Hi all,

I have a question about replication. We are not sure if this is a bug, but it certainly feels like it. Here is the simplified situation...

We have a larger database (~50GB) that is replicated to a second MySQL machine as a sort-of live backup. It has over 200 million daily transactions and we need to keep a live backup for disaster planning.

We have some other non-replicated databases on the Master MySQL machine for reporting, research work, etc...

binlog sizing

Hello,

I am using NDB 7.1.22 and binlog format is mixed.

So I wonder how to calculate the binlog writing speed (Mbytes/s) at a specific traffic.

Now I have two formula as below,
1) writing speed = row-data-size * throughput * ratio
ratio may be 1.2, 1.3, or 1.5
2) writing speed = (row-data-size + binlog-overhead) * throughput

which one is better?
do you know how to calculate RATIO or binlog-overhead?

Thanks

Alex

Binlog sizing

Hello,

I am using NDB 7.1.22 and binlog format is mixed.

So I wonder how to calculate the binlog writing speed (Mbytes/s) at a
specific traffic.

Now I have two formula as below,
1) writing speed = row-data-size * throughput * ratio
ratio may be 1.2, 1.3, or 1.5
2) writing speed = (row-data-size + binlog-overhead) * throughput

which one is better?
do you know how to calculate RATIO or binlog-overhead?

Thanks

Alex

MySQL Cluster Connection Pool

Hello,

I have a 2 Mgmt nodes, 4 data nodes, and 2 mysql servers. I have configured
the mysql servers to use 30 API node slots each (32 core).

The current limit of 255 total nodes (inclusive of mgmt, data, and api)
seems low. Am I wrong in my thinking, am I missing something here? All of
our load tests that have a concurrency of 60 or below (the sum of the api
nodes) runs fast! However, once we go over 60 concurrency, the performance
suffers exponentially.

binlog sizing

Hello,

I am using NDB 7.1.22 and binlog format is mixed.

So I wonder how to calculate the binlog writing speed (Mbytes/s) at a
specific traffic.

Now I have two formula as below,
1) writing speed = row-data-size * throughput * *ratio*
ratio may be 1.2, 1.3, or 1.5
2) writing speed = (row-data-size + *binlog-overhead*) * throughput

which one is better?
do you know how to calculate RATIO or binlog-overhead?

Thanks

Alex

Three node mysql cluster setup issues

Hi folks,

We are facing issues in setting up three node mysql cluster for high
availability.
We have set management server on one machine and the same machine has two
nodes running locally on them. The connection seems to be working fine
after following
the documentations in the following link
<http://downloads.mysql.com/tutorials/cluster/mysql_wp_cluster_quickstart_linux.pdf>.
Everything works like a charm.

But when we attach a third node which is another machine with a different
IP address.
We get into lot of issues.

Configuration for ndbd

Hi all.

I am new to MySQL Cluster, and I'm doing a basic installation in some VMs
with Debian 6 just to test if we actually want to migrate from MySQL Server
to Cluster. My doubt is related to Data nodes configuration.

RE: Problem Scan Operations (Read) in Parallel

Dear All,

I couldn't resolve the below mentioned problem so far, anyone could help me
with it?

Kind regards,

Mazen

Dear All,

I'm facing a problem when trying to perform NDB read scan operations in
parallel. The execution of the program is aborted, and one of the following
message gets printed:

. pollCompleted error 0

.

Alter table lack of RAM

Hello,

I have a NDB table called cdr which has 10M rows, roughly 20Gb. And, the
table cdr is partitioned by cdrYear.

Now, I want to change the partition by below command,
* alter table cdr partitioned by key(areaCode)*

It was said "When you do an alter table, a new copy of the table is created
and the
is copied to that table, which is later renamed to the original, and the
original table is removed."

That means, there would be two table in RAM when altering table.
The total RAM of my server is 30Gb.

VARCHAR column with Unique Index storage requirement in NDB engine

Dear All,

In MySQL Cluster (ndb engine) disk based table, if a column is varchar(255)
with UNIQUE INDEX defined then,

- For Latin(default) char set, does varchar column takes fixed
size?

- For UTF-8 (3 char wide), Does column takes Fixed
length[255*3+length] or variable chars taken care i.e., [Actual length of
data*3 + length]

I would really appreciate if someone can help me understand the behavior.

Thanks&Regards,

SYED

Problem Scan Operations (Read) in Parallel

Dear All,

I'm facing a problem when trying to perform NDB read scan operations in
parallel. The execution of the program is aborted, and one of the following
message gets printed:

. pollCompleted error 0

. pollCompleted error 2

However, the code is executed correctly when running the scan operations
sequentially (i.e. send/poll for only one operation at a time). I'm using
the async API (batching the send/poll). Any idea what might be the problem
here? I'd really appreciate your help.

Kind regards,
Mazen Abdulaziz

uneven data distribution, how to fix this?

Hi,

in a test system we have a very uneven data distribution:

ndb_mgm> all report memory;
Node 10: Data usage is 55%(66989 32K pages of total 120000)
Node 10: Index usage is 10%(6657 8K pages of total 64032)
Node 11: Data usage is 14%(17221 32K pages of total 120000)
Node 11: Index usage is 10%(6654 8K pages of total 64032)

This started when one datanode was offline for a week due to failing
hardware.

How can I find out, which tables are affected and how can I fix this?

I tried:
- alter table ... reorganize partition
- optimize table ...
with the largest tables.

NDB Hot backup

Dear All,

I have couple of doubts regarding NDB alone backup/Restore,

- Does online backup of NDB means Database "HOT Backup"?

- I found that MySQL Enterprise Backup does only "Warm backups" for
non-InnoDB engines; any tools which can do hot backups for NDB?

- Best practices or strategy to be followed for MySQL NDB only (not
InnoDB, MyISAM) "HOT backups".

Best Regards,

SYED

Cluster with logfile group restart node error

Dear Sir/Madam,

I am having trouble when restarting a node after I create a log file group.
The log file gets created with no errors.

<ADV> A bayfront lifestyle coming in Tampines

<ADV> A bayfront lifestyle coming in Tampinesif your page does not display correctly , click here
If you are not the intentended recieption of this email and do not wish to further recieved email in property related
please click here to unsubscribe from our database.
Like us on facebook

You are invited for a preview - Qbay @ Tampines
For more information you may contact us @ +65 81098866
Alternatively you may email to us @ <a href="mailto: ... at livingspace dot com.sg"> ... at livingspace dot com.sg</a>
<a href="http://www.livingspace.com.sg" title="www.livingspace.com.sg">www.livingspace.com.sg</a>

All information, specifications, rendering, visual representations and plans shown here are subject to changes
wi

Season Greetings

Season Greetings
To view our christmas greetings in youtube click here.
To follow us on facebook

Rowid already allocated

Hi,

What does it mean if a transaction fails with "rowid already allocated" ?

Should i just re-commit the transaction to try again ?

Memcached NDB

Hi,

I am trying to use Memcached API to set value to a NDB table having
composite primary key (col1+col2).

- Could anyone kindly guide me the correct syntax of using multi
column key in memcached_set_by_key() API.

- Memcached server crashes if caching policy set to CACHING, and a
GET operation is performed on NDB table. I think there is already a bug
posted, any plan to fix it soon.

- Any workaround for the above said crashing problem?

Thanks&Regards,

SYED

how Indexing in HDD hard disk in cluster ??

HI

Is to place indexing in HDD hard disk in cluster ????

SessionFactory retrieval

On my cluster its currently taking 20-25 seconds to get a SessionFactory
instance back from ClusterJHelper.getSessionFactory(props)

Is there anything I can do to make this faster ?

G.

A quick question about config.ini and ClusterJ

Do i have to declare an [api] entry in config.ini for every machine that i
want to be able to connect to the cluster with ClusterJ.

If i have multiple processes on each machine, does that mean i need one
entry per process ?

NDB API Order by with Limit

Hi,

I am currently using NDB API for developing some web application.

I faced a specific requirement where results from NDB Index scan have to be
ordered ascending on a specific column and limit results to a specific
value.

Is there any way to order by on specific column in NDB API?

Best Regards,

SYED

Cluster J scalability

When we're using JDBC to connect to MySQL cluster - we have to have
multiple query nodes to spread the load.

However, ClusterJ is configured by setting up a connect string. Currently I
have this pointing to my management node. How scaleable does this end up
being ? ie How much resource is the management node having to provide in
order for a query/insert/update etc ? Do i need to think about having
multiple SessionFactory's in my code to connect to different nodes to
spread the load ?

NDB API: PK Autoincrement

Hello there,

I'm currently implementing some application on top of NDB API, but I'm
facing a problem of incrementing the PK with an auto_increment attribute. Do
I have to read the last value then do the auto increment explicitly in the
code, or is there an easier way?

A simple example would be of great help.

Kind regards,

Mazen

Hello World. NDB API?

Hi there,

Is this the right mailing list to post questions about NDB API?

Kind regards,

Mazen

Problem with multithreading and ClusterJ

I'm trying to make my app multi-threaded and running into
problems.

I have a Session local to each thread that is attempting to write to the
db.

Help with ClusterJ

I have a stream of data that i'm trying to persist into a cluster using
ClusterJ and I'm running into problems.

For each ASCII record that i receive, I'm parsing into Java primitives then
setting the fields on a Java representation that i've gotten via
Session.newInstance()

what i would really like to do then is to call

session.savePersistent()

so that if the primary key already exists in the db the row gets updated,
and if the primary key doesnt exist a new row gets created.

Unfortunately, this doesnt work as I get an exception back if the primary
key already exists.

Is there a way arou

memcached big values save but return empty result

Hello!

I try set "big" value as memcaced client. I use prefix 'b:' and happy with
small value. And can save big value and can see its in `external_values`
table. But `get my_key` return empty result.

My actions:
1. In a begining empty tables:

mysql> SELECT * FROM ndbmemcache.demo_table_large;
Empty set (0.01 sec)

mysql> SELECT * FROM ndbmemcache.external_values;
Empty set (0.02 sec)

2.

FOSDEM 2013 CfP is open !

Hi everybody,

2013 is near… and so is the next FOSDEM edition !

This year again, MySQL will be represented by its Community.
If you want to discuss with friends of MySQL it's the place to be in
February !

Like every year, FOSDEM takes place the first week-end of February in
Brussels.

We will again have a room in the H building (100 seat).

Occasional Single Very Slow Response

I am working on a development system that uses a MySQL Cluster. There is very little activity on this system. Basically just development of a product. It seems that on occasion the cluster is very slow to respond and I haven't been able to find a reason for this. I have no idea if it is OS, DB or hardware related. Back on Wednesday I attempted to access the project and it took just over a minute for the page to respond. I know it is somehow connected to the cluster or the machines running on the cluster because another page on the same machine using a local database responded immediately.

Installation of SQL-Node - connection established & heartbeat not working

Hello everyone,

I've trouble with the Installation of the SQL-Node for my
SQL-Server-Cluster.
I'm a bit stuck and would appreciate any help =)

Somehow its not possible to keep the connection between SQL-Node and
Management-Server, although the systems are in the same local network,
no firewall between them or installed on them.

Management-Server Log:
2012-10-18 15:22:18 [MgmSrvr] ALERT -- Node 2: Node 4 Disconnected
2012-10-18 15:22:19 [MgmSrvr] ALERT -- Node 3: Node 4 Disconnected
2012-10-18 15:22:21 [MgmSrvr] INFO -- Node 3: Communication to Node
4 opened
2012-10-18 15:22:22

cluster 5.5.27-ndb-7.2.8 crash with signal 11 in ndb_binlog_thread_func

Hi,

after upgrading from version 7.1.18 to 7.2.8 we get regularly a crash in
all systems under the conditions described in bugreport #65979:

09:38:47 UTC - mysqld got signal 11 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured.

Brought to you by Training.com Asia - The Training Insider Issue 05 (SS)

oct_5Having trouble viewing this email? View it in your browser.

Find & Follow us on

Emotional Intelligence : The Cutting Edge. Transforming Businesses

Business leaders globally are recognizing emotional intelligence as a critical but untapped capability that can bring great transformations in the workplace.

Problem with memcached

Hello,

I try to configure memcached on my mysql cluster but i have an error.

Result of ndb_mgm -e show :
ndb_mgm -e show
Connected to Management Server at: 3.3.3.3:1186
Cluster Configuration
[ndb_mgmd(MGM)] 2 node(s)
id=1 @3.3.3.3 (mysql-5.5.22 ndb-7.2.6)
id=2 @4.4.4.4 (mysql-5.5.22 ndb-7.2.6)

[mysqld(API)] 14 node(s)
id=5 @2.2.2.2 (mysql-5.5.22 ndb-7.2.6)
id=6 @1.1.1.1 (mysql-5.5.22 ndb-7.2.6)
id=7 (not

cluster to non cluster replication issues ...

Hi ,

I recently re-started one of the data nodes of the production cluster to
which the slave (innodb) was pointing .
The node re-start almost took 3 hours . There was around 16 GB data in
whole . During this time ofcourse , the slave was lagging behind .
But after the re-start , the master has written two huge binlog files . The
slave was just lagging behind for almost 3 days , executing all the
statements
in these files . This was not happened before like this , though I
re-started the servers in order to free some memory earlier .

Why this is happening ?

Improve cluster performances in certain cases

Hello,

I have 4 data nodes on my cluster. NoOfReplica is set to 4.

I have SQL nodes on the same servers.

Is there a parameter to say "Connect to local data node if online" ? In =
my case, it would prevent a lot of useless networking and improve =
response times.

Thank you

Jerome

Re: Windows Cluster 7.2.7 Zip Download configdir issue

I believe that this is a warning related to the user being used to run the management node not having the privileges to edit the registry.

Windows Cluster 7.2.7 Installer Issue

This time I chose to use the installer and during the initial config
process I receive this error:

<a href="http://screencast.com/t/YPtgLiHpE" title="http://screencast.com/t/YPtgLiHpE">http://screencast.com/t/YPtgLiHpE</a>

So I then copied the my-template.ini over to the bin directory and renamed
it to my-template.cnf which allowed it to generate the my.ini file but on
the next step the service does not start giving the error:

The MySQL service failed to start due to the following error:

The system cannot find the path specified.

Here is the path to the executable:

"E:\mysqlcluster\bin\bin\mysqld"
--defaults-file="E:\mysqlcluster\bin\my.ini" MySQL that was auto

Windows Cluster 7.2.7 Zip Download configdir issue

Hello,

I downloaded cluster 7.2.7 zip archive.

I am following the quick start guide and I am up to this command:

E:/mysql-cluster-gpl-7.2.7-winx64/cluster/mysql/bin/ndb_mgmd -f
E:/mysql-cluster-gpl-7.2.7-winx64/cluster/conf/config.ini –-initial
–-configdir=E:/mysql-cluster-gpl-7.2.7-winx64/cluster/conf

When I run that command I am receiving this error:

Here is the text in case the image does not come through:

E:\mysql-cluster-gpl-7.2.7-winx64\cluster\mysql>E:/mysql-cluster-gpl-7.2.7-winx6

4/cluster/mysql/bin/ndb_mgmd -f
E:/mysql-cluster-gpl-7.2.7-winx64/cluster/conf/c

error starting data node

elo,

I am receiving error when trying to start the data node. The
configuration seems ok.
Kindly help.

*C:\mysql\bin>ndbd*
*Unable to connect with connect string: nodeid=10,172.17.3.66:1186*
*Retrying every 5
seconds.

InnoDB engine to NDB using parallel ALTER TABLE

I'm in the process of migrating my MySQL InnoDB database (~6 GB in
total) to an NDBCluster. I'm following this blog post[1] and I'm
stumbled into a problem while executing ALTER TABLE <table_name>
ENGINE=NDB commands in parallel.

I'm initiating an ALTER TABLE <table_name> ENGINE=NDB command for
every table in all of my databases in different sessions with a script
and I see this[2]. (I *dotted out* the names of my tables, but each
'...' represents a unique table name.

MySQL C API Insertion Doubt

Hi,

I'm writing a C code (using the mysql api) to select specific rows from
a database and insert them in another database in a different host. The
problem is that I didn't find any method to insert a row directly, What
I've noticed so far is that I have to construct a mysql statement
(Insert into bla bla bla..) based on the result of the query, and then
pass it to the mysql_query function to insert the row in the another
database. Is a easier way to do that?

Mysql Server not starting on datanode

Hi,
This is mysql-datanode error logs. I am not finding any solution. What could be the problem?
Basically I started ndbd  process,then I went to start mysql.server , But it gave error as  "MYSQL server pid could not be found!" 

120718 12:23:28 mysqld_safe Starting mysqld daemon with databases from /usr/local/mysql/data
120718 12:23:28 [Note] Plugin 'FEDERATED' is disabled.
/usr/local/mysql/bin/mysqld: Table 'mysql.plugin' doesn't exist
120718 12:23:28 [ERROR] Can't open the mysql.plugin table.

NDBD Start process

Hi,

I would like to know why sometimes the ndbd nodes take so longer to
start after a configuration change, here is what appears at the
ndb_x_out.log:

jbalock thr: 0 waiting for lock, contentions: 20 spins: 120
jbalock thr: 2 waiting for lock, contentions: 12 spins: 1271
jbalock thr: 2 waiting for lock, contentions: 13 spins: 1272
jbalock thr: 2 waiting for lock, contentions: 14 spins: 4331
jbalock thr: 2 waiting for lock, contentions: 15 spins: 4332
jbalock thr: 2 waiting for lock, contentions: 16 spins: 4333
jbalock thr: 2 waiting for lock, contentions: 17 spins: 4334
jbalock thr: 2 wait

Syndicate content