The second node fails as: ========================================================
2014-02-20 02:18:31 16336 [Note] WSREP: Synchronized with group, ready for connections 2014-02-20 02:18:31 16336 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2014-02-20 02:18:31 16336 [Note] /pxc56/bin/mysqld: ready for connections. Version: '5.6.15-25.3-log' socket: '/tmp/node1/node1/mysql.sock' port: 19301 Percona XtraDB Cluster (GPL) 5.6.15-25.3, Revision 723, wsrep_25.3.r723 2014-02-20 02:19:03 16336 [ERROR] Slave SQL: Could not execute Update_rows event on table test.table1_innodb_int_autoinc; Can't find record in 'table1_innodb_int_autoinc', Error_code: 1032; handler error HA_ERR_K EY_NOT_FOUND; the event's master log FIRST, end_log_pos 204, Error_code: 1032 2014-02-20 02:19:03 16336 [Warning] WSREP: RBR event 3 Update_rows apply warning: 120, 4092 2014-02-20 02:19:03 16336 [Warning] WSREP: Failed to apply app buffer: seqno: 4092, status: 1 at galera/src/trx_handle.cpp:apply():340 Retrying 2th time 2014-02-20 02:19:03 16336 [ERROR] Slave SQL: Could not execute Update_rows event on table test.table1_innodb_int_autoinc; Can't find record in 'table1_innodb_int_autoinc', Error_code: 1032; handler error HA_ERR_K EY_NOT_FOUND; the event's master log FIRST, end_log_pos 204, Error_code: 1032 2014-02-20 02:19:03 16336 [Warning] WSREP: RBR event 3 Update_rows apply warning: 120, 4092 2014-02-20 02:19:03 16336 [Warning] WSREP: Failed to apply app buffer: seqno: 4092, status: 1 at galera/src/trx_handle.cpp:apply():340 Retrying 3th time 2014-02-20 02:19:03 16336 [ERROR] Slave SQL: Could not execute Update_rows event on table test.table1_innodb_int_autoinc; Can't find record in 'table1_innodb_int_autoinc', Error_code: 1032; handler error HA_ERR_K EY_NOT_FOUND; the event's master log FIRST, end_log_pos 204, Error_code: 1032 2014-02-20 02:19:03 16336 [Warning] WSREP: RBR event 3 Update_rows apply warning: 120, 4092 2014-02-20 02:19:03 16336 [Warning] WSREP: Failed to apply app buffer: seqno: 4092, status: 1 at galera/src/trx_handle.cpp:apply():340 Retrying 4th time 2014-02-20 02:19:03 16336 [ERROR] Slave SQL: Could not execute Update_rows event on table test.table1_innodb_int_autoinc; Can't find record in 'table1_innodb_int_autoinc', Error_code: 1032; handler error HA_ERR_K EY_NOT_FOUND; the event's master log FIRST, end_log_pos 204, Error_code: 1032 2014-02-20 02:19:03 16336 [Warning] WSREP: RBR event 3 Update_rows apply warning: 120, 4092 2014-02-20 02:19:03 16336 [ERROR] WSREP: Failed to apply trx: source: 2d4b9ea9-99a7-11e3-94e6-3abed63932d9 version: 3 local: 0 state: APPLYING flags: 1 conn_id: 30 trx_id: 132887 seqnos (l: 4143, g: 4092, s: 4081 , d: 4075, ts: 199093692186419) 2014-02-20 02:19:03 16336 [ERROR] WSREP: Failed to apply trx 4092 4 times 2014-02-20 02:19:03 16336 [ERROR] WSREP: Node consistency compromized, aborting... 2014-02-20 02:19:03 16336 [Note] WSREP: Closing send monitor... 2014-02-20 02:19:03 16336 [Note] WSREP: Closed send monitor. 2014-02-20 02:19:03 16336 [Note] WSREP: gcomm: terminating thread 2014-02-20 02:19:03 16336 [Note] WSREP: gcomm: joining thread 2014-02-20 02:19:03 16336 [Note] WSREP: gcomm: closing backend 2014-02-20 02:19:04 16336 [Note] WSREP: view(view_id(NON_PRIM,2d4b9ea9-99a7-11e3-94e6-3abed63932d9,2) memb { 2d94558e-99a7-11e3-bea6-43718cd611a0,0 } joined { } left { } partitioned { 2d4b9ea9-99a7-11e3-94e6-3abed63932d9,0 }) 2014-02-20 02:19:04 16336 [Note] WSREP: view((empty)) 2014-02-20 02:19:04 16336 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1 2014-02-20 02:19:04 16336 [Note] WSREP: gcomm: closed 2014-02-20 02:19:04 16336 [Note] WSREP: Flow-control interval: [16, 16] 2014-02-20 02:19:04 16336 [Note] WSREP: Received NON-PRIMARY.
The second node fails as: ======= ======= ======= ======= ======= ======= =======
=======
2014-02-20 02:18:31 16336 [Note] WSREP: Synchronized with group, ready for connections node1/mysql. sock' port: 19301 Percona XtraDB Cluster (GPL) 5.6.15-25.3, Revision 723, wsrep_25.3.r723 innodb_ int_autoinc; Can't find record in 'table1_ innodb_ int_autoinc' , Error_code: 1032; handler error HA_ERR_K EY_NOT_FOUND; the event's master log FIRST, end_log_pos 204, Error_code: 1032 src/trx_ handle. cpp:apply( ):340 innodb_ int_autoinc; Can't find record in 'table1_ innodb_ int_autoinc' , Error_code: 1032; handler error HA_ERR_K EY_NOT_FOUND; the event's master log FIRST, end_log_pos 204, Error_code: 1032 src/trx_ handle. cpp:apply( ):340 innodb_ int_autoinc; Can't find record in 'table1_ innodb_ int_autoinc' , Error_code: 1032; handler error HA_ERR_K EY_NOT_FOUND; the event's master log FIRST, end_log_pos 204, Error_code: 1032 src/trx_ handle. cpp:apply( ):340 innodb_ int_autoinc; Can't find record in 'table1_ innodb_ int_autoinc' , Error_code: 1032; handler error HA_ERR_K EY_NOT_FOUND; the event's master log FIRST, end_log_pos 204, Error_code: 1032 99a7-11e3- 94e6-3abed63932 d9 version: 3 local: 0 state: APPLYING flags: 1 conn_id: 30 trx_id: 132887 seqnos (l: 4143, g: 4092, s: 4081 , d: 4075, ts: 199093692186419) id(NON_ PRIM,2d4b9ea9- 99a7-11e3- 94e6-3abed63932 d9,2) memb {
2d94558e- 99a7-11e3- bea6-43718cd611 a0,0
2d4b9ea9- 99a7-11e3- 94e6-3abed63932 d9,0
2014-02-20 02:18:31 16336 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2014-02-20 02:18:31 16336 [Note] /pxc56/bin/mysqld: ready for connections.
Version: '5.6.15-25.3-log' socket: '/tmp/node1/
2014-02-20 02:19:03 16336 [ERROR] Slave SQL: Could not execute Update_rows event on table test.table1_
2014-02-20 02:19:03 16336 [Warning] WSREP: RBR event 3 Update_rows apply warning: 120, 4092
2014-02-20 02:19:03 16336 [Warning] WSREP: Failed to apply app buffer: seqno: 4092, status: 1
at galera/
Retrying 2th time
2014-02-20 02:19:03 16336 [ERROR] Slave SQL: Could not execute Update_rows event on table test.table1_
2014-02-20 02:19:03 16336 [Warning] WSREP: RBR event 3 Update_rows apply warning: 120, 4092
2014-02-20 02:19:03 16336 [Warning] WSREP: Failed to apply app buffer: seqno: 4092, status: 1
at galera/
Retrying 3th time
2014-02-20 02:19:03 16336 [ERROR] Slave SQL: Could not execute Update_rows event on table test.table1_
2014-02-20 02:19:03 16336 [Warning] WSREP: RBR event 3 Update_rows apply warning: 120, 4092
2014-02-20 02:19:03 16336 [Warning] WSREP: Failed to apply app buffer: seqno: 4092, status: 1
at galera/
Retrying 4th time
2014-02-20 02:19:03 16336 [ERROR] Slave SQL: Could not execute Update_rows event on table test.table1_
2014-02-20 02:19:03 16336 [Warning] WSREP: RBR event 3 Update_rows apply warning: 120, 4092
2014-02-20 02:19:03 16336 [ERROR] WSREP: Failed to apply trx: source: 2d4b9ea9-
2014-02-20 02:19:03 16336 [ERROR] WSREP: Failed to apply trx 4092 4 times
2014-02-20 02:19:03 16336 [ERROR] WSREP: Node consistency compromized, aborting...
2014-02-20 02:19:03 16336 [Note] WSREP: Closing send monitor...
2014-02-20 02:19:03 16336 [Note] WSREP: Closed send monitor.
2014-02-20 02:19:03 16336 [Note] WSREP: gcomm: terminating thread
2014-02-20 02:19:03 16336 [Note] WSREP: gcomm: joining thread
2014-02-20 02:19:03 16336 [Note] WSREP: gcomm: closing backend
2014-02-20 02:19:04 16336 [Note] WSREP: view(view_
} joined {
} left {
} partitioned {
})
2014-02-20 02:19:04 16336 [Note] WSREP: view((empty))
2014-02-20 02:19:04 16336 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1
2014-02-20 02:19:04 16336 [Note] WSREP: gcomm: closed
2014-02-20 02:19:04 16336 [Note] WSREP: Flow-control interval: [16, 16]
2014-02-20 02:19:04 16336 [Note] WSREP: Received NON-PRIMARY.