there is error log from 2nd node
110928 18:39:06 [ERROR] Slave SQL: Could not execute Update_rows event on table test.DD; Can't find record in 'DD', Error_code: 1032; handler error HA_ERR_KEY_NOT_FOUND; the event's master log FIRST, end_log_pos 981, Error_code: 1032 110928 18:39:06 [Warning] WSREP: RBR event 2 apply warning: 120, 126062 110928 18:39:06 [ERROR] WSREP: Failed to apply trx: source: 608bc31a-ea21-11e0-0800-35fa1bfd4d40 version: 1 local: 0 state: CERTIFYING flags: 1 conn_id: 105 trx_id: 1136961 seqnos (l: 9097, g: 126062, s: 126061, d: 126055, ts: 1317249230968256296) 110928 18:39:06 [ERROR] WSREP: Failed to apply app buffer: Π�N , seqno: 126062, status: WSREP_FATAL at galera/src/replicator_smm.cpp:apply_data():77 at galera/src/replicator_smm.cpp:apply_trx_ws():184 110928 18:39:06 [ERROR] WSREP: Node consistency compromized, aborting... 110928 18:39:06 [Note] WSREP: Closing send monitor... 110928 18:39:06 [Note] WSREP: Closed send monitor. 110928 18:39:06 [Note] WSREP: gcomm: terminating thread 110928 18:39:06 [Note] WSREP: gcomm: joining thread 110928 18:39:06 [Note] WSREP: gcomm: closing backend 110928 18:39:06 [Note] WSREP: evs::proto(31bd488e-ea22-11e0-0800-a819c51eec43, LEAVING, view_id(REG,31bd488e-ea22-11e0-0800-a819c51eec43,2)) uuid 608bc31a-ea21-11e0-0800-35fa1bfd4d40 missing from install message, assuming partitioned 110928 18:39:06 [Note] WSREP: GMCast::handle_stable_view: view(view_id(NON_PRIM,31bd488e-ea22-11e0-0800-a819c51eec43,2) memb { 31bd488e-ea22-11e0-0800-a819c51eec43, } joined { } left { } partitioned { 608bc31a-ea21-11e0-0800-35fa1bfd4d40, }) 110928 18:39:06 [Note] WSREP: GMCast::handle_stable_view: view((empty)) 110928 18:39:06 [Note] WSREP: New COMPONENT: primary = no, my_idx = 0, memb_num = 1 110928 18:39:06 [Note] WSREP: gcomm: closed 110928 18:39:06 [Note] WSREP: Flow-control interval: [8, 16] 110928 18:39:06 [Note] WSREP: Received NON-PRIMARY. 110928 18:39:06 [Note] WSREP: Shifting SYNCED -> OPEN (TO: 126062) 110928 18:39:06 [Note] WSREP: Received self-leave message. 110928 18:39:06 [Note] WSREP: Flow-control interval: [0, 0] 110928 18:39:06 [Note] WSREP: Received SELF-LEAVE. Closing connection. 110928 18:39:06 [Note] WSREP: Shifting OPEN -> CLOSED (TO: 126062) 110928 18:39:06 [Note] WSREP: RECV thread exiting 0: Success 110928 18:39:06 [Note] WSREP: recv_thread() joined. 110928 18:39:06 [Note] WSREP: Closing slave action queue. 110928 18:39:06 [Note] WSREP: bin/mysqld: Terminated.
there is error log from 2nd node
110928 18:39:06 [ERROR] Slave SQL: Could not execute Update_rows event on table test.DD; Can't find record in 'DD', Error_code: 1032; handler error HA_ERR_ KEY_NOT_ FOUND; the event's master log FIRST, end_log_pos 981, Error_code: 1032 ea21-11e0- 0800-35fa1bfd4d 40 version: 1 local: 0 state: CERTIFYING flags: 1 conn_id: 105 trx_id: 1136961 seqnos (l: 9097, g: 126062, s: 126061, d: 126055, ts: 131724923096825 6296) src/replicator_ smm.cpp: apply_data( ):77 src/replicator_ smm.cpp: apply_trx_ ws():184 31bd488e- ea22-11e0- 0800-a819c51eec 43, LEAVING, view_id( REG,31bd488e- ea22-11e0- 0800-a819c51eec 43,2)) uuid 608bc31a- ea21-11e0- 0800-35fa1bfd4d 40 missing from install message, assuming partitioned :handle_ stable_ view: view(view_ id(NON_ PRIM,31bd488e- ea22-11e0- 0800-a819c51eec 43,2) memb {
31bd488e- ea22-11e0- 0800-a819c51eec 43,
608bc31a- ea21-11e0- 0800-35fa1bfd4d 40, :handle_ stable_ view: view((empty))
110928 18:39:06 [Warning] WSREP: RBR event 2 apply warning: 120, 126062
110928 18:39:06 [ERROR] WSREP: Failed to apply trx: source: 608bc31a-
110928 18:39:06 [ERROR] WSREP: Failed to apply app buffer: Π�N
, seqno: 126062, status: WSREP_FATAL
at galera/
at galera/
110928 18:39:06 [ERROR] WSREP: Node consistency compromized, aborting...
110928 18:39:06 [Note] WSREP: Closing send monitor...
110928 18:39:06 [Note] WSREP: Closed send monitor.
110928 18:39:06 [Note] WSREP: gcomm: terminating thread
110928 18:39:06 [Note] WSREP: gcomm: joining thread
110928 18:39:06 [Note] WSREP: gcomm: closing backend
110928 18:39:06 [Note] WSREP: evs::proto(
110928 18:39:06 [Note] WSREP: GMCast:
} joined {
} left {
} partitioned {
})
110928 18:39:06 [Note] WSREP: GMCast:
110928 18:39:06 [Note] WSREP: New COMPONENT: primary = no, my_idx = 0, memb_num = 1
110928 18:39:06 [Note] WSREP: gcomm: closed
110928 18:39:06 [Note] WSREP: Flow-control interval: [8, 16]
110928 18:39:06 [Note] WSREP: Received NON-PRIMARY.
110928 18:39:06 [Note] WSREP: Shifting SYNCED -> OPEN (TO: 126062)
110928 18:39:06 [Note] WSREP: Received self-leave message.
110928 18:39:06 [Note] WSREP: Flow-control interval: [0, 0]
110928 18:39:06 [Note] WSREP: Received SELF-LEAVE. Closing connection.
110928 18:39:06 [Note] WSREP: Shifting OPEN -> CLOSED (TO: 126062)
110928 18:39:06 [Note] WSREP: RECV thread exiting 0: Success
110928 18:39:06 [Note] WSREP: recv_thread() joined.
110928 18:39:06 [Note] WSREP: Closing slave action queue.
110928 18:39:06 [Note] WSREP: bin/mysqld: Terminated.