Comment 2 for bug 1369039

Just updating with the extracts from the dtm log files from 451:

http://logs.trafodion.org/51/451/1/check/phoenix_quick-cdh4.4/df0a4ef/trafodion/core/sqf/sql/scripts/trafodion.dtm.log

Similar to 1361395 (also 1366204, 1353685)

====

2014-09-24 13:11:10,735 DEBUG dtm.HBaseTxClient: Enter prepareCommit, txid: 138
2014-09-24 13:11:10,737 WARN transactional.TransactionManager: Received IOException org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hbase.NotServingRegionException): org.apache.hadoop.hbase.NotServingRegionException: Region is not online: TRAFODION.PHOENIX.I,,1411564230755.6672ff0bf0a490e843cc9a6272635612.
 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3361)
 at org.apache.hadoop.hbase.regionserver.transactional.TransactionalRegionServer.getTransactionalRegion(TransactionalRegionServer.java:217)
 at org.apache.hadoop.hbase.regionserver.transactional.TransactionalRegionServer.commitRequest(TransactionalRegionServer.java:364)
 at sun.reflect.GeneratedMethodAccessor38.invoke(Unknown Source)
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:606)
 at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:320)
 at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1428)
 from commitRequest for transaction 138 rethrowing exception
2014-09-24 13:11:10,738 ERROR transactional.TransactionManager: exception in prepareCommit (during completion processing): java.util.concurrent.ExecutionException: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hbase.NotServingRegionException): org.apache.hadoop.hbase.NotServingRegionException: Region is not online: TRAFODION.PHOENIX.I,,1411564230755.6672ff0bf0a490e843cc9a6272635612.
 at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3361)
 at org.apache.hadoop.hbase.regionserver.transactional.TransactionalRegionServer.getTransactionalRegion(TransactionalRegionServer.java:217)
 at org.apache.hadoop.hbase.regionserver.transactional.TransactionalRegionServer.commitRequest(TransactionalRegionServer.java:364)
 at sun.reflect.GeneratedMethodAccessor38.invoke(Unknown Source)
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:606)
 at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:320)
 at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1428)

2014-09-24 13:11:10,738 ERROR dtm.HBaseTxClient: Returning from HBaseTxClient:prepareCommit, txid: 138 retval: 7 CommitUnsuccessfulException
2014-09-24 13:11:10,738 DEBUG dtm.HBaseTxClient: Enter abortTransaction, txid: 138
2014-09-24 13:11:10,738 DEBUG dtm.TmAuditTlog: table names: ,TRAFODION.PHOENIX.I,TRAFODION.PHOENIX.T
2014-09-24 13:11:10,738 DEBUG dtm.TmAuditTlog: key: -6917529027641081718, hex: a00000000000008a, transid: 138
2014-09-24 13:11:10,738 DEBUG dtm.TmAuditTlog: transid: 138 state: ABORTED ASN: 225
2014-09-24 13:11:10,738 DEBUG dtm.TmAuditTlog: TLOG putSingleRecord synchronizing tlogAuditLock[10] in thread 54
2014-09-24 13:11:10,740 DEBUG dtm.TmAuditTlog: try table.put {"totalColumns":1,"families":{"tf":[{"timestamp":9223372036854775807,"qualifier":"as","vlen":4154}]},"row":"\\xA0\\x00\\x00\\x00\\x00\\x00\\x00\\x8A"}
2014-09-24 13:11:10,740 DEBUG dtm.TmAuditTlog: TLOG putSingleRecord synchronization copmplete in thread 54