[Neo-report] NEO tests [master:2894-g5d7dc24:py2.6]: 631 Tests, 22 Errors, 17 Failures

neo-report at nexedi.com neo-report at nexedi.com
Tue Jan 3 16:10:26 CET 2012


Title                     : NEO tests [master:2894-g5d7dc24:py2.6]
Date                      : 2012-01-03
Node                      : blade1
Machine                   : x86_64
System                    : Linux
Python                    : 2.6.6

Directory                 : /tmp/neo_tests/1325602754.397125
Status                    : 93.819%
NEO_TEST_ZODB_FUNCTIONAL  : 1

                               NEO TESTS REPORT

              Test Module |   run   | success |  errors |  fails  |   time   
--------------------------+---------+---------+---------+---------+----------
                ClientApp |    23   |    23   |     .   |     .   |   1.04s   
           ConnectionPool |     5   |     5   |     .   |     .   |   1.00s   
            MasterHandler |    14   |    14   |     .   |     .   |   0.01s   
           StorageHandler |    14   |    14   |     .   |     .   |   0.01s   
--------------------------+---------+---------+---------+---------+----------
         neo.tests.client |         |         |         |         |          
--------------------------+---------+---------+---------+---------+----------
                   Client |    10   |     9   |     1   |     .   |  17.00s   
                  Cluster |     6   |     5   |     1   |     1   |  65.24s   
                   Master |     4   |     .   |     4   |     .   | 122.09s   
                  Storage |    15   |     2   |    13   |    13   | 790.62s   
--------------------------+---------+---------+---------+---------+----------
     neo.tests.functional |         |         |         |         |          
--------------------------+---------+---------+---------+---------+----------
            ClientHandler |     6   |     6   |     .   |     .   |   0.01s   
          ElectionHandler |    21   |    21   |     .   |     .   |   0.04s   
                MasterApp |     2   |     2   |     .   |     .   |   0.00s   
                 MasterPT |     7   |     7   |     .   |     .   |   0.01s   
                 Recovery |     3   |     3   |     .   |     .   |   0.03s   
           StorageHandler |     8   |     8   |     .   |     .   |   0.07s   
             Transactions |     9   |     9   |     .   |     .   |   0.01s   
             Verification |     6   |     6   |     .   |     .   |   0.01s   
--------------------------+---------+---------+---------+---------+----------
         neo.tests.master |         |         |         |         |          
--------------------------+---------+---------+---------+---------+----------
            ClientHandler |    18   |    18   |     .   |     .   |   0.14s   
    IdentificationHandler |     3   |     3   |     .   |     .   |   0.01s   
    InitializationHandler |     2   |     2   |     .   |     .   |   0.02s   
            MasterHandler |    11   |    11   |     .   |     .   |   0.08s   
              Replication |    10   |    10   |     .   |     .   |   2.64s   
       ReplicationHandler |    21   |    21   |     .   |     .   |   0.02s   
               Replicator |     7   |     7   |     .   |     .   |   0.00s   
               StorageApp |     3   |     3   |     .   |     .   |   0.02s   
             StorageBTree |    24   |    24   |     .   |     .   |   0.01s   
           StorageHandler |     9   |     9   |     .   |     .   |   0.07s   
           StorageMySQLdb |    32   |    32   |     .   |     .   |   0.27s   
             Transactions |    19   |    19   |     .   |     .   |   0.02s   
      VerificationHandler |    11   |    11   |     .   |     .   |   0.11s   
--------------------------+---------+---------+---------+---------+----------
        neo.tests.storage |         |         |         |         |          
--------------------------+---------+---------+---------+---------+----------
                Bootstrap |     2   |     2   |     .   |     .   |   0.03s   
               Connection |    75   |    75   |     .   |     .   |   0.09s   
               Dispatcher |     5   |     5   |     .   |     .   |   0.00s   
                    Event |     1   |     1   |     .   |     .   |   0.00s   
                  Handler |     1   |     1   |     .   |     .   |   0.00s   
                    Nodes |    14   |    14   |     .   |     .   |   0.01s   
                       PT |    11   |    11   |     .   |     .   |   0.01s   
                 Protocol |    87   |    87   |     .   |     .   |   0.02s   
                     Util |     4   |     4   |     .   |     .   |   0.00s   
--------------------------+---------+---------+---------+---------+----------
                neo.tests |         |         |         |         |          
--------------------------+---------+---------+---------+---------+----------
                          |    14   |    11   |     3   |     .   |   2.19s   
--------------------------+---------+---------+---------+---------+----------
       neo.tests.threaded |         |         |         |         |          
--------------------------+---------+---------+---------+---------+----------
                    Basic |    16   |    16   |     .   |     .   |  12.61s   
                 Conflict |     5   |     5   |     .   |     .   |   3.86s   
                  History |     1   |     1   |     .   |     .   |   0.80s   
                 Iterator |     9   |     9   |     .   |     .   |   7.05s   
                       MT |     5   |     5   |     .   |     .   |   7.08s   
                     Pack |    14   |    12   |     .   |     2   |  16.37s   
               Persistent |     1   |     1   |     .   |     .   |   0.80s   
                 ReadOnly |     2   |     2   |     .   |     .   |   1.58s   
                 Revision |     7   |     7   |     .   |     .   |   6.76s   
          Synchronization |     7   |     7   |     .   |     .   |   5.24s   
                     Undo |    17   |    16   |     .   |     1   |  15.66s   
                     ZODB |    10   |    10   |     .   |     .   |   8.75s   
--------------------------+---------+---------+---------+---------+----------
           neo.tests.zodb |         |         |         |         |          
--------------------------+---------+---------+---------+---------+----------
                  Summary |   631   |   606   |    22   |    17   | 1089.52s   
--------------------------+---------+---------+---------+---------+----------



ERRORS:
neo.tests.threaded.test.Test.testDeadlockAvoidance
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/threaded/test.py", line 225, in testDeadlockAvoidance
    self.assertEqual(self._testDeadlockAvoidance([1, 3]),
  File "/home/neo/master/neoppod/neo/tests/threaded/test.py", line 199, in _testDeadlockAvoidance
    t.join()
  File "/home/neo/master/neoppod/neo/tests/threaded/__init__.py", line 664, in run
    apply(*self.__target)
  File "/home/neo/master/py2.6/eggs/transaction-1.2.0-py2.6.egg/transaction/_manager.py", line 89, in commit
    return self.get().commit()
  File "/home/neo/master/py2.6/eggs/transaction-1.2.0-py2.6.egg/transaction/_transaction.py", line 342, in commit
    reraise(t, v, tb)
  File "/home/neo/master/py2.6/eggs/transaction-1.2.0-py2.6.egg/transaction/_transaction.py", line 333, in commit
    self._commitResources()
  File "/home/neo/master/py2.6/eggs/transaction-1.2.0-py2.6.egg/transaction/_transaction.py", line 473, in _commitResources
    reraise(t, v, tb)
  File "/home/neo/master/py2.6/eggs/transaction-1.2.0-py2.6.egg/transaction/_transaction.py", line 450, in _commitResources
    rm.tpc_vote(self)
  File "/home/neo/master/py2.6/src/ZODB3/src/ZODB/Connection.py", line 777, in tpc_vote
    s = vote(transaction)
  File "/home/neo/master/neoppod/neo/client/Storage.py", line 34, in wrapped
    return func(self, *args, **kw)
  File "/home/neo/master/neoppod/neo/client/Storage.py", line 127, in tpc_vote
    tryToResolveConflict=self.tryToResolveConflict)
  File "/home/neo/master/neoppod/neo/client/app.py", line 699, in tpc_vote
    result = self.waitStoreResponses(txn_context, tryToResolveConflict)
  File "/home/neo/master/neoppod/neo/client/app.py", line 678, in waitStoreResponses
    tryToResolveConflict)
  File "/home/neo/master/neoppod/neo/client/app.py", line 647, in _handleConflicts
    serial), data=data)
ConflictError: database conflict error (oid 0x01, class neo.tests.threaded.test.PCounterWithResolution, serial this txn started with 0x039386c3598f3355 2012-01-03 14:59:20.990479, serial currently committed 0x03 1900-01-01 00:00:00.000000)
-------------------------------------------------------------

neo.tests.threaded.test.Test.testStorageReconnectDuringTransactionLog
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/threaded/test.py", line 374, in testStorageReconnectDuringTransactionLog
    ZERO_TID, c.root()._p_serial, 10)
  File "/home/neo/master/neoppod/neo/client/app.py", line 959, in transactionLog
    conn = self.cp.getConnForNode(node)
  File "/home/neo/master/neoppod/neo/client/pool.py", line 165, in getConnForNode
    conn = self._initNodeConnection(node)
  File "/home/neo/master/neoppod/neo/client/pool.py", line 69, in _initNodeConnection
    app._ask(conn, p, handler=app.storage_bootstrap_handler)
  File "/home/neo/master/neoppod/neo/client/app.py", line 240, in _ask
    _handlePacket(qconn, qpacket)
  File "/home/neo/master/neoppod/neo/client/app.py", line 177, in _handlePacket
    handler.dispatch(conn, packet)
  File "/home/neo/master/neoppod/neo/lib/handler.py", line 55, in dispatch
    method(conn, *args)
  File "/home/neo/master/neoppod/neo/client/handlers/storage.py", line 106, in answerTIDsFrom
    assert not tids_from.intersection(set(tid_list))
AttributeError: 'NoneType' object has no attribute 'intersection'
-------------------------------------------------------------

neo.tests.threaded.test.Test.testStorageReconnectDuringUndoLog
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/threaded/test.py", line 385, in testStorageReconnectDuringUndoLog
    t1, = cluster.client.undoLog(0, 10)
  File "/home/neo/master/neoppod/neo/client/app.py", line 920, in undoLog
    conn = self.cp.getConnForNode(storage_node)
  File "/home/neo/master/neoppod/neo/client/pool.py", line 165, in getConnForNode
    conn = self._initNodeConnection(node)
  File "/home/neo/master/neoppod/neo/client/pool.py", line 69, in _initNodeConnection
    app._ask(conn, p, handler=app.storage_bootstrap_handler)
  File "/home/neo/master/neoppod/neo/client/app.py", line 240, in _ask
    _handlePacket(qconn, qpacket)
  File "/home/neo/master/neoppod/neo/client/app.py", line 177, in _handlePacket
    handler.dispatch(conn, packet)
  File "/home/neo/master/neoppod/neo/lib/handler.py", line 55, in dispatch
    method(conn, *args)
  File "/home/neo/master/neoppod/neo/client/handlers/storage.py", line 138, in answerTIDs
    self.app.getHandlerData().update(tid_list)
AttributeError: 'NoneType' object has no attribute 'update'
-------------------------------------------------------------

neo.tests.functional.testMaster.MasterTests.testMasterSequentialStart
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testMaster.py", line 32, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 344, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 339, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testMaster.MasterTests.testStoppingPrimaryWithOneSecondary
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testMaster.py", line 32, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 344, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 339, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testMaster.MasterTests.testStoppingPrimaryWithTwoSecondaries
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testMaster.py", line 32, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 344, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 339, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testMaster.MasterTests.testStoppingSecondaryMaster
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testMaster.py", line 32, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 344, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 339, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testClient.ClientTests.testExportFileStorageBug
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testClient.py", line 228, in testExportFileStorageBug
    self.testExport(True)
  File "/home/neo/master/neoppod/neo/tests/functional/testClient.py", line 224, in testExport
    self.__checkTree(root['trees'])
  File "/home/neo/master/neoppod/neo/tests/functional/testClient.py", line 165, in __checkTree
    self.__checkTree(tree.right, depth)
  File "/home/neo/master/neoppod/neo/tests/functional/testClient.py", line 166, in __checkTree
    self.__checkTree(tree.left, depth)
AttributeError: 'Tree' object has no attribute 'left'
-------------------------------------------------------------

neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testCluster.py", line 32, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 379, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neostorage' {'--cluster': 'neo_31', '--adapter': 'MySQL', '--bind': '127.0.0.1:0', '--database': 'test:@test_neo1', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/storage_0.log', '--name': 'storage_0', '--uuid': '328a6a231409c5b63b3d55c90d30f7d1', '--masters': '127.0.0.1:21466/127.0.0.1:32665/127.0.0.1:17208/127.0.0.1:17388/127.0.0.1:20158/127.0.0.1:29877/127.0.0.1:24982/127.0.0.1:28282/127.0.0.1:25103/127.0.0.1:23360/127.0.0.1:28668/127.0.0.1:20178/127.0.0.1:27373/127.0.0.1:23600/127.0.0.1:30526/127.0.0.1:19333/127.0.0.1:19047/127.0.0.1:17513/127.0.0.1:27446/127.0.0.1:23971'} exited with status 1
'neostorage' {'--cluster': 'neo_31', '--adapter': 'MySQL', '--bind': '127.0.0.1:0', '--database': 'test:@test_neo2', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/storage_1.log', '--name': 'storage_1', '--uuid': '181922420d9eda2c59118ab85cfb4519', '--masters': '127.0.0.1:21466/127.0.0.1:32665/127.0.0.1:17208/127.0.0.1:17388/127.0.0.1:20158/127.0.0.1:29877/127.0.0.1:24982/127.0.0.1:28282/127.0.0.1:25103/127.0.0.1:23360/127.0.0.1:28668/127.0.0.1:20178/127.0.0.1:27373/127.0.0.1:23600/127.0.0.1:30526/127.0.0.1:19333/127.0.0.1:19047/127.0.0.1:17513/127.0.0.1:27446/127.0.0.1:23971'} exited with status 1
'neomaster' {'--cluster': 'neo_31', '--bind': '127.0.0.1:21466', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_0.log', '--name': 'master_0', '--partitions': 10, '--uuid': '04abe1ada23eaf0bc61f25e5b7d3cdcf', '--masters': '127.0.0.1:21466/127.0.0.1:32665/127.0.0.1:17208/127.0.0.1:17388/127.0.0.1:20158/127.0.0.1:29877/127.0.0.1:24982/127.0.0.1:28282/127.0.0.1:25103/127.0.0.1:23360/127.0.0.1:28668/127.0.0.1:20178/127.0.0.1:27373/127.0.0.1:23600/127.0.0.1:30526/127.0.0.1:19333/127.0.0.1:19047/127.0.0.1:17513/127.0.0.1:27446/127.0.0.1:23971', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_31', '--bind': '127.0.0.1:32665', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_1.log', '--name': 'master_1', '--partitions': 10, '--uuid': '9c3d9b802e3ca7448b33bed3fc323665', '--masters': '127.0.0.1:21466/127.0.0.1:32665/127.0.0.1:17208/127.0.0.1:17388/127.0.0.1:20158/127.0.0.1:29877/127.0.0.1:24982/127.0.0.1:28282/127.0.0.1:25103/127.0.0.1:23360/127.0.0.1:28668/127.0.0.1:20178/127.0.0.1:27373/127.0.0.1:23600/127.0.0.1:30526/127.0.0.1:19333/127.0.0.1:19047/127.0.0.1:17513/127.0.0.1:27446/127.0.0.1:23971', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_31', '--bind': '127.0.0.1:17208', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_2.log', '--name': 'master_2', '--partitions': 10, '--uuid': '779cecf48138f9d4cc863638ccd9a950', '--masters': '127.0.0.1:21466/127.0.0.1:32665/127.0.0.1:17208/127.0.0.1:17388/127.0.0.1:20158/127.0.0.1:29877/127.0.0.1:24982/127.0.0.1:28282/127.0.0.1:25103/127.0.0.1:23360/127.0.0.1:28668/127.0.0.1:20178/127.0.0.1:27373/127.0.0.1:23600/127.0.0.1:30526/127.0.0.1:19333/127.0.0.1:19047/127.0.0.1:17513/127.0.0.1:27446/127.0.0.1:23971', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_31', '--bind': '127.0.0.1:17388', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_3.log', '--name': 'master_3', '--partitions': 10, '--uuid': 'b0ceceab128ee2bcff8f378f64793abb', '--masters': '127.0.0.1:21466/127.0.0.1:32665/127.0.0.1:17208/127.0.0.1:17388/127.0.0.1:20158/127.0.0.1:29877/127.0.0.1:24982/127.0.0.1:28282/127.0.0.1:25103/127.0.0.1:23360/127.0.0.1:28668/127.0.0.1:20178/127.0.0.1:27373/127.0.0.1:23600/127.0.0.1:30526/127.0.0.1:19333/127.0.0.1:19047/127.0.0.1:17513/127.0.0.1:27446/127.0.0.1:23971', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_31', '--bind': '127.0.0.1:20158', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_4.log', '--name': 'master_4', '--partitions': 10, '--uuid': 'b7d1a75b4731da1f8ec18d2677b38da5', '--masters': '127.0.0.1:21466/127.0.0.1:32665/127.0.0.1:17208/127.0.0.1:17388/127.0.0.1:20158/127.0.0.1:29877/127.0.0.1:24982/127.0.0.1:28282/127.0.0.1:25103/127.0.0.1:23360/127.0.0.1:28668/127.0.0.1:20178/127.0.0.1:27373/127.0.0.1:23600/127.0.0.1:30526/127.0.0.1:19333/127.0.0.1:19047/127.0.0.1:17513/127.0.0.1:27446/127.0.0.1:23971', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_31', '--bind': '127.0.0.1:29877', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_5.log', '--name': 'master_5', '--partitions': 10, '--uuid': 'c8aed785cde97bd531d34fd8dae9af9d', '--masters': '127.0.0.1:21466/127.0.0.1:32665/127.0.0.1:17208/127.0.0.1:17388/127.0.0.1:20158/127.0.0.1:29877/127.0.0.1:24982/127.0.0.1:28282/127.0.0.1:25103/127.0.0.1:23360/127.0.0.1:28668/127.0.0.1:20178/127.0.0.1:27373/127.0.0.1:23600/127.0.0.1:30526/127.0.0.1:19333/127.0.0.1:19047/127.0.0.1:17513/127.0.0.1:27446/127.0.0.1:23971', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_31', '--bind': '127.0.0.1:24982', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_6.log', '--name': 'master_6', '--partitions': 10, '--uuid': 'c048c07c8370070b04279ce65b31a35c', '--masters': '127.0.0.1:21466/127.0.0.1:32665/127.0.0.1:17208/127.0.0.1:17388/127.0.0.1:20158/127.0.0.1:29877/127.0.0.1:24982/127.0.0.1:28282/127.0.0.1:25103/127.0.0.1:23360/127.0.0.1:28668/127.0.0.1:20178/127.0.0.1:27373/127.0.0.1:23600/127.0.0.1:30526/127.0.0.1:19333/127.0.0.1:19047/127.0.0.1:17513/127.0.0.1:27446/127.0.0.1:23971', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_31', '--bind': '127.0.0.1:28282', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_7.log', '--name': 'master_7', '--partitions': 10, '--uuid': 'b274297b197be35a9b0c6ecca16563a0', '--masters': '127.0.0.1:21466/127.0.0.1:32665/127.0.0.1:17208/127.0.0.1:17388/127.0.0.1:20158/127.0.0.1:29877/127.0.0.1:24982/127.0.0.1:28282/127.0.0.1:25103/127.0.0.1:23360/127.0.0.1:28668/127.0.0.1:20178/127.0.0.1:27373/127.0.0.1:23600/127.0.0.1:30526/127.0.0.1:19333/127.0.0.1:19047/127.0.0.1:17513/127.0.0.1:27446/127.0.0.1:23971', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_31', '--bind': '127.0.0.1:25103', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_8.log', '--name': 'master_8', '--partitions': 10, '--uuid': '15d98a73dc635ba6c4ffae38cf9b0725', '--masters': '127.0.0.1:21466/127.0.0.1:32665/127.0.0.1:17208/127.0.0.1:17388/127.0.0.1:20158/127.0.0.1:29877/127.0.0.1:24982/127.0.0.1:28282/127.0.0.1:25103/127.0.0.1:23360/127.0.0.1:28668/127.0.0.1:20178/127.0.0.1:27373/127.0.0.1:23600/127.0.0.1:30526/127.0.0.1:19333/127.0.0.1:19047/127.0.0.1:17513/127.0.0.1:27446/127.0.0.1:23971', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_31', '--bind': '127.0.0.1:23360', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_9.log', '--name': 'master_9', '--partitions': 10, '--uuid': 'db2fd751be37806e546fd4ce0c8ebde2', '--masters': '127.0.0.1:21466/127.0.0.1:32665/127.0.0.1:17208/127.0.0.1:17388/127.0.0.1:20158/127.0.0.1:29877/127.0.0.1:24982/127.0.0.1:28282/127.0.0.1:25103/127.0.0.1:23360/127.0.0.1:28668/127.0.0.1:20178/127.0.0.1:27373/127.0.0.1:23600/127.0.0.1:30526/127.0.0.1:19333/127.0.0.1:19047/127.0.0.1:17513/127.0.0.1:27446/127.0.0.1:23971', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_31', '--bind': '127.0.0.1:28668', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_10.log', '--name': 'master_10', '--partitions': 10, '--uuid': '887517f2ac5f73488d474fa9a1653b32', '--masters': '127.0.0.1:21466/127.0.0.1:32665/127.0.0.1:17208/127.0.0.1:17388/127.0.0.1:20158/127.0.0.1:29877/127.0.0.1:24982/127.0.0.1:28282/127.0.0.1:25103/127.0.0.1:23360/127.0.0.1:28668/127.0.0.1:20178/127.0.0.1:27373/127.0.0.1:23600/127.0.0.1:30526/127.0.0.1:19333/127.0.0.1:19047/127.0.0.1:17513/127.0.0.1:27446/127.0.0.1:23971', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_31', '--bind': '127.0.0.1:20178', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_11.log', '--name': 'master_11', '--partitions': 10, '--uuid': '7f22e51cf03d72b4d26692c4ad92fba7', '--masters': '127.0.0.1:21466/127.0.0.1:32665/127.0.0.1:17208/127.0.0.1:17388/127.0.0.1:20158/127.0.0.1:29877/127.0.0.1:24982/127.0.0.1:28282/127.0.0.1:25103/127.0.0.1:23360/127.0.0.1:28668/127.0.0.1:20178/127.0.0.1:27373/127.0.0.1:23600/127.0.0.1:30526/127.0.0.1:19333/127.0.0.1:19047/127.0.0.1:17513/127.0.0.1:27446/127.0.0.1:23971', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_31', '--bind': '127.0.0.1:27373', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_12.log', '--name': 'master_12', '--partitions': 10, '--uuid': '86791f7e32f1fbead546b88b29cc1019', '--masters': '127.0.0.1:21466/127.0.0.1:32665/127.0.0.1:17208/127.0.0.1:17388/127.0.0.1:20158/127.0.0.1:29877/127.0.0.1:24982/127.0.0.1:28282/127.0.0.1:25103/127.0.0.1:23360/127.0.0.1:28668/127.0.0.1:20178/127.0.0.1:27373/127.0.0.1:23600/127.0.0.1:30526/127.0.0.1:19333/127.0.0.1:19047/127.0.0.1:17513/127.0.0.1:27446/127.0.0.1:23971', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_31', '--bind': '127.0.0.1:23600', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_13.log', '--name': 'master_13', '--partitions': 10, '--uuid': '486c88a6502210882ec8b091d5df5279', '--masters': '127.0.0.1:21466/127.0.0.1:32665/127.0.0.1:17208/127.0.0.1:17388/127.0.0.1:20158/127.0.0.1:29877/127.0.0.1:24982/127.0.0.1:28282/127.0.0.1:25103/127.0.0.1:23360/127.0.0.1:28668/127.0.0.1:20178/127.0.0.1:27373/127.0.0.1:23600/127.0.0.1:30526/127.0.0.1:19333/127.0.0.1:19047/127.0.0.1:17513/127.0.0.1:27446/127.0.0.1:23971', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_31', '--bind': '127.0.0.1:30526', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_14.log', '--name': 'master_14', '--partitions': 10, '--uuid': 'ccf9cd969ad18a9ef7258ce0839911e1', '--masters': '127.0.0.1:21466/127.0.0.1:32665/127.0.0.1:17208/127.0.0.1:17388/127.0.0.1:20158/127.0.0.1:29877/127.0.0.1:24982/127.0.0.1:28282/127.0.0.1:25103/127.0.0.1:23360/127.0.0.1:28668/127.0.0.1:20178/127.0.0.1:27373/127.0.0.1:23600/127.0.0.1:30526/127.0.0.1:19333/127.0.0.1:19047/127.0.0.1:17513/127.0.0.1:27446/127.0.0.1:23971', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_31', '--bind': '127.0.0.1:19333', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_15.log', '--name': 'master_15', '--partitions': 10, '--uuid': '9b86ee22e51bef2e8d9bef60ca4b7aee', '--masters': '127.0.0.1:21466/127.0.0.1:32665/127.0.0.1:17208/127.0.0.1:17388/127.0.0.1:20158/127.0.0.1:29877/127.0.0.1:24982/127.0.0.1:28282/127.0.0.1:25103/127.0.0.1:23360/127.0.0.1:28668/127.0.0.1:20178/127.0.0.1:27373/127.0.0.1:23600/127.0.0.1:30526/127.0.0.1:19333/127.0.0.1:19047/127.0.0.1:17513/127.0.0.1:27446/127.0.0.1:23971', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_31', '--bind': '127.0.0.1:19047', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_16.log', '--name': 'master_16', '--partitions': 10, '--uuid': 'd46ad08fb1cb2e4808c08c459ebe657d', '--masters': '127.0.0.1:21466/127.0.0.1:32665/127.0.0.1:17208/127.0.0.1:17388/127.0.0.1:20158/127.0.0.1:29877/127.0.0.1:24982/127.0.0.1:28282/127.0.0.1:25103/127.0.0.1:23360/127.0.0.1:28668/127.0.0.1:20178/127.0.0.1:27373/127.0.0.1:23600/127.0.0.1:30526/127.0.0.1:19333/127.0.0.1:19047/127.0.0.1:17513/127.0.0.1:27446/127.0.0.1:23971', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_31', '--bind': '127.0.0.1:17513', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_17.log', '--name': 'master_17', '--partitions': 10, '--uuid': 'c4e60c9169e3ca8da0a385a53cfb7ac5', '--masters': '127.0.0.1:21466/127.0.0.1:32665/127.0.0.1:17208/127.0.0.1:17388/127.0.0.1:20158/127.0.0.1:29877/127.0.0.1:24982/127.0.0.1:28282/127.0.0.1:25103/127.0.0.1:23360/127.0.0.1:28668/127.0.0.1:20178/127.0.0.1:27373/127.0.0.1:23600/127.0.0.1:30526/127.0.0.1:19333/127.0.0.1:19047/127.0.0.1:17513/127.0.0.1:27446/127.0.0.1:23971', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_31', '--bind': '127.0.0.1:27446', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_18.log', '--name': 'master_18', '--partitions': 10, '--uuid': 'dc64d912b0b0ad768c99aa805923f911', '--masters': '127.0.0.1:21466/127.0.0.1:32665/127.0.0.1:17208/127.0.0.1:17388/127.0.0.1:20158/127.0.0.1:29877/127.0.0.1:24982/127.0.0.1:28282/127.0.0.1:25103/127.0.0.1:23360/127.0.0.1:28668/127.0.0.1:20178/127.0.0.1:27373/127.0.0.1:23600/127.0.0.1:30526/127.0.0.1:19333/127.0.0.1:19047/127.0.0.1:17513/127.0.0.1:27446/127.0.0.1:23971', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_31', '--bind': '127.0.0.1:23971', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_19.log', '--name': 'master_19', '--partitions': 10, '--uuid': 'e8c150a3dc4acdb33353c08b8863f2b8', '--masters': '127.0.0.1:21466/127.0.0.1:32665/127.0.0.1:17208/127.0.0.1:17388/127.0.0.1:20158/127.0.0.1:29877/127.0.0.1:24982/127.0.0.1:28282/127.0.0.1:25103/127.0.0.1:23360/127.0.0.1:28668/127.0.0.1:20178/127.0.0.1:27373/127.0.0.1:23600/127.0.0.1:30526/127.0.0.1:19333/127.0.0.1:19047/127.0.0.1:17513/127.0.0.1:27446/127.0.0.1:23971', '--replicas': 0} exited with status 1
'neoadmin' {'--cluster': 'neo_31', '--bind': '127.0.0.1:18286', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/admin.log', '--name': 'admin', '--uuid': 'df93e0539c1477e7f55100e2186695aa', '--masters': '127.0.0.1:21466/127.0.0.1:32665/127.0.0.1:17208/127.0.0.1:17388/127.0.0.1:20158/127.0.0.1:29877/127.0.0.1:24982/127.0.0.1:28282/127.0.0.1:25103/127.0.0.1:23360/127.0.0.1:28668/127.0.0.1:20178/127.0.0.1:27373/127.0.0.1:23600/127.0.0.1:30526/127.0.0.1:19333/127.0.0.1:19047/127.0.0.1:17513/127.0.0.1:27446/127.0.0.1:23971'} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testAcceptFirstEmptyStorageAfterStartupAllowed
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 45, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 379, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neomaster' {'--cluster': 'neo_88', '--bind': '127.0.0.1:31886', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testAcceptFirstEmptyStorageAfterStartupAllowed/master_0.log', '--name': 'master_0', '--partitions': 10, '--uuid': 'd7e5c5bf1a2ad572b32d377d39d2bb91', '--masters': '127.0.0.1:31886/127.0.0.1:19575', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_88', '--bind': '127.0.0.1:19575', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testAcceptFirstEmptyStorageAfterStartupAllowed/master_1.log', '--name': 'master_1', '--partitions': 10, '--uuid': 'ca017879f2aab5d16770fc9adf3379d7', '--masters': '127.0.0.1:31886/127.0.0.1:19575', '--replicas': 0} exited with status 1
'neoadmin' {'--cluster': 'neo_88', '--bind': '127.0.0.1:32244', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testAcceptFirstEmptyStorageAfterStartupAllowed/admin.log', '--name': 'admin', '--uuid': '3b39737cbf5b9e33192fd048de9875fa', '--masters': '127.0.0.1:31886/127.0.0.1:19575'} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testConflictingStorageRejected
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 45, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 379, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neostorage' {'--cluster': 'neo_44', '--adapter': 'MySQL', '--bind': '127.0.0.1:0', '--database': 'test:@test_neo0', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testConflictingStorageRejected/storage_0.log', '--name': 'storage_0', '--uuid': '57db0d70afb199adf2736a8f19db1786', '--masters': '127.0.0.1:26112/127.0.0.1:27082'} exited with status 1
'neomaster' {'--cluster': 'neo_44', '--bind': '127.0.0.1:26112', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testConflictingStorageRejected/master_0.log', '--name': 'master_0', '--partitions': 10, '--uuid': 'a4cf7a0853a3f05af8abe25ad25315a7', '--masters': '127.0.0.1:26112/127.0.0.1:27082', '--replicas': 1} exited with status 1
'neomaster' {'--cluster': 'neo_44', '--bind': '127.0.0.1:27082', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testConflictingStorageRejected/master_1.log', '--name': 'master_1', '--partitions': 10, '--uuid': 'e72cc64eb48bb2ffa4832dd794fc7508', '--masters': '127.0.0.1:26112/127.0.0.1:27082', '--replicas': 1} exited with status 1
'neoadmin' {'--cluster': 'neo_44', '--bind': '127.0.0.1:31385', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testConflictingStorageRejected/admin.log', '--name': 'admin', '--uuid': '4b1617a6c60f1fc81319b57dd2804b30', '--masters': '127.0.0.1:26112/127.0.0.1:27082'} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testDropNodeWithOtherPending
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 45, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 379, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neostorage' {'--cluster': 'neo_37', '--adapter': 'MySQL', '--bind': '127.0.0.1:0', '--database': 'test:@test_neo0', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testDropNodeWithOtherPending/storage_0.log', '--name': 'storage_0', '--uuid': 'cb866f3ac1f38fd54778b1f9261f41fc', '--masters': '127.0.0.1:19526/127.0.0.1:19470'} exited with status 1
'neomaster' {'--cluster': 'neo_37', '--bind': '127.0.0.1:19526', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testDropNodeWithOtherPending/master_0.log', '--name': 'master_0', '--partitions': 10, '--uuid': '52b501775cb1e11770f7f9083d1adbf3', '--masters': '127.0.0.1:19526/127.0.0.1:19470', '--replicas': 1} exited with status 1
'neomaster' {'--cluster': 'neo_37', '--bind': '127.0.0.1:19470', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testDropNodeWithOtherPending/master_1.log', '--name': 'master_1', '--partitions': 10, '--uuid': '38435682f1e87a0558d38bc5ac342431', '--masters': '127.0.0.1:19526/127.0.0.1:19470', '--replicas': 1} exited with status 1
'neoadmin' {'--cluster': 'neo_37', '--bind': '127.0.0.1:31595', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testDropNodeWithOtherPending/admin.log', '--name': 'admin', '--uuid': 'a1d682300425b3f30f9e04d967298605', '--masters': '127.0.0.1:19526/127.0.0.1:19470'} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testNewNodesInPendingState
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 45, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 379, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neostorage' {'--cluster': 'neo_56', '--adapter': 'MySQL', '--bind': '127.0.0.1:0', '--database': 'test:@test_neo0', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testNewNodesInPendingState/storage_0.log', '--name': 'storage_0', '--uuid': 'e439bd44b8e0d3c92684f40ff4e6a939', '--masters': '127.0.0.1:25893/127.0.0.1:17855'} exited with status 1
'neomaster' {'--cluster': 'neo_56', '--bind': '127.0.0.1:25893', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testNewNodesInPendingState/master_0.log', '--name': 'master_0', '--partitions': 10, '--uuid': 'f9aa9fd4cd92991ab6727b193c8cd559', '--masters': '127.0.0.1:25893/127.0.0.1:17855', '--replicas': 1} exited with status 1
'neomaster' {'--cluster': 'neo_56', '--bind': '127.0.0.1:17855', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testNewNodesInPendingState/master_1.log', '--name': 'master_1', '--partitions': 10, '--uuid': '4c35183c897fa60b02998f0adf910331', '--masters': '127.0.0.1:25893/127.0.0.1:17855', '--replicas': 1} exited with status 1
'neoadmin' {'--cluster': 'neo_56', '--bind': '127.0.0.1:17826', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testNewNodesInPendingState/admin.log', '--name': 'admin', '--uuid': 'a5498a32863d8904df5b6f7d66ccb4d6', '--masters': '127.0.0.1:25893/127.0.0.1:17855'} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testOudatedCellsOnDownStorage
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 45, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 379, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neostorage' {'--cluster': 'neo_41', '--adapter': 'MySQL', '--bind': '127.0.0.1:0', '--database': 'test:@test_neo0', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testOudatedCellsOnDownStorage/storage_0.log', '--name': 'storage_0', '--uuid': '36da8a51520c99ca3e7310e2ef0a8423', '--masters': '127.0.0.1:26880/127.0.0.1:19434'} exited with status 1
'neostorage' {'--cluster': 'neo_41', '--adapter': 'MySQL', '--bind': '127.0.0.1:0', '--database': 'test:@test_neo1', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testOudatedCellsOnDownStorage/storage_1.log', '--name': 'storage_1', '--uuid': '3154d51f9e0a610db93f6e785f5ee246', '--masters': '127.0.0.1:26880/127.0.0.1:19434'} exited with status 1
'neomaster' {'--cluster': 'neo_41', '--bind': '127.0.0.1:26880', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testOudatedCellsOnDownStorage/master_0.log', '--name': 'master_0', '--partitions': 10, '--uuid': '82c75fd61639019bd89069ba2d6ae71e', '--masters': '127.0.0.1:26880/127.0.0.1:19434', '--replicas': 1} exited with status 1
'neomaster' {'--cluster': 'neo_41', '--bind': '127.0.0.1:19434', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testOudatedCellsOnDownStorage/master_1.log', '--name': 'master_1', '--partitions': 10, '--uuid': '70b53cf250a2c90fac5453b468344134', '--masters': '127.0.0.1:26880/127.0.0.1:19434', '--replicas': 1} exited with status 1
'neoadmin' {'--cluster': 'neo_41', '--bind': '127.0.0.1:22898', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testOudatedCellsOnDownStorage/admin.log', '--name': 'admin', '--uuid': '0e0310c5b78df2879058c2bad883335d', '--masters': '127.0.0.1:26880/127.0.0.1:19434'} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testPartitionTableReorganizedAfterDrop
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 45, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 379, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neostorage' {'--cluster': 'neo_33', '--adapter': 'MySQL', '--bind': '127.0.0.1:0', '--database': 'test:@test_neo0', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testPartitionTableReorganizedAfterDrop/storage_0.log', '--name': 'storage_0', '--uuid': '9c579b76e4722d7d359041c1e1e2e44d', '--masters': '127.0.0.1:27089/127.0.0.1:18124'} exited with status 1
'neostorage' {'--cluster': 'neo_33', '--adapter': 'MySQL', '--bind': '127.0.0.1:0', '--database': 'test:@test_neo1', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testPartitionTableReorganizedAfterDrop/storage_1.log', '--name': 'storage_1', '--uuid': '1df8dfc75a1b8342d6bf7893459ddfde', '--masters': '127.0.0.1:27089/127.0.0.1:18124'} exited with status 1
'neomaster' {'--cluster': 'neo_33', '--bind': '127.0.0.1:27089', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testPartitionTableReorganizedAfterDrop/master_0.log', '--name': 'master_0', '--partitions': 10, '--uuid': '4bab90b3fb0cef04179a9934d951e141', '--masters': '127.0.0.1:27089/127.0.0.1:18124', '--replicas': 1} exited with status 1
'neomaster' {'--cluster': 'neo_33', '--bind': '127.0.0.1:18124', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testPartitionTableReorganizedAfterDrop/master_1.log', '--name': 'master_1', '--partitions': 10, '--uuid': '8a2f2da279a22141507e37f0c9e43b9c', '--masters': '127.0.0.1:27089/127.0.0.1:18124', '--replicas': 1} exited with status 1
'neoadmin' {'--cluster': 'neo_33', '--bind': '127.0.0.1:22965', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testPartitionTableReorganizedAfterDrop/admin.log', '--name': 'admin', '--uuid': 'a650c0b6e78558cf6ac75370ec621892', '--masters': '127.0.0.1:27089/127.0.0.1:18124'} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testPartitionTableReorganizedWithNewStorage
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 45, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 379, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neostorage' {'--cluster': 'neo_0', '--adapter': 'MySQL', '--bind': '127.0.0.1:0', '--database': 'test:@test_neo0', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testPartitionTableReorganizedWithNewStorage/storage_0.log', '--name': 'storage_0', '--uuid': 'e1d8d0b35150563a039a746501e237b6', '--masters': '127.0.0.1:17918/127.0.0.1:27168'} exited with status 1
'neomaster' {'--cluster': 'neo_0', '--bind': '127.0.0.1:17918', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testPartitionTableReorganizedWithNewStorage/master_0.log', '--name': 'master_0', '--partitions': 10, '--uuid': 'fdc5966b935fca22ff0a836e50c9be6a', '--masters': '127.0.0.1:17918/127.0.0.1:27168', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_0', '--bind': '127.0.0.1:27168', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testPartitionTableReorganizedWithNewStorage/master_1.log', '--name': 'master_1', '--partitions': 10, '--uuid': '06fbf451685e43041066044983a474d7', '--masters': '127.0.0.1:17918/127.0.0.1:27168', '--replicas': 0} exited with status 1
'neoadmin' {'--cluster': 'neo_0', '--bind': '127.0.0.1:30463', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testPartitionTableReorganizedWithNewStorage/admin.log', '--name': 'admin', '--uuid': '0f45a28c6be0bebf1b0be2981fc4df98', '--masters': '127.0.0.1:17918/127.0.0.1:27168'} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testRecoveryWithMultiplePT
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 45, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 379, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neostorage' {'--cluster': 'neo_73', '--adapter': 'MySQL', '--bind': '127.0.0.1:0', '--database': 'test:@test_neo0', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testRecoveryWithMultiplePT/storage_0.log', '--name': 'storage_0', '--uuid': '449a42bb768f6ef096d2accb830603bc', '--masters': '127.0.0.1:28900/127.0.0.1:18480'} exited with status 1
'neostorage' {'--cluster': 'neo_73', '--adapter': 'MySQL', '--bind': '127.0.0.1:0', '--database': 'test:@test_neo1', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testRecoveryWithMultiplePT/storage_1.log', '--name': 'storage_1', '--uuid': '398eddb8e638a32baa2a5cdc91cf09cc', '--masters': '127.0.0.1:28900/127.0.0.1:18480'} exited with status 1
'neomaster' {'--cluster': 'neo_73', '--bind': '127.0.0.1:28900', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testRecoveryWithMultiplePT/master_0.log', '--name': 'master_0', '--partitions': 10, '--uuid': 'fd4af4f8586df44aca4dcb2ee1aa4a14', '--masters': '127.0.0.1:28900/127.0.0.1:18480', '--replicas': 1} exited with status 1
'neomaster' {'--cluster': 'neo_73', '--bind': '127.0.0.1:18480', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testRecoveryWithMultiplePT/master_1.log', '--name': 'master_1', '--partitions': 10, '--uuid': 'b1e2f3f05de0c9475e3b126836434979', '--masters': '127.0.0.1:28900/127.0.0.1:18480', '--replicas': 1} exited with status 1
'neoadmin' {'--cluster': 'neo_73', '--bind': '127.0.0.1:17466', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testRecoveryWithMultiplePT/admin.log', '--name': 'admin', '--uuid': '805a02119f0ea5d1cb9ea774cb33f9ab', '--masters': '127.0.0.1:28900/127.0.0.1:18480'} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testReplicationBlockedByUnfinished
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 45, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 379, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neostorage' {'--cluster': 'neo_36', '--adapter': 'MySQL', '--bind': '127.0.0.1:0', '--database': 'test:@test_neo0', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testReplicationBlockedByUnfinished/storage_0.log', '--name': 'storage_0', '--uuid': '4a7d0e1a116b5091a8a5110319a842d6', '--masters': '127.0.0.1:23300/127.0.0.1:23440'} exited with status 1
'neomaster' {'--cluster': 'neo_36', '--bind': '127.0.0.1:23300', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testReplicationBlockedByUnfinished/master_0.log', '--name': 'master_0', '--partitions': 10, '--uuid': 'fe20dc8156ffd6639b0d68c46e61674f', '--masters': '127.0.0.1:23300/127.0.0.1:23440', '--replicas': 1} exited with status 1
'neomaster' {'--cluster': 'neo_36', '--bind': '127.0.0.1:23440', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testReplicationBlockedByUnfinished/master_1.log', '--name': 'master_1', '--partitions': 10, '--uuid': '7b500994acc2708b78f401e651d0995f', '--masters': '127.0.0.1:23300/127.0.0.1:23440', '--replicas': 1} exited with status 1
'neoadmin' {'--cluster': 'neo_36', '--bind': '127.0.0.1:16537', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testReplicationBlockedByUnfinished/admin.log', '--name': 'admin', '--uuid': '17068bdf14a8c7fa48c4c66e2016eb37', '--masters': '127.0.0.1:23300/127.0.0.1:23440'} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testReplicationThenRunningWithReplicas
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 45, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 379, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neostorage' {'--cluster': 'neo_85', '--adapter': 'MySQL', '--bind': '127.0.0.1:0', '--database': 'test:@test_neo0', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testReplicationThenRunningWithReplicas/storage_0.log', '--name': 'storage_0', '--uuid': '8312cedb09173a50260a4b03285df709', '--masters': '127.0.0.1:18114/127.0.0.1:22535'} exited with status 1
'neomaster' {'--cluster': 'neo_85', '--bind': '127.0.0.1:18114', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testReplicationThenRunningWithReplicas/master_0.log', '--name': 'master_0', '--partitions': 10, '--uuid': '940f034d9ebc6936d641dd214e7820e9', '--masters': '127.0.0.1:18114/127.0.0.1:22535', '--replicas': 1} exited with status 1
'neomaster' {'--cluster': 'neo_85', '--bind': '127.0.0.1:22535', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testReplicationThenRunningWithReplicas/master_1.log', '--name': 'master_1', '--partitions': 10, '--uuid': '8201bf4da005761bf7357e45a425d726', '--masters': '127.0.0.1:18114/127.0.0.1:22535', '--replicas': 1} exited with status 1
'neoadmin' {'--cluster': 'neo_85', '--bind': '127.0.0.1:25824', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testReplicationThenRunningWithReplicas/admin.log', '--name': 'admin', '--uuid': '927695506af230fa460d898ad82f0b47', '--masters': '127.0.0.1:18114/127.0.0.1:22535'} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testReplicationWithNewStorage
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 45, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 379, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neostorage' {'--cluster': 'neo_8', '--adapter': 'MySQL', '--bind': '127.0.0.1:0', '--database': 'test:@test_neo0', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testReplicationWithNewStorage/storage_0.log', '--name': 'storage_0', '--uuid': 'd649f1b854d0bf787f7abfe688df92a5', '--masters': '127.0.0.1:23643/127.0.0.1:17700'} exited with status 1
'neomaster' {'--cluster': 'neo_8', '--bind': '127.0.0.1:23643', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testReplicationWithNewStorage/master_0.log', '--name': 'master_0', '--partitions': 10, '--uuid': '1fdfd0887e76d9ba06711f5d5a18e383', '--masters': '127.0.0.1:23643/127.0.0.1:17700', '--replicas': 1} exited with status 1
'neomaster' {'--cluster': 'neo_8', '--bind': '127.0.0.1:17700', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testReplicationWithNewStorage/master_1.log', '--name': 'master_1', '--partitions': 10, '--uuid': '51002a8973c5b2c64939c322bfd6ea6b', '--masters': '127.0.0.1:23643/127.0.0.1:17700', '--replicas': 1} exited with status 1
'neoadmin' {'--cluster': 'neo_8', '--bind': '127.0.0.1:19325', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testReplicationWithNewStorage/admin.log', '--name': 'admin', '--uuid': 'b7d90662e40b43410a9d0dcd189c5169', '--masters': '127.0.0.1:23643/127.0.0.1:17700'} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testSequentialStorageKill
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 45, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 379, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neostorage' {'--cluster': 'neo_38', '--adapter': 'MySQL', '--bind': '127.0.0.1:0', '--database': 'test:@test_neo0', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testSequentialStorageKill/storage_0.log', '--name': 'storage_0', '--uuid': '176e9e21a63603f8da1baec8f0a3b550', '--masters': '127.0.0.1:29186/127.0.0.1:30580'} exited with status 1
'neostorage' {'--cluster': 'neo_38', '--adapter': 'MySQL', '--bind': '127.0.0.1:0', '--database': 'test:@test_neo1', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testSequentialStorageKill/storage_1.log', '--name': 'storage_1', '--uuid': 'd9bcb2c143c44ba77d56e1f211fb0176', '--masters': '127.0.0.1:29186/127.0.0.1:30580'} exited with status 1
'neostorage' {'--cluster': 'neo_38', '--adapter': 'MySQL', '--bind': '127.0.0.1:0', '--database': 'test:@test_neo2', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testSequentialStorageKill/storage_2.log', '--name': 'storage_2', '--uuid': '7b553d6bc8d135889733f38ae730a7f4', '--masters': '127.0.0.1:29186/127.0.0.1:30580'} exited with status 1
'neomaster' {'--cluster': 'neo_38', '--bind': '127.0.0.1:29186', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testSequentialStorageKill/master_0.log', '--name': 'master_0', '--partitions': 10, '--uuid': '9a2ad4b37888668e86eb2dcba7edc463', '--masters': '127.0.0.1:29186/127.0.0.1:30580', '--replicas': 2} exited with status 1
'neomaster' {'--cluster': 'neo_38', '--bind': '127.0.0.1:30580', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testSequentialStorageKill/master_1.log', '--name': 'master_1', '--partitions': 10, '--uuid': '39f9751907effa156f56e4c8571432f2', '--masters': '127.0.0.1:29186/127.0.0.1:30580', '--replicas': 2} exited with status 1
'neoadmin' {'--cluster': 'neo_38', '--bind': '127.0.0.1:28506', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testSequentialStorageKill/admin.log', '--name': 'admin', '--uuid': 'dd47425b2f19b4b5ab5cece7ae3e181e', '--masters': '127.0.0.1:29186/127.0.0.1:30580'} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testVerificationTriggered
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 45, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 379, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neostorage' {'--cluster': 'neo_74', '--adapter': 'MySQL', '--bind': '127.0.0.1:0', '--database': 'test:@test_neo0', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testVerificationTriggered/storage_0.log', '--name': 'storage_0', '--uuid': '2393f2582d903cbc8547461eaf5c670c', '--masters': '127.0.0.1:18793/127.0.0.1:24026'} exited with status 1
'neomaster' {'--cluster': 'neo_74', '--bind': '127.0.0.1:18793', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testVerificationTriggered/master_0.log', '--name': 'master_0', '--partitions': 10, '--uuid': '27a30e17700ea815acceb977dcc1c7eb', '--masters': '127.0.0.1:18793/127.0.0.1:24026', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_74', '--bind': '127.0.0.1:24026', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testVerificationTriggered/master_1.log', '--name': 'master_1', '--partitions': 10, '--uuid': '04596ea09f2e67f3c55f0b5ac0f8b082', '--masters': '127.0.0.1:18793/127.0.0.1:24026', '--replicas': 0} exited with status 1
'neoadmin' {'--cluster': 'neo_74', '--bind': '127.0.0.1:29890', '--verbose': True, '--logfile': '/tmp/neo_tests/1325602754.397125/neo.tests.functional.testStorage.StorageTests.testVerificationTriggered/admin.log', '--name': 'admin', '--uuid': '7d29ef65ea4886e4ceb6fb79cda7549a', '--masters': '127.0.0.1:18793/127.0.0.1:24026'} exited with status 1
-------------------------------------------------------------


FAILURES:
neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testCluster.py", line 76, in testElectionWithManyMasters
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 344, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 339, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testAcceptFirstEmptyStorageAfterStartupAllowed
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 438, in testAcceptFirstEmptyStorageAfterStartupAllowed
    pending_number=1, partitions=10)
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 70, in __setup
    self.neo.start(except_storages=stopped_processes)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 344, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 339, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testConflictingStorageRejected
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 275, in testConflictingStorageRejected
    (started, stopped) = self.__setup(storage_number=2, pending_number=1)
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 70, in __setup
    self.neo.start(except_storages=stopped_processes)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 344, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 339, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testDropNodeWithOtherPending
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 452, in testDropNodeWithOtherPending
    pending_number=1, partitions=10)
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 70, in __setup
    self.neo.start(except_storages=stopped_processes)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 344, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 339, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testNewNodesInPendingState
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 145, in testNewNodesInPendingState
    processes = self.__setup(storage_number=3, replicas=1, pending_number=2)
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 70, in __setup
    self.neo.start(except_storages=stopped_processes)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 344, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 339, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testOudatedCellsOnDownStorage
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 192, in testOudatedCellsOnDownStorage
    (started, _) = self.__setup(storage_number=2, replicas=1)
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 70, in __setup
    self.neo.start(except_storages=stopped_processes)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 344, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 339, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testPartitionTableReorganizedAfterDrop
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 326, in testPartitionTableReorganizedAfterDrop
    partitions=10, pending_number=0)
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 70, in __setup
    self.neo.start(except_storages=stopped_processes)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 344, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 339, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testPartitionTableReorganizedWithNewStorage
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 301, in testPartitionTableReorganizedWithNewStorage
    partitions=10, replicas=0)
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 70, in __setup
    self.neo.start(except_storages=stopped_processes)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 344, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 339, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testRecoveryWithMultiplePT
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 468, in testRecoveryWithMultiplePT
    pending_number=0, partitions=10)
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 70, in __setup
    self.neo.start(except_storages=stopped_processes)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 344, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 339, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testReplicationBlockedByUnfinished
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 502, in testReplicationBlockedByUnfinished
    pending_number=1, partitions=10)
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 70, in __setup
    self.neo.start(except_storages=stopped_processes)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 344, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 339, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testReplicationThenRunningWithReplicas
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 353, in testReplicationThenRunningWithReplicas
    pending_number=1, partitions=10)
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 70, in __setup
    self.neo.start(except_storages=stopped_processes)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 344, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 339, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testReplicationWithNewStorage
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 165, in testReplicationWithNewStorage
    partitions=10)
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 70, in __setup
    self.neo.start(except_storages=stopped_processes)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 344, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 339, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testSequentialStorageKill
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 239, in testSequentialStorageKill
    (started, _) = self.__setup(replicas=2, storage_number=3, partitions=10)
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 70, in __setup
    self.neo.start(except_storages=stopped_processes)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 344, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 339, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testVerificationTriggered
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 211, in testVerificationTriggered
    (started, _) = self.__setup(replicas=0, storage_number=1)
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 70, in __setup
    self.neo.start(except_storages=stopped_processes)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 344, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 339, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testPack.PackableTests.checkPackAllRevisions
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/py2.6/src/ZODB3/src/ZODB/tests/PackableStorage.py", line 360, in checkPackAllRevisions
    raises(KeyError, self._storage.loadSerial, oid, revid3)
AssertionError: KeyError not raised
-------------------------------------------------------------

neo.tests.zodb.testPack.PackableTests.checkPackUndoLog
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/py2.6/src/ZODB3/src/ZODB/tests/PackableStorage.py", line 655, in checkPackUndoLog
    self.assertEqual(1,len(self._storage.undoLog()))
  File "/home/neo/master/neoppod/neo/tests/__init__.py", line 144, in assertEqual
    return super(NeoTestBase, self).assertEqual(first, second, msg=msg)
AssertionError: 1 != 3
-------------------------------------------------------------

neo.tests.zodb.testUndo.UndoTests.checkTransactionalUndoAfterPack
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/py2.6/src/ZODB3/src/ZODB/tests/TransactionalUndoStorage.py", line 463, in checkTransactionalUndoAfterPack
    self.assertEqual(len(info2), 2)
  File "/home/neo/master/neoppod/neo/tests/__init__.py", line 144, in assertEqual
    return super(NeoTestBase, self).assertEqual(first, second, msg=msg)
AssertionError: 4 != 2
-------------------------------------------------------------






More information about the Neo-report mailing list