[Neo-report] NEO tests [master:2921-gbb451f1:py2.6]: 631 Tests, 139 Errors, 33 Failures

neo-report at nexedi.com neo-report at nexedi.com
Mon Jan 9 16:21:57 CET 2012


Title                     : NEO tests [master:2921-gbb451f1:py2.6]
Date                      : 2012-01-09
Node                      : blade1
Machine                   : x86_64
System                    : Linux
Python                    : 2.6.6

Directory                 : /tmp/neo_tests/1326118568.917418
Status                    : 72.742%
NEO_TEST_ZODB_FUNCTIONAL  : 1

                               NEO TESTS REPORT

              Test Module |   run   | success |  errors |  fails  |   time   
--------------------------+---------+---------+---------+---------+----------
                ClientApp |    23   |    23   |     .   |     .   |   1.04s   
           ConnectionPool |     5   |     5   |     .   |     .   |   1.00s   
            MasterHandler |    14   |    14   |     .   |     .   |   0.01s   
           StorageHandler |    14   |    14   |     .   |     .   |   0.01s   
--------------------------+---------+---------+---------+---------+----------
         neo.tests.client |         |         |         |         |          
--------------------------+---------+---------+---------+---------+----------
                   Client |    10   |     .   |     7   |    10   | 511.26s   
                  Cluster |     7   |     .   |     6   |     7   | 406.04s   
                   Master |     4   |     .   |     4   |     .   | 122.78s   
                  Storage |    13   |     1   |    10   |    12   | 682.34s   
--------------------------+---------+---------+---------+---------+----------
     neo.tests.functional |         |         |         |         |          
--------------------------+---------+---------+---------+---------+----------
            ClientHandler |     6   |     6   |     .   |     .   |   0.02s   
          ElectionHandler |    20   |    12   |     4   |     4   |   0.04s   
                MasterApp |     2   |     2   |     .   |     .   |   0.00s   
                 MasterPT |     7   |     7   |     .   |     .   |   0.01s   
                 Recovery |     3   |     3   |     .   |     .   |   0.03s   
           StorageHandler |     8   |     8   |     .   |     .   |   0.07s   
             Transactions |     9   |     9   |     .   |     .   |   0.01s   
             Verification |     6   |     6   |     .   |     .   |   0.01s   
--------------------------+---------+---------+---------+---------+----------
         neo.tests.master |         |         |         |         |          
--------------------------+---------+---------+---------+---------+----------
            ClientHandler |    18   |    18   |     .   |     .   |   0.15s   
    IdentificationHandler |     3   |     3   |     .   |     .   |   0.01s   
    InitializationHandler |     2   |     2   |     .   |     .   |   0.02s   
            MasterHandler |    11   |    11   |     .   |     .   |   0.09s   
              Replication |    10   |    10   |     .   |     .   |   2.65s   
       ReplicationHandler |    21   |    21   |     .   |     .   |   0.02s   
               Replicator |     7   |     7   |     .   |     .   |   0.01s   
               StorageApp |     3   |     3   |     .   |     .   |   0.02s   
             StorageBTree |    24   |    24   |     .   |     .   |   0.01s   
           StorageHandler |     9   |     9   |     .   |     .   |   0.07s   
           StorageMySQLdb |    32   |    32   |     .   |     .   |   0.27s   
             Transactions |    19   |    19   |     .   |     .   |   0.02s   
      VerificationHandler |    11   |    11   |     .   |     .   |   0.11s   
--------------------------+---------+---------+---------+---------+----------
        neo.tests.storage |         |         |         |         |          
--------------------------+---------+---------+---------+---------+----------
                Bootstrap |     2   |     2   |     .   |     .   |   0.05s   
               Connection |    75   |    75   |     .   |     .   |   0.09s   
               Dispatcher |     5   |     5   |     .   |     .   |   0.00s   
                    Event |     1   |     1   |     .   |     .   |   0.00s   
                  Handler |     1   |     1   |     .   |     .   |   0.00s   
                    Nodes |    17   |    17   |     .   |     .   |   0.01s   
                       PT |    11   |    11   |     .   |     .   |   0.01s   
                 Protocol |    87   |    86   |     1   |     .   |   0.02s   
                     Util |     4   |     4   |     .   |     .   |   0.00s   
--------------------------+---------+---------+---------+---------+----------
                neo.tests |         |         |         |         |          
--------------------------+---------+---------+---------+---------+----------
                          |    13   |     .   |    13   |     .   |   0.35s   
--------------------------+---------+---------+---------+---------+----------
       neo.tests.threaded |         |         |         |         |          
--------------------------+---------+---------+---------+---------+----------
                    Basic |    16   |     .   |    16   |     .   | 497.38s   
                 Conflict |     5   |     .   |     5   |     .   | 155.43s   
                  History |     1   |     .   |     1   |     .   |  31.09s   
                 Iterator |     9   |     .   |     9   |     .   | 279.78s   
                       MT |     5   |     .   |     5   |     .   | 155.43s   
                     Pack |    14   |     .   |    14   |     .   | 435.19s   
               Persistent |     1   |     .   |     1   |     .   |  31.09s   
                 ReadOnly |     2   |     .   |     2   |     .   |  62.17s   
                 Revision |     7   |     .   |     7   |     .   | 217.59s   
          Synchronization |     7   |     .   |     7   |     .   | 217.60s   
                     Undo |    17   |     .   |    17   |     .   | 528.48s   
                     ZODB |    10   |     .   |    10   |     .   | 310.87s   
--------------------------+---------+---------+---------+---------+----------
           neo.tests.zodb |         |         |         |         |          
--------------------------+---------+---------+---------+---------+----------
                  Summary |   631   |   482   |   139   |    33   | 4650.72s   
--------------------------+---------+---------+---------+---------+----------



ERRORS:
neo.tests.testProtocol.ProtocolTests.test_13_askPrimary
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/testProtocol.py", line 108, in test_13_askPrimary
    self.assertEqual(p.decode(), ())
  File "/home/neo/master/neoppod/neo/lib/protocol.py", line 183, in decode
    raise PacketMalformedError("%s fail (%s)" % (name, msg))
PacketMalformedError: PrimaryMaster fail (at ask_primary/node_list:
  File "/home/neo/master/neoppod/neo/lib/protocol.py", line 340, in _decode
    length = self.unpack(reader(self.size))[0]
error: unpack requires a string argument of length 4
)
-------------------------------------------------------------

neo.tests.master.testElectionHandler.MasterClientElectionTests.test_acceptIdentification3
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/master/testElectionHandler.py", line 127, in test_acceptIdentification3
    self.assertTrue(self.app.primary or node.getUUID() < self.app.uuid)
AttributeError: 'Application' object has no attribute 'primary'
-------------------------------------------------------------

neo.tests.master.testElectionHandler.MasterServerElectionTests.test_askPrimary1
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/master/testElectionHandler.py", line 302, in test_askPrimary1
    self.election.askPrimary(conn)
TypeError: askPrimary() takes exactly 3 arguments (2 given)
-------------------------------------------------------------

neo.tests.master.testElectionHandler.MasterServerElectionTests.test_askPrimary2
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/master/testElectionHandler.py", line 317, in test_askPrimary2
    self.election.askPrimary(conn)
TypeError: askPrimary() takes exactly 3 arguments (2 given)
-------------------------------------------------------------

neo.tests.master.testElectionHandler.MasterServerElectionTests.test_askPrimary3
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/master/testElectionHandler.py", line 330, in test_askPrimary3
    self.election.askPrimary(conn)
TypeError: askPrimary() takes exactly 3 arguments (2 given)
-------------------------------------------------------------

neo.tests.threaded.test.Test.testBasicStore
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/threaded/test.py", line 46, in testBasicStore
    cluster.start()
  File "/home/neo/master/neoppod/neo/tests/threaded/__init__.py", line 567, in start
    self._startCluster()
  File "/home/neo/master/neoppod/neo/tests/threaded/__init__.py", line 574, in _startCluster
    self.neoctl.startCluster()
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 144, in startCluster
    return self.setClusterState(ClusterStates.VERIFYING)
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 90, in setClusterState
    response = self.__ask(packet)
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 72, in __ask
    raise NotReadyException(response[2])
NotReadyException: Not connected to a primary master.
-------------------------------------------------------------

neo.tests.threaded.test.Test.testConflictResolutionTriggered2
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/threaded/test.py", line 232, in testConflictResolutionTriggered2
    cluster.start()
  File "/home/neo/master/neoppod/neo/tests/threaded/__init__.py", line 567, in start
    self._startCluster()
  File "/home/neo/master/neoppod/neo/tests/threaded/__init__.py", line 574, in _startCluster
    self.neoctl.startCluster()
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 144, in startCluster
    return self.setClusterState(ClusterStates.VERIFYING)
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 90, in setClusterState
    response = self.__ask(packet)
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 72, in __ask
    raise NotReadyException(response[2])
NotReadyException: Not connected to a primary master.
-------------------------------------------------------------

neo.tests.threaded.test.Test.testDeadlockAvoidance
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/threaded/test.py", line 225, in testDeadlockAvoidance
    self.assertEqual(self._testDeadlockAvoidance([1, 3]),
  File "/home/neo/master/neoppod/neo/tests/threaded/test.py", line 180, in _testDeadlockAvoidance
    cluster.start()
  File "/home/neo/master/neoppod/neo/tests/threaded/__init__.py", line 567, in start
    self._startCluster()
  File "/home/neo/master/neoppod/neo/tests/threaded/__init__.py", line 574, in _startCluster
    self.neoctl.startCluster()
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 144, in startCluster
    return self.setClusterState(ClusterStates.VERIFYING)
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 90, in setClusterState
    response = self.__ask(packet)
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 72, in __ask
    raise NotReadyException(response[2])
NotReadyException: Not connected to a primary master.
-------------------------------------------------------------

neo.tests.threaded.test.Test.testDelayedStore
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/threaded/test.py", line 215, in testDelayedStore
    self.assertEqual(self._testDeadlockAvoidance([2, 4]),
  File "/home/neo/master/neoppod/neo/tests/threaded/test.py", line 180, in _testDeadlockAvoidance
    cluster.start()
  File "/home/neo/master/neoppod/neo/tests/threaded/__init__.py", line 567, in start
    self._startCluster()
  File "/home/neo/master/neoppod/neo/tests/threaded/__init__.py", line 574, in _startCluster
    self.neoctl.startCluster()
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 144, in startCluster
    return self.setClusterState(ClusterStates.VERIFYING)
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 90, in setClusterState
    response = self.__ask(packet)
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 72, in __ask
    raise NotReadyException(response[2])
NotReadyException: Not connected to a primary master.
-------------------------------------------------------------

neo.tests.threaded.test.Test.testDelayedUnlockInformation
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/threaded/test.py", line 127, in testDelayedUnlockInformation
    cluster.start()
  File "/home/neo/master/neoppod/neo/tests/threaded/__init__.py", line 567, in start
    self._startCluster()
  File "/home/neo/master/neoppod/neo/tests/threaded/__init__.py", line 574, in _startCluster
    self.neoctl.startCluster()
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 144, in startCluster
    return self.setClusterState(ClusterStates.VERIFYING)
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 90, in setClusterState
    response = self.__ask(packet)
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 72, in __ask
    raise NotReadyException(response[2])
NotReadyException: Not connected to a primary master.
-------------------------------------------------------------

neo.tests.threaded.test.Test.testDropNodeThenRestartCluster
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/threaded/test.py", line 395, in testDropNodeThenRestartCluster
    cluster.start()
  File "/home/neo/master/neoppod/neo/tests/threaded/__init__.py", line 567, in start
    self._startCluster()
  File "/home/neo/master/neoppod/neo/tests/threaded/__init__.py", line 574, in _startCluster
    self.neoctl.startCluster()
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 144, in startCluster
    return self.setClusterState(ClusterStates.VERIFYING)
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 90, in setClusterState
    response = self.__ask(packet)
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 72, in __ask
    raise NotReadyException(response[2])
NotReadyException: Not connected to a primary master.
-------------------------------------------------------------

neo.tests.threaded.test.Test.testRestartWithMissingStorage
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/threaded/test.py", line 305, in testRestartWithMissingStorage
    cluster.start()
  File "/home/neo/master/neoppod/neo/tests/threaded/__init__.py", line 567, in start
    self._startCluster()
  File "/home/neo/master/neoppod/neo/tests/threaded/__init__.py", line 574, in _startCluster
    self.neoctl.startCluster()
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 144, in startCluster
    return self.setClusterState(ClusterStates.VERIFYING)
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 90, in setClusterState
    response = self.__ask(packet)
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 72, in __ask
    raise NotReadyException(response[2])
NotReadyException: Not connected to a primary master.
-------------------------------------------------------------

neo.tests.threaded.test.Test.testStorageDataLock
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/threaded/test.py", line 71, in testStorageDataLock
    cluster.start()
  File "/home/neo/master/neoppod/neo/tests/threaded/__init__.py", line 567, in start
    self._startCluster()
  File "/home/neo/master/neoppod/neo/tests/threaded/__init__.py", line 574, in _startCluster
    self.neoctl.startCluster()
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 144, in startCluster
    return self.setClusterState(ClusterStates.VERIFYING)
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 90, in setClusterState
    response = self.__ask(packet)
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 72, in __ask
    raise NotReadyException(response[2])
NotReadyException: Not connected to a primary master.
-------------------------------------------------------------

neo.tests.threaded.test.Test.testStorageReconnectDuringStore
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/threaded/test.py", line 347, in testStorageReconnectDuringStore
    cluster.start()
  File "/home/neo/master/neoppod/neo/tests/threaded/__init__.py", line 567, in start
    self._startCluster()
  File "/home/neo/master/neoppod/neo/tests/threaded/__init__.py", line 574, in _startCluster
    self.neoctl.startCluster()
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 144, in startCluster
    return self.setClusterState(ClusterStates.VERIFYING)
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 90, in setClusterState
    response = self.__ask(packet)
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 72, in __ask
    raise NotReadyException(response[2])
NotReadyException: Not connected to a primary master.
-------------------------------------------------------------

neo.tests.threaded.test.Test.testStorageReconnectDuringTransactionLog
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/threaded/test.py", line 363, in testStorageReconnectDuringTransactionLog
    cluster.start()
  File "/home/neo/master/neoppod/neo/tests/threaded/__init__.py", line 567, in start
    self._startCluster()
  File "/home/neo/master/neoppod/neo/tests/threaded/__init__.py", line 574, in _startCluster
    self.neoctl.startCluster()
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 144, in startCluster
    return self.setClusterState(ClusterStates.VERIFYING)
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 90, in setClusterState
    response = self.__ask(packet)
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 72, in __ask
    raise NotReadyException(response[2])
NotReadyException: Not connected to a primary master.
-------------------------------------------------------------

neo.tests.threaded.test.Test.testStorageReconnectDuringUndoLog
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/threaded/test.py", line 375, in testStorageReconnectDuringUndoLog
    cluster.start()
  File "/home/neo/master/neoppod/neo/tests/threaded/__init__.py", line 567, in start
    self._startCluster()
  File "/home/neo/master/neoppod/neo/tests/threaded/__init__.py", line 574, in _startCluster
    self.neoctl.startCluster()
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 144, in startCluster
    return self.setClusterState(ClusterStates.VERIFYING)
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 90, in setClusterState
    response = self.__ask(packet)
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 72, in __ask
    raise NotReadyException(response[2])
NotReadyException: Not connected to a primary master.
-------------------------------------------------------------

neo.tests.threaded.test.Test.testVerificationCommitUnfinishedTransactions
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/threaded/test.py", line 322, in testVerificationCommitUnfinishedTransactions
    cluster.start()
  File "/home/neo/master/neoppod/neo/tests/threaded/__init__.py", line 567, in start
    self._startCluster()
  File "/home/neo/master/neoppod/neo/tests/threaded/__init__.py", line 574, in _startCluster
    self.neoctl.startCluster()
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 144, in startCluster
    return self.setClusterState(ClusterStates.VERIFYING)
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 90, in setClusterState
    response = self.__ask(packet)
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 72, in __ask
    raise NotReadyException(response[2])
NotReadyException: Not connected to a primary master.
-------------------------------------------------------------

neo.tests.threaded.test.Test.test_notifyNodeInformation
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/threaded/test.py", line 281, in test_notifyNodeInformation
    cluster.start()
  File "/home/neo/master/neoppod/neo/tests/threaded/__init__.py", line 567, in start
    self._startCluster()
  File "/home/neo/master/neoppod/neo/tests/threaded/__init__.py", line 574, in _startCluster
    self.neoctl.startCluster()
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 144, in startCluster
    return self.setClusterState(ClusterStates.VERIFYING)
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 90, in setClusterState
    response = self.__ask(packet)
  File "/home/neo/master/neoppod/neo/neoctl/neoctl.py", line 72, in __ask
    raise NotReadyException(response[2])
NotReadyException: Not connected to a primary master.
-------------------------------------------------------------

neo.tests.functional.testMaster.MasterTests.testMasterSequentialStart
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testMaster.py", line 32, in setUp
    self.neo.run()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testMaster.MasterTests.testStoppingPrimaryWithOneSecondary
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testMaster.py", line 32, in setUp
    self.neo.run()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testMaster.MasterTests.testStoppingPrimaryWithTwoSecondaries
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testMaster.py", line 32, in setUp
    self.neo.run()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testMaster.MasterTests.testStoppingSecondaryMaster
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testMaster.py", line 32, in setUp
    self.neo.run()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testClient.ClientTests.testConflictResolutionTriggered1
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testClient.py", line 82, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 384, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neomaster' {'--cluster': 'neo_60', '--bind': '127.0.0.1:28658', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testClient.ClientTests.testConflictResolutionTriggered1/master_0.log', '--name': 'master_0', '--partitions': 1, '--uuid': '73961034b59e5190ec5d6d6a6c2a4742', '--masters': '127.0.0.1:28658', '--replicas': 2} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testClient.ClientTests.testExport
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testClient.py", line 82, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 384, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neomaster' {'--cluster': 'neo_37', '--bind': '127.0.0.1:22651', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testClient.ClientTests.testExport/master_0.log', '--name': 'master_0', '--partitions': 1, '--uuid': '2a60caefd915b4badd329070caad764a', '--masters': '127.0.0.1:22651', '--replicas': 2} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testClient.ClientTests.testExportFileStorageBug
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testClient.py", line 82, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 384, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neomaster' {'--cluster': 'neo_1', '--bind': '127.0.0.1:18178', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testClient.ClientTests.testExportFileStorageBug/master_0.log', '--name': 'master_0', '--partitions': 1, '--uuid': '1ac96aea25cfc830600ab72c68cc09b7', '--masters': '127.0.0.1:18178', '--replicas': 2} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testClient.ClientTests.testGreaterOIDSaved
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testClient.py", line 82, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 384, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neomaster' {'--cluster': 'neo_91', '--bind': '127.0.0.1:24018', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testClient.ClientTests.testGreaterOIDSaved/master_0.log', '--name': 'master_0', '--partitions': 1, '--uuid': '7703b5d3d759e235a6a0da1c0523392c', '--masters': '127.0.0.1:24018', '--replicas': 0} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testClient.ClientTests.testImport
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testClient.py", line 82, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 384, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neomaster' {'--cluster': 'neo_36', '--bind': '127.0.0.1:20649', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testClient.ClientTests.testImport/master_0.log', '--name': 'master_0', '--partitions': 1, '--uuid': 'cb8f290733eb163be11d31e6156ad6f8', '--masters': '127.0.0.1:20649', '--replicas': 2} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testClient.ClientTests.testIsolationAtZopeLevel
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testClient.py", line 82, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 384, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neomaster' {'--cluster': 'neo_65', '--bind': '127.0.0.1:29726', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testClient.ClientTests.testIsolationAtZopeLevel/master_0.log', '--name': 'master_0', '--partitions': 1, '--uuid': '227ea2ddae2c0bd1248ce4da1a35c0a3', '--masters': '127.0.0.1:29726', '--replicas': 2} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testClient.ClientTests.testIsolationWithoutZopeCache
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testClient.py", line 82, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 384, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neomaster' {'--cluster': 'neo_90', '--bind': '127.0.0.1:25608', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testClient.ClientTests.testIsolationWithoutZopeCache/master_0.log', '--name': 'master_0', '--partitions': 1, '--uuid': 'ef61cebd6f54abfc5c0d96b897f4deb3', '--masters': '127.0.0.1:25608', '--replicas': 2} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testCluster.ClusterTests.testClusterBreaks
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testCluster.py", line 32, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 384, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neomaster' {'--cluster': 'neo_81', '--bind': '127.0.0.1:18793', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testCluster.ClusterTests.testClusterBreaks/master_0.log', '--name': 'master_0', '--partitions': 1, '--uuid': '2b23b61f9863fb0a8150b73ccd6bf3a3', '--masters': '127.0.0.1:18793', '--replicas': 0} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testCluster.ClusterTests.testClusterBreaksWithTwoNodes
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testCluster.py", line 32, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 384, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neomaster' {'--cluster': 'neo_40', '--bind': '127.0.0.1:27852', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testCluster.ClusterTests.testClusterBreaksWithTwoNodes/master_0.log', '--name': 'master_0', '--partitions': 2, '--uuid': '23afb366054fb8de304404fad50d51de', '--masters': '127.0.0.1:27852', '--replicas': 0} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testCluster.ClusterTests.testClusterDoesntBreakWithTwoNodesOneReplica
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testCluster.py", line 32, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 384, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neomaster' {'--cluster': 'neo_36', '--bind': '127.0.0.1:30678', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testCluster.ClusterTests.testClusterDoesntBreakWithTwoNodesOneReplica/master_0.log', '--name': 'master_0', '--partitions': 2, '--uuid': '01c3a4a5ffd4a7ac18a3a287a5c08ec9', '--masters': '127.0.0.1:30678', '--replicas': 1} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testCluster.py", line 32, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 384, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neomaster' {'--cluster': 'neo_99', '--bind': '127.0.0.1:27061', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_0.log', '--name': 'master_0', '--partitions': 10, '--uuid': 'dffacaa2d3a1fd99add150af5d6c586f', '--masters': '127.0.0.1:27061 127.0.0.1:17703 127.0.0.1:31945 127.0.0.1:20405 127.0.0.1:32737 127.0.0.1:23409 127.0.0.1:23523 127.0.0.1:18416 127.0.0.1:29089 127.0.0.1:28002 127.0.0.1:27459 127.0.0.1:31978 127.0.0.1:25358 127.0.0.1:18892 127.0.0.1:18946 127.0.0.1:27456 127.0.0.1:30914 127.0.0.1:23589 127.0.0.1:25727 127.0.0.1:19708', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_99', '--bind': '127.0.0.1:17703', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_1.log', '--name': 'master_1', '--partitions': 10, '--uuid': '1c4c78184afcebbd7d690942b313c33d', '--masters': '127.0.0.1:27061 127.0.0.1:17703 127.0.0.1:31945 127.0.0.1:20405 127.0.0.1:32737 127.0.0.1:23409 127.0.0.1:23523 127.0.0.1:18416 127.0.0.1:29089 127.0.0.1:28002 127.0.0.1:27459 127.0.0.1:31978 127.0.0.1:25358 127.0.0.1:18892 127.0.0.1:18946 127.0.0.1:27456 127.0.0.1:30914 127.0.0.1:23589 127.0.0.1:25727 127.0.0.1:19708', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_99', '--bind': '127.0.0.1:31945', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_2.log', '--name': 'master_2', '--partitions': 10, '--uuid': '16366b3a9c74251369d1bf7e2f16e93e', '--masters': '127.0.0.1:27061 127.0.0.1:17703 127.0.0.1:31945 127.0.0.1:20405 127.0.0.1:32737 127.0.0.1:23409 127.0.0.1:23523 127.0.0.1:18416 127.0.0.1:29089 127.0.0.1:28002 127.0.0.1:27459 127.0.0.1:31978 127.0.0.1:25358 127.0.0.1:18892 127.0.0.1:18946 127.0.0.1:27456 127.0.0.1:30914 127.0.0.1:23589 127.0.0.1:25727 127.0.0.1:19708', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_99', '--bind': '127.0.0.1:20405', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_3.log', '--name': 'master_3', '--partitions': 10, '--uuid': '9454e139fead3718a0561e4c00921786', '--masters': '127.0.0.1:27061 127.0.0.1:17703 127.0.0.1:31945 127.0.0.1:20405 127.0.0.1:32737 127.0.0.1:23409 127.0.0.1:23523 127.0.0.1:18416 127.0.0.1:29089 127.0.0.1:28002 127.0.0.1:27459 127.0.0.1:31978 127.0.0.1:25358 127.0.0.1:18892 127.0.0.1:18946 127.0.0.1:27456 127.0.0.1:30914 127.0.0.1:23589 127.0.0.1:25727 127.0.0.1:19708', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_99', '--bind': '127.0.0.1:32737', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_4.log', '--name': 'master_4', '--partitions': 10, '--uuid': '6a13dc42a67e77b934277ce1a9e1ad4a', '--masters': '127.0.0.1:27061 127.0.0.1:17703 127.0.0.1:31945 127.0.0.1:20405 127.0.0.1:32737 127.0.0.1:23409 127.0.0.1:23523 127.0.0.1:18416 127.0.0.1:29089 127.0.0.1:28002 127.0.0.1:27459 127.0.0.1:31978 127.0.0.1:25358 127.0.0.1:18892 127.0.0.1:18946 127.0.0.1:27456 127.0.0.1:30914 127.0.0.1:23589 127.0.0.1:25727 127.0.0.1:19708', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_99', '--bind': '127.0.0.1:23523', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_6.log', '--name': 'master_6', '--partitions': 10, '--uuid': 'a842e3b84d52a20d994d3b06c76ec2ff', '--masters': '127.0.0.1:27061 127.0.0.1:17703 127.0.0.1:31945 127.0.0.1:20405 127.0.0.1:32737 127.0.0.1:23409 127.0.0.1:23523 127.0.0.1:18416 127.0.0.1:29089 127.0.0.1:28002 127.0.0.1:27459 127.0.0.1:31978 127.0.0.1:25358 127.0.0.1:18892 127.0.0.1:18946 127.0.0.1:27456 127.0.0.1:30914 127.0.0.1:23589 127.0.0.1:25727 127.0.0.1:19708', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_99', '--bind': '127.0.0.1:18416', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_7.log', '--name': 'master_7', '--partitions': 10, '--uuid': 'dc50d55a0f7f6e7bdb4da0f18239eec3', '--masters': '127.0.0.1:27061 127.0.0.1:17703 127.0.0.1:31945 127.0.0.1:20405 127.0.0.1:32737 127.0.0.1:23409 127.0.0.1:23523 127.0.0.1:18416 127.0.0.1:29089 127.0.0.1:28002 127.0.0.1:27459 127.0.0.1:31978 127.0.0.1:25358 127.0.0.1:18892 127.0.0.1:18946 127.0.0.1:27456 127.0.0.1:30914 127.0.0.1:23589 127.0.0.1:25727 127.0.0.1:19708', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_99', '--bind': '127.0.0.1:29089', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_8.log', '--name': 'master_8', '--partitions': 10, '--uuid': 'dcc393d36d6fa972c70b713994182634', '--masters': '127.0.0.1:27061 127.0.0.1:17703 127.0.0.1:31945 127.0.0.1:20405 127.0.0.1:32737 127.0.0.1:23409 127.0.0.1:23523 127.0.0.1:18416 127.0.0.1:29089 127.0.0.1:28002 127.0.0.1:27459 127.0.0.1:31978 127.0.0.1:25358 127.0.0.1:18892 127.0.0.1:18946 127.0.0.1:27456 127.0.0.1:30914 127.0.0.1:23589 127.0.0.1:25727 127.0.0.1:19708', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_99', '--bind': '127.0.0.1:31978', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_11.log', '--name': 'master_11', '--partitions': 10, '--uuid': '036ebba818c821c3ab7cf013c72d165a', '--masters': '127.0.0.1:27061 127.0.0.1:17703 127.0.0.1:31945 127.0.0.1:20405 127.0.0.1:32737 127.0.0.1:23409 127.0.0.1:23523 127.0.0.1:18416 127.0.0.1:29089 127.0.0.1:28002 127.0.0.1:27459 127.0.0.1:31978 127.0.0.1:25358 127.0.0.1:18892 127.0.0.1:18946 127.0.0.1:27456 127.0.0.1:30914 127.0.0.1:23589 127.0.0.1:25727 127.0.0.1:19708', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_99', '--bind': '127.0.0.1:18892', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_13.log', '--name': 'master_13', '--partitions': 10, '--uuid': '799a4aef69bed26345927482627feeac', '--masters': '127.0.0.1:27061 127.0.0.1:17703 127.0.0.1:31945 127.0.0.1:20405 127.0.0.1:32737 127.0.0.1:23409 127.0.0.1:23523 127.0.0.1:18416 127.0.0.1:29089 127.0.0.1:28002 127.0.0.1:27459 127.0.0.1:31978 127.0.0.1:25358 127.0.0.1:18892 127.0.0.1:18946 127.0.0.1:27456 127.0.0.1:30914 127.0.0.1:23589 127.0.0.1:25727 127.0.0.1:19708', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_99', '--bind': '127.0.0.1:18946', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_14.log', '--name': 'master_14', '--partitions': 10, '--uuid': 'bb67a2f01b5a17cadb6114632d7c7e7d', '--masters': '127.0.0.1:27061 127.0.0.1:17703 127.0.0.1:31945 127.0.0.1:20405 127.0.0.1:32737 127.0.0.1:23409 127.0.0.1:23523 127.0.0.1:18416 127.0.0.1:29089 127.0.0.1:28002 127.0.0.1:27459 127.0.0.1:31978 127.0.0.1:25358 127.0.0.1:18892 127.0.0.1:18946 127.0.0.1:27456 127.0.0.1:30914 127.0.0.1:23589 127.0.0.1:25727 127.0.0.1:19708', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_99', '--bind': '127.0.0.1:27456', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_15.log', '--name': 'master_15', '--partitions': 10, '--uuid': 'e9fd10cda2d7069d0eec51d995df102e', '--masters': '127.0.0.1:27061 127.0.0.1:17703 127.0.0.1:31945 127.0.0.1:20405 127.0.0.1:32737 127.0.0.1:23409 127.0.0.1:23523 127.0.0.1:18416 127.0.0.1:29089 127.0.0.1:28002 127.0.0.1:27459 127.0.0.1:31978 127.0.0.1:25358 127.0.0.1:18892 127.0.0.1:18946 127.0.0.1:27456 127.0.0.1:30914 127.0.0.1:23589 127.0.0.1:25727 127.0.0.1:19708', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_99', '--bind': '127.0.0.1:23589', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_17.log', '--name': 'master_17', '--partitions': 10, '--uuid': '66caf4dc166aad42e93784ad592aa671', '--masters': '127.0.0.1:27061 127.0.0.1:17703 127.0.0.1:31945 127.0.0.1:20405 127.0.0.1:32737 127.0.0.1:23409 127.0.0.1:23523 127.0.0.1:18416 127.0.0.1:29089 127.0.0.1:28002 127.0.0.1:27459 127.0.0.1:31978 127.0.0.1:25358 127.0.0.1:18892 127.0.0.1:18946 127.0.0.1:27456 127.0.0.1:30914 127.0.0.1:23589 127.0.0.1:25727 127.0.0.1:19708', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_99', '--bind': '127.0.0.1:25727', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_18.log', '--name': 'master_18', '--partitions': 10, '--uuid': '434d604064417ad41ec1a4c617e3beb2', '--masters': '127.0.0.1:27061 127.0.0.1:17703 127.0.0.1:31945 127.0.0.1:20405 127.0.0.1:32737 127.0.0.1:23409 127.0.0.1:23523 127.0.0.1:18416 127.0.0.1:29089 127.0.0.1:28002 127.0.0.1:27459 127.0.0.1:31978 127.0.0.1:25358 127.0.0.1:18892 127.0.0.1:18946 127.0.0.1:27456 127.0.0.1:30914 127.0.0.1:23589 127.0.0.1:25727 127.0.0.1:19708', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_99', '--bind': '127.0.0.1:19708', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters/master_19.log', '--name': 'master_19', '--partitions': 10, '--uuid': 'd9629210ec5aff422a8e0a0cfa3ea259', '--masters': '127.0.0.1:27061 127.0.0.1:17703 127.0.0.1:31945 127.0.0.1:20405 127.0.0.1:32737 127.0.0.1:23409 127.0.0.1:23523 127.0.0.1:18416 127.0.0.1:29089 127.0.0.1:28002 127.0.0.1:27459 127.0.0.1:31978 127.0.0.1:25358 127.0.0.1:18892 127.0.0.1:18946 127.0.0.1:27456 127.0.0.1:30914 127.0.0.1:23589 127.0.0.1:25727 127.0.0.1:19708', '--replicas': 0} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testCluster.ClusterTests.testLeavingOperationalStateDropClientNodes
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testCluster.py", line 32, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 384, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neomaster' {'--cluster': 'neo_60', '--bind': '127.0.0.1:22888', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testCluster.ClusterTests.testLeavingOperationalStateDropClientNodes/master_0.log', '--name': 'master_0', '--partitions': 1, '--uuid': '963e8418959acae84b0b0136489cae17', '--masters': '127.0.0.1:22888', '--replicas': 0} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testCluster.ClusterTests.testStorageLostDuringRecovery
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testCluster.py", line 32, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 384, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neomaster' {'--cluster': 'neo_25', '--bind': '127.0.0.1:19663', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testCluster.ClusterTests.testStorageLostDuringRecovery/master_0.log', '--name': 'master_0', '--partitions': 10, '--uuid': 'a0bffe3e212a98830c9e3b926d7199d4', '--masters': '127.0.0.1:19663', '--replicas': 1} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testConflictingStorageRejected
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 45, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 384, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neomaster' {'--cluster': 'neo_80', '--bind': '127.0.0.1:31159', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testStorage.StorageTests.testConflictingStorageRejected/master_1.log', '--name': 'master_1', '--partitions': 10, '--uuid': '8107ffc3b664b0280c1e8ece9996d222', '--masters': '127.0.0.1:29000 127.0.0.1:31159', '--replicas': 1} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testDropNodeWithOtherPending
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 45, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 384, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neomaster' {'--cluster': 'neo_13', '--bind': '127.0.0.1:20636', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testStorage.StorageTests.testDropNodeWithOtherPending/master_0.log', '--name': 'master_0', '--partitions': 10, '--uuid': '3558cdffe82d1433988d4a51b6b7de20', '--masters': '127.0.0.1:20636 127.0.0.1:27800', '--replicas': 1} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testNewNodesInPendingState
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 45, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 384, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neomaster' {'--cluster': 'neo_83', '--bind': '127.0.0.1:28387', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testStorage.StorageTests.testNewNodesInPendingState/master_0.log', '--name': 'master_0', '--partitions': 10, '--uuid': 'e928faf2be43834cd347ed19d1ebde9e', '--masters': '127.0.0.1:28387 127.0.0.1:18404', '--replicas': 1} exited with status 1
'neomaster' {'--cluster': 'neo_83', '--bind': '127.0.0.1:18404', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testStorage.StorageTests.testNewNodesInPendingState/master_1.log', '--name': 'master_1', '--partitions': 10, '--uuid': '0289ae286053a3f6c9b2b0164ebac347', '--masters': '127.0.0.1:28387 127.0.0.1:18404', '--replicas': 1} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testPartitionTableReorganizedAfterDrop
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 45, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 384, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neomaster' {'--cluster': 'neo_67', '--bind': '127.0.0.1:20580', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testStorage.StorageTests.testPartitionTableReorganizedAfterDrop/master_0.log', '--name': 'master_0', '--partitions': 10, '--uuid': '474d7a64f8791f9a6b19ce929b08d916', '--masters': '127.0.0.1:20580 127.0.0.1:26865', '--replicas': 1} exited with status 1
'neomaster' {'--cluster': 'neo_67', '--bind': '127.0.0.1:26865', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testStorage.StorageTests.testPartitionTableReorganizedAfterDrop/master_1.log', '--name': 'master_1', '--partitions': 10, '--uuid': '3138ab07e6c6623b043b52ee4f940456', '--masters': '127.0.0.1:20580 127.0.0.1:26865', '--replicas': 1} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testPartitionTableReorganizedWithNewStorage
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 45, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 384, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neomaster' {'--cluster': 'neo_82', '--bind': '127.0.0.1:16792', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testStorage.StorageTests.testPartitionTableReorganizedWithNewStorage/master_0.log', '--name': 'master_0', '--partitions': 10, '--uuid': 'f37f2df3b2f791f4d90ee38315d26adf', '--masters': '127.0.0.1:16792 127.0.0.1:30274', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_82', '--bind': '127.0.0.1:30274', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testStorage.StorageTests.testPartitionTableReorganizedWithNewStorage/master_1.log', '--name': 'master_1', '--partitions': 10, '--uuid': '29034c7c0ea0976df7fd38baa6b9469c', '--masters': '127.0.0.1:16792 127.0.0.1:30274', '--replicas': 0} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testRecoveryWithMultiplePT
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 45, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 384, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neomaster' {'--cluster': 'neo_74', '--bind': '127.0.0.1:22246', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testStorage.StorageTests.testRecoveryWithMultiplePT/master_0.log', '--name': 'master_0', '--partitions': 10, '--uuid': '2c89d00e99ece59369a1be515cb06bbe', '--masters': '127.0.0.1:22246 127.0.0.1:19694', '--replicas': 1} exited with status 1
'neomaster' {'--cluster': 'neo_74', '--bind': '127.0.0.1:19694', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testStorage.StorageTests.testRecoveryWithMultiplePT/master_1.log', '--name': 'master_1', '--partitions': 10, '--uuid': 'e854db79abb66d8bdc0b5a41a2760662', '--masters': '127.0.0.1:22246 127.0.0.1:19694', '--replicas': 1} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testReplicationWithNewStorage
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 45, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 384, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neomaster' {'--cluster': 'neo_47', '--bind': '127.0.0.1:25032', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testStorage.StorageTests.testReplicationWithNewStorage/master_0.log', '--name': 'master_0', '--partitions': 10, '--uuid': '805907ccfc38e7ac6ecf6602bf4e96a3', '--masters': '127.0.0.1:25032 127.0.0.1:23842', '--replicas': 1} exited with status 1
'neomaster' {'--cluster': 'neo_47', '--bind': '127.0.0.1:23842', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testStorage.StorageTests.testReplicationWithNewStorage/master_1.log', '--name': 'master_1', '--partitions': 10, '--uuid': '7fc97505f6e9597a9d2f6b555b9991c9', '--masters': '127.0.0.1:25032 127.0.0.1:23842', '--replicas': 1} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testSequentialStorageKill
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 45, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 384, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neomaster' {'--cluster': 'neo_93', '--bind': '127.0.0.1:26810', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testStorage.StorageTests.testSequentialStorageKill/master_0.log', '--name': 'master_0', '--partitions': 10, '--uuid': 'dee3671a7e4dd9c7847345fa7eb95ce4', '--masters': '127.0.0.1:26810 127.0.0.1:18462', '--replicas': 2} exited with status 1
'neomaster' {'--cluster': 'neo_93', '--bind': '127.0.0.1:18462', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testStorage.StorageTests.testSequentialStorageKill/master_1.log', '--name': 'master_1', '--partitions': 10, '--uuid': 'd3ec0ad28c40070451eec40b10ae5a9a', '--masters': '127.0.0.1:26810 127.0.0.1:18462', '--replicas': 2} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testStartWithManyPartitions
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 45, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 384, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neomaster' {'--cluster': 'neo_73', '--bind': '127.0.0.1:26552', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testStorage.StorageTests.testStartWithManyPartitions/master_0.log', '--name': 'master_0', '--partitions': 5000, '--uuid': 'e84f9de65677b1d1fb27df14b3c511fd', '--masters': '127.0.0.1:26552', '--replicas': 1} exited with status 1
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testVerificationTriggered
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 45, in tearDown
    self.neo.stop()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 384, in stop
    raise NodeProcessError('\n'.join(error_list))
NodeProcessError: 'neomaster' {'--cluster': 'neo_96', '--bind': '127.0.0.1:32751', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testStorage.StorageTests.testVerificationTriggered/master_0.log', '--name': 'master_0', '--partitions': 10, '--uuid': '551575734c269093f54aa453fb5edf9c', '--masters': '127.0.0.1:32751 127.0.0.1:27770', '--replicas': 0} exited with status 1
'neomaster' {'--cluster': 'neo_96', '--bind': '127.0.0.1:27770', '--verbose': True, '--logfile': '/tmp/neo_tests/1326118568.917418/neo.tests.functional.testStorage.StorageTests.testVerificationTriggered/master_1.log', '--name': 'master_1', '--partitions': 10, '--uuid': '2a8bfe2356933b4f55c88a5385afccca', '--masters': '127.0.0.1:32751 127.0.0.1:27770', '--replicas': 0} exited with status 1
-------------------------------------------------------------

neo.tests.zodb.testBasic.BasicTests.checkAbortAfterVote
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testBasic.BasicTests.checkBasics
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testBasic.BasicTests.checkConflicts
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testBasic.BasicTests.checkGetSize
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testBasic.BasicTests.checkGetTid
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testBasic.BasicTests.checkInterfaces
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testBasic.BasicTests.checkLen
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testBasic.BasicTests.checkMultipleEmptyTransactions
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testBasic.BasicTests.checkNote
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testBasic.BasicTests.checkSerialIsNoneForInitialRevision
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testBasic.BasicTests.checkStore
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testBasic.BasicTests.checkStoreAndLoad
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testBasic.BasicTests.checkStoreTwoObjects
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testBasic.BasicTests.checkWriteAfterAbort
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testBasic.BasicTests.check_checkCurrentSerialInTransaction
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testBasic.BasicTests.check_tid_ordering_w_commit
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testConflict.ConflictTests.checkBuggyResolve1
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testConflict.ConflictTests.checkBuggyResolve2
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testConflict.ConflictTests.checkResolve
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testConflict.ConflictTests.checkUnresolvable
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testConflict.ConflictTests.checkZClassesArentResolved
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testHistory.HistoryTests.checkSimpleHistory
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testIterator.IteratorTests.checkExtendedIteration
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testIterator.IteratorTests.checkIterateRecordsRepeatedly
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testIterator.IteratorTests.checkIterateRepeatedly
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testIterator.IteratorTests.checkIterateWhileWriting
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testIterator.IteratorTests.checkIterationIntraTransaction
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testIterator.IteratorTests.checkLoad_was_checkLoadEx
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testIterator.IteratorTests.checkSimpleIteration
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testIterator.IteratorTests.checkTransactionExtensionFromIterator
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testIterator.IteratorTests.checkUndoZombie
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testMT.MTTests.check2StorageThreads
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testMT.MTTests.check2ZODBThreads
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testMT.MTTests.check4ExtStorageThread
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testMT.MTTests.check7StorageThreads
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testMT.MTTests.check7ZODBThreads
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testPack.PackableTests.checkPackAllRevisions
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/testPack.py", line 34, in setUp
    super(PackableTests, self).setUp(cluster_kw={'adapter': 'MySQL'})
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testPack.PackableTests.checkPackAllRevisionsNoGC
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/testPack.py", line 34, in setUp
    super(PackableTests, self).setUp(cluster_kw={'adapter': 'MySQL'})
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testPack.PackableTests.checkPackEmptyStorage
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/testPack.py", line 34, in setUp
    super(PackableTests, self).setUp(cluster_kw={'adapter': 'MySQL'})
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testPack.PackableTests.checkPackJustOldRevisions
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/testPack.py", line 34, in setUp
    super(PackableTests, self).setUp(cluster_kw={'adapter': 'MySQL'})
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testPack.PackableTests.checkPackLotsWhileWriting
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/testPack.py", line 34, in setUp
    super(PackableTests, self).setUp(cluster_kw={'adapter': 'MySQL'})
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testPack.PackableTests.checkPackNowWhileWriting
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/testPack.py", line 34, in setUp
    super(PackableTests, self).setUp(cluster_kw={'adapter': 'MySQL'})
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testPack.PackableTests.checkPackOnlyOneObject
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/testPack.py", line 34, in setUp
    super(PackableTests, self).setUp(cluster_kw={'adapter': 'MySQL'})
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testPack.PackableTests.checkPackTomorrow
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/testPack.py", line 34, in setUp
    super(PackableTests, self).setUp(cluster_kw={'adapter': 'MySQL'})
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testPack.PackableTests.checkPackUndoLog
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/testPack.py", line 34, in setUp
    super(PackableTests, self).setUp(cluster_kw={'adapter': 'MySQL'})
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testPack.PackableTests.checkPackUnlinkedFromRoot
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/testPack.py", line 34, in setUp
    super(PackableTests, self).setUp(cluster_kw={'adapter': 'MySQL'})
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testPack.PackableTests.checkPackWhileWriting
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/testPack.py", line 34, in setUp
    super(PackableTests, self).setUp(cluster_kw={'adapter': 'MySQL'})
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testPack.PackableTests.checkPackWithMultiDatabaseReferences
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/testPack.py", line 34, in setUp
    super(PackableTests, self).setUp(cluster_kw={'adapter': 'MySQL'})
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testPack.PackableTests.checkPackYesterday
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/testPack.py", line 34, in setUp
    super(PackableTests, self).setUp(cluster_kw={'adapter': 'MySQL'})
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testPack.PackableTests.checkRedundantPack
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/testPack.py", line 34, in setUp
    super(PackableTests, self).setUp(cluster_kw={'adapter': 'MySQL'})
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testPersistent.PersistentTests.checkUpdatesPersist
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testReadOnly.ReadOnlyTests.checkReadMethods
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testReadOnly.ReadOnlyTests.checkWriteMethods
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testRevision.RevisionTests.checkLoadBefore
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testRevision.RevisionTests.checkLoadBeforeConsecutiveTids
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testRevision.RevisionTests.checkLoadBeforeCreation
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testRevision.RevisionTests.checkLoadBeforeEdges
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testRevision.RevisionTests.checkLoadBeforeOld
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testRevision.RevisionTests.checkLoadBeforeUndo
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testRevision.RevisionTests.checkLoadSerial
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testSynchronization.SynchronizationTests.checkAbortNotCommitting
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testSynchronization.SynchronizationTests.checkAbortWrongTrans
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testSynchronization.SynchronizationTests.checkBeginCommitting
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testSynchronization.SynchronizationTests.checkFinishNotCommitting
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testSynchronization.SynchronizationTests.checkFinishWrongTrans
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testSynchronization.SynchronizationTests.checkStoreNotCommitting
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testSynchronization.SynchronizationTests.checkStoreWrongTrans
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testUndo.UndoTests.checkCreationUndoneGetTid
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testUndo.UndoTests.checkIndicesInUndoInfo
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testUndo.UndoTests.checkIndicesInUndoLog
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testUndo.UndoTests.checkNotUndoable
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testUndo.UndoTests.checkPackAfterUndoDeletion
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testUndo.UndoTests.checkPackAfterUndoManyTimes
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testUndo.UndoTests.checkSimpleTransactionalUndo
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testUndo.UndoTests.checkTransactionalUndoAfterPack
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testUndo.UndoTests.checkTransactionalUndoAfterPackWithObjectUnlinkFromRoot
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testUndo.UndoTests.checkTwoObjectUndo
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testUndo.UndoTests.checkTwoObjectUndoAgain
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testUndo.UndoTests.checkTwoObjectUndoAtOnce
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testUndo.UndoTests.checkUndoConflictResolution
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testUndo.UndoTests.checkUndoCreationBranch1
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testUndo.UndoTests.checkUndoCreationBranch2
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testUndo.UndoTests.checkUndoLogMetadata
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testUndo.UndoTests.checkUndoUnresolvable
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testZODB.NEOZODBTests.checkExplicitTransactionManager
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/testZODB.py", line 27, in setUp
    super(NEOZODBTests, self).setUp()
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testZODB.NEOZODBTests.checkExportImport
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/testZODB.py", line 27, in setUp
    super(NEOZODBTests, self).setUp()
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testZODB.NEOZODBTests.checkExportImportAborted
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/testZODB.py", line 27, in setUp
    super(NEOZODBTests, self).setUp()
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testZODB.NEOZODBTests.checkFailingCommitSticks
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/testZODB.py", line 27, in setUp
    super(NEOZODBTests, self).setUp()
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testZODB.NEOZODBTests.checkFailingSavepointSticks
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/testZODB.py", line 27, in setUp
    super(NEOZODBTests, self).setUp()
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testZODB.NEOZODBTests.checkMultipleUndoInOneTransaction
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/testZODB.py", line 27, in setUp
    super(NEOZODBTests, self).setUp()
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testZODB.NEOZODBTests.checkResetCache
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/testZODB.py", line 27, in setUp
    super(NEOZODBTests, self).setUp()
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testZODB.NEOZODBTests.checkResetCachesAPI
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/testZODB.py", line 27, in setUp
    super(NEOZODBTests, self).setUp()
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testZODB.NEOZODBTests.checkSavepointDoesntGetInvalidations
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/testZODB.py", line 27, in setUp
    super(NEOZODBTests, self).setUp()
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.zodb.testZODB.NEOZODBTests.checkTxnBeginImpliesAbort
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/zodb/testZODB.py", line 27, in setUp
    super(NEOZODBTests, self).setUp()
  File "/home/neo/master/neoppod/neo/tests/zodb/__init__.py", line 42, in setUp
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------


FAILURES:
neo.tests.master.testElectionHandler.MasterClientElectionTests.test_connectionClosed
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/master/testElectionHandler.py", line 99, in test_connectionClosed
    self.assertTrue(node.isUnknown())
AssertionError
-------------------------------------------------------------

neo.tests.master.testElectionHandler.MasterClientElectionTests.test_connectionCompleted
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/master/testElectionHandler.py", line 83, in test_connectionCompleted
    self.assertTrue(node.isUnknown())
AssertionError
-------------------------------------------------------------

neo.tests.master.testElectionHandler.MasterClientElectionTests.test_connectionFailed
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/master/testElectionHandler.py", line 75, in test_connectionFailed
    self.assertTrue(node.isUnknown())
AssertionError
-------------------------------------------------------------

neo.tests.master.testElectionHandler.MasterServerElectionTests.testAnnouncePrimary1
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/master/testElectionHandler.py", line 284, in testAnnouncePrimary1
    self.assertRaises(ElectionFailure, announce, conn)
AssertionError: ElectionFailure not raised
-------------------------------------------------------------

neo.tests.functional.testClient.ClientTests.testConflictResolutionTriggered1
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testClient.py", line 101, in testConflictResolutionTriggered1
    self.__setup()
  File "/home/neo/master/neoppod/neo/tests/functional/testClient.py", line 88, in __setup
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testClient.ClientTests.testDelayedLocksCancelled
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testClient.py", line 316, in testDelayedLocksCancelled
    self.runWithTimeout(10, test)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 645, in runWithTimeout
    self.assertFalse(thread.isAlive(), 'Run timeout')
AssertionError: Run timeout
-------------------------------------------------------------

neo.tests.functional.testClient.ClientTests.testExport
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testClient.py", line 211, in testExport
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testClient.ClientTests.testExportFileStorageBug
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testClient.py", line 228, in testExportFileStorageBug
    self.testExport(True)
  File "/home/neo/master/neoppod/neo/tests/functional/testClient.py", line 211, in testExport
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testClient.ClientTests.testGreaterOIDSaved
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testClient.py", line 327, in testGreaterOIDSaved
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testClient.ClientTests.testIPv6Client
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testClient.py", line 270, in testIPv6Client
    self.runWithTimeout(40, test)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 638, in excWrapper
    method(*args, **kw)
  File "/home/neo/master/neoppod/neo/tests/functional/testClient.py", line 267, in test
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testClient.ClientTests.testImport
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testClient.py", line 198, in testImport
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testClient.ClientTests.testIsolationAtZopeLevel
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testClient.py", line 123, in testIsolationAtZopeLevel
    self.__setup()
  File "/home/neo/master/neoppod/neo/tests/functional/testClient.py", line 88, in __setup
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testClient.ClientTests.testIsolationWithoutZopeCache
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testClient.py", line 141, in testIsolationWithoutZopeCache
    self.__setup()
  File "/home/neo/master/neoppod/neo/tests/functional/testClient.py", line 88, in __setup
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testClient.ClientTests.testLockTimeout
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testClient.py", line 253, in testLockTimeout
    self.runWithTimeout(40, test)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 638, in excWrapper
    method(*args, **kw)
  File "/home/neo/master/neoppod/neo/tests/functional/testClient.py", line 236, in test
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testCluster.ClusterTests.testClusterBreaks
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testCluster.py", line 81, in testClusterBreaks
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testCluster.ClusterTests.testClusterBreaksWithTwoNodes
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testCluster.py", line 93, in testClusterBreaksWithTwoNodes
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testCluster.ClusterTests.testClusterDoesntBreakWithTwoNodesOneReplica
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testCluster.py", line 105, in testClusterDoesntBreakWithTwoNodesOneReplica
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testCluster.ClusterTests.testClusterStartup
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testCluster.py", line 39, in testClusterStartup
    neo.run()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testCluster.ClusterTests.testElectionWithManyMasters
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testCluster.py", line 117, in testElectionWithManyMasters
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testCluster.ClusterTests.testLeavingOperationalStateDropClientNodes
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testCluster.py", line 131, in testLeavingOperationalStateDropClientNodes
    self.neo.start()
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testCluster.ClusterTests.testStorageLostDuringRecovery
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testCluster.py", line 161, in testStorageLostDuringRecovery
    self.neo.run(except_storages=storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testConflictingStorageRejected
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 275, in testConflictingStorageRejected
    (started, stopped) = self.__setup(storage_number=2, pending_number=1)
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 70, in __setup
    self.neo.start(except_storages=stopped_processes)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testDropNodeWithOtherPending
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 407, in testDropNodeWithOtherPending
    pending_number=1, partitions=10)
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 70, in __setup
    self.neo.start(except_storages=stopped_processes)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testNewNodesInPendingState
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 145, in testNewNodesInPendingState
    processes = self.__setup(storage_number=3, replicas=1, pending_number=2)
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 70, in __setup
    self.neo.start(except_storages=stopped_processes)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testOudatedCellsOnDownStorage
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 192, in testOudatedCellsOnDownStorage
    (started, _) = self.__setup(storage_number=2, replicas=1)
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 70, in __setup
    self.neo.start(except_storages=stopped_processes)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testPartitionTableReorganizedAfterDrop
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 326, in testPartitionTableReorganizedAfterDrop
    partitions=10, pending_number=0)
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 70, in __setup
    self.neo.start(except_storages=stopped_processes)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testPartitionTableReorganizedWithNewStorage
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 301, in testPartitionTableReorganizedWithNewStorage
    partitions=10, replicas=0)
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 70, in __setup
    self.neo.start(except_storages=stopped_processes)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testRecoveryWithMultiplePT
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 423, in testRecoveryWithMultiplePT
    pending_number=0, partitions=10)
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 70, in __setup
    self.neo.start(except_storages=stopped_processes)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testReplicationThenRunningWithReplicas
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 353, in testReplicationThenRunningWithReplicas
    pending_number=1, partitions=10)
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 70, in __setup
    self.neo.start(except_storages=stopped_processes)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testReplicationWithNewStorage
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 165, in testReplicationWithNewStorage
    partitions=10)
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 70, in __setup
    self.neo.start(except_storages=stopped_processes)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testSequentialStorageKill
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 239, in testSequentialStorageKill
    (started, _) = self.__setup(replicas=2, storage_number=3, partitions=10)
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 70, in __setup
    self.neo.start(except_storages=stopped_processes)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testStartWithManyPartitions
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 400, in testStartWithManyPartitions
    self.__setup(storage_number=2, partitions=5000, master_count=1)
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 70, in __setup
    self.neo.start(except_storages=stopped_processes)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------

neo.tests.functional.testStorage.StorageTests.testVerificationTriggered
-------------------------------------------------------------
Traceback (most recent call last):
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 211, in testVerificationTriggered
    (started, _) = self.__setup(replicas=0, storage_number=1)
  File "/home/neo/master/neoppod/neo/tests/functional/testStorage.py", line 70, in __setup
    self.neo.start(except_storages=stopped_processes)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 341, in start
    self.run(except_storages=except_storages)
  File "/home/neo/master/neoppod/neo/tests/functional/__init__.py", line 336, in run
    raise AssertionError('Timeout when starting cluster')
AssertionError: Timeout when starting cluster
-------------------------------------------------------------






More information about the Neo-report mailing list