LocalCluster.shutdown seems to return before all services are completely stopped

The tests for storm-esper create a new local cluster in the setUp method and shut it down (with killTopology followed by shutdown) in the tearDown method. Unfortunately, when the shutdown method returns it seems as if not everything is stopped yet (e.g. zookeeper), and so the next tests interact with the still-running services and fail because they are in the process of shutting down (sorry for the long stacktrace, this is with debug enabled):
INFO 2012-01-23 04:45:22,573  main backtype.storm.zookeeper Starting inprocess zookeeper at port 2181 and dir /var/folders/04/nrrmlfvx05l43fj6rljc2z400000gq/T//6ddda619-0f31-4624-8842-556ecdb128e1
INFO 2012-01-23 04:45:22,584  main org.apache.zookeeper.server.ZooKeeperServer Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 datadir /var/folders/04/nrrmlfvx05l43fj6rljc2z400000gq/T/6ddda619-0f31-4624-8842-556ecdb128e1/version-2 snapdir /var/folders/04/nrrmlfvx05l43fj6rljc2z400000gq/T/6ddda619-0f31-4624-8842-556ecdb128e1/version-2
INFO 2012-01-23 04:45:22,598  main org.apache.zookeeper.server.NIOServerCnxn binding to port <IP_ADDRESS>/<IP_ADDRESS>:2181
INFO 2012-01-23 04:45:22,607  main org.apache.zookeeper.server.persistence.FileTxnSnapLog Snapshotting: 0
INFO 2012-01-23 04:45:22,757  main backtype.storm.daemon.nimbus Starting Nimbus with conf {"topology.fall.back.on.java.serialization" true, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "nimbus.monitor.freq.secs" 10, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "storm.local.dir" "/var/folders/04/nrrmlfvx05l43fj6rljc2z400000gq/T//e4d62f55-b330-4689-9b86-bc0f6c1e6277", "supervisor.worker.start.timeout.secs" 240, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "storm.zookeeper.port" 2181, "storm.zookeeper.root" "/storm", "supervisor.enable" true, "topology.worker.childopts" nil, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "task.heartbeat.frequency.secs" 3, "topology.max.spout.pending" nil, "supervisor.slots.ports" [6700 6701 6702 6703], "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx1024m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "nimbus.task.timeout.secs" 30, "drpc.invocations.port" 3773, "zmq.threads" 1, "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "topology.ackers" 1, "storm.cluster.mode" "local", "topology.optimize" true, "topology.max.task.parallelism" nil}
INFO 2012-01-23 04:45:22,792  main com.netflix.curator.framework.imps.CuratorFrameworkImpl Starting
INFO 2012-01-23 04:45:22,794  main org.apache.zookeeper.ZooKeeper Initiating client connection, connectString=/ sessionTimeout=10000 watcher=com.netflix.curator.ConnectionState@77bdbf9d
INFO 2012-01-23 04:45:22,805  main-SendThread() org.apache.zookeeper.ClientCnxn Opening socket connection to server localhost/<IP_ADDRESS>:2181
INFO 2012-01-23 04:45:22,808  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Socket connection established to localhost/<IP_ADDRESS>:2181, initiating session
INFO 2012-01-23 04:45:22,812  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Accepted socket connection from /<IP_ADDRESS>:60772
INFO 2012-01-23 04:45:22,815  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Client attempting to establish new session at /<IP_ADDRESS>:60772
INFO 2012-01-23 04:45:22,817  SyncThread:0 org.apache.zookeeper.server.persistence.FileTxnLog Creating new log file: log.1
INFO 2012-01-23 04:45:22,835  SyncThread:0 org.apache.zookeeper.server.NIOServerCnxn Established session 0x13508e1fd480000 with negotiated timeout 10000 for client /<IP_ADDRESS>:60772
INFO 2012-01-23 04:45:22,835  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Session establishment complete on server localhost/<IP_ADDRESS>:2181, sessionid = 0x13508e1fd480000, negotiated timeout = 10000
INFO 2012-01-23 04:45:22,838  main-EventThread backtype.storm.zookeeper Zookeeper state update: :connected:none
INFO 2012-01-23 04:45:22,857  ProcessThread:-1 org.apache.zookeeper.server.PrepRequestProcessor Processed session termination for sessionid: 0x13508e1fd480000
INFO 2012-01-23 04:45:22,858  main-EventThread org.apache.zookeeper.ClientCnxn EventThread shut down
INFO 2012-01-23 04:45:22,858  main org.apache.zookeeper.ZooKeeper Session: 0x13508e1fd480000 closed
INFO 2012-01-23 04:45:22,859  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Closed socket connection for client /<IP_ADDRESS>:60772 which had sessionid 0x13508e1fd480000
INFO 2012-01-23 04:45:22,860  main com.netflix.curator.framework.imps.CuratorFrameworkImpl Starting
INFO 2012-01-23 04:45:22,860  main org.apache.zookeeper.ZooKeeper Initiating client connection, connectString=/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@9ad5d46
INFO 2012-01-23 04:45:22,861  main-SendThread() org.apache.zookeeper.ClientCnxn Opening socket connection to server localhost/<IP_ADDRESS>:2181
INFO 2012-01-23 04:45:22,861  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Accepted socket connection from /<IP_ADDRESS>:60773
INFO 2012-01-23 04:45:22,861  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Socket connection established to localhost/<IP_ADDRESS>:2181, initiating session
INFO 2012-01-23 04:45:22,861  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Client attempting to establish new session at /<IP_ADDRESS>:60773
INFO 2012-01-23 04:45:22,862  SyncThread:0 org.apache.zookeeper.server.NIOServerCnxn Established session 0x13508e1fd480001 with negotiated timeout 20000 for client /<IP_ADDRESS>:60773
INFO 2012-01-23 04:45:22,862  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Session establishment complete on server localhost/<IP_ADDRESS>:2181, sessionid = 0x13508e1fd480001, negotiated timeout = 20000
INFO 2012-01-23 04:45:22,898  main com.netflix.curator.framework.imps.CuratorFrameworkImpl Starting
INFO 2012-01-23 04:45:22,898  main org.apache.zookeeper.ZooKeeper Initiating client connection, connectString=/ sessionTimeout=10000 watcher=com.netflix.curator.ConnectionState@313816e0
INFO 2012-01-23 04:45:22,898  main-SendThread() org.apache.zookeeper.ClientCnxn Opening socket connection to server localhost/<IP_ADDRESS>:2181
INFO 2012-01-23 04:45:22,899  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Socket connection established to localhost/<IP_ADDRESS>:2181, initiating session
INFO 2012-01-23 04:45:22,899  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Accepted socket connection from /<IP_ADDRESS>:60774
INFO 2012-01-23 04:45:22,899  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Client attempting to establish new session at /<IP_ADDRESS>:60774
INFO 2012-01-23 04:45:22,900  SyncThread:0 org.apache.zookeeper.server.NIOServerCnxn Established session 0x13508e1fd480002 with negotiated timeout 10000 for client /<IP_ADDRESS>:60774
INFO 2012-01-23 04:45:22,900  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Session establishment complete on server localhost/<IP_ADDRESS>:2181, sessionid = 0x13508e1fd480002, negotiated timeout = 10000
INFO 2012-01-23 04:45:22,900  main-EventThread backtype.storm.zookeeper Zookeeper state update: :connected:none
INFO 2012-01-23 04:45:22,902  ProcessThread:-1 org.apache.zookeeper.server.PrepRequestProcessor Processed session termination for sessionid: 0x13508e1fd480002
INFO 2012-01-23 04:45:22,903  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Closed socket connection for client /<IP_ADDRESS>:60774 which had sessionid 0x13508e1fd480002
INFO 2012-01-23 04:45:22,903  main-EventThread org.apache.zookeeper.ClientCnxn EventThread shut down
INFO 2012-01-23 04:45:22,904  main org.apache.zookeeper.ZooKeeper Session: 0x13508e1fd480002 closed
INFO 2012-01-23 04:45:22,904  main com.netflix.curator.framework.imps.CuratorFrameworkImpl Starting
INFO 2012-01-23 04:45:22,904  main org.apache.zookeeper.ZooKeeper Initiating client connection, connectString=/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@252a78ee
INFO 2012-01-23 04:45:22,905  main-SendThread() org.apache.zookeeper.ClientCnxn Opening socket connection to server localhost/<IP_ADDRESS>:2181
INFO 2012-01-23 04:45:22,905  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Socket connection established to localhost/<IP_ADDRESS>:2181, initiating session
INFO 2012-01-23 04:45:22,905  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Accepted socket connection from /<IP_ADDRESS>:60775
INFO 2012-01-23 04:45:22,905  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Client attempting to establish new session at /<IP_ADDRESS>:60775
INFO 2012-01-23 04:45:22,906  SyncThread:0 org.apache.zookeeper.server.NIOServerCnxn Established session 0x13508e1fd480003 with negotiated timeout 20000 for client /<IP_ADDRESS>:60775
INFO 2012-01-23 04:45:22,906  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Session establishment complete on server localhost/<IP_ADDRESS>:2181, sessionid = 0x13508e1fd480003, negotiated timeout = 20000
INFO 2012-01-23 04:45:22,907  main com.netflix.curator.framework.imps.CuratorFrameworkImpl Starting
INFO 2012-01-23 04:45:22,907  main org.apache.zookeeper.ZooKeeper Initiating client connection, connectString=/ sessionTimeout=10000 watcher=com.netflix.curator.ConnectionState@4eb64f2e
INFO 2012-01-23 04:45:22,908  main-SendThread() org.apache.zookeeper.ClientCnxn Opening socket connection to server localhost/<IP_ADDRESS>:2181
INFO 2012-01-23 04:45:22,908  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Socket connection established to localhost/<IP_ADDRESS>:2181, initiating session
INFO 2012-01-23 04:45:22,908  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Accepted socket connection from /<IP_ADDRESS>:60776
INFO 2012-01-23 04:45:22,908  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Client attempting to establish new session at /<IP_ADDRESS>:60776
INFO 2012-01-23 04:45:22,909  SyncThread:0 org.apache.zookeeper.server.NIOServerCnxn Established session 0x13508e1fd480004 with negotiated timeout 10000 for client /<IP_ADDRESS>:60776
INFO 2012-01-23 04:45:22,909  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Session establishment complete on server localhost/<IP_ADDRESS>:2181, sessionid = 0x13508e1fd480004, negotiated timeout = 10000
INFO 2012-01-23 04:45:22,910  main-EventThread backtype.storm.zookeeper Zookeeper state update: :connected:none
INFO 2012-01-23 04:45:22,912  ProcessThread:-1 org.apache.zookeeper.server.PrepRequestProcessor Processed session termination for sessionid: 0x13508e1fd480004
INFO 2012-01-23 04:45:22,917  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Closed socket connection for client /<IP_ADDRESS>:60776 which had sessionid 0x13508e1fd480004
INFO 2012-01-23 04:45:22,917  main-EventThread org.apache.zookeeper.ClientCnxn EventThread shut down
INFO 2012-01-23 04:45:22,917  main org.apache.zookeeper.ZooKeeper Session: 0x13508e1fd480004 closed
INFO 2012-01-23 04:45:22,918  main com.netflix.curator.framework.imps.CuratorFrameworkImpl Starting
INFO 2012-01-23 04:45:22,926  main org.apache.zookeeper.ZooKeeper Initiating client connection, connectString=/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@1ae2b9e5
INFO 2012-01-23 04:45:22,927  main-SendThread() org.apache.zookeeper.ClientCnxn Opening socket connection to server localhost/<IP_ADDRESS>:2181
INFO 2012-01-23 04:45:22,928  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Accepted socket connection from /<IP_ADDRESS>:60777
INFO 2012-01-23 04:45:22,928  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Socket connection established to localhost/<IP_ADDRESS>:2181, initiating session
INFO 2012-01-23 04:45:22,928  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Client attempting to establish new session at /<IP_ADDRESS>:60777
INFO 2012-01-23 04:45:22,929  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Session establishment complete on server localhost/<IP_ADDRESS>:2181, sessionid = 0x13508e1fd480005, negotiated timeout = 20000
INFO 2012-01-23 04:45:22,929  SyncThread:0 org.apache.zookeeper.server.NIOServerCnxn Established session 0x13508e1fd480005 with negotiated timeout 20000 for client /<IP_ADDRESS>:60777
INFO 2012-01-23 04:45:22,958  main backtype.storm.daemon.supervisor Starting Supervisor with conf {"topology.fall.back.on.java.serialization" true, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "nimbus.monitor.freq.secs" 10, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "storm.local.dir" "/var/folders/04/nrrmlfvx05l43fj6rljc2z400000gq/T//4572a18b-d469-4172-9d48-32ae6d44244e", "supervisor.worker.start.timeout.secs" 240, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "storm.zookeeper.port" 2181, "storm.zookeeper.root" "/storm", "supervisor.enable" true, "topology.worker.childopts" nil, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "task.heartbeat.frequency.secs" 3, "topology.max.spout.pending" nil, "supervisor.slots.ports" (1 2 3), "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx1024m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "nimbus.task.timeout.secs" 30, "drpc.invocations.port" 3773, "zmq.threads" 1, "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "topology.ackers" 1, "storm.cluster.mode" "local", "topology.optimize" true, "topology.max.task.parallelism" nil}
INFO 2012-01-23 04:45:22,963  main com.netflix.curator.framework.imps.CuratorFrameworkImpl Starting
INFO 2012-01-23 04:45:22,975  main org.apache.zookeeper.ZooKeeper Initiating client connection, connectString=/ sessionTimeout=10000 watcher=com.netflix.curator.ConnectionState@7570b819
INFO 2012-01-23 04:45:22,976  main-SendThread() org.apache.zookeeper.ClientCnxn Opening socket connection to server localhost/<IP_ADDRESS>:2181
INFO 2012-01-23 04:45:22,976  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Accepted socket connection from /<IP_ADDRESS>:60778
INFO 2012-01-23 04:45:22,976  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Socket connection established to localhost/<IP_ADDRESS>:2181, initiating session
INFO 2012-01-23 04:45:22,977  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Client attempting to establish new session at /<IP_ADDRESS>:60778
INFO 2012-01-23 04:45:22,978  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Session establishment complete on server localhost/<IP_ADDRESS>:2181, sessionid = 0x13508e1fd480006, negotiated timeout = 10000
INFO 2012-01-23 04:45:22,979  SyncThread:0 org.apache.zookeeper.server.NIOServerCnxn Established session 0x13508e1fd480006 with negotiated timeout 10000 for client /<IP_ADDRESS>:60778
INFO 2012-01-23 04:45:22,979  main-EventThread backtype.storm.zookeeper Zookeeper state update: :connected:none
INFO 2012-01-23 04:45:22,981  ProcessThread:-1 org.apache.zookeeper.server.PrepRequestProcessor Processed session termination for sessionid: 0x13508e1fd480006
INFO 2012-01-23 04:45:22,986  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Closed socket connection for client /<IP_ADDRESS>:60778 which had sessionid 0x13508e1fd480006
INFO 2012-01-23 04:45:22,986  main-EventThread org.apache.zookeeper.ClientCnxn EventThread shut down
INFO 2012-01-23 04:45:22,987  main org.apache.zookeeper.ZooKeeper Session: 0x13508e1fd480006 closed
INFO 2012-01-23 04:45:22,987  main com.netflix.curator.framework.imps.CuratorFrameworkImpl Starting
INFO 2012-01-23 04:45:22,987  main org.apache.zookeeper.ZooKeeper Initiating client connection, connectString=/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@2d9b4fac
INFO 2012-01-23 04:45:22,988  main-SendThread() org.apache.zookeeper.ClientCnxn Opening socket connection to server localhost/<IP_ADDRESS>:2181
INFO 2012-01-23 04:45:22,989  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Accepted socket connection from /<IP_ADDRESS>:60779
INFO 2012-01-23 04:45:22,989  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Socket connection established to localhost/<IP_ADDRESS>:2181, initiating session
INFO 2012-01-23 04:45:22,989  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Client attempting to establish new session at /<IP_ADDRESS>:60779
INFO 2012-01-23 04:45:22,990  SyncThread:0 org.apache.zookeeper.server.NIOServerCnxn Established session 0x13508e1fd480007 with negotiated timeout 20000 for client /<IP_ADDRESS>:60779
INFO 2012-01-23 04:45:22,990  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Session establishment complete on server localhost/<IP_ADDRESS>:2181, sessionid = 0x13508e1fd480007, negotiated timeout = 20000
INFO 2012-01-23 04:45:23,065  main backtype.storm.daemon.supervisor Starting supervisor with id 61741bfd-39bb-443a-8eff-1c8fbb6975b8 at host <IP_ADDRESS>
INFO 2012-01-23 04:45:23,096  main backtype.storm.daemon.supervisor Starting Supervisor with conf {"topology.fall.back.on.java.serialization" true, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "nimbus.monitor.freq.secs" 10, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "storm.local.dir" "/var/folders/04/nrrmlfvx05l43fj6rljc2z400000gq/T//135d7f01-8d0a-457a-a2d3-ff7714c1b16c", "supervisor.worker.start.timeout.secs" 240, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "storm.zookeeper.port" 2181, "storm.zookeeper.root" "/storm", "supervisor.enable" true, "topology.worker.childopts" nil, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "task.heartbeat.frequency.secs" 3, "topology.max.spout.pending" nil, "supervisor.slots.ports" (4 5 6), "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx1024m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "nimbus.task.timeout.secs" 30, "drpc.invocations.port" 3773, "zmq.threads" 1, "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "topology.ackers" 1, "storm.cluster.mode" "local", "topology.optimize" true, "topology.max.task.parallelism" nil}
INFO 2012-01-23 04:45:23,114  main com.netflix.curator.framework.imps.CuratorFrameworkImpl Starting
INFO 2012-01-23 04:45:23,114  main org.apache.zookeeper.ZooKeeper Initiating client connection, connectString=/ sessionTimeout=10000 watcher=com.netflix.curator.ConnectionState@7a6dd8e1
INFO 2012-01-23 04:45:23,115  main-SendThread() org.apache.zookeeper.ClientCnxn Opening socket connection to server localhost/<IP_ADDRESS>:2181
INFO 2012-01-23 04:45:23,116  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Accepted socket connection from /<IP_ADDRESS>:60780
INFO 2012-01-23 04:45:23,116  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Socket connection established to localhost/<IP_ADDRESS>:2181, initiating session
INFO 2012-01-23 04:45:23,117  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Client attempting to establish new session at /<IP_ADDRESS>:60780
INFO 2012-01-23 04:45:23,118  SyncThread:0 org.apache.zookeeper.server.NIOServerCnxn Established session 0x13508e1fd480008 with negotiated timeout 10000 for client /<IP_ADDRESS>:60780
INFO 2012-01-23 04:45:23,118  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Session establishment complete on server localhost/<IP_ADDRESS>:2181, sessionid = 0x13508e1fd480008, negotiated timeout = 10000
INFO 2012-01-23 04:45:23,118  main-EventThread backtype.storm.zookeeper Zookeeper state update: :connected:none
INFO 2012-01-23 04:45:23,121  ProcessThread:-1 org.apache.zookeeper.server.PrepRequestProcessor Processed session termination for sessionid: 0x13508e1fd480008
INFO 2012-01-23 04:45:23,125  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Closed socket connection for client /<IP_ADDRESS>:60780 which had sessionid 0x13508e1fd480008
INFO 2012-01-23 04:45:23,126  main-EventThread org.apache.zookeeper.ClientCnxn EventThread shut down
INFO 2012-01-23 04:45:23,126  main org.apache.zookeeper.ZooKeeper Session: 0x13508e1fd480008 closed
INFO 2012-01-23 04:45:23,126  main com.netflix.curator.framework.imps.CuratorFrameworkImpl Starting
INFO 2012-01-23 04:45:23,127  main org.apache.zookeeper.ZooKeeper Initiating client connection, connectString=/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@3eb8f71
INFO 2012-01-23 04:45:23,127  main-SendThread() org.apache.zookeeper.ClientCnxn Opening socket connection to server localhost/<IP_ADDRESS>:2181
INFO 2012-01-23 04:45:23,128  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Accepted socket connection from /<IP_ADDRESS>:60781
INFO 2012-01-23 04:45:23,128  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Socket connection established to localhost/<IP_ADDRESS>:2181, initiating session
INFO 2012-01-23 04:45:23,128  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Client attempting to establish new session at /<IP_ADDRESS>:60781
INFO 2012-01-23 04:45:23,129  SyncThread:0 org.apache.zookeeper.server.NIOServerCnxn Established session 0x13508e1fd480009 with negotiated timeout 20000 for client /<IP_ADDRESS>:60781
INFO 2012-01-23 04:45:23,130  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Session establishment complete on server localhost/<IP_ADDRESS>:2181, sessionid = 0x13508e1fd480009, negotiated timeout = 20000
INFO 2012-01-23 04:45:23,159  main backtype.storm.daemon.supervisor Starting supervisor with id f78f3bac-f19b-4df7-aa71-7b4fa765a4db at host <IP_ADDRESS>
INFO 2012-01-23 04:45:23,205  main backtype.storm.daemon.nimbus Received topology submission for test with conf {"topology.kryo.register" nil, "storm.id" "test-1-1327293923", "storm.zookeeper.port" 60782, "topology.debug" true, "nimbus.thrift.port" 60783}
INFO 2012-01-23 04:45:23,269  main backtype.storm.daemon.nimbus Task test-1-1327293923:1 timed out
INFO 2012-01-23 04:45:23,270  main backtype.storm.daemon.nimbus Task test-1-1327293923:2 timed out
INFO 2012-01-23 04:45:23,270  main backtype.storm.daemon.nimbus Task test-1-1327293923:3 timed out
INFO 2012-01-23 04:45:23,271  main backtype.storm.daemon.nimbus Task test-1-1327293923:4 timed out
INFO 2012-01-23 04:45:23,272  main backtype.storm.daemon.nimbus Task test-1-1327293923:5 timed out
INFO 2012-01-23 04:45:23,274  main backtype.storm.daemon.nimbus Reassigning test-1-1327293923 to 1 slots
INFO 2012-01-23 04:45:23,275  main backtype.storm.daemon.nimbus Reassign ids: [1 2 3 4 5]
INFO 2012-01-23 04:45:23,275  main backtype.storm.daemon.nimbus Available slots: (["f78f3bac-f19b-4df7-aa71-7b4fa765a4db" 4] ["f78f3bac-f19b-4df7-aa71-7b4fa765a4db" 5] ["f78f3bac-f19b-4df7-aa71-7b4fa765a4db" 6] ["61741bfd-39bb-443a-8eff-1c8fbb6975b8" 1] ["61741bfd-39bb-443a-8eff-1c8fbb6975b8" 2] ["61741bfd-39bb-443a-8eff-1c8fbb6975b8" 3])
INFO 2012-01-23 04:45:23,278  main backtype.storm.daemon.nimbus Setting new assignment for storm id test-1-1327293923: #:backtype.storm.daemon.common.Assignment{:master-code-dir "/var/folders/04/nrrmlfvx05l43fj6rljc2z400000gq/T//e4d62f55-b330-4689-9b86-bc0f6c1e6277/nimbus/stormdist/test-1-1327293923", :node->host {"f78f3bac-f19b-4df7-aa71-7b4fa765a4db" "<IP_ADDRESS>"}, :task->node+port {5 ["f78f3bac-f19b-4df7-aa71-7b4fa765a4db" 4], 4 ["f78f3bac-f19b-4df7-aa71-7b4fa765a4db" 4], 3 ["f78f3bac-f19b-4df7-aa71-7b4fa765a4db" 4], 2 ["f78f3bac-f19b-4df7-aa71-7b4fa765a4db" 4], 1 ["f78f3bac-f19b-4df7-aa71-7b4fa765a4db" 4]}, :task->start-time-secs {1<PHONE_NUMBER>, 2<PHONE_NUMBER>, 3<PHONE_NUMBER>, 4<PHONE_NUMBER>, 5<PHONE_NUMBER>}}
INFO 2012-01-23 04:45:23,286  main backtype.storm.daemon.nimbus Activating test: test-1-1327293923
INFO 2012-01-23 04:45:23,296  Thread-6 backtype.storm.daemon.supervisor Downloading code for storm id test-1-1327293923 from /var/folders/04/nrrmlfvx05l43fj6rljc2z400000gq/T//e4d62f55-b330-4689-9b86-bc0f6c1e6277/nimbus/stormdist/test-1-1327293923
INFO 2012-01-23 04:45:23,317  Thread-11 backtype.storm.daemon.supervisor Downloading code for storm id test-1-1327293923 from /var/folders/04/nrrmlfvx05l43fj6rljc2z400000gq/T//e4d62f55-b330-4689-9b86-bc0f6c1e6277/nimbus/stormdist/test-1-1327293923
INFO 2012-01-23 04:45:23,906  Thread-6 backtype.storm.daemon.supervisor Finished downloading code for storm id test-1-1327293923 from /var/folders/04/nrrmlfvx05l43fj6rljc2z400000gq/T//e4d62f55-b330-4689-9b86-bc0f6c1e6277/nimbus/stormdist/test-1-1327293923
INFO 2012-01-23 04:45:23,940  Thread-11 backtype.storm.daemon.supervisor Finished downloading code for storm id test-1-1327293923 from /var/folders/04/nrrmlfvx05l43fj6rljc2z400000gq/T//e4d62f55-b330-4689-9b86-bc0f6c1e6277/nimbus/stormdist/test-1-1327293923
INFO 2012-01-23 04:45:23,967  Thread-12 backtype.storm.daemon.supervisor Launching worker with assignment #:backtype.storm.daemon.supervisor.LocalAssignment{:storm-id "test-1-1327293923", :task-ids (5 4 3 2 1)} for this supervisor f78f3bac-f19b-4df7-aa71-7b4fa765a4db on port 4 with id c7d905d9-193b-48ae-86f4-6c12f3b3a829
INFO 2012-01-23 04:45:23,969  Thread-12 backtype.storm.daemon.worker Launching worker for test-1-1327293923 on f78f3bac-f19b-4df7-aa71-7b4fa765a4db:4 with id c7d905d9-193b-48ae-86f4-6c12f3b3a829 and conf {"topology.fall.back.on.java.serialization" true, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "nimbus.monitor.freq.secs" 10, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "storm.local.dir" "/var/folders/04/nrrmlfvx05l43fj6rljc2z400000gq/T//135d7f01-8d0a-457a-a2d3-ff7714c1b16c", "supervisor.worker.start.timeout.secs" 240, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "storm.zookeeper.port" 2181, "storm.zookeeper.root" "/storm", "supervisor.enable" true, "topology.worker.childopts" nil, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "task.heartbeat.frequency.secs" 3, "topology.max.spout.pending" nil, "supervisor.slots.ports" (4 5 6), "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx1024m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "nimbus.task.timeout.secs" 30, "drpc.invocations.port" 3773, "zmq.threads" 1, "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "topology.ackers" 1, "storm.cluster.mode" "local", "topology.optimize" true, "topology.max.task.parallelism" nil}
INFO 2012-01-23 04:45:23,969  Thread-12 com.netflix.curator.framework.imps.CuratorFrameworkImpl Starting
INFO 2012-01-23 04:45:23,969  Thread-12 org.apache.zookeeper.ZooKeeper Initiating client connection, connectString=/ sessionTimeout=10000 watcher=com.netflix.curator.ConnectionState@6fe88c7f
INFO 2012-01-23 04:45:23,970  Thread-12-SendThread() org.apache.zookeeper.ClientCnxn Opening socket connection to server localhost/<IP_ADDRESS>:2181
INFO 2012-01-23 04:45:23,972  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Accepted socket connection from /<IP_ADDRESS>:60784
INFO 2012-01-23 04:45:23,972  Thread-12-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Socket connection established to localhost/<IP_ADDRESS>:2181, initiating session
INFO 2012-01-23 04:45:23,973  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Client attempting to establish new session at /<IP_ADDRESS>:60784
INFO 2012-01-23 04:45:23,974  SyncThread:0 org.apache.zookeeper.server.NIOServerCnxn Established session 0x13508e1fd48000a with negotiated timeout 10000 for client /<IP_ADDRESS>:60784
INFO 2012-01-23 04:45:23,974  Thread-12-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Session establishment complete on server localhost/<IP_ADDRESS>:2181, sessionid = 0x13508e1fd48000a, negotiated timeout = 10000
INFO 2012-01-23 04:45:23,974  Thread-12-EventThread backtype.storm.zookeeper Zookeeper state update: :connected:none
INFO 2012-01-23 04:45:23,978  ProcessThread:-1 org.apache.zookeeper.server.PrepRequestProcessor Processed session termination for sessionid: 0x13508e1fd48000a
INFO 2012-01-23 04:45:23,979  Thread-12 org.apache.zookeeper.ZooKeeper Session: 0x13508e1fd48000a closed
INFO 2012-01-23 04:45:23,979  Thread-12 com.netflix.curator.framework.imps.CuratorFrameworkImpl Starting
INFO 2012-01-23 04:45:23,979  Thread-12 org.apache.zookeeper.ZooKeeper Initiating client connection, connectString=/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@44a64a92
INFO 2012-01-23 04:45:23,992  Thread-12-EventThread org.apache.zookeeper.ClientCnxn EventThread shut down
INFO 2012-01-23 04:45:23,993  Thread-12-SendThread() org.apache.zookeeper.ClientCnxn Opening socket connection to server localhost/<IP_ADDRESS>:2181
INFO 2012-01-23 04:45:23,993  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Closed socket connection for client /<IP_ADDRESS>:60784 which had sessionid 0x13508e1fd48000a
INFO 2012-01-23 04:45:23,993  Thread-12-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Socket connection established to localhost/<IP_ADDRESS>:2181, initiating session
INFO 2012-01-23 04:45:23,993  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Accepted socket connection from /<IP_ADDRESS>:60785
INFO 2012-01-23 04:45:23,994  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Client attempting to establish new session at /<IP_ADDRESS>:60785
INFO 2012-01-23 04:45:23,995  SyncThread:0 org.apache.zookeeper.server.NIOServerCnxn Established session 0x13508e1fd48000b with negotiated timeout 20000 for client /<IP_ADDRESS>:60785
INFO 2012-01-23 04:45:23,995  Thread-12-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Session establishment complete on server localhost/<IP_ADDRESS>:2181, sessionid = 0x13508e1fd48000b, negotiated timeout = 20000
INFO 2012-01-23 04:45:24,057  Thread-12 backtype.storm.daemon.task Loading task spout2:5
INFO 2012-01-23 04:45:24,136  Thread-12 backtype.storm.daemon.task Opening spout spout2:5
INFO 2012-01-23 04:45:24,136  Thread-12 backtype.storm.daemon.task Opened spout spout2:5
Emitting tuple [1]
INFO 2012-01-23 04:45:24,140  Thread-20 backtype.storm.daemon.task Emitting: spout2 source: spout2:5, stream: default, id: {}, [1]
INFO 2012-01-23 04:45:24,141  Thread-12 backtype.storm.daemon.task Finished loading task spout2:5
Emitting tuple [3]
INFO 2012-01-23 04:45:24,144  Thread-20 backtype.storm.daemon.task Emitting: spout2 source: spout2:5, stream: default, id: {}, [3]
Emitting tuple [2]
INFO 2012-01-23 04:45:24,145  Thread-20 backtype.storm.daemon.task Emitting: spout2 source: spout2:5, stream: default, id: {}, [2]
INFO 2012-01-23 04:45:24,157  Thread-12 backtype.storm.daemon.task Loading task spout1:4
Emitting tuple [4]
INFO 2012-01-23 04:45:24,160  Thread-20 backtype.storm.daemon.task Emitting: spout2 source: spout2:5, stream: default, id: {}, [4]
INFO 2012-01-23 04:45:24,179  Thread-12 backtype.storm.daemon.task Opening spout spout1:4
INFO 2012-01-23 04:45:24,179  Thread-12 backtype.storm.daemon.task Opened spout spout1:4
Emitting tuple [4]
INFO 2012-01-23 04:45:24,184  Thread-24 backtype.storm.daemon.task Emitting: spout1 source: spout1:4, stream: default, id: {}, [4]
Emitting tuple [2]
INFO 2012-01-23 04:45:24,185  Thread-24 backtype.storm.daemon.task Emitting: spout1 source: spout1:4, stream: default, id: {}, [2]
Emitting tuple [1]
INFO 2012-01-23 04:45:24,185  Thread-24 backtype.storm.daemon.task Emitting: spout1 source: spout1:4, stream: default, id: {}, [1]
Emitting tuple [3]
INFO 2012-01-23 04:45:24,185  Thread-24 backtype.storm.daemon.task Emitting: spout1 source: spout1:4, stream: default, id: {}, [3]
INFO 2012-01-23 04:45:24,199  Thread-12 backtype.storm.daemon.task Finished loading task spout1:4
INFO 2012-01-23 04:45:24,200  Thread-12 backtype.storm.daemon.task Loading task bolt4:3
INFO 2012-01-23 04:45:24,233  Thread-12 backtype.storm.daemon.task Preparing bolt bolt4:3
INFO 2012-01-23 04:45:24,233  Thread-12 backtype.storm.daemon.task Prepared bolt bolt4:3
INFO 2012-01-23 04:45:24,239  Thread-12 backtype.storm.daemon.task Finished loading task bolt4:3
INFO 2012-01-23 04:45:24,240  Thread-12 backtype.storm.daemon.task Loading task bolt3:2
INFO 2012-01-23 04:45:24,286  Thread-12 backtype.storm.daemon.task Preparing bolt bolt3:2
INFO 2012-01-23 04:45:24,493  Thread-12 com.espertech.esper.core.EPServiceProviderImpl Initializing engine URI 'default' version 4.3.0
INFO 2012-01-23 04:45:24,827  Thread-12 com.espertech.esper.core.EPServiceProviderImpl Initializing engine URI 'default' version 4.3.0
INFO 2012-01-23 04:45:25,841  Thread-12 backtype.storm.daemon.task Prepared bolt bolt3:2
INFO 2012-01-23 04:45:25,843  Thread-12 backtype.storm.daemon.task Finished loading task bolt3:2
INFO 2012-01-23 04:45:25,844  Thread-12 backtype.storm.daemon.task Loading task __acker:1
INFO 2012-01-23 04:45:25,879  Thread-12 backtype.storm.daemon.task Preparing bolt __acker:1
INFO 2012-01-23 04:45:25,880  Thread-12 backtype.storm.daemon.task Prepared bolt __acker:1
INFO 2012-01-23 04:45:25,880  Thread-12 backtype.storm.daemon.task Finished loading task __acker:1
INFO 2012-01-23 04:45:25,948  Thread-30 backtype.storm.daemon.task Emitting: bolt3 source: bolt3:2, stream: default, id: {}, [1, 4]
INFO 2012-01-23 04:45:25,954  Thread-12 backtype.storm.daemon.worker Worker has topology config {"storm.id" "test-1-1327293923", "topology.fall.back.on.java.serialization" true, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "nimbus.monitor.freq.secs" 10, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "storm.local.dir" "/var/folders/04/nrrmlfvx05l43fj6rljc2z400000gq/T//135d7f01-8d0a-457a-a2d3-ff7714c1b16c", "supervisor.worker.start.timeout.secs" 240, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "storm.zookeeper.port" 60782, "storm.zookeeper.root" "/storm", "supervisor.enable" true, "topology.worker.childopts" nil, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "task.heartbeat.frequency.secs" 3, "topology.max.spout.pending" nil, "supervisor.slots.ports" (4 5 6), "topology.debug" true, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.kryo.register" nil, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx1024m", "nimbus.thrift.port" 60783, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "nimbus.task.timeout.secs" 30, "drpc.invocations.port" 3773, "zmq.threads" 1, "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "topology.ackers" 1, "storm.cluster.mode" "local", "topology.optimize" true, "topology.max.task.parallelism" nil}
INFO 2012-01-23 04:45:25,955  Thread-12 backtype.storm.daemon.worker Worker c7d905d9-193b-48ae-86f4-6c12f3b3a829 for storm test-1-1327293923 on f78f3bac-f19b-4df7-aa71-7b4fa765a4db:4 has finished loading
INFO 2012-01-23 04:45:26,053  main backtype.storm.daemon.nimbus Delaying event :remove for 30 secs for test-1-1327293923
INFO 2012-01-23 04:45:26,057  main backtype.storm.daemon.nimbus Updated test-1-1327293923 with status {:type :killed, :kill-time-secs 30}
INFO 2012-01-23 04:45:26,057  main backtype.storm.daemon.nimbus Shutting down master
INFO 2012-01-23 04:45:26,059  ProcessThread:-1 org.apache.zookeeper.server.PrepRequestProcessor Processed session termination for sessionid: 0x13508e1fd480001
INFO 2012-01-23 04:45:26,059  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Closed socket connection for client /<IP_ADDRESS>:60773 which had sessionid 0x13508e1fd480001
INFO 2012-01-23 04:45:26,060  main org.apache.zookeeper.ZooKeeper Session: 0x13508e1fd480001 closed
INFO 2012-01-23 04:45:26,060  main-EventThread org.apache.zookeeper.ClientCnxn EventThread shut down
INFO 2012-01-23 04:45:26,060  main backtype.storm.daemon.nimbus Shut down master
INFO 2012-01-23 04:45:26,063  ProcessThread:-1 org.apache.zookeeper.server.PrepRequestProcessor Processed session termination for sessionid: 0x13508e1fd480003
INFO 2012-01-23 04:45:26,064  main org.apache.zookeeper.ZooKeeper Session: 0x13508e1fd480003 closed
INFO 2012-01-23 04:45:26,064  main-EventThread org.apache.zookeeper.ClientCnxn EventThread shut down
WARN 2012-01-23 04:45:26,064  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn EndOfStreamException: Unable to read additional data from client sessionid 0x13508e1fd480003, likely client has closed socket
INFO 2012-01-23 04:45:26,065  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Closed socket connection for client /<IP_ADDRESS>:60775 which had sessionid 0x13508e1fd480003
INFO 2012-01-23 04:45:26,065  ProcessThread:-1 org.apache.zookeeper.server.PrepRequestProcessor Processed session termination for sessionid: 0x13508e1fd480005
INFO 2012-01-23 04:45:26,066  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Closed socket connection for client /<IP_ADDRESS>:60777 which had sessionid 0x13508e1fd480005
INFO 2012-01-23 04:45:26,066  main org.apache.zookeeper.ZooKeeper Session: 0x13508e1fd480005 closed
INFO 2012-01-23 04:45:26,066  main-EventThread org.apache.zookeeper.ClientCnxn EventThread shut down
INFO 2012-01-23 04:45:26,067  main backtype.storm.daemon.supervisor Shutting down supervisor 61741bfd-39bb-443a-8eff-1c8fbb6975b8
INFO 2012-01-23 04:45:26,067  Thread-8 backtype.storm.util Async loop interrupted!
INFO 2012-01-23 04:45:26,067  Thread-9 backtype.storm.util Async loop interrupted!
INFO 2012-01-23 04:45:26,067  Thread-10 backtype.storm.util Async loop interrupted!
INFO 2012-01-23 04:45:26,068  Thread-6 backtype.storm.event Event manager interrupted
INFO 2012-01-23 04:45:26,068  Thread-7 backtype.storm.event Event manager interrupted
INFO 2012-01-23 04:45:26,069  ProcessThread:-1 org.apache.zookeeper.server.PrepRequestProcessor Processed session termination for sessionid: 0x13508e1fd480007
INFO 2012-01-23 04:45:26,069  main org.apache.zookeeper.ZooKeeper Session: 0x13508e1fd480007 closed
INFO 2012-01-23 04:45:26,069  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Closed socket connection for client /<IP_ADDRESS>:60779 which had sessionid 0x13508e1fd480007
INFO 2012-01-23 04:45:26,069  main-EventThread org.apache.zookeeper.ClientCnxn EventThread shut down
INFO 2012-01-23 04:45:26,069  main backtype.storm.daemon.supervisor Shutting down f78f3bac-f19b-4df7-aa71-7b4fa765a4db:c7d905d9-193b-48ae-86f4-6c12f3b3a829
INFO 2012-01-23 04:45:26,070  main backtype.storm.process-simulator Killing process 82d3d40b-ca02-4390-bd02-125dd00039cf
INFO 2012-01-23 04:45:26,070  main backtype.storm.daemon.worker Shutting down worker test-1-1327293923 f78f3bac-f19b-4df7-aa71-7b4fa765a4db 4
INFO 2012-01-23 04:45:26,070  main backtype.storm.daemon.task Shutting down task test-1-1327293923:5
INFO 2012-01-23 04:45:26,071  Thread-20 backtype.storm.util Async loop interrupted!
INFO 2012-01-23 04:45:26,071  Thread-18 backtype.storm.util Async loop interrupted!
INFO 2012-01-23 04:45:26,077  main backtype.storm.daemon.task Shut down task test-1-1327293923:5
INFO 2012-01-23 04:45:26,077  main backtype.storm.daemon.task Shutting down task test-1-1327293923:4
INFO 2012-01-23 04:45:26,077  Thread-24 backtype.storm.util Async loop interrupted!
INFO 2012-01-23 04:45:26,077  Thread-22 backtype.storm.util Async loop interrupted!
INFO 2012-01-23 04:45:26,080  main backtype.storm.daemon.task Shut down task test-1-1327293923:4
INFO 2012-01-23 04:45:26,080  main backtype.storm.daemon.task Shutting down task test-1-1327293923:3
INFO 2012-01-23 04:45:26,081  Thread-26 backtype.storm.util Async loop interrupted!
INFO 2012-01-23 04:45:26,083  main backtype.storm.daemon.task Shut down task test-1-1327293923:3
INFO 2012-01-23 04:45:26,083  main backtype.storm.daemon.task Shutting down task test-1-1327293923:2
INFO 2012-01-23 04:45:26,084  Thread-29 backtype.storm.util Async loop interrupted!
INFO 2012-01-23 04:45:26,289  main backtype.storm.daemon.task Shut down task test-1-1327293923:2
INFO 2012-01-23 04:45:26,289  main backtype.storm.daemon.task Shutting down task test-1-1327293923:1
INFO 2012-01-23 04:45:26,290  Thread-31 backtype.storm.util Async loop interrupted!
INFO 2012-01-23 04:45:26,294  main backtype.storm.daemon.task Shut down task test-1-1327293923:1
INFO 2012-01-23 04:45:26,294  main backtype.storm.daemon.worker Terminating zmq context
INFO 2012-01-23 04:45:26,294  main backtype.storm.daemon.worker Disconnecting from storm cluster state context
INFO 2012-01-23 04:45:26,294  main backtype.storm.daemon.worker Waiting for heartbeat thread to die
INFO 2012-01-23 04:45:26,295  Thread-34 backtype.storm.util Async loop interrupted!
INFO 2012-01-23 04:45:26,295  Thread-35 backtype.storm.util Async loop interrupted!
INFO 2012-01-23 04:45:26,296  Thread-17 backtype.storm.util Async loop interrupted!
INFO 2012-01-23 04:45:26,296  Thread-16 backtype.storm.event Event manager interrupted
INFO 2012-01-23 04:45:26,297  ProcessThread:-1 org.apache.zookeeper.server.PrepRequestProcessor Processed session termination for sessionid: 0x13508e1fd48000b
INFO 2012-01-23 04:45:26,298  main org.apache.zookeeper.ZooKeeper Session: 0x13508e1fd48000b closed
INFO 2012-01-23 04:45:26,298  main backtype.storm.daemon.worker Shut down worker test-1-1327293923 f78f3bac-f19b-4df7-aa71-7b4fa765a4db 4
INFO 2012-01-23 04:45:26,299  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Closed socket connection for client /<IP_ADDRESS>:60785 which had sessionid 0x13508e1fd48000b
INFO 2012-01-23 04:45:26,299  Thread-12-EventThread org.apache.zookeeper.ClientCnxn EventThread shut down
INFO 2012-01-23 04:45:26,300  main backtype.storm.daemon.supervisor Shut down f78f3bac-f19b-4df7-aa71-7b4fa765a4db:c7d905d9-193b-48ae-86f4-6c12f3b3a829
INFO 2012-01-23 04:45:26,301  main backtype.storm.daemon.supervisor Shutting down supervisor f78f3bac-f19b-4df7-aa71-7b4fa765a4db
INFO 2012-01-23 04:45:26,301  Thread-13 backtype.storm.util Async loop interrupted!
INFO 2012-01-23 04:45:26,301  Thread-14 backtype.storm.util Async loop interrupted!
INFO 2012-01-23 04:45:26,301  Thread-15 backtype.storm.util Async loop interrupted!
INFO 2012-01-23 04:45:26,301  Thread-11 backtype.storm.event Event manager interrupted
INFO 2012-01-23 04:45:26,302  Thread-12 backtype.storm.event Event manager interrupted
INFO 2012-01-23 04:45:26,302  ProcessThread:-1 org.apache.zookeeper.server.PrepRequestProcessor Processed session termination for sessionid: 0x13508e1fd480009
INFO 2012-01-23 04:45:26,303  main org.apache.zookeeper.ZooKeeper Session: 0x13508e1fd480009 closed
INFO 2012-01-23 04:45:26,303  main backtype.storm.testing Shutting down in process zookeeper
INFO 2012-01-23 04:45:26,303  main org.apache.zookeeper.server.NIOServerCnxn Closed socket connection for client /<IP_ADDRESS>:60781 which had sessionid 0x13508e1fd480009
INFO 2012-01-23 04:45:26,304  main-EventThread org.apache.zookeeper.ClientCnxn EventThread shut down
INFO 2012-01-23 04:45:26,304  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn NIOServerCnxn factory exited run method
INFO 2012-01-23 04:45:26,304  ProcessThread:-1 org.apache.zookeeper.server.PrepRequestProcessor PrepRequestProcessor exited loop!
INFO 2012-01-23 04:45:26,304  SyncThread:0 org.apache.zookeeper.server.SyncRequestProcessor SyncRequestProcessor exited!
INFO 2012-01-23 04:45:26,304  main org.apache.zookeeper.server.FinalRequestProcessor shutdown of request processor complete
INFO 2012-01-23 04:45:26,305  main backtype.storm.testing Done shutting down in process zookeeper
INFO 2012-01-23 04:45:26,310  main backtype.storm.testing Deleting temporary path /var/folders/04/nrrmlfvx05l43fj6rljc2z400000gq/T//e4d62f55-b330-4689-9b86-bc0f6c1e6277
INFO 2012-01-23 04:45:26,319  main backtype.storm.testing Deleting temporary path /var/folders/04/nrrmlfvx05l43fj6rljc2z400000gq/T//6ddda619-0f31-4624-8842-556ecdb128e1
INFO 2012-01-23 04:45:26,319  main backtype.storm.testing Deleting temporary path /var/folders/04/nrrmlfvx05l43fj6rljc2z400000gq/T//4572a18b-d469-4172-9d48-32ae6d44244e
INFO 2012-01-23 04:45:26,321  main backtype.storm.testing Deleting temporary path /var/folders/04/nrrmlfvx05l43fj6rljc2z400000gq/T//135d7f01-8d0a-457a-a2d3-ff7714c1b16c
INFO 2012-01-23 04:45:26,480  main backtype.storm.zookeeper Starting inprocess zookeeper at port 2181 and dir /var/folders/04/nrrmlfvx05l43fj6rljc2z400000gq/T//27458e94-54c4-41fe-b123-a62cfd96189a
INFO 2012-01-23 04:45:26,480  main org.apache.zookeeper.server.ZooKeeperServer Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 datadir /var/folders/04/nrrmlfvx05l43fj6rljc2z400000gq/T/27458e94-54c4-41fe-b123-a62cfd96189a/version-2 snapdir /var/folders/04/nrrmlfvx05l43fj6rljc2z400000gq/T/27458e94-54c4-41fe-b123-a62cfd96189a/version-2
INFO 2012-01-23 04:45:26,480  main org.apache.zookeeper.server.NIOServerCnxn binding to port <IP_ADDRESS>/<IP_ADDRESS>:2181
INFO 2012-01-23 04:45:26,481  main org.apache.zookeeper.server.persistence.FileTxnSnapLog Snapshotting: 0
INFO 2012-01-23 04:45:26,486  main backtype.storm.daemon.nimbus Starting Nimbus with conf {"topology.fall.back.on.java.serialization" true, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "nimbus.monitor.freq.secs" 10, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "storm.local.dir" "/var/folders/04/nrrmlfvx05l43fj6rljc2z400000gq/T//4f8be61b-97b1-4fac-876f-439295d0c953", "supervisor.worker.start.timeout.secs" 240, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "storm.zookeeper.port" 2181, "storm.zookeeper.root" "/storm", "supervisor.enable" true, "topology.worker.childopts" nil, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "task.heartbeat.frequency.secs" 3, "topology.max.spout.pending" nil, "supervisor.slots.ports" [6700 6701 6702 6703], "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx1024m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "nimbus.task.timeout.secs" 30, "drpc.invocations.port" 3773, "zmq.threads" 1, "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "topology.ackers" 1, "storm.cluster.mode" "local", "topology.optimize" true, "topology.max.task.parallelism" nil}
INFO 2012-01-23 04:45:26,487  main com.netflix.curator.framework.imps.CuratorFrameworkImpl Starting
INFO 2012-01-23 04:45:26,488  main org.apache.zookeeper.ZooKeeper Initiating client connection, connectString=/ sessionTimeout=10000 watcher=com.netflix.curator.ConnectionState@7bfb7cbb
INFO 2012-01-23 04:45:26,499  main-SendThread() org.apache.zookeeper.ClientCnxn Opening socket connection to server localhost/<IP_ADDRESS>:2181
INFO 2012-01-23 04:45:26,502  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Socket connection established to localhost/<IP_ADDRESS>:2181, initiating session
INFO 2012-01-23 04:45:26,502  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Accepted socket connection from /<IP_ADDRESS>:60786
INFO 2012-01-23 04:45:26,502  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Client attempting to establish new session at /<IP_ADDRESS>:60786
INFO 2012-01-23 04:45:26,502  SyncThread:0 org.apache.zookeeper.server.persistence.FileTxnLog Creating new log file: log.1
INFO 2012-01-23 04:45:26,505  SyncThread:0 org.apache.zookeeper.server.NIOServerCnxn Established session 0x13508e20c510000 with negotiated timeout 10000 for client /<IP_ADDRESS>:60786
INFO 2012-01-23 04:45:26,505  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Session establishment complete on server localhost/<IP_ADDRESS>:2181, sessionid = 0x13508e20c510000, negotiated timeout = 10000
INFO 2012-01-23 04:45:26,505  main-EventThread backtype.storm.zookeeper Zookeeper state update: :connected:none
INFO 2012-01-23 04:45:26,507  ProcessThread:-1 org.apache.zookeeper.server.PrepRequestProcessor Processed session termination for sessionid: 0x13508e20c510000
INFO 2012-01-23 04:45:26,508  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Closed socket connection for client /<IP_ADDRESS>:60786 which had sessionid 0x13508e20c510000
INFO 2012-01-23 04:45:26,508  main org.apache.zookeeper.ZooKeeper Session: 0x13508e20c510000 closed
INFO 2012-01-23 04:45:26,510  main-EventThread org.apache.zookeeper.ClientCnxn EventThread shut down
INFO 2012-01-23 04:45:26,510  main com.netflix.curator.framework.imps.CuratorFrameworkImpl Starting
INFO 2012-01-23 04:45:26,510  main org.apache.zookeeper.ZooKeeper Initiating client connection, connectString=/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@1c45484a
INFO 2012-01-23 04:45:26,512  main-SendThread() org.apache.zookeeper.ClientCnxn Opening socket connection to server localhost/<IP_ADDRESS>:2181
INFO 2012-01-23 04:45:26,512  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Accepted socket connection from /<IP_ADDRESS>:60787
INFO 2012-01-23 04:45:26,513  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Socket connection established to localhost/<IP_ADDRESS>:2181, initiating session
INFO 2012-01-23 04:45:26,513  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Client attempting to establish new session at /<IP_ADDRESS>:60787
INFO 2012-01-23 04:45:26,514  SyncThread:0 org.apache.zookeeper.server.NIOServerCnxn Established session 0x13508e20c510001 with negotiated timeout 20000 for client /<IP_ADDRESS>:60787
INFO 2012-01-23 04:45:26,514  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Session establishment complete on server localhost/<IP_ADDRESS>:2181, sessionid = 0x13508e20c510001, negotiated timeout = 20000
INFO 2012-01-23 04:45:26,531  main com.netflix.curator.framework.imps.CuratorFrameworkImpl Starting
INFO 2012-01-23 04:45:26,532  main org.apache.zookeeper.ZooKeeper Initiating client connection, connectString=/ sessionTimeout=10000 watcher=com.netflix.curator.ConnectionState@21882d18
INFO 2012-01-23 04:45:26,532  main-SendThread() org.apache.zookeeper.ClientCnxn Opening socket connection to server localhost/<IP_ADDRESS>:2181
INFO 2012-01-23 04:45:26,533  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Accepted socket connection from /<IP_ADDRESS>:60788
INFO 2012-01-23 04:45:26,535  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Socket connection established to localhost/<IP_ADDRESS>:2181, initiating session
INFO 2012-01-23 04:45:26,535  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Client attempting to establish new session at /<IP_ADDRESS>:60788
INFO 2012-01-23 04:45:26,536  SyncThread:0 org.apache.zookeeper.server.NIOServerCnxn Established session 0x13508e20c510002 with negotiated timeout 10000 for client /<IP_ADDRESS>:60788
INFO 2012-01-23 04:45:26,536  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Session establishment complete on server localhost/<IP_ADDRESS>:2181, sessionid = 0x13508e20c510002, negotiated timeout = 10000
INFO 2012-01-23 04:45:26,536  main-EventThread backtype.storm.zookeeper Zookeeper state update: :connected:none
INFO 2012-01-23 04:45:26,537  ProcessThread:-1 org.apache.zookeeper.server.PrepRequestProcessor Processed session termination for sessionid: 0x13508e20c510002
INFO 2012-01-23 04:45:26,538  main org.apache.zookeeper.ZooKeeper Session: 0x13508e20c510002 closed
INFO 2012-01-23 04:45:26,538  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Closed socket connection for client /<IP_ADDRESS>:60788 which had sessionid 0x13508e20c510002
INFO 2012-01-23 04:45:26,538  main-EventThread org.apache.zookeeper.ClientCnxn EventThread shut down
INFO 2012-01-23 04:45:26,538  main com.netflix.curator.framework.imps.CuratorFrameworkImpl Starting
INFO 2012-01-23 04:45:26,538  main org.apache.zookeeper.ZooKeeper Initiating client connection, connectString=/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@1b186cf9
INFO 2012-01-23 04:45:26,539  main-SendThread() org.apache.zookeeper.ClientCnxn Opening socket connection to server localhost/<IP_ADDRESS>:2181
INFO 2012-01-23 04:45:26,539  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Accepted socket connection from /<IP_ADDRESS>:60789
INFO 2012-01-23 04:45:26,542  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Socket connection established to localhost/<IP_ADDRESS>:2181, initiating session
INFO 2012-01-23 04:45:26,542  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Client attempting to establish new session at /<IP_ADDRESS>:60789
INFO 2012-01-23 04:45:26,542  main com.netflix.curator.framework.imps.CuratorFrameworkImpl Starting
INFO 2012-01-23 04:45:26,542  main org.apache.zookeeper.ZooKeeper Initiating client connection, connectString=/ sessionTimeout=10000 watcher=com.netflix.curator.ConnectionState@459bdb65
INFO 2012-01-23 04:45:26,543  SyncThread:0 org.apache.zookeeper.server.NIOServerCnxn Established session 0x13508e20c510003 with negotiated timeout 20000 for client /<IP_ADDRESS>:60789
INFO 2012-01-23 04:45:26,543  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Session establishment complete on server localhost/<IP_ADDRESS>:2181, sessionid = 0x13508e20c510003, negotiated timeout = 20000
INFO 2012-01-23 04:45:26,543  main-SendThread() org.apache.zookeeper.ClientCnxn Opening socket connection to server localhost/<IP_ADDRESS>:2181
INFO 2012-01-23 04:45:26,547  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Accepted socket connection from /<IP_ADDRESS>:60790
INFO 2012-01-23 04:45:26,549  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Socket connection established to localhost/<IP_ADDRESS>:2181, initiating session
INFO 2012-01-23 04:45:26,549  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Client attempting to establish new session at /<IP_ADDRESS>:60790
INFO 2012-01-23 04:45:26,550  SyncThread:0 org.apache.zookeeper.server.NIOServerCnxn Established session 0x13508e20c510004 with negotiated timeout 10000 for client /<IP_ADDRESS>:60790
INFO 2012-01-23 04:45:26,550  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Session establishment complete on server localhost/<IP_ADDRESS>:2181, sessionid = 0x13508e20c510004, negotiated timeout = 10000
INFO 2012-01-23 04:45:26,550  main-EventThread backtype.storm.zookeeper Zookeeper state update: :connected:none
INFO 2012-01-23 04:45:26,551  ProcessThread:-1 org.apache.zookeeper.server.PrepRequestProcessor Processed session termination for sessionid: 0x13508e20c510004
INFO 2012-01-23 04:45:26,552  main org.apache.zookeeper.ZooKeeper Session: 0x13508e20c510004 closed
INFO 2012-01-23 04:45:26,552  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Closed socket connection for client /<IP_ADDRESS>:60790 which had sessionid 0x13508e20c510004
INFO 2012-01-23 04:45:26,552  main-EventThread org.apache.zookeeper.ClientCnxn EventThread shut down
INFO 2012-01-23 04:45:26,552  main com.netflix.curator.framework.imps.CuratorFrameworkImpl Starting
INFO 2012-01-23 04:45:26,552  main org.apache.zookeeper.ZooKeeper Initiating client connection, connectString=/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@2389b9bd
INFO 2012-01-23 04:45:26,553  main-SendThread() org.apache.zookeeper.ClientCnxn Opening socket connection to server localhost/<IP_ADDRESS>:2181
INFO 2012-01-23 04:45:26,553  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Accepted socket connection from /<IP_ADDRESS>:60791
INFO 2012-01-23 04:45:26,554  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Socket connection established to localhost/<IP_ADDRESS>:2181, initiating session
INFO 2012-01-23 04:45:26,555  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Client attempting to establish new session at /<IP_ADDRESS>:60791
INFO 2012-01-23 04:45:26,556  SyncThread:0 org.apache.zookeeper.server.NIOServerCnxn Established session 0x13508e20c510005 with negotiated timeout 20000 for client /<IP_ADDRESS>:60791
INFO 2012-01-23 04:45:26,556  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Session establishment complete on server localhost/<IP_ADDRESS>:2181, sessionid = 0x13508e20c510005, negotiated timeout = 20000
INFO 2012-01-23 04:45:26,570  main backtype.storm.daemon.supervisor Starting Supervisor with conf {"topology.fall.back.on.java.serialization" true, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "nimbus.monitor.freq.secs" 10, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "storm.local.dir" "/var/folders/04/nrrmlfvx05l43fj6rljc2z400000gq/T//65dd39fb-e8ff-4189-a280-d4b97806b618", "supervisor.worker.start.timeout.secs" 240, "nimbus.cleanup.inbox.freq.secs" 600, "nimbus.inbox.jar.expiration.secs" 3600, "storm.zookeeper.port" 2181, "storm.zookeeper.root" "/storm", "supervisor.enable" true, "topology.worker.childopts" nil, "worker.childopts" "-Xmx768m", "supervisor.heartbeat.frequency.secs" 5, "drpc.port" 3772, "supervisor.monitor.frequency.secs" 3, "task.heartbeat.frequency.secs" 3, "topology.max.spout.pending" nil, "supervisor.slots.ports" (1 2 3), "topology.debug" false, "nimbus.task.launch.secs" 120, "nimbus.supervisor.timeout.secs" 60, "topology.message.timeout.secs" 30, "task.refresh.poll.secs" 10, "topology.workers" 1, "supervisor.childopts" "-Xmx1024m", "nimbus.thrift.port" 6627, "topology.stats.sample.rate" 0.05, "worker.heartbeat.frequency.secs" 1, "nimbus.task.timeout.secs" 30, "drpc.invocations.port" 3773, "zmq.threads" 1, "topology.state.synchronization.timeout.secs" 60, "supervisor.worker.timeout.secs" 30, "nimbus.file.copy.expiration.secs" 600, "storm.local.mode.zmq" false, "ui.port" 8080, "nimbus.childopts" "-Xmx1024m", "topology.ackers" 1, "storm.cluster.mode" "local", "topology.optimize" true, "topology.max.task.parallelism" nil}
INFO 2012-01-23 04:45:26,572  main com.netflix.curator.framework.imps.CuratorFrameworkImpl Starting
INFO 2012-01-23 04:45:26,572  main org.apache.zookeeper.ZooKeeper Initiating client connection, connectString=/ sessionTimeout=10000 watcher=com.netflix.curator.ConnectionState@25082661
INFO 2012-01-23 04:45:26,572  main-SendThread() org.apache.zookeeper.ClientCnxn Opening socket connection to server localhost/<IP_ADDRESS>:2181
INFO 2012-01-23 04:45:26,583  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Socket connection established to localhost/<IP_ADDRESS>:2181, initiating session
INFO 2012-01-23 04:45:26,583  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Accepted socket connection from /<IP_ADDRESS>:60792
INFO 2012-01-23 04:45:26,584  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Client attempting to establish new session at /<IP_ADDRESS>:60792
INFO 2012-01-23 04:45:26,585  SyncThread:0 org.apache.zookeeper.server.NIOServerCnxn Established session 0x13508e20c510006 with negotiated timeout 10000 for client /<IP_ADDRESS>:60792
INFO 2012-01-23 04:45:26,585  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Session establishment complete on server localhost/<IP_ADDRESS>:2181, sessionid = 0x13508e20c510006, negotiated timeout = 10000
INFO 2012-01-23 04:45:26,585  main-EventThread backtype.storm.zookeeper Zookeeper state update: :connected:none
INFO 2012-01-23 04:45:26,587  ProcessThread:-1 org.apache.zookeeper.server.PrepRequestProcessor Processed session termination for sessionid: 0x13508e20c510006
INFO 2012-01-23 04:45:26,588  main org.apache.zookeeper.ZooKeeper Session: 0x13508e20c510006 closed
INFO 2012-01-23 04:45:26,588  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Closed socket connection for client /<IP_ADDRESS>:60792 which had sessionid 0x13508e20c510006
INFO 2012-01-23 04:45:26,588  main-EventThread org.apache.zookeeper.ClientCnxn EventThread shut down
INFO 2012-01-23 04:45:26,588  main com.netflix.curator.framework.imps.CuratorFrameworkImpl Starting
INFO 2012-01-23 04:45:26,588  main org.apache.zookeeper.ZooKeeper Initiating client connection, connectString=/storm sessionTimeout=20000 watcher=com.netflix.curator.ConnectionState@788c1852
INFO 2012-01-23 04:45:26,590  main-SendThread() org.apache.zookeeper.ClientCnxn Opening socket connection to server localhost/<IP_ADDRESS>:2181
INFO 2012-01-23 04:45:26,591  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Accepted socket connection from /<IP_ADDRESS>:60793
INFO 2012-01-23 04:45:26,594  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Socket connection established to localhost/<IP_ADDRESS>:2181, initiating session
INFO 2012-01-23 04:45:26,595  NIOServerCxn.Factory:<IP_ADDRESS>/<IP_ADDRESS>:2181 org.apache.zookeeper.server.NIOServerCnxn Client attempting to establish new session at /<IP_ADDRESS>:60793
INFO 2012-01-23 04:45:26,596  SyncThread:0 org.apache.zookeeper.server.NIOServerCnxn Established session 0x13508e20c510007 with negotiated timeout 20000 for client /<IP_ADDRESS>:60793
INFO 2012-01-23 04:45:26,596  main-SendThread(localhost:2181) org.apache.zookeeper.ClientCnxn Session establishment complete on server localhost/<IP_ADDRESS>:2181, sessionid = 0x13508e20c510007, negotiated timeout = 20000
INFO 2012-01-23 04:45:26,605  main backtype.storm.daemon.supervisor Starting supervisor with id 807634ff-fdf1-4a8f-9df6-9e6294005cab at host <IP_ADDRESS>
INFO 2012-01-23 04:45:26,608  main backtype.storm.daemon.supervisor Starting Supervisor with conf {"topology.fall.back.on.java.serialization" true, "zmq.linger.millis" 0, "topology.skip.missing.kryo.registrations" true, "storm.zookeeper.session.timeout" 20000, "nimbus.reassign" true, "nimbus.monitor.freq.secs" 10, "

The storm unit tests bring up and take down local clusters over and over without issue, and the shutdown code shuts down Zookeeper. So I'm not sure why you're hitting this issue. Can you provide a small reproducible test case?

The problem seems to be the timing, i.e. the method returns before all parts are shut down. You can easily reproduce this by cloning https://github.com/tomdz/storm-esper and running mvn test.


updating high contrast and high contrast (dark) color palettes

This pull request would close #87
Updated the color palettes for both high contrast and high contrast (dark). From the re

Original High Contrast Dark

Classic Dark (for reference, was not edited)

Updated High Contrast Dark

Original High Contrast

Updated High Contrast

Yes of course, here are updated values and wcag contrast checkers, sorry I didn't think of this earlier! Values are updated and here are screenshots to accompany.

Looks good to me; thank you! I think this is ready to merge once highContrastDark is also updated accordingly.


@error "#{$target} not found in $typi map";

I got version 2.3.x working and decided to upgrade to 3.  I got the error on line 21 of _breakpoints.scss.  It appears that it needs a target map, but it is not documented in the README.  My typi follows:
$typi: (
base: (
//       font-size, line-height
null:       ( 16px, 1.4 ),  // 20em
iPhone5:    ( 16px, 1.4 ),  // 20em,
iPhone6p:   ( 16px, 1.4 ),  // 25.875em
tablet:     ( 18px, 1.4 ),  // 48em,
sDesktop:   ( 20px, 1.45 ), // 64em,
desktop:    ( 20px, 1.45 ), // 71.25em
lDesktop:   ( 22px, 1.45 )  // 80em
)
);

Error on my end.


After installing pip install cairo lang, execute the starknit version and the error message is as follows. Please help to answer the question

lc@LCdeMacBook-Pro ~ % starknet version
Traceback (most recent call last):
File "/opt/homebrew/bin/starknet", line 8, in
from starkware.starknet.cli.starknet_cli import main  # noqa
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/homebrew/lib/python3.11/site-packages/starkware/starknet/cli/starknet_cli.py", line 18, in
from starkware.starknet.cli.starknet_cli_utils import (
File "/opt/homebrew/lib/python3.11/site-packages/starkware/starknet/cli/starknet_cli_utils.py", line 25, in
from starkware.starknet.services.api.feeder_gateway.feeder_gateway_client import (
File "/opt/homebrew/lib/python3.11/site-packages/starkware/starknet/services/api/feeder_gateway/feeder_gateway_client.py", line 7, in
from starkware.starknet.services.api.feeder_gateway.request_objects import (
File "/opt/homebrew/lib/python3.11/site-packages/starkware/starknet/services/api/feeder_gateway/request_objects.py", line 6, in
from starkware.starknet.business_logic.execution.execute_entry_point import ExecuteEntryPoint
File "/opt/homebrew/lib/python3.11/site-packages/starkware/starknet/business_logic/execution/execute_entry_point.py", line 9, in
from starkware.cairo.common.cairo_function_runner import CairoFunctionRunner
File "/opt/homebrew/lib/python3.11/site-packages/starkware/cairo/common/cairo_function_runner.py", line 21, in
from starkware.cairo.lang.vm.cairo_runner import CairoRunner, process_ecdsa, verify_ecdsa_sig
File "/opt/homebrew/lib/python3.11/site-packages/starkware/cairo/lang/vm/cairo_runner.py", line 35, in
from starkware.cairo.lang.instances import DYNAMIC_LAYOUT_NAME, LAYOUTS, CairoLayout
File "/opt/homebrew/lib/python3.11/site-packages/starkware/cairo/lang/instances.py", line 64, in
@dataclasses.dataclass
^^^^^^^^^^^^^^^^^^^^^
File<EMAIL_ADDRESS>line 1230, in dataclass
return wrap(cls)
^^^^^^^^^
File<EMAIL_ADDRESS>line 1220, in wrap
return _process_class(cls, init, repr, eq, order, unsafe_hash,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File<EMAIL_ADDRESS>line 958, in _process_class
cls_fields.append(_get_field(cls, name, type, kw_only))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File<EMAIL_ADDRESS>line 815, in _get_field
raise ValueError(f'mutable default {type(f.default)} for field '
ValueError: mutable default <class 'starkware.cairo.lang.instances.CpuInstanceDef'> for field cpu_instance_def is not allowed: use default_factory

lc@LCdeMacBook-Pro ~ % starknet version
Traceback (most recent call last):
File "/opt/homebrew/bin/starknet", line 8, in
from starkware.starknet.cli.starknet_cli import main  # noqa
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/homebrew/lib/python3.11/site-packages/starkware/starknet/cli/starknet_cli.py", line 18, in
from starkware.starknet.cli.starknet_cli_utils import (
File "/opt/homebrew/lib/python3.11/site-packages/starkware/starknet/cli/starknet_cli_utils.py", line 25, in
from starkware.starknet.services.api.feeder_gateway.feeder_gateway_client import (
File "/opt/homebrew/lib/python3.11/site-packages/starkware/starknet/services/api/feeder_gateway/feeder_gateway_client.py", line 7, in
from starkware.starknet.services.api.feeder_gateway.request_objects import (
File "/opt/homebrew/lib/python3.11/site-packages/starkware/starknet/services/api/feeder_gateway/request_objects.py", line 6, in
from starkware.starknet.business_logic.execution.execute_entry_point import ExecuteEntryPoint
File "/opt/homebrew/lib/python3.11/site-packages/starkware/starknet/business_logic/execution/execute_entry_point.py", line 9, in
from starkware.cairo.common.cairo_function_runner import CairoFunctionRunner
File "/opt/homebrew/lib/python3.11/site-packages/starkware/cairo/common/cairo_function_runner.py", line 21, in
from starkware.cairo.lang.vm.cairo_runner import CairoRunner, process_ecdsa, verify_ecdsa_sig
File "/opt/homebrew/lib/python3.11/site-packages/starkware/cairo/lang/vm/cairo_runner.py", line 35, in
from starkware.cairo.lang.instances import DYNAMIC_LAYOUT_NAME, LAYOUTS, CairoLayout
File "/opt/homebrew/lib/python3.11/site-packages/starkware/cairo/lang/instances.py", line 64, in
@dataclasses.dataclass
^^^^^^^^^^^^^^^^^^^^^
File<EMAIL_ADDRESS>line 1230, in dataclass
return wrap(cls)
^^^^^^^^^
File<EMAIL_ADDRESS>line 1220, in wrap
return _process_class(cls, init, repr, eq, order, unsafe_hash,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File<EMAIL_ADDRESS>line 958, in _process_class
cls_fields.append(_get_field(cls, name, type, kw_only))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File<EMAIL_ADDRESS>line 815, in _get_field
raise ValueError(f'mutable default {type(f.default)} for field '
ValueError: mutable default <class 'starkware.cairo.lang.instances.CpuInstanceDef'> for field cpu_instance_def is not allowed: use default_factory

same error, someone can fix this?

Hi there again, I tried python3.9 and python.3.11, and it prints different errors, finally, I tried python3.10 and it works!
Anyone who meets this error can follow my steps here:

brew install python3.10
alias python=python3.10
python -m pip install ecdsa sympy
CFLAGS=-I/usr/local/Cellar/gmp/6.2.1_1/include LDFLAGS=-L/usr/local/Cellar/gmp/6.2.1_1/lib python -m  pip install fastecdsa (for silicon mac user)
python -m pip cairo-lang
starknet --version

Hi there again, I tried python3.9 and python.3.11, and it prints different errors, finally, I tried python3.10 and it works! Anyone who meets this error can follow my steps here:

brew install python3.10
alias python=python3.10
python -m pip install ecdsa sympy
CFLAGS=-I/usr/local/Cellar/gmp/6.2.1_1/include LDFLAGS=-L/usr/local/Cellar/gmp/6.2.1_1/lib python -m  pip install fastecdsa (for silicon mac user)
python -m pip cairo-lang
starknet --version

I got this message when doing the 5th step
ERROR: unknown command "cairo-lang"
I checked my pip is the latest version 23.2.1
can anyone solve this?


Increment_flatten can be executed using qemu-img commit  instead of qemu-img convert

Description
The goal is shorten the time and I/O required to merge the full and the next incremental on the chain when the keep_last value reached.
Use case
When we execute the qemu-img commit on the top file that point to the base image (backing_file) or full image in this case. Only the changes of the incremental goes to override the clusters in the base image, even if there are more than 1 elements in the chain.
Interface Changes
remotes/datastore/rsync/increment_flatten  to modify the function merge_chain call
remotes/tm/lib/backup.rb to add a new function the handle this scenario.
Additional Context
Operations performed in the rsync host:
qemu-img commit -f qcow2 '/var/lib/one/datastores/100/7/768671/disk.0.3'                                                                                │·
mv '/var/lib/one/datastores/100/7/2757f7/disk.0.0' '/var/lib/one/datastores/100/7/768671/disk.0.3'

Progress Status

[ ] Code committed
[ ] Testing - QA
[ ] Documentation (Release notes - resolved issues, compatibility, known issues)

This has a storage and performance saving approach. Awsome nacho :)


make API requests transactional (OSIDB-232)

This was really as easy as turning the option on in the DB settings. The tests should be hopefully demonstrative enough to see how this functionality works. The motivation is simple - we do not want to leave the DB in some half-way state in the case that a part of a more complex operation failed only after something related was already changed.
This is of course still not solving all the transaction issues. Namely the changes to the backends will of course not be rolled back. We can eg. ended up in a situation when the flaw was successfully updated in DB and the followup Jira task update failed. This should however still be a step forward dealing at least with what we can be easily dealt with.
I am setting the transactions to be atomic in all the environments (stage, prod, local, ...) as I think it is better to keep them behaving similarly. I am opened to any objections against it.
Closes OSIDB-232

@JakubFrejlach I see that for some reason I originally tagged only Conrado as a reviewer :smile: but still as this is an important change I would be glad to have your eyes on it too


Feature Request: Allow definition of fixer to be executed via CLI

Feature Request
It would be great if it would be possible to define an argument for executing defined fixer without running any other rules.

Do you mean running a fixer for only one rule? I'd suggest just pointing the CLI at a special tslint.json to accomplish this:
{
  "rules": {
    "prefer-const": true
  }
}

tslint -c tslint-fix.json --fix

Yes you are right I can achieve it with a special file, too. But in this case we have to change both files to have consistent changes.
I hoped I can reuse the existing file and tell tslint which fixer should be used.


Add Built-in TypeScript project templates

Description
It would be amazing if you add TypeScript projects to the built-in templates just like ReactJs.
TypeScript makes everything easier
Example
It would be nice to be able to create the projects like this, just like with ReactJs projects:
symfony new HelloWorld --webapp --typescript

Replacing all js files with ts files and preconfiguring the entire project to use TypeScript.

It would be interesting to more helpfully bootstrap common assets setups, though I'm not exactly sure how best to do that.


class_prompt parameter setting

How to setup class_prompt parameter for class data generation.
help = 'The prompt to specify images in the same class as provided instance images.' in train.py.
importance of prior_loss

Hi,
If you want to can specify a general prompt that contains all the concepts in the image, e.g., "a photo of a creature and a bowl and a stone". It may improve the results.
But from my experience, it is not mandatory, you can get good results even with a general prompt (as the default one).

@omriav But does that means the prior preservation loss is calculated from (a creature, a bowl, and a stone) to the default class images of (a photo of a beach)?  Then why do we need the prior preservation loss as in dreambooth?

We found that the prior preservation helps a bit with the overfitting issue. But it may be removed if you train for a smaller number of iterations / with a lower LR.


Feature: Summarise YouTube Videos

This feature will let users get a summary of most YouTube videos having English subtitles. The program will first fetch the subtitles of the video mentioned by the user, and then, GPT will summarise and show it to the user.

Go for it ;)


Cannot run from subdirectories [bug]

Currently you must be in the project's root directory to run hourly. One should be able to run from any subdirectory, just as git commands also work in subdirectories.

Fixed in 6bde662b011c81db0aef48d9d4970fa9f9128141


Tracking issue for abi-cafe failures

https://github.com/rust-lang/rustc_codegen_cranelift/blob/master/patches/0002-abi-cafe-Disable-broken-tests.patch

[ ] aarch64-unknown-linux-gnu

[ ] F32Array with extern "C"
[ ] OptionU128 with extern "Rust" and repr(C)

[ ] aarch64-apple-darwin

[ ] SingleVariantUnion with extern "C" and repr(C)
[ ] OptionU128 with extern "Rust" and repr(C)

[ ] x86_64 unix

[ ] OptionU128 with extern "Rust" and repr(Rust)

[ ] x86_64-pc-windows-msvc

[ ] OptionU128 with extern "Rust"
[ ] simple with extern "Rust"

https://github.com/rust-lang/rust/pull/131211 which will be in next nightly fixed the OptionU128 issues on at least x86_64-unknown-linux-gnu and aarch64-unknown-linux-gnu and likely on macOS and Windows too.

On aarch64-unknown-linux-gnu
extern "C" {
    fn write_val(val: f32);
}

#[repr(C)]
#[derive(Copy, Clone)]
struct F32Array {
    field0: [f32; 4],
}

#[no_mangle]
pub unsafe extern "C" fn val_in_3(_: F32Array, _: F32Array, arg2: F32Array) {
    unsafe {
        write_val(arg2.field0[0]);
        write_val(arg2.field0[1]);
        write_val(arg2.field0[2]);
        write_val(arg2.field0[3]);
    }
}

produces the following LLVM ir:
define void @val_in_3([4 x float] %0, [4 x float] %1, [4 x float] %2) unnamed_addr #0 !dbg !6 {
  %.fca.0.extract9 = extractvalue [4 x float] %2, 0
  %.fca.1.extract10 = extractvalue [4 x float] %2, 1
  %.fca.2.extract11 = extractvalue [4 x float] %2, 2
  %.fca.3.extract12 = extractvalue [4 x float] %2, 3
  tail call void @write_val(float noundef %.fca.0.extract9) #1, !dbg !11
  tail call void @write_val(float noundef %.fca.1.extract10) #1, !dbg !12
  tail call void @write_val(float noundef %.fca.2.extract11) #1, !dbg !13
  tail call void @write_val(float noundef %.fca.3.extract12) #1, !dbg !14
  ret void, !dbg !15
}

declare void @write_val(float noundef) unnamed_addr #0

and the following clif ir:
function u0:0(f32, f32, f32, f32, f32, f32, f32, f32, f32, f32, f32, f32) system_v {
; kind  loc.idx   param    pass mode                            ty
; zst   _0    ()                                0b 1, 8              align=8,offset=
; ret   _0      -          Ignore                               ()
; arg   _1      = v0,v1,v2,v3 Cast { pad_i32: false, cast: CastTarget { prefix: [None, None, None, None, None, None, None, None], rest: Uniform { unit: Reg { kind: Float, size: Size(4 bytes) }, total: Size(16 bytes), is_consecutive: true }, attrs: ArgAttributes { regular: , arg_ext: None, pointee_size: Size(0 bytes), pointee_align: None } } } F32Array
; arg   _2      = v4,v5,v6,v7 Cast { pad_i32: false, cast: CastTarget { prefix: [None, None, None, None, None, None, None, None], rest: Uniform { unit: Reg { kind: Float, size: Size(4 bytes) }, total: Size(16 bytes), is_consecutive: true }, attrs: ArgAttributes { regular: , arg_ext: None, pointee_size: Size(0 bytes), pointee_align: None } } } F32Array
; arg   _3      = v8,v9,v10,v11 Cast { pad_i32: false, cast: CastTarget { prefix: [None, None, None, None, None, None, None, None], rest: Uniform { unit: Reg { kind: Float, size: Size(4 bytes) }, total: Size(16 bytes), is_consecutive: true }, attrs: ArgAttributes { regular: , arg_ext: None, pointee_size: Size(0 bytes), pointee_align: None } } } F32Array

    ss0 = explicit_slot 16, align = 16
    ss1 = explicit_slot 16, align = 16
    ss2 = explicit_slot 16, align = 16
    sig0 = (f32) system_v
    sig1 = (f32) system_v
    sig2 = (f32) system_v
    sig3 = (f32) system_v
    fn0 = u0:1 sig0 ; Instance { def: Item(DefId(0:4 ~ rust_out[4f40]::{extern#0}::write_val)), args: [] }
    fn1 = u0:1 sig1 ; Instance { def: Item(DefId(0:4 ~ rust_out[4f40]::{extern#0}::write_val)), args: [] }
    fn2 = u0:1 sig2 ; Instance { def: Item(DefId(0:4 ~ rust_out[4f40]::{extern#0}::write_val)), args: [] }
    fn3 = u0:1 sig3 ; Instance { def: Item(DefId(0:4 ~ rust_out[4f40]::{extern#0}::write_val)), args: [] }

block0(v0: f32, v1: f32, v2: f32, v3: f32, v4: f32, v5: f32, v6: f32, v7: f32, v8: f32, v9: f32, v10: f32, v11: f32):
; ........................
}

I'm pretty sure that the issue is that the [f32; 4] gets splatted into individual arguments which get a register or stack location assigned independently, while the ABI requires them to be assigned to either consecutive registers or to the stack as a whole.

Opened https://github.com/bytecodealliance/wasmtime/issues/9510 to suggest removing the broken implicit return area pointer support of Cranelift to avoid others hitting the same issue.


provider_raw_config_args appears to be ignored

Issue Type

Bug report

Molecule and Ansible details
$ ansible --version
ansible 2.5.3

$ molecule --version
molecule, version 2.14.0

Molecule installation method (one of):

pip

Ansible installation method (one of):

pip
OS package

Desired Behavior
provider_raw_config_args for vagrant should be copied into vagrant.yml when using vagrant as the provider.
Actual Behaviour (Bug report only)
raw_config_args in vagrant.yml is empty. provider_raw_config_args appear to be ignored.
$ cat molecule/full-install/molecule.yml
---
dependency:
  name: galaxy
  enabled: false
driver:
  name: vagrant
  provider:
    name: virtualbox
platforms:
  - name: instance
    box: ubuntu/xenial64
    provider_raw_config_args:
      - "customize [ 'modifyvm', :id, '--uartmode1', 'disconnected']"
provisioner:
  name: ansible
  playbooks:
    create: ../create.yml
    destroy: ../destroy.yml
    prepare: ../prepare.yml
    converge: ../../install.yml
  env:
    ANSIBLE_ROLES_PATH: ../roles
verifier:
  name: testinfra
scenario:
  name: full-install

$ molecule create --scenario-name full-install
--> Validating schema /home/jharrison/common/ansible/molecule/full-install/molecule.yml.
Validation completed successfully.
--> Test matrix

└── full-install
    ├── create
    └── prepare

--> Scenario: 'full-install'
--> Action: 'create'

    PLAY [Create] ******************************************************************

    TASK [Create molecule instance(s)] *********************************************
    changed: [localhost] => (item=None)

    TASK [Populate instance config dict] *******************************************
    ok: [localhost] => (item=None)

    TASK [Convert instance config dict to a list] **********************************
    ok: [localhost]

    TASK [Dump instance config] ****************************************************
    changed: [localhost]

    PLAY RECAP *********************************************************************
    localhost                  : ok=4    changed=2    unreachable=0    failed=0

--> Scenario: 'full-install'
--> Action: 'prepare'

    PLAY [Prepare] *****************************************************************

    TASK [Install python for Ansible] **********************************************
    ok: [instance]

    PLAY RECAP *********************************************************************
    instance                   : ok=1    changed=0    unreachable=0    failed=0

$ cat /tmp/molecule/ansible/full-install/vagrant.yml
# Molecule managed

---
config:
  options:
    ssh.insert_key: true
    synced_folder: false
instance:
  interfaces: []
  name: instance
  raw_config_args: null
platform:
  box: ubuntu/xenial64
  box_url: null
  box_version: null
provider:
  name: virtualbox
  options:
    cpus: 2
    memory: 512
  override_args: null
  raw_config_args: null

In the above output, the raw_config_args should not be null.

@jamesharrisonquantium Molecule mapps molecule.yml values into the create and destroy playbooks.
I am guessing you have old create and destroy.yml playbooks from an earlier version of Molecule, which later introduced provider_raw_config_args.

the playbooks had been created on a different machine which I've now discovered had an old version installed.

Also, if you are running 2.14 and using either the docker or vagrant driver, you can just delete the create/destroy playbooks if they are unmodified.  Molecule now bundles them for you.
You can also delete the prepare.yml as well if you aren't using it.  Molecule won't complain about the deprecation warning any longer.

Perfect, we don't modify them, so deleting should work


Improve test DX

Add jest-watch-typeahead to the standard jest setup in scripts for better development experience and ease of use.

:rocket: Issue was released in<EMAIL_ADDRESS>:rocket:

:rocket: Issue was released in<EMAIL_ADDRESS>:rocket:


Add :telemetry_prefix option to Tesla.Middleware.Telemetry

This PR gives Tesla HTTP client users the ability to configure a :telemetry_prefix option at the Tesla.Middleware.Telemetry module or config.ex level. This is useful for developers creating platform-specific sdks or api clients that want Telemetry events to align more closely with their platform or app.

@keatz55 Thanks for the PR! I've added a few comments on the diff.
@bryannaegele Would you mind taking a look? :)

❤

Sure, @teamon !
@keatz55 can you elaborate on what your use case is and what you're looking to accomplish? The telemetry team and Observability WG have established telemetry prefixes in libraries as an anti-pattern since the primary use case of distinguishing different usage contexts of a library can be accomplished through event metadata. We'd love to walk that pattern back, but we're stuck with it in a couple of places. :/
I'm happy to provide suggestions or guidance to help accomplish your goal, but I do not believe this PR should be merged. I would suggest opening an issue instead and find a solution for you that could possibly be documented better. We did have a use case at WM that was somewhat related but is solvable through different middleware.

@bryannaegele At least in our case, the use case is to be able to track metrics from connections to different services seperately. In our app, we have tesla clients connection to at least three external services and currently the telemetry metrics that come in have no way of distinguishing between which service was being called.
I had roughed out an alternative solution here: https://github.com/teamon/tesla/pull/387. Do you think that approach works better?

@aselder yeah! So we had a similar thing internally where they wanted to use something other than the module name in the env to distinguish the target service being called. The solution @moxley came up with was so use a separate middleware that added metadata to the opts and then the metric used that as a label.
Example:
# middleware
defmodule MyApp.Tesla.Middleware.Metadata do
  def call(env, next, opts) do
    env_opts = Keyword.merge(env.opts, opts)
    env = %{env | opts: env_opts}
    Tesla.run(env, next)
  end
end

# calling
middleware = [
  {MyApp.Tesla.Middleware.Metadata, service: "target_service"},
  Tesla.Middleware.Telemetry
]

# metric
counter("tesla_request_total",
  event_name: [:tesla, :request, :stop],
  description: "Tesla http request count",
  tags: [:module, :method, :status],
  tag_values: fn %{env: env} ->
    # Get the service name given to the metadata middleware keyword list
    target_service = env.opts[:service]
    %{
      method: env.method,
      status: env.status,
      target_service: target_service
    }
  end)

So there's certainly a pattern that could possibly be formally established as additional middleware rather than altering the Tesla client code or adding prefixes to telemetry events. The added bonus with going the extra middleware route is that it makes that metadata available for other use cases, such as the logger middleware.
I encouraged @moxley to formalize this pattern into a generic metadata middleware that could go in here. Would anyone be interested in taking up a proposal for that and example use cases with the telemetry and logger middlewares? @teamon any thoughts?

@bryannaegele I like that approach. It's close to what I had done, just a much cleaner way of injecting it.
I'd like to propose however that a metadata field be added to the Env, instead of using opts. From the name of the middleware, it's not clear that it will be storing passed information in the opts map. I could see someone accidentally overwriting a critical option with out realizing they were doing so. Thoughts?

Thanks for the response @bryannaegele,

@keatz55 can you elaborate on what your use case is and what you're looking to accomplish?

We have the same internal case mentioned above by @aselder with the addition of the following cases:

we are building an elixir-specific sdk and a :prefix would allow us to group all sdk-specific events together, as opposed to having sdk-specific events with the addition of tesla-specific dependency events.
having a configurable :prefix also encourages looser coupling, which would more easily allow users to keep the same telemetry event names independent of the http client library they use.

As a side note, when I submitted the above PR I was taking a page from the ecto implementation where you have a specific repo and telemetry events are based on the repo module name.

I'm not sure if you noticed, but there is also built-in Tesla.Middleware.Opts
Before telemetry was a thing I've built an internal integration for tesla & prometheus. From observability perspective it makes sense to treat prefix as metric type/name and use labels/tags to distinguish source/target. For all the different clients I'm using the same middleware with the same metric name tesla_request_*, add source label taken from app config and target label based on hostname. This works well for internal services as all hostnames are in the same format some-app.tld. Having a single metric allows further manipulation like summing or joining into golden signals.
One of the design principles of tesla was to let users choose their http adapters. With this in mind, if you are creating an API wrapper library you could allow users to use a different adapter. With telemetry as an abstraction/integration layer it make sense to use the same event handler for multiple clients as the metrics represent the same thing, and if one wants to customise the handler for specific client it can be done by looking into tags.
As for the logger - the current one is far form perfect but I have yet to find time to propose a better solution.
tl;dr - I'm not sure, the simpler and more practical the better

@teamon Nice call... Didn't even realize Tesla.Middleware.Opts was there.

I was using a similar approach to the ecto telemetry implementation where you have a specific repo and telemetry events are based on the repo module name:

Yes, unfortunately that is the anti-pattern I was denoting. We can't remove it, so we're stuck with it in that library, but we highly discourage this practice going forward.

we are building an elixir-specific sdk and a :prefix would allow sdk users to group all sdk-specific events together, as opposed to having sdk-specific events with the addition of tesla-specific dependency events.

In this case, we'd suggest using your own events and wrapping the calls. In a sense, the use of prefixes was a way to "hijack" a library's events. This also corners you and your users into using Tesla since those events would always be a part of your events. The usage of Tesla is an implementation concern of your SDK, so bleeding that out can be problematic.

having a configurable :prefix also encourages looser coupling, which would more easily allow users to keep the same telemetry event names independent of the http client library they use.

In practice this is the inverse since :tesla must be a part of the event name since that is the library. In a trace, we want to know which module/library was called versus a generic name.
An additional issue is that with prefixes our potential solutions for event discovery for tracing won't work. Our solutions for exposing traceable spans via telemetry events is highly dependent on static definition of events and that they be consistent for all uses of the library. Prefixes require the use of macros and still don't solve the problem of distinguishing individual requests from a particular client.
If you'd like to read more about how some of these conclusions were reached, especially around events in libraries, you can check out elixir-plug/plug_cowboy/pull/25, elixir-plug/plug_cowboy/pull/31, and #34

One change I'd like to ask as part of this is to pass the env along for the exception event. If we're relying on opts to carry the meta data to identify the request, we're blind to it in the exception case.

@bryannaegele Thank you for taking the time for such thorough response and for including sources. It is much appreciated. Under the additional context that you have just given, would it make sense to remove the :tesla prefix? E.g., [:tesla, :request, :stop] -> [:request, :stop]

@keatz55 no problem. We still want tesla in this case because we're emitting an event from that library. If it were left to just [:request, :stop] then a listener on that event would have no idea what that correlates to.
Say we use that pattern in multiple libraries, such as http clients or servers, such as Phoenix. Was it an http request stopping? And was it Phoenix? Or was it an http client? We quickly find ourselves in a precarious situation because in each of these cases, the measurements and metadata being emitted are different causing things like Metrics to no longer work. So we have to distinguish which library it came from, which is the reasoning for libraries to have a root prefix for all of its events.
I apologize for all of the confusion. A lot of people have put out some helpful information but we need to get official guides together.
Two other approaches to this particular issue should be put out there, one of which could be helpful for some use cases presented here.

Allow for user-injected metadata in this middleware, thus negating the need to add the opts middleware. This would be static metadata for all emitted events. I can definitely get behind this!
You can always ship a custom middleware if nothing here fits the bill. This middleware should try to cover most use cases while still adhering to guidelines and patterns the observability team are trying to propagate to create an overall good story.

@bryannaegele Thanks again. Everything you are saying makes perfect sense. One thing I still don't quite understand is why in the following sample in elixir-plug/plug_cowboy/pull/31 they don't use the :plug_cowboy lib name and instead use :plug_adapter. Under that context, would tesla events be structured [:tesla, :request, :stop] -> [:http_client, :request, :stop]? Am I misunderstanding?
:telemetry.execute(
      [:plug_adapter, :call, :start],
      %{system_time: System.system_time()},
      %{adapter: @adapter, conn: conn, plug: plug}
    )

@keatz55 That's a great callout. I don't know that we put a lot more thought into it beyond it being a plug_adapter and that there is central control of all of those adapters by the same folks so coordination of naming, measurements, and metadata is straightforward across every adapter. It's easy for us to say "this is how it's all structured and here's how we identify the adapter". That isn't necessarily true for everything else out there, such as http clients, although that would be very nice.
The main theme is consistency across the entire ecosystem, so we should provide docs with guidance. These patterns, conventions, and libraries are born out of trial and error, which has been rough for the community, but is necessary to determine the best overall solutions.
How do you feel about the ability to pass static metadata as an option? Do you want to take a crack at that?

Sidenote, just to highlight the customisation options in tesla:
# 1. Pass static opts
defmodule MyStaticClient do
  use Tesla

  plug Tesla.Middleware.Telemetry, static: opts
end

# 2. Pass opts on client creation
defmodule MyDynamicClient do
  def new(opts) do
    middleware = [
      # ...
      {Tesla.Middleware.Telemetry, [dynamic: opts]}
    ]
  end
end

# 3. Wrap with custom middleware and modify on each request
defmodule MyTelemetryMiddleware do
  def call(env, next, opts) do
    {new_env, new_opts} = do_magic_with(env, opts)
    Tesla.Middleware.Telemetry.call(new_env, next, new_opts)
  end
end

@bryannaegele Sounds good. I'll take a crack at it tonight post-work.

👋 @keatz55 How's going? :)

@teamon I apologize. Work has been eating me alive and I completely spaced this. I'll take a crack at it this weekend.

@bryannaegele Is the convention described in https://keathley.io/blog/telemetry-conventions.html blessed by beam-telemetry community? :)

@teamon generally, yes. I was supposed to review it prior to publication but he pretty much nailed it.

Prefixes are an anti-pattern.
Make metadata configurable for your users in some way if possible.
And expose everything to let the user decide what's important.

Let me know what do you think of https://github.com/teamon/tesla/pull/419


Fix renaming of "runtime" container to "docker-daemon".

Original PR #1656.

This change is

@k8s-bot ok to test

@k8s-bot pull-heapster-e2e test this

merging since this has lgtm and tests pass