Adding cloud.udmi.pointset test

Referencing: https://github.com/faucetsdn/daq/issues/152

@grafnu I was wondering about the gateway vs deviceId dilemma I was having!

You are 100% right -- that's just a change that I didn't test properly
end-to-end... thanks for catching that.
On Thu, Jun 27, 2019 at 6:02 AM Jason Brewer<EMAIL_ADDRESS>wrote:

@InBrewJ requested changes on this pull request.
Keygen links now work fine 👍
Also regarding the keygen itself, I changed the TARGET_PREFIX in
https://github.com/grafnu/daq/blob/udmitest/pubber/bin/keygen to
local/rsa_ since that's what I belive this file:
https://github.com/grafnu/daq/blob/udmitest/pubber/src/main/java/daq/pubber/Configuration.java
is expecting. This could be expected behaviour but it makes pubber
slightly hard to test with
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/grafnu/daq/pull/165?email_source=notifications&email_token=AAIEPD4FQ623FK57ETQ7DH3P4S25JA5CNFSM4H3I2D7KYY3PNVWWK3TUL52HS4DFWFIHK3DMKJSXC5LFON2FEZLWNFSXPKTDN5WW2ZLOORPWSZGOB43C7MI#pullrequestreview-255209393,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAIEPDYDGOSYKOONIAAUUXDP4S25JANCNFSM4H3I2D7A
.

No problem - I'm running the udmi test (and nothing else) as we speak. I'll report back

Also these were the topics I set up for the registrar/pubber to work. I'm pretty sure they're still not right but it's a start.

I think you only need one topic, it's just that everything needs to be
configured the same, and I don't think the examples/defaults are setup like
that.  I use "target" for everything :-).   If I get a chance (maybe), I
should walk through everything from scratch and make sure it's all
coherent...
On Thu, Jun 27, 2019 at 6:39 AM Jason Brewer<EMAIL_ADDRESS>wrote:

Also these were the topics I set up for the registrar/pubber to work. I'm
pretty sure they're still not right but it's a start.
[image: registrarTopics]
https://user-images.githubusercontent.com/5684825/60270888-3b3a7700-98e9-11e9-9c4f-82a56584993b.png
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/grafnu/daq/pull/165?email_source=notifications&email_token=AAIEPD4ALLCHVOC7BNEPOKTP4S7H5A5CNFSM4H3I2D7KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODYXETEA#issuecomment-506349968,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAIEPD7HTWUMBQJE5JVDXRTP4S7H5ANCNFSM4H3I2D7A
.

@grafnu I'm getting an error at the end of the udmi test as follows:

INFO:gcp:Unsubscribe callback device/9a:02:57:1e:8f:00
INFO:google.cloud.firestore_v1.watch:RPC termination has signaled manager shutdown.
ERROR:gcp:Error intercepted at 2019-06-27T14:00:06.245Z, StatusCode.CANCELLED for origin/daq-firebase-dashboard-role/device/9a:02:57:1e:8f:00/config/definition
ERROR:google.api_core.bidi:Thread-ConsumeBidirectionalStream caught unexpected exception <_Rendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Locally cancelled by application!"
	debug_error_string = "None"
> and will exit.
Traceback (most recent call last):
  File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 633, in _thread_main
    response = self._bidi_rpc.recv()
  File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 140, in <lambda>
    rpc.recv = lambda: self._hack_recv(rpc, path)
  File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 130, in _hack_recv
    raise e
  File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 124, in _hack_recv
    return rpc._recoverable(rpc._recv) # Erp.
  File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 503, in _recoverable
    raise exc
  File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 493, in _recoverable
    return method(*args, **kwargs)
  File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 541, in _recv
    return next(call)
  File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py", line 364, in __next__
    return self._next()
  File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py", line 358, in _next
    raise self
grpc._channel._Rendezvous: <_Rendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Locally cancelled by application!"
	debug_error_string = "None"
>
INFO:google.api_core.bidi:Thread-ConsumeBidirectionalStream exiting
INFO:gcp:Releasing origin/daq-firebase-dashboard-role/device/9a:02:57:1e:8f:00/config/definition
INFO:gcp:Unsubscribe callback control/port-1
INFO:google.cloud.firestore_v1.watch:RPC termination has signaled manager shutdown.
ERROR:gcp:Error intercepted at 2019-06-27T14:00:06.461Z, StatusCode.CANCELLED for origin/daq-firebase-dashboard-role/control/port-1/config/definition
ERROR:google.api_core.bidi:Thread-ConsumeBidirectionalStream caught unexpected exception <_Rendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Locally cancelled by application!"
	debug_error_string = "None"
> and will exit.
Traceback (most recent call last):
  File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 633, in _thread_main
    response = self._bidi_rpc.recv()
  File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 140, in <lambda>
    rpc.recv = lambda: self._hack_recv(rpc, path)
  File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 130, in _hack_recv
    raise e
  File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 124, in _hack_recv
    return rpc._recoverable(rpc._recv) # Erp.
  File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 503, in _recoverable
    raise exc
  File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 493, in _recoverable
    return method(*args, **kwargs)
  File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 541, in _recv
    return next(call)
  File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py", line 364, in __next__
    return self._next()
  File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py", line 358, in _next
    raise self
grpc._channel._Rendezvous: <_Rendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Locally cancelled by application!"
	debug_error_string = "None"
>

The test is failing (as I half expect it to since my configuration is still, doubtless, wrong):

But the error seems to stop that 'fail' result from being written into the inst/reports, which shows this:
DAQ scan report for device 9a02571e8f00
Report summary

Result
Test
Notes

skip
base.switch.ping

pass
base.target.ping
target

Module ping
Baseline ping test report
%% 62 packets captured.
RESULT skip base.switch.ping
RESULT pass base.target.ping target %% <IP_ADDRESS>

Report complete
activate.log
Using credentials from /config/inst/gcp_service_account.json
Extracted project arup-bos
Extracted service daq-firebase-dashboard-role
Configured topic is target
Configured schema is schemas/udmi
Target device is PUB-01

Executing validator /root/schemas/udmi pubsub:target...
Running schema . in /root/schemas/udmi
GOOGLE_APPLICATION_CREDENTIALS=/config/inst/gcp_service_account.json
Results will be uploaded to https://console.cloud.google.com/firestore/data/registries/?project=arup-bos
Also found in such directories as /root/schemas/udmi/out
Connecting to pubsub topic target
Connecting to pubsub subscription projects/arup-bos/subscriptions/daq-validator-daq-firebase-dashboard-role-udmi01
Deleting old subscription projects/arup-bos/subscriptions/daq-validator-daq-firebase-dashboard-role-udmi01
Creating new subscription projects/arup-bos/subscriptions/daq-validator-daq-firebase-dashboard-role-udmi01
Entering pubsub message loop on projects/arup-bos/subscriptions/daq-validator-daq-firebase-dashboard-role-udmi01
ls: cannot access 'schemas/udmi/out/pointset_PUB-01.*': No such file or directory

I've added a target topic on my GCP account, but still no joy. I feel like I'm still missing something...

Can you send the complete log?
On Thu, Jun 27, 2019, 7:12 AM Jason Brewer<EMAIL_ADDRESS>wrote:

@grafnu https://github.com/grafnu I'm getting an error at the end of
the udmi test as follows:
INFO:gcp:Unsubscribe callback device/9a:02:57:1e:8f:00
INFO:google.cloud.firestore_v1.watch:RPC termination has signaled manager shutdown.
ERROR:gcp:Error intercepted at 2019-06-27T14:00:06.245Z, StatusCode.CANCELLED for origin/daq-firebase-dashboard-role/device/9a:02:57:1e:8f:00/config/definition
ERROR:google.api_core.bidi:Thread-ConsumeBidirectionalStream caught unexpected exception <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Locally cancelled by application!"
debug_error_string = "None"

and will exit.
Traceback (most recent call last):
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 633, in _thread_main
response = self._bidi_rpc.recv()
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 140, in
rpc.recv = lambda: self._hack_recv(rpc, path)
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 130, in _hack_recv
raise e
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 124, in _hack_recv
return rpc._recoverable(rpc._recv) # Erp.
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 503, in _recoverable
raise exc
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 493, in _recoverable
return method(*args, **kwargs)
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 541, in _recv
return next(call)
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py", line 364, in next
return self._next()
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py", line 358, in _next
raise self
grpc._channel._Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Locally cancelled by application!"
debug_error_string = "None"

INFO:google.api_core.bidi:Thread-ConsumeBidirectionalStream exiting
INFO:gcp:Releasing origin/daq-firebase-dashboard-role/device/9a:02:57:1e:8f:00/config/definition
INFO:gcp:Unsubscribe callback control/port-1
INFO:google.cloud.firestore_v1.watch:RPC termination has signaled manager shutdown.
ERROR:gcp:Error intercepted at 2019-06-27T14:00:06.461Z, StatusCode.CANCELLED for origin/daq-firebase-dashboard-role/control/port-1/config/definition
ERROR:google.api_core.bidi:Thread-ConsumeBidirectionalStream caught unexpected exception <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Locally cancelled by application!"
debug_error_string = "None"

and will exit.
Traceback (most recent call last):
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 633, in _thread_main
response = self._bidi_rpc.recv()
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 140, in
rpc.recv = lambda: self._hack_recv(rpc, path)
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 130, in _hack_recv
raise e
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 124, in _hack_recv
return rpc._recoverable(rpc._recv) # Erp.
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 503, in _recoverable
raise exc
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 493, in _recoverable
return method(*args, **kwargs)
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 541, in _recv
return next(call)
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py", line 364, in next
return self._next()
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py", line 358, in _next
raise self
grpc._channel._Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Locally cancelled by application!"
debug_error_string = "None"

The test is failing (as I half expect it to since my configuration is
still, doubtless, wrong):
[image: failudmi]
https://user-images.githubusercontent.com/5684825/60272728-97eb6100-98ec-11e9-9836-a1371ae0274a.png
But the error seems to stop that 'fail' result from being written into the
inst/reports, which shows this:
DAQ scan report for device 9a02571e8f00 Report summary
Result Test Notes
skip base.switch.ping
pass base.target.ping target Module ping
Baseline ping test report
%% 62 packets captured.
RESULT skip base.switch.ping
RESULT pass base.target.ping target %% <IP_ADDRESS>
Report complete
activate.log
Using credentials from /config/inst/gcp_service_account.json
Extracted project arup-bos
Extracted service daq-firebase-dashboard-role
Configured topic is target
Configured schema is schemas/udmi
Target device is PUB-01
Executing validator /root/schemas/udmi pubsub:target...
Running schema . in /root/schemas/udmi
GOOGLE_APPLICATION_CREDENTIALS=/config/inst/gcp_service_account.json
Results will be uploaded to https://console.cloud.google.com/firestore/data/registries/?project=arup-bos
Also found in such directories as /root/schemas/udmi/out
Connecting to pubsub topic target
Connecting to pubsub subscription projects/arup-bos/subscriptions/daq-validator-daq-firebase-dashboard-role-udmi01
Deleting old subscription projects/arup-bos/subscriptions/daq-validator-daq-firebase-dashboard-role-udmi01
Creating new subscription projects/arup-bos/subscriptions/daq-validator-daq-firebase-dashboard-role-udmi01
Entering pubsub message loop on projects/arup-bos/subscriptions/daq-validator-daq-firebase-dashboard-role-udmi01
ls: cannot access 'schemas/udmi/out/pointset_PUB-01.*': No such file or directory
I've added a target topic on my GCP account, but still no joy. I feel
like I'm still missing something...
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/grafnu/daq/pull/165?email_source=notifications&email_token=AAIEPD5C4YNS7QYKCSEV4Z3P4TDFZA5CNFSM4H3I2D7KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODYXH4QY#issuecomment-506363459,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAIEPDY3AISGQF5A7OYDRD3P4TDFZANCNFSM4H3I2D7A
.

Also try disabling the udmi test to certify the system is WAI without it.
Problem might be unrelated...
On Thu, Jun 27, 2019, 7:12 AM Jason Brewer<EMAIL_ADDRESS>wrote:

@grafnu https://github.com/grafnu I'm getting an error at the end of
the udmi test as follows:
INFO:gcp:Unsubscribe callback device/9a:02:57:1e:8f:00
INFO:google.cloud.firestore_v1.watch:RPC termination has signaled manager shutdown.
ERROR:gcp:Error intercepted at 2019-06-27T14:00:06.245Z, StatusCode.CANCELLED for origin/daq-firebase-dashboard-role/device/9a:02:57:1e:8f:00/config/definition
ERROR:google.api_core.bidi:Thread-ConsumeBidirectionalStream caught unexpected exception <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Locally cancelled by application!"
debug_error_string = "None"

and will exit.
Traceback (most recent call last):
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 633, in _thread_main
response = self._bidi_rpc.recv()
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 140, in
rpc.recv = lambda: self._hack_recv(rpc, path)
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 130, in _hack_recv
raise e
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 124, in _hack_recv
return rpc._recoverable(rpc._recv) # Erp.
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 503, in _recoverable
raise exc
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 493, in _recoverable
return method(*args, **kwargs)
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 541, in _recv
return next(call)
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py", line 364, in next
return self._next()
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py", line 358, in _next
raise self
grpc._channel._Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Locally cancelled by application!"
debug_error_string = "None"

INFO:google.api_core.bidi:Thread-ConsumeBidirectionalStream exiting
INFO:gcp:Releasing origin/daq-firebase-dashboard-role/device/9a:02:57:1e:8f:00/config/definition
INFO:gcp:Unsubscribe callback control/port-1
INFO:google.cloud.firestore_v1.watch:RPC termination has signaled manager shutdown.
ERROR:gcp:Error intercepted at 2019-06-27T14:00:06.461Z, StatusCode.CANCELLED for origin/daq-firebase-dashboard-role/control/port-1/config/definition
ERROR:google.api_core.bidi:Thread-ConsumeBidirectionalStream caught unexpected exception <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Locally cancelled by application!"
debug_error_string = "None"

and will exit.
Traceback (most recent call last):
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 633, in _thread_main
response = self._bidi_rpc.recv()
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 140, in
rpc.recv = lambda: self._hack_recv(rpc, path)
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 130, in _hack_recv
raise e
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 124, in _hack_recv
return rpc._recoverable(rpc._recv) # Erp.
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 503, in _recoverable
raise exc
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 493, in _recoverable
return method(*args, **kwargs)
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 541, in _recv
return next(call)
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py", line 364, in next
return self._next()
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py", line 358, in _next
raise self
grpc._channel._Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Locally cancelled by application!"
debug_error_string = "None"

The test is failing (as I half expect it to since my configuration is
still, doubtless, wrong):
[image: failudmi]
https://user-images.githubusercontent.com/5684825/60272728-97eb6100-98ec-11e9-9836-a1371ae0274a.png
But the error seems to stop that 'fail' result from being written into the
inst/reports, which shows this:
DAQ scan report for device 9a02571e8f00 Report summary
Result Test Notes
skip base.switch.ping
pass base.target.ping target Module ping
Baseline ping test report
%% 62 packets captured.
RESULT skip base.switch.ping
RESULT pass base.target.ping target %% <IP_ADDRESS>
Report complete
activate.log
Using credentials from /config/inst/gcp_service_account.json
Extracted project arup-bos
Extracted service daq-firebase-dashboard-role
Configured topic is target
Configured schema is schemas/udmi
Target device is PUB-01
Executing validator /root/schemas/udmi pubsub:target...
Running schema . in /root/schemas/udmi
GOOGLE_APPLICATION_CREDENTIALS=/config/inst/gcp_service_account.json
Results will be uploaded to https://console.cloud.google.com/firestore/data/registries/?project=arup-bos
Also found in such directories as /root/schemas/udmi/out
Connecting to pubsub topic target
Connecting to pubsub subscription projects/arup-bos/subscriptions/daq-validator-daq-firebase-dashboard-role-udmi01
Deleting old subscription projects/arup-bos/subscriptions/daq-validator-daq-firebase-dashboard-role-udmi01
Creating new subscription projects/arup-bos/subscriptions/daq-validator-daq-firebase-dashboard-role-udmi01
Entering pubsub message loop on projects/arup-bos/subscriptions/daq-validator-daq-firebase-dashboard-role-udmi01
ls: cannot access 'schemas/udmi/out/pointset_PUB-01.*': No such file or directory
I've added a target topic on my GCP account, but still no joy. I feel
like I'm still missing something...
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/grafnu/daq/pull/165?email_source=notifications&email_token=AAIEPD5C4YNS7QYKCSEV4Z3P4TDFZA5CNFSM4H3I2D7KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODYXH4QY#issuecomment-506363459,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAIEPDY3AISGQF5A7OYDRD3P4TDFZANCNFSM4H3I2D7A
.

cmdrun.log
Activating venv
Loading config from local/system.conf into inst/config/system.conf
Release version 1.0.0
ovsdb-server is running with pid 1514
ovs-vswitchd is running with pid 4276
Creating mudacl templates...

Task :compileJava UP-TO-DATE
Task :processResources NO-SOURCE
Task :classes UP-TO-DATE
Task :shadowJar UP-TO-DATE

BUILD SUCCESSFUL in 0s
2 actionable tasks: 2 up-to-date
Running mudacl regression test...
Writing output files to /home/guestsudo/Projects/GoogleBos/grafnu/daq/mudacl/out/acl_templates
Writing output files to /home/guestsudo/Projects/GoogleBos/grafnu/daq/mudacl/out/port_acls
Compare out/acl_templates/ with setup/acl_templates/...
Compare out/port_acls/ with setup/port_acls/...
Activating venv
Loading config from local/system.conf into inst/config/system.conf

Task :compileJava UP-TO-DATE
Task :processResources NO-SOURCE
Task :classes UP-TO-DATE
Task :shadowJar UP-TO-DATE

BUILD SUCCESSFUL in 0s
2 actionable tasks: 2 up-to-date
Executing mudacl generator on mud_files/...
Writing output files to /home/guestsudo/Projects/GoogleBos/grafnu/daq/inst/acl_templates
inst/acl_templates:
total 40
-rw-r--r-- 1 root root  540 Jun 27 15:26 template_bacnet_acl.yaml
-rw-r--r-- 1 root root  332 Jun 27 15:26 template_bacnet_frdev_acl.yaml
-rw-r--r-- 1 root root  332 Jun 27 15:26 template_bacnet_todev_acl.yaml
-rw-r--r-- 1 root root  768 Jun 27 15:26 template_baseline_acl.yaml
-rw-r--r-- 1 root root 1966 Jun 27 15:26 template_commissioning_acl.yaml
-rw-r--r-- 1 root root 1452 Jun 27 15:26 template_controller_acl.yaml
-rw-r--r-- 1 root root   78 Jun 27 15:26 template_default_acl.yaml
-rw-r--r-- 1 root root 1442 Jun 27 15:26 template_lightbulb_acl.yaml
-rw-r--r-- 1 root root  258 Jun 27 15:26 template_raw_acl.yaml
-rw-r--r-- 1 root root  496 Jun 27 15:26 template_telnet_acl.yaml
inst/port_acls:
total 0
Sourcing misc/startup_base.cmd...
DAQ autostart cmd/faux
Activating venv
Loading config from local/system.conf into inst/config/system.conf
Launching faux ...
Clensing old container daq-faux
DAQ autoclean docker kill daq-faux
Removing old interface faux
Adding new interface to 8034...
Done with faux device launch.
Entering virtual python environment...
Using python3 at /home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/bin/python3
Executing: python3 -u daq/daq.py /home/guestsudo/Projects/GoogleBos/grafnu/daq/local/system.conf -s
Prepending /home/guestsudo/Projects/GoogleBos/grafnu/daq/binhack to PATH
processing arg: /home/guestsudo/Projects/GoogleBos/grafnu/daq/local/system.conf
Reading config from /home/guestsudo/Projects/GoogleBos/grafnu/daq/local/system.conf
processing arg: -s
base_conf=local/module_config.json
gcp_cred=local/arup-bos-417ac300ed18.json
gcp_topic=target
host_tests=misc/all_tests.conf
intf_names=faux
run_mode=local
schema_path=schemas/udmi
single_shot=True
site_description=AA-DEA-DBEEF
site_path=local/site/
startup_cmds=misc/startup_base.cmd
INFO:daq:pid is 8144
INFO:gcp:Loading gcp credentials from local/arup-bos-417ac300ed18.json
INFO:gcp:Initialized gcp pub/sub arup-bos:daq-firebase-dashboard-role
INFO:gcp:Initialized gcp firestore arup-bos:daq-firebase-dashboard-role
INFO:gcp:Dashboard at https://arup-bos.firebaseapp.com/?origin=daq-firebase-dashboard-role
INFO:gcp:Storage bucket arup-bos.appspot.com already exists
INFO:gcp:Connection initialized at 2019-06-27T14:26:27.526Z
INFO:config:Loading config from local/module_config.json
INFO:config:Skipping missing local/site/module_config.json
INFO:gcp:Registering origin/daq-firebase-dashboard-role/runner/setup/config/definition
INFO:gcp:Patching recv callback for origin/daq-firebase-dashboard-role/runner/setup/config/definition with 2
INFO:runner:Reading test definition file misc/all_tests.conf
INFO:runner:Reading test definition file misc/host_tests.conf
INFO:runner:Reading test definition file subset/pentests/build.conf
INFO:runner:Reading test definition file subset/switches/build.conf
INFO:runner:Reading test definition file subset/connection/build.conf
INFO:runner:Reading test definition file subset/bacnet/build.conf
INFO:runner:Reading test definition file subset/security/build.conf
INFO:runner:Reading test definition file subset/cloud/build.conf
INFO:runner:Configured with tests ['pass', 'fail', 'ping', 'bacnet', 'mudgee', 'nmap', 'brute', 'switch', 'macoui', 'bacext', 'tls', 'udmi']
INFO:network:Activating faucet topology...
INFO:topology:No device_specs file specified, skipping...
INFO:topology:Writing network config to inst/faucet.yaml
INFO:topology:Starting faucet...
INFO:network:Creating ovs sec with dpid/port 2/7
INFO:network:Added switch link pri-eth1 <-> sec-eth7
INFO:network:Attaching device interface faux on port 1.
INFO:network:Attaching device interface sec-2 on port 2.
INFO:network:Attaching device interface sec-3 on port 3.
INFO:network:Attaching device interface sec-4 on port 4.
INFO:network:Attaching device interface sec-5 on port 5.
INFO:network:Attaching device interface sec-6 on port 6.
INFO:network:Starting mininet...
INFO:mininet:*** Configuring hosts
INFO:mininet:*** Starting controller
INFO:mininet:controller
INFO:mininet:*** Starting 2 switches
INFO:mininet:pri
INFO:mininet:sec
INFO:mininet:...
INFO:runner:Waiting for system to settle...
INFO:runner:Entering main event loop.
INFO:runner:If this blocks for too long, see docs/test_lab.md for tips and tricks.
INFO:runner:System port 7 on dpid 2 is active True
INFO:runner:Port 1 dpid 2 is now active True
INFO:runner:Port 1 dpid 2 learned 9a:02:57:1e:8f:00
INFO:runner:Gateway for device group 9a02571e8f00 not found, initializing base 1...
INFO:gateway:Initializing gateway 9a02571e8f00 as gw01/10
INFO:gateway:Added networking host gw01 on port 10 at <IP_ADDRESS>
INFO:gateway:Added dummy target dummy01 on port 11 at <IP_ADDRESS>
INFO:gateway:Gateway 1 startup capture gw01-eth0 in container's /tmp/gateway.pcap
INFO:dhcp:DHCP monitor gw01 waiting for replies...
INFO:runner:Test ping gw01->dummy01
INFO:runner:Test ping gw01->dummy01
INFO:runner:Test ping dummy01->gw01
INFO:runner:Test ping dummy01-><IP_ADDRESS>
INFO:runner:Test ping gw01->dummy01 from <IP_ADDRESS>
INFO:gateway:Attaching target 1 to gateway group 9a02571e8f00
INFO:config:Loading config from /home/guestsudo/Projects/GoogleBos/grafnu/daq/local/site/mac_addrs/9a02571e8f00/module_config.json
INFO:config:Loading config from /home/guestsudo/Projects/GoogleBos/grafnu/daq/local/site/mac_addrs/9a02571e8f00/module_config.json
INFO:host:Device config reloaded: True 9a:02:57:1e:8f:00
INFO:config:Writing config to /home/guestsudo/Projects/GoogleBos/grafnu/daq/local/site/mac_addrs/9a02571e8f00/aux/module_config.json
INFO:host:Host 1 running with enabled tests ['pass', 'fail', 'ping', 'udmi']
INFO:report:Creating report as inst/reports/report_9a02571e8f00_2019-06-27T142652+0000.md
INFO:runner:Target port 1 registered 9a:02:57:1e:8f:00
INFO:host:Target port 1 initializing...
INFO:config:Loading config from /home/guestsudo/Projects/GoogleBos/grafnu/daq/local/site/mac_addrs/9a02571e8f00/module_config.json
INFO:gcp:Registering origin/daq-firebase-dashboard-role/device/9a:02:57:1e:8f:00/config/definition
INFO:gcp:Patching recv callback for origin/daq-firebase-dashboard-role/device/9a:02:57:1e:8f:00/config/definition with 2
INFO:gcp:Registering origin/daq-firebase-dashboard-role/control/port-1/config/definition
INFO:gcp:Patching recv callback for origin/daq-firebase-dashboard-role/control/port-1/config/definition with 2
INFO:network:Creating mirror pair mirror-1 <-> mirror-1-ext at 1001
INFO:host:Target port 1 startup pcap capture
INFO:network:Directing traffic for 9a:02:57:1e:8f:00 on port 1: True
INFO:topology:Waiting 5s for network to settle
INFO:host:Updated control config: 9a:02:57:1e:8f:00 {'paused': True}
WARNING:host:Inconsistent control state for update of 9a:02:57:1e:8f:00
INFO:host:Target port 1 waiting for dhcp as 9a:02:57:1e:8f:00
INFO:runner:DHCP notify 9a:02:57:1e:8f:00 is <IP_ADDRESS> on gw01 (pass/None/30)
INFO:gateway:Ready target 9a:02:57:1e:8f:00 from gateway group 9a02571e8f00
INFO:runner:DHCP activating target 9a:02:57:1e:8f:00
INFO:host:Target port 1 triggered as <IP_ADDRESS>
INFO:runner:Test ping gw01-><IP_ADDRESS>
INFO:runner:Test ping gw01-><IP_ADDRESS>
INFO:runner:Test ping gw01-><IP_ADDRESS> from <IP_ADDRESS>
INFO:host:Target port 1 monitor scan complete
INFO:host:Target port 1 done with base.
INFO:host:Target port 1 background scan for 30s
INFO:host:Target port 1 scan complete
INFO:host:Target port 1 monitor scan complete
INFO:config:Loading config from /home/guestsudo/Projects/GoogleBos/grafnu/daq/local/site/mac_addrs/9a02571e8f00/module_config.json
INFO:config:Writing config to inst/run-port-01/nodes/pass01/tmp/module_config.json
INFO:docker:Target port 1 test pass running
INFO:docker:Target port 1 test pass passed 1.638411s
INFO:host:test_host callback pass/pass01 was 0 with None
INFO:config:Loading config from /home/guestsudo/Projects/GoogleBos/grafnu/daq/local/site/mac_addrs/9a02571e8f00/module_config.json
INFO:config:Writing config to inst/run-port-01/nodes/fail01/tmp/module_config.json
INFO:docker:Target port 1 test fail running
INFO:docker:Target port 1 test fail failed 1.390333s: 1 None
INFO:host:test_host callback fail/fail01 was 1 with None
INFO:config:Loading config from /home/guestsudo/Projects/GoogleBos/grafnu/daq/local/site/mac_addrs/9a02571e8f00/module_config.json
INFO:config:Writing config to inst/run-port-01/nodes/ping01/tmp/module_config.json
INFO:docker:Target port 1 test ping running
INFO:runner:DHCP notify 9a:02:57:1e:8f:00 is <IP_ADDRESS> on gw01 (pass/None/44)
INFO:runner:DHCP activation group 9a02571e8f00 already activated
INFO:docker:Target port 1 test ping passed 10.806785s
INFO:host:test_host callback ping/ping01 was 0 with None
INFO:config:Loading config from /home/guestsudo/Projects/GoogleBos/grafnu/daq/local/site/mac_addrs/9a02571e8f00/module_config.json
INFO:config:Writing config to inst/run-port-01/nodes/udmi01/tmp/module_config.json
INFO:docker:Target port 1 test udmi running
INFO:docker:Target port 1 test udmi failed 61.64184s: 2 None
INFO:host:test_host callback udmi/udmi01 was 2 with None
INFO:host:Target port 1 no more tests remaining
INFO:report:Finalizing report report_9a02571e8f00_2019-06-27T142652+0000.md
INFO:report:Skipping missing report header template local/site/report_template.md
INFO:report:Copying test report inst/run-port-01/nodes/ping01/tmp/report.txt
INFO:report:Copying report to local/site/mac_addrs/9a02571e8f00/device_report.md
INFO:gcp:Uploaded test report to inst/reports/report_9a02571e8f00_2019-06-27T142652+0000.md
INFO:runner:Target port 1 finalize: ['01:udmi:2'] (target set not active)
INFO:runner:Target port 1 cancel 9a:02:57:1e:8f:00 (#1/0).
INFO:network:Directing traffic for 9a:02:57:1e:8f:00 on port 1: False
INFO:topology:Waiting 5s for network to settle
INFO:host:Target port 1 terminate, trigger False
INFO:gcp:Unsubscribe callback device/9a:02:57:1e:8f:00
INFO:google.cloud.firestore_v1.watch:RPC termination has signaled manager shutdown.
ERROR:gcp:Error intercepted at 2019-06-27T14:29:12.285Z, StatusCode.CANCELLED for origin/daq-firebase-dashboard-role/device/9a:02:57:1e:8f:00/config/definition
ERROR:google.api_core.bidi:Thread-ConsumeBidirectionalStream caught unexpected exception <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Locally cancelled by application!"
debug_error_string = "None"

and will exit.
Traceback (most recent call last):
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 633, in _thread_main
response = self._bidi_rpc.recv()
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 140, in
rpc.recv = lambda: self._hack_recv(rpc, path)
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 130, in _hack_recv
raise e
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 124, in _hack_recv
return rpc._recoverable(rpc._recv) # Erp.
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 503, in _recoverable
raise exc
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 493, in _recoverable
return method(*args, **kwargs)
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 541, in _recv
return next(call)
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py", line 364, in next
return self._next()
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py", line 358, in _next
raise self
grpc._channel._Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Locally cancelled by application!"
debug_error_string = "None"

INFO:google.api_core.bidi:Thread-ConsumeBidirectionalStream exiting
INFO:gcp:Releasing origin/daq-firebase-dashboard-role/device/9a:02:57:1e:8f:00/config/definition
INFO:gcp:Unsubscribe callback control/port-1
INFO:google.cloud.firestore_v1.watch:RPC termination has signaled manager shutdown.
ERROR:gcp:Error intercepted at 2019-06-27T14:29:12.491Z, StatusCode.CANCELLED for origin/daq-firebase-dashboard-role/control/port-1/config/definition
ERROR:google.api_core.bidi:Thread-ConsumeBidirectionalStream caught unexpected exception <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Locally cancelled by application!"
debug_error_string = "None"

and will exit.
Traceback (most recent call last):
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 633, in _thread_main
response = self._bidi_rpc.recv()
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 140, in
rpc.recv = lambda: self._hack_recv(rpc, path)
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 130, in _hack_recv
raise e
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 124, in _hack_recv
return rpc._recoverable(rpc._recv) # Erp.
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 503, in _recoverable
raise exc
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 493, in _recoverable
return method(*args, **kwargs)
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 541, in _recv
return next(call)
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py", line 364, in next
return self._next()
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py", line 358, in _next
raise self
grpc._channel._Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Locally cancelled by application!"
debug_error_string = "None"

INFO:google.api_core.bidi:Thread-ConsumeBidirectionalStream exiting
INFO:gcp:Releasing origin/daq-firebase-dashboard-role/control/port-1/config/definition
INFO:network:Deleting mirror pair mirror-1 <-> mirror-1-ext
INFO:gateway:Detach target 1 from gateway group 9a02571e8f00
INFO:runner:Retiring target gateway 1, 9a:02:57:1e:8f:00, 9a02571e8f00, 1
INFO:gateway:Terminating gateway 1/9a02571e8f00
WARNING:runner:Suppressing future tests because test done in single shot.
INFO:runner:Remaining target sets: []
WARNING:runner:No active ports remaining (0 monitors), ending test run.
INFO:runner:Stopping network...
INFO:mininet:*** Stopping 1 controllers
INFO:mininet:controller
INFO:mininet:*** Stopping 1 links
INFO:mininet:.
INFO:mininet:*** Stopping 2 switches
INFO:mininet:pri
INFO:mininet:sec
INFO:mininet:*** Stopping 1 hosts
INFO:mininet:gw01
INFO:mininet:*** Done
INFO:runner:Done with runner.
INFO:gcp:Unsubscribe callback runner/setup
INFO:google.cloud.firestore_v1.watch:RPC termination has signaled manager shutdown.
ERROR:gcp:Error intercepted at 2019-06-27T14:29:14.577Z, StatusCode.CANCELLED for origin/daq-firebase-dashboard-role/runner/setup/config/definition
ERROR:google.api_core.bidi:Thread-ConsumeBidirectionalStream caught unexpected exception <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Locally cancelled by application!"
debug_error_string = "None"

and will exit.
Traceback (most recent call last):
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 633, in _thread_main
response = self._bidi_rpc.recv()
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 140, in
rpc.recv = lambda: self._hack_recv(rpc, path)
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 130, in _hack_recv
raise e
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 124, in _hack_recv
return rpc._recoverable(rpc._recv) # Erp.
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 503, in _recoverable
raise exc
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 493, in _recoverable
return method(*args, **kwargs)
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py", line 541, in _recv
return next(call)
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py", line 364, in next
return self._next()
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py", line 358, in _next
raise self
grpc._channel._Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Locally cancelled by application!"
debug_error_string = "None"

INFO:google.api_core.bidi:Thread-ConsumeBidirectionalStream exiting
INFO:gcp:Releasing origin/daq-firebase-dashboard-role/runner/setup/config/definition
ERROR:runner:Test failures: ['01:udmi:2']
INFO:daq:DAQ runner returned 1
Cleanup docker kill daq-faux
daq-faux
Done with run, exit 1

Is it possible to send as an attachment?
On Thu, Jun 27, 2019, 7:31 AM Jason Brewer<EMAIL_ADDRESS>wrote:

cmdrun.log
Activating venv
Loading config from local/system.conf into inst/config/system.conf
Release version 1.0.0
ovsdb-server is running with pid 1514
ovs-vswitchd is running with pid 4276
Creating mudacl templates...
Task :compileJava UP-TO-DATE
Task :processResources NO-SOURCE
Task :classes UP-TO-DATE
Task :shadowJar UP-TO-DATE
BUILD SUCCESSFUL in 0s
2 actionable tasks: 2 up-to-date
Running mudacl regression test...
Writing output files to
/home/guestsudo/Projects/GoogleBos/grafnu/daq/mudacl/out/acl_templates
Writing output files to
/home/guestsudo/Projects/GoogleBos/grafnu/daq/mudacl/out/port_acls
Compare out/acl_templates/ with setup/acl_templates/...
Compare out/port_acls/ with setup/port_acls/...
Activating venv
Loading config from local/system.conf into inst/config/system.conf
Task :compileJava UP-TO-DATE
Task :processResources NO-SOURCE
Task :classes UP-TO-DATE
Task :shadowJar UP-TO-DATE
BUILD SUCCESSFUL in 0s
2 actionable tasks: 2 up-to-date
Executing mudacl generator on mud_files/...
Writing output files to
/home/guestsudo/Projects/GoogleBos/grafnu/daq/inst/acl_templates
inst/acl_templates:
total 40
-rw-r--r-- 1 root root 540 Jun 27 15:26 template_bacnet_acl.yaml
-rw-r--r-- 1 root root 332 Jun 27 15:26 template_bacnet_frdev_acl.yaml
-rw-r--r-- 1 root root 332 Jun 27 15:26 template_bacnet_todev_acl.yaml
-rw-r--r-- 1 root root 768 Jun 27 15:26 template_baseline_acl.yaml
-rw-r--r-- 1 root root 1966 Jun 27 15:26 template_commissioning_acl.yaml
-rw-r--r-- 1 root root 1452 Jun 27 15:26 template_controller_acl.yaml
-rw-r--r-- 1 root root 78 Jun 27 15:26 template_default_acl.yaml
-rw-r--r-- 1 root root 1442 Jun 27 15:26 template_lightbulb_acl.yaml
-rw-r--r-- 1 root root 258 Jun 27 15:26 template_raw_acl.yaml
-rw-r--r-- 1 root root 496 Jun 27 15:26 template_telnet_acl.yaml
inst/port_acls:
total 0
Sourcing misc/startup_base.cmd...
DAQ autostart cmd/faux
Activating venv
Loading config from local/system.conf into inst/config/system.conf
Launching faux ...
Clensing old container daq-faux
DAQ autoclean docker kill daq-faux
Removing old interface faux
Adding new interface to 8034...
Done with faux device launch.
Entering virtual python environment...
Using python3 at
/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/bin/python3
Executing: python3 -u daq/daq.py
/home/guestsudo/Projects/GoogleBos/grafnu/daq/local/system.conf -s
Prepending /home/guestsudo/Projects/GoogleBos/grafnu/daq/binhack to PATH
processing arg:
/home/guestsudo/Projects/GoogleBos/grafnu/daq/local/system.conf
Reading config from
/home/guestsudo/Projects/GoogleBos/grafnu/daq/local/system.conf
processing arg: -s
base_conf=local/module_config.json
gcp_cred=local/arup-bos-417ac300ed18.json
gcp_topic=target
host_tests=misc/all_tests.conf
intf_names=faux
run_mode=local
schema_path=schemas/udmi
single_shot=True
site_description=AA-DEA-DBEEF
site_path=local/site/
startup_cmds=misc/startup_base.cmd
INFO:daq:pid is 8144
INFO:gcp:Loading gcp credentials from local/arup-bos-417ac300ed18.json
INFO:gcp:Initialized gcp pub/sub arup-bos:daq-firebase-dashboard-role
INFO:gcp:Initialized gcp firestore arup-bos:daq-firebase-dashboard-role
INFO:gcp:Dashboard at
https://arup-bos.firebaseapp.com/?origin=daq-firebase-dashboard-role
INFO:gcp:Storage bucket arup-bos.appspot.com already exists
INFO:gcp:Connection initialized at 2019-06-27T14:26:27.526Z
INFO:config:Loading config from local/module_config.json
INFO:config:Skipping missing local/site/module_config.json
INFO:gcp:Registering
origin/daq-firebase-dashboard-role/runner/setup/config/definition
INFO:gcp:Patching recv callback for
origin/daq-firebase-dashboard-role/runner/setup/config/definition with 2
INFO🏃Reading test definition file misc/all_tests.conf
INFO🏃Reading test definition file misc/host_tests.conf
INFO🏃Reading test definition file subset/pentests/build.conf
INFO🏃Reading test definition file subset/switches/build.conf
INFO🏃Reading test definition file subset/connection/build.conf
INFO🏃Reading test definition file subset/bacnet/build.conf
INFO🏃Reading test definition file subset/security/build.conf
INFO🏃Reading test definition file subset/cloud/build.conf
INFO🏃Configured with tests ['pass', 'fail', 'ping', 'bacnet', 'mudgee',
'nmap', 'brute', 'switch', 'macoui', 'bacext', 'tls', 'udmi']
INFO:network:Activating faucet topology...
INFO:topology:No device_specs file specified, skipping...
INFO:topology:Writing network config to inst/faucet.yaml
INFO:topology:Starting faucet...
INFO:network:Creating ovs sec with dpid/port 2/7
INFO:network:Added switch link pri-eth1 <-> sec-eth7
INFO:network:Attaching device interface faux on port 1.
INFO:network:Attaching device interface sec-2 on port 2.
INFO:network:Attaching device interface sec-3 on port 3.
INFO:network:Attaching device interface sec-4 on port 4.
INFO:network:Attaching device interface sec-5 on port 5.
INFO:network:Attaching device interface sec-6 on port 6.
INFO:network:Starting mininet...
INFO:mininet:*** Configuring hosts
INFO:mininet:*** Starting controller
INFO:mininet:controller
INFO:mininet:*** Starting 2 switches
INFO:mininet:pri
INFO:mininet:sec
INFO:mininet:...
INFO🏃Waiting for system to settle...
INFO🏃Entering main event loop.
INFO🏃If this blocks for too long, see docs/test_lab.md for tips and
tricks.
INFO🏃System port 7 on dpid 2 is active True
INFO🏃Port 1 dpid 2 is now active True
INFO🏃Port 1 dpid 2 learned 9a:02:57:1e:8f:00
INFO🏃Gateway for device group 9a02571e8f00 not found, initializing base
1...
INFO:gateway:Initializing gateway 9a02571e8f00 as gw01/10
INFO:gateway:Added networking host gw01 on port 10 at <IP_ADDRESS>
INFO:gateway:Added dummy target dummy01 on port 11 at <IP_ADDRESS>
INFO:gateway:Gateway 1 startup capture gw01-eth0 in container's
/tmp/gateway.pcap
INFO:dhcp:DHCP monitor gw01 waiting for replies...
INFO🏃Test ping gw01->dummy01
INFO🏃Test ping gw01->dummy01
INFO🏃Test ping dummy01->gw01
INFO🏃Test ping dummy01-><IP_ADDRESS>
INFO🏃Test ping gw01->dummy01 from <IP_ADDRESS>
INFO:gateway:Attaching target 1 to gateway group 9a02571e8f00
INFO:config:Loading config from
/home/guestsudo/Projects/GoogleBos/grafnu/daq/local/site/mac_addrs/9a02571e8f00/module_config.json
INFO:config:Loading config from
/home/guestsudo/Projects/GoogleBos/grafnu/daq/local/site/mac_addrs/9a02571e8f00/module_config.json
INFO:host:Device config reloaded: True 9a:02:57:1e:8f:00
INFO:config:Writing config to
/home/guestsudo/Projects/GoogleBos/grafnu/daq/local/site/mac_addrs/9a02571e8f00/aux/module_config.json
INFO:host:Host 1 running with enabled tests ['pass', 'fail', 'ping',
'udmi']
INFO:report:Creating report as
inst/reports/report_9a02571e8f00_2019-06-27T142652+0000.md
INFO🏃Target port 1 registered 9a:02:57:1e:8f:00
INFO:host:Target port 1 initializing...
INFO:config:Loading config from
/home/guestsudo/Projects/GoogleBos/grafnu/daq/local/site/mac_addrs/9a02571e8f00/module_config.json
INFO:gcp:Registering
origin/daq-firebase-dashboard-role/device/9a:02:57:1e:8f:00/config/definition
INFO:gcp:Patching recv callback for
origin/daq-firebase-dashboard-role/device/9a:02:57:1e:8f:00/config/definition
with 2
INFO:gcp:Registering
origin/daq-firebase-dashboard-role/control/port-1/config/definition
INFO:gcp:Patching recv callback for
origin/daq-firebase-dashboard-role/control/port-1/config/definition with 2
INFO:network:Creating mirror pair mirror-1 <-> mirror-1-ext at 1001
INFO:host:Target port 1 startup pcap capture
INFO:network:Directing traffic for 9a:02:57:1e:8f:00 on port 1: True
INFO:topology:Waiting 5s for network to settle
INFO:host:Updated control config: 9a:02:57:1e:8f:00 {'paused': True}
WARNING:host:Inconsistent control state for update of 9a:02:57:1e:8f:00
INFO:host:Target port 1 waiting for dhcp as 9a:02:57:1e:8f:00
INFO🏃DHCP notify 9a:02:57:1e:8f:00 is <IP_ADDRESS> on gw01 (pass/None/30)
INFO:gateway:Ready target 9a:02:57:1e:8f:00 from gateway group 9a02571e8f00
INFO🏃DHCP activating target 9a:02:57:1e:8f:00
INFO:host:Target port 1 triggered as <IP_ADDRESS>
INFO🏃Test ping gw01-><IP_ADDRESS>
INFO🏃Test ping gw01-><IP_ADDRESS>
INFO🏃Test ping gw01-><IP_ADDRESS> from <IP_ADDRESS>
INFO:host:Target port 1 monitor scan complete
INFO:host:Target port 1 done with base.
INFO:host:Target port 1 background scan for 30s
INFO:host:Target port 1 scan complete
INFO:host:Target port 1 monitor scan complete
INFO:config:Loading config from
/home/guestsudo/Projects/GoogleBos/grafnu/daq/local/site/mac_addrs/9a02571e8f00/module_config.json
INFO:config:Writing config to
inst/run-port-01/nodes/pass01/tmp/module_config.json
INFO:docker:Target port 1 test pass running
INFO:docker:Target port 1 test pass passed 1.638411s
INFO:host:test_host callback pass/pass01 was 0 with None
INFO:config:Loading config from
/home/guestsudo/Projects/GoogleBos/grafnu/daq/local/site/mac_addrs/9a02571e8f00/module_config.json
INFO:config:Writing config to
inst/run-port-01/nodes/fail01/tmp/module_config.json
INFO:docker:Target port 1 test fail running
INFO:docker:Target port 1 test fail failed 1.390333s: 1 None
INFO:host:test_host callback fail/fail01 was 1 with None
INFO:config:Loading config from
/home/guestsudo/Projects/GoogleBos/grafnu/daq/local/site/mac_addrs/9a02571e8f00/module_config.json
INFO:config:Writing config to
inst/run-port-01/nodes/ping01/tmp/module_config.json
INFO:docker:Target port 1 test ping running
INFO🏃DHCP notify 9a:02:57:1e:8f:00 is <IP_ADDRESS> on gw01 (pass/None/44)
INFO🏃DHCP activation group 9a02571e8f00 already activated
INFO:docker:Target port 1 test ping passed 10.806785s
INFO:host:test_host callback ping/ping01 was 0 with None
INFO:config:Loading config from
/home/guestsudo/Projects/GoogleBos/grafnu/daq/local/site/mac_addrs/9a02571e8f00/module_config.json
INFO:config:Writing config to
inst/run-port-01/nodes/udmi01/tmp/module_config.json
INFO:docker:Target port 1 test udmi running
INFO:docker:Target port 1 test udmi failed 61.64184s: 2 None
INFO:host:test_host callback udmi/udmi01 was 2 with None
INFO:host:Target port 1 no more tests remaining
INFO:report:Finalizing report report_9a02571e8f00_2019-06-27T142652+0000.md
INFO:report:Skipping missing report header template
local/site/report_template.md
INFO:report:Copying test report
inst/run-port-01/nodes/ping01/tmp/report.txt
INFO:report:Copying report to
local/site/mac_addrs/9a02571e8f00/device_report.md
INFO:gcp:Uploaded test report to
inst/reports/report_9a02571e8f00_2019-06-27T142652+0000.md
INFO🏃Target port 1 finalize: ['01:udmi:2'] (target set not active)
INFO🏃Target port 1 cancel 9a:02:57:1e:8f:00 (#1
https://github.com/grafnu/daq/pull/1/0).
INFO:network:Directing traffic for 9a:02:57:1e:8f:00 on port 1: False
INFO:topology:Waiting 5s for network to settle
INFO:host:Target port 1 terminate, trigger False
INFO:gcp:Unsubscribe callback device/9a:02:57:1e:8f:00
INFO:google.cloud.firestore_v1.watch:RPC termination has signaled manager
shutdown.
ERROR:gcp:Error intercepted at 2019-06-27T14:29:12.285Z,
StatusCode.CANCELLED for
origin/daq-firebase-dashboard-role/device/9a:02:57:1e:8f:00/config/definition
ERROR:google.api_core.bidi:Thread-ConsumeBidirectionalStream caught
unexpected exception <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Locally cancelled by application!"
debug_error_string = "None"
and will exit.
Traceback (most recent call last):
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py",
line 633, in _thread_main
response = self._bidi_rpc.recv()
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 140,
in
rpc.recv = lambda: self._hack_recv(rpc, path)
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 130,
in _hack_recv
raise e
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 124,
in _hack_recv
return rpc._recoverable(rpc._recv) # Erp.
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py",
line 503, in _recoverable
raise exc
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py",
line 493, in _recoverable
return method(*args, **kwargs)
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py",
line 541, in _recv
return next(call)
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py",
line 364, in next
return self._next()
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py",
line 358, in _next
raise self
grpc._channel._Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Locally cancelled by application!"
debug_error_string = "None"
INFO:google.api_core.bidi:Thread-ConsumeBidirectionalStream exiting
INFO:gcp:Releasing
origin/daq-firebase-dashboard-role/device/9a:02:57:1e:8f:00/config/definition
INFO:gcp:Unsubscribe callback control/port-1
INFO:google.cloud.firestore_v1.watch:RPC termination has signaled manager
shutdown.
ERROR:gcp:Error intercepted at 2019-06-27T14:29:12.491Z,
StatusCode.CANCELLED for
origin/daq-firebase-dashboard-role/control/port-1/config/definition
ERROR:google.api_core.bidi:Thread-ConsumeBidirectionalStream caught
unexpected exception <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Locally cancelled by application!"
debug_error_string = "None"
and will exit.
Traceback (most recent call last):
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py",
line 633, in _thread_main
response = self._bidi_rpc.recv()
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 140,
in
rpc.recv = lambda: self._hack_recv(rpc, path)
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 130,
in _hack_recv
raise e
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 124,
in _hack_recv
return rpc._recoverable(rpc._recv) # Erp.
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py",
line 503, in _recoverable
raise exc
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py",
line 493, in _recoverable
return method(*args, **kwargs)
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py",
line 541, in _recv
return next(call)
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py",
line 364, in next
return self._next()
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py",
line 358, in _next
raise self
grpc._channel._Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Locally cancelled by application!"
debug_error_string = "None"
INFO:google.api_core.bidi:Thread-ConsumeBidirectionalStream exiting
INFO:gcp:Releasing
origin/daq-firebase-dashboard-role/control/port-1/config/definition
INFO:network:Deleting mirror pair mirror-1 <-> mirror-1-ext
INFO:gateway:Detach target 1 from gateway group 9a02571e8f00
INFO🏃Retiring target gateway 1, 9a:02:57:1e:8f:00, 9a02571e8f00, 1
INFO:gateway:Terminating gateway 1/9a02571e8f00
WARNING🏃Suppressing future tests because test done in single shot.
INFO🏃Remaining target sets: []
WARNING🏃No active ports remaining (0 monitors), ending test run.
INFO🏃Stopping network...
INFO:mininet:*** Stopping 1 controllers
INFO:mininet:controller
INFO:mininet:*** Stopping 1 links
INFO:mininet:.
INFO:mininet:*** Stopping 2 switches
INFO:mininet:pri
INFO:mininet:sec
INFO:mininet:*** Stopping 1 hosts
INFO:mininet:gw01
INFO:mininet:*** Done
INFO🏃Done with runner.
INFO:gcp:Unsubscribe callback runner/setup
INFO:google.cloud.firestore_v1.watch:RPC termination has signaled manager
shutdown.
ERROR:gcp:Error intercepted at 2019-06-27T14:29:14.577Z,
StatusCode.CANCELLED for
origin/daq-firebase-dashboard-role/runner/setup/config/definition
ERROR:google.api_core.bidi:Thread-ConsumeBidirectionalStream caught
unexpected exception <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Locally cancelled by application!"
debug_error_string = "None"
and will exit.
Traceback (most recent call last):
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py",
line 633, in _thread_main
response = self._bidi_rpc.recv()
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 140,
in
rpc.recv = lambda: self._hack_recv(rpc, path)
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 130,
in _hack_recv
raise e
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 124,
in _hack_recv
return rpc._recoverable(rpc._recv) # Erp.
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py",
line 503, in _recoverable
raise exc
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py",
line 493, in _recoverable
return method(*args, **kwargs)
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py",
line 541, in _recv
return next(call)
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py",
line 364, in next
return self._next()
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py",
line 358, in _next
raise self
grpc._channel._Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Locally cancelled by application!"
debug_error_string = "None"
INFO:google.api_core.bidi:Thread-ConsumeBidirectionalStream exiting
INFO:gcp:Releasing
origin/daq-firebase-dashboard-role/runner/setup/config/definition
ERROR🏃Test failures: ['01:udmi:2']
INFO:daq:DAQ runner returned 1
Cleanup docker kill daq-faux
daq-faux
Done with run, exit 1
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/grafnu/daq/pull/165?email_source=notifications&email_token=AAIEPD3XJTD3IYXDJ37DR33P4TFK3A5CNFSM4H3I2D7KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODYXJXVI#issuecomment-506371029,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAIEPDZQRWOA5NUCHSVMGF3P4TFK3ANCNFSM4H3I2D7A
.

cmdrun.log
(Apologies!)

That log seems incomplete?  For me it ends with...
...
INFO:runner:Test ping gw01-><IP_ADDRESS> from <IP_ADDRESS>
INFO:host:Target port 1 monitor scan complete
INFO:host:Target port 1 done with base.
INFO:host:Target port 1 background scan for 30s
On Thu, Jun 27, 2019 at 7:35 AM Jason Brewer<EMAIL_ADDRESS>wrote:

cmdrun.log https://github.com/grafnu/daq/files/3335218/cmdrun.log
(Apologies!)
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/grafnu/daq/pull/165?email_source=notifications&email_token=AAIEPDYDGTDBLQPXOA3ADYTP4TF2ZA5CNFSM4H3I2D7KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODYXKFAA#issuecomment-506372736,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAIEPD3VIUM3W3DPDNQ3HXDP4TF2ZANCNFSM4H3I2D7A
.

Are you sure the report isn't there?  According to the logs it's being
generated -- so the problem wouldn't be with an error of some kind
preventing it from going out.
INFO:report:Finalizing report report_9a02571e8f00_2019-06-27T142652+0000.md
INFO:report:Skipping missing report header template
local/site/report_template.md
INFO:report:Copying test report inst/run-port-01/nodes/ping01/tmp/report.txt
INFO:report:Copying report to
local/site/mac_addrs/9a02571e8f00/device_report.md
INFO:gcp:Uploaded test report to
inst/reports/report_9a02571e8f00_2019-06-27T142652+0000.md
That nasty error you see is an unfortunate by-product of the Firebase gRPC
mechanism that gets triggered when you remove a change subscription. I
spent some time trying to figure it out, but I couldn't both make the error
go away and keep the system functional. It's a lesson in how not to design
a library error handling mechanism. Anyway -- it should be fine if it's the
CANCELLED message, since that means it (the cancelling) was intentional.  I
believe that message to be a red herring in this case.
On Thu, Jun 27, 2019 at 7:31 AM Jason Brewer<EMAIL_ADDRESS>wrote:

cmdrun.log
Activating venv
Loading config from local/system.conf into inst/config/system.conf
Release version 1.0.0
ovsdb-server is running with pid 1514
ovs-vswitchd is running with pid 4276
Creating mudacl templates...
Task :compileJava UP-TO-DATE
Task :processResources NO-SOURCE
Task :classes UP-TO-DATE
Task :shadowJar UP-TO-DATE
BUILD SUCCESSFUL in 0s
2 actionable tasks: 2 up-to-date
Running mudacl regression test...
Writing output files to
/home/guestsudo/Projects/GoogleBos/grafnu/daq/mudacl/out/acl_templates
Writing output files to
/home/guestsudo/Projects/GoogleBos/grafnu/daq/mudacl/out/port_acls
Compare out/acl_templates/ with setup/acl_templates/...
Compare out/port_acls/ with setup/port_acls/...
Activating venv
Loading config from local/system.conf into inst/config/system.conf
Task :compileJava UP-TO-DATE
Task :processResources NO-SOURCE
Task :classes UP-TO-DATE
Task :shadowJar UP-TO-DATE
BUILD SUCCESSFUL in 0s
2 actionable tasks: 2 up-to-date
Executing mudacl generator on mud_files/...
Writing output files to
/home/guestsudo/Projects/GoogleBos/grafnu/daq/inst/acl_templates
inst/acl_templates:
total 40
-rw-r--r-- 1 root root 540 Jun 27 15:26 template_bacnet_acl.yaml
-rw-r--r-- 1 root root 332 Jun 27 15:26 template_bacnet_frdev_acl.yaml
-rw-r--r-- 1 root root 332 Jun 27 15:26 template_bacnet_todev_acl.yaml
-rw-r--r-- 1 root root 768 Jun 27 15:26 template_baseline_acl.yaml
-rw-r--r-- 1 root root 1966 Jun 27 15:26 template_commissioning_acl.yaml
-rw-r--r-- 1 root root 1452 Jun 27 15:26 template_controller_acl.yaml
-rw-r--r-- 1 root root 78 Jun 27 15:26 template_default_acl.yaml
-rw-r--r-- 1 root root 1442 Jun 27 15:26 template_lightbulb_acl.yaml
-rw-r--r-- 1 root root 258 Jun 27 15:26 template_raw_acl.yaml
-rw-r--r-- 1 root root 496 Jun 27 15:26 template_telnet_acl.yaml
inst/port_acls:
total 0
Sourcing misc/startup_base.cmd...
DAQ autostart cmd/faux
Activating venv
Loading config from local/system.conf into inst/config/system.conf
Launching faux ...
Clensing old container daq-faux
DAQ autoclean docker kill daq-faux
Removing old interface faux
Adding new interface to 8034...
Done with faux device launch.
Entering virtual python environment...
Using python3 at
/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/bin/python3
Executing: python3 -u daq/daq.py
/home/guestsudo/Projects/GoogleBos/grafnu/daq/local/system.conf -s
Prepending /home/guestsudo/Projects/GoogleBos/grafnu/daq/binhack to PATH
processing arg:
/home/guestsudo/Projects/GoogleBos/grafnu/daq/local/system.conf
Reading config from
/home/guestsudo/Projects/GoogleBos/grafnu/daq/local/system.conf
processing arg: -s
base_conf=local/module_config.json
gcp_cred=local/arup-bos-417ac300ed18.json
gcp_topic=target
host_tests=misc/all_tests.conf
intf_names=faux
run_mode=local
schema_path=schemas/udmi
single_shot=True
site_description=AA-DEA-DBEEF
site_path=local/site/
startup_cmds=misc/startup_base.cmd
INFO:daq:pid is 8144
INFO:gcp:Loading gcp credentials from local/arup-bos-417ac300ed18.json
INFO:gcp:Initialized gcp pub/sub arup-bos:daq-firebase-dashboard-role
INFO:gcp:Initialized gcp firestore arup-bos:daq-firebase-dashboard-role
INFO:gcp:Dashboard at
https://arup-bos.firebaseapp.com/?origin=daq-firebase-dashboard-role
INFO:gcp:Storage bucket arup-bos.appspot.com already exists
INFO:gcp:Connection initialized at 2019-06-27T14:26:27.526Z
INFO:config:Loading config from local/module_config.json
INFO:config:Skipping missing local/site/module_config.json
INFO:gcp:Registering
origin/daq-firebase-dashboard-role/runner/setup/config/definition
INFO:gcp:Patching recv callback for
origin/daq-firebase-dashboard-role/runner/setup/config/definition with 2
INFO🏃Reading test definition file misc/all_tests.conf
INFO🏃Reading test definition file misc/host_tests.conf
INFO🏃Reading test definition file subset/pentests/build.conf
INFO🏃Reading test definition file subset/switches/build.conf
INFO🏃Reading test definition file subset/connection/build.conf
INFO🏃Reading test definition file subset/bacnet/build.conf
INFO🏃Reading test definition file subset/security/build.conf
INFO🏃Reading test definition file subset/cloud/build.conf
INFO🏃Configured with tests ['pass', 'fail', 'ping', 'bacnet', 'mudgee',
'nmap', 'brute', 'switch', 'macoui', 'bacext', 'tls', 'udmi']
INFO:network:Activating faucet topology...
INFO:topology:No device_specs file specified, skipping...
INFO:topology:Writing network config to inst/faucet.yaml
INFO:topology:Starting faucet...
INFO:network:Creating ovs sec with dpid/port 2/7
INFO:network:Added switch link pri-eth1 <-> sec-eth7
INFO:network:Attaching device interface faux on port 1.
INFO:network:Attaching device interface sec-2 on port 2.
INFO:network:Attaching device interface sec-3 on port 3.
INFO:network:Attaching device interface sec-4 on port 4.
INFO:network:Attaching device interface sec-5 on port 5.
INFO:network:Attaching device interface sec-6 on port 6.
INFO:network:Starting mininet...
INFO:mininet:*** Configuring hosts
INFO:mininet:*** Starting controller
INFO:mininet:controller
INFO:mininet:*** Starting 2 switches
INFO:mininet:pri
INFO:mininet:sec
INFO:mininet:...
INFO🏃Waiting for system to settle...
INFO🏃Entering main event loop.
INFO🏃If this blocks for too long, see docs/test_lab.md for tips and
tricks.
INFO🏃System port 7 on dpid 2 is active True
INFO🏃Port 1 dpid 2 is now active True
INFO🏃Port 1 dpid 2 learned 9a:02:57:1e:8f:00
INFO🏃Gateway for device group 9a02571e8f00 not found, initializing base
1...
INFO:gateway:Initializing gateway 9a02571e8f00 as gw01/10
INFO:gateway:Added networking host gw01 on port 10 at <IP_ADDRESS>
INFO:gateway:Added dummy target dummy01 on port 11 at <IP_ADDRESS>
INFO:gateway:Gateway 1 startup capture gw01-eth0 in container's
/tmp/gateway.pcap
INFO:dhcp:DHCP monitor gw01 waiting for replies...
INFO🏃Test ping gw01->dummy01
INFO🏃Test ping gw01->dummy01
INFO🏃Test ping dummy01->gw01
INFO🏃Test ping dummy01-><IP_ADDRESS>
INFO🏃Test ping gw01->dummy01 from <IP_ADDRESS>
INFO:gateway:Attaching target 1 to gateway group 9a02571e8f00
INFO:config:Loading config from
/home/guestsudo/Projects/GoogleBos/grafnu/daq/local/site/mac_addrs/9a02571e8f00/module_config.json
INFO:config:Loading config from
/home/guestsudo/Projects/GoogleBos/grafnu/daq/local/site/mac_addrs/9a02571e8f00/module_config.json
INFO:host:Device config reloaded: True 9a:02:57:1e:8f:00
INFO:config:Writing config to
/home/guestsudo/Projects/GoogleBos/grafnu/daq/local/site/mac_addrs/9a02571e8f00/aux/module_config.json
INFO:host:Host 1 running with enabled tests ['pass', 'fail', 'ping',
'udmi']
INFO:report:Creating report as
inst/reports/report_9a02571e8f00_2019-06-27T142652+0000.md
INFO🏃Target port 1 registered 9a:02:57:1e:8f:00
INFO:host:Target port 1 initializing...
INFO:config:Loading config from
/home/guestsudo/Projects/GoogleBos/grafnu/daq/local/site/mac_addrs/9a02571e8f00/module_config.json
INFO:gcp:Registering
origin/daq-firebase-dashboard-role/device/9a:02:57:1e:8f:00/config/definition
INFO:gcp:Patching recv callback for
origin/daq-firebase-dashboard-role/device/9a:02:57:1e:8f:00/config/definition
with 2
INFO:gcp:Registering
origin/daq-firebase-dashboard-role/control/port-1/config/definition
INFO:gcp:Patching recv callback for
origin/daq-firebase-dashboard-role/control/port-1/config/definition with 2
INFO:network:Creating mirror pair mirror-1 <-> mirror-1-ext at 1001
INFO:host:Target port 1 startup pcap capture
INFO:network:Directing traffic for 9a:02:57:1e:8f:00 on port 1: True
INFO:topology:Waiting 5s for network to settle
INFO:host:Updated control config: 9a:02:57:1e:8f:00 {'paused': True}
WARNING:host:Inconsistent control state for update of 9a:02:57:1e:8f:00
INFO:host:Target port 1 waiting for dhcp as 9a:02:57:1e:8f:00
INFO🏃DHCP notify 9a:02:57:1e:8f:00 is <IP_ADDRESS> on gw01 (pass/None/30)
INFO:gateway:Ready target 9a:02:57:1e:8f:00 from gateway group 9a02571e8f00
INFO🏃DHCP activating target 9a:02:57:1e:8f:00
INFO:host:Target port 1 triggered as <IP_ADDRESS>
INFO🏃Test ping gw01-><IP_ADDRESS>
INFO🏃Test ping gw01-><IP_ADDRESS>
INFO🏃Test ping gw01-><IP_ADDRESS> from <IP_ADDRESS>
INFO:host:Target port 1 monitor scan complete
INFO:host:Target port 1 done with base.
INFO:host:Target port 1 background scan for 30s
INFO:host:Target port 1 scan complete
INFO:host:Target port 1 monitor scan complete
INFO:config:Loading config from
/home/guestsudo/Projects/GoogleBos/grafnu/daq/local/site/mac_addrs/9a02571e8f00/module_config.json
INFO:config:Writing config to
inst/run-port-01/nodes/pass01/tmp/module_config.json
INFO:docker:Target port 1 test pass running
INFO:docker:Target port 1 test pass passed 1.638411s
INFO:host:test_host callback pass/pass01 was 0 with None
INFO:config:Loading config from
/home/guestsudo/Projects/GoogleBos/grafnu/daq/local/site/mac_addrs/9a02571e8f00/module_config.json
INFO:config:Writing config to
inst/run-port-01/nodes/fail01/tmp/module_config.json
INFO:docker:Target port 1 test fail running
INFO:docker:Target port 1 test fail failed 1.390333s: 1 None
INFO:host:test_host callback fail/fail01 was 1 with None
INFO:config:Loading config from
/home/guestsudo/Projects/GoogleBos/grafnu/daq/local/site/mac_addrs/9a02571e8f00/module_config.json
INFO:config:Writing config to
inst/run-port-01/nodes/ping01/tmp/module_config.json
INFO:docker:Target port 1 test ping running
INFO🏃DHCP notify 9a:02:57:1e:8f:00 is <IP_ADDRESS> on gw01 (pass/None/44)
INFO🏃DHCP activation group 9a02571e8f00 already activated
INFO:docker:Target port 1 test ping passed 10.806785s
INFO:host:test_host callback ping/ping01 was 0 with None
INFO:config:Loading config from
/home/guestsudo/Projects/GoogleBos/grafnu/daq/local/site/mac_addrs/9a02571e8f00/module_config.json
INFO:config:Writing config to
inst/run-port-01/nodes/udmi01/tmp/module_config.json
INFO:docker:Target port 1 test udmi running
INFO:docker:Target port 1 test udmi failed 61.64184s: 2 None
INFO:host:test_host callback udmi/udmi01 was 2 with None
INFO:host:Target port 1 no more tests remaining
INFO:report:Finalizing report report_9a02571e8f00_2019-06-27T142652+0000.md
INFO:report:Skipping missing report header template
local/site/report_template.md
INFO:report:Copying test report
inst/run-port-01/nodes/ping01/tmp/report.txt
INFO:report:Copying report to
local/site/mac_addrs/9a02571e8f00/device_report.md
INFO:gcp:Uploaded test report to
inst/reports/report_9a02571e8f00_2019-06-27T142652+0000.md
INFO🏃Target port 1 finalize: ['01:udmi:2'] (target set not active)
INFO🏃Target port 1 cancel 9a:02:57:1e:8f:00 (#1
https://github.com/grafnu/daq/pull/1/0).
INFO:network:Directing traffic for 9a:02:57:1e:8f:00 on port 1: False
INFO:topology:Waiting 5s for network to settle
INFO:host:Target port 1 terminate, trigger False
INFO:gcp:Unsubscribe callback device/9a:02:57:1e:8f:00
INFO:google.cloud.firestore_v1.watch:RPC termination has signaled manager
shutdown.
ERROR:gcp:Error intercepted at 2019-06-27T14:29:12.285Z,
StatusCode.CANCELLED for
origin/daq-firebase-dashboard-role/device/9a:02:57:1e:8f:00/config/definition
ERROR:google.api_core.bidi:Thread-ConsumeBidirectionalStream caught
unexpected exception <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Locally cancelled by application!"
debug_error_string = "None"
and will exit.
Traceback (most recent call last):
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py",
line 633, in _thread_main
response = self._bidi_rpc.recv()
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 140,
in
rpc.recv = lambda: self._hack_recv(rpc, path)
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 130,
in _hack_recv
raise e
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 124,
in _hack_recv
return rpc._recoverable(rpc._recv) # Erp.
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py",
line 503, in _recoverable
raise exc
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py",
line 493, in _recoverable
return method(*args, **kwargs)
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py",
line 541, in _recv
return next(call)
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py",
line 364, in next
return self._next()
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py",
line 358, in _next
raise self
grpc._channel._Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Locally cancelled by application!"
debug_error_string = "None"
INFO:google.api_core.bidi:Thread-ConsumeBidirectionalStream exiting
INFO:gcp:Releasing
origin/daq-firebase-dashboard-role/device/9a:02:57:1e:8f:00/config/definition
INFO:gcp:Unsubscribe callback control/port-1
INFO:google.cloud.firestore_v1.watch:RPC termination has signaled manager
shutdown.
ERROR:gcp:Error intercepted at 2019-06-27T14:29:12.491Z,
StatusCode.CANCELLED for
origin/daq-firebase-dashboard-role/control/port-1/config/definition
ERROR:google.api_core.bidi:Thread-ConsumeBidirectionalStream caught
unexpected exception <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Locally cancelled by application!"
debug_error_string = "None"
and will exit.
Traceback (most recent call last):
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py",
line 633, in _thread_main
response = self._bidi_rpc.recv()
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 140,
in
rpc.recv = lambda: self._hack_recv(rpc, path)
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 130,
in _hack_recv
raise e
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 124,
in _hack_recv
return rpc._recoverable(rpc._recv) # Erp.
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py",
line 503, in _recoverable
raise exc
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py",
line 493, in _recoverable
return method(*args, **kwargs)
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py",
line 541, in _recv
return next(call)
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py",
line 364, in next
return self._next()
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py",
line 358, in _next
raise self
grpc._channel._Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Locally cancelled by application!"
debug_error_string = "None"
INFO:google.api_core.bidi:Thread-ConsumeBidirectionalStream exiting
INFO:gcp:Releasing
origin/daq-firebase-dashboard-role/control/port-1/config/definition
INFO:network:Deleting mirror pair mirror-1 <-> mirror-1-ext
INFO:gateway:Detach target 1 from gateway group 9a02571e8f00
INFO🏃Retiring target gateway 1, 9a:02:57:1e:8f:00, 9a02571e8f00, 1
INFO:gateway:Terminating gateway 1/9a02571e8f00
WARNING🏃Suppressing future tests because test done in single shot.
INFO🏃Remaining target sets: []
WARNING🏃No active ports remaining (0 monitors), ending test run.
INFO🏃Stopping network...
INFO:mininet:*** Stopping 1 controllers
INFO:mininet:controller
INFO:mininet:*** Stopping 1 links
INFO:mininet:.
INFO:mininet:*** Stopping 2 switches
INFO:mininet:pri
INFO:mininet:sec
INFO:mininet:*** Stopping 1 hosts
INFO:mininet:gw01
INFO:mininet:*** Done
INFO🏃Done with runner.
INFO:gcp:Unsubscribe callback runner/setup
INFO:google.cloud.firestore_v1.watch:RPC termination has signaled manager
shutdown.
ERROR:gcp:Error intercepted at 2019-06-27T14:29:14.577Z,
StatusCode.CANCELLED for
origin/daq-firebase-dashboard-role/runner/setup/config/definition
ERROR:google.api_core.bidi:Thread-ConsumeBidirectionalStream caught
unexpected exception <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Locally cancelled by application!"
debug_error_string = "None"
and will exit.
Traceback (most recent call last):
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py",
line 633, in _thread_main
response = self._bidi_rpc.recv()
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 140,
in
rpc.recv = lambda: self._hack_recv(rpc, path)
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 130,
in _hack_recv
raise e
File "/home/guestsudo/Projects/GoogleBos/grafnu/daq/daq/gcp.py", line 124,
in _hack_recv
return rpc._recoverable(rpc._recv) # Erp.
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py",
line 503, in _recoverable
raise exc
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py",
line 493, in _recoverable
return method(*args, **kwargs)
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/google/api_core/bidi.py",
line 541, in _recv
return next(call)
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py",
line 364, in next
return self._next()
File
"/home/guestsudo/Projects/GoogleBos/grafnu/daq/venv/lib/python3.6/site-packages/grpc/_channel.py",
line 358, in _next
raise self
grpc._channel._Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Locally cancelled by application!"
debug_error_string = "None"
INFO:google.api_core.bidi:Thread-ConsumeBidirectionalStream exiting
INFO:gcp:Releasing
origin/daq-firebase-dashboard-role/runner/setup/config/definition
ERROR🏃Test failures: ['01:udmi:2']
INFO:daq:DAQ runner returned 1
Cleanup docker kill daq-faux
daq-faux
Done with run, exit 1
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/grafnu/daq/pull/165?email_source=notifications&email_token=AAIEPD3XJTD3IYXDJ37DR33P4TFK3A5CNFSM4H3I2D7KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODYXJXVI#issuecomment-506371029,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAIEPDZQRWOA5NUCHSVMGF3P4TFK3ANCNFSM4H3I2D7A
.

Not entirely sure what happened there - here's the complete one:
cmdrun.log

Thanks, same answer as before -- those errors are coming after the report
is written, so from the logs it's showing that the reports should in fact
be there.
On Thu, Jun 27, 2019 at 8:03 AM Jason Brewer<EMAIL_ADDRESS>wrote:

Not entirely sure what happened there - here's the complete one:
cmdrun.log https://github.com/grafnu/daq/files/3335372/cmdrun.log
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/grafnu/daq/pull/165?email_source=notifications&email_token=AAIEPDY4SYFVNYPWCM3CF33P4TJE3A5CNFSM4H3I2D7KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODYXNCHQ#issuecomment-506384670,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAIEPD2PPB5B6WFESIIVD5DP4TJE3ANCNFSM4H3I2D7A
.

It works!
DAQ scan report for device 9a02571e8f00
Report summary

Result
Test
Notes

skip
base.switch.ping

pass
base.target.ping
target

fail
cloud.udmi.pointset
No result found

Module ping
Baseline ping test report
%% 59 packets captured.
RESULT skip base.switch.ping
RESULT pass base.target.ping target %% <IP_ADDRESS>

Module udmi
RESULT fail cloud.udmi.pointset No result found

Report complete
(but my configuration still no doubt leaves something to be desired)
Your || true was the key

I'm not sure this fixes my config, but as an aside:
Line 32 of https://github.com/grafnu/daq/blob/0014ec03d4da1ba5dd5b16f209f6dd61bc968ac7/pubber/src/main/java/daq/pubber/Pubber.java
...seems to suggest that events/pointset is the topic is where the pointset goes when a test message is being sent, down on line 232 of the same file.
Try as I

Main thing is that the PubSub "topic" (target) is not the same as the
MQTT topic (events/pointset) -- they are just different topics in different.
PubSub -- looks like test_udmi is hard-coded to "target" while there's also
"registrar" which is used in misc/test_site/cloud_iot_config.json -- they
likely shouldn't be different by default. That also is what needs to be
configured in the GCP project for where Cloud IoT dumps data.
On Thu, Jun 27, 2019 at 10:05 AM Jason Brewer<EMAIL_ADDRESS>wrote:

@InBrewJ commented on this pull request.
In subset/cloud/test_udmi
https://github.com/grafnu/daq/pull/165#discussion_r298278241:

@@ -0,0 +1,56 @@
+#!/bin/bash -e

+REPORT=/tmp/report.txt
+
+# Necessary to reach gcp. Should be done by framework but this works for now.
+route add default gw $GATEWAY_IP
+
+gcp_cred=/config/inst/gcp_service_account.json
+gcp_topic=target
@grafnu https://github.com/grafnu The gcp_topic is hardcoded here to
'target', but the Pubber.java seems to publish its test pointset messages
to events/pointset. Is that right?
see line 32 of
https://github.com/grafnu/daq/blob/0014ec03d4da1ba5dd5b16f209f6dd61bc968ac7/pubber/src/main/java/daq/pubber/Pubber.java
line 232 of the same file for where the test message is being sent
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/grafnu/daq/pull/165?email_source=notifications&email_token=AAIEPD4LUKOAVDB2JPR5I7TP4TXNVA5CNFSM4H3I2D7KYY3PNVWWK3TUL52HS4DFWFIHK3DMKJSXC5LFON2FEZLWNFSXPKTDN5WW2ZLOORPWSZGOB44H5KQ#pullrequestreview-255360682,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAIEPD2HXCTWFIJZOR4LQXLP4TXNVANCNFSM4H3I2D7A
.

I've got:
/registrar
/state
/events
/target
set up in my account and can definitely confirm that running registrar/pubber/validator runs fine outside of daq dockerland. I've realised it's something as simple as not turning pubber on in my system.conf properly. Do I enable the pubber like this?
system.conf
# Custom config
site_description="AA-DEA-DBEEF"
site_path=local/site/
gcp_cred=local/arup-bos-417ac300ed18.json
intf_names=faux
faux_opts=pubber
schema_path=schemas/udmi
gcp_topic=events

run_mode=local
base_conf=local/module_config.json

# For this run all tests.
host_tests=misc/all_tests.conf

# Command file with startup commands.
startup_cmds=misc/startup_base.cmd

Ah, yes -- the associated line from the tests are
https://github.com/grafnu/daq/blob/udmitest/testing/test_aux.sh#L47
That's for the multi-faux case, if you look in misc/startup_base.cmd you'll
see it's similar but different (and yours isn't quite right).
autostart cmd/faux $startup_faux_opts
On Thu, Jun 27, 2019 at 10:46 AM Jason Brewer<EMAIL_ADDRESS>wrote:

I've got:
/registrar
/state
/events
/target
set up in my account and can definitely confirm that running
registrar/pubber/validator runs fine outside of daq dockerland. I've
realised it's something as simple as not turning pubber on in my
system.conf properly. Do I enable the pubber like this?
system.conf
Custom config
site_description="AA-DEA-DBEEF"
site_path=local/site/
gcp_cred=local/arup-bos-417ac300ed18.json
intf_names=faux
faux_opts=pubber
schema_path=schemas/udmi
gcp_topic=events
run_mode=local
base_conf=local/module_config.json
For this run all tests.
host_tests=misc/all_tests.conf
Command file with startup commands.
startup_cmds=misc/startup_base.cmd
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/grafnu/daq/pull/165?email_source=notifications&email_token=AAIEPD3NMGFZHHVSKFYUFP3P4T4GVA5CNFSM4H3I2D7KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODYX3YOY#issuecomment-506444859,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAIEPD4E63FJJ6CGHBCACJ3P4T4GVANCNFSM4H3I2D7A
.

If you look at the faux logs you should see relevant stuff...
docker logs daq-faux
...
Faux device at <IP_ADDRESS> bcast <IP_ADDRESS>
Running cloud pubber tool...
Runtime config /config/start/start_faux.sh not found.
Blocking for all eternety.
1d0
< nameserver <IP_ADDRESS>
Updating resolv.conf with DNS=<IP_ADDRESS>
Sun Jun 23 19:49:21 UTC 2019
[main] INFO daq.pubber.Pubber - Reading configuration from
/root/local/pubber.json
[main] INFO daq.pubber.Pubber - Starting instance for project
bos-daq-testing registry registrar_test
Loading device key file from local/rsa_private.pkcs8
[main] INFO daq.pubber.MqttPublisher - Creating new publisher-client for
GAT-123
[main] INFO daq.pubber.MqttPublisher - Attempting connection to
registrar_test:GAT-123
On Thu, Jun 27, 2019 at 10:50 AM Trevor Pering<EMAIL_ADDRESS>wrote:

Ah, yes -- the associated line from the tests are
https://github.com/grafnu/daq/blob/udmitest/testing/test_aux.sh#L47
That's for the multi-faux case, if you look in misc/startup_base.cmd
you'll see it's similar but different (and yours isn't quite right).
autostart cmd/faux $startup_faux_opts
On Thu, Jun 27, 2019 at 10:46 AM Jason Brewer<EMAIL_ADDRESS>wrote:

I've got:
/registrar
/state
/events
/target
set up in my account and can definitely confirm that running
registrar/pubber/validator runs fine outside of daq dockerland. I've
realised it's something as simple as not turning pubber on in my
system.conf properly. Do I enable the pubber like this?
system.conf
Custom config
site_description="AA-DEA-DBEEF"
site_path=local/site/
gcp_cred=local/arup-bos-417ac300ed18.json
intf_names=faux
faux_opts=pubber
schema_path=schemas/udmi
gcp_topic=events
run_mode=local
base_conf=local/module_config.json
For this run all tests.
host_tests=misc/all_tests.conf
Command file with startup commands.
startup_cmds=misc/startup_base.cmd
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/grafnu/daq/pull/165?email_source=notifications&email_token=AAIEPD3NMGFZHHVSKFYUFP3P4T4GVA5CNFSM4H3I2D7KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODYX3YOY#issuecomment-506444859,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAIEPD4E63FJJ6CGHBCACJ3P4T4GVANCNFSM4H3I2D7A
.


👉🏻 REQUEST:  Adding Progressive Web App (PWA) to the App

Is there an existing issue for this?

[X] I have searched the existing issues

Is your feature request related to a problem? Please describe.
A PWA is a web application that apprehends the advantages of native and web applications. It delivers hardware features enveloped in the body of a cross-platform app that is quicker, more comfortable, and more inexpensive to create and support than a native app.  PWA is used by Facebook,  Linkedin, Instagram etc
Describe the solution you'd like

BENEFITS OF PWA

Working Offline: PWAs can operate offline. Thus, when your network connection is unstable this type of app will still work as a clock, but in offline mode. Due to the built-in service workers, the features and information of the PWA are saved and cached. This allows accessing the PWA without downloading it, especially in terms of poor connectivity
Performance: PWAs are loaded from a secure origin connection, i.e., using HTTPS. It helps reduce the app's load time and increases the app's loading time.
Fast Installation:PWAs  are not required to be downloaded from a store; the user can save the app on a device with a click of a button. They can run as a standalone window instead of a browser, making them launchable from the user's home screen.

Describe alternatives you've considered
React PWA documentation
Additional context
No response

@wh0sumit is this something I can proceed with?

sorry for the late response @isiakaabd, it'll be great if we have a PWA for Invoicetor💜🤩
you can start working on this issue ✅ Happy Hacking ✨

Ok, Thanks, I'm on it, please assign reviewer to my PRs🤲

Currently, I am reviewing your PR, and one of our maintainers will review and merge it as soon as possible if there are no conflicts.

@wh0sumit  I need a 512x512 image so I can generate the manifest logo.

@wh0sumit  please don't forget the image

It's been a busy week for me, so my reply is a bit late, but here is the 512 x 512 Image!

Send a message to NEROTOOL_ for help


leading "//"  of publicPath became  "/"

when output.PublicPath   is    "//some.somecnd.com"  . ( // is necessary for  auto select http/https url  base on current page's protocol )
But in  the generated html , the url became  "/some.somecnd.com/xxx.js"   , should be
"//some.somecnd.com/xxx.js"
I think this  change cause this problem
https://github.com/ampedandwired/html-webpack-plugin/commit/396cdedf8a554465d00797bb4d279b085e2e05d8

Actually this should have been fixed:
https://github.com/ampedandwired/html-webpack-plugin/blob/feature/loaders/index.js#L333

Ok. Thanks .  I guess I will stick to 1.6.1  before next stable release .


vagrant provisioning errors

==> default: error reading information on service mysqld: No such file or directory
==> default: Starting MySQL (Percona Server)
==> default: .
==> default: .
==> default:  SUCCESS!
==> default: Starting httpd:
==> default: httpd: Could not reliably determine the server's fully qualified domain name, using localhost.localdomain for ServerName
==> default: [  OK  ]
==> default: /tmp/vagrant-shell: line 16: /vagrant/anemometer/install.sql: No such file or directory
==> default: /tmp/vagrant-shell: line 17: /vagrant/anemometer/mysql56-install.sql: No such file or directory

fixed in develop


commit 444ecb4 caused regression in vp9 decoder

The output Shift is not set since commit commit 444ecb4, which results in regression when running a gst-msdk pipeline:
https://github.com/Intel-Media-SDK/MediaSDK/commit/444ecb480a3918cc6faeb7662ca7492fd564f301#diff-d8bc9fb5bc14276fa6b733fff663ba7aL151-L153
gst-launch-1.0 filesrc location=input.10bit.ivf ! ivfparse ! msdkvp9dec ! fakesink
Redistribute latency...
0:00:00.021322781 15413 0x557733521050 ERROR                msdkdec gstmsdkdec.c:396:gst_msdkdec_init_decoder: Init failed (invalid video parameters)
0:00:00.021337017 15413 0x557733521050 ERROR                msdkdec gstmsdkdec.c:868:gst_msdkdec_negotiate: Failed to re-negotiate

BTW for HEVC decoder, the output Shift is still equal to the input Shift. I think both VP9 and HEVC encoder should keep consistency for 10bit decoding

@xhaihao : do you use MFX_VERSION>=MFX_VERSION_NEXT path to build mediasdk or you see regression when this condition is not true?

@dvrogozh I see the regression no matter this condition is true or not.


Questions about the code

ey :)
I am sorry I have another question
in the recon_loss.py
res_vote = res_vote / 6 / bs
all the devisions by 6 is this because of the 6 distances paramters or is this related to the number of categories
and another question https://github.com/lolrudy/GPV_Pose/blob/5ac3307ac3af5892f09812a04621fdae415deec8/losses/recon_loss.py#L234
this line why is this not calculated for latop?

and same question here how is this selected: https://github.com/lolrudy/GPV_Pose/blob/5ac3307ac3af5892f09812a04621fdae415deec8/network/GPVPose.py#L202

6 is the number of the bounding box faces.
The category which obj_id==5 is "mug".  Since the x-axis of the mug category is shifted by SPD, the ground truth of x-axis is hard to calculated. So we do not calculate the loss on x-axis for mug.
We follow the code of FS-Net and only imply box-cage augmentation on "bowl" and "mug". This augmentation preserves the geometry characteristics of these two categories and achieves best performance.

@lolrudy one question regarding that, but category 5 is the category laptop
https://github.com/lolrudy/GPV_Pose/blob/2b9afaf5c3960799afd7f554e6af3c1602f88396/datasets/load_data.py#L74
mug is category  'mug': 6 if I read it correctly


Merge is not working

I have 2 microservices, I want to merge the their swagger.yaml files and then serve with swagger-cli to use that final merged file.
Issue is that I run this command and It creates new yaml file only with content of input yaml from the last parameter of command.
 go-swagger-merger -o final_swagger.yaml network-service/docs/swagger.yaml controller-service/docs/swagger.yaml
The final_swagger.yaml contains content only from controller-service/docs/swagger.yaml and nothing from network-service/docs/swagger.yaml

I confirm that when we merge 2 files that have the same paths (endpoint url) but two different methods (get vs post), only the last file is considered, when the 2 paths are different it all goes smooth.
I have attached 2 files to show the glitch, updating the path of one of them would show the well functioning of the merge function
assets-1.oas3.json
assets.oas3.json

I confirm that when we merge 2 files that have the same paths (endpoint url) but two different methods (get vs post), only the last file is considered, when the 2 paths are different it all goes smooth.
I have attached 2 files to show the glitch, updating the path of one of them would show the well functioning of the merge function
assets-1.oas3.json
assets.oas3.json


SAP BW source support ?

I think we all know why there is no SAP BW source support here but I would like to just make it official that it would be greatly appreciated.
P.S.  You should change your package description from plural "systems" to singular "system"  not to get people like myself too excited.  ;)

I'm sorry for asking beginner questions here; I have never worked with any SAP product and know nothing about them, but as the integration specialist in my current project I'm tasked with making "SAP BW" data available in Kafka.
In a call with someone from the "SAP BW" team they also used HANA to refer to it, so I assumed these two names were interchangeable. But now I read this issue from @reisepass and it sounds like this connector will in fact not do what I need.
Can someone clarify? @elakito
And for someone unfamiliar with the matter, could you @reisepass elaborate on "I think we all know why", because I don't know... thanks!


Fix thread channel parent type

Summary
This PR fixes an exception that occurs when a threads parent channel is not a text channel. Discord is rolling out new channel types that contain threads that are not text channels so this is future prep for them.

Labs is no longer maintained. Feel free to open a PR on the main repository if this PR is still valid.


propose that a json format "text" preview be added

Concerning Storage explorer's preview feature It would be nice if the file has a json suffix it tries to display the file in formatted JSON, preferable with collapsible nodes.

This is a duplicate of https://github.com/microsoft/AzureStorageExplorer/issues/6195. We will consider the capability to toggle between original content and formatted JSON in the preview editor.


Fix tokenizer classname for legacy multilingual tokenizer

Pull Request Template
Basic Information

What is this this pull request do ? : SSIA
Summary of changes proposed in this pull request:

Fix classname for legacy multilingual/multilingualUniversal tokenizer.

How should this be tested ? :
Relevant issues :

#xxxx

Test cases

https://github.com/IBM/SystemT/pull/15 covers this change.  So I'll close this PR.


Reformat fr_FR

I don't like horizontal scrolls. 😇 (no change in the list)
I also removed a duplicated female firstname, replacing it by another one.

Hello here 😬

Hi!
Do I close?


Dishwasher SPV6HMX2MR add switch extra rinse

Is your feature request related to a problem? Please describe.
I am always frustrated when I can't enable extra rinse when installing the SPV6HMX2MR dishwasher program.
Describe the solution you'd like
Please add an extra rinse option switch like dishcare_dishwasher_option_extradry.
Describe alternatives you've considered
I tried searching for the API key on https://api-docs.home-connect.com/programs-and-options , and couldn't find it, maybe I didn't search well(.
If the key exists, please post it.

As noted in the FAQ, if this was supported by the API a relevant control would have been added automatically by the integration. It can't be done without support from the API.


Add test coverage for EventMediaManager fetch failures

Codecov Report

Merging #104 (d71351a) into main (37b2f53) will increase coverage by 0.21%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##             main     #104      +/-   ##
==========================================
+ Coverage   90.28%   90.49%   +0.21%
==========================================
  Files          16       16
  Lines        1461     1462       +1
==========================================
+ Hits         1319     1323       +4
+ Misses        142      139       -3

Impacted Files
Coverage Δ

google_nest_sdm/event_media.py
94.23% <100.00%> (+0.51%)
:arrow_up:

google_nest_sdm/google_nest_subscriber.py
60.64% <100.00%> (+0.92%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 37b2f53...d71351a. Read the comment docs.


create-turbo not able to find tasks on Windows

Verify canary release

[X] I verified that the issue exists in the latest Turborepo canary release.

Link to code that reproduces this issue
npx create-turbo@latest && pnpm dev
What package manager are you using / does the bug impact?
pnpm
What operating system are you using?
Windows
Which canary version will you have in your reproduction?
2.0.3-canary.0
Describe the Bug
When I Create new turbo repo with npx create-turbo@latest and select package manager as pnpm and run pnpm dev it throws an error.

Expected Behavior
It should start an development server
To Reproduce
Run the following commands

npx create-turbo@latest
cd to project directory
pnpm dev

Additional context
No response

I can't reproduce this on macOS and I'd be quite surprised to learn that there's a platform difference here.
Can I ask what other debugging you've done?

Does running pnpm install again help possibly?
I see the directory is named turbo-1. Does that mean you're using Turborepo at version 1? (Could be just a placeholder but want to make sure.)

Hello @anthonyshew,

Yes i tried running pnpm install but it doesn't help.
I'm using turbo version 2.0.1. turbo-1 is just project name

Hello @anthonyshew,
Looks like<EMAIL_ADDRESS>has fixed this issue.