Controller can disappear from the device list about a minute or so of the service running

When I try to run the Calibrate Tracking Colors I get an error message saying "Failed to start controller stream". Help me please?
Dunno if this is any help:

[2016-07-25 19:03:48.845956]: main - Starting PSMoveService
[2016-07-25 19:03:48.861582]: bluetooth_get_host_address - Found a bluetooth radio
[2016-07-25 19:03:48.861582]: bluetooth_get_host_address - Retrieved radio info
[2016-07-25 19:03:48.938804]: PSMoveController::open - Opening PSMoveController(\?\hid#vid_054c&pid_03d5&col01#6&16c50889&0&0000#{4d1e55b2-f16f-11cf-88cb-001111000030})
[2016-07-25 19:03:48.938804]: PSMoveController::open -   with EMPTY serial_number
[2016-07-25 19:03:48.954902]: DeviceTypeManager::update_connected_devices - Device device_id 0 (PSMove) opened
[2016-07-25 19:03:49.096983]: PS3EyeTracker::open - Opening PS3EyeTracker(USB\VID_1415&PID_2000\12\0, camera_index=0)
[2016-07-25 19:03:49.289237]: SharedMemory::initialize() - Allocating shared memory: tracker_view_0
[2016-07-25 19:03:49.304863]: DeviceTypeManager::update_connected_devices - Device device_id 0 (PSEYE) opened
[2016-07-25 19:03:50.760050]: ClientConnection::start - Starting client connection id 0
[2016-07-25 19:03:50.763052]: ClientConnection::send_connection_info - Sending connection id to client 0
[2016-07-25 19:03:54.211500]: PSMoveController::close - Closing PSMoveController(\?\hid#vid_054c&pid_03d5&col01#6&16c50889&0&0000#{4d1e55b2-f16f-11cf-88cb-001111000030})
[2016-07-25 19:03:54.218508]: ServerRequestHandler - Async bluetooth request([Unpair] Controller ID: 0 Conn: 0) started.
[2016-07-25 19:03:57.579556]: ServerRequestHandler - Async bluetooth request([Unpair] Controller ID: 0 Conn: 0) completed.
[2016-07-25 19:03:57.647624]: PSMoveController::open - Opening PSMoveController(\?\hid#vid_054c&pid_03d5&col01#6&16c50889&0&0000#{4d1e55b2-f16f-11cf-88cb-001111000030})
[2016-07-25 19:03:57.654630]: PSMoveController::open -   with EMPTY serial_number
[2016-07-25 19:03:57.667643]: DeviceTypeManager::update_connected_devices - Device device_id 0 (PSMove) opened
[2016-07-25 19:03:58.596608]: DeviceTypeManager::update_connected_devices - Closing device 0 (PSMove) since it's no longer in the device list.
[2016-07-25 19:03:58.602614]: PSMoveController::close - Closing PSMoveController(\?\hid#vid_054c&pid_03d5&col01#6&16c50889&0&0000#{4d1e55b2-f16f-11cf-88cb-001111000030})
[2016-07-25 19:04:01.641730]: PSMoveController::open - Opening PSMoveController(\?\hid#vid_054c&pid_03d5&col01#6&16c50889&0&0000#{4d1e55b2-f16f-11cf-88cb-001111000030})
[2016-07-25 19:04:01.650222]: PSMoveController::open -   with EMPTY serial_number
[2016-07-25 19:04:01.660947]: DeviceTypeManager::update_connected_devices - Device device_id 0 (PSMove) opened
[2016-07-25 19:04:03.321057]: AsyncBluetoothPairDeviceRequest - Found a bluetooth radio
[2016-07-25 19:04:03.326062]: AsyncBluetoothPairDeviceRequest - Retrieved radio info
[2016-07-25 19:04:03.432183]: AsyncBluetoothPairDeviceRequest - Assigned host address 5c:f3:70:73:f9:4f to controller id 0
[2016-07-25 19:04:03.439675]: AsyncBluetoothPairDeviceRequest - Making radio accept incoming connections
[2016-07-25 19:04:03.439175]: ServerRequestHandler - Async bluetooth request([Pair] ID: 0 Conn: 0) started.
[2016-07-25 19:04:03.449763]: AsyncBluetoothPairDeviceRequest - Making radio discoverable
[2016-07-25 19:04:04.744856]: AsyncBluetoothPairDeviceRequest - No bluetooth devices connected.
[2016-07-25 19:04:04.749861]: AsyncBluetoothPairDeviceRequest - No Bluetooth device found matching the given address: 00:06:f7:18:fd:b2
[2016-07-25 19:04:06.164654]: AsyncBluetoothPairDeviceRequest - No bluetooth devices connected.
[2016-07-25 19:04:06.169645]: AsyncBluetoothPairDeviceRequest - No Bluetooth device found matching the given address: 00:06:f7:18:fd:b2
[2016-07-25 19:04:07.584100]: AsyncBluetoothPairDeviceRequest - Bluetooth device found matching the given address: 00:06:f7:18:fd:b2
[2016-07-25 19:04:07.590107]: AsyncBluetoothPairDeviceRequest - Bluetooth device matching the given address is the expected controller type
[2016-07-25 19:04:07.598114]: AsyncBluetoothPairDeviceRequest - Connection attempt: 0/80
[2016-07-25 19:04:07.602118]: AsyncBluetoothPairDeviceRequest - Patching the registry ...
[2016-07-25 19:04:07.605121]: AsyncBluetoothPairDeviceRequest - Failed to open registry key, it does not yet exist
[2016-07-25 19:04:07.610125]: AsyncBluetoothPairDeviceRequest - Checking HID service
[2016-07-25 19:04:07.615130]: AsyncBluetoothPairDeviceRequest - HID service not enabled, attempting to enable
[2016-07-25 19:04:10.830726]: AsyncBluetoothPairDeviceRequest - Patching the registry ...
[2016-07-25 19:04:10.834718]: AsyncBluetoothPairDeviceRequest - Get VirtuallyCabled: 0
[2016-07-25 19:04:10.838722]: AsyncBluetoothPairDeviceRequest - Verification attempt 0 / 5
[2016-07-25 19:04:10.841725]: AsyncBluetoothPairDeviceRequest - Device Remembered
[2016-07-25 19:04:10.845255]: AsyncBluetoothPairDeviceRequest - HID service enabled
[2016-07-25 19:04:10.848751]: AsyncBluetoothPairDeviceRequest - HID service not enabled
[2016-07-25 19:04:10.852255]: AsyncBluetoothPairDeviceRequest - Verified failed. Re-establish connection
[2016-07-25 19:04:10.856759]: AsyncBluetoothPairDeviceRequest - Connection attempt: 0/80
[2016-07-25 19:04:10.859261]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:11.164139]: AsyncBluetoothPairDeviceRequest - Connection attempt: 1/80
[2016-07-25 19:04:11.168136]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:11.472433]: AsyncBluetoothPairDeviceRequest - Connection attempt: 2/80
[2016-07-25 19:04:11.476437]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:11.780512]: AsyncBluetoothPairDeviceRequest - Connection attempt: 3/80
[2016-07-25 19:04:11.784516]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:12.088817]: AsyncBluetoothPairDeviceRequest - Connection attempt: 4/80
[2016-07-25 19:04:12.091820]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:12.397830]: AsyncBluetoothPairDeviceRequest - Connection attempt: 5/80
[2016-07-25 19:04:12.400833]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:12.705013]: AsyncBluetoothPairDeviceRequest - Connection attempt: 6/80
[2016-07-25 19:04:12.709016]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:13.015653]: AsyncBluetoothPairDeviceRequest - Connection attempt: 7/80
[2016-07-25 19:04:13.018655]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:13.323000]: AsyncBluetoothPairDeviceRequest - Connection attempt: 8/80
[2016-07-25 19:04:13.325002]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:13.630191]: AsyncBluetoothPairDeviceRequest - Connection attempt: 9/80
[2016-07-25 19:04:13.634177]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:13.937668]: AsyncBluetoothPairDeviceRequest - Connection attempt: 10/80
[2016-07-25 19:04:13.942673]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:14.246865]: AsyncBluetoothPairDeviceRequest - Connection attempt: 11/80
[2016-07-25 19:04:14.251370]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:14.554724]: AsyncBluetoothPairDeviceRequest - Connection attempt: 12/80
[2016-07-25 19:04:14.558216]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:14.861311]: AsyncBluetoothPairDeviceRequest - Connection attempt: 13/80
[2016-07-25 19:04:14.864875]: AsyncBluetoothPairDeviceRequest - Patching the registry ...
[2016-07-25 19:04:14.868881]: AsyncBluetoothPairDeviceRequest - Get VirtuallyCabled: 1
[2016-07-25 19:04:14.871891]: AsyncBluetoothPairDeviceRequest - Checking HID service
[2016-07-25 19:04:14.874885]: AsyncBluetoothPairDeviceRequest - Verification attempt 0 / 5
[2016-07-25 19:04:14.879890]: AsyncBluetoothPairDeviceRequest - Device Connected
[2016-07-25 19:04:14.882892]: AsyncBluetoothPairDeviceRequest - Device Remembered
[2016-07-25 19:04:14.885895]: AsyncBluetoothPairDeviceRequest - HID service enabled
[2016-07-25 19:04:14.888898]: AsyncBluetoothPairDeviceRequest - Connected, Remembered, and HID service enabled
[2016-07-25 19:04:15.194799]: AsyncBluetoothPairDeviceRequest - Verification attempt 1 / 5
[2016-07-25 19:04:15.202809]: AsyncBluetoothPairDeviceRequest - Device Remembered
[2016-07-25 19:04:15.206812]: AsyncBluetoothPairDeviceRequest - HID service enabled
[2016-07-25 19:04:15.209818]: AsyncBluetoothPairDeviceRequest - HID service not enabled
[2016-07-25 19:04:15.214818]: AsyncBluetoothPairDeviceRequest - Verified failed. Re-establish connection
[2016-07-25 19:04:15.217821]: AsyncBluetoothPairDeviceRequest - Connection attempt: 0/80
[2016-07-25 19:04:15.220823]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:15.525143]: AsyncBluetoothPairDeviceRequest - Connection attempt: 1/80
[2016-07-25 19:04:15.531149]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:15.836473]: AsyncBluetoothPairDeviceRequest - Connection attempt: 2/80
[2016-07-25 19:04:15.841467]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:16.147668]: AsyncBluetoothPairDeviceRequest - Connection attempt: 3/80
[2016-07-25 19:04:16.152675]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:16.457004]: AsyncBluetoothPairDeviceRequest - Connection attempt: 4/80
[2016-07-25 19:04:16.462010]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:16.765412]: AsyncBluetoothPairDeviceRequest - Connection attempt: 5/80
[2016-07-25 19:04:16.769416]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:17.074721]: AsyncBluetoothPairDeviceRequest - Connection attempt: 6/80
[2016-07-25 19:04:17.080736]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:17.384024]: AsyncBluetoothPairDeviceRequest - Connection attempt: 7/80
[2016-07-25 19:04:17.388028]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:17.692347]: AsyncBluetoothPairDeviceRequest - Connection attempt: 8/80
[2016-07-25 19:04:17.696350]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:18.000716]: AsyncBluetoothPairDeviceRequest - Connection attempt: 9/80
[2016-07-25 19:04:18.005709]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:18.310031]: AsyncBluetoothPairDeviceRequest - Connection attempt: 10/80
[2016-07-25 19:04:18.314036]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:18.618362]: AsyncBluetoothPairDeviceRequest - Connection attempt: 11/80
[2016-07-25 19:04:18.623354]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:18.927237]: AsyncBluetoothPairDeviceRequest - Connection attempt: 12/80
[2016-07-25 19:04:18.933247]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:19.238064]: AsyncBluetoothPairDeviceRequest - Connection attempt: 13/80
[2016-07-25 19:04:19.243072]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:19.549407]: AsyncBluetoothPairDeviceRequest - Connection attempt: 14/80
[2016-07-25 19:04:19.553913]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:19.858709]: AsyncBluetoothPairDeviceRequest - Connection attempt: 15/80
[2016-07-25 19:04:19.863214]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:20.166538]: AsyncBluetoothPairDeviceRequest - Connection attempt: 16/80
[2016-07-25 19:04:20.172045]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:20.477342]: AsyncBluetoothPairDeviceRequest - Connection attempt: 17/80
[2016-07-25 19:04:20.482348]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:20.786542]: AsyncBluetoothPairDeviceRequest - Connection attempt: 18/80
[2016-07-25 19:04:20.791535]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:21.096851]: AsyncBluetoothPairDeviceRequest - Connection attempt: 19/80
[2016-07-25 19:04:21.100864]: AsyncBluetoothPairDeviceRequest - Patching the registry ...
[2016-07-25 19:04:21.103867]: AsyncBluetoothPairDeviceRequest - Get VirtuallyCabled: 0
[2016-07-25 19:04:21.107862]: AsyncBluetoothPairDeviceRequest - Checking HID service
[2016-07-25 19:04:21.111866]: AsyncBluetoothPairDeviceRequest - HID service not enabled, attempting to enable
[2016-07-25 19:04:24.298056]: AsyncBluetoothPairDeviceRequest - Patching the registry ...
[2016-07-25 19:04:24.301060]: AsyncBluetoothPairDeviceRequest - Get VirtuallyCabled: 1
[2016-07-25 19:04:24.305063]: AsyncBluetoothPairDeviceRequest - Verification attempt 0 / 5
[2016-07-25 19:04:24.308066]: AsyncBluetoothPairDeviceRequest - Device Remembered
[2016-07-25 19:04:24.313072]: AsyncBluetoothPairDeviceRequest - HID service enabled
[2016-07-25 19:04:24.317075]: AsyncBluetoothPairDeviceRequest - HID service not enabled
[2016-07-25 19:04:24.322080]: AsyncBluetoothPairDeviceRequest - Verified failed. Re-establish connection
[2016-07-25 19:04:24.326084]: AsyncBluetoothPairDeviceRequest - Connection attempt: 0/80
[2016-07-25 19:04:24.331088]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:24.636391]: AsyncBluetoothPairDeviceRequest - Connection attempt: 1/80
[2016-07-25 19:04:24.640395]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:24.946699]: AsyncBluetoothPairDeviceRequest - Connection attempt: 2/80
[2016-07-25 19:04:24.949703]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:25.254002]: AsyncBluetoothPairDeviceRequest - Connection attempt: 3/80
[2016-07-25 19:04:25.258509]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:25.562804]: AsyncBluetoothPairDeviceRequest - Connection attempt: 4/80
[2016-07-25 19:04:25.566807]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:25.871154]: AsyncBluetoothPairDeviceRequest - Connection attempt: 5/80
[2016-07-25 19:04:25.875168]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:26.180130]: AsyncBluetoothPairDeviceRequest - Connection attempt: 6/80
[2016-07-25 19:04:26.184122]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:26.488417]: AsyncBluetoothPairDeviceRequest - Connection attempt: 7/80
[2016-07-25 19:04:26.492421]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:26.796731]: AsyncBluetoothPairDeviceRequest - Connection attempt: 8/80
[2016-07-25 19:04:26.801738]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:27.107085]: AsyncBluetoothPairDeviceRequest - Connection attempt: 9/80
[2016-07-25 19:04:27.111077]: AsyncBluetoothPairDeviceRequest - Device not connected
[2016-07-25 19:04:27.416423]: AsyncBluetoothPairDeviceRequest - Connection attempt: 10/80
[2016-07-25 19:04:27.420427]: AsyncBluetoothPairDeviceRequest - Patching the registry ...
[2016-07-25 19:04:27.424431]: AsyncBluetoothPairDeviceRequest - Get VirtuallyCabled: 1
[2016-07-25 19:04:27.429436]: AsyncBluetoothPairDeviceRequest - Checking HID service
[2016-07-25 19:04:27.433439]: AsyncBluetoothPairDeviceRequest - Verification attempt 0 / 5
[2016-07-25 19:04:27.436442]: AsyncBluetoothPairDeviceRequest - Device Connected
[2016-07-25 19:04:27.440446]: AsyncBluetoothPairDeviceRequest - Device Remembered
[2016-07-25 19:04:27.443449]: AsyncBluetoothPairDeviceRequest - HID service enabled
[2016-07-25 19:04:27.447453]: AsyncBluetoothPairDeviceRequest - Connected, Remembered, and HID service enabled
[2016-07-25 19:04:27.752921]: AsyncBluetoothPairDeviceRequest - Verification attempt 1 / 5
[2016-07-25 19:04:27.757927]: AsyncBluetoothPairDeviceRequest - Device Connected
[2016-07-25 19:04:27.760929]: AsyncBluetoothPairDeviceRequest - Device Remembered
[2016-07-25 19:04:27.764435]: AsyncBluetoothPairDeviceRequest - HID service enabled
[2016-07-25 19:04:27.767436]: AsyncBluetoothPairDeviceRequest - Connected, Remembered, and HID service enabled
[2016-07-25 19:04:28.071745]: AsyncBluetoothPairDeviceRequest - Verification attempt 2 / 5
[2016-07-25 19:04:28.075248]: AsyncBluetoothPairDeviceRequest - Device Connected
[2016-07-25 19:04:28.078774]: AsyncBluetoothPairDeviceRequest - Device Remembered
[2016-07-25 19:04:28.081776]: AsyncBluetoothPairDeviceRequest - HID service enabled
[2016-07-25 19:04:28.084779]: AsyncBluetoothPairDeviceRequest - Connected, Remembered, and HID service enabled
[2016-07-25

The PSMoveService log looks like it's getting cut off. You might try attaching the log file as an attachment to this issue.
In general the "Failed to start controller stream" error means that the config tool can't get controller data from PSMoveService. This frequently happens because PSMoveService has crashed. There was an occasional crash we get when you are adjust the camera settings in the color calibration tool (mashing the buttons too quickly).
Another common problem is the psmove controller becoming disconnected without you realizing it. For example, if you reboot your machine the PSMoveController will disconnect. Make sure the red light on the psmove controller is on (press the PS button if it is not on). Also make sure the controller shows up in the controller settings menu of the PSMoveConfig tool.

The red light on the ps move controller is on. And the controller shows up in the controller settings menu.

PSMoveService log_0.txt

Works now?!?

Ok here is the problem:
[2016-07-25 19:43:18.616094]: DeviceTypeManager::update_connected_devices - Closing device 0 (PSMove) since it's no longer in the device list.
[2016-07-25 19:43:18.622567]: PSMoveController::close - Closing PSMoveController(\\?\hid#vid_054c&pid_03d5&col01#6&16c50889&0&0000#{4d1e55b2-f16f-11cf-88cb-001111000030})

For some reason HIDAPI (the library we use to access the PSMoveController) thinks that the psmove controller was no longer in the device list when it was refreshing the controller list. I'm not sure why it did this.

Glad to hear that's working but that's wierd you had the device timeout. I'm going to re-label this issue as a bug. We should be more robust to this. You are running Win10 correct?

Yes running Win10

Help? Still getting the error!?

Red light is flashing fast on the ps move controller

I think of it's flashing your controller battery is getting low. If it's on old controller it's possible the battery isn't holding a charge like it used to.

Hi HipsterSloth,
i have the same issue here. Loaded them long enough to get sure that the battery is ok. Even checked it with my ps4. So i am running Win10 64 bit. I use only 1 camera attached to my oculus camera. I ll do the following:
Start Oculus Home
Start Steam VR
Start PS Moove Service
Start PS Moove Config
Than i paired my moove Controllers.
Now one thing is different to yours. After the pairing my controllers bulbs are off. There is no magenta or Cyan light. But they can be calibrated (magnometer) and the rumble works as well.
Where now the problems begin are when i try to use the calibration mat and than the controller gets lost. Something even before that point. Its every time the same that its no longer in the device list and something that i exeeded the semphore limit. Ill allready googled semphore limit but it seems like its not a regular problem.

@Gilver1991 Did you run the color calibration before trying to the calibration mat? If the color filter isn't calibrated then service can't track the bulb and the calibration mat tool won't work.

Its every time the same that its no longer in the device list and something that i exeeded the semphore limit

Wow that's a new one on me. Could you attach the PSMoveService_0.log file (or copy the log out of the PSMoveService console window) when that error happens again? That's a good find.

HI,
seems like i dont have a real logging that stays? Like i said in the edit i tryed more n more. Now the log is clear. Nothing in it anymore. If i am not blind you should add that for future versions log_timestamp.log or something like this. A number from type long should fitt it.
What i reached so far is, after i recheked the Color filter i made some more tweaks and now it worked but when ill start Steam VR they look really worse as i mentioned in my edit2. Now the first controller stays above the second even when startet in their docking station (start steam vr -> controller 1 n 2 stays in docking => one is above the other in VR). I dont think that i just use one camera is the reason or is it?

@Gilver1991 Ah right this is a problem with the log file not getting saved out in some cases. I have an issue for fixing up how the logging is done (having proper timestamps on the files is part of that). In the meantime the best thing is to copy the log out of the console window.

 What do you think is the reason?

There was someone else that reported similar problems with extreme latency, check out issue #117. Does this issue sound like what you are experiencing. The issue went away for them when they re-installed windows (not that I'm recommending you do that). Point being, we never figured out what was causing the terrible latency for them.

Now the first controller stays above the second even when startet in their docking station (start steam vr -> controller 1 n 2 stays in docking => one is above the other in VR). I dont think that i just use one camera is the reason or is it?

There are two things that affect tracking quality.
The first problem is that we don't undistort the image we get from the camera. This affects the tracking near the edge of the screen. I have a calibration tool for this that I haven't merged into master yet that should help with this once it's done. Hopefully I will get this in late next week.
The other problem with one camera is that we have to judge distance based on the size of the tracking bulb which has more noise then when you use two cameras and can triangulate the position.

here was someone else that reported similar problems with extreme latency, check out issue #117. Does this issue sound like what you are experiencing. The issue went away for them when they re-installed windows (not that I'm recommending you do that). Point being, we never figured out what was causing the terrible latency for them.

So far i can start test_camera and the psmoveservice after. The testcamera stops and the service does not start the camera exclusivly.

The other problem with one camera is that we have to judge distance based on the size of the tracking bulb which has more noise then when you use two cameras and can triangulate the position.

So i guess its not that i use only one camera.

So far i can start test_camera and the psmoveservice after.

Ah don't run test_camera and psmoveservice at the same time. Only one application can get exclusive access to the camera. For future reference, if you want to test a camera either:
A) Run test_camera with psmoveservice not running to verify your video feeds
OR
B) Run PSMoveService, then run PSMoveConfigTool, and Select a tracker from the "Tracker Settings", and then select "Test Tracker Video Feed"

Ah don't run test_camera and psmoveservice at the same time. Only one application can get exclusive access to the camera. For future reference, if you want to test a camera either:

A) Run test_camera with psmoveservice not running to verify your video feeds
OR
B) Run PSMoveService, then run PSMoveConfigTool, and Select a tracker from the "Tracker Settings", and then select "Test Tracker Video Feed"
I just did this as a test because you mentioned it in the thread u linked.
So far i no idea what the problem is. Re-installing my windows would be worse now lol^^


Fix #27 - adding baseline for unit and mock tests

Heads up that when you pull this to run the requirements.txt file through pip install.


merge from template-sync/template-arlac77-github

.github/workflows/update_package_lock.yml

chore: add<EMAIL_ADDRESS>(jobs.update_package_lock.steps.uses)

.github/workflows/update_readme_api.yml

chore: add<EMAIL_ADDRESS>(jobs.update_readme_api.steps.uses)

Pull Request Test Coverage Report for Build<PHONE_NUMBER>7
Details

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 87.135%

Totals

Change from base Build<PHONE_NUMBER>0:
0.0%

Covered Lines:
2538

Relevant Lines:
2901

💛  - Coveralls


Is there an option to load from .htm or .html file?

or I need to use beautifulsoup to do that?

nvm got the answer


Generic Dot & builders for QLinearMatmul

This PR:

Adds builders for QLinearMatmul op's in ONNX
Adds generic dot implementation (to support u8u8 matmul)
Supports non-zero zero point for QLinearMatmul by falling back to fp32 Dot

Note:
The builders will require changes in the ngraph-onnx bridge as to how they call into ngraph.

Two ONNX Runtime tests are still failing (also on master):
[  FAILED  ] QuantizeLinearMatmulOpTest.QLinearMatMul3D
[  FAILED  ] QuantizeLinearMatmulOpTest.QLinearMatMul

It would be great to address those before we wrap this up.

Fixed it


[config] YAML with template

Transferred from: https://github.com/dyweb/Ayi/issues/65
Related issues: embed script language https://github.com/dyweb/Ayi/issues/51, xephon-b config https://github.com/xephonhq/xephon-b/issues/6, runner command config https://github.com/dyweb/Ayi/issues/63
TODO

[x] render template using vars from previous documents
[x] render template using vars from current document
[x] render template using  environment variables, test broke, mixed use of env and envs
[ ] access data using the dot syntax like viper https://github.com/spf13/viper#getting-values-from-viper

Get https://github.com/spf13/viper/blob/master/viper.go#L591
split the access path into slice and then search the data
find https://github.com/spf13/viper/blob/master/viper.go#L851

Legacy
TODO

[ ] specification

[ ] merge the example from runner

[ ] summarize the related libraries, the comments in these related issues all have some useful/inspiration libraries
[ ] write the test cast based on spec
[ ] implementation (need to divide into several stages)

Won't fix

[ ] extra blank line shows up https://github.com/flosch/pongo2/issues/94
[ ] pongo2 render false to False, but Yaml spec support a lot of values http://yaml.org/type/bool.html

Found  viper complains about go-yaml as well

// mergeMaps merges two maps. The itgt parameter is for handling go-yaml's
// insistence on parsing nested structures as map[interface{}]interface{}
// instead of using a string as the key for nest structures beyond one level
// deep. Both map types are supported as there is a go-yaml fork that uses
// map[string]interface{} instead.

I think I rewrite a new yaml parser for golang now

now I am considering using https://golang.org/pkg/text/template instead of pong2 because we don't need that much feature, though the golang syntax is a little bit strange ....

so current version is using go's template, and has function to get environment variables, it is rendered twice to make use of variables declared in current file, it supports multiple yaml in same document (by split before unmarshal), also we no longer have so many getter and setter, we chose to unmarshal it into a go struct, which provides usage and type safety.
We may change to a DSL, like https://github.com/dhall-lang/dhall-lang, but that would be another story, sorry didn't have a release for config .... there is no semver in all projects where I am the only active developer and user ....


Treat devicetree warnings as errors

Once all DT warnings are fixed or suppressed we should treat new warnings as errors.

@galak how do you propose enabling DT warnings as errors?  Is this something products can start using today to prepare for the eventuality of enabling the feature?


Regenerate internal code with latest code generator

Fixed up generated const type names to ease transition to CGC.

/azp run go - azappconfig


InternVL-Chat-V1-5 Batch Inference

Hello

I want to perform batch inference using OpenGVLab/InternVL-Chat-V1-5.
Could you give me some tips or suggest examples to refer to?

Thank you.

Same question.

@whai362 @czczup

I will strive to resolve this issue by April 27th.

Hi, batch inference is now supported.
Here is an example:
import json
import os
from transformers import AutoTokenizer, AutoModel
from tqdm import tqdm
import torch
import torchvision.transforms as T
from PIL import Image

from torchvision.transforms.functional import InterpolationMode

IMAGENET_MEAN = (0.485, 0.456, 0.406)
IMAGENET_STD = (0.229, 0.224, 0.225)

def build_transform(input_size):
    MEAN, STD = IMAGENET_MEAN, IMAGENET_STD
    transform = T.Compose([
        T.Lambda(lambda img: img.convert('RGB') if img.mode != 'RGB' else img),
        T.Resize((input_size, input_size), interpolation=InterpolationMode.BICUBIC),
        T.ToTensor(),
        T.Normalize(mean=MEAN, std=STD)
    ])
    return transform

def find_closest_aspect_ratio(aspect_ratio, target_ratios, width, height, image_size):
    best_ratio_diff = float('inf')
    best_ratio = (1, 1)
    area = width * height
    for ratio in target_ratios:
        target_aspect_ratio = ratio[0] / ratio[1]
        ratio_diff = abs(aspect_ratio - target_aspect_ratio)
        if ratio_diff < best_ratio_diff:
            best_ratio_diff = ratio_diff
            best_ratio = ratio
        elif ratio_diff == best_ratio_diff:
            if area > 0.5 * image_size * image_size * ratio[0] * ratio[1]:
                best_ratio = ratio
    return best_ratio

def dynamic_preprocess(image, min_num=1, max_num=6, image_size=448, use_thumbnail=False):
    orig_width, orig_height = image.size
    aspect_ratio = orig_width / orig_height

    # calculate the existing image aspect ratio
    target_ratios = set(
        (i, j) for n in range(min_num, max_num + 1) for i in range(1, n + 1) for j in range(1, n + 1) if
        i * j <= max_num and i * j >= min_num)
    target_ratios = sorted(target_ratios, key=lambda x: x[0] * x[1])

    # find the closest aspect ratio to the target
    target_aspect_ratio = find_closest_aspect_ratio(
        aspect_ratio, target_ratios, orig_width, orig_height, image_size)

    # calculate the target width and height
    target_width = image_size * target_aspect_ratio[0]
    target_height = image_size * target_aspect_ratio[1]
    blocks = target_aspect_ratio[0] * target_aspect_ratio[1]

    # resize the image
    resized_img = image.resize((target_width, target_height))
    processed_images = []
    for i in range(blocks):
        box = (
            (i % (target_width // image_size)) * image_size,
            (i // (target_width // image_size)) * image_size,
            ((i % (target_width // image_size)) + 1) * image_size,
            ((i // (target_width // image_size)) + 1) * image_size
        )
        # split the image
        split_img = resized_img.crop(box)
        processed_images.append(split_img)
    assert len(processed_images) == blocks
    if use_thumbnail and len(processed_images) != 1:
        thumbnail_img = image.resize((image_size, image_size))
        processed_images.append(thumbnail_img)
    return processed_images

def load_image(image_file, input_size=448, max_num=6):
    image = Image.open(image_file).convert('RGB')
    transform = build_transform(input_size=input_size)
    images = dynamic_preprocess(image, image_size=input_size, use_thumbnail=True, max_num=max_num)
    pixel_values = [transform(image) for image in images]
    pixel_values = torch.stack(pixel_values)
    return pixel_values

path = "OpenGVLab/InternVL-Chat-V1-5"
model = AutoModel.from_pretrained(
    path,
    torch_dtype=torch.bfloat16,
    low_cpu_mem_usage=True,
    trust_remote_code=True).eval().cuda()

tokenizer = AutoTokenizer.from_pretrained(path, trust_remote_code=True)
# set the max number of tiles in `max_num`
pixel_values = load_image('./examples/image1.jpg', max_num=6).to(torch.bfloat16).cuda()

generation_config = dict(
    num_beams=1,
    max_new_tokens=512,
    do_sample=False,
)

# batch inference
pixel_values1 = load_image('./examples/image1.jpg', max_num=6).to(torch.bfloat16).cuda()
pixel_values2 = load_image('./examples/image2.jpg', max_num=6).to(torch.bfloat16).cuda()
image_counts = [pixel_values1.size(0), pixel_values2.size(0)]
pixel_values = torch.cat((pixel_values1, pixel_values2), dim=0)

questions = ["Describe the image in detail."] * len(image_counts)
responses = model.batch_chat(tokenizer, pixel_values,
                             image_counts=image_counts,
                             questions=questions,
                             generation_config=generation_config)
for question, response in zip(questions, responses):
    print(question)
    print(response)


Rotate the column Horizontally with drag and drop

I need to rotate the board view where I can scroll each column horizontally. How can I achieve this?
Like this -

Hello, unfortunately this is not supported in the lib at this moment, but I can add it to the backlog. How soon would you need this functionality?

Actually tomorrow.

Ok, let me tack a look at it today, I will get back to you.

Thanks man thanks a lot. I will wait for your reply.

A question, do you really mean the BoardView? Don't you mean the DragListView with a gridlayout that scrolls horizontally?

Sorry for late reply. Yes I mean Board view. As you can see in the image there should be two row, just like yours board view column1 & column2. I should drag and drop from 1st row to 2nd as well as 2nd to first. Actually this two row will represent diffrent

Ah ok I see. I missunderstood you then. That is a much bigger task I am afraid. So I will not have time to do that now :/

Any idea how to do that, Then I can try..

The biggest challenge will be to handle that the touch events shall now do column switches vertically instead of horizontally and and item switches should be horizontally instead of vertically. There need to be some refactorization to be able to handle both instead of just one in the BoardView file.
Also, how do you want the headers? To the left of the row or above?

Ok. Above the row.

Ok, feel free to fork and try it out.

Can make DragListView with a gridlayout that scrolls horizontally. I can adjust my layout as per that..


Pelican 4.0.1 + Tipue Search Fails to Generate Search.html

Recently installed and am using elegant.
The only issue I cannot seem to fix is the search.html and the search box, and such I have temporarily disabled it.
Using Pelican 4.0.1, the latest tipue plugin and elegant theme, as of 29 Jun 2019.
Went through the file that should be there, and all of the js and css files are where they should be, included the tipuesearch_content.js.  When I press the search button, it states that the page "search.html" is not there.
Went through documentation for tipue and elegant, and can't see anything that should be preventing "search.html" from being written.  I am not sure if it is a documentation issue or a bug.
Happy to debug and test on this side if I can get a primer on where to start!

What's is the value of DIRECT_TEMPLATES? For reference see our configuration.
If this does not help then please share the source code of your blog.

@jackdewinter you can check https://iranzo.github.io that uses lastest pelican and latest tipue plugins, etc on each 'build' of the website try the search box and for example 'paella' once you check what @talha131 commented, let us know!

Thanks for the pointer.  When I cut and pasted from the configuration page, it somehow pasted the configuration as
DIRECT_TEMPLATES = (('index', 'tags', 'categories','archives', 'search', '404'))
fixed it to
DIRECT_TEMPLATES = ('index', 'tags', 'categories','archives', 'search', '404')
and now working.   Does this happen often? Configuration issues I mean?  If so, would it be worth some kind of comment in the documentation? I had to search for that file, but having "this was tested against https://elegant.oncrashreboot.com/configuration-variables-and-metadata-list" would have helped early on.
And can I help with that?

We so desperately need someone to take over our documentation. It is 5 years old. We are updating it, albeit slowly.
You can view our soon to be release version of docs and features here. (Please ignore the SSL error for now).

Does this happen often? Configuration issues I mean?

Most of Elegant features work out of the box. But for some, user has to read the documentation and fix his configuration.

And can I help with that?

As I said we are desperate. If you can write few help articles that would be of great help to us.
For example,

an article on how to setup search
an article on enabling FreeLists support
review existing articles and simplify it
how to install Elegant (like if you are using pelican-themes repo then you need to update the elegant submodule regularly)
help article on where to start reading the documentation

Let me know if you are interested. I will guide you with the process.
(We have recently setup some automation which requires contributions to be made under some specific rules. I am adding docs for it but it's going to take a week or more)

@jackdewinter have a look at this article
https://elegant.oncrashreboot.com/add-tipue-search
Let me know if it can be improved.

Giving it a look... will have something later today.


fix(ip): cache ip queries

Changes

[!WARNING]
This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

#907  👈
#905
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @NathanFlurry and the rest of your teammates on  Graphite


Conjur Helm Chart Deploys the Database as Persistent

Currently the PostgreSQL instance which is deployed as part of Conjur OSS, is not persistent. This means that as soon as the database container stops, all the data in it is lost.
Expected Behavior
The Conjur Helm chart should expose a new parameter that can toggle the deployment of PostgreSQL as persistent. We can use this link as a reference.

Added in v1.3.5 (3682682)


fix: PT-MONO font doesn't load

Closes #1781
This PR replaces the font name from PT MONO to PT-MONO.

It seems that there is no need to add /public to the path when using Nextjs.

I think this is exclusive for components and pages, but for SCSS files we need to explicitly add /public.


feat: add more things

This PR adds:

more Apple products;
some basic food.

I wasn't able to find information about Samsung products…

This will not (obviously) get deployed automatically because I did not do my job (yet) but there is this notion article about publishing the library that I started to write/work on.


Tag gives inconsistent results

Using usaddress.tag provides different results: One is correct and the other is not.
t = "5 BEECROFT ROAD 10"
(OrderedDict([('AddressNumber', '5'), ('StreetNamePreType', 'BEECROFT ROAD'), ('StreetName', '10')]), 'Street Address')
but
t = "5 BEECROFT ROAD 2"
(OrderedDict([('AddressNumber', '5'), ('StreetName', 'BEECROFT'), ('StreetNamePostType', 'ROAD'), ('OccupancyIdentifier', '2')]), 'Street Address')

That's interesting @FlamingMo, can you say a little bit more about when you see the first result versus the second? Are there any patterns? It'd also help to know what version of usaddress you're using and what OS you're on.


Require Go 1.11 in README

The README for u-root says "Make sure your Go version is 1.11." The first step of the build process is to install github.com/u-root/u-root. Therefore, systemboot requires 1.11, not 1.10 or later

Codecov Report

Merging #63 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master      #63   +/-   ##
=======================================
  Coverage   45.01%   45.01%
=======================================
  Files          13       13
  Lines         562      562
=======================================
  Hits          253      253
  Misses        271      271
  Partials       38       38

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update bf59668...4fc66d9. Read the comment docs.

u-root switched to Go 1.11 just to keep up to date. We only run the CI tests with go1.11, which is why it's recommended in the readme. Everything may still work with go1.10, but there is no automated testing for it.

Thanks for the context @rjoleary ! At this point I would rather prefer to add systemboot builds for 1.10 and above rather than telling people they can only use 1.11. I am already making a PR for that

hey @driusan , now as per https://github.com/systemboot/systemboot/pull/64 we will support explicitly Go 1.10 and Go 1.11, despite u-root not running 1.10 in the CI. Can you please update your PR title and content to mention both versions? Thanks!


dotnet pack fails with paket and .NET Core 2.1.500

Description
Get the error message when running dotnet pack with .NET Core 2.1.500:
/Users/dbrattli/Developer/GitHub/classlib/.paket/Paket.Restore.targets(226,5): error : The provided SymbolPackageFormat value  is invalid. Allowed values : 'snupkg', 'symbols.nupkg'. [/Users/dbrattli/Developer/GitHub/classlib/classlib.csproj]

I have no idea is this is an issue is related to dotnet and/or paket. Tested on Mac OS X 14.4.1, and Windows 10, and get the same error on three different machines and installations.
Repro steps

Install .NET Core 2.1.500, https://www.microsoft.com/net/download

dotnet new classlib -o myproject

Add paket to new project and initialize. Add a nuget to dependencies so project file classlib.csproj imports Paket.Restore.targets`:

<Project Sdk="Microsoft.NET.Sdk">
  <PropertyGroup>
    <TargetFramework>netstandard2.0</TargetFramework>
  </PropertyGroup>
  <Import Project=".paket\Paket.Restore.targets" />
</Project>

dotnet restore

dotnet build

dotnet pack

Expected behavior
Expected behavior is that dotnet pack completes without error. This used to work in earlier versions of dotnet.
Actual behavior
➜  classlib dotnet pack
Microsoft (R) Build Engine version 15.9.20+g88f5fadfbe for .NET Core
Copyright (C) Microsoft Corporation. All rights reserved.

  shasum: /Users/dbrattli/Developer/GitHub/classlib/.paket/../paket-files/paket.restore.cached:
  Paket version 5.188.1
  Starting full restore process.
  Performance:
   - Disk IO: 17 milliseconds
   - Runtime: 2 seconds
  Restoring packages for /Users/dbrattli/Developer/GitHub/classlib/classlib.csproj...
  Restore completed in 178.88 ms for /Users/dbrattli/Developer/GitHub/classlib/classlib.csproj.
  Paket version 5.188.1
  The last restore is still up to date. Nothing left to do.
  Performance:
   - Runtime: 60 milliseconds
  classlib -> /Users/dbrattli/Developer/GitHub/classlib/bin/Debug/netstandard2.0/classlib.dll
  Paket version 5.188.1
  Performance:
   - Runtime: 644 milliseconds
/Users/dbrattli/Developer/GitHub/classlib/.paket/Paket.Restore.targets(226,5): error : The provided SymbolPackageFormat value  is invalid. Allowed values : 'snupkg', 'symbols.nupkg'. [/Users/dbrattli/Developer/GitHub/classlib/classlib.csproj]

Known workarounds
Don't know any workarounds. Downgrading dotnet might work.

I have the same problem in an F# project, coincidentally after updating visual studio 2017 to the latest version.
I have the problem in both Visual Studio AND the a fake build script (using MSBuild)
I don't have the details here but I got
....Paket.Restore.targets(226,5): error : The provided SymbolPackageFormat value  is invalid. Allowed values : 'snupkg', 'symbols.nupkg'.
my project compiles if
true
is not present (and presumably false).
it fails with the above error if "true"
I have no workaround except reverting to nuget.

do you guys have a zip with a repro?

Empty classlib dotnet new classlib with added Paket. https://github.com/dbrattli/PackFailure

cc @cartermp

ok I can repro - but I have no idea what's going on. it works with 2.1.403 but does not with latest .500 - ouch

so we need to find a way to detect if we are in .net 500 or earlier and duplicate the pack task yet another time. WIP in https://github.com/fsprojects/Paket/pull/3428
I added 2 ToDos - so if someone can try to come up with what needs to go there - I'd appreciate the help

Enrico is on honeymoon/holiday for a month.

Tried looking at the RuntimeFrameworkVersion but it's only set to 2.1 when not set explicitly.

Is there an issue on the CLI for this? I'm not aware of any major changes to pack for 2.1.500

https://github.com/Microsoft/msbuild/issues/2350
$(MSBuildVersion) each msbuild version usually correlates to a version of the sdk as they're shipped and updated together.

MSBuildVersion=15.9.20 when run with 2.1.500. Notable New Features in 15.9. "We have improved the debugging experience for NuGet packages using the new symbol package format (.snupkg).". https://docs.microsoft.com/en-us/visualstudio/releasenotes/vs2017-relnotes

yeah I noticed that and thought it a bit of a coincidence.

@forki  is the message about addiing the property in the .deps file a workaround?
my choice at the moment really is remove paket completely or wait (I actually needed the MSBuild upgrade to make something else work)

Yes you can add that property manually in the targets file. I just can't
release it yet because it would break older cli.
@cartermp yes it seems to be breaking since the new property does not have
a default. That wouldn't be a problem if the pack task that ships with
nuget in old cli would just ignore it.
Am Do., 15. Nov. 2018, 17:26 hat MarkNicholls<EMAIL_ADDRESS>geschrieben:

@forki https://github.com/forki is the message about addiing the
property in the .deps file a workaround?
my choice at the moment really is remove paket completely or wait (I
actually needed the MSBuild upgrade to make something else work)
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/fsprojects/Paket/issues/3427#issuecomment-439100781,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AADgNGMYHiUXeVCxxAI1AJmURj9Q77YRks5uvZWsgaJpZM4YfSuE
.

Sounds like you need to add a check for the MSBuild version then. Though I'm generally worried that people on very old SDKs would still be using much newer Paket versions.

"very old"? We are talking about a single minor version. But yes we trying
to be as backwards compatible as possible
Am Do., 15. Nov. 2018, 17:43 hat Phillip Carter<EMAIL_ADDRESS>geschrieben:

Sounds like you need to add a check for the MSBuild version then. Though
I'm generally worried that people on very old SDKs would still be using
much newer Paket versions.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/fsprojects/Paket/issues/3427#issuecomment-439106764,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AADgNFig4ynuQ1lDjHWxrOzE35_8c_KSks5uvZmYgaJpZM4YfSuE
.

The implication here is that any project on an older SDK is likely to be using the very latest Paket, yes?

Many users are always using latest paket versions. Yes. That has benefits -
except on days like today ;-)
Am Do., 15. Nov. 2018, 17:53 hat Phillip Carter<EMAIL_ADDRESS>geschrieben:

The implication here is that any project on an older SDK is likely to
be using the very latest Paket, yes?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/fsprojects/Paket/issues/3427#issuecomment-439110534,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AADgNHFnA3o-k2y0aWi6OjLAm5ZUlP9nks5uvZwJgaJpZM4YfSuE
.

so just for advice to others, my workaround is to copy the paket.restore.targets and add SymbolPackageFormat line as described about and then ammend my projects to import this ammended file rather than the default one. Hopefully will get a fix and undo this, it only affects a few of my projects

I think I have a fix ready in https://github.com/fsprojects/Paket/pull/3428 - I'd appreciate review.

Confirmed fixed in 5.189.0

So according to @dasmulli $(NETCoreSdkVersion) also exists!

PR welcome if it improves things

it worked for me!

So apparently my fix wasn't good enough. https://github.com/fsprojects/Paket/issues/3429
Any ideas?


Decompression of acyclic coloring with SparseMatrixCSC

The current code is quite optimal, but we could optimize further for SparseMatrixCSC by storing here four values (i, j, k1, k2), where k1 is the position in A.nzval of A[i,j] and k2 is the position of A[j,i] in A.nzval.
We should do the same thing for diagonal coefficients here.
The current issue is that I don't know how to use this information if we just want to update one triangle of the Hessian.
The positions in A.nzval are not valid anymore.

Feel free to give it a try!
Ideally I would want to avoid having three separate index storages, one for the full Hessian and one for each triangle, so indeed I'm not sure how to handle only one triangle.

I have a solution @gdalle!
If H[i,j] is in the upper triangular part (i < j) we could store the positive offset k1 such that during the decompression H.nzval[k] = H[i,j] with
k = H.colptr[j] + k1

It will work for both options :F and :U.
If H[i,j] is in the lower triangular part (i > j) we could store the negative offset k2 such that during the decompression H.nzval[k] = H[i,j] with
k = H.colptr[j+1] - k2

It will work for both options :F and :L.

But those offsets depend on the column/row, right?

Yes but we also need to store i and j to update stored_values so that's fine.


v3

TODO:

[x] Replace custom rollup config with microbundle
[ ] Replace custom docs setup with Docz

Move all docs to new setup
Make YMaps in "docs" mode use default namespace

[ ] Change all instaceRef calls to ref util

@gribnoysup What about to add some new components?
I suppose it will be helpful to add component for Route?

@mmarkelov even though it's a major release, I want it to be a quick one and avoid changing too much stuff implementation-wise unless completely necessary. It's a major mostly because the build process is changing, even though all APIs will stay the same.
After this one is done, Route API is the next thing I want to tackle 👍


Game theory 3

Solved issue #695
In Language- Java

[x] Updated README Link
[x] Added code with comments

Thanks for contributing!

Resolve conflicts

Resolve conflicts

Resolved.

Resolved.


Error 400 on DefaultMaxPodsConstraint

Currently setting this up, and running into the following error when setting up the Kubernetes App Launcher baseline.  Stage 5 of the walkthrough via the Cloud Launcher is kicking out the following 400:
Error: googleapi: Error 400: DefaultMaxPodsConstraint can only be used if IpAllocationPolicy.UseIpAliases is true., badRequest
I believe this may be related to some updates to Terraform and how it handles VPC Native networking, as described in the following Issue - https://github.com/terraform-providers/terraform-provider-google/issues/6744.
Version deprecation seems like a workaround, but not a proper solution.  Unsure if the Terraform module definition allows the networking_mode item (limited TF experience).

Of course I figure it out like 30 seconds later.
Changing the following allows the stage to continue, though I'm hesitant to put up a PR for it because it seems like a hack to get around a change in TF 3.29.0 (also uh, this may not be the right project I now realize).
diff --git a/setup/infra/cluster/versions.tf b/setup/infra/cluster/versions.tf
index 9fba122..1c54514 100644
--- a/setup/infra/cluster/versions.tf
+++ b/setup/infra/cluster/versions.tf
@@ -19,8 +19,8 @@ terraform {
   required_version = ">= 0.12"
   required_providers {
     external    = "~> 1.2.0"
-    google      = "~> 3.19"
-    google-beta = "~> 3.19"
+    google      = "~> 3.18, != 3.29.0"
+    google-beta = "~> 3.18, != 3.29.0"
     kubernetes  = "~> 1.11.0"
     template    = "~> 2.1"
     null        = "~> 2.1"

Thanks for reporting this! I saw the same thing and pushed the fix to the app launcher repo.


[INLONG-5722][Agent] Support Redis Source

Prepare a Pull Request

Fixes #5722

Motivation
make agent module support redis source
Modifications

add RedisSource and RedisReader
add unit test for redisReader

Verifying this change
(Please pick either of the following options)

[ ] This change is a trivial rework/code cleanup without any test coverage.

[ ] This change is already covered by existing tests, such as:
(please describe tests)

[x] This change added tests and can be verified as follows:

TestRedisReader

@pocozh @EMsnap PTAL

@iamsee123 please fix the comment and conficts


Updated submodules, except for Cardinal and SAM

Refs #0

Job VTB Documentation on 6ddb369 wanted to post the following:
View the site here
This comment will be updated on new commits.

A MOOSE patch is needed - I currently added a version from my fork with some fixes (not merged yet).

looks like there are some 'speed' functor failures. So this requires your patch to moose to make it to pgh and then a pgh subdmodule update

Right, I only did that for BC and was basically not looking at PH results, since that should just be a subset-ish. I still need to fix some BC tests it looks like. It was just difficult to get everything fixed without having SAM to compile into BC.
Could you update SAM for me, since I don't have access? We'd need to wait for SAM to get the MOOSE update too.
I should be able to do Cardinal, since it's open.

For the Lotus test that is timing out: I saw that in tests a file called run_neutronics.i was used that doesn't exist - appears to have been replaced by run_neutronics_9_group.i, so I changed this.
I'll see if I can use the BC on HPC to regold the diffing test, since that one has SAM.

That lotus test is still timing out, even after doubling the max time to 2000 s. It already has a minimum of 32 processes, and it's a steady test, so I can't just reduce the number of time steps, so I'm not sure what we should do to resolve it.
I'll address the remaining Direwolf failure.

Direwolf failure is because DW needs a Sockeye update, so I'll wait on https://github.inl.gov/ncrc/dire_wolf/pull/294 and then update DW again.

There is a test, sfr/abtr_xsgen_workflow.xs_generation_syntax (https://civet.inl.gov/job/2294439/) that uses Mesh/data_driven_generator, which apparently requires the app to set allow_data_driven_mesh_generation to true because it's experimental. What's the move here? Change the test or set the allow_data_driven_mesh_generation to true in Griffin/BlueCrab? @loganharbour @shikhar413

Should already be set in Griffin.
I guess we need to set it in BlueCrab too.

If there is a BlueCrabApp.C, you can add the following line in validParams:
// Needed for enabling data driven mesh generation
params.set<bool>(MeshGeneratorSystem::allow_data_driven_param) = true;

I will add it to BlueCrabApp.

@GiudGiud would you mind reviewing https://github.inl.gov/ncrc/blue_crab/pull/281?

Hopefully https://github.com/idaholab/civet_recipes/pull/1751 should address the BC failure.

https://github.com/idaholab/moose/pull/27951 has a fix that will likely prevent regolding these MSFR tests. I'll get it green again

ok new failures are fixed by this PR
https://github.com/idaholab/moose/pull/28096
there's no "previous submodule" we can use because the "removing NSFV action" both creates these new issues and removes the need for the regold of the MSFR input

Needs a submodule update still, Pronghorn DW and BlueCrab dont have an up-to-date enough moose

Only failure is an intermittent timeout


fix(config): options.darken.sidebars.enabled

Problem: options.darken.sidebars.enabled and options.darken.sidebars.enable both exist, but it is only one option. The default in config.lua is enable, but it is referred to as enabled as well (both in code and docs). It used to be enable but was renamed to enabled, so it is technically supposed to be options.darken.sidebars.enabled at this time (as of this commit's parent).
Solution: Revert options.darken.sidebars.enabled back to options.darken.sidebars.enable. This brings it back in-line with the changelog and runtime deprecation checks. enable is also more consistent as this is what is used in other parts of the config (e.g. config for modules). Continue to accept options.darken.sidebars.enabled for backwards-compatibility. Either may be used: enabled is now coerced to enable in config.lua.
Problem: In a couple of places, options.darken.sidebars is checked for truthiness. This seems to be a typo of options.darken.sidebars.enable which is a boolean (unlike the former, which is a table by default and also documented as a table). Tables are always truthy.
Solution: Use options.darken.sidebars.enable instead of options.darken.sidebars in conditionals.
Reverts: fff3e20e, 806903c1
Fixes: #306

TODO

[ ] Obtain review
[ ] Tests?
[ ] Deprecate enabled?


Cannot assign requested address in unreal_proxy.py

Traceback (most recent call last):
File "", line 1, in
File "/home/airspace/DroneSimLab/UE4PyhtonBridge/src/Wrappers/pyinit.py", line 7, in
from Wrappers import entry_point
File "/home/airspace/DroneSimLab/UE4PyhtonBridge/src/Wrappers/entry_point.py", line 4, in
exec("import "+os.environ['BRIDGE_ENTRY_NAME']+" as main_module")
File "", line 1, in
File "/home/airspace/DroneSimLab/demos/unreal_proxies/two_drones/unreal_proxy.py", line 41, in
socket_pub.bind("tcp://%s:%d" % config.zmq_pub_unreal_proxy )
File "zmq/backend/cython/socket.pyx", line 547, in zmq.backend.cython.socket.Socket.bind
File "zmq/backend/cython/checkrc.pxd", line 25, in zmq.backend.cython.checkrc._check_rc
zmq.error.ZMQError: Cannot assign requested address
Traceback (most recent call last):
File "", line 1, in
NameError: name 'pyinit' is not defined

Even after I assigned the proper address for both FDM and unreal_proxy.py

try to change the line in the config.py
zmq_pub_unreal_proxy=('<IP_ADDRESS>',5577)
to
zmq_pub_unreal_proxy=('*',5577)

that worked!

nice!


[WIP] PulseQobj updates for pulse simulator QobjConfig

Summary
This adds optional fields to PulseQobjConfigSchema for pulse simulator.
closes #2053
Details and comments
In current spec, these fields are specified as required regardless of backend (device/simulator)
"meas_level",
"pulse_library",
"memory_slot_size",
"meas_return",
"qubit_lo_freq",
"meas_lo_freq",
"rep_time"

This PR adds optional fields with validation
"hamiltonian",
"noise"
"dt"
"ode_options"

example of simulator configuration:
hamiltonian = {
    'h_str': [
      '2*pi*v0*O0',
      'X0||D0'
    ],
    'vars': {'v0': 5.1},
    'osc': {},
    'qub': {'0': 2}
}
noise = {
    'qubit': {
        '0': {
            'Sm': 0.006
        }
    },
    'oscillator': {
        'n_th': {},
        'coupling': {}
    }
}
ode_options = {
    'atol': 1e-18,
    'nsteps': 50000,
    'rhs_reuse': False,
    'rhs_filename': 'rhs'
}
dt = 1.0

Why is memory_slot_size required?  Also currently QASM jobs have the option memory_slots which is just equal to the number of qubits on the device.  For Pulse we have memory_slots and memory_slot_size.  How does the relate to the QASM notation.  Are all the qasm jobs of memory_slot_size = 1?  And if so, then this does not play well with the Results class.  Indeed, formatting the memory in the results class automatically assumes memory slots sizes equal to the number of qubits, i.e . num slots = 1 slot size = num qubits.

memory_slot_size is only needed for meas_level 0 in open pulse (so doesn't apply really to qasm jobs). Otherwise the size should be 1 (ie. a slot fits a bit for meas_level 2 or a complex float for meas_level 1).

Ok, I think we need to update the contains of QobjConfig to be reasonable both for the simulator and real backends. And I also need to create proper schemas for each field of simulator configuration. I changed this PR to WIP.

The configurations for simulator is combined under simulator_spec field. This field is optional, but all fields necessary to be specified are set required within simulator_spec.
And below fields are removed from required:
"memory_slot_size",
"qubit_lo_freq",
"meas_lo_freq",
"rep_time"

Current PulseQobjConfig comprises:
+-meas_level
+-meas_return
+-pulse_library
+-(memory_slot_size)
+-(qubit_lo_freq)
+-(meas_lo_freq)
+-(rep_time)
+-(simulator-spec)
    |
    +-hamiltonian
    +-vars
    +-dim_osc
    +-dim_qub
    +-dt
    +-(noise_model)
    +-(ode_options)

and simulator_spec can be crated by new models:
simulator_spec = PulseSimulatorSpec(
    hamiltonian=['2*pi*v0*O0', 'X0||D0'],
    vars={'v0': 5.1},
    dim_osc=[],
    dim_qub=[2],
    dt=1.0,
    noise_model=PulseNoiseModel(
        qubit=[{'Sm': 0.006}],
        oscillator=[]
    ),
    ode_options=PulseOdeOption(
        atol=1e-18,
        nsteps=50000,
        rhs_reuse=False,
        rhs_filename='rhs'
    )
)

Finally the PulseQobjConfig becomes:
+-meas_level
+-meas_return
+-pulse_library
+-(memory_slot_size)
+-qubit_lo_freq
+-meas_lo_freq
+-(rep_time)
+-(simulator-spec)

where, optionals are in ().
simulator-spec will be defined for each pulse simulators.
For now, it comprises:
simulator-spec
    |
    +-hamiltonian
    |    +-h_str
    |    +-vars
    |    +-dim_osc
    |    +-dim_qub
    +-dt
    +-(noise_model)
    |    +-qubit
    |    +-oscillator
    +-(ode_options)

This field can be generated with validation by:
simulator_spec = PulseSimulatorSpec(
    hamiltonian=PulseHamiltonian(
        h_str=['2*pi*v0*O0', 'X0||D0'],
        vars={'v0': 5.1},
        dim_osc=[],
        dim_qub=[2]
    )
    dt=1.0,
    noise_model=PulseNoiseModel(
        qubit=[{'Sm': 0.006}],
        oscillator=[]
    ),
    ode_options=PulseOdeOption(
        atol=1e-18,
        nsteps=50000,
        rhs_reuse=False,
        rhs_filename='rhs'
    )
)

Also I allowed for empty list of gates and basis_gates in backend_configuration_schema to create pulse-simulator dedicated backend.


Some DB-specific dialects produce parsing exceptions

I've found the following statements, which are legal MySQL sql generate parsing errors

DROP TABLE IF EXISTS 'my_table'; - Parse chokes on IF
CREATE TABLE 'my_table' ... - Character literals for table names
CREATE TABLE my_table ( 'id' bigint(20) ... - Character literals for column names
CREATE TABLE my_table ( id beignet(20) NOT NULL AUTO_INCREMENT, PRIMARY KEY ('id') ... - Character literals in primary key definitions
LOCK TABLES 'my_table' WRITE; - Lock is an unknown identifier, I'm guessing unlock (UNLOCK TABLES;) is too
Character literals for table and column names on INSERT statements too. Most likely everywhere.

Character literals for table names or any objects name will not go into JSqlParser ( look at #168, regarding SQLServer it is an deprecated feature)
---> As for MySQL look at https://dev.mysql.com/doc/refman/5.0/en/identifiers.html : "The identifier quote character is the backtick (“`”):" Maybe it is a copy paste error from you? SQLFiddle does not run as well: http://sqlfiddle.com/#!9/6f69bc/7
drop if exists is simply not implemented
lock / unlock is not implemented

Doh! For some reason the backticks got converted to ticks. I'll re-test with backticks.
Will you update the grammar to understand drop if exists and lock/unlock? No problems, I can compensate either way, just curious.
Thanks!

At the moment I have only little time to spare. You know, something to do for food ;). At least ~drop if exists~ shoulnd't be to hard to implement.


Image->allocator()->allocate() is too slow for large image

Platform:
Raspberry PI4
Operating System:
Raspbian
ACL version
20.05
Problem descriptio
when use a large image  it is too slow to allocate memory,  for example, I run NEScharr3x3 :
img.allocator()->init(TensorInfo(4000, 3000, Format::U8));
dx.allocator()->init(TensorInfo(4000, 3000, Format::U8));
dy.allocator()->init(TensorInfo(4000, 3000, Format::U8));

scharr3x3.config(&img, &dx, &dy,  BorderMode::REPLICATE);

src.allocator()->allocate();   <---
dx.allocator()->allocate();    <---
dx.allocator()->allocate();    <--- about 90ms for all those  allocate.

scharr3x3.run();                    <--  about 40ms

the scharr3x3 run  is very fast  about 10 times than opencv,   but allocate memory is very slow
I try to pre-allocate memory myself then use import_memory()  to import it,  it is fast!  but the scharr3x3.run() become slow now.
img.allocator()->init(TensorInfo(4000, 3000, Format::U8));
dx.allocator()->init(TensorInfo(4000, 3000, Format::U8));
dy.allocator()->init(TensorInfo(4000, 3000, Format::U8));

scharr3x3.config(&img, &dx, &dy,  BorderMode::REPLICATE);

uint8_t *src_ptr=new uint8_t[src.info()->total_size()];
src.allocator()->import_memory(src_ptr);
.. import_memory for dx
.. import_memory for dy       <--- it below 1ms  for all those  allocate.

scharr3x3.run();                    <--  about 80ms

what wrong with it ?

Hello @gallex ,
We do have import capabilities in ACL but unfortunately Scharr3x3 is one of the kernels that add implicit padding to the tensors. We are working at the moment to remove padding requirements from our functions thus is will be quite trivial to import memory once done.
Do you have a specific list of kernels that you are interested in?
Hope this helps,
George

I this it may cause by unnecessary  memory initial when  run  allocate(),  I try to change runtime/ MemoryRegion.h  line 52  remove parentheses after new unit8_t[space] :
FROM
     _mem         = std::shared_ptr<uint8_t>(new uint8_t[space](), [](uint8_t *ptr)

TO
    _mem         = std::shared_ptr<uint8_t>(new uint8_t[space], [](uint8_t *ptr)

then allocate the tensor is very fast now,   But: 1)  I don't know will those change effect other function.  2) function run time is slight longer ,  same as use import_memory()

now I use following function :NEScharr3x3, 	NEPhase ,  NEMagnitude

Hello @gallex,
Will note the functions of interest (fyi @mpekatsoula)
What do you time and measure? Do you time the whole program execution or just the call to allocate? If the second is the case then malloc might defer the actual page allocation until you request to access the memory. So you might be seeing allocate being so fast because memory is lazily requested, thus you might see bigger execution time from the function that actually request access to the memory.
Hope this helps,
George

Oh, you are right, I only measure the allocate call time.
But, I still thing initial the memory is unnecessary, set a large block of memory to zero will waste lots time.
maybe you can add a option params: inital the memory or not.

Hello @gallex,
Yes I totally understand you suggestion, main reason for doing this was around the implicit padding that we have, we will most likely remove it once we get rid of the implicit padding (we are in the process of doing this).
Will capture this as feature request, will that be fine?
Best Regards,
George


Add approbation support to check the market-sim repo for core approbation runs

In order to better track the need for, scope and coverage of vega-market-sim fuzzing tests a new process will be introduced akin to that used for the core ACs.
At a high level the protocol design / research process will be:

"Fuzzing" ACs can be defined in the specs detailing scope and value ranges that would feed into the test
AC codes would be applied in the specs and "marked" in the tests in this market sim directory for each features fuzzing run as we do today for core ACs.
The reporting would be as we do now for all ACs (until we identify a good need to report differently)
The feature core AC coverage can be tracked to a high % so we know when its a good time to start the fuzzing work and effectively close off the testing for the feature

This issue is to add support for this process to the core approbation runs

I think this is currently almost a non-task. The way I would approach this:

Add fuzzing ACs as usual
Add a new category for fuzzing, not because it's required just for point 3
Update the jenkins config for core runs to clone ther vega-market-sim repo
Update core's TEST_ARGS to include the market sim test dir (something like '{/workspace/system-tests/tests/**/*.py,/workspace/vega/commands/*.{go,feature},/workspace/vega/core/integration/**/*.{go,feature},/workspace/MultisigControl/test/*.js,/workspace/Vega_Token_V2/test/*.js,/workspace/Staking_Bridge/test/*.js,/workspace/vega-market-sim/vega_sim/scenario/fuzzed_markets/**/*.py}')

Then if the category itself has good coverage and is proving useful, we can look at breaking out fuzzing in the same way that we have done with system tests


Scheduling accross zones

Does AKS support scheduling based on zones as described in the kubernetes doc which imply to add specific tagging accross nodes during creation and scaling ?
https://kubernetes.io/docs/setup/best-practices/multiple-zones/

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 471c32a2-1f6a-88d1-7df4-80b8f6fbc4a4
Version Independent ID: 10de5ee1-942d-e30f-5f0c-f163bd45904d
Content: Use Availability Zones in Azure Kubernetes Service (AKS)
Content Source: articles/aks/availability-zones.md
Service: container-service
GitHub Login: @mlearned
Microsoft Alias: mlearned

@lgmorand Thank you for your feedback! We will review and update as appropriate.

@lgmorand Yes . AKS adds labels to the nodes with zone details.
Example is failure-domain.beta.kubernetes.io/zone=eastus2-1
@jluk @sauryadas Will AKS support auto spreading pods across zones in a deployment.
In kubernetes docs , SelectorSpreadPriority is mentioned.  Please add your comments

@MicrosoftDocs/aks-pm please provide your inputs

From a colleague, I got this information "The Kube Scheduler will automatically understand that the spreading behavior should be extended across zones, and it will try in "best effort" to distribute your pods evenly across zones assuming your nodes are heterogeneous (similar SKU)"
It seems logical, as it is the default dehavior of k8s but since, it's possible to override the scoring of SelectorSpreadPriority in the scheduler, I just want to be sure of the default behavior :)
thanks

@lgmorand  thanks for the info.   I will close this issue for now.
Feel free to open new issues when needed


OptogeneticSeries with small amount of data failing

https://neurosift.app/?p=/nwb&url=https://api.dandiarchive.org/api/assets/7d1990d7-a714-406e-9cb2-1b8f4015869e/download/&dandisetId=000971&dandisetVersion=draft&tab=neurodata-item:/stimulus/presentation/OptogeneticSeries|OptogeneticSeries&tab-time=0,404.9999999986085,undefined

Uncaught (in promise) Error: Problem slicing stimulus/presentation/OptogeneticSeries/timestamps: i1End > shape[0]: 3000 > 81
    at bv (index-1560e54b.js:253:63141)
    at zk.getDatasetData (index-1560e54b.js:253:68955)
    at async nUA.getTimestampsForDataIndices (index-1560e54b.js:282:61521)
    at async index-1560e54b.js:282:67162

cc @pauladkisson

This has been fixed. (and you need to zoom out to see it, but that wasn't the problem)

@pauladkisson, is this what you intended it to look like?
https://neurosift.app/?p=/nwb&url=https://api.dandiarchive.org/api/assets/7d1990d7-a714-406e-9cb2-1b8f4015869e/download/&dandisetId=000971&dandisetVersion=draft&tab=neurodata-item:/stimulus/presentation/OptogeneticSeries|OptogeneticSeries&tab-time=0,2038.9050000000002,undefined
I think it might help to add 0-amp points at times immediately before each stim time so we get rectangles instead of ramps

@magland an alternative might be to render as steps instead of linear interpolation. The TimeSeries type has a flag "continuity" which could be used to control this.

The current mode matches "continuous"
"discrete" would be points but no line connecting them
"step" would render as a step rather than linear interpolation

I think it might help to add 0-amp points at times immediately before each stim time so we get rectangles instead of ramps

There's a couple problems with this approach, the main one being what time is "immediately before"?  The other problem is that the second 0-amp timepoint carries basically no information so it's pretty inefficient.  That being said, the time series approach in general is a bit inefficient for cases like these that are really more appropriately described an array of onset times and a set of parameters (frequency, amplitude, pulse width, etc.).  At some point it may be worth incorporating this alternative representation into one of the ogen extensions.

an alternative might be to render as steps instead of linear interpolation.
I think would be the best solution for the near-term.

Looking back at this, the original issue has been fixed, but I do see that there are some other things to consider. Should I close this and we can open a new issue for figuring out whether/when to do continuous, discrete, and step?

Yes, that sounds good


fix: preserve output to stderr and stdout when spinner is active

Purpose
Describe the problem you want to address or the feature you want to implement.
Approach
Describe how your changes address the issue or implement the desired functionality in as much detail as possible.
References
Provide a link to the existing issue(s), if any.
Pre-Merge TODO

[ ] Write tests for your proposed changes
[ ] Make sure that existing tests do not fail

We should fix Safari Client Tests in #6879


GitHub Actions: which shell for Windows?

What settings do we need to upload with GitHub Actions when running on Windows?
With no shell:
    - name: Upload coverage
      if: success()
      run: |
        bash <(curl -s https://codecov.io/bash)
      env:
        CODECOV_TOKEN: ${{ secrets.CODECOV_TOKEN }}
        CODECOV_NAME: ${{ runner.os }} Python ${{ matrix.python-version }}

gives:
Run bash <(curl -s https://codecov.io/bash)
  bash <(curl -s https://codecov.io/bash)
  shell: C:\Program Files\PowerShell\6\pwsh.EXE -command ". '{0}'"
  env:
    pythonLocation: C:\hostedtoolcache\windows\Python\3.5.4\x86
    CODECOV_TOKEN: ***
    CODECOV_NAME: Windows Python 3.5
At D:\a\_temp\f9f81a44-97d3-4908-8e7c-7d8d676e9d93.ps1:2 char:6
+ bash <(curl -s https://codecov.io/bash)
+      ~
The '<' operator is reserved for future use.
+ CategoryInfo          : ParserError: (:) [], ParseException
+ FullyQualifiedErrorId : RedirectionNotSupported

##[error]Process completed with exit code 1.

These settings work for Ubuntu and macOS.
Adding shell: bash
    - name: Upload coverage
      if: success()
      run: |
        bash <(curl -s https://codecov.io/bash)
      env:
        CODECOV_TOKEN: ${{ secrets.CODECOV_TOKEN }}
        CODECOV_NAME: ${{ runner.os }} Python ${{ matrix.python-version }}
      shell: bash

gives:
Run bash <(curl -s https://codecov.io/bash)
  bash <(curl -s https://codecov.io/bash)
  shell: C:\Program Files\Git\bin\bash.EXE --noprofile --norc -e -o pipefail {0}
  env:
    pythonLocation: C:\hostedtoolcache\windows\Python\3.5.4\x86
    CODECOV_TOKEN: ***
    CODECOV_NAME: Windows Python 3.5
bash: /dev/fd/63: No such file or directory
##[error]Process completed with exit code 127.

Changing to shell: cmd
    - name: Upload coverage
      if: success()
      run: |
        bash <(curl -s https://codecov.io/bash)
      env:
        CODECOV_TOKEN: ${{ secrets.CODECOV_TOKEN }}
        CODECOV_NAME: ${{ runner.os }} Python ${{ matrix.python-version }}
      shell: cmd

gives:
Run bash <(curl -s https://codecov.io/bash)
  bash <(curl -s https://codecov.io/bash)
  shell: C:\windows\system32\cmd.EXE /D /E:ON /V:OFF /S /C "CALL "{0}""
  env:
    pythonLocation: C:\hostedtoolcache\windows\Python\3.5.4\x86
    CODECOV_TOKEN: ***
    CODECOV_NAME: Windows Python 3.5
The system cannot find the file specified.
##[error]Process completed with exit code 1.

Thanks to @smac89 on Stack Overflow, this works:
- name: Upload coverage
  if: success()
  run: |
    curl -s https://codecov.io/bash | bash
  env:
    CODECOV_TOKEN: ${{ secrets.CODECOV_TOKEN }}
    CODECOV_NAME: ${{ runner.os }} Python ${{ matrix.python-version }}
  shell: bash


steempy backup nodes doesn't work (and you will never know until you need it)

setting up custom node works fine:
steempy set nodes https://gtg.steem.house:8090/
setting up such node as backup/fallback node works fine:
set nodes https://api.steemit.com,https://gtg.steem.house:8090/
but it does not if it can't connect to first node from the list
set nodes https://localhost:8080,https://api.steemit.com,https://gtg.steem.house:8090/
where port 8080 at localhost is closed it won't even try next nodes
gandalf@sandbox:~$ steempy info
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 138, in _new_conn
    (self.host, self.port), self.timeout, **extra_kw)
  File "/usr/lib/python3/dist-packages/urllib3/util/connection.py", line 98, in create_connection
    raise err
  File "/usr/lib/python3/dist-packages/urllib3/util/connection.py", line 88, in create_connection
    sock.connect(sa)
ConnectionRefusedError: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 594, in urlopen
    chunked=chunked)
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 350, in _make_request
    self._validate_conn(conn)
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 837, in _validate_conn
    conn.connect()
  File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 281, in connect
    conn = self._new_conn()
  File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 147, in _new_conn
    self, "Failed to establish a new connection: %s" % e)
urllib3.exceptions.NewConnectionError: <urllib3.connection.VerifiedHTTPSConnection object at 0x7f6063ae6828>: Failed to establish a new connection: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.5/dist-packages/steem-1.0.0-py3.5.egg/steembase/http_client.py", line 202, in call
  File "/usr/lib/python3/dist-packages/urllib3/poolmanager.py", line 244, in urlopen
    response = conn.urlopen(method, u.request_uri, **kw)
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 671, in urlopen
    release_conn=release_conn, **response_kw)
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 671, in urlopen
    release_conn=release_conn, **response_kw)
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 671, in urlopen
    release_conn=release_conn, **response_kw)
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 671, in urlopen
    release_conn=release_conn, **response_kw)
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 671, in urlopen
    release_conn=release_conn, **response_kw)
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 671, in urlopen
    release_conn=release_conn, **response_kw)
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 671, in urlopen
    release_conn=release_conn, **response_kw)
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 671, in urlopen
    release_conn=release_conn, **response_kw)
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 671, in urlopen
    release_conn=release_conn, **response_kw)
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 671, in urlopen
    release_conn=release_conn, **response_kw)
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 671, in urlopen
    release_conn=release_conn, **response_kw)
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 671, in urlopen
    release_conn=release_conn, **response_kw)
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 671, in urlopen
    release_conn=release_conn, **response_kw)
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 671, in urlopen
    release_conn=release_conn, **response_kw)
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 671, in urlopen
    release_conn=release_conn, **response_kw)
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 671, in urlopen
    release_conn=release_conn, **response_kw)
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 671, in urlopen
    release_conn=release_conn, **response_kw)
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 671, in urlopen
    release_conn=release_conn, **response_kw)
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 671, in urlopen
    release_conn=release_conn, **response_kw)
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 671, in urlopen
    release_conn=release_conn, **response_kw)
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 643, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/usr/lib/python3/dist-packages/urllib3/util/retry.py", line 363, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='localhost', port=8080): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f6063ae6828>: Failed to establish a new connection: [Errno 111] Connection refused',))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/bin/steempy", line 11, in <module>
    load_entry_point('steem==1.0.0', 'console_scripts', 'steempy')()
  File "/usr/local/lib/python3.5/dist-packages/steem-1.0.0-py3.5.egg/steem/cli.py", line 776, in legacyentry
  File "/usr/local/lib/python3.5/dist-packages/steem-1.0.0-py3.5.egg/steem/steem.py", line 60, in __init__
  File "/usr/local/lib/python3.5/dist-packages/steem-1.0.0-py3.5.egg/steem/commit.py", line 96, in __init__
  File "/usr/local/lib/python3.5/dist-packages/steem-1.0.0-py3.5.egg/steem/wallet.py", line 61, in __init__
  File "/usr/local/lib/python3.5/dist-packages/steem-1.0.0-py3.5.egg/steem/steemd.py", line 65, in chain_params
  File "/usr/local/lib/python3.5/dist-packages/steem-1.0.0-py3.5.egg/steem/steemd.py", line 419, in get_dynamic_global_properties
  File "/usr/local/lib/python3.5/dist-packages/steem-1.0.0-py3.5.egg/steembase/http_client.py", line 223, in call
  File "/usr/local/lib/python3.5/dist-packages/steem-1.0.0-py3.5.egg/steembase/http_client.py", line 243, in call
  File "/usr/local/lib/python3.5/dist-packages/steem-1.0.0-py3.5.egg/steembase/http_client.py", line 262, in _return
steembase.exceptions.RPCError: Error Response: {'message': 'Assert Exception:api_itr != _registered_apis.end(): Could not find API ', 'data': {'message': 'Assert Exception', 'stack': [{'data': {'api': ''}, 'format': 'api_itr != _registered_apis.end(): Could not find API ${api}', 'context': {'method': 'find_api_method', 'file': 'json_rpc_plugin.cpp', 'level': 'error', 'line': 203, 'hostname': '', 'timestamp': '2018-03-27T21:20:41'}}], 'code': 10, 'name': 'assert_exception'}, 'code': -32002}

bonus:
I can't revert from that situation by setting up working node:
steempy set nodes https://gtg.steem.house:8090/
for the same reason... steempy fails to set it because it crashes while connecting to current (bad) node
(workaround: editing or just removing .local/share/steem/steem.sqlite)

Too narrow errorList?
https://github.com/steemit/steem-python/blob/9628744f838cdf85ee797db194e6fcc51921c310/steembase/http_client.py#L194-L199

node handling in this lib needs a lot of work. very unpredictable.

I can't repro either. Appears to be working as expected. Going to close unless @Gandalf-the-Grey you still see this happening.

I have not been able to reproduce this issue. Observations:

Why does the cli make a steem request before it will allow you to apply any setting updates??
If I'm reading the recursive stack trace correctly, ConnectionRefusedError was handled fine, and the final error was from steemd: Could not find API -- a valid response which should not be retried.

At this point it would be great if you could try to reproduce the issue. And at any rate we need to fix the CLI behavior but I've been able to put in junk nodes and edit them just fine right now (aside from annoying 60s timeout before new settings are applied)

Not seeing any PR for this to review

@jnordberg no PR yet (may not be necessary), we’ve asked OP to reproduce the behavior since much of this code has been updated lately

Unfortunately I can still run into such troubles. However I guess that now I need to search for more tricky cases.
All depends on exact issue with connection, sometimes is easily handled like trivial connection refused (tcp reject):
$ steempy set nodes https://<IP_ADDRESS>,https://api.steemit.com,https://gtg.steem.house:8090/
$ steempy info
WARNING:urllib3.connectionpool:Retrying (Retry(total=19, connect=None, read=None, redirect=0)) after connection broken by 'NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7fd62a10b908>: Failed to establish a new connection: [Errno 111] Connection refused',)': /
WARNING:urllib3.connectionpool:Retrying (Retry(total=18, connect=None, read=None, redirect=0)) after connection broken by 'NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7fd62a10b7f0>: Failed to establish a new connection: [Errno 111] Connection refused',)': /
WARNING:urllib3.connectionpool:Retrying (Retry(total=17, connect=None, read=None, redirect=0)) after connection broken by 'NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7fd62a10b668>: Failed to establish a new connection: [Errno 111] Connection refused',)': /

(...) up to the limit of retries
or even in case of a node that returns some unexpected "garbage"
$ steempy set nodes https://steemit.com,https://api.steemit.com,https://gtg.steem.house:8090/
$ steempy info
Unexpected error: Expecting value: line 1 column 1 (char 0)
Traceback (most recent call last):
  File "/usr/local/bin/steempy", line 11, in <module>
    load_entry_point('steem==1.0.0', 'console_scripts', 'steempy')()
  File "/usr/local/lib/python3.5/dist-packages/steem-1.0.0-py3.5.egg/steem/cli.py", line 776, in legacyentry
  File "/usr/local/lib/python3.5/dist-packages/steem-1.0.0-py3.5.egg/steem/steem.py", line 60, in __init__
  File "/usr/local/lib/python3.5/dist-packages/steem-1.0.0-py3.5.egg/steem/commit.py", line 96, in __init__
  File "/usr/local/lib/python3.5/dist-packages/steem-1.0.0-py3.5.egg/steem/wallet.py", line 61, in __init__
  File "/usr/local/lib/python3.5/dist-packages/steem-1.0.0-py3.5.egg/steem/steemd.py", line 65, in chain_params
  File "/usr/local/lib/python3.5/dist-packages/steem-1.0.0-py3.5.egg/steem/steemd.py", line 419, in get_dynamic_global_properties
  File "/usr/local/lib/python3.5/dist-packages/steem-1.0.0-py3.5.egg/steembase/http_client.py", line 271, in call
  File "/usr/local/lib/python3.5/dist-packages/steem-1.0.0-py3.5.egg/steembase/http_client.py", line 231, in call
  File "/usr/lib/python3.5/json/__init__.py", line 319, in loads
    return _default_decoder.decode(s)
  File "/usr/lib/python3.5/json/decoder.py", line 339, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/lib/python3.5/json/decoder.py", line 357, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

but that can be more tricky with variety of different things that can go wrong while connecting, and once I find it I'm locked out (until I remove that in directly within sqlite)
Example:
$ steempy set nodes https://<IP_ADDRESS>,https://api.steemit.com,https://gtg.steem.house:8090/
$ steempy info
Unexpected error: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:720)
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 594, in urlopen
    chunked=chunked)
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 350, in _make_request
    self._validate_conn(conn)
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 837, in _validate_conn
    conn.connect()
  File "/usr/lib/python3/dist-packages/urllib3/connection.py", line 323, in connect
    ssl_context=context)
  File "/usr/lib/python3/dist-packages/urllib3/util/ssl_.py", line 324, in ssl_wrap_socket
    return context.wrap_socket(sock, server_hostname=server_hostname)
  File "/usr/lib/python3.5/ssl.py", line 385, in wrap_socket
    _context=self)
  File "/usr/lib/python3.5/ssl.py", line 760, in __init__
    self.do_handshake()
  File "/usr/lib/python3.5/ssl.py", line 996, in do_handshake
    self._sslobj.do_handshake()
  File "/usr/lib/python3.5/ssl.py", line 641, in do_handshake
    self._sslobj.do_handshake()
ssl.SSLError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:720)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/bin/steempy", line 11, in <module>
    load_entry_point('steem==1.0.0', 'console_scripts', 'steempy')()
  File "/usr/local/lib/python3.5/dist-packages/steem-1.0.0-py3.5.egg/steem/cli.py", line 776, in legacyentry
  File "/usr/local/lib/python3.5/dist-packages/steem-1.0.0-py3.5.egg/steem/steem.py", line 59, in __init__
  File "/usr/local/lib/python3.5/dist-packages/steem-1.0.0-py3.5.egg/steem/commit.py", line 96, in __init__
  File "/usr/local/lib/python3.5/dist-packages/steem-1.0.0-py3.5.egg/steem/wallet.py", line 61, in __init__
  File "/usr/local/lib/python3.5/dist-packages/steem-1.0.0-py3.5.egg/steem/steemd.py", line 65, in chain_params
  File "/usr/local/lib/python3.5/dist-packages/steem-1.0.0-py3.5.egg/steem/steemd.py", line 419, in get_dynamic_global_properties
  File "/usr/local/lib/python3.5/dist-packages/steem-1.0.0-py3.5.egg/steembase/http_client.py", line 291, in call
  File "/usr/local/lib/python3.5/dist-packages/steem-1.0.0-py3.5.egg/steembase/http_client.py", line 235, in call
  File "/usr/lib/python3/dist-packages/urllib3/poolmanager.py", line 244, in urlopen
    response = conn.urlopen(method, u.request_uri, **kw)
  File "/usr/lib/python3/dist-packages/urllib3/connectionpool.py", line 624, in urlopen
    raise SSLError(e)
urllib3.exceptions.SSLError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:720)

And now I'm unable to go back to safe set:
steempy set nodes https://api.steemit.com,https://gtg.steem.house:8090/
because it fails at attempts to connect <IP_ADDRESS> (sorry, google still doesn't run their own Steem API)
Different commands that supposed to be local has troubles too, like steempy config

@Gandalf-the-Grey Are you using the most recent version from master? Or the version from PyPi? Using master, the line numbers for your tracebacks don't match up to my codebase, and it seems to be working.

Between https://github.com/steemit/steem-python/pull/225 and https://github.com/steemit/steem-python/pull/229 we can call this resolved. Should it happen again we'll get more useful information.


Sometimes router.navigate does not update the URL bar

I think it's a race condition when a route immediate navigates to another, the prior route may end up being the final state.

This happened because the previous navigate op wasn't calling the callback until the inner navigate op finished. Now that they are asynchronous, they execute in order, although it's still possible to introduce a race condition if the callback that is executing navigate performs several operations after calling navigate.


Crash Report

Are you using the latest commit of the Sodium next branch?

Fixed in the next-compat branch


Awesome books

In this pull request I implemented the following:

Create a new directory and initialize it with git.

Use npm init -y command to create package.json file.

Create the entry point for your JavaScript code called index.js

Create index.css file for your styles.

Create the main index.html file. Link your index.js and index.css files there.

Create a directory called modules.

Re-create your Awesome books app following the rules:

Use ES6 syntax.

Divide your code into modules. Save each module in a separate file in the modules dir. Import modules in the index.js file. For this exercise - the more modules the better!

Keep all funcionalities of the app without errors.

Refactor your methods and functions to arrow functions.

Use let and const in a correct way.

Display the current date below the navigation bar.

For this requirement you should use a library Luxon

Download the script and save it to your project.

Import it as a module.

Thank you for the review and approval.


⚠ Bofrost.at has degraded performance

In 7912851, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 840 ms

Resolved: Bofrost.at performance has improved in 56212ef after 14 minutes.


localResourceRoots should include extension folder in addition to workspace folder

Testing #44466
Feel this is a saner default.

Already covered by the vscode-extension-resource scheme. The vscode-extension-resource resources are always available regardless of the localResourceRoots setting

vscode-extension-resource

Can we start a documentation for the Webview early? I'm happy to set up yet another preview server where the team can see early documentation and give feedback. It would be nice to see the API and the doc evolving together.
Now it seems impossible to figure out how to include external js/css files (the <base> thing we talked about and the CSP rules). I don't even know if @jrieken or @tsalinger were able to test including external js/css from extension folder.

@octref good point! I was trying to include external js but didn't succeed.
In the meantime, Matt gave me some feedback on it and I'll try again later today.

For the record: I didn't manage to include an external js file.
@mjbvz would be cool if you could add a minimal example on how to do it.


Implementation of High Level Data Setup to NightlyPipeline

Notes:

high level data setup nightly pipeline implementation

Link to somewhere this has been tested? There's no runtime coverage for this pipeline outside of unit tests

This has been tested in data store api. You can see the details below https://build.platform.hmcts.net/view/CDM/job/HMCTS_Nightly_CDM/job/ccd-data-store-api/job/nightly-ccd-1284/


Update README.md

How is that different from jsonlint? That's already on the list.
Also you'd have to create a yaml file here instead.

Any updates on this @ixhimanshu? 😅

Alright, that's fine then. Can you create a yaml file for the tool and revert the manual changes to the README.md?
Here is a description on how to do that: https://github.com/analysis-tools-dev/static-analysis/blob/master/CONTRIBUTING.md
Thanks a lot.

@ixhimanshu, can you make the changes and reopen the pull request once you're done? Thanks a lot.


chore(stages): Helper for walking over table range

Closes #912 and closes #702
Motivation

Revise and clean up repetitive pattern, cursor -> walk -> take_while

retest

Codecov Report

Merging #942 (61850ab) into main (1e84189) will decrease coverage by 0.04%.
The diff coverage is 97.72%.

@@            Coverage Diff             @@
##             main     #942      +/-   ##
==========================================
- Coverage   73.80%   73.77%   -0.04%
==========================================
  Files         294      294
  Lines       32329    32316      -13
==========================================
- Hits        23860    23840      -20
- Misses       8469     8476       +7

Flag
Coverage Δ

unit-tests
73.77% <97.72%> (-0.04%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

crates/stages/src/db.rs
88.63% <91.66%> (+0.30%)
:arrow_up:

crates/stages/src/stages/hashing_storage.rs
96.03% <97.56%> (-0.08%)
:arrow_down:

crates/stages/src/stages/bodies.rs
92.38% <100.00%> (-0.37%)
:arrow_down:

crates/stages/src/stages/execution.rs
90.02% <100.00%> (-0.25%)
:arrow_down:

crates/stages/src/stages/hashing_account.rs
94.75% <100.00%> (-0.14%)
:arrow_down:

crates/stages/src/stages/sender_recovery.rs
94.00% <100.00%> (-0.14%)
:arrow_down:

crates/net/eth-wire/src/capability.rs
62.13% <0.00%> (-0.98%)
:arrow_down:

crates/net/dns/src/lib.rs
78.48% <0.00%> (-0.95%)
:arrow_down:

... and 1 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

resolved merge conflicts.

rebase to resolve merge conflicts.

This PR is replaced by #1025


Delete webhook subscription cURL request contains -d/-F typo. Fixes #78

Thanks for the PR @njwest! Can I assume you've successfully deleted a push subscription with the revised curl command?

@zackisaacs Yes, I have been using the revised DELETE curl in the pull request
Initially, I copied and pasted the DELETE cURL currently in the docs, but the Strava endpoint returned only errors -- then I saw that the DELETE cURL in the docs used GET request field flags (-d instead of -F), so I decided to fix the docs
Cheers!

@njwest your change is deployed.