Hub handshake failed with error 'WebSocket is not in the OPEN state' SignalR WebSockets Angular client with AutoReconnect()

My application was first built on dotnetcore 2.2, then it was upgraded to dotnetcore 3.0 and it was working properly. But WithAutoReconnect() from Angular web app and all the default settings, gives following log:
[2019-12-05T12:10:14.538Z] Information: Reconnect attempt number 3 will start in 10000 ms.
zone.js:3372 OPTIONS http://<IP_ADDRESS>:9938/host/negotiate?clientIdentifier=b462ed0d-4df0-4f2d-82b1-4ad1ee72b09b net::ERR_CONNECTION_REFUSED
Utils.js:208 [2019-12-05T12:10:24.540Z] Debug: Starting connection with transfer format 'Text'.
Utils.js:208 [2019-12-05T12:10:24.540Z] Debug: Sending negotiation request: http://<IP_ADDRESS>:9938/host/negotiate?clientIdentifier=b462ed0d-4df0-4f2d-82b1-4ad1ee72b09b.
Utils.js:208 [2019-12-05T12:10:24.683Z] Debug: Selecting transport 'WebSockets'.
Utils.js:208 [2019-12-05T12:10:24.683Z] Trace: (WebSockets transport) Connecting.
Utils.js:204 [2019-12-05T12:10:24.723Z] Information: WebSocket connected to ws://<IP_ADDRESS>:9938/host?clientIdentifier=b462ed0d-4df0-4f2d-82b1-4ad1ee72b09b&id=KOrhcPrFdlHaeTzcJxZjlA.
Utils.js:208 [2019-12-05T12:10:24.724Z] Debug: The HttpConnection connected successfully.
Utils.js:208 [2019-12-05T12:10:24.724Z] Debug: Sending handshake request.
Utils.js:208 [2019-12-05T12:10:24.743Z] Debug: Hub handshake failed with error 'WebSocket is not in the OPEN state' during start(). Stopping HubConnection.
Utils.js:208 [2019-12-05T12:10:24.744Z] Trace: (WebSockets transport) socket closed.
Utils.js:208 [2019-12-05T12:10:24.744Z] Debug: HttpConnection.stopConnection(undefined) called while in state Disconnecting.
Utils.js:198 [2019-12-05T12:10:24.744Z] Error: Connection disconnected with error 'WebSocket is not in the OPEN state'.
Utils.js:208 [2019-12-05T12:10:24.745Z] Debug: HubConnection.connectionClosed(WebSocket is not in the OPEN state) called while in state Reconnecting.
Utils.js:204 [2019-12-05T12:10:24.745Z] Information: Reconnect attempt failed because of error 'WebSocket is not in the OPEN state'.
Utils.js:204 [2019-12-05T12:10:24.745Z] Information: Reconnect attempt number 4 will start in 30000 ms.
Utils.js:208 [2019-12-05T12:10:54.747Z] Debug: Starting connection with transfer format 'Text'.
Utils.js:208 [2019-12-05T12:10:54.748Z] Debug: Sending negotiation request: http://<IP_ADDRESS>:9938/host/negotiate?clientIdentifier=b462ed0d-4df0-4f2d-82b1-4ad1ee72b09b.
Utils.js:208 [2019-12-05T12:10:54.773Z] Debug: Selecting transport 'WebSockets'.
Utils.js:208 [2019-12-05T12:10:54.773Z] Trace: (WebSockets transport) Connecting.
Utils.js:204 [2019-12-05T12:10:54.780Z] Information: WebSocket connected to ws://<IP_ADDRESS>:9938/host?clientIdentifier=b462ed0d-4df0-4f2d-82b1-4ad1ee72b09b&id=JEu_f9AcM9fx4OE3SMWEVg.
Utils.js:208 [2019-12-05T12:10:54.780Z] Debug: The HttpConnection connected successfully.
Utils.js:208 [2019-12-05T12:10:54.781Z] Debug: Sending handshake request.
Utils.js:208 [2019-12-05T12:10:54.781Z] Trace: (WebSockets transport) sending data. String data of length 32.
Utils.js:204 [2019-12-05T12:10:54.782Z] Information: Using HubProtocol 'json'.
Utils.js:208 [2019-12-05T12:10:54.829Z] Trace: (WebSockets transport) data received. String data of length 3.
Utils.js:208 [2019-12-05T12:10:54.830Z] Debug: Server handshake complete.
Utils.js:204 [2019-12-05T12:10:54.831Z] Information: HubConnection reconnected successfully.

The server is disconnected and client tries to reconnect. When server goes up and connected; then the following steps occurred:

3rd retry attempted and though "The HttpConnection connected successfully." but "Hub handshake failed with error 'WebSocket is not in the OPEN state' during start(). Stopping HubConnection" and (WebSockets transport) socket closed. HttpConnection.stopConnection(undefined) called while in state Disconnecting.
And as result "Error: Connection disconnected with error 'WebSocket is not in the OPEN state'." is logged in the console.
After 30sec 4th retry attempted and It will automatically reconnected.
These steps are consistency reproducible.

Please help me to get rid of this error in between 3rd and 4th retry attempt.

I think we need better logging in the WebSocketTransport.ts's WebSocket.onclose handler to see exactly what happened here.
I don't see any log of the WebSocket CloseEvent details, though the logs that exist certainly imply the WebSocket closed shortly after it was open during the hub handshake. Given that the websocket closed during the hub handshake, it's not surprising that it took one more reconnect attempt to successfully reestablish the connection, though it would be nice to know why the WebSocket closed to begin whit.
@paramitamandal can you reliably reproduce the handshake error? If so, is there any trick to make the repro reliable? If you could, putting the following log statement at the top of WebSocketTransport.ts's WebSocket.onclose handler might help diagnose the issue.
https://github.com/aspnet/AspNetCore/blob/f5492be35bc5831e3cd7f394e252690c43bd1c7f/src/SignalR/clients/ts/signalr/src/WebSocketTransport.ts#L110
this.logger.log(LogLevel.Trace, `WebSocket closed with status code: ${event.code} (${event.reason}).`);

ok. thanks @halter73. This error occurred each and every time when client tries to reconnect with the Server after the server goes down. The first attempt always failed due to the handshaking error, and then in 2nd attempt connection established. I will put a log in webSocket.onclose() and let you know the feedback.

We've seen some weird behavior with Angular's use of zone.js here, since it replaces the WebSocket class in JS with a different version. We should do an end-to-end angular test to see what we can find.

@bradygaster to prove out the end-to-end

I have already put some log as suggested by @halter73 but that did not add any other error log other than the previous one.
We are getting this error logged everytime as the first attempt of reconnection. @anurse May be due to angular as you said. I will update you if I find anything other than this log for non angular app during reconnection.

@anurse there is no luck in non angular project also. same error everywhere.

Can you tell us more about your hosting environment?

What OS are you on?
What server are you using (IIS/Kestrel/HttpSysServer)?
Do you have any proxies in between the client and the server (Nginx/Apache/HAproxy/etc.)?

Also, can you capture a network trace? We have documentation on how to do this.
It looks like something is causing the socket to be closed. Unfortunately the browser is somewhat unhelpful in these cases and doesn't give us a detailed error message, just "WebSocket is not in the OPEN state".

We are using Win 10, 1809 x64. aprart from this we are using Win7, win 8.1, and server2016 and also other versions of Windows 10.
We are using "Kestrel" and  No proxies have been implemented.

IEnwtrace1 - Copy.txt

Hrm, looks like the WebSockets are very short-lived, but there's no real indication why it's being terminated in that trace (Browser dev tools traces have very limited WebSockets support unfortunately). Are you able to try using Fiddler or a tool like Wireshark? (If you're using Wireshark, it's best if you can do the trace over HTTP, and not HTTPS since decrypting the traffic with Wireshark is very difficult).
Can you also collect server-side trace logs? Looking at the client-side logs and the trace you provided, it appears there isn't anything interrupting the connection there.

fiddler capture - Copy.zip

If you're using HTTPS you need to configure Fiddler to decrypt HTTPS traffic. All I see in that trace is encrypte TLS traffic and I can't decrypt it :(.
Let me know if you have any more questions on how to assemble the necessary information.

Here is the traffic captured by fiddler. Please let me know if this helps to investigate further or not.
errorReconnectingIE.txt

How about server-side trace logs? Have you been able to collect those?

I'm not able to find anything in the traces. Is it possible for you to share a runnable sample application that reproduces the problem?

I took a look at the fiddler trace too. The following request seems to be the reconnect attempt that failed. The trace shows the request only lasted a second and transferred a few bytes. The last WebSocket request happened 30 seconds later and seems to have stayed open until the end of the capture.
GET https://<IP_ADDRESS>:9926/host?id=MWpPeHaWrlIvInzIuzFb4w HTTP/1.1
Origin: http://<IP_ADDRESS>:8080
Sec-WebSocket-Key: bUO3pf60pngV4wFz//IFiA==
Connection: Upgrade
Upgrade: websocket
Sec-WebSocket-Version: 13
User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; Trident/7.0; rv:11.0) like Gecko
Host: <IP_ADDRESS>:9926
Cache-Control: no-cache

HTTP/1.1 101 Switching Protocols
Connection: Upgrade
Date: Wed, 18 Dec 2019 09:57:37 GMT
Server: Kestrel
Upgrade: websocket
Vary: Origin
Access-Control-Allow-Credentials: true
Access-Control-Allow-Origin: http://<IP_ADDRESS>:8080
Sec-WebSocket-Accept: S82skX5AsL8JE/y2xJrswfNf3FE=
EndTime: 15:27:38.009
ReceivedBytes: 4
SentBytes: 6

I agree with Andrew. It would be super helpful to get a runnable sample that demonstrates the issue. Server-side trace logs might also be helpful.

Just wanted to pinch in: We're experiencing the same behaviour in a react app using @microsoft/signalr 3.0.1. Can share the code later on!

@halter73 @anurse Can you please let me know the specific requirement about the runnable sample application? We just created a connection between dotnetcore web app and an angular web app with @microsoft/signalr 3.0.1 and experiencing the error everytime while reconnecting.

@paramitamandal Ideally a git repo we can clone and run (with some steps you provide) to reproduce the issue. We can certainly try to reproduce this ourselves, but there may be a subtle difference that doesn't become clear until we're comparing code. If it's easy for you to set up a repro project then we don't lose a bunch of time to getting the correct scenario identified.

will give u the repo link soon.

@halter73 @anurse You can use my repo to reproduce the issue
https://github.com/dlimkin/AspNetCore-issues-17613

@halter73 @anurse did u able to look into code which @dlimkin provided?

@halter73 @anurse Any luck??

@paramitamandal We've been a bit delayed due to the holidays but will take a look soon.

@anurse no issue..


Draft disappear from the LHN when typing in the thread inside the thread

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Version Number:
Reproducible in staging?: Y
Reproducible in production?: Y
If this was caught during regression testing, add the test name, ID and link from TestRail:
Email or phone of affected tester (no customers):
Logs: https://stackoverflow.com/c/expensify/questions/4856
Expensify/Expensify Issue URL:
Issue reported by: @rafecolton
Slack conversation: https://expensify.slack.com/archives/C049HHMV9SM/p1713554758093909
https://expensify.slack.com/archives/C049HHMV9SM/p1713975763697069
Action Performed:

Comment in any chat
Long-press or right click on the comment, then select Reply in thread
Start a thread inside the first thread
Start composing a reply in the thread. You'll see the draft message appear as an item in your LHN with the pencil icon.
Click on a different item in the LHN

Expected Result:
The draft comment in the thread should remain in your LHN.
Actual Result:
The draft comment in the thread disappears from your LHN.
Workaround:
unknown
Platforms:

Which of our officially supported platforms is this issue occurring on?

[ ] Android: Native
[ ] Android: mWeb Chrome
[ ] iOS: Native
[ ] iOS: mWeb Safari
[x] MacOS: Chrome / Safari
[ ] MacOS: Desktop

Screenshots/Videos
Add any screenshot/video evidence

View all open jobs on GitHub

This has been labelled "Needs Reproduction". Follow the steps here: https://stackoverflowteams.com/c/expensify/questions/16989

I am checking with @rafecolton to recreate and record this - I am not able to. The pencil remains while I navigate away from the threaded chat.

Not able to reproduce any longer


set proper url of the backend

most of your api calls have wrong api url
like this one in the contact form

i want to fix these url so that correct request can be made to the backend api
please assign this issue to me @theashikagupta

Assigned @AyushSharma72


Dingo is not converting version tags with a suffix (e.g. '-beta') to "revision": 0

Dingo is not correctly converting version tags on a repository when retrieving package versions.
Tags with a suffix (e.g. '-beta') are being converted to revision: 0, which results in multiple of the same major.minor.revision being reported in the version selection.

This can be reproduced using https://github.com/lodash/lodash/


FileNotFoundError: [Errno 2] No such file or directory: 'results/Huggy/configuration.yaml'

Describe the bug
No configuration.yaml file for results found and unable to save trained model to HF.
1
!mlagents-push-to-hf --run-id="HuggyTraining" --local-dir="./results/Huggy" --repo-id="ThomasSimonini/ppo-Huggy" --commit-message="Huggy"
[INFO] This function will create a model card and upload your HuggyTraining into HuggingFace Hub. This is a work in progress: If you encounter a bug, please send open an issue
Traceback (most recent call last):
File "/usr/local/bin/mlagents-push-to-hf", line 33, in
sys.exit(load_entry_point('mlagents', 'console_scripts', 'mlagents-push-to-hf')())
File "/content/ml-agents/ml-agents/mlagents/utils/push_to_hf.py", line 205, in main
package_to_hub(
File "/content/ml-agents/ml-agents/mlagents/utils/push_to_hf.py", line 159, in package_to_hub
_generate_config(local_path, configfile_name)
File "/content/ml-agents/ml-agents/mlagents/utils/push_to_hf.py", line 29, in _generate_config
with open(os.path.join(local_dir, configfile_name)) as yaml_in:
FileNotFoundError: [Errno 2] No such file or directory: 'results/Huggy/configuration.yaml'
Material
Google Colab
Trained successfully with no issue
Saved original yaml file.

It looks like you need to update this argument --local-dir="./results/Huggy" to --local-dir="./results/Huggy2"


0.8.6, doesn't seem to do anything

I was very happy to see this mod because a certain P.......m mod did this and I wanted to not use it on systems other than 5E
But on 0.8.6, smol doesn't seem to do anything. The settings are not respected by scene and token lists.

Figured I need to change the settings for smolification to happen. Sorry about the false aparm.


Data preview

Data preview:

If CSV, show at least 5 rows in the front-end

Implementation can be discussed internally with Butch


Same random number returned for Core 1 (IDFGH-10761)

Answers checklist.

[X] I have read the documentation ESP-IDF Programming Guide and the issue is not addressed there.
[X] I have updated my IDF branch (master or release) to the latest version and checked that the issue is present there.
[X] I have searched the issue tracker for a similar issue and not found a similar issue.

IDF version.
V4.4
Operating System used.
Linux
How did you build your project?
Other (please specify in More Information)
If you are using Windows, please specify command line type.
None
Development Kit.
Custom Board
Power Supply used.
External 3.3V
What is the expected behavior?
I use rust, but I assume issue is in underlying API
I use std Rust to create my firmware. It uses multiple threads (RTOS tasks) to generate random number. Issue I notice is that only half of my numbers are random. Other are the same number (Different after each reboot). Note that WIFI and BT is disabled.
'''
use esp_idf_sys::rand;
let random_num = unsafe { rand() as u32 };
'''
random_num should be random each call.
What is the actual behavior?
'random_num' is the same for Core 1.
Steps to reproduce.

Create simple Rust std project
Disable Wifi/BT
Run multiple threads that call random number
Check that 1 Core returns the same number

Debug Logs.
No response
More Information.
No response

Is the expected behaviour when WIFI or Bluetooth are disabled.  Link here

It is the expected behavior when WIFI or Bluetooth are disabled. Link here

As I understand true randomness doesnt work, but pseudo should work. Plus it works fine on 1 core

@reinismu I cannot reproduce your issue on IDF with FreeRTOS tasks. Do you have any code that reproduces your case so that we or the Rust community can work on it?
In general, reading from the RNG always produces a different number, as suggested in the documentation. The function esp_random() is not thread-safe, though. It might be possible to read the RNG register at the exact same time, but since esp_random() is waiting for many CPU cycles to acquire entropy, this seems pretty unlikely.

@reinismu Are there any updates on this issue or has it maybe been solved eventually?

@reinismu Are there any updates on this issue or has it maybe been solved eventually?

I did hacky fix to add time to numbers on my end. Will try to do minimal project with this issue

@reinismu We will close this issue for now (it is easier for use to deal only with "active" issues in order to not loose track). Please feel free to re-open it if there is any update about this issue which requires additional discussion.


Switch from circe-generic to circe-derivation

Uses circe-derivation instead of circe-generic. See https://github.com/scalameta/lsp4s/pull/9 for the same change in the LSP project and some additional context.
Note: Currently circe-generic will be pulled in transitively until we update the lsp4s dependency version to a release cut with the linked PR.

Thanks Andy :smile:

Sure thing!
Also: rebased on the changes in #26. Hopefully the build works.

Heads up: jsonrpc 0.2.0 is out :)

Release notes https://github.com/scalameta/lsp4s/releases/tag/v0.2.0

I can open a separate PR for the LSP version bump. I like to keep changes as logical as I can, when feasible.

Yup, my comment was about the circe-generic dependency which is now gone even transitively in 0.2.0.

Aah got it. I went ahead and opened the other PR, which should get a rebase before merging. I can take care of that after this is merged.


Add GH action configuration

@niuzhenguo thanks, I merged, I will now rebase the other branches to include build.

FYI, the build is failing (as expected) as I have to use the "official" Minho (ex K5) SNAPSHOTs and Apache SNAPSHOT repository. I'm working on it.


Warning messages misspell 'Anonymous'

The warning message generated during validation of an SPDX document misspells the word 'Anonymous' as 'Anonomous' as shown in the following screen capture:

Thanks @ralphie79 - Just made a PR to fix this in one of the dependent libraries: https://github.com/spdx/Spdx-Java-Library/pull/58/files
I'll keep this issue open until we update the online tools with the latest library


WebVR

With WebVR picking up speed, it'd be interesting to start investigating supporting it with a small collection of modules. Namely:

Calculating the projection matrices for each eye of a HMD, as seen in WebVRRenderer.
Post-processing shaders for barrel distortion, vignettes, and shifting RGB channels.

Calculating the projection matrices for each eye of a HMD, as seen in WebVRRenderer.

gl-mat4 now has perspectiveFromFieldOfView to help with this, accepts a field of view object from WebVR getRecommendedEyeFieldOfView. Used it in voxel-vr but may be worth pulling out some of this code into a generic (non-voxel.js) stackgl module.

Post-processing shaders for barrel distortion, vignettes, and shifting RGB channels.

With WebVR the browser/platform is expected to perform the barrel distortion vignette (source: https://www.youtube.com/playlist?list=PLUj8-Hhrb-a0Z3f70ygX5fXLk8Sa4mTQZ), once the web app requests fullscreening to the VR device. But this still might be useful for VR without WebVR (Google Cardboard? or Oculus Rift on non-WebVR (current) browsers). References:

Applying and removing lens distortion in post production by Gergely Vass , Tamás Perlaki (pdf) - examples: 1, 2

I'm happy to start taking a look at this.

@nickdesaulniers :grin:

In particular, first, I'd like to abstract a first person camera to use:

an HMD if present
a PS if present
fallback/polyfill device orientation

It then spits out a view and project matrix for each eye.


Ft client dashboard 164741813

This branch builds a client dashboard where the client can see any opened bank account and be provided with a link to open an account if client hasn't. There is also a link for editing profile


NVD - Support for running configuration

CVE-2020-8022 only affects suse. This needs to be handled somehow.

Fixed with 1.6.10


Clean up the build script

Sort the dependencies of core/build.gradle
Fix the incorrect comment related with ProGuarding Caffeine

Pretty much cosmetic change only. Will self-merge.


Added Module Link URI Tests

If a uri is provided it will use Invoke-WebRequest and expect a 200 response code.
I have found 1 link so far that gave a false positive. The site was blocking the request via IWR but allowed via browser.
I have found this Helpful in what I have worked on, but maybe there could be instances where a URI is known to be non functioning and that is expected.
There is also the scenario of Tests being ran offline. So, this may be something that is given as an option.

I know this might not totally work as is. I am sure there are cases where Tests need to be ran offline.
One thing I have been thinking about, was adding a little config file. Since not everyone uses the same folder structure, they often will need to hardcode the ModuleName or Path into the script.
If you have a little config file that let you set Module Name, Paths, and options to exclude certain tests, I think it will answer many of those issue. Just drop it into the same directory as the Test file.

Just a few suggestions.
-- Use a Describe block instead of a context blog. That lets you add a tag that users can use to exclude the test.
e.g. Describe "$CommandName : URL links should be valid" -Tag OnlineOnly { ... }
-- To exclude empty links (no need for extra if Link):
$Links = $help.relatedLinks.navigationLink.uri | Where-Object {$_ -ne ''}
e.g.
Describe "$CommandName : URL links should be valid" -Tag OnlineOnly {
$Links = $help.relatedLinks.navigationLink.uri | Where-Object {$_ -ne ''}
	foreach ($Link in $Links)
	{
		# Uri returns OK. Doesn't verify content
		It "[$Link] has 200 status code" {
			$Results = Invoke-WebRequest -Uri $Link -UseBasicParsing
			$Results.StatusCode | Should Be '200'
		}
	}
}

Awesome, I totally forgot about tags. Both suggestions are great ideas.
What are your thoughts on handling slightly different module layouts? The more projects I contribute to, the more I am noticing that many do not follow the standard layout. I have started using a slightly altered layout that Warren F uses. It just kind of naturally makes sense in some scenarios. It makes deploying the module much easier.
It has the module in another subdirectory. $ModuleName$ModuleName\
Posh-Teamviewer
    - Posh-Teamviewer
        - Module Folders and Scripts here.
    - Tests
        - Tests here.

I have also been seeing more of a need to break tests up into subdirectories.
Posh-Teamviewer
    - Posh-Teamviewer
        - Module Folders and Scripts here.
    - Tests
        - SubCategory
            - SubCategory Tests go here
        - SubCategory
            - SubCategory Tests go here
        - SubCategory
            - SubCategory Tests go here

Then I have seen many others that handle it with other types of Sub folder for the module.
Posh-Teamviewer
    - Release
        - Posh-Teamviewer
            - Module Folders and Scripts here.
    - Tests
        - Tests here.

I have just been trying to think of an intelligent way to handle different module layout scenarios without having to worry about editing the scripts themselves while still being able to drop in a Tests folder and let Pester handle execution.

Hmm, what if you did this.
ModuleName.Help.Tests.ps1.
The Test could the extract the ModuleName from the Test filename.

I moved these to a Describe block and added a "Links" Tag. I can change the tag to whatever sounds best to you.

Ok, I am going to have to alter this. This part is not working properly
$Links = $help.relatedLinks.navigationLink.uri | Where-Object {$_ -ne ''}

It is still testing links that are empty

Ok, seems to be working properly now. I added a $null check.
$Links = $help.relatedLinks.navigationLink.uri | Where-Object { ($_ -ne '') -AND ($_ -ne $Null) }


firestore-bigquery-export docs: fs-bq-import-collection -> firestore-bigquery-change-tracker

As reported in #13, IMPORT_EXISTING_DOCUMENTS.md tells us to use the script @firebaseextensions/fs-bq-import-collection, which doesn't exist. I believe the correct script is @firebaseextensions/firestore-bigquery-change-tracker, which is actually included in this repo.
Closes #13

This seems right to me:
https://www.npmjs.com/package/@firebaseextensions/firestore-bigquery-change-tracker
But I'll let @jhuleatt and @rachelsaunders double-check.

Update: I've checked our scripts/import/package.json file and apparently, this package should expose a fs-bq-import-collection command (see line 22), but after installing the package, the command fs-bq-import-collection is not found.
@IanWyszynski any idea ?

Update: I've checked our scripts/import/package.json file and apparently, there should be a @firebaseextensions/fs-bq-import-collection package exposing a fs-bq-import-collection command (see line 22), but this package doesn't seem to be on npm. I'm guessing it hasn't been published yet.
@IanWyszynski thoughts ?

Can you paste the output of:
npm install -g @firebaseextensions/fs-bq-import-collection

https://www.npmjs.com/package/@firebaseextensions/fs-bq-import-collection

@IanWyszynski this is the output:

npm ERR! code E404
npm ERR! 404 Not Found - GET https://registry.npmjs.org/@firebaseextensions%2Ffs-bq-import-collection - Not found
npm ERR! 404
npm ERR! 404  '@firebaseextensions/fs-bq-import-collection@latest' is not in the npm registry.
npm ERR! 404 You should bug the author to publish it (or use the name yourself!)
npm ERR! 404
npm ERR! 404 Note that you can also install from a
npm ERR! 404 tarball, folder, http url, or git url.
npm ERR! A complete log of this run can be found in:
npm ERR!     /home/username/.npm/_logs/2019-10-01T07_36_10_513Z-debug.log

Also, accessing the link you posted requires me to sign in to npmjs and then shows a 404. Maybe the package is marked as private?

https://screenshot.googleplex.com/fbaKTocsXPa

@rosariopfernandes I've made the package public, are you able to install now?

@IanWyszynski Yes! It's working now. Thank you very much!


Fix public key installation command for SSH into Windows VM

Right now the PowerShell script to install the SSH Key into the Windows VM does not force UTF8 encoding.
When using SSH from the VM extension given in the article, it currently is not able to use the public key downloaded into it. Instead, it will constantly revert to user entry based password authentication as compared to RSA based authentication.
OpenSSH does not have any warnings or errors even at the highest debug level on both client and host side (tested using sshd.exe -ddd on the host and ssh -vvv on the client, both Windows VMs, thus debugging this can be a hurdle for a developer, especially in business scenarios where RDP and other forms of direct access to the VM are blocked.
Using the -Encoding UTF8 flag in the inline PowerShell script fixed the problem for several types of Windows VMs that I tested this on.

@cynthn
Can you review the proposed changes?
When the changes are ready for publication, add a #sign-off comment to signal that the PR is ready for the review team to merge.
#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

PR https://github.com/MicrosoftDocs/azure-docs/pull/117073 addresses more bug fixes.


Parse Blender output without writing to disk first

The exr file can be very large without pixel data compression.
Is there any way to parse the output exr file directly in the memory(BytesIO), without writing the exr file  to disk first?

py-minexr is only related with reading exr files not generating them (in memory or at disk). You can access the rendered image in memory using a ViewerNode (at least that's how it was done in earlier versions of Blender).


How to train properly from scratch?

The instructions in training notebook are crystal clear, however, you only seem to train on "07+12" trainval, and evaluate on 07 test.
How do I reproduce the results from the main README.md that even surpass the original? They claim to have first trained on COCO and then finetuned on VOC 07+12, but I can't figure out if the model was trained on COCO to convergence, or simply for a certain number of epochs and finetuning was performed on "interim" weights. How exactly did you do it? I would like to know exact number of epochs for both datasets.
The original:

Your implementation:

I plan on doing this to test a feature-reinjection to help SSD better recognize smaller objects from https://arxiv.org/pdf/1712.00960.pdf
I need the model to recognize "person" class once trained, so I believe training on both COCO and VOC can only help.

The instructions in training notebook are crystal clear, however, you only seem to train on "07+12" trainval, and evaluate on 07 test.

Correct, that is the only training I replicated. The point of replicating the training of one configuration was just to test whether my implementation is accurate. There was no need to replicate the training of the other configurations, because I already provide all the ported weights for all the original configurations.
The results you're quoting are from the ported weights, not from my own training.
If you wanted to reproduce the trainings of those models that were trained on both MS COCO and Pascal VOC, you'd have to consult the original Caffe implementation for instructions. All the models there come with Python training scripts. Although presumably they just trained the respective model to convergence on MS COCO, then sub-sampled the classifier weights in the canonical way (the Pascal VOC classes are a subset of the MS COCO classes), and then trained to convergence on Pascal VOC.

I need the model to recognize "person" class once trained, so I believe training on both COCO and VOC can only help.

Yes, but it makes an important difference whether you train on two datasets sequentially or if you train on the union of both simultaneously. MS COCO is a much larger dataset with more objects per image on average and more smaller objects. In that sense it is a more complex and thus more challenging dataset. Training on this more complex dataset first and then training on a similar but less complex dataset (Pascal VOC) afterwards might not necessarily lead to a general improvement, but rather to a deterioration. I would assume that merging both datasets and training on the union would be a better idea. Those are both just my assumptions though, I haven't tried this.

So the original learning rate and number of epochs is mentioned in the original SSD paper. The actual python training script I was able to find at https://github.com/weiliu89/caffe/blob/master/python/train.py is not very descriptive, as it parses command line arguments and no values appear to be hard-set.
Anyway, do you have any insight into why a single epoch is 1000 steps? With 32 images in batch, that gives you 32000 images per epoch, but the 07+12 train set only has 16551 images. It appears almost as if this value was chosen arbitrarily. Is there an actual meaning to it?

So the original learning rate and number of epochs is mentioned in the original SSD paper. The actual python training script I was able to find at https://github.com/weiliu89/caffe/blob/master/python/train.py is not very descriptive, as it parses command line arguments and no values appear to be hard-set.

The training scripts are not on GitHub. You have to download the models. The training scripts are in the zip files for the respective models.

Do you have any insight into why a single epoch is 1000 steps? With 32 images in batch, that gives you 32000 images per epoch, but the 07+12 train set only has 16551 images. It appears almost as if this value was chosen arbitrarily. Is there an actual meaning to it?

The concept of an epoch is utterly meaningless with regard to the training performance. It never matters how many steps one epoch consists of, it only matters for how many steps the model has been trained in total and how many times it has seen the dataset during the training. One epoch is 1000 steps in the SSD300 training notebook because I chose it to be 1000 steps. It would make no difference if it were 100 steps or 469 steps.

in your training notebook, you load VGG detection weights but don't freeze them.

Of course not. And neither does the original Caffe implementation. I would never freeze any weights unless I was concerned of overfitting (e.g. if I had a very small dataset).

The additional SSD untrained randomly-initialized layers will probably have large updates by the optimizer. Will not such updates negatively affect the already trained layers in the VGG, since they propagate all the way to the first conv layers?

No. Just because the derivatives with respect to the weights of a given layer are large does not mean that the derivatives with respect to the weights of any previous layer will be large.

If I want to merge COCO and VOC datasets, do I still have to consider different scales for each dataset? Scales are only used to scale box_height and box_width, and do not partake in loss function, where only offsets are considered (line taken from SSDLoss class):
localization_loss = tf.to_float(self.smooth_L1_loss(y_true[:,:,-12:-8], y_pred[:,:,-12:-8]))
Those indexes strip away class predictions, variances and anchor box coordinates, if I understand correctly, and only leave offsets.
Is my understanding correct, that during training, the scales are irrelevant?

Is my understanding correct, that during training, the scales are irrelevant?

No, that is not correct. If the scales weren't relevant for the training, then what else would they be relevant for?
The scaling factors determine the sizes of the anchor boxes. The sizes of the anchor boxes affect which ground truth boxes get matched to which anchor boxes. This matching process determines what the individual neurons in the predictor layers will learn. That is, the scaling factors are very relevant to the training.

So how can I train on both datasets at the same time?

Same as you would treat any dataset: You pick scaling factors that cover the object sizes in your dataset well.
In the case of a merged MS COCO & Pascal VOC dataset that means just taking the MS COCO scaling factors (which you could also have figured out from the fact that the Pascal VOC "07+12+COCO" models use the MS COCO scaling factors and work very well).

Thank you, yet again. One additional question, what use are variances? The paper never mentions them, but they are in the code and I don't quite understand why you should scale the anchors like that.

You can interpret them as the assumed variances of the distributions of the offsets from the respective anchor box coordinates. From this perspective, dividing by them normalizes those distributions. Or, if you don't know much about probability theory, you can just see them as scaling factors for the anchor box offsets. They allow you to scale the offsets and, in particular, to scale the different coordinates differently.
I have not studied their effect and, as you mentioned, the authors of the paper provide no justification as to why they introduced these variances, let alone why they chose the values the way they did.

I think by offsets you mean aspect rations in your implementation. Can you please clarify why the offset values are 0.5 for all the layers? I read the comment but I can't imagine how it works


Documentation link is corrected in the readme.md

FILE: microsoft/powerbi-jupyter/README.md
Line: 25
(\DOCUMENTATION.md) is corrected to (./DOCUMENTATION.md)
Line: 27
Demo Notebook Link is corrected

Thank you for your contribution, link was fixed in new release


Playground test throws exception when selecting a theme

Start
1st "Test Bench"
ListView
Combo DropDown
Select Office 2007-Black

Boom :

Hi @Smurf-IV
I think this has been fixed in the Development branch to use the newly created ThemeManager


0.59.0 errors on snowflake_role_grants

Provider Version
0.59.0
Terraform Version
1.3.4
Describe the bug
With 0.59.0 most grants have stopped crashing or erroring but we are seeing occasional errors with snowflake_role_grants; unexpected ID parts such as below
│ Error: unexpected number of ID parts (1), expected 6
│
│   with module.at_work_tracking.snowflake_role_grants.default,
│   on .terraform/modules/at_work_tracking/snowflake-user/roles.tf line 11, in resource "snowflake_role_grants" "default":
│   11: resource "snowflake_role_grants" "default" {
│

tf state show 'module.at_work_tracking.snowflake_role_grants.default'
# module.at_work_tracking.snowflake_role_grants.default:
resource "snowflake_role_grants" "default" {
    id        = "AT_WORK_TRACKING"
    role_name = "AT_WORK_TRACKING"
    roles     = [
        "SYSADMIN",
    ]
    users     = [
        "SNOWFLAKE_AT_WORK_TRACKING_SRVC_RO",
    ]
}

Expected behavior
No error

Was looking at this doing a compare with 0.56.2 and 0.59.0 in the docs and it looks like the identifier of the snowflake_role_grant has changed, can we allow for backwards compatibility?
0.56.2 - https://registry.terraform.io/providers/Snowflake-Labs/snowflake/0.56.2/docs/resources/role_grants#import
0.59.0 - https://registry.terraform.io/providers/Snowflake-Labs/snowflake/0.56.2/docs/resources/role_grants#import

Hello @bennylu2, thank you for bringing this to my attention. I will get this fixed ASAP.

@sfc-gh-swinkler in addition there's a bug with the snowflake_pipe_grant resource. It will always show a diff and want to add the role after apply so it has a perpetual diff
  # module.tdm_customers.module.private_raw.snowflake_pipe_grant.this["MONITOR"] will be updated in-place
  ~ resource "snowflake_pipe_grant" "this" {
        id                     = "TDM_CUSTOMERS|RAW||MONITOR|ANALYST,DMS_RO|false"
      ~ roles                  = [
          + "TDM_CUSTOMERS__RAW__READ",
        ]
        # (6 unchanged attributes hidden)
    }

Hello, i have a fix in 0.60, which solves both reported issues. Sorry it took a while, there were some unrelated build issues. Can you please confirm?

Looking preliminarily, the grant errors have been resolved but I am now seeing an issue with the resource monitor resource. I will open a separate bug for that

Thank you! Works nicely with version 0.60. 🙏

Hello. I'm still getting this error with 0.60 and 0.61 on all "snowflake_role_grants" coming from 0.56.3


nix-prefetch-git: Add the --include-date option.

Motivation for this change
@expipiplus1 and I are working on a tool for automatically updating the revision and sha256 information in a fetchgit Nix expression.  When we are updating that information, we would also like to know the commit date because many packages that use fetchgit also store the commit date in a version attribute for that package.  Those packages are following a rule from the Nixpkgs manual:

If package is fetched from git's commit then the version part of the name must be the date of that (fetched) commit. The date must be in "YYYY-MM-DD" format.

Currently, nix-prefetch-git does output a human-readable commit date on the standard error.  However, it would be useful to have the date be in the standard output of nix-prefetch-git so that we can get it with a standard JSON parser and not worry as much about its format changing.
Things done

[ ] Tested using sandboxing
(nix.useChroot on NixOS,
or option build-use-chroot in nix.conf
on non-NixOS)
Built on platform(s)

[ ] NixOS
[ ] OS X
[x] Linux

[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[x] Tested execution
[x] Fits CONTRIBUTING.md.

This would be very useful!

Why not just add it to the output? JSON is usually open for extension so it shouldn't break existing tools.

@zimbatm My first idea was to always add the date to the json but then I found an example of a tool in the nixpkgs repository that would be broken by that change because it uses head and tail to get specific lines of the output.
Still, if you think that it is best to unconditionally add the date to the JSON, then I would be happy to do that.

Yeah I prefer to avoid the branching because it tends to accumulate and create dark areas in the code.
Do you mind fixing the other tool to use name-based indexing instead of position based?

@zimbatm: Upon looking into it further, I think no one is actually using update-upstream-data.sh to update git repositories, and the parsing is already broken.  It's using tail -2 to get the last two lines of output from nix-prefetch-git.  It expects those lines to have the rev and hash in them but those last two lines will actually be something like:
"sha256": "008xwkjfsv3rj50x9fqj0vvggl1zwrbqh7bkvnga94krmij63hib"
}
I'm pinging @7c6f434c because he wrote update-upstream-data.sh and still is an active contributor to this project, but I think it's OK to proceed without worrying about that script.
I'll update the pull request with @zimbatm's suggestions.

OK, @zimbatm, I updated this pull request.  I am using pushd and popd so that whole block of commands that fetches git information will be run in the correct directory.  I think this is nicer than using -C "$dir" because there will be less repetition, but I don't feel too strongly about it.

Perfect, thanks. I just tweaked the commit a bit so shellcheck is happy and pushed it as f56ab9e5e4a31ead55efd9e1d9b55ddf70533908 on master.

Thanks!


CI for Node

› 1 snapshot failed.
Snapshot Summary
› 1 snapshot failed from 1 test suite. Inspect your code changes or run npm test -- -u to update them.
Test Suites: 1 failed, 1 total
Tests:       4 failed, 7 passed, 11 total
Snapshots:   1 failed, 1 total
Time:        0.826 s
Ran all test suites.
npm ERR! Test failed.  See above for more details.
Error: Process completed with exit code


allow to set COCKROACH_ENGINE_MAX_SYNC_DURATION

Signed-off-by: Christian Hüning<EMAIL_ADDRESS>
What this PR does / why we need it:
we need it because CRDB support told us to set COCKROACH_ENGINE_MAX_SYNC_DURATION but we couldn't via the helm chart
Which issue this PR fixes
(optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close that issue when PR gets merged)
Special notes for your reviewer:
Checklist
[Place an '[x]' (no spaces) in all applicable fields. Please remove unrelated fields.]

[ ] DCO signed
[ ] Chart Version bumped
[ ] Variables are documented in the README.md

@a-robinson Agreed, I switched to an ExtraEnvArgs option. Also I bumped the default tag to 2.1.6 and increased the Chart "App Version" accordingly.

/ok-to-test
/lgtm
/approve
Thanks!


fix plots can have too many ticks and lines #900

I did a algorithm for  calculation grid lines more flexible. Algorithm  looks for an interval where the number of intervals stops decreasing and begins to grow. The intervals may be added during the algorithm working

:+1:


Wgpu uses 100% CPU on linux

Any wgpu sample uses 100% of one cpu core on linux, even though the time to render and display the frame is less than that
zig build triangle_wgpu-run # uses 100% cpu
zig build minimal_glfw_gl-run # barely uses any cpu

In tracy sampling, it seems like it might be spending all its time on gctx.device.tick inside zgpu.GraphicsContext.uniformsNextStagingBuffer.

This could possibly be an issue specific to the i3 window manager, I haven't tested in any other wm.

No repro running popOS with X11 and radv Mesa 24.0.3-1 driver.


Missing scroll bar in the "API Reqest" page.

Rancher server version - v1.2.0-pre2-rc4
User Interface -	v1.2.8

Version - master 9/8
Verified fixed


Can change evnet source handler && trigger handler image repo to private image repo

Description
We try to use event framework to trigger a function，all env in an internal network。But the event controller make eventsource handler image to a constant value。Can make the image value read from Open Function Controller pod env or configmap else？

It's a good requirement, would you like to create a PR for this? @shyupc
If not, we can fix this later @wrongerror


Set href tag on Time Display in Day View

In day view the time column shows likes this:
<%= cal._hour(i, l) %>
I would like to use a data attribute like this:
'<%= cal._hour(i, l) %>'
Is it possible to get that date format in to the data-datetime attribute. If so, how? I have tried various methods. I know that <%= cal._hour(i, l) %> makes the hour and minute but what about the date.
My aim is that when a user clicks the time a:link in the day view, both the current date (in the view) AND time is passed to a form, where the $_POST['datetime'] is populated with the GET value passed by the href click.
Example: data-datetime="2015-08-10 18:20"
Can this be done?

Well, on day view...
When you have "event" var, you can get the event.start and event.end (they are in ms format!). So, you can convert it, and shows a date... or pass them and work with that on backend!
For example, on day you can change it for:
<a href="<%= event.url ? event.url : 'javascript:void(0)' %>" data-event-id="<%= event.id %>"
				   data-event-class="<%= event['class'] %>" class="event-item" data-event-start="<%= event.start %>" data-event-end="<%= event.end %>">
					<%= event.title %>

To make it a little easier to understand, I have included a snapshot image. Please see attached.
As you can see, I have place the current day view Date into data-datetime tag for 11.00 am.
I am trying to achieve a date format in the data-datetime like this. data-datetime="2015-08-11 11:00"
So, when the user clicks the "time" link (in the left column of day view calendar) it will pass the data-datetime value to a form.
I just need to be able to format the date in that tag like 0000-00-00 00:00
Thanks for your assistance.

OK. I got this resolved with:
var d = new Date(this.getTitle());
var date = d.toISOString().slice(0,10);
Used jquery to set the text of the data-date="date" // Sets the data-date to var date
Used data-time="<%= cal._hour(i, l) %>" //Holds the calendar time
var datetime = $(this).data('date') + ' ' + $(this).data('time')
$.get('form.php?datetime='+datetime, function(data) {etc etc etc}
Now datetime field in form is populated with $_GET['datetime'] value
Voila!


[WORK IN PROGRESS] [build] add OS X build

/cc @chinmaygarde

lgtm

Depends on #4028

Do you also have a patch for turning the tests on on the infra bots?

@Hixie Good idea. Logged a separate issue (https://github.com/flutter/flutter/issues/4056) because this has to be done in the Chrome infra repo.

@yjbanov I'm closing this PR since it's been inactive for a couple of weeks and is not ready for checkin, but please don't hesitate to reopen it when it's ready.


Implement host collector as part of system-stats-monitor

Host collector report below things today:

Host OS uptime (in seconds)
Host kernel version (as a metric label)
Host OS version (as a metric label)

This is part of #301
The vendor part of this PR is done in #302 . I will rebase when #302 is merged.
Example:
$ curl http://localhost:20257/metrics
...
# HELP host_uptime The uptime of the operating system
# TYPE host_uptime gauge
host_uptime{kernel_version="4.19.37-2rodete1-amd64",os_version="debian "} 700612

(My debian machine is a custom built OS, and does not comes with a version. So "debian " OS version is expected)

/assign @wangzhen127

/ok-to-test

/lgtm
/approve

/hold

Are you going to merge this with the dependency changes or merge the other PR first?

I plan to merge #302 first, and then rebase this PR, then merge this PR.

/retest

(Actually, if it's easier, we could merge everything in this PR, and I can then drop #302 . Because current PR is a super set of #302 )

Feel free to merge the vendor part and actual implementation in the PR. You have different commits for those. So it is ok to review.

/cc @krzyzacy
Is the test failure a test-infra problem? The CI jobs are also failing.

Feel free to merge the vendor part and actual implementation in the PR. You have different commits for those. So it is ok to review.

Sounds good. The vendor part is already in this PR. So we can just merge it :)
I'll drop #302 then

Is the test failure a test-infra problem?

Seems the test failed when trying to fetch the kubernetes.tar.gz at https://storage.googleapis.com/kubernetes-release-dev/ci/v1.16.0-alpha.0.1789+a807cb625b08c7/kubernetes.tar.gz
2019/07/02 10:19:46 extract_k8s.go:288: U=https://storage.googleapis.com/kubernetes-release-dev/ci R=v1.16.0-alpha.0.1789+a807cb625b08c7 get-kube.sh
2019/07/02 10:19:46 process.go:153: Running: /workspace/get-kube.sh
Downloading kubernetes release v1.16.0-alpha.0.1789+a807cb625b08c7
  from https://storage.googleapis.com/kubernetes-release-dev/ci/v1.16.0-alpha.0.1789+a807cb625b08c7/kubernetes.tar.gz
  to /home/prow/go/src/k8s.io/node-problem-detector/kubernetes.tar.gz
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
curl: (22) The requested URL returned error: 404
2019/07/02 10:19:46 process.go:155: Step '/workspace/get-kube.sh' finished in 154.592053ms
2019/07/02 10:19:46 extract_k8s.go:298: U=https://storage.googleapis.com/kubernetes-release-dev/ci R=v1.16.0-alpha.0.1789+a807cb625b08c7 get-kube.sh failed: error during /workspace/get-kube.sh: exit status 22

someone probably broke the build from k8s head?
/retest

Thanks @krzyzacy !
@wangzhen127 I think we can merge this PR now?

/hold cancel

Thanks Zhen!


UI not working

I brought up the UI using the Docker image. Does it need something else to be running in the backend?

Please help ASAP.

Hi @ranvijayj,
You need to deploy Kubeless as well in order to be able to use the UI. You can find Kubeless manifests either in the releases page of the repository or following the quick start guide: https://kubeless.io/docs/quick-start/


Help needed to configure application.conf for Confluent distribution of Kafka

Hi,
I am new to Kafka and have a requirement to read binary log of MySQL and publish it to Kafka. I have followed your "readme" file and have mdoified my.cnf for MySQL.
My application.conf file is as below.
application_conf.txt
My stdout producer works fine and I am able to see the logs in the console.
But I am not able to see the same in kafka.
I can see that the topics are created.
I run the following command to see view the same from Kafka
./sbt "project runner" "runMain mypipe.runner.KafkaGenericConsoleConsumer kafka_test_test_user_generic localhost:2181 test-consumer-group"
I get the following output. I am not sure how to proceed further. I believe it has to do with my schema registry address. Please kindly help me
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=256m; sup                                                                                port was removed in 8.0
[info] Loading project definition from /home/kafkauser/confluent-2.0.1/mypipe/project
[warn] Multiple resolvers having different access mechanism configured with same name 'sbt-plugin-releases'. To avoid conflict, Remove duplicate project resolvers (resolvers) or rename publishing resolver (publishTo).
[info] Set current project to mypipe (in build file:/home/kafkauser/confluent-2.0.1/mypipe/)
[info] Set current project to runner (in build file:/home/kafkauser/confluent-2.0.1/mypipe/)
[warn] Multiple main classes detected.  Run 'show discoveredMainClasses' to see the list
[info] Running mypipe.runner.KafkaGenericConsoleConsumer kafka_test_test_user_generic localhost:2181 test-consumer-group
log4j:WARN No appenders could be found for logger (kafka.utils.VerifiableProperties).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
16:36:44 INFO  [org.apache.zookeeper.ZooKeeper          ] Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
16:36:44 INFO  [org.apache.zookeeper.ZooKeeper          ] Client environment:host.name=BIPROSHADOOP2
16:36:44 INFO  [org.apache.zookeeper.ZooKeeper          ] Client environment:java.version=1.8.0_77
16:36:44 INFO  [org.apache.zookeeper.ZooKeeper          ] Client environment:java.vendor=Oracle Corporation
16:36:44 INFO  [org.apache.zookeeper.ZooKeeper          ] Client environment:java.home=/opt/jdk1.8.0_77/jre
16:36:44 INFO  [org.apache.zookeeper.ZooKeeper          ] Client environment:java.class.path=/home/kafkauser/.sbt/launchers/0.13.9/sbt-launch.jar
16:36:44 INFO  [org.apache.zookeeper.ZooKeeper          ] Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
16:36:44 INFO  [org.apache.zookeeper.ZooKeeper          ] Client environment:java.io.tmpdir=/tmp
16:36:44 INFO  [org.apache.zookeeper.ZooKeeper          ] Client environment:java.compiler=
16:36:44 INFO  [org.apache.zookeeper.ZooKeeper          ] Client environment:os.name=Linux
16:36:44 INFO  [org.apache.zookeeper.ZooKeeper          ] Client environment:os.arch=amd64
16:36:44 INFO  [org.apache.zookeeper.ZooKeeper          ] Client environment:os.version=3.10.0-327.el7.x86_64
16:36:44 INFO  [org.apache.zookeeper.ZooKeeper          ] Client environment:user.name=kafkauser
16:36:44 INFO  [org.apache.zookeeper.ZooKeeper          ] Client environment:user.home=/home/kafkauser
16:36:44 INFO  [org.apache.zookeeper.ZooKeeper          ] Client environment:user.dir=/home/kafkauser/confluent-2.0.1/mypipe
16:36:44 INFO  [org.apache.zookeeper.ZooKeeper          ] Initiating client connection, connectString=localhost:2181 sessionTimeout=400 watcher=org.I0Itec.zkclient.ZkClient@1089e457
16:36:44 INFO  [org.apache.zookeeper.ClientCnxn         ] Opening socket connection to server localhost/<IP_ADDRESS>:2181. Will not attempt to authenticate using SASL (unknown error)
16:36:44 INFO  [org.apache.zookeeper.ClientCnxn         ] Socket connection established to localhost/<IP_ADDRESS>:2181, initiating session
16:36:44 INFO  [org.apache.zookeeper.ClientCnxn         ] Session establishment complete on server localhost/<IP_ADDRESS>:2181, sessionid = 0x1549530daae0006, negotiated timeout = 6000
[WARNING] Avro: Invalid default for field txid: "null" not a ["null",{"type":"fixed","name":"Guid","namespace":"mypipe.avro","size":16}]
[WARNING] Avro: Invalid default for field txid: "null" not a ["null",{"type":"fixed","name":"Guid","namespace":"mypipe.avro","size":16}]
[WARNING] Avro: Invalid default for field txid: "null" not a ["null",{"type":"fixed","name":"Guid","namespace":"mypipe.avro","size":16}]

First you can check your kafka queue position.

There is no message

@bb56277 you mentioned that you see the topic(s) created, is kafka_test_test_user_generic one of them? And to confirm with what @tramchamploo said, the topic is there but has no messages even if you use the kafka console consumer provided with Kafka to try to look at it?
My other question is about the Confluent Platform. Are you using CP1 or CP2? Note that mypipe uses Kafka 0.8, not 0.9 (used by CP2).

Perhaps of interest here, as of 55f53212bfcd67f5e6054e1aaf7bdfe0f72cdf66 we're adding the ability to easily switch out the Kafka serializer / deserializer in order to allow mypipe to support Confluent's (and other) schema repos.

I can not to run mypipe
"project runner" "runMain mypipe.runner.KafkaGenericConsoleConsumer $world_$test_generic <IP_ADDRESS>:4180 groupId"
project runner need to use which project
and groupId is what?
thank you very much


Improve database migrations management

Description
This PR improves the database migration experience by:

Providing a new --revision param to the database migrate command. This will be useful to downgrade DB to a specific version
A new database revisions command to show info about DB revisions.

NOTE: Still needed to review the doc sections
Type of change
(Please delete options that are not relevant. Remember to title the PR according to the type of change)

[x] Improvement (change adding some improvement to an existing functionality)

How Has This Been Tested
It was tested locally. No new tests have been included.
Checklist

[x] I have merged the original branch into my forked branch
[ ] I added relevant documentation
[x] follows the style guidelines of this project
[x] I did a self-review of my code
[ ] I made corresponding changes to the documentation
[x] I have added relevant notes to the CHANGELOG.md file (See https://keepachangelog.com/)

Thanks for your comments @gabrielmbmb  I will push them asap. Also, I will move the migrations method into the tasks.database modules since makes more sense to me.


Expand Aurelius Support for GLMs

Add a function that maps most all GLM family functions in the glm() function in R to an appropriate specification in PFA for generating documents.
Relates to issue #27.
Add a pfa() function that creates a complete pfa document from an object and an S3 method for glm models to be generated via pfa(). This decreases barriers to model creation for simpler GLM models.
Relates to issue #28.

Can someone from ODG review and merge this? Matt?

Thanks for bringing this up, we will review the pull request.

On Dec 28, 2016, at 11:26 AM, Jim Pivarski<EMAIL_ADDRESS>wrote:
Can someone from ODG review and merge this? Matt?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub https://github.com/opendatagroup/hadrian/pull/29#issuecomment-269510004, or mute the thread https://github.com/notifications/unsubscribe-auth/ALsJob3vmXkMdH84fd8-6f8IVUMxhQKtks5rMpvJgaJpZM4LXEPK.


Build fails due to "cannot open source file .tlh" + "framework/file.h not found"

I'm attempting to build a project ported to windows through islandwood. The project includes openssl as a .framework folder with the headers for the openssl functions contained within the folder in "openssl.framework/headers/." None of the headers appear in the ProjectName-Headers solution and moving them manually to the header solution does not fix the issue.
After running vsimporter on the project and attempting to build it, the build fails due to the following error. Every location which contains an import from the framework such as  "#import <openssl/rand.h>" registers a failure with the following error
Cannot open source file "C:/........../projectName.vsimporter/...../Debug/rand.tlh"
The compiler output is a single line stating Fatal Error: 'openssl/rand.h file not found.

@LucasTaiMacArthur  The tlh error messages are a known issue, but they do not result in compilation errors. In this case, the build failure is caused by missing openssl headers, which is tracked by Issue #928.


The rule for detecting unicode or zawgyi has problem

I tested with your library. My device use the zawgyi font. But when call the MDetect.isUnicode(), it is return true, so the font are not correctly showed.

What's your device and can you send me the font(ttf) that you are using?

ASUS zenfone and i think i downloaed the zawgyi samsung font.

After tracing, i found that i change the display font style to zawgyi samsung. May be that's why it can't detect...


Future exception was never retrieved

I am getting following error in console quite often. not sure its a bug or something.
further my loads tab never populated ?
[E 151009 16:01:50 concurrent:122] Future exception was never retrieved: Traceback (most recent call last):
      File "/usr/local/lib/python2.7/site-packages/tornado/gen.py", line 810, in run
        yielded = self.gen.throw(*sys.exc_info())
      File "/usr/local/lib/python2.7/site-packages/redshift_console/redshift.py", line 76, in start
        yield self._refresh()
      File "/usr/local/lib/python2.7/site-packages/tornado/gen.py", line 807, in run
        value = future.result()
      File "/usr/local/lib/python2.7/site-packages/tornado/concurrent.py", line 209, in result
        raise_exc_info(self._exc_info)
      File "/usr/local/lib/python2.7/site-packages/tornado/gen.py", line 810, in run
        yielded = self.gen.throw(*sys.exc_info())
      File "/usr/local/lib/python2.7/site-packages/redshift_console/redshift.py", line 105, in _refresh
        yield self.refresh()
      File "/usr/local/lib/python2.7/site-packages/tornado/gen.py", line 807, in run
        value = future.result()
      File "/usr/local/lib/python2.7/site-packages/tornado/concurrent.py", line 209, in result
        raise_exc_info(self._exc_info)
      File "/usr/local/lib/python2.7/site-packages/tornado/gen.py", line 810, in run
        yielded = self.gen.throw(*sys.exc_info())
      File "/usr/local/lib/python2.7/site-packages/redshift_console/redshift.py", line 276, in refresh
        yield self._fetch_load_errors()
      File "/usr/local/lib/python2.7/site-packages/tornado/gen.py", line 807, in run
        value = future.result()
      File "/usr/local/lib/python2.7/site-packages/tornado/concurrent.py", line 209, in result
        raise_exc_info(self._exc_info)
      File "/usr/local/lib/python2.7/site-packages/tornado/gen.py", line 812, in run
        yielded = self.gen.send(value)
      File "/usr/local/lib/python2.7/site-packages/redshift_console/redshift.py", line 310, in _fetch_load_errors
        row['table'] = self.table_id_mapping[row['table_id']]['table_name']
    KeyError: 169366
[I 151009 16:01:52 web:1825] 304 GET /api/queries/inflight (::1) 0.48ms

Indeed looks like a bug.
The user you're running redshift-console with, does it have sufficient privileges to read the schema?

Yes. i am connecting with a user having root user previlages. if you have any specific user previlage requirement i can happy to assert that as well.

Re. Loads tab not populating - currently it supposed to show only load errors. Do you know if you had any load errors when you checked it?

yes we do have errors reported in STL_LOAD_ERRORS  table.


How to unlock Samsung phone with a broken screen?

"Anyone who can help me? How can I retrieve data from Samsung phone with broken screen and having a lock pattern? In another words, is it possible to unlock Samsung phone with cracked screen without losing any data (without changing a new screen)?"
You will be suddenly enlightened after readed this article, because it can solve your problem with ease.
Samsung Data Extraction can helps to fix Samsung Galaxy phone that sudden death and black screen of death in a click. What’s more, the program can also recover any data like contacts, text messages, photos, videos, call logs, WhatsApp messages, audios and more from Samsung Galaxy phone with black screen / broken screen / cracked screen and so on.
Read the related video guide here:  https://youtu.be/Q51QnlZNEWg
Related Articles:
Recover data from Samsung with black screen
Recover data from Samsung sudden death

Samsung Galaxy Recovery is the all-in-one data & system recovery tool that can repair your phone errors and recover lost and deleted data, including contacts, text messages, photos, videos, call logs, WhatsApp messages and so on. So, you can try removing the lock screen for your broken Samsung phone.
Read more:
Recover data from Samsung with broken screen
How to unlock Samsung Galaxy
Repair Samsung Phone Sudden Death


Duplicate named audio sources break UI

PREVIOUS TITLE: Last Audio Source Not Selectable
Hi,
I've been using SWYH-rs daily since my last message (#62) using the same audio source. I decided to change it today, but do not seem to be able to set it back. I get the "Configuration Value Changed!" prompt to restart the app, but the actual audio source doesn't seem to change for that device in particular.
My (unfounded) suggestion would be to check for an off-by-one error in the Audio Source call, but that could just be a coincidence. Sorry I'm not being of more help diagnosing the issue!
I've recorded a video as that's probably a better demonstration: https://youtu.be/o1EySN72X4o
Previously using release 1.3.26 (I think) -- uninstalled and reinstalled latest release (1.4.3) which is the version on video above.
Thank you & let me know if I can provide any further information!

(The app still works just fine when selecting another option, i.e. Rift Audio, then playing to speakers from there)

actually i figured out what the problem is:
Reading debug logs, it seems that selecting the speakers that I want actually changes to the wrong audio source.

The reason for this is that I have two monitors named the same thing (S2719DGF) as they are the same model. Both of these have a headphone output that I don't use, but they're still listed as output options in Windows sound devices.
Disabling one of these monitor options fixes the issue, and I can now re-select the speakers that I want.

Therefore, I think the real issue is that the UI is pulling from an index of audio devices, and in skipping over the duplicate name entry it doesn't re-map the index that it skipped. Instead, the duplicate-named audio device should still be listed, allowing both to be selected.

When the app starts it uses the audio device name that was saved in the config file, the index in the device list is not used. In the presence of duplicates names that is obviously going to be a problem.
Using an index could be an even bigger problem if Windows rearranges the devices or if the user removes or disables devices.
Perhaps using both in case of duplicates is an option to consider.

Could you check if the new 1.4.4 beta fixes it?

Should be fixed in 1.4.4


root endpoint should have dynamic "routes" instead of hardcoded ones

Right now we hardcode the routes that "we provide", which means everytime we change/add/remove a route, this gets outdated. So we need to make it dynamic... The routes should be pushed on some kind of list and we need to make sure the changes are always reflected on the response..
related with:
https://github.com/oceanprotocol/ocean-node/pull/459

closed on https://github.com/oceanprotocol/ocean-node/pull/492


Verbose mode for pio update

https://stackoverflow.com/questions/67843421/capture-the-output-of-subprocess-run-but-also-print-it-in-real-time


SVG link is invalid

ENGCS can use URL attribute
URL attribute is available in GraphViz
URL attribute is unavailable in QuickGV

Load SVG image by tags  or  can solve this problem.


App Engine Source to Prod Codelab Issues

Page: /guides/tutorials/codelabs/appengine-source-to-prod/
Feedback: The codelab is very helpful in showcasing awesome functionality.  I had 2 issues though.

the step to set hal config version edit --version 0.3.0 caused the hal deploy apply step to not work. I believe I used version 1.0.1 to get it to work. There were other messages that said version 0.3.0 was not supported
I had trouble with the github webhook.  I copy & pasted the network settings and double checked the IP Addresses, but github said it couldn't talk with the server. I'm not sure if it was GCP networking issues, or even where to begin debugging at which step the failure was.

Thanks - I'll update the docs.
With respect to the webhook, it looks like Github added a second source range for the webhook since I wrote the codelab (<IP_ADDRESS>/22 and <IP_ADDRESS>/22, listed here. Try adding both to your firewall rule.
The codelab assumes you're running Halyard on a GCE VM - I would double check that your VM and firewall rule were set up according to the codelab.

Hi @danielpeach - thanks for the follow up. I saw that an added the other range and the webhook still doesn't work.
In fact, I carefully started the tutorial all over again with a brand new GCP project, carefully following each step and am still having the same issue. Here is what my configuration looks like for the VM, Firewall rules, and Github Webhook.
VM Settings

Firewall Rule

Github Webhook

I still get the message from github We couldn’t deliver this payload: Couldn't connect to server

I was able to reproduce this -
Run the following:
echo "host: <IP_ADDRESS>" | tee ~/.hal/default/service-settings/echo.yml
sudo hal deploy apply

@danielpeach oh nice, thank you.. now the webhook is working!
before I ran the command I opened the echo.yml file and it appeared to already have that host: <IP_ADDRESS> in it. I ran your commands anyways and now things are good.
If you're looking to clean up a few other parts of the tutorial, here are just a couple other very minor things I noticed.

The New Application screen looks slightly different than the current screen shot (you don't set an account yet on the first page.
At the Pipeline Creation step, the tooltip isn't New, it is now Create Pipeline or Strategy
At the Webhook Trigger section, to be consistent with other areas, step 1 should be to click Add Trigger

Thanks again for this fantastic codelab!

Great, thanks - I've updated the codelab so that it works properly now.
The screenshots will have to be updated periodically as the UI drifts - I'll be sure to include your suggestions.

I get the following error when i run the following command: Any idea why?
hal config provider appengine account add my-appengine-account --project $GCP-PROJECT-ID

Get current deployment
Success

Add the my-appengine-account account
Failure
Problems in default.provider.appengine.my-appengine-account:
! ERROR Failed to connect to appengine Admin API: 403 Forbidden
{
"code" : 403,
"errors" : [ {
"domain" : "global",
"message" : "Operation not allowed",
"reason" : "forbidden"
} ],
"message" : "Operation not allowed",
"status" : "PERMISSION_DENIED"
}.

Failed to add account my-appengine-account for provider
appengine.

The command you've provided will work only if the application default credentials for the machine that's running Halyard have access to the App Engine Admin API.
I would verify the following:

That Halyard is running on a machine with application default credentials (e.g., on a GCE VM).
That those application default credentials have access to the App Engine Admin API.

If you're still seeing a problem, could you please open a new issue? This seems unrelated to the original issue here.
Thanks.


MP4 files generated with mp4parser wont play in chrome.

Input file download : https://s3-eu-west-1.amazonaws.com/bitbucketireland/Sintel_trailer.mp4
If I remux this file with mp4parser, the resultant output will not play in chrome or totem player. But it does play in other players (ffmpeg, vlc).
Minimial example to reproduce:

        Movie movie = MovieCreator.build("/tmp/Sintel_trailer.mp4");
        Mp4Builder builder = new DefaultMp4Builder();
        Container c = builder.build(movie);
        WritableByteChannel wbc = new FileOutputStream("/tmp/Sintel_trailer_isoparser.mp4").getChannel();
        c.writeContainer(wbc);

The /tmp/Sintel_trailer_isoparser.mp4 wont play in chrome. The first frame of the video gets displayed, the video playback is stuck. The audio still plays in the background.

Version used : 1.9.34
Any ideas in what the issue might be?
Thanks in advance.

Such a nice project but there's no feedback from developers. Did you manage to solve this?

Same issue here, did you find a solution for this? could you do it another way to get it working? @AdithyanI
Thanks!


boards: arm: stm32h750b_dk: add support for display (fixed)

Add support for display on stm32h750b_dk. samples/drivers/display is compiling and flashing correctly now.  Previous PR is here: https://github.com/zephyrproject-rtos/zephyr/pull/67245 but, I can't reopen it.
Contains patch by pcornu, also tested by ajarmouni-st

Hi @toonst can you rebase & incoporate changes directly from my branch https://github.com/ajarmouni-st/zephyr_dev/tree/dev_stm32h750b_dk_display ? Thanks!

I've pushed @ajarmouni-st 's branch here: https://github.com/zephyrproject-rtos/zephyr/pull/73107

Bulk changing the milestone from everything which did not make it to the v3.7.0 freeze deadline
and which is not labeled as a bug or documentation (or does not appear clearly as only containing
a bug fix or a documentation change).
If you disagree about this change please add the milestone again.
Please note that until rc2 only PRs containing bug fixes, docs and tests can be merged.
After that and until release only bug fixes and docs changes.
Exceptions require approval by the release team and a vote by the TSC.
https://docs.zephyrproject.org/latest/project/release_process.html#stabilization-phase

@toonst rebase needed

Closed in favor of https://github.com/zephyrproject-rtos/zephyr/pull/74294.


MINOR: Delete KafkaCSVMetricsReporter

All classes/traits are private and unused.
Committer Checklist (excluded from commit message)

[ ] Verify design and implementation
[ ] Verify test coverage and CI build status
[ ] Verify documentation (including upgrade notes)

unrelated to this PR, but it seems KafkaMetricsReporterMBean has unused method startReporter and stopReporter after this gets merged. Maybe we should deprecate KafkaMetricsReporterMBean (and KafkaMetricsReporter) with new Java interface. WDYT?

Perhaps this is actually a public interface from the days where these things didn't follow a consistent pattern. For example:
https://users.kafka.apache.narkive.com/2b0VBWUX/monitoring-kafka-metrics
So, we probably need a KIP and the removal may have to wait for 4.0.

I will close this for now.


[cbuild-pack.yml] Document cbuild-pack.yml

Document cbuild-pack.yml introduced in PR https://github.com/Open-CMSIS-Pack/devtools/pull/1143
Fixes https://github.com/Open-CMSIS-Pack/devtools/issues/1122
Contributed by STMicroelectronics
Easiest way to read it is by looking at the rendered form https://github.com/slhultgren/cmsis-toolbox/blob/pr/shu-cbuild-pack-documentation/docs/YML-CBuild-Format.md#pack-locking

Updated the PR with a bit more clarification on when the cbuild-pack.yml is used and updated:
Easiest to read is here: https://github.com/slhultgren/cmsis-toolbox/blob/pr/shu-cbuild-pack-documentation/docs/YML-CBuild-Format.md#pack-locking

@slhultgren  thanks a lot for adding detail to the documentation regarding the reading and writing of the cbuild-pack.yml file and which csolution commands are affected, as well as the maintenance of entries.
Could you please confirm that the cbuild-pack.yml does not contain any kind of history information anymore and therefore there is no need for a command for cleaning up.
We are frequently discussing the aspect of "backward compatibility". With the introduction of the cbuild-pack.yml the previous behavior is changed such that after installing an updated pack version used by a csolution which does not fix the pack version, the newly installed pack version will not be used.
My request is to add a command line option for both cbuild and csolution that allows to enable/disable the use of cbuild-pack.yml.
For strict backward compatibility the cbuild-pack.yml would be disabled by default and require
- P --pack-lock-on            Lock pack versions using *.cbuild-pack.yml

We could consider an explicit entry in the csolution.yml file similar to enabling the use of cdefault.yml
solution:
  cdefault:
  cbuild-pack:
  ...

@slhultgren thanks for documenting the feature.
I agree with @jkrech to add a option for enabling this feature.

I believe just one option is enough.  By default the file *.cbuild-pack.yml is written and records all packs including versions that are used by the project files (*.csolution.yml, *.cproject.yml, *.clayer.yml.
Option:
-P, --pack-lock      Use *.cbuild-pack.yml as input to lock software pack usage.
The option --pack-lock reports an error when the file *.cbuild-pack.yml does not exist, or when there are different packs requested by the project files.


scaling and centre of covariate

Video mentions this but would be a good idea to add to the R Markdown text a demo of how to actually do this.

done


Add llvm_asm! and deprecate asm!

Fixes #3

Since nobody has any objection, I'll just go ahead and submit the RFC.


setup in-cluster image registry

The registry pod is setup in rukpak-system namespace in the kind cluster
Self-signed certificate is generated and ca certificates is set to necessary places
The registry can be accessed by docker-registry:$NODE_PORT from the host system and by docker-registry:5000 in the cluster.  The credential for the registry is myuser/mypasswd.  The registrysecret secret is created for the image pull secret.
e2e tests are not updated or added in the PR.
Closes #280
Signed-off-by: akihikokuroda<EMAIL_ADDRESS>

I could remove the host system configuration changes for pushing images into the registry.  The registry is still in the rukpak-system namespace.  There seems some work to move it out to another namespace.  I want to make it in a separate issue.  Thanks!

We can use this to test the private image registry access.  I'm planning to add some e2e tests.

@timflannagan Thanks for review.  The make registry-load-bundles depends on the images are loaded into kind by make kind-load-bundles.  I should have put the dependency in the Make file.  Please run make kind-load-bundles then make registry-load-bundles should work.
I'll create an issue to add the e2e tests with the image registry.

I opened the follow up issue.

One other comment: should the e2e workflow be deploying this in-cluster registry once the kind cluster has been started?

I'm not sure.  I'll add some tests for private image registry access at least.  WDYT?
I'll merge this unless any other concerns.  Thanks!

I think you could just add it to the chain of prerequisite targets in the e2e Makefile target, and the e2e workflow will deploy it?

I guess we're not explicitly checking the healthy of that image registry deployment though, so let's just merge this, and if e2e starts complaining once we update the bundle images, then we have some notion that the deployment may be off.

OK.  I'll add image-registry in the chain of prerequisite targets in the e2e.


fork/exec /path/to/nydus-image: permission denied

when i execute command
sudo /data/nydus-static/nydusify convert --nydus-image /path/to/nydus-image --source hub.site/test/nginx:v1.1 --target hub.site/test/nginx:v1.3
fork/exec /path/to/nydus-image: permission denied

The nydus-image is a binary file, would you make chmod +x /path/to/nydus-image ?

@laowenyi Did chmod +x helps?

No response for over a month.


PEFT checkpointing only trainable weights

I am wondering if there is a way to checkpoint training models e.g. with LoRA. I tried using accelerate.save_state() but that saves the pretrained weights also. Is there a way just to checkpoint after a certain number of iterations. Right now I am pushing to hub after each epoch, how would I change it so that it happens after a certain number of iteration steps?
accelerator = Accelerator(project_dir = project_dir)

model, optimizer, train_dataloader, eval_dataloader = accelerator.prepare(model, optimizer, train_dataloader, eval_dataloader)

accelerator.register_for_checkpointing(lr_scheduler)

device = accelerator.device

model = model.to(device)

    for epoch in range(num_epochs):
        model.train()
        total_loss = 0
        for step, batch in enumerate(tqdm(train_dataloader)):
            batch = {k: v for k, v in batch.items()} # remove '(v).to(device)
            outputs = model(**batch)
            loss = outputs.loss
            total_loss += loss.detach().float()
            accelerator.backward(loss) #loss.backward()
            optimizer.step()
            lr_scheduler.step()
            optimizer.zero_grad()

        model.eval()
        eval_loss = 0
        eval_preds = []
        for step, batch in enumerate(tqdm(eval_dataloader)):
            batch = {k: v for k, v in batch.items()} # remove '(v).to(device)
            with torch.no_grad():
                outputs = model(**batch)
            loss = outputs.loss
            eval_loss += loss.detach().float()
            eval_preds.extend(
                tokenizer.batch_decode(torch.argmax(outputs.logits, -1).detach().cpu().numpy(), skip_special_tokens=True)
            )

        eval_epoch_loss = eval_loss / len(eval_dataloader)
        eval_ppl = torch.exp(eval_epoch_loss)
        train_epoch_loss = total_loss / len(train_dataloader)
        train_ppl = torch.exp(train_epoch_loss)
        print(f"{epoch=}: {train_ppl=} {train_epoch_loss=} {eval_ppl=} {eval_epoch_loss=}")
        # accelerator.save_state(project_dir) <- this saves the entire model instead of just the peft weights
        model_id = f"{dataset_name}_{model_name_or_path}_{method}_{max_length}_{num_epochs}_{sample_size}_{batch_size}_{epoch}_{version_control}".replace("/", "_")
        model.push_to_hub(model_id, use_auth_token=True)

hi @NandaSmith
Thanks for pointing out the issue,
A potential fix should go on accelerate, however we advise users to use the push_to_hub and save_pretrained utility functions. Also make sure to run the saving mechanism only on the main process in case you are doing distributed training
if accelerate.is_main_process:
    model.push_to_hub(xxx, )


Feedback wanted: Extended highlighting

From commit 8f6ba69:

The previous highlighting functionality was very limited - all classes
and interfaces declared in the solution were added as solution-wide
keywords.
Instead, use the roslyn-provided syntax highlighting. This entails
parsing the highlighting information provided by OmniSharp-roslyn (a
json file containing line/column groupings describing syntax fragments),
extracting the interesting parts (class and interfaces), then reading
the relevant spans from the buffer into an array of type name strings.
The result is much more comprehensive highlighting coverage, but at an
efficiency cost.

This commit has been added to new branch type_highlighting, as an experiment based on the issue #428 and the discussion there. I am hoping for some feedback before merging it into master. The new highlighting replaces the previous type highlighting. It could be added as a 2nd highlighting option but I'd prefer to avoid that, I think it would be too confusing.
To test, pull down this the type_highlighting branch. To do this directly from i.e. vim-plug, update the entry in your .vimrc like this:
Plug 'OmniSharp/omnisharp-vim', { 'branch': 'type_highlighting' }

To get basic highlighting, just start OmniSharp as usual, and run :OmniSharpHighlightTypes. This will highlight the current buffer, and begin highlighting new buffers when they are opened.
For better results which are refreshed regularly (at the cost of more server interactions), add this to a ~/.vim/after/ftplugin/cs.vim file:
augroup MyOmniSharpHighlighting
  autocmd!
  " Note the argument 1 indicating that highlighting should be refreshed even
  " for buffers which have already been highlighted.
  " Other/additional possible autocmds are BufWritePost, CursorHold etc.
  autocmd BufEnter *.cs call OmniSharp#EnableTypeHighlightingForBuffer(1)
augroup END

" Optional mapping to manually refresh the buffer:
nnoremap <buffer> <F9> :call OmniSharp#EnableTypeHighlightingForBuffer(1)<CR>

The highlight groups used are csUserType and csUserInterface, and they are linked to Type and Include respectively. To try different colours, you can do things like this, in your ~/.vim/after/ftplugin/cs.vim file:
highlight link csUserType Identifier
highlight csUserInterface ctermfg=12 guifg=Blue

Currently this branch only highlights classes and interfaces. It doesn't highlight methods/properties/variables, although some of these may be added. At this stage it's pretty rough.

Closed by #438


docker_clone_volume.sh misses dot files in root

The cp -a /from/* . command does not pick up dot files (like .bashrc). Eiter cp -a /from/* /from/.* . or using rsync would fix the problem.

Thanks for this!
I just updated the source

For me the fix don't work. I get errors
If i change it to cd /from ; cp -a . /to. it works fine.


Improve runtime

Accept a precomputed dist matrix instead of calculating ourselves
Use numpy operations for faster runtime

Tested on 1000 samples of scipy's half-moons with noise=0.24 and seed=1. Benchmark results on my machine:
master branch: time=128.46s memory=172864 KB
this branch: time=12.08s memory=164668 KB

Haven't noticed #17 before. I didn't compare their changes to mine


More documentation sprint progress

Fix https://github.com/pydantic/pydantic/issues/6606
Add note on performance issues discussed here: https://github.com/pydantic/pydantic/discussions/6388
Fix https://github.com/pydantic/pydantic/issues/8224
Fix https://github.com/pydantic/pydantic/issues/8530

Please review


fix: escape mdx variable ServiceLifetime

the mdx bundler will interpret {ServiceLifetime} as a variable, which is declared or initialised elsewhere.
If you intend to have the string Try{ServiceLifetime} in your docs, put it inside an inline code block.

Thank you @cabljac
I'll review the other files and correct them.

@ezzabuzaid
I have a PR in docs.page which should add functionality for what you had originally - it will check whether the expression is exported earlier in the mdx file. If it isnt then it will handle the expression as a text node. I will let you know if/when this is done.

@ezzabuzaid
just merged, let me know if you run into any issues
https://github.com/invertase/docs.page/pull/37
:)


CSHARP-2373: GridFSForwardOnlyUploadStream not closing properly on .NET Standard 2+ when cast to Stream before calling Close.

Evergreen patch build:
https://evergreen.mongodb.com/version/5bd0e784c9ec440354f0aded

Some background info:
Historically Stream defines both Close and Dispose methods. They are intended to be interchangeable.
But in .NET Standard 1.5 (and other early versions) Microsoft omitted the Close method because they considered it redundant. Only to later change their minds because people complained about the backward breaking change. It was added back in .NET Standard 2.0.
So what's happening here is that the user cast their GridFS stream to the base Stream class and called the base class Close method (which exists for them because they are using .NET Standard 2.0+). We did NOT override Close because for us the Close method does not exist (we are targeting .NET Standard 1.5) so we never saw the call to Close. The Close method that we don't even know about ends up calling Dispose(true) so we have to put a hook in the Dispose(true) method to close the GridFS stream.


Reorg frequency and depth metrics

The blockchain tree is responsible for handling reorgs, specifically between its various sidechains and the canonical chain. Metrics exist for the number of sidechains already, but it would be useful to see how often reorgs occur, and how large these reorgs are, so these should be tracked in a blockchain tree metric.
The current blockchain tree metrics are defined here:
https://github.com/paradigmxyz/reth/blob/01e1344cc1175b7c7110498db6e5319329b62472/crates/blockchain-tree/src/metrics.rs#L6-L14
And mainly updated here:
https://github.com/paradigmxyz/reth/blob/01e1344cc1175b7c7110498db6e5319329b62472/crates/blockchain-tree/src/blockchain_tree.rs#L1096-L1109

@int88 awesome, assigned!

Completed in #3824 #3860


Update acquisition function scaling for constrained optimization

This makes the acqusition function equivalent to the unconstrained case if the GP is certain that the constraint is fulfilled.
NB: Should we add a note somewhere that constrained optimization is best used with the EI acquisition function?

Codecov Report
Patch coverage: 100.00% and no project coverage change.

Comparison is base (33b99ec) 98.57% compared to head (ff087a0) 98.57%.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
Additional details and impacted files
@@           Coverage Diff           @@
##           master     #413   +/-   ##
=======================================
  Coverage   98.57%   98.57%
=======================================
  Files           8        8
  Lines         560      560
  Branches       79       79
=======================================
  Hits          552      552
  Misses          4        4
  Partials        4        4

Impacted Files
Coverage Δ

bayes_opt/util.py
97.84% <100.00%> (ø)

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.

Hi @till-m , I don't 100% understand this but all checks are passing and it seems like you do, so from this perspective I'm happy to approve :-) you can merge this yourself now right?

Hi @till-m , I don't 100% understand this but all checks are passing and it seems like you do, so from this perspective I'm happy to approve :-) you can merge this yourself now right?

Fair point, I'll just outline my thinking for the record:
Gardner derived constrained optimization while using EI, which is non-negative. However, if an acquisition function is used that is not non-negative we cannot just scale by probability (this would make negative acq-value points more attractive if the model is sure of the constraint not being fulfilled!). Because of that, I thought up some sort of scaling law for negative values of the acquisition function when I made the original PR. The idea here was to have the same properties that of the positive case:

Make exploring values more attractive if the model is rather sure of the constraint being fulfilled.
Make exploring values less attractive if the model is rather sure of the constraint not being fulfilled.

However, the original formulation by Gardner has a third nice property, which is leaving the objective unchanged (compared to the unconstrained optimization) if the model is sure of the constraint being fulfilled. This probably makes little difference in practice, but I felt it would maybe be nice to have this property in the negative case as well, thus the small change in rescaling.


No handler accepted "/"

I'm trying to make ekg accessible out in the open on a server using
forkServer anIpAddress aPort

when visiting that ip address on that port I get No handler accepted "/". Is this expected? If so, how do I use ekg remotely?

Here's my story while running into this problem:
I'm using Stack to build a web app (including ekg) that I'm deploying inside a Docker container. In particular, I'm installing my app in a fresh container with no explicit Haskell dependencies (we'll see how that goes!). JSON API calls to EKG worked but HTML did not.
The problem was indeed that the directory of assets didn't exist in the runtime container, and ekg could not find it. This directory contains the files needed to provide the HTML interface, and Snap apparently raises this error when a file it's trying to serve can't be found (see https://github.com/snapframework/snap/issues/102 ).
The problem Sean mentions in https://github.com/tibbe/ekg/issues/48 bit me hard, since if his path to the assets directory was weird, mine using Stack/Docker is really weird. I don't know an easy way to magic these files into my Docker installation, so I cheated: I'm pinning EKG for now and copying the assets/ directory into my project.
One final note: You'll see that ekg appends </> assets to your data path, so make sure you're not setting your data directory to the assets directory itself! I installed my stuff in /app/ekg-<IP_ADDRESS>/assets, and set ENV ekg_datadir=/app/ekg-<IP_ADDRESS>. That was what did the trick.

I just hit the same problem with stack and a docker-enabled project

It might be better to use fileEmbed so that directories don't need to be found.

In case anyone is looking for a solution. I have this script for building the image:
	docker pull
	stack build
	find ~/.stack -name "assets" -exec cp -a {} shared_folder \;
	stack image container --build

This works with the following stack.yaml configuration:
docker:
    enable: true
    repo: "fpco/stack-build"
    auto-pull: true
image:
  container:
    name: image-name
    base: fpco/stack-run
    add:
        shared_folder: /build_stuff

And when executed with this ENV var:
ekg_datadir=/build_stuff


Getting Banned

So after my 2nd ban I just ran the bot here and there for 5 minutes at a time, to let to collect and do it's basic things.  Well today I left it on by mistake for about 8 hours.  Well when I logged in it said banned 7 days, well that sucks.  So my question is how are they picking it up, and what can be done to slow down the bot to make it so they do not, I was thinking that if it would only preform actions every hour and when everything is done it sleeps tell the next hour.  This would allow for one out building and productions and ever 4 hours it  would reset the goods building and spend FP on the tech tree / GB of your choice (how do you set that???)
Can this be done or do you have any other ideas.

So I've been ruining it only a few minutes at a time 2 time a day and now I got the AX

i'm using few month on secundary account. No ban no problem

I asked really nice and they un-banned me, what verson of the bot are you using?

https://github.com/mgierw/auto-foe

same one i'm using and got banned, good luck to you


Mari backend

file conflict, wont merge until backend errors have been fixed. Do not merge or pull yet


Dice roll

Added a dice roll feature.
The files are src/dice.py and tests/test_dice.py

Looks good to me! Nice work!

Thanks, not too sure why the tests are failing

It is because @swapagarwal hasn't trained wit.ai for your tests.

Thanks @UshalNaidoo! 👍


[ScrollSpyContainer] Ignore popin Panels for the menu.

(0.7.1)
The ScrollSpyContainer scans for all the panels inside its children to build the left menu.
I have a Popin inside a Panel that has another Panel inside it. So what happens when I open the Popin is that its Panel gets added in the menu, and it shouldn't.
I think it would be hard to detect automatically which Panels to add and which Panels not to add, so I suggest we find a way to do it manually (a prop ?)

+1

+1

It is not as easy as this.
A popin content could be an existing page.
It shoud be a selector which excludes the  popin.

@Tommass

Yes, but you manually add the content to the popin, so you could give it a prop in that case that excludes it from the selector.


fix(Project): Set last 7 days of records as default time range

This PR sets the last 7 days in which records were recorded as the default time range as discussed with @dnsos and @edgalindo. This ensures that, as long as a sensor recorded some data, this data will be shown and an empty chart is avoided.

Much better experience browsing through the projects/devices now.

Thx for the quick review! 🙏

:tada: This PR is included in version 1.0.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Initial OpenSearch integration

Signed-off-by: Andriy Redko<EMAIL_ADDRESS>Description
Taking into account how widely popular Spring Data Elasticsearch is, it is highly likely that community would seek the first class support of the OpenSearch integration. In scope of this issue and multiple discussions with Spring Data Elasticsearch team (@sothawo), the decision has been made to host the integration on OpenSearch side as a standalone project based on Spring Data Elasticsearch 5.0, under spring-data-opensearch repository.
TODOs:

[x] Add Github actions
[x] Update license headers
[x] Add documentation
[x] Add spotless checks

Issues Resolved
Closes https://github.com/opensearch-project/opensearch-clients/issues/28
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@sothawo would appreciate your review please (we finally got a repo), it retargets https://github.com/spring-projects/spring-data-elasticsearch/pull/2203 to spring-data-opensearch, as we have discussed, thank you.

Great to see that this is set up now. @reta: nice work.
I just tried this, building a local version with mvn install  and then setting up a Spring Boot 3.0.0.M5 application where I manually added the dependency for opensearch. One thing I needed to do:  I needed to disable the Spring Boot autoconfiguration for Spring Data Elasticsearch as this fails because you have excluded the Elasticsearch dependencies:
@SpringBootApplication(exclude = {ElasticsearchDataAutoConfiguration.class})
public class OpensearchDemoApplication {

	public static void main(String[] args) {
		SpringApplication.run(OpensearchDemoApplication.class, args);
	}

}

You might want to add this to the docs.

@dblock @rursprung @sothawo thanks a lot guys for the review, my apologies, was off yesterday but will work through the comments today :bow:

@sothawo Thanks! Want to help out and update README?

@dblock thanks for the invite. But I'm busy enough keeping Spring Data Elasticsearch up to date.


Token authentication

Hi Noam. Great work on the Sorcery gem.  Is token authentication something that would find it's way into Sorcery on day?

Is token authentication planned for 1.x release?

Seems that we should use some custom implementation of tokens :)

hi excelent work. Thanks
I was wondering, if was implemented this feature ?

@arjayx the gem is transitioning to new maintainers, is this a useful feature for? If a few folks weigh in, it will make it onto the 1.0 roadmap. @Mehonoshin, @volisoft, and @FUT, are you all still using Sorcery?

@Ch4s3 yep, still using

@Mehonoshin would JWT/ruby-jwt integration work for you?

@Ch4s3 I'm no longer using Sorcery

@Ch4s3 we've implemented some workaround, but anyway jwt looks good for token authentication

@volisoft, if you don't mind me asking, what are you using now and what features does it provide that sorcery does not? Thanks @Mehonoshin.

@Ch4s3 I wondered about feature Token for restfull api and be able to implement sorcery in projects that could have mobile clients

@arjayx interesting, let me look into how people do that

@Ch4s3 Is there any plan to support this feature? Thanks.

I think its on the 1.0 agenda.


call a function when input box is clicked

I added ng-focus="clearModel()" inside ui-select but it didn't call it. I moved it to ui-select-match which you see below, it still didn't call clearModel() function. What am I doing wrong? I'm doing it this way because i have different dropdowns that are related to each other.
        <ui-select ng-model="model.selected" ng-disabled="disabled">
          <ui-select-match ng-focus="clearModel()" placeholder="enter name...">{{$select.selected.name}}</ui-select-match>
          <ui-select-choices repeat="model in displayedCollection | propsFilter: {name: $select.search}">

          </ui-select-choices>
        </ui-select>

Is the uis-open-close the solution to this?  Available in 0.19.0 https://github.com/angular-ui/ui-select/wiki/uis-open-close

I'm closing this for now. I've forgotten how I got it to work.