Upgrade kind to 0.5.1

What type of PR is this?
/component kudoctl
/kind test
What this PR does / why we need it:
Upgrades the kind version used by kudo test to 0.5.1. This includes improved image loading capabilities and fixes to the base images.
Special notes for your reviewer:
Does this PR introduce a user-facing change?:

kudo test uses kind version 0.5.1.

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: jbarrick-mesosphere
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS [jbarrick-mesosphere]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@jbarrick-mesosphere: The following test failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

test
03a38f0cc1963271896061cc4d237c6e4b34be15
link
/test test

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: alenkacz, jbarrick-mesosphere
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS [alenkacz,jbarrick-mesosphere]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment


MONDO:0018965 Alport syndrome MONDO:0005334 hereditary nephritis both ExactMatch  MeSH:D009394

http://purl.obolibrary.org/obo/MONDO_0018965 Alport syndrome
http://purl.obolibrary.org/obo/MONDO_0005334 hereditary nephritis
both have exactMatch
http://identifiers.org/mesh/D009394  Nephritis, Hereditary
Hereditary Nephritis seems to describe a group of conditions of which Alport Syndrome is the most common, but there does not seem to have any parent/child relationship between the MeSH term and Alport syndrome?

this is fixed now :)


fix: missing import functions

What this PR does:
Which issue(s) this PR fixes:

Fixes #
Special notes for your reviewer:
Does this PR introduce a user-facing change?:

Codecov Report
Base: 36.59% // Head: 36.59% // Increases project coverage by +0.00% :tada:

Coverage data is based on head (0f22dc7) compared to base (0d0d7ab).
Patch has no changes to coverable lines.

Additional details and impacted files
@@           Coverage Diff           @@
##           master     #530   +/-   ##
=======================================
  Coverage   36.59%   36.59%
=======================================
  Files         165      165
  Lines       21675    21675
=======================================
+ Hits         7931     7933    +2
+ Misses      12877    12874    -3
- Partials      867      868    +1

Impacted Files
Coverage Δ

pkg/runtime/runtime.go
2.14% <ø> (ø)

pkg/schema/loader.go
6.74% <0.00%> (+1.12%)
:arrow_up:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


🏃 Bump the Golang version to 1.16

What this PR does / why we need it:
Bump the Golang version to 1.16

/hold until metal3-io/project-infra#172 gets merged
/test-integration

/hold cancel
since metal3-io/project-infra#172 is merged now.

/test-integration

/test-integration

/cc @furkatgofurov7

Seems you are missing some more places that need to be updated, see below:
* https://github.com/metal3-io/ip-address-manager/blob/master/Makefile#L322

* https://github.com/metal3-io/ip-address-manager/blob/master/hack/ensure-go.sh#L34

* https://github.com/metal3-io/ip-address-manager/blob/master/hack/tools/go.mod#L3

@furkatgofurov7 thanks. Fixed.

/test-integration

/cc @kashifest

/test-integration


Don't run ready function if session has been terminated

Problem:
If session has been terminated during setTimeout for ready function that function will throw an exception NoSuchMethodError: The setter 'onIceCandidate=' was called on null.. That happens because by that time _connection is null and we try to access onIceCandidate on it. The issue itself doesn't cause any problems besides an uncaught error.
How to reproduce the issue:

make a phone call to an app using dart-sip-ua
accept the call
hang up the call on the caller side in the first 3 seconds after the call has been accepted

Fix description
I've just added a check inside ready function to check if session has been terminated. May be a better fix would be to store ready function on rtc_session and clear timer during session close(). What do you think?

Hey, have you executed dart format rtc_session.dart? It looks like the code block has changed.


[Feature Request] Integrate Tesla_API_Lite project to obtain Auth Token locally

Is your feature request related to a problem? Please describe.
Using 3 party (untrusted) apps to obtain auth tokens, not knowing if they are being stored by the app remotely etc.
Describe the solution you'd like
There is a nice GitHub project which processes the Authentication locally on the users machine, it would be nice if this can be somehow added to the Tesla HA integration so it takes you through the onboarding process locally.
Process could be something like this ->

User installs the Tesla HACS integration
Click here to obtain refresh token OR Already have token
if Obtain refresh token print out the URL to paste into browser
User performs authentication against Tesla login screen - receives Page not found copies the address
Pastes the address into the setup window on home assistant, this then takes the refresh token as the variable and passes it through to the rest of the setup where user inputs email etc to finish.

Describe alternatives you've considered
Using 3rd party apps is the only way a normal user can obtain Auth token, this can possibly be risky giving someone a "key" to your vehicle.
Additional context
Tesla_API_Lite project is here
https://github.com/Marky0/tesla_api_lite/tree/main
get_token.py is all that's needed (without storing a local JSON file)

This I won't do. We used to do it locally but Tesla kept breaking it. There are open source apps that will grab the tokens. You can trust them as much as you can trust this open source component or the one you linked.


Upper light some times blink when installed mod

Upper cabin light FO sometimes blink (when it off of course) after installed mod.

Sorry, I didn't understand. Could you send me a screenshot or video to show what's going on?

This lamp sometimes blink one/two times. May be it's not mod problem. Removed mod, installed again. Now didnt see this issue.

Didnt see anymore


Regression tests for comparers

This is a set of regression tests for #513. It's is branched from the point just before modifications in that pull requests began.
Possibly this is a bit of overkill, but I suppose that is the point of regression tests. This will be merged into #513, but is here to obviously prove that it was OK prior to the changes.
The data is mainly generated by running the CreateComparersRegression.fsx and pasting the results over the top of the bottom part of the ComparersRegression.fs file (I suppose it could have been a seperate file... Maybe that would have been better; but I'm hoping there really isn't much need to run it multiple times)

Hi @manofstick, I'm your friendly neighborhood Microsoft Pull Request Bot (You can call me MSBOT). Thanks for your contribution!
You've already signed the contribution license agreement. Thanks!
The agreement was validated by Microsoft and real humans are currently evaluating your PR.
TTYL, MSBOT;

@latkin,
Argh, the compiler is inlining these (obviously) and so no really achieving what I want. I will have to regenerate. Soon, soon....

+47,167  -0

This is actually right in line with what I think we need - a near-exhaustive set of regression tests that really nail down how things work.
Looking at the CI build, this doesn't appear to have too drastic of an effect on compilation or execution time, which I was a bit worried about.

OK; hopefully this is a better test suite.
I have now ensured that there are both the potential for the compiler to do inlining optimizations as well as not. This has meant that the number of tests has doubled.
But, I have shrunk the format a little (limiting spaces, using 0,1 for false and true) and so the actual file is a little smaller than it was before.

I'm feeling too lazy at the moment (and it's not really in scope of what I'm trying to achieve), but slight modifications to this suite could be used to pick up any inconsistencies between compiler optimizations and not, as well as between direct versions and wrapped versions, embedded in other types, etc...
i.e. for #576, #527 & #556
(on another note, when those items are fixed, then obviously this regression suite would need to be updated)

I'd like to merge this separately, and before, #513.  That way it's unambiguous that behavior remains  unchanged before/after 513 is applied.

@latkin
I agree, that was why I created this pull request :-)
(wow, it's almost like we're talking in real time!)

Ah ok, "this will be merged into 513" made me think you planned to keep them together.

No, I just merged it in so that I could make sure it worked before and after.

(like it has been merged in, but I still expected the regression tests to run in a unmolested state...)
Hmmm.. that make sense?


timeout when simultanious redeeming

I found that if two or more clients (servers) are trying to redeem invite at the same time, one of them is getting timeout. The 'simultaneous' is much simpler to reproduce than it sound, because playbooks in Ansible normally does stuff in parallel on all servers in a group.
Here is a simple playbook to configure servers (not the innernet server, other servers):
- hosts: innernet
  tasks:
    - name: Create invite for the server
      delegate_to: '{{ innernet_auth_server }}'
      become: true
      command:
        innernet add-peer
        --name '{{ inventory_hostname }}'
        --ip '{{ innernet_ip }}'
        --cidr '{{ innernet_servers_cidr_name }}'
        --invite-expires {{ innernet_server_invite_expiration_time }}
        --save-config '{{ innernet_invite_path }}'
        --admin false
        --yes
        '{{ innernet_network_name }}'
      register: res
      changed_when: res.rc==0

    - name: Fetch invite
      become: true
      delegate_to: '{{ innernet_auth_server }}'
      shell: |
        cat '{{ innernet_invite_path }}'
        rm '{{ innernet_invite_path }}'
      register: invite
      changed_when: invite.rc==0

    - name: Save invite
      become: true
      copy:
        content: '{{ invite.stdout }}'
        dest: '{{ innernet_invite_path }}'
        owner: root
        group: root
        mode: '0600'

    - name: Accept invite
      become: true
      command:
        innernet
          install
          --default-name
          --delete-invite
          '{{ innernet_invite_path }}'
      register: res
      changed_when: res.rc==0

    - name: Activate systemd unit
      become: true
      systemd:
        name: innernet@{{ innernet_network_name }}

'Accept invite' task succeed for the first host and fails for all others. Adding throttle: 1 or retries helps.

Interestingly, I added a quick section in the docker tests that spins up two peers redeeming invitations at about the same time, and it didn't error out. Will have to dig more into this. Thanks for reporting, and I'm sorry I've been away for so long!

I got permission from a company I work for to opensource our innernet playbooks/roles, which I'll do shortly. For testing I use libvirt vms, and when ansible do redeeming, it does so in parallel, and it's pretty reproducible. I'm afraid, GH Actions does not allow to use nested virtualization, so to run it one would need a normal linux machine.

@amarao that would be great, thanks! I started working on dropping the docker tests in favor of just using netns on linux directly, using https://git.zx2c4.com/wireguard-linux/tree/tools/testing/selftests/wireguard/netns.sh as the base, but if the ansible playbooks are more readable that could be another possible way to do "integration" testing.

Hey @amarao have you published your ansible playbooks on gh/galaxy?
i am working on:

https://ansible.build/roles/innernet-client/
https://ansible.build/roles/innernet-server/

The roles are not as good as they should be.

I'm working on open sourcing, it's a bit harder than I expected (mostly to rip off internal stuff and make it self-sustaining). My plan is to publish playbooks, not roles, as I don't believe roles can work there (there is too much delegation and cross-host orchestration for role). Insofar I got molecule working. I think it would take couple of days (.. evenings).

Finally, I got everything streamlined and permitted for publishing.
My playbook is here: https://github.com/lidofinance/innernet-playbooks
It's full of 'retries', 'throttle: 1', etc; nevertheless there is 30-50% chance than one of the nodes fails to redeem invite.
Each of those hacks is issue with automation.

Does the server use async, and if so, is it using the multi-threaded runner or just the default single threaded one? Another place to look is SQLITE ( I think innernet uses this for assigned ip storage ) and that is single threaded. But it shouldn't block long enough to back up.

@DanielJoyce yep, it uses async.


Cells ran should change as headers are added and removed

Testing #235049

I believe this could be related to https://github.com/microsoft/vscode/issues/235083
Open an MD file with a cell (A) that has a header
Click on Run cells in section on cell (A) - code cells below it are ran
Choose the next MD cell (B) below cell (A) and add a header there (make sure it previously didn't have one)
Click on Run cells in section on cell (A) - all the same code cells below it as before are ran
I would expect only the code cells between cell (A) and (B) to be ran
It seems as though maybe the cell content changes are not taken into account in deciding what cells to currently run in the section 🐛

https://github.com/user-attachments/assets/f0939cf0-8e78-4ae6-80b7-9cf1fb589ace

I think it shares the same root cause as https://github.com/microsoft/vscode/issues/235083#issuecomment-2515448915.
@Yoyokrazy maybe if the markdown cell is in editing mode, and users trigger Run in Section, we always compute the folding/toc before running the section. I'll put this in Nov milestone first, we can postpone if the change is big.


Yield nose tests functions so run separately

Quick update for convenience, yielding tests from nose apparently runs them as separate tests while still letting us keep it in one function. This way, we get a little more insight into which ones specifically are failing.

lgtm


Re-open Add UI role

https://github.com/geekan/MetaGPT/pull/248
add unit tests for resp_parse.py. All the unit tests are generated by MetaGPT!

LGTM


Feat/275 featured communites revisited

Resolves #275
Preview
Acceptance Criteria:

[x] An "Admin" link is visible in the header navigation, visible and accessible only to DevHub admins (not community admins!)
[x] When a DevHub admin clicks the Admin button, they see a settings page with section for configuring the featured communities
[x] Within the settings section, DevHub admins can edit communities to display on the homepage. The interface for this can be super simple ... just need to solve the goal.
[x] The UI show a maximum of 5 featured communities, to support the current display limit
Once the admin clicks save, the changes are instantly reflected on the homepage
[x] The admin UI should prevent the user from accidentally showing fewer than 4 communities.

@ailisp I closed #275 ticket to combine it with issue #315 them both in PR #388. Didn't realise I forgot to close this PR.

I will close this PR now in favor of #388

@Tguntenaar Sorry I didn't see the latest discussion on issue. Don't worry about this:

How should I manage communication moving forward? I can share updates on both the pull request and the issue; of course, it could become overly spammy that way.

Let's close issue and PRs as soon as it's not relevant, if sometimes it's not closed in time, it's also not a big problem, some outdated message will be like this one, just like peers in a distributed system :D


Codeium Auth fails ("version of Vim is unsupported")

I've tried authorizing Codeium on the latest versions of vim provided by nix (9.0.135) and the AUR on arch linux (9.0.1628), but I keep getting:
This version of Vim is unsupported. Install Vim 9.0.0185 or greater to use Codeium.
I believe it's failing this condition:
let s:vim_virt_text_support = has('patch-9.0.0185') && has('textprop')
More specifically, has('patch-9.0.0185') is returning 0.

Not sure why the Arch Linux version is failing (I guess the nix version seems to low). I'm seeing 9.0.1441 as the latest on nix though, could you give that a try?

Thank you for pointing me in the right direction.  I've tried loads of things but I cannot get anything higher than vim 9.0.135 to install from the latest nix channel (yes I updated the channel and garbage collected, etc).  However if I add the unstable nix channel, then I can get vim 9.0.1562, which works.


issue with client using http/1.0

Hello team.
I new in this world. Im using Membrane Service Proxy 4.8.0 for testing.
I need balance soap services throught membrane service proxy, the criteria to each service proxy will be FQDN. I use wsdlRewriter to change SOAP Address Location accorde to https://www.membrane-soa.org/service-proxy-doc/current/url-rewriting-wsdl.htm
My issue is:
With clients that use HTTP/1.1 and up communication is successfull (clients .NET, SOAPUI, etc) but when I try with a AXIS/1.4 client (from Sybase database) using HTTP1.0 the communication failed.
I tested with SOAPUI changing the HTTP version to 1.0, the result is failed.
Can you help me to understand the problem or a solution to issue? When I test the service without membrane service proxy works fine.
Environment
<---Client--->                 <---Membrane Service Proxy--->                        <---Backend's SOAP Services--->
.NET
SOAPUI			devAccountServices.invexgf.com (<IP_ADDRESS>)                 <IP_ADDRESS> and <IP_ADDRESS>
AXIS/1.4
This is my current configuration.
            <serviceProxy name="devAccountServices" host="devAccountServices.invexgf.com" port="80">
                    <request>
                            <log level="DEBUG"/>
                    </request>
                    <balancer name="devAccountServices-Balancer">
                            <clusters>
                                    <cluster name="devAccountServices-BL">
                                            <node host="<IP_ADDRESS>" port="10091" />
					<node host="<IP_ADDRESS>" port="10091" />
                                    </cluster>
                            </clusters>
                            <nodeOnlineChecker/>
                    </balancer>
                    <wsdlRewriter />
                    <response>
                            <log level="DEBUG"/>
                    </response>
                    <target host="devAccountServices.invexgf.com"/>
            </serviceProxy>

####This is the output from AXIS/1.4 client (DB Sybase)
16:36:52,570 DEBUG HttpEndpointListener:146 - Accepted connection from /<IP_ADDRESS>:63255
16:36:52,571 DEBUG HttpServerHandler:77 - New ServerThread created. 477
16:36:52,572 DEBUG Request:140 - createBody
16:36:52,572 DEBUG Message:169 - createBody
16:36:52,572 DEBUG InterceptorFlowController:104 - Invoking request handler: Rule Matching Interceptor on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:36:52,573 DEBUG RuleManager:220 - Host from rule: devAccountServices.invexgf.com;   Host from parameter rule key: DEVAccountServices.invexgf.com
16:36:52,573 DEBUG ServiceProxyKey:194 - Rule host: devAccountServices.invexgf.com;  Request host: DEVAccountServices.invexgf.com
16:36:52,573 DEBUG RuleMatchingInterceptor:95 - Matching Rule found for RuleKey DEVAccountServices.invexgf.com POST /Services/AccountServices/Endpoint 80 <IP_ADDRESS>
16:36:52,574 DEBUG InterceptorFlowController:104 - Invoking request handler:   Store Interceptor on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:36:52,574 DEBUG InterceptorFlowController:104 - Invoking request handler: Dispatching Interceptor on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:36:52,574 DEBUG DispatchingInterceptor:78 - destination: http://devAccountServices.invexgf.com:80/Services/AccountServices/Endpoint
16:36:52,575 DEBUG InterceptorFlowController:104 - Invoking request handler: Reverse Proxy on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:36:52,575 DEBUG InterceptorFlowController:104 - Invoking request handler: User Feature on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:36:52,575 DEBUG InterceptorFlowController:104 - Invoking request handler: Request Interceptor on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:36:52,575 DEBUG RequestInterceptor:51 - Invoking request handler: Log on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:36:52,576 DEBUG LogInterceptor:124 - ==== Request ===
16:36:52,576 DEBUG LogInterceptor:124 - POST /Services/AccountServices/Endpoint HTTP/1.0

16:36:52,576 DEBUG LogInterceptor:124 - Headers:
16:36:52,576 DEBUG LogInterceptor:124 - Content-Type: text/xml; charset=utf-8
Accept: application/soap+xml, application/dime, multipart/related, text/*
User-Agent: Axis/1.4
Host: DEVAccountServices.invexgf.com
Cache-Control: no-cache
Pragma: no-cache
SOAPAction: "/Services/AccountServices/AccountBalanceInquiry"
Content-Length: 1970
X-Forwarded-For: <IP_ADDRESS>
X-Forwarded-Proto: http
X-Forwarded-Host: DEVAccountServices.invexgf.com

16:36:52,577 DEBUG LogInterceptor:124 - ================
16:36:52,577 DEBUG InterceptorFlowController:104 - Invoking request handler: Balancer on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:36:52,577 DEBUG LoadBalancingInterceptor:154 - no session id found.
16:36:52,579 DEBUG InterceptorFlowController:104 - Invoking request handler: com.predic8.membrane.core.interceptor.flow.ResponseInterceptor on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:36:52,579 DEBUG InterceptorFlowController:104 - Invoking request handler: HTTPClient on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:36:52,580 DEBUG HttpClient:194 - try # 0 to http://<IP_ADDRESS>:10091/Services/AccountServices/Endpoint
16:36:52,580 DEBUG ConnectionManager:145 - connection requested for <IP_ADDRESS>:10091
16:36:52,580 DEBUG ConnectionManager:147 - Number of connections in pool: 1
16:36:52,581 DEBUG Connection:111 - Opened connection on localPort: 56356
16:36:52,590 DEBUG InterceptorFlowController:145 - Invoking abortion handler: com.predic8.membrane.core.interceptor.flow.ResponseInterceptor on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:36:52,590 DEBUG InterceptorFlowController:145 - Invoking abortion handler: Log on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:36:52,591 DEBUG InterceptorFlowController:145 - Invoking abortion handler: WSDL Rewriting Interceptor on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:36:52,591 DEBUG InterceptorFlowController:145 - Invoking abortion handler: Balancer on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:36:52,592  INFO NodeOnlineChecker:172 - Node down: http://<IP_ADDRESS>:10091/Services/AccountServices/Endpoint
16:36:52,592 DEBUG InterceptorFlowController:145 - Invoking abortion handler: Reverse Proxy on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:36:52,592 DEBUG InterceptorFlowController:145 - Invoking abortion handler:   Store Interceptor on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:36:52,593 DEBUG HttpServerHandler:160 - No response received. Maybe increase the keep-alive timeout on the server.

###Testing with SOAPUI and HTTP/1.1 (success)
16:48:53,118 DEBUG HttpEndpointListener:146 - Accepted connection from /<IP_ADDRESS>:59783
16:48:53,119 DEBUG HttpServerHandler:77 - New ServerThread created. 479
16:48:53,141 DEBUG Request:140 - createBody
16:48:53,141 DEBUG Message:169 - createBody
16:48:53,141 DEBUG InterceptorFlowController:104 - Invoking request handler: Rule Matching Interceptor on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:48:53,142 DEBUG RuleManager:220 - Host from rule: devAccountServices.invexgf.com;   Host from parameter rule key: devAccountServices.invexgf.com
16:48:53,142 DEBUG ServiceProxyKey:194 - Rule host: devAccountServices.invexgf.com;  Request host: devAccountServices.invexgf.com
16:48:53,142 DEBUG RuleMatchingInterceptor:95 - Matching Rule found for RuleKey devAccountServices.invexgf.com POST /Services/AccountServices/Endpoint 80 <IP_ADDRESS>
16:48:53,143 DEBUG InterceptorFlowController:104 - Invoking request handler:   Store Interceptor on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:48:53,143 DEBUG InterceptorFlowController:104 - Invoking request handler: Dispatching Interceptor on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:48:53,143 DEBUG DispatchingInterceptor:78 - destination: http://devAccountServices.invexgf.com:80/Services/AccountServices/Endpoint
16:48:53,144 DEBUG InterceptorFlowController:104 - Invoking request handler: Reverse Proxy on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:48:53,144 DEBUG InterceptorFlowController:104 - Invoking request handler: User Feature on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:48:53,144 DEBUG InterceptorFlowController:104 - Invoking request handler: Request Interceptor on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:48:53,145 DEBUG RequestInterceptor:51 - Invoking request handler: Log on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:48:53,145 DEBUG LogInterceptor:124 - ==== Request ===
16:48:53,145 DEBUG LogInterceptor:124 - POST /Services/AccountServices/Endpoint HTTP/1.1

16:48:53,145 DEBUG LogInterceptor:124 - Headers:
16:48:53,146 DEBUG LogInterceptor:124 - Accept-Encoding: gzip,deflate
Content-Type: text/xml;charset=UTF-8
SOAPAction: "/Services/AccountServices/AccountBalanceInquiry"
Content-Length: 1491
Host: devAccountServices.invexgf.com
Connection: Keep-Alive
User-Agent: Apache-HttpClient/4.1.1 (java 1.5)
X-Forwarded-For: <IP_ADDRESS>
X-Forwarded-Proto: http
X-Forwarded-Host: devAccountServices.invexgf.com

16:48:53,146 DEBUG LogInterceptor:124 - ================
16:48:53,146 DEBUG InterceptorFlowController:104 - Invoking request handler: Balancer on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:48:53,147 DEBUG LoadBalancingInterceptor:154 - no session id found.
16:48:53,147 DEBUG InterceptorFlowController:104 - Invoking request handler: com.predic8.membrane.core.interceptor.flow.ResponseInterceptor on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:48:53,147 DEBUG InterceptorFlowController:104 - Invoking request handler: HTTPClient on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:48:53,148 DEBUG HttpClient:194 - try # 0 to http://<IP_ADDRESS>:10091/Services/AccountServices/Endpoint
16:48:53,148 DEBUG ConnectionManager:145 - connection requested for <IP_ADDRESS>:10091
16:48:53,148 DEBUG ConnectionManager:147 - Number of connections in pool: 2
16:48:53,149 DEBUG Connection:111 - Opened connection on localPort: 56364
16:48:55,320 DEBUG Message:169 - createBody
16:48:55,321 DEBUG InterceptorFlowController:126 - Invoking response handler: com.predic8.membrane.core.interceptor.flow.ResponseInterceptor on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:48:55,321 DEBUG InterceptorFlowController:126 - Invoking response handler: Log on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:48:55,321 DEBUG LogInterceptor:124 - ==== Response ===
16:48:55,322 DEBUG LogInterceptor:124 - HTTP/1.1 200 OK

16:48:55,322 DEBUG LogInterceptor:124 - Headers:
16:48:55,322 DEBUG LogInterceptor:124 - Server: Apache/HttpComponents1.1
content-type: text/xml; charset="utf-8"
Date: Wed, 23 Jun 2021 21:48:55 GMT
Content-Length: 1800
Connection: Keep-Alive

16:48:55,322 DEBUG LogInterceptor:124 - ================
16:48:55,323 DEBUG InterceptorFlowController:126 - Invoking response handler: WSDL Rewriting Interceptor on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:48:55,323 DEBUG RelocatingInterceptor:45 - WSDL Rewriting Interceptor HTTP method wasn't GET: No relocating done!
16:48:55,323 DEBUG InterceptorFlowController:126 - Invoking response handler: Balancer on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:48:55,324 DEBUG InterceptorFlowController:126 - Invoking response handler: Reverse Proxy on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:48:55,324 DEBUG InterceptorFlowController:126 - Invoking response handler:   Store Interceptor on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:48:55,325 DEBUG HttpServerHandler:239 - exchange set completed
16:49:02,853 DEBUG Connection:139 - Closing HTTP connection LocalPort: 56364
16:49:02,854 DEBUG ConnectionManager:246 - closed 1 connections

####Testing with SOAPUI and HTTP/1.0 (fail)
16:52:33,512 DEBUG HttpEndpointListener:146 - Accepted connection from /<IP_ADDRESS>:57852
16:52:33,512 DEBUG HttpServerHandler:77 - New ServerThread created. 480
16:52:33,514 DEBUG Request:140 - createBody
16:52:33,514 DEBUG Message:169 - createBody
16:52:33,514 DEBUG InterceptorFlowController:104 - Invoking request handler: Rule Matching Interceptor on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:52:33,515 DEBUG RuleManager:220 - Host from rule: devAccountServices.invexgf.com;   Host from parameter rule key: devAccountServices.invexgf.com
16:52:33,515 DEBUG ServiceProxyKey:194 - Rule host: devAccountServices.invexgf.com;  Request host: devAccountServices.invexgf.com
16:52:33,515 DEBUG RuleMatchingInterceptor:95 - Matching Rule found for RuleKey devAccountServices.invexgf.com POST /Services/AccountServices/Endpoint 80 <IP_ADDRESS>
16:52:33,516 DEBUG InterceptorFlowController:104 - Invoking request handler:   Store Interceptor on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:52:33,516 DEBUG InterceptorFlowController:104 - Invoking request handler: Dispatching Interceptor on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:52:33,517 DEBUG DispatchingInterceptor:78 - destination: http://devAccountServices.invexgf.com:80/Services/AccountServices/Endpoint
16:52:33,517 DEBUG InterceptorFlowController:104 - Invoking request handler: Reverse Proxy on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:52:33,517 DEBUG InterceptorFlowController:104 - Invoking request handler: User Feature on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:52:33,517 DEBUG InterceptorFlowController:104 - Invoking request handler: Request Interceptor on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:52:33,518 DEBUG RequestInterceptor:51 - Invoking request handler: Log on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:52:33,518 DEBUG LogInterceptor:124 - ==== Request ===
16:52:33,518 DEBUG LogInterceptor:124 - POST /Services/AccountServices/Endpoint HTTP/1.0

16:52:33,519 DEBUG LogInterceptor:124 - Headers:
16:52:33,519 DEBUG LogInterceptor:124 - Accept-Encoding: gzip,deflate
Content-Type: text/xml;charset=UTF-8
SOAPAction: "/Services/AccountServices/AccountBalanceInquiry"
Content-Length: 1491
Host: devAccountServices.invexgf.com
Connection: Keep-Alive
User-Agent: Apache-HttpClient/4.1.1 (java 1.5)
X-Forwarded-For: <IP_ADDRESS>
X-Forwarded-Proto: http
X-Forwarded-Host: devAccountServices.invexgf.com

16:52:33,519 DEBUG LogInterceptor:124 - ================
16:52:33,520 DEBUG InterceptorFlowController:104 - Invoking request handler: Balancer on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:52:33,520 DEBUG LoadBalancingInterceptor:154 - no session id found.
16:52:33,520 DEBUG InterceptorFlowController:104 - Invoking request handler: com.predic8.membrane.core.interceptor.flow.ResponseInterceptor on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:52:33,521 DEBUG InterceptorFlowController:104 - Invoking request handler: HTTPClient on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:52:33,521 DEBUG HttpClient:194 - try # 0 to http://<IP_ADDRESS>:10091/Services/AccountServices/Endpoint
16:52:33,521 DEBUG ConnectionManager:145 - connection requested for <IP_ADDRESS>:10091
16:52:33,522 DEBUG ConnectionManager:147 - Number of connections in pool: 2
16:52:33,523 DEBUG Connection:111 - Opened connection on localPort: 56414
16:52:33,525 DEBUG InterceptorFlowController:145 - Invoking abortion handler: com.predic8.membrane.core.interceptor.flow.ResponseInterceptor on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:52:33,525 DEBUG InterceptorFlowController:145 - Invoking abortion handler: Log on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:52:33,526 DEBUG InterceptorFlowController:145 - Invoking abortion handler: WSDL Rewriting Interceptor on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:52:33,526 DEBUG InterceptorFlowController:145 - Invoking abortion handler: Balancer on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:52:33,526  INFO NodeOnlineChecker:172 - Node down: http://<IP_ADDRESS>:10091/Services/AccountServices/Endpoint
16:52:33,527 DEBUG InterceptorFlowController:145 - Invoking abortion handler: Reverse Proxy on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:52:33,527 DEBUG InterceptorFlowController:145 - Invoking abortion handler:   Store Interceptor on exchange: [time:Jun 23, 2021,requestURI:/Services/AccountServices/Endpoint]
16:52:33,528 DEBUG HttpServerHandler:160 - No response received. Maybe increase the keep-alive timeout on the server.

Hi @FNXPAVEL ,
thanks for reporting. The HTTP/1.0 version is too old. Also Apache Axis 1 is outdated for years. I know it is not always possible to switch to a newer software. But we have to look foreward at some point and concentrate on the newer things. Sorry, but I hope you understand.
Thomas


Add support for boolean tagSupport value since it's present in stable vscode

Needed for rust-analyzer/rust-analyzer#2651
While tagSupport is a field not coming until the next lsp version (3.15), vscode already presents this value in a stable release, so we should support it.

:( LGTM (wish this wasn't necessary though). Released 0.66


httpclient-backend (the new java http client) for 2.12

Hi guys, is it possible to get a release for httpclient-backend for scala 2.12?

def httpClientBackendProject(proj: String, includeDotty: Boolean = false) = {
  ProjectMatrix(s"httpClientBackend${proj.capitalize}", file(s"httpclient-backend/$proj"))
    .settings(commonJvmSettings)
    .settings(testServerSettings)
    .settings(name := s"httpclient-backend-$proj")
    .jvmPlatform(
      scalaVersions = List(scala2_12, scala2_13) ++ (if (includeDotty) scala3 else Nil)
    )
    .dependsOn(httpClientBackend % compileAndTest)
}

should be there :) which artifact fails to be found?

I'm looking here:  https://mvnrepository.com/artifact/com.softwaremill.sttp.client/httpclient-backend
can't find 2.12, my understanding of maven is limited, maybe I fail to understand something

If you're looking for latest (3.1), that organization id is different: https://mvnrepository.com/artifact/com.softwaremill.sttp.client3/httpclient-backend

We are still using 2.2.8 here, need to investigate if I can do an upgrade, but that is another topic

I imagine you need to publish 2.2.8 builds for scala 2.12 on maven?

Yes, in progress, sonatype is slow for a change :)
And I'm releasing it for 2.2.9, the latest in 2.x

There you go: https://repo1.maven.org/maven2/com/softwaremill/sttp/client/httpclient-backend_2.12/


Verify /dev/pts/* are writable by the user

Wal tries to change settings for all terminals which may cause unnecessary warnings like:
[...]/wal: line 194: /dev/pts/51: Permission denied
This could be avoided by checking the write permission first:
[[ -w "$term" ]] && printf "%b" "$sequences" > "$term" &

Added!
Thanks :+1:


Hit points are no longer capped by maximum hit points

In dnd 3.0, you can now over-heal actors.  E.g. if your HP is currently 10 out of 20, and you heal 30 HP, your HP goes up to 40 out of 20.  It should clamp at 20 out of 20.

This seems to still be happening.


Omni-Lingual Quantizer?

(Took me way too long to realize this, and it just goes to show that most of us are just point and click type of fellas who don't really understand what we're using - not really a skiddie because we can code, but.. .you get what I mean)
So if the whole point of using bark-generated audio training a quantizer like this,
instead of simply grabbing a massive good dataset of audio and having whisper transcribe and then adding in tags or correcting as needed (or god forbid, manually finding voice clips with actual good audio that matches more or less what you hear)
is simply because you don't know how exactly they trained their hubert voice features to semantic tokens mapping, the unknown here being the semantic tokens, and you want to make sure you at least start off from THEIR hubert voice features to tokens mapping and refine it,
... then couldn't a general-purpose hubert to semantic tokens quantizer be made instead? You would just generate or aggregate all the supported languages, generate datasets if you don't have them already, train a quantizer on ALL OF THAT since its aim is just a reverse "tell me the semantic tokens for this series of sounds" and it should theoretically cover any "known" language
(minus the african ones because there's no statistically significant presence of tongue-click languages on the internet, but knowing bark and its random noises during generation, assuming hubert model has also learned that, it probably CAN map a tongue-click language too)
I see you did it for english, but I'm wondering why everyone has stopped at a single language quantizer when it can probably be made into an omnilingual quantizer.
I ask in the name of languages like Klingon, Middle English, Old English, Vietnamese with a southern accent....

It's planned, but I'll need some datasets to combine first.

I fully support this approach! I don't know much about this technology, but I think it's the best universal method.


chore: Add enhancement to label for stale bot to ignore

Add enhancement to label for stale bot to ignore.
I've thought of adding bug as well but didn't proceed given we want to auto-close bugs where reporters are not getting rid of the stale poke given it might not be relevant anymore.
Checklist

[x] Commits are signed with Developer Certificate of Origin (DCO - learn more)

Trivy failed on a new vulnerability but created https://github.com/kedacore/keda/issues/3351 since it's unrelated. Ok for you @JorTurFer if we merge this one?

Trivy failed on a new vulnerability but created #3351 since it's unrelated. Ok for you @JorTurFer if we merge this one?

Yes, we can merge even trivy has detected it. It's a vulnerability in the k8s packages upstream (and others), we can't solve it before they have updated their packages so we have to merge the PRs with that check failing atm


Add shortcut addAs methods to DocumentWriteSet

To align with the rest of the Java Client API, DocumentWriteSet should have addAs methods that accept a content object then uses the handle registry to lookup the appropriate handle for the object.

This is implemented both on develop and 3.0-develop

Added the following method to TestDatabaseClientConnection.java
// Test to validate that addAs with a java.io.object in DocumentWriteSet writes the document.
	@Test
	public void testAddAs() throws Exception {

		System.out.println("Running testAddAs");

		String[] docId = {"aggr1.xml", "aggr2.xml", "aggr3.xml"};
		DatabaseClient client = DatabaseClientFactory.newClient("localhost", Uberport, UberdbName, "eval-user", "x", Authentication.DIGEST);
		Transaction transaction = client.openTransaction();

		try {
			TextDocumentManager docMgr = client.newTextDocumentManager();
			docMgr.setMetadataCategories(Metadata.ALL);
			DocumentWriteSet writeset = docMgr.newWriteSet();

			DocumentMetadataHandle mhRead = new DocumentMetadataHandle();
			InputStream inputStream1 = new FileInputStream("src/test/java/com/marklogic/client/functionaltest/data/" + docId[0]);
			InputStream inputStream2 = new FileInputStream("src/test/java/com/marklogic/client/functionaltest/data/" + docId[1]);
			InputStream inputStream3 = new FileInputStream("src/test/java/com/marklogic/client/functionaltest/data/" + docId[2]);
			writeset.addAs(docId[0], inputStream1);
			writeset.addAs(docId[1], inputStream2);
			writeset.addAs(docId[2], inputStream3);

			docMgr.write(writeset, transaction);
			StringHandle wrteTransHandle = new StringHandle();
			transaction.readStatus(wrteTransHandle);
			assertTrue("Transaction readStatus during write does not contain Database name. ", (wrteTransHandle.get()).contains(UberrestServerName));
			assertTrue("Transaction readStatus during write does not contain Database name. ", (wrteTransHandle.get()).contains("App-Services"));
			transaction.commit();

			transaction = client.openTransaction();
			String txId = transaction.getTransactionId();

			DocumentPage page = docMgr.read(transaction, docId[0], docId[1], docId[2]);
			assertTrue("DocumentPage Size did not return expected value returned==  "+page.size(), page.size() == 3 );
			// Read back the doc contents to make sure that write succeeded.
			String strDocContent1 = docMgr.read(docId[0], new StringHandle()).get();
			assertTrue("Text document write difference", strDocContent1.contains("Vannevar Bush wrote an article for The Atlantic Monthly"));
			String strDocContent2 = docMgr.read(docId[1], new StringHandle()).get();
			assertTrue("Text document write difference", strDocContent2.contains("The Bush article described a device called a Memex."));
			String strDocContent3 = docMgr.read(docId[2], new StringHandle()).get();
			assertTrue("Text document write difference", strDocContent3.contains("For 1945, the thoughts expressed in The Atlantic Monthly were groundbreaking."));

			StringHandle readTransHandle = new StringHandle();
			transaction.readStatus(readTransHandle);
			assertTrue("Transaction readStatus during read does not contain App Server name. ", (readTransHandle.get()).contains(UberrestServerName));
			assertTrue("Transaction readStatus during read does not contain Database name. ", (readTransHandle.get()).contains(dbName));
			assertTrue("Transaction readStatus during read does not contain Transaction Id name. ", (readTransHandle.get()).contains(txId));
		}
		catch(Exception exp) {
			System.out.println(exp.getMessage());
			throw exp;
		}
		finally {
			transaction.rollback();
		}
	}


Don't try attribute 'iteritems' on 'dict' object

/usr/bin/python --version
Python 3.6.10

Without this patch I get:
munin-run tor_connections
Traceback (most recent call last):
  File "/etc/munin/plugins/tor_connections", line 539, in <module>
    main()
  File "/etc/munin/plugins/tor_connections", line 533, in main
    provider.fetch()
  File "/etc/munin/plugins/tor_connections", line 254, in fetch
    for state, count in states.iteritems():
AttributeError: 'dict' object has no attribute 'iteritems'

With this patch I get
munin-run tor_connections
new.value 2
launched.value 3
connected.value 3858
failed.value 0
closed.value 0

Hello,
thanks for this, this has been commited upstream already https://github.com/munin-monitoring/contrib/commit/71f9280576321488f87c286b61a40d6b6ab7fcea.
I'm going to archive this repo, and the munin-monitoring/contrib one will become the official source for this plugin.


NAS Volume1 unavailable to select files to backup in CP interface

Still having trouble getting docker/cp reloaded. I figured out the problems getting the ports set correct for the GUI. But I couldn't sync to the CP Repository. With a conversation with CP tech, he said the server can't locate the previously selected files on the NAS (all files in the CP console at CP are showing as deleted). So I started from scratch. Removed the container, images, cache, etc. Reloaded Docker and the jl-crashplanpro-latest. When I went to manage files I can no longer pick from the Synology "Volume1" location. All I see is "root" and directories below it. Even with show hidden files checked. Clearly this is why I couldn't sync up. I tried creating a new container with elevated permissions, the same problem. See below screenshot of what the CP interface sees - no Volume1 to pick from! I'm really in a bad way since I've had no backups for weeks now.

Uninstalled, re-installed, still cannot see "volume1" to either manage files for backup or restore to. I can show hidden files at CP Central, pick a file to restore to "original location" but it goes nowhere. If I select "other location" to restore to then "volume1" still does not show up.
I did a complete "find" on the NAS and the file did not get restored. What I did to test this is I deleted an outdated, no longer needed file, on the NAS and then restored it from CP Central using the CP interface on the NAS. File not found on the NAS.
I realize the docker and CP interface is a free product, which I appreciate, but CP tech will provide no help because they claim it unsupported. I am willing to pay to have this straightened out. I'm really in a bad way - I cannot back up from - or restore to the NAS.
This is what I get if I choose "other location"

This is what I get if I try to access root:

Somehow I got it to run and see volume1. But the volume's location doesn't match that on Cp Central.
Cp Central shows volume one as /volume1
But docker/CP shows it as /root/volume1 and next to all the directories on the far right the CP interface shows "file not found" which is likely why CP Central can't see the directories.
Please help - I'm desparate

You can map a folder from your Synology to a folder in the container.  This is how you expose your data to the container.  I think that Synology calls this "Shared folders".
So if you mapped volume1 to /root/volume1 in the container, CP will see your data in /root/volume1.  If you want CP to see your files in /volume1, you need to adjust your mapping...

I've read the docs from head to bottom. No mention of how to do this in the GUI. So I deleted the container, re-created it and went to advanced settings, volume tab. All my directories below /volume1 are showing there just fine. Nothing there to map and I never mapped /volume1 to /root/volume1 previously on my own. Once I finish creating the container is there any config file where I can check what, if anything, was remapped?
Thank you for continuing to help. I feel like we are so close to getting this fixed...

Ok so when you edit the container, you should have a tab Volume.  This is where you can map a folder to the container.  The Mount path is the path inside the container, i.e. the path seen by CrashPlan.
Example of this page:
https://preview.redd.it/t8xaba2mdp111.png?width=646&format=png&auto=webp&s=2b4e191ed3b4cace958440a53d95bce7706f05bd

sorry to be a pest, but based on my paths what do I put on the left and right side of the volume mapping?
to reiterate:
CP Central shows /volume1
CP Client shows /root/volume1
I've been using docker/crashplan for quite a while. I never had issues with it until now. I was always able to upgrade without a problem. I can only surmise CP messed something up with their latest version.

I guess you need to click "Add folder", select the volume1 folder and then set the mount point to /volume1.

Yes, I tried that but the odd thing is that the folders on the left side to pick from are those already below /volume1 (image attached). I'm totally lost. I am willing to pay to have this fixed.

So probably that you created the container via shell the first time ?
Do you need to backup every available folders?

No, I created the container always via the GUI. I never had any trouble before now updating to a new version.
I do not backup every available folder on the NAS.

Are you expecting your Synology folders to be under volume1 in CrashPlan ?  For example, are you expecting Photos to be found at /volume1/Photos in CP ?
If yes, then just add all the volume you need, making sur to set the Mount path to /volume1/XXX.  For example, your Photos folder should have a mount point set to /volume1/Photos.

Do I have to do this for every folder I want to backup? Or can I just set the mount point to /volume1 so I can pick files to backup from the GUI? Also, what is the relation of this to the /config default in the container? In all the time I've been using the docker and crashplan image I've never had to do anything like this. I'm totally confused.

Do I have to do this for every folder I want to backup? Or can I just set the mount point to /volume1 so I can pick files to backup from the GUI?

Yes this is needed for each folder, because you cannot have multiple volumes with the same mount point.

Also, what is the relation of this to the /config default in the container?

/config is the directory inside the container where all states of CrashPlan are saved.  When mapped to a directory on your Synology, it allows you to update or re-create the container without having to start over with CrashPlan.  You have to know that anything written by an application inside a container is not permanent, unless data is written to a directory mapped to the host.

In all the time I've been using the docker and crashplan image I've never had to do anything like this. I'm totally confused.

Sorry, hard to comment on this since I don't know how you were setup before :)  But mapping volumes to a container is the only way to either share your data with the container or to save persistent data needed by the container.

If we refer to y Synology NAS i have done a new config last week that works perfectly.
Created a Crashplan user "Crashplan" and a "Backup operator" group. Granted backup operator group RO access to all shares part of volume 1. Gathered user id and group ID for backup operator group.
Then confogured the container with SSH:
docker create --name=crashplan-pro
-p 5800:5800
-v /volume1/docker/crashplan:/config:rw
-v /volume1/:/volume1:ro
-e USER_ID=1031
-e GROUP_ID=65548
-e CLEAN_TMP_DIR=1
-e CRASHPLAN_SRV_MAX_MEM=4096M
-e TZ=Europe/Zurich
jlesage/crashplan-pro
-Make sure User ID is properly set as well as group ID which should be the group ID of backup operators (since user may be member of many groups)

You will NOT see the volume configuration association between Volume 1 and Volume 1 on Syno NAS. However this volume association WILL work.
Problem solved i have access to root, and volume 1 is visible.

Hi,
How do I definitively determine numbers for:
-e USER_ID=1031
-e GROUP_ID=65548
for my particular setup?

also, what is the timezone text for USA Eastern New York?

To find a user's UID or GID in Unix, use the id command. To find a specific user's UID, at the Unix prompt, enter:
id -u username
Replace username with the appropriate user's username. To find a user's GID, at the Unix prompt, enter:
id -g username
If you wish to find out all the groups a user belongs to, instead enter:
id -G username
If you wish to see the UID and all groups associated with a user, enter id without any options, as follows:
id username
For the time zone, your is America/New_York
please refer to the following webpage: https://en.wikipedia.org/wiki/List_of_tz_database_time_zones

I will save the info on timezones. Very helpful.
What username am I looking for? Is it the username I used to telnet into the NAS to perform the docker create commands?
Thanks!

Nevermind - I just answered my own question. Thank you again for your help!
Be safe...

No worries :)
It is better to associate the container with a known user on the NAS. When manipulating files, the container will do it in the context of the user in question, hence having its rights and privileges.
Usually you dont grant a user rights, you grant a group rights where a user is member of, this is the clean way.
have a look at this:

Kip - is it possible to PM here or have you contact me directly?
Thanks - Jim

Kip - is it possible to PM here or have you contact me directly?
Thanks - Jim
What is exactly your issue ?

I'm having one problem after another. I've been using Docker/lasage for about two years now and never had this much trouble getting it setup. It all started back about 45 days ago when I needed to perform an update. I followed the same steps I always had but it didn't work this time. Since then I've deleted and reinstalled Docker several times and I still can't get it to work. I even used CL interface to manually remove containers. At this point I need some professional help. I am even willing to pay to get it running again. CP support is zero help because of the Docker environment.
I'm really stuck in cement at this point.

i am an IT pro but not a linux pro, however i can try. First let me know what is exactly not working today, can you provide precise details so i can make initial diag.


Splitting terminal buffer using :FuzzyBuffers opens incorrect buffer

When using :FuzzyBuffers to select a terminal buffer opened by :term works fine, but it fails to open the proper buffer when using split or tab keymaps <C-s>, <C-v> or <C-t>.
To reproduce:
# Open vim
:terminal
<C-w>c  # closes terminal window
:FuzzyBuffers
# Select terminal buffer
<C-s>

It works fine if I use <CR> instead of <C-s> or <C-v>
Once again, thanks for the plugin and quick response to issues!

Thank you for the bug report. This issue should be fixed in the latest commit.


Using Node.php instead of Node.js

Hello everyone..
Please, Have anyone tried to run parse server on node.php (https://github.com/niutech/node.php) ?
I am about to buy a shared webhosting to try it... So if not I will leave feedback here

What's that? ahah
Get a cheap VPS and use a serious installation of Node.js.

you're better off getting set up on DigitalOcean then wasting your time trying to get a MongoDB and parse server running on a shared hosting site

You have great guides to be live in minutes at the bottom here https://github.com/ParsePlatform/parse-server/wiki


Uses a more recent version of easymock

Uses a more recent version of easymock where https://github.com/easymock/easymock/issues/274 is fixed
Fix #886

thank you for your interests. this is not feature enhancement, I will block this


Ordering of Authorial Status filter choices

The "of x" choices are in the wrong place -- they should be moved as a block into proper alphabetical order.

It looks to me like this might be the result of some automated alphabetizing system based on what I see at
https://github.com/upenndigitalscholarship/deep/blob/main/main/management/commands/build.py#L153
but I'm not sure. If so, the system is not simply ignoring "of", because the choices are not properly alphabetized even if you ignore "of" -- all of the "of" items are placed at the end.
They should all move, as a block, to between "Minister" and "Orator of the University of Oxford"

Ignore "the" when alphabetizing -- "of the Mont" should alphabetize like "Mont", for example.


Fix bugs that have broken yarn build

This changes are not needed anymore due to https://github.com/BitBagCommerce/SyliusMolliePlugin/pull/147


[FLINK-3036] [gelly] Fix Graph.fromCsvReader method in Gelly's Scala API

The Graph.fromCsvReader in Gelly's Scala API returns a wrongly typed Graph instance because
the implementation contains code paths with return types which are not compatible. This
lead to a bad user experience.
This commit fixes this. However, it also introduces a slightly different behaviour and is
thus API breaking. Before there were parameters hasEdgeValues and readVertices which
controlled whether edge values and vertices shall be read. This is now implicitly controlled
by the types of the vertex and edge value. If the type is NullValue for the edge values then
the edge value won't be read from the given csv file. If the vertex value type is NullValue,
then all vertices will have a value of a NullValue instance. If the pathVertices is not
specified and the vertex value type is unequal to NullValue, then the vertexValueInitializer
is used for the initialization.

Thanks a lot for fixing this @tillrohrmann!
I actually like the new behavior better ;) Could you please also update the gelly guide?
One more thing, some of the formatting changes you've made are also present in #1356. I was planning to merge it, but you'll have to rebase this one. Let me know if that's OK or whether it's more convenient for you to merge #1356 and this one yourself. Thanks again!

@vasia, I can take care of merging both PRs. The overlapping parts don't seem to be too difficult to resolve.
Will update the gelly guide before merging.

Awesome, thanks Till!


Unable to send Observe notifications to client

Dear Sir
I have created an RandomResource in exampleresources.py and would like to send an random value to the client for every 5 seconds using an thread RandomThread , I used RandomResource._coap_server.notify(RandomResource) to send the updated value. Please take a look through the code. Don't know what mistake am doing
class RandomResource(Resource):
class RandomThread(threading.Thread):
    def run(self):
        while True:
            sleep(5)
            randnum = randint(1,50)
            RandomResource.payload="response:" +str(randnum)
            RandomResource._coap_server.notify(RandomResource)

def __init__(self,name="RandomResource",coap_server=None):
    super(RandomResource,self).__init__(name, coap_server, visible=True,
                                       observable=True, allow_children=True)
    try:
        t1 = self.RandomThread()
        t1.start()
    except:
        print "Error: Unable to start thread"

def render_GET(self,request):
    return self

got it problem sloved .....I forgot to add (coap_server = self ) while adding Resource
"self.add_resource('randomResource/', ObservableResource(coap_server=self))"


bootstrap: make a 0.7 release that honors prerelease & snapshots

CI in #559 is failing because a newer version of zpm-registry has been published. The new zpm-registry needs IncludePrerelease and IncludeSnapshots in the URL query string to return prereleases and snapshots. Since older version (0.7.x) of zpm doesn't yet properly set them in URL, it won't install prerelease 0.9.0-dev.559.1, hence causing the migration test from 0.7.x to fail.
This PR addresses this problem by setting IncludePrerelease and IncludeSnapshots. Another commit to change the CI in v1 branch is also needed (after this PR is merged and released)

With https://github.com/intersystems-community/zpm-registry/pull/115 merged and published, this PR is no longer critical to unblock CIs for #559, but it's still nice to have so ZPM 0.7.x users can properly filter by includePrerelease and includeSnapshots.


[openvpn3] openvpn3 should use the upstreams CMakeLists.txt

Currently it uses a custom CMakeLists.txt file. Maybe this also fixes the macOS build

still valid

Stay active

This package isn't sane.
The vcpkg port builds a lib which doesn't match directly an upstream artifact. Upstream provides a python lib using swig, and it provides command line tools. That lib and and the tools are the only translation units. Everything else is inline in the headers.
I have a patch to build the vcpkg lib instead of the python lib, to deal with deps and to fix the exported config. But with most of the code being headers, I wonder if the binary artifact is used at all, or if the port's usage is mostly header-only.


added myself to the contributors.md

I have added myself to the contributors.md file.

Your pull request seems good, but must be checked by a human maintainer for the following reason(s):

Modifications to contributors.md must be checked manually, thanks for your submission.

Please be patient until a maintainer has time to look over your contribution.
This is an automated response, beep boop.
if you think there is a mistake, contact a maintainer

d2d981f87b3885b5fff7e9caa27b222c2a47d911


In am wondering why you have to convert manually to get proper the proper price of something.
For example i want to store an item with a price of €500 formatted, in my input i just fill 500 then its stored in a decimal field exact like 500.00
I am expecting that i would standard format to €500 but without the convert option it gets €5.
Can someone explain this maybe why this is happening?

Sorry i already know!

@fridzema Could you tell us what you did to make it work? Currently facing it myself.

@Thijmen don't know for sure anymore, but i think there was something wrong with my calculations what was causing this issue.

Ah, I put a string in my Money::EUR method in stead of a float... silly me.


Multiple particle classes

It would be nice to be able to annotate multiple classes of particles in a single session.
It isn't clear to me the best way to write this type of annotation to disk. Some options:

Single star file with a column to annotate the class
One star file per class
Something else?

Any thoughts? cc @bbarad @alisterburt @kephale

Hey @kevinyamauchi - standard RELION way of doing this would be an extra column called 'rlnClassNumber' with integer class ids starting at 1

Thanks @alisterburt and @bbarad ! It sounds like long term we should support both single and multi-file output.
Perhaps just to keep it simple, we start with a single file and then add multi-file as an option in a follow up.


CMP0048 Policy warnings, because no version is being set with project(...)

Exactly the same problem as this here:
https://github.com/cpp-redis/cpp_redis/issues/47

Thank you for reporting this issue.

it is also possible to get the version number from some source file like this project does: https://github.com/teeworlds/teeworlds/blob/master/CMakeLists.txt


Concepts: Add volume discount programme

The Chore
A volume discount programme is being introduced to Vega, we need to explain Vega's implementation.
Tasks

[ ] Describe Vega's implementation that enables the community to create a volume discount programme

Additional details / background info

Spec: https://github.com/vegaprotocol/specs/pull/1829 see https://github.com/vegaprotocol/specs/blob/9ae928fb95dfb511ae5e7a29c280ef0d9a8cf7b0/protocol/0083-VDPR-volume_discount_program.md
Related to #719

Barney & Ramsey are doing drafts of this stuff ... so TBC if this ends up in Concepts


util: added umask manipulation

This pr tries to add umask manipulation to test util, this would allow changing umask in a contained manner instead of doing it globally.

@tertsdiepraam Does this look like it will do the trick? Should I port existing tests to utilize this?

I love it!

And yes, it'd be great if you could port a few tests (in a separate commit) so that we can see that this actually solves our issue.

thanks!


Update README with new packaging method

Any chance of including some build instructions for macOS? I'd like to try this new version 1.4.0 but have no clue how to build it and what the requirements are. I have macports installed and can grab "packages" that way.

sounds good!!
To get it running you need:

npm
node (I use 6.7.0)
git (to clone the repository)

I think that will be it.

clone the repository git clone https://github.com/yakyak/yakyak.git
cd yakyak
install modules by running npm install
git checkout 1.4.0 checkout 1.4.0 branch that has the new code
npm run gulp to compile the code to javascripts (it's written in coffescript)
npm run electron app to run the application

note: you can always run compile and run with one command npm run gulp && npm run electron app
it would be awesome if you could validate this instructions in MacOSX :)
@kwrobel before you can have it running in your machine you can try the new 1.4.0 beta4

@averissimo I actually grabbed the latest beta build and got it running no problem on Mac OS X Yosemite following the readme instructions for development. Specifically, the following:
With npm and git already installed

Downloaded the latest tar.gz
Unpacked to desired location (~/Applications, in my case)
npm install
npm run gulp
npm run deploy

The resulting .app package has run fine so far. I did this in response to the protocol change by google because my cask-installed instance stopped working.

@seeker44 my bad then!! Should have checked readme before that reply.
Topic still holds as deployment 'structure' changed and to create win32 binaries wine is a requirement

And thanks for pointing that out :)

Thank you both. I do not have npm installed. So I will do that tomorrow and then follow those instructions. I will give feedback since I am on a newer version of macOS (Sierra) things might still break (slightly).

@kwrobel feel free to share your experience and don't hesitate on ask for help if you get crazy errors :)
npm actually comes with node.js (my bad)

Just updated the readme: 00584bf3cb639182b00728dff84ebcf0c564731e
closing this issue

Hi. Just reporting back that I have issues getting YakYak to build on my Mac. Here's a paste of the output of the npm build command: http://pastebin.com/9ZLXq4s9

don't worry, that's expected... optional libraries that are not really required (they are install as some module might need it)
I have the same output, as should everyone else :)

Thanks. I figured I would not have been able to continue with the other steps had there been serious errors.

@kwrobel if you want to test the pull requests you can open their page via github.com
Click on command line instructions
and pull to the current branch (or create a new branch to test it)

Just recently discovered this, I used to do it much more complicated. If you already know this, please ignore :)


Issue on running Demo

Hi thx for this package i wan to try the demo like documented.
i get
webpack-external-import git:(master) ✗ npm run demo

<EMAIL_ADDRESS>demo /Users/myuser/dev/webpack-external-import
yarn && yarn && yarn link webpack-external-import && concurrently "yarn compile" "yarn link" "yarn demo:one"  "yarn demo:two"

yarn install v1.21.0
warning package.json: License should be a valid SPDX license expression
warning package-lock.json found. Your project contains lock files generated by tools other than Yarn. It is advised not to mix package managers in order to avoid resolution inconsistencies caused by unsynchronized lock files. To clear this warning, remove package-lock.json.
warning<EMAIL_ADDRESS>License should be a valid SPDX license expression
[1/4] 🔍  Resolving packages...
success Already up-to-date.
$ yarn compile && cd manual && yarn
yarn run v1.21.0
warning package.json: License should be a valid SPDX license expression
$ babel src -d .
Successfully compiled 5 files with Babel.
✨  Done in 1.32s.
yarn install v1.21.0
warning package.json: No license field
warning ../package.json: License should be a valid SPDX license expression
warning<EMAIL_ADDRESS>No license field
[1/4] 🔍  Resolving packages...
success Already up-to-date.
✨  Done in 0.39s.
✨  Done in 3.38s.
yarn install v1.21.0
warning package.json: License should be a valid SPDX license expression
warning package-lock.json found. Your project contains lock files generated by tools other than Yarn. It is advised not to mix package managers in order to avoid resolution inconsistencies caused by unsynchronized lock files. To clear this warning, remove package-lock.json.
warning<EMAIL_ADDRESS>License should be a valid SPDX license expression
[1/4] 🔍  Resolving packages...
success Already up-to-date.
$ yarn compile && cd manual && yarn
yarn run v1.21.0
warning package.json: License should be a valid SPDX license expression
$ babel src -d .
Successfully compiled 5 files with Babel.
✨  Done in 1.11s.
yarn install v1.21.0
warning package.json: No license field
warning ../package.json: License should be a valid SPDX license expression
warning<EMAIL_ADDRESS>No license field
[1/4] 🔍  Resolving packages...
success Already up-to-date.
✨  Done in 0.38s.
✨  Done in 2.56s.
yarn link v1.21.0
warning package.json: License should be a valid SPDX license expression
error No registered package found called "webpack-external-import".
info Visit https://yarnpkg.com/en/docs/cli/link for documentation about this command.
npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR<EMAIL_ADDRESS>demo: yarn && yarn && yarn link webpack-external-import && concurrently "yarn compile" "yarn link" "yarn demo:one"  "yarn demo:two"
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>demo script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.

npm ERR!      /Users/myuser/.npm/_logs/2019-12-04T08_07_04_663Z-debug.log

the error : error No registered package found called "webpack-external-import".
maybe you know whats wrong ?
thx for your help
system :
OSx 10.15.1
node 10.16.3
npm 6.13.0
yarn 1.21.0

i try also run with yarn
 ./node_modules/.bin/yarn demo
yarn run v1.21.0
warning package.json: License should be a valid SPDX license expression
$ yarn && yarn && yarn link webpack-external-import && concurrently "yarn compile" "yarn link" "yarn demo:one"  "yarn demo:two"
warning package.json: License should be a valid SPDX license expression
warning package-lock.json found. Your project contains lock files generated by tools other than Yarn. It is advised not to mix package managers in order to avoid resolution inconsistencies caused by unsynchronized lock files. To clear this warning, remove package-lock.json.
warning<EMAIL_ADDRESS>License should be a valid SPDX license expression
[1/4] 🔍  Resolving packages...
success Already up-to-date.
$ yarn compile && cd manual && yarn
warning package.json: License should be a valid SPDX license expression
$ babel src -d .
Successfully compiled 5 files with Babel.
warning package.json: No license field
warning ../package.json: License should be a valid SPDX license expression
warning<EMAIL_ADDRESS>No license field
[1/4] 🔍  Resolving packages...
success Already up-to-date.
warning package.json: License should be a valid SPDX license expression
warning package-lock.json found. Your project contains lock files generated by tools other than Yarn. It is advised not to mix package managers in order to avoid resolution inconsistencies caused by unsynchronized lock files. To clear this warning, remove package-lock.json.
warning<EMAIL_ADDRESS>License should be a valid SPDX license expression
[1/4] 🔍  Resolving packages...
success Already up-to-date.
$ yarn compile && cd manual && yarn
warning package.json: License should be a valid SPDX license expression
$ babel src -d .
Successfully compiled 5 files with Babel.
warning package.json: No license field
warning ../package.json: License should be a valid SPDX license expression
warning<EMAIL_ADDRESS>No license field
[1/4] 🔍  Resolving packages...
success Already up-to-date.
warning package.json: License should be a valid SPDX license expression
error No registered package found called "webpack-external-import".
info Visit https://yarnpkg.com/en/docs/cli/link for documentation about this command.
error Command failed with exit code 1.
info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.

Hmmm, let me see what I can do. What node version or what machine are you on?

It looks like we need to run 'yarn link' at the root directory.

released a fix


add the routing module compiling dependence

add the graph dependence in routing BUILD file

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.Michael seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


manual: Cannot make manual: missing APPNOTE_010_Verilog_to_BLIF.pdf

Steps to reproduce:
Install texlive-full and the luximono font.  Clone the master branch from scratch in a temporary directory.  make && sudo make install.  All goes well up to here.
Now try to build the manual PDF: make manual.
Expected result:
Successful creation of manual PDF.
Actual result:
pdflatex error:
LaTeX Warning: Reference `app:010' on page 216 undefined on input line 16.

LaTeX Warning: Reference `app:011' on page 216 undefined on input line 17.

LaTeX Warning: Reference `app:012' on page 216 undefined on input line 18.

[216]

! Package pdfpages Error: Cannot find file `APPNOTE_010_Verilog_to_BLIF.pdf'.

See the pdfpages package documentation for explanation.
Type  H <return>  for immediate help.
 ...

l.22 ...e{plain}]{APPNOTE_010_Verilog_to_BLIF.pdf}

!  ==> Fatal error occurred, no output PDF file produced!
Transcript written on manual.log.
make: *** [Makefile:861: manual] Error 1

Note
FWIW I have also manually run appnotes.sh in manual/.  I still get the same error.

@boqwxp Is this still an issue? as of 1c36f4cc2 make manual appears to work


Adjust allocation paradigms and associated logic

Adds new enum type AllocationAssetGrouping to encapsulate the way in which compute assets from a resource node should be grouped together into individual ResourceAllocation objects
Updates ResourceManager functions that handle allocations for the different AllocationParadigms to:

accept a AllocationAssetGrouping param
support both current AllocationAssetGrouping values

SILO - return multiple 1-CPU, isolated allocations per node (which was effectively the previous behavior)
BUNDLE - return a single allocation per node that included all that nodes contributed compute assets (newly added behavior)

made BUNDLE the default param value and the default operational behavior

Closes #573.
Supersedes #220.

@aaraney, I'll have a look at the inline comments shortly, but to address your main comment ...

I am a little concerned that the AllocationAssetGrouping is only practically applicable to jobs with the AllocationParadigm.SINGLE_NODE. I am likely missing something though. For example, I don't think it is desirable for a job created with a AllocationParadigm.FILL_NODES and BUNDLE.  This can result in a heterogenous compute environment (some resources will have more vCPUs and memory than others) and there is not a way to control this. Likewise, AllocationParadigm.ROUND_ROBIN and BUNDLE likely does not express the shape of the desired compute environment without knowing how many nodes are present in the deployment.

We can't really assume (at this point) that a heterogenous compute worker layout is inherently unwanted.  Some things are bound to have a problem with it, but it's possible some things could benefit from it, and at minimum some don't care.  A ngen model exec job, for instance, should be able to use such a layout fine because of the way the worker MPI host files are built.

Aside, but related, I am having similar concerns that I raised in https://github.com/NOAA-OWP/DMOD/pull/220. I understand that it is desirable to further abstract the compute environment from the user (i.e. just specify memory, cpu, and allocation paradigm requirements). However, I think pursuing that limits not only the users of the software, but other software that uses the scheduler (e.g. other DMOD services) including the needs of NextGen workloads. For example, it is not out of the ordinary for NextGen modules to utilize means like python's multiprocessing module to improve performance or use libraries like OpenMP to take advantage of multiple cores. It is not entirely clear what the computing needs of coupled coastal model will be either, which to speculate, may benefit from a tailored heterogenous compute environment.

Yeah, our paradigm-based strategy for resource allocation is not as robust as it could be, but it's mostly sufficient for the moment, and this change just tweaked it slightly to address a current need for calibration jobs.
Completely overhauling is likely not work we can afford to prioritize right now.  We can, however, afford to take smaller iterative steps toward something, even if they aren't essential right now, as long as they can work alongside what we have now without breaking it.
I will note that I feel it is essential that DMOD be capable of abstracting resource management in some manner and handling it for the user, though having DMOD also provide alternative, more fine-grained controls does sound like a good idea.

We can't really assume (at this point) that a heterogenous compute worker layout is inherently unwanted. Some things are bound to have a problem with it, but it's possible some things could benefit from it, and at minimum some don't care. A ngen model exec job, for instance, should be able to use such a layout fine because of the way the worker MPI host files are built.

I agree for the SINGLE_NODE allocation paradigm case with BUNDLE. However, the FILL_NODES and ROUND_ROBIN with BUNDLE cases are what throw me for a loop. At face value, without knowledge of the number of nodes and the current usage of those nodes, I don't see a way to determine the number of resource allocations and thus containers to be allocated / spawned. We assume that the majority of work DMOD schedules will be CPU bound. An assumption that I am making, and perhaps this is where we aren't seeing eye-to-eye, is many CPU bound jobs that use MPI will benefit from a higher number of processes (mpirun -n x, higher x value). I am not assuming that each replicated MPI process will only need 1 virtual core but instead, in many cases, a replicated MPI process will benefit from access to multiple vCPUs (local parallelism). Assuming my assumptions are valid, I do not see a way to request a job, that for example, needs 16 containers each with 4 vCPUs. I understand that this is likely by design, however, my concern is this cuts out a large number of use cases DMOD could handle.

At face value, without knowledge of the number of nodes and the current usage of those nodes, I don't see a way to determine the number of resource allocations and thus containers to be allocated / spawned.

(I'm assuming here by "determine" you mean "cause to occur" as opposed to "ascertain."  Also, I'm assuming by "resource allocations" you mean ResourceAllocation objects, and not just the allocation of compute resources, which I've tried to differentiate by calling them "assets.")
Nope.  We don't want the users to have to think about that.  Except in the case where they know they want everything on one machine.

Assuming my assumptions are valid, I do not see a way to request a job, that for example, needs 16 containers each with 4 vCPUs. I understand that this is likely by design, however, my concern is this cuts out a large number of use cases DMOD could handle.

There is not a way currently and that was by design, at least for now.  The point is valid, but I don't think this is what's causing problems or discouraging use right now.  Not to the degree other things in our backlog are.  And again, it's out of scope here.  The allocation paradigms aren't changing, we're just going back to assigning all assets from a physical node to a single ResourceAllocation/container as the default (which either remains sufficient or was previously needed for our supported jobs currently).
FWIW, this addition actually should make it easier to add in some similar capabilities relatively quickly if something is lacking for a specific need in the future; e.g., we could add a CPU_QUARTET AllocationAssetGrouping value, and other similar ones.

What about the round robin allocation case when the number of requested cpus < num_nodes? This can result in a job receiving less memory than requested:
from dataclasses import dataclass
from typing import Dict, Optional, Tuple

PAGE_SIZE = 4096

@dataclass
class Resource:
    cpu_count: int
    memory: int = PAGE_SIZE

def round_robin_allocations(
    resource_nodes: dict[str, Resource], cpus: int, memory: int
) -> Tuple[Optional[Dict[str, int]], Optional[Dict[str, int]]]:
    cpus_per_node, memory_per_node = dict(), dict()
    num_nodes = len(resource_nodes)
    cpu_share, cpu_remainder = divmod(cpus, num_nodes)
    mem_share, mem_remainder = divmod(memory, num_nodes)

    for node_id, node in resource_nodes.items():
        # We must plan to request at least the per-node amounts on each node
        if node.cpu_count < cpu_share or node.memory < mem_share:
            return None, None
        cpus_per_node[node_id] = cpu_share
        memory_per_node[node_id] = mem_share
        # But we also need to try to pick up a share of the remainders if we can
        if node.cpu_count > cpu_share and cpu_remainder > 0:
            cpus_per_node[node_id] += 1
            cpu_remainder -= 1
        if node.memory > mem_share and mem_remainder > 0:
            memory_per_node[node_id] += 1
            mem_remainder -= 1

    # We must also make sure that all of each remainder was picked up
    if cpu_remainder > 0 or mem_remainder > 0:
        return None, None

    return cpus_per_node, memory_per_node

def test_cpus_lt_num_nodes():
    resources = {
        "a": Resource(cpu_count=2, memory=PAGE_SIZE),
        "b": Resource(cpu_count=2, memory=PAGE_SIZE),
    }
    cpus = 1
    mem = 2 * PAGE_SIZE
    c, m = round_robin_allocations(resources, cpus, mem)

    assert c is not None
    assert m is not None
    assert c == {"a": 1, "b": 0}
    assert m == {"a": 2 * PAGE_SIZE, "b": 0} # is really {"a": 2 PAGE_SIZE, "b": PAGE_SIZE}

I am not sure how to handle the case when you request fewer cpus than we have nodes using a balanced round robin using the current approach.

I am not sure how to handle the case when you request fewer cpus than we have nodes using a balanced round robin using the current determine resource allocations for each node approach.

That's a very interesting question.  I did ponder for a while whether this was a use case we should support or should block.  I landed on support, since the user isn't necessarily aware of or expected to consider the node count.  So maybe someone asks for a 8 CPU job and doesn't know/notice the cluster has 10 nodes.  I've modified the function to handle when we aren't pigeon-holed into every node being used.


kate's post

Thanks and sorry about the delay! Just got back from holiday :)

It's posted now: https://astrodata.nyc/posts/2019-08-23-anomalies/


Installing code-server comes with unsecure modules

Web Browser: Chrome
Local OS: OSX
Remote OS: Ubuntu 18.04
Remote Architecture:
code-server --version: 3.4.1

Installing the latest version of code-server comes with the following security issues:
nodejs	 high	npm version 1.1.22 has 6 vulnerabilities. - CVE-2016-3956
nodejs	 high	npm version 1.0.1 has 6 vulnerabilities. - CVE-2016-3956
nodejs	 high	minimatch version 2.0.10 has 1 vulnerability. CVE-2016-10540
nodejs	 high	lodash version 3.10.1 has 3 vulnerabilities. CVE-2019-10744
nodejs	 high	js-yaml version 3.6.1 has 2 vulnerabilities. NODE-SECURITY-813
If there is a way to manually update these modules post/pre-install do let me know and I'll be happy to do so in the meantime.
Thanks
Petter

I think the only manual way would be to edit the corresponding package.json with updated versions then run yarn again in the package.json directory.

@code-asher Seems easy enough. Any issue unzipping the package, edit the package.json files, and then zip it up for re-distribution?
Also, can I update all modules while I am at it are there any known dependencies that can not break at this time?

@code-asher Figured I'll try this right away and it does seem to semi-work. I am using this package as an example.
js-yaml, this comes as version 3.13.1. Fixed up the package.json but it seem to reply on 3.6.1 somewhere as it grabs that version and adds it here /usr/local/share/.cache/yarn/v6/npm-js-yaml-3.6.1-6e5fe67d8b205ce4d22fad05b7781e8dadcc4b30-integrity/node_modules/js-yaml. I now have both<EMAIL_ADDRESS>and 3.6.1.
Any ideas are welcome.

Ahh that looks like a false positive. That's the VS Code extension, not an npm module.
Yup, you can absolutely zip it back up for distribution.
Updating modules is most likely going to work but there's always a chance that something will break. The only way to be sure is to test it.

This should be resolved and we've got dependabot now to keep us up to date.


Implement AdaptiveColorNorm

Currently this is empty.

Leaving this out for now - the current methods seems to work OK.


Pull latest dotnet 6.0-focal image and add Microsoft Signing Keys to avoid expired signature causing deployment failure

Purpose
Closes #7
Per #7, I get a deployment error when trying to use the sample because the sample's dockerfile refers to an old image from October 3, 2023:

https://mcr.microsoft.com/en-us/product/devcontainers/dotnet/tags
Essentially: hardcoding the image to use 0-6.0-focal pull that specific image. Removing the prefix 0- allows the latest container image to be pulled for dotnet 6 on Ubuntu 20.04 (Focal).

tag
type
digest
date

0-6.0-focal
OCI Image Index
sha256:ec557bf5cb00970cd09488f38b15a9bf488cfb8ab15269174b5882f6b3255e82
10/03/2023

And should be pulling latest:

tag
type
digest
date

6.0-focal
OCI Image Index
sha256:d45a9a129eceb58ce018eced364d29959514ebfb096fcc71a375b719693bf7cb
05/30/2024

Also imports Microsoft signing keys to fix gpg error
# Import Microsoft Signing Keys
# https://learn.microsoft.com/dotnet/core/install/linux-ubuntu#unable-to-locate--some-packages-could-not-be-installed
RUN sudo apt-get install -y gpg wget \
    && wget https://packages.microsoft.com/keys/microsoft.asc \
    && cat microsoft.asc | gpg --dearmor -o microsoft.asc.gpg \
    && sudo mv microsoft.asc.gpg /etc/apt/trusted.gpg.d/ \
    && sudo chown root:root /etc/apt/trusted.gpg.d/microsoft.asc.gpg

Background on failure
The deployment errors out seemingly due to docker-outside-of-docker. Not sure if this is the cause or just a symptom of the failure.

5.546 W: GPG error: https://packages.microsoft.com/ubuntu/20.04/prod focal InRel
ease: The following signatures couldn't be verified because the public key is no
t available: NO_PUBKEY EB3E94ADBE1229CF
5.546 E: The repository 'https://packages.microsoft.com/ubuntu/20.04/prod focal
InRelease' is not signed.
5.547 ERROR: Feature "Docker (docker-outside-of-docker)" (ghcr.io/devcontainers/
features/docker-outside-of-docker) failed to install! Look at the documentation
at https://github.com/devcontainers/features/tree/main/src/docker-outside-of-doc
ker for help troubleshooting this error.

It looks like the docker outside of docker feature install.sh only imports the Microsoft signing keys if Moby is used:
https://github.com/devcontainers/features/blob/414d3450434b9072f01afe80cab226c60088224a/src/docker-outside-of-docker/install.sh#L215-L229
I do notice the Sample project I'm using doesn't provide a Moby property, which per docker outside of docker docs, moby should be true by default. Not sure why the key setup isn't working.
https://github.com/Azure-Samples/azure-sql-library-app-blazor/blob/0a1ba8c97744d887f209d95c7f932ddf0eb8b04c/.devcontainer/devcontainer.json#L59-L61
		"ghcr.io/devcontainers/features/docker-outside-of-docker:1": {
			"version": "latest"
		}

Does this introduce a breaking change?
By staying at .net 6 and Ubuntu 20.04 (focal), this is a non-breaking change.
[ ] Yes
[X] No

Pull Request Type
What kind of change does this Pull Request introduce?

[X] Bugfix
[ ] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Documentation content changes
[ ] Other... Please describe:

How to Test

Pull latest code from this commit
"Open Folder in Container"
Operation should now succeed without signature failure because latest dotnet image is used.

Merge #9 in first to see if fixing the pre-req scripts (which also include importing microsoft signing keys) fixes the root of the issue


[FIX] Update embedding script

Description
Fix a few issues found in the embedding script:

some documentation is outdated
params_path is actually not passed to the object
fix hardcoded indices in text processing
display actual text used for getting the embedding (after truncation)
(not a bug) add support for sentence-piece vocab
(not a bug) drop py2 specific code

Checklist
Essentials

[ ] PR's title starts with a category (e.g. [BUGFIX], [MODEL], [TUTORIAL], [FEATURE], [DOC], etc)
[ ] Changes are complete (i.e. I finished coding on this PR)
[ ] All changes have test coverage
[ ] Code is well-documented

Changes

[ ] Feature1, tests, (and when applicable, API doc)
[ ] Feature2, tests, (and when applicable, API doc)

Comments

If this change is a backward incompatible change, why must this change be made.
Interesting edge cases to note here

cc @dmlc/gluon-nlp-team

Job PR-1046/1 is complete.
Docs are uploaded to http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR-1046/1/index.html

Job PR-1046/2 is complete.
Docs are uploaded to http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR-1046/2/index.html

Job PR-1046/3 is complete.
Docs are uploaded to http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR-1046/3/index.html

Job PR-1046/4 is complete.
Docs are uploaded to http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR-1046/4/index.html

[2019-12-16T06:10:48.189Z] mxnet.base.MXNetError: [05:43:31] src/io/local_filesys.cc:209: Check failed: allow_null:  LocalFileSystem::Open "~/.mxnet/models/bert_12_768_12_book_corpus_wiki_en_uncased-75cc780f.params": No such file or directory

Job PR-1046/5 is complete.
Docs are uploaded to http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR-1046/5/index.html


remove: convertndstopanes

The panes have been converted in the parent commits!

Codecov Report

Merging #819 (71dd6b5) into feat/dynamic-paradigms (5e227fe) will increase coverage by 1.25%.
The diff coverage is n/a.

@@                    Coverage Diff                     @@
##           feat/dynamic-paradigms     #819      +/-   ##
==========================================================
+ Coverage                   79.40%   80.66%   +1.25%
==========================================================
  Files                         103      102       -1
  Lines                        4167     4065     -102
  Branches                      625      605      -20
==========================================================
- Hits                         3309     3279      -30
+ Misses                        739      669      -70
+ Partials                      119      117       -2

Impacted Files
Coverage Δ

.../search_quality/management/commands/featuredump.py
32.69% <0.00%> (ø)

...ranslate/management/commands/translatewordforms.py
73.17% <0.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5e227fe...71dd6b5. Read the comment docs.


Feature Request: Allow specifying the listen address

Today, it is hardcoded to listen on "localhost". I'm in an environment where I do remote development, so my browser is not on the same server as the code running. I'm also unable to do ssh port forwarding because of server configs.
I would suggest adding an addition command line argument to specify an address (for example, <IP_ADDRESS> to listen on all ipv4 addresses). This would allow starting httpdbg up, and then allowing remote fetching of the web interface.

Hello,
It looks doable. I will implement it.
cle.

I added a new command line argument, --host, to configure the address on which the internal web server will listen.
To start httpdbg with a web server that listens on all IPv4 addresses and a different port:
pyhttpdbg --host <IP_ADDRESS> --port 5000

@TheLocehiliosan I hope this will help you to use httpdbg.
documentation

Outstanding! I suspect this will be helpful to many people.
Thanks.

New option available in httpdbg v0.23.0.


Update the user_modelled_crossing_fixes.csv bcfishpass file with all we know

the modelled crossing on Stock Creek right by the highway (need to figure out the modelled xing id) needs to go in here as it does not exist
https://github.com/smnorris/bcfishpass/blob/main/data/user_modelled_crossing_fixes.csv

This was dealt with via commit linked here that was merged into Simons repo


VS2022, .Net 4.8, ModelEditor

Hi, can I use

VS2022
.net 4.8 Projects
and the Xpand.XAF.ModelEditor?

what is the error u get?

I don´t know how to install/use the Xpand ModelEditor

u r not helping much
https://github.com/eXpandFramework/Reactive.XAF/tree/master/tools/Xpand.XAF.ModelEditor

what u tried and failed from that wiki

the cspoj must be sdk format there is no other option there

I got this error. But my projects are for .net Framework 4.81

it is  not supported as per message the project is online though feel free to compile it and remove the restriction you might be lucky and the problems do not apply to your case

hi @CWolffIF, did you find a solution?

hi @vimarx
No. we are still on VS2019

so how you open your model now? at least the native .netcore ME works fine in all my projects since the latest update?

feel free to compile it and remove the restriction you might be lucky and the problems do not apply to your case

did u tried this suggestion


Crash when changing desktop background

Ambie crashes when:

The desktop background automatically changes per Windows user settings.
The user right-clicks the desktop background and selects "Next desktop background"

(I already mentioned this in another post, but now I'm able to replicate it again)

Wow! Ambie crashes when you change your desktop wallpaper?! that's a crazy interesting bug. I will investigate soon! Thank you for creating an issue!

@dpaulino Thank you for the super fast response! I'm truly enjoying your app, so reporting an issue is the least I could do!  🤓👍

@Jude24to25 I am trying to reproduce the issue but it seems I can't. Can you still reproduce this with version 2.0.4?

@dpaulino I had the app crash today twice when I did the "next background" function. However, I was not able to reproduce it after that. Normally the way I use the app is I have the app playing, another music app playing, and the Windows Dolby Atmos plugin. I have also been using a remote screen software (Luna beta), so it could be that maybe that is contributing somehow. Over the next few days, I'll see if I can figure out if there are any particular conditions that need to be present to reproduce the bug, and then I'll get back to you! 🤓👍

@dpaulino Just as a heads up, I experienced the crash with v<IP_ADDRESS> after doing the "next background" function. I'll keep trying to see if I can figure out the exact circumstances, though I had the same setup as described in my previous post

@Jude24to25 what OS build are you running? For example, here's my machine

I'm on: Version 21H1 (OS Build 19043.1081)

I can confirm the issue is still present in v<IP_ADDRESS>.
The app crashed, even when it was the only app playing, and without any Dolby Atmos sound enabled. I restarted the computer, and the app crashed again when I did "Next Background". The problem is that it's not consistent. Sometimes it crashes when I do "Next Background", and sometimes it does not.

@Jude24to25 are you still having issues? If so, would be great to have a video recording!

@dpaulino Yeah, I'm still experiencing the issue. However, I can't seem to scientifically reproduce it. I tried recording it just a moment ago, but the issue wasn't happening. And then I stopped trying to record it, and then it happened, LOL. Also, I should mention that I've had the issue on a Windows 11 computer; however, I also cannot scientifically reproduce it. Is there any bug-reporting process that we can implement that will collect crash data and send it?

Does this still repro?