Remove Ecommerce Events (close #329)

I am a bit unsure whether we can already remove the old ecommerce events. It might be better for two things to happen (or at least one of them):

We update the currency conversion enrichment to work with the new Snowplow ecommerce events.
We implement APIs for the new Snowplow ecommerce events in the Python tracker.

Otherwise we are removing functionality without providing an alternative which makes me a bit nervous. So I would suggest keeping this PR open for maybe v2 of the tracker? But happy to discuss if there are other opinions.

I wasn't initially aware the ecom events were linked to the currency enrichment, so this makes sense.
In the JS tracker I think we added an enhanced ecom API, could we do something similar for Python, and add a line in the ecom event deprecation notices to use the enhanced events?

The enhanced ecommerce is already outdated, but we have the recent Snowplow Ecommerce that is a new plugin in the JS tracker (also in an accelerator) which we could also add here. We are currently adding it to the mobile trackers. Would be nice to have it everywhere but I think it's a larger task that needs some planning.


URL is not valid

Hi Rose,
Thanks for the app., that's exactly what I was lookinf for, although I am struggling with the URL which I share with you.
In the browser I get the file 18k... not too big?
I can't figure out the issue.
https://www.xpfi.online/Data/0001/Clients.csv
Could you help?
Thanks in advance.
Frédéric.

Oh I think the .online was being caught as an error in my URL validation regex. I've changed it now so it just shows a warning if it doesn't match. Try it out again, and if it doesn't work for you please re-open!


Apply random numbering to projects

Hashtags are used for numbering the projects in an unobstrusive way. Done properly, this also allows listing the projects by number in the Event page and Backboard. Currently, the automatic numbering of projects or challenges is done from the CLI. It is regularly desired by organizers, and should be a feature of the Web admin.
Consider the use of a separate field (e.g. identifier, max 3 characters), rather than hashtags, for numbering schemes.
Additionally, it should be possible to clear the numbering automatically.

We already have the numbering function, it is just not accessible yet to administrators via the UI.


github workflows added

closes #25

@LegendSumeet please add the hard and iwoc24 tag on both issue and PR before merging so that it counts on my dashboard if you like my work. Thanks


cert-inspection: add GatherCertsFromPlatformNamespaces, PKIRegistryInfo

This adds few functions used in e2e test (from https://github.com/openshift/origin/pull/28222)

minor comments, lgtm otherwise.

/lgtm

/approve


Add the option for Pod Annotations.

What this PR does / why we need it:
This adds the ability to add Pod annotations. This is needed for adding (for instance) Prometheus scrape annotations.

/assign @scottrigby

/assign

/ok-to-test

/lgtm


Minimal changes required for the project to work when deployed to AWS

Issue #, if available:
Issue 2
Description of changes:
Adding suitable IAM permissions to the Lambda functions
Adding a suitable memory allocation to the Lambda functions
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

I've run the tests locally and remotely.


Feature/updates

update elixir/otp ver

beta3
beta4

bump to beta4 LD lib
speed up dialyzer github action runs

Those tests all pass, this appears to be a communication bug in github with prs <-> actions.


User Accounts that have MFA

What's missing from this content is how to handle MFA / Aggressive timeout policies as this also affects Connectors for Flows that are using your credentials. I am always having to re-login to Connectors because of our MFA / login timeouts. There is mention of Service Accounts but the advice is to NOT use them. So how do we work around this problem?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 97bf9b6c-5628-f18c-7027-45b21eb3b6bc
Version Independent ID: a4394ad5-9d46-2a6d-16d9-48b0c88fb401
Content: Learn to connect to your data using connections and on-premises data gateways - Microsoft Flow
Content Source: flow-docs/add-manage-connections.md
Service: flow
GitHub Login: @stepsic-microsoft-com
Microsoft Alias: stepsic

@roscocheeta  Thanks for your feedback. I'll follow up with the team and get back to you on this.

Any updates on this @MSFTMan ?

@roscocheeta Thanks for following up. I discussed with the team. Currently the timeout period for MFA and OAuth is 5 minutes. So we can help better, can you let us know: under what conditions are you encountering this timeout? Do you have specific steps we can try to reproduce this issue to understand it better?

@roscocheeta Thanks for following up. I discussed with the team. Currently the timeout period for MFA and OAuth is 5 minutes. So we can help better, can you let us know: under what conditions are you encountering this timeout? Do you have specific steps we can try to reproduce this issue to understand it better?

I observed this issue using a Flow that connects to Outlook and Forms. I observed every few weeks the Forms connector stops working and asks me "re-sign in" to re-authenticate that connector.
I've also contacted my IT Department to see if they can look into it. I would note there are some forum posts on the Flows community forum about MFA affecting connectors. Some have found a workaround by whitelisting / trusting IP's for a particular user account, but don't think our Security team will allow that!

@roscocheeta Thanks for following up. I discussed with the team. Currently the timeout period for MFA and OAuth is 5 minutes. So we can help better, can you let us know: under what conditions are you encountering this timeout? Do you have specific steps we can try to reproduce this issue to understand it better?

I observed this issue using a Flow that connects to Outlook and Forms. I observed every few weeks the Forms connector stops working and asks me "re-sign in" to re-authenticate that connector.
I've also contacted my IT Department to see if they can look into it. I would note there are some forum posts on the Flows community forum about MFA affecting connectors. Some have found a workaround by whitelisting / trusting IP's for a particular user account, but don't think our Security team will allow that!

Thanks @roscocheeta. I'll follow up with the team on this.

I just wanted to comment to let you know I am having the same issue. We also have MFA, and to my knowledge, didn't change any of the "default" settings when we activated MFA. I look forward to hearing a solution to this issue outside of whitelisting IPs. This is especially true since it would require bumping to a higher subscription level in order to have the capability to whitelist.

We were having the same problem and it was fixed by assigning the MaxAgeMultipfactor policy described in this document.
https://docs.microsoft.com/en-us/azure/active-directory/develop/active-directory-configurable-token-lifetimes
New-AzureADPolicy -Definition @('{"TokenLifetimePolicy":{"Version":1,"MaxAgeMultiFactor":"until-revoked","MaxAgeSessionMultiFactor":"3.00:00:00"}}') -DisplayName "DefaultPolicyScenario" -IsOrganizationDefault $true -Type "TokenLifetimePolicy"

@LC-1  @roscocheeta , does @oberjc solution work for you?

We were having the same problem and it was fixed by assigning the MaxAgeMultipfactor policy described in this document.
https://docs.microsoft.com/en-us/azure/active-directory/develop/active-directory-configurable-token-lifetimes
New-AzureADPolicy -Definition @('{"TokenLifetimePolicy":{"Version":1,"MaxAgeMultiFactor":"until-revoked","MaxAgeSessionMultiFactor":"3.00:00:00"}}') -DisplayName "DefaultPolicyScenario" -IsOrganizationDefault $true -Type "TokenLifetimePolicy"

This is the recommended policy. Thank you.

@roscocheeta Good news: This issue is now fixed so you should no longer see it. Thanks for using Microsoft Flow.


Add SSL Support

FYI to anyone who wants this support. We are waiting for Dart 1.13 before merging this, as 1.13 will support BoringSSL, which makes this super easy to support when working with providers like compose.io.

1.13 is out now, so I will be getting this up and running soon!


fix: very_good test fails when some tests have a space in their golden name

Description
When running very_good test in a flutter repository which have golden tests, the commands fails to find the correct golden.
Steps To Reproduce

Create a sample app with very_good create example
Replace the renders CounterView test in test/counter/view/counter_page_test.dart by:

testWidgets('renders CounterView', (tester) async {
  await tester.pumpApp(const CounterPage());
  expect(find.byType(CounterView), findsOneWidget);

  await expectLater(
    find.byType(CounterView),
    matchesGoldenFile('counter page.png'),
  );
});

Generate golden with flutter test --update-goldens
Run very_good test and see this error:

══╡ EXCEPTION CAUGHT BY FLUTTER TEST FRAMEWORK ╞═══════════════════════
The following StateError was thrown running a test:
Bad state: No element

When the exception was thrown, this was the stack:
#0      ListMixin.singleWhere (dart:collection/list.dart:202:5)
#1      _TestOptimizationAwareGoldenFileComparator.getTestUri (file:///[path-to-the-project]/test/.test_runner.dart:46:10)
#2      MatchesGoldenFile.matchAsync (package:flutter_test/src/_matchers_io.dart:50:50)
#3      _expect (package:test_api/src/expect/expect.dart:98:26)
#4      expectLater (package:test_api/src/expect/expect.dart:62:5)
#5      expectLater (package:flutter_test/src/widget_tester.dart:497:23)
#6      main.<anonymous closure>.<anonymous closure> (file:///[path-to-the-project]/test/counter/view/counter_page_test.dart:25:13)
<asynchronous suspension>
<asynchronous suspension>
(elided one frame from package:stack_trace)

The test description was:
  renders CounterView

Expected Behavior
The expected behavior is for the command very_good test to succeed.
Additional Context
When debugging, I found the getTestUri helper in the _TestOptimizationAwareGoldenFileComparator class:
Uri getTestUri(Uri key, int? version) {
  final keyString = key.path;
  return Uri.parse(goldenFilePaths.singleWhere((goldenFilePath) => goldenFilePath.endsWith(keyString)));
}

By adding a breakpoint in this function, I found that the keystring was counter%20page.png whereas the goldenFilePaths list in which are all the golden paths contains the following element: [path-to-the-project]/test/counter/view/counter page.png.
So in one case we have a %20 and in the other a space, which leads the Uri.parse(goldenFilePaths.singleWhere((goldenFilePath) => goldenFilePath.endsWith(keyString))) line to throw an error as no element is found.
I don't know if the approach for a fix would be to store all the golden paths with a %20 instead of spaces or to replace all the %20 in the keystring of the getTestUri method?
Thank you for your time!

@Kirpal can you comment on this so we can assign you?

Yeah, it's PR #651


CRD apiVersion for stable features running in production should be v1beta1

Describe the feature you'd like to have
The CSI operator CRDs should be v1 instead of v1alpha1 when we expect it to be running in production.
The conversation was started in the csi operator design doc here, but it was marked resolved after some offline conversation without documenting the reasoning. Let's discuss openly on the expectation for v1.
Who is the end user and what is the use case where this feature will be valuable?
Users look at CRD stability for a clue if it is production ready.
We are taking a stable CSI driver and moving the settings to a stable CSI operator where we expect it to quickly be used in production. Production users will expect a stable version, even though it's new.
Many users may not care about the api version as long as we claim to support it, but some users will look at an alpha version and refuse to run it in production. For Rook upstream I consider it a blocker to use alpha CRDs in production deployments.
If we are anyway supporting it in production, we have to provide full support for all of our customers, for all new and upgraded clusters, with full feature parity for all customized settings. To me, that is the definition of v1, not alpha. Why not just ship with v1 now? Then we don’t have to worry about conversion to v1 later. As suggested, we expect stability from the start if we are putting it in production.
And if we are supporting alpha in production, let's define the blocking criteria for moving it to v1.

After some offline discussion, the blocker for declaring stable upstream would be to declare at least v1beta1.


Improve ambient occlusion algorithm in situations where scene depth range is very deep

In certain situations where the scene depth range is very deep, the iTwin.js ambient occlusion algorithm could produce a jarring striping effect.  This was due to a loss of precision caused by representing such a large range of floating point values in a packed byte buffer.  This large depth range often happens when the background map is enabled and the view angle is very low, looking at the horizon.  We can resolve this issue by instead using a real logZ floating point depth texture (when possible).  If that is unavailable, we fall back to the old approach.
Before:

After:

Performance appears the same:
Resolution  Dataset             FPS (Old AO)     FPS (New AO)
1080p       small_building      41.31            41.34
1080p       BGRFull             18.38            18.39

Did you test disabling one or both of the required extensions in display-test-app (using IMJS_DISABLED_EXTENSIONS) to confirm it renders as before (warts and all)?

@pmconne I tested the alternate path manually (forcing it in the AmbientOcclusion.ts file), but did not use IMJS_DISABLED_EXTENSIONS to do so.  I'll do that.

Did you test disabling one or both of the required extensions in display-test-app (using IMJS_DISABLED_EXTENSIONS) to confirm it renders as before (warts and all)?

@pmconne I tested the alternate path manually (forcing it in the AmbientOcclusion.ts file), but did not use IMJS_DISABLED_EXTENSIONS to do so. I'll do that.

@pmconne Tested - all seems reasonable.


Add loaddata command and some related changes

Downloads a database dump from S3 and runs it on the environment RDS instance.
Runs Elasticsearch import script from the digitalmarketplace-api repository with environment API and Elasticsearch as arguments.
A lot of this will change once we have write endpoints on api and search-api that would allow loading data throught them instead of using the databases directly.

Some of the commit messages could benefit from a bit of explanation to why they're being done. For example, using the KeyName type; was it causing a specific problem or was this just to use a more specific type? git styleguide

@robyoung no idea how it's actually different from String tbh, I saw there was a separate type for keys, so I changed the templates. I've read the style guide before.

That in itself is useful information.

Rebased and fixed merge conflict on KeyName type change


Feature Support drop resource group

Proposed changes
Issue Number: https://github.com/apache/doris/issues/18098
Problem summary
DROP RESOURCE GROUP group_name;

Checklist(Required)

[ ] Does it affect the original behavior
[x] Has unit tests been added
[ ] Has document been added or modified
[ ] Does it need to update dependencies
[x] Is this PR support rollback (If NO, please explain WHY)

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

run buildall

run buildall

run buildall

run buildall

run buildall

run buildall

TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 33.96 seconds
stream load tsv:          423 seconds loaded<PHONE_NUMBER>9 Bytes, about 168 MB/s
stream load json:         24 seconds loaded<PHONE_NUMBER> Bytes, about 93 MB/s
stream load orc:          58 seconds loaded<PHONE_NUMBER> Bytes, about 18 MB/s
stream load parquet:          30 seconds loaded 861443392 Bytes, about 27 MB/s
https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230421112005_clickbench_pr_132510.html

run buildall

run buildall

run buildall

run buildall


Cassandra 3.0.0 support

With Cassandra having released an RC2 for 3.0.0, the final is getting close. What are the plans for supporting this? Any assessment done on the impact, as well as expectations for when it would land?
Currently assessing to use phantom for our production, hence the question.

Hi @pjan,
Cassandra 3.0.0 will definitely be supported but it's not on the roadmap as of yet until the Java Driver also hits a good milestone release. As adopting the very bleeding edge of Cassandra is highly unlikely to be high priority for any large consumer, it will take perhaps weeks to see this through.
Hope this answers your question!
Regards.

https://github.com/datastax/java-driver/tree/3.0.0

Hi @phact,
We are already running a 3.0.0 milestone release, we will bump to final very shortly.
Regards.

What is the ETA?

HI @Konstantin-Skachkov,
This is already out, both 1.22.0 on Maven Central and 1.24.0 on Bintray are compatible with Cassandra 3.0.
Regards.


Problems caused by “fliplr” in the Matlab program (SGMD.m).

It can be noted that when using the matlab program to decompose the simulated signal with noise (5 dB), the initial single components are sorted by energy from largest to smallest, and “fliplr” breaks this distribution so that the program cannot get the correct results.
However, it can also be noted that when decomposing the noise-free signal, the initial single components are sorted by energy from smallest to largest and need to be flipped using “fliplr”.
Therefore, a temporary solution is provided by determining the standard deviation of the first and last columns of the initial single component to determine whether it is flipped or not.
if std(sgc(:,end)) > std(sgc(:,1))     y = fliplr(sgc); else     y = sgc; end

The exact cause of the problem is unclear, so only a temporary solution is provided, where the standard deviation of the first and last columns of the initial single component is compared to determine whether it is flipped or not.


Revise comments, polish things, make NPS great again

This PR basically goes through the comments and cleans some of them up, clarifying where possible and rewriting some that are.. questionable. It also does some minor re-arrangement and also tries to do some consistency such as the if/else checks  (although no code is 100% consistent IMO, there's always bound to be stuff needing polish). Example if else:
if(Potato()) {
  DoSomething();
}

...becomes...
if(Potato())
  DoSomething();

I honestly don't know if braces mean anything for the if/else statements that do one thing when it gets compiled but I thought I recall someone saying "for if/else that do one thing, don't bother with braces, but add them for conditions that multiple things need to be done".
I am completely fine with this PR being rejected, it's main goal is to make it easier to understand and explain to someone who many not be 100% fluent in the subject what functions do what. Oh, and a free spelling check too.

merged here https://github.com/James-Frowen/NetworkPositionSync/commit/8ec750805920d897971c9400adb48f38fcfebc63


chore(main): release 1.5.0

:robot: I have created a release beep boop
1.5.0 (2023-01-19)
Features

更新首页组件、商品详情，修复登录状态检测 (4483592)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/mason369/Knock-Ding-Yanxuan/releases/tag/v1.5.0 :sunflower:


Vula

With zero configuration, Vula automatically encrypts IP communication between hosts on a local area network in a forward-secret and transitionally post-quantum manner to protect against passive eavesdropping.
With manual key verification and/or automatic key pinning and manual resolution of IP or hostname conflicts, Vula will additionally protect against interception by active adversaries.
When the local gateway to the internet is also Vula peer, internet-destined traffic will also be encrypted on the LAN.

Website: https://vula.link/
source: https://codeberg.org/vula/vula
installation instructions: https://codeberg.org/vula/vula/src/branch/main/INSTALL.md
hacking instructions: https://codeberg.org/vula/vula/src/branch/main/HACKING.md

Thanks for helping to package vula!
Last week we tagged a new vula release that could be packaged immediately. However we're also working on a major upgrade that will change a key dependency by replacing sibc with libhighctidh. It will be less work if whoever is packaging the software is able to wait until the next tag is ready.
We expect to have libhighctidh ready for release by the end of today and then a new release of vula should be tagged by the end of this week.

In my initial attempt I quickly found out that the dependencies "sibc" and "ggwave" appear to not be packaged in Nixpkgs. Since @ioerror commented that "sibc" might be replaced by another dependency in a newer version soon, I suggest to postpone further work until a version that does not depend on "sibc" is released.
See https://github.com/ngi-nix/ngipkgs/pull/97

We'll need to package libhighctidh, and ggwave after we complete the transition from sibc. The ggwave  dependency is a soft dependency for desktop or server vula deployments with sound hardware capabilities while the libhighctidh is a hard dependency that is required for basic operation in all cases.

We'd prefer to only have packages that include ggwave  but if it was a question of a package vs none, and later iterating towards a better package, a few dependencies could be made optional and the core software could still function. Examples that come to mind include pstray, ggwave, and anything with the GUI. For a headless server, only ggwave could even be used among those three but in that case it would need audio hardware.
For the next vula release tag, we'll look carefully at PEP 621/631 to see if anything  could be made optional in addition to those three packages.

Sweet. I think none of the NGIpkgs contributors would object to packaging vula, even if it unconditionally depends on ggwave. It's more of a comment/wish than a requirement, really, so don't let it slow you down.
Nix does support having two flavours of the package (say, one for "headless" operation, that depends on ggwave, and one for "desktop" operation, that does not depend on ggwave) and most people like to keep things slim. Scenarios would be installing vula on a small home server, Raspberry Pi, etc.

The new vula dependency highctidh that will soon replace sibc  in vula has been tagged and released:
https://codeberg.org/vula/highctidh/releases/tag/v1.0.2023112000
https://pypi.org/project/highctidh/

We have tagged and released new versions of vula and vula_libnss which should now be ready for packaging:
https://codeberg.org/vula/vula/releases/tag/v0.2.2023112400
https://codeberg.org/vula/vula_libnss/releases/tag/0.0.2023112400

@fricklerhandwerk I packaged highctidh and bumped vula to a version that uses it. These changes are at #97. The PR is still in draft because I'd like to add a NixOS module (based on the systemd unit files that come with Vula) and a NixOS test.

@fricklerhandwerk I improved the vula package to patch upstream systemd configuration files so that they can be consumed via systemd.packages and added a module that does this. The NixOS test that consumes the module however still gives some trouble: I can't start Vula because of DBus errors.
Investigating...

systemd[1]: vula-discover.service: Scheduled restart job, restart counter is at 16.
systemd[1]: Starting vula service discovery daemon...
vula[1106]: Traceback (most recent call last):
vula[1106]:   File "/nix/store/…-vula-0.2.2023112801/bin/.vula-wrapped", line 9, in
vula[1106]:     sys.exit(main())
vula[1106]:              ^^^^^^
vula[1106]:   File "/nix/store/…-python3.11-click-8.1.7/lib/python3.11/site-packages/click/core.py", line 1157, in __call__
vula[1106]:     return self.main(*args, **kwargs)
vula[1106]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^
vula[1106]:   File "/nix/store/…-python3.11-click-8.1.7/lib/python3.11/site-packages/click/core.py", line 1078, in main
vula[1106]:     rv = self.invoke(ctx)
vula[1106]:          ^^^^^^^^^^^^^^^^
vula[1106]:   File "/nix/store/…-vula-0.2.2023112801/lib/python3.11/site-packages/vula/notclick.py", line 124, in invoke
vula[1106]:     raise ex
vula[1106]:   File "/nix/store/…-vula-0.2.2023112801/lib/python3.11/site-packages/vula/notclick.py", line 103, in invoke
vula[1106]:     return super(Debuggable, self).invoke(ctx)
vula[1106]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vula[1106]:   File "/nix/store/…-python3.11-click-8.1.7/lib/python3.11/site-packages/click/core.py", line 1688, in invoke
vula[1106]:     return _process_result(sub_ctx.command.invoke(sub_ctx))
vula[1106]:                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vula[1106]:   File "/nix/store/…-python3.11-click-8.1.7/lib/python3.11/site-packages/click/core.py", line 1434, in invoke
vula[1106]:     return ctx.invoke(self.callback, **ctx.params)
vula[1106]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vula[1106]:   File "/nix/store/…-python3.11-click-8.1.7/lib/python3.11/site-packages/click/core.py", line 783, in invoke
vula[1106]:     return __callback(*args, **kwargs)
vula[1106]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
vula[1106]:   File "/nix/store/…-vula-0.2.2023112801/lib/python3.11/site-packages/vula/discover.py", line 232, in main
vula[1106]:     Discover.daemon(**kwargs)
vula[1106]:   File "/nix/store/…-vula-0.2.2023112801/lib/python3.11/site-packages/vula/discover.py", line 186, in daemon
vula[1106]:     process = system_bus.get(
vula[1106]:               ^^^^^^^^^^^^^^^
vula[1106]:   File "/nix/store/…-python3.11-pydbus-0.6.0/lib/python3.11/site-packages/pydbus/proxy.py", line 44, in get
vula[1106]:     ret = self.con.call_sync(
vula[1106]:           ^^^^^^^^^^^^^^^^^^^
vula[1106]: gi.repository.GLib.GError: g-dbus-error-quark: GDBus.Error:org.freedesktop.DBus.Error.ServiceUnknown: The name local.vula.organize was not provided by any .service files (2)
systemd[1]: vula-discover.service: Main process exited, code=exited, status=1/FAILURE
systemd[1]: vula-discover.service: Failed with result 'exit-code'.
systemd[1]: Failed to start vula service discovery daemon.
systemd[1]: Starting vula organize service...
vula[1120]: 2023-12-22-12:23:32: Keys file not found
vula[1120]: 2023-12-22-12:23:32: Generating keys...
wireguard: WireGuard 1.0.0 loaded. See www.wireguard.com for information.
wireguard: Copyright (C) 2015-2019 Jason A. Donenfeld<EMAIL_ADDRESS>All Rights Reserved.
vula[1120]: 2023-12-22-12:23:32: Couldn't load state file: FileNotFoundError(2, 'No such file or directory')
vula[1120]: Traceback (most recent call last):
vula[1120]:   File "/nix/store/…-vula-0.2.2023112801/bin/.vula-wrapped", line 9, in
vula[1120]:     sys.exit(main())
vula[1120]:              ^^^^^^
vula[1120]:   File "/nix/store/…-python3.11-click-8.1.7/lib/python3.11/site-packages/click/core.py", line 1157, in call
vula[1120]:     return self.main(*args, **kwargs)
vula[1120]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^
vula[1120]:   File "/nix/store/…-python3.11-click-8.1.7/lib/python3.11/site-packages/click/core.py", line 1078, in main
vula[1120]:     rv = self.invoke(ctx)
vula[1120]:          ^^^^^^^^^^^^^^^^
vula[1120]:   File "/nix/store/…-vula-0.2.2023112801/lib/python3.11/site-packages/vula/notclick.py", line 124, in invoke
vula[1120]:     raise ex
vula[1120]:   File "/nix/store/…-vula-0.2.2023112801/lib/python3.11/site-packages/vula/notclick.py", line 103, in invoke
vula[1120]:     return super(Debuggable, self).invoke(ctx)
vula[1120]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vula[1120]:   File "/nix/store/…-python3.11-click-8.1.7/lib/python3.11/site-packages/click/core.py", line 1688, in invoke
vula[1120]:     return _process_result(sub_ctx.command.invoke(sub_ctx))
vula[1120]:                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vula[1120]:   File "/nix/store/…-python3.11-click-8.1.7/lib/python3.11/site-packages/click/core.py", line 1666, in invoke
vula[1120]:     rv = super().invoke(ctx)
vula[1120]:          ^^^^^^^^^^^^^^^^^^^
vula[1120]:   File "/nix/store/…-python3.11-click-8.1.7/lib/python3.11/site-packages/click/core.py", line 1434, in invoke
vula[1120]:     return ctx.invoke(self.callback, **ctx.params)
vula[1120]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vula[1120]:   File "/nix/store/…-python3.11-click-8.1.7/lib/python3.11/site-packages/click/core.py", line 783, in invoke
vula[1120]:     return __callback(*args, **kwargs)
vula[1120]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
vula[1120]:   File "/nix/store/…-python3.11-click-8.1.7/lib/python3.11/site-packages/click/decorators.py", line 33, in new_func
vula[1120]:     return f(get_current_context(), *args, **kwargs)
vula[1120]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vula[1120]:   File "/nix/store/…-vula-0.2.2023112801/lib/python3.11/site-packages/vula/notclick.py", line 203, in wrapper
vula[1120]:     instance = callback(*a, **kw)
vula[1120]:                ^^^^^^^^^^^^^^^^^^
vula[1120]:   File "/nix/store/…-python3.11-click-8.1.7/lib/python3.11/site-packages/click/decorators.py", line 33, in new_func
vula[1120]:     return f(get_current_context(), *args, **kwargs)
vula[1120]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vula[1120]:   File "/nix/store/…-vula-0.2.2023112801/lib/python3.11/site-packages/vula/organize.py", line 577, in init
vula[1120]:     self.run(monolithic=False)
vula[1120]:   File "/nix/store/…-vula-0.2.2023112801/lib/python3.11/site-packages/vula/organize.py", line 795, in run
vula[1120]:     system_bus.publish(_ORGANIZE_DBUS_NAME, self)
vula[1120]:   File "/nix/store/…-python3.11-pydbus-0.6.0/lib/python3.11/site-packages/pydbus/publication.py", line 42, in publish
vula[1120]:     return Publication(self, bus_name, *objects)
vula[1120]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vula[1120]:   File "/nix/store/…-python3.11-pydbus-0.6.0/lib/python3.11/site-packages/pydbus/publication.py", line 35, in init
vula[1120]:     self._at_exit(bus.request_name(bus_name, allow_replacement=allow_replacement, replace=replace).exit)
vula[1120]:                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vula[1120]:   File "/nix/store/…-python3.11-pydbus-0.6.0/lib/python3.11/site-packages/pydbus/request_name.py", line 29, in request_name
vula[1120]:     return NameOwner(self, name, allow_replacement, replace)
vula[1120]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vula[1120]:   File "/nix/store/…-python3.11-pydbus-0.6.0/lib/python3.11/site-packages/pydbus/request_name.py", line 8, in init
vula[1120]:     res = bus.dbus.RequestName(name, flags)
vula[1120]:           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vula[1120]:   File "/nix/store/…-python3.11-pydbus-0.6.0/lib/python3.11/site-packages/pydbus/proxy_method.py", line 72, in call
vula[1120]:     ret = instance._bus.con.call_sync(
vula[1120]:           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vula[1120]: gi.repository.GLib.GError: g-dbus-error-quark: GDBus.Error:org.freedesktop.DBus.Error.AccessDenied: Connection ":1.24" is not allowed to own the service "local.vula.organize" due to security policies in the configuration file (9)
systemd[1]: vula-organize.service: Main process exited, code=exited, status=1/FAILURE
systemd[1]: vula-organize.service: Failed with result 'exit-code'.
systemd[1]: Failed to start vula organize service.

@lorenzleutgeb is this closed by https://github.com/ngi-nix/ngipkgs/pull/97?

No, see https://github.com/ngi-nix/ngipkgs/pull/97#discussion_r1587243452

@lorenzleutgeb Are the patches to systemd service files something that we should consider for merging upstream?

@ioerror The patches we do apply so far are quite "mild" and mostly related to NixOS. But I'll keep to notify you in case we have something to upstream. Just for reference:

Exec=/bin/false is not compatible with NixOS since there's no /bin/false, we refer to coreutils in the Nix store explicitly.
ExecStart=vula relies on vula being in $PATH, again we use the Nix store to refer to the particular version of vula in the store, that is currently being built.

@ngi-nix/magic filed an issue upstream: https://codeberg.org/vula/vula/issues/49

We, the maintenance mobs Magic and Cake have been working on this.
We found the existing package not only have the issue reported above, but several more. Among them

The NixOS test file has no assertions.
The package contains no executable (no $out/bin).
The systemd services were not placed in the correct output path.
An extraneous systemd unit file (monolithic).
A required NSS module is missing from the service.
Upstream tests are not running in the checkPhase.
Systemd and dbus services are missing from the NixOS module.
An upstream issue has been identified and reported: https://codeberg.org/vula/vula/issues/49
Some dependencies  are missing.
Service discovery is not configured in the NixOS module.

Most of the above issues have been resolved. Here is a snapshot of the known remaining tasks:

Write NixOS tests.
Work with upstream to resolve issue.
Add more options to the module.
Clean up.

@A-jay98 it's good that you are improving on the current state. Thanks!

The systemd services were not placed in the correct output path.

Please elaborate. I believe that you are mistaken, see https://github.com/ngi-nix/ngipkgs/commit/ad2e9a5aa4e04a6d3155d7e33fb40d7e3f384cf8#r142089207

Systemd and dbus services are missing from the NixOS module.

What makes you think that? There is no explicit configuration, but they are loaded directly from the configuration provided by upstream, which you can then customize/override using systemd.services.
Upstream files are registered here:
https://github.com/ngi-nix/ngipkgs/blob/17c5cb68f553984d361bc1f3e1a49b3a55ebf296/projects/Vula/service.nix#L73
You might have broken this mechanism, see (again) https://github.com/ngi-nix/ngipkgs/commit/ad2e9a5aa4e04a6d3155d7e33fb40d7e3f384cf8#r142089207

The highctidh package produced today during the group development session seems useful to merge independently.

Wanted to update the team regarding where @GetPsyched and I left things today while wrapping up pairing with @ioerror:
Running the vula nixosTest:
$ nix build .#hydraJobs.tests.x86_64-linux.nixos.Vula.vula.driverInteractive -L
$ ./result/bin/nixos-test-driver
...
>>> start_all()
...
>>> run_tests()
...

Resulted in output from vula regarding an invalid descriptor:
...
a # [   54.231369] vula[797]: 2024-05-16-15:00:24: discover dropped invalid descriptor: {'r': '', 'pk': b'Zv9xR32f0FArb6wTLPcfHus/vQcrX3/fv9uRfMfbAhM=', 'c': b'qopkW/9Ih6KSNPrLJqIfcly5MwNqXYSA129Sr7BIbVqvfECJQwXHckXfL1Uq+3Sioh1maOypOZGrp71LRWJNYg==', 'addrs': b'<IP_ADDRESS>', 'vk': b'NVx3TrxYuuuytO0Ptc9wXK0bh9j54CAts3KDAkpJTl4=', 'vf': b'1715871624', 'dt': b'86400', 'port': b'5354', 'hostname': b'a.local.', 'e': b'False', 's': b'ZlcV8uUl5ItRanpKNYkI5SHx2xa9eI9OzwclFfObEm8AcrChuKwxLYyiTM92gxAgAm4cgL0GjhD54OpWUueXDg=='} (SchemaError("b'Zv9xR32f0FArb6wTLPcfHus/vQcrX3/fv9uRfMfbAhM=' is not 32 bytes or a 44-char base64 string which decodes to 32 bytes"))
...

Even though checking the SchemaError value of pk seems valid and is able to be decoded:
$ python3
Python 3.11.9 (main, Apr  2 2024, 08:25:04) [GCC 13.2.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> z = 'Zv9xR32f0FArb6wTLPcfHus/vQcrX3/fv9uRfMfbAhM='
>>> len(z)
44
>>> import base64
>>> base64.b64.decode(z)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
AttributeError: module 'base64' has no attribute 'b64'
>>> base64.b64decode(z)
b'f\xffqG}\x9f\xd0P+o\xac\x13,\xf7\x1f\x1e\xeb?\xbd\x07+_\x7f\xdf\xbf\xdb\x91|\xc7\xdb\x02\x13'
>>> len(base64.b64decode(z))
32

There were concerns around the python schema package version differences but the version of nixpkgs and vula are the same version 0.7.5: https://github.com/NixOS/nixpkgs/blob/ee4a6e0f566fe5ec79968c57a9c2c3c25f2cf41d/pkgs/development/python-modules/schema/default.nix#L12 and https://codeberg.org/vula/vula/src/branch/main/Pipfile.lock#L339-L345
We turned to enabling the full unittest suite of vula by passing pytest --doctest-modules. This was in hopes that a similar error would with the descriptor would be raised during the tests.  Called %s times.%s"
vula-unstable->                    % (self._mock_name or 'mock',
vula-unstable->                       self.call_count,
vula-unstable->                       self._calls_repr()))
vula-unstable-> >           raise AssertionError(msg)
vula-unstable-> E           AssertionError: Expected 'mock' to have been called once. Called 0 times.
vula-unstable-> /nix/store/lpi16513bai8kg2bd841745vzk72475x-python3-3.11.9/lib/python3.11/unittest/mock.py:918: AssertionError
vula-unstable-> =========================== short test summary info ============================
vula-unstable-> FAILED test/test_discover.py::TestWireGuardServiceListener::test_add_service_calls_callback - AssertionError: Expected 'mock' to have been called once. Called 0 times.
vula-unstable-> ======================== 1 failed, 105 passed in 1.54s =========================
vula-unstable-> /nix/store/558iw5j1bk7z6wrg8cp96q2rx03jqj1v-stdenv-linux/setup: line 1579: pop_var_context: head of shell_variables not a function context
error: builder for '/nix/store/aaj74i50m18vx9774vr317w81dgd3rks-vula-unstable-.drv' failed with exit code 1;
       last 10 log lines:
       >                       self.call_count,
       >                       self._calls_repr()))
       > >           raise AssertionError(msg)
       > E           AssertionError: Expected 'mock' to have been called once. Called 0 times.
       >
       > /nix/store/lpi16513bai8kg2bd841745vzk72475x-python3-3.11.9/lib/python3.11/unittest/mock.py:918: AssertionError
       > =========================== short test summary info ============================
       > FAILED test/test_discover.py::TestWireGuardServiceListener::test_add_service_calls_callback - AssertionError: Expected 'mock' to have been called once. Called 0 times.
       > ======================== 1 failed, 105 passed in 1.54s =========================
       > /nix/store/558iw5j1bk7z6wrg8cp96q2rx03jqj1v-stdenv-linux/setup: line 1579: pop_var_context: head of shell_variables not a function context
       For full logs, run 'nix log /nix/store/aaj74i50m18vx9774vr317w81dgd3rks-vula-unstable-.drv'.

In TestWireGuardServiceListener.test_add_service_calls_callback the following lines in this test are suspicious since there doesn't seem to be an actual callback and causes the assertion to fail:
listener = vula.discover.WireGuardServiceListener(callback)
listener.add_service(zeroconf, "test_type", "test_name")

@ioerror here is the command that I was running from https://github.com/ngi-nix/ngipkgs/tree/mob/vula-test branch to build the vula package and run the tests:
$ nix build .#vula -L

Additional Note: after installing nix make sure to enable flakes since they are needed to use this ngi repo but are experimental:
$ echo "experimental-features = nix-command flakes" > ./nix.conf && install -D ./nix.conf $HOME/.config/nix/nix.conf

Also here is a way to get the versions of the dependencies that we are using for vula:
$ nix repl
nix-repl> :lf .
Added 20 variables.

nix-repl> lib = inputs.nixpkgs.lib
nix-repl> versions = contents: lib.lists.naturalSort (lib.lists.forEach contents (x: lib.strings.getName x + ":" + lib.strings.getVersion x))

nix-repl> versions outputs.packages.x86_64-linux.vula.propagatedBuildInputs                                                    [ "click:8.1.7" "cryptography:42.0.5" "highctidh:1.0.2024050500" "hkdf:0.0.3" "packaging:24.0" "pillow:10.3.0" "pyaudio:0.2.14" "pydbus:0.6.0" "pygobject:3.48.2" "pynacl:1.5.0" "pyroute2:0.7.12" "pystray:0.19.2" "python3:3.11.9" "pyyaml:6.0.1" "qrcode:7.4.2" "schema:0.7.5" "setuptools:69.5.1" "tkinter:3.11.9" "zeroconf:0.132.2" ]

I believe the patch is the culprit for the error there; it misses restoring the original intend, which was to decode the v variable.
Using v.decode() fixes the test.
diff --git a/vula/discover.py b/vula/discover.py
index 08235d9..3fe41f7 100644
--- a/vula/discover.py
+++ b/vula/discover.py
@@ -68,7 +68,10 @@ class WireGuardServiceListener(ServiceListener):
         info: Optional[ServiceInfo] = zeroconf.get_service_info(s_type, name)
         if info is None:
             return
-        data = {k.decode(): v.decode() for k, v in info.properties.items()}
+
+        data = dict()
+        for k, v in info.properties.items():
+            data[k.decode()] = v.decode() if v is not None else ''

         try:
             desc = Descriptor(data)

With the new patch (which is still needed btw) I have peers running during an interactive shell
>>> print(a.execute("vula peer")[1])
a # [   67.434526] dbus-daemon[545]: [system] Would reject message, 5 matched rules; type="method_call", sender=":1.12" (uid=0 pid=922 comm="/nix/store/lpi16513bai8kg2bd841745vzk72475x-python" label="kernel") interface="org.freedesktop.DBus.Introspectable" member="Introspect" error name="(unset)" requested_reply="0" destination="local.vula.organize" (uid=992 pid=691 comm="/nix/store/lpi16513bai8kg2bd841745vzk72475x-python" label="kernel")
a # [   67.453742] vula[691]: 2024-05-16-21:22:57: Fetching interface info for vula
peer: b.local.
  id: 2ViD9GZbIPiqrUCPFDPP6QMt71L100c7XH9r9+S6C+k=
  status: enabled unpinned unverified
  endpoint: <IP_ADDRESS>:5354
  allowed ips: <IP_ADDRESS>/32
  latest signature: 0:00:37 ago
  latest handshake: none
  wg pubkey: Z++mfEerJN03vxe1O0dBIxQ+vGxi6M0hEV6do2Tscyk=

>>> print(b.execute("vula peer")[1])
b # [   71.101350] dbus-daemon[547]: [system] Would reject message, 5 matched rules; type="method_call", sender=":1.11" (uid=0 pid=914 comm="/nix/store/lpi16513bai8kg2bd841745vzk72475x-python" label="kernel") interface="org.freedesktop.DBus.Introspectable" member="Introspect" error name="(unset)" requested_reply="0" destination="local.vula.organize" (uid=992 pid=693 comm="/nix/store/lpi16513bai8kg2bd841745vzk72475x-python" label="kernel")
b # [   71.119133] vula[693]: 2024-05-16-21:23:02: Fetching interface info for vula
peer: a.local.
  id: nMZq/EXQQoOnPX4QgOfS6sINj8rEUzYpgAAZoESawro=
  status: enabled unpinned unverified
  endpoint: <IP_ADDRESS>:5354
  allowed ips: <IP_ADDRESS>/32, <IP_ADDRESS>/32
  latest signature: 0:00:43 ago
  latest handshake: none
  wg pubkey: CiBc9pEWpvE/6XXZwH+0Rb7RqYD9frn5QBk2GrL5NE8=

@adfaure Would you open a pull request on vula for that fix?

We designed our Descriptor schema validation to fail closed and the consequence of this malformed key, value pair is that it invalidates the entire vula descriptor and it does not  pass the descriptor to vula organize, and vula does not add the descriptor. We have a minimal reproducer for the bug and we are tracking this in  https://codeberg.org/vula/vula/issues/50 on codeberg.

Hi @ioerror, it looks like the issue is deeper than the patch.
Do you still need my pull request ?

Hi @ioerror, it looks like the issue is deeper than the patch.
Do you still need my pull request ?

We would be happy to review a pull request, and we will also work on solving the other issues in parallel.

I attempted to follow the instructions to reproduce this and was surprised that installing nix failed with the linked instructions when using a POWER9 machine (ppc64le):
user@power9:~$ sh <(curl -L https://nixos.org/nix/install) --no-daemon
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  4052  100  4052    0     0  13854      0 --:--:-- --:--:-- --:--:-- 13854
/dev/fd/63: sorry, there is no binary distribution of Nix for your platform

Hi @ioerror, it looks like the issue is deeper than the patch.
Do you still need my pull request ?

We have now solved the issue (using nix on x86_64). We have confirmed that the fix works in nix if the pkgs/by-name/vula/patch is identical to the changes made in the fix that we added to vula's main branch. The package itself should no longer need to carry any patches at all and all unit tests should now pass in the nix environment. The vula nix package will need to be updated to git tip.
We will release a new version of vula. In our release commit, we would like to credit everyone here for their help in finding this bug and for helping create a nix package for vula. Please let us know if you would like to be credited.
Is there a standard way for the CI (e.g.: GHA or gitlab) to test building the nix vula package with an updated vula as we continue to improve vula? We would be happy to run such a test to ensure that vula is always ready for inclusion into an updated nix package.
We would also be interested to include documentation to encourage people to consider using vula with nix once we have analyzed the properties of the nix environment.

The vula nix package will need to be updated to git tip.

Confirming that vula now builds and pass all the test against the latest commit https://codeberg.org/vula/vula/commit/b82933c2d45496afb91727e7ce3dff61ae262473:
vula-unstable-> ============================= 107 passed in 1.42s ==============================
vula-unstable-> Finished executing pytestCheckPhase
vula-unstable-> Running phase: pytestcachePhase
vula-unstable-> Running phase: pytestRemoveBytecodePhase

We will release a new version of vula. In our release commit, we would like to credit everyone here for their help in finding this bug and for helping create a nix package for vula. Please let us know if you would like to be credited.

Fantastic @ioerror ! I'd be happy to be included.

Is there a standard way for the CI (e.g.: GHA or gitlab) to test building the nix vula package with an updated vula as we continue to improve vula? We would be happy to run such a test to ensure that vula is always ready for inclusion into an updated nix package.

Definitely doable. I think the easiest way to do this would be to refer to the vula pkg from ngipkgs (once its merged) then override the source to be the updated vula sources instead of a specific version. Happy to discuss other ideas with the wider team.

@A-jay98 it's good that you are improving on the current state. Thanks!

The systemd services were not placed in the correct output path.

Please elaborate. I believe that you are mistaken, see ad2e9a5#r142089207

Thank you, we don't remember why we thought that /lib was wrong. We reverted to lib (which is the documented way).

Systemd and dbus services are missing from the NixOS module.

What makes you think that? There is no explicit configuration, but they are loaded directly from the configuration provided by upstream, which you can then customize/override using systemd.services.
Upstream files are registered here:
https://github.com/ngi-nix/ngipkgs/blob/17c5cb68f553984d361bc1f3e1a49b3a55ebf296/projects/Vula/service.nix#L73
You might have broken this mechanism, see (again) ad2e9a5#r142089207

Sorry, what we meant is that they are not configured to start. That was resolved (in mob/vula-test) by a wantedBy.

@ioerror mentioning us and possibly our sponsors and the NixOS Foundation would be appreciated, but perhaps after the package is released? We will let you know when that happens. And then we'd also help you integrate testing this package into your CI.

@ioerror mentioning us and possibly our sponsors and the NixOS Foundation would be appreciated, but perhaps after the package is released? We will let you know when that happens. And then we'd also help you integrate testing this package into your CI.

Yes, please do let us know. We'd be happy to do that in both projects (vula and highctidh) at the very minimum. Thank you again for all of your work on these packages, and thank you for taking the time to include us in your working process.


Missing setting for created field in setAdditionalData

$created field is missed https://github.com/LKDevelopment/hetzner-cloud-php-sdk/blob/master/src/Models/Servers/Server.php#L44  in https://github.com/LKDevelopment/hetzner-cloud-php-sdk/blob/master/src/Models/Servers/Server.php#L131
must be added:
$this->created = $data->created;

Yep you are right, was fixed with v1.6.2

Thanks


[Changelog] Rollup of Ivanchuk releases

[skip ci]

@miq-bot add_label documentation

@miq-bot add_label ivanchuk/yes

"Remove pglogical package"
This belongs in Removed section, not Added.

Ivanchuk backport details:
$ git log -1
commit 660c0ffa286e996cc4af71624cdf72694a1d9e16
Author: Satoe Imaishi<EMAIL_ADDRESS>Date:   Tue Sep 10 11:50:34 2019 -0400

    Merge pull request #348 from JPrause/ivanchukGA_cl

    [Changelog] Rollup of Ivanchuk releases

    (cherry picked from commit 24cbe112eea1afe059928b0e4d2ccd2c58c5da29)


[stability] Add Pause_Resume_Webapp_Repeatedly tests

Remove Suspend_Resume_System_WithVideoPlaying, becasue it will be replaced by stability-iterative-android-tests/Pause_Resume_Webapp_Repeatedly
Impacted tests(approved): new 1, update 0, delete 1
Unit test platform: Crosswalk Project for Android 15.44.366.0
Unit test result summary: pass 1, fail 0, block 0

LGTM


Columns and Frames

This pull request unifies Duplicator and frame styles (which already looked the same) and fixes issues with the column display in the backend. Furthermore it contains the following improvements:

Field settings will now be displayed properly even with JavaScript disabled (and missing Duplicator functionality).
Duplicators now correctly treats unique items.
The XSLT editor used for pages and utilities now only displays a two column layout if a second column exists.
The XSLT editor now allows the usage of tabs when editing utilities in the backend directly.
The publish area now uses the new column setup (two.columns + primary.column / secondary.column).

This pull request also prepares updated styling of error messages in the backend which will be available soon on a Symphony install near by.

In case anyone is thinking "Which frames is he talking about?": The grey boxes used by the upload field and the Export Ensemble download are called frames.


matching property not available in the results

When we have
        [ text:propListProp bdo:extendedStmts ;
          text:props ( bdo:colophon
                       bdo:incipit
                       bdo:catalogInfo
                       bdo:biblioNote
                       bdo:authorshipStatement
                       bdo:editionStatement
                       bdo:publisherName
                       bdo:publisherLocation ) ;
        ]

in the assembler, if we query
(?res ?sc ?extMatch) text:query ( bdo:extendedStmts ?L_NAME "highlight:" ) .

we can't have the matching property... It would be cool if we could use:
(?res ?sc ?extMatch ?prop) text:query ( bdo:extendedStmts ?L_NAME "highlight:" ) .

the property is returned as the fifth output var
construct { ?s ?p ?o . }
where {
  (?s ?sc ?o ?g ?p) text:query (bdo:skosLabels "\"'phags brtsegs\"~2" 'lang:bo-x-ewts' 'highlight:')
} order by desc(?sc) limit 300

Are wanting something else?

ooooh wonderful! Perhaps a little thing  in the documentation of text:propListProp (I looked for it there)? other than that all good

I also juist updated the text-query.md in the Jena documentation. I should have done that much earlier. I imagine that's why you didn't know the feature was already present.

perfect, thanks


LM Hash not being picked up.

I have noticed that when extracting LM Hashes from older Windows XP and under group policy of "Do not store LAN Manager hash value on next password change", the hashes are not being picked up by Pypykatz. However the program Mimikatz can recover them. Is this true?

pypykatz should find the LM hashes on WinXP if there are any. If you find that it doesn't then it's a bug.


Issue with excluded scope at Subscription and ManagementGroups level

Describe the bug
The Desired state exclude scopes seems to be ignored in the code logic.
To Reproduce
Add in global settings in DesiredState.excludedScope a management group child to the deployment root scope.
"desiredState": {
"strategy": "full",
"keepDfcSecurityAssignments": false,
"excludedScopes": [
"/providers/Microsoft.Management/managementGroups/MGChild"
]
}
The assignment in excluded scopes are still being evaluated.
Expected behavior
EPAC should not include the Definitions and assignment from that Management Groups or Subscription.
EPAC Version
EPAC v10.1.11.
In Get-GlobalSettings.ps1, at line 270:
else {
$null = $globalNotScopesSubscriptionsList.Add($excludedScope)
}
should be
else {
$null = $globalExcludedScopesSubscriptionsList.Add($excludedScope)
}
Also in Build-ScopeTableForManagementGroup.ps1 and Build-ScopeTableForSubscription.ps1, when we refer to excluded scope variable, it should point to desiredstate.
Ex. $PacEnvironment.globalExcludedScopesManagementGroups should be $PacEnvironment.desiredState.globalExcludedScopesManagementGroups

Accidental close

I will look at this either today or Monday


missing position

Hi,
It seems that some positions are missing from the precomputed files, e.g. chr1:9073584-9073694
Just wondered what might cause this issue.
Thanks,
Hurley

ah... cuz they're coding... duh...


setVolume method is not working

The setVolume method of the audio player is not working. For example: When I set the volume value to 0, it should mute the volume, right? but I can still hear the volume despite setting the volume to 0
`
AudioPlayer audioPlayer = AudioPlayer();
void playMusic() async {
await audioPlayer.setVolume(0); // Not working
audioPlayer.play(url); // I can still hear the volume despite setting the volume value to zero
}
`

AudioPlayer audioPlayer = AudioPlayer();
void playMusic() async { await audioPlayer.setVolume(0); // Not working audioPlayer.play(url); // I can still hear the volume despite setting the volume value to zero } `

Actually you haven't understood the play function. The default value of volume while playing the url is set to 1 by default and you have to set that particular volume like this .
AudioPlayer audioPlayer = AudioPlayer();
void playMusic(String url, double? volume) async {
audioPlayer.play(url, volume: volume ?? 1);
// Setting Volume 1 to play the music at full volume and
// if you send value 0, it was muted
}

Sorry but I didn’t get your point! Can’t we use the setVolume method to set the volume instead of setting it inside the play method
you may ask why would you want to use the setVolume method
because setVolume method allows you to set the volume for left and right volume scalar

see (native code) it lets you set volume for both left and right volume scalar

There could be one possibility on why setVolume isn't working
Maybe the volume value of setMethod is getting overwritten by the volume of the play method @jinosh05

AudioPlayer audioPlayer = AudioPlayer();
void playMusic(String url, double? volume) async { audioPlayer.play(url, volume: volume ?? 1); // Setting Volume 1 to play the music at full volume by default and // if you send value 0, it was muted }

There could be one possibility on why setVolume isn't working
Maybe the volume value of setMethod is getting overwritten by the volume of the play method @jinosh05

Actually, the default value of the play method is
Future play(
String url, {
bool? isLocal,
double volume = 1.0,
// position must be null by default to be compatible with radio streams
Duration? position,
bool respectSilence = false,
bool stayAwake = false,
bool duckAudio = false,
bool recordingActive = false,
}) async {....}
Here the volume is controlled manually, so we have to pass the volume override it.
To use the setVolume you can code like this.
AudioPlayer audioPlayer = AudioPlayer();
void playMusic(String url, {double? volume}) async {
audioPlayer.setUrl(url);
audioPlayer.setVolume(volume ?? 1);
audioPlayer.resume();
}

good catch. I will make the volume parameter on play nullable and optional, instead of default to 1, it should default to no-op

Should be fixed on main (or RC3 soon)


[1664] Override reverse_mapping in deserializable_course

Context
Publish validations are hacky on the Frontend because the backend does not give us source pointers which map the errors to their appropriate field.
Changes proposed in this pull request
reverse_mapping is responsible for generating the pointer attributes in a JSON API response which contains validation errors. The way it works is jsonapi-rails will inspect the params and based on the attributes provided, populate reverse_mapping. This means that the only attributes that can be associated with errors are ones that get passed in as part of the request.
When we do the publish action, we don't pass in any attributes, because they already exist on the model. This means that without help, jsonapi-rails can't figure out to which attributes the fields we're showing errors on should map back to. In this scenario, it silently moves on without setting pointers.
We need validation errors to always have pointers, so it makes sense to force it to always include them by overriding the default reverse_mapping.
The qualifications are also added to the attributes call, to allow them to correctly map.
Guidance to review
🤕
Checklist

[x] Make sure all information from the Trello card is in here
[ ] Attach to Trello card
[x] Rebased master
[x] Cleaned commit history
[x] Tested by running locally

 Errors that display on publish are persisted when users move to about/fees/requirements/salary


Brkt_env defaults to prod for gce commands

If no brkt_env option is provided to encrypt
or update gce image commands it defaults to
the prod endpoints.
Testing: ran encrypt_gce_image and update_gce_image
without --brkt-env and verified the prod endpoints
were passed through userdata.

LGTM


Add IMT Nord Europe to supported domains

Hi JetBrains team!
Could you please add the IMT Nord Europe French high school to the educational institutions list?
Here are the useful information to help you validate this request:

Domain being added: imt-nord-europe.fr
Official website: https://imt-nord-europe.fr/en/
URL to the IT-related courses offered:

General engineering: https://imt-nord-europe.fr/en/trainings-directory/general-engineering/
Telecom and IT Engineer: https://imt-nord-europe.fr/en/trainings-directory/telecommunications-and-it-engineer/

Proof for the email domain name:

Attached: the Teacher's guide provided by the institution. Sorry, it's in French, it would need translating.
FOR_Guide-enseignant.pdf
The interesting part is in the middle of the second page:

In any case, as a teacher or speaker for the benefit of our training, you have an address such as @imt-nord-europe.fr or @ext.imt-nord-europe.fr. This address is your key that provides access to your My Services portal.

Thank you for all!
Have a nice day.
Eric.

@esigoillot First stage of verification passed, official domain is imt-nord-europe.fr as far as I verified. This is just an informational note. Pull request is still in the review. I appreciate your patience while waiting for the final decision.

@esigoillot Thank you for your patience while waiting for a review and processing your request. Pull request merged. Thank you!


Add a __getMy() function on that

This will make it possible to access protected fields (e.g., from tests) while still keeping the ugliness so we avoid doing it when not necessary.

IMHO, as we mainly (only?) use that for tests, I would instead add a wrapper class so that your tests will look like:
let builder  = WrapperClass(ClassToTest);

it('bla', () => {
    let instance = builder(stuff);
    let instanceMy = instance.getMy();
});

maybe a bit more boilerplate, but maybe less slippery

I tend to agree with Ben.

This is also useful while debugging. What do you mean by "slippery"? What do you fear precisely?

while debugging, you have inspect that should do it for you :smile:
I fear uses of __getMy because I can, because it's useful, etc.

Benjamin Van Ryseghem<EMAIL_ADDRESS>writes:

while debugging, you have inspect that should do it for you :smile:

what do you mean by inspect? If I look inside objects, I just see a list
of public functions. A list of protected fields would surely help.
--
Damien Cassou
Företagsplatsen AB
Phone/Fax: +46 (0)8 774 63 00
Mobile: +33 (0)6 80 50 18 91
Address: Skeppsbron 26, 4tr, SE-111 30 Stockholm
Web: www.foretagsplatsen.se

Damien Cassou<EMAIL_ADDRESS>writes:

what do you mean by inspect? If I look inside objects, I just see a list
of public functions. A list of protected fields would surely help.

klassified.object has an inspect method.

Nicolas Petton<EMAIL_ADDRESS>writes:

klassified.object has an inspect method.

It's actually in util.js, as an extension of object.  Maybe we should
move it to klassified.

@NicolasPetton indeed we should move it

I just learned about inspect(), thanks.
I'm not sure it is enough in the case of composition though. Imagine a class A with a field containing an instance of class B. You can inspect() the instance of class A, but how do you inspect the instance of class B? Indded, a.inspect() don't give you the instance of B, so you can't inspect it. With inspect(), you cannot dive into objects.

Damien Cassou<EMAIL_ADDRESS>writes:

I just learned about inspect(), thanks.
I'm not sure it is enough in the case of composition though. Imagine a
class A with a field containing an instance of class B. You can
inspect() the instance of class A, but how do you inspect the
instance of class B? Indded, a.inspect() don't give you the
instance of B, so you can't inspect it. With inspect(), you cannot
dive into objects.

We could improve upon what we have.


Remove usage of MintMsg<T> if it gets removed

if this lands: https://github.com/CosmWasm/cw-nfts/pull/104

subset of: https://github.com/public-awesome/ics721/issues/48


Add escalation routine for AllocatedReviewGroup (GOKbIT-83)

@hornmo Added the parameters (see a7acf32). Still, e. g. calling group/index/<id> is not working.
Exception is: org.hibernate.hql.internal.ast.QuerySyntaxException: Invalid path: 'arc.status_id'
I could not yet find out what the code problem is. Can you?

@hornmo Added the parameters (see a7acf32). Still, e. g. calling group/index/ is not working.
Exception is: org.hibernate.hql.internal.ast.QuerySyntaxException: Invalid path: 'arc.status_id'
I could not yet find out what the code problem is. Can you?

For HQL Queries you need to use the domain class property name (so arc.status) rather than the database row status_id.

@hornmo If tested fine, the backend might generally be finished. We might be wanting to add a reviews/deescalatable check - see https://github.com/openlibraryenvironment/gokb-ui/pull/55#issuecomment-921004992 .
@darupp I think we lost track of the discussion while trying to define the names of the CG categories. Please send them to hornmo so that he can add them to the Bootstrap.


Add a bubble icon near titles for tooltips on hover in webview frontend

Currently you need to hover over the input field to get a tooltip explaining what the setting does or why is it disabled. A bubble icon that makes the tooltip appear on hover, will likely be more helpful.

Having it small and in the upper right corner would help draw the eye towards it as it would be right next to whatever toggle is used for that section without being obtrusive


Incoming scam:

Full node with 459266
by IP: <IP_ADDRESS>
SCAM ?

How do we prevent connections from people with old/incorrect chains?  Had this same 459266 one, as well as a 27xxx one from earlier.

Probably Chia nodes, Chaingreen suffered the same problem.

It should be solved with the new update (changed SSL certs). You need to reinstall Spare.

It should be solved with the update (changed SSL certs). You need to reinstall Spare (delete the directory ".spare-blockchain" but copy the db to another space before to not sync from scatch).

I'm usgin the latest version for Windows available for download, just downloaded 8 hours ago and it's the first time ever installing Spare.


Luxembourg addresses

I'm delighted to contribute our brand new address dataset for the whole country of Luxembourg.

Possible cause for the SSL error in the test:
https://github.com/kennethreitz/requests/issues/2022

cc/ @migurski could you please look into this one? Old openssl version? The link works fine in a browser.

I will look into it, thank you for the contribution!

Sorry, it’s taking a while for me to be able to look at this. I just returned from a disconnected trip, and I may be able to circle around to the SSL issue this week.

Ok! Let me know if there's anything I can do on the data.public.lu side.
We're also working on a way to get an URL that will always return the latest version of the data.

Late to see this, but it's fantastic news -- thanks so much, @grischard! @migurski lmk if there's a way I can be helpful here.

@sbma44 Actually I'd love to chat about Mapbox's experience with imports of similar data to OSM, e.g. in New York. Would it please be ok to email you?

@grischard by all means, though I will likely need to refer you to a colleague who is more familiar with that experience. But please don't hesitate to email me -- tlee at mapbox dot com.

@migurski I can't reproduce this bug with my local version of requests and openssl. Would it maybe be possible to try to simply update requests and openssl on the CI server?
import requests
resp = requests.request('GET', "https://download.data.public.lu/resources/adresses-georeferencees-bd-adresses/20160407-174800/addresses.geojson", stream=True)
print("{} addresses found".format(len(resp.json()['features'])))

158370 addresses found

@grischard if you'd like to try this again to see if the SSL issue is addressed, you'll have to "trick" the continuous integration check by adding a "notes" attribute or a whitespace to one of the JSON attributes.

Thanks @slibby, looks like @migurski hasn't had the time to look into it yet!

Yeah, sorry.

Hi @migurski, I'm just checking in to see if you know when you think you'll have a chance to look at this.

Hi @migurski, can I gently ask for an update on this? It's been, what, two months now.

Yes, thank you for that.

I’ve made a change to our use of HTTPS in https://github.com/openaddresses/machine/pull/328 that I think might fix this. Can I ask you to make a small edit to the source (such as adding a line of whitespace) that will convince the queue it’s seeing something new to process?

Hurrah! Thank you @migurski!

:+1: :100:

Glad that worked!


The logic to calculate the disk quota seems to be wrong

See original issue on GitLab
In GitLab by [Gitlab user @jjardon] on Feb 12, 2019, 12:37
Summary
We got the following error in the overnight job:

Error instantiating artifact cache: Your system does not have enough available space to support the cache quota specified.

    You have specified a quota of infinity total disk space.
    The filesystem containing /root/.cache/buildstream/artifacts only has 618G total disk space.

Seems that either

The logic to calculate free space is wrong
The login to parse the quota options is wrong (It should not possible to request "infinite")

Steps to reproduce
simply check any of the overnight-tests jobs
Relevant logs and/or screenshots
https://gitlab.com/BuildStream/buildstream/-/jobs/159768027
Other relevant information

BuildStream version affected: master

In GitLab by [Gitlab user @aevri] on Mar 1, 2019, 09:45
From the error message, I think this MR will fix this: https://gitlab.com/BuildStream/buildstream/merge_requests/1196
That MR fixes the case where the current cache size is over-estimated to the point where it's larger that the current volume usage.
The 'infinity' wording comes from the default in userconfig.yaml, this now comes out as None as parsed by parse_size. The error message changed a week ago in this MR - it would say 'None' today.

In GitLab by [Gitlab user @aevri] on Mar 1, 2019, 09:45
mentioned in merge request !1196

In GitLab by [Gitlab user @aevri] on Mar 1, 2019, 09:46
assigned to [Gitlab user @aevri]

In GitLab by [Gitlab user @marge-bot123] on Mar 1, 2019, 15:18
closed via merge request !1196

In GitLab by [Gitlab user @marge-bot123] on Mar 1, 2019, 15:18
mentioned in commit c4e29c307c168b40b595983b16b7507fe9e09742


Easier encoding for paging links

That's an issue for discussion how to make pagination links generation easier.
As JSON-API spec says it is agnostic about the pagination strategy as there are at least a few possibilities e.g. page-based, offset-based, and cursor-based. For this reason pagination strategy is not detailed in the spec.
Currently paging links could be generated like this
$links = [
    Link::FIRST => new Link('/authors?page=1'),
    Link::LAST  => new Link('/authors?page=4'),
    Link::NEXT  => new Link('/authors?page=6'),
    Link::LAST  => new Link('/authors?page=9'),
];
$encoder->withLinks($links)->encodeData($authors);

While this approach is almost fine it would've better if Encoder looked into $authors and took sub-URL part /authors from AuthorSchema.
The question is what interface such a method could have to be flexible and easy to use? There are a few thinks that should be in mind: URLs might be relative as in the sample above or absolute http://example.com/api/authors?..., links might have meta information and different paging strategies are possible.
One of the possible approach
$encoder
    ->withPagingLinks([Link::FIRST, Link::FIRST, ...], $pageLinksGenerator)
    ->encodeData(...);

Where first parameter is a list of desired links (all possible values are defined by the spec) and $pageLinksGenerator is an instance of a class which implements
interface PageLinksGeneratorInterface
{
    public function getLink(string $linkKey, string $schemaSubUrl);
}

So PageLinksGeneratorInterface implementation e.g. PageBasedLinksGenerator will do it for particular strategy and user can chose which one to use.

@neomerx
Think the withPagingLinks method might work. How would you include other links (i.e. links that aren't paging related) in the same links object in the document that is encoded? E.g. if the document links object was to include self as a link as well as the paging links?
The other thing to bear in mind about paging links is they are not only limited to the top level (document) scope. For the spec:

To paginate the primary data, supply pagination links in the top-level links object. To paginate an included collection returned in a compound document, supply pagination links in the corresponding links object.

I think an example of the latter is providing pagination links in the links object on a has-many relationship. Would your paging links generator approach work for that too?

How would you include other links

You can combine those methods. If a link key is used more than once the last Link value will be used
$encoder
    ->withPagingLinks([Link::FIRST, Link::FIRST, ...], $pageLinksGenerator)
    ->withLinks([...])
    ->encodeData(...);

The other thing to bear in mind about paging links is they are not only limited to the top level

Very good point. Similar kind of helper method is needed to be accessible from Schema (from method getRelationships in particular). I can't figure out syntax of that method however it should be similar to withPagingLinks. These links will be placed in links section of the relationship.

You can combine those methods

Ah yep, had missed that. Works nicely.

I can't figure out syntax of that method however it should be similar to withPagingLinks

Definitely makes sense to try to keep the method signatures as close as possible.

That's another piece of paging puzzle

@neomerx what's the complication with that? I'd take that doc page with a pinch of salt as the example server response isn't JSON API, plus Ember Data v2.0 will be built to default to the JSON API spec.

Ember drives me crazy :smile: I'be been spending past two days with Ember documentation, samples and videos. I just want to do a simple form with fields for attributes and combo/drop-down-list/select for one of the relationships with all data taken from backend.
Looking for paging was't my priority but that link was the only I found. And yes you right it's not relevant :smile:

Let's say we have data which were filtered and sorted before it's passed to Encoder. How can we look at those and say which filtering and sorting parameters were applied? We can't. Thus it's a fundamentally wrong idea to generate URLs based on provided data. The party which sends data to encoder should compose proper URLs. The lib currently provides all the means for that.
I'm closing this open question.


Add command to auto-configure new radios

At the moment, riftd requires a somewhat specific configuration for new radios. Currently, it requires the following attributes to be set on a standard XBee radio:

PAN IDs must be the same for any peer connectivity; for ease of use, this is assumed to be 0xFFFF, which effectively transmits on all PANs
DH and DL must be set to 0x0 to force 64-bit addressing mode
MY must be set to 0xFFFF to disable receiving non-64-bit transmissions
RR must be set to 0x0 to use default 802.15.4 MAC retries
CE must be set to 0x0 to configure this device as an "end device"
AP must be set to 0x1 to enabled "API mode"

Additionally, these attributes are not currently used, but may be used in the future:

SH and SL may be read in the future in order to easily obtain the current device's local IPv6 address
MM may be modified for strict 802.15.4 adherence
EE and KY may be modified to enable AES encryption
PL and SM may be modified to switch between varying power and sleep modes for transmission
BD may be modified to support higher baud rates

As such, it would be ideal to build out a simple subcommand to riftd for auto-configuring the correct attributes for a new radio device (as hardware vendor configuration utilities are a bit obnoxious to use at times).

Placeholder for this subcommand has been created here. Also, I've started to build out a very simple AT command protocol library called "ratatat"


Error when converting pydantic classes with nested subclasses to strawberry types

Hi,
when the strawberry.experimental.pydantic.type decorator tries to convert a Pydantic class to a strawberry type, an error occurs if one of the attributes of the Pydantic class is a nested subclass that has not yet been converted.
# pydantic.py
# my two pydantic classes

from pydantic import BaseModel, Field

class User(BaseModel):
    id: int
    username: str
    name: Optional[str]
    surname: Optional[str]
    age: Optional[int]
    sex: Optional[str]
    posts: Optional[List["Post"]] = Field(default_factory=list)

class Post(BaseModel):
    id: int
    user: Optional["User"]
    create_date: datetime = Field(default_factory=datetime.utcnow)
    message: str

# graphql.py
# my two strawberry type classes

from .pydantic import Post, User

@strawberry.experimental.pydantic.type(model=Post, fields=[
    'id',
    'user',
    'create_date',
    'message',
])
class PostType:
    ...

@strawberry.experimental.pydantic.type(model=User, fields=[
    "id",
    "username",
    "name",
    "surname",
    "age",
    "sex",
    "posts",
])
class UserType:
    ...

Error:
strawberry.experimental.pydantic.exceptions.UnregisteredTypeException: Cannot find a Strawberry Type for <class 'api_gateway.model.pydantic.User'> did you forget to register it?
Cause:
The problem is that the decorator doesn't wait until all the conversions are done and check again at the end.
It also doesn't matter in which order I write the statements, because each time the other class is not yet converted.

@jerber thx for the hint. I hadn't seen this issue.
Closing this in favor of #769

Is there a functional workaround yet for this issue (my original example here is still stumping me 😭)?!


[GOBBLIN-1413]-Emit-GMCE-as-long-as-watermark-moved

Dear Gobblin maintainers,
Please accept this PR. I understand that it will not be reviewed until I have checked off all the steps below!
JIRA

[ ] My PR addresses the following Gobblin JIRA issues and references them in the PR title. For example, "[GOBBLIN-1413] My Gobblin PR"

https://issues.apache.org/jira/browse/GOBBLIN-1413

Description

[ ] Here are some details about my PR, including screenshots (if applicable):
Emit GMCE(Gobblin Metadata Change Event) as long as watermark moved on streaming pipeline.

Currently the GMCE won't be triggered within streaming pipeline if no new file being generated. This causes problem if watermarks moved, while no file being generated(for example, data been filtered out by quality checker), GMCE will be missed.
Change GMCE publisher to produce GMCE when no file generated. Change IcebergMetadataWriter to correctly update watermark.
Tests

[ ] My PR adds the following unit tests OR does not need testing for this extremely good reason:

Commits

[ ] My commits all reference JIRA issues in their subject lines, and I have squashed multiple commits if they address the same issue. In addition, my commits follow the guidelines from "How to write a good git commit message":

Subject is separated from body by a blank line
Subject is limited to 50 characters
Subject does not end with a period
Subject uses the imperative mood ("add", not "adding")
Body wraps at 72 characters
Body explains "what" and "why", not "how"

Codecov Report

Merging #3252 (5c037a5) into master (d9ae535) will decrease coverage by 37.41%.
The diff coverage is 0.00%.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d9ae535...5c037a5. Read the comment docs.


feat: instrument requests with profiler

Like the title on the can says, it instruments requests after authorization and starts the tracer/profiler.

Codecov Report

Merging #323 (5a0dc55) into main (8556e95) will decrease coverage by 0.00%.
The diff coverage is 0.00%.

@@            Coverage Diff             @@
##             main     #323      +/-   ##
==========================================
- Coverage   28.70%   28.69%   -0.01%
==========================================
  Files          60       60
  Lines        6431     6433       +2
==========================================
  Hits         1846     1846
- Misses       4369     4371       +2
  Partials      216      216

Impacted Files
Coverage Δ

server/midddleware/middleware.go
0.00% <0.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8556e95...5a0dc55. Read the comment docs.


Fix SPI peripheral based SPI basic controller construction/initialization

The SPI peripheral based SPI basic controller (::picolibrary::Microchip::megaAVR::SPI::Basic_Controller<::picolibrary::Microchip::megaAVR::Peripheral::SPI>) currently has the following construction/initialization issues:

The SPI peripheral is not disabled before it is configured in the constructor.
The call to configure_controller() in initialize() is redundant. initialize() should simply enable the SPI peripheral.

Fixes will be applied to the constructor and initialize().


rattler-build error when using --target-platform linux-64 on osx-arm64

Having this recipe.yaml in a recipe folder
# yaml-language-server: $schema=https://raw.githubusercontent.com/prefix-dev/recipe-format/main/schema.json

context:
  version: "13.4.2"

package:
  name: "boltons"
  version: ${{ version }}

source:
  url: https://github.com/mahmoud/boltons/archive/${{ version }}.tar.gz
  sha256:<PHONE_NUMBER>f560802b5240adf8073e35112d17a4ca02581b5c45bb571ded4df7

build:
  script:
    - python -m pip install . --no-deps -vv

requirements:
  host:
    - pip
    - python >=3.7
    - setuptools
  run:
    - python >=3.7

Running rattler-build build --render-only --recipe recipe --target-platform linux-64
will output this error:
thread 'tokio-runtime-worker' panicked at /Users/runner/miniforge3/conda-bld/rattler-build_1709722974673/_build_env/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.36.0/src/runtime/time/entry.rs:556:9:
A Tokio 1.x context was found, but it is being shutdown.
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
Error:   × Failed to resolve dependencies: failed to link 'share/terminfo/N/NCR260VT300WPP'
  ├─▶ failed to link 'share/terminfo/N/NCR260VT300WPP'
  ├─▶ could not open source file
  ╰─▶ Invalid argument (os error 22)

and running rattler-build build --render-only --recipe recipe --target-platform win-64 this:
thread 'tokio-runtime-worker' panicked at /Users/runner/miniforge3/conda-bld/rattler-build_1709722974673/_build_env/.cargo/git/checkouts/rattler-3fdeff0ba0214908/82dc20f/crates/rattler/src/install/entry_point.rs:18:14:
unsupported platform
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
thread 'main' panicked at /Users/runner/miniforge3/conda-bld/rattler-build_1709722974673/_build_env/.cargo/git/checkouts/rattler-3fdeff0ba0214908/82dc20f/crates/rattler/src/install/driver.rs:139:13:
internal error: entered unreachable code: if a send error occurs here it means the task processor is dropped. Since this only happens when dropping this object there cannot be another call to this function. Therefor this should never happen.

running using:
rattler-build 0.13.0
osx-arm64 macos 13.4 (22F66)

This is not rattler-build's fault, but weird behavior of ncurses. You can't create the same file both uppercase and lowercase on macOS file systems. https://github.com/conda-forge/ncurses-feedstock/issues/73
rattler-build could create a better error message, though.

duplicate of https://github.com/mamba-org/rattler/issues/460

I would argue that in combination with the --render-only we could do a better job though (e.g. not extract everything or use the run_exports.json index file).

@nichmor this is practically also fixed for the render-only use case, right?

@nichmor this is practically also fixed for the render-only use case, right?

yes


Make tokio/async optional

It would be nice if the Tokio integration / async stuff were an optional (but default-on) feature. For folks who are sensitive about build times and/or size of the dependency tree and don't need the async features.

Relatedly, at some point I expect the Rust async community might finally standardize the AsyncRead/AsyncWrite traits, in which case the gitoid crate wouldn't need to explicitly depend on the tokio versions of those traits, and could instead become runtime-agnostic.


Cross compilation detected. Use PKG_CONFIG_ALLOW_CROSS=1

Hello, I am trying to compile to aarch64-unknown-linux-gnu, and i get this when it's compiling the hidapi crate
$ PKG_CONFIG_ALLOW_CROSS=1 OPENSSL_STATIC=1 cross build --target aarch64-unknown-linux-gnu
   Compiling hidapi v0.4.1
error: failed to run custom build command for `hidapi v0.4.1`
process didn't exit successfully: `/target/debug/build/hidapi-76bd7f33aee12772/build-script-build` (exit code: 101)
--- stderr
thread 'main' panicked at 'Unable to find libusb-1.0: "Cross compilation detected. Use PKG_CONFIG_ALLOW_CROSS=1 to override"', src/libcore/result.rs:997:5
note: Run with `RUST_BACKTRACE=1` environment variable to display a backtrace.

Closed in #386.


Adds numeric, phone-pad and email-address input types

Adds numeric, phone-pad and email-address input types
Updates and refactor example component
Adds props docs to README

Thanks for this PR 👍

You're welcome! (:


81 mqtt:There are pending publish calls every minute

ecowitt2mqtt version
Latest Docker version
Describe the bug
I'm getting a ton of pending publish calls on my logs. My mqtt server is running on a proper computer so I don't see why they would need to be rate limited. Is there a way to increase the threshold? Or to reduce the frequency data gets reported?
Screenshots
today at 6:05:24 PM WARNING:mqtt:There are 11 pending publish calls.
today at 6:05:24 PM WARNING:mqtt:There are 12 pending publish calls.
...
today at 6:05:24 PM WARNING:mqtt:There are 80 pending publish calls.
today at 6:05:24 PM WARNING:mqtt:There are 81 pending publish calls.

Additional context
Add any other context about the problem here.

Thanks for the report – I notice the same. I'm in the middle of a pretty large rearchitecture and will look to address this there.


repro: find inside suspense when root element

This is a regression with rc.18

Should be good now? https://github.com/vuejs/test-utils/pull/1397

We can 👍


Windows x64
Did you edit anything in this build? If so, mention or summarize your changes.
No

Try the following:
haxelib remove linc_luajit
haxelib git linc_luajit haxelib git linc_luajit https://github.com/superpowers04/linc_luajit.git
Then tell me if your issue is fixed!

FNF-PsychEngine-0.7.1/.haxelib/SScript/4,0,0/src/macro/Macro.hx:46: characters 23-31 : Array has no field contains
FNF-PsychEngine-0.7.1/.haxelib/linc_luajit/git/llua/Convert.hx:92: characters 11-12 : Missing type declaration
Same thing, nothing happened

https://github.com/ShadowMario/FNF-PsychEngine/wiki/Libraries-versions
Check this page

IT WORKED!! but i got this now
Standard library not found. You may need to set your HAXE_STD_PATH environment variable

Obrigado mano!!!!!!!!


ServiceBus Track2 - Create MessageReceiver class

Create MessageReceiver class, which allows to send single message and batch messages.
API to consider

receiveDeferredMessage (sequenceNumber ) :  . This is Sync API.
receiveDeferredMessage (sequenceNumbers[] ) : This is Sync API.
registerMessageHandler
renewMessageLock  : This is Sync API.
getMessageIterator() : Look at this is it make sense for Java . Reference  https://docs.microsoft.com/en-us/javascript/api/%40azure/service-bus/receiver?view=azure-node-latest#getmessageiterator--

Note: sequenceNumber  is message identifier
References:
Track 1 : com.microsoft.azure.servicebus.MessageReceiver

Fixed as part of #4506


Using ElFinder file manager to Pick up a file back occure error

Hi:
When I pick up a image or file , I got a error message as below. Any suggestion? thanks
Error in getFileCallback.
parent.tinymce.activeEditor.windowManager.getParams(...).setUrl is not a function

Hi!
This error is caused by updating TinyMCE to version 4.6.7. To correct the error, I temporarily fixed the version of TinyMCE on 4.6.6. Perform the composer update . Thank you!

It is back to normal. Thanks a lot!!


[UBS-user page. 'Замовлення' tab] 'Часткова оплата' field is not displayed in order details when order is partially paid

Environment: all browsers
Reproducible: always
Build found: 18.11.2021
Preconditions

The user must have partially paid order

Steps to reproduce

Go to: https://ita-social-projects.github.io/GreenCityClient/#/
Open "Замовлення" tab in the personal UBS-user cabinet
Click on expanding icon of the order (order from precondition )
Verify 'Часткова оплата' field in the order

Actual result
'Часткова оплата' field is not displayed in order details
Expected result
'Часткова оплата' field is displayed in order details like total amount that client has paid in the order
User story and test case links
E.g.: "User story #3478

No longer up to date


--device cpu doesn't work

Doing animatediff generate --device cpu does not work. Generating with cuda does, and the program works fine otherwise, but cpu support does not appear to be functional.
╭──────────────────────────── Traceback (most recent call last) ─────────────────────────────╮
│/animatediff-cli/src/animatediff/cli.py:154 in     │
│ generate                                                                                │
│                                                                                │
│   151 │   set_diffusers_verbosity_error()                                                  │
│   152 │                                                                                │
│   153 │   device = torch.device(device)                                                    │
│ ❱ 154 │   device_info = torch.cuda.get_device_properties(device)                           │
│   155 │                                                                                │
│   156 │   logger.info(device_info_str(device_info))                                        │
│   157 │   has_bf16 = torch.cuda.is_bf16_supported()                                        │
│                                                                                │
│ /animatediff-cli/venv/lib/python3.10/site-packages │
│ /torch/cuda/__init__.py:396 in get_device_properties                                       │
│                                                                                │
│    393 │   │   _CudaDeviceProperties: the properties of the device                         │
│    394 │   """                                                                             │
│    395 │   _lazy_init()  # will define _get_device_properties                              │
│ ❱  396 │   device = _get_device_index(device, optional=True)                               │
│    397 │   if device < 0 or device >= device_count():                                      │
│    398 │   │   raise AssertionError("Invalid device id")                                   │
│    399 │   return _get_device_properties(device)  # type: ignore[name-defined]             │
│                                                                                │
│ /animatediff-cli/venv/lib/python3.10/site-packages │
│ /torch/cuda/_utils.py:32 in _get_device_index                                              │
│                                                                                │
│   29 │   │   │   if device.type not in ['cuda', 'cpu']:                                    │
│   30 │   │   │   │   raise ValueError('Expected a cuda or cpu device, but got: {}'.format( │
│   31 │   │   elif device.type != 'cuda':                                                   │
│ ❱ 32 │   │   │   raise ValueError('Expected a cuda device, but got: {}'.format(device))    │
│   33 │   if not torch.jit.is_scripting():                                                  │
│   34 │   │   if isinstance(device, torch.cuda.device):                                     │
│   35 │   │   │   return device.idx                                                         │
╰────────────────────────────────────────────────────────────────────────────────────────────╯
ValueError: Expected a cuda device, but got: cpu

If you follow the error further down the line, it turns into an issue with fp16 not being possible on cpu. It might be extremely slow, but proper cpu support may be worth adding.

Ah, yeah, right now this does sorta assume a CUDA device and XFormers support. This is mostly because of the attention code I carried over from the original repo; it needs a refactor to use Diffusers' new-ish AttentionProcessor, which comes with a bunch of other fun improvements for both GPU and CPU use.
This should actually be fairly straightforward and is pretty much next on my todo list. In the short term I can make a few small tweaks to make CPU inference work - no promises about performance, though.
Will try to get to that in the next day or two; if you want to sorta hack around it yourself, change the dtype variables in src/animatediff/cli.py's generate() function to torch.float32, comment out the torch.cuda.device_info line that threw the error above, error and comment out the part of create_pipeline() where it enables xformers; that should cover it.

CPU support should work now 😄 feel free to reopen this if not!

So, it does get all the way to starting to generate (thank you), but there's some kind of insane memory leak and it tries to use more than 68gb of ram when generating. So it doesn't actually work.


Update Log Output Files (#274)

Description
Updates the logging for the Manager and the Engine to output to: ~/.cache/kaskada/logs/<service_name>/<service_name>-<stderr/std-out>-<timestamp>.log.
Example:

~/.cache/kaskada/logs/engine/engine-stderr-2023-05-02T18-11-25.log
~/cache/kaskada/logs/engine/engine-stdout-2023-05-02T18-11-37.log

We will also need to update the docs
https://kaskada.io/docs-site/kaskada/main/troubleshooting/logs.html

I've revised the proposed implementation to output to:
~/.cache/kaskada/logs/<timestamp>-<service_name>-<std-err/std-out>.log


chore: update OT core to 0.50.0

I believe pkg/tools/udpdemux/udpdemux should be removed

I believe pkg/tools/udpdemux/udpdemux should be removed

Added it to .gitignore.


Portable Hole not being imported with "Weightless Contents" checked

Describe the bug
Portable Hole not being imported with "Weightless Contents" checked, causing players to incorrectly be marked as over-encumbered.
To Reproduce
Steps to reproduce the behavior:

Import a character with a portable hole filled with stuff
See that they are over-encumbered and that in the Details page of the Portable Hole the check box for Weightless Contents is unchecked.

Expected behavior
The Portable Hole should import with the Weightless Contents checkbox checked and should not impact the carry weight of the character who has it.
Screenshots

Environment:

Browser Chrome
Foundry Version 11.315
5e System Version 3.0.4
Module Version 4.0.16
Does this behaviour occur with other modules disabled: Yes

Additional context
Add any other context about the problem here.

A Character URL: https://www.dndbeyond.com/characters/70101654

Thanks, this will be fixed in the next release.


Saleor 2270/update nullable editor js fields

I want to merge this change because it adds handling of null values everywhere we use description and content fields that come as rich text json or null
https://app.clickup.com/t/2549495/SALEOR-2270

PR intended to be tested with API branch:
Screenshots

Pull Request Checklist

[ ] All visible strings are translated with proper context.
[ ] All data-formatting is locale-aware (dates, numbers, and so on).
[ ] Translated strings are extracted.
[ ] Number of API calls is optimized.
[ ] The changes are tested.
[ ] Data-test are added for new elements.
[ ] Type definitions are up to date.
[ ] Changes are mentioned in the changelog.
[ ] The changes are tested in different browsers (Chrome, Firefox, Safari).
[ ] The changes are tested in light and dark mode.

Test environment config

API_URI=https://master.staging.saleor.cloud/graphql/

Task linked: SALEOR-2270 Editor.js should handle null values in content fields


Port ndt_pcl_modified to ROS2

I tried with ament_auto but it didn't find PCL.

Please review, @jilaada!

@jilaada That's a good point, I wasn't quite happy with the CMakeLists.txt format as well. I now used ament_auto's ament_auto_package() which should do the job of ament_export_include_directories() mentioned in the linked article, and used generator expressions for target_include_directories(). That might still not be the cleanest way, but it's the best way I could find to handle PCL for now.
It is "tested" by being included in https://github.com/tier4/Pilot.Auto/pull/29, which compiles successfully for me.

@jilaada Updated the CMakeLists.txt yet again, sorry – I think now I'm happy with it though.

@nnmm Out of curiosity, what was the reason for reverting ament_cmake_auto?

I'm on mobile and can't link to it, but see PR 29

I'm on mobile and can't link to it, but see PR 29

For some reason I didn't get a notification for this! Else I would have approved earlier. I just checked, and re-tested the package. LGTM :+1:

Don't worry about not approving immediately, it must have been the middle of the night for you! I certainly don't want to disturb you guys outside working hours.

However, could you please merge the PR? I don't think I have permissions for that.

No worries! I've merged the PR, thanks!


Support for grunt-collection

Hello,
currently jsdoc is required in node_modules for every folder containing a Gruntfile.js and package.json.
For bigger projects there are grunt-collections where in the project root all needed modules are stored in the node_modules folder.
For now I need to have jsdoc in every subproject node_module folder, to be found from grunt-jsdoc-plugin.
BR,
mybecks

This seem to be obsolete. I never found a reference to something called grunt-collection


class weights of cityscapes

I don't find the weight file 'class_weights.pkl',can you tell me have to get it

Hi,
You'll have to run utils/preprocess_data.py.
//
Fredrik

Thank u, but I get some new troubles when I  train this code directly. It occur 'RuntimeError('cuda runtime error (77) : an illegal memory access was encountered '. So I add 'torch.cuda.set_device(1)' on the top, but here's a new one 'RuntimeError('cuda runtime error (4) : unspecified launch failure at ' These all happen at batch_losses.append(loss_value) in train.py. I try to skip it and sth correspond to it, but the same thing happens in loss.backward(). Could you give me some advice?

Hi,
You'll have to run utils/preprocess_data.py.
// Fredrik
Hi,

The eval code for generating IOU values is missing. Kindly push that code too.