Dynamic resources?

Not sure if there is a discussion board. Is there a view on patterns for dynamic datasets or rather dynamic resources? For example hourly files or growing lists of user records.

Hi @cottrell, probably the best place for this discussion is the specs issue tracker - https://github.com/frictionlessdata/specs/issues (cc @rufuspollock)

https://github.com/frictionlessdata/specs/issues/590


[Question] Using metadata.name as a namespace selector ?

Hi there,
I was wondering if we could use the metadata namespace name for the namespace selector.
Otherwise, it looks like I would have to add a label name==metadata.name for each of my namespace.

If you use Calico network policies you can use a special label to match:
namespaceSelector: projectcalico.org/name == "<namespace name>"

See here: https://docs.projectcalico.org/reference/resources/globalnetworkpolicy#spec


channelData deprecation

The Microsoft Bot Framework team prefers that "How To" questions be submitted on Stack Overflow. The official Bot Framework GitHub repository  is the preferred platform for submitting bug fixes and feature requests.
Bot Info

SDK Platform: Node.js
SDK Version: 3.1
Active Channels: Cortana
Deployment Environment: Azure Bot Service

Issue Description
channelData is deprecated - needs an update to sourceEvent
Code Example
new builder.Message(session)
.setChannelData({
action: {
type: 'LaunchUri',
uri: 'http://example.com/'
}
})
Reproduction Steps

channel data is deprecated
sourceEvent doesn't seem to include information required to get cortana to response

Expected Behavior
Cortana should be able to assist the skill in performing actions on the appropriate device.
Actual Results
Nothing.

Are you able to share your code? Please feel free to add me privately so that I can take a look.
Thank you!


[SPARK-21079] [SQL] Calculate total size of a partition table as a sum of individual partitions

What changes were proposed in this pull request?
Storage URI of a partitioned table may or may not point to a directory under which individual partitions are stored. In fact, individual partitions may be located in totally unrelated directories. Before this change, ANALYZE TABLE table COMPUTE STATISTICS command calculated total size of a table by adding up sizes of files found under table's storage URI. This calculation could produce 0 if partitions are stored elsewhere.
This change uses storage URIs of individual partitions to calculate the sizes of all partitions of a table and adds these up to produce the total size of a table.
CC: @wzhfy
How was this patch tested?
Added unit test.
Ran ANALYZE TABLE xxx COMPUTE STATISTICS on a partitioned Hive table and verified that sizeInBytes is calculated correctly. Before this change, the size would be zero.

Can one of the admins verify this patch?

Please explain the failed scenario in PR description. That's why our test cases cannot catch it and we need to test it manually.

Can you add a test case? In the test, we can add partitions with different paths by ALTER TABLE SET LOCATION command. I think that can reproduce your scenario, right?

@wzhfy, @tejasapatil, thanks for your feedback. I think I addressed all of your comments and added a test. Please, take another look.

@rxin, could you help unblock Jenkins for this PR?

ok to test

test this please

Please also update description of PR, the key point of the problem is URI for table is different from that of its partitions, otherwise, it works fine for partitioned tables.

Jenkins test this please

@mbasmanova Let's first fix the above comments and ping admins to unblock this pr :)

@wzhfy , @tejasapatil , I updated description of this PR, enhanced the test and renamed a function I missed before in Tejas's comment. How does it look now?

@wzhfy, thank you careful review and helpful suggestions. I think I incorporated all of your comments. Would you take another look?

LGTM except some minor comments.
ping @cloud-fan @gatorsmile Could you start Jenkins for this pr?

ok to test

Test build #78231 has started for PR 18309 at commit b290bf9.

Could you add another test case? First, creates an external partitioned data source table (with an external location). Second, add only a subset of partitions. Third, analyze table but the statistics only include the visible partitions.

Test build #78231 has finished for PR 18309 at commit b290bf9.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78231/
Test PASSed.

Test build #78250 has started for PR 18309 at commit 09c4900.

@gatorsmile, re: additional test, how can I create a table with a mix of visible and invisible partitions?

Test build #78250 has finished for PR 18309 at commit 09c4900.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78250/
Test PASSed.

Merged build finished. Test PASSed.

@mbasmanova
create table ${fullTableName} using parquet options (path "${fullPath}")

If the path points to the directory of a partitioned table, the partitions are not visible unless you insert/load the data to that partition or you explicitly run ALTER TABLE ADD PARTITION.

@gatorsmile, thanks for clarifying. I added a test to analyze a table with only some of partitions being visible. Would you take another look?

Test build #78292 has started for PR 18309 at commit 70f569b.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78292/
Test FAILed.

Merged build finished. Test FAILed.

i'll re-trigger this test once jenkins is back up.

Thank you, @shaneknapp .

test this please

Test build #78298 has started for PR 18309 at commit 70f569b.

Test build #78298 has finished for PR 18309 at commit 70f569b.

This patch fails PySpark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78298/
Test FAILed.

@shaneknapp, I can't think of why PySpark unit tests failed other than flakiness of the tests or infrastructure. Any chance you could trigger a re-run?

test this please

crap, this clobbered the pypy install.  fixing this now.

Test build #78328 has started for PR 18309 at commit 70f569b.

done

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78328/
Test FAILed.

test this please

Test build #78343 has started for PR 18309 at commit 70f569b.

Test build #78343 has finished for PR 18309 at commit 70f569b.

This patch fails SparkR unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78343/
Test FAILed.

test this please

Test build #78359 has started for PR 18309 at commit 70f569b.

Except the comments about test cases, the other parts look good to me.

Test build #78359 has finished for PR 18309 at commit 70f569b.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78359/
Test PASSed.

Test build #78386 has started for PR 18309 at commit c17917a.

@gatorsmile, thank you for review. All the comments should be addressed now. Please, check it out.

Test build #78387 has started for PR 18309 at commit 05dacbc.

Test build #78386 has finished for PR 18309 at commit c17917a.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78386/
Test PASSed.

Merged build finished. Test PASSed.

Test build #78387 has finished for PR 18309 at commit 05dacbc.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78387/
Test PASSed.

Merged build finished. Test PASSed.

LGTM

Thanks! Merging to master/2.2

Could you submit a backport PR to 2.1? Thanks!

@gatorsmile This failure is related to this change? https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78575/console

@maropu yes, I've submitted a fix here.

oh, Thanks!

Folks, thanks for merging this PR.
@gatorsmile, re: a request to backport to 2.1. Is this something that happens automatically? If not, could you point me to some instructions on how to do that?


Shorten intro section

in the JWT, in the three-party-model as described above. This is a common problem
in the three-party model: An Issuer creates a Verifiable Credential for
some End-User (Holder), who then presents this credential to multiple Verifiers.
A Verifiable Credential might contain a large number of claims, but the Holder

We should short this as suggested by @tlodderstedt
Originally posted by @tlodderstedt in https://github.com/vcstuff/draft-terbu-sd-jwt-vc/pull/61#discussion_r1200389171

Relates to #71


Enabling / Disabling Sensors

I may have misunderstood, but your Readme says you can enable / disable etc the sensors and schedules. What is the correct Siri command to action this. I have tried say turn off the bathroom sensor, but it actually turns off everything in the bathroom.

I deliberately use a custom characteristic Enabled for enabling/disabling the sensors, schedules, and rules, so Siri cannot accidentally do so.  Unfortunately, the iOS built-in Home app cannot deal with custom characteristics, so you need another HomeKit app (like Elgato's Eve) to access these.
If you deliberately want to enable/disable sensors from Siri, you can create a HomeKit scene (from another HomeKit app), that sets/clears the custom Enabled characteristic.  Once created, the scene can be triggered by Siri and from the built-in Home app.

Has this gone now? I can't see the enabled attribute of my motion sensor in iOS 14.1


image/gif: Mention the uselessness of BackgroundIndex in the docs

Go version: Go 1.8 (but this is a documentation issue)
Quick introduction to GIF disposal methods:
In an animated GIF, a disposal method can be set for each frame. It specifies to which state the canvas should be set before displaying the next frame when the current frame is finished being shown. There are three disposal methods, represented in image/gif by DisposalNone, DisposalBackground and DisposalPrevious.
DisposalNone means that the following frame is drawn on top of the current frame, so that transparent areas of the next frame continue to show this frame's content. DisposalPrevious means that the canvas is reset to the last frame that didn't have its disposal method set to DisposalPrevious. DisposalBackground means something else and I will come to that in a moment.
In Go, an animated GIF can be written by EncodeAll() in image/gif, which accepts a GIF struct that describes the animated GIF. This struct has a member BackgroundIndex byte whose inline documentation reads:
// BackgroundIndex is the background index in the global color table, for
// use with the DisposalBackground disposal method.
BackgroundIndex byte

This gives the impression that DisposalBackground means "the canvas is restored to the color given by BackgroundIndex.
However, in all modern browsers DisposalBackground is interpreted as "clear the canvas to fully transparent".
It turns out that this is indeed an ambiguity in the GIF89a specification which in the past has been interpreted as "clear to BackgroundIndex" but is apparently interpreted as "clear to transparent" since about 15 years ago, as this comment from the Mozilla bugtracker shows.
Since I just spent an hour figuring out why Chrome (as I thought) doesn't reset the canvas to BackgroundIndex, I would appreciate if the fact that BackgroundIndex is essentially ignored by all browsers would be mentioned in the docs.

Marking for Go 1.10, but if you want to shoot something off soon, it could make Go 1.9 if it's docs only.

@bradfitz ?


[sidecar] Use unbuffered channel, it is possible to lose the signal.

Describe the problem

If you use unbuffered channel, it is possible to lose the signal.
To Reproduce

If Ctrl + C or Kill occurs when it is blocked before <- stop, the program will stop.
Expected behavior
Ctrl+C or Kill when blocking befor <-stop , the program will also stop.

Environment:

RadonDB MySQL version:
v2.1.2

@mgw2168
Add link.

fix in: https://github.com/radondb/radondb-mysql-kubernetes/pull/411


fully automate release process

a few things that are currently semi-automated but should be fully automated:

release is first set to draft, and then manually released. but that is working fine now, i don't need to verify everything manually anymore, just release it right away
for https://github.com/FWDekker/homebrew-mommy i have to manually trigger the Update workflow. make it so that this is done automatically. best idea: commit and push to homebrew-mommy from inside this repo. now i only need to figure out where to do the installation verification for homebrew then...
for aur, i should locally check out the aur repo containing the pkgbuild, update the necessary info, and then push back~ here i need to put the ssh key for uploading somewhere, and also see if i can use my pgp key somewhere, and preferably also check the sha256 sum!

the aur part is fixed in 6d9dadc1b39c5c2f922fdcc488f159d684d8cd42. i hope. it's not actually tested yet :skull:


Still vulnerable with multiple allowed algorithms

Maybe I'm missing something obvious, but I tried your library and it is still vulnerable to type confusion when using multiple allowed algorithms (i.e. your first example in https://github.com/firebase/php-jwt/issues/351).
Furthermore your JWT::encode function has two problems:

Encode does not work when you supply a keyring (keyId check is wrong)
PHPDoc parameters are wrong for $key, $keyId and $head

Consider this test case:
<?php

use ParagonIE\PhpJwtGuard\JWT;
use ParagonIE\PhpJwtGuard\KeyRing;
use PHPUnit\Framework\TestCase;

class JWTTest extends TestCase
{
    public function testConfusion(): void
    {
        $hsKey = hash('sha256', 'phpunit-test-key-for-issue-351');

        $esPubkey = <<<END
            -----BEGIN PUBLIC KEY-----
            MFkwEwYHKoZIzj0CAQYIKoZIzj0DAQcDQgAEEVs/o5+uQbTjL3chynL4wXgUg2R9
            q9UU8I5mEovUf86QZ7kOBIjJwqnzD1omageEHWwHdBO6B+dFabmdT9POxg==
            -----END PUBLIC KEY-----
            END;

        $keyring = new KeyRing();
        $keyring->with('HS256', 'foo', $hsKey);
        $keyring->with('ES256', 'bar', $esPubkey);

        $payload = ['sub' => 'phpunit'];
        $token = JWT::encode($payload, $esPubkey, 'HS256', 'bar'); // wrong algo

        $fail = false;
        try {
            JWT::decode($token, $keyring, ['HS256', 'ES256']);
            $fail = true;
        } catch (UnexpectedValueException $ex) {
        }
        $this->assertFalse($fail, 'Expected an exception');
    }

    public function testEncode(): void
    {
        $keyring = new KeyRing();
        $keyring->with('HS256', 'foo', hash('sha256', 'phpunit-test-key-for-issue-351'));

        $payload = ['sub' => 'phpunit'];
        JWT::encode($payload, $keyring, 'HS256', 'foo'); // should not throw exception
    }
}

The first example in that example is actually a dud created in haste when trying to understand the full impact of the finding, and we need to correct it because it's confusing people.
If you are permitting both algorithms, explicitly, in the same call, then you've deliberately made the choice to permit algorithm confusion. You can permit none as well.
If your argument is, "We should prevent that in this wrapper library too," then that's worth considering.

I definitely think it's worth considering, since I ran into this issue and immediately tried the wrapper after seeing your post as a hotfix, with the impression that it also prevents the problem with multiple allowed algorithms.
Or alternatively you might want to state explicitly in the README that this is not covered, since I suspect other people will run into the same issue and may be misled into thinking it will fix the issue.
Thanks for your immediate response and making people aware of this vulnerability!

This is fixed in v0.3.0.


Navigating away from a search filtered GridField triggers "dirty" warning

Steps to reproduce:

Go to Security
Search for a member using any of the search columns
Click on the member to edit it
See "are you sure you want to leave" message

Not sure why this was closed. The issue persists for me. Can anyone confirm otherwise?

@lukereative fixed this with this PR https://github.com/silverstripe/silverstripe-framework/pull/8315

Confirmed working in Firefox and Safari, but not in Chrome. Can you have another look, @lukereative ?

@unclecheese and I have done some investigation as to why this happens in Chrome:
Chrome is showing the warning because changing and submitting the pagination number is causing the edit form data to be detected as changed due to detectChanges being triggered at different times depending on the browser (specific function admin/thirdparty/jquery-changetracker/lib/jquery.changetracker.js:127)
Chrome triggers detectChanges on pressing enter in the page number input directly after editing the page number in the input causing the edit form to have changes detected and the changed class added but if we change the page number, focus out of the page number input field then go back into the field then press enter the changed class is not added to the edit form and thus no warning on navigation.
Firefox does not trigger detectChanges on pressing enter in the pagination and therefore the changed class is never added and thus the warning is never shown.

Merged.


Support or-tools 9.7; drop 9.4

Updates GLOP and PDLP to support or-tools 9.7. Drops support for or-tools 9.4.
I tested the code locally on 9.6 and 9.7.

Thanks!


Use valid GPU for allocating CUDA host memory

This PR fixes (again!) issue #1888.
Before this commit, when allocating CUDA host memory, device 0 would
always be used to allocate the memory (because the memory is allocated
on the host with DMA enabled in the same way for all devices; it does
not matter which stream executor allocates the host memory). This
works, but if device 0 is not a valid device in this session (e.g. it
is turned off using GPUOptions.visible_device_list), doing so would
allocate a context on GPU 0, even when it was not being used. This
change fixes this, so that a visible device is found by looking at
which GPU allocators exist, and then using that device to allocate host
memory.
@vrv

This is pretty much what I was thinking, so thanks!  I wonder what happened to the CLA bot though, we need that to go through...

@googlebot where are you

I guess if this is being done as part of your work from Baidu, we'd need Baidu to sign the corp CLA.  Perhaps I should just implement this fix myself instead, unless you want to push that through ;)

Probably best  to just have you re-implement it, then, especially given how small it is; this is not being done for Baidu (hence non corp CLA) and I do not think I can get a corp CLA there for this work at this point, but given how small this change is, may as well play it safe.

ah, the commit had a baidu.com email address, so I wasn't sure.  Okay, sorry about that, legal stuff makes me sad too.  I'll send in a fix soon.


python38Packages.h5py: 3.1.0 -> 3.2.1

Motivation for this change
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[ ] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[ ] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 118844 at 0f56dbe1 run on x86_64-linux 1

13 packages marked as broken and skipped:

python38Packages.arviz
python38Packages.clifford
python38Packages.dm-sonnet
python38Packages.graph_nets
python38Packages.optuna
python38Packages.pymc3
python38Packages.rl-coach
python38Packages.tensorflow-probability
python39Packages.dm-sonnet
python39Packages.graph_nets
...

2 packages failed to build:

python38Packages.hickle
python39Packages.hickle

30 packages skipped due to time constraints:

gpt2tc
python38Packages.baselines
python38Packages.caffe
python38Packages.dipy
python38Packages.edward
python38Packages.mask-rcnn
python38Packages.nilearn
python38Packages.pywick
python38Packages.scikit-tda
python38Packages.sfepy
...

55 packages built successfully:

python38Packages.Keras
python38Packages.annoy
python38Packages.aplpy
python38Packages.asdf
python38Packages.bayespy
python38Packages.dicom2nifti
python38Packages.h5netcdf
python38Packages.h5py
python38Packages.h5py-mpi
python38Packages.keras-applications
python38Packages.meshio
python38Packages.nibabel
python38Packages.nipy
python38Packages.nipype
python38Packages.nitime
python38Packages.phonopy
python38Packages.pybids
python38Packages.pyregion
python38Packages.pytest-astropy
python38Packages.pytest-astropy-header
python38Packages.python-openems
python38Packages.qiskit
python38Packages.qiskit-aqua
python38Packages.radio_beam
python38Packages.reproject
python38Packages.sumo
python38Packages.sunpy
python39Packages.Keras
python39Packages.annoy
python39Packages.aplpy
python39Packages.asdf
python39Packages.bayespy
python39Packages.dicom2nifti
python39Packages.h5netcdf
python39Packages.h5py
python39Packages.h5py-mpi
python39Packages.keras-applications
python39Packages.meshio
python39Packages.nibabel
python39Packages.nipy
python39Packages.nipype
python39Packages.nitime
python39Packages.phonopy
python39Packages.pybids
python39Packages.pyregion
python39Packages.pytest-astropy
python39Packages.pytest-astropy-header
python39Packages.python-openems
python39Packages.qiskit
python39Packages.qiskit-aqua
python39Packages.radio_beam
python39Packages.reproject
python39Packages.sumo
python39Packages.worldengine
visidata

4 suggestions:

warning: unused-argument
Unused argument: python.
Near pkgs/development/python-modules/h5py/default.nix:1:27:
  |
1 | { lib, fetchPypi, isPy27, python, buildPythonPackage, pythonOlder
  |                           ^

warning: unused-argument
Unused argument: fetchpatch.
Near pkgs/development/python-modules/h5py/default.nix:2:51:
  |
2 | , numpy, hdf5, cython, six, pkgconfig, unittest2, fetchpatch
  |                                                   ^

warning: duplicate-check-inputs
Dependencies listed in propagatedBuildInputs should not be repeated in checkInputs.
Detected duplicates:

openssh-8.5p1

Near pkgs/development/python-modules/h5py/default.nix:39:3:
   |
39 |   checkInputs = lib.optional isPy27 unittest2 ++ [ pytestCheckHook openssh ];
   |   ^

Near pkgs/development/python-modules/h5py/default.nix:43:3:
   |
43 |   propagatedBuildInputs = [ numpy six]
   |   ^

warning: maintainers-missing
Package does not have a maintainer. Consider adding yourself?
Near pkgs/development/python-modules/h5py/default.nix:49:3:
   |
49 |   meta = with lib; {
   |   ^

Note that build failures may predate this PR, and could be nondeterministic or hardware dependent.
Please exercise your independent judgement.

hickle want h5py<3.0.0.
  ERROR: Could not find a version that satisfies the requirement h5py<3.0.0,>=2.8.0 (from hickle)

That was already broken before this update.

That was already broken before this update.

Yes, it was. https://github.com/telegraphic/hickle/issues/143

This is a semi-automatic executed nixpkgs-review with nixpkgs-review-checks extension. It is checked by a human on a best effort basis and does not build all packages (e.g. lumo, tensorflow or pytorch).
If you have any questions or problems please reach out to SuperSandro2000 on IRC.
Result of nixpkgs-review pr 118844 run on x86_64-linux 1

11 packages marked as broken and skipped:

python38Packages.arviz
python38Packages.clifford
python38Packages.dm-sonnet
python38Packages.graph_nets
python38Packages.optuna
python38Packages.pymc3
python38Packages.rl-coach
python39Packages.dm-sonnet
python39Packages.graph_nets
python39Packages.optuna
python39Packages.rl-coach

6 packages failed to build and already failed to build on hydra master:

python38Packages.hickle: log was empty
python38Packages.nilearn: log was empty
python38Packages.pywick: log was empty
python39Packages.hickle: log was empty
python39Packages.nilearn: log was empty
python39Packages.pywick: log was empty

2 packages failed to build and are new build failures:

python38Packages.qiskit: log was empty
python38Packages.qiskit-aqua: log was empty

64 packages built:

gpt2tc
python38Packages.Keras
python38Packages.annoy
python38Packages.aplpy
python38Packages.asdf
python38Packages.bayespy
python38Packages.caffe
python38Packages.dicom2nifti
python38Packages.dipy
python38Packages.h5netcdf
python38Packages.h5py
python38Packages.h5py-mpi
python38Packages.keras-applications
python38Packages.meshio
python38Packages.nibabel
python38Packages.nipy
python38Packages.nipype
python38Packages.nitime
python38Packages.phonopy
python38Packages.pybids
python38Packages.pyregion
python38Packages.pytest-astropy
python38Packages.pytest-astropy-header
python38Packages.python-openems
python38Packages.radio_beam
python38Packages.reproject
python38Packages.sfepy
python38Packages.spectral-cube
python38Packages.sumo
python38Packages.sunpy
python38Packages.worldengine
python39Packages.Keras
python39Packages.annoy
python39Packages.aplpy
python39Packages.asdf
python39Packages.bayespy
python39Packages.caffe
python39Packages.dicom2nifti
python39Packages.dipy
python39Packages.h5netcdf
python39Packages.h5py
python39Packages.h5py-mpi
python39Packages.keras-applications
python39Packages.meshio
python39Packages.nibabel
python39Packages.nipy
python39Packages.nipype
python39Packages.nitime
python39Packages.phonopy
python39Packages.pybids
python39Packages.pyregion
python39Packages.pytest-astropy
python39Packages.pytest-astropy-header
python39Packages.python-openems
python39Packages.qiskit
python39Packages.qiskit-aqua
python39Packages.radio_beam
python39Packages.reproject
python39Packages.sfepy
python39Packages.spectral-cube
python39Packages.sumo
python39Packages.sunpy
python39Packages.worldengine
visidata


Refactor type_mapping test set

Found in testing-to-remove/test_sets/type_mapping.
This needs to be moved into tests/integration and modernised.

I've added these tests but we ideally need to action https://github.com/gluent/goe/issues/32 before merging these changes.


GTFS defines a common format for public transportation schedules & associated geographic info [0]

https://codeforgvl.imaginethat.io/trolleytracker/i/5154

Copying @bikeoid comment on GTFS to this post and adding @thedanfields to the comment as I believe he's working on parts of this as well.
"GTFS would be a good model to use for our datastore - that way if Greenlink were to ever publish that format, we could pull it directly from them. It would support everything mentioned in the issue list.
If we re-work the datastore, how do people feel about different tools? I'm too easily discouraged by the command line. For example, while Microsoft .NET dev tools are boring, we might find it easier to get backup resources. Several people from the GSP .NET developers group were interested in the beginning, but dropped out when it didn't sound like any parts of the project could use .NET.
Otherwise, conceptually, it will also work to keep adding needed elements to our existing datastore (time permitting!)."

A couple of notes on this,

Greenlink is converting all their route data for the buses to GTFS and submitting that to Google to appear on Google Transit. The buses won't be sending real-time data to Google just the standard route data. It would be cool if we could submit real-time to data to Google for the trolley and beat the buses to that.

On .NET , I've got some head trash to .NET stuff but the big deal is whoever shows up gets to pick the tools to use. That all being typed, the only note I think is pretty f'ing important is that all the work can published under an open source license.


Replace travis with github actions build

This is basically the same build which currently runs on travis.
We have to wait probably on #5976 or #6240, because the current build fails without the fixes included there.

https://github.com/libgdx/libgdx/actions/runs/320268639
There's some deprecation warnings that we should fix.

I saw them. The warnings are from the setup-android action. I don't know how to fix them because the functions are used internally

Oh, sorry, you're right. Nothing for us to do there then.


Thank you for making this

I suppose it's working for you? I haven't tried it yet. Just asking before I consider.

Well, I tried it. And it seems to work for me, as well, so far. Thanks again.


Command line export doesn't work in Windows 10 for Godot 3.1.2 due to error code 12

Godot version:
3.1.2 (the official one)
OS/device including version:
Windows 10
Issue description:
Exporting a Godot project (even a brand-new one) doesn't work in the command line as it returns an error:

Steps to reproduce:

Make a new Godot Project in 3.1.2
Create some node (in my case I created a Node2D) and configure it to be the main scene.
Make an export preset for windows: "Windows Desktop"
Run following command in powershell (or any other cmd tool):
godot -e -v --export-debug "Windows Desktop" build/test.exe
Exporting fails due to error code 12

Downgrade to Godot v3.1.1 and do the exact same steps. The export completes successfully without any issues... as seen here:

Tested on Linux, it seems to work fine there:
~/tmp/godot/stable/3.1/Godot_v3.1.2-stable_x11.64 -e -v --export-debug "Linux/X11" build/test.x86_64

Note that I created the build folder beforehand. If I don't and the directory is missing, I get:
ERROR: _fs_changed: Project export failed with error code 9.
   At: editor/editor_node.cpp:495.

Maybe that's your issue?
It seems to fail the same in 3.1.1 so that wouldn't be a regression.

I also get error code 9 when I don't make the folder beforehand.
(in both 3.1.1 and 3.1.2)
However, the error code 12 only appears when I try to export with 3.1.2 in Windows 10.
I didnt try this yet with Linux or MacOsX so I have no idea if those OS' have the same issue...

So on Ubuntu LTS (18), I get following behaviour:
Godot v3.1.1, exporting to Windows:

Godot v3.1.2, exporting to Windows:

So it works on Linux (except for the memory leak, but whatever)

Export path seems relative to project location.
Example: godot -v --export "Windows Desktop" ../BUILD/LTG.exe --path ENGINE/
This works for me where I have ENGINE/project.godot and BUILD/ within my repo. Tell all your friends and save 'em some frustration.

@garyritchie
Thanks that did the trick!
Also shout-out to Calinou for adding this to the --help command (https://github.com/godotengine/godot/pull/34589) to spare future generations from running into this issue.
Closing this...


Make phoviz plug and play

If the usb cable is disconnected, the visualizer does not stop running. This might be due to the way it has been programmed. Not sure what to do about this.
http://stackoverflow.com/questions/9835881/releasing-a-unplugged-virtual-serial-port

If the usb cable is disconnected, we'll stop receiving messages. Even though the visualizer is still running, the bicycle pose isn't getting updated, which we can easily see (also timestamp if that's being displayed). I don't really see that as a problem?
I haven't thought much about the desired behavior if the usb cable is disconnected. What are your thoughts?

Although I guess I'm not clear on when logging messages to file should stop and start.

After seeing https://github.com/oliverlee/phobos/issues/176, maybe we should discuss phoviz behavior over a video chat.

We'll take the "disconnect when no messages have been received for x seconds" approach.

If the simulation keeps running and the visualizer is stopped, the visualizer is able to catch up.
If the visualizer keeps running and the simulation is stopped or if the cable is simply disconnected, the visualizer keeps displaying the last state it received. The status panel indicates no messages are being received.
What happens when the cable is re-attached needs to be tested. The simulation should just continue after https://github.com/oliverlee/phobos/pull/197. Hopefully, the visualization will simply continue but it depens on the C# SerialPort class.

When disconnecting and reconnecting the USB cable while the simulation and visualization are running, the simulation seems to continue (rapid blinking green led) but the visualizer does not start processing messages again.
Re-starting the visualizer works.

Restarting the visualizer to handle USB disconnects (which should not occur under normal operating conditions) is a fine solution.


Adds a new config to parallelize loading of ssl_multicert.config

The new setting is (default: 0):
CONFIG proxy.config.ssl.server.multicert.concurrency INT 24

A setting of -1 will create one loader thread per system CPU. Still testing performance implications here, but this likely is only a noticeable win with many, many thousands of certificates, or, a very slow "file system".
I intentionally left the line parser as-is, to avoid too much breakage and change. I think we should redo this parser, and use standard STL streams etc. to read the file line by line rather than loading the entire file into memory.

This is just FYI, but certs are loaded twice if you enable QUIC because QUICMultiCertConfigLoader is created and it does basically the same thing as SSLMultiCertConfigLoader with a couple of different options for SSL_CTX for QUIC.

[ci approve autest]

if anyone wants to test / play with this (I'm still baffled that loading certs is so CPU expensive!), I have a tar-ball with 20,000 certificates and the accompanying ssl_multicert.config file.

@shinrich is going to review
@zwoop please fix the conflicts


Add support for Text fragment feature (#1545)

Text Fragment feature implementation pull request. The feature follows the published URL Fragment Text Directives specification (https://wicg.github.io/scroll-to-text-fragment/).
(base) lychee % lychee -vv --include-text-fragments  https://developer.mozilla.org/en-US/docs/Web/URI/Fragment/Text_fragments
...
[DEBUG] tdirective: "text=From%20the%20foregoing%20remarks%20we%20may%20gather%20an%20idea%20of%20the%20importance
[DEBUG] status: Completed
[DEBUG] result: "From the foregoing remarks we may gather an idea of the importance"
[200] https://mdn.github.io/css-examples/target-text/index.html#:~:text=From the foregoing remarks we may gather an idea of the importance
[DEBUG] tdirective: "text=linked%20URL,-'s%20format"
[DEBUG] status: Completed
[DEBUG] result: "linked URL"
[DEBUG] tdirective: "text=Deprecated-,attributes,attribute"
[DEBUG] status: Completed
[DEBUG] result: "attributes     charset Deprecated   Hinted at the character encoding of the linked URL.   Note:This attribute"
[200] https://developer.mozilla.org/en-US/docs/Web/HTML/Element/a#:~:text=linked URL,-'s format&text=Deprecated-,attributes,attribute
[DEBUG] tdirective: "text=downgrade:-,The%20Referer,be%20sent,-to%20origins"
[DEBUG] status: Completed
[DEBUG] result: "The Referer header will not be sent"
[200] https://developer.mozilla.org/en-US/docs/Web/HTML/Element/a#:~:text=downgrade:-,The Referer,be sent,-to origins
[DEBUG] tdirective: "text=linked%20URL,defining%20a%20value"
[DEBUG] status: Completed
[DEBUG] result: "linked URL as a download. Can be used with or without a filename value:    Without a value, the browser will suggest a filename/extension, generated from various sources:   The Content-Disposition HTTP header  The final segment in the URL path  The media type (from the Content-Type header, the start of a data: URL, or Blob.type for a blob: URL)     filename: defining a value"
[200] https://developer.mozilla.org/en-US/docs/Web/HTML/Element/a#:~:text=linked URL,defining a value
...
If the fragment directive is not found, a TextDirectiveNotFound error will be returned.
Below changes are completed:

Fragment Directive parser uses fancy-regex

this package was added as a dependency

a new flag, include-text-fragments is added to support the feature

this is a deviation from the original feature request (which asked for using the text-fragments flag itself)

Fragment (Text) Directive feature is tested on LTR sites only
new UrlExt trait is implemented to enhance Url's to support Fragment Directive
Support for multiple text fragment directives (for example, #:~:text=linked%20URL,-'s%20format&text=Deprecated-,attributes,attribute)
tests are added for validating the feature
cargo clippy & cargo tests were executed

I missed to run the clippy across the test modules - the related lint failure issues are now fixed and ready for review!


Backers should not be able to fund products which are past end date

Intended Behavior:
Backers should only be able to fund products that are currently active and within their funding period.
Products that have exceeded their funding period or are otherwise considered "out of date" should not be available for funding by backers.
Actual Behavior (Bug):
Backers can still fund products that have passed their funding period or are otherwise considered out of date.
This allows backers to contribute to projects that may no longer be viable or available for funding, leading to potential confusion and wasted resources.

Validation has been added in contribution.


Only run capabilities module in apply mode.

Running this module in check mode can cause a fatal error, as the file (normally installed by the role earlier) may not exist. Also, add a debug message indicating why this was skipped.
This resolves #72. Instead of the fatal error noted there, the following output is produced and execution continues:
TASK [blackbox-exporter : Ensure blackbox exporter binary has cap_net_raw capability] **************************************
skipping: [hostname.mydomain.com]

TASK [blackbox-exporter : Check Debug Message] *****************************************************************************
ok: [hostname.mydomain.com] => {
    "msg": "The capabilities module is skipped during check mode, as the file may not exist, causing execution to fail."
}

Thanks! :+1:


Temporarily Increase Fistbump Limit Feature

Sometime we'd like to increase the daily limit of fistbumps on a temporary basis such as for team events. Add some functionality to increase the fistbump limit to some user-provided amount for a specified amount of time. Revert to the original fistbump limit after the time has expired.
This functionality should be limited to some specific set of admin users.

This was completed with issue #238


Netboot Image with preconfigured/random password

Good evening folks!
I'm currently preparing a pxe environment for semi-automated provisioning of many physical and virtual machines. These machines should be ready for their nixos-anywhere deployment after boot, without human interaction.
Your current installer images with their display of the generated root-password and network config is almost ideal. (It just doesn't work in my ipxe environment due to efi/memdisk.)
Could you add that functionality to the pxe images as well?
Moving this a step further: Would it be possible to specify a fixed root password (or public key) with the command line options?
Thanks a lot!
(I could probably generate my own modified images - I'm just too lazy to add another responsibility to that project. Keeping it simple and stupid.)

Did we not already support putting password hashes in the cmdline in nixos in general?
https://github.com/NixOS/nixpkgs/blob/76193bc2e99e42ddd6264bba9c5c372bc019e50e/nixos/modules/installer/cd-dvd/installation-cd-base.nix#L37
Unsure if we also import this in the netboot image, but if we don't, we can add this. Would you than still need a random password?

This sounds awesome!
No, if I can specify a hash, I'm all set.
And thanks for the quick response 🙇🏼

I'm sorry for the delay, just found a bit of time to test.
The current pxe setup does not react to live.nixos.passwd set on cmdline. So I went ahead and created this MR. First MR in that repo, let's see how much I've missed on the conventions 🙈

Hey @Mic92! Thank you very much for reviewing and merging the change in nixpkgs, highly appreciated!
I've seen your change to the nixpkgs inputs in this repo - do you plan on keeping this for a longer time? Is there something I have to/can do to get my change into an actual netboot build in here?


Localization of search dialogs

Hi,
I'm using CodeMirror on French platforms, therefore I'm eager to have it easily translatable.
I added localization support (used for search) and extended the demo.
In my second commit, I roughly put subsections in the docs' Addons section, as it is currently very hard to browse.
Do you have any suggestions regarding these changes?

I don't want to incur more UI complexity in the core library. In fact, I'm thinking about moving stuff like the search functionality out of the distribution entirely, since I'm not really interested in maintaining them. As such, I'm not interested in growing them further, and recommend you set up a fork with your changes.

OK, thanks for your reply. Yeah, let's follow the KISS rule. Then I'll propose my changes to this possible separate project.
Happy hacking.


Hibernate Search EntityManager wrapping should be typesafe

Is your feature request related to a problem? Please describe.
Tight coupling is introduced and compile-time safety is removed by the current method of wrapping EntityManager in FullTextEntityManager
Describe the solution you'd like
Introduce a mechanism for keeping the Hibernate Search code in the Hibernate Search module and out of the JPA Support module.
Additional context
The current code in the opentracing package might also benefit from a standard wrapping mechanism.

Given that this issue is marked as Done, ok to close?

Not sure why I didn't do that earlier, sorry


Transfer Jarvis's waiting-for styles to React

On production:

On production:

I am not sure how it looks like now. If the last screenshots are correct, then it is wrong in WaitingForDeployment component. Because we have duplication of description. So we should show only one. I suggest the one on the bottom.


CAMEL-18127: implement adapter auto-configuration in the resume API

This is the first part of CAMEL-18127 and the work to make the resume
api simpler to use (see apache/camel-examples#92 for details).
There are a few things missing in this PR, that will be completed in
subsequent PRs (otherwise it would be too big):

Update the remaining components to implement auto-configuration for
them
endpoint self-configuration (CAMEL-18128)
improve the serialization (CAMEL-18148)
generate the adapter configuration automatically (CAMEL-18152)

❌ Finished component verification: 1 component(s) test failed out of 7 component(s) tested

Test failure is unrelated to this change and a work-around is provided on #7690.

Please don't merge it yet. It needs a fix to load the config files w/ license information.


Collapse: add icon trigger attribute

Collapse adds the trigger attribute.
When users use custom content with title slot, they donot want the title triggers the collapse event, but only the icon arrow. See #14936
Now setting trigger="icon" on the <el-collapse /> or <el-collapse-item /> components will help.

+1


Using reInit() to change mode (horizontal / vertical) on the fly

I've read another issue (https://github.com/nolimits4web/Swiper/issues/308), and I think I may use reInit() to achieve it but problems happened.
            var mySwiper = $('.swiper-container').swiper({
                mode: 'vertical',
                loop: false,
                calculateHeight: true,
                centeredSlides: true,
                onSlideChangeEnd: function(swiper) {
                    if (swiper.activeIndex === 6) {
                        if (swiper.previousIndex === 5) {
                            swiper.params.mode = 'horizontal';
                            swiper.params.loop = false;
                            swiper.params.calculateHeight = true;
                            swiper.params.centeredSlides = true;
                            swiper.reInit();
                            // swiper.swipeTo(6, 100, false);
                        } else if (swiper.previousIndex === 7) {
                            swiper.params.mode = 'vertical';
                            swiper.params.loop = false;
                            swiper.params.calculateHeight = true;
                            swiper.params.centeredSlides = true;
                            swiper.reInit();
                            // swiper.swipeTo(6, 100, false);
                        }
                    }
                }
            }

Here I want to change the mode when I swipe to the 7th slide (index is 6).
But when the swiper was reinitialized, only the page transition animation changed. Gesture to change slide remained. And also, the next slide would be empty. (BTW, after reinit, it always return to the first slide.)

No, it will not work. You may do .destroy() and init it again with new direction


Wapiti error during scan

Traceback (most recent call last):
File "/usr/bin/wapiti", line 11, in
load_entry_point('wapiti3==3.0.1', 'console_scripts', 'wapiti')()
File "/usr/lib/python3/dist-packages/wapitiCore/main/wapiti.py", line 1002, in wapiti_main
wap.attack()
File "/usr/lib/python3/dist-packages/wapitiCore/main/wapiti.py", line 445, in attack
self.report_gen.generate_report(self.output_file)
File "/usr/lib/python3/dist-packages/wapitiCore/report/htmlreportgenerator.py", line 57, in generate_report
copytree(os.path.join(self.BASE_DIR, self.REPORT_DIR, subdir), os.path.join(output_path, subdir))
File "/usr/lib/python3.6/shutil.py", line 315, in copytree
names = os.listdir(src)
FileNotFoundError: [Errno 2] No such file or directory: '/usr/lib/python3/dist-packages/wapitiCore/report_template/js'

Try adding a / symbol at the end of the URL

I know that you remove that js folder

simply quote on the parameters' value solved the issue

I'm having the same issue

wapiti -u https://mydomain.com/

[*] Launching module permanentxss
Traceback (most recent call last):
File "/usr/bin/wapiti", line 11, in
load_entry_point('wapiti3==3.0.1', 'console_scripts', 'wapiti')()
File "/usr/lib/python3/dist-packages/wapitiCore/main/wapiti.py", line 1002, in wapiti_main
wap.attack()
File "/usr/lib/python3/dist-packages/wapitiCore/main/wapiti.py", line 445, in attack
self.report_gen.generate_report(self.output_file)
File "/usr/lib/python3/dist-packages/wapitiCore/report/htmlreportgenerator.py", line 57, in generate_report
copytree(os.path.join(self.BASE_DIR, self.REPORT_DIR, subdir), os.path.join(output_path, subdir))
File "/usr/lib/python3.7/shutil.py", line 315, in copytree
names = os.listdir(src)
FileNotFoundError: [Errno 2] No such file or directory: '/usr/lib/python3/dist-packages/wapitiCore/report_template/js'

Quoting the URL makes no difference.

It's probably not the clean and definite answer, but simply create the directory (and you can leave it empty) :
mkdir /usr/lib/python3/dist-packages/wapitiCore/report_template/js

Looks like a broken package, someone said in a thread on SourceForge. Copying the files from the git repo also works.

simply quote on the parameters' value solved the issue

It solved me at first try, tks mate!


Still maintained?

There hasn't been a commit in two years - wondering if I should just make a hard fork or try to make PRs for changes...

A PR will do

Awesome thanks!


How to reference currenty startify loaded session

I'm trying to use tmux-resurrect and wanted to autosave the session on VimLeave like this in my .vimrc:
function SaveBeforeShutdown()   " Some call to startify here to   " A. check if it's a session   " B. If it is a session, save it endfunction au VimLeave * call SaveBeforeShutdown()
I've enabled these flags for vim-startify:
let g:startify_session_persistence = 1
let g:startify_session_autoload = 1
Is there a way to reference if vim-startify has a session it loaded named in a string variable someplace? I looked at startify.vim +201 and saw v:this_session ?
I'm trying to figure this out for myself and another tmux-resurrect/vim-startify lover here: https://github.com/tmux-plugins/tmux-resurrect/issues/107
Thanks as always for this awesome plugin :+1:

Hi. I was away for the last 2 months so I have to read up on many things right now.
I'm not sure I'm getting the whole picture at the moment, but yes, you can always check v:this_session (see :h v:this_session). It's a builtin variable but can be set by users. If there is a running session, that variable will contain its name.
g:startify_session_persistence will also work on VimLeave, so pay attention to when your autocmd is set, since autocmds are executed in the order they were given.

Thanks as always for this awesome plugin

:-)

:SLoad without an argument loads the last used session now (on non-Windows).
Session persistence + tmux-resurrect are a dream team now:
set -g @resurrect-processes '"vim->vim +SLoad"'


feat(search): highlight search result terms

Signed-off-by: Phil Kuang<EMAIL_ADDRESS>Hey, I just made a Pull Request!

Closes #7041
I decided to take a different approach from the possible implementation suggested in the linked issue where instead of passing highlight position metadata to the frontend, highlight annotated result fragments are supplied and rendered directly instead. The motivation behind is that most search engines (ES & PG) already have built in mechanisms for fetching these annotated fragments which has various benefits we can take advantage of by using them directly (eg. fragments formed around the context of the highlighted term, returning the most applicable fragment like excerpts with the most matched terms, etc.). I think this ultimately leads to a more effective search result UX.
Future Work
Didn't have time to implement this for search-backend-module-pg but I believe @Fox32 mentioned he would be interested in implementing support there 😁  It should be pretty straightforward using ts_headline and doing something similar to how ES was implemented.
:heavy_check_mark: Checklist

[x] A changeset describing the change and affected packages. (more info)
[x] Added or updated documentation
[x] Tests for new functionality and regression tests for bug fixes
[x] Screenshots attached (for UI changes)
[x] All your commits have a Signed-off-by line in the message. (more info)

@iamEAP made updates based on your initial feedback, let me know what you think!

@iamEAP updated based on your latest feedback. Let me know if you have any other thoughts!

@Rugvip updated and addressed some of your comments. Let me know if you still have concerns!

@Rugvip @iamEAP do you have any other concerns here before we can get this through?

Note the question above about removing the changes to the app itself though.

@iamEAP @freben this should be mergeable now!


1287 purldb scan worker update

This PR updates the purldb-scan-worker management command to send project results back using a new addon pipeline, send_project_results. This pipeline is appended to the list of pipelines to be run on a package, allowing the worker that handles the project execution to send back the data when all of the pipelines have been run. This allows us to not have the main task loop to monitor a single project run for completion in order to return data, and allows us to request multiple scan projects and work on them simultaneously. A new option, --max-concurrent-projects, has been added to set the number of purldb packages that can be requested and processed at once.

@JonoYang The code looks fine but I don't feel great about adding a specialized pipeline only useful in the context of the PurlDB worker.
Couldn't we use the existing Webhook system for this instead?

@tomd I forgot about the webhook functions on the Project model. I will revise my code to use that instead.

@tomd I am looking at the webhook code and its relation to Projects and Runs. I see that in https://github.com/nexB/scancode.io/blob/main/scanpipe/tasks.py#L72 that we send back the project results after every Run on a Project. I would like to send back the results after all of the requested pipelines are run, as is the behavior of my code that adds the send_project_results pipeline. I have the idea to add a flag or some other attribute on Project to tell scancode.io when to process webhooks. I would like your opinion on the best way of triggering a webhook reply once all Project Runs are completed.

I see that in https://github.com/nexB/scancode.io/blob/main/scanpipe/tasks.py#L72 that we send back the project results after every Run on a Project. I would like to send back the results after all of the requested pipelines are run,

Yes, I think that's a good opportunity to improve the Webhook system.
We could add a flag as you suggested to control if the webhook should be sent after each pipeline completion, or only at the end.
We need to take into account that a pipeline (last or not) may fail and we need to decide what should happen to the Wehbook in that case.
Also, we need to define the default behavior. Posting only when all pipelines have been completed as default probably makes the most sense. With maybe a send_on_failure flag enabled by default.

@JonoYang Added results_url and summary_url in the Webhook payload in https://github.com/nexB/scancode.io/pull/1326/files

We could add a flag as you suggested to control if the webhook should be sent after each pipeline completion, or only at the end.

Actually in the short term, since the next_run value is available in the payload, could your receiving view check if all the runs have completed to trigger the import process?

We need to take into account that a pipeline (last or not) may fail and we need to decide what should happen to the Wehbook in that case. Also, we need to define the default behavior. Posting only when all pipelines have been completed as default probably makes the most sense. With maybe a send_on_failure flag enabled by default.

For what it's worth, in the context of the purldb-scan-worker command, if any of the requested pipelines failed, then we consider the entire Project to have failed and then send back a response to the purldb with that status.

Actually in the short term, since the next_run value is available in the payload, could your receiving view check if all the runs have completed to trigger the import process?

Do you mean having the receiver (purldb) poll to see if the project is done? The endpoint that issues and handles the package scan requests on purldb currently does not poll outstanding package scan requests, but just waits for updates from the worker.

@JonoYang The code looks good! Is this ready for merge or do you plan to add more?

I have nothing else to add. This is good to go for me

Meged! @JonoYang feel free to close https://github.com/nexB/scancode.io/issues/1287 if completed 🚀


Add support for queries on to-many relationships

@mkistler filed this originally here
CoreData supports filter predicates for a to-many relationship.
This basically means that the predicate specifies a condition on an attribute in an entity related to the root entity by a to-many relationship.  The attribute is specified with dotted notation: relationship_name.attribute_name.
Note: CloudantQuery allows querying into subdocuments, but relationships are not implemented using subdocuments.

Closing old issue.


Error for fetching file from this link

DO NOT REMOVE OR SKIP THE ISSUE TEMPLATE

[X] I understand that I will be blocked if I intentionally remove or skip any mandatory* field

Checklist

[X] I'm reporting that yt-dlp is broken on a supported site
[X] I've verified that I'm running yt-dlp version 2023.07.06 (update instructions) or later (specify commit)
[X] I've checked that all provided URLs are playable in a browser with the same IP and same login details
[X] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[X] I've searched known issues and the bugtracker for similar issues including closed ones. DO NOT post duplicates
[X] I've read the guidelines for opening an issue
[X] I've read about sharing account credentials and I'm willing to share it if required

Region
Hong Kong
Provide a description that is worded well enough to be understood
403 error on below link
https://d1k2us671qcoau.cloudfront.net/vodapi/viu_aws.m3u8?vid=111b94bf65c26785981a8ab2f5d1754f&layer=Layer4&area_id=1&lang_id=1&ts=202309012242&Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9kMWsydXM2NzFxY29hdS5jbG91ZGZyb250Lm5ldC92b2RhcGkvKiIsIkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTY5MzU5NzM0NH19fV19&Signature=bAt~-Lz4vPlQza9V5w-tvT45H2A9c8ZdfrqU7Zh5JZhp2RxibOfU6L3MMalGsGErYDRcUutfBqycni3DT9NW7zDVYobYLhP~kEWOozAnp6TTWuQ4GFLN9vwdRqcXh9VbYVnHMtmf9txhZiUoHtQlxE3WPz6jq0bh6UrGP7WubRTYVjDZGini~Q2li-aww2Ba5nmIiDyvFVJV9CORPY466mWbtEi3LV1uWYYiZ05jY7iN8c~9RLm~OR531lYeZeJD0Ha~I39efyQXM90b52c5G7UG00RbbALvujusw7488j1HkN1p6Ka-BJfsZMYHYK6wyrDLI1y9vETArr7YcgpLvA__&Key-Pair-Id=APKAJ6Z4RF5IYK7Y3SQQ
Provide verbose output that clearly demonstrates the problem

[X] Run your yt-dlp command with -vU flag added (yt-dlp -vU <your command line>)
[ ] If using API, add 'verbose': True to YoutubeDL params instead
[X] Copy the WHOLE output (starting with [debug] Command-line config) and insert it below

Complete Verbose Output
[generic] viu_aws: Downloading webpage
ERROR: [generic] None: Unable to download webpage: HTTP Error 403: Forbidden (caused by <HTTPError 403: 'Forbidden'>); please report this issue on  https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using  yt-dlp -U
'layer' is not recognized as an internal or external command,
operable program or batch file.
'area_id' is not recognized as an internal or external command,
operable program or batch file.
'lang_id' is not recognized as an internal or external command,
operable program or batch file.
'ts' is not recognized as an internal or external command,
operable program or batch file.
'Policy' is not recognized as an internal or external command,
operable program or batch file.
'Signature' is not recognized as an internal or external command,
operable program or batch file.
'Key-Pair-Id' is not recognized as an internal or external command,
operable program or batch file.

Try putting the entire URL inside quotes

what mean by inside quotes?

yt-dlp -v "https://d1k2us671qcoau.cloudfront.net/vodapi/viu_aws.m3u8?vid=111b94bf65c26785981a8ab2f5d1754f&layer=Layer4&area_id=1&lang_id=1&ts=202309012242&Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9kMWsydXM2NzFxY29hdS5jbG91ZGZyb250Lm5ldC92b2RhcGkvKiIsIkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTY5MzU5NzM0NH19fV19&Signature=bAt~-Lz4vPlQza9V5w-tvT45H2A9c8ZdfrqU7Zh5JZhp2RxibOfU6L3MMalGsGErYDRcUutfBqycni3DT9NW7zDVYobYLhP~kEWOozAnp6TTWuQ4GFLN9vwdRqcXh9VbYVnHMtmf9txhZiUoHtQlxE3WPz6jq0bh6UrGP7WubRTYVjDZGini~Q2li-aww2Ba5nmIiDyvFVJV9CORPY466mWbtEi3LV1uWYYiZ05jY7iN8c~9RLm~OR531lYeZeJD0Ha~I39efyQXM90b52c5G7UG00RbbALvujusw7488j1HkN1p6Ka-BJfsZMYHYK6wyrDLI1y9vETArr7YcgpLvA__&Key-Pair-Id=APKAJ6Z4RF5IYK7Y3SQQ"

see, thank you


Enable notification

Add route "/event/${domain}" for post requests
Add command "Enable notification"
Enable notification must add route "notify/${domain}" to combomanual
https://vetmanager.ru/knowledgebase/nastroyka-web-hukov
"Disable notification" - delete our route from combo manual
When receive hook with action InvoiceRollback - notify all users for this domain with message "Откатили счет ${invoiceId}"

One web-hook link per one domain


JB-477 - Clicking cycle card take user to cycle tab

What does this PR do and why?
Closes JB-477
Screenshots or screen recordings
If applicable, provide screenshots or screen recordings to demonstrate the changes.
Acceptance checklist

[ ] I have evaluated the Approval Guidelines for this PR.
[ ] (if relevant) I have tested this PR in all supported browsers.
[ ] (if relevant) I have tested this PR in dark mode and light mode (if applicable).

Current dependencies on/for this PR:

main

PR #3794

PR #3795

PR #3796

PR #3797

PR #3798

PR #3799

PR #3800

PR #3801

@wraeth-eth started a stack merge that includes this pull request via Graphite.

Graphite rebased this pull request as part of a merge.

@wraeth-eth merged this pull request with Graphite.


How to set empty list or empty widget when no data from server?

Currently. No data equals firstPageProgressIndicatorBuilder displayed.
How to get rid of that? What need to be returned to pagingController?
Thanks

You need to append a new page.
I recommend that you go through our step-by-step tutorial.


Use list in all yum/apt package install tasks

Description
This PR replaces all loops on package install tasks with a list of packages supplied to the yum and apt ansible modules. This should improve performance on the desired state package tasks.
I have left out the upgrade-playbooks, at least for now, as they are not idempotent (#https://github.com/confluentinc/cp-ansible/issues/588) and will typically be run just once.
Type of change

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

Checklist:

[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my own code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] Any dependent changes have been merged and published in downstream modules
[ ] Any variable changes have been validated to be backwards compatible

Doing some testing now- looks like packages with the correct versions are getting installed:
dbove@dbove-MBP15 terraform % docker exec -it kafka-broker1 rpm -qa | grep confluent
confluent-telemetry-6.1.0-1.noarch
confluent-rest-utils-6.1.0-1.noarch
confluent-kafka-rest-6.1.0-1.noarch
confluent-ce-kafka-http-server-6.1.0-1.noarch
confluent-security-6.1.0-1.noarch
confluent-common-6.1.0-1.noarch
confluent-metadata-service-6.1.0-1.noarch
confluent-server-rest-6.1.0-1.noarch
confluent-server-6.1.0-1.noarch
confluent-rebalancer-6.1.0-1.noarch

I'm hoping not to see any 611 in this list fyi.
It does seem to take a while now. where before at least you felt like there was progress bc of the loop. I can't say its faster or not but I'm guessing it is. We might be able to tell via old jenkins logs- ill check.

In you jenkins logs it appears to install the zookeeper packages it took ~40 seconds:
22:51:42      TASK [confluent.zookeeper : Install the Zookeeper Packages] ********************
22:52:21      changed: [zookeeper11]
22:52:21      changed: [zookeeper31]
22:52:21      changed: [zookeeper21]

From other logs without this change we have ~60 seconds:
08:52:12      TASK [confluent.zookeeper : Install the Zookeeper Packages] ********************
08:52:17      changed: [zookeeper21] => (item=confluent-common)
08:52:17      changed: [zookeeper11] => (item=confluent-common)
08:52:17      changed: [zookeeper31] => (item=confluent-common)
08:52:24      changed: [zookeeper11] => (item=confluent-rest-utils)
08:52:24      changed: [zookeeper21] => (item=confluent-rest-utils)
08:52:24      changed: [zookeeper31] => (item=confluent-rest-utils)
08:52:30      changed: [zookeeper21] => (item=confluent-metadata-service)
08:52:30      changed: [zookeeper11] => (item=confluent-metadata-service)
08:52:32      changed: [zookeeper31] => (item=confluent-metadata-service)
08:52:36      changed: [zookeeper11] => (item=confluent-ce-kafka-http-server)
08:52:36      changed: [zookeeper21] => (item=confluent-ce-kafka-http-server)
08:52:38      changed: [zookeeper31] => (item=confluent-ce-kafka-http-server)
08:52:46      changed: [zookeeper11] => (item=confluent-kafka-rest)
08:52:46      changed: [zookeeper21] => (item=confluent-kafka-rest)
08:52:46      changed: [zookeeper31] => (item=confluent-kafka-rest)
08:52:50      changed: [zookeeper21] => (item=confluent-server-rest)
08:52:50      changed: [zookeeper11] => (item=confluent-server-rest)
08:52:50      changed: [zookeeper31] => (item=confluent-server-rest)
08:52:54      changed: [zookeeper21] => (item=confluent-telemetry)
08:52:54      changed: [zookeeper11] => (item=confluent-telemetry)
08:52:55      changed: [zookeeper31] => (item=confluent-telemetry)
08:53:10      changed: [zookeeper21] => (item=confluent-server)
08:53:10      changed: [zookeeper31] => (item=confluent-server)
08:53:10      changed: [zookeeper11] => (item=confluent-server)

I just checked another log, also around 60 seconds. So theres definitely efficiency improvements! Nice work!

Yes, it is sad that you don't see the progress - as you do with the loop. But speed is more important in my opinion. 😄

Yep this is a nice improvement. Thanks for yet another contribution! I just confirmed no 6.1.1 packages were installed on any hosts after setting confluent_package_version to 6.1.0


Failed to download almost all of the files

Failed to download: lib/reac_utils.lua
Failed to download: lib/monitor_utils.lua
Failed to download: lib/stat_utils.lua
Failed to download: lib/energy_core_utils.lua

This might be due to the program trying to download from /lib/ instead of just downloading the files from the root. Should be a simple fix.

I updated most of the program, try reinstalling and see if that works.


Adding username/password produces htpasswd: command not found error

Problem/Motivation
When adding a username/password the logs produce this error:
[cont-init.d] 30-nginx.sh: executing...
/var/run/s6/etc/cont-init.d/30-nginx.sh: line 36: htpasswd: command not found

Full log:
[s6-init] making user provided files available at /var/run/s6/etc...exited 0.
[s6-init] ensuring user provided files have correct perms...exited 0.
[fix-attrs.d] applying ownership & permissions fixes...
[fix-attrs.d] 10-postgres: applying...
[fix-attrs.d] 10-postgres: exited 0.
[fix-attrs.d] 11-octobox: applying...
[fix-attrs.d] 11-octobox: exited 0.
[fix-attrs.d] done.
[cont-init.d] executing container initialization scripts...
[cont-init.d] 00-banner.sh: executing...
-----------------------------------------------------------
 Hass.io Add-on: Octobox v0.1.0
 Take back control of your GitHub notifications
 From: Community Hass.io Add-ons
 By: Franck Nijhof<EMAIL_ADDRESS>-----------------------------------------------------------
[cont-init.d] 00-banner.sh: exited 0.
[cont-init.d] 01-log-level.sh: executing...
Log level is set to INFO
[cont-init.d] 01-log-level.sh: exited 0.
[cont-init.d] 02-updates.sh: executing...
INFO: You are running the latest version of this add-on
[cont-init.d] 02-updates.sh: exited 0.
[cont-init.d] 10-requirements.sh: executing...
[cont-init.d] 10-requirements.sh: exited 0.
[cont-init.d] 20-initdb.sh: executing...
[cont-init.d] 20-initdb.sh: exited 0.
[cont-init.d] 30-nginx.sh: executing...
/var/run/s6/etc/cont-init.d/30-nginx.sh: line 36: htpasswd: command not found
[cont-init.d] 30-nginx.sh: exited 127.
[cont-finish.d] executing container finish scripts...
[cont-finish.d] 99-message.sh: executing...
-----------------------------------------------------------
                Oops! Something went wrong.

 We are so sorry, but something went terribly wrong when
 starting or running this add-on.

 Be sure to check the log above, line by line, for hints.
-----------------------------------------------------------
[cont-finish.d] 99-message.sh: exited 0.
[cont-finish.d] done.
[s6-finish] syncing disks.
[s6-finish] sending all processes the TERM signal.

Steps to reproduce
Add a username/password to the add-on config

Thanks for reporting @timmo001, this is high priority because of the possible security implication this might have.


Linking in local Backstage packages

I have created my backstage app. So, I need to work on @backstage/core package located in another folder.
by following this instructions (https://backstage.io/docs/getting-started/create-an-app#linking-in-local-backstage-packages), it is installed successfully.
Expected Behavior

With this in place you I now modify the @backstage/core package within the main repo, and have those changes be reflected and tested in my app. Simply run your app using yarn start as normal.
Current Behavior

It is installed @backstage/core from registry npm, but the local backstage package components are not installed instead.
Steps to Reproduce

Add path to workspace files package.json and lerna.json

"workspaces": {
    "packages": [
      "packages/*",
      "plugins/*",
      "../backstage/packages/core"  // -> new path added
    ]
  },

Install command:

yarn install

Also, I deleted the root node_modules and reinstall as additional step.
Context
I am trying to get custom componets for my custom application.

On the other hand, if I run the command:
yarn tsc

I get stack trace error log:
Type 'import("/backstage-sample/sample/node_modules/@backstage/theme/dist/index").BackstageTheme' is not assignable to type 'import("/backstage/packages/theme/src/types").BackstageTheme'.
...
packages/app/src/sidebar.tsx:29:18 - error TS2322: Type 'OverridableComponent<SvgIconTypeMap<{}, "svg">>' is not assignable to type 'ComponentType<OverrideProps<SvgIconTypeMap<{}, "svg">, "svg">>'.
  Type 'OverridableComponent<SvgIconTypeMap<{}, "svg">>' is not assignable to type 'FunctionComponent<OverrideProps<SvgIconTypeMap<{}, "svg">, "svg">>'.
    Types of parameters 'props' and 'props' are incompatible.

I need help to solve this issue. Any solution?
Your Environment

NodeJS Version (v14): v14
Operating System and Version (e.g. Ubuntu 14.04): MacOS 10.15.7
Browser Information: Safari, Chrome, (it is not important)

Hey! This issue does not seem to be related to the TechDocs feature, hence I'd update the title. :)

Hey! This issue does not seem to be related to the TechDocs feature, hence I'd update the title. :)

@LARGH Does yarn start work as expected?
Tbh I don't think we can guarantee that types work smoothly since the linked packages will use the types from that repo, which means any dependency versions between the two projects have to match. A workaround that did work for me was to copy the yarn.lock from the linked in project to the app and running yarn install, in this case copying backstage/yarn.lock to sample/yarn.lock. This is quite intrusive to an existing project and may cause breakages in other places though, so not a silver bullet.
One thing I did notice when messing around with this a bit is that incremental types don't work correctly. Changes in the linked in packages won't be reflected unless the type cache in dist-types is cleaned. A workaround for this is to add "incremental": false in the compiler options in tsconfig.json, gonna add that to docs too.

@LARGH Does yarn start work as expected?
Tbh I don't think we can guarantee that types work smoothly since the linked packages will use the types from that repo, which means any dependency versions between the two projects have to match. A workaround that did work for me was to copy the yarn.lock from the linked in project to the app and running yarn install, in this case copying backstage/yarn.lock to sample/yarn.lock. This is quite intrusive to an existing project and may cause breakages in other places though, so not a silver bullet.
One thing I did notice when messing around with this a bit is that incremental types don't work correctly. Changes in the linked in packages won't be reflected unless the type cache in dist-types is cleaned. A workaround for this is to add "incremental": false in the compiler options in tsconfig.json, gonna add that to docs too.

Curiously, when I execute yarn start, the project builds successfully but the core components are from registry.
So that you said, I should test to change "incremental": false or I should wait to the #4116 pull request?

Curiously, when I execute yarn start, the project builds successfully but the core components are from registry.
So that you said, I should test to change "incremental": false or I should wait to the #4116 pull request?

Curiously, when I execute yarn start, the project builds successfully but the core components are from registry.
So that you said, Should I should test to change "incremental": false? or Should I wait to the #4116 pull request?
Or, Is there another way to modify core components?
Do you think if it is better to create my own components library based on the core components package?

Curiously, when I execute yarn start, the project builds successfully but the core components are from registry.
So that you said, Should I should test to change "incremental": false? or Should I wait to the #4116 pull request?
Or, Is there another way to modify core components?
Do you think if it is better to create my own components library based on the core components package?

@LARGH Updated https://backstage.io/docs/getting-started/create-an-app#linking-in-local-backstage-packages with my comments from above. The main thing you'd need to do if you want type checking to work is to sync up dependency versions.
Regarding modifying core components, the best way is to do it in the main repo and then sending a PR, perhaps opening an issue with ideas before that. We may eventually allow components to be overridden in the app as well, but no concrete plans for that yet. For creating your own components you'd just put them in plugins, or in a separate package in your app monorepo.

@LARGH Updated https://backstage.io/docs/getting-started/create-an-app#linking-in-local-backstage-packages with my comments from above. The main thing you'd need to do if you want type checking to work is to sync up dependency versions.
Regarding modifying core components, the best way is to do it in the main repo and then sending a PR, perhaps opening an issue with ideas before that. We may eventually allow components to be overridden in the app as well, but no concrete plans for that yet. For creating your own components you'd just put them in plugins, or in a separate package in your app monorepo.


CYF-ITP-South Africa| Serna Malala | Module-User-Focused-Data | Week 2

Briefly explain your PR.
I have created a simple form with different labels and input tags.
I have added basic CSS to give the page some colour and made sure the footer remained at the bottom.
Questions
I wanted to find out if my layout is correct and whether I should refrain from using too many divs.

Hi, your layout looks acceptable. For accessibility you will need to address the following.
"Form elements do not have associated labels"
As for divs, it depends on the situation, but generally speaking, if you don't need something you shouldn't add it.

It is best practice to add a submit button to your form.

You also don't need to ask for a surname.

Hi @Waldo-Strydom I added the submit button. For the forms elements do not have associated labels, In the exercise instructions it mentioned 'All fields are required. Do not write a form action for this project.' so I'm not sure what you mean.

Hi @sernamalala labels are not form actions. They are there for accessibility purposes. Blind people etc. Rely on screen readers to tell them what is on screen.
Without a label, they will just hear "input" and they will not know what they need to input.
That is why labels are important.

Hi @Waldo-Strydom. Thanks alot I understand now so the 'name' of each label is necessary for people with special needs.

I'm not sure why the lighthouse output is giving me the same result, I have added the labels

Okay. I understand, the AI said that it's good practice especially since we'll be using javascript soon. Thank you @Waldo-Strydom.

Well done.


What is the ground truth we used for training semantic global policy?

Does anybody can give me some explanations about:

I think the semantic mapping module is not a learnable module, am I right?
What is the ground truth we need to train the semantic global policy, the top-view 2D semantic map?

Thanks!!

I am reading this paper and want to do the experiment.
For the first question: As it says in the paper, the semantic mapping module should be trained.  The Mask RCNN weights are frozen but the denoising network should be trained.
For the second question: As it says in the paper, The Goal-Oriented Semantic Policy decides a long-term goal
based on the current semantic map to reach the given object goal. It takes the semantic map, the agent’s current and
past locations, and the object goal as input and predicts a long-term goal in the top-down map space.


GPL with linking exception

Before You Begin
Before proceeding, please make sure to follow these steps:

[x] I have checked for similar questions in the project's issue tracker to avoid duplicates.
[x] I have searched existing issues to see if this question has been asked before.

Your Question
Shouldn't GPL with linking exception be compatible with other open source licences?
See https://en.wikipedia.org/wiki/GPL_linking_exception
Example
I import pygit2 from an MIT licence project and it says it is incompatible. The author state the contrary (see https://github.com/libgit2/pygit2/issues/632). Wikipedia back this up.
I'm not a lawyer.

This is my understanding - Disclaimer: IANAL (I am not a lawyer)
In the context of Python, where libraries are typically imported dynamically at runtime (similar to dynamic linking), the distinction between static and dynamic linking is less clear-cut than in compiled languages.
Licensecheck errs on the side of caution when flagging GPL-licensed dependencies, even in Python projects, to prevent accidental license violations. The use of a GPL library in a project with a different license, like MIT, may raise concerns about whether the entire project needs to comply with GPL terms.
It might be absolutely fine to use a library that is GPL licensed in your project, though I'd suggest consulting with a lawyer to ensure compliance with licensing obligations, especially in commercial or business settings.
In my experience, many companies prefer to avoid GPL libraries altogether due to these complexities, including in python.
Again, this does not constitute legal advice, so please speak with a legal professional for specific guidance.
For now, I do not plan on changing this behaviour, as imo it is right to flag potential violations even if unlikely

Fixed in https://github.com/FHPythonUtils/LicenseCheck/releases/tag/2024.3


Design a FAQ page for the website

Give me this task please

@shubhagarwal1 @arpit74170 we already have a FAQ page for the website

hey @notsoocool can you tell me soemthing other to work on, that would enhance and help the website to upgrade, it would be a greate opportunity for me.

@shubhagarwal1 can you make the whole website responsive???

@shubhagarwal1 can you make the whole website responsive???

whole website includes all pages, canyou please share more details

@shubhagarwal1 can you make the whole website responsive???

whole website includes all pages, canyou please share more details

See, whatever seems not responsive for mobile, you can work on that. It depends on how many pages you want to make responsive, and it will also affect your points.


Add collection to datastore interface

What this PR does / why we need it:
This PR adds a way to extend the logic of "what should we handle storing data object" without specific its kind by using an interface called Collection instead of primitive string Kind.
The Datastore interface will be
type DataStore interface {
	Find(ctx context.Context, col Collection, opts ListOptions) (Iterator, error)
	Get(ctx context.Context, col Collection, id string, entity interface{}) error
	Create(ctx context.Context, col Collection, id string, entity interface{}) error
	Put(ctx context.Context, col Collection, id string, entity interface{}) error
	Update(ctx context.Context, col Collection, id string, updater Updater) error
	Close() error
}

And the Collection interface will be
type Collection interface {
	Kind() string
	Factory() Factory
}

Which issue(s) this PR fixes:
Fixes #
Does this PR introduce a user-facing change?:

NONE

Nice. This makes the datastore package more flexible.
/lgtm

Love it. That brings us to be latitude, btw hopefully we can generate mock programmatically 😓
/approve


EDI3

Hi folks!
Are you familiar with EDI3?

"EDI for the Web: Supply Chain Standards and Tools for Web Developers"
Addresses this problem:
Web APIs are a “publish once, consume many times” model whilst EDI documents are more like a “create once and copy & paste many times” model.
https://edi3.org/: home
https://edi3.org/semantic-specs/: shows the scope. IMHO there is plenty of overlap with some GS1 specs

A conceptual model that then has Open API, JSON-LD, UML profile renditions
https://github.com/edi3: 26 repos
https://github.com/edi3/edi3-json-ld-ndr/

It is an informal collaboration that contributes to UN/CEFACT.
IPR Policy for edi3.org:

All edi3.org specifications are available under GPL3.0 open source license.
edi3.org does not own any IP. Ownership of all contributions remains with the contributor.
From time to time, edi3.org specifications may be offered as initial contributions to formal projects run by UN/CEFACT. In such cases, contributors are expected to grant ownership of their IP to the UN.

Hi @VladimirAlexiev, yes, we are. Colleagues are involved directly in the UN/CEFACT work from which EDI3 is derived. I see Jaco included you in an email to a lot of people a short while ago so you're up to date. With that in mind, OK if we close the issue here?

Jaco Voorspuij:
Over the past few years Thierry and I have attended several UN/CEFACT sessions on the topic of EDI3.ORG.
In principle edi3.org “translates” the UN/CEFACT data models into JSON format based API and they (intend to) do that automatically.
So they should in principle be able to quite quickly map any updates to the UN/CEFACT data models into a corresponding JSON format.
This means that again in principle, the edi3.org JSON based API can cover the same business processes that the UN/CEFACT data models cover.
Since GS1 and UN/CEFACT both cover a large number of data models, there is also a large overlap between the models/processes that edi3.org cover.
The issue still remains that the industry does NOT implement the business processes very consistently and therefore the choreography of information exchanges is often incomplete or inconsistent.
This is one of the main reasons that GS1 have started the Visibility4Cargo initiative (lead by the Transport & Logistics sector) that will establish a guideline for consistent implementation of global data standards (including those from GS1 but not limited to GS1) to enable multi-modal track & trace of goods from seller to buyer. EPCIS is one of the primary building blocks for the guideline building on global data standards, but commonly used global identification standards (like the GS1 ID Keys) is the top priority.
The MSWG Visibility4Cargo has its kick-off meeting 12th January.
More info (and option to join) is available here.
Thierry is also involved in a UN/CEFACT group that is engaged in related efforts, so we can align with the UN/CEFACT efforts and standards..
Truth be told, I am not entirely sure about the “official” relationship between UN/CEFACT and edi3.org today.
When I was more closely involved in UN/CEFACT efforts, the official relationship was “complex” and edi3.org was definitely not considered as part of UN/CEFACT.
Unless things have changed a lot, the edi3.org products  cannot be considered official standards.
Ultimately, adoption is always more important than solutions being official standards.
Therefore, it is imperative that GS1 develop a good implementation guideline as a result from the Visibility4Cargo MSWG, that industry will want to adopt.
Being the first solution to be (widely) adopted ensures a competitive advantage for further adoption.
The MSWG Visibility4Cargo will welcome further participation to ensure we deliver this good implementation guideline.

Hi @philarcher sorry, maybe this project is completely inappropriate for EDI3 and maybe instead I should post an issue in EDI3 so they could consider aligning to GS1 standards. But let's keep it open for a while to gather some info.
I'm still trying to orient myself in the GS1 standards universe.

I knew about the existence of Visibility4Cargo but not really what it means
Jaco wrote "lead by the Transport & Logistics sector": but in my mind GS1 is all about Transport & Logistics? Sure, it has WGs on special topics like tracking of medical devices, but the main topic is Transport & Logistics?
I've watched a presentation by the "EDI Semantics" GS1 WG, but if I understand correctly it's not about semantic web at all?

I browsed through EDI3 and

many of the specs are just templates with little text inside
naming convention between classes (PascalCase) and props (camelCase) is not conformed to
this may stem from a mixup between what is class and what is property and what is individual, eg https://github.com/edi3/edi3-json-ld-ndr/blob/main/docs/index.md#linked-data says something atrocious like this (author is not a proper individual, neither it is a proper class for a person!)
<https://schema.org/author> <https://schema.org/givenName> Nis
wrong URLs expressed in Turtle examples, eg
<rec20:kilogram_per_square_meter> <rdfs:comment> "Unit of surface density, areic mass" .
ontology definitions in Turtle are wrong: subClassOf "stringNameOfClass"
no proper namespace design, eg new permanent url, e.g https://edi3.org/vocab/2020.09/context.json: "new" and "permanent" make an oxymoron, and ironically that URL does not resolve

I posted a few more specific issues in https://github.com/edi3/edi3-json-ld-ndr/issues


[docs][seatunnel] add seatunnel flink doris sink doc

Proposed changes
Issue Number: close #xxx
Problem Summary:
Describe the overview of changes.
Checklist(Required)

Does it affect the original behavior: (Yes/No/I Don't know)
Has unit tests been added: (Yes/No/No Need)
Has document been added or modified: (Yes/No/No Need)
Does it need to update dependencies: (Yes/No)
Are there any changes that cannot be rolled back: (Yes/No)

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

add sidebar

add sidebar

thanks, already modified


Failing to build memory.cpp.o

I'm trying to build MKL-DNN in my Docker (based on the GCC 8.1.0 image which is built on Debian:Stretch), and have been getting this issue (see below) where it fails to build the memory cpp object. Please let me know if any other information would be helpful!
(Note: I tried to use the -w flag to override all the warnings but it still treats them as errors)

Environment

CPU

Architecture:          x86_64
CPU op-mode(s):        32-bit, 64-bit
Byte Order:            Little Endian
CPU(s):                8
On-line CPU(s) list:   0-7
Thread(s) per core:    1
Core(s) per socket:    1
Socket(s):             8
NUMA node(s):          1
Vendor ID:             GenuineIntel
CPU family:            6
Model:                 58
Model name:            Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz
Stepping:              0
CPU MHz:               2599.998
BogoMIPS:              5199.99
Hypervisor vendor:     VMware
Virtualization type:   full
L1d cache:             32K
L1i cache:             32K
L2 cache:              256K
L3 cache:              25600K
NUMA node0 CPU(s):     0-7
Flags:                 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts mmx fxsr sse sse2 ss syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts nopl xtopology tsc_reliable nonstop_tsc pni pclmulqdq ssse3 cx16 pcid sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm spec_ctrl retpoline kaiser fsgsbase tsc_adjust smep arat

OS:

Linux 41b12110b15c 4.4.0-116-generic #140-Ubuntu SMP Mon Feb 12 21:23:04 UTC 2018 x86_64 GNU/Linux

GCC
gcc (GCC) 8.1.0

MKLROOT:
 /opt/intel/compilers_and_libraries/linux/mkl
(version is 2018.3.222)

CMake
Version: 3.7.2

Steps to reproduce
     git clone https://github.com/intel/mkl-dnn.git && \
     cd /opt/mkl-dnn && cd scripts && ./prepare_mkl.sh && cd .. && \
     mkdir -p build && cd build && cmake -w CMAKE_CXX_FLAGS='-w' .. &&   make CFLAGS="-w" "-Werror=format-truncation=" && make install

Behavior
-- The CXX compiler identification is GNU 8.1.0
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- CMAKE_BUILD_TYPE is unset, defaulting to Release
-- Detecting Intel(R) MKL: trying mklml_intel
-- Detecting Intel(R) MKL: trying mklml
-- Detecting Intel(R) MKL: trying mkl_rt
-- Intel(R) MKL: include /opt/intel/compilers_and_libraries/linux/mkl/include
-- Intel(R) MKL: lib /opt/intel/compilers_and_libraries/linux/mkl/lib/intel64/libmkl_rt.so
-- Intel(R) MKL: OpenMP lib /opt/intel/compilers_and_libraries/linux/lib/intel64/libiomp5.so
-- Try OpenMP C flag = [-fopenmp]
-- Performing Test OpenMP_FLAG_DETECTED
-- Performing Test OpenMP_FLAG_DETECTED - Success
-- Try OpenMP CXX flag = [-fopenmp]
-- Performing Test OpenMP_FLAG_DETECTED
-- Performing Test OpenMP_FLAG_DETECTED - Success
-- Found OpenMP: -fopenmp
-- Found Doxygen: /usr/bin/doxygen (found version "1.8.13")
-- VTune profiling environment is unset
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Looking for pthread_create
-- Looking for pthread_create - found
-- Found Threads: TRUE
-- Configuring done
-- Generating done
-- Build files have been written to: /opt/mkl-dnn/build

Error on make:
[  1%] Building CXX object src/CMakeFiles/mkldnn.dir/common/batch_normalization.cpp.o
[  1%] Building CXX object src/CMakeFiles/mkldnn.dir/common/convolution.cpp.o
[  1%] Building CXX object src/CMakeFiles/mkldnn.dir/common/convolution_relu.cpp.o
[  2%] Building CXX object src/CMakeFiles/mkldnn.dir/common/deconvolution.cpp.o
[  2%] Building CXX object src/CMakeFiles/mkldnn.dir/common/eltwise.cpp.o
[  3%] Building CXX object src/CMakeFiles/mkldnn.dir/common/engine.cpp.o
[  3%] Building CXX object src/CMakeFiles/mkldnn.dir/common/inner_product.cpp.o
[  3%] Building CXX object src/CMakeFiles/mkldnn.dir/common/lrn.cpp.o
[  4%] Building CXX object src/CMakeFiles/mkldnn.dir/common/memory.cpp.o
In file included from /opt/mkl-dnn/src/common/primitive_desc.hpp:26,
                 from /opt/mkl-dnn/src/common/primitive.hpp:27,
                 from /opt/mkl-dnn/src/common/engine.hpp:24,
                 from /opt/mkl-dnn/src/common/memory.cpp:24:
/opt/mkl-dnn/src/common/verbose.hpp: In function ‘void mkldnn::impl::init_info_mem(pd_t*, char*) [with pd_t = mkldnn::impl::concat_pd_t]’:
/opt/mkl-dnn/src/common/verbose.hpp:53:46: error: ‘%s’ directive output may be truncated writing up to 383 bytes into a region of size between 232 and 1019 [-Werror=format-truncation=]
     snprintf(buffer, MKLDNN_VERBOSE_BUF_LEN, "%s,%s,%s,%s,%s,%s",
                                              ^~~~~~~~~~~~~~~~~~~
/opt/mkl-dnn/src/common/verbose.hpp:215:22:
             aux_str, prb_str);
                      ~~~~~~~
In file included from /usr/include/stdio.h:938,
                 from /usr/local/include/c++/8.1.0/cstdio:42,
                 from /usr/local/include/c++/8.1.0/ext/string_conversions.h:43,
                 from /usr/local/include/c++/8.1.0/bits/basic_string.h:6361,
                 from /usr/local/include/c++/8.1.0/string:52,
                 from /usr/local/include/c++/8.1.0/stdexcept:39,
                 from /usr/local/include/c++/8.1.0/array:39,
                 from /usr/local/include/c++/8.1.0/tuple:39,
                 from /usr/local/include/c++/8.1.0/bits/stl_map.h:63,
                 from /usr/local/include/c++/8.1.0/map:61,
                 from /opt/mkl-dnn/src/common/nstl.hpp:25,
                 from /opt/mkl-dnn/src/common/event.hpp:20,
                 from /opt/mkl-dnn/src/common/engine.hpp:23,
                 from /opt/mkl-dnn/src/common/memory.cpp:24:
/usr/include/x86_64-linux-gnu/bits/stdio2.h:64:35: note: ‘__builtin___snprintf_chk’ output 6 or more bytes (assuming 1176) into a destination of size 1024
   return __builtin___snprintf_chk (__s, __n, __USE_FORTIFY_LEVEL - 1,
          ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
        __bos (__s), __fmt, __va_arg_pack ());
        ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
cc1plus: all warnings being treated as errors
src/CMakeFiles/mkldnn.dir/build.make:254: recipe for target 'src/CMakeFiles/mkldnn.dir/common/memory.cpp.o' failed
make[2]: *** [src/CMakeFiles/mkldnn.dir/common/memory.cpp.o] Error 1
CMakeFiles/Makefile2:117: recipe for target 'src/CMakeFiles/mkldnn.dir/all' failed
make[1]: *** [src/CMakeFiles/mkldnn.dir/all] Error 2
Makefile:138: recipe for target 'all' failed
make: *** [all] Error 2

Hi @sadatnfs,
Thanks for noting this. The fix is shown below.
We will promote it to master soon.
diff --git a/src/common/verbose.hpp b/src/common/verbose.hpp
index c55182a8..b57ebd3c 100644
--- a/src/common/verbose.hpp
+++ b/src/common/verbose.hpp
@@ -42,8 +42,8 @@ double get_msec();
 #define MKLDNN_VERBOSE_PRB_LEN 384

 #define DECL_DAT_AUX_PRB_STRS() \
-    char dat_str[MKLDNN_VERBOSE_PRB_LEN] = {'\0'}; MAYBE_UNUSED(dat_str); \
-    char aux_str[MKLDNN_VERBOSE_PRB_LEN] = {'\0'}; MAYBE_UNUSED(aux_str); \
+    char dat_str[MKLDNN_VERBOSE_DAT_LEN] = {'\0'}; MAYBE_UNUSED(dat_str); \
+    char aux_str[MKLDNN_VERBOSE_AUX_LEN] = {'\0'}; MAYBE_UNUSED(aux_str); \
     char prb_str[MKLDNN_VERBOSE_PRB_LEN] = {'\0'}; MAYBE_UNUSED(prb_str)

 inline void verbose_templ(char *buffer, mkldnn_primitive_kind_t prim_kind,
diff --git a/tests/benchdnn/common.cpp b/tests/benchdnn/common.cpp
index fa028a45..7d836ba0 100644
--- a/tests/benchdnn/common.cpp
+++ b/tests/benchdnn/common.cpp
@@ -299,7 +299,7 @@ FILE *open_batch_file(const char *fname) {
     const int max_paths = 4;

     static int n_paths = 0;
-    static char search_paths[max_paths][PATH_MAX] = {{0}};
+    static char search_paths[max_paths][PATH_MAX - 2] = {{0}};

     char *fdir = NULL;
     {

Awesome, I'll just wait until Master is updated for my next build, thanks @emfomenk !

Oh, is there a PR in order for this fix? Wasn't sure how long I'd wait for Master to be updated, and whether I could just use a fork or a hack in my Dockerfile for this fix now. Thanks!

I am going to promote the fix tomorrow. We already have the fix in the internal repo, and just wait for some final checks to finish.

Here we are.
The fix is in the master.

Can confirm that memory.cpp compiles all good! Thanks!!!

Glad to hear!
Thanks for the report! :)


Add documentation comments when we have app code completion

@bhagatabhijeet @bosshogg86 @vharnarine @mkamran67
Let's make sure we add documentation comments when we have app code completion and before we show code during presentation.
we need to show we followed best practices.

done!


Material-Theme in new Version

Describe the bug
The style of the Material Theme is not correct in the new Version (2.1.0.alpha1 and current Master)
To Reproduce

Add @Theme(Material.class) in com.github.appreciated.app.layoutMainLayout of the app-layout-demo.
Run the application

Screenshots
App Drawer

Ripple effect on click:

Notifications:

I don't understand what the problem is, this looks beautiful 😅.

Most of the issues should have been fixed by<PHONE_NUMBER>ffbe2ce92797e00de1b3f73c56fdfb. Dark still has some major issues.

fixed by 1ec458cbf4d248cebce8748eefddedd44ca41e2d


related to: Unable to compile anymore #377 - fixes bug to compile it with opencv 3.2.0

fixes the compile error:
/opt/ros/kinetic/include/opencv-3.2.0-dev/opencv2/flann/saving.h:113:63: error: exception handling disabled, use -fexceptions to enable
throw FLANNException("Invalid index file, cannot read");

Works like a charm! My configuration:

Ubuntu 16.04
ROS Kinetic
OpenCV 3.2
CUDA 8.0
PCL 1.8

#465  fixes this


[WIP] Include GitHub URL in SARIF locations

Alternative to #639. Maybe we can directly embed the GitHub URL in the SARIF location.

Best not to mess with SARIF. Going back to the other PR!