[YoutubeBridge] Fix bridge

Add support for custom channel name (as request #2206).
Add new method to fetch JSON data.
Search, listing now parsing data through JSON, HTML is not work anymore.
~Remove page number input on the Search endpoint.~
Merge two parseJSON function into one.
~Add ability to get better timestamp.~
Fix regex on duration limit.
Add anchor on some link in the description text.
Add URL on the getURI() for each context.
UPDATE 20/07/2021:
Add support for Youtube Data API v3.
Fix playlists that have more than 15 items not display correctly.
Add new custom name parameter.
Fix sorting on playlist not function correctly if use API.
Fix duration when try to get timestamp from Premiering video. (I haven't tested this on API)
Update regex for URL.

Notes: This bridge will handle the case like Video, Livestream. Other videos like Premiering stuff not tested.

https://feed.eugenemolotov.ru/pr2208/?action=display&bridge=Youtube&context=By+playlist+Id&p=PLaDrN74SfdT7Ueqtwn_bXo1MuSWT0ji2w&duration_min=&duration_max=&format=Html
Item timestamps are incorrect. All videos show July 13 (today) with different years.
Previous version of timestamp fetching worked fine. Isn't it?

https://feed.eugenemolotov.ru/pr2208/?action=display&bridge=Youtube&context=By+playlist+Id&p=PLaDrN74SfdT7Ueqtwn_bXo1MuSWT0ji2w&duration_min=&duration_max=&format=Html
Item timestamps are incorrect. All videos show July 13 (today) with different years.
Previous version of timestamp fetching worked fine. Isn't it?

I looked into the video, for example like this: https://www.youtube.com/watch?v=UP091FeB-3o and see the timestamp is 2 years ago 15 minutes after extracted. So that why you see all videos show today with different years.

I'm going to remove those timestamp and set it back to use the meta timestamp instead.
The only way to get the corrected timestamp beside RSS feed is to using API from YouTube.

Add support for custom channel name

This must be implemented as the other context, not as "User". For example, these channels are different:
https://www.youtube.com/c/DeathmatchTV
https://www.youtube.com/user/DeathmatchTV
Everything else looks good and ready to be merged once resolved issue above.

Temporary marking this as draft until PR #2100 is merged

hi, @csisoap!
How is this PR related to that PR? That PR btw is blocked by other (droping support of php 5.6 and 7.0)

hi, @csisoap!
How is this PR related to that PR? That PR btw is blocked by other (droping support of php 5.6 and 7.0)

Hi @em92, this PR does supported Youtube Data API v3, which requires an API key. And that PR supported using environment variable for the bridge. I'm intent to add support for getting API key from environment variable once that PR is merged to avoid people accidently commited to the public repo.

hi again, @csisoap!
Could you please temporary take out Youtube Data API v3 support and add new PR after I merge this PR? There are other some good features and fixes that you implemented. #2100 problably will be long to accept since RSS-Bridge needs to drop php 5.6 and 7.0.
After you take that API usage out, I will check PR again and, if everything works fine, I will accept it.

You can merged it now, @em92

Following links return empty feed:
https://feed.eugenemolotov.ru/pr2208/?action=display&bridge=Youtube&context=Search+result&s=Front+Mission+3&duration_min=&duration_max=&format=Html (search)
https://feed.eugenemolotov.ru/pr2208/?action=display&bridge=Youtube&context=By+playlist+Id&p=PLaDrN74SfdT7Ueqtwn_bXo1MuSWT0ji2w&duration_min=&duration_max=&format=Html (playlist)
Current version returns non-empty playlist: https://feed.eugenemolotov.ru/?action=display&bridge=Youtube&context=By+playlist+Id&p=PLaDrN74SfdT7Ueqtwn_bXo1MuSWT0ji2w&duration_min=&duration_max=&format=Html

Oops, my bad. Sorry about that. I've pushed a commit that resolve this.

gj!


Android Basics in Kotlin

@android-dev-lxl @osuleymanova
This course requires attention and an update

Some of the course content is nonsensical because of how its been written and there are a lot of issues.
I would expect these courses to be easy to follow along to and easy retain as they are created by JetBrains and by Android Developer.

Hello @User202379,
Thank you for your feedback. We're sorry to hear that the courses don't live up to your expectations.


[ENHANCEMENT] add custom field mode support

Description

Closes #<issue_number>
Type of change

Bug fix (non-breaking change which fixes an issue)
New feature (non-breaking change which adds functionality)
Breaking change (fix or feature that would cause existing functionality to not work as expected)
Refactor (change restructuring the codebase without changing functionality)
Improvement (change adding some improvement to an existing functionality)
Documentation update

How Has This Been Tested

Checklist

I added relevant documentation
I followed the style guidelines of this project
I did a self-review of my code
I made corresponding changes to the documentation
I confirm My changes generate no new warnings
I have added tests that prove my fix is effective or that my feature works
I have added relevant notes to the CHANGELOG.md file (See https://keepachangelog.com/)

And maybe it makes sense to include here all required changes in the frontend part cc @damianpumar @leiyre

Should we merge these SDK changes on to https://github.com/argilla-io/argilla/pull/5422, and then make the frontend changes there?


Documents section for the site

Documents include

Code of Conduct (Done)
Child Protection Policy (Done - see PR)
Constitution (Done)
Equal Opportunities Policy (Done)
Sponsorship (WIP)

Changes

Add documents section
Reorder social links
Remove unused social links
Remove long paths for imgs used in Mentors and Core Team
Add Code of Conduct and Child Protection Policy to Footer of site

Please review the Child Protection Policy (CPP) PR first before approving this. Once the CPP has been merged into this branch, we can merge all the documents into master together.

Code of Conduct has now been merged into this branch! Feel free to approve it now.


Store into database

store news into database, the project it can stop and continue crawler website.

use database store data.


yarn pnp error

Is this a bug report?
Yes

Did you try recovering your dependencies?

(Write your answer here.)
No
Which terms did you search for in User Guide?

(Write your answer here if relevant.)
Environment

System:
OS: macOS 10.14.3
CPU: x64 Intel(R) Core(TM) i7-7700HQ CPU @ 2.80GHz
Binaries:
Node: 11.9.0 - /usr/local/bin/node
Yarn: 1.13.0 - /usr/local/bin/yarn
npm: 6.5.0 - /usr/local/bin/npm
Browsers:
Chrome: 72.0.3626.121
Firefox: 63.0.1
Safari: 12.0.3
npmPackages:
react:  16.8.4
react-dom:  16.8.4
react-scripts: Not Found
npmGlobalPackages:
create-react-app: Not Found
Steps to Reproduce

(Write your steps here:)

mkdir foo
cd foo
yarn create react-app . --typescript --use-pnp
yarn run start

Expected Behavior

(Write what you thought would happen.)
It runs well
Actual Behavior

(Write what happened. Please add screenshots!)
yarn run v1.13.0
$ react-scripts start
internal/modules/cjs/loader.js:611
    throw err;
    ^

Error: Cannot find module 'react-dev-utils/crossSpawn'
    at Function.Module._resolveFilename (internal/modules/cjs/loader.js:609:15)
    at Function.Module._load (internal/modules/cjs/loader.js:535:25)
    at Module.require (internal/modules/cjs/loader.js:663:17)
    at require (internal/modules/cjs/helpers.js:20:18)
    at Object.<anonymous> (/Users/zhaojinxiang/Library/Caches/Yarn/v4/npm-react-scripts-2.1.8-21195bb928b2c0462aa98b2d32edf7d034cff2a9/node_modules/react-scripts/bin/react-scripts.js:18:15)
    at Module._compile (internal/modules/cjs/loader.js:734:30)
    at Object.Module._extensions..js (internal/modules/cjs/loader.js:745:10)
    at Module.load (internal/modules/cjs/loader.js:626:32)
    at tryModuleLoad (internal/modules/cjs/loader.js:566:12)
    at Function.Module._load (internal/modules/cjs/loader.js:558:3)
error Command failed with exit code 1.
info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.

Reproducible Demo

(Paste the link to an example project and exact instructions to reproduce the issue.)

?

Duplicate of #5380


[SPARK-36838][SQL] Refactor InSet generated code

What changes were proposed in this pull request?
Since Set can't check is NaN value is contained in current set.
With codegen, only when value set contains NaN then we have  necessary to check if the value is NaN, or we just need t
o check is the Set contains the value.
Why are the changes needed?
Improve generated code's performance. Make only check NaN when Set contains NaN.
Does this PR introduce any user-facing change?
No
How was this patch tested?
Existed UT

Test build #143601 has finished for PR 34097 at commit 6f13869.

This patch fails to build.
This patch merges cleanly.
This patch adds no public classes.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143601/

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48113/

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48113/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/48113/

retest this please

Test build #143606 has started for PR 34097 at commit 6f13869.

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48118/

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48118/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/48118/

Test build #143606 has finished for PR 34097 at commit 6f13869.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143606/

Test build #143623 has started for PR 34097 at commit d406a3a.

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48135/

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48135/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/48135/

Test build #143623 has finished for PR 34097 at commit d406a3a.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143623/

ping @cloud-fan

@AngersZhuuuu,

Make generated code more simple

can you elabourate it more in the PR description?

@AngersZhuuuu,

Make generated code more simple

can you elabourate it more in the PR description?

DOne

Test build #143630 has started for PR 34097 at commit 85297cf.

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48142/

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48142/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/48142/

Test build #143635 has started for PR 34097 at commit 84cd398.

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48147/

Test build #143630 has finished for PR 34097 at commit 85297cf.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143630/

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48147/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/48147/

Test build #143635 has finished for PR 34097 at commit 84cd398.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143635/

ping @cloud-fan

@AngersZhuuuu mind updating PR title too since this is not just a refactoring?

@AngersZhuuuu mind updating PR title too since this is not just a refactoring?

updated

Merged to master. (since this is improvement)

late LGTM


riak_kv_gcounter dialyzer errors

riak_kv_gcounter.erl:64: Invalid type specification for function riak_kv_gcounter:new/2. The success typing is (_,pos_integer()) -> {'ok',riak_kv_gcounter:gcounter()}
riak_kv_gcounter.erl:75: Invalid type specification for function riak_kv_gcounter:update/3. The success typing is ('increment' | {'increment',pos_integer()},_,riak_kv_gcounter:gcounter()) -> {'ok',riak_kv_gcounter:gcounter()}
riak_kv_gcounter.erl:85: Function merge/2 has no local return
riak_kv_gcounter.erl:86: The call riak_kv_gcounter:merge(GCnt1::any(),GCnt2::any(),[]) does not have an opaque term of type riak_kv_gcounter:gcounter() as 3rd argument
riak_kv_gcounter.erl:99: The call riak_kv_gcounter:merge(Rest::any(),RestOfClock2::[tuple()],[{_,_},...]) does not have opaque terms as 2nd and 3rd arguments
riak_kv_gcounter.erl:101: The call riak_kv_gcounter:merge(Rest::any(),Clock2::[tuple()],[{_,_},...]) does not have opaque terms as 2nd and 3rd arguments

Some of these are pretty domain-specific, so I figured I'd file an issue for now. For example, I'm not sure what types should be integer() vs. pos_integer(), etc.

The #1164 (merged into 2.1 branch) deals with these warnings. Is it sufficient to close this issue?


[NEW RULE] [SQL] Cleartext passwords in SQL

Is your feature request related to a problem? Please describe.
New rule to find cleartext passwords in SQL files
Describe the solution you'd like
I start using this rule:
(?i)(alter user [\w-]+ identified by [\w\S]+;)
Examples in Github
regex101 tests
My real example:

Describe alternatives you've considered
Correct my rule
cc @zricethezav

m?


Make textarea bigger

Hey @nstaszak
I would like to add a little improvement for the textarea where the JSON is written. By default, the textarea is like two rows and I always have to expand it with the mouse when editing the JSON. Giving it e.g. 20 rows simplifies the work.

Hi @tfamula,
thank you for your pull request. It's nice to know that the plugin might be used and useful elsewhere as well.
Have a great christmas break!

@nstaszak Is there a way I can contact you? I've sent you a DM in Discord, maybe that could be a start ;)


Support the usage of Markdown-based notebooks with "Lite" directives

Description
Please refer to the proposal in #191 for additional context and the rationale behind this change. This PR adds preprocessing functionalities to the base "Lite" directive (in the _LiteIframe class), which will allow a user to pass in a plain Markdown/MyST-Markdown notebook file to a directive, which will then get converted on the fly when JupyterLite is triggered. The conversion is performed via jupytext, which has been included as a dependency.
There is also the option of leaving this as an experimental feature behind an experimental flag and/or an optional dependency on jupytext, as suggested in https://github.com/jupyterlite/jupyterlite-sphinx/issues/191#issuecomment-2244589977. However, I haven't implemented that change and would like to wait for further direction on this before I do so.
Changes made

Preprocessing added to the run() method of the _LiteIframe class to convert .md files to .ipynb files and pass them on to JupyterLite
Refactored the notebook conversion and cell stripping logic to two separate hidden functions that we subsequently call in _LiteIframe.run()
Handled potential notebook collisions (in case notebooks of the same name but with different formats are present anywhere in the docs) – here, we handle only those notebooks that are referenced in a directive, and we raise a ValueError for any conflicts, recommending that the user rename their notebooks to have unique names.
jupytext added as a dependency for facilitating the conversion
Documentation for all directives updated to showcase this functionality
A sample MyST Markdown notebook added

Additional context
This is supposed to make interacting with Markdown-based notebook workflows easier – a few notable examples are scipy/scipy#20303 and PyWavelets/pywt#741, which have their own ways of dealing with this intermediate step that might make sense to include in jupyterlite-sphinx itself through this PR, such as https://github.com/scipy/scipy/blob/82ee02556872b9f91576b835a8f40f1d9eb1fd8d/doc/convert_notebooks.py and https://github.com/agriyakhetarpal/pywt/blob/fd3e01c3003a18cca770fc6f33752f8c07084e21/doc/source/conf.py#L33-L49 respectively.
cc: @melissawm @steppi @gabalafou

I am facing some unrelated troubles when testing it locally with the SciPy documentation from SciPy's main branch right now, and I intend to test this a bit more thoroughly with multiple projects, also to ensure that things like https://github.com/scipy/scipy/pull/21433 do not break with this change.

I am facing some unrelated troubles when testing it locally with the SciPy documentation from SciPy's main branch right now, and I intend to test this a bit more thoroughly with multiple projects, also to ensure that things like scipy/scipy#21433 do not break with this change.

Update: I've tested it multiple times by now and this is working perfectly well with the SciPy docs 🎉 though the use of a UUID to append to the filename would break the caching (obviously) of the notebook builds and also adds additional notebooks to the built docs. So, I've chosen to adapt the caching-related check from https://github.com/scipy/scipy/pull/21433 in e3b6882b9dc25a897308a2b77bf8b3987a2fd7ed, and I can confirm that there are no regressions as those that were noticed in scipy/scipy#21394. This does mean that I've had to revert the commit via d1c7f7dd7aec734f55ddd909ee182c342e0ac86d where I added a sample my_notebook.md file to accompany our existing my_notebook.ipynb file, because of the naming conflict that will be caused after conversion (which is something I'm looking for opinions on – please see https://github.com/jupyterlite/jupyterlite-sphinx/pull/221#discussion_r1866936923 for context!)
When this PR becomes part of a release, we can remove the convert_notebooks.py script and the convert-notebooks Make target in SciPy, essentially eliminating the changes introduced through scipy/scipy#21433, and instead of having to write:
.. jupyterlite:: ../../_contents/hypothesis_chi2_contingency.ipynb
   :new_tab: True

we can just write:
.. jupyterlite:: hypothesis_chi2_contingency.md
   :new_tab: True

which would be much cleaner – and I can submit a follow-up PR to SciPy for this, or step back if you wish to do so, @melissawm. :) This PR should now be ready for review now!

Note; we can also allow both notebook_X.ipynb and notebook_X.md to coexist in the same folder, and just add a suffix for the Markdown-based case, so that using .. notebooklite:: notebook_X.ipynb opens the original notebook, but using .. notebooklite:: notebook_X.md would convert notebook_X.md to notebook_X_converted.ipynb (or perhaps something like notebook_X.md.jupyterlite) and open it, which would perform both actions: resolving such an edge case, and keeping both notebooks intact in the documentation's source folder.
The docs build is failing because of this, but I would like to receive further direction before I proceed with this approach.

Thanks – will do when this is reviewed and released!

Hi @gabalafou, I've ensured that these Markdown/MyST notebooks can be stripped via 6a6d7a2a6bb5c85fa08f9b5a2b1818f11ac82adf, and added docs on how to use the stripping functionality with Markdown notebooks in 586742819f54c3edb0fa5f1a07555991975341c7 – as we were discussed yesterday. I have tested the changes that I have also upstreamed to a SciPy PR here: scipy/scipy#22042. Based on a self-review, things look alright to me to go ahead with.

The case where my_notebook.ipynb and my_notebook.md both exist in the same folder has been handled, but I found yet another edge case based on these collisions, which is slightly trickier to resolve (but also much less likely to happen). If we have multiple files of the same name that exist across folders, we would have a problem. For example,

my_notebook.ipynb exists in folder1/, my_notebook.md exists in folder1/ and my_notebook.ipynb exists in folder2/

We would have a conflict again because all of the notebooks are going to be copied under the contents/ directory. We should preserve the folder structure when copying to the contents/ folder (i.e., create contents/folder1/ and contents/folder2/ and copy the notebooks in there) and indeed add UUID suffixes for the files to ensure that no collisions happen.
But, at the same time, it is safe to say that this case would have existed prior to this PR as well (my example is about two .ipynb files, and I am not sure if there are any examples of anyone having faced it in the wild (no bug reports so far, at least). Would it be okay to proceed with this PR as a known failure case and open a separate issue for it?

The case where my_notebook.ipynb and my_notebook.md both exist in the same folder has been handled, but I found yet another edge case based on these collisions, which is slightly trickier to resolve (but also much less likely to happen). If we have multiple files of the same name that exist across folders, we would have a problem. For example,

my_notebook.ipynb exists in folder1/, my_notebook.md exists in folder1/ and my_notebook.ipynb exists in folder2/

We would have a conflict again because all of the notebooks are going to be copied under the contents/ directory. We should preserve the folder structure when copying to the contents/ folder (i.e., create contents/folder1/ and contents/folder2/ and copy the notebooks in there) and indeed add UUID suffixes for the files to ensure that no collisions happen.
However, it is safe to say that this case existed prior to this PR as well (my example concerns two .ipynb files). I am not sure if anyone has encountered it in the wild – at least, there have been no bug reports about it so far. Would it be okay to proceed with this PR as is, mark this behaviour as a known case of failure, and open a separate issue for it?

Rebased on top of main to fix merge conflicts.

Rebased on top of main to fix merge conflicts I recently introduced.

The case where my_notebook.ipynb and my_notebook.md both exist in the same folder has been handled, but I found yet another edge case based on these collisions, which is slightly trickier to resolve (but also much less likely to happen). If we have multiple files of the same name that exist across folders, we would have a problem. For example,

my_notebook.ipynb exists in folder1/, my_notebook.md exists in folder1/ and my_notebook.ipynb exists in folder2/

We would have a conflict again because all of the notebooks are going to be copied under the contents/ directory. We should preserve the folder structure when copying to the contents/ folder (i.e., create contents/folder1/ and contents/folder2/ and copy the notebooks in there) and indeed add UUID suffixes for the files to ensure that no collisions happen.
However, it is safe to say that this case existed prior to this PR as well (my example concerns two .ipynb files). I am not sure if anyone has encountered it in the wild – at least, there have been no bug reports about it so far. Would it be okay to proceed with this PR as is, mark this behaviour as a known case of failure, and open a separate issue for it?

This was discussed with @steppi today, and we agreed upon making a naming conflict a hard error, regardless of file extension. He suggested that I check if any projects have notebooks with duplicate names, so that we could correct them downstream as a safety measure before we release. I didn't find any for NumPy, SciPy, or scikit-learn; and neither has anyone reported an issue about this before – ever since jupyterlite-sphinx has had its inception. So, it is all the more the right time to conform to correct behaviour, and if someone raises this, we could just ask them to rename the duplicate notebook they have – at most, it would cost them a broken URL or few, which they can fix with redirects via RTD or through any other methods that we are not concerned about. Or, if we get a lot of bug reports about it, we could look into mangling the filenames with UUIDs and the like (which was my previous approach).

I've gone one step ahead in the check and also allowed having notebooks of the same filename stem—such as my_notebook.ipynb and my_notebook.md—to co-exist anywhere in the folder structure, but only under the condition where both of them are not referenced in our directives. This way, we are not going to deal with notebooks that are not our business – if, say, if only my_notebook.ipynb has been included in a .. jupyterlite:: my_notebook.ipynb directive somewhere in the docs by a user, it is only then that we process it further.
Also, we perform this lookup with a set, so that operation happens in linear time anyway – I did think about caching it using a frozenset with paths serialised to strings and a simple LRU approach, but I didn't feel it was worth keeping because we are never going to expect notebooks in the order of thousands.
This is ready for review, now!

Albert and I discussed the error message offline and in consideration, reduced its size because of its verbosity; plus, it would be weird to see it as such from a user's perspective. It made more sense to make it more impersonal, highlighting the problem of conflicting notebook names at hand. Implemented in 81c0c09f5bfe162c503ef62d8f978725e3a0da7a.

With 29bb81015a67f34090834f9cf8b66d59846dc617, we don't keep going until we find all conflicts at once, and stop at the first one itself.

Closing and reopening to investigate XPython kernel not being found in the readthedocs preview in https://github.com/jupyterlite/jupyterlite-sphinx/pull/228#issuecomment-2557874829

🤔 I cannot reproduce it here either

Thanks @agriyakhetarpal. The issue with the docs was transient. I'm still not sure what the problem was


Using externalHelpers causes webpack errors 'import' and 'export' may appear only with 'sourceType: module'

Describe the bug
In my config swc is currently set up to output esm modules in order to let the webpack handle all the stuff with modules. And it mostly works well, but for some packages in node_modules I'm getting the next error:
error GLOBAL:ERROR Module parse failed: 'import' and 'export' may appear only with 'sourceType: module' (2:0)
File was processed with these loaders:
 * ../../node_modules/swc-loader/src/index.js
You may need an additional loader to handle the result of these loaders.
| "use strict";
import _type_of from<EMAIL_ADDRESS>| exports.__esModule = true;
| exports.calcFontColor = calcFontColor;
Error: Module parse failed: 'import' and 'export' may appear only with 'sourceType: module' (2:0)
File was processed with these loaders:
 * ../../node_modules/swc-loader/src/index.js
You may need an additional loader to handle the result of these loaders.
| "use strict";
import _type_of from<EMAIL_ADDRESS>| exports.__esModule = true;
| exports.calcFontColor = calcFontColor;
    at /workspaces/Tinkoff/tramvai/packages/cli/lib/builder/webpack/utils/runWebpack.js:10:13
    at finalCallback (/workspaces/Tinkoff/tramvai/node_modules/webpack/lib/Compiler.js:441:32)
    at /workspaces/Tinkoff/tramvai/node_modules/webpack/lib/Compiler.js:458:13
    at Hook.eval [as callAsync] (eval at create (/workspaces/Tinkoff/tramvai/node_modules/tapable/lib/HookCodeFactory.js:33:10), <anonymous\>:33:1)
    at Hook.CALL_ASYNC_DELEGATE [as _callAsync] (/workspaces/Tinkoff/tramvai/node_modules/tapable/lib/Hook.js:18:14)
    at onCompiled (/workspaces/Tinkoff/tramvai/node_modules/webpack/lib/Compiler.js:456:21)
    at /workspaces/Tinkoff/tramvai/node_modules/webpack/lib/Compiler.js:1196:17
    at Hook.eval [as callAsync] (eval at create (/workspaces/Tinkoff/tramvai/node_modules/tapable/lib/HookCodeFactory.js:33:10), <anonymous\>:6:1)
    at Hook.CALL_ASYNC_DELEGATE [as _callAsync] (/workspaces/Tinkoff/tramvai/node_modules/tapable/lib/Hook.js:18:14)
    at /workspaces/Tinkoff/tramvai/node_modules/webpack/lib/Compiler.js:1192:33

There is no such issue for babel though.
I've made some digging to trace the error cause:

swc inserts esm imports for helpers anyway - code that later are compiled to commonjs if module is set to commonjs in swc config. And as I'm configured swc to output esm they are not converted to commonjs inside commonjs module
the issue surprisingly doesn't affect most of modules. This is because webpack in most cases parses type of file as javascript/auto to provide smart parsing that will dynamically figure out is it esm or commonjs. But some of the packages are explicitly marked with type: "commonjs" in their package.json and it get parsed in webpack more strictly leading to the error above
babel outputs the import depending on the package itself so there is no issue when using babel-loader

Input code
const fs = require("fs");

exports.test = async () => {};

Config
{
  "jsc": {
    "parser": {
      "syntax": "typescript",
      "tsx": false
    },
    "externalHelpers": true,
    "target": "es5",
    "loose": false,
    "minify": {
      "compress": false,
      "mangle": false
    }
  },
  "module": {
    "type": "es6"
  },
  "minify": false,
  "isModule": true
}

Playground link
https://play.swc.rs/?version=1.3.24&code=H4sIAAAAAAAAA0vOzysuUUgrVrBVKEotLM0sStVQSitW0rTm5eLlSq0oyC8qKdYrSQWqsVVILK7MS1bQ0FSwtVOorrUGALdsYEI7AAAA&config=H4sIAAAAAAAAA0WOSwrDMAxE76K1t%2B3CJ%2BimhxCuElz8Q1IgxvjutYNLdmI0b2YafMWBbVCQhXheUpPiCRa0FhLHvigYUBnShkGoG6BTiROGF4VCLGCVDxoe5J10kCSPgYSchRZkIPrktzoLXI6FSeR%2BYdrD39lHfsyfYwrt2nAFPqHfGYvz8l7G2d9%2Fo%2FC0EMwAAAA%3D
Expected behavior
Generate imports for helpers as it is implemented in babel - based on the sourceType of the module itself, not only bare config
Actual behavior
Generated imports for helpers are always in esm
Version
1.3.24
Additional context
The issue might be related

Closing as this is not a bug of swc

the issue surprisingly doesn't affect most of module

Little update on this - it actually affects all of those modules, but instead of errors during build it will lead to runtime errors. Because webpack in this case will consider that modules as esm and will ignore any exports.= in the code and will output modules that exports nothing.

Closing as this is not a bug of swc

I agree that swc did what it told to do i.e. to generate esm code. The issue comes more from the different module ecosystems that should work together. But it makes swc actually unusable to generate optimized bundles as we can't change all the npm packages at once to make it work properly for esm build. I see that babel chose to be more flexible in that case to support real projects as it may affect any project that uses different npm packages.

Why do you transpile packages in node_modules at first?
It's very likely that you are simply doing something wrong

Why do you transpile packages in node_modules at first?

It's very common that some packages use ES6 or higher version syntax in their output, it makes sense to me.
Also want to ask, is there a plan that SWC can transpile a file but leaving its module type unchanged, like automatic set moduleType according to the input.

See https://play.swc.rs/?version=1.3.27&code=H4sIAAAAAAAAA0vOzysuUUgrVrBVKEotLM0sStVQSitW0rTm5eLlSq0oyC8qKdYrSQWqsVVILK7MS1bQ0FSwtVOorrUGALdsYEI7AAAA&config=H4sIAAAAAAAAA0WOSw7DMAgF78La23bhE3TTQyCXRK78ExApluW710lcZYceMw8afMWBbVCQhfiYpCbFHSxoLSSOfVEwoDKiBYNQN0C7EicMLwqFWMAqbzQY5JV0mCSPoYSchaZkIPrkl3occDkWJpF7hWkNf7KP%2Fpg%2F2xG084ez8An97piel%2FcEL%2FMH4rWGbc0AAAA%3D
It's not a bug anyway IMO, but it's fixed in recent versions

It's not a bug anyway IMO, but it's fixed in recent versions

If it's not a bug why is that fixed then? Or is it a bug that it is fixed and that behavior might be rolled back again in the future?
I see that you pointed to the playground, but the link actually uses isModule: false in the config, that is not quite the same as the original issue. Although, I see that with the latest version 1.3.27 the option isModule: 'unknown' is now working and provides imports depending on module system (it doesn't work for 1.3.24 that I've originally tested).

Thats not a bug. you can the pr fix the polyfill in script.
You can set isModule unknown, let swc decide it.


[fortran] use flang-classic for windows instead of gfortran

Steps

[x] Have clang-cl
[x] Build llvm fork of flang
[x] Build pgmath
[x] Build flang-driver (flang1, flang2)
[x] Build flang fortran runtime
[x] Build Lapack

Missing:

[ ] Proper Flag Handling
[ ] Proper Fortran Runtime Handling (defined by pgmath)
[ ] use /defaultlib: in cmake instead of flang internally? (not able to provide that to the object files.)

Hmm something is wrong with the blas detection in the release configuration.
Mismatching number of debug and release binaries. Found 1 for debug but 2 for release.
Debug binaries

    D:/packages/lapack-reference_x64-windows-static/debug/lib/lapack.lib

Release binaries

    D:/packages/lapack-reference_x64-windows-static/lib/blas.lib
    D:/packages/lapack-reference_x64-windows-static/lib/lapack.lib

Unfortunately I am not able to reproduce it locally.


Add instructions for read-only filesystem

https://medium.com/swlh/make-your-raspberry-pi-file-system-read-only-raspbian-buster-c558694de79

I might help with this. Ordering a HDMI capture usb device today :)

Just an FYI on this. According to:
https://www.raspberrypi.org/forums/viewtopic.php?f=63&t=253104&p=1549229#p1549117
There is now an option in raspi-config to enable an overlay RO fs. Apparently that is just a call to a script:
https://github.com/ghollingworth/overlayfs
So not sure if this can be hooked into, or if modifications would be needed, if tinypilot needs to do any writes.


Support for PyScript & Brython.

Brython & PyScript are projects that enable Python in modern browsers, the latter of which has gained a lot of attraction from the Python community recently.
They both work by enabling the use of Python directly in html files without  the need of cross compilation.
To give you a taste, here are some examples:
Brython example:

Brython is a Python interpreter written in JavaScript, with similar execution speed to that of CPython itself. It enables complete access to the "DOM", enabling it to interact with existing HTML elements as well as create new ones, it offers full access to JS declared objects (allowing you to use JS libraries and frameworks directly with Python) and supports the vast majority of the CPython STD (where only modules that simply cant run in a browser is unavailable, like the OS module which requires direct access to the computers file system or running OS dependent pre-compiled code that must run outside of the browser).
Brython has neglible load times thanks to extremely small package sizes as well as runtime performance comparable to that of CPython on desktop, making the technology useable for simpler websites. In addition to this it supports the full language syntax of Python itself.
PyScript

Just like Brython, PyScript is also enabled by an interpreter, which in this case runs with the help of WebAssembly, just like Brython, PyScript supports the entire language syntax of Python leveraging the more advanced features of the language.
Unlike Brython ,PyScript comes with a package manager for installing libraries from Pypy.org, known as "micropip", making it really convenient to use 3rd party libraries also on the client side. However PyScript also has significantly longer load times than that of Brython, making the technology more suitable for applications where longer load times are acceptable to be able to make use of potentially larger 3rd party packages on the client in a more convenient fashion.
Help wanted!
Both Brython and PyScript have lots of potential, (the latter of which also has a fast growing community at this time) and are in need of a stable & reliable language extension that enable code highlighting & autocompletion, especially for when writing Python code directly in the HTML files. With this feature request Im hoping to see support for Python in .html files (similar to that of JS in html files) in a way thats compatable with both projects as well as auto completion for project specific language features & libraries that both projects implement to allow for interoperability with common browser features (something that can probably be solved to  a large extent with the help of "fake modules" or pyi files). Due to both projects closely replicating the behaviour of the CPython interpreter I can see it being viable to use existing language servers like PyLance to take care of most of he heavy lifting by simply enabling it to read relevant sections of the html files.
They are both fantastic efforts overall.  Im here on hopes that the maintainers of this repo would find the projects interesting enough to add some form of support for them.
I can definetely see a possibility for community collaboration to make this a reality considering that both of these projects are to a large extent driven by open source contributors. I myself would gladly help contributing with CPython compatible pyi files for instance if we were to go down such a route.
Thanks for reading, have a nice day 💖

I believe this would need an extension to virtualize the contents of the html files and then send the python parts to whatever python language server is registered (which is usually Pylance).
Something akin as to what is described here:
https://code.visualstudio.com/api/language-extensions/embedded-languages#request-forwarding
I don't believe that would require any work on the Pylance/Python extensions, just another extension that did the forwarding.


phraseapp-client: remove

Description of changes

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
22.05 Release Notes (or backporting 21.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[ ] Fits CONTRIBUTING.md.

@manveru are you still interested in this? If so, you could package https://github.com/phrase/phrase-cli and we could drop this and point the alias to that.

@manveru are you still interested in this? If so, you could package https://github.com/phrase/phrase-cli and we could drop this and point the alias to that.

hi @ajs124 I already packaged phrase-cli!
cc @manveru

Awesome. Alias updated.

Sorry, I missed this, but no, not using this anymore for a few years now ^^;


We may need to remove PositionedCryptoOutputStream

PositionedCryptoOutputStream has no valuable implementation in it if there is CTRCryptoOutputStream.
We may need to remove this class. Instead PositionedCryptoInputStream has its value.

Committed.


When downloading versions of kubectl, verify their contents against known SHA256 hashes

When testing kuberlr with rancher desktop, we noticed that sometimes only part of
an instance of kubectl would be downloaded. Needless to say, this caused problems
once it was installed.
So, download into a temporary file, verify its hash, and then copy to the
final destination.

So if I leave the defer statements in place, I think I've covered all your comments. Let me know if you'd like the commits squashed before merging.

Thanks for your contribution @ericpromislow . I'll take care of renaming the old errors.go file and then I'll tag a new release


[#69] Add approval flow for new customers

Closes: #69

What?

Add a new attribute to the users table: self_registered
Add a way for unauthenticated users to register themselves in the platform
When a user registers themselves, an email is sent to all admins notifying about the new user and their email address
Self registered users have, by default, self_registered: true and active: false and need to be enabled manually by an admin

Why?
With these changes, admins no longer need to manually add each user to the platform, they only need to approve their entry.
How to test it?
Open up the application and create a new user via the JSON request POST /signup with the body:
{
  "user": {
    "full_name": "John Doe",
    "email"<EMAIL_ADDRESS>    "password": "12345678",
    "address": "Test Street, 123",
    "cpf": "12345670088",
    "cellphone": "123456789012345"
  }
}

Example cURL request:
curl -v -X POST http://localhost:3000/signup.json \
  -H 'Content-Type: application/json' \
  -d '{
    "user": {
      "full_name": "John Doe",
      "email"<EMAIL_ADDRESS>      "password": "12345678",
      "address": "Test Street, 123",
      "cpf": "12345670088",
      "cellphone": "123456789012345"
    }
  }'

It should return status 201 Created and a body containing the created user:
{
  "id": 5,
  "full_name": "John Doe",
  "email"<EMAIL_ADDRESS>  "cpf": "12345670088",
  "address": "Test Street, 123",
  "cellphone": "123456789012345",
  "picture_url": null,
  "admin": false,
  "active": false,
  "self_registered": true,
  "created_at": "2022-03-23T17:10:05.768Z",
  "updated_at": "2022-03-23T17:10:05.768Z",
  "companies": []
}

If something is wrong, it will return 422 Unprocessable Entity with the errors inside the body:
{
  "errors": {
    "email": [
      "já está em uso"
    ],
    "cpf": [
      "já está em uso"
    ]
  }
}

Mailer Preview Screenshot

@allcontributors add @rhian-cs for code

@allcontributors add @wenderjean and @RodrigoVitiello for review

@allcontributors add @RodrigoVitiello for review


Reproducing Stoilos Distance Based Result

Hi,
I am trying to reproduce your results on zero shot general dataset using Stoilos distance. I have used your pre-computed file term_onto_ed_dic_zeroshot_general.pkl. I took the first element with the smallest distance and counted as a hit if it was either match with the entity or its synonyms, but I am only getting accuracy of 0.3011.
Please let me know what you think. Thank you!
count = 0
corr = 0
for g in gold_entites_dict:
    if mid_to_idx[g] not in ONT_ED_DICT: continue
    count += 1
    label_id = label_ids[g]
    for term in dp.snomed.index_definition[str(dp.label_to_snomed_id[label_id])]:
        cur_result = int(term.lower() == ONT_ED_DICT[mid_to_idx[g]][0][0].lower())
        if cur_result == 1:
            corr += 1
            break

Hi,
Thanks for your interest in the project.
I can see that you skipped all lines where the index is not in ONT_ED_DICT. This is where the problem comes from. I only stored the distances for examples that do not find an exact match. If an exact match is found, my code directly compares the matched ID with ground-truth and then skips that example (see here).
If you write something like below, you should be able to replicate the .53 accuracy:
acc = 0
for row in test_table.iterrows():
    term = row[1]["Term"].lower()
    gt_id = row[1]["General SNOMED ID"]
    i = row[0]

    if term in SF2ID.keys():
        if SF2ID[term] == gt_id:
            acc += 1
        continue

    if i not in ONT_ED_DICT.keys(): continue
    count += 1
    if SF2ID[ONT_ED_DICT[i][0][0]] == gt_id:
        acc += 1
print (acc / len(test_table))

Hope this helps.
Best,
Fangyu

no activity, close for now.


Update PHPUnit to latest

Update unit tests to work with PHPUnit 6.3

Why not PHPUnit 7 ?

Oh ya sure PHPUnit 7.x would do as well


Make deCONZ VNC URL a link

For convenient clicking from browser. At least my Firefox and Chromium on Ubuntu support it.

The problem is, that it causes invalid links on your website (e.g., for search engines), which is a problem.
For our website, we have removed all those occurrences lately for that same reason.

Uh, that's one broken search engine :(

Oh shit, you are right, sorry, this is a vnc:// URL. I was too quick with my judgment, on the initial scan.
The website was riddled with links to http://localhost http://hassio.local and similars, which are HTTP links.
This is perfect! 👍

Np, thanks for taking a closer look.


MKL2017 implemented layers integration to improve IA perf. on mxnet

Hi @piiswrong ,
Pls review the latest MKL2017 implemented layers patches including conv, relu, lrn, batch-norm, concat, elementwise-sum, pooling and fc (total 8 layers). PR#3458 related code is merged into this. This version is putting MKL buffer inside layers and do conversion for input and output. Once your review is done, I will submit another PR to provide much higher perf. patch to pass MKL buffer between layers.
Pls kindly review ASAP.
Thanks

code looks good to me.
Please fix lint.
also remove debug print

please make sure test passes when USE_MKL2017=1:
nosetests --verbose tests/python/unittests
nosetests --verbose tests/python/gpu/test_operator_gpu.py

Currently it fails for me with:
test_operator.test_convolution_grouping ... [00:42:07] /scratch/intel-mxnet/dmlc-core/include/dmlc/logging.h:235: [00:42:07] src/operator/mkl/mkl_memory.cc:51: Check failed: (status) == (E_SUCCESS) Failed creation convert_to_int with status -1 for buffer: fwd_filter_data   @ MKLConvolutionOp

[00:42:07] /scratch/intel-mxnet/dmlc-core/include/dmlc/logging.h:235: [00:42:07] src/engine/./threaded_engine.h:306: [00:42:07] src/operator/mkl/mkl_memory.cc:51: Check failed: (status) == (E_SUCCESS) Failed creation convert_to_int with status -1 for buffer: fwd_filter_data   @ MKLConvolutionOp

An fatal error occurred in asynchronous engine operation. If you do not know what caused this error, you can try set environment variable MXNET_ENGINE_TYPE to NaiveEngine and run with debugger (i.e. gdb). This will force all operations to be synchronous and backtrace will give you the series of calls that lead to this error. Remember to set MXNET_ENGINE_TYPE back to empty after debugging.
terminate called after throwing an instance of 'dmlc::Error'
  what():  [00:42:07] src/engine/./threaded_engine.h:306: [00:42:07] src/operator/mkl/mkl_memory.cc:51: Check failed: (status) == (E_SUCCESS) Failed creation convert_to_int with status -1 for buffer: fwd_filter_data   @ MKLConvolutionOp

An fatal error occurred in asynchronous engine operation. If you do not know what caused this error, you can try set environment variable MXNET_ENGINE_TYPE to NaiveEngine and run with debugger (i.e. gdb). This will force all operations to be synchronous and backtrace will give you the series of calls that lead to this error. Remember to set MXNET_ENGINE_TYPE back to empty after debugging.

Eric, thanks for quick response. Debug msg and lint clean now. But I can not reproduce your issue in my side when running nosetest though there have two other issues when running unittest to follow up as below. I am using a clean CenOS and only enable USE_MKL2017=1 but keep USE_BLAS=atlas. Could you pls let me know your env. and more details then I can do further debug?
BTW, I will get back to you soon about below 2 issues. Actually if change 1e-6 to 1e-4 for deconv_grad, then it will pass.
======================================================================
FAIL: test_executor.test_dot
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/home/zhenlin/Mxnet/upstream/intel-mxnet/PR/mxnet/tests/python/unittest/test_executor.py", line 102, in test_dot
sf = mx.symbol.dot)
File "/home/zhenlin/Mxnet/upstream/intel-mxnet/PR/mxnet/tests/python/unittest/test_executor.py", line 60, in check_bind_with_uniform
assert reldiff(rhs_grad.asnumpy(), rhs_grad2) < 1e-6
AssertionError
======================================================================
FAIL: test_operator.test_deconvolution
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/home/zhenlin/Mxnet/upstream/intel-mxnet/PR/mxnet/tests/python/unittest/test_operator.py", line 694, in test_deconvolution
pad = (3,3)
File "/home/zhenlin/Mxnet/upstream/intel-mxnet/PR/mxnet/tests/python/unittest/test_operator.py", line 638, in check_deconvolution_gradient
assert reldiff(conv_args_grad[1].asnumpy(), deconv_args_grad[1].asnumpy()) < 1e-6
AssertionError

Ran 90 tests in 21.202s

I'm using USE_CUDA=1, USE_CUDNN=1, USE_MKL2017=1

Can you try to not change anything but just USE_MKL2017=1 in make/config.mk to see if still have issue? BTW, what HW are you running?

tried only use mkl, python tests/python/unittest/test_operator.py gives same error:
MKL Build:20160413
[13:03:37] /scratch/intel-mxnet/dmlc-core/include/dmlc/logging.h:235: [13:03:37] src/operator/mkl/mkl_memory.cc:47: Check failed: (status) == (E_SUCCESS) Failed creation convert_to_int with status -1 for buffer: fwd_filter_data   @ MKLConvolutionOp
[13:03:37] /scratch/intel-mxnet/dmlc-core/include/dmlc/logging.h:235: [13:03:37] src/engine/./threaded_engine.h:306: [13:03:37] src/operator/mkl/mkl_memory.cc:47: Check failed: (status) == (E_SUCCESS) Failed creation convert_to_int with status -1 for buffer: fwd_filter_data   @ MKLConvolutionOp
An fatal error occurred in asynchronous engine operation. If you do not know what caused this error, you can try set environment variable MXNET_ENGINE_TYPE to NaiveEngine and run with debugger (i.e. gdb). This will force all operations to be synchronous and backtrace will give you the series of calls that lead to this error. Remember to set MXNET_ENGINE_TYPE back to empty after debugging.
terminate called after throwing an instance of 'dmlc::Error'
what():  [13:03:37] src/engine/./threaded_engine.h:306: [13:03:37] src/operator/mkl/mkl_memory.cc:47: Check failed: (status) == (E_SUCCESS) Failed creation convert_to_int with status -1 for buffer: fwd_filter_data   @ MKLConvolutionOp
An fatal error occurred in asynchronous engine operation. If you do not know what caused this error, you can try set environment variable MXNET_ENGINE_TYPE to NaiveEngine and run with debugger (i.e. gdb). This will force all operations to be synchronous and backtrace will give you the series of calls that lead to this error. Remember to set MXNET_ENGINE_TYPE back to empty after debugging.
Aborted (core dumped)

I know your issue. You pre-installed old MKL lib before which does not support MKL dnn API yet. By default, if you installed anaconda2, there will a old MKL lib in it. You need to

remove old MKL version
when do make, see if mklml package is downloaded
export  export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/mklml_lnx_2<IP_ADDRESS>60801/lib

Pls let me know if it works.

didn't work.
Other mkldnn layers work fine. Only test_operator.test_convolution_grouping breaks

could you show me your output from
nosetests --verbose tests/python/unittest/test_operator.py

Did you try "conda remove mkl mkl-service"? This group feature is supported in MKL20160801 or later. I know MKL env. setting is annoying. For quick test, you can remove anaconda2 then test out. If you set LD_LIBRARY_PATH to what you downloaded MKLML package, the version should be MKL20160801. My log as below:
[root@epp-hpc-h4-18 mxnet]# nosetests --verbose tests/python/unittest/test_operator.py
test_operator.test_elementwise_sum ... ok
test_operator.test_concat ... ok
test_operator.test_slice_channel ... ok
test_operator.test_regression ... ok
test_operator.test_softmax ... ok
test_operator.test_python_op ... ok
test_operator.test_swapaxes ... ok
test_operator.test_scalarop ... ok
test_operator.test_scalar_pow ... ok
test_operator.test_symbol_pow ... ok
test_operator.test_pow_fn ... ok
test_operator.test_embedding ... ok
test_operator.test_binary_op_duplicate_input ... ok
test_operator.test_sign ... ok
test_operator.test_round_ceil_floor ... ok
test_operator.test_rsqrt_cos_sin ... ok
test_operator.test_maximum_minimum ... ok
test_operator.test_maximum_minimum_scalar ... ok
test_operator.test_abs ... ok
test_operator.test_deconvolution ... MKL Build:20160801
FAIL
test_operator.test_nearest_upsampling ... ok
test_operator.test_batchnorm_training ... ok
test_operator.test_convolution_grouping ... ok
test_operator.test_broadcast_binary_op ... ok
test_operator.test_run_convolution_dilated_impulse_response ... ok
test_operator.test_convolution_dilated_impulse_response ... ok
test_operator.test_reshape ... [14:41:49] src/operator/./reshape-inl.h:270: Using target_shape will be deprecated.
ok
test_operator.test_reduce ... ok
test_operator.test_broadcast ... ok
test_operator.test_transpose ... ok
test_operator.test_expand_dims ... ok
test_operator.test_crop ... ok
test_operator.test_slice_axis ... ok
test_operator.test_flip ... ok
test_operator.test_stn ... ok
test_operator.test_dot ... ok
test_operator.test_batch_dot ... ok
test_operator.test_correlation ... ok
test_operator.test_support_vector_machine_l1_svm ... ok
test_operator.test_support_vector_machine_l2_svm ... ok
test_operator.test_roipooling ... ERROR
======================================================================
ERROR: test_operator.test_roipooling
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/home/zhenlin/Mxnet/upstream/intel-mxnet/PR/mxnet/tests/python/unittest/test_operator.py", line 1460, in test_roipooling
numeric_eps=1e-3, check_eps=1e-2)
File "/usr/lib/python2.7/site-packages/mxnet-0.7.0-py2.7.egg/mxnet/test_utils.py", line 361, in check_numeric_gradient
raise Exception(msg)
Exception:
Items are not equal:
In symbol "roipooling0", ctx=cpu(0), numeric check failed for "data", grad_req= "add". Rel Err=0.010300, Expected <=0.010000
NUMERICAL: array([[[[ 0.        ,  0.        ,  0.        , ...,  0.        ,
0.        ,  0.        ],
[ 0.        ,  0.42724609,  0.67138672, ...,  0.9765625 ,...
BACKWARD: array([[[[-0.        ,  0.        ,  0.        , ..., -0.        ,
-0.        ,  0.        ],
[ 0.        ,  0.42862961,  0.68517176, ...,  0.99525211,...
======================================================================
FAIL: test_operator.test_deconvolution
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/home/zhenlin/Mxnet/upstream/intel-mxnet/PR/mxnet/tests/python/unittest/test_operator.py", line 694, in test_deconvolution
pad = (3,3)
File "/home/zhenlin/Mxnet/upstream/intel-mxnet/PR/mxnet/tests/python/unittest/test_operator.py", line 638, in check_deconvolution_gradient
assert reldiff(conv_args_grad[1].asnumpy(), deconv_args_grad[1].asnumpy()) < 1e-6
AssertionError

Ran 41 tests in 7.718s
FAILED (errors=1, failures=1)

Ok it works.
This is going to be a freqent problem for users though. Basically mkldnn is not compatible with anaconda, which a lot of users use.
Is it possible to set the linker order so that it works with anaconda?

Thanks for suggestion. I did some debug. Actually this is because if anaconda is installed with mkl, numpy and related python will call the mkl and iomp5 lib in anaconda which is pre-defined.
find library=libiomp5.so [0]; searching
search path=/root/anaconda2/lib/python2.7/site-packages/numpy/core/../../../..   (RPATH from file /root/anaconda2/lib/python2.7/site-packag     es/numpy/core/multiarray.so)
trying file=/root/anaconda2/lib/python2.7/site-packages/numpy/core/../../../../libiomp5.so
Because of this, the old MKL version in anaconda will be initialized and loaded so when calling new API, it will be wrong.
62803: calling init: /root/anaconda2/lib/python2.7/site-packages/numpy/core/../../../../libmkl_avx2.so
62803:
62803: python: error: symbol lookup error: undefined symbol: scalable_malloc (fatal)
MKL Build:20160413
[18:49:27] /home/zhenlin/Mxnet/upstream/intel-mxnet/intel-mxnet/dmlc-core/include/dmlc/logging.h:235: [18:49:27] src/operator/mkl/mkl_memory.cc:51: Check fai
led: (status) == (E_SUCCESS) Failed creation convert_to_int with status -1 for buffer: fwd_filter_data   @ MKLConvolutionOp
[18:49:27] /home/zhenlin/Mxnet/upstream/intel-mxnet/intel-mxnet/dmlc-core/include/dmlc/logging.h:235: [18:49:27] src/engine/./threaded_engine.h:306: [18:49:27] src/operator/mkl/mkl_memory.cc:51: Check failed: (status) == (E_SUCCESS) Failed creation convert_to_int with status -1 for buffer: fwd_filter_data   @ MKL
ConvolutionOp
It is not issue of mkldnn compatible with anaconda. It is the issue when installing 2 different MKL version in system to cause annoying. The quick way to resolve this is remove mkl in anaconda until anaconda integrate the latest MKL2017. Pls refer to https://www.continuum.io/blog/developer-blog/anaconda-25-release-now-mkl-optimizations
Since I believe anaconda will integrate the new MKL2017 soon, this issue will disappear automatically. I will put this into README as known issue. Also I will continue to look at this to see if have better w/a.
But I think this should not block the PR merge, right? Pls let me know.

hi all:
I build a pure cpu version , USE_MKL2017=0
I get below problem too for nosetests --verbose tests/python/unittests
======================================================================
FAIL: test_executor.test_dot
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/home/lingyan/mkldnn_compare/mxnet_gcc/tests/python/unittest/test_executor.py", line 102, in test_dot
sf = mx.symbol.dot)
File "/home/lingyan/mkldnn_compare/mxnet_gcc/tests/python/unittest/test_executor.py", line 60, in check_bind_with_uniform
assert reldiff(rhs_grad.asnumpy(), rhs_grad2) < 1e-6
AssertionError

For FAIL: test_executor.test_dot issue
it should be atlas library issue , mkl do not have problem
this should because atlas create NaN value for dot
-USE_BLAS = atlas
+USE_BLAS = mkl

ok. Please fix the deconvolution test and we can merge
On Oct 20, 2016 6:25 PM, "Zhenlin"<EMAIL_ADDRESS>wrote:

Thanks for suggestion. I did some debug. Actually this is because if
anaconda is installed with mkl, numpy and related python will call the mkl
and iomp5 lib in anaconda which is pre-defined.
find library=libiomp5.so [0]; searching
search path=/root/anaconda2/lib/python2.7/site-packages/numpy/core/../../../..
(RPATH from file /root/anaconda2/lib/python2.7/site-packag
es/numpy/core/multiarray.so)
trying file=/root/anaconda2/lib/python2.7/site-packages/numpy/
core/../../../../libiomp5.so
Because of this, the old MKL version in anaconda will be initialized and
loaded so when calling new API, it will be wrong.
62803: calling init: /root/anaconda2/lib/python2.7/
site-packages/numpy/core/../../../../libmkl_avx2.so
62803:
62803: python: error: symbol lookup error: undefined symbol:
scalable_malloc (fatal)
MKL Build:20160413
[18:49:27] /home/zhenlin/Mxnet/upstream/intel-mxnet/intel-mxnet/dmlc-
core/include/dmlc/logging.h:235: [18:49:27] src/operator/mkl/mkl_memory.cc:51:
Check fai
led: (status) == (E_SUCCESS) Failed creation convert_to_int with status -1
for buffer: fwd_filter_data @ MKLConvolutionOp
[18:49:27] /home/zhenlin/Mxnet/upstream/intel-mxnet/intel-mxnet/dmlc-
core/include/dmlc/logging.h:235: [18:49:27] src/engine/./threaded_engine.h:306:
[18:49:27] src/operator/mkl/mkl_memory.cc:51: Check failed: (status) ==
(E_SUCCESS) Failed creation convert_to_int with status -1 for buffer:
fwd_filter_data @ MKL
ConvolutionOp
It is not issue of mkldnn compatible with anaconda. It is the issue when
installing 2 different MKL version in system to cause annoying. The quick
way to resolve this is remove mkl in anaconda until anaconda integrate the
latest MKL2017. Pls refer to https://www.continuum.io/blog/
developer-blog/anaconda-25-release-now-mkl-optimizations
Since I believe anaconda will integrate the new MKL2017 soon, this issue
will disappear automatically. I will put this into README as known issue.
Also I will continue to look at this to see if have better w/a.
But I think this should not block the PR merge, right? Pls let me know.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/dmlc/mxnet/pull/3581#issuecomment-255270768, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAiudFrivCuZtyqrp8jh1gD3B7hFKXh0ks5q2BSKgaJpZM4KbwUO
.


Fix IU plugin compilation

Description
Fixed the build of the plugin for the IU version due to a compilation error in the JavaScript module after #1791
Manual tests
Various scenarios have been tested. You can find the examples in the folder `/utbot-js/samples' and try to run UTBot.
Self-check list

[x] I've set the proper labels for my PR (at least, for category and component).
[x] PR title and description are clear and intelligible.
[x] I've added enough comments to my code, particularly in hard-to-understand areas.
[ ] The functionality I've repaired, changed or added is covered with automated tests.
[x] Manual tests have been provided optionally.
[ ] The documentation for the functionality I've been working on is up-to-date.

Produce #1812


Spotify Can't Play This Right Now

wrong place, make the issue in the spicetify-cli repo. And its also probably not a spicetify issue.


api.hnpwa.com is down

The response of the API calls is:
Cannot read property 'apply' of undefined

Yeah, hnpwa api goes down sometimes and I think there's nothing I can do about it. The project seems to be unmaintained. I'll see if I can use HN's api directly


Invitations: Adding members to user groups through invitations.

Fixes: #24365

Screenshots and screen captures:
New invite user form

Popover shown on clicking a user pill

Self-review checklist

[ ] Self-reviewed the changes for clarity and maintainability
(variable names, code reuse, readability, etc.).

Communicate decisions, questions, and potential concerns.

[x] Explains differences from previous plans (e.g., issue description).
[ ] Highlights technical choices and bugs encountered.
[ ] Calls out remaining decisions and concerns.
[x] Automated tests verify logic where appropriate.

Individual commits are ready for review (see commit discipline).

[x] Each commit is a coherent idea.
[x] Commit message(s) explain reasoning and motivation for changes.

Completed manual review and testing of the following:

[x] Visual appearance of the changes.
[x] Responsiveness and internationalization.
[x] Strings and tooltips.
[x] End-to-end functionality of buttons, interactions and flows.
[x] Corner cases, error conditions, and easily imagined bugs.

@alya please review this PR.

Nice!

Let's make the input field full-width to make it more pleasant to input multiple groups.
Is it possible to make the typeahead appear immediately when the cursor is in the groups field, rather than waiting until the first character has been entered? I think that would be helpful.

Nice!

Let's make the input field full-width to make it more pleasant to input multiple groups.
Is it possible to make the typeahead appear immediately when the cursor is in the groups field, rather than waiting until the first character has been entered? I think that would be helpful.

I have increased the width and updated the screenshot. Regarding the second point I have gone through the library docs used for typeahead but did not anything for the behaviour we want. I have asked for help in czo here

Were you able to figure out how to make the typeahead appear immediately? If not, maybe @N-Shar-ma can help.

Were you able to figure out how to make the typeahead appear immediately? If not, maybe @N-Shar-ma can help.

I tried but cannot get how to make typeahead appear immediately.

@Ujjawal3 Could you resolve the merge conflicts here so I can then try figuring out what needs to be done for the typeahead to appear immediately?
In general, you should always try to resolve conflicts on a PR as soon as they occur to make things easier for reviewers and yourself :)

@Ujjawal3 I looked into our typeahead code, and it seems the helpOnEmptyStrings option is what you need to set true for this case

@alya I have updated the PR now typeahead suggestions appear immediately. Please have a look.

I can take a look once conflicts have been resolved. Thanks!

I have resolved the conflicts. You can take a test now.

Cool, thanks -- works for me in manual testing!
@sahil839 could you please take a look at this one when you have time?

The "Groups they should join" field should be disabled when the user doesn't have permission to manage user groups. Currently, it's enabled, but there is an error when one tries to use it:

We should show a tooltip on the disabled field that says: "You do not have permission to add users to groups in this organization."

@alya I have disabled the input and have added screenshots of  disabled look in PR description. Please take a look.

@alya  I have updated the PR. Now input is disabled when user is not allowed to add users and also added screenshots of disabled field in PR description. Please have a look.

Cool, thanks -- the screenshots look good to me.
@sahil839 perhaps you could review this next, when you are not too busy with release goals?

@sahil839 I have updated the PR as per your comments. Please have a look.

Also, I think we can just hide the UI in case user is not allowed to add others to groups.

Sounds good to me.

Also, I think we can just hide the UI in case user is not allowed to add others to groups.

Sounds good to me.

Should we also hide the UI when user is allowed to add to user groups but there is no user group whose membership can be changed by that user ? This can come up when a non admin user is allowed to add to user groups but that user is not a member of any user group.

Sounds reasonable to me.

@sahil839 I have updated the PR as per your comments.

Looks good to me. I am not sure about what would be the way forward for this comment.

@timabbott Approved by @sahil839 (but note @sahil839 's comment just above)  and me; tagging for your review. I did not re-test the latest version.

@sahil839 Did you manually QA the PR, or does it need more poking?

Tested, both functionality and UI elements are working as intended.

I too did the manual testing when I did the review previously and it works fine. So, removing the QA needed label should be fine now I guess.

Apart from comment here I think this PR is ready for integration. I have done the manual testing and everything seems to work fine.

@alya I have resolved the merge conflicts. As files in web/src folder has been migrated to typescript now I have added a couple of comments where I need some help. It may be possible that the comments might be trivial one because I don't have any prior experience working in typescript. Although on testing everything is working as expected.

Updated this PR to add a new set_up_user_groups function like the one added in #30344. As a result also squashed a couple of old commits into the main commit since a complete new function is added for setting up typeahead.
Posted one comment about the typeahead behavior of showing it when input is empty.

Closing as this was finally completed via https://github.com/zulip/zulip/pull/30299. Thanks so much for all your work on this @Ujjawal3!


Steps with Form Validation and Ajax request

I have a form at www.lgbtcm.com that uses Steps and form validation. I can get the form validation to work with an Ajax call to verify if a username or email is working but then it disables the ability to move to the next Step.
bemail: {                     validators: {                         notEmpty: {                             message: 'The email address is required'                         },                         emailAddress: {                             message: 'The input is not a valid email address'                         },                         remote: {                             url: '<?php echo get_bloginfo('url'); ?>/wp-admin/admin-ajax.php',                             type: "GET",                             message: 'This email is already in use',                             cache: false,                             async: false                             }                     }                 },
How can I get the Steps to work with the form.?? THANKS!

Same problem here... Please tell if you find a solution

+1

I have the same issue. The whole problem is that the onStepChanging function is supposed to return true or false. It is not designed to run an async code.

+1

@hedgehed Thank you for your solution, I had been sick of searching the internet and no good, Your approach is simple and crisp. Thank you buddy !


Johncarpenter/traffic

Traffic Signal Detection Updates

Added test code under light classification
Added CV2 based traffic light identification
Updated control mechanisms for broadcasting traffic light positions

Wrong repo. Sorry


request: ephemeral messages

Only you can see this message
Is your feature request related to a problem? Please describe.
No

"Only you can see this" message

Already a feature: https://github.com/skyra-project/discord-components/tree/main/packages/core/src/components/discord-message#properties.
It's also included in the live demo that is linked in the README:


.html() doesn't work on winmobile 6.5

x$('h2').html('set this..');
seem to have no effect on pda device running winmo6.5pro, ce os 5.2

What build profile did you use? The stock one or the IE-specific one?

Thanks for your feed back. xui-ie-2.3.2.min.js used.
_init_

(works in PC IE, not PDA running winmo 6.5)


bug EOS token expected on Text2ClassProblem labels

Description
I created a Text2ClassProblem including 7 labels. When I execute t2t-decoder, it crashes as soon as the output is label id 1. I researched a bit and in decoding.py it is running through _save_until_eos, where id 1 is removed. But why is this function called on label ids, when id 0 and 1 are allowed?
This is also part of the description for Text2ClassProblem: The label should be an int in [0, self.num_classes)
I used:

model: transformer
hparams_set: transformer_base_single_gpu
vocab: 32k subwords

Environment information
OS: Ubuntu 16.04
$ pip freeze | grep tensor
tensor2tensor==1.6.2
tensorboard==1.7.0
tensorflow-gpu==1.7.0
$ python -V
Python 2.7.12
Steps to reproduce:
Create a Text2ClassProblem and assign label ids 0-6.
t2t-datagen
t2t-trainer
t2t-decoder
(then it should crash)
Error logs:
Traceback (most recent call last):
File "/home//.local/bin/t2t-decoder", line 16, in
tf.app.run()
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/platform/app.py", line 126, in run
_sys.exit(main(argv))
File "/home//.local/bin/t2t-decoder", line 12, in main
t2t_decoder.main(argv)
File "/home//.local/lib/python2.7/site-packages/tensor2tensor/bin/t2t_decoder.py", line 190, in main
decode(estimator, hp, decode_hp)
File "/home//.local/lib/python2.7/site-packages/tensor2tensor/bin/t2t_decoder.py", line 104, in decode
dataset_split="test" if FLAGS.eval_use_test_set else None)
File "/home//.local/lib/python2.7/site-packages/tensor2tensor/utils/decoding.py", line 204, in decode_from_dataset
log_targets=decode_hp.log_targets)
File "/home//.local/lib/python2.7/site-packages/tensor2tensor/utils/decoding.py", line 94, in log_decode_results
decoded_outputs = targets_vocab.decode(_save_until_eos(outputs, is_image))
File "/home/***/.local/lib/python2.7/site-packages/tensor2tensor/data_generators/text_encoder.py", line 230, in decode
return self._class_labels[label_id]
TypeError: only integer scalar arrays can be converted to a scalar index

That is indeed a bug. decoding.py needs to check the target modality and only _save_until_eos if it's SymbolModality.

There is another symptom when I use t2t-exporter to export a Text2ClassProblem, the tensorflow_model_server prints an error, when requesting an inference. Maybe this is related to this issue?
Steps to reproduce:
t2t-exporter
tensorflow_model_server
t2t-query-server
Error logs:
Traceback (most recent call last):
File "/home//dev/git/prinvision/nets/test_doc_to_language.py", line 22, in
outputs = service.process(inputs)
File "/home//dev/git/prinvision/nets/public_service_api_v3.py", line 50, in process
outputs = serving_utils.predict([input_string], self.problem, self.request_fn)
File "/home//.local/lib/python2.7/site-packages/tensor2tensor/serving/serving_utils.py", line 118, in predict
predictions = request_fn(examples)
File "/home//.local/lib/python2.7/site-packages/tensor2tensor/serving/serving_utils.py", line 75, in _make_grpc_request
response = stub.Predict(request, timeout_secs)
File "/usr/local/lib/python2.7/dist-packages/grpc/beta/_client_adaptations.py", line 309, in call
self._request_serializer, self._response_deserializer)
File "/usr/local/lib/python2.7/dist-packages/grpc/beta/_client_adaptations.py", line 195, in _blocking_unary_unary
raise _abortion_error(rpc_error_call)
grpc.framework.interfaces.face.face.AbortionError: AbortionError(code=StatusCode.INVALID_ARGUMENT, details="Feature: targets (data type: int64) is required but could not be found.
[[Node: ParseSingleExample/ParseSingleExample = ParseSingleExample[Tdense=[DT_INT64, DT_INT64], dense_keys=["batch_prediction_key", "targets"], dense_shapes=[[1], [1]], num_sparse=1, sparse_keys=["inputs"], sparse_types=[DT_INT64]](arg0, ParseSingleExample/Reshape, ParseSingleExample/Const)]]
[[Node: DatasetToSingleElement = DatasetToSingleElementoutput_shapes=[[?,1], [?,?,1,1], [?,1,1,1]], output_types=[DT_INT32, DT_INT32, DT_INT32], _device="/job:localhost/replica:0/task:0/device:CPU:0"]]")

@friesel @rsepassi @fciannel I sent a PR to fix this bug, wish it can help. Thanks.

I had the same error with the imdb sentiment problem, I implemented the changes to /utils/decoding.py as per @yanboliang 's fix and the issue was resolved :D


Add support for justified tabs

http://getbootstrap.com/components/#nav-justified

Thank you for the PR.
What happen of you have both vertical and justified at the same time? This makes me wonder if it should be a string rather than two booleans.

It will behave as justified, which i guess is a bit weird. As you mention, perhaps it's better to have a style property or similar instead.


Heroku button deployment broken

Deploying via the Heroku button fails since we removed ffaker from the default group, probably because it wasn't being installed (Heroku runs bundle install --without=development:test) so even though we require it in the seeds.rb script, it's not available for us to use. We could manually install it in the buildpack or move those gems to a different group. This should be fixed ASAP, I've already resolved a separate Heroku build issue due to the authentication initializer, but I'd like to tag / release v5.2.1 today.

This was my suggestion from awhile back: https://github.com/YaleSTC/reservations/pull/1164#issuecomment-75308243

Yea, that should do it (I forgot you had opened up a PR before the issue was opened). I'll get that done now and see if it fixes things.

Whoops, completed without a PR :disappointed:. My bad!


You're awesome. 2. Is there a demo app somewhere?

You're awesome. Simple-schema, collection2, autoform and now this? Great work

My actual question, is there a demo app up yet?

:blush:
No. I have one I've been using for testing, but I need to improve it a bit before posting.

+1 for being awesome.

+1

+1 indeed!

:+1: here too, really good stuff, just wanted to make sure you know you're appreciated :)

Thanks all. :grinning:

Hi all. I created a basic demo app on Meteorpad.

Hi Y'all,
Have a look at http://greatalbums.meteor.com/albums for a working demonstration of a Collection with reactively CRUD using aldeed:tabular, aldeed:autoform
The source is on github, https://github.com/AnnotatedJS/GreatAlbums
You can signin with email<EMAIL_ADDRESS>and password "password".
René
AnnotatedJS

Thanks @AnnotatedJS!


Layout revamp ideas

I really like this card so far, thank you very much for it!
My suggestion is to rearrange the table columns to achieve a more streamlined look that could help digesting the information easier.
The column order could be:
|icon1| |icon2| |description| |date| |weekday| |numberofdays|
Left: Current
Right: Suggestion (with one_icon: true and w_day: false)

I'd prefer keeping the current layout with icons, date and day values on left and garbage type on right to comply with the general entity layout.
You can however fork this repo and do your desired changes in the forked repo.


Add documentation for downloading the latest builds

This change is

Thanks @alex-taffe!  This is definitely a good idea.  For some reason the rich review indicates that the markdown isn't rendering properly.  Is that just an artifact of the diff viewer?

It seems like it's just the diff viewer, it was screwed up in the first commit but I fixed it in d8899b5

Sounds good to me!  I'm not going to bother with the CI for the docs change.


pip安装requirements时出错

在我输入 pip install -r requirements.txt时，输出错误，请问怎么解决
Collecting aiohttp==3.6.2 (from -r requirements.txt (line 1))
Could not find a version that satisfies the requirement aiohttp==3.6.2 (from -r requi)
No matching distribution found for aiohttp==3.6.2 (from -r requirements.txt (line 1))

手动安装吧。pip install aiohttp


OCPBUGS-37486: Set right endpointSlice port

What this PR does / why we need it:
This https://github.com/openshift/hypershift/pull/4228 introduced an inconsistency between the endpoint and endpointSlice ports. Resulting in old HCs having hcp.Spec.Networking.APIServer.Port=443 failing to talk to the CP via kubernetes.svc.
This PR fixes that.
Which issue(s) this PR fixes (optional, use fixes #<issue_number>(, fixes #<issue_number>, ...) format, where issue_number might be a GitHub issue, or a Jira story:
Fixes #
Checklist

[ ] Subject and description added to both, commit and PR.
[ ] Relevant issues have been referenced.
[ ] This change includes docs.
[ ] This change includes unit tests.

/hold
to add unit test

cc @rtheis

/cherrty-pick release-4.16 release-4.15

/jira refresh

/hold cancel

/lgtm

--- FAIL: TestValidateKeyPairItempotency (0.51s)
--- FAIL: TestValidateKeyPairItempotency/0 (0.32s)
tls_test.go:168: validation failed when config was unchanged: actual validity 74304.17291666666 differs from expected 74304.17291219337
/test unit

/test e2e-azure

/retest

/retest


typo in docs

http://www.agnosticui.com/docs/advanced/advanced-usage.html#modular-css-imports references ...reset... but it's actually resets

"agnostic-svelte": "^1.1.6",

Thanks @longrunningprocess https://www.agnosticui.com/docs/advanced/advanced-usage.html is fixed now

I'm sorry Rob, I did that from my phone and obviously gave you the wrong link, it's in theming:  https://www.agnosticui.com/docs/theming.html#reset

yes, thank you!

@longrunningprocess https://developtodesign.com/agnosticui-examples has the Vest form example I was mentioning and links to the source code. Might be helpful

@longrunningprocess https://developtodesign.com/agnosticui-examples has the Vest form example I was mentioning and links to the source code. Might be helpful

very slick and encouraging they stayed focused and cohesive on validation!


Feature Request: Support specifying neo4j database

Neo4j 4.0+ (enterprise) supports multiple databases.
It seems this is not super complicated, you just need to send a cypher USE <database> command to switch to the right database.
This would be really helpful for running both a test and dev database locally with a single instance of neo4j, similar to how ActiveRecord uses test/dev databases by default.

@yourpalal Thanks for reporting. We will add this in Feature list.

The relevant issue on neo4j-ruby-driver appears to be https://github.com/neo4jrb/neo4j-ruby-driver/issues/48


graph.res do not exist when running XInsight

I am running the XInsight code.
I have changed the sl_algo in "run.py", line 72, into xl = XLearner(data_path, sl_algo='blip') to use BLIP, but got an issue
FileNotFoundError: [Errno 2] No such file or directory: 'C:\\Users\\DINGHU~1\\AppData\\Local\\Temp\\tmpnj_rdn_q\\graph.res'

which occurs in "BLIP.py", line 52, in parse_res_file
The blip file and jkd are placed in the lib dir.

Is there any additional error information? It looks like the BLIP fail to generate the graph file. Could you try to run BLIP in terminal and see if it can produce a graph file?

You may need to adjust the memory argument (-Xmx200G) in BLIP.py as appropriate. The experiments were conducted on a server with 256GB of memory. Be aware that running BLIP on large datasets without adequate memory might lead to OOM issues.


Add device option to Json for edge Version

Hi,
in zigbee2mqtt they added
serial:
  adapter: <z-stack|deconz>
  port: /dev/ttyS0

in dev branch so it works with deconz (conbee 2 stick) see:
https://github.com/Koenkk/zigbee-herdsman/issues/72
I tried to fork this project and add the Json by myself until it's done in this project, but it keeps removing the "adapter" part (i updated config.json in scheme).
So i hope you find some time to do this in the edge Version
Greetings

Issue is not stale, Stalebot...


Run soak tests with VFS retention enabled

To shake out some of those pesky crashes.

cc: @gradle/build-cache

What we want to do is create a soak tests, where we run

many builds with file changes in between the builds with VFS retention enabled
have one daemon watching a project directory, and then have another daemon (maybe another version) run many builds on that project, so the first daemon needs to pick up many changes while idle.

Just a thought: for the second case we don’t need the changes to be effected by a Gradle daemon; we can simply modify a lot of files in the idle daemon’s project directory.


tbpore-modules and tests

Hi @abhi18av and @Mxrcon

I have wrapped tbpore-process and tbpore-cluster as separate modules
Could not do the same with tbpore-download (the download keeps failing
urllib.error.URLError: <urlopen error [Errno -3] Temporary failure in name resolution. So decontamination db has to be passed using a Channel (fromPath)
Wrote tests for both processes (tbpore-process and tbpore-cluster)
The tests too keep failing (not becaus of the code but because of minimap2 runtime failure)
Error calling minimap2 -aL2 -x map-ont -t 6 -o .tbpore/test.decontaminated.sam remove_contam.map-ont.mmi .tbpore/test.fq.gz (return code -9) This seems like a memory problem but I doubt it. I ran the test first on a 32GB RAM PC, and for the benefit of doubt on a 128GB Workstation. Spent about 15 hours of my precious time trying to debug to know avail.

Thanks @ycode-sh , does this mean that we can close https://github.com/nf-core/tbanalyzer/pull/6 without merging?

Thanks for all your efforts here @ycode-sh , please allow me sometime to go through this PR especially the minimap2 issue 🤔

The tests too keep failing (not becaus of the code but because of minimap2 runtime failure)
Error calling minimap2 -aL2 -x map-ont -t 6 -o .tbpore/test.decontaminated.sam remove_contam.map-ont.mmi .tbpore/test.fq.gz (return code -9) This seems like a memory problem but I doubt it. I ran the test first on a 32GB RAM PC, and for the benefit of doubt on a 128GB Workstation. Spent about 15 hours of my precious time trying to debug to know avail.

Thanks @ycode-sh , does this mean that we can close #6 without merging?

The modules are okay to merge

Thanks for all your efforts here @ycode-sh , please allow me sometime to go through this PR especially the minimap2 issue 🤔

I'm not sure but I think there is a problem with how nextflow and tbpore interacts. minimap2 did not fail when running tbpore without nextflow.  return code -9 indicates insufficient memory. I'm wondering how that's even possible since the process was run  with a 128GB memory workstation and label 'process_high'


object_store 0.9.1 breaks Azure Storage Emulator Config

Describe the bug, including details regarding any error messages, version, and platform.
delta-rs is using this config to connect to Azure Storage Emulator:
dict(
        AZURE_STORAGE_ACCOUNT_NAME="devstoreaccount1",
        AZURE_STORAGE_ACCOUNT_KEY="Eby8vdM02xNOcqFlqUwJPLlmEtlCDXJ1OUzFT50uSRZ6IFsuFq2UVErCz4I6tq/K1SZFPTOtr/KBHBeksoGMGw==",
        AZURE_STORAGE_CONTAINER_NAME="deltars",
        AZURE_STORAGE_USE_EMULATOR="true",
        AZURE_STORAGE_USE_HTTP="true",
    )

this is passed via python, but it basically just sets the configs in object_store.
In 0.9.1, this started to cause an authentication error:
E       OSError: Generic MicrosoftAzure error: Client error with status 403 Forbidden: <?xml version="1.0" encoding="UTF-8" standalone="yes"?>
E       <Error>
E         AuthorizationFailure
E         <Message>Server failed to authenticate the request. Make sure the value of the Authorization header is formed correctly including the signature.
E       RequestId:44a1c5ff-8a6b-491a-a890-e07d0d823e87
E       Time:2024-03-05T11:31:55.140Z</Message>
E       </Error>

Can you check this?
Since there was a check in Azure Authentication in object_store 0.9.1, is there some different config required? I was assuming a bug since it's only a minor version increase and the config looks good
Component(s)
Other

Could you report this to https://github.com/apache/arrow-rs/ ?
This is not the upstream of object_store.

Ah sorry, ported it here: https://github.com/apache/arrow-rs/issues/5475


Update Enforce checks

Hi @SvanBoxel great job on this APP.
I found an possible bug when i configure enforce: true and enforce_admin: true, at this point everything works like a charm.
But when i try to set enforce: false and enforce_admin: false after the workflow already created checks on protection branchs it keeps as true for all repositoryes  in my organization.
It would be great if, after the change forces it to false, it is updated checks for all repositoires.

Bug confirmed. 👍🏽
At the moment the app copies all current required status checks as an array and then, depending on whether you enforce it or not, adds a new required check to that array. That means that even though you toggle the boolean from true to false, it will still be part of the original array of required checks.
Culprit:
https://github.com/SvanBoxel/organization-workflows/blob/0227befa53ad36f2a182ee5f99c18e2a63cca8f9/src/utils/enforce-protection.ts#L39

Bug confirmed. 👍🏽
At the moment the app copies all current required status checks as an array and then, depending on whether you enforce it or not, adds a new required check to that array. That means that even though you toggle the boolean from true to false, it will still be part of the original array of required checks.
Culprit:
https://github.com/SvanBoxel/organization-workflows/blob/0227befa53ad36f2a182ee5f99c18e2a63cca8f9/src/utils/enforce-protection.ts#L39

Release with 1.3.0.


Process Name for OutOfProcess hosting in ASP.Net Core 3.1

[Enter feedback here]
In ASP.Net Core 3.1, the process name is returned as application name instead of 'dotnet' for 'OutOfProcess' hosting model.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: fe69b3a9-896f-e189-0c2c-f87ff735df9c
Version Independent ID: 97c8549b-66ad-0a23-1971-784fb923042a
Content: ASP.NET Core Module
Content Source: aspnetcore/host-and-deploy/aspnet-core-module.md
Product: aspnet-core
Technology: aspnetcore-hostdeploy
GitHub Login: @Rick-Anderson
Microsoft Alias: riande

@shirhatti  please confirm and I'll get this fixed ASAP.

Thank you for contacting us. Due to a lack of activity on this discussion issue we're closing it in an effort to keep our backlog manageable. If you believe there is a concern which hasn't been addressed, please file a new issue.

This could help:
https://stackoverflow.com/questions/62276413/why-do-i-see-project-directory-name-instead-of-dotnetout-of-process-while-runn

Thanks @gurucharan2206.


Release @google-cloud/connect-datastore v2.0.2

This pull request was generated using releasetool.  Fixes #84

Release is at https://github.com/googleapis/nodejs-datastore-session/releases/tag/v2.0.2

The release build has started, the log can be viewed here. :sunflower:

:egg: You hatched a release! The release build finished successfully! :purple_heart:


Update links

Coverage remained the same at 88.271% when pulling d0baa337e941b7149fc5c2cb469048fe50d1c387 on nullproxy:master into 3c7d067cb0c8f05003270989189438bc372e52df on kusanagi:master.


Latest pyswisseph (2.8.0) breaks computations

Need to update codes. For example calc_ut now returns some additional flags etc.

Functions calc/calc_ut and fixstar/fixstar_ut have changed. Simply fix:
res = swe.calc_ut(...) becomes: res, flg = swe.calc_ut(...)
res = swe.fixstar_ut(...) becomes: res, starname, flg = swe.fixstar_ut(...)

New weird error with zero ayanamsha values showing up in b3f88d2

New weird error with zero ayanamsha values showing up in b3f88d2
This breaks solar day computation, and returns the last tropical month start, as ayanamsha is returned as 0.0.

https://github.com/astrorigin/pyswisseph/issues/34
Pushed a workaround which uses the misnamed swe.SIDM_LAHIRI


hexagon layer with height column

I'm trying to get the hexagon layer/heatmap chart working with a height column. So my csv has 3 columns: lng,lat,height. Each lng/lat value will only occur once in the csv, but the height value is then used to determine how high to build that hex cell.
From what I understand, I should be looking at the "getElevationValue" function. But I'm not sure how to apply that function to my csv data? Is there a quick code example somewhere that demonstrates this?
Thanks in advance!

In this example they are using the getPosition function here. You would just add getElevationValue in the sample place.

ok, but what is "d"? Is that a row in my csv? Is that some javascript object? How do I know what value to return in the getElevationValue? My question is that in the "getElevationValue", somehow I have to dig back into my csv and retrieve the height value for the current lat/lng pair.

Yes it appears that each row in your csv will become an object. See https://github.com/uber/deck.gl/blob/5.2-release/examples/website/3d-heatmap/app.js#L30
The object should have property names which are the column titles in the csv.

@danmarshall It looks like the problem is that the parameter is the points in the given bin and by default it returns the length of that bin. If that's the case, I don't see there is a way to set the height of the bar via explicit value. One option would be to preprocess the data.
I see there's a similar question at https://github.com/uber/deck.gl/issues/829, but I don't know how to proceed with that. Maybe @heshan0131 can kindly chime in? :)
I prepared some data at https://gist.githubusercontent.com/veikkoeeva/29cdb7e5cf9438a8e0181c9e5d8a99b8/raw/4640ef338dfd672e8e83228ff19003f7c27c0301/data.csv, just in case someone has the time to help here (it's data around China, Vietnam, Philippines).

@danmarshall I thought there's more than one modification that developers should concern about when they want to customize the elevation value via their own data，getColorValue is required at least since we change the display elevation of our map.
@veikkoeeva I think the problem you met can be resolved in this way.
Suppose your data is consists of many points, and you have property SPACES to defined the height you want to show:
[{
	COORDS: [lng, lat],
	SPACES: Math.random()*100,
	...
}, ...]

you can iterate the elevation input and take out the result from it in this way:
const getElevationValue = d => d.reduce(
	(accumulator, currentValue) => currentValue ?
		accumulator + currentValue.SPACES : accumulator,
	0
),

the input format can be found like this:
[
	{}, // YOUR ORIGINAL POINT
	{}, // YOUR ORIGINAL POINT
	...
	x: NUMBER,
	y: NUMBER,
]

the same approach can be applied in getColorValue method, for rendering the right color corresponding each hexagon with your customized height in getElevationValue method.
The issue #829 can be resolved by this way, too. Last, if your data not met the format of default data format, you should also define getPosition to get your project work well.

I have been trying to achieve the same result where I have a weight property which I wanna use to give heights to the Hexagon cells.
const layers = [ 		new HexagonLayer({ 			id: 'crowding-pattern', 			colorRange, 			coverage: 1, 			data, 			elevationRange: [0, 1000], 			elevationScale: 50, 			extruded: true, 			getPosition: d => { 				const { lat, lng } = d 				return [Number(lng), Number(lat)] 			}, 			pickable: true, 			radius: 100, 			upperPercentile: 100, 			material, 			getElevationValue: d => { 				const { weight } = d[0] 				return weight 			}, 			transitions: { 				getElevationValue: { duration: 800 } 			} 		}) 	]
I went through the whole issue and a couple more related to this but I am still not seeing any cells drawn!
Am I missing something?

I am trying to achieve the same result where I have property which I wanna use to define the height of the cells.
		new HexagonLayer({
			id: 'crowding-pattern',
			colorRange,
			coverage: 1,
			data,
			elevationRange: [0, 1000],
			elevationScale: 50,
			extruded: true,
			getPosition: d => d.coordinates,
			pickable: true,
			radius: 20,
			upperPercentile: 100,
			material,
			getElevationValue: d => {
				const { weight } = d[0]
				return weight * 100
			},
			transitions: {
				getElevationValue: { duration: 800 }
			}
		})
	]```
But the cells that get drawn have no height! Am I missing something?


Logitech G305 throws ERR_INVALID_ARGUMENT

Information

ratbagd version: 0.11 (installed from arch packages)
Distribution: Arch Linux
Kernel version: Linux 5.4.2-arch1-1 x86_64 GNU/Linux
Machine: Lenovo Thinkpad E595
Mouse: Logitech G305

Describe the bug
cannot start daemon with g305 plugged in.
To Reproduce

Be me
run ratbagd
??
profit

Logs
● ratbagd.service - Daemon to introspect and modify configurable mice
     Loaded: loaded (/usr/lib/systemd/system/ratbagd.service; enabled; vendor preset: disabled)
     Active: failed (Result: core-dump) since Sat 2019-12-14 15:36:22 WET; 32min ago
    Process: 3789 ExecStart=/usr/bin/ratbagd (code=dumped, signal=ABRT)
   Main PID: 3789 (code=dumped, signal=ABRT)

Dec 14 15:36:22 gimbas-thinkpad systemd[1]: ratbagd.service: Scheduled restart job, restart counter is at 5.
Dec 14 15:36:22 gimbas-thinkpad systemd[1]: Stopped Daemon to introspect and modify configurable mice.
Dec 14 15:36:22 gimbas-thinkpad systemd[1]: ratbagd.service: Start request repeated too quickly.
Dec 14 15:36:22 gimbas-thinkpad systemd[1]: ratbagd.service: Failed with result 'core-dump'.

I just merged a PR fixing this. Should be working in master. I will hopefully make a release pater this week.

Just saw the commit log, installed from AUR and it's runing just fine


Error occurs when click on map

Hi, I'm developent use openlayer v3 libary. Sometime I meet error when click on map, the map suddenly invisible content. You can see its result when click on map in example like bellow:http://openlayers.org/en/v3.8.2/examples/overlay.html :

This bug still occur in http://openlayers.org/en/v3.10.1/examples/overlay.html.

See http://openlayers.org/en/v3.10.1/examples/popup.html. The automatic positioning does not work with Bootstrap popovers. So please create your popup like in the example I linked.


Cannot load plugin ipynb.markup

ERROR: Cannot load plugin ipynb.markup
| ImportError: No module named 'IPython'
i followed this instructions - https://www.dataquest.io/blog/how-to-setup-a-data-science-blog/
jupyter version -4.3
python - 3.5.2+

I was using virtualenv, and when i tried without it it worked fine. May be dependencies were not installed properly.