HBASE-23892 KeyStoreTestUtil.getClasspathDir NPE when running UT exte…

…nds SecureTestCluster and hbase-server is referred as a jar file.

Idea here is that we need to figure out a valid path from resources within the classpath, but that's only possible if we refer a file that's not contained with a jar, so thought of checking for possible existence of a file named "hbase-test-util-dependent" file that extending tests could then define in its classpath.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 32s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
hbaseanti
0m  0s
Patch does not have any anti-patterns.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s
The patch appears to include 1 new or modified test files.

_ master Compile Tests _

+1 :green_heart:
mvninstall
5m 33s
master passed

+1 :green_heart:
compile
0m 25s
master passed

+1 :green_heart:
checkstyle
0m 18s
master passed

+1 :green_heart:
shadedjars
4m 39s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 20s
master passed

+0 :ok:
spotbugs
0m 41s
Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
0m 38s
master passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
5m  4s
the patch passed

+1 :green_heart:
compile
0m 23s
the patch passed

+1 :green_heart:
javac
0m 23s
the patch passed

+1 :green_heart:
checkstyle
0m 15s
the patch passed

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
shadedjars
4m 54s
patch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
hadoopcheck
17m 15s
Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.

+1 :green_heart:
javadoc
0m 17s
the patch passed

+1 :green_heart:
findbugs
0m 44s
the patch passed

_ Other Tests _

+1 :green_heart:
unit
0m 47s
hbase-http in the patch passed.

+1 :green_heart:
asflicense
0m 13s
The patch does not generate ASF License warnings.

49m  5s

Subsystem
Report/Notes

Docker
Client=19.03.6 Server=19.03.6 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1207/1/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/1207

Optional Tests
dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile

uname
Linux 745ed911f0a4 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux

Build tool
maven

Personality
/home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1207/out/precommit/personality/provided.sh

git revision
master / 3e21dc73de

Default Java
1.8.0_181

Test Results
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1207/1/testReport/

Max. process+thread count
617 (vs. ulimit of 10000)

modules
C: hbase-http U: hbase-http

Console output
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1207/1/console

versions
git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11

Powered by
Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

Can you share the top of the stack-trace -- what your test code calls and how that filters down into the hbase code here?

The test code extends SecureTestCluster, so when SecureTestCluster.setup runs, it calls HBaseKerberosUtils.setSSLConfiguration passing its own class reference here.
HBaseKerberosUtils.setSSLConfiguration, in turn, calls KeyStoreTestUtil.getClasspathDir here.  KeyStoreTestUtil.getClasspathDir uses the passed class reference name to look for its related resource in the class loader. This line returns an URL value as follows, when the passed class reference resource resides on jar file in the class loader (instead of being in a valid local FS path):
jar:file:/Users/wellingtonchevreuil/.m2/repository/org/apache/hbase/hbase-server/2.2.3./hbase-server-2.2.3-tests.jar!/org/apache/hadoop/hbase/security/token/SecureTestCluster.class
This causes subsequent line calling url.toURI().getPath() to return null, then we get the NPE thrown in the following line, and the test errors out:
java.lang.NullPointerException 	at org.apache.hadoop.hbase.http.ssl.KeyStoreTestUtil.getClasspathDir(KeyStoreTestUtil.java:59) 	at org.apache.hadoop.hbase.security.HBaseKerberosUtils.setSSLConfiguration(HBaseKerberosUtils.java:173) 	at org.apache.hadoop.hbase.security.token.SecureTestCluster.setUp(SecureTestCluster.java:74) 	at com.cloudera.hbase.security.token.TestCldrManualDelegationToken.setUp(TestCldrManualDelegationToken.java:168) 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 	at java.lang.reflect.Method.invoke(Method.java:498) 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) 	at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298) 	at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292) 	at java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:266) 	at java.util.concurrent.FutureTask.run(FutureTask.java) 	at java.lang.Thread.run(Thread.java:748)

Can we fix the test-API such that the downstream code has the hook to provide a class which will actually get a classloader from test-classes instead of the jar?

I can think of defining a protected static Class instance in SecureTestCluster whose default value would be SecureTestCluster.class, then pass that HBaseKerberosUtils.setSSLConfiguration so that downstream sub-classes of SecureTestCluster could override that property with its own values. Let me update this PR with this option.

@joshelser , had pushed another commit with alternative solution I had mentioned on my previous comments. Let me know what you think.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 32s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
hbaseanti
0m  0s
Patch does not have any anti-patterns.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s
The patch appears to include 2 new or modified test files.

_ master Compile Tests _

+0 :ok:
mvndep
0m 39s
Maven dependency ordering for branch

+1 :green_heart:
mvninstall
5m 22s
master passed

+1 :green_heart:
compile
1m 22s
master passed

+1 :green_heart:
checkstyle
1m 22s
master passed

+1 :green_heart:
shadedjars
4m 43s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 57s
master passed

+0 :ok:
spotbugs
4m 15s
Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
4m 52s
master passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 15s
Maven dependency ordering for patch

+1 :green_heart:
mvninstall
5m  7s
the patch passed

+1 :green_heart:
compile
1m 21s
the patch passed

+1 :green_heart:
javac
1m 21s
the patch passed

+1 :green_heart:
checkstyle
1m 21s
the patch passed

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
shadedjars
4m 38s
patch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
hadoopcheck
16m  4s
Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.

+1 :green_heart:
javadoc
0m 54s
the patch passed

+1 :green_heart:
findbugs
5m 12s
the patch passed

_ Other Tests _

+1 :green_heart:
unit
0m 43s
hbase-http in the patch passed.

+1 :green_heart:
unit
61m 30s
hbase-server in the patch passed.

+1 :green_heart:
asflicense
1m  5s
The patch does not generate ASF License warnings.

124m 39s

Subsystem
Report/Notes

Docker
Client=19.03.6 Server=19.03.6 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1207/2/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/1207

Optional Tests
dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile

uname
Linux 0442caf891be 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux

Build tool
maven

Personality
/home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1207/out/precommit/personality/provided.sh

git revision
master / 3c3aae9a2f

Default Java
1.8.0_181

Test Results
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1207/2/testReport/

Max. process+thread count
8920 (vs. ulimit of 10000)

modules
C: hbase-http hbase-server U: .

Console output
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1207/2/console

versions
git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11

Powered by
Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

Thanks Wellington. Your explanation was super helpful. I like your second fix much much more :)

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 33s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
hbaseanti
0m  0s
Patch does not have any anti-patterns.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s
The patch appears to include 2 new or modified test files.

_ master Compile Tests _

+0 :ok:
mvndep
0m 36s
Maven dependency ordering for branch

+1 :green_heart:
mvninstall
5m 23s
master passed

+1 :green_heart:
compile
1m 22s
master passed

+1 :green_heart:
checkstyle
1m 21s
master passed

+1 :green_heart:
shadedjars
4m 41s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 56s
master passed

+0 :ok:
spotbugs
4m 11s
Used deprecated FindBugs config; considering switching to SpotBugs.

+1 :green_heart:
findbugs
4m 46s
master passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 15s
Maven dependency ordering for patch

+1 :green_heart:
mvninstall
5m  5s
the patch passed

+1 :green_heart:
compile
1m 21s
the patch passed

+1 :green_heart:
javac
1m 21s
the patch passed

+1 :green_heart:
checkstyle
1m 20s
the patch passed

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
shadedjars
4m 51s
patch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
hadoopcheck
16m 19s
Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.

+1 :green_heart:
javadoc
0m 56s
the patch passed

+1 :green_heart:
findbugs
5m 38s
the patch passed

_ Other Tests _

+1 :green_heart:
unit
0m 48s
hbase-http in the patch passed.

-1 :x:
unit
65m 25s
hbase-server in the patch failed.

+1 :green_heart:
asflicense
1m  0s
The patch does not generate ASF License warnings.

129m 27s

Reason
Tests

Failed junit tests
hadoop.hbase.io.hfile.bucket.TestBucketCache

Subsystem
Report/Notes

Docker
Client=19.03.6 Server=19.03.6 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1207/3/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/1207

Optional Tests
dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile

uname
Linux 55df191e0171 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 GNU/Linux

Build tool
maven

Personality
/home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1207/out/precommit/personality/provided.sh

git revision
master / 3c3aae9a2f

Default Java
1.8.0_181

unit
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1207/3/artifact/out/patch-unit-hbase-server.txt

Test Results
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1207/3/testReport/

Max. process+thread count
8545 (vs. ulimit of 10000)

modules
C: hbase-http hbase-server U: .

Console output
https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1207/3/console

versions
git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11

Powered by
Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.


add autosummary check to documents

I added functionality to check autosummary automatically, by reverse-generating a list of exported features.
Now we can catch the documentation error when adding new feature.
I started with Functions and Links, but if this idea is acceptable, I can just add another modules.
By #4037 and this PR,
$ SPHINXOPTS= make check-html

will print:
chainer/docs/source/_autosummary_check.rst:75: WARNING: unknown document: reference/generated/chainer.functions.f1_score
chainer/docs/source/_autosummary_check.rst:76: WARNING: unknown document: reference/generated/chainer.functions.precision
chainer/docs/source/_autosummary_check.rst:77: WARNING: unknown document: reference/generated/chainer.functions.recall
chainer/docs/source/_autosummary_check.rst:86: WARNING: unknown document: reference/generated/chainer.functions.decov
chainer/docs/source/_autosummary_check.rst:100: WARNING: unknown document: reference/generated/chainer.functions.absolute
chainer/docs/source/_autosummary_check.rst:106: WARNING: unknown document: reference/generated/chainer.functions.batch_det
chainer/docs/source/_autosummary_check.rst:107: WARNING: unknown document: reference/generated/chainer.functions.det
chainer/docs/source/_autosummary_check.rst:151: WARNING: unknown document: reference/generated/chainer.functions.zoneout
chainer/docs/source/_autosummary_check.rst:154: WARNING: unknown document: reference/generated/chainer.functions.batch_renormalization
chainer/docs/source/_autosummary_check.rst:155: WARNING: unknown document: reference/generated/chainer.functions.fixed_batch_renormalization
chainer/docs/source/_autosummary_check.rst:166: WARNING: unknown document: reference/generated/chainer.functions.unpooling_nd
chainer/docs/source/_autosummary_check.rst:191: WARNING: unknown document: reference/generated/chainer.links.StatefulMGU
chainer/docs/source/_autosummary_check.rst:192: WARNING: unknown document: reference/generated/chainer.links.StatelessMGU
chainer/docs/source/_autosummary_check.rst:202: WARNING: unknown document: reference/generated/chainer.links.Parameter
chainer/docs/source/_autosummary_check.rst:219: WARNING: unknown document: reference/generated/chainer.links.BatchRenormalization

Currently missing Functions and Links are listed in #4038.
I'd like to use make check-html in chainer-test.

I feel it's not very straight-forward way.
Isn't it possible to implement this check using sphinx events, perhaps autodoc-process-docstring and build-finished?

Thank you for the suggestion! I'll try that.

I rewrote the check it using Sphinx events.
This check is enabled only when CHAINER_DOCS_CHECK_UNDOCUMENTED_ENTITY=1 is defined and another error is not occurred during build. The test is disabled by default, because autodoc-process-docstring is not emitted if build tree is already built (i.e., without make clean, it does not work as expected)
$ CHAINER_DOCS_CHECK_UNDOCUMENTED_ENTITY=1 make clean html

now displays:
...

Warning, treated as error:
Undocumented entities found.
(Note: be sure to use `make clean html` to run this check):

chainer.functions.f1_score
chainer.functions.precision
chainer.functions.recall
chainer.functions.decov
chainer.functions.absolute
chainer.functions.batch_det
chainer.functions.det
chainer.functions.zoneout
chainer.functions.batch_renormalization
chainer.functions.fixed_batch_renormalization
chainer.functions.unpooling_nd
chainer.links.StatefulMGU
chainer.links.StatelessMGU
chainer.links.Parameter
chainer.links.BatchRenormalization
Makefile:56: recipe for target 'html' failed
make: *** [html] Error 1

as expected.

I'm sorry for late review.
I've come up with another idea: how about directly checking existence of generated document files (*.rst?), from e.g. build-finished event?
I'm sorry for completely different suggestion, but in that way you would not need an environment variable.

Thanks! That sounds much better. Fixed, and found that chainer.functions.shift is undocumented.

This PR needs a fix to chainer.functions.shift first.

jenkins, test this please

jenkins, test this please

LGTM!


Clean up unused metrics in the API package

Metrics like LastRequestUnixNano are no longer required since legacyHA is no longer supported. We should remove those metrics.

@Harkishen-Singh is this issue still relevant?

We can close this as I don't find those metrics.


Compiling with .NET Native toolchain causes InvalidDataContractException during serialization

Using this library in a Windows 10 app which compiles against the .NET Native toolchain, I'm getting an InvalidDataContractException in ForecastApi.ParseForecastFromResponse when the call to serializer.ReadObject is being made:
Type 'ForecastIOPortable.Models.Forecast' cannot be serialized, serialization code for the type is missing. Consult the SDK documentation for adding it as a root serialization type.

I've tried adding various runtime directives but so far none of them have worked. Adding @MattWhilden on the .NET Native team to take a look.

Hey. Sorry about the delay. The long weekend and being a bit short staffed here has keep me busy with another issue. I'm checking this out now and will report back in a bit.

So I pulled down this repo and built my own Forecast dll as per another issue you had open. I've added it to a new UWP project in VS Update 1 and added the few lines from the main page to get started. With that setup I hit a MissingMethodException and it looks like some issue with the .NET Native tools resolving System.Net.Http.Primitives and System.Private.Networking... So I'll have to take a look at that. One step forward one step back. :-)
It's not what you've reported through... what build of VS are you using?

@MattWhilden I'm using VS 2015 14.0.23107.0 and I too had some issues with missing network APIs. I believe all of that should be resolved if you add the Microsoft.Net.Http NuGet package.

Interesting. I've added that nuget and I still get the same error. I'll keep fighting with it.
Additional information: Method 'HttpClientHandler.set_AutomaticDecompression(DecompressionMethods)' was not included in compilation, but was referenced in ForecastApi.GetCompressionHandler(). There may have been a missing assembly.
If there is a handler for this exception, the program may be safely continued.

Ah yes, that was quite annoying. Looking at my solution I'm not sure how I got around that. Do you have Microsoft.Bcl.Build? I'll keep looking when I have some time.

So this is a real bug in .NET Native that this hits because this isn't building against .NET Core.  This can be worked around by adding a reference to the System.Runtime.Serialization.Json contract which is where these types all live in a non PCL world. They used to live off in System.ServiceModel.Web. As a somewhat cleaner possibility, this library could be retargeted to the .NET Core profile. I don't actually know what's best for this particular project and it'll probably need some input from @jcheng31.
It's a bit unfortunate because we make it like 95% of the way to this working perfectly correctly out of the box. We correctly analyze this line (https://github.com/jcheng31/ForecastPCL/blob/master/ForecastPCL/ForecastApi.cs#L513) and make a note that you're totally going to want to serialize Forecast. We then write that information down into one of our intermediate files but when we go to spin up the serialization generator (sg.exe) there's a bit of overly clever code that says, "Hey, this library totally doesn't depend on System.Runtime.Serialization.Json. That must mean all this stuff I figured out about using DataContractJsonSerilaizer is totally wrong and I won't write it out." The fix on our side will be to remove this extra bit of fancy state tracking and will be available in Update 2 of Visual Studio sometime early next year.
Let me know if you have any questions. Happy to help.

Thanks for the info @MattWhilden. So in the meantime, if I want to get my app compiling against this library how do I add this reference? I tried adding the System.Runtime.Serialization.Json NuGet package but that didn't help.

Thanks a lot to both of you for digging into this! Sorry for not being more active here.
Regarding the two options - I'm not entirely sure what the trade-offs are between them. I suppose the priority for this library is to ensure it'll still work across all platforms (including mobile) going forward; if targeting .NET Core allows that, then I'm happy to just go with that. I'm still somewhat new to all this, so I'm not sure what that exactly entails; I took a brief look at the introductory blog post, which I interpreted as saying .NET Core is the way to go for cross-platform stuff in the future.

@jcheng31 You're right, that's the surface area we're targeting for the future .NET platforms including cross plat and .NET Native. Not a bad thing to head that way.
@anthonyhenderson Let me see how much work it is just to get this targeting .NET Core and building. Can't be too hard right?

Alright. So I've learned a valuable lesson about hubris on the internet. Getting this project to be retargeted to .NET Core (aka ASP.NET 5 profile) got me a bit stuck... you have to migrate to nuget 3 and then I ended up with a busted project.json etc etc.
What does seem to work is starting a new portable library project targeting Windows 10, .NET 4.6, and ASP.NET 5. After importing the code into that project, it builds just fine, seems to know what's up and has the correct assembly reference to make .NET Native happy. I'll have to get someone from the framework team to help me actually sort this out tomorrow but that's what you get when you let a compiler dev fight with libraries and build stuff eh? :-)
I've pushed my changes into my fork here: https://github.com/MattWhilden/ForecastPCL/tree/PortToCore/
Perhaps that'll unblock @anthonyhenderson

I can confirm that the portable library targeting .NET Core makes my app run as expected :)
Wasn't very hard to create the new project but I suppose it all depends on what framework versions @jcheng31 wants to support moving forward.

It does look like the suggested way to get moved onto .NET Core (aka ASP.NET 5 profile) is to melt down your project file and start a new one. :-(
It's possible that the correct thing here is just "do nothing". Folks that have an issue can use my hacked up fork and when we release the next version of .NET Native, I expect this issue to be fixed (early next year some time).

I'm using Visual Studio 2015 Update 2 and I'm still getting this error.  My code is at https://github.com/cbordeman/gameofgo.  If I enable .Net Native I get the crash, but on the type GoGameState.  I've added all the types used in my OnRegisterKnownTypesForSerialization(), which uses DataContractSerializer.  All types have empty constructors.
If I disable .Net Native, all works fine, but when I generate the .appxupload file for the Store via Visual Studio, a _Test folder is created, but the necessary .appxupload file is not generated.  I'd be happy to disable .Net Native if I could just get the .appxupload file without the app crashing.

There's more than one reason you may be seeing this error. It may be that this wasn't completely addressed by the work in Update 2 or some other issue. Hard to say at first glance but we're happy to help. Can you start a mail with us at<EMAIL_ADDRESS>It helps with our internal tracking here at MS.

After reinstalling VS Update 2, the problem resolved itself.  Thanks anyway.

Happy to hear you're unblocked. Do let us know if you see other oddities. Happy to help.

Sorry, this issue actually isn't resolved.  I will email the team.

We've sync'd up and the issue is being investigated. It looks similar to this issue but I suspect it has a different root cause. As this doesn't have to do directly with ForecastPCL I'll just report back when we have a solution (don't want to leave anyone hanging).

Alrighty - it's been quite a while, though I think I've finally gotten this resolved. I've (sadly) been away from the .NET world for a while, so I'm not sure if VS2015 Update 2 would have fixed it on its own; I went and created a new solution/project, added ASP.NET Core 1.0 as a target (losing Silverlight in the process), and copied the existing code into there.
I tested the NuGet package locally in a UWP app with .NET Native enabled, and it worked in both Debug and Release mode. Will leave this issue open for a little longer just in case I missed something, though!

Perfect. Update 2 should contain the fix for ForecastPCL. Thanks for letting us know.


converted file ends up in automator folder

The mp4 file and all associated files (.srt) are in the mp4_automator folder, not the destination folder which should also be the source folder.

Post your logs and post your settings
Sent from my iPhone

On May 26, 2017, at 15:19, smithdo<EMAIL_ADDRESS>wrote:
The mp4 file and all associated files (.srt) are in the mp4_automator folder, not the destination folder which should also be the source folder.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.

Autoprocess.ini
[MP4]
ffmpeg = /usr/bin/ffmpeg
ffprobe = /usr/bin/ffprobe
threads = auto
output_directory =
copy_to =
move_to =
output_extension = mp4
output_format = mp4
delete_original = True
relocate_moov = True
video-codec = h264,x264
video-bitrate =
video-crf =
video-max-width =
h264-max-level =
use-qsv-decoder-with-encoder = True
ios-audio = True
ios-first-track-only = False
ios-audio-filter =
max-audio-channels =
audio-codec = ac3
audio-language =
audio-default-language =
audio-channel-bitrate = 256
audio-filter =
subtitle-codec = mov_text
subtitle-language = eng
subtitle-default-language =
subtitle-encoding =
fullpathguess = True
convert-mp4 = True
tagfile = True
tag-language = en
download-artwork = Poster
download-subs = True
embed-subs = False
sub-providers = addic7ed,podnapisi,thesubdb,opensubtitles
permissions = 0777
post-process = False
pix-fmt =
aac_adtstoasc = False
postopts =
preopts =
info.log
2017-05-30 12:40:39 - NZBGetPostProcess - INFO - Reading video stream.
2017-05-30 12:40:39 - NZBGetPostProcess - INFO - Video codec detected: h264.
2017-05-30 12:40:39 - NZBGetPostProcess - INFO - Pix Fmt: yuv420p.
2017-05-30 12:40:39 - NZBGetPostProcess - INFO - Reading audio streams.
2017-05-30 12:40:39 - NZBGetPostProcess - INFO - No audio streams detected in any appropriate language, relaxing restrictions so there will be some audio stream present.
2017-05-30 12:40:39 - NZBGetPostProcess - INFO - Audio detected for stream #1: ac3 [eng].
2017-05-30 12:40:39 - NZBGetPostProcess - INFO - Creating audio stream 0 from source audio stream 1 [iOS-audio].
2017-05-30 12:40:39 - NZBGetPostProcess - INFO - Audio track is number 0 setting disposition to default
2017-05-30 12:40:39 - NZBGetPostProcess - INFO - Creating audio stream 1 from source stream 1.
2017-05-30 12:40:39 - NZBGetPostProcess - INFO - Audio Track is number 1 setting disposition to none
2017-05-30 12:40:39 - NZBGetPostProcess - INFO - Reading subtitle streams.
2017-05-30 12:40:39 - NZBGetPostProcess - INFO - Subtitle detected for stream #2: subrip [eng].
2017-05-30 12:40:39 - NZBGetPostProcess - INFO - Ripping eng subtitle from source stream 2 into external file.
2017-05-30 12:40:41 - NZBGetPostProcess - INFO - /downloads/mp4_automator/house.of.cards.2013.s05e08.720p.webrip.x264-morose.eng.srt created.
2017-05-30 12:40:41 - NZBGetPostProcess - INFO - Starting conversion.
2017-05-30 12:48:01 - NZBGetPostProcess - INFO - /downloads/mp4_automator/house.of.cards.2013.s05e08.720p.webrip.x264-morose.mp4 created.
2017-05-30 12:48:02 - NZBGetPostProcess - INFO - Successfully processed /downloads/NZBGet/completed/sonarr/House.of.Cards.2013.S05E08.720p.WEBRip.x264-MOROSE/house.of.cards.2013.s05e08.720p.webrip.x264-morose.mkv.
2017-05-30 12:48:02 - autoprocess.sonarr - INFO - [INFO] Sonarr notifier started.
2017-05-30 12:48:02 - autoprocess.sonarr - INFO - [INFO] Requesting Sonarr to scan directory '/downloads/mp4_automator/'.
2017-05-30 12:48:02 - autoprocess.sonarr - INFO - [INFO] Sonarr response: started.
2017-05-30 12:56:11 - NZBGetPostProcess - INFO - Script triggered from NZBGet (11.0 or later).
2017-05-30 12:56:11 - readSettings - INFO - /usr/bin/python
2017-05-30 12:56:11 - readSettings - ERROR - Subliminal is not installed, automatically downloading of subs has been disabled.
Traceback (most recent call last):
File "/downloads/mp4_automator/readSettings.py", line 294, in init
import subliminal
File "/usr/lib/python2.7/site-packages/subliminal/init.py", line 10, in
from .api import (ProviderPool, check_video, provider_manager, download_best_subtitles, download_subtitles,
File "/usr/lib/python2.7/site-packages/subliminal/api.py", line 13, in
from .subtitle import compute_score, get_subtitle_path
File "/usr/lib/python2.7/site-packages/subliminal/subtitle.py", line 7, in
from guessit.matchtree import MatchTree
File "/usr/lib/python2.7/site-packages/guessit/init.py", line 99, in
from guessit.plugins import transformers
File "/usr/lib/python2.7/site-packages/guessit/plugins/transformers.py", line 222, in
reload()
File "/usr/lib/python2.7/site-packages/guessit/plugins/transformers.py", line 220, in reload
reload_options(all_transformers())
File "/usr/lib/python2.7/site-packages/guessit/plugins/transformers.py", line 179, in all_transformers
return _extensions.objects()
File "/usr/lib/python2.7/site-packages/guessit/plugins/transformers.py", line 111, in objects
return self.map(self._get_obj)
File "/usr/lib/python2.7/site-packages/stevedore/extension.py", line 252, in map
raise NoMatches('No %s extensions found' % self.namespace)
NoMatches: No guessit.transformer extensions found
2017-05-30 12:56:11 - readSettings - WARNING - Invalid external subtitle codec mov_text, ignoring.
2017-05-30 12:56:11 - readSettings - WARNING - No valid subtitle formats found, defaulting to 'srt'.
2017-05-30 12:56:11 - NZBGetPostProcess - INFO - Reading video stream.
2017-05-30 12:56:11 - NZBGetPostProcess - INFO - Video codec detected: h264.
2017-05-30 12:56:11 - NZBGetPostProcess - INFO - Pix Fmt: yuv420p.
2017-05-30 12:56:11 - NZBGetPostProcess - INFO - Reading audio streams.
2017-05-30 12:56:11 - NZBGetPostProcess - INFO - No audio streams detected in any appropriate language, relaxing restrictions so there will be some audio stream present.
2017-05-30 12:56:11 - NZBGetPostProcess - INFO - Audio detected for stream #1: ac3 [eng].
2017-05-30 12:56:11 - NZBGetPostProcess - INFO - Creating audio stream 0 from source audio stream 1 [iOS-audio].
2017-05-30 12:56:11 - NZBGetPostProcess - INFO - Audio track is number 0 setting disposition to default
2017-05-30 12:56:11 - NZBGetPostProcess - INFO - Creating audio stream 1 from source stream 1.
2017-05-30 12:56:11 - NZBGetPostProcess - INFO - Audio Track is number 1 setting disposition to none
2017-05-30 12:56:11 - NZBGetPostProcess - INFO - Reading subtitle streams.
2017-05-30 12:56:11 - NZBGetPostProcess - INFO - Subtitle detected for stream #2: subrip [eng].
2017-05-30 12:56:11 - NZBGetPostProcess - INFO - Ripping eng subtitle from source stream 2 into external file.
2017-05-30 12:56:13 - NZBGetPostProcess - INFO - /downloads/mp4_automator/house.of.cards.2013.s05e09.720p.webrip.x264-morose.eng.srt created.
2017-05-30 12:56:13 - NZBGetPostProcess - INFO - Starting conversion.
2017-05-30 13:04:54 - NZBGetPostProcess - INFO - /downloads/mp4_automator/house.of.cards.2013.s05e09.720p.webrip.x264-morose.mp4 created.
2017-05-30 13:04:54 - NZBGetPostProcess - INFO - Successfully processed /downloads/NZBGet/completed/sonarr/House.of.Cards.2013.S05E09.720p.WEBRip.x264-MOROSE/house.of.cards.2013.s05e09.720p.webrip.x264-morose.mkv.
2017-05-30 13:04:54 - autoprocess.sonarr - INFO - [INFO] Sonarr notifier started.
2017-05-30 13:04:54 - autoprocess.sonarr - INFO - [INFO] Requesting Sonarr to scan directory '/downloads/mp4_automator/'.
2017-05-30 13:04:55 - autoprocess.sonarr - INFO - [INFO] Sonarr response: queued.
2017-05-30 13:10:16 - NZBGetPostProcess - INFO - Script triggered from NZBGet (11.0 or later).
2017-05-30 13:10:16 - readSettings - INFO - /usr/bin/python
2017-05-30 13:10:16 - readSettings - ERROR - Subliminal is not installed, automatically downloading of subs has been disabled.
Traceback (most recent call last):
File "/downloads/mp4_automator/readSettings.py", line 294, in init
import subliminal
File "/usr/lib/python2.7/site-packages/subliminal/init.py", line 10, in
from .api import (ProviderPool, check_video, provider_manager, download_best_subtitles, download_subtitles,
File "/usr/lib/python2.7/site-packages/subliminal/api.py", line 13, in
from .subtitle import compute_score, get_subtitle_path
File "/usr/lib/python2.7/site-packages/subliminal/subtitle.py", line 7, in
from guessit.matchtree import MatchTree
File "/usr/lib/python2.7/site-packages/guessit/init.py", line 99, in
from guessit.plugins import transformers
File "/usr/lib/python2.7/site-packages/guessit/plugins/transformers.py", line 222, in
reload()
File "/usr/lib/python2.7/site-packages/guessit/plugins/transformers.py", line 220, in reload
reload_options(all_transformers())
File "/usr/lib/python2.7/site-packages/guessit/plugins/transformers.py", line 179, in all_transformers
return _extensions.objects()
File "/usr/lib/python2.7/site-packages/guessit/plugins/transformers.py", line 111, in objects
return self.map(self._get_obj)
File "/usr/lib/python2.7/site-packages/stevedore/extension.py", line 252, in map
raise NoMatches('No %s extensions found' % self.namespace)
NoMatches: No guessit.transformer extensions found
2017-05-30 13:10:16 - readSettings - WARNING - Invalid external subtitle codec mov_text, ignoring.
2017-05-30 13:10:16 - readSettings - WARNING - No valid subtitle formats found, defaulting to 'srt'.
2017-05-30 13:10:16 - NZBGetPostProcess - INFO - Reading video stream.
2017-05-30 13:10:16 - NZBGetPostProcess - INFO - Video codec detected: h264.
2017-05-30 13:10:16 - NZBGetPostProcess - INFO - Pix Fmt: yuv420p.
2017-05-30 13:10:16 - NZBGetPostProcess - INFO - Reading audio streams.
2017-05-30 13:10:16 - NZBGetPostProcess - INFO - No audio streams detected in any appropriate language, relaxing restrictions so there will be some audio stream present.
2017-05-30 13:10:16 - NZBGetPostProcess - INFO - Audio detected for stream #1: ac3 [eng].
2017-05-30 13:10:16 - NZBGetPostProcess - INFO - Creating audio stream 0 from source audio stream 1 [iOS-audio].
2017-05-30 13:10:16 - NZBGetPostProcess - INFO - Audio track is number 0 setting disposition to default
2017-05-30 13:10:16 - NZBGetPostProcess - INFO - Creating audio stream 1 from source stream 1.
2017-05-30 13:10:16 - NZBGetPostProcess - INFO - Audio Track is number 1 setting disposition to none
2017-05-30 13:10:16 - NZBGetPostProcess - INFO - Reading subtitle streams.
2017-05-30 13:10:16 - NZBGetPostProcess - INFO - Subtitle detected for stream #2: subrip [eng].
2017-05-30 13:10:16 - NZBGetPostProcess - INFO - Ripping eng subtitle from source stream 2 into external file.
2017-05-30 13:10:17 - NZBGetPostProcess - INFO - /downloads/mp4_automator/house.of.cards.2013.s05e10.720p.webrip.x264-morose.eng.srt created.
2017-05-30 13:10:17 - NZBGetPostProcess - INFO - Starting conversion.
2017-05-30 13:18:45 - NZBGetPostProcess - INFO - /downloads/mp4_automator/house.of.cards.2013.s05e10.720p.webrip.x264-morose.mp4 created.
2017-05-30 13:18:45 - NZBGetPostProcess - INFO - Successfully processed /downloads/NZBGet/completed/sonarr/House.of.Cards.2013.S05E10.720p.WEBRip.x264-MOROSE/house.of.cards.2013.s05e10.720p.webrip.x264-morose.mkv.
2017-05-30 13:18:45 - autoprocess.sonarr - INFO - [INFO] Sonarr notifier started.
2017-05-30 13:18:45 - autoprocess.sonarr - INFO - [INFO] Requesting Sonarr to scan directory '/downloads/mp4_automator/'.
2017-05-30 13:18:45 - autoprocess.sonarr - INFO - [INFO] Sonarr response: queued.

So what is the cause or do you need additional information?

Do you accidentally have the output_dir set in your NZBGetPostProcess settings set to the script directory?


Issue/#39/eviction warning scrooge core

See #39

@RayRoestenburg you might want to check out this and other changes in the CDH5_new_deps branch (https://github.com/CommBank/uniform/tree/CDH5_new_deps), which I hope to merge into master soon.

Oh, and :+1:

Cool thanks, didn't notice the branch, looks like a really nice cleanup! (this is just a quick fix for an annoying warning I wanted to get out of the way ;-)

I don't understand why it fails on 'push' and not on 'pr' though, is that normal? (not too familiar with the setup), looking forward to the full cleanup in https://github.com/CommBank/uniform/tree/CDH5_new_deps which also includes this change. Close this and wait for new deps, or merge?

I'm entirely happy for you to merge this now. Dealing with the conflict will add approximately 5 seconds to my workload when I go to merge my changes with master, which is completely insignificant in the grand scheme of things. :smile:
Re: the failure, my initial guess is that the # in your branch name is confusing the script, as the majority of the "unique" part of the url name is now a fragment identifier. Maybe try changing the branch name to something without any special symbols and redoing the PR? Just a guess ...

Closing this pull request to test Sam's guess about the # in the branch name


Incorrect link for the "Inline code" connector

The link of the "Inline code" connector is incorrect.
The link now is https://docs.microsoft.com/en-us/azure/logic-apps/logic-apps-azure-functions, which is actually for the "Azure functions" connector.
The correct link should be https://docs.microsoft.com/en-us/azure/logic-apps/logic-apps-add-run-inline-code

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 283ea333-d9a1-50c6-581c-753131c88f5a
Version Independent ID: 45207a34-a98b-8214-3364-61a62fbada4a
Content: Connectors for Azure Logic Apps - Azure Logic Apps
Content Source: articles/connectors/apis-list.md
Service: logic-apps
GitHub Login: @ecfan
Microsoft Alias: estfan

Hi @charleschenzheng Thanks for your feedback. We will review and update as appropriate.

This issue is now fixed and live.
@DixitArora-MSFT: #please-close


Store yarn.lock in git without publishing to npm

Summary
Fixes #3272.
cc: @bestander

Codecov Report

Merging #3357 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #3357   +/-   ##
=======================================
  Coverage   64.93%   64.93%
=======================================
  Files         176      176
  Lines        6514     6514
  Branches        4        4
=======================================
  Hits         4230     4230
  Misses       2283     2283
  Partials        1        1

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a9288e4...446214b. Read the comment docs.

Why does it matter if it's published or not?
One issue I've noticed with keeping the lockfile around is that if you then is in e.g.babel-cliand do yarn add something, it might fail because it won't find the other deps in the repo that yarn has linked in. So I ended up doing either npm install or manually editing package.json, then run yarn from root.

According to this article it doesn't matter, they're ignored anyway, but we ship less files to npm.
Lockfiles are around in Jest packages regardless if they're gitignored or not. Have you tried to file an issue in their GitHub on that?

The problem is from Lerna's side I think, not yarn. But as they're merging maybe they've worked out the kinks 😄

fantastic!


Add powershell version of the Grant AKS access to ACR script

Currently there's just a bash script. A working Powershell port is below. It would be good if this was added to the page ...
$AKS_RESOURCE_GROUP='<myAKSResourceGroup>'
$AKS_CLUSTER_NAME='<myAKSCluster>'
$ACR_RESOURCE_GROUP='<myACRResourceGroup>'
$ACR_NAME='<myACRRegistry>'

# Get the id of the service principal configured for AKS
$CLIENT_ID = az aks show --resource-group $AKS_RESOURCE_GROUP --name $AKS_CLUSTER_NAME --query "servicePrincipalProfile.clientId" --output tsv

# Get the ACR registry resource id
$ACR_ID = az acr show --name $ACR_NAME --resource-group $ACR_RESOURCE_GROUP --query "id" --output tsv

# Create role assignment
az role assignment create --assignee $CLIENT_ID --role Reader --scope $ACR_ID

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: ed59d472-ac33-5c03-dbb7-0e86e88c7dd8
Version Independent ID: 69e1ad8c-2dd3-cc1b-2b31-996a5d866cc0
Content: Authenticate with Azure Container Registry from Azure Kubernetes Service
Content Source: articles/container-registry/container-registry-auth-aks.md
Service: container-service
GitHub Login: @iainfoulds
Microsoft Alias: iainfou

Hi, @dracan. Thanks for reaching out. Right now, the main use of AKS and the Azure CLI is from a *nix platform, so the docs are lined up accordingly. The examples shown in the docs should work in a PowerShell shell by adding in the dollar sign to variable names, as you suggest here. In other docs, we've intentionally tried to avoid the use of parameters so as to avoid this problem, but that's not always ideal either.
There are doc platform updates in the works that allow easier switching of the samples between a Bash shell and a PowerShell shell so that both samples can be shown, but for now, the focus is on the Bash experience.
I'll follow up with out docs engineering team on timeline for being able to show both Bash and PowerShell examples in the same doc, but for now #please-close


Call User autocmd event to custom the window

I want to set options such as winblend and winhl for the window. It calls FTermOpen event with this.
autocmd User FTermOpen set winblend=10

I am more in favour of exposing winhl and winblend as a config option rather than autocommand. Thoughts?

It should be good. But this autocmd event is also useful to do any other settings when FTerm is opened, such as mappings, other window-level options, other autocmd, and so on.
For another suggestion, floaterm sets its own filetype for the term. We can use it as the same purpose. It can be also good.
autocmd FileType Floaterm set winblend=10


Fixes a few memory leaks

Fixes #196
(Needs testing)

@Pandapip1 does it work?

I need to check. I believe so.

Yea I believe it works. The CI seems to have broke, so I'll just re-trigger it.

Never mind, the CI is just broken.

lgtm, merging, thanks


Document guidelines for using EF Core with trimming or NativeAOT

Depending on where we end up, this may just be "disable it", or a set of coding guidelines to make things work well when trimming is enabled.

Using a compiled model with precompiled queries is recommended for trimming and required for NativeAOT.


i18n: Updates for missing translations for Ukrainian and Russian. Also, a minor correction for English

I've a question: is there any character limit? I think it would be better to use more detailed explanations. Therefore, I made some changes to the English translation.
If for any reason this isn't acceptable to you, please reject this pull request.

Thanks! No there is no character limit.
For a bit more context: Here is the new UI of the "Receive" tab. When "Favorites" is selected, the dialog with the warning is shown. So the last part by enabling the "Automatically accept requests" option. is a bit confusing here. Also: Maybe "restriction" is a better (simpler) word than "hindrance".


enable io binding for outputs

This PR enables io-binding for outputs.

@tanmayv25  and @GuanLuo, please review for 22.02.
@askhade I will start a CI with this change.

Looks good to me. @askhade  just update the copyright year at the top.


Fix rendering error on 64 bit IIS, ColorBlend position must be betwee…

#224

thanks!

@tebjan are there any plans to include this fix in a nuget package?


remove icon issue while using antd@4

remove icon will not be shown while using antd@4, any clue to fix it?
Thanks

updated on version 0.3.6

updated on version 0.3.6


Please add @estudante.sc.senai.br domain

Official website URL: https://sc.senai.br
My university is using old domains for students that already did a course long ago (which is my case), this old domain is not being accepted to get the licence for the ultimate version of InteliJ, only the new one is, the problem is that they can't update my student e-mail to the new domain. Please add the domain in the commit message so I can get the students licence as well. Thank you!

@vXultz I have to close this request without merging, because you requested to add a non-existent domain to this repository: Host scsenai.estudante.senai.br not found: 3(NXDOMAIN) Please ensure that you are familiar with this repository rules located at the bottom of this page and submit a new request with the correct information. Thank you for your understanding!


[RRIO] [Call] Implement PTransform without adaptive throttling

This PR addresses #28711 by implementing the Call PTransform that executes user custom code.

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

[x] Mention the appropriate issue in your description (for example: addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment fixes #<ISSUE NUMBER> instead.
[ ] Update CHANGES.md with noteworthy changes.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.
To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md
GitHub Actions Tests Status (on master branch)

See CI.md for more information about GitHub Actions CI or the workflows README to see a list of phrases to trigger workflows.

Thanks. LGTM.

Thank you @chamikaramj for your help and insight with this. It still shows you are requesting changes and wanted to make sure all was well before Squash/Merge.


Is there a way to get Syntastic working without saving the file.

Hi,
I have just installed Syntastic on MacVim and configured it to work with pyflakes. All critical config is in my .vimrc file, so the plugin works. However, I would like to be able to invoke the plugin check and the error display functions without saving the file. Well I did things like:
map   :w:Errors
imap   :w:Errors
Which are supposed to make the process seamless, but still this is saving the file. Is there a way to get this working without actually saving the changes to the file. I thought the passive mode is designed for this?
map  :w:SyntasticToggleMode
imap  :w:SyntasticToggleMode
So by switching the PASSIVE mode ON, I should be able to run the ":SyntasticCheck" and the ":Errors" manually, right? However that seems not to be able to update the results on the fly. The error reports and the signs are still there even after the mistakes are corrected. However once I run ":w", it all works again.
Any ideas? Thanks.

I think why @symbolix asks for that, or at least why i would like this to be possible; is in a Javascript environment. Popular Javascript build systems, like Grunt, often listen for file modifications, then automatically rebuild. When a build fails, because of a syntax error, such build process often exits. So to keep the build process running, you definitely want to know about syntax errors before you save the file. Therefore it would be very useful if Syntastic could check the buffer, not the file, automatically, after a few idle seconds...

@guilala Sorry, syntastic can't do this.
At some point I made an experiment in that direction, and nobody cared (cf. #1351).  Reviving it would be easy, but that approach would only work for the (few) languages for which Vim has embedded interpreters: Perl, Python, Ruby, Lua, and perhaps TCL and MzScheme.  Extending it to JavaScript wouldn't be possible without a major re-design of syntastic, and would only work with major limitations.  Not going to happen, sorry.

@lcd047 I would really appreciate this behavior. Often, syntax errors depend on each other, so I have to save & re-check after fixing each error. How about automatically writing the buffer to a temporary file outside of the source tree and linting that?

@danijar Nope: many linters run checks against the full project rather than against a single file.

Hi, you may wanna try vim-auto-save ; it works for me on this need.

get the vim, syntactic, pylint ready to go
install Vundle to vim
add Plugin '907th/vim-auto-save' between the call vundle#begin() and call vundle#end()  lines in .vimrc
run vim +PluginInstall +qall  in command line
add let g:auto_save = 1 to .vimrc, to enable the AutoSave on Vim startup
open a python in Vim and set :AutoSave on to test

I think it's a little strange that you say syntastic "can't do this". It seems like there should be any number of fairly straightforward solutions to the problem: e.g. save the file to a temporary directory, and run linting on that temporary directory.

@haberdashPI Did you read the thread above?

save the file to a temporary directory, and run linting on that temporary directory.

What file?  As I said, many linters run checks against the full project rather than against a single file.  You may try copying the entire project locally, but Vim has no concept of project.
But even if the actual checks are against a single file, that doesn't mean there is a single file involved.  Consider f.i. #include <foo.h> in C.  The file foo.h may not even be part of the project.
Sadly, a solution that save files locally to check them would be half-assed at best. shrug


Enabling hardware.sane.dsseries.enable prompts for wrong package name for unfree predicate

Describe the bug
Enabling hardware.sane.dsseries.enable without allowing unfree packages causes the following error:
error:
       … while evaluating attribute 'nodes'

         at «string»:4:25:

            3|                       (deploy // {
            4|                         nodes = {
             |                         ^
            5|                           inherit (deploy.nodes) "host";

       … while evaluating attribute 'host'

         at «string»:5:49:

            4|                         nodes = {
            5|                           inherit (deploy.nodes) "host";
             |                                                 ^
            6|                         };

       (stack trace truncated; use '--show-trace' to show the full trace)

       error: Package ‘libsane-dsseries-1.0.5-1’ in /nix/store/450afzqlzzgw6wnyc3dwysf3i5yxyqkr-source/pkgs/applications/graphics/sane/backends/dsseries/default.nix:47 has an unfree license (‘unfree’), refusing to evaluate.

       a) To temporarily allow unfree packages, you can use an environment variable
          for a single invocation of the nix tools.

            $ export NIXPKGS_ALLOW_UNFREE=1

          Note: When using `nix shell`, `nix build`, `nix develop`, etc with a flake,
                then pass `--impure` in order to allow use of environment variables.

       b) For `nixos-rebuild` you can set
         { nixpkgs.config.allowUnfree = true; }
       in configuration.nix to override this.

       Alternatively you can configure a predicate to allow specific packages:
         { nixpkgs.config.allowUnfreePredicate = pkg: builtins.elem (lib.getName pkg) [
             "libsane-dsseries-1.0.5-1"
           ];
         }

       c) For `nix-env`, `nix-build`, `nix-shell` or any other Nix command you can add
         { allowUnfree = true; }
       to ~/.config/nixpkgs/config.nix.

The suggested fix for allowUnfreePredicate is wrong as it contains the version, where as only the package name should be used.
Steps To Reproduce
Steps to reproduce the behavior:

Set the option
Build it
See the error

Expected behavior
The error message should not contain the version
Metadata
Please run nix-shell -p nix-info --run "nix-info -m" and paste the result.
❯ nix-shell -p nix-info --run "nix-info -m"
 - system: `"x86_64-linux"`
 - host os: `Linux 6.6.25, NixOS, 24.05 (Uakari), 24.05.20240408.4cba8b5`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.18.2`
 - channels(neikos): `"home-manager"`
 - channels(root): `"nixos-21.11.337114.9887f024766"`
 - nixpkgs: `/nix/store/450afzqlzzgw6wnyc3dwysf3i5yxyqkr-source`

Add a :+1: reaction to issues you find important.

I think this is a broader issue with all unfree packages; you can see the same thing if you try to run nix shell nixpkgs#obsidian
It looks like the error message prints out the name attribute of the derivation, which is effectively ${pname}-${version}, but lib.getName only returns the ${pname} part.

The fix would be in pkgs/stdenv/generic/check-meta.nix.
It looks like the error message for permittedInsecurePackages is likely to be similarly incorrect.
The locally defined getName function returns, in order of preference: ${pkg.name}, then ${pkg.pname}-${pkg.version}:
https://github.com/NixOS/nixpkgs/blob/11486e15b5ae0e89b12efce6214fd4602ea4de49/pkgs/stdenv/generic/check-meta.nix#L49
But lib.getName functions differently, preferring ${pkg.pname} and falling back to builtins.parseDrvName which itself extracts the equivalent of pname
https://github.com/NixOS/nixpkgs/blob/e53c564e26256144addbb7ee40d2b695e1e4a8eb/lib/strings.nix#L729-L734

Hm. allowInsecureDefaultPredicate uses the local getName, so config.permittedInsecurePackages should include the version, and the error message there is correct.
I suspect it'd be enough to change templated remediate_predicate string as:
diff --git a/pkgs/stdenv/generic/check-meta.nix b/pkgs/stdenv/generic/check-meta.nix
index bcb2ca249..a61f3e1ae 100644
--- a/pkgs/stdenv/generic/check-meta.nix
+++ b/pkgs/stdenv/generic/check-meta.nix
@@ -189,7 +189,7 @@ let

       Alternatively you can configure a predicate to allow specific packages:
         { nixpkgs.config.${predicateConfigAttr} = pkg: builtins.elem (lib.getName pkg) [
-            "${getName attrs}"
+            "${lib.getName attrs}"
           ];
         }
     '';

For insecure packages, the version is correct, and should also stay there since only some are insecure (hopefully). But for unfree packages, they rarely change between versions. So that seems fair to not have to update the version on every upgrade.

Yeah, that seems right. PR incoming.


rewrite in Go or in Rust

Go version could be easily implemented just by forking from https://github.com/opencontainers/runc/tree/v1.1.0/contrib/cmd/seccompagent

@AkihiroSuda hey, some questions to understand how an agent for this will look like.
The current code handles the connect(2) syscall and it basically creates a new socket identical to the one used and allows the application to continue. So, the agent will probably have to do just that, right? That is quite trivial to implement, indeed (just need to define the addfd thingy in C, as the go bindings don't have that yet).
However, some other questions to make sure I'm not missing something:

This will break if the container connects to anything in <IP_ADDRESS>, right? (typically used for some other container in this pod)
The seccomp agent runs in the host network namespace, so in a way the container is using something similar to hostNetwork (with some "filtering" to disallow connections to 127.0 and such). What is the advantage of this over using hostNetwork exactly? Can we use hostNetwork with rootless or it doesn't work?
Will the container be able to handle incoming connection (let's say it is an nginx server)? I'm not sure I see how those connections will be routed to the container, is there an IP allocated and routed? Is that connection over slow slirp or how does it work (in rootless scenarios)?

What is the advantage of this over using hostNetwork exactly?

hostNetwork is insecure because it allows containers to connect to host abstract sockets (dbus, ibus, X11,...) and host loopback addresses.
I wrote a blog about this issue. https://medium.com/nttlabs/dont-use-host-network-namespace-f548aeeef575

Can we use hostNetwork with rootless or it doesn't work?

Rootless Podman supports hostNetwork but it is insecure as explained above.
Rootless Docker and Rootless containerd do not support hostNetwork because dockerd and containerd are already executed inside netns (for ease of implementation).

Wouldn't some restrictions be ineffective as the agent creates a socket in the host network that later passes? Maybe traffic shaping, or things like that won't be effective?

Yes, and the users will have to be aware of that.
Perhaps, docker/podman/nerdctl should execute bypass4netns in the container's cgroup to enforce cgroup-scoped limitations.

Will the container be able to handle incoming connection (let's say it is an nginx server)? I'm not sure I see how those connections will be routed to the container, is there an IP allocated and routed? Is that connection over slow slirp or how does it work (in rootless scenarios)?

More news to come, very soon
cc @naoki9911

What is the advantage of this over using hostNetwork exactly?

hostNetwork is insecure because it allows containers to connect to host abstract sockets (dbus, ibus, X11,...) and host loopback addresses. I wrote a blog about this issue. https://medium.com/nttlabs/dont-use-host-network-namespace-f548aeeef575

Oh, I had read that same blog post you wrote long ago. Good point, thanks! :)

Can we use hostNetwork with rootless or it doesn't work?

Rootless Podman supports hostNetwork but it is insecure as explained above.
Rootless Docker and Rootless containerd do not support hostNetwork because dockerd and containerd are already executed inside netns (for ease of implementation).

Ohh, good to know. Thanks!

Wouldn't some restrictions be ineffective as the agent creates a socket in the host network that later passes? Maybe traffic shaping, or things like that won't be effective?

Yes, and the users will have to be aware of that. Perhaps, docker/podman/nerdctl should execute bypass4netns in the container's cgroup to enforce cgroup-scoped limitations.

That seems interesting. I'm not sure we will be able to not bypass any restriction by doing so. I remember Eric Dumazet mentioned these limitations on some Linux Plumbers talk and my memory from that is that it wasn't obvious if doing what you suggest will be enough.

Will the container be able to handle incoming connection (let's say it is an nginx server)? I'm not sure I see how those connections will be routed to the container, is there an IP allocated and routed? Is that connection over slow slirp or how does it work (in rootless scenarios)?

More news to come, very soon
cc @naoki9911

haha, great! I assume for now the answer is that it can't receive incoming connections, right?
Also, now that I think about it, there are other limitations that come from doing this at connect(2) time. I think most can be solved if we handle socket(2) instead.
When we replace the fd at connect, it is already too late:

If the process added the fd to an epoll list (probably select and others fail too, but I've tested it in the past with epoll) then the new injected fd won't be used for that list. We found that some Java framework was using that pattern underneath, so it was not good for applications using it. The go runtime, with net.Dial and such, adds the fd to an epoll list just after running connect(2), so go apps were lucky.
If the fd is dup(), dup2() or whatever before the connect call, then dup() and friends won't have the expected effect
Probably any other fd specific operation that can be done before connect, if done, will fail/not behave as expected.

If we replace the socket at socket(2) time, not connect, none of the mentioned problems will happen. If you dup the socket, add it to epoll lists, etc. it will all just work.
To inject it at socket(2) time safely, though, we need to use SECCOMP_ADDFD_FLAG_SEND in the addfd call. I added that flag to the kernel due to a race condition you can easily hit otherwise: https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?h=v5.17-rc2&id=0ae71c7720e3ae3aabd2e8a072d27f7bd173d25c.
With connect, as we do today, that flag is not needed as we replace always the same fd, so we don't inadvertently leak fds. With socket, as we won't put any new_fd field (just using 0 will allocate a free socket safely, as if they were calling socket themselves, lowest free int, etc.), we need to use that flag to not have the race.
Also, today we only handle the connect syscall, so for UDP sockets this won't work (in case they are not using connect, that is quite common for UDP sockets. If the UDP socket is using connect, as they can and rarely do, it will work). Probably for other connection-less protocols this won't work either. But if we inject the socket at socket(2) time, it should work for UDP too, right? We will need to check the socket domain, family and all in the agent, of course. But should work IIUC. Am I missing something?
So, what do you think of rewriting this to use runc 1.1, a seccomp agent in golang (using the example agent as base, or https://github.com/kinvolk/seccompagent/) and handling the socket(2) syscall instead of connect?

@AkihiroSuda sorry, forgot to tag you! ^

haha, great! I assume for now the answer is that it can't receive incoming connections, right?

Now possible with #9 .  Thanks to @naoki9911 !

rewriting this to use runc 1.1, a seccomp agent in golang

Done in #9 .

handling the socket(2) syscall instead of connect?

How can we support accept() with that?

@AkihiroSuda  @naoki9911 cool!
@AkihiroSuda to support accept, I think we don't need to do anything. The container just runs accept...What is the issue with that?
I mean, if we inject the fd when the container calla socket(2), then the fd is an fd created from the host netns and accept will probably just work? Not sure if we might need to handle listen too, but I think accept would work. Wouldn't it?

The problem is that we want to accept from processes inside the netns, as well as processes outside the netns.
i.e., when we run nerdctl run -p 80:80 --name foo --net-opt bypass4netns nginx, the nginx should be accessible from the processes in the same container (foo) too.

Why accept process from inside the netns? If the process inside the container, when calling socket, returns a socket from the host netns, it will just work when it runs connect, right?


Storage class dependency of object size

https://github.com/kahing/goofys/blob/master/internal/backend_s3.go
In CopyBlob and in PutBlob there are conditions for storage class of objects less than 128*1024 or more.

Could you please explain the reason of that?
Is it save to reduce it to 128 bytes or less?

IIUC, With STANDARD_IA, files smaller than 128KB will be charged as if they are 128KB.
See https://github.com/kahing/goofys/pull/255

Looks like it's AWS specific.
Thanks!


chore: benchmark new compiler

!bench

Looks good

Does this measure the same thing as the old metric?  From what I can tell the old one includes IR compilation as well.

Correct, it only measures the parts that are already there, so the two numbers should not be compared directly without keeping that in mind

Remarks:

The new code generator is re-type-checking the code after each pass. This is useful for debugging, but we will not enable these checks by default in the future.

The most expensive passes are already in the new code generator: simp and specialize.


As a WHO employee we are responsible to create reports of All Capital Cities in the World

All the capital cities in the world organised by largest population to smallest.
All the capital cities in a continent organised by largest population to smallest.
All the capital cities in a region organised by largest to smallest.
The top N populated capital cities in the world where N is provided by the user.
The top N populated capital cities in a continent where N is provided by the user.
The top N populated capital cities in a region where N is provided by the user.

Subtasks:

Write SQL query to retrieve all capital cities.

Organize capital cities by population (largest to smallest).

Integrate the query into the report system.


没有中文版

没有中文版，阅读不方便

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 434e640f-ea90-3c49-9510-1fda8cbee7a1
Version Independent ID: 9c5af71d-7980-d644-b2bc-9b54bda5e551
Content: Vectors and matrices in quantum computing - Microsoft Quantum
Content Source: articles/concepts/vectors-and-matrices.md
Product: quantum
GitHub Login: @QuantumWriter
Microsoft Alias<EMAIL_ADDRESS>

Thanks for submitting the feedback! My apologies for having to resort to Google Translate, but the translation came out as "No Chinese version, not easy (/inconvenient) to read". From that, I can guess that you bumped into one of two issues:

you've found yourself on the English page specifically (the more likely scenario, seeing as the issue was added via the en-us page URL). In this case, you can change to a Chinese version by either:

scrolling to the bottom of the page, clicking the globe icon 🌐 where it says "English (United States)", and selecting the new language
simply changing the en-us in the URL to zh-cn, zh-tw, or zh-hk ("simplified", "traditional", "Hong Kong").

the issue is in some of the LaTeX rendering of matrices and math symbols on the page. Unfortunately this is an issue that we've seen on other non-English pages as well, and is not something our US docs team is able to currently take on. However, you could then submit the issue to the GitHub repo for the Chinese page: https://github.com/MicrosoftDocs/quantum-docs-pr.zh-CN/issues.

I apologize again for any inconvenience (or potential mis-translation) if you have to send all this through a translator as I did, but I hope I was able to help! Thanks again for the feedback, and we hope your time with Q# is off to a good start!


rotation can't rotate with 1/8 circle (45 degrees)

Hello,
I have a rotation problem .
Here is my code
https://jsfiddle.net/supermrji/mzupmrj6/1/
Set rotation to +=0.125 seems can't  rotate exact degrees .
Does any method can do this thing ?
And does it provide any event to track degrees ?

If you you radians values, it works:
var arc = Math.PI * 2 * 0.125;

Thanks a lot .
It works !!!


Support Multiple tokens in Valora

Product Requirements Document: https://www.notion.so/valora-inc/PRD-Support-for-multiple-tokens-in-Valora-9d6eca94b0844b948777325caeff194f
Designs: https://www.figma.com/file/8USELhisKuP1YlCt95WrD2/Balances-on-the-Home-Screen?node-id=0%3A1

@kathaypacific can this epic be closed out? it seems like all the work is completed

Yes! the only thing left i can think of is removing the remote config flag for the old transaction feed (there was a big refactor of the home feed and there is still a lot of old code for the feed that doesn't support multi tokens) - i'll create a separate issue for that


SPIKE Attribute based access control for the APIs

Basic Information
Currently, implementing a way to retrieve only a sufficient amount of data for a given user role in an API will result in a lot of code duplication and unmaintainable code.
For example, both the client and repairer should be able to access the /api/repair-request endpoint. However, a client should only get back repair requests that were created by them and a repairer should only receive repair requests that are assigned to them.
There are three different ways to implement this?

Create a separate endpoint for each user role, /api/repairer/repair-requests  and /api/client/repair-requests. But might potentially be unmaintainable and a bunch of code that is similar but slightly different.
All user roles share an endpoint but different queries to the database based on their roles (if or switch case). This will lead to similar issues faced above and a bunch of IF statements everywhere.
All user roles share an endpoint but we use something like Zenstack to filter the queries retrieved from the database based on the user role by creating "policies" on how the data should be retrieved or mutated based on an attribute. Least amount of code duplication as far as I can tell but an additional learning curve?

Policies that we will have to implement (There are still more)

A client can only view, update, and delete their own repair requests.
A repairer can only view and update repair requests assigned to them.
An event manager can only update and delete events from their own organisation but can view all events.
An admin can do everything.

https://docs.google.com/spreadsheets/d/18AxrBPgUUgtK0lcNLxSUmxFfxQERglB_L3c7OL6s9DE/edit?usp=sharing
As discussed with @justinliangg considering the amount of endpoints that have complex permissions I think this is achievable without zenstack


Steeltoe.Management.EndpointAutofac is named poorly

This package is extensions for using the EndpointOwin package with Autofac
Proposed new name: Steeltoe.Management.EndpointOwin.Autofac

This package name should be Steeltoe.Management.EndpointOwinAutofac to better align with the others


[Bug]: Virtual mocks created with jest.unstable_mockModule do not work outside of the test file

Version
29.7.0, also tested on 30.0.0-alpha.6
Steps to reproduce

Clone https://github.com/ygrandgirard/jest-esm-mock-repro
Run npm install
Run npm test

Expected behavior
Both tests should pass.
Actual behavior

The first test passes, so importing a virtual ESM module works within the test file itself.
The second test fails, so importing a virtual ESM module does not work outside of said test file (e.g. in the source file).

Additional context
The error apparently comes from here (perhaps this could cause issues too, I am not sure) because the mock is checked against this._virtualMocks instead of this._virtualModuleMocks. Checking against the correct map fixes my issue.
I could open a PR with one or both changes if you think it is that simple. To me, it looked like this part of the code is used with ESM mocks only, but I did not get too deep in it and I may be wrong.
Environment
System:
    OS: Windows 11 10.0.22631
    CPU: (16) x64 AMD Ryzen 7 5800H with Radeon Graphics
  Binaries:
    Node: 20.16.0 - C:\Program Files\nodejs\node.EXE
    npm: 10.8.1 - C:\Program Files\nodejs\npm.CMD
  npmPackages:
    jest: ^29.7.0 => 29.7.0

Up
My current way around this is to modify the jest module with patch-package in a npm postinstall script. It gets the job done but it is really annoying to have to do this extra work for mocking to work in ESM environments!
Below are the changes I needed to make it work. As I said before, if you think these are okay I can post a PR with them.
--- a/packages/jest-environment/src/index.ts
+++ b/packages/jest-environment/src/index.ts
@@ -386,6 +386,12 @@ export declare interface Jest {
    * real module).
    */
   unmock(moduleName: string): Jest;
+  /**
+   * Indicates that the module system should never return a mocked version of
+   * the specified module from `import()` (e.g. that it should always
+   * return the real module).
+   */
+  unstable_unmockModule(moduleName: string): Jest;
   /**
    * Instructs Jest to use fake versions of the global date, performance,
    * time and timer APIs. Fake timers implementation is backed by

--- a/packages/jest-runtime/src/index.ts
+++ b/packages/jest-runtime/src/index.ts
@@ -1973,7 +1973,7 @@ class Runtime {
     const options: ResolveModuleConfig = {conditions: this.esmConditions};
     const moduleID = await this._resolver.getModuleIDAsync(
-      this._virtualMocks,
+      this._virtualModuleMocks,
       from,
       moduleName,
       options,
@@ -2019,7 +2019,7 @@ class Runtime {

     // transitive unmocking for package managers that store flat packages (npm3)
     const currentModuleID = await this._resolver.getModuleIDAsync(
-      this._virtualMocks,
+      this._virtualModuleMocks,
       from,
       undefined,
       options,
@@ -2116,6 +2116,16 @@ class Runtime {
       this._explicitShouldMock.set(moduleID, false);
       return jestObject;
     };
+    const unmockModule = (moduleName: string) => {
+      const moduleID = this._resolver.getModuleID(
+          this._virtualModuleMocks,
+          from,
+          moduleName,
+          { conditions: this.esmConditions },
+      );
+      this._explicitShouldMockModule.set(moduleID, false);
+      return jestObject;
+    };
     const deepUnmock = (moduleName: string) => {
       const moduleID = this._resolver.getModuleID(
         this._virtualMocks,
@@ -2395,6 +2405,7 @@ class Runtime {
       spyOn,
       unmock,
       unstable_mockModule: mockModule,
+      unstable_unmockModule: unmockModule,
       useFakeTimers,
       useRealTimers,
     };

Bump


Convert html to plaintext in mutt

Use something like links -dump or html2text so that html emails are readable.

0b43da7e64cb107e3ab702264e12705f474dee7f


SpaceCraftFile refactor for orbital info breaks 511keV-DC2-ScAtt-DataReduction notebook

The recent refactor of SpaceCraftFile to support orientation files with orbital information makes the default orientation file in 511keV-DC2-ScAtt-DataReduction.ipynb un-parsable. This is because this line in the new SpaceCraftFile.parse_from_file() implies the source file has orbital info.
Potential fixes

Change the suggested orientation file to be 20280301_3_month_with_orbital_info.ori instead of 20280301_3_month.ori in the Jupyter Notebook.
Continue to support parsing files that do not have orbital information.

Trace of Error
File /project/cassini/cosi/cosipy/cosipy/spacecraftfile/SpacecraftFile.py:134, in SpacecraftFile.parse_from_file(cls, file)
    117 @classmethod
    118 def parse_from_file(cls, file):
    120     """
    121     Parses timestamps, axis positions from file and returns to __init__.
    122
   (...)
    131         The SpacecraftFile object.
    132     """
--> 134     orientation_file = np.loadtxt(file, usecols=(1, 2, 3, 4, 5, 6, 7, 8),delimiter=' ', skiprows=1, comments=("#", "EN"))
    135     time_stamps = orientation_file[:, 0]
    136     axis_1 = orientation_file[:, [2, 1]]

File /project/cassini/miniconda3/envs/cosipy/lib/python3.10/site-packages/numpy/lib/npyio.py:1373, in loadtxt(fname, dtype, comments, delimiter, converters, skiprows, usecols, unpack, ndmin, encoding, max_rows, quotechar, like)
   1370 if isinstance(delimiter, bytes):
   1371     delimiter = delimiter.decode('latin1')
-> 1373 arr = _read(fname, dtype=dtype, comment=comment, delimiter=delimiter,
   1374             converters=converters, skiplines=skiprows, usecols=usecols,
   1375             unpack=unpack, ndmin=ndmin, encoding=encoding,
   1376             max_rows=max_rows, quote=quotechar)
   1378 return arr

File /project/cassini/miniconda3/envs/cosipy/lib/python3.10/site-packages/numpy/lib/npyio.py:1016, in _read(fname, delimiter, comment, quote, imaginary_unit, usecols, skiplines, max_rows, converters, ndmin, unpack, dtype, encoding)
   1013     data = _preprocess_comments(data, comments, encoding)
   1015 if read_dtype_via_object_chunks is None:
-> 1016     arr = _load_from_filelike(
   1017         data, delimiter=delimiter, comment=comment, quote=quote,
   1018         imaginary_unit=imaginary_unit,
   1019         usecols=usecols, skiplines=skiplines, max_rows=max_rows,
   1020         converters=converters, dtype=dtype,
   1021         encoding=encoding, filelike=filelike,
   1022         byte_converters=byte_converters)
   1024 else:
   1025     # This branch reads the file into chunks of object arrays and then
   1026     # casts them to the desired actual dtype.  This ensures correct
   1027     # string-length and datetime-unit discovery (like `arr.astype()`).
   1028     # Due to chunking, certain error reports are less clear, currently.
   1029     if filelike:

ValueError: invalid column index 6 at row 1 with 6 columns

Thanks, @augustus-thomas. I think we can implement your suggested fix #1. Do you want to update this?

Okay it looks like this is being taken care already here! https://github.com/cositools/cosipy/pull/264

@ckarwin Yes, I can do that

Great, thank you!

Also being discussed in Issue #263


Custom status is not matching at Receipt controller

At file vendor/paytrail/paytrail-for-adobe-commerce/Controller/Receipt/Index.php, you are comparing Status of order to specified status     public const ORDER_SUCCESS_STATUSES = ["processing", "pending_paytrail", "pending", "complete"]; , here custome status is not included which so its throwing error and returning blank cart page.
So as per my view need to compare state of order except status.

Than you @plunagariya for the report. Unfortunately, we can't cover cases where something were customised. We have restricted area where we can do any customisations. If you have any customised order statuses, please customise also ORDER_SUCCESS_STATUSES by preference or patch. I can provide you instructions how to achieve this.


can't get a list of namespaces in CLI : internal system error

Environment: MacOS
Issue: the command
wsk namespace list
returns the error
error: Unable to obtain list of available namspaces: Request failure: There was an internal server error. (code 4002301)

@kerryspchang - try re-configuring your wsk CLI with a new auth key.  Log into Bluemix and then head over to https://console.ng.bluemix.net/openwhisk/learn/cli and issue the wsk commands listed in step 2.

That works. Thanks!

re-opening: "internal system error" is by definition a bug, no matter what the user does

@markusthoemmes will this go away when you nuke namespaces?

@markusthoemmes assigning to you since I think nuking namespaces is on your radar. Feel free to reassign.

nuking namespaces
Could someone provide some insight into what this means?

Thanks
pj

See this pr https://github.com/openwhisk/openwhisk/pull/1914.


Type response error

Properly type the returned response error.
To avoid Error: Property 'errors' does not exist on type 'unknown'.

Thanks for your PR. However, I'd like to solve this with Zod to actually validate the response, so I'm going to close this one out in the meantime.


Lex Text, Comments, and Annotations

Pull Request Description
This PR completes the implementation of the new Enso lexer, allowing it to lex all the possible language constructs successfully, while maintaing robust information about token positioning, length, and offsets.
Closes #944.
Important Notes
This will be published for use by the IDE once the situation with the libraries is sorted out in rust-libs. This effort is currently blocked waiting for the shortcut manager PR to merge, and then I will sort it immediately. This PR should merge regardless of waiting for that.
Additionally, this PR is not benchmarked. Creating a benchmark regression suite for the lexer is a separate task to happen next.
Checklist
Please include the following checklist in your PR:

[x] The documentation has been updated if necessary.
[x] All code conforms to the Scala, Java, and Rust style guides.
[x] All documentation and configuration conforms to the markdown and YAML style guides.
[x] All code has been tested where possible.

Ara, what is the status of benchmarks here? This was openned 19 days ago, and we agreed during phone call that we will not merge it until we are sure its working fast and consumes the right amount of memory. Moreover, you promised to share info about compilation times on different opt settings + info of the funal size on WASM target.

As mentioned previously, I had to work on the library merge first. That is now done, and I'm working on the benchmarks.


Broken README link

Hey, this "here" link:

Is broken and leads to a 404 page:

ngl it took me a while to understand this is a print screen. The link is working for me, can you check again?

@dolby360  Everything works now. I will close the issue thank you


Refactor based on Coding Standard of Angular team

Using coding standard in this link
https://angular.io/guide/styleguide
https://github.com/angular/components/blob/master/CODING_STANDARDS.md
https://itnext.io/clean-code-checklist-in-angular-%EF%B8%8F-10d4db877f74
https://medium.com/@rajaramtt/angular-style-guide-best-practices-e7ec08ad3226
Using TSLint to audit code
https://medium.com/burak-tasci/angular-tslint-rules-a-configuration-preset-for-both-tslint-codelyzer-8b5fa1455908

Added tslint and refactor code


Inform user when bp old is used

What type of PR is this?
feature
What this PR does / Why we need it?
Implement functionality to inform user when old ocm-backplane version is used to access the cluster
Which Jira/Github issue(s) does this PR fix?
OSD-14573
Resolves #
OSD-14573
Special notes for your reviewer
Pre-checks (if applicable)

[ Yes ] Ran unit tests locally
[ Yes ] Validated the changes in a cluster
[No ] Included documentation changes with PR

Codecov Report

Merging #78 (362090a) into main (5956b86) will decrease coverage by 0.89%.
The diff coverage is 0.00%.

:exclamation: Current head 362090a differs from pull request most recent head f3cc200. Consider uploading reports for the commit f3cc200 to get more accurate results

Additional details and impacted files

@@            Coverage Diff             @@
##             main      #78      +/-   ##
==========================================
- Coverage   44.41%   43.53%   -0.89%
==========================================
  Files          37       38       +1
  Lines        2195     2219      +24
==========================================
- Hits          975      966       -9
- Misses       1079     1109      +30
- Partials      141      144       +3

Impacted Files
Coverage Δ

cmd/ocm-backplane/upgrade/upgrade.go
31.25% <0.00%> (-7.22%)
:arrow_down:

cmd/ocm-backplane/version/version.go
0.00% <0.00%> (ø)

pkg/info/info.go
0.00% <0.00%> (ø)

... and 1 file with indirect coverage changes


Differences in throughput for an application in HIP/SYCL

The attached paper shows that the throughput of the application in SYCL is higher than that of the HIP program, but it does not explain the performance difference.
Unlocking performance portability on LUMI-G supercomputer:
A virtual screening case study
3648115.3648125.pdf

5.1.1 Software stack. [...]
Moreover, we used the HIPIFY tool 4 to
automatically generate a HIP implementation from the CUDA one,
based on HIP 5.3. We have used the ROCm LLVM’s to perform a
code build of the HIP version on AMD GPUs

5.2 Single GPU performance portability [...]
Moreover, we include an automatically generated
HIP version for AMD GPUs, while for NVIDIA GPUs, we include a
hand-optimized CUDA version.

It doesn't sound like they made any effort to tune the generated HIP version. CUDA results for A100 are double that of AdaptiveCPP so there's a good chance that hand-optimized HIP could also outperform SYCL.


Add midi tempo CLI argument

Why
Resolves issue #40 requesting a CLI option of specifying the tempo of the created MIDI file.
This is my first contribution! Unsure if:

I should add some tests
The midi tempo is set in the correct way

Would happily get some input :)
What is changing
You are now able to use an option in the CLI to specify the tempo of the created midi file
Example
basic-pitch <output-directory> <input-audio-path> --midi-tempo 75

Hi @LukasGardberg! Thanks for your patience and apologies for taking so long to get back to you. Did an end-to-end test and the command line arg looks good! Midi tempo seems to be reflected properly in the output.

@johngao2 Super! No problem, happy to help out on any future issues too :)


Add side-effect import type statement

Apologies if this is a duplicate. My searching yielded many results, but I didn't come across an existing issue.
Search Terms

import type side effect

Suggestion
import type was a great addition to TypeScript. However we're currently not able to have side-effect type imports like so:
import type '@material-ui/lab/themeAugmentation'

I'm currently using a workaround:
import type {} from '@material-ui/lab/themeAugmentation'

Using the traditional side-effect import would cause the import statement to be emitted into the runtime code:
import '@material-ui/lab/themeAugmentation'

Use Cases
I want to be able to import type from a module that may change the global types, or do some sort of declaration merging on existing types as in the example above. I want to ensure that this side effect import will have no runtime implications which is what import type provides for me.
Examples
Used for declaration merging in Material UI's Theme type: https://material-ui.com/components/about-the-lab/#typescript. I could see uses elsewhere such as importing Jest global definitions in test files without including the types in all source files of the project.
Checklist
My suggestion meets these guidelines:

[x] This wouldn't be a breaking change in existing TypeScript/JavaScript code
[x] This wouldn't change the runtime behavior of existing JavaScript code
[x] This could be implemented without emitting different JS based on the types of the expressions
[x] This isn't a runtime feature (e.g. library functionality, non-ECMAScript syntax with JavaScript output, etc.)
[x] This feature would agree with the rest of TypeScript's Design Goals.

Does /// <reference types="@material-ui/lab/themeAugmentation" /> fit the bill?

If you are using the "files" property in "tsconfig.json", you can set "include" property to import some global type declarations from .d.ts files

I think this is a duplicate of #36812

I think this is a duplicate of #36812

Ah yes, I figured someone else would have requested this. Thanks for finding it!
Closing in favor of #36812.


Variant pickling won't work for not-human and non-EnsemblRelease Genomes

See https://github.com/hammerlab/varcode/pull/146#discussion_r60986004

Plan to fix this: instead of popping the release number, instead get the genome name and then call genome_for_reference_name

Fixed by my elaborate conversion to Serializable and sercol.


ReactiveUI-Events package does not support Xamarin Forms portable

The reactiveui-events package does not install into a portable Xamarin Forms project:

Could not install package 'reactiveui-events 6.5.0'. You are trying to install this package into a project that targets 'portable-net45+win+wp80+MonoTouch10+MonoAndroid10+xamarinmac20+xamarinios10', but the package does not contain any assembly references or content files that are compatible with that framework. For more information, contact the package author.

It seems to me it should be possible to support this, since Xamarin.Forms itself has portable support.

@paulcbetts is the reason for this because there is no way to specifically target Xamarin Forms in a NuGet? I can see that the reactiveui-events package does not contain a portable variant of the build, but adding one seems non-sensical because whilst it would be portable, it would also be specific to XamForms.
Do you agree that we need a reactiveui-events-xamforms package?


The UI should exclusively use OpenAPI

Is your feature request related to a problem? Please describe.
The UI is using a combination of Swagger-generated and OpenAPI-generated code. This causes a couple of issues:

It's making it difficult to full address #5471, as sometimes we have, for example, a Swagger Workflow, and sometimes an OpenAPI Workflow, and you can't interchange them from a compiler perspective.
We're no longer updating the Swagger generated YAML on the web service, so new/updated APIs will not be available.
3

Describe the solution you'd like
The UI should exclusively use
Describe alternatives you've considered
Struggle along like we have
┆Issue is synchronized with this Jira Story
┆Issue Number: DOCK-2410
┆Sprint: Backlog
┆Issue Type: Story

and you can't interchange them from a compiler perspective

Sounds like Typescript doesn't have qualified package names like in Java (that said, it is still a pain in Java)

Sounds like Typescript doesn't have qualified package names like in Java? (that said, it is still a pain in Java)

They do; I didn't explain it very well. The problem we have is a component that takes an OpenAPI Workflow as a parameter, but the parent component is fetching the the workflow with Swagger -- you can't pass the Swagger Workflow to a component expecting an OpenAPI workflow.


Fix to change arrow color when link color or highlight color changes

closes #360
Issue https://github.com/danielcaldas/react-d3-graph/issues/360
Our application allow user to choose between light and dark theme. We set link color and highlight color to text color for theme. When the graph is loaded initially, both link and arrow color are in sync. But when user switches theme, the arrow color remain same, giving a bad user experience.
Change Detail

Current code assumes that defs are static and they need not be changed ever after the graph is loaded.
Current code caches the defs based on initial render and always returns cached copy of defs
Changed the code to maintain a cache for link.color and link.highlightColor combinations
A new cache key is added for each combination of  link.color and link.highlightColor
defs are returned from cache, if it already exists in cache
Added e2e tests to validate that the changes indeed fix the issue https://github.com/danielcaldas/react-d3-graph/issues/360. These tests fail currently
See screenshots after fix

Screenshot

Link and arrow color mismatch in normal mode

Link and arrow color mismatch when hover over node/link

Any chances of this limitation being solved? The arrow heads still don't have the same color as the link.
Thanks


[doc] Add troubleshooting note to FPGA user guide.

This fixed an issue I was having getting the FPGA board set up, and it seems like a good idea to document it.
Thanks to @moidx for suggesting the fix!

We've had at least one issue raised by an outside contributor complaining about exactly this message. I wonder whether this is related to #9200.

The message there does look exactly like the one I got, so possibly yes!

CC @colinoflynn

We had been toggling the PLL still sometimes, the USB RST would reinitialize everything. In theory this could be done quasi-automatically too if required in the future.
If there is a consistent requirement to hit the USB RST button maybe open an issue on https://github.com/newaetech/cw310-bergen-board/issues too so it's tracked somewhere more specific to that board!


cant save google MXes and TXT size too short to store DKIM value

Versions
NetBox Version: 3.5.6
NetBox DNS Version: 0.18.5
Python Version: 3.10.6
Describe the bug
More than one MX record
error TXT value too long to store "DKIM1 rsa key"

Hi @abdurrm, that's an interesting one ... can you provide a DNS query for this record?
Actually there is a size limit to record values in the database (fields for RR values are limited to 1000 characters). Probably that was a limit imposed in an early version of NetBox DNS, and I'll have to modify the Record model to fix it.

Hi @abdurrm, I just published version 0.18.6, which fixes the size limit for RR values.
Regarding the MX records I don't see what the problem is, you can provide as many MX records as needed right now. If you still have a problem, please reopen this issue with a detailed description how to reproduce it.

sorry, my mistake, no issue for duplicate MX record.
but one more, is it forbidden to add "_" character to A record? i have some old record using it.
I am done adding 3000 record, import manually from our PDNS API
it will be great if someone make two way sync between netbox-plugin-dns to powerdns,
unfortunately this script only allow netbox as the SoT, which is so risky to be run in our big old records.
https://github.com/v0tti/netbox-powerdns-sync
thank you btw, i will find a way to sync

Hi @abdurrm, thanks for the update.
Normally, underscores in RR names are restricted to some special cases as TXT and SRV records.
You can, however, allow them using a config setting. This came up only recently in issue #23 and is described in detail under Validation Options.
Currently I don't have a custom sync script for PowerDNS, but contributions are welcome :-)


Can't use multiple fields (expresions) on _id for aggregations

import mongomock

client = mongomock.MongoClient()
db = client['db']
collection = db['collection_name']

pipeline = [
    {'$group': {_id: {'field_1': '$field_1', 'field_2': '$field_2'}}}
]

collection.aggregate(pipeline)

Produces TypeError: unhashable type: 'slice'
https://docs.mongodb.org/v3.0/reference/operator/aggregation/group/
https://docs.mongodb.org/v3.0/meta/aggregation-quick-reference/#aggregation-expressions

Fixed by #197


Implement ClearRecordCommand

Implements basic execution path for clearing a person's record list.
Adds ClearRecordCommand class.
Adds personWithRecords field in ModelManager to encapsulate the current person whose records are being displayed/processed.

Todo:

Fully implement the command by updating the default personWithRecords in the ModelManager class.

Resolves #44

Codecov Report

Merging #50 (11ee8fa) into master (6554894) will decrease coverage by 0.52%.
The diff coverage is 7.14%.

@@             Coverage Diff              @@
##             master      #50      +/-   ##
============================================
- Coverage     69.16%   68.63%   -0.53%
  Complexity      416      416
============================================
  Files            78       79       +1
  Lines          1375     1387      +12
  Branches        138      138
============================================
+ Hits            951      952       +1
- Misses          390      401      +11
  Partials         34       34

Impacted Files
Coverage Δ

...edu/address/logic/commands/ClearRecordCommand.java
0.00% <0.00%> (ø)

.../seedu/address/logic/parser/AddressBookParser.java
84.21% <0.00%> (-4.68%)
:arrow_down:

src/main/java/seedu/address/model/Model.java
100.00% <ø> (ø)

...c/main/java/seedu/address/model/person/Person.java
93.75% <0.00%> (-4.08%)
:arrow_down:

...in/java/seedu/address/model/person/RecordList.java
66.66% <0.00%> (-8.34%)
:arrow_down:

...rc/main/java/seedu/address/ui/RecordListPanel.java
0.00% <0.00%> (ø)

...rc/main/java/seedu/address/model/ModelManager.java
89.65% <33.33%> (-3.08%)
:arrow_down:

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


Refactor NavbarNotifier apis

Describe the bug
Some of the methods of NavbarNotifier are not required to be exposed to client
e.g Don't expose onBackButtonPressed

[ ] Don't expose NavbarNotifier properties to outside world
[x] Add a method to programmatically push a route in any index of navbar

Added a method to programmatically push a route to any tab in Navigator Stack using NavbarNotifier.pushNamed(route,index) in v0.6.3