storage blob generate-sas generates an invalid token/uri

Describe the bug
az storage blob generate-sas \
--account-name $STORAGE_NAME \
--container-name $STORAGE_CONTAINER \
--account-key $STORAGE_KEY \
--auth-mode key \
--name file.sh \
--permissions r \
--start "$(date -u '+%Y-%m-%dT%H:%MZ')" \
--expiry "$(date -v+1d -u '+%Y-%m-%dT%H:%MZ')" \
--full-uri \
-o tsv

The uri returned is as follow (not sensitive):
https://<account-name>.blob.core.windows.net/<container-name>/file.sh.sh?st=2019-06-22T00%3A08Z&se=2019-06-23T00%3A08Z&sp=r&sv=2018-03-28&sr=b&sig=Bi9jAJQigiEgS/X1Nq9eemoJjpKKPWL9RCBqlWp%2Blls%3D
This fails with :
<Error>
    AuthenticationFailed
    <Message>
Server failed to authenticate the request. Make sure the value of Authorization header is formed correctly including the signature.
RequestId:e51e04ff-701e-0126-2c8d-288820000000
Time:2019-06-22T00:01:48.2032274Z
    </Message>
    <AuthenticationErrorDetail>Signature fields not well formed.</AuthenticationErrorDetail>
</Error>

Expected behavior
If my parameters are wrong, I expect a clear error message from the CLI.
if the CLI returns me a URI, I expect it to be working.
Environment summary
Darwin-18.6.0-x86_64-i386-64bit
Python 3.7.3
Shell: bash
azure-cli 2.0.67
date format :
echo $(date -u '+%Y-%m-%dT%H:%MZ')
2019-06-22T00:12Z
(date -v+1d -u '+%Y-%m-%dT%H:%MZ')
2019-06-23T00:12Z
Additional context
Add any other context about the problem here.

@serbrech , can you retry to generate a new sas token for the current time frame? The parameters are good. I don't see any issue.
One more thing to try is to remove both "--account-key $STORAGE_KEY " and "--auth-mode key ". CLI should find the right key.

@serbrech Have you solved your problem? If yes, I will close this issue. If you still have problem, please feel free to ask me.

I can confirm this is still broken on my end with az version  2.0.62.
I have tried the workarounds above as well as using the  connection string for the account key, none of the generated SAS tokens were valid.
Using the Powershell cmdlet's is the only workaround I have found if I need to script the SAS generation.

I think what happens is that, if any of the parameter is wrong it doesn’t
return an error, instead it spits out an invalid key without complaining.
My command started working after I rewrote it with a different format, new
line, etc... I could not figure out what was different, I just assume it
was a formatting difference.
It would go a long way if the cmd would only ever return a key that is
valid, and an error in other cases.
On Tue, Aug 6, 2019 at 07:40 Chris McIntosh<EMAIL_ADDRESS>wrote:

I can confirm this is still broken on my end with az version 2.0.62.
I have tried the workarounds above as well as using the connection string
for the account key, none of the generated SAS tokens were valid.
Using the Powershell cmdlet's is the only workaround I have found if I
need to script the SAS generation.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/Azure/azure-cli/issues/9771?email_source=notifications&email_token=AACNDTOPISTVZ3UAMT7GCDLQDGEPRA5CNFSM4H2VRD32YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD3VLSAY#issuecomment-518699267,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AACNDTIU57NMVGONKV7B7ZLQDGEPRANCNFSM4H2VRD3Q
.

--
Stéphane Erbrech

@serbrech  Can you show the two different format you used for generating sas token? It will give us some idea for bad parameters format validation.

@serbrech It looks that in (date -v+1d -u '+%Y-%m-%dT%H:%MZ'), -v cannot be recognized. Does this why you get bad formatted sas token?

Hi @@serbrech could you please provide more information for cli improvement?

@serbrech any update?

as I said it the previous answer, I was receiving a uri what wasn't working, while I'd prefer the cli to fail. I ended up not using sas key, so I don't have any more feedback to provide. I'll close this issue as I'm unable to help further.


Question: Does LocalSend verify the checksum of sent / received files to ensure data integrity?

This is supported by the protocol but not implemented yet

@Tienisto I'd be willing to contribute if I knew Dart :(
Thank you for your instant response 🙏

has there been any progress on this? or still waiting?


Use Bytes without using proto2

So either accidentally or intentionally this crate works with proto3. I was attempting to hack in Bytes support but things got a little weird because its requiring internal google protobufs.
Could you jot down a quick guide on how to integrate the Bytes crate?

requiring internal google protobufs.

Not sure I understand. I don't work for Google, and rust-protobuf doesn't need internal protobuf.

Could you jot down a quick guide on how to integrate the Bytes crate?

Instruction is there. Isn't anything clear in it?

Okay this is what confused me
The link you give points too rustproto which syntax=proto2; and uses the optionalkeyword  which is illegal in syntax=proto3;. Also it points to a google proto which is also incompatible with syntax=proto3;.

It is OK to include file with syntax=proto2 from file with syntax=proto3.

I hope I answered the question.


Fix bug in bitsequence.pushReservation

pushReservation fails to correctly detect when
the affected block is the last in the current
sequence. It thinks instead the block is in between
the sequence. Because of this a couple of issues
may happen:

The allocation of the last bit causes the creation
of a phantom sequence (length 0) at the end.
(This has no side effects).
The allocation of a bit somewhere in the middle of
the bitmask may lead to a completely incorrect
sequence pattern.

Signed-off-by: Alessandro Boch<EMAIL_ADDRESS>

LGTM

LGTM


xSQLServerAlwaysOnAvailabilityGroup\Replica: Utilize the Get-PrimaryReplicaServerObject helper function

Pull Request (PR) description
Updated xSQLServerAlwaysOnAvailabilityGroup and xSQLServerAlwaysOnAvailabilityGroupReplica to utilize the Get-PrimaryReplicaServerObject helper function.
This Pull Request (PR) fixes the following issues:
Fixes #630
Task list:

[X] Change details added to Unreleased section of CHANGELOG.md?
[ ] Added/updated documentation, comment-based help and descriptions in .schema.mof files where appropriate?
[ ] Examples appropriately updated?
[X] New/changed code adheres to Style Guidelines?
[X] Unit and (optional) Integration tests created/updated where possible?

This change is

Codecov Report

Merging #842 into dev will decrease coverage by <1%.
The diff coverage is 100%.

@@         Coverage Diff         @@
##            dev   #842   +/-   ##
===================================
- Coverage    96%    96%   -1%
===================================
  Files        31     31
  Lines      3314   3311    -3
===================================
- Hits       3197   3194    -3
  Misses      117    117

Reviewed 2 of 2 files at r1, 3 of 3 files at r2.
Review status: all files reviewed at latest revision, all discussions resolved.

Comments from Reviewable

Awesome work! 😄


added validation for app_name and transport_class

Also moved client tests to use pytest tests/fixtures

@simitt totally agree about splitting up the PR. I got carried away refactoring the tests. I'll try to avoid that going forward.


CLOUDP-167772: performance advisor in separate store

Migrating store only. No v2 changes

but I did to mod tidy :(


Awes/UI Select

- we would like to get simple select in UI
Animation:
https://gyazo.com/da6a026796455292ae2dab33b1076a66

➤ Ilya Kitayev commented:
usege:
<AwSelect :options="['One', 'Two'] v-model="..." />


inconsistencies in between Px and S1 mode: default user, groups

I've noticed two inconsistencies in between Px and S1 exec mode in devel:

When no --user= flag is given it defaults to root in Px whereas in S1 it defaults to $USER
When I run as --user=root I obtain all groups of $USER in Px whereas I just get group 0 in S1.
While the behavior of Px is quite convenient because I need at least group membership adm to accomplish anything useful in my container I am not sure if this is intended. In S1 I cannot do anything useful unless I add root to at least adm.

I wonder whats the intended behaviour, it doesn't strike me as obvious but maybe it can be more consistent. I did not check the other run modes, but I can do this if desirable.
Maybe it would be even sensible to have an option to pass custom /etc/group /etc/passwd files.

Hi,
The default behavior of udocker is starting Pn as root and Sn as normal user. We don't want to change that, as this is what the users expect as default behavior. Defaults will likely change for udocker3.
For simple modes that do not require much setup changes (P1, P2, F1, S1, S2, R1, R2, R3) the default mode is modifiable using UDOCKER_DEFAULT_EXECUTION_MODE=S2 this is available in the devel branch, also you can use -v /somefile:/etc/group and -v /someotherfile:/etc/passwd.
The groups behavior across modes suffers from the limitations of the upstream tools that support these modes. In singularity the faked root mode seems to ignore group membership. The same also happens with runC with all the limitations of groups under user namespaces.

Hi,
once again thanks a lot for the explanations.
The fake root behaviour in singularity is indeed interesting - try it for yourself:
 UDOCKER_DEFAULT_EXECUTION_MODE=S1 ./udocker.py run --user=root alpine sh
Warning: non-existing user will be created

 //////////////////////////////////////////////////////////////////////////////
 /                                                                            /
 /               STARTING 28a0635e-b6b8-355a-8fc4-f60069b4282c                /
 /                                                                            /
 //////////////////////////////////////////////////////////////////////////////
 executing: sh
28a0635e# id
uid=0(root) gid=0(root) groups=0(root)
28a0635e# su -c id
uid=0(root) gid=0(root) groups=0(root),0(root),1(bin),2(daemon),3(sys),4(adm),4(adm),6(disk),6(disk),10(wheel),11(floppy),20(dialout),20(dialout),24(G24),26(tape),27(video),27(video),30(readproc),44(G44),46(G46),115(G115),128(G128),129(G129),132(G132),136(G136),1000(G1000)


FilePlayer: Autoplay attribute is changing every time the user click on play/pause button.

Current Behavior
When you use FilePlayer (html5) each time the user click on play - autoplay attribute is added. And versa, clicking in pause - autoplay attribute is removed.
Expected Behavior
Autoplay attribute should not rely on 'playing' props.
Steps to Reproduce
It even reproduces on official demo page

Go to https://cookpete.com/react-player/
Click on controls (to ensure you can manipulate with built-it buttons)
Choose mp4 format
Look at the console: autoplay attribute is added every time you click on play button and removed when you pause video.

If I look at the code, I see in file https://github.com/cookpete/react-player/blob/master/src/players/FilePlayer.js line 359  autoPlay={playing || undefined}, which does exactly what was described. However, this is not how autoplay should work by default.
It cause many issues with analytics tracking, when you have lazy video loading and disabled autoplay. User clicks on play - autoplay attribute is added.

Having the same doubts, any updates?

@AmelloAster I've temp-fixed it by using a useEffect and useRef:
  // Autoplay attribute is changing every time user click on play/pause button
  useEffect(() => {
    if (!videoRef.current || videoRef.current?.getInternalPlayer()?.nodeName !== 'VIDEO') {
      return;
    }

    if (config.autoplay) {
      videoRef.current.getInternalPlayer().setAttribute('autoplay', '');
    } else {
      videoRef.current.getInternalPlayer().removeAttribute('autoplay');
    }
  }, [playing, config.autoplay]);

@AmelloAster I've temp-fixed it by using a useEffect and useRef:
  // Autoplay attribute is changing every time user click on play/pause button
  useEffect(() => {
    if (!videoRef.current || videoRef.current?.getInternalPlayer()?.nodeName !== 'VIDEO') {
      return;
    }

    if (config.autoplay) {
      videoRef.current.getInternalPlayer().setAttribute('autoplay', '');
    } else {
      videoRef.current.getInternalPlayer().removeAttribute('autoplay');
    }
  }, [playing, config.autoplay]);

However, I think this approach is not a cure, it's the react-player source code itself that is the problem.😂
But I still appreciate your help, thanks!


Simplified unary/binary math operators

Description
These are simplifications, suggested by @piiswrong. I added some further changes, which make sure that all gradient expressions are computed in the same way as forward expressions (namely either in float or double).
Checklist
Essentials

[ ] Passed code style checking (make lint)
[ ] Changes are complete (i.e. I finished coding on this PR)
[ ] All changes have test coverage
[ ] For user-facing API changes, API doc string has been updated.
[ ] To my best knowledge, examples are either not affected by this change, or have been fixed to be compatible with this change

Changes

[ ] Feature1, tests, (and when applicable, API doc)
[ ] Feature2, tests, (and when applicable, API doc)

Comments

If this change is a backward incompatible change, why must this change be made.
Intersting edge cases to note here

@piiswrong : This is #8323, plus further changes of mine.

Chris observed 4x performance regression for LSTMs that might be related to the previous PR.
@cjolivier01  have you found the cause?

We see it in the nightly benchmark runs, but I was unable to reproduce locally after spending quite a bit of time on it. However probably I should try again after I’ve now heard from a second source (you being the first) that c4.8xlarge machines behave strangely from a performance perspective. I’ll try this on Monday or this weekend if I get a chance.

For example, a unit test that takes 3 seconds on my machine, I’m told it takes 15-20 minutes on a c4.8xlarge.

Due to the unary/binary math functions?
In principle, at least for the majority of all expressions, we should go through the same computations for DType != double, and I suppose LSTMs probably use float?
WIth the current PR, I have now also changed the gradient expressions to be computed in float, when before they were computed in DType. But I'd be surprised if this would have a large effect.
But we are also seeing these weird compilation errors for Linux CentOS ...

Which functions in mshadow_op.h would be used in an LSTM? sigmoid, or relu? We could easily change them back to the old code and compare run times.

What is wrong with Jenkins?

@piiswrong Jenkins just won't run for this one, I am giving up

We have verified that the LSTM regression was a test error. However, we are seeing a 10% performance degradation on non-mkl cpu builds for cifar10/resnet50 benchmarks.

Jenkins is being problematic (as usual). Try triggering a commit with --allow-empty to add an empty commit and trigger a build

This PR repeatly gets killed (Jenkins), after several hours, with:
[incubator-mxnet_PR-8361-VK7D2LCLHPJDTFGAV5ZDEZEO7TQBFRVPINSHGGPQ3YOWVDLFE3AA] Running shell script

echo caught hudson.AbortException: Queue task was cancelled

caught hudson.AbortException: Queue task was cancelled

I, personally, haven't got the slightest idea what that message means :(
CI right now is a nightmare all around.
On Tue, Oct 24, 2017 at 7:56 AM, mseeger<EMAIL_ADDRESS>wrote:

This PR repeatly gets killed (Jenkins), after several hours, with:
[incubator-mxnet_PR-8361-VK7D2LCLHPJDTFGAV5ZDEZEO7TQBFRVPINSHGGPQ3YOWVDLFE3AA]
Running shell script

echo caught hudson.AbortException: Queue task was cancelled

caught hudson.AbortException: Queue task was cancelled
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/apache/incubator-mxnet/pull/8361#issuecomment-339018792,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AKts_Vd1xsGGNI_HZSp9pK7FUasGUaISks5svfqJgaJpZM4QA0zG
.

Do you think the degradation has anything to do with the unary operators? If so, if you point out the code for the benchmark, I can maybe have a look (but only on my Mac on CPU).

I do not know what the issues are -- I have not been able to reproduce them locally.

CI seems to be in better shape now. Please rebase your PR on master and push again.

BTW @cjolivier01 This PR just does not get built at all, since 6 days. Is it better I push it again regularly, or wait until it finally gets in? Or is it "too old" now to get in?

Finally!

Only 6 days? Looks like things are finally speeding up.

can this be merged?

Yes, please merge it. I rebase to master. This triggers Jenkins again, but please do not wait (there are no changes of mine).

Merge is blocked by GitHub until CI completes successfully.
On Sat, Oct 28, 2017 at 2:05 AM mseeger<EMAIL_ADDRESS>wrote:

Yes, please merge it. I rebase to master. This triggers Jenkins again, but
please do not wait (there are no changes of mine).
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/apache/incubator-mxnet/pull/8361#issuecomment-340162717,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AKts_YUHQaTkTC7kmdf-Zr56PkkmEhwIks5swu5kgaJpZM4QA0zG
.

Are we back to square 1 (Jenkins failed)? Can you skip CI?

Apache Jenkins server seems to be problematic. We are going to build our own server system. It isn’t possible to merge in since master is a github protected branch. Please try kicking off a new build with git commit —allow-empty -m”trigger build”
Or edit something here. Maybe merge in latest while you’re at it.

??? Are unit tests of master broken (not mine!) ???
test_viz.test_print_summary ... ERROR
======================================================================
ERROR: test_viz.test_print_summary

Traceback (most recent call last):
File "C:\Anaconda3\envs\py2\lib\site-packages\nose\case.py", line 197, in runTest
self.test(*self.arg)

File "c:\jenkins_slave\workspace\ut-python-cpu\tests\python\unittest\test_viz.py", line 30, in test_print_summary
mx.viz.print_summary(sc1)

File "c:\jenkins_slave\workspace\ut-python-cpu\pkg_vc14_cpu\python\mxnet\visualization.py", line 184, in print_summary
total_params += print_layer_summary(nodes[i], out_shape)

File "c:\jenkins_slave\workspace\ut-python-cpu\pkg_vc14_cpu\python\mxnet\visualization.py", line 137, in print_layer_summary
if ("no_bias" in node["attrs"]) and int(node["attrs"]["no_bias"]):

KeyError: 'attrs'
-------------------- >> begin captured stdout << ---------------------

Layer (type)                                        Output Shape            Param #     Previous Layer
========================================================================================================================
data(null)                                                                  0

I think tqchen changed that to ‘attr’ from ‘attrs’
@tqchen
On Mon, Oct 30, 2017 at 5:24 AM mseeger<EMAIL_ADDRESS>wrote:

??? Are unit tests of master broken (not mine!) ???
test_viz.test_print_summary ... ERROR
======================================================================
ERROR: test_viz.test_print_summary
Traceback (most recent call last):
File "C:\Anaconda3\envs\py2\lib\site-packages\nose\case.py", line 197, in
runTest
self.test(*self.arg)
File
"c:\jenkins_slave\workspace\ut-python-cpu\tests\python\unittest\test_viz.py",
line 30, in test_print_summary
mx.viz.print_summary(sc1)
File
"c:\jenkins_slave\workspace\ut-python-cpu\pkg_vc14_cpu\python\mxnet\visualization.py",
line 184, in print_summary
total_params += print_layer_summary(nodes[i], out_shape)
File
"c:\jenkins_slave\workspace\ut-python-cpu\pkg_vc14_cpu\python\mxnet\visualization.py",
line 137, in print_layer_summary
if ("no_bias" in node["attrs"]) and int(node["attrs"]["no_bias"]):
KeyError: 'attrs'
-------------------- >> begin captured stdout << ---------------------
Layer (type) Output Shape Param # Previous Layer
========================================================================================================================
data(null) 0
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/apache/incubator-mxnet/pull/8361#issuecomment-340428659,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AKts_VYXytRV-Q_iPQ1WfUneslG1BaSDks5sxb_1gaJpZM4QA0zG
.

Yeah weird, a colleague told me his PR went through. But this failed already twice for me, with the same error. I try another force push.

You are updating nnvm with this PR. Try removing that.

Sorry, I am getting real confused with these different repos. I now have nnvm at commit
8d79cfd0b42fbe9f6ad75886d495065d5500b9dd.
If you can point out a workflow for updating my local branch (I usually just do a rebase, clearly this seems not enough if the other repos change?), I'd not mess this up in the future.

If any of these double overloads are removed, there's a unit test that will fail, correct?

I am trying again.

@cjolivier01 My new unit tests should indeed fail if functions for DType = double are not computed in double, but in float. Even though this is not guaranteed (but I've seen it happen for some).
Is that what you mean?
The tests simply compare ours against NumPy. It is not really clear what NumPy is doing for DType not equal to float or double. So the tests for float16 have to be taken with a grain of salt.
But I do not know of better ones

@piiswrong OK, this went through. Please go ahead and merge it

I'm merging this.
Afterwards, we'll need to decide whether log2 and log10 should use float constants instead


TImezone by Abbreviation - Schedule Command

We should allow specifying timezone by abbreviation instead of just an offset on the schedule command
!schedule CEST should do the same thing as !schedule +2.

I'll try to do this!

As ajukraine suggested in chat yesterday, another nice addition would be to get the timezone by city, as in: !schedule

@asyncawake Can you open a separate issue for that please?

@Nufflee There is now a hangman test class. I created a test for you to code this abbreviation enhancement against. In theory, if you'd like to do that, jst uncomment it and run it against your implementation until it's green.
https://github.com/DevChatter/devchatterbot/blob/master/src/UnitTests/Core/Commands/ScheduleCommandTests/ProcessShould.cs


Incorporate magnetometer / compass drift-mitigation

Magnetometer is not really suitable anymore for HMD due to the problems with headphones and other magnetic sources (and seems to never be implemented anymore after the DK2)


[SPARK-13643][SQL] Implement SparkSession

What changes were proposed in this pull request?
After removing most of HiveContext in 8fc267ab3322e46db81e725a5cb1adb5a71b2b4d we can now move existing functionality in SQLContext to SparkSession. As of this PR SQLContext becomes a simple wrapper that has a SparkSession and delegates all functionality to it.
How was this patch tested?
Jenkins.

@rxin @yhuai

Test build #56457 has started for PR 12553 at commit ba8e56a.

Test build #56457 has finished for PR 12553 at commit ba8e56a.

This patch fails MiMa tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/56457/
Test FAILed.

Thank you! This one looks good. Seems MIMA is complaining the following.
[error]  * method getSchema(java.lang.Class)scala.collection.Seq in class org.apache.spark.sql.SQLContext does not have a correspondent in current version
[error]    filter with: ProblemFilters.exclude[DirectMissingMethodProblem]("org.apache.spark.sql.SQLContext.getSchema")

Test build #56468 has started for PR 12553 at commit 7ccfb38.

Test build #56468 has finished for PR 12553 at commit 7ccfb38.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/56468/
Test FAILed.

Test build #56566 has started for PR 12553 at commit 530f039.

Test build #56566 has finished for PR 12553 at commit 530f039.

This patch fails MiMa tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
class SparkSqlParser(conf: SQLConf) extends AbstractSqlParser
class SparkSqlAstBuilder(conf: SQLConf) extends AstBuilder
   *   [STORED AS file_format | STORED BY storage_handler_class [WITH SERDEPROPERTIES (...)]]
case class AddJar(path: String) extends RunnableCommand
case class AddFile(path: String) extends RunnableCommand
case class CreateTableAsSelectLogicalPlan(
case class CreateViewAsSelectLogicalCommand(
case class HiveSerDe(
class HiveSqlParser(conf: SQLConf, hiveconf: HiveConf) extends AbstractSqlParser
class HiveSqlAstBuilder(conf: SQLConf) extends SparkSqlAstBuilder(conf)

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/56566/
Test FAILed.

retest this please

Test build #56568 has started for PR 12553 at commit 530f039.

Test build #56575 has started for PR 12553 at commit 83b131a.

Test build #56577 has started for PR 12553 at commit ae8d1fc.

Test build #2850 has started for PR 12553 at commit ae8d1fc.

Test build #2851 has started for PR 12553 at commit ae8d1fc.

Test build #56568 has finished for PR 12553 at commit 530f039.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
class SparkSqlParser(conf: SQLConf) extends AbstractSqlParser
class SparkSqlAstBuilder(conf: SQLConf) extends AstBuilder
   *   [STORED AS file_format | STORED BY storage_handler_class [WITH SERDEPROPERTIES (...)]]
case class AddJar(path: String) extends RunnableCommand
case class AddFile(path: String) extends RunnableCommand
case class CreateTableAsSelectLogicalPlan(
case class CreateViewAsSelectLogicalCommand(
case class HiveSerDe(
class HiveSqlParser(conf: SQLConf, hiveconf: HiveConf) extends AbstractSqlParser
class HiveSqlAstBuilder(conf: SQLConf) extends SparkSqlAstBuilder(conf)

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/56568/
Test FAILed.

Test build #56575 has finished for PR 12553 at commit 83b131a.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/56575/
Test FAILed.

Merged build finished. Test FAILed.

Test build #56577 has finished for PR 12553 at commit ae8d1fc.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/56577/
Test PASSed.

LGTM. Thanks. Merging to master.

Test build #2850 has finished for PR 12553 at commit ae8d1fc.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test build #2851 has finished for PR 12553 at commit ae8d1fc.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.


How to set request rate-limits for the server

Hi, is there any recommended or even possible way to set rate-limits for requests hitting the server? I am happy to work on that as we will have add this anyways for https://cloudron.io where we use ldapjs for app auth. Haven't yet looked much into the code as I first wanted to see if there are already existing solutions.
Thanks.

I have taken the node modules express-rate-limit and adjusted it to ldapjs, so it can now be used as a middleware.
https://www.npmjs.com/package/ldapjs-rate-limit


update_dart_sdk.sh does not handle spaces in paths well

We see:
usage: dirname path

from update_dart_sdk.sh.
https://github.com/flutter/flutter/blob/master/bin/cache/update_dart_sdk.sh#L8

If we fix this and want to not break it again we'll want to change our bots to have a space in their path: https://chromium.googlesource.com/chromium/tools/build/+/master/scripts/slave/recipes/flutter/flutter.py  This is a very common problem for tools in a unix-like environment to not handle spaces well. :/

@bkonyi This may be relevant to your current interests.

/cc @cbracken as well


Missing NMT broadcast

The send_nmt_command is expecting a state change for a single controller. In order to change the nmt state of all controllers in the network a broadcast can be used by sending 0 as node id. But there is no function in the library to do this.

Thanks for reporting the issue! To be clear, we should expect a state change message for all controllers?
Should we use a timeout to determine when all controllers should have responded?

Depends on the use case. If we use it before initiailization we don't know which controllers are connected yet (case I will be using it for). If we do, we can use the individual one. But there maybe are use cases on which you want to do a broadcast when the controllers are initialized. EMCY stop maybe?


Fix a couple of syntax errors

A couple of layouts had = where they should have had :=.

I'm pretty sure that's no mistake. See https://gohugo.io/templates/introduction/#variables

I'm using hugo 0.48, and got an error because of those lines, which this fixed. I'm not at the computer I was running, on now, but I can add the actual error I got later.

This is what I get without my changes with hugo 0.48 and go 1.11:
ERROR 2018/09/21 23:11:02 Failed to add template "partials/home/projects.html" in path "partials/home/projects.html": template: partials/home/projects.html:16: unexpected "=" in operand
ERROR 2018/09/21 23:11:02 Failed to add template "projects/list.html" in path "projects/list.html": template: projects/list.html:13: unexpected "=" in operand
ERROR 2018/09/21 23:11:02 partials/home/projects.html : template: partials/home/projects.html:16: unexpected "=" in operand
Building sites … ERROR 2018/09/21 23:11:07 Error while rendering "home" in "": template: index.html:75:19: executing "index.html" at <partial "home/projec...>: error calling partial: template: "partials/home/projects.html" is an incomplete or empty template

hmm, if I use the binary of hugo from the hugo releases page it works. Maybe the archlinux package wasn't built correctly.

yeah, it's an archlinux packaging bug (https://bugs.archlinux.org/index.php?do=details&action=details.addvote&task_id=59946). I'll close

Anyway, thank for investigation!


Intermittently failing at config map aws_auth.tf

I have issues
I'm submitting a...

[ *] bug report
[ ] feature request
[ ] support request - read the FAQ first!
[ ] kudos, thank you, warm fuzzy

What is the current behavior?
Eks cluster provisioning with map roles intermittently fails at config map creation
If this is a bug, how to reproduce? Please include a code sample if relevant.
provision eks using node groups.
module.eks-cluster.null_resource.wait_for_cluster[0]: Creation complete after 5m27s [id=7869213295342156152]
739 | module.eks-cluster.kubernetes_config_map.aws_auth[0]: Creating...
740 | module.eks-cluster.kubernetes_config_map.aws_auth[0]: Still creating... [10s elapsed]
741 | module.eks-cluster.kubernetes_config_map.aws_auth[0]: Still creating... [20s elapsed]
742 | module.eks-cluster.kubernetes_config_map.aws_auth[0]: Still creating... [30s elapsed]
743 |
744 | Error: Post https://xxxxxxxxxxxx.yl4.us-east-1.eks.amazonaws.com/api/v1/namespaces/kube-system/configmaps: dial tcp <IP_ADDRESS>:443: i/o timeout
745 |
746 | on .terraform/modules/eks-cluster/aws_auth.tf line 61, in resource "kubernetes_config_map" "aws_auth":
747 | 61: resource "kubernetes_config_map" "aws_auth" {
What's the expected behavior?
there should not be failure
Are you able to fix this problem and submit a PR? Link here if you have already.
No
Environment details

Affected module version:
v11.0.0
OS:
Terraform version:
Terraform v0.12.24

provider.aws v2.59.0
provider.kubernetes v1.11.1
provider.local v1.4.0
provider.null v2.1.2
provider.random v2.2.1
provider.template v2.1.2

Any other relevant info

Do you have whitelisting of the public endpoint enabled, or the public endpoint turned off?
Maybe you need to increase the timeout for waiting for the endpoint to be available after creating the cluster?

how do i increase the timeout...its polling

If you're absolutely certain that the issue is EKS being very slow at bringing up the endpoint and it's not a networking/security configuration issue then you could increase the sleep time or number of loops in the polling. You can do this via the wait_for_cluster_cmd variable since v8.2.0.
module "eks" {
  wait_for_cluster_cmd = "for i in `seq 1 60`; do wget --no-check-certificate -O - -q $ENDPOINT/healthz >/dev/null && exit 0 || true; sleep 10; done; echo TIMEOUT && exit 1"
}


How to dynamically switch language?

Hi,
Is there any way I can switch between different languages at runtime??
Thanks In Advance.

Hi @SumanBhowmick, sorry for the late response. There is an example in the pre-1.1 branch: https://github.com/elmasse/Ext.i18n.Bundle/tree/pre-1.1/examples/demo-classic-vm
While it is not in the master branch and it's not published yet you can use that branch following the steps in the Readme to manually add the package.
I haven't find the time yet to publish this new version but I'll do it as soon as I can.

I just published a new version (1.1.0). It is available from the repository (See the README on how to add the repo to your Sencha Cmd). You can follow the example I mentioned in the previous comment.
I'm closing this issue. Please feel free to re-open it in case you have any questions.

Hi,
My app is based on simple MVC architecture.
How do I change the language dynamically in the controller?
I find that the latest elmasse-bundle(version 1.1.0) examples are based on MVVM architecture.
Thanks In advance.


Docker pull progress

Rancher Version:
v1.1.1
Docker Version:
1.10.3, build 3cd164c
OS and where are the hosts located? (cloud, bare metal, etc):
CoreOS, QingCloud
Hi, I have a rancher managed host in China. When I tried to set up a new rancher service on the host which would pull a large docker image from outside of China, the service status was kind of stuck at "Starting" indefinitely. So my question is: how can I view the pulling progress?

There is no way to directly view the pulling progress.
Did you click on the service name to see if there is any status on the specific containers?

closing issue.


doc: the new Stringer package is fmt

Docs are updated regarding the change of the Stringer package.

Thanks @mgenov


Initialize instrumentationKey via http request

Hi.
I have multiple application insight instances, which correspond to my runtime environments (DEV, ACT, PROD). I am searching for the best way to set up the instrumentationKey dependent on the environment it was distributed from. I was thinking about requesting the corresponding server, if this is possible in any way.
Do you know how I could achieve this the best?

Currently APP_INITIALIZER would be the best way, where you'd make the request and then when the app actually bootstraps you already have the string ready.
I'm working on better ways of handling the key, like from an http observable so this can be easier in the future and then fire off the other events when it's all ready. For now use the initializer though! Cheers.

fixed via  2c6c713 thanks to @jycouet


RAM Usage bar

Hi, @rymate1234, how do i interpret 'RAM Usage' bar? I use -Xmx1800M and Jpanel shows smthng like 'RAM: 516MB / 1016MB', but I expected smthng like this 'RAM: 516MB / 1800MB'. Thank you in advance!

Interpret it as it is, 1016mb is actually the total of what the server has been allocated in ram, and 516mb is the total of what the server has used of the allocated amount of ram, Java virtual machines don't use all the memory that has been specified for it. For example,

this is what my server looks like when allocated 8192mb of ram and viewed through JPanel. It is accurate and there is no issue with the project, it is just how java works, accept it for how it is. Part of the reason it might be so low as compared to 1800mb could be that roughly 784mb is currently being used for the java virtual machine to run, or system ram usage at server execution + 1800mb is > maximum system ram, then it will lower the allocated ram usage.


Set build args properly for Rubygems >=2.0

There is an issue with applying 'build' args that were set through 'bundler config' for Rubygems >=2.0. The default 'install_with_build_args' set them properly https://github.com/bundler/bundler/blob/master/lib/bundler/rubygems_integration.rb#L256 but existing one doesn't set at all.

Please open an issue with details of the problem you're seeing rather than just deleting code?

Added issue - https://github.com/bundler/bundler/issues/5401.
It could be possible that I missed an idea of overriding method 'install_with_build_args' for RubyGems 2.0 ... if so please let me know and I'll modify a fix.

The idea is that rubygems 2.0+ allow setting build args directly on the gem installer, so we could avoid mutexing installation

Well, I definitely can install gem using 'gem install' with '--with-cppflags' but it sounds like a unrelated to bundler config issue. It seems to me that mutex usage for concurrent gem installation still reasonable because of an args that user can set in the bundler config.
Please share your thoughts and thank you for quick response.

https://github.com/bundler/bundler/issues/5410 should address this


Add pangeo-escience object store

New OpenStack project and Check-In group available.
Please remember that attendees for the eScience workhop need to be added to the pangeo.escience group in Check-In:
https://docs.egi.eu/users/aai/check-in/vos/#adding-members-to-vo-groups

Thanks Sebastian. I don't think I am an admin for Pangeo prod (only for the dev) so I cannot see and approve the petitions and add users to pangeo-escience.

Thanks Sebastian. I don't think I am an admin for Pangeo prod (only for the dev) so I cannot see and approve the petitions and add users to pangeo-escience.

Sorry I was not looking at the right "place". Students and mentors haven't enrolled to the pangeo prod yet and this is what I could not approve anyone!

Hm, not sure why, but I don't have management rights on this repository anywore.
@annefou I suspect that there has been cleaning of permissions at Pangeo steering council level (which is perfectly normal), I previously had every rights on all Pangeo repo, but I don't have anymore.


Question about ctc topology

In the build_ctc_topo function below:
https://github.com/k2-fsa/snowfall/blob/8bb8d8cd667e89b5963b4e3c14c15c5370d751ce/snowfall/training/ctc_graph.py#L35
In my opinion, “0” is blank label, can we take it as an input and produce a corresponding phone?

0 should not be a phone, I think.
On Tuesday, January 19, 2021, yaguang<EMAIL_ADDRESS>wrote:

In the build_ctc_topo function below:
https://github.com/k2-fsa/snowfall/blob/8bb8d8cd667e89b5963b4e3c14c15c
5370d751ce/snowfall/training/ctc_graph.py#L35
In my opinion, “0” is blank label, can we take it as an input and produce
a corresponding phone?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/k2-fsa/snowfall/issues/77, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAZFLOZBWSGK4JKDP4YWN6LS2WBJ3ANCNFSM4WIYOETA
.

0 should not be a phone, I think.
On Tuesday, January 19, 2021, yaguang<EMAIL_ADDRESS>wrote:

In the build_ctc_topo function below:
https://github.com/k2-fsa/snowfall/blob/8bb8d8cd667e89b5963b4e3c14c15c
5370d751ce/snowfall/training/ctc_graph.py#L35
In my opinion, “0” is blank label, can we take it as an input and produce
a corresponding phone?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/k2-fsa/snowfall/issues/77, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAZFLOZBWSGK4JKDP4YWN6LS2WBJ3ANCNFSM4WIYOETA
.

yes, it should be blank label, but the corresponding output should be epsilon.
获取 Outlook for iOShttps://aka.ms/o0ukef

发件人: Daniel Povey<EMAIL_ADDRESS>发送时间: Tuesday, January 19, 2021 9:30:44 PM
收件人: k2-fsa/snowfall<EMAIL_ADDRESS>抄送: yaguang<EMAIL_ADDRESS>Author<EMAIL_ADDRESS>主题: Re: [k2-fsa/snowfall] Question about ctc topology (#77)
0 should not be a phone, I think.
On Tuesday, January 19, 2021, yaguang<EMAIL_ADDRESS>wrote:

In the build_ctc_topo function below:
https://github.com/k2-fsa/snowfall/blob/8bb8d8cd667e89b5963b4e3c14c15c
5370d751ce/snowfall/training/ctc_graph.py#L35
In my opinion, “0” is blank label, can we take it as an input and produce
a corresponding phone?
―
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/k2-fsa/snowfall/issues/77, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAZFLOZBWSGK4JKDP4YWN6LS2WBJ3ANCNFSM4WIYOETA
.

―
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/k2-fsa/snowfall/issues/77#issuecomment-762839876, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ABPRKXBF6STN34QW6JDPZETS2WCQJANCNFSM4WIYOETA.

yes, it should be blank label, but the corresponding output should be epsilon.
获取 Outlook for iOShttps://aka.ms/o0ukef

发件人: Daniel Povey<EMAIL_ADDRESS>发送时间: Tuesday, January 19, 2021 9:30:44 PM
收件人: k2-fsa/snowfall<EMAIL_ADDRESS>抄送: yaguang<EMAIL_ADDRESS>Author<EMAIL_ADDRESS>主题: Re: [k2-fsa/snowfall] Question about ctc topology (#77)
0 should not be a phone, I think.
On Tuesday, January 19, 2021, yaguang<EMAIL_ADDRESS>wrote:

In the build_ctc_topo function below:
https://github.com/k2-fsa/snowfall/blob/8bb8d8cd667e89b5963b4e3c14c15c
5370d751ce/snowfall/training/ctc_graph.py#L35
In my opinion, “0” is blank label, can we take it as an input and produce
a corresponding phone?
―
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/k2-fsa/snowfall/issues/77, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAZFLOZBWSGK4JKDP4YWN6LS2WBJ3ANCNFSM4WIYOETA
.

―
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/k2-fsa/snowfall/issues/77#issuecomment-762839876, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ABPRKXBF6STN34QW6JDPZETS2WCQJANCNFSM4WIYOETA.

Oh.  Now that I look at how it's used, yes, it looks like tokens is supposed to contain epsilon; however, that is not really treated as a phone.   In some sense it is the start state.
@csukuangfj I think we should clarify that epsilon must be included among tokens.  I don't like the word 'rules' for those variables, 'arcs' would be better.  I think you are viewing the FST as a function from inputs to outputs, that is not really the right way to think about it.

Oh.  Now that I look at how it's used, yes, it looks like tokens is supposed to contain epsilon; however, that is not really treated as a phone.   In some sense it is the start state.
@csukuangfj I think we should clarify that epsilon must be included among tokens.  I don't like the word 'rules' for those variables, 'arcs' would be better.  I think you are viewing the FST as a function from inputs to outputs, that is not really the right way to think about it.

.. and the start state also doubles as a mechanism for allowing repeated blanks after repeats of the label we just saw.

.. and the start state also doubles as a mechanism for allowing repeated blanks after repeats of the label we just saw.

yes, it looks like tokens is supposed to contain epsilon

https://github.com/k2-fsa/snowfall/blob/8bb8d8cd667e89b5963b4e3c14c15c5370d751ce/egs/librispeech/asr/simple_v1/mmi_bigram_decode.py#L209-L210
0 in tokens means blank and is the aux_label of the output FSA.
The eps symbol is also represented as 0, but it is contained in the label of the output FSA.

I think we should clarify that epsilon must be included among tokens

What do you mean? What's the difference between blank and eps in tokens?

yes, it looks like tokens is supposed to contain epsilon

https://github.com/k2-fsa/snowfall/blob/8bb8d8cd667e89b5963b4e3c14c15c5370d751ce/egs/librispeech/asr/simple_v1/mmi_bigram_decode.py#L209-L210
0 in tokens means blank and is the aux_label of the output FSA.
The eps symbol is also represented as 0, but it is contained in the label of the output FSA.

I think we should clarify that epsilon must be included among tokens

What do you mean? What's the difference between blank and eps in tokens?

I don't like the word 'rules' for those variables, 'arcs' would be better.

Will change it.

I think you are viewing the FST as a function from inputs to outputs, that is not really the right way to think about it.

I have been viewing the FST as a function that transforms a stream of input symbols into a stream of output symbols.
And the variable rules means transition rules between states (or nodes of the graph).
What is the correct way of thinking about the FST?

I don't like the word 'rules' for those variables, 'arcs' would be better.

Will change it.

I think you are viewing the FST as a function from inputs to outputs, that is not really the right way to think about it.

I have been viewing the FST as a function that transforms a stream of input symbols into a stream of output symbols.
And the variable rules means transition rules between states (or nodes of the graph).
What is the correct way of thinking about the FST?

I just mean that 0 should be included in tokens.  Of course we treat it as blank on the left and epsilon on the right.
RE viewing it as rules: that might be workable if the FSA was deterministic, but it's not... I prefer to view the FST as a function from pair (input-sequence, output-sequence) to (cost for that pair of sequences), if we are to view it as a function at all.  I just feel like arcs is more neutral and less likely to confuse the reader.

I just mean that 0 should be included in tokens.  Of course we treat it as blank on the left and epsilon on the right.
RE viewing it as rules: that might be workable if the FSA was deterministic, but it's not... I prefer to view the FST as a function from pair (input-sequence, output-sequence) to (cost for that pair of sequences), if we are to view it as a function at all.  I just feel like arcs is more neutral and less likely to confuse the reader.

Of course we treat it as blank on the left and epsilon on the right.
I just feel like arcs is more neutral and less likely to confuse the reader.

Will change it.

Of course we treat it as blank on the left and epsilon on the right.
I just feel like arcs is more neutral and less likely to confuse the reader.

Will change it.

0 in ilabels represents , while in ilabels represents , wich is confusing. Although we don't need  for ilabels, but is it better to make the symbol consistent?
BTW, this function called "build_ctc_topo" is confusing too, a reversed ctc topology fst is generated by it. I couldn't figure out why do we have to do this.

0 in ilabels represents , while in ilabels represents , wich is confusing. Although we don't need  for ilabels, but is it better to make the symbol consistent?
BTW, this function called "build_ctc_topo" is confusing too, a reversed ctc topology fst is generated by it. I couldn't figure out why do we have to do this.

You're right that it's reversed vs. the normal formulation; this is my fault.   We could revert it.

You're right that it's reversed vs. the normal formulation; this is my fault.   We could revert it.

I can help to do this. But I don't know how to test whether it is correct. Do you have any unit tests or test cases?

I can help to do this. But I don't know how to test whether it is correct. Do you have any unit tests or test cases?

Do git grep ctc_topo to find such places.  You'll have to do ctc_topo =
get_ctc_topo(..).invert_() or something like that.
(Assuming invert_ returns this).
On Wed, Jan 20, 2021 at 3:47 PM yaguang<EMAIL_ADDRESS>wrote:

I can help to do this. But I don't know how to test whether it is correct.
Do you have any unit tests or test cases?
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/k2-fsa/snowfall/issues/77#issuecomment-763406981, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAZFLO7FTNXGWLAVDSSSIM3S22DCNANCNFSM4WIYOETA
.

Do git grep ctc_topo to find such places.  You'll have to do ctc_topo =
get_ctc_topo(..).invert_() or something like that.
(Assuming invert_ returns this).
On Wed, Jan 20, 2021 at 3:47 PM yaguang<EMAIL_ADDRESS>wrote:

I can help to do this. But I don't know how to test whether it is correct.
Do you have any unit tests or test cases?
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/k2-fsa/snowfall/issues/77#issuecomment-763406981, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAZFLO7FTNXGWLAVDSSSIM3S22DCNANCNFSM4WIYOETA
.

OK, I will do that. Thanks a lot for your instructions.

OK, I will do that. Thanks a lot for your instructions.

Another question, since we have already implemented compose function, do we still need reverse a fst and then intersect it with another fsa?
Such as:
https://github.com/k2-fsa/snowfall/blob/8bb8d8cd667e89b5963b4e3c14c15c5370d751ce/snowfall/training/ctc_graph.py#L89

Another question, since we have already implemented compose function, do we still need reverse a fst and then intersect it with another fsa?
Such as:
https://github.com/k2-fsa/snowfall/blob/8bb8d8cd667e89b5963b4e3c14c15c5370d751ce/snowfall/training/ctc_graph.py#L89

mm, I suppose compose would work.  If you can test it, I'd be Ok with the change.

mm, I suppose compose would work.  If you can test it, I'd be Ok with the change.

OK, I will try to test it. I would suggest that we should use compose instead of intersect in this case, because I thinks " intersect" between fst and fsa is very confusing.

OK, I will try to test it. I would suggest that we should use compose instead of intersect in this case, because I thinks " intersect" between fst and fsa is very confusing.

Let me know if you encounter the same problem posted by Yiming Wang a few days ago https://github.com/k2-fsa/k2/pull/554

Let me know if you encounter the same problem posted by Yiming Wang a few days ago https://github.com/k2-fsa/k2/pull/554

To avoid this issue, I want to implement a function of linear fst creation, like k2.linear_fsa. Do you think it's useful  @csukuangfj @danpovey @qindazhu ?

To avoid this issue, I want to implement a function of linear fst creation, like k2.linear_fsa. Do you think it's useful  @csukuangfj @danpovey @qindazhu ?

See
k2/python/tests/linear_fsa_test.py
it might already exist
On Wed, Jan 20, 2021 at 7:13 PM yaguang<EMAIL_ADDRESS>wrote:

To avoid this issue, I want to implement a function of linear fst
creation, like k2.linear_fsa. Do you think it's useful @csukuangfj
https://github.com/csukuangfj @danpovey https://github.com/danpovey
@qindazhu https://github.com/qindazhu ?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/k2-fsa/snowfall/issues/77#issuecomment-763531071, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAZFLO4PW7XLBABJFVTX7E3S223EZANCNFSM4WIYOETA
.

See
k2/python/tests/linear_fsa_test.py
it might already exist
On Wed, Jan 20, 2021 at 7:13 PM yaguang<EMAIL_ADDRESS>wrote:

To avoid this issue, I want to implement a function of linear fst
creation, like k2.linear_fsa. Do you think it's useful @csukuangfj
https://github.com/csukuangfj @danpovey https://github.com/danpovey
@qindazhu https://github.com/qindazhu ?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/k2-fsa/snowfall/issues/77#issuecomment-763531071, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAZFLO4PW7XLBABJFVTX7E3S223EZANCNFSM4WIYOETA
.

emm, it seems like not supported yet.

emm, it seems like not supported yet.

??  If the test runs, then it should work.. dunno what you mean by not
supported.
On Wed, Jan 20, 2021 at 7:27 PM yaguang<EMAIL_ADDRESS>wrote:

emm, it seems like not supported yet.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/k2-fsa/snowfall/issues/77#issuecomment-763539045, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAZFLO7REMWO65DVK62F63LS22427ANCNFSM4WIYOETA
.

??  If the test runs, then it should work.. dunno what you mean by not
supported.
On Wed, Jan 20, 2021 at 7:27 PM yaguang<EMAIL_ADDRESS>wrote:

emm, it seems like not supported yet.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/k2-fsa/snowfall/issues/77#issuecomment-763539045, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAZFLO7REMWO65DVK62F63LS22427ANCNFSM4WIYOETA
.

Create a linear fst is not supported yet. I can only find linear fsa creation in the test.
获取 Outlook for iOShttps://aka.ms/o0ukef

发件人: Daniel Povey<EMAIL_ADDRESS>发送时间: Thursday, January 21, 2021 12:04:55 AM
收件人: k2-fsa/snowfall<EMAIL_ADDRESS>抄送: yaguang<EMAIL_ADDRESS>Author<EMAIL_ADDRESS>主题: Re: [k2-fsa/snowfall] Question about ctc topology (#77)
?? If the test runs, then it should work.. dunno what you mean by not
supported.
On Wed, Jan 20, 2021 at 7:27 PM yaguang<EMAIL_ADDRESS>wrote:

emm, it seems like not supported yet.
―
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/k2-fsa/snowfall/issues/77#issuecomment-763539045, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAZFLO7REMWO65DVK62F63LS22427ANCNFSM4WIYOETA
.

―
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/k2-fsa/snowfall/issues/77#issuecomment-763736123, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ABPRKXBGBBH7V4ST54F7DXLS235KPANCNFSM4WIYOETA.

Create a linear fst is not supported yet. I can only find linear fsa creation in the test.
获取 Outlook for iOShttps://aka.ms/o0ukef

发件人: Daniel Povey<EMAIL_ADDRESS>发送时间: Thursday, January 21, 2021 12:04:55 AM
收件人: k2-fsa/snowfall<EMAIL_ADDRESS>抄送: yaguang<EMAIL_ADDRESS>Author<EMAIL_ADDRESS>主题: Re: [k2-fsa/snowfall] Question about ctc topology (#77)
?? If the test runs, then it should work.. dunno what you mean by not
supported.
On Wed, Jan 20, 2021 at 7:27 PM yaguang<EMAIL_ADDRESS>wrote:

emm, it seems like not supported yet.
―
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/k2-fsa/snowfall/issues/77#issuecomment-763539045, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAZFLO7REMWO65DVK62F63LS22427ANCNFSM4WIYOETA
.

―
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/k2-fsa/snowfall/issues/77#issuecomment-763736123, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ABPRKXBGBBH7V4ST54F7DXLS235KPANCNFSM4WIYOETA.

In k2 you can just attach aux_labels with fst.aux_labels = tensor / ragged_tensor to get an fst, so it's fine to call k2.linear_fsa and attach the aux_labels to the result.

In k2 you can just attach aux_labels with fst.aux_labels = tensor / ragged_tensor to get an fst, so it's fine to call k2.linear_fsa and attach the aux_labels to the result.

I just want to warp an interface such as k2.linear_fst, because I think it's useful. Just need to make some changes in the python level code. What's your opinion?

I just want to warp an interface such as k2.linear_fst, because I think it's useful. Just need to make some changes in the python level code. What's your opinion?

because I think it's useful

Could you give an example illustrating in which case it would be useful?

because I think it's useful

Could you give an example illustrating in which case it would be useful?

because I think it's useful

Could you give an example illustrating in which case it would be useful?

In compose function, we usually need a fst as input, not a fsa. I think it's uesful in CTC graph construction, chain model numerator graph construction, and etc.

because I think it's useful

Could you give an example illustrating in which case it would be useful?

In compose function, we usually need a fst as input, not a fsa. I think it's uesful in CTC graph construction, chain model numerator graph construction, and etc.

When at least one of the two inputs is an FSA, use k2.intersect
When two inputs are both FSTs, use k2.compose

In compose function, we usually need a fst as input, not a fsa

Yes, that is true. We need two FSTs for k2.compose.
But I still don't get the point why a linear_fst is helpful here. aux_labels is good enough, I think.

When at least one of the two inputs is an FSA, use k2.intersect
When two inputs are both FSTs, use k2.compose

In compose function, we usually need a fst as input, not a fsa

Yes, that is true. We need two FSTs for k2.compose.
But I still don't get the point why a linear_fst is helpful here. aux_labels is good enough, I think.

linear_fst is just a wrapper function for combining linear fsa and aux_labels, and would to be more user-friendly.

linear_fst is just a wrapper function for combining linear fsa and aux_labels, and would to be more user-friendly.

FWIW I agree with @yaguanghu, I extensively used Pynini library in the past and found such APIs useful. In general I recommend checking out their examples for inspiration https://github.com/kylebgorman/pynini/tree/master/pynini/examples

FWIW I agree with @yaguanghu, I extensively used Pynini library in the past and found such APIs useful. In general I recommend checking out their examples for inspiration https://github.com/kylebgorman/pynini/tree/master/pynini/examples

I'm OK with creating such a function, I guess....
If the input and output labels will be the same, there should never be a
need to make an FST instead of an FSA.
In general I do want to encourage people to think in terms of FSAs and
auxiliary labels, because it will get them in a frame of mind
where they can try out more complex things with multiple auxiliary labels.
On Thu, Jan 21, 2021 at 1:14 PM Piotr Żelasko<EMAIL_ADDRESS>wrote:

FWIW I agree with @yaguanghu https://github.com/yaguanghu, I
extensively used Pynini library in the past and found such APIs useful. In
general I recommend checking out their examples for inspiration
https://github.com/kylebgorman/pynini/tree/master/pynini/examples
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/k2-fsa/snowfall/issues/77#issuecomment-764352821, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAZFLOYYRAGJE4CAP42BFSTS26Z3FANCNFSM4WIYOETA
.

I'm OK with creating such a function, I guess....
If the input and output labels will be the same, there should never be a
need to make an FST instead of an FSA.
In general I do want to encourage people to think in terms of FSAs and
auxiliary labels, because it will get them in a frame of mind
where they can try out more complex things with multiple auxiliary labels.
On Thu, Jan 21, 2021 at 1:14 PM Piotr Żelasko<EMAIL_ADDRESS>wrote:

FWIW I agree with @yaguanghu https://github.com/yaguanghu, I
extensively used Pynini library in the past and found such APIs useful. In
general I recommend checking out their examples for inspiration
https://github.com/kylebgorman/pynini/tree/master/pynini/examples
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/k2-fsa/snowfall/issues/77#issuecomment-764352821, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAZFLOYYRAGJE4CAP42BFSTS26Z3FANCNFSM4WIYOETA
.

I can implement the linear_fst function first, and will modify it after we find a more general representation.

I can implement the linear_fst function first, and will modify it after we find a more general representation.


npm install -g @cloudflare/wrangler Error: EACCES: permission denied, mkdir

🐛 Bug Report
NOTE:
Please fill out each section below before submitting your 🐛 bug report.
Before opening a new issue, please:

search for existing issues: https://github.com/cloudflare/wrangler/issues
make sure you are using the latest release: https://workers.cloudflare.com/docs/quickstart/updating-the-cli/

BUG REPORT TEMPLATE PROBLEM:
404 NOT FOUND on https://workers.cloudflare.com/docs/quickstart/updating-the-cli/
Environment

operating system: macOS 10.15.5 (output of sw_vers -productVersion)
output of rustc -V: rustc 1.45.2
output of node -v: v14.8.0
output of wrangler -V: 👷 ✨  wrangler 1.11.0 (after successful installation)
contents of wrangler.toml

Steps to reproduce

install nodejs using binary package installer, e.g. https://nodejs.org/en/download/
$ sudo npm install -g @cloudflare/wrangler
fake success message:

Downloading release https://workers.cloudflare.com/get-npm-wrangler-binary/1.11.0/x86_64-apple-darwin
wrangler has been installed!
+<EMAIL_ADDRESS>updated 1 package in 5.075s

attempt to verify successful installation: $ wrangler -V

Error: spawnSync /Users/jasoncoombs/.wrangler/bin/wrangler ENOENT
    at Object.spawnSync (internal/child_process.js:1070:20)
    at spawnSync (child_process.js:602:24)
    at Binary.run (/usr/local/lib/node_modules/@cloudflare/wrangler/node_modules/binary-install/src/binary.js:131:20)
    at run (/usr/local/lib/node_modules/@cloudflare/wrangler/binary.js:39:10)
    at Object.<anonymous> (/usr/local/lib/node_modules/@cloudflare/wrangler/run-wrangler.js:4:1)
    at Module._compile (internal/modules/cjs/loader.js:1251:30)
    at Object.Module._extensions..js (internal/modules/cjs/loader.js:1272:10)
    at Module.load (internal/modules/cjs/loader.js:1100:32)
    at Function.Module._load (internal/modules/cjs/loader.js:962:14)
    at Function.executeUserEntryPoint [as runMain] (internal/modules/run_main.js:72:12) {
  errno: -2,
  code: 'ENOENT',
  syscall: 'spawnSync /Users/jasoncoombs/.wrangler/bin/wrangler',
  path: '/Users/jasoncoombs/.wrangler/bin/wrangler',
  spawnargs: [ '-V' ]
}

google "Error: spawnSync wrangler"
read https://github.com/cloudflare/wrangler/issues/803
down the rabbit hole to #803

https://github.com/cloudflare/wrangler/issues/803#issuecomment-678593003

install nvm

$ nvm ls
->      v14.8.0
system
default -> node (-> v14.8.0)
node -> stable (-> v14.8.0) (default)
stable -> 14.8 (-> v14.8.0) (default)

10. `$ nvm install node`

Downloading and installing node v14.8.0...
Downloading https://nodejs.org/dist/v14.8.0/node-v14.8.0-darwin-x64.tar.xz...
############################################################################################################### 100.0%
Computing checksum with shasum -a 256
Checksums matched!
Now using node v14.8.0 (npm v6.14.7)
Creating default alias: default -> node (-> v14.8.0)

11. verify nvm version of npm instead of system-install:

$ which npm
/Users/jasoncoombs/.nvm/versions/node/v14.8.0/bin/npm

12. try again to npm install -g (note: no longer requires sudo but [probably?] nvm doesn't truly install wrangler globally):

$ npm install -g @cloudflare/wrangler
/Users/jasoncoombs/.nvm/versions/node/v14.8.0/bin/wrangler -><EMAIL_ADDRESS>
<EMAIL_ADDRESS>postinstall /Users/jasoncoombs/.nvm/versions/node/v14.8.0/lib/node_modules/@cloudflare/wrangler
node ./install-wrangler.js

Downloading release https://workers.cloudflare.com/get-npm-wrangler-binary/1.11.0/x86_64-apple-darwin
wrangler has been installed!

<EMAIL_ADDRESS>added 34 packages from 21 contributors in 3.732s
$ wrangler -V
👷 ✨  wrangler 1.11.0

13. SUCCESS

#### What did you expect to see?

wrangler global installation successful using system nodejs installation from global binary package installer

#### What did you see instead?

wrangler installation failed with `npm ERR! code ELIFECYCLE`

mandatory requirement for nvm (not explained in the documentation, not found in searching known Issues)

sh: 1: node: Permission denied
解决这个问题的方法如下
npm config set user 0
npm config set unsafe-perm true

As a new user to Cloudflare Workers, this really threw me for a loop. It's only in this thread that I've found nvm is a requirement. I use n to manage node versions so it's a bit of a pain too.

This bit us really hard for our CI containers, which just install nodejs and don't use nvm. We had to resort to installing wrangler via cargo which was a bit of a pain.

closing since it looks like the docs PR has been merged to recommend nvm as part of onboarding on the docs site.
@iandelahorne I think #1780 may be of interest to you, which allows you to configure exactly where you want to install wrangler which should be useful for CI.


Create Installer

Create simple installer package which will setup the correct DirectX version if needed.

Just a suggestion.. instead of creating a installer you could also include all necessary files using this Nuget: https://github.com/Fody/Costura
Regarding DirectX I would just make a check if it's installed and if not notify the user. :)

Hey @IDmedia thanks for the suggestion. I had some issues embedding the SlimDX.dll libraries with the app but I will give Costura a try.
I found an easy way to check and install dependencies with Inno setup so adding DirectX / .net 4.0 won't be a problem :)

@IDmedia I was able to use Costura :smile:
I have also created an installer that sets up all the required dependencies. You can find it here
https://github.com/djhansel/HyperionScreenCap/releases/latest


cant load kernel from hdd

hi, did try load kernel from attached hdd.
`Marvell>> ide reset
Reset IDE:
Marvell Serial ATA Adapter
Integrated Sata device found
Device 1 @ 0 1:
Model: Samsung SSD 850 PRO 256GB                Firm: EXM04B6Q Ser#: S1SUNSAG349096F
Type: Hard Disk
Supports 48-bit addressing
Capacity: 244198.3 MB = 238.4 GB (500118192 x 512)
Marvell>> fatinfo ide 0:1
error in mv_ide: queue command failed
** Can't read from device 0 **
** Unable to use ide 0:1 for fatinfo **
`
did try two hdds, formated with MBR and Fat32 or ext2. also did try primary and extednded partition :( same behaviour.
`Marvell Serial ATA Adapter
Integrated Sata device found
Device 1 @ 0 1:
Model: WDC WD20EFRX-68EUZN0                     Firm: 82.00A82 Ser#:      WD-WCC4M2XSFAU8
Type: Hard Disk
Supports 48-bit addressing
Capacity: 1907729.0 MB = 1863.0 GB<PHONE_NUMBER> x 512)
Marvell>> ext2ls ide 1:1
Failed to mount ext2 filesystem...
** Bad ext2 partition or disk - ide 1:1 **
Marvell>> ext2ls ide 0:1
** Bad partition - ide 0:1 **
Marvell>> ext2ls ide `
any hints hot to prepare the hdd?

tried another way of formating


Can't compile on Linux

Hi,
I'm trying to compile a demo. It worked on macOS, but I'm getting weird OpenGL errors even though I link everything properly:
gcc -I../src/ ../src/nanovg.c example_gl2.c demo.c perf.c -lglfw -pthread -lGL -lGLU -lX11 -lXxf86vm -lXrandr -lpthread -lXi -ldl -lm

In file included from example_gl2.c:27:0:
../src/nanovg_gl.h: In function ‘glnvg__blendFuncSeparate’:
../src/nanovg_gl.h:339:3: warning: implicit declaration of function ‘glBlendFuncSeparate’ [-Wimplicit-function-declaration]
   glBlendFuncSeparate(blend->srcRGB, blend->dstRGB, blend->srcAlpha,blend->dstAlpha);
   ^
../src/nanovg_gl.h: In function ‘glnvg__dumpShaderError’:
../src/nanovg_gl.h:402:2: warning: implicit declaration of function ‘glGetShaderInfoLog’ [-Wimplicit-function-declaration]
  glGetShaderInfoLog(shader, 512, &len, str);
  ^
../src/nanovg_gl.h: In function ‘glnvg__dumpProgramError’:
../src/nanovg_gl.h:412:2: warning: implicit declaration of function ‘glGetProgramInfoLog’ [-Wimplicit-function-declaration]
  glGetProgramInfoLog(prog, 512, &len, str);
  ^
In file included from example_gl2.c:27:0:
../src/nanovg_gl.h: In function ‘glnvg__createShader’:
../src/nanovg_gl.h:439:9: warning: implicit declaration of function ‘glCreateProgram’ [-Wimplicit-function-declaration]
  prog = glCreateProgram();
         ^
../src/nanovg_gl.h:440:9: warning: implicit declaration of function ‘glCreateShader’ [-Wimplicit-function-declaration]
  vert = glCreateShader(GL_VERTEX_SHADER);
         ^
../src/nanovg_gl.h:443:2: warning: implicit declaration of function ‘glShaderSource’ [-Wimplicit-function-declaration]
  glShaderSource(vert, 3, str, 0);
  ^
../src/nanovg_gl.h:447:2: warning: implicit declaration of function ‘glCompileShader’ [-Wimplicit-function-declaration]
  glCompileShader(vert);
  ^
../src/nanovg_gl.h:448:2: warning: implicit declaration of function ‘glGetShaderiv’ [-Wimplicit-function-declaration]
  glGetShaderiv(vert, GL_COMPILE_STATUS, &status);
  ^

I get the same result when using premake.
Please help :) Thanks

Ok I managed to compile it by adding -lGLEW and removing the graph (for some reason it was still complaining about glBeginQuery even after linking with GLEW).
Unfortunately now I get a segmentation error...

Probably you have outdated GL headers in system. GLEW crashed because initial code do not use GLEW and do not initialize it.

Thanks @lieff
OpenGL stuff was fine when I was calling it from Go.
Do you know how I can fix this? I tried updating mesa-common-dev without any luck.

Thanks @lieff
OpenGL stuff was fine when I was calling it from Go.
Do you know how I can fix this? I tried updating mesa-common-dev without any luck.

@medvednikov Hmm, look like I'm wrong. Original code uses glew. And -lGLEW present in makefile generated by premake4 gmake.


Multipart formdata

Hi!
I created a multipart/form-data request handler to also support those requests. Although I tried to minimize the amount of changes I couldn't get around changing the Request.Data.content to HttpContent[Any, Byte] instead of HttpContent[Any, String]. You probably have some better ideas about this setup than I do so I just want to put this out here and hear your thoughts on this.
Best,
DJ

io.netty.Buffer.Bytebuf is a mutable, unsafe data structure and also exposes implementation details. It would be great if we could come up with a performant immutable indirection.

@tusharmath io.netty.Buffer.Bytebuf is indeed mutable and pretty tricky to work with. Take the messagecodec for example: you need to use this utility function because just using .content.array() will throw exceptions caused by mixed reader and writer indices.
Personally, I like offering HttpContent[Any, Byte] because it allows for lots of flexibility, also for non-text content-type. With some added utils like asString it still pretty easy to use. I do understand though that this train of thought conflicts with the current API.  Also, you probably already have ideas on how to offer streaming request bodies as I saw some discussion on Discord? I am happy to wait for those design details and then adjust this PR to that interface? The handler doesn't have to change that much; just the way the data is offered to the zio-http API.

@tusharmath what are your thoughts on my comment?
Also another question: I see that headers is part of Request.Data and not of Request directly. In the Response, it's directly part of Response and not of its data. I'm probably missing something; what's the reason for that?

I'll take a look at this PR today.

Also another question: I see that headers is part of Request.Data and not of Request directly. In the Response, it's directly part of Response and not of its data. I'm probably missing something; what's the reason for that?

Yes, I also think we don't need Request.Data anymore.

Rebased and updated. Removing Draft as more structural changes required at the time have landed in main.
I think this Tapir PR is waiting for this.
Note that it seems we're also affected by this Netty bug that should be resolved in the next patch release.

Response.scala
sealed trait Response[-R, +E]

object Response {
  case class HttpResponse(status: Status, headers: List[Header], content: HttpData[R, E]) extends Response[R, E]
  case class SocketResponse[-R, +E](socket: SocketApp[R, E]) extends Response[R, E]

  // Responses with the prefix `ReadAs` is used to signal the server to change the channel handler.
  // Based on the response various channel handlers can be created.
  case class ReadAsComplete(cb: HttpData.CompleteData[] => HttpApp[R, E]) extends Response[R, E]
  case class ReadAsMultipart(cb: HttpData.MultipartFormData => HttpApp[R, E]) extends Response[R, E]
}

This is how we will respond to a multipart request.
MultipartExample.scala
Http.collect[Request] {
  case GET -> Root / "upload" => Response.AsMultipart { fd =>
    HttpApp.response(Response.HttpResponse(Status.OK, Nil, size(fd)))
  }
}

This is how we can process the responses
ServerRequestHandler.scala
def channelRead(ctx: ChannelHandlerContext, msg: HttpRequest) = {
  ctx.channel.config.setAutoRead(false) // Stop reading bytes for now.
  executeAsync(app(msg)) {
     case HttpResponse() => ??? /// continue as before
     case ReadAsMultipart() =>
       /// Remove the current handler
       /// Add the multipart handler
       ctx.channel.read() // Read the channel in chunks now.
     case ReadAsComplete() =>
       /// Add HttpObjectAggregator
      ctx.channel.read()
  }
}

We can further cleanup the MultipartExample as follows —

TODO: (will add an example)

Nice approach! Have been busy but I expect to be able to give this some time later this week.

We will support this via the content-decoder API. Thanks @DJLemkes !


Wiring shortcut

[x] New feature (non-breaking change which adds functionality)

Adds a pair of new actions for wiring nodes.

core:wire-series-of-nodes - for a selection of nodes, add a wire (if necessary) between each node pair in the order they exist in the selection
core:wire-node-to-multiple - for a selection of nodes, wires the first node (the source) in the selection to all of the remaining nodes. If the source node has multiple outputs, they are wired in turn.

No default keyboard shortcut assigned to them (yet)... something to consider adding.

Coverage remained the same at 67.356% when pulling 5856d043ca89a09dc91df55941916edd7823c172 on wiring-shortcut into 7cd3e49f04f30b8c23a89fe08d6c984b68ce7be8 on dev.


Event 'input' not triggering

Similar to the https://github.com/plentz/jquery-maskmoney/issues/19 but using the "input" event.

Is there any progress on this issue?

Any chance this will get fixed soon?  I would love to use this plug-in but can't because of this issue

Hi, will this bug ever be fixed?

This is again (or still) a problem in jquery-maskmoney - v3.1.1.

This should works
.on('keyup.maskMoney', function () {});

I'm using:
document.getElementById(idElement).addEventListener("blur", () => function(){}));
But this problem exist, yet.
I wrote this lib monitorFormChange, but this soluction is not the best for me.

It seems to me that the 'onInput' bug persists.
Depending on your objective, onFocus and onFocusout work normally, for me, it worked.


[Snyk] Security upgrade node from 18.12.1 to 18.18.2

This PR was automatically created by Snyk using the credentials of a real user.Keeping your Docker base image up-to-date means you’ll benefit from security fixes in the latest version of your chosen image.
Changes included in this PR

Dockerfile

We recommend upgrading to node:18.18.2, as this image has only 160 known vulnerabilities. To do this, merge this pull request, then verify your application still works as expected.
Some of the most important vulnerabilities in your base image include:

Severity
Priority Score / 1000
Issue
Exploit Maturity

829
Out-of-bounds Write SNYK-DEBIAN11-LIBWEBP-5893094
Mature

829
Out-of-bounds Write SNYK-DEBIAN11-LIBWEBP-5893094
Mature

829
Out-of-bounds Write SNYK-DEBIAN11-LIBWEBP-5893094
Mature

829
Out-of-bounds Write SNYK-DEBIAN11-LIBWEBP-5893094
Mature

829
Resource Exhaustion SNYK-DEBIAN11-NGHTTP2-5953384
Mature

Note: You are seeing this because you or someone else with access to this repository has authorized Snyk to open fix PRs.
For more information:
🧐 View latest project report
🛠 Adjust project settings

Learn how to fix vulnerabilities with free interactive lessons:
🦉 Resource Exhaustion

UPDATED NODE FOR SECURITY


image transfer

How long should it take to load the files from a player? Using the image transfer program?

Player found at:  ('<IP_ADDRESS>', 60001)
1 player found
Exception in thread Thread-22:
Traceback (most recent call last):
File "C:\Users\Peter Neunteufel\Documents\GitRepos\raspmedia\Desktop\build\RMI
mageTransfer\out00-PYZ.pyz\threading", line 810, in __bootstrap_inner
File "C:\Users\Peter Neunteufel\Documents\GitRepos\raspmedia\Desktop\build\RMI
mageTransfer\out00-PYZ.pyz\threading", line 763, in run
File "C:\Users\Peter Neunteufel\Documents\GitRepos\raspmedia\Desktop\build\RMI
mageTransfer\out00-PYZ.pyz\packages.rmnetwork.tcpfilesocket", line 37, in _openS
ocket
File "C:\Users\Peter Neunteufel\Documents\GitRepos\raspmedia\Desktop\build\RMI
mageTransfer\out00-PYZ.pyz\packages.rmnetwork.tcpfilesocket", line 18, in readIn
t
IndexError: bytearray index out of range
error i get


mock up frame_time history for mp4s without time stamps

this was handled in a way that should allow the syncrhonization to work provided that all mp4 files hae ve synchronized first and last frames. Different frame rates/frame drops should be ok and managed in a reasonable way by the Synchronizer.


Feature Request: add an option to disable whole line prediction for IntelliCode for C# Dev Kit

Product and Version: Visual Studio Code 1.88.0
OS Version: Windows_NT x64 10.0.22631
IntelliCode Extension Version: 1.3.1
IntelliCode for C# Dev Kit Version: 2.0.25
Target Platform or Language: C#
Please, add an option to disable whole line predictions for C# and have only member ranking enabled.
Such settings already exist for JavaScript, TypeScript and Python under the IntelliCode Completions extension.

Thanks for the suggestion, that should be straightforward to implement. I'll try to address that in the next release.


remove unreached code in AllreduceRobust::CheckAndRecover

@chenqin Feels like spring cleaning for rabit.

Yeah, just live a notes here. The way it restore connection is problematic when you have large cluster. We might needs to put more thoughts on how to deal with single worker recovery without swamp tracker...


Port to Godot 3.3.2 & GLES2

I've fixed what bugs I can find with porting it to the newer version but I haven't gotten gud enough to actually win the danmaku or platformer.

as per usual most of these file changes are done by Godot automatically


feat: DEV-3595: Improve repeater tests

Hi @Travis1282!
This PR was created in response to a PRs in upstream repo:

https://github.com/heartexlabs/label-studio-frontend/pull/946

already merged


Reset sleep timer/wake up when receiving CDC data

Random late late night "that'll be easy" thought... and it was as soon as I actually flashed the modified firmware... :facepalm:  :yawning_face:

Thank you. I've had these random late night thoughts and they never end well :grimacing:


More alternatives

This PR adds EitherOfFour and EitherOfFive to the list of alternatives.
This PR also fixes test for EitherOfThree which previously checked wrong iterator instances for the end of iteration.
Spine version advanced to 0.10.23-SNAPSHOT.

@armiol, PTAL.


macddrsetup: fix coding style issues

This patch resolves the warnings & errors detected against checkpatch.pl script
This patch migrates to the code to use OCTAL Permissions.
Improves code readability.

TESTS :- Compile the binary after the patches.
Signed-off-by: dev-harsh1998<EMAIL_ADDRESS>

@jerpelea Its done


processed_data download address is not valid.

”processed_data/: contains processed (or derivative) data required to generate figure panels in the Jupyter Notebooks. Data can be accessed here.“
The address is not valid, can you update the latest address? Thanks!

apologies! the link has been updated: https://drive.google.com/drive/folders/1ooZgxGzVtkgHmeZz7BZI79qcYML2XFwX?usp=sharing


Disable travis and component update version to 2.4

Related Issue:  open-cluster-management/backlog#10511
Description of changes

Updated component version to 2.4
Disabled Travis jobs for main and release-2.4.  Moving to prow.

/hold

/lgtm

/unhold


Multiple issues with indentation in particle process material shader

Godot version
4.2
System information
Fedora, RX 590
Issue description
Post https://github.com/godotengine/godot/pull/79527, a lot of indentation issues have been introduced in thegenerated shader of the particle process material. They need to be fixed.
Steps to reproduce
n/a
Minimal reproduction project
n/a

As discussed in another PR, this should be refactored (after 4.2) to use R-strings, which would allow making all this much easier to read and thus to enforce indentation and style guidelines.

One day, I hope we can move it to a shader with defines. Is there any example of anything else that uses R strings in the repo that I can look at?

SkyMaterial does, but unsure if anything that has dynamic code like this does currently


Updated field is displaying correctly in MacOS Preview, but not Adobe Acrobat

I'm able to read and save PDF with the below code.  However, for some reason, the field I'm updating to is not showing correctly in Adobe Acrobat.  I've already set the 'NeedAppearances' on both the form and the individual field.  After saving the PDF, I see in MacOS Preview the field is displaying email<EMAIL_ADDRESS>properly, however, when opening in Adobe Acrobat, the email is not displaying.  Any help is greatly appreciated!
Input test.pdf:
test.pdf

        const pdfDoc = await PDFDocument.load(fs.readFileSync('./test.pdf'));

        // Need below to show the updated values properly
        // This has to be done before the fill in fields calls
        const acroForm = pdfDoc.context.lookup(
            pdfDoc.catalog.get(PDFName.of('AcroForm')),
            PDFDict,
        );
        acroForm.set(PDFName.of('NeedAppearances'), PDFBool.True);

        const rootFields = getRootAcroFields(pdfDoc);

        const fields = [];
        for (let idx = 0, len = rootFields.length; idx < len; idx++) {
            fields.push(...recurseAcroFieldKids(rootFields[idx]));
        }

        function hex2a(hexx) {
            var hex = hexx.toString();//force conversion
            var str = '';
            for (var i = 0; (i < hex.length && hex.substr(i, 2) !== '00'); i += 2)
                str += String.fromCharCode(parseInt(hex.substr(i, 2), 16));
            return str;
        }

        let index=0;
        const myFields = fields.map((field) => pdfDoc.context.lookup(field));
        myFields.forEach( field => {
            index++;

            const name = field.get( PDFName.of( 'T' ));
            let nameValue = name.value;

            // If field name is of type PDFHexString it has been encoded as contained extended
            // unicode characters. Need to decode them now.
            // For example: €_6 may be encoded in hex as "FEFF 20AC 005F 0036". Note,
            // first 4 characters (FEFF) are a 'ZERO WIDTH NO-BREAK SPACE'/BOM unicode character that may be
            // ignored. Could be acting as a BOM as well.
            if(name instanceof PDFHexString) {
                // Remove any 'ZERO WIDTH NO-BREAK SPACE'/BOM unicode characters and split into groups of 4 characters.
                let parts = nameValue.replace('FEFF', '').match(/[\s\S]{1,4}/g) || []
                nameValue = ''
                for(let i = 0; i < parts.length; i++) {
                    // Reconstruct string.
                    nameValue += String.fromCharCode(parseInt(parts[i], 16))
                }
            }

            if ( name ) {
                const value = field.get( PDFName.of( 'V' ));
                console.log(index, "field name", nameValue, "value", value);

                if(nameValue === "Email_ft[0]") {
                    field.set(PDFName.of('NeedAppearances'), PDFBool.True);
                    field.set(PDFName.of('V'), PDFString.of("test@test.com"));
                    field.set(PDFName.of('AP'), PDFName.of('N'));
                    field.set( PDFName.of( 'Ff' ), PDFNumber.of( 1 ));
                }
            }
        });
        console.log('Total fields:', fields.length);

        fs.writeFileSync( './test-output.pdf', await pdfDoc.save());

Hello @suspiration!
pdf-lib has a new form filling API that should solve this problem for you. Please see the form filling example.
I hope this helps. Please let me know if you have any additional questions!


fixed cor_xy_an for precip by removing conv

@doutriaux1  oops... missed a push....

@gleckler1 probably need to update tests 😉


kademlia-<IP_ADDRESS> test suite runs too long

Hi, we packaged kademlia on NixOS, but unfortunately our central builds fail with a timeout error during the test suite run. Is it normal for that test suite to run for 2+ hours? Please see http://hydra.nixos.org/build/25334361/log/raw for a complete build log.

The tests take 55 seconds on my laptop, so I can't realy imagine it taking 2+ hours, even on a busy hydra.
This probably means that something goes wrong during those tests, but I can't think of anything that could cause the tests not to finish.
There is a lot of stuff being sent between sockets during the tests, could that be a problem on a hydra?

Does the test suite depend on a nameserver or an public Internet access? Because those options are unavailable to Hydra builds.

Nope, all the communication is between UDP sockets on localhost in the portrange of 1123-1142.
A failure to connect should result in a failure of the test, though, so that shouldn't be a problem.

Well, in that case I'm not sure how to explain this phenomenon. The test ran on i686. Maybe that makes a difference?

I’m currently running the tests on my ThinkPad X40 (Which is i686). I started them about 20 minutes ago, and they are still running.

The same happens for windows 10 (which is x86-64).


there is no hyperlink of GNSS_EVENT

There is no hyperlink of GNSS_EVENT in Output buffer section.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 60830c64-b814-907f-ce2a-21ced5b603a5
Version Independent ID: ff043a76-f3fa-93d3-6b0e-545dd8ab9dc3
Content: IOCTL_GNSS_LISTEN_ERROR (gnssdriver.h) - Windows drivers
Content Source: wdk-ddi-src/content/gnssdriver/ni-gnssdriver-ioctl_gnss_listen_error.md
Product: windows-hardware
Technology: windows-devices
GitHub Login: @barrygolden
Microsoft Alias: bagold

Fixed in source and confirmed on live site.
Thanks!!
Eliot


Revert net.SortIPs usage

net.SortIPs doesn't work with '<addr>:<port>' strings. Switch back to standard functions
JIRA: OSPRH-9565

/lgtm

/test octavia-operator-build-deploy-kuttl

/test octavia-operator-build-deploy-kuttl


Editorconfig

As a learner, I do not want auto-format to introduce large changes so that I can easily see and revert my own changes.
Acceptance criteria:

Add an .editorconfig file to ensure that all contributions use the same code style.
Format all current files with this code style.
Re-enable auto format on save in the settings.json (see: #179).

Addendum: Visual Studio Code requires a separate plugin for .editorconfig support:
https://editorconfig.org/#download links to https://marketplace.visualstudio.com/items?itemName=EditorConfig.EditorConfig


This still have support by creator?

Does not seem like this repo is actively supported at the moment.
you can use the fork Transcribe - https://github.com/vivekuppal/transcribe
which seems to be have active resolution of any reported issues and many more features as compared to ecoute


Group section failure

https://github.com/UIUC-PPL/charm/tree/debug_groupsection
I want to implement the case where there are 2 PEs, (PE0 and PE2) creating one section each involving all chare elements.
For each section, it will do a broadcast call to recvMsg , reduce to repeat, increment iteration count and then repeat.
The code does compile but the run hangs.

Charm++> Running on MPI version: 3.1
Charm++> level of thread support used: -1 (desired: 0)
Charm++> Running in SMP mode: 4 processes, 1 worker threads (PEs) + 1 comm threads per process, 4 PEs total
Charm++> The comm. thread both sends and receives messages
Converse/Charm++ Commit ID: v7.1.0-devel-37-ga84e4523f
Charm++ built with internal error checking enabled.
Do not use for performance benchmarking (build without --enable-error-checking to do so).
Charm++: Tracemode Projections enabled.
Trace: traceroot: /home/simengl2/School/cp_charm/examples/charm++/groupsection/trace/check_proj
Isomalloc> Synchronized global address space.
CharmLB> Load balancer assumes all CPUs are same.
Charm++> Running on 1 hosts (2 sockets x 20 cores x 1 PUs = 40-way SMP)
Charm++> cpu topology info is gathered in 0.002 seconds.
Numpes: 4
Leader [0] :: broadcast groupId 10 CkMulticastMgr * 0x7fffdc0403d0
Leader [2] :: broadcast groupId -1073741825 CkMulticastMgr * 0x7fffdc04a3b0
PE [2] :: sectionBcastMsg received from Leader [0] @ iteration 1 groupId 10 CkMulticastMgr* 0x7fffdc03e6c0
PE [0] :: sectionBcastMsg received from Leader [0] @ iteration 1 groupId 10 CkMulticastMgr* 0x7fffdc0403d0
PE [1] :: sectionBcastMsg received from Leader [0] @ iteration 1 groupId 10 CkMulticastMgr* 0x7fffdc03e6c0
PE [3] :: sectionBcastMsg received from Leader [0] @ iteration 1 groupId 10 CkMulticastMgr* 0x7fffdc03e6c0
Leader [0] Iteration 1
PE [0] :: sectionBcastMsg received from Leader [0] @ iteration 2 groupId 10 CkMulticastMgr* 0x7fffdc0403d0
PE [0] :: sectionBcastMsg received from Leader [2] @ iteration 1 groupId -1073741825 CkMulticastMgr* 0x7fffdc03fdc0
Leader [0] Iteration 2
PE [2] :: sectionBcastMsg received from Leader [0] @ iteration 2 groupId 10 CkMulticastMgr* 0x7fffdc03e6c0
PE [2] :: sectionBcastMsg received from Leader [2] @ iteration 1 groupId -1073741825 CkMulticastMgr* 0x7fffdc04a3b0
PE [1] :: sectionBcastMsg received from Leader [0] @ iteration 2 groupId 10 CkMulticastMgr* 0x7fffdc03e6c0
PE [1] :: sectionBcastMsg received from Leader [2] @ iteration 1 groupId -1073741825 CkMulticastMgr* 0x7fffdc03f970
PE [3] :: sectionBcastMsg received from Leader [0] @ iteration 2 groupId 10 CkMulticastMgr* 0x7fffdc03e6c0
PE [3] :: sectionBcastMsg received from Leader [2] @ iteration 1 groupId -1073741825 CkMulticastMgr* 0x7fffdc03f970
PE [0] :: sectionBcastMsg received from Leader [0] @ iteration 3 groupId 10 CkMulticastMgr* 0x7fffdc0403d0
PE [2] :: sectionBcastMsg received from Leader [0] @ iteration 3 groupId 10 CkMulticastMgr* 0x7fffdc03e6c0
PE [3] :: sectionBcastMsg received from Leader [0] @ iteration 3 groupId 10 CkMulticastMgr* 0x7fffdc03e6c0
PE [1] :: sectionBcastMsg received from Leader [0] @ iteration 3 groupId 10 CkMulticastMgr* 0x7fffdc03e6c0


Add LD_RUNPATH_SEARCH_PATHS to app-extension preset

This was added to the iMessage extensions, but it seems that it's required for an action extension to work as well.

Wow, quick pull 😍


${userHome} in a task command creates bad paths

Does this issue occur when all extensions are disabled?: Yes/No

VS Code Version: 1.87.2
OS Version: Windows_NT x64 10.0.22631

Steps to Reproduce:

Create a tasks.json with a task command that looks like this:

"command": "${userHome}/myfolder/my.exe",
"type": "process"

The variable works if you set it to be type shell and the default shell is pwsh and not git bash. But if set to type process it results in a path like:

/c:/Users/myuser/myfolder/my.exe

With an error like: "The terminal process could not be started: The path to the executable shell file "\c:\Users\myuser\myfolder\my.exe" does not exist.
NOTE: The task does work if I use ${env:USERPROFILE} instead of ${userHome}, as env:USERPROFILE results in a path like C:\Users\myuser/myfolder/my.exe to be executed.

I faced a similar issue where ${userHome} is recognized as ${workspaceFolder}. I'm using VSCode Macros and tried to set the following config:
    "vscodemacros.macroFilePath": "${userHome}${/}personal${/}vscodemacros${/}macros.js",

However I got the following error message:
'/Users/yoshifumi/personal/foo_workspace/$$personal$vscodemacros$macros.js' not found.```

${userHome} should be recognized as /Users/yoshifumi but it was treated as /Users/yoshifumi/personal/foo_workspace/ which is the directory name that I was opening in VS Code.
My environment info is as the following:
Version: 1.88.1 (Universal)
Commit: e170252f762678dec6ca2cc69aba1570769a5d39
Date: 2024-04-10T17:42:52.765Z (6 days ago)
Electron: 28.2.8
ElectronBuildId: 27744544
Chromium: 120.0.6099.291
Node.js: 18.18.2
V8: 12.0.267.19-electron.0
OS: Darwin arm64 23.4.0

I face a similar issue on Windows where userHome does not always resolve to env:USERPROFILE.
See: https://github.com/raspberrypi/pico-vscode/issues/100
Though I guess I should open another ticket really.


Typo in WebSocketServerExtension?

Is it a typo WebSocketServerExtension.newReponseData()? Reponse instead of Response.
Sorry if it's normal. I'm not strong in the English )

Looks like a typo to me. However since its an interface, and we can't use default methods bcz we support jdk6 ... I'm not really sure what we can do here.

May be just add TODO in the code now, and make this deprecated (with default method) after migrated to JDK 8?

+1 can you do a pr?

Am 08.03.2017 um 07:04 schrieb Nikolay Fedorovskikh<EMAIL_ADDRESS>May be just add TODO in the code now, and make this deprecated (with default method) after migrated to JDK 8?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.

done #6514


Release/Revision Change_Requests_Accepted.md

This issue was created to collect comments about the upcoming metrics release.
This thread is for comments about Change_Requests_Accepted.md
GitHub location: https://github.com/chaoss/wg-evolution/blob/master/metrics/Change_Requests_Accepted.md
See all release candidates at: https://chaoss.community/metrics/

Name change revision - From "reviews to "change request"

Change Request LGTM!
Signed-Off-By<EMAIL_ADDRESS>

closing for release

This metric should be reviewed. There is a filter for this metric that is very close to another metric (Change Request Acceptance Ratio) so we could clarify this a little better (or at least reference the other metric). We may want to rethink how the Change Request metrics relate to each other.


[BUG] notes import truncates name if filename has a space in it

Describe the bug
The 'notes import' command truncates filenames that include a space in them. A filename called "My File.txt" will be imported as "My.gpg"
The content of the note will still be imported but the filename will be truncated a the first space
This is because of the globbing being used.

This will require some refactoring of the function for importing
The current behaviour of the other functions such as add and delete is that the script shifts the subcommand out of ARGV and then the rest of the line is the note title.
However, during coding I found that tweaking some of these lines broke imports with spaces in the directories so initially to get version 1.0 out I decided to keep this bug in the code for a little while longer until I had the main features in the latest release


Add Postgres 15 to docker compose

Adds Postgres 15 to docker compose file. (We already use it for integration tests)

Codecov Report

Merging #366 (28cc685) into main (8981a23) will not change coverage.
The diff coverage is n/a.

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #366   +/-   ##
=======================================
  Coverage   42.97%   42.97%
=======================================
  Files         118      118
  Lines        8242     8242
=======================================
  Hits         3542     3542
  Misses       4700     4700


chore: downgrade to spark3.3

Related Issues/PRs

#xxx
What changes are proposed in this pull request?
Briefly describe the changes included in this Pull Request.
How is this patch tested?

[ ] I have written tests (not required for typo or doc fix) and confirmed the proposed feature/bug-fix/change works.

Does this PR change any dependencies?

[ ] No. You can skip this section.
[ ] Yes. Make sure the dependencies are resolved correctly, and list changes here.

Does this PR add a new feature? If so, have you added samples on website?

[ ] No. You can skip this section.
[ ] Yes. Make sure you have added samples following below steps.

Find the corresponding markdown file for your new feature in website/docs/documentation folder.
Make sure you choose the correct class estimators/transformers and namespace.
Follow the pattern in markdown file and add another section for your new API, including pyspark, scala (and .NET potentially) samples.
Make sure the DocTable points to correct API link.
Navigate to website folder, and run yarn run start to make sure the website renders correctly.
Don't forget to add <!--pytest-codeblocks:cont--> before each python code blocks to enable auto-tests for python samples.
Make sure the WebsiteSamplesTests job pass in the pipeline.

/azp run

/azp run

/azp run

Codecov Report
Attention: 4 lines in your changes are missing coverage. Please review.

Comparison is base (522661a) 86.21% compared to head (2aaa5c6) 11.90%.

Files
Patch %
Lines

...spark/ml/recommendation/RecommendationHelper.scala
0.00%
3 Missing :warning:

...osoft/azure/synapse/ml/core/env/PackageUtils.scala
0.00%
1 Missing :warning:

Additional details and impacted files
@@             Coverage Diff             @@
##           master    #2141       +/-   ##
===========================================
- Coverage   86.21%   11.90%   -74.31%
===========================================
  Files         312      312
  Lines       16483    16325      -158
  Branches     1462      856      -606
===========================================
- Hits        14211     1944    -12267
- Misses       2272    14381    +12109

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

/azp run

/azp run

/azp run


Monk (level 3) health correction

Ardougne monastery. Accidentally hit one and realised the health is wrong.

Seems correct 👍


improve sys::xcopy method

In some cases, the return statement is wrong. Check if folder exists before processing will fix this.

done.