cmd to join new computes

Is your feature request related to a problem? Please describe.
we need a command to join new computes after the cluster has been created.
Describe the solution you'd like
something like grow_cluster -f ./new_inventory_file
Describe alternatives you've considered
maybe just a tag in the ansible playbook?
Additional context
this could apply to different scenarios:

adding new compute hardware to existing cluster
adding cloud infrastructure to existing cluster

Definitely a needed feature. I think the right approach might be to make startworkers the place where this happens, i.e., startworkers is really just grow_cluster beyond a cluster of 1 node.

If we are considering the refactoring task that's being discussed in #139, then we could have multiple main playbooks for these different operations within the omnia namespace:
omnia.create
omnia.destroy
omnia.grow
omnia.shrink

So omnia.grow might accept an inventory file where the manager is already operational, but compute hosts need to be added. Similarly, omnia.shrink might accept an inventory file where the manager is already operations, but compute hosts need to be removed.
omnia.create is basically the omnia.yml proposed in #139, while omnia.destroy is a playbook-based version of scuttle (see #83).

Commenting to prevent this issue from being closed. I think this is a really important capability that we should continue to develop.


Failing to install from CRAN

Our nightly tests for sparklyr started failing when trying to install sparklyr from CRAN. This is the error:
ERROR: dependency ‘dbplyr’ is not available for package ‘sparklyr’

We use install.packages("sparklyr", repos = "https://cloud.r-project.org") for installation.

@falaki I just tried from scratch and the installation worked correctly, are we sure this is not intermittent? Here is the head/tail of my installation, are you still hitting this?
R version 3.3.3 (2017-03-06) -- "Another Canoe"
Copyright (C) 2017 The R Foundation for Statistical Computing
Platform: x86_64-redhat-linux-gnu (64-bit)

R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.

  Natural language support but running in an English locale

R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.

Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.

> install.packages("sparklyr", repos = "https://cloud.r-project.org")

...

** building package indices
** testing if installed package can be loaded
* DONE (sparklyr)

Turns out our environment had an old version of Rcpp. Updating that fixed the issue.


Mellanox SN2010 loading

The video showing flashing the SN2010 image in the wiki seems to actually show the process for a  Delta TN48M and not a Mellanox SN2010.
Can this be updated to show the process for loading the SN2010 image on an actual SN2010?

Good catch, we will replace the asciinema video with appropriate one for the SN2010 platform.

The Mellanox SN2010 wiki page has been updated with appropriate asciinema videos.


Is there a way to skip the initial injection prompt?

Sorry if this is dumb, but I didn't see anything in the config that indicated a way to inject without confirmation. Is there a way to do that?

Try making a shortcut, and giving -a load as parameters.

Copy XivAlexanderLoader32/64.exe, right click on window background, and Paste shortcut.
Right click on newly created shortcut, select Properties, and append  -a load to Target.

Thanks! I saw the command line arguments and figured the solution was there, but wasn't sure where to put them (even though I've done that before with shortcuts).


Why there exist major differences when translate instruction to PcodeOp and PcodeOpAST?

Hello, I am a beginner to Ghidra. I am trying to use the PcodeOp to analyze the data flow within a binary. I understand the PcodeOpAST/VarnodeAST is the traceable structures (Forward/Backward Slice Supported) used by decompiler. However, I noticed the PcodeOpsAST generated from pcode syntax tree (highfunction) is difficult to understand. I can barely trace the data flow by reading the PcodeOpASTs. In contrast, the PcodeOps generated from instruction in same address is more readable but untraceable.
Here I have one example to better explain the situation.
The instruction address is 0x00401bc4 : JMP qword ptr [0x409c60 + RAX*0x8]
Here is the PcodeOpASTs generated from highfunction (highfunction.getPcodeOps(Address)).
('PcodeOpAST',  ---  BRANCHIND (register, 0x0, 4), 'Seqnum', (ram, 0x401bc4, 166, 8))
('PcodeOpAST', (register, 0x1, 7) INT_ZEXT (unique, 0x100004e1, 3), 'Seqnum', (ram, 0x01bc4, 15441, 5))
('PcodeOpAST', (unique, 0x100004e1, 3) SUBPIECE (unique, 0x10002039, 4) , (const, 0x0, 4), 'Seqnum', (ram, 0x401bc4, 15444, 4))
('PcodeOpAST', (unique, 0x10002039, 4) INT_RIGHT (unique, 0x1000257c, 4) , (const, 0x8, 4), 'Seqnum', (ram, 0x401bc4, 27678, 3))
('PcodeOpAST', (unique, 0x1000214e, 8) COPY (register, 0xb0, 8), 'Seqnum', (ram, 0x401bc4, 27714, 6))
('PcodeOpAST', (unique, 0x100022da, 4) COPY (register, 0x8, 4), 'Seqnum', (ram, 0x401bc4, 27766, 7))
('PcodeOpAST', (unique, 0x1000257c, 4) CAST (register, 0x0, 4), 'Seqnum', (ram, 0x401bc4, 27868, 2))
According to the results, I do not see any PcodeOp related to memory address 0x409c60 which is involved in the jump table address calculation. In fact, I can barely understand the meaning of those PcodeOpASTs.
Here is the PcodeOps of same address from Instruction (instruction.getPCode()).
('PCodeOp:', (unique, 0x3480, 8) INT_MULT (register, 0x0, 8) , (const, 0x8, 8), 'Seqnum', (ram, 0x401bc4, 0, 0))
('PCodeOp:', (unique, 0x3580, 8) INT_ADD (const, 0x409c60, 8) , (unique, 0x3480, 8), 'Seqnum', (ram, 0x401bc4, 1, 0))
('PCodeOp:', (unique, 0xbd80, 8) LOAD (const, 0x1b1, 4) , (unique, 0x3580, 8), 'Seqnum', (ram, 0x401bc4, 2, 0))
('PCodeOp:',  ---  BRANCHIND (unique, 0xbd80, 8), 'Seqnum', (ram, 0x401bc4, 3, 0))
Here the result is more readable. We can see the register RAX and address 0x409c60 are both used to determine the jump table address.
I do not understand why there are huge differences of PcodeOps and PcodeOpASTs both generated from same address. Please let me know if there are better ways to get the data flow of a program especially I can easily apply backward slice. Thanks for your time!

In a nutshell there are at least two groups of rules which influence this: heritage and various optimizations. Heritage adds INDIRECT, MULTIEQUAL, PTRADD, PTRSUB, CAST ops. Optimizations usualy replace one set of ops with other ones but not very correctly sometimes like replacing array manipulations (SUBPIECE, CONCAT, ZEXT, SEXT) with ANDs, ORs, RIGHTs, SRIGHTs, LEFTs etc with array datatypes whereas only number datatypes can be manipulated such way.

In a nutshell there are at least two groups of rules which influence this: heritage and various optimizations. Heritage adds INDIRECT, MULTIEQUAL, PTRADD, PTRSUB, CAST ops. Optimizations usualy replace one set of ops with other ones but not very correctly sometimes like replacing array manipulations (SUBPIECE, CONCAT, ZEXT, SEXT) with ANDs, ORs, RIGHTs, SRIGHTs, LEFTs etc with array datatypes whereas only number datatypes can be manipulated such way. Every rule's applicability is dictated by expected ops and additional checks then either more ops are added, some are removed or replaced with others simultaneously. Or there will be return with 0 code without changes (else 1 on success).

Thanks for the explanation! I did not realize the PcodeOpASTs can be optimized. Is there any way I can make the optimized PcodeOpASTs more readable? For instance, how can I get the values involved in jump table calculation? Right now the optimized Pcode is very hard to understand.

Maybe there is some way to view those ops slightly differently but generally no, you can't do anything special about that like deoptimize something. Jump table calculation should be done using emulation via SoftModelling module. Remeber that decompiler first searches guard which defines range of values (comparison ops limiting usual cases after which default case is used) and then starts emulation on all of these values (except default cases of course).

Maybe there is some way to view those ops slightly differently but generally no, you can't do anything special about that like deoptimize something. Jump table calculation should be done using emulation very first (sleigh generated) ops via SoftModelling module. Remeber that decompiler first searches the guard which defines range of values (comparison ops limiting usual cases after which default case is used) and then starts emulation on all of these values (except default cases of course).

Thanks again. In this case, I will need to read the source code to understand how ghidra handle jump table then.

Maybe there is some way to view those ops slightly differently but generally no, you can't do anything special about that like deoptimize something. Jump table calculation should be done using emulation very first (sleigh generated) ops via SoftModelling module. Remeber that decompiler first searches the guard which defines range of values (comparison ops limiting usual cases after which default case is used) and then starts emulation on all of these values (except default cases of course).

By the way, if I can get the guard which defines range of values with jump table API? I assume all the details includes ops and guard are inaccessible by using API since none of them are mentioned in API user manual. (JumpTable API)

There may be many types of guards depending on the language, there may even be used a minimum instruction (one of nvidia gpu assembly languages) which is also a guard as it should be normally implemented with CBRANCH pcode op. It (or even they if there are several of them) should be placed by compiler just before calculating "jump" register's value which is in turn just before BRANCHIND pcode op containing instruction. If there is no guard then the behaviour is generally undefined, any normal compiler should include this for safety.


Local port elimination

Fixes bundle elim's local port elimination to prevent local ports from being generated in the ir at all.

Can't review this till #239 is merged. In general, you should rebase on main when creating a PR that is not related to another one.

LGTM! Resolve comments and merge at your discretion!

Let's merge this once ready so I can review #240


Ability to delete a user account

i used self hosting in my projects. but the users have a abnormal user. the user always can't login. even password is correct. i want delete the user and register again. what can i do? thanks.

Currently the only way is to do this via elasticsearch DELETE /organizations-v1/users/idhere We currently don't have a view for managing users but that would be a nice to have to reuse the profile page and add a route for the user with a delete button. Would this be something you'd be willing to submit a pr for? What issues are they seeing with login? It would be great to get any issues fixed.

I used DELETE /organizations-v1/users/idhere is work.
Thanks!!

If they are still having issues logging in, please let me know.

Hi @niemyjski! Anybody working on this enhancement?

@niemyjski I can work on it.


Yesterday result is a day behind

The data reported as yesterday is actually one day behind.
Because the variable list_of_dates does not actually include yesterdays date the eventual calculation of yesterdays costs are a day behind.

Resolved in the mae repository.


vend deleted go.exe

I... seriously.
$ go get github.com/nomad-software/vend
go: finding github.com/nomad-software/vend latest
go: finding golang.org/x/sys v0.0.0-20181218192612-074acd46bca6
go: downloading github.com/nomad-software/vend v0.0.0-20181222113412-fb70e2a0dee9
go: extracting github.com/nomad-software/vend v0.0.0-20181222113412-fb70e2a0dee9

$ cd <project directory in question>

$ vend
download:, exit status<PHONE_NUMBER>

$ vend -package
tidy:, exec: "go": executable file not found in %PATH%

$ go
'go' is not recognized as an internal or external command,
operable program or batch file.

$ which go
which: no go in (C:\Program Files\...snip...)

$ dir c:\go\bin
 Volume in drive C is OS
 Volume Serial Number is 58BF-59A1

 Directory of c:\go\bin

04/02/2019  10:16 AM    <DIR>          .
04/02/2019  10:16 AM    <DIR>          ..
02/25/2019  11:09 PM        17,127,424 godoc.exe
02/25/2019  11:09 PM         3,640,320 gofmt.exe
               2 File(s)     20,767,744 bytes
               2 Dir(s)  176,467,365,888 bytes free

The go.mod was touched, but unchanged. The vendor directory in question was unchanged.

Looking over your code, I can't see anything suspicious - but it looks like the error happened when the initial go mod download failed to run (and in fact exited with a STATUS-FATAL-APP-EXIT)...
...

After re-installing go (1.12.1), vend -package worked.

However, they are not pulling in all sources - one of our dependencies is a private git repo. The initial attempt to clone the private mod may have been what catalyzed the go.exe deletion issue in the first place?
At the very least, failure to download a module after trying to do so should be logged.

I seriously doubt vend deleted anything but the vendor folder. If there was any problem doing that, it would have been reported on the command line.
vend is a very simple program, it deletes the vendor folder in the current directory then copies directories reported by go mod download -json. It's that simple. vend does not download anything.

Like I said, I didn't find any likely culprit in your code, but what happened happened. I'm concerned this might be a bug in go mod download that was somehow only exposed when run this way.


Issue #7695: Python client does not handle default schema values

Fixes #7695
Motivation
When changing a schema and pushing messages an 'IncompatibleSchema' error is thrown.
Modifications
Added line to ensure a default value is declared for each field in the schema.
Verifying this change

[ ] Make sure that the change passes the CI checks.

[x] This change is a trivial rework / code cleanup without any test coverage.

[ ] This change is already covered by existing tests, such as (please describe tests).

[ ] This change added tests and can be verified as follows:

Does this pull request potentially affect one of the following parts:
If yes was chosen, please highlight the changes

Dependencies (does it add or upgrade a dependency): (no)
The public API: (no)
The schema: (don't know)
The default values of configurations: (no)
The wire protocol: (no)
The rest endpoints: (no)
The admin cli options: (no)
Anything that affects deployment: (don't know)

Documentation

Does this pull request introduce a new feature? (no)
If yes, how is the feature documented? (not applicable)
If a feature is not applicable for documentation, explain why?
If a feature is not documented yet in this PR, please create a followup issue for adding the documentation

Closing as this needs more consideration.


Hints sorting crash fix

Previous sorting implementation failed to satisfy strict weak ordering rule. It could lead to crashes with some compilers if they have built-in validation for that (CLang i.e.)

Sorry for the delayed response, I may have missed the email.

I have an additional question about the Hints. I noticed that the Hints button A is not allowed to be touched by default.
https://github.com/xfangfang/borealis/blob/1c85be17b9d0ce907c0d8393dba65b114664829e/library/lib/views/hint.cpp#L66
Some users have asked me why they cannot click button A. And I checked the official bottom hint of Switch UI and found that they can be clicked. So, should we allow the bottom button A to be clickable by default?

No worries at all, thanks!
Speaking about "OK" action, try to touch "OK" when you already in touch mode and you could notice that it will not work, you can click it only if HOS is in "gamepad" mode yet. Clicking "OK" in most cases make no sense for me, because in gamepad mode, you need to focus element first and then perform action attached to focused element by pressing "OK", but in touchscreen mode you perform both of this actions at the same time, you cannot focus item without performing it's action, so it make sense to have clickable "OK" on it
At least I think about it in this way


Added preliminary change of variables integrator

I apparently can't review this PR since I opened it. 😄

@jonwong12 , other than merging in develop, is this ready for review?

I don't really understand what this code is doing, can you give a short explanation of what it does and where it might be applied to serac?

I don't really understand what this code is doing, can you give a short explanation of what it does and where it might be applied to serac?

Sorry, I just noticed it's not in the description for the PR.
So this PR adds the ability to "transform" any nonlinearintegrator by applying a function to the input of the "residual" term, and applying another function to post-process the "tangent" term. One application of this PR is to provide a "change of variables" for a given problem R(u) = 0, for u. So if one wanted instead to solve the residual in terms of v, this wrapper will allow  nonlinearforms to possibly undergo "change of variables" transparently and solve R(u(v)) = 0 for v. This is used in the newmark beta solver, so the equilbrium PDE can be solved in a general way, while the time integration schemes are supplied elsewhere in the code.

@joshessman-llnl @samuelpmishLLNL what are the outstanding issues on this PR?

LGTM

LGTM


[GOBBLIN-1797] Skip scheduling flows far into future

Dear Gobblin maintainers,
Please accept this PR. I understand that it will not be reviewed until I have checked off all the steps below!
JIRA

[X] My PR addresses the following Gobblin JIRA issues and references them in the PR title. For example, "[GOBBLIN-XXX] My Gobblin PR"

https://issues.apache.org/jira/browse/GOBBLIN-1797

Description

[X] Here are some details about my PR, including screenshots (if applicable):
The unschedule feature sets a schedule to run Jan 1st of 2050 so far in advance that it will "never run" but potentially there are over 100k of these flows so we are loading and scheduling many unnecessary flows increasing the startup time. On initialization we add a check that verifies the next run of the flow is within a certain time frame (100 days by default) and loads it into the scheduler if it is within that time frame. We choose that default value under the assumption that we will redeploy GaaS at least every 100 days and then if we approach a far out scheduled flow we will load it into the Scheduler. However, in most cases uses schedule flows for near future or immediately and those will all be scheduled. This PR also renames metrics and adds helpful new ones.

Tests

[X] My PR adds the following unit tests OR does not need testing for this extremely good reason:
Unit test checks the functionality for calculating the number of days until the next run for a cron expression and evaluates cases of far out scheduled flows, regularly occurring, and blank flows (adhoc ones).

Commits

[X] My commits all reference JIRA issues in their subject lines, and I have squashed multiple commits if they address the same issue. In addition, my commits follow the guidelines from "How to write a good git commit message":

Subject is separated from body by a blank line
Subject is limited to 50 characters
Subject does not end with a period
Subject uses the imperative mood ("add", not "adding")
Body wraps at 72 characters
Body explains "what" and "why", not "how"

Codecov Report

Merging #3656 (02f8965) into master (26d6ed3) will increase coverage by 1.68%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##             master    #3656      +/-   ##
============================================
+ Coverage     46.91%   48.59%   +1.68%
+ Complexity    10756     7904    -2852
============================================
  Files          2135     1475     -660
  Lines         83834    58272   -25562
  Branches       9320     6703    -2617
============================================
- Hits          39332    28319   -11013
+ Misses        40933    27343   -13590
+ Partials       3569     2610     -959

Impacted Files
Coverage Δ

...apache/gobblin/runtime/metrics/RuntimeMetrics.java
0.00% <ø> (ø)

...a/org/apache/gobblin/util/limiter/NoopLimiter.java
40.00% <0.00%> (-20.00%)
:arrow_down:

...lin/util/filesystem/FileSystemInstrumentation.java
85.71% <0.00%> (-14.29%)
:arrow_down:

.../gobblin/cluster/GobblinHelixTaskStateTracker.java
62.50% <0.00%> (-6.25%)
:arrow_down:

...pache/gobblin/configuration/ConfigurationKeys.java

.../modules/scheduler/GobblinServiceJobScheduler.java

...gestion/google/webmaster/UrlTriePrefixGrouper.java

...n/java/org/apache/gobblin/configuration/State.java

...in/kafka/writer/Kafka1JsonObjectWriterBuilder.java

...configuration/CombinedWorkUnitAndDatasetState.java

... and 656 more

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


Make Optional TransactionIndex

Consumer can't consume from-beginning due to an internal error. The internal error is that RemoteIndexCache expects TransactionIndex to be available. But it's not created and copied in the first place. So this patch makes TransactionIndex optional.
[2022-01-11 15:28:31,001] ERROR [RemoteLogReader-0]: Error due to (kafka.log.remote.RemoteLogReader)
org.apache.kafka.server.log.remote.storage.RemoteResourceNotFoundException: Block Blob with namesfejVam9RLeiReH-5mUXIg.TRANSACTION does not exist!

An alternative approach was adopted wherein TransactionIndex object is created with an empty FileChannel and thereby not causing the exception.


[SPARK-22475][SQL] show histogram in DESC COLUMN command

What changes were proposed in this pull request?
Added the histogram representation to the output of the DESCRIBE EXTENDED table_name column_name command.
How was this patch tested?
Modified SQL UT and checked output
Please review http://spark.apache.org/contributing.html before opening a pull request.

Test build #83972 has started for PR 19774 at commit 9bfa80c.

Test build #83966 has finished for PR 19774 at commit 24bfcb1.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83966/
Test PASSed.

Test build #83972 has finished for PR 19774 at commit 9bfa80c.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83972/
Test PASSed.

seems good to me. ping @gatorsmile @cloud-fan @HyukjinKwon

Test build #84072 has started for PR 19774 at commit 0abc951.

LGTM

Test build #84075 has started for PR 19774 at commit 38ef638.

Test build #84072 has finished for PR 19774 at commit 0abc951.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84072/
Test PASSed.

Test build #84075 has finished for PR 19774 at commit 38ef638.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84075/
Test PASSed.

thanks, merging to master!


Single backspace deletes two space characters

Gotta Go Fast <IP_ADDRESS>, but this isn't a recently introduced problem.
For a simple example lets say my text file includes the words dog ate, I mistyped a space where the character a should be, and my cursor now lies at the position of character t. Bold characters represent what has already been typed.

dog _te
     ^

At this cursor position pressing backspace to correct the error causes my cursor to end up here by removing both previous spaces. I now have to retype space in order to continue.

dog ate
   ^

The expected behavior is that the single incorrect space is removed and my cursor is placed at character a while also avoiding having to retype the space.

dog ate
    ^

I've only been able to induce this behavior with incorrcet spaces preceded by other spaces. If you open a text file and place multiple contiguous spaces then press backspace a single time all previous spaces will be removed until the last previous character or beginning of the entire text example.

Good find. I've reproduced this myself, and it doesn't look like the fix will be difficult. Watch this space!
Thanks for the brilliant issue report by the way, very well explained.

Latest commit fixes it, thanks for the quick turnaround.

Glad to hear it :)

@gyvess just wanted to let you know that I was planning to release the fix to this issue as part of the larger release of v<IP_ADDRESS> which is now out, but you saw my commit on master so got in a bit early! (Really I shouldn't have been developing on master... sometimes I forget other people use my little toy project 😅)
There's a couple of new options so be sure to take a look at the readme if you're curious.


Rust toolchain

Do you have any interest in moving to the Stable version of Rust or is there some experimental feature requiring Nightly?

Do you have any interest in moving to the Stable version of Rust or is there some experimental feature requiring Nightly?

I don't think there are any requirements for nightly. I simply copy-pasted the ci configuration.


Rotaract Introductory Session

Session Name
Rotaract Introductory Session
Abstract
Have a passion to serve the community? Want to use your talents and skills to make a difference? Get to know what SUTD Rotaract has in store for you during this Introductory Session!
Student Organisation organising this session
Rotaract Club
Event Format
Virtual
Session intent (what to expect)

Participants will get to learn more about the volunteering, event planning and leadership opportunities that Rotaract Club offers, as well as how Rotaract Club continued serving the community amidst the COVID-19 pandemic.
Everyone is welcome to this Introductory Session and no prior knowledge is required! Join us to find out how we can change the community together!

Session details
Date: Monday, 20 September 2021
Time: 1930 - 2030
Venue: MS Teams (https://tinyurl.com/32s4ch9c), link will be sent out again via email closer to date to confirm attendance
No. of participants: NO LIMIT
Speakers/Workshop facilitators
SUTD Rotaract EXCO Members
Sign up link(if any)
https://forms.office.com/r/nME4YR4zx4
Logistical details / Budget Needed
No budget required.
Club Email<EMAIL_ADDRESS>Telegram Group Link: https://t.me/joinchat/IkywE0yhCsrdykbptliO7A

Dear @rotaractsutd Your event has been approved by the school admin. Wishing you a smooth and successful event!


TwigDirectoryAssetProvider Enhancement Ideas..

Hey @mariusbalcytis
One of my biggest vices with Assetic is that it looks at all of our thousands of twig files within our handful of bundles and has to parse them to generate the assets - it takes a long time to do and it's very sluggish.
I understand that this approach allows us to forget about defining the bundles/entry points in a config file and let them be found automatically at compile time making it easier to develop your applications.
I wonder if there are some improvements that can be made - off the top of my head I've come up with a few ideas, some terrible, some not..

Manually produce a list of entry points for bundles where there are a large amount of twig files --
Naturally this one requires no changes to the bundle but makes it harder to introduce more entry points in the future.
Introduce a new file type that the bundle looks for such as .wbpk.twig and have the TwigDirectoryAssetProvider configured with such a pattern -- This one could be fairly simple to implement and could save time at compile time.
Implement a multithreaded TwigDirectoryAssetProvider possibly combined with the idea above, delegating the work to a handful of workers to get the resources faster.

I'd be happy to look into implementing any of these as a PR, but would like to get your thoughts on it first.
Thanks again for an awesome bundle!
Antony

First of all, are you sure that parsing those twig files really takes that much time? In my experience, webpack compilation most often is the bottleneck. Of course your configuration is probably different - lots of twig files and not that many assets.
About manually providing the list of entry points - this approach is possible but I don't see much point in using the bundle in this case, as it's practically the main feature. If that's an option, you could consider defining your entry points in webpack configuration file itself. In that case, to get the resulting URL, you could use core symfony feature to get asset URLs from manifest file (it's documented somewhere in encore documentation, even if I don't see direct relationship between them).
Configuring a different pattern would be quite simple option - it could easily be made configurable if really needed. Of course, it requires manual work (and a good memory) to make it work. If you want to use webpack in any of twig files, you need to rename it and rename all usages alongside.
I'd also like to note that there's cache used (by twig file modification date), but it's meant for iterations when running dev-server command. What's your use-case, does it bother you on deployment or while developing?

Apologies for not coming back on your points above. I've since moved on from that role and this issue no longer holds any relevant value.
Thanks again for the library.


DsnParser - removing some special characters from shared key

Hey!
I think this urldecode is creating a small problem here.
Azure Keys often will come with values like "+" inside of them which will end up replacing "+" with " " (empty space).
https://3v4l.org/UoVYi#v8.3.2

Hello, you can just encode the keys if you put them in the DSN, and  +  will become  %2B :
https://3v4l.org/7Rmll

Yeah, I'm aware, I'm just not sure why it's done this way or why it's not at least mentioned in the documentation.
Might be worth mentioning in the docs, or removing that urldecode.

Hello, sorry for the side effects. This won't be fixed in v1.5 but I released v2.0.0 documenting the need for URL encoding the keys in the DSN.
As for why it's done this way: the DSN is exactly like a URL and parsing it as such makes it easier to do, and more reliable. Official Symfony Messenger transports also do the same.
If you don't want to encode your keys, stay with the v1.4.


twistlock/authz-broker policy failure

I am trying on Container Linux by CoreOS 1353.7.0 (Ladybug)
Client:
Version:      1.12.6
API version:  1.24
Go version:   go1.6.3
Git commit:   d5236f0
Built:        Wed Apr 26 21:47:57 2017
OS/Arch:      linux/amd64
Server:
Version:      1.12.6
API version:  1.24
Go version:   go1.6.3
Git commit:   d5236f0
Built:        Wed Apr 26 21:47:57 2017
OS/Arch:      linux/amd64
From default account ("core") i've created user "user1" as a member of group docker:
sudo useradd -p "*" -U -m user1 -G docker
i added "readonly" policy for "user1" in /var/lib/authz-broker/policy.json
{"name":"policy_1","users":["user1"],"actions":["container"],"readonly":true}
and launched broker container:
docker run -d  --restart=always -v /var/lib/authz-broker/policy.json:/var/lib/authz-broker/policy.json -v /run/docker/plugins/:/run/docker/plugins twistlock/authz-broker
After I ssh into CoreOS system as "user1" I can do pretty much anything with docker, like pulling and removing docker images

Hi @lvic4594, did you configure dockerd to use the authz plugin?
--authorization-plugin list               Authorization plugins to load
Also, consider installing the authz code as a v2 authorization plugin, this will require some changes in the code.

Got it for "user1": (Error response from daemon: authorization denied by plugin authz-broker: no policy applied (user: '' action: 'docker_info')). Using system default: https://index.docker.io/v1/
Error response from daemon: authorization denied by plugin authz-broker: no policy applied (user: '' action: 'image_create'). That looks like expected behavior.
Sorry, don't see anything about "v2 authorization plugin" in the link you've provided... Why should I consider doing that?
Thank you

I am trying to allow default user "core" to perform any docker operations:
policy.json:
{"name":"policy_1","users":["core"],"actions":["*"]}
{"name":"policy_2","users":["user1"],"actions":["container"],"readonly":true}
but when i run "docker ps" as "core" i have the following error:
Error response from daemon: authorization denied by plugin authz-broker: no policy applied (user: '' action: 'container_list')

@lvic4594 currently only TLS authorization is supported so you need to configure docker with TLS certificate and provide a client certificate. See instructions

That would be proble

After I followed directions, I have the following error:
Cannot connect to the Docker daemon. Is the docker daemon running on this host?
systemctl list-units | grep docker
docker-tcp.socket                                                                        loaded active listening Docker Socket for the API
docker.socket                                                                            loaded active listening Docker Socket for the API

I've configured dockerd and docker for TLS authorization using your link. It doesn't seem to help: on any policy like
{"name":"policy_1","users":[""],"actions":[""]}
or
{"name":"policy_1","users":[""],"actions":[""]}
I see the same error:
Error response from daemon: authorization denied by plugin authz-broker: no policy applied (user: 'client' action: 'container_list')

You need to set the name of the user: client, and the action, in the allow list.

like: {"name":"policy_1","users":["client"],"actions":["*"]} in policy.json?
What's the "allow list"?
Sorry, I tried to use example from readme, don't have any other resource. Can i have some example?

The action you want to apply, as written in the plugin log container_list. But ensure first that the plugin is actually loading the policy you specified and not another file.

You should see a log like loaded z policy. Should see it where?

More specifically: where's plugin log container_list? I don't see it with "find"

The plugin logs when the policy is loaded, if you did not put it in the correct place, nothing will work.

According to "readme", the place is /var/lib/authz-broker/policy.json; that's where i put it...

I have created the file /var/lib/authz-broker/policy.json

I suggest that you check inside the container that the policy is mounted and updated.

seems like chicken and egg problem: i start dockerd with --authorization-plugin=authz-broker : then I cannot "docker run" eg load plugin.  Is there default policy file?

i see "loaded" message when i start plugin:
time="2017-05-24T20:49:41Z" level=info msg="Loaded '1' policies"

Hi, since I don't understand exactly what you did. I suggest you debug the plugin using the source code.
Specifically,
# From the root repository
$ make
# run the binary
$ ./authz-broker --debug --policy-file /var/lib/authz-broker/policy.json
# This is the policy.json file
# {"name":"policy_1","users":["","*"],"actions":[""]}
# from **another** terminal stop docker and run it with the plugin
$ sudo service docker stop
$ sudo dockerd --authorization-plugin authz-broker
# from **another** terminal, check the plugin
 docker ps

Shouldn't i also run "authz-broker" as root?
Shouldn't i also set env vars from dockerfile, like AUTHORIZER=basic?
Anyway, here's the output from "authz-broker":
INFO[0128] Loaded '1' policies
DEBU[0145] Received AuthZ request, method: 'GET', url: '/v1.24/containers/json'
DEBU[0145] no policy applied (user: 'client' action: 'container_list')
{"allow":false,"err":"","fields.msg":"no policy applied (user: 'client' action: 'container_list')","level":"info","method":"GET","msg":"Request","time":"2017-05-25T14:33:02Z","uri":"/v1.24/containers/json","user":"client"}
And "docker ps" results in
Error response from daemon: authorization denied by plugin authz-broker: no policy applied (user: 'client' action: 'container_list')
So, it looks as policy is loaded but not parsed.

Does selinux=enabled makes any difference?
here's my dockerd line:
dockerd --authorization-plugin=authz-broker --tlsverify --tlscacert=/home/core/ca.pem --tlscert=/home/core/server-cert.pem --tlskey=/home/core/server-key.pem -H=<IP_ADDRESS>:2378 --insecure-registry=<IP_ADDRESS>/0 --selinux-enabled

it looks like something is wrong with your policy. I suggest you add prints in the code and debug it.
You need to have
{"name":"policy_1","users":["client"],"actions":[""]}

or
{"name":"policy_1","users":["client"],"actions":["container_list"]}

{"name":"policy_1","users":["client"],"actions":["*"]} - this works. It looks as something is wrong not with my policy but with your matching in AuthZReq:
for _, user := range policy.Users {
if user == authZReq.User {
...
eg regexp is not used to match user vs. policy user
Where's"client" in AuthZReq coming from?

In authorization, you can't match a user name against regular expression only against the full name (otherwise, people might impersonate you).
client is the CN (common name) in the certificate you generated. This is propagated via docker not authz.
I'm going to close the issue, since it appears there is no problem with the code. As said, feel free to contribute with pull requests to improve the documentation or code.

The policy examples in "readme" could certainly be improved from this experience

Thanks, feel free to contribute a pull request.

Thanks for your help. One more question: suppose i want authorization policies per shell users, not certificates. Can this plugin work without ssl certificates?

If TLS is enabled, the default user authorization flow extracts the user
details from the certificate subject name. That is, the User field is set
to the client certificate subject common name, and the AuthenticationMethod
field is set to TLS.
Is there a way to customize authorization method? Suppose I need to extract
user details from LDAP...
Thanks
On Thu, May 25, 2017 at 3:00 PM, Liron Levin<EMAIL_ADDRESS>wrote:

Thanks, feel free to contribute a pull request.
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/twistlock/authz/issues/40#issuecomment-304094833, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AX8bH18f4NH8Up6ZONsnEg3z_jvFEyEFks5r9c_ggaJpZM4Nj0tf
.

Hi @lvic4594, no.
The docker daemon only supports TLS authentication.
twistlock offers local (unix) and LDAP authentication in our dev/enterprise edition.

Thanks Liron,
Would it be possible to change response of dockerd if operation is
permitted? For example in the case of "docker image" to see only images
from the certain repos?
On Fri, Jun 2, 2017 at 12:48 AM, Liron Levin<EMAIL_ADDRESS>wrote:

Hi @lvic4594 https://github.com/lvic4594, no.
The docker daemon only supports TLS authentication.
twistlock http://www.twistlock.com offers local (unix) and LDAP
authentication in our dev/enterprise edition.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/twistlock/authz/issues/40#issuecomment-305688722, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AX8bH19061b2_xY9VwjfQOG-5Doh7_VGks5r_5QXgaJpZM4Nj0tf
.

No, this scenario is not supported. I suggest you read docker documenation.

That doesn't exactly tell me what i can/ cannot do with plugins... My goal
is "container isolation": the user should only be able to see and use
images in the repo assigned to that user. For example: user "core" should
only be able to see and use images like /core/busybox:latest but
not /platform/busybox:latest; Would it be possible to implement
with plugins?
Thanks again,
On Tue, Jun 6, 2017 at 2:18 PM, Liron Levin<EMAIL_ADDRESS>wrote:

No, this scenario is not supported. I suggest you read docker documenation
https://docs.docker.com/engine/extend/plugins_authorization/.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/twistlock/authz/issues/40#issuecomment-306573169, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AX8bHyNGF-fF_5yoy-ss8323jFPNOOO0ks5sBZf_gaJpZM4Nj0tf
.

No.


Export a file with transmembrane regions

For Snezhka.  See helpdesk ticket #6851

On Wednesday 10 April 2019 at 00:14:46, Oliferenko, Snezhana via RT wrote:

Ideally, I would love to have a tab-delimited text file, with ORF names, full
ORF sequences, transmembrane region coordinates and the actual sequences of
the transmembrane regions. In case of multi-spanning membrane proteins, I
figure the coordinates/TM sequences could be separated by a comma or a
semicolon.

maybe

ID_tm_1_coordinate_coordinate
HHHHLLLLL
ID_tm_2_coordinate_coordinate
LLLHHHHH

so it would end up as standard fasta, with info about position and we could make it available

A tab delimited, one line per gene file would probably be easier to parse.  But we could have more than one file in different formats if we wanted to.

OK let's make 2 files, fasta might be useful is people actually want to use the sequence in tools.
Will point Snezhka to this ticket to see if either or both are what she wants

housekeeping note: I have merged helpdesk ticket 6851 into 6850

Dear Val,
Both files would be great, thank you!!
Snezhka

I've had a go at this. For now it's in the nightly_update directory.  We need to decide where in the FTP site it should live long term.
ftp://ftp.pombase.org/nightly_update/misc/transmembrane_domain_coords_and_seqs.tsv

Add to protein datasets
https://www.pombase.org/downloads/protein-datasets
and copy to
ftp://ftp.pombase.org/pombe/Protein_data/
?

The file will be in ftp://ftp.pombase.org/pombe/Protein_data/ after the next load.

The file will be in ftp://ftp.pombase.org/pombe/Protein_data/ after the next load.

I just looked there, and I don't see the new file. I'll add a link to https://www.pombase.org/downloads/protein-datasets once it's in its new ftp home.

I can see it: ftp://ftp.pombase.org/pombe/Protein_data/transmembrane_domain_coords_and_seqs.tsv

and now I can see it too .... coulda sworn it wasn't there yesterday (but I may be losing it)


Facet by date

Ability to facet on datetime fields by their date.

Demo: https://latest.datasette.io/fixtures/facetable?_facet_date=created


Ignore path constructors that do not begin with  m

I have encountered a couple of PDFs (see https://github.com/jsvine/pdfplumber/issues/636#issue-1192550515 and https://github.com/jsvine/pdfplumber/discussions/644#discussion-4023909) that include a ("h", ) path — i.e., just the h operator and no others. This causes this second statement here to throw ValueError: not enough values to unpack (expected 2, got 1): https://github.com/pdfminer/pdfminer.six/blob/1bf3c42b59125f4491d863e1c11dca7ebbe96adc/pdfminer/converter.py#L126-L129
Pull request
Although there may be narrower solutions to this particular problem (e.g., handling the specific edge-case of ("h",)), this PR introduces what — at least to me — seems like the most generalized-yet-accurate solution, after reading the PDF Reference.
Per Section 4.4.1, "path construction operators may be invoked in any sequence, but the first one invoked must be m or re to begin a new subpath." Since pdfminer.six already converts all re (rectangle) operators to their equivelent mlllh representation, paths ingested by .paint_path(...) that do not begin with the m operator are invalid.
I am, however, open to other approaches 👍
How Has This Been Tested?
I have added a test to tests/test_converter.py. I have also examined all non-encrypted PDFs in the samples/ directory. Of the 31,116 paths and subpaths in those 33 PDFs, all start with the “m” operator (or have been translated from the “re” operator to take that form).
Checklist

[x] I have formatted my code with black.
[x] I have added tests that prove my fix is effective or that my feature
works
[x] [not applicable] I have added docstrings to newly created methods and classes
[x] I have optimized the code at least one time after creating the initial
version
[x] I have updated the README.md or verified that this
is not necessary
[x] I have updated the readthedocs documentation or
verified that this is not necessary
[x] I have added a concise human-readable description of the change to
CHANGELOG.md

Not a review, but user-originating test: This solves the problem I initially encountered in #729!

Thanks @jsvine and @Nebukadneza!

Fixes #729


HELP

Help
Given a global array - lets call it gpio_out  - of 40 integers...
How do I define and initialise that in the contrib node
I've tried a few variations none of which worked so far??

Set the value type to JSON and then just set the value to the array using JSON array syntax - [
1, 2, 3, 4, .....]
Here is an example flow:
[
{
"id": "3fc45f72.1b5a48",
"type": "config",
"z": "8b42e25d.61776",
"name": "",
"properties": [
{
"p": "array",
"pt": "flow",
"to": "[5, 3, 7, 3, 7, 5]",
"tot": "json"
}
],
"active": true,
"x": 537.5,
"y": 104,
"wires": []
},
{
"id": "3f5b30de.91ddd8",
"type": "inject",
"z": "8b42e25d.61776",
"name": "",
"topic": "",
"payload": "array[4]",
"payloadType": "flow",
"repeat": "",
"crontab": "",
"once": false,
"x": 607.5,
"y": 203,
"wires": [
[
"a7f61b00.34052"
]
]
},
{
"id": "a7f61b00.34052",
"type": "debug",
"z": "8b42e25d.61776",
"name": "",
"active": true,
"console": "false",
"complete": "false",
"x": 794.5,
"y": 203,
"wires": []
}
]
Cheers,
Dean
On Thursday, 16 March 2017 12:13:07 PM AEST Peter Scargill wrote:
Help
Given a global array - lets call it gpio_out - of 40 integers...
How do I define and initialise that in the contrib node
I've tried a few variations none of which worked so far??
—You are receiving this because you are subscribed to this thread.Reply to this email
directly, view it on GitHub[1], or mute the thread[2].[3]

[1] https://github.com/DeanCording/node-red-contrib-config/issues/1
[2] https://github.com/notifications/unsubscribe-auth/
AAPVIhERzY7Kud1xTcykEFU4UAh55ic6ks5rmYnDgaJpZM4MfwUP
[3] https://github.com/notifications/beacon/
AAPVIlQZqH25cOXpuu2hudd49gjfiKTvks5rmYnDgaJpZM4MfwUP.gif

Realised that – don’t understand WHY JSON – but it does work thank you!
Thanks for the comprehensive response. Marvelous node.
From: Dean Cording<EMAIL_ADDRESS>Sent: 17 March 2017 10:42
To: DeanCording/node-red-contrib-config<EMAIL_ADDRESS>Cc: Peter Scargill<EMAIL_ADDRESS>Author<EMAIL_ADDRESS>Subject: Re: [DeanCording/node-red-contrib-config] HELP (#1)
Set the value type to JSON and then just set the value to the array using JSON array syntax - [
1, 2, 3, 4, .....]
Here is an example flow:
[
{
"id": "3fc45f72.1b5a48",
"type": "config",
"z": "8b42e25d.61776",
"name": "",
"properties": [
{
"p": "array",
"pt": "flow",
"to": "[5, 3, 7, 3, 7, 5]",
"tot": "json"
}
],
"active": true,
"x": 537.5,
"y": 104,
"wires": []
},
{
"id": "3f5b30de.91ddd8",
"type": "inject",
"z": "8b42e25d.61776",
"name": "",
"topic": "",
"payload": "array[4]",
"payloadType": "flow",
"repeat": "",
"crontab": "",
"once": false,
"x": 607.5,
"y": 203,
"wires": [
[
"a7f61b00.34052"
]
]
},
{
"id": "a7f61b00.34052",
"type": "debug",
"z": "8b42e25d.61776",
"name": "",
"active": true,
"console": "false",
"complete": "false",
"x": 794.5,
"y": 203,
"wires": []
}
]
Cheers,
Dean
On Thursday, 16 March 2017 12:13:07 PM AEST Peter Scargill wrote:
Help
Given a global array - lets call it gpio_out - of 40 integers...
How do I define and initialise that in the contrib node
I've tried a few variations none of which worked so far??
—You are receiving this because you are subscribed to this thread.Reply to this email
directly, view it on GitHub[1], or mute the thread[2].[3]

[1] https://github.com/DeanCording/node-red-contrib-config/issues/1
[2] https://github.com/notifications/unsubscribe-auth/
AAPVIhERzY7Kud1xTcykEFU4UAh55ic6ks5rmYnDgaJpZM4MfwUP
[3] https://github.com/notifications/beacon/
AAPVIlQZqH25cOXpuu2hudd49gjfiKTvks5rmYnDgaJpZM4MfwUP.gif
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub https://github.com/DeanCording/node-red-contrib-config/issues/1#issuecomment-287322257 , or mute the thread https://github.com/notifications/unsubscribe-auth/ABzUg0X49TaZiOfQSmpwXu9IF4K9Ftf2ks5rmmOUgaJpZM4MfwUP .  https://github.com/notifications/beacon/ABzUg2I9_rSZu73LSd0VlSB8LRUV2hNgks5rmmOUgaJpZM4MfwUP.gif

The other types are just simple types. Only JSON allows you to do complex types like arrays.-------- Original Message --------Subject: Re: [DeanCording/node-red-contrib-config] HELP (#1)From: Peter Scargill To: DeanCording/node-red-contrib-config CC: Dean Cording ,Comment Realised that – don’t understand WHY JSON – but it does work thank you!
Thanks for the comprehensive response. Marvelous node.
From: Dean Cording<EMAIL_ADDRESS>Sent: 17 March 2017 10:42
To: DeanCording/node-red-contrib-config<EMAIL_ADDRESS>Cc: Peter Scargill<EMAIL_ADDRESS>Author<EMAIL_ADDRESS>Subject: Re: [DeanCording/node-red-contrib-config] HELP (#1)
Set the value type to JSON and then just set the value to the array using JSON array syntax - [
1, 2, 3, 4, .....]
Here is an example flow:
[
{
"id": "3fc45f72.1b5a48",
"type": "config",
"z": "8b42e25d.61776",
"name": "",
"properties": [
{
"p": "array",
"pt": "flow",
"to": "[5, 3, 7, 3, 7, 5]",
"tot": "json"
}
],
"active": true,
"x": 537.5,
"y": 104,
"wires": []
},
{
"id": "3f5b30de.91ddd8",
"type": "inject",
"z": "8b42e25d.61776",
"name": "",
"topic": "",
"payload": "array[4]",
"payloadType": "flow",
"repeat": "",
"crontab": "",
"once": false,
"x": 607.5,
"y": 203,
"wires": [
[
"a7f61b00.34052"
]
]
},
{
"id": "a7f61b00.34052",
"type": "debug",
"z": "8b42e25d.61776",
"name": "",
"active": true,
"console": "false",
"complete": "false",
"x": 794.5,
"y": 203,
"wires": []
}
]
Cheers,
Dean
On Thursday, 16 March 2017 12:13:07 PM AEST Peter Scargill wrote:
Help
Given a global array - lets call it gpio_out - of 40 integers...
How do I define and initialise that in the contrib node
I've tried a few variations none of which worked so far??
—You are receiving this because you are subscribed to this thread.Reply to this email
directly, view it on GitHub[1], or mute the thread[2].[3]

[1] https://github.com/DeanCording/node-red-contrib-config/issues/1
[2] https://github.com/notifications/unsubscribe-auth/
AAPVIhERzY7Kud1xTcykEFU4UAh55ic6ks5rmYnDgaJpZM4MfwUP
[3] https://github.com/notifications/beacon/
AAPVIlQZqH25cOXpuu2hudd49gjfiKTvks5rmYnDgaJpZM4MfwUP.gif
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub https://github.com/DeanCording/node-red-contrib-config/issues/1#issuecomment-287322257 , or mute the thread https://github.com/notifications/unsubscribe-auth/ABzUg0X49TaZiOfQSmpwXu9IF4K9Ftf2ks5rmmOUgaJpZM4MfwUP .  https://github.com/notifications/beacon/ABzUg2I9_rSZu73LSd0VlSB8LRUV2hNgks5rmmOUgaJpZM4MfwUP.gif
—You are receiving this because you commented.Reply to this email directly, view it on GitHub, or mute the thread.
{"api_version":"1.0","publisher":{"api_key":"05dde50f1d1a384dd78767c55493e4bb","name":"GitHub"},"entity":{"external_key":"github/DeanCording/node-red-contrib-config","title":"DeanCording/node-red-contrib-config","subtitle":"GitHub repository","main_image_url":"https://cloud.githubusercontent.com/assets/143418/17495839/a5054eac-5d88-11e6-95fc-7290892c7bb5.png","avatar_image_url":"https://cloud.githubusercontent.com/assets/143418/15842166/7c72db34-2c0b-11e6-9aed-b52498112777.png","action":{"name":"Open in GitHub","url":"https://github.com/DeanCording/node-red-contrib-config"}},"updates":{"snippets":[{"icon":"PERSON","message":"@scargill in #1: Realised that – don’t understand WHY JSON – but it does work thank you!\n\n \n\nThanks for the comprehensive response. Marvelous node.\n\n \n\nFrom: Dean Cording<EMAIL_ADDRESS>\nSent: 17 March 2017 10:42\nTo: DeanCording/node-red-contrib-config<EMAIL_ADDRESS>Peter Scargill<EMAIL_ADDRESS>Author<EMAIL_ADDRESS>Re: [DeanCording/node-red-contrib-config] HELP (#1)\n\n \n\nSet the value type to JSON and then just set the value to the array using JSON array syntax - [ \n1, 2, 3, 4, .....]\n\nHere is an example flow:\n\n[\n{\n"id": "3fc45f72.1b5a48",\n"type": "config",\n"z": "8b42e25d.61776",\n"name": "",\n"properties": [\n{\n"p": "array",\n"pt": "flow",\n"to": "[5, 3, 7, 3, 7, 5]",\n"tot": "json"\n}\n],\n"active": true,\n"x": 537.5,\n"y": 104,\n"wires": []\n},\n{\n"id": "3f5b30de.91ddd8",\n"type": "inject",\n"z": "8b42e25d.61776",\n"name": "",\n"topic": "",\n"payload": "array[4]",\n"payloadType": "flow",\n"repeat": "",\n"crontab": "",\n"once": false,\n"x": 607.5,\n"y": 203,\n"wires": [\n[\n"a7f61b00.34052"\n]\n]\n},\n{\n"id": "a7f61b00.34052",\n"type": "debug",\n"z": "8b42e25d.61776",\n"name": "",\n"active": true,\n"console": "false",\n"complete": "false",\n"x": 794.5,\n"y": 203,\n"wires": []\n}\n]\n\n\nCheers,\n\nDean\n\nOn Thursday, 16 March 2017 12:13:07 PM AEST Peter Scargill wrote:\n\n\nHelp\nGiven a global array - lets call it gpio_out - of 40 integers...\nHow do I define and initialise that in the contrib node\nI've tried a few variations none of which worked so far?? \n—You are receiving this because you are subscribed to this thread.Reply to this email \ndirectly, view it on GitHub[1], or mute the thread[2].[3]\n\n\n\n\n--------\n[1] https://github.com/DeanCording/node-red-contrib-config/issues/1\n[2] https://github.com/notifications/unsubscribe-auth/\nAAPVIhERzY7Kud1xTcykEFU4UAh55ic6ks5rmYnDgaJpZM4MfwUP\n[3] https://github.com/notifications/beacon/\nAAPVIlQZqH25cOXpuu2hudd49gjfiKTvks5rmYnDgaJpZM4MfwUP.gif\n\n\n\n—\nYou are receiving this because you authored the thread.\nReply to this email directly, view it on GitHub \u003chttps://github.com/DeanCording/node-red-contrib-config/issues/1#issuecomment-287322257\u003e , or mute the thread \u003chttps://github.com/notifications/unsubscribe-auth/ABzUg0X49TaZiOfQSmpwXu9IF4K9Ftf2ks5rmmOUgaJpZM4MfwUP\u003e .  \u003chttps://github.com/notifications/beacon/ABzUg2I9_rSZu73LSd0VlSB8LRUV2hNgks5rmmOUgaJpZM4MfwUP.gif\u003e \n\n"}],"action":{"name":"View Issue","url":"https://github.com/DeanCording/node-red-contrib-config/issues/1#issuecomment-287327296"}}}


Display plugin as possible execution in list of alternatives

When multiple keycloak executions are set as alternative for one another, keycloak will display a "Try Another Way" button below the blue action button.
As of right now, even if set to be an alternative execution, this plugin isn't exposed as a possible option.
Flow (relevant part):

Email OTP Alternative not being selectable by the user:

@kominoshja You found any solution to this? When i use it as alternative it just skips the selection screen and goes straight to the email one

@beezerk23 No, I imagine something needs to be updated in the codebase, but haven't investigated much further.

@kominoshja Currently looking for something like this too. What I found was another plugin that supports this, but sadly, it doesn’t work with this one. However, they also offer an SMS OTP feature if that’s of any interest.
https://github.com/netzbegruenung/keycloak-mfa-plugins/tree/main/enforce-mfa


References to host.docker.internal don't resolve to host OS

In my existing usage of Docker Desktop, I find I use the hostname host.docker.internal often in test/dev configurations to refer to the host OS, this is for connecting to locally, non-container installed PostgreSQL servers or the like.
I see that this doesn't appear to work under OrbMachine, is this possible via a different host name/configuration somewhere?

Yes, you can use host.internal instead. I'll document this and add an alias for host.docker.internal. Thanks for bringing it up!


More WIP

Codecov Report

Merging #11 (ee7351b) into master (0485d6b) will decrease coverage by 2.41%.
The diff coverage is 73.07%.

:exclamation: Current head ee7351b differs from pull request most recent head b6e4d91. Consider uploading reports for the commit b6e4d91 to get more accurate results

@@            Coverage Diff             @@
##           master      #11      +/-   ##
==========================================
- Coverage   74.15%   71.73%   -2.42%
==========================================
  Files           4        4
  Lines          89       92       +3
==========================================
  Hits           66       66
- Misses         23       26       +3

Impacted Files
Coverage Δ

src/LossDevelopment.jl
0.00% <0.00%> (ø)

src/Triangle.jl
60.60% <65.51%> (-1.16%)
:arrow_down:

src/utils.jl
72.72% <72.22%> (-2.28%)
:arrow_down:

src/Mack.jl
90.90% <89.28%> (-9.10%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0485d6b...b6e4d91. Read the comment docs.


Mixin curios as knowledge fragment.

Hi Keletu, thank you for this PR. I think I'm going to leave them as curios rather than knowledge fragments. the only difference it really makes is the registry names in-game. keeping it "curio" helps people who already know thaumcraft 6 understand what they do.


⚠ Jenkins Plugins Artifactory has degraded performance

In da61f95, Jenkins Plugins Artifactory (https://get.jenkins.io/plugins/artifactory/) experienced degraded performance:

HTTP code: 200
Response time: 1204 ms

Resolved: Jenkins Plugins Artifactory performance has improved in 72978c4 after 23 minutes.


formula_auditor: fix versioned alias audit

[x] Have you followed the guidelines in our Contributing document?
[x] Have you checked to ensure there aren't other open Pull Requests for the same change?
[x] Have you added an explanation of what your changes do and why you'd like us to include them?
[ ] Have you written new tests for your changes? Here's an example.

[x] Have you successfully run brew typecheck with your changes locally?
[ ] Have you successfully run brew tests with your changes locally?

Fix audit not being run at all due to always-false condition (@build_stable).
Don't fail audit if versioned alias would clash with a versioned formula (e.g. we for a few days had<EMAIL_ADDRESS>as a formula while the main go formula was also still 1.17).
Allow versioned aliases with the name of another alias (e.g. kubectl is an alias of kubernetes-cli, so allow - but not require -<EMAIL_ADDRESS>to exist).

Review period skipped due to critical label.


RWKV v6?

Any plans on supporting RWKV v6?

yea its part of the larger rewrite in happening in the rewrite branch, i do have something somewhat working locally just haven't pushed it yet. will push when i have some time.

Awesome


Automatic increment in margin space

When a new item is added, or an existing item is deleted, margin space is increasing automatically in all rows and columns. It should be happening only in the vicinity of an interacted item.
This is the setting I am using:
       ChipsLayoutManager chipsLayoutManager = ChipsLayoutManager.newBuilder(this)                 .setChildGravity(Gravity.CENTER_VERTICAL)                 .setMaxViewsInRow(5)                 .setScrollingEnabled(true)                 .setOrientation(ChipsLayoutManager.HORIZONTAL)                 .setRowStrategy(ChipsLayoutManager.STRATEGY_DEFAULT)                 .withLastRow(true).build();
rvSubject.setLayoutManager(chipsLayoutManager); rvSubject.addItemDecoration(new SpacingItemDecoration(5, 5));

Every time the page is launched,
rvSubject.addItemDecoration() is adding new space to the existing one. With the help of boolean variable, I am executing that line only one.


HDFS-16731. hadoop-minikdc dependency duplicated in hadoop-yarn-server-nodemanager pom.xml

Description of PR
HDFS-16731
How was this patch tested?
For code changes:

[ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
[ ] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
[ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
[ ] If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

Hi, I created this issue under Hadoop HDFS by accident when it should have been under YARN, so the correct JIRA is actually https://issues.apache.org/jira/browse/YARN-11254. I've submitted a PR with the correct JIRA, so would you mind closing your PR? Really sorry about the incorrect issue report!

@clara0  Appologies !
I didnt checked that the ticket was created recently and missed asking for assignment !
Thought to add the change over code

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
1m  6s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  1s

codespell was not available.

+0 :ok:
detsecrets
0m  1s

detect-secrets was not available.

+0 :ok:
xmllint
0m  1s

xmllint was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

-1 :x:
test4tests
0m  0s

The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.

_ trunk Compile Tests _

+1 :green_heart:
mvninstall
43m 23s

trunk passed

+1 :green_heart:
compile
2m  0s

trunk passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
compile
1m 51s

trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

+1 :green_heart:
mvnsite
1m  8s

trunk passed

+1 :green_heart:
javadoc
1m  6s

trunk passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javadoc
0m 51s

trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

+1 :green_heart:
shadedclient
75m 12s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
0m 46s

the patch passed

+1 :green_heart:
compile
1m 40s

the patch passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javac
1m 40s

the patch passed

+1 :green_heart:
compile
1m 32s

the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

+1 :green_heart:
javac
1m 32s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

+1 :green_heart:
mvnsite
0m 49s

the patch passed

+1 :green_heart:
javadoc
0m 41s

the patch passed with JDK Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS>

+1 :green_heart:
javadoc
0m 39s

the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

+1 :green_heart:
shadedclient
27m 50s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
24m 41s

hadoop-yarn-server-nodemanager in the patch passed.

+1 :green_heart:
asflicense
0m 43s

The patch does not generate ASF License warnings.

135m 38s

Subsystem
Report/Notes

Docker
ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4754/1/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/4754

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint

uname
Linux 0d50e819cc29 4.15.0-191-generic #202-Ubuntu SMP Thu Aug 4 01:49:29 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 3376e55632781f27dea19f7c60b14f1be074b43d

Default Java
Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Private Build-11.0.15+10-Ubuntu-0ubuntu<IP_ADDRESS> /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4754/1/testReport/

Max. process+thread count
533 (vs. ulimit of 5500)

modules
C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-4754/1/console

versions
git=2.25.1 maven=3.6.3

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.


Is there any method supports long press copy?

As the Title said I have a feature that when I long press the label, I can copy the text. I think it's a common feature, so there any method supports long press copy?

There is first-class support for this. See -[TTTAttributedLabelLink linkLongPressBlock].


Query caching

This is a part of slaxweb/framework#154 and slaxweb/framework#150
Query caching must attach to the following hooks in the slaxweb/database components BaseModel class:

Before data retrieval - to check if data exists in cache and return it
After data retrieval - to cache the result object
After update - to remove the possibly cached row

Exact hook names are not yet known, as the Database component does not yet use them.
The query cache must construct a name from the primary key value, if is set in the result set, and the table name, if primary key is not found in result set log a warning and generate a random hash for the name, and serialize the Result object. When reading from cache, the Result object must be re-constructed and return. On update remove the cached data if primary key is found in the update statement.

Primary key checking has been removed in favor of specific cache names which users must handle on their own.
Resolved.


windows are always sorted by windowLevel

windows are always sorted by windowLevel (it's in the doc)
originalSubviews is private, so the object type is always UIView: no need to guard
typo

@devxoul Hi, I'd like to include this improvement from your repository instead of my fork. Could we talk about it and see which parts are good and which parts need improvement? Thank you.

@Coeur, I was at the army training center at that time due to my military service 😂 This improvement will be included today's release. Thanks for your great work!


General: System.IO.DirectoryNotFoundException: Could not find part of path

Gave this error while extracting the level1, level2 ... can you help me?
 I think that may be because path is too long. Try to enable long path support for your OS https://betanews.com/2016/05/29/long-paths-windows-10/ or something like this

String "C:\Users\Erik\Downloads\MAS 11.5 Cine Build\MAS_CINEPB_Data\Ripped\level1\Texture2D\brick-wall-background-fortythree-texture-and-background-brick-walls-quote-the-last-lecture-brick-walls-in-kitchen-decoration-photo-brick-walls-kitchen-wall-background_NRM.dds" has 259 symbols. And that file was successfully created for you.
String "C:\Users\Erik\Downloads\MAS 11.5 Cine Build\MAS_CINEPB_Data\Ripped\level1\Texture2D\brick-wall-background-fortythree-texture-and-background-brick-walls-quote-the-last-lecture-brick-walls-in-kitchen-decoration-photo-brick-walls-kitchen-wall-background_NRM.dds.meta" has 264 symbols. This one cause error message.
Max allowed is 260 without enabled option in your OS. So definitely this is the reason

I fixed long path support in 7da3cd97b78e0c682de4d5ae230970b0dfc10ddc but as I mentioned earlier your OS should support long paths. Otherwise put game folder to the root of your disk


Make Initializer Lists within Block initialization default to BLOCK!

Right now you have to write:
ren::Block {1, red::Block{2, 3}, 4}

Using a std::initializer_list, this could default to the behavior of assuming "brace means block".  Then you could write:
ren::Block {1, {2, 3}, 4}

It's a little bit questionable because { isn't really a [, and there's not necessarily any real reason why a BLOCK! should get this special treatment over PAREN! or PATH!.  But it might be cute.

Reopening this issue for discussion.
@Morwenn pointed out that the technical underpinnings of initializer_list were actually an array...and you could effectively get at the data for that array as a pointer from the iterator.  So basically all the vector work was not necessary.
This seems to reopen the door to this.  I talked myself out of it partially from an implementation point of view, but maybe it should be rethought--so that if we can do it, should we?

To truly close this issue out, @HostileFork needs to go back to the code review question and fix it up to correct potential future misunderstandings for others.
http://codereview.stackexchange.com/q/72252/9042

Old link from source about performance gap of vector vs. array:
http://stackoverflow.com/q/381621/211160

So, the problem should definitely be solved with the pull request #51 (as explained in its description). To sum up just in case we need to check again in the future:

AnyBlock_ has a third parameter BracesT which correspond to the type built by the curly braces when no type is specified.
This parameter defaults to void so that untyped curly braces are a compile time error if nt explicitly specified otherwise.
Block provides Block as a third parameter so that it can easily create blocks of blocks with less typing.
Everything else uses the default void.

The global behaviour of untyped curly braces can then be trivially defined for every type deriving from AnyBlock_ and the default behaviour can also be trivially changed by changing the default value for the third template parameter of AnyBlock_. I do think that this resolution can solve almost any future issue related to Loadable and curly braces.

So what's keeping this an open issue for now is that while the method is working for constructors, it's not working for variadic functions.  So:
runtime(1, {2, 3}, 4);

Won't make a block.  @Morwenn says this is likely a technical limitation of constructors that take initializer lists vs. variadic functions that do.  It may warrant a StackOverflow question for a canon answer.
If it turns out to be true that you can't do it, then it can either be left alone or some trick to make runtime calls somehow rig around internally with a class constructed on each call, so something like:
runtime {1, {2, 3}, 4};
Exactly what that would involve is not known.  But this is a good thing to consider as the runtime/engine level goes under review.

The thing is that the only way to get as many elements as we want in operator() is to make it a variadic template, and variadic templates use the template deduction mechanism, which can't deduce an std::initializer_list, so we can't give meaning to untyped braces in this context. In order to do what we want with operator(), we would need a language extension so that we can write this:
template <std::size_t N>
void operator(BlockLoadable<Block>...[n] loadables)
{
    // the code
}

With such a anguage extension (proposed, but I am not even sure that it will make it to C++17), the compiler would know that every parameter is to be deduced as a BlockLoadable<Block>; there wouldn't the same template deduction mechanism. Unfortunately, it's unlikely that we will have this extension before long. Therefore, if we really want {} == Block {}, the constructor solution would be the more feasable one with some changes to how runtime is handled.


Uncaught Error: filesystem paths do not work in the browser

WebTorrent version: 0.91.1
Node.js version: v5.2.0
Browser name/version (if using WebTorrent in the browser): Chromium 49.0.2623.108 Built on 8.3, running on Debian 8.3 (64-bit)

I got this message when try to seed a file served from localhost via nginx: http://localhost/a.mp4. My code:
index.html
<!doctype html>
<html>

  <body>
    <input type="file" name="upload" onchange="handleFiles()" multiple>
  </body>
  <script src="webtorrent.min.js">
  </script>
  <script src="script.js"></script>
</html>

script.js
var rtcConfig = {iceServers: []};
var client = new WebTorrent({ rtcConfig: rtcConfig });
client.seed("http://localhost/a.mp4", function (torrent) {

        console.log('Web Seeding support ..' + torrent.magnetURI);
    })

I have just search in issue and find #665 but i can't any information to solve this. Pls help me.

HTTP url arguments are not supported to client.seed. You should try passing in one of the other supported types.
If you insist on using an http url, then you should download the file first, if it's not too large.
var get = require('simple-get')

var client = new WebTorrent({ rtcConfig: rtcConfig })
get('http://localhost/a.mp4', function (err, res) {
  if (err) return console.error(err.message)
  client.seed(res, {
    name: 'My cool torrent',
    urlList: [ 'http://localhost/a.mp4' ] // add a web seed to the torrent
  }, function (torrent) {
    console.log('magnet link with web seed support: ' + torrent.magnetURI)
  })
})


OpenBSD misses dns_sd.h

This projects is awesome.
Until now i've used it on an old mac mini.
Now i would like to move everything on my OpenBSD home server.
It misses dns-sd, I'm getting the following error during install:
checking for dns_sd.h... no
I've already searched for an OpenBSD port of FreeBSD's net/avahi-libdns without luck.
Also, on OpenBSD there's not a port of Debian's libavahi-compat-libdnssd-dev
Do you know a workaround for this?
BTW many many thx for putting your efforts in building this thing, i saw your talk from Sheffield Ruby 18 and felt astonished by your hard work!

Thanks for the kind words. I am glad you found and enjoyed the presentation 😄
I've never ran RubyHome on OpenBSD only on Mac OS X for development and my Raspberry Pi. I'm very invested to hear if it's possible to get it working.
RubyHome uses the dnssd gem which @tenderlove maintains at  https://github.com/tenderlove/dnssd for DNS Service Discovery. There is possibly a similar issue posted in the repository https://github.com/tenderlove/dnssd/issues/9 with a suggested fix that might be of some help.
Please let me know if that's useful / how you get on.
Thanks again! 😸

Nice piece of advice! I've made some progress...Here's what I did:
pkg_add avahi
gem install dnssd -- --with-dnssd-lib=/usr/local/lib --with-dnssd-include=/usr/local/include/avahi-compat-libdns_sd/

...And then 🎉 😄 dnssd smooooothly installed so thx @kalw (aka Regis A. Despres) for the hint.
After that I launched avahi&co.
doas rcctl enable messagebus avahi_daemon
doas rcctl start messagebus avahi_daemon

Then created and run a switch.rb
Everything went well until the last paring step i.e. after inserting the code in my iOS Home app.
There I got:
...
The program 'ruby' called 'DNSServiceAddRecord()' which is not supported (or only supported partially) in the Apple Bonjour compatibility layer of Avahi.
*** WARNING *** Please fix your application to use the native API of Avahi!
*** WARNING *** For more information see <http://0pointer.de/blog/projects/avahi-compat.html>
2019-09-26 00:56:20 - DNSSD::UnsupportedError - DNSSD operation failed with error code: -65544:
/usr/local/lib/ruby/gems/2.4/gems/dnssd-3.0.1/lib/dnssd/service.rb:45:in `_add_record'
...

Which seems to be related to the use of partially supported call made by dnssd.
The error log has a pointer to some more info located here http://0pointer.de/blog/projects/avahi-compat.html (author of the avahi port)
I will dig more into it and let you know.

@microspino glad to hear you got a bit further!
The new bug you've encountered is actually also present on Linux. To circumvent the issue, for now, I ended up added a guard clause to the DNS::Service#update method call I also found this inside the test suite of dnssd.
This means RubyHome is still useable on Linux but the services that are advertised via DNS Service Discovery get out of date until the program is restarted. This doesn't appear to effect anything in a massive way and I've been using it successfully on my Raspberry Pi for months.
The quick fix would be for you to run:
irb
irb(main):001:0> require 'dnssd'
=> true
irb(main):002:0> RbConfig::CONFIG['target_os']
=> "darwin18"
irb(main):003:0>

Then we could update the code to also skip your target_os.
The longer term fix would be (I guess) updating https://github.com/tenderlove/dnssd to make it work without DNSServiceAddRecord on Linux and FreeBSD.

🎉 🎉 🎉
I've modified my ruby_home gem  ...ruby_home-0.2.2/lib/ruby_home/dns/service.rb with this on line#9:
return if RbConfig::CONFIG['target_os'] =~ /linux|openbsd/
RbConfig::CONFIG['target_os'] was "openbsd6.4" on my home server.
It works like a charm.
🙇

I can control my Kitchen Light with Siri now and 🤣 since I'm sure everybody in the world was waiting for this 🤣 we can safely close the issue i guess.


whitelist files that are in .gitignore?

this is almost an edge behavior, but in some projects i have files in my .gitignore that i need to jump to somewhat frequently. usually they are local configs at the project root where i usually have vim running, so its no big deal to do :e .someconfig but it would be nice to be able to do everything in leaderf if possible

You can have a try Leaderf file --no-ignore.

well i would like to whitelist some files, not all files. is that at all possible?

Currently, there are two ways to work around it.

Use Leaderf file --file files_list.txt, all the files and some files in .gitignore can be written to files_list.txt(can be any name).
Use g:Lf_ExternalCommand.


Foregoing bank-account exercise.

The exercise specifically talks about threads which cannot be done in
an implementation independant fashion in Common Lisp. Removing that
from the exercise does not leave much of interest that has not been
seen already.

Agreed. I'll merge a bit later this evening to give more time if someone objects.

:+1:

:+1:


Add missing cstdlib include

std::malloc, std::realloc and std::free are provided by cstdlib

Thanks!


Utilize MyDate.nextDay() in Task 28 Resolution

The instructions for task 28 suggests that MyDate.nextDay() should be utilized.  The DateIterator in the resolution doesn't.

Fixed, thanks!


Gradle Dependency

Waiting... :）

Sorry but i'm busy with another projects
You can add it yourself though

OK, Thank you!

Added gradle dependency


[Lint] Update space-unary-ops rule in eslintrc (fixes Atom linter crash)

space-unary-word-ops was replaced with space-unary-ops. This fixes an error in Atom with linter-eslint installed: https://github.com/AtomLinter/linter-eslint/issues/24

GitHub turned the fork into a mess: re-PR'd as #259


Python 2.7 UnicodeEncodeError for Path Type in click 7.1.x (regression)

Hi, thanks for creating Click. Happy user for many years (and donated in the past)!
I believe I've found a bug wrt Unicode handling in the Path Option Type in python 2.7 in click 7.1.x.
Click 7.0 doesn't exhibit this issue, so I believe it's a regression.
Expected Behavior
Consider this code:
from __future__ import print_function
import click

@click.command()
@click.option('--path', type=click.Path(exists=True))
def cli(path):
    print("path=", path)

if __name__ == "__main__":
    cli()

When invoking this code and passing a path name containing unicode in click 7.0, everything works as expected (in both python 3.x and 2.7).
# Python 2.7, click 7.0
(.venv27) /tmp $ pip freeze | grep -i click
Click==7.0
(.venv27)  /tmp $ python cli.py --path föo
Usage: cli.py [OPTIONS]
Try "cli.py --help" for help.

Error: Invalid value for "--path": Path "föo" does not exist.

# Python 3.8, click 7.0
(.venv38)  /tmp $ pip freeze | grep -i click
Click==7.0
(.venv38)  /tmp $ python cli.py --path föo
Usage: cli.py [OPTIONS]
Try "cli.py --help" for help.

Error: Invalid value for "--path": Path "föo" does not exist.

Actual Behavior
When running the above code in python 2.7 on click 7.1.2, a UnicodeEncodeError occurs
(.venv27)  /tmp $ pip freeze | grep -i click
click==7.1.2
(.venv27)  /tmp $ python cli.py --path föo
# Traceback in block below occurs

Traceback (most recent call last):
  File "cli.py", line 10, in <module>
    cli()
  File "/private/tmp/.venv27/lib/python2.7/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/private/tmp/.venv27/lib/python2.7/site-packages/click/core.py", line 781, in main
    with self.make_context(prog_name, args, **extra) as ctx:
  File "/private/tmp/.venv27/lib/python2.7/site-packages/click/core.py", line 700, in make_context
    self.parse_args(ctx, args)
  File "/private/tmp/.venv27/lib/python2.7/site-packages/click/core.py", line 1048, in parse_args
    value, args = param.handle_parse_result(ctx, opts, args)
  File "/private/tmp/.venv27/lib/python2.7/site-packages/click/core.py", line 1623, in handle_parse_result
    value = self.full_process_value(ctx, value)
  File "/private/tmp/.venv27/lib/python2.7/site-packages/click/core.py", line 1965, in full_process_value
    return Parameter.full_process_value(self, ctx, value)
  File "/private/tmp/.venv27/lib/python2.7/site-packages/click/core.py", line 1589, in full_process_value
    value = self.process_value(ctx, value)
  File "/private/tmp/.venv27/lib/python2.7/site-packages/click/core.py", line 1579, in process_value
    return self.type_cast_value(ctx, value)
  File "/private/tmp/.venv27/lib/python2.7/site-packages/click/core.py", line 1568, in type_cast_value
    return _convert(value, (self.nargs != 1) + bool(self.multiple))
  File "/private/tmp/.venv27/lib/python2.7/site-packages/click/core.py", line 1565, in _convert
    return self.type(value, self, ctx)
  File "/private/tmp/.venv27/lib/python2.7/site-packages/click/types.py", line 46, in __call__
    return self.convert(value, param, ctx)
  File "/private/tmp/.venv27/lib/python2.7/site-packages/click/types.py", line 614, in convert
    self.path_type, filename_to_ui(value)
UnicodeEncodeError: 'ascii' codec can't encode character u'\xf6' in position 1: ordinal not in range(128)

It works as expected in python 3.x:
# Python 3.8, click 7.1.2
(.venv38) /tmp $ pip freeze | grep click
click==7.1.2
(.venv38) /tmp $ python cli.py --path föo
Usage: cli.py [OPTIONS]
Try 'cli.py --help' for help.

Error: Invalid value for '--path': Path 'föo' does not exist.

Environment

Python version: 2.7.13
Click version: 7.1.2

Although the current release supports Python 2.7, I am no longer providing support for 2.7 myself. If you'd like to write a PR against that branch, I can review it and possibly make a release.


Mark service as pending if load balancer is not available.

[Resolves #5]

Closed pull requests due to current architecture not using the 'LoadBalancer' type due to Amazon EC2 restrictions on the number of external load balancers available


Fix code scanning alert - Inclusion of functionality from an untrusted source

Tracking issue for:

[x] https://github.com/Astraxx04/LearnZ/security/code-scanning/9

Fixed by PR #44


Facet Cursor syntax

Continue to experiment with Baobab. Facets look great. One little question / proposal:
Current syntax:
cursors: {
  url: ["url"],
  models: ["robots", "models"],
},
get: function(data) {
  let {url, models} = data;
  ...
}

Subjectively cleaner alternative:
cursors: [
  ["url"],
  ["robots", "models"],
],
get: function(url, models) {
  ...
}

Keys removed, destructuring is lifted to function signature.

:+1:

Why not? This wouldn't be incompatible with the current implementation. Let me thinks about it a bit more and take a decision.

Shorthand implemented in v2.


Allow custom sections with a name other than name

I've got a custom section in my wasm module that has a name jwt. When I attempt to load this module, I get an error. It appears from the code that your parser will throw an exception upon encountering any custom section other than name. This, I believe, breaks the spec rules allowing anyone to embed any custom section with any name. Can we just get the section added to the module as a binary blob if you don't know how to parse it? Then I can turn it into a string and do the decoding myself later.
This is the error I get:
08:40:34.286 [error] Task #PID<0.403.0> started from #PID<0.398.0> terminating
** (RuntimeError) Parser for custom section jwt not implemented
    (alchemy_vm) lib/decoding/custom_section_parser.ex:20: AlchemyVM.Decoder.CustomSectionParser.parse_section/2
    (alchemy_vm) lib/decoding/custom_section_parser.ex:12: AlchemyVM.Decoder.CustomSectionParser.parse/1
    (elixir) lib/task/supervised.ex:90: Task.Supervised.invoke_mfa/2
    (elixir) lib/task/supervised.ex:35: Task.Supervised.reply/5
    (stdlib) proc_lib.erl:249: :proc_lib.init_p_do_apply/3
Function: &:erlang.apply/2
    Args: [#Function<0.83825848/1 in AlchemyVM.Decoder.parallel_decode/1>, [{0, <<3, 106, 119, 116, 101, 121, 74, 48, 101, 88, 65, 105, 79, 105, 74, 113, 100, 51, 81, 105, 76, 67, 74, 104, 98, 71, 99, 105, 79, 105, 74, 108, 90, 68, 73, 49, 78, 84, 69, 53, 73, 110, 48, 46, 101, ...>>}]]
** (EXIT from #PID<0.398.0>) shell process exited with reason: an exception was raised:
    ** (RuntimeError) Parser for custom section jwt not implemented
        (alchemy_vm) lib/decoding/custom_section_parser.ex:20: AlchemyVM.Decoder.CustomSectionParser.parse_section/2
        (alchemy_vm) lib/decoding/custom_section_parser.ex:12: AlchemyVM.Decoder.CustomSectionParser.parse/1
        (elixir) lib/task/supervised.ex:90: Task.Supervised.invoke_mfa/2
        (elixir) lib/task/supervised.ex:35: Task.Supervised.reply/5
        (stdlib) proc_lib.erl:249: :proc_lib.init_p_do_apply/3

On this line .. is there a way to just leave the raw binary sitting in the section and not raise an exception? Then my code can just go through the custom section map later, extract the binary, and do what I need with it.

Yeah this is something we haven't implemented yet. I'll look into
implementing this weekend -- could you provide some description of how
non-name custom sections are typically parsed by other VMs? Or a link to
relevant information would be helpful as well.
On Thu, May 2, 2019, 8:48 AM Kevin Hoffman<EMAIL_ADDRESS>wrote:

On this line
https://github.com/ElixiumNetwork/AlchemyVM/blob/7a313825ed50720256dda6e61e83356621357963/lib/decoding/custom_section_parser.ex#L20
.. is there a way to just leave the raw binary sitting in the section and
not raise an exception? Then my code can just go through the custom section
map later, extract the binary, and do what I need with it.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/ElixiumNetwork/AlchemyVM/issues/36#issuecomment-488659017,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ACG5XYQORCWUDCBPNX6UOVDPTLPIPANCNFSM4HJ6AEIA
.

According to the spec, the custom sections are designed for debugging or third party use. As such, interpreters typically ignore them (like Rust's wasmer and Firefox and Chrome... all ignore the custom sections). Libraries that allow for reading of module data, like yours and the one Parity has for Rust, should expose access to the custom section "as an uninterpreted sequence of bytes for custom use".
So, with parity-wasm, I can iterate through the custom sections and get a byte array/blob for each one - the main parser doesn't care what the bytes are, it just makes them available to me.

Tangentially related - @alexdovzhanyn are there any benchmarks in terms of execution time and instantiation/load time that I can see? I want to compare them against wasmer

So, with parity-wasm, I can iterate through the custom sections and get a byte array/blob for each one - the main parser doesn't care what the bytes are, it just makes them available to me.

This makes sense -- we can implement this way since its considered to be the standard approach.

Tangentially related - @alexdovzhanyn are there any benchmarks in terms of execution time and instantiation/load time that I can see? I want to compare them against wasmer

We don't have any benchmarks at the moment but I expect that in single threaded execution (i.e. one vm instance at a time) Alchemy will be less performant than something written in a lower level language like Rust or C. The goal with alchemy is to be performant when running multiple VMs in parallel. That being said, it should be quite usable for things that don't require a very high throughput.

Cool thanks for the info!

Did this ever get implemented? I'm curious if this project is still being maintained.


Column resizing issue

My code is already updated but after resizing the column when i save wiki page, its not changing

column of the table?

when i edit second time it will reset to it's real width, every time i need to change width column

There were 2 bugs that happened here.

Tiptap omitted  tags that determines the length of table cell while using editor.getHTML() method. So I had to do a hack using jquery to fetch the HTML in editor (sub optimal fix until tiiptap fixes this issue)
Tiptap doesn't load the saved HTML properly (missing attributes in tables)

reference https://github.com/ueberdosis/tiptap/issues/4105


Can't import Bestiary 5 - Seal (hero lab = yes, aonprd.com = no)

Can't import:
https://www.aonprd.com/MonsterDisplay.aspx?ItemName=Seal
Error message:

Great work!  I'm estimating that now about 85% of Bestiary 5 is importing using the latest Foundry VTT, PF1e game system, and your latest module.

Fixed in 2.0.7


Unknown argument output_layer=final_result

when i execute this code:
bazel-bin/tensorflow/examples/label_image/label_image \

output_layer=final_result
labels=/tf_files/retrained_labels.txt
image=/tf_files/flower_photos/daisy/5547758_eea9edfd54_n.jpg
graph=/tf_files/retrained_graph.pb

i got the error:
E tensorflow/examples/label_image/main.cc:319] Unknown argument output_layer=final_result
usage: bazel-bin/tensorflow/examples/label_image/label_image

Thank you for your post. We noticed you have not filled out the following field in the issue template. Could you update them if they are relevant in your case, or leave them as N/A? Thanks.
Have I written custom code
OS Platform and Distribution
TensorFlow installed from
TensorFlow version
Bazel version
CUDA/cuDNN version
GPU model and memory
Exact command to reproduce

I've got the retrained_labels.txt and retrained_graph.pb, but how do I run it on iOS?

Nagging Assignee @aselle: It has been 16 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

@kSimpleCoder : Use ' --' before any arguments, e.g. --output_layer,


Support full spectrum of HAProxy rules

Request:
https://www.haproxy.com/doc/aloha/7.0/haproxy/http_rewriting.html#rewriting-http-requests
Response:
https://www.haproxy.com/doc/aloha/7.0/haproxy/http_rewriting.html#rewriting-http-responses
Health checks:
https://www.haproxy.com/doc/aloha/7.0/haproxy/healthchecks.html

From @skuda
I needed to add another haproxy rule to get phpmyadmin fully working
this is the final setup of one backend
   reqrep ^(GET|POST|HEAD)\ /1/(.*)     \1\ /\2

   acl hdr_location res.hdr(Location) -m found
   rspirep ^Location:\ (https?://phpmyadmin.local(:[0-9]+)?)?(/.*) Location:\ /1/ if hdr_location

   server server-<IP_ADDRESS> <IP_ADDRESS>:80```

This way I got the rewrites needed, this is something that is accomplish in Apache mod_proxy with "ProxyPassReverse"

you can get the details here https://www.haproxy.com/blog/howto-write-apache-proxypass-rules-in-haproxy/ (edited)

without that I was able to see the home but every submit button was broken, because it directed to phpmyadmin.local, not phpmyadmin.local/1

[ ] haproxyRule or rawRule key.
[ ] Array of strings
[ ] Prefix auto generated acls with __ prefix

If we use haproxyRule / backendRules then there is option that we can remove our current existing
headerRule and rewriteRule. But removing those won't be backward compatible. So should we mark those deprecated for now and introduce the new backendRule along side them? @TamalSaha

We will keep the old things as is. When we rewrite everything for the new TPR in 1.7, we will review these things. I think there is a good case to be made to have direct support for common HTTP rewrite rules.

@skuda, We have added new BackendRule that can used to add any custom acl rules for a backend. This can be used to add response headers. See docs here: https://github.com/appscode/voyager/blob/master/docs/user-guide/component/ingress/backend-rule.md

Tested, working fine, thanks!!


ci(workflow): add cache to workflows using actions/setup-node

Description
Add cache to workflows using actions/setup-node
Context
setup-node GitHub Action just released a new option to add cache to steps using it.
You can find the details here: https://github.blog/changelog/2021-07-02-github-actions-setup-node-now-supports-dependency-caching/

🤖 This PR has been generated automatically by this octoherd script, feel free to run it in your GitHub user/org repositories! 💪🏾

whoops, sorry, missed this PR. it's implemented now via https://github.com/simplabs/ember-hbs-minifier/pull/424 😅

whoops, sorry, missed this PR. it's implemented now via #424 😅

No problem! 😎


[Computer] az ssh vm: Automatically launch browser when getting certificate fails

Description
Fix #16988, #16989
Require #17072
When getting certificate fails for VM SSH,

the original AAD error is shown as a warning
browser is automatically launched to open /authorize with resource=https://pas.windows.net/CheckMyAccess/Linux

Conditional Access policy for MFA (#16989)
When ARM doesn't require MFA, but VM SSH does, az ssh vm calls /token and fails with
AADSTS50076: Due to a configuration change made by your administrator, or because you moved to a new location, you must use multi-factor authentication to access 'ce6ff14a-7fdc-4685-bbe0-f6afdfcfa8e0'.
Trace ID: ab8e08ab-b0f3-4c1b-b2b8-85f905da5b00
Correlation ID: 73ad3fe7-524c-4a6f-9e14-b448fa4b8c06
Timestamp: 2021-02-25 11:21:49Z

CLI then launches the browser. The browser prompts the user to do MFA.
Conditional Access policy for compliance check (#16988)
When ARM doesn't require compliance check, but VM SSH does, az ssh vm calls /token and fails with
AADSTS53000: Device is not in required device state: compliant. Conditional Access policy requires a compliant device, and the device is not compliant. The user must enroll their device with an approved MDM provider like Intune.
Trace ID: fed27c52-e7f0-4d4b-a6df-51016ec54a00
Correlation ID: 582d7943-5bc3-4fd4-9bb9-f6c7721b131f
Timestamp: 2021-02-25 11:06:44Z

CLI then launches the browser. After logging in, the browser gives the user a better error message:

Limitation

Only user account with authorization code flow is supported.
CLI should selectively launch the browser instead of launching the browser unconditionally for any AAD error.

Testing Guide
az login
az ssh vm -g <group> --vm-name <vm>

ssh vm


Buying an item in inventory view loses certain available item portraits

The ones that aren't visible from the top lose their portraits and don't reload them when scrolled:

Possibly related: http://discourse.codecombat.com/t/item-icons-not-loading/2222


load_huggingface_model failed on rugpt3large_based_on_gpt2 RuntimeError: The size of tensor a (50264) must match...

I try to reproduce finetuning process for rugpt3large with deepspeed and apex.
I managed to finetune rugpt3small.
But when a run the same script with large configuration a get the following error
R0/1: Loaded 49 examples, 100352 tokens
> padded vocab (size: 50257) with 7 dummy tokens (new size: 50264)
> end-of-document token: 0
building GPT3 model ...
Load huggingface model from sberbank-ai/rugpt3large_based_on_gpt2
Downloading: 100%|██████████| 609/609 [00:00<00:00, 636kB/s]
Downloading: 100%|██████████| 3.14G/3.14G [01:02<00:00, 50.0MB/s]
Traceback (most recent call last):
  File "ru-gpts/pretrain_gpt3.py", line 830, in <module>
    main()
  File "ru-gpts/pretrain_gpt3.py", line 786, in main
    model, optimizer, lr_scheduler = setup_model_and_optimizer(args)
  File "ru-gpts/pretrain_gpt3.py", line 177, in setup_model_and_optimizer
    model = get_model(args)
  File "ru-gpts/pretrain_gpt3.py", line 78, in get_model
    model = load_huggingface_model(model, args.load_huggingface, args.huggingface_double_pos_embeddings)
  File "/notebooks/ru-gpts_apex/ru-gpts/src/utils.py", line 474, in load_huggingface_model
    move_weights(model2fill, h_model, double_pos_embeddings)
  File "/notebooks/ru-gpts_apex/ru-gpts/src/utils.py", line 454, in move_weights
    load_weights(transformer_model.wte, our.word_embeddings, dst2src)
  File "/notebooks/ru-gpts_apex/ru-gpts/src/utils.py", line 421, in load_weights
    load.copy_(data)
RuntimeError: The size of tensor a (50264) must match the size of tensor b (50257) at non-singleton dimension 0
--------------------------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.

My apex installation slightly differs from one in Finetune_and_generate_RuGPTs_deepspeed_megatron.ipynb example, because I had to install it with Nidia container, in other case it didn't work.

Same here.

I've exactly the same with RuGPT-3 Medium.
@IvanAntipov what configuration are you using (cuda, torch, triton)?

I added a new parameter

--make-vocab-size-divisible-by 1

And it works.

I've exactly the same with RuGPT-3 Medium.
@IvanAntipov what configuration are you using (cuda, torch, triton)?

I think it is not actual anymore, but nevertheless:
CUDA 11.2
torch==1.5.0
No triton

solved by https://github.com/sberbank-ai/ru-gpts/issues/69#issuecomment-891336114