Combining 2 input sequences with sequence Combiner

Is your feature request related to a problem? Please describe.
I am trying to figure out how to combine 2 input sequences with sequence Combiner and I am not sure if this is possible. It would be great if it would ;) Right now I am getting
ValueError: Decoder inputs rank is 2, but should be 3 [batch x sequence x hidden] when using a tagger sequential decoder. Consider setting reduce_output to null / None if a sequential encoder / combiner is used.

if I try to put two sequences as inputs to sequence combiner.
Describe the use case
Consider following (simplified) features where tag is the ouput feature.
text                                lexicon                                      tag
I am a robot                   0 0 0 1                                      O O O X
George killed Greg        1 0 1                                         X O X

Describe the solution you'd like
I would like to embed text and lexicon series and predict tag with tagger.
So I would like to set up the combiner in a way that the first row that goes into the encoder of the sequence combiner would look like
[ (emb(I) | emb(0)), (emb(am) | emb(0)), (emb(a) | emb(0)), (emb(robot) | emb(1)]

like this:
input_features:
  - name: text
    type: text
    level: word
    encoder: embed
    reduce_output: null
  - name: lexicon
    type: sequence
    encoder: embed
    representation: sparse
    reduce_output: null
combiner:
  type: sequence
  main_sequence_feature: text
  encoder: rnn
  cell_type: lstm
  bidirectional: true
  num_layers: 2
  reduce_output: null
output_features:
  - name: tag
    type: sequence
    decoder: tagger
    reduce_inputs: null

Describe alternatives you've considered
I was hoping for this to work out of the box, but now I am not sure if this is supported.
Additional context

Your task is exactly the reason why the sequence combiner exists :)
It looks like you did everything correctly apart from reduce_inputs in the output feature, which should be reduce_input. With that, the tesnor the error is complaining about should have the correct sapes.
Let me know if this fixes your issue. (this also suggests me to provide a mechanism to notify the user when wrong keys are used in the model definition, this would have avoided your error to happen if you got notified).
I am really glad that people are starting to use those more advanced features in Ludwig!

Thank you for your fast reply, the promise of an easy way to use those advanced features was what has drawn me to Ludwig in the first place (after seeing you present at Interspeech 2019).
Unfortunately your recommendation does not solve the problem (same issue persists) - likely because reduce_input was set to None anyway as it is the default value for tagger.
As to your other points:
I think that ensuring correct user input is an essential addition, as there are few things more frustrating that chasing a configuration typo for half a day ;) You could use something like jsonschema for it - it is pretty easy to write and convenient to use for validation. Alternatively Data Classes in 3.7's PEP 557 could be of use, but maybe its too early for that.
I guess there is also a bug in documentation, as this was a copy-paste from the tagger definition. Where it says reduce_inputs (with the s at the end), the same typo appears at least 13 times in the user guide.

Also it would be awesome to have a clear example for such a use-case in Examples :)

@w4nderlust Thank you for your fast reply, the promise of an easy way to use those advanced features was what has drawn me to Ludwig in the first place (after seeing you present at Interspeech 2019).

Nice :)

Unfortunately your recommendation does not solve the problem (same issue persists) - likely because reduce_input was set to None anyway as it is the default value for tagger.

Let me try to fix it. Could you please provide a complete reproducible example with data, configuration and command? The data can be synthetic data generated using the script in data/dataset_synthesizer.py and can also be just a couple of lines, no need for the full dataset, as I believe the same problem will appear whith any amount of data.

As to your other points:
I think that ensuring correct user input is an essential addition, as there are few things more frustrating that chasing a configuration typo for half a day ;) You could use something like jsonschema for it - it is pretty easy to write and convenient to use for validation. Alternatively Data Classes in 3.7's PEP 557 could be of use, but maybe its too early for that.

These are good suggestions, thank you. Although Ludwig's configuration file is highly dynamic, in the sense that it maps directly the parmeters you put in the configuration to parameters in the classes and functions it uses. For that reason, and for the fact that the classes themselves are often changing and new ones are added, so far I preferred not to have a static parsers for the configuration (it's a v0.x still so I know things will change quite a lot still). Moreover, if a use adds their own additional encoder for instance, they would have to modify the parser too, and I want to avoid that. What I plan to do instead is find a simple mechanism that notifies of all the unrecognized keyowrds passed to each function / object, that could be a temporary solution that preserves dynamicity and avoids failing silently like it happens right now.

I guess there is also a bug in documentation, as this was a copy-paste from the tagger definition. Where it says reduce_inputs (with the s at the end), the same typo appears at least 13 times in the user guide.

Fixed it. Although the default value for sequence features is sum not null.

Also it would be awesome to have a clear example for such a use-case in Examples :)

If you agree I can use yours as an example :)

this will generate the data
import pandas as pd

tagged = {'Greg', 'Xavier', 'Smith', 'Piotr', 'robot', 'dad', 'George'}
lex = {'Greg', 'Xavier', 'robot'}

texts = [
    "I like Greg and Greg likes me more than George",
    "Xavier Smith went to the gym with robot dad",
    "robot dad was not the best dad cause he didn't have limbs",
    "Piotr Smith is a better name than Xavier Greg cause at least it is not both first names",
    "the gut is called the second brain for good reasons listen to your gut",
    "omg how many more examples I have to think of am I a robot or what",
    "this is not going to be easy I should ask my dad for help",
    "well he is busy so here is one more from the top of my head",
    "this is a very nice libary btw i hope we manage to solve this issue so I can continue using it",
    "i have great hopes for it"
]

df = pd.DataFrame(dict(
    text=texts,
    lexicon=[" ".join('1' if w in lex else '0' for w in t.split()) for t in texts],
    tag=[" ".join('X' if w in tagged else 'O' for w in t.split()) for t in texts]
))
df.to_csv('combiner_test.csv')

here is the example.yaml
input_features:
  - name: text
    type: text
    level: word
    embeddings_trainable: true
    embedding_size: 300
    encoder: embed
    preprocessing:
      word_format: space
    reduce_output: null

  - name: lexicon
    type: sequence
    encoder: embed
    reduce_output: null

combiner:
  type: sequence
  main_sequence_feature: text
  encoder: rnn
  cell_type: lstm
  bidirectional: true
  num_layers: 2
  reduce_input: null
  reduce_output: null

output_features:
  - name: tag
    type: sequence
    decoder: tagger
    reduce_input: null

and here is a command to reproduce
ludwig train --data_csv combiner_test.csv --model_definition_file example.yaml

Thank you, I found the bug and fixed it. Can you please confirm it now works for you?
Please install from master with:
pip uninstall ludwig & pip install git+http://github.com/uber/ludwig.git
Also if you confirm your approval, I will add this to both examples and test.

I will do that first thing after the Wed meeting spree ;) Thank you @w4nderlust ! :)
You have my approval to use the examples I provided in any way you like, as they are purely synthetic :)

@w4nderlust I guess we found another bug in the docs then :) as it does say word_format: space in the tagger example. (or maybe I am looking at release docs and we changed to work with master throughout the development of this thread, not sure)
also adding these lines under the text feature like in the example above did not help, I had to add it as a top level item in the yaml file, but now I am able to train. Thank you!
I think this is something to underline in the documentation :)
If any one has the same problem the following config could be of help:
input_features:
  - name: text
    type: text
    level: word
    embeddings_trainable: true
    embedding_size: 300
    encoder: embed
    preprocessing:
      word_format: space
    reduce_output: null

  - name: lexicon
    type: sequence
    encoder: embed
    reduce_output: null

combiner:
  type: sequence
  main_sequence_feature: text
  encoder: rnn
  cell_type: lstm
  bidirectional: true
  num_layers: 2
  reduce_input: null
  reduce_output: null

output_features:
  - name: tag
    type: sequence
    decoder: tagger
    reduce_input: null

preprocessing:
  text:
    word_tokenizer: space

Good catch. yes word_format was an old name for word_tokenizer, I'm updating the docs right now. Regarding your model definition. You need only one word_tokenizer: space, either in the text feature or at the top level. The top level one applies to all text features, the one inside the feature applies only to that specific feature, but you have only one text feature so it makes no difference.


[core] Bump MUI Base's version in Material UI

[x] I have followed (at least) the PR section of the contributing guide.

In the latest release (v5.11.12) (#36443), I made a mistake of adding a code snippet to yarn.lock to pass a CI test failure. This occurred because I didn't bump the version of @mui/base from alpha 119 to alpha 120 in the package.json of @mui/material. (The version of MUI Base itself was bumped and in other packages as well except for the @mui/material).

Note
This PR doesn't need to be merged as this can be resolved as part of the v5.11.13 release on upcoming Monday. Opened this PR as a reference point just in case.

Did we break something with this release? Were there some breaking changes in MUI Base?

I will merge so that the next release is straight forward.

Did we break something with this release? Were there some breaking changes in MUI Base?

Yes, there was one breaking change in Base: https://github.com/hbjORbj/material-ui/blob/release/5.11.12/CHANGELOG.md#breaking-changes-1
Some community member seemed to struggle from this. Issue: https://github.com/mui/material-ui/issues/36447


Allow different beginning and ending frontmatter delimiters.

- Summary
This is a minor update on top of #1064 to allow different beginning and ending frontmatter delimiters.

- Test plan
Tests added. Also manually tested both with single and list.

- Description for the changelog

- A picture of a cute animal (not mandatory but encouraged)

Deploy preview for netlify-cms-www ready!
Built with commit 4c1acd2290b733b3addfe764a023e70cafbdbce1
https://deploy-preview-1094--netlify-cms-www.netlify.com

Deploy preview for cms-demo ready!
Built with commit 4c1acd2290b733b3addfe764a023e70cafbdbce1
https://deploy-preview-1094--cms-demo.netlify.com


Add functions to execute docker-compose commands

Hi, thanks for you contribution!
Help me understand the rationale for this PR: what are the use cases you have in mind?
I personally never feel the need to run any of those docker-compose commands when I'm editing docker-compose.yml files. Additionally, when I do run them, I nearly always target a specific service.
It would really help if you described some scenarios where these functions would be useful. 🙂

I had them in my config for a while as I find it much more natural to bind them to a key and run them when working with containers, don't know if other people feel the same about that though.
I wrote them when I was developing a few containers that were all sharing configs with each other as it was just easier to switch into the compose buffer and run those rather than leaving emacs or running a shell command. I don't often feel the need to target a specific service in a compose file with the stuff I tend to work with but thinking about it our compose files are segmented so you wouldn't actually need to.

I've made an extended version of this over in #25. Feedback is welcome from you guys!

Check out functionality on Silex/docker.el package.


Update Font Awesome item in release notes

As of #3984, FA is now 4.6.3, not 4.5.0.

Thanks, derp.


Start Bot Failed Messages When Trying To Launch The Bot Using Bot Framework Composer

Start bot failed
Error: Command failed: dotnet user-secrets init --project azurewebapp /bin/sh: dotnet: command not found
Describe the bug

Version
version : 1.1.1 <> Elsctron 8.2.4 <>NOdeJS:12.13.0
Browser

[ ] Electron distribution
[ ] Chrome [X]
[ ] Safari
[ ] Firefox
[ ] Edge

OS

[ ] macOS [X]
[ ] Windows
[ ] Ubuntu

To Reproduce
Steps to reproduce the behavior:

Go to '...'Bot Framework Composer
Click on '....'Add New Bot From Scratch, once added, add the greetings action and now click "Start Bot"
Scroll down to '....'
See error

Expected behavior

The Bot should have launched as an simulator

Screenshots

Additional context

na

Have you installed the .NET Core SDK?
Quoting the docs:
Prerequisites

The Bot Framework Emulator.
The .NET Core SDK 3.1 and above.
Download and use Composer: Windows | macOS | Linux.

As @nitroin explained, it looks like you may need to install the dotnet dependencies.

I'm having the same issue. It was working fine last night. This morning I quit Composer and the Emulator and re-launched them and now I'm seeing this error.


⚠ SceneTime has degraded performance

In d82a27f, SceneTime ($ST) experienced degraded performance:

HTTP code: 200
Response time: 2739 ms

Resolved: SceneTime performance has improved in caff1f9 after 6 minutes.


Adapters for models through API

I have a pre-trained BERT model that can only be accessed through a REST API. How can I use adapters with that model? I need to fine-tune the model on different datasets. How can I achieve this using Adapter Transformers?

This issue has been automatically marked as stale because it has been without activity for 90 days. This issue will be closed in 14 days unless you comment or remove the stale label.

This issue was closed because it was stale for 14 days without any activity.


Wiki Link Does not work

The wiki link in the read me does not work. https://wiki.runonflux.io/

can we connect need help for miningcore

The wiki link in the read me does not work. https://wiki.runonflux.io/

can we connect need help for miningcore


Use flat arrays in stats collection.

Reduces time taken for stats merging with 16 tiles from 575us
to 224us on my machine.

Looking for tips to make this faster. It's still too slow, so for realtime I'll still need to add a flag to disable stats collection. But it would be nice if I didn't need the flag.

I should have realized these each had a known, finite number of options and done it like this in the first place. Nice.
As far as disabling, we only output the stats if the verbose flag is enabled, but maybe disabling stats collection using that flag is tying the encoder too closely to the CLI?

I mean, we can have an API for compute stats, and the CLI can use that API based on the verbose flag.


set min_child_weight as a float instead of int

Hi, all
Based on xgboost documentation, min_child_weight is treated as number of observation for rmse objective and is usually chosen as int such as https://xgboost.readthedocs.io/en/latest/python/python_api.html#xgboost.XGBRegressor.
However, I recently read a article saying that "With XGBoost, you can specify this parameter as a float as well. If you do, it will use a percentage of samples to determine leaf nods." (https://kevinvecmanis.io/machine learning/hyperparameter tuning/dataviz/python/2019/05/11/XGBoost-Tuning-Visual-Guide.html#child_weight). I cannot find a second source using min_child_weight as a float.
So I am confused and worried that is it true that we could set min_child_weight as a float?? Any comfirmation would be appreciated.

sklearn's min_samples_leaf supports float as a percentage of total sample size which makes sense to me. It would be great if xgboost supports similar functionality.

Sorry for the mistake in our doc.   Also, the parameter you referred min_samples_leaf is indeed on our roadmap: https://github.com/dmlc/xgboost/issues/5444

Hi @trivialfis , thanks so much for your timely reply. May I double check with you that if min_child_weight is set as, for example, 0.01, it will be treated as n_sample * 0.01, meaning 1% of total sample?
Reference: https://kevinvecmanis.io/machine learning/hyperparameter tuning/dataviz/python/2019/05/11/XGBoost-Tuning-Visual-Guide.html#child_weight

No.  It's the minimum value of accumulated Hessian for each leaf.  Hessian is often used as a proxy for data in gradient boosting.

No. It's the minimum value of accumulated Hessian for each leaf. Hessian is often used as a proxy for data in gradient boosting.

I see. Thanks for answering.


Mismatch in text and example for row_number

In the docs for window functions:
https://duckdb.org/docs/sql/window_functions
Under section Partition and Ordering, the docs provide the following example:
SELECT "Plant", "Date", row_number() over () AS "Row"
FROM "History"
ORDER BY 1, 2

Then it says:

Note that even though the function is computed with an ORDER BY clause, the result does not have to be sorted, so the SELECT also needs to be explicitly sorted if that is desired.

But the function row_number in the example above is computed without an order by clause, and the select is sorted.
(BTW what I was looking in particular was trying to determine how row_number with an empty over() would determine the order, and how would that order compares to the order in the select with or without an order by at the end. I think it'd be helpful to cover these types of details)

This was fixed by #575.


ACME_AGREE environment variable not working

I have set the ACME_AGREE environment variable to true but am unable to get past the agreement dialog. My logs show the following and just stop.
Activating privacy features...

Your sites will be served over HTTPS automatically using Let's Encrypt.
By continuing, you agree to the Let's Encrypt Subscriber Agreement at:
  https://letsencrypt.org/documents/LE-SA-v1.2-November-15-2017.pdf

2018/04/07 01:35:33 user must agree to CA terms (use -agree flag)

I got it to accept by manually entering y in the log window. Doesn't seem right though.

This is strange, as you're the first to report this. What version of the docker image are you using ?

latest

I'm still pretty new to docker, using Portainer to manage all of my containers, here are the container details.

You're not running the latest version. The version should be 0.10.12. The environment variable was only introduced in 0.10.12.

I have same issue. Here is my docker-compose.yml
services:
  caddy:
    image: abiosoft/caddy:0.11.0-no-stats
    environment:
      - ACME_AGREE=true
    volumes:
      - "./Caddyfile:/etc/Caddyfile"
      - "caddy-data:/root/.caddy/"
    ports:
      - 80:80
      - 443:443

Caddy log:
caddy_1    | Your sites will be served over HTTPS automatically using Let's Encrypt.
caddy_1    | By continuing, you agree to the Let's Encrypt Subscriber Agreement at:
caddy_1    |   https://letsencrypt.org/documents/LE-SA-v1.2-November-15-2017.pdf
caddy_1    | 2018/07/20 11:46:15 user must agree to CA terms (use -agree flag)
caddy_1    | exit status 1
caddy_1    | Do you agree to the terms? (y/n): testapp_caddy_1 exited with code 1


Focus outline should cover search/button

In at least Safari/Chrome, the outline for a <input type="text"> doesn't cover search which I at least "feel" would be the right thing to do. I obviously know why this is occurring so I guess the issue could be whether (or not) this should be a thing :)

I guess this applies to most input groups (scroll a bit further).

@jbergstroem Yes, it is a known issue which doesn't look perfect. There is a way to make the whole component covered by the outline. But more complex code structure.
I will try to make it in the Experimentals first to test whether it is workable.


Add a contact button at the top-right of the page

the contact button will open up an e-mail to be sent to<EMAIL_ADDRESS>

this  looks good @valearna. Closing


your paper's demo script request("Methods for Few-View CT Image Reconstruction")

@kylechampley Could you add some demo script for checking your last paper's figure-6,7,8 with data?
Paper name is "Methods for Few-View CT Image Reconstruction".

Ya, that's a good idea, I'll try to dig those up.  I actually wrote that paper about three years ago and at that time was using LTT to make those results, so it'll take me some time to dig those up.


Save game download issue -> all schools removed

Describe the bug
When a friend joins and downloads the save, all school buildings get completely removed (no money refuned)
To Reproduce
Steps to reproduce the behavior:

Build some schools
A new player joins
All unhappy faces, and school buildings are gone

Expected behavior
No buildings removed
Screenshots
Active DLCs

After dark
Carols, candles and candy
Green Cities
Industries
Mass Transit
Match Day
Pearls from the east
Snowfall
Sunset Harbor

Active mods

This mod
25 tiles mod w correct pricing
Mod Achievement Enabler
Unlimited soil
Precision engineering

Versions
Type /version into the in-game chat and paste the version numbers here:

Mod version: 2<IP_ADDRESS>
Game version: 1.13.0-f7

Additional context
Add any other context about the problem here.

This was my own mistake, I checked all mods and DLC to be compatible with my friends DLC, but forgot one asset pack.
But if it would be possible to check these mods and assets on join, it would be better than just 'removing' everything :)


Title flash when new message recieved

Also add an orange dot on the favicon to indicate a new message.

Completed


Global deprecated filtering settings

From: https://github.com/sensu/sensu/issues/1530
the settings of the "deprecated filtering" should have a global server setting
Expected Behavior
Be able to set a global server setting to disable the deprecated filtering
Current Behavior
currently the settings needs to be in many places to completely bypass de deprecated filtering

in checks
in client config for the keepalive event
in all manual tcp socket events

Your Environment

Sensu version used: 0.26.3

this should only be while the feature is still there, so it can be disabled as a whole

this feature is included in sensu-plugin 1.4.5, now available on rubygems.org


WIP: Unhide a ValueError for deserialization errors.

Closes #501
Removes reference to a dead link - OBE's #296

@neozenith Opened this for discussion

Codecov Report

:exclamation: No coverage uploaded for pull request base (master@accffa8). Click here to learn what that means.
The diff coverage is 100%.

@@            Coverage Diff            @@
##             master     #506   +/-   ##
=========================================
  Coverage          ?   89.17%
=========================================
  Files             ?       24
  Lines             ?     1543
  Branches          ?      211
=========================================
  Hits              ?     1376
  Misses            ?      138
  Partials          ?       29

Impacted Files
Coverage Δ

vcr/errors.py
100% <100%> (ø)

vcr/serialize.py
100% <100%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update accffa8...d35e73b. Read the comment docs.

Thanks for following this up! I’ll have a look at it between now and New Years.

Actually I won’t have bandwidth to look at PRs until mid January when I’m finished my annual leave.

@neozenith Have you been able to look at this?


"PowerToys Run ran into an issue" while booting

Microsoft PowerToys version
0.53.3-x64
Running as admin

[X] Yes

Area(s) with issue?
PowerToys Run
Steps to reproduce
I installed the updated version, rebooted, and this error came up.
2022-01-22.txt
✔ Expected Behavior
I was just expecting it to run when I logged in.
❌ Actual Behavior
Instead, I got this error message.
2022-01-22.txt
Other Software
No response

Issue: App.Dark.png not found

/dup #9742

Duplicate of #9742


n71 error

Version: 3fc8c093f4660f6c6e07c0c9214618733da01ffc - 36
libfragmentzip version: 0.60-120447d0f410dffb49948fa155467fc5d91ca3c8
init pzb: https://updates.cdn-apple.com/2022SummerFCS/fullrestores/012-41736/19A1E631-3FB4-4F85-BE5B-266C40FACEEB/iPhone_4.7_15.6_19G71_Restore.ipsw
init done
Error: file Firmware/.trustcache does not exist, or is a directory
failed

Did you try again. I only have a n71m, and it works for me

Did you try again. I only have a n71m, and it works for me

it worked now but i cant ssh into it
─[hoanglong@PainKiller]:[~/SSHRD_Script]
└──╼ $ ssh -p 2222 root@localhost
kex_exchange_identification: read: Connection reset by peer
┌─[hoanglong@PainKiller]:[~/SSHRD_Script]
└──╼ $ ssh -p 4444 root@localhost
kex_exchange_identification: read: Connection reset by peer
┌─[hoanglong@PainKiller]:[~/SSHRD_Script]
└──╼ $

Worked fine on my n71, did you use iproxy?

Worked fine on my n71, did you use iproxy?

worked now, but i want to edit com.apple.MobileGestalt.plist
is there any way to do it ?

when i use nano and save it says operation not permitted

SEP restrictions

SEP restrictions

can i create a symlink for this
eg from Downloads


Top level server annotation in v3

There is no top-level OpenAPI annotation (should we?), so it's not clear how to define the top level array of @Server annotations.

@arthurdm This possibly includes other top level metadata, as tags in #2268 and maybe other;
I guess the only options are either

adding an annotation similar to 2.0 @SwaggerDefinition (and implement related code in jaxrs reader)

or

relying solely on filter and/or bootstrapping to include such info.

Possibly 2. is enough, and it would provide a single consistent way to provide such data.
@webron @fehguy any thought on this?

I think having something similar to @SwaggerDefinition would be better, so that we can claim the annotation set is complete (ie: you don't need to use bootstrapping or filter if you don't want to).

implemented in #2470 and #2490


Count of one log greater than another?

Having a bit of trouble with writing an elastalert rule. I need to know if the count of one log is greater than the count of another log, if it is, alert.
Struggling because it's effectively doing some arithmetic (X - Y > 0) which I don't think elastalert supports?

We've since implemented this in Python, so i'll happily close this issue. I've raised another issue (https://github.com/Yelp/elastalert/issues/1783) to describe the problem with the log data that's coming in if you could possibly look at that!


KNN

Thank you for the great work.
i want know how to use KNN,I set KNN-use to True in arch_cfg.yaml and infer
I've tested several sets of KNN parameters, but I don't even see a change after using KNN
By the way, this is my rangeview, I want to remove the blue dots and change them to yellow dots, can you give me some advice on how to do that.

i got it


Add support for extracting original array type for ColumnType array

Fixes #957

SelectType<T>, InsertType<T> and UpdateType<T> definitions were extended to allow for extraction of the underlying type for ColumnType array.
Typings tests were added for all of the above (i.e. select, insert, update).

For more information about the rationale, read description of #957 .

Hey 👋
This could be fine on the premisr that ColumnType<...>[] is a thing. This is wrong usage of ColumnType - it should always be singular - the types passed to it can be arrays.


Move communication to gitter

I suggest we open a channel on https://gitter.im for all neba specific communication.

That looks like a good idea. I'd say this channel would also be an interactive alternative to getting support.

I will close this issue as won't fix for now. The communication around NEBA is, for now, mostly consisting of periodic, issue-centric discussions on github and discussions via social media (twitter, stack overflow). I see no significant improvement in opening another channel as long as this does not change.


Dropping of duplicates

At the moment duplicates are dropped based on whether they have an identical DOI or PM(C)ID. This may loose some information, which is a pity. Possibly, some rows may contain more information than others, so in principle, using all available information would be preferable.
Instead of doing
df_pub = df_pub[df_pub.doi!=""].drop_duplicates(['doi'])

and similar, you may prefer to do
df_pub = df_pub[df_pub.doi!=""].groupby('doi').first()

This groups by the DOI, and then use the first non-NA value for each column. Of course, information in multiple rows may not be fully consistent due to conflicting information. But in principle, this integrates the data better from all datasources.

Cool, I did not know. I will update with the next release.

Done

It seems that there are 256 publications with duplicate DOIs in the resulting dataset, 3 publications with duplicate PMID and one with duplicate PMCID. There seems to be going something wrong, but I can't immediately spot what, perhaps you can take closer look @Giovanni1085 ?

@vtraag so I checked the pub table, and indeed there were some issues with capitalized DOIs and further string sanitization to be done to delete all possible duplicates (capitalized DOIs are considered as different from lowercased when doing a drop_duplicates call). Please do check on the 200410 version, as soon as ready, and let me know if there is still an issue (or close). Thanks!

I believe this issue has been properly solved (at least in the 200701 version).


storage/ramdisk uses no longer defined KMDF_VERSION_MINOR

There are are several places where the value of KMDF_VERSION_MINOR is checked via preprocessor. However, the symbol is neither defined in the code nor the vcxproj.

It has been quite a while, but I recall this not to compile out of the box. If this is something I would need to adjust manually how could I possible know about it?

You need not do anything special. It works out of box now.


bug:There is a conflict between the two plug-ins. The bitsandbytes  version  required by the two plug-ins are different（Dreambooth-bitsandbytes version 0.41.1，but mov2mov bitsandbytes version 0.41.2.post2）.

bug
There is a conflict between the two plug-ins. The bitsandbytes  version  required by the two plug-ins are different（Dreambooth-bitsandbytes version 0.41.1，but mov2mov bitsandbytes version 0.41.2.post2）.
Initializing Dreambooth
Dreambooth revision: d8e01e1fd13dd4b6afadbb0382875f905ee5f429
[+] xformers version 0.0.21 installed.
[+] torch version 2.0.1+cu118 installed.
[+] torchvision version 0.15.2+cu118 installed.
[+] accelerate version 0.23.0 installed.
[+] diffusers version 0.21.2 installed.
[+] transformers version 4.30.2 installed.
[+] bitsandbytes version 0.41.1 installed.
False
The following directories listed in your path were found to be non-existent: {WindowsPath('J')}
CUDA_SETUP: WARNING! libcudart.so not found in any environmental path. Searching in backup paths...
The following directories listed in your path were found to be non-existent: {WindowsPath('/usr/local/cuda/lib64')}
DEBUG: Possible options found for libcudart.so: set()
CUDA SETUP: PyTorch settings found: CUDA_VERSION=118, Highest Compute Capability: 8.9.
CUDA SETUP: To manually override the PyTorch CUDA version please see:https://github.com/TimDettmers/bitsandbytes/blob/main/how_to_use_nonpytorch_cuda.md
CUDA SETUP: Loading binary J:\StableDiffusion\sdwebui\py310\lib\site-packages\bitsandbytes\libbitsandbytes_cuda118.so...
argument of type 'WindowsPath' is not iterable
CUDA SETUP: Problem: The main issue seems to be that the main CUDA runtime library was not detected.
CUDA SETUP: Solution 1: To solve the issue the libcudart.so location needs to be added to the LD_LIBRARY_PATH variable
CUDA SETUP: Solution 1a): Find the cuda runtime library via: find / -name libcudart.so 2>/dev/null
CUDA SETUP: Solution 1b): Once the library is found add it to the LD_LIBRARY_PATH: export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:FOUND_PATH_FROM_1a
CUDA SETUP: Solution 1c): For a permanent solution add the export from 1b into your .bashrc file, located at ~/.bashrc
CUDA SETUP: Solution 2: If no library was found in step 1a) you need to install CUDA.
CUDA SETUP: Solution 2a): Download CUDA install script: wget https://github.com/TimDettmers/bitsandbytes/blob/main/cuda_install.sh
CUDA SETUP: Solution 2b): Install desired CUDA version to desired location. The syntax is bash cuda_install.sh CUDA_VERSION PATH_TO_INSTALL_INTO.
CUDA SETUP: Solution 2b): For example, "bash cuda_install.sh 113 ~/local/" will download CUDA 11.3 and install into the folder ~/local
    CUDA Setup failed despite GPU being available. Please run the following command to get more information:

    python -m bitsandbytes

    Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
    to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes
    and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues

Traceback (most recent call last):
File "J:\StableDiffusion\sdwebui\launch.py", line 48, in
main()
File "J:\StableDiffusion\sdwebui\launch.py", line 44, in main
start()
File "J:\StableDiffusion\sdwebui\modules\launch_utils.py", line 436, in start
webui.webui()
File "J:\StableDiffusion\sdwebui\webui.py", line 64, in webui
shared.demo = ui.create_ui()
File "J:\StableDiffusion\sdwebui\modules\ui.py", line 1279, in create_ui
with gr.TabItem(label, id=ifid, elem_id=f"tab_{ifid}"):
File "J:\StableDiffusion\sdwebui\py310\lib\site-packages\gradio\layouts.py", line 221, in init
BlockContext.init(self, elem_id=elem_id, **kwargs)
File "J:\StableDiffusion\sdwebui\extensions\sd-webui-mov2mov\scripts\m2m_ui.py", line 603, in block_context_init
on_ui_tabs()
File "J:\StableDiffusion\sdwebui\extensions\sd-webui-mov2mov\scripts\m2m_ui.py", line 497, in on_ui_tabs
editor = MovieEditor(id_part, init_mov, movie_frames)
UnboundLocalError: local variable 'movie_frames' referenced before assignment
提示：Python 运行时抛出了一个异常。请检查疑难解答页面。

[程序崩溃，退出代码为 1 (0x00000001)]

Bitsandbytes was not supported windows before, but my method can support windows.（yuhuang）
1  open folder J:\StableDiffusion\sdwebui，Click the address bar of the folder and enter CMD
or WIN+R, CMD  。enter，cd /d J:\StableDiffusion\sdwebui
2  J:\StableDiffusion\sdwebui\py310\python.exe -m pip uninstall bitsandbytes
3 J:\StableDiffusion\sdwebui\py310\python.exe -m pip uninstall bitsandbytes-windows
4 J:\StableDiffusion\sdwebui\py310\python.exe -m pip install https://github.com/jllllll/bitsandbytes-windows-webui/releases/download/wheels/bitsandbytes-0.41.1-py3-none-win_amd64.whl
Replace your SD venv directory file（python.exe Folder） here（J:\StableDiffusion\sdwebui\py310）

Thank you! This worked for me


[ENG-522]Update testcases credentials, create reusable schema,

This PR updates salesforce test cases to implement credential registry.

Current dependencies on/for this PR:

#73  👈
main

This stack of pull requests is managed by Graphite.


Implement k8s controller for NSM connections

Overview

Link to the Google Docs document

References

Hi @denis-tingaikin I'm interested in working on this issue. Could you please provide more details or clarify the scope of the implementation? Thanks!


Rxjs 5 Beta 1 using System.js in Browser

I am unable to run Rxjs in browser using System.js
The complete code project is here:
https://github.com/panacloud/learn-typed-rxjs/blob/master/step02_in_browser/
I am getting the following error:
https://www.dropbox.com/s/oj1o5evzu2rv4q5/Screenshot 2016-02-03 22.16.39.png?dl=0

I'm not really a System.js expert, so I'll defer to @robwormald or @jeffbcross on this one... but it looks like something with how you're building your main.js file. It's calling System.register("rxjs/Observable") which is likely trampling the definition of the "real" one in rxjs.

At last it is working have pushed the updated code here:
https://github.com/panacloud/learn-typed-rxjs/tree/master/step02_in_browser
Thanks


[FEATURE] Navbar items hovering can be improved

🎇 Description
@KiranAminPanjwani When we hover over the navbar items, the hovering effect is not optimal. I believe this effect can be improved. Therefore, please assign this task to me
🖼 Screenshots

@KiranAminPanjwani ma'am pls. assign me the issue

Sure, please proceed @youtanimstar

@KiranAminPanjwani ma'am pls. assign me the issue

Please visit #66

Sure, please proceed @youtanimstar

Thank you for assigning this task to me. I will do my best. 😊


Implementation of support feedback

Tasks

[ ] Update support flow last step
[ ] Add animation into article page
[ ] Update support section

References

Product doc
Design

3


nodejs: disable JS test suite on Darwin

Description of changes
This was recently enabled in #313982. It seems to be much too flaky on Darwin currently, especially x86; see:

https://hydra.nixos.org/build/264860513/nixlog/8
https://hydra.nixos.org/build/264956149/nixlog/3
https://hydra.nixos.org/build/265094929/nixlog/3
https://hydra.nixos.org/build/264901296/nixlog/3

Disable these tests on macOS for now as the broken Node.js package is holding up a lot of builds.
Fixes: b26563aae2a1fce011ac52e28ff23a460866e82f
@aduh95 Unfortunately, I lack the expertise to figure out how to get these tests working more reliably on macOS, but if you have any idea what’s going on I’d be happy to work with you to try and get them functioning properly once this is no longer blocking a bunch of builds. There’s a community builder box if you don’t have any Mac hardware available, but I understand if you don’t want to spend time trying to fix this on an OS you don’t use, too.
@vcunat I’ve targeted master on your prior suggestion, but let me know if you think this is too heavy; it would be unfortunate to have a broken Node.js for another entire staging cycle since a lot of things pull it in, but I don’t want to overload the builders. It could potentially be conditionalized further to x86_64-darwin for now as we lucked out with only nodejs_18 failing on aarch64-darwin. I’m also wondering if it might make sense to roll https://github.com/NixOS/nixpkgs/pull/325620, https://github.com/NixOS/nixpkgs/pull/325616, and https://github.com/NixOS/nixpkgs/pull/325621 into this, as they’re high‐severity (only on Windows actually) Node.js security updates that would cause the same number of builds on Darwin anyway (but it’d cause Linux rebuilds too, which this shouldn’t).
Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[x] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
24.11 Release Notes (or backporting 23.11 and 24.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

I built nodejs-slim successfully on x86_64-darwin with these changes.

I'm convinced that master is fine for this.  (for posterity)

This was recently enabled in #313982. It seems to be much too flaky on Darwin currently, especially x86; see:
* https://hydra.nixos.org/build/264860513/nixlog/8

* https://hydra.nixos.org/build/264956149/nixlog/3

* https://hydra.nixos.org/build/265094929/nixlog/3

* https://hydra.nixos.org/build/264901296/nixlog/3

looking at the logs it seems to me that after out/Release/node gets built and the tests start to run there is another clang++ process that gets run and builds out/Release/node in the middle of the tests after which some tests fail to find out/Release/node which i assume happens due to the build process unlinking it before re-creating it?
seems odd.

Wow, I didn’t pick up on that at all. That’s cursed. There are other weird flaky test failures too, although if the out/Release/node thing was mitigated it’d probably be easier to fix them whack‐a‐mole style.
Seems best to unblock Darwin builds for now and try to address this more properly during a later staging cycle?

Apparently it’s flaky on other platforms too, but going by Hydra it seems like it’s worse on macOS for whatever reason. Just wanted to scope the patch to the observed breakage (and avoid generating even more builds on master).

@vcunat @emilazy, wasn’t this already fixed in #262124? The merge into staging was really weird.
https://github.com/NixOS/nixpkgs/blob/924367a5f731db266bd39fe97fe6c0d9291dfd51/pkgs/development/web/nodejs/nodejs.nix#L149-L158

I agree that the 176a56c40f05 merge resulted into nonsensical state.

Uh, hmm, guess we need to clean that up? 20 and 22 were broken on Hydra on x86_64-darwin too, so I don’t think that the version condition seems right.

Yes, the default one certainly was breaking.

20 and 22 were broken on Hydra on x86_64-darwin too, so I don’t think that the version condition seems right.

IIRC I’ve also disabled some tests on Darwin independent of the version and added a few fixes for other failing tests. If these failures are specific to x86_64-darwin, I think it makes more sense to add a check for that instead of disabling the for all Darwin platforms.

I don’t really have confidence in running this test suite at all right now if https://github.com/NixOS/nixpkgs/pull/325844#issuecomment-2218300065 is true. I’d rather figure out what’s causing that race condition than play whack‐a‐mole with its consequences. It wasn’t a case of individual tests failing, but the tests suddenly breaking nondeterministically at random points. Unfortunately I don’t have the Node.js build system expertise to really dig in to the cause. The comments in https://github.com/NixOS/nixpkgs/pull/313982 suggest that the tests might have been causing issues on Linux, too.
If the race condition is truly x86_64-darwin‐only then I’m fine with disabling these tests only on that platform, though.

I don’t really have confidence in running this test suite at all right now if https://github.com/NixOS/nixpkgs/pull/325844#issuecomment-2218300065 is true. […] The comments in https://github.com/NixOS/nixpkgs/pull/313982 suggest that the tests might have been causing issues on Linux, too.

Hm, maybe enableParallelChecking = false could help? Looks like we run multiple test suits in parallel and for some reason one of them rebuilds node binary.
I think the underlying tools/test.py script that runs some of these tests can also be used with an external node binary (via --shell flag), so perhaps we can integration tests to passthru in a separate derivation.

A separate derivation would be nice, considering how slow the build is already. If you want to PR a less blunt fix I’m happy to review and test it, but I’m not sure I have the cycles to actively make the changes myself right now. Obviously avoiding the rebuild at all would be preferable to making the checks slower, but I couldn’t really figure out what was going on.
The 22 test suite will also separate need fixes for Python 3.12, by the way. There was a warning about calling fork in a multi‐threaded program triggering on a test helper script that didn’t seem to spawn threads at all, probably because macOS system libraries like to spawn threads in the background and 3.12 added that warning.

considering how slow the build is already

Uh, yes, that’s a bug (see #321847) 😅
With https://github.com/NixOS/nixpkgs/pull/220204#issuecomment-2229544988, it takes ~10m to build instead of >30m. I’ll open a separate PR soon that switches Node.js build to ninja based on the patch attached to the comment.

That would probably have helped my patience for running the whole build again to see how the tests are breaking last longer 🙃
Anyway, I’m sorry for stepping on your toes here; I just wanted to make sure the x86_64-darwin channel wasn’t missing a huge number of packages in the short term. I do approve of running test suites where we can, I just exceeded the time I wanted to allocate to these specific failures since they weren’t being run at all until very recently anyway. Thanks for your work on this; I’d definitely be happy to be cc’d on any improvements you make for review and testing locally.


Colors on Windows

How do you feel about using https://pypi.python.org/pypi/colorama to make the colorized handler work on Windows? It can be made into a dependency on Windows for that part of the code, or the relevant parts of the code copied over to _termcolors.py (it's BSD licensed).

I'm fine with that as long as it is portable and configurable, @vmalloc?

I'm also fine with using Colorama, but we need people to help test it on Windows - our CI doesn't do that and I myself am not using Windows...

The problem I see is that ColorizedStderrHandler claims to use sys.stdout even when it changes, so if we wrapped sys.stdout then the colours wouldn't work if sys.stdout changed.
We could make ColorizedStreamHandler which uses colorama to wrap self.stream after StreamHandler.__init__.
Other than that, perhaps it's easiest to add a note to the documentation that Windows need to import and initialise colorama.

@asmeurer, happy to receive and review a pullrequest on that if you wish to implement it :+1:

I can't remember what I was originally using this for, but I'm not currently using logbook (or Windows for that matter). Someone else may end up doing it, though.

I'm going to submit a pull request for this soon.


Password Resets

User should be able to reset their password by providing the email address they registered with.  An email should be sent with a link directing them to the page to reset their password.

sorry, wrong repository...


Update r5apex.dxvk-cache.md

The cache on Reddit is still being updated so I thought of having two links but Ryao keeps changing the links while the one on GitHub is static and is a direct download link, so thanks!

The cache on Reddit is still being updated so I thought of having two links but Ryao keeps changing the link while the one on GitHub is static and direct, so thanks!


fix: Close websocket connections as per spec.

Fixes FF websocket issue. @marek-mihok please verify if works for you as well.
Part of #2276

@mturoci works for me! Good job.


Have ACPI use only the first battery value

Description

Ported the solution used in the following PR: https://github.com/denysdovhan/spaceship-prompt/pull/583
Motivation and Context

Closes #124
Types of changes

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)

Screenshots (if appropriate):
How Has This Been Tested?

[ ] I have tested using MacOS
[ ] I have tested using Linux

This feature is untested as I have no computer using acpi. I would appreciate it if someone could validate this fix.
Checklist:

[x] I have checked that no other PR duplicates mine
[x] My code follows the code style of this project.
[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.
[ ] I have updated the tests accordingly.

As for testing, I'll be happy to test uhh... Tomorrow if I have free time and can remember!

Thank you @Snuggle! Hope you had some enjoyable time off. 😎🌴
I've also been taking it easy the last couple weeks.
Sounds perfect! No pressure if you don't get around to it right away. 😄

@Snuggle Just a friendly reminder that this PR needs testing if you've got some free time. 😄


number-only string interpreted as datetime in symbol layer.

Describe the bug
When a symbol layer marker uses TextOptions() to define a property based label, the label is formatted as the year in a datetime.
To Reproduce
Create a symbol layer marker. Use this textField format:
string LabelFormat = @"[
    ""format"",
    [""get"", ""Label""],
    {
        ""text-font"": [""literal"", [""StandardFont-Bold""]],
        ""font-scale"": 1.2
    }
]";

and
TextField = new ExpressionOrString(
        System.Text.Json.JsonDocument.Parse(LabelFormat)
),

Any label with a whitespace-delimited section of numbers is interpreted as a DateTime. "1972" is a datetime. "Tx 1972" is a datetime, but "Tx1972" is not.
I have tried using the format [""to-string"", [""get"", ""Label""]] which didn't change behaviour.
Expected behavior
Don't format everything as a datetime.
Screenshots

Desktop (please complete the following information):

OS: Windows 10
Browser: Edge v91

Thanks for noticing that, I will try to take a look at it today

There should be a version 1.7.1-beta0001 available in a couple of minutes, would you mind trying if this solves your issue ?
All the inputs you gave me should now be displayed as a text instead of a datetime. If you want to display a datetime, you can still give a datetime format (like "2021-06-03") or a DateTime object on the properties of the feature.
Let me know if this works for you, if yes, I will publish a stable version.

Sorry to say, but I've just got home for the day and it's a long weekend here so I won't be back at work till Tuesday.
Mind if I test it then?

Sure, there's no rush! Enjoy the weekend 😊

1.7.1-beta0001 fixes the problem. Thanks very much :)

Great, thanks for the feedback! I have published a stable 1.7.1 with the fix


Error when trying to import LSGConverter

Hi,
I get the following error message when trying to convert a model with the lsg_converter package. Do you know what the issue might be? My transformers version is 4.22.2 :
Traceback (most recent call last):
  File "/home/cribin/Documents/MDS/mds-project-repo/mds-project/mds_model/lsg_converter/convert_mbart_to_lsg.py", line 1, in <module>
    from lsg_converter import LSGConverter
  File "/home/cribin/Documents/MDS/mds-project-repo/mds-project/venv/lib/python3.8/site-packages/lsg_converter/__init__.py", line 1, in <module>
    from .converter import *
  File "/home/cribin/Documents/MDS/mds-project-repo/mds-project/venv/lib/python3.8/site-packages/lsg_converter/converter.py", line 9, in <module>
    from .camembert.convert_camembert_checkpoint import *
  File "/home/cribin/Documents/MDS/mds-project-repo/mds-project/venv/lib/python3.8/site-packages/lsg_converter/camembert/convert_camembert_checkpoint.py", line 1, in <module>
    from .modeling_lsg_camembert import *
  File "/home/cribin/Documents/MDS/mds-project-repo/mds-project/venv/lib/python3.8/site-packages/lsg_converter/camembert/modeling_lsg_camembert.py", line 394, in <module>
    class LSGCamembertEmbeddings(CamembertEmbeddings):
NameError: name 'CamembertEmbeddings' is not defined

hi @RibinMTC
This is a likely an issue with the transformers version. CamemBERT was fully inherited from RoBERTa in the past, they made the change in 4.23.0.
Can you try with a newer transformers version?
I will check the issue and change the required version.

Thanks, upgrading to version 4.23.0 fixed the problem.
Best,
Ribin

Just for reference if anybody end up here like me, the last versions that worked for me for camembert was
lsg-converter==0.1.8 transformers==4.35.2 (I didn't search too much though)
After that I got the name 'AlbertEmbeddings' is not defined error


refactor: Replace Status with BTStatus

Replaced Status with BTStatus. This was done by search and replace and needs to be tested!

Blackboard to BTBlackboard

No, since this can be used with FSM too, so maybe BehaviourBlackboard

Lol I though BT stands for Behavior Toolkit haha maybe we should think about our own prefix for all classes to avoid collusions like Bt ?

GDScript needs namespaces...

I think just Behaviour should do.

Yeah it's fine.

I really want to keep things like FiniteStateMachine without any additional Pre or suffixes.

 I'm just concerned if use would want to use other addon with conflicting name (it's generic name it's high chance for it). GDScript needs namespaces for addons lol xD

Needs testing, as I fixed this in codespaces.

I've checked the code and looks good! At least what it's worth, my atention span today is of a golden retriever xD
Will take this PR on test ride today night :)

Ok tested it above bug is the only one I found.
After that one fix I think it's fine to merge. :)

Ok tested it and above bug is the only one I found.
After that one fix I think it's fine to merge. :)

If something else is broken pls open another issue. Cant test it right now as I am working in codespaces!


reference/security-model is out of date

http://docs.projectcalico.org/v2.0/reference/security-model is out of date, doesn't discuss Policies.
Tags should be marked as deprecated.

Removed


OSX Yosemite 200 node cluster throws paramiko.rsakey.RSAKey object ERROR

I have been facing the same issue reported here at https://github.com/nchammas/flintrock/issues/78 when I attempt to launch a 200 node spot instance cluster
I followed http://blog.mact.me/2014/10/22/yosemite-upgrade-changes-open-file-limit to increase my file descriptor limit. This removed the occasional "Too many open files" error. However, the RSAKey object error still persists.
('<IP_ADDRESS>', <paramiko.rsakey.RSAKey object at 0x142d488d0>, <paramiko.rsakey.RSAKey object at 0x142d29e80>)

I have an Ubuntu VM that does not run into this issue and it is able to create a 200 node cluster without a problem.

Thanks for the report. Quick questions:

Are you running off of Flintrock master?
Does this happen consistently for you with your setup (OS X, 200 nodes, spot slaves)?
Do you hit this same issue if you launch a smaller cluster?

As you saw, I wasn't able to get to the bottom of the issue reported in #78, so any information you can provide here that will narrow down what the issue may be caused by will be valuable.

I was on master until the release of 0.2.0, now I am running flintrock from the pip install for 0.2.0. I have seen this issue for both the master (before 0.2.0) and for 0.2.0
In OSX I either see
('<IP_ADDRESS>', <paramiko.rsakey.RSAKey object at 0x142d488d0>, <paramiko.rsakey.RSAKey object at 0x142d29e80>)

or
Error: Failed to install Spark.

I do not hit this same issue when I launch a smaller cluster (The only smaller cluster I have launched at this point is with --num-slaves 5)

OK, I am able to reproduce the error with installing Spark when I spin up a cluster with 200 slaves. For the record, could you update your comment with full stack traces or a little more context?
For example, I get:
Error: Failed to install Spark.
[Errno 24] Too many open files: '.../flintrock/flintrock/scripts/install-spark.sh'

I don't see this when I spin up clusters with 50 or even 100 slaves, so it's clearly a resource usage issue. Enabling ResourceWarning confirms this.
This is going to take some time to dig into. I probably need to do a better job of reusing files and closing handles so that Flintrock doesn't hit these limits when we launch really large clusters.
cc @engrean - You may be interested in following this issue.

If you get a higher value for the soft limit on Linux, that may explain why you don't see this issue on there.

For example, these are the results I get for how many open file descriptors a process can have by default:

soft limit
hard limit

OS X
256
9223372036854775807

Fedora Linux (VM)
1024
4096

Here are my results for getrlimit()
| soft limit | hard limit
--- | --- | ---
OS X Yosemite | 65536 | 65536
Ubuntu Linux (VM) | 262144 | 262144

The higher soft limit would explain why it is working on my Ubuntu VM. I changed my soft and hard limits to be 262144 on OS X Yosemite and I was able to launch a 200 node cluster.
So it would appear that 65536 as a soft limit is not sufficient to create a 200 node cluster.

I'm surprised your default soft limits are so high, and that your OS X hard limit is so low.
After seeing that my soft limit was 256, I thought 2048 or even 1024 would be plenty for a 200-node cluster since I've been launching 100-node clusters on OS X without issue at the 256 limit. :confused:
If you add this to the start of main() inside flintrock.py, does it let you launch 200-node clusters on OS X without issue?
import resource
resource.setrlimit(resource.RLIMIT_NOFILE, (262144, 262144))

Since you're changing your hard limit, you'll need to run Flintrock with sudo.

Hmm, I'll have to track down why Flintrock consumes so many file handles... This smells wrong, though I'm glad we have a workaround for this issue.

@dhulse - I've been working on a version of Flintrock that uses a different SSH library and concurrency model. Some basic testing shows that it uses fewer file handles (which actually includes sockets used for SSH connections) during launches.
I'm curious if this version lets you launch a 200-node cluster with your original limits. If you're interested in giving it a shot, you can install it with this:
pip install git+https://github.com/nchammas/flintrock@asyncssh

You'll need Python 3.5+ for this. This may become part of Flintrock in 0.3, depending on whether it helps solves problems like this one, so I'm interested in seeing whether it works for you.

I ran that pip install you sent and I attempted to launch a 200 node cluster with two different file limit settings. For the first attempt, I used a file limit setting by following this link http://blog.mact.me/2014/10/22/yosemite-upgrade-changes-open-file-limit. For the second attempt, I used the OS X Yosemite default file limit settings.
Here is the version of flintrock I used
flintrock --version
flintrock, version 0.3.0.dev0

Attempt 1
| soft limit | hard limit
--- | --- | ---
OS X Yosemite | 65536 | 65536
Using my custom file limit settings, I was able to launch a 200 node cluster successfully.
Attempt 2
| soft limit | hard limit
--- | --- | ---
OS X Yosemite | 256 |<PHONE_NUMBER>854775807
Using the default OS X Yosemite file limit settings, I ran into an error immediately after being granted with all the instances. Here is the output:
Requesting 201 spot instances at a max price of $0.2...
0 of 201 instances granted. Waiting...
0 of 201 instances granted. Waiting...
0 of 201 instances granted. Waiting...
0 of 201 instances granted. Waiting...
0 of 201 instances granted. Waiting...
0 of 201 instances granted. Waiting...
63 of 201 instances granted. Waiting...
200 of 201 instances granted. Waiting...
200 of 201 instances granted. Waiting...
200 of 201 instances granted. Waiting...
200 of 201 instances granted. Waiting...
200 of 201 instances granted. Waiting...
200 of 201 instances granted. Waiting...
All 201 instances granted.
[Errno 24] Too many open files
Do you want to terminate the 201 instances created by this operation? [Y/n]:

I hope this is helpful!

Great! Your results from Attempt 1 are promising, since they suggest that the AsyncSSH branch uses fewer file handles than the current master branch does during cluster launches. I wonder if things would still work fine with a limit of 2048 or even 1024.
Anyway, I'll put together some tracking code on my side to understand exactly the maximum number of file handles that Flintrock has open simultaneously over the course of a launch.
Once I have some precise measurements for that maximum, I'll pick a value for RLIMIT_NOFILE that should be higher than that for most users launching even obscenely large clusters (maybe up to 1000 nodes?), and have Flintrock set that limit directly so users don't have to do it themselves.
I'll still make an effort to find and fix leaks of open file handles, but my preliminary research suggests that the high allocation of file handles is actually caused by open sockets for SSH connections. Open sockets in Unix are also open files, so I suspect for the most part the high allocation of file handles by Flintrock is reasonable.

OK, I pushed a few commits to master which fix both issues captured here:

eca59fc0052874d9aa48b7d4d7d79192b5e609d1: Flintrock will automatically retry downloading Spark if that fails; this sometimes happens when we launch really large clusters, perhaps due to some kind of S3 rate-limiting.
3cf6ee64162ceaac6429d79c3bc6ef25988eaa8e, 7e1091473fb60f861108a87ec7874bb71f8542f4: This raises the open file limit for Flintrock to 4096 if the OS default soft limit is lower than that.

For good measure, I put together a series of tests using code adapted from here and then later using psutil to track the maximum number of file handles Flintrock has open simultaneously during a launch.
import pprint
import psutil
import time
from datetime import datetime

cmdline = []

while True:
    for ps in psutil.process_iter():
        try:
            if ps.name() == 'Python' and any(['flintrock' in part for part in ps.cmdline()]):
                if ps.cmdline() != cmdline:
                    print(ps.cmdline()[2:])
                    cmdline = ps.cmdline()
                print(
                    datetime.now(),
                    ps.num_fds())
                break
        except psutil.NoSuchProcess:
            pass
    time.sleep(0.5)

Here are the results.
Maximum number of simultaneously open file descriptors

Flintrock launch
Threads
AsyncSSH

1 slave
16
15

20 slaves
36
25

200 slaves
331
414

Running these tests was really expensive (:money_with_wings: :sob:) so I didn't do any repeated runs.
I suspect the numbers are heavily dependent on how quickly SSH becomes available on launched instances (e.g. if everything comes up at once, then more file descriptors will be open simultaneously), but I think they're good enough to demonstrate that a limit of 4096 file handles should be enough for anybody launching even 1000-node clusters. We can easily raise the limit later if we need to.
@dhulse @engrean - If you want, you can test out the latest code on master by resetting your OS limits to their defaults and launching 200+ node clusters with Flintrock. It should work out of the box now on OS X. :v:


[Build] Install Fails when node_modules found in parent of path

Typing 'gulp build' can't build semantic and throws an error saying "Cannot find semantic.json. Run "gulp installation" to set-up Semantic though I already installed gulp

How did you get semantic ui? Did you run the interactive installer?

I just followed it here.
http://semantic-ui.com/introduction/getting-started.html
I read some solution though. It says I need to copy the 'node_modules' inside my project folder and it turns out it works but is there any possible solution for this?

That's really weird. Did you wait for peer dependencies to install? What version of npm are you using?

Npm version: 2.5.1
Yeah kinda weird. Based here, the only solution I can find is copying the node_modules folder to the semantic project but it has tons of files. Would be great if have different solution to this case.

I've the same problem. After copying npm_modules following solution - http://semantic-ui.com/introduction/getting-started.html work fine. But it's not convenient solution.
My npm version is 2.5.1 and node 0.12.7

Is there a solution for this?

It worked for me when I created an empty node_modules folder in the project folder before running npm install semantic-ui --save

It also worked to create an empty node_modules folder in the /semantic folder after having installed semantic (to avoid copying the parent node_modules folder).

Unfortunately, creating empty node_modules directory doesn't work for me.
Why can't I somehow specify the exact location of the semantic.json config file? I'd like to separate my source files from the gulp etc. files (i.e. modules shouldn't be in my project directory at all).

Possible duplicate of #2056


when will the new update for kotlin code will be live

@wlanjie i want to know when the new update will be available

using implementation 'com.github.wlanjie:trinity:0.3.0' video editor call prepare before playing


Importer refactor

What this PR does:

Refactors tariff_importer.rb and add more tests
Remove deprecated methods.
Configure use_transactional_fixtures value to false, since we are using DatabaseCleaner.
Creates a LoggerHelper module with helper methods for LogSubscriber testing.
Add more tests.

Notes
I've noticed that we are not testing the logging calls in the unit test, for example in the chief_importer_spec.rb file we don't check for the import method the possible logger calls..  but  we are testing here things like the initialization process that should be tested in the tariff_importer test.
The unit/tariff_importer/logger_spec.rb is the file that holds the testing of the import method for the ChiefImporter class which is weird since this is an unit test, it should test only the expected result.
So I've decided to add the missing tests to the chief_importer_spec.rb, move one test from  unit/tariff_importer/logger_spec.rb and create a new one checking the logging message in case of failure, and in the unit/tariff_importer/logger_spec.rb I changed this from being an integration test, to only check the expected message in isolation.
What do you think about this change @matthewford ?  Having the logging checks in another file leads to issues like, for example the one we had about not testing the log message in case of a failure and of course we split the unit tests in different files with different responsibilities.
Updates
After the feedback that we don't want to have multiple log files for each process, I've removed this config, so Rails will send this logs to each enviroment file. In production since we are using the rails_stdout_logging gem this logs will be send to the STDOUT by default.
In development we want to show this logs in the STDOUT too but this will produce an empty development.log and we might want to persist these logs (?) .. so, in the development.rb environment file, we set a custom logger to the development.log file and we broadcast to another logger (STDOUT).
As a note, I found that is no longer possible to extend the logger, from this file, so you have to create a new one a set it to the config.logger. Another option could be, created an initializer and extend the Rails.logger that is no longer empty to the new desired one, but I didn't want to add conditionals in a initializer file.

One thing springs to mind, in the new CF env we should be logging to STDOUT not a separate file.

Update added to the description :point_up:


Added IntMap and patched src/Subhask/TemplateHaskell/Monad.hs

Please compare src/SubHask/Compatibility/Containers.hs lines 233 to 237 vs 523 to 527

Thanks!  Commit a780405 looks great!
I'm not sure what 4c8f88c is doing though.  I think it might be a mistake?  If you remove that commit I'll merge.

4c8f88c is just and update from you I did because my fork was way behind.

Okay.  I'll try to merge this later today.  I have some changes locally that I'll have to update first.

Thanks!

I had changed the container class hierarchy a bit, so I updated the IntMap instances to reflect this.  I also added test cases.


Judy for linux and mac

First of all, I would like to thank you for your work.
Any progress with judy working on linux and Mac OS?

Sorry, currently we have no plan for continuing this project.

currently we have no plan for continuing this project.

Please state so in the README.md. Thanks.


Custom options not appearing for exception log lines

I believe that this is not a lograge issue but I'm not certain so I thought I'd raise it.
When an exception occurs, and a 500 is logged, custom options are missing from the log line.
For example:
If I have the following in /config/environments/production.rb
config.lograge.custom_options = lambda do |event|
  {
    remote_ip: event.payload[:remote_ip],
    request_id: event.payload[:request_id]
  }
end

I'm then appending to the payload in my application_controller.rb
def append_info_to_payload(payload)
  super
  payload[:remote_ip] = request.remote_ip
  payload[:request_id] = request.env['HTTP_HEROKU_REQUEST_ID']
end

I get the following for an exception log line.
method=POST path=/users.json format=json controller=users action=create status=500 error='NoMethodError:undefined method `id' for nil:NilClass' duration=447.09 remote_ip= request_id=

Both remote_ip and request_id  are blank.
Log lines for successful transactions are receiving the remote_ip and request_id correctly so I suspect the issue is that Rails is not passing the additional payload items when there is an exception.
Any ideas on how this info could be made to flow through?

FYI, this is now fixed in rails. https://github.com/rails/rails/pull/17978

:heart:

Awesome.


Design Layout

This layout is dependent on some tweaks to the HTML inside movie-item(s), please review carefully.
We can use this for reference purposes while restyling what has been engineered on the back-end, hopefully it's already similar.

There is a new span in movie-details for personal-details which holds our user's adjustable information

This includes a watched status checkbox, movie-score and notes. See the reference images below for more information.

Fonts updated, went with Google Fonts' Urbanist, as it works well for both titles and body text. Also one font saves bandwidth.
Media Queries for major page-sizes.
tooltips for the Modal window
Header, Search Bar and Filters styled together
Styled around the standard items for checkbox and textarea.
Sticky footer for the Add Movie button
Filter tags renamed for now, just to help my brain remember they're not functional yet. Easy change to toss.

Image Reference:
Wide Layout

Medium Layout

Thin Layout

This looks fabulous! Approving it now so we can see this right away :D


OSD-16660 - Add error handling and unit test for empty list of scripts

What type of PR is this?
Bug
What this PR does / Why we need it?
When a user does not have any script listed for them, Backplane CLI throws a vague error which is bad user experience. This PR fixes the issue.
Which Jira/Github issue(s) does this PR fix?
OSD-15550
Pre-checks (if applicable)

[x] Ran unit tests locally
[x] Validated the changes in a cluster
[x] Included documentation changes with PR

Codecov Report

Merging #47 (6045726) into main (e889cf8) will increase coverage by 0.08%.
The diff coverage is 100.00%.

Additional details and impacted files

@@            Coverage Diff             @@
##             main      #47      +/-   ##
==========================================
+ Coverage   42.82%   42.91%   +0.08%
==========================================
  Files          35       35
  Lines        2071     2074       +3
==========================================
+ Hits          887      890       +3
  Misses       1050     1050
  Partials      134      134

Impacted Files
Coverage Δ

cmd/ocm-backplane/script/listScripts.go
72.09% <100.00%> (+2.09%)
:arrow_up:

/lgtm


use Abort instead of Admitted, when we can, so we dont start building on top of too many unproven things

In future I think we should use Abort where we can with some discretion for the author. Maybe worth adding to contributing guidelines?

Agreed. Updated the Contributing Guidelines.


Per-organization widgets

Is this a special case of the all builds widget?

Putting this into future for the time being; it doesn't really feel like a must-have for a first ship.


OrientDB 2.2.0 ETL

Expected behavior and actual behavior
ETL with dbUser/dbPassword  returned:
"ERROR please provide server administrator credentials",
oetl.sh ended after listing several java errors.
added serverUser/Password (keeping dbUser/Pwd) to json file - then OK
Steps to reproduce the problem
run oetl.sh w/someconfig.json
Important Questions
Has this changed from 2.1.17?
Runninng Mode

[ ] Embedded, using PLOCAL access mode
[ ] Embedded, using MEMORY access mode
[ *] Remote

Misc

[ ] I have a distributed setup with multiple servers. How many?
[ ] I'm using the Enterprise Edition

OrientDB Version

[ ] v2.0.x - Please specify last number:
[ ] v2.1.x - Please specify last number:
[ *] v2.2.x - Please specify last number: 0

Operating System

[ *] Linux
[ ] MacOSX
[ ] Windows
[ ] Other Unix
[ ] Other, name?

Java Version

[ ] 6
[ ] 7
[ *] 8

As stated in the documentation (http://orientdb.com/docs/last/Loader.html#orientdb-loader) if you want ETL to create a db on a remote server you must provide server admin credential AND database credentials. If the db was created (by studio or console) before, you need to provide only db credential.
The ability to create a database on remote db is present only from 2.2.0.

I added serverUser and serverPassword and it worked. I have placed posts.csv file in the \bin directory where oetl.bat exists.
The content of the posts.csv is below
id,title
10,NoSQL movement
20,New OrientDB
And my JSON file content is.
{
"source": { "file": { "path": "posts.csv" } },
"extractor": { "csv": {"separator": ",", "nullValue": "NULL"} },
"transformers": [
{ "vertex": { "class": "Post" } }
],
"loader": {
"orientdb": {
"dbURL": "remote:localhost/soft",
"serverUser": "root",
"serverPassword": "DBROOTPASSWORD",
"dbUser": "admin",
"dbPassword": "admin",
"dbType": "graph",
"classes": [
{"name": "Post", "extends": "V"},
{"name": "Comment", "extends": "V"},
{"name": "HasComments", "extends": "E"}
], "indexes": [
{"class":"Post", "fields":["id:integer"], "type":"UNIQUE" }
]
}
}
}


[Event Grid] Update package description for older package to point to the new one

Update the package description for the Microsoft.Azure.EventGrid to point to the new Azure.Messaging.EventGrid
Use https://github.com/Azure/azure-sdk-for-net/pull/20402 as a reference where we did the same for Service Bus

cc @lmazuel


Minor fix to Russian translation

Changed the string to use localized event name

Thanks @iamkuoz, your changes will make it into the next release. (Along with Razor's Arcana Assets)


Incompatible python dependencies

There are a set of incompatible python dependencies with installing fawkes with pip:

ERROR: fawkes 0.3.2 has requirement numpy==1.16.4, but you'll have numpy 1.16.5 which is incompatible.
ERROR: scipy 1.6.0 has requirement numpy>=1.16.5, but you'll have numpy 1.16.4 which is incompatible.

The workaround is to pin scipy to version 1.5.4. Might want to make this explicit in your requirements.txt.

Thanks for bringing this up. The numpy requirement is not very crucial. I will fix it


Added HTML Media Message Type

Handy for rendering things such as equations/LaTeX easily. Made for use within GotIt!. Sample HTML media type added to sample project.

This looks pretty sweet for HTML rendering. Is it performant? What do you think @jessesquires. Maybe get the merge conflict fixed and it could be added @Stunner?

@dmyers Done.

:+1: Sweet. What do you think @jessesquires?

I did some testing on this and it works really well. Is there a way to style the fonts by chance @Stunner?

@dmyers Didn't get the chance to implement that, was going to take more time than we had allocated for that sprint. I wouldn't mind revisiting it but am unsure when I'll be free to dedicate time to it (pretty swamped these days). Would greatly appreciate any assistance.

:+1: Sweet. What do you think @jessesquires? I'm not exactly sure on that myself @Stunner, I'll try to play around with it some more though.

Hello everyone!
I'm sorry to inform the community that I'm officially deprecating this project. 😢 Please read my blog post for details:
http://www.jessesquires.com/blog/officially-deprecating-jsqmessagesviewcontroller/
Thus, I'm closing all issues and pull requests and making the necessary updates to formally deprecate the library. I'm sorry if this is unexpected or disappointing. Please know that this was an extremely difficult decision to make. I'd like to thank everyone here for contributing and making this project so great. It was a fun 4 years. 😊
Thanks for understanding,
— jsq


Type narrowing fails when in unreachable code due to early return

TypeScript Version:  3.6.3 (also tested on nightly on playground)

Search Terms: unreachable code narrowing early return
Playground Link: Playground demonstration
Expected behavior:
If you uncomment the early return in the doAThing function (common temp change to disable some stuff for debugging), nothing should happen (allowUnreachableCode is enabled in playground options)
Actual behavior:
TypeScript now fails to perform the type-narrow from the if statement, causing a type error on the assignment line within it. An early return should of course produce an unreachable code error, as it would if the option to allow it wasn't turned on, but I'd expect this to otherwise be side-effect free, TypeScript doesn't seem to stop any other type checks just because the code is unreachable.
Related Issues:
There's a lot of narrowing-related issues so apologies if I happened to miss one, but I couldn't find anything quite related to this, as opposed to other types of narrowing issues.

Duplicate of https://github.com/microsoft/TypeScript/issues/26914

Ah, there we go, one I didn't manage to spot. I'll close this in favour of that then, thanks for finding it.


Allow a mix of Zenodo sandbox & production DOIs

PR Overview
Okay I did this off the clock since it has been driving me a little bit nuts and I wanted to do something technical that felt easy and satisfying as a break from the never-ending saga of #2016.
Historically we've required that all Zenodo DOIs in the datastore come either from the Sandbox or the Production server, which makes testing a single new archive on its own a hassle, and adds complexity across the whole application with switches for sandbox vs. not-sandbox data sources.
This commit removes this requirement, and allows a mix of sandbox and production DOIs to be used in development.
I also removed some very sparse documentation about how to create an archive in the Datastore by hand, which I think was very old and probably no longer supported and certainly not being tested, since it seemed likely to confuse and frustrate anyone who actually tried to do it.
There's a unit test which checks that all DOIs are production, rather than sandbox to make it difficult to accidentally check in code that refers to unofficial input data.
PR Checklist

[x] Merge the most recent version of the branch you are merging into (probably dev).
[ ] All CI checks are passing. Run tests locally to debug failures
[ ] Make sure you've included good docstrings.
[ ] For major data coverage & analysis changes, run data validation tests
[ ] Include unit tests for new functions and classes.
[ ] Defensive data quality/sanity checks in analyses & data processing functions.
[ ] Update the release notes and reference reference the PR and related issues.
[ ] Do your own explanatory review of the PR to help the reviewer understand what's going on and identify issues preemptively.

Not sure what's going on with the unit test failure here, it works fine for me locally...

@rousik I am stumped why the datastore unit tests are failing in CI but working fine locally. Is there anything that looks obviously fishy to you in the test? Does it work locally for you? The huge diff that it's reporting between the mocked and expected datapackage descriptor makes me wonder if it's getting the real datapackage descriptor rather than the mocked one somehow. But I don't know why that would happen in CI but not locally.
pytest test/unit/workspace/datastore_test.py


Favicon.ico

Did a favicon ever exist for this theme? The head.html tries to load one from assets/img/ but there is currently any such file in the img folder. I was wondering if this had been accidentally removed at some point, or if it never existed?

It's up to the user to add a favicon. It never existed in the theme itself.


Need ability to disable in development

I don't see a config to disable this module in development. Current workaround is to set the env var as UA-000000-1, but this is not ideal.
With missing GA code, the following error returns in development:
client.js:533 [nuxt] Error while initializing app Error: [vue-analytics] Please enter a Google Analytics tracking ID
    at A (http://localhost:3000/_nuxt/vendor.js:19078:4201)
    at I (http://localhost:3000/_nuxt/vendor.js:19078:5605)
    at Function.Vue.use (http://localhost:3000/_nuxt/vendor.js:28179:14)
    at _callee$ (http://localhost:3000/_nuxt/app.js:1270:58)
    at tryCatch (http://localhost:3000/_nuxt/vendor.js:2017:40)
    at Generator.invoke [as _invoke] (http://localhost:3000/_nuxt/vendor.js:2251:22)
    at Generator.prototype.(anonymous function) [as next] (http://localhost:3000/_nuxt/vendor.js:2069:21)
    at step (http://localhost:3000/_nuxt/vendor.js:1832:30)
    at http://localhost:3000/_nuxt/vendor.js:1850:14
    at new Promise (<anonymous>)

You can set debug.sendHitTask to false and it will not send anything to your domain
https://github.com/MatteoGabriele/vue-analytics/blob/master/docs/debug.md

I couldn't get this to work. I was hoping I didn't have to pass a valid tracking code on development. This is my config;
['@nuxtjs/google-analytics', {
            id: process.env.NODE_ENV === 'production' ? process.env.GOOGLE_ANALYTICS : false,
            debug: {
                sendHitTask: process.env.NODE_ENV === 'production',
            }
        }]

What error is it giving you? It wants a code.
I set an env UA-000000-1 for dev.

Thanks for SUPER fast reply @robyedlin.
This is the error I was getting;

That is a sweet solution! Solved my error. Thanks for your help!

👍 You can also use @MatteoGabriele 's suggestion: https://github.com/nuxt-community/analytics-module/issues/10#issuecomment-370054625, but I prefer not to fiddle with the config in this case.


[Service Bus] Remove atomManagementApi references in 1.x

Issue - #7938
Changes in the PR

[x] Delete atomManagementApi samples
[x] Cherry-pick 12b4ff0fb97810e14217cf17c48a8f789f522c35
[x] Update API report
[x] Update the package.json version, changelog, and the constants.ts file

Live tests
https://dev.azure.com/azure-sdk/internal/_build/results?buildId=329627&view=results


Implement Nginx Ingress features based on Gateway API

Why do you need it?
Nginx Ingress provides a lot of routing features via annotations. We need to migrate them to the new configuration model of Gateway API.
How could it be?

[ ] Summarize all the routing features provided via annotations. Find out which are already supported by Gateway API, and which are not.
[ ] Submit proposals for the latter ones.
[ ] Implement these features with Gateway API

我申请参与下这个任务～

We can achieve this by contributing to the ingress2gateway community and integrating it

If you are interested in contributing to this task, you can also claim this issue: https://github.com/kubernetes-sigs/ingress2gateway/issues/64

我可以尝试一下

https://docs.google.com/document/d/1rVmn_SOKZ8XbAZwVIORdaA-IghnivTnbculjZ_0_8NQ/edit

我最近调研了higress实现的nginx注解功能在gateway api中的支持情况，详见https://docs.google.com/document/d/1rVmn_SOKZ8XbAZwVIORdaA-IghnivTnbculjZ_0_8NQ/edit#heading=h.dzoqm1w6kagf

我最近调研了higress注解功能在gateway api中的支持情况，详见https://docs.google.com/document/d/1rVmn_SOKZ8XbAZwVIORdaA-IghnivTnbculjZ_0_8NQ/edit#heading=h.dzoqm1w6kagf


notify: 0.0.2 -> 1.0.0

Motivation for this change
Update to latest upstream release 1.0.0
Change log: https://github.com/projectdiscovery/notify/releases/tag/v1.0.0
Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
21.11 Release Notes (or backporting 21.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 135456 run on x86_64-linux 1

1 package built:

notify


no visual indication of mypy pretty linting errors on path names of >80 chars

Environment data

VS Code version: 1.58.2
Extension version (available under the Extensions sidebar): v2021.7.1060902895 (Python)
OS and version: macOS Mojave - 10.14.6
Python version (& distribution if applicable, e.g. Anaconda): 3.6.12, 3.7.9
Type of virtual environment used (N/A | venv | virtualenv | conda | ...): N/A
Relevant/affected Python packages and their versions: mypy==0.812
Relevant/affected Python-related VS Code extensions and their versions: v2021.7.1060902895
Value of the python.languageServer setting: Pylance

Expected behaviour
I expect squiggly lines under characters where mypy error occurs.
Actual behaviour
Output logs indicate error but there is no visual indication of a simple mypy error.
Steps to reproduce:

Create file in folder or with name such that the path length is greater than >80 char long.
Ensure --pretty is an argument to mypy and linting for mypy is enabled.
Add following code:

x: int = 's'

Note the lack of visual indication of error from mypy.

Script to reproduce:
mkdir test
cd test
echo "x: int = 's'" >> no_visual_error_xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx.py
echo "x: int = 's'" >> visual_error.py
echo '{
	"folders": [
		{
			"path": "."
		}
	],
	"settings": {
		"python.linting.mypyArgs": [
			"--pretty"
		],
		"python.linting.mypyEnabled": true
	}
}' >> test.code-workspace
code test.code-workspace

Logs

Output for Python in the Output panel (View→Output, change the drop-down the upper-right of the Output panel to Python)

> ~/.pyenv/shims/python -m mypy --pretty ~/test/visual_error.py
cwd: ~/test
> ~/.pyenv/shims/python -m mypy --pretty ~/test/visual_error.py
cwd: ~/test
##########Linting Output - mypy##########
visual_error.py:1: error: Incompatible types in assignment (expression has type
"str", variable has type "int")
    x: int = 's'
             ^
Found 1 error in 1 file (checked 1 source file)
> ~/.pyenv/shims/python -m mypy --pretty ~/test/no_visual_error_xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx.py
cwd: ~/test
> ~/.pyenv/shims/python -m mypy --pretty ~/test/no_visual_error_xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx.py
cwd: ~/test
##########Linting Output - mypy##########
no_visual_error_xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx.py:1: error:
Incompatible types in assignment (expression has type "str", variable has type
"int")
    x: int = 's'
             ^
Found 1 error in 1 file (checked 1 source file)

@timforby Can you run this mypy --pretty . from command line and share the output? I am not able to get errors or warning from mypy from the command line.

@karthiknadig Here you go:
$ mypy --pretty .
visual_error.py:1: error: Incompatible types in assignment (expression has type "str",
variable has type "int")
    x: int = 's'
             ^
no_visual_error_xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx.py:1: error:
Incompatible types in assignment (expression has type "str", variable has type "int")
    x: int = 's'
             ^
Found 2 errors in 2 files (checked 2 source files)

Looks like with --pretty the error printed out gets split into two lines. The regex we have for mypy output parsing does not handle this scenario.
https://github.com/microsoft/vscode-python/blob/f3ea0ecfe13e7f668cd670199397f381ffd4e571/src/client/linters/mypy.ts#L10


provisioner execs a new shell repeatedly without virtualenv

Provisioner is erroring with an unknown parameter. botocore version I am running is 1.10.
(mypips) [medberry@thestrel provisioner]$ python
Python 2.7.14 (default, Mar 14 2018, 13:36:31)
[GCC 7.3.1 20180303 (Red Hat 7.3.1-5)] on linux2
Type "help", "copyright", "credits" or "license" for more information.

import botocore
print botocore.version
1.10.42

ah, but it looks like the provisioner is NOT always running inside of my virtualenv and is dropping down to the shell (which only has 1.6.0 not 1.10.42). Sheesh, why is it calling straight to the shell?
The full traceback is:
Traceback (most recent call last):
File "/tmp/ansible_fbiOxX/ansible_module_ec2_vpc_subnet.py", line 266, in handle_waiter
**waiter_params(module, params, start_time)
File "/usr/lib/python2.7/site-packages/botocore/waiter.py", line 295, in wait
response = self._operation_method(**kwargs)
File "/usr/lib/python2.7/site-packages/botocore/waiter.py", line 84, in call
return self._client_method(**kwargs)
File "/usr/lib/python2.7/site-packages/botocore/client.py", line 312, in _api_call
return self._make_api_call(operation_name, kwargs)
File "/usr/lib/python2.7/site-packages/botocore/client.py", line 575, in _make_api_call
api_params, operation_model, context=request_context)
File "/usr/lib/python2.7/site-packages/botocore/client.py", line 630, in _convert_to_request_dict
api_params, operation_model)
File "/usr/lib/python2.7/site-packages/botocore/validate.py", line 291, in serialize_to_request
raise ParamValidationError(report=report.generate_report())
ParamValidationError: Parameter validation failed:
Unknown parameter in input: "WaiterConfig", must be one of: Filters, SubnetIds, DryRun

Did you set what Ansible is using?  You need to set the
ansible_python_interpreter in your ansible.cfg if you are going to be using
venv with Ansible.
On Thu, Jun 21, 2018 at 4:52 PM, David Medberry<EMAIL_ADDRESS>wrote:

Provisioner is erroring with an unknown parameter. botocore version I am
running is 1.10.
(mypips) [medberry@thestrel provisioner]$ python
Python 2.7.14 (default, Mar 14 2018, 13:36:31)
[GCC 7.3.1 20180303 (Red Hat 7.3.1-5)] on linux2
Type "help", "copyright", "credits" or "license" for more information.
import botocore
print botocore.version
1.10.42
ah, but it looks like the provisioner is NOT always running inside of my
virtualenv and is dropping down to the shell (which only has 1.6.0 not
1.10.42). Sheesh, why is it calling straight to the shell?
The full traceback is:
Traceback (most recent call last):
File "/tmp/ansible_fbiOxX/ansible_module_ec2_vpc_subnet.py", line 266, in
handle_waiter
**waiter_params(module, params, start_time)
File "/usr/lib/python2.7/site-packages/botocore/waiter.py", line 295, in
wait
response = self._operation_method(**kwargs)
File "/usr/lib/python2.7/site-packages/botocore/waiter.py", line 84, in
call
return self._client_method(**kwargs)
File "/usr/lib/python2.7/site-packages/botocore/client.py", line 312, in
_api_call
return self._make_api_call(operation_name, kwargs)
File "/usr/lib/python2.7/site-packages/botocore/client.py", line 575, in
_make_api_call
api_params, operation_model, context=request_context)
File "/usr/lib/python2.7/site-packages/botocore/client.py", line 630, in
_convert_to_request_dict
api_params, operation_model)
File "/usr/lib/python2.7/site-packages/botocore/validate.py", line 291,
in serialize_to_request
raise ParamValidationError(report=report.generate_report())
ParamValidationError: Parameter validation failed:
Unknown parameter in input: "WaiterConfig", must be one of: Filters,
SubnetIds, DryRun
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/network-automation/linklight/issues/44, or mute the
thread
https://github.com/notifications/unsubscribe-auth/AGPB0CekmsCple39Fd9ppJM809ZqHXZbks5t_Ad2gaJpZM4Uyv3-
.

I'll try that. Thanks.


FileNotFoundError on PyPy

I got this error running on pypy3.6-v7.3.0-linux64:
Error calling sys.excepthook:
Traceback (most recent call last):
  File "<builtin>/app_main.py", line 146, in display_exception
  File "/floof/pypy3.6-v7.3.0-linux64/site-packages/better_exceptions/__init__.py", line 53, in excepthook
    formatted = format_exception(exc, value, tb)
  File "/floof/pypy3.6-v7.3.0-linux64/site-packages/better_exceptions/__init__.py", line 49, in format_exception
    return formatter.format_exception(exc, value, tb)
  File "/floof/pypy3.6-v7.3.0-linux64/site-packages/better_exceptions/formatter.py", line 314, in format_exception
    return u''.join(formatted for formatted in self._format_exception(value, tb))
  File "/floof/pypy3.6-v7.3.0-linux64/site-packages/better_exceptions/formatter.py", line 314, in <genexpr>
    return u''.join(formatted for formatted in self._format_exception(value, tb))
  File "/floof/pypy3.6-v7.3.0-linux64/site-packages/better_exceptions/formatter.py", line 303, in _format_exception
    formatted, colored_source = self.format_traceback(exc_traceback)
  File "/floof/pypy3.6-v7.3.0-linux64/site-packages/better_exceptions/formatter.py", line 266, in format_traceback
    formatted, colored = self.format_traceback_frame(tb)
  File "/floof/pypy3.6-v7.3.0-linux64/site-packages/better_exceptions/formatter.py", line 226, in format_traceback_frame
    filename, lineno, function, source, color_source, relevant_values = self.get_traceback_information(tb)
  File "/floof/pypy3.6-v7.3.0-linux64/site-packages/better_exceptions/formatter.py", line 198, in get_traceback_information
    frame_info = inspect.getframeinfo(tb)
  File "/floof/pypy3.6-v7.3.0-linux64/lib-python/3/inspect.py", line 1458, in getframeinfo
    filename = getsourcefile(frame) or getfile(frame)
  File "/floof/pypy3.6-v7.3.0-linux64/lib-python/3/inspect.py", line 700, in getsourcefile
    if getattr(getmodule(object, filename), '__loader__', None) is not None:
  File "/floof/pypy3.6-v7.3.0-linux64/lib-python/3/inspect.py", line 729, in getmodule
    file = getabsfile(object, _filename)
  File "/floof/pypy3.6-v7.3.0-linux64/lib-python/3/inspect.py", line 713, in getabsfile
    return os.path.normcase(os.path.abspath(_filename))
  File "/floof/pypy3.6-v7.3.0-linux64/lib-python/3/posixpath.py", line 383, in abspath
    cwd = os.getcwd()
FileNotFoundError: [Errno 2] No such file or directory

This is frustrating because I can't know what's the directory it's not finding. Can better-exceptions deal with such problems with graceful degradation? If a certain frame has a missing task, it's better to mark it as missing than crash.

I know it looks weird but I ran into this too recently, os.getcwd() itself needs to open some file under the hood, I don't know why. Check if it works on its own?

Damn Alex, are you stalking me? ;)
This is my work account, by the way.
I confirmed os.getcwd() works on its own. It's curious that it would fail when called inside abspath. In any case I'd recommend that even if PyPy or the standard library have bugs in that code, that better-exception should degrade gracefully when they happen.

We can wrap it, though it's a matter of what to do in lieu of the existing logic if an exception is raised.

I'd show something like SOURCE UNAVAILABLE for those frames, anything besides failing.


Implement pip and junction origin loading for SourceMirror plugins

This adds support for loading SourceMirror plugins via both pip and junction plugin origins.
This tests essential mirror behavior when loading the plugins with pip or junction plugin origins,
and also tests the case where the mirror itself is used to define the mirror required to obtain itself
across a junction boundary, succeeding when the mirror is not used and asserting the failure mode
when mirroring is forced.

The project will not load properly depending on the order in which the SourceMirrors are declared in project.conf

As long as the behavior is deterministic and this results in a clear error message, I don't think we need to let that issue block this PR. It may be worth a note in the documentation. However, I agree that we likely want to eliminate this limitation at some point.


Added support for hooks in the plan

Short description:
More details:
What this PR does / why we need it:
Which issue(s) this PR fixes:
Special notes for reviewer:
Bug:

Please fix CI failed tests (use pre-commit)

/retest

/retest

You need to run pre-commit install (install it via pip if not installed already)
Then run pre-commit run --all-files (since you already pushed without the hook)
Next time you do git commit it will run automatically on the modified files.

/retest

You need to run pre-commit install (install it via pip if not installed already) Then run pre-commit run --all-files (since you already pushed without the hook) Next time you do git commit it will run automatically on the modified files.

Thank you, did as you explained. Now we will see how it will work.

/approve

/verified


Page.query_selector_all test fails intermittently

@coreyti Erik and I are unable to reproduce this today on my computer. We wondered if there was some specific constraint that we ran into on your computer that might not apply to mine, like RAM.

I retract my comment. We can reproduce this—it just happens much more rarely on my computer.

@sax Not sure if it is related to this, but I also saw intermitted / more frequent failings of the query_selector method too. Adding %{ strict: false } option seemed to help. This seems like a new issue in the last few days.

I filed this issue with Playwright, and it seems like this is a known issue unrelated to the Elixir code. We're thinking of implementing locators next, and either adding warnings to the docs or to the compiler for the element handles.

We've added almost all of the Locator implementation, which is what the official packages suggest one use instead of ElementHandle, query_selector, etc.[^1]
We've also removed, for now, async from the running of the test suite. That seems to resolve all of the flakiness pretty well (which is interesting).
[^1]: funnily enough, Locator actually depends on ElementHandle under the hood.

@coreyti Awesome!
Just a side note, I'm terrible at this too, but I think as this codebase matures, its best to make all changes (perhaps require) through a PR instead of commits on the main branch. That way it can be linked to issues like this so it is references and so that the changes can be reviewed by people like me who depend on the codebase which is quickly changing and evolving.
Anyway, awesome to see the progress and work put into this library!