rPackages.arrow: fix for current CRAN version <IP_ADDRESS>

Description of changes
Current {arrow} on CRAN is now at <IP_ADDRESS>: https://cran.r-project.org/web/packages/arrow/index.html . arrow-cpp (libarrow) in Nixpkgs master is currently at 15.0.0, which means that the versions are not compatible when compiling rPackages.arrow. arrow-cpp is a compile- and run-time dependency of rPackages.arrow. Currently, the release cycle is out-of-sync, more details here: https://github.com/apache/arrow/issues/39698 . On the long term, such a mismatch of library versions is likely, and also it seems more likely that the arrow-cpp is more frequently updated on Nixpkgs compared to CRAN updates/adjustments/fixes in rPackages. By going for a patch, I think its more likely to avoid unnoticed breakages in Nixpkgs arrow CRAN package (if a patch is not necessary, it would maybe be easy to disable in default.nix in r-modules. So this would have to be checked, for now manually, but there could be also additional, automated scripts for this after updates with generate-r-packages.R for CRAN.
Things done
Regenerated rPackages using generate-r-packages.R. Adjusted buildInputs and nativeBuildInputs for failing build of rPackages.arrow. I could not yet figure out how to apply the patch arrow-cpp as Input for rPackages.arrow.

Built on platform(s)

[ ] x86_64-linux
[x] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.05 Release Notes (or backporting 23.05 and 23.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

Result of nixpkgs-review pr 289274 run on aarch64-darwin 1

4 packages marked as broken and skipped:

python312Packages.nbdev
python312Packages.nbdev.dist
python312Packages.rpy2
python312Packages.rpy2.dist

13 packages built:

python311Packages.nbdev
python311Packages.nbdev.dist
python311Packages.radian
python311Packages.radian.dist
python311Packages.rchitect
python311Packages.rchitect.dist
python311Packages.rpy2
python311Packages.rpy2.dist
python312Packages.radian
python312Packages.radian.dist
python312Packages.rchitect
python312Packages.rchitect.dist
quarto

Result of nixpkgs-review pr 289274 run on aarch64-darwin 1

4 packages marked as broken and skipped:

python312Packages.nbdev
python312Packages.nbdev.dist
python312Packages.rpy2
python312Packages.rpy2.dist

15 packages built:

python311Packages.nbdev
python311Packages.nbdev.dist
python311Packages.radian
python311Packages.radian.dist
python311Packages.rchitect
python311Packages.rchitect.dist
python311Packages.rpy2
python311Packages.rpy2.dist
python312Packages.radian
python312Packages.radian.dist
python312Packages.rchitect
python312Packages.rchitect.dist
quarto
rWrapper
radianWrapper

Result of nixpkgs-review pr 289274 run on x86_64-linux 1

4 packages marked as broken and skipped:

python312Packages.nbdev
python312Packages.nbdev.dist
python312Packages.rpy2
python312Packages.rpy2.dist

1 package failed to build:

jasp-desktop

21 packages built:

cantor (libsForQt5.cantor ,plasma5Packages.cantor)
labplot
python311Packages.nbdev
python311Packages.nbdev.dist
python311Packages.radian
python311Packages.radian.dist
python311Packages.rchitect
python311Packages.rchitect.dist
python311Packages.rpy2
python311Packages.rpy2.dist
python312Packages.radian
python312Packages.radian.dist
python312Packages.rchitect
python312Packages.rchitect.dist
quarto
rstudio
rstudio-server
rstudioServerWrapper
rstudioWrapper
sage
sageWithDoc

I could not reproduce the build, it fails for me with a different error. I'm also not sure if patching is the correct way to handle this. I'd first try to override the version and hash of the pkgs.arrow without patching anything.

You can probably also put this PR back to draft stage. PR-s should contain a commit for each logical unit (in this case that's just the rPackages.arrow, so a single commit)

nix-build --pure -A rPackages.arrow

* removing '/nix/store/c6azanmwdk0mzx7xh5jsp47lv1mplsvd-r-arrow-<IP_ADDRESS>/library/arrow'
error: builder for '/nix/store/rm53v5qzndi2fspvi7i87ah540iq35m1-r-arrow-<IP_ADDRESS>.drv' failed with exit code 1;
       last 10 log lines:
       > /nix/store/k687y4hiraslz65qz8pli1wb5wmcabvn-clang-wrapper-16.0.6/bin/c++ -std=gnu++17 -I"/nix/store/1hfs8ylpsyfrrakhyvskr4dgycd0l16c-R-4.3.2/lib/R/include" -DNDEBUG -I/nix/store/a5yby7z43cngyy3m3h9hmrbswmpxqflx-arrow-cpp-14.0.0/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_SUBSTRAIT -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -I'/nix/store/icgvzqb9iimya88zh611qzbc91b6zxqk-r-cpp11-0.4.7/library/cpp11/include' -isystem /nix/store/ydfb1m5h1lcghpvs2hmv9686z008paij-libcxx-16.0.6-dev/include/c++/v1    -fPIC  -g -O2  -c symbols.cpp -o symbols.o
       > /nix/store/k687y4hiraslz65qz8pli1wb5wmcabvn-clang-wrapper-16.0.6/bin/c++ -std=gnu++17 -I"/nix/store/1hfs8ylpsyfrrakhyvskr4dgycd0l16c-R-4.3.2/lib/R/include" -DNDEBUG -I/nix/store/a5yby7z43cngyy3m3h9hmrbswmpxqflx-arrow-cpp-14.0.0/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_SUBSTRAIT -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -I'/nix/store/icgvzqb9iimya88zh611qzbc91b6zxqk-r-cpp11-0.4.7/library/cpp11/include' -isystem /nix/store/ydfb1m5h1lcghpvs2hmv9686z008paij-libcxx-16.0.6-dev/include/c++/v1    -fPIC  -g -O2  -c table.cpp -o table.o
       > /nix/store/k687y4hiraslz65qz8pli1wb5wmcabvn-clang-wrapper-16.0.6/bin/c++ -std=gnu++17 -I"/nix/store/1hfs8ylpsyfrrakhyvskr4dgycd0l16c-R-4.3.2/lib/R/include" -DNDEBUG -I/nix/store/a5yby7z43cngyy3m3h9hmrbswmpxqflx-arrow-cpp-14.0.0/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_SUBSTRAIT -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -I'/nix/store/icgvzqb9iimya88zh611qzbc91b6zxqk-r-cpp11-0.4.7/library/cpp11/include' -isystem /nix/store/ydfb1m5h1lcghpvs2hmv9686z008paij-libcxx-16.0.6-dev/include/c++/v1    -fPIC  -g -O2  -c threadpool.cpp -o threadpool.o
       > /nix/store/k687y4hiraslz65qz8pli1wb5wmcabvn-clang-wrapper-16.0.6/bin/c++ -std=gnu++17 -I"/nix/store/1hfs8ylpsyfrrakhyvskr4dgycd0l16c-R-4.3.2/lib/R/include" -DNDEBUG -I/nix/store/a5yby7z43cngyy3m3h9hmrbswmpxqflx-arrow-cpp-14.0.0/include   -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_ACERO -DARROW_R_WITH_SUBSTRAIT -DARROW_R_WITH_JSON -DARROW_R_WITH_S3 -I'/nix/store/icgvzqb9iimya88zh611qzbc91b6zxqk-r-cpp11-0.4.7/library/cpp11/include' -isystem /nix/store/ydfb1m5h1lcghpvs2hmv9686z008paij-libcxx-16.0.6-dev/include/c++/v1    -fPIC  -g -O2  -c type_infer.cpp -o type_infer.o
       > /nix/store/k687y4hiraslz65qz8pli1wb5wmcabvn-clang-wrapper-16.0.6/bin/c++ -std=gnu++17 -dynamiclib -Wl,-headerpad_max_install_names -undefined dynamic_lookup -L/nix/store/1hfs8ylpsyfrrakhyvskr4dgycd0l16c-R-4.3.2/lib/R/lib -L/nix/store/hi4fialjfb9wd2f5al4vpzlyh8dz38fz-libcxx-16.0.6/lib -o arrow.so RTasks.o altrep.o array.o array_to_vector.o arraydata.o arrowExports.o bridge.o buffer.o chunkedarray.o compression.o compute-exec.o compute.o config.o csv.o dataset.o datatype.o expression.o extension-impl.o feather.o field.o filesystem.o io.o json.o memorypool.o message.o parquet.o r_to_arrow.o recordbatch.o recordbatchreader.o recordbatchwriter.o safe-call-into-r-impl.o scalar.o schema.o symbols.o table.o threadpool.o type_infer.o -L/nix/store/a5yby7z43cngyy3m3h9hmrbswmpxqflx-arrow-cpp-14.0.0/lib -larrow_substrait -larrow_dataset -larrow_acero -lparquet -larrow -L/nix/store/1hfs8ylpsyfrrakhyvskr4dgycd0l16c-R-4.3.2/lib/R/lib -lR -lintl -Wl,-framework -Wl,CoreFoundation
       > ld: library not found for -lintl
       > clang-16: error: linker command failed with exit code 1 (use -v to see invocation)
       > make: *** [/nix/store/1hfs8ylpsyfrrakhyvskr4dgycd0l16c-R-4.3.2/lib/R/share/make/shlib.mk:10: arrow.so] Error 1
       > ERROR: compilation failed for package 'arrow'
       > * removing '/nix/store/c6azanmwdk0mzx7xh5jsp47lv1mplsvd-r-arrow-<IP_ADDRESS>/library/arrow'
       For full logs, run 'nix log /nix/store/rm53v5qzndi2fspvi7i87ah540iq35m1-r-arrow-<IP_ADDRESS>.drv'.

on x86_64-linux nix-build --pure -A rPackages.arrow compiles successfully.
** R
** inst
** byte-compile and prepare package for lazy loading
** help
*** installing help indices
** building package indices
** testing if installed package can be loaded from temporary location
** checking absolute paths in shared objects and dynamic libraries
** testing if installed package can be loaded from final location
** testing if installed package keeps a record of temporary installation path
* DONE (arrow)
installPhase completed in 2 minutes 29 seconds
Running phase: fixupPhase
shrinking RPATHs of ELF executables and libraries in /nix/store/1zs1933axj5xf3wwi60mfsv64c081ck3-r-arrow-<IP_ADDRESS>
shrinking /nix/store/1zs1933axj5xf3wwi60mfsv64c081ck3-r-arrow-<IP_ADDRESS>/library/arrow/libs/arrow.so
checking for references to /build/ in /nix/store/1zs1933axj5xf3wwi60mfsv64c081ck3-r-arrow-<IP_ADDRESS>...
patching script interpreter paths in /nix/store/1zs1933axj5xf3wwi60mfsv64c081ck3-r-arrow-<IP_ADDRESS>
/nix/store/1zs1933axj5xf3wwi60mfsv64c081ck3-r-arrow-<IP_ADDRESS>/library/arrow/build_arrow_static.sh: interpreter directive changed from "#!/usr/bin/env bash" to "/nix/store/5l50g7kzj7v0rdhshld1vx46rf2k5lf9-bash-5.2p26/bin/bash"
rewriting symlink /nix/store/1zs1933axj5xf3wwi60mfsv64c081ck3-r-arrow-<IP_ADDRESS>/nix-support/propagated-user-env-packages to be relative to /nix/store/1zs1933axj5xf3wwi60mfsv64c081ck3-r-arrow-<IP_ADDRESS>
/nix/store/1zs1933axj5xf3wwi60mfsv64c081ck3-r-arrow-<IP_ADDRESS>

Tested on linux-aarch64 (rpi5), compiles and runs:
> arrow::arrow_info()
Arrow package version: <IP_ADDRESS>

Capabilities:

acero      TRUE
dataset    TRUE
substrait  TRUE
parquet    TRUE
json       TRUE
s3         TRUE
gcs        TRUE
utf8proc   TRUE
re2        TRUE
snappy     TRUE
gzip       TRUE
brotli     TRUE
zstd       TRUE
lz4        TRUE
lz4_frame  TRUE
lzo       FALSE
bz2        TRUE
jemalloc   TRUE
mimalloc   TRUE

Memory:

Allocator jemalloc
Current    0 bytes
Max        0 bytes

Runtime:

SIMD Level          none
Detected SIMD Level none

Build:

C++ Library Version  14.0.0
C++ Compiler            GNU
C++ Compiler Version 13.2.0

I like the approach you're going for, this way, the package and the cpp lib will never desync again. I was just wondering, do we need to all these changes in the pkgs/development/r-modules/cran-packages.nix file? That's really a lot.

Tested on linux-aarch64 (rpi5), compiles and runs:
> arrow::arrow_info()
Arrow package version: <IP_ADDRESS>

Capabilities:

acero      TRUE
dataset    TRUE
substrait  TRUE
parquet    TRUE
json       TRUE
s3         TRUE
gcs        TRUE
utf8proc   TRUE
re2        TRUE
snappy     TRUE
gzip       TRUE
brotli     TRUE
zstd       TRUE
lz4        TRUE
lz4_frame  TRUE
lzo       FALSE
bz2        TRUE
jemalloc   TRUE
mimalloc   TRUE

Memory:

Allocator jemalloc
Current    0 bytes
Max        0 bytes

Runtime:

SIMD Level          none
Detected SIMD Level none

Build:

C++ Library Version  14.0.0
C++ Compiler            GNU
C++ Compiler Version 13.2.0

I like the approach you're going for, this way, the package and the cpp lib will never desync again. I was just wondering, do we need to all these changes in the pkgs/development/r-modules/cran-packages.nix file? That's really a lot.

thanks for testing. actually, valid point it's all the CRAN package updates, which is better handled by an upgrade process. However, since one does already the effort of fixing packages, wouldn't it make sense to allow for single package updates at https://github.com/NixOS/nixpkgs/blob/nixos-23.11/pkgs/development/r-modules/generate-r-packages.R as an extension? For this PR, will get back to current master list of CRAN pkgs, and only update arrow.

closing i totally messed up the rebasing.

closing i totally messed up the rebasing.

I feel you. It brings back memories of my (very recent) first rebase.


Add task locking

Since we run multiple app servers we need to ensure that cron jobs are only executed the once across the autoscaling group. To do this we can add a tasks table that allows us to create a shared lock that works across the whole group.
Depends on #508 and #510 to be merged first.

Okay, moved to a background job


Spending password issue

I never set up a spending password and I can no longer find my mnemonic for this specific wallet.  Is there a default password, assuming I never set one up, there should not a a password for spending. Without the password my bitcoin is essentially frozen without a way to transfer.  I have another wallet I can use, but I cannot transfer the bitcoin to it. Thank you.

Do you have the backup?

Unfortunately not for this wallet, otherwise I would delete and reset. My issue is not understanding why it requests a sending password when I never set one. It only makes sense that there would be no password associated at this point. Understandably,  it is my duty to have the recovery phrase, but it is not my duty to have a password that was never set. This concerns me bc I can no longer access my Bitcoin.

Have you ever left your phone unattended? Unlocked?
My son messed with my unlocked phone and managed to add a spending password to a wallet on Copay once... Almost as if he did it on purpose.
Luckily, I kept my phrase backups safe, so no harm was done.

Unfortunately without a backup there is nothing we can do.

No, never.  I am the only person with access to my device and no password was set up. If I could send to my other wallet or even sell the bitcoin I would be fine with deleting and using my other wallet that has no spending password associated. Really do not understand the password request since there was never one set.

If you really think Copay is lying to you:

Export the wallet. You will need to set a password, "a" is fine.
use sjcl to decrypt the wallet using the "a" password you just set.
If you see your phrase in there, you didn't have a password set, if you don't see it, then you have encrypted the phrase and need the password.

https://bitwiseshiftleft.github.io/sjcl/demo/
Paste the exported wallet in Ciphertext, and type "a" in the password box to see the raw wallet data.

I know the wallets I have are separate identities, but aren't they connected in some way?
And as far as my password, I am saying that I haven't set one up. I will see if that works.

Also, my wallet in question has an option to delete recovery phrase. Obviously the mnemonic phrase is still in existence. Is there any way of showing/recovering the mnemonic phrase?
I don't know how to export my wallet, as I'm not brushed up on all the tech points. I'm just a simple man with enough knowledge to know that there are doors that have been opened and not yet closed so to speak.

IMG_4120.PNG

It will not allow me to export, as it asks for spending password (which I did not set to begin with)

Ok from what I'm seeing between my two wallets is that the one with the "phantom" spending password, the password is needed to allow and access any spending as well as the mnemonic recovery phrase off of my device for that wallet. The other wallet, I have no issues with a password when transferring bitcoin and I have no issue viewing my recovery phrase. In all honesty it looks like a glitch in the system and it has cost me frozen bitcoin that I cannot access in that wallet. I did not delete my recovery phrase on either of my wallets, yet I can only access to RP on the wallet that doesn't have a spending password.
From reading several threads on this site, I'm not the only person on here with this "phantom" spending password problem. Seems there should be an easy solution to this problem.

@slinky2 to void all of this kind of scenarios, we strongly recommend on BitPay App (mandatory for Copay) write the RP down, so you can recover the access to your funds.
If the Private Key is encrypted, you will not be able to:

Spend money
Access to the RP
Access to backup flow
Export wallet

To avoid these scenarios, I have the option to have the RP stored on my phone with a suggestion to write it down. I haven't lost nor deleted my RP, and I have now a password that I did not apply to my wallet that prevents access to any option other than adding Bitcoin to my wallet. This seems odd that the app has this issue with no way to resolve. I could see that there would be an issue if I made a password or if I deleted my RP, but it's still there, locked by the phantom "spending" password. Funny that I'm not spending, yet it will not allow me to access the RP without a "spending password".
Sorry if this comes off rude or matter of fact, but this is an issue that needs to be resolved and is an error with the app, it seems. And there are many other threads that would suggest the same.

And I do appreciate all help that has been suggested.

Hello,
I am experiencing the same problem. I didn't set up a "spending password" and now the app keeps asking for it for everything, even for the back up. Nobody has access to my phone but me.
Thanks for the help.

Ok I am answering for myself for those who experience the same problem. I wrote down my secret phrase on a piece of paper as suggested during the set up of Copay. So I just deleted the wallet and created a new one with that phrase. This time, the app asked me if I wanted to set up a spending password. Don't know why it didn't ask for it the first time.

Same for me. Installed bitpay for first time on windows desktop. It asked for email, then took me to the steps up to the point where it asked to create a password.  I never had any passphrase or anything just directly to the screen to create password I skipped it as noted and as the screen says I could set this up later.
I transferred some bitcoin to bitpay and then tried to buy something and it still says setup backup and asks for password. It never EVER showed any passphrases or anything just directly to the password screens. Now I have bitcoin stuck in limbo that can't be used without spend password which was never created.

The same thing happened to me, I was never prompted to set a password and after a few weeks I went to send BTC and was asked for encrypted password. I struggled with it for hours going over many variations of the password formula I would have set if I were prompted with no luck. I luckily found the pass phrase to import the wallet once it was deleted and was asked to setup encrypted password. I am surprised I kept the pass phrase usually they get written down and lost somewhere on my desk forever.

Help....I have the same "Phantom Password" issue.  I downloaded the bitpay app and sent btc to the wallet.  I am now trying to pay an invoice and cannot because its asking for a password I never set up.  I have spent hours with numerous configurations of passwords....but I dont make these mistakes.  I know my passwords.  This is a glitch.   Did anyone solve the above guys issue?

Hello @darakaye
Thanks for reaching out to us.
Please refer to #5497
Please let us know if you have any additional questions.
Kind regards.

@slinky2
@darakaye
@rnwilson
@AgentZ86
@fademar
I can crack password for bitpay wallet spending pin if you have the text backup of your wallet.
most of the password are the result of letting the kids use the phone.
I can crack the password in 50% of the cases, if you need help send me message.
telegram username: @walletrecover


feature: Make relayers configurable from config

Overview
Configs for relayers should be configureable from the config file itself.
Proposal
Similar to exposing the scripts and genesis for chains, we can expose the config files be overwritten or even exposed via the relayer directive.
Implementation
TBD

Need to expose this: https://github.com/cosmology-tech/starship/blob/main/charts/devnet/templates/relayers/hermes/configmap.yaml
The issue here is chain and non-chain part.
Maybe we can have full config overrides available via config file. The issue is, toml config might have to be exposed as yaml config, that is then merged with the configuration of the relayers. (Note only hermes config is in TOML, all other relayers have yaml compatible configurations)
As a user, i would want to make the setup directly into the config file, relayer directive.

Only needed for hermes relayer for now, that too for non chain specific values.
Chain specific values should still be derived from chain values.


Object(...) is not a function

🐞 Bug report
I am trying to add scully to my existing Angular 7 application and got this error in console without additional message when serving.
Description
🔬 Minimal Reproduction
ng build
npm run skully
npm run scully:serve
http://localhost:1668/
💻Your Environment
Angular Version:

Angular CLI: 7.3.9
Node: 10.14.1
OS: darwin x64
Angular: 7.2.15
... animations, common, compiler, compiler-cli, core, forms
... http, language-service, platform-browser
... platform-browser-dynamic, router, service-worker

Package                           Version
-----------------------------------------------------------
@angular-devkit/architect         0.13.9
@angular-devkit/build-angular     0.13.9
@angular-devkit/build-optimizer   0.13.9
@angular-devkit/build-webpack     0.13.9
@angular-devkit/core              7.3.9
@angular-devkit/schematics        7.3.9
@angular/cdk                      7.3.6
@angular/cli                      7.3.9
@angular/flex-layout              7.0.0-beta.24
@angular/material                 7.3.6
@angular/pwa                      0.12.4
@ngtools/webpack                  7.3.9
@schematics/angular               7.3.9
@schematics/update                0.13.9
rxjs                              6.5.2
typescript                        3.2.4
webpack                           4.29.0

Scully Version:

 "@scullyio/init": "^1.0.0-beta.0"

🔥 Exception or Error

Uncaught TypeError: Object(...) is not a function
    at scullyio-ng-lib.js:607
    at<EMAIL_ADDRESS>(scullyio-ng-lib.js:609)
    at __webpack_require__ (bootstrap:78)
    at Module../src/app/app.module.ts (app.component.ts:12)
    at __webpack_require__ (bootstrap:78)
    at Module../src/main.ts (main.ts:1)
    at __webpack_require__ (bootstrap:78)
    at Object.0 (main.ts:19)
    at __webpack_require__ (bootstrap:78)
    at checkDeferredModules (bootstrap:45)
(anonymous) @ scullyio-ng-lib.js:607
<EMAIL_ADDRESS>@ scullyio-ng-lib.js:609
__webpack_require__ @ bootstrap:78
./src/app/app.module.ts @ app.component.ts:12
__webpack_require__ @ bootstrap:78
./src/main.ts @ main.ts:1
__webpack_require__ @ bootstrap:78
0 @ main.ts:19
__webpack_require__ @ bootstrap:78
checkDeferredModules @ bootstrap:45
webpackJsonpCallback @ bootstrap:32
(anonymous) @ main.js:1

As stated in the docs, Scully doesn't support Angular 7.

Thank you! I will try to upgrade. Do you have suggestion should I upgrade to 8 or 9 to better use Scully?

Also, if I have jQuery in Angular ts file or in JS library, would Scully work with that? Thank you.

I would always recommend to use latest angular version in order to be up to date with latest features (and it's always easier to update on each new version rather than having to deal with several versions updates at once).
You can use the guidelines of the official site to update your project : https://update.angular.io/#7.0:9.1
Scully parses your project to find routes then use Pupeteer to explore it : JQuery won't affect it.

Thank you so much for your inputs. Scully doc mentioned supports Angular 8 and 9, would it work with Angular 10 work as well?

@desongyu Yes, Scully works with version 10 as well.
Going to close this issue now as there is no actionable content for us. Feel free to keep discussing things here.

Sounds good. Thank you everyone's help and advice.

Another question. We are thinking of migrating from 7 to 8 to use Scully. But we use JIT compiler from angular/core to compile HTML(containing angular code) from CMS database at runtime. After running Scully, would this function still be there? Or does Scully uses the AOT. What would then happen to our use of the JIT compiler and its behavior? Thank you for your help!

@desongyu Scully does work with the JIT compiler too. It does parse the end-result, and doesn't care how yo build it.

@SanderElias  Thank you so much for that information. So if I understand correctly, the angular code in the CMS HTML would be compiled into static HTML and Javascript(AOT or JIT on running Scully). No configuration needed in Scully to know if using AOT or JIT in angular.json. With each CMS HTML change, I would just need to rebuild Scully and upload the new static HTML and Javascript for that page. Please let me know if this correct. Thank you!

@desongyu Yes, the static HTML will start your SPA like it normally does. So uploading the file for that page will work as you expect.

Thank you so much! I look forward to upgrading to 8 then use Scully. Have a great day!

BTW, this just came to me, if Scully doesn't need AOT, why doesn't it support Angular 7?

Because that would limit the version of typescript we can use. Also, we would need to manually build the library or version 7, add extra testing, and so on. We do only support the Active angular -and the previous version. So currently, we do support V9 and V10.
If you are upgrading your app, you might as well move directly to V10. If you follow the steps on the update site going from 8 to 9 to 10 is a breeze. (at least it was for me, during the 6 apps I updated in the last few weeks)

@SanderElias Thank you for your inputs. I appreciate your help!


Improve flow for new apps' chatflows

Proposal:

Scenarios to be handled for the service payments:

Wrong payment(wrong amount or wrong payment id in memo text of transaction)
Should wait on payment that it was successful
Options for handling service fees

Option 1: Need to set the fees for the use of the service which will be a one time payment when they first access. The users that payed will be kept track of on the machine (similar to trader and polls voting mechanism) and the payments for the pool deployments are done from user to explorer directly no double transfer is done.

Option 2: Fees are added to the cost of the deployment, and the tokens are transferred to the app store's wallet, and the app store deducts the fees and proceeds with the payment for the deployment (Disadvantage: not sure if multiple transactions can be done simultaneously if we have multiple deployments from different users at the same time using only 1 app store wallet)

Deployment scenarios to be handled:

when someone pays for a pool and deploys network,but by the time they create a container the resources finished and the deployment fails, then their money is lost. The failed deployments can be saved for that user where they can list them in the UI and have an option to deploy later or cancel that attempt in the first place. This will ensure the pool they paid for is not lost but doesn't guarantee that resources will free up.

I agree with Option 1

I think the first suggestion has less edge cases and less complicated

After discussing with @waleedhammam @ashraffouda ,and @rkhamis : Option 1-b will be approached.

Initially will go with letting the user make 2 payments in the flow, one for the fees to the app store's wallet and another to the explorer for the deployment itself.
A feature request has been suggested to be able to create multiple payments by scanning one bardcode through the 3bot app. Where a list of payments would be saved in the QR code instead of info for only 1 payment. This will save the hassle for the user to have to deal with 2 payments where they only scan once. Each payment will be processed separately in sequence.

WIP added fees payment scenario

in case of wrong transaction amount, it will be refunded

Part of: https://github.com/threefoldtech/home/issues/878

not relevant anymore


Clarify index order in TextureAtlas::from_grid

Objective
Docs on from_grid/from_grid_with_padding aren't clear on indexing order.
Solution
Make the docs better!

bors retry


Support ddl sync kudu

Prepare a Pull Request

Title: [BitSail] support DDL sync in KuduWriter

https://github.com/bytedance/bitsail/issues/141
Purpose
add a generic interface to support schema change
and support DDL sync in KuduWriter
Related Issues
https://github.com/bytedance/bitsail/issues/141
Documentation

Does this pull request introduce a new feature? (yes / no)
If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)
If a feature is not applicable for documentation, explain why?
If a feature is not documented yet in this PR, please create a follow-up issue for adding the documentation

@BlockLiu please help review code thx!

@beyond-up Hi guys, thanks for your contribution！
In addition, when submitting a PR next time, please use the latest PR template, which is clearer and can be automatically associated with the corresponding Issue.

@beyond-up Hi guys, thanks for your contribution！
In addition, when submitting a PR next time, please use the latest PR template, which is clearer and can be automatically associated with the corresponding Issue.

ok, I will


learning semantic role labeling

Hi,
Is there any documentation on training a semantic role labeler ?
thanks

Omid,
Sorry there is no document yet :(  I’m really pushing hard to make the next release of ClearNLP which is several months over due.  Good thing is that the semantic role labeler is the only thing that I have to add for this release so hopefully I can get it done soon.  How soon do you need this module working?
best,
Jinho
http://mathcs.emory.edu/~choi/
Assistant professor, Emory University
On Feb 12, 2015, at 4:55 PM, Omid Bakhshandeh <notifications<EMAIL_ADDRESS>wrote:
Hi,
Is there any documentation on training a semantic role labeler ?
thanks
—
Reply to this email directly or view it on GitHubhttps://github.com/clearnlp/clearnlp/issues/8.

This e-mail message (including any attachments) is for the sole use of
the intended recipient(s) and may contain confidential and privileged
information. If the reader of this message is not the intended
recipient, you are hereby notified that any dissemination, distribution
or copying of this message (including any attachments) is strictly
prohibited.
If you have received this message in error, please contact
the sender by reply e-mail message and destroy all copies of the
original message (including attachments).

Thanks for reply, I’m working on a paper for ACL and I need to train a semantic role labeler (which is not doing semantic role labeling but the task is exactly the same as semantic role labeling). So I need a SRL that is easy to train with my data and features,
Thanks,
--Omid
Sent from Windows Mail
From: ClearNLP Project
Sent: Friday, February 13, 2015 3:52 PM
To: clearnlp/clearnlp
Cc: Omid Bakhshandeh
Omid,
Sorry there is no document yet :( I’m really pushing hard to make the next release of ClearNLP which is several months over due. Good thing is that the semantic role labeler is the only thing that I have to add for this release so hopefully I can get it done soon. How soon do you need this module working?
best,
Jinho
http://mathcs.emory.edu/~choi/
Assistant professor, Emory University
On Feb 12, 2015, at 4:55 PM, Omid Bakhshandeh <notifications<EMAIL_ADDRESS>wrote:
Hi,
Is there any documentation on training a semantic role labeler ?
thanks
—
Reply to this email directly or view it on GitHubhttps://github.com/clearnlp/clearnlp/issues/8.

This e-mail message (including any attachments) is for the sole use of
the intended recipient(s) and may contain confidential and privileged
information. If the reader of this message is not the intended
recipient, you are hereby notified that any dissemination, distribution
or copying of this message (including any attachments) is strictly
prohibited.
If you have received this message in error, please contact
the sender by reply e-mail message and destroy all copies of the
original message (including attachments).
—
Reply to this email directly or view it on GitHub.

Dear Omid,
I am looking for a similar semantic role labeler which enables me to retrain it with my own data. I was wondering if you have found one? any help would be appreciated

@Masoudn I end writing the whole thing from scratch myself. Is your task SRL ?

Yes, i'm really in the need of applying a semantic role labeler on my own dataset and then retraining semantic role labeler with new data and see if there is any change in the results. Its a long time that i'm looking for it. Could you please help me? really thanks

You can use clearNLP if you don't want to write it from scratch, there are also other SRLers out there that you can try,
or if you can wait, @clearnlp will finish this part soon and you can use that.

I have been trying ClearNLP for a while but i don't know how to retrain it.
I have also tried Senna but i can't retrain it.
Could you please let me know if there is anyway that i can retrain
ClearNLP? or if there is any other Semantic role labeler that i can
retrain, could you let me know? Thanks
Kind Regards,
Masoud Narouei
<EMAIL_ADDRESS>On Tue, Mar 17, 2015 at 10:23 AM, Omid Bakhshandeh<EMAIL_ADDRESS>
wrote:

You can use clearNLP if you don't want to write it from scratch, there are
also other SRLers out there that you can try,
or if you can wait, @clearnlp https://github.com/clearnlp will finish
this part soon and you can use that.
—
Reply to this email directly or view it on GitHub
https://github.com/clearnlp/clearnlp/issues/8#issuecomment-82409786.

Masoud,
The ClearNLP version 3.0.0 is about to be released and it gives a much better way of training.  Unfortunately, the semantic role labeler will be integrated towards the end of this semester (sometime in April) if you can wait.  Please let me know if you have any question.  Thanks!
best,
Jinho
http://mathcs.emory.edu/~choi/
Assistant professor, Emory University
On Mar 17, 2015, at 11:27 AM, Masoudn <notifications<EMAIL_ADDRESS>wrote:
I have been trying ClearNLP for a while but i don't know how to retrain it.
I have also tried Senna but i can't retrain it.
Could you please let me know if there is anyway that i can retrain
ClearNLP? or if there is any other Semantic role labeler that i can
retrain, could you let me know? Thanks
Kind Regards,
Masoud Narouei
masoudnarouei<EMAIL_ADDRESS>On Tue, Mar 17, 2015 at 10:23 AM, Omid Bakhshandeh <notifications<EMAIL_ADDRESS>
wrote:

You can use clearNLP if you don't want to write it from scratch, there are
also other SRLers out there that you can try,
or if you can wait, @clearnlp https://github.com/clearnlp will finish
this part soon and you can use that.
—
Reply to this email directly or view it on GitHub
https://github.com/clearnlp/clearnlp/issues/8#issuecomment-82409786.

—
Reply to this email directly or view it on GitHubhttps://github.com/clearnlp/clearnlp/issues/8#issuecomment-82412683.

This e-mail message (including any attachments) is for the sole use of
the intended recipient(s) and may contain confidential and privileged
information. If the reader of this message is not the intended
recipient, you are hereby notified that any dissemination, distribution
or copying of this message (including any attachments) is strictly
prohibited.
If you have received this message in error, please contact
the sender by reply e-mail message and destroy all copies of the
original message (including attachments).


tls connection error and support quic

2024-09-29 05:03:07 ERROR cthulhu::net_proxy::proxy::net: Failed to establish TLS connection: received fatal alert: CertificateUnknown,URI:www.googleapis.com:443
at src\net_proxy\proxy\net.rs:271
I keep getting this error
even when the site loads, but i keep getting warnings about the certificate and need to keep clicking ok or change settings in the browser not to show a warning about an invalid certificate i think you can add a way to ignore the check certificate or always return it valid not sure I tried to edit this but failed
also, there's another error that it does not support http3 and QUIC  which makes some sites fail to load you using an old version of hyper. I am trying to use a branch that supports QUIC like this https://github.com/djc/hyper/tree/quinn-h3
or add https://crates.io/crates/quinn
but it is still not 100% working i think if you can integrate it with http3 and Quic, it will be more stable and reliable

If only the domain googleapis.com has this issue, it is possible that it is caused by Google Chrome’s built-in trust configuration not trusting third-party CAs.
The quinn-h3 branch has not been updated for 4 years, and it seems that there is no mature HTTP/3 library in the Rust ecosystem.

I am encountering issues with many websites that display a warning message before allowing me to proceed. I cannot determine the cause of this issue, which makes using a proxy unstable, especially when using software other than Chrome or browsers that do not have the option to disable these warnings.
about Quic and h3 there is some .
https://github.com/cloudflare/quiche
https://github.com/hyperium/h3
https://github.com/quinn-rs/quinn
https://crates.io/crates/salvo_core

Is there a way to communicate directly?
I shared my WhatsApp contact with you. I've been working on this project for over 2 weeks,
but I'm feeling frustrated as I'm not experienced with Rust.
i fix one issue i get another,
I feel like I'm wasting time.

https://github.com/Tencent/tquic
this maybe can help to add quic http3  ?

I am encountering issues with many websites that display a warning message before allowing me to proceed. I cannot determine the cause of this issue, which makes using a proxy unstable, especially when using software other than Chrome or browsers that do not have the option to disable these warnings.
about Quic and h3 there is some .
https://github.com/cloudflare/quiche https://github.com/hyperium/h3 https://github.com/quinn-rs/quinn https://crates.io/crates/salvo_core

Have you added the CA certificate to the root directory trust zone?

Is there a way to communicate directly? I shared my WhatsApp contact with you. I've been working on this project for over 2 weeks, but I'm feeling frustrated as I'm not experienced with Rust. i fix one issue i get another, I feel like I'm wasting time.

i dont have a Whatsapp account...

I have added the CA certificate to the root directory trust zone.
It works fine in some browsers but not in others.
So, my setup is correct, but as you said, the browser thinks it's not trusted.
I believe you can avoid this issue by ensuring that the code always returns a valid certificate,
but I'm not sure how to implement that.
The important part is to make it support HTTP/3 QUIC.
I've tried using various libraries and methods,
but I keep encountering unfamiliar errors and can't get it to work

It may be difficult to make this project support http3 because http3 uses UDP, which is completely different from other HTTP protocols at the bottom level

I am unable to return the correct certificate every time because some programs may limit the trust to only certificates issued by certain CAs regardless of whether the certificate is trusted by the system, and the technology used in this project is man in the middle attack, which can only return self signed certificates

It may be difficult to make this project support http3 because http3 uses UDP, which is completely different from other HTTP protocols at the bottom level

it just need to accept http3 traffic if you look at the last
https://github.com/Tencent/tquic
it has the server for quic and client so it accepts http3 requests and redirects it to the server
or other method uses quic socks proxy if http3 requests quic traffic want to go through it

do you have any website for test http3 and certificate verification?

https://quic.nginx.org/ for http3 quic traffic test
and https://http3.is/ this check h3

https://websocketstest.com/ to test WebSocket

When I open it https://quic.nginx.org/ This website defaults to using the http2 protocol as the cthulhuRs proxy does not support http3, everything else is normal.

I'm not sure what you're trying to do or test,
but you need to try sending traffic over QUIC HTTP/3 to test if HTTP/3 requests will go through or not.
The site opens fine and most sites will open, but HTTP/3 traffic will not work because it's not supported in cthulhuRs . So, you need to either add support for HTTP/3 over QUIC or tunnel the traffic to a SOCKS5 server that supports QUIC (allow to set that if HTTP/3 traffic is found it redirects it to another proxy that will handle it ) so it works like a bridge.
https://mitmproxy.org/posts/releases/mitmproxy10/ is python that do quic mitm not sure if it can help

if you want o test http3 connection only you can use curl --http3 use curl version that support it
https://github.com/stunnel/static-curl/releases/tag/8.10.1
and use something like this to check http3 and tls
curl -I --http3 https://www.cloudflare.com -v

any progress on this issue?
Are you going to work on this or should I find alternative methods,
i hope we can talk directly via telegram WhatsApp etc so I know what you trying to do

After researching, it was found that HTTP requests based on UDP do not forward to TCP based proxy services at all

I am unable to register for the communication apps you mentioned

After researching, it was found that HTTP requests based on UDP do not forward to TCP based proxy services at all

yes it needs udp proxy or you can do UDP over tcp to a proxy that supports this
or just tunnel it to local udp proxy did you check
https://mitmproxy.org/posts/releases/mitmproxy10/
they added support for http3

I am unable to register for the communication apps you mentioned

which app works for you but not qq coz i can't register on it

I am unable to register for the communication apps you mentioned

which app works for you but not qq coz i can't register on it

I use WeChat ,’lxs3451743380’ that is my account


Adding all file and directory content for package

Adding necessary .toml, readme, requirements files, as well as the contents of the package in src/

Why do you need the following pieces
/data/bright_source_cat.fits
/data/F646018360
there may be other extraneous pieces too.
You can look at what you actually need to do the relevant response calculation and tests, and only include that.

also many of the requirements listed are not needed

@Tohuvavohu  Removed the F64601860 directory and added the test_response.py file that will run using pytest. I also edited the requirements to just include the necessary modules and just cleaned up the repository in general according to your advice

Also, when you've figured that out, install instructions should be in README.md

Looks like the package should install just as you described in 1.  I've included the install instructions into the README.md file. I'm still figuring out how to squash my last commits. Should I be squashing all of my commits into a singular one after your initial commit for the repo?

Yep!

also you have an extraneous, empty, file called 'ls'

@Tohuvavohu alright, was a nail-biter but was able to squash the commits successfully and now all the commits show up as a singular commit.

Was there any other things that needed to be changed?


Select with Limit clause is slower than without

CrateDB version:
4.5
Environment description:
Linux Debian Stretch
Problem description:
A select * from users query is faster than select * from users limit 100000  on a table containing 100 001 rows.
Steps to reproduce:
Table schema user:

Name
Type

id
lInteger

firstname
text

lastname
text

year_of_birth
Integer

active
text

Insert 100001 rows of user into doc.user.
Measure time on queries select * from users  and select * from users limit 100000.
Based on this discussion.

Duplicate of https://github.com/crate/crate/issues/11285


Releases: please use the same tarballs for github and pypi

Hi,
The tarballs available on github and the ones available on https://pypi.python.org/pypi/django-q differ. Indeed, the former contain the docs/ directory whereas the latter don't.
I discovered this difference while packaging 0.8.1 into Debian. As it's easier to rely on the pypi tarball for the package maintaining, would you consider having the next releases' tarballs be the same on both media?
Thanks a lot! :)

Hi @Koed00, can you add the Changelog.md file into the release tarball you put on pypi? :)

It should be in there. Have a look at the MANIFEST.in
Please not that the MANIFEST files are not included in the wheels.

Yes, indeed, but the MANIFEST.in of django-q 0.9.2 on pypi and github don't contain the include CHANGELOG line. :(
Don't know what happened. :/

I downloaded 0.9.2 myself from pypi and the CHANGELOG.md is in there.
Not sure why it would be different for you.

Oh, my bad. I didn't switch the debian package watchfile to the pypi version.
I thought I did. So actually only the github tarball misses it.

I'll close this issue, as you did your best to have two lookalike releases. :)
Thanks, and cheers!

Ah, there still is no docs/ directory in the pypi release. :(


Update 3.0.0.md

I believe the use of the key representations here was a typo, and should be content. If I am mistaken, please disregard!

You're not wrong. This oversight was however fixed in https://github.com/OAI/OpenAPI-Specification/commit/d45549e004a54a72d11a9ec9aa676bd2d0748d30#diff-3c215413cf312161e312fcb4327fda00 which was included in v3.0.1 of the specification. (Each version of the specification is fixed once published.)
Thanks again.


runtime/pprof: give more useful profiling output for time.Now (and other vDSO functions) on Linux

(Moving this over from a discussion at https://groups.google.com/d/msg/golang-nuts/83xaAgzL2cU/OcLIOdi8CwAJ.)
These results are on Go 1.10 / Linux / amd64, but they're unchanged from previous versions.
On Linux, time.Now (and anything else which calls runtime.walltime and runtime.nanotime) are implemented using a vDSO. When a profiling signal arrives during the vDSO call, pprof attributes that time to the catch-all runtime._ExternalCode, unrelated to any Go function.
Here's a demonstration:
go test -run xxx -bench '^BenchmarkNow$' -benchtime 5s -cpuprofile time.prof time

(pprof) top10
Showing nodes accounting for 5320ms, 100% of 5320ms total
      flat  flat%   sum%        cum   cum%
    3910ms 73.50% 73.50%     3910ms 73.50%  runtime._ExternalCode
     400ms  7.52% 81.02%      660ms 12.41%  time.now
     330ms  6.20% 87.22%      330ms  6.20%  runtime.nanotime
     310ms  5.83% 93.05%      970ms 18.23%  time.Now
     240ms  4.51% 97.56%      240ms  4.51%  runtime.walltime
     130ms  2.44%   100%     1100ms 20.68%  time_test.BenchmarkNow
         0     0%   100%     4220ms 79.32%  runtime._System
         0     0%   100%     1100ms 20.68%  testing.(*B).launch
         0     0%   100%     1100ms 20.68%  testing.(*B).runN

This is unhelpful for the user in several ways:

This time is counted in the same bucket as any other external code (such as cgo). Most users will not expect that runtime._ExternalCode is due to a core standard library function like time.Now.
It doesn't actually tell the user what part of the Go code is the source of the time.Now calls.

@ianlancetaylor kindly cooked up https://golang.org/cl/97315 to address (1), so that at least this will be marked as _VDSO instead of _ExternalCode.
Even with this change, it's still hard for users to know that the VDSO time is (likely, but not necessarily) due to time.Now calls, or where those calls originate.
By contrast, if I have a program which is slow because it's making many os.Stat calls, it will be clear from the profile graph that the cause is os.Stat (and what function is calling os.Stat), even though the big red box with all the self time is labeled syscall.Syscall.
I don't know how this would be implemented or even if it's feasible, but I hope that something better can be done for these vDSO calls as well.
This is not a hypothetical or benchmark-only problem. Here is a small part of a pprof graph from an important production service that I'm trying to debug:

(This is a CGO_ENABLED=0 build.)

It is certainly possible to get the complete call stack for the call to time.Now, but the only way I can think to do it involves adding at least three memory stores to runtime.walltime, effectively treating it as a cgo call (which is what happens with the stat system call).  I'm hesitant to do that since the function is so hot, and this has to be something of an unusual case.

OK, I discovered a slight wrinkle here: in production, we're running on virtual instances in EC2 and the default Xen clocksource doesn't support vDSO, so time.Now is very slow (~720ns, vs ~50ns on my local machine). This is why I'm seeing such a large _ExternalCode cost in my profiles.
If I understand this correctly, we're going through the __vdso_gettimeofday_sym fallback which does a syscall under the hood.
One option would be to do the cgo-style bookkeeping only in the fallback case where we know we're going to incur the syscall overhead anyway.

It's more painful than I thought, as it turns out that the time functions can be called while we are nominally in system call, so simply reusing the fields breaks traceback also.


Pin the hosted-provider charts to a specific version

Is your feature request related to a problem? Please describe.
When there are newer versions of the charts for the hosted providers (EKS, AKS, GKE) Rancher will install the chart automatically. This has caused some issues with chart versions being installed that we didn't want. And its less deterministic which version of the chart is installed.
Describe the solution you'd like
For each Rancher release, we want to pin the version of the hosted provider charts that are installed with that release. This is what is done with rancher-webhook.
If we need to do an out-of-band release to fix a issue we will support changing the version via a system setting. This would be something that support would direct a customer to do.
Additional context
See the rancher-webhook implmenetation for an example: https://github.com/rancher/rancher/pull/41302
PR's

[x] https://github.com/rancher/rancher/pull/44042

Initial implementation which we can use was already submitted and we have to wait until it will be merged https://github.com/rancher/rancher/pull/42304/files

Updating the target milestone as PR is merged in v2.9
cc: @kkaempf @mjura

Blocked on https://github.com/rancher/charts/pull/3409

Validated on build:
v2.9-44e346d1228543c202a7f7a74a8d3277ca250bbe-head
Test case:
Test Rancher installs AKS version via CATTLE_AKS_OPERATOR_VERSION environment variable.
Install command:
Docker Install:
docker run -d --restart=unless-stopped -p 80:80 -p 443:443 -e CATTLE_AKS_OPERATOR_VERSION=104.0.0+up1.3.0-rc1 -e CATTLE_BOOTSTRAP_PASSWORD=rancherpassword --privileged rancher/rancher:v2.9-head
or
Helm Install:
helm install rancher --devel rancher-latest/rancher --namespace cattle-system --set hostname=<HOSTNAME> --set replicas=1 --set global.cattle.psp.enabled=false --set rancherImageTag=v2.9-head --set 'extraEnv[0].name=CATTLE_AKS_OPERATOR_VERSION' --set 'extraEnv[0].value=104.0.0+up1.3.0-rc1' --wait
Results:

Rancher installs and is up and running
AKS CRDs are not initialized yet
Provision an downstream AKS cluster, now AKS crds are initialized
AKS version deployed is:

# kubectl describe deployment aks-config-operator -n cattle-system | grep Image
    Image:  rancher/aks-operator:v1.3.0-rc2

Expected version is rancher/aks-operator:v1.3.0-rc1, provided while Rancher install command.
@mjura Can you please take a look.
Also as in PR, it seems pinned version needs to be provided in build.yaml ? https://github.com/rancher/rancher/pull/42000

I have tested it again and everything works as expected.
To use it, please do following steps:

Change Rancher deployment and add:

        env:
        - name: CATTLE_GKE_OPERATOR_VERSION
          value: 104.0.0+up1.9.0
        - name: CATTLE_EKS_OPERATOR_VERSION
          value: 104.0.0+up1.9.0

Apply changes to Rancher k8s cluster
Delete old eks and gke operator deployment in Rancher local Installed Apps section
Try to create new EKS or GKE managed cluster.
Rancher will deploy already pinned version of EKS and GKE operator

Nothing to do, I am closing this issue.
3.


[Storage.Datalake] Remove DataLakeAclChangeFailedError

We will add (or document) support for continuation_token to AzureError in azure.core: #14176
Once this added we should remove this object and support raising the original error along with the continuation token.
This will need to happen before the GA release.
This also applies to the storage pageable operations - where the continuation token can be added to exceptions raised while iterating.

Hi Anna!
Just want to clarify a bit about the error field of DataLakeAclChangeFailedError class: https://github.com/Azure/azure-sdk-for-python/blob/master/sdk/storage/azure-storage-file-datalake/azure/storage/filedatalake/_models.py#L826
The error is a type of AzureError instead of the exact AzureError instance. For example, we caught ServiceRequestError which is a subclass of AzureError, we want to set that ServiceRequestError instance as the error field to let user know the precise error raised.
If we add continuation_token to AzureError, all it's subclasses will have a continuation token, which will only be used for recursive acl operation. I guess the coninuation_token is too precise to add to the super parent class?

We would prefer not to have an "error within an error" for Python - in Python we use try/except syntax to have different handling for different error types - but you cannot use this syntax if the different error types are an attribute of only one error.
For example, we would prefer this:
try:
    client.operation()
except ServiceRequestError as e:
    do_something(e.continuation_token)
except HttpResponseError as e:
    do_something_else(e.continuation_token)

Instead of:
try:
    client.operation()
except FailedError as e:
    if isinstance(e.error, ServiceRequestError):
        do_something(e.continuation_token)
    elif isinstance(e.error, HttpResponseError):
        do_something_else(e.continuation_token)

Yeah you are absolutely right that we'd want to let user use the simplest syntax when dealing with error.
Just the reason we decided to create DataLake specific error for all three platforms was we don't want  to use a generic error for a specific purpose. Here is the original discussion.
Since that wasn't a random decision, all SDKs hesitate to break users experience. (Even it's a preview feature)

Will proceed to close this issue since it seems it has been resolved. If this needs to be discussed further please feel free to reopen :)


Frontend: fix bugs in Bitkeep mobile wallet

Closes #1513
Ensures that no transfers are shown mistakenly as failing with Bitkeep. During testing I also found that the chain switching does not work properly with Bitkeep. This is also fixed. See commit messages for details.

Are you sure they are not emitting any events? I could verify that BitKeep is throwing the event, but the call to location.reload does nothing. See the comment in the code. If this happens with multiple wallets, maybe it is related to the in-app browser that is probably somewhat based on the Android chrome browser for all apps. Not sure how these in-app browsers work exactly.

You are right, the event emitting is not the problem here but rather the location.reload not working properly. Thanks for the effort and for creating the follow up issues!


Create security urgently

Version 6.x.x supported current LTS but 2 opened yet over 1,000 closed.
Urgent security to be ACTIONED as soon as possible.  Before Friday end of September 2022.
Vergecurrency illegitimate. 🌡🪫🖲⛑
To be reviewed as stated above

Description

Related Issue

Motivation and Context

How Has This Been Tested?

Screenshots (if appropriate):
Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

[x] My code follows the code style of this project.
[x] My change requires a change to the documentation.
[x] I have updated the documentation accordingly.

To be ACTIONED asap

what do you mean?
7.x supports 18.04 and 22.04

All done


[WIP] fix: set default numberOfLines prop to 1 in HeaderTitle

Description
I added back default numberOfLines prop to the HeaderTitle Component. It will truncate the default title text. [#290]
This PR would not fix the above issue, because HeaderTitle still overlaps on the headerLeft and/or headerRight.

Next steps
I'm not sure how you would like to handle positioning in the Header Component if text is long (overlaps).

we know the back button layout, so it'd be possible to set a horizontal margin of the same size.
though imo truncating the title is bad. since title is for users to recognize what the screen is. truncating it prevents it. instead developers should ensure not to put anything that's too long in the title.

@satya164 I'm using the header bar as a search bar, the user can write whatever he want and it will be displayed as the title, how should I handle this situation where the input isn't a fixed/known string?
I don't think it's bad to truncate it in this scenario, the user would know what the full title is anyway because he wrote it. Besides that, a text that overlaps with the buttons or, even worse, overflows the screen won't be readable anyway. I would prefer it to be truncated and just see the dots.
By the way, if there's an input in the header it should hide the first letters to avoid overlapping, take WhatsApp or Telegram search as example.

overflows the screen won't be readable anyway. I would prefer it to be truncated and just see the dots

overflow is worse, but that doesn't mean that truncating isn't bad. design guidelines such as material guidelines specifically advise against it. if you know, title can be long, it's always possible to come up with a different design (e.g. large header which shrinks on scroll, title inside the screen etc.).
regardless, handling this properly isn't even possible because of async APIs of React Native regarding layout measurement. you're always going to see a flicker before we can truncate it. it's not going to change until Fabric releases.

if there's an input in the header it should hide the first letters to avoid overlapping

there are a lot of limitations regarding what can be done. it's impossible to automatically detect of there is an input or not. however, there are props we provide such as headerBackTitleVisible which you can use to hide the back label when you know you have an input. you can also provide a horizontal margin in your headerTitle and customize it to truncate it yourself. it's not possible to do it automatically and provide a good user experience with the current limitations of React Native.

Thanks for the fast response @satya164.

it's impossible to automatically detect of there is an input or not

I didn't mean that it should detect if there's an input, I was describing how it should behave in that situation.
The problem is that all the elements of the header have an absolute position and no width (or max width), that's why they overlap.
If I set a width to the title then it behave as what I consider is correct:

Doesn't overlap, it truncates with ellipsis.
The input shows only the text that fills in the width but you can navigate with a swipe to display previous/next characters.

I don't really like to play with the width, even less when there's no calc() in RN.

The problem is that all the elements of the header have an absolute position and no width (or max width), that's why they overlap.

They are using absolute position because it's impossible to achieve the desired layout using flexbox. We cannot set a width or max width for the same reason I mentioned, layout is async and you'll see a flicker.
There are a lot of things that needs to be handled and I have spent a lot of time on it. We'd have handled it better if it was possible. It's not as simple as it looks.

I don't really like to play with the width, even less when there's no calc() in RN.

I'm talking about adding horizontal margin, not width.
We can add margins/width in the library, but it will have a flicker and there's nothing we can do about it. It's easier to add a width/margin for you because you can hardcode values depending on your app. Whether you like it or not, it will provide the best UX.

I understand, thanks for taking the time to discuss it!

what can i do about this in my case? do i have to wait for this PR to be merged?


portfolio Naman

Description 📝
Please describe the purpose and scope of this Pull Request.
Changes Made 🛠
Summarize the changes you made in this PR.

Provide a clear and concise list.
Use bullet points for readability.

Related Issues 🔗
Link any related issues or reference the issue numbers that this PR addresses. For example:

Fixes #123
Addresses #456

Screenshots (if applicable) 📸
If your changes are visual or impact the user interface, please include screenshots or animated GIFs demonstrating the changes.
Checklist ✅

[x] My code follows the project's coding style and guidelines.
[x] I have tested my changes and ensured they work as intended.
[x] I have updated the project's documentation (if applicable).
[x] I have added the appropriate labels to this PR.
[x] I have assigned this PR to the relevant reviewer(s).

Additional Comments 💬
Add any additional information or context that is important for the reviewers to know.

First Pull Request


[AutoPR applicationinsights/data-plane]  fix: Rename applicationinsights/data-plane/Microsoft.Insights

Created to sync https://github.com/Azure/azure-rest-api-specs/pull/4736

(message created by the CI based on PR content)

This PR has been merged into https://github.com/Azure/azure-sdk-for-python/pull/3456


Add label tip for Base URL settings fields

Adds label tips for Base URL fields! Simple fix for https://github.com/jorenn92/Maintainerr/issues/1390
Screenshot

lol 🤦 I force-pushed because the label text I added was the opposite of what it should have been

@ydkmlt84 Made the requested changes!
Not sure what happened with my first force-push ¯\_(ツ)_/¯

Wouldn't it be better for the server-side logic to check for a leading slash and remove it if present?

@jorenn92 Definitely would be better for the server to do it! There was some discussion in the issue I created and adding a label seemed like a decent interim solution that I could readily handle myself.
Not sure how much more involved it would be to properly handle on the back end.

Oh, I see! I missed that issue. I didn’t realize this was just a temporary solution. In that case, it works for me


remove offline mode for now

Remove off-line mode to allow invocations to download dependencies as this seems to cause build flakes.

Codecov Report

Merging #1030 into master will not change coverage by %.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master    #1030   +/-   ##
=========================================
  Coverage     99.42%   99.42%
  Complexity     2285     2285
=========================================
  Files           348      348
  Lines          6281     6281
  Branches        364      364
=========================================
  Hits           6245     6245
  Misses            5        5
  Partials         31       31

Flag
Coverage Δ
Complexity Δ

#unittests
99.42% <ø> (ø)
2285.00 <ø> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 26547ce...8cb4349. Read the comment docs.


Add various options

Option to download fewer than 10 papers when --scholar-pages=1..(not tested) (on issue #33 )
It also has those changes of the master branch NOT on the DEV branch..

@ferru97 ,I guess it would be better to have PyPaperBot-dev and Pypaperbot-UI as a seperate python package.. wont it?

Well... The above proxy options cannotbe implemented in systems without sem_open implementation.. so.. it has to be changed..

@ferru97 ,I guess it would be better to have PyPaperBot-dev and Pypaperbot-UI as a seperate python package.. wont it?

Yes, but for the moment I don't think to implement it, if you want you can obviously do it

Are these changes you made tested?

Are these changes you made tested?

Scholar results option is tested amd works fine... Proxy option is yet to be tested...

Well proxy option works now

Perfect, thanks!


Why GATT need full control of HCI device and how about BLE work before HCI_USER_CHANNEL

As you mentioned: We must need patch the HCI_USER_CHANNEL relevant commits, but how do kernel version before 3.13 support BLE?

You can use HCI_RAW_CHANNEL instead, but then you'll have two stacks manage the controller at the same time.
Kernel has link manager to manage links/connections. But BLE has been a moving target. Spec is evolving, and hardware vendors try to add new features/functions which was not standardized in spec. To keep up with the changes, BT stack in kernel is also evolving. Depends on which revision you're running, sometimes you have different behavior or different feature supported.
HCI_USER_CHANNEL allows us to have full and "exclusive" control of the controller in user space.


Following the Directions on the Homepage of the project doesn't seem to work...

#tool "nuget:?package=AliaSQL"
#addin "Cake.AliaSql"
var baseDirectory = MakeAbsolute(Directory("."));
var databaseServer = ".\\";
var databaseName = "ASSESS";
var dataDirectory = baseDirectory + "\\data";
Task("RebuildDatabase")
   .Does(() =>
    {
        AliaSql("Rebuild", new AliaSqlSettings
        {
            ConnectionString = databaseServer,
            DatabaseName = databaseName,
            ScriptsFolder = dataDirectory
        });
    });
When I run the build, I get an error which Cake is building script.
The type or namespace name 'AliaSqlSettings' could not be found (are you missing a using directive or an assembly reference?)

You might have to add using Cake.AliaSql at the top after the directives.

Maybe I'm daft, but I can't get it to work either. I added the #tool and #addin directives and when I ran the script, I got the same error as @dcjulian29 . I added the using Cake.AliaSql to the script, but now I'm getting a different error.
Error: C:/repo/project/build.cake(51,5): error CS0103: The name 'AliaSql' does not exist in the current context
Task("RebuildDatabase")   .Does(() => {     AliaSql("Rebuild", new AliaSqlSettings         {             ToolPath = "./tools/AliaSQL/tools/AliaSQL.exe",             ConnectionString = "Data Source=(LocalDb)\v11.0;Initial Catalog=Taurus;Integrated Security=True;",             DatabaseName = "Nematoad",             ScriptsFolder = "./src/Migrations/scripts",         });   });
The line number points to the AliaSql line which I copy/pasted into my project. Any ideas?

The current version of the addin "0.4.1" is compiled against the "0.6.4" version of Cake. The current version of Cake is 0.14.0 so I think that there must be some breaking change between 0.6.4 and 0.14.0... I created a "private" feed containing a compiled DLL against the 0.14.0 Cake.Core.dll to test the idea, but can't get Cake to load the AddIn from my private feed... I'm currently working around this issue with the following:
#tool "nuget:?package=AliaSQL"

Task("RebuildDatabase")
    .Does(() =>
    {
        StartProcess ("tools\\AliaSQL\\tools\\AliaSQL.exe", new ProcessSettings {
            Arguments = "Rebuild " + databaseServer + " " + databaseName + " " + dataDirectory
        });
    });

I put in a PR (#7) to update the project to be built against Cake 0.15.2. There was an obsolete constructor that was being used and apparently it doesn't actually work anymore. Once I updated the constructor to the new one, everything seemed to work correctly.
I'm not sure how to handle the version bumping. @RichiCoder1 , can you review/merge my changes and version bump / package this guy up? Or tell me the steps I should take to do so and I will update my PR.

@dcjulian29 @nelsonwellswku a new package version, 0.5.0, has just been pushed to NuGet.org.  Let me know how you get on with it, and if there is anything else you need.  Thanks!

Sorry for taking so long to get back to you (@gep13)... I just tested with 0.5.0 from the Nuget.org feed and it works with the current Cake version... Thanks...


Material from Geometry ESProducer

PR description:
change material derivation from a table derived from the tracking ntuple to storing it while looping over modules in the Geometry ESProducer
the material is stored in a r-z grid (120x300 bins of 1cm pitch)
the layers are filled with the closest bin material in case there are no modules in a given part of the layer
PR validation:
new material grid (radL)

old material grid (radL)

validation http://uaf-10.t2.ucsd.edu/~legianni/single-iter-checkmat/plots_1000ev/
validation with timing (100 eats) http://uaf-10.t2.ucsd.edu/~legianni/single-iter-checkmat/plots_time/
parts where I had some issues/ may benefit from review

https://github.com/leonardogiannini/cmssw/blob/Material-GeomESProducer/RecoTracker/MkFit/plugins/MkFitGeometryESProducer.cc#L445

the second loop to find the neighbor in the grid can be sped up a bit

https://github.com/leonardogiannini/cmssw/blob/Material-GeomESProducer/RecoTracker/MkFitCore/src/PropagationMPlex.cc#L657

I had to put the check on the float because just checking the int was not working (but it used to in the old material implementation)
In particular I had rbin = -2147483648 passing the >=0 check. The value should be at the limits of int.

@leonardogiannini
was both code-checks and  code-format run on this?
Please run a timing profiler on one event (igprof -pp) to see the cost of MkFitGeometryESProducer

@leonardogiannini was both code-checks and code-format run on this?
Please run a timing profiler on one event (igprof -pp) to see the cost of MkFitGeometryESProducer

yes, it should be ok. I'll run the profiler

reran validation after the last update
+cpu profiling (need to find MkFitGeometryESProducer)

old
https://legianni.web.cern.ch/legianni/cgi-bin/igprof-navigator/materialESProducer/igOLDcpu132/
new
https://legianni.web.cern.ch/legianni/cgi-bin/igprof-navigator/materialESProducer/igNEWcpu132/

I guess it means a rebase is needed

reran validation after the last update
+cpu profiling (need to find MkFitGeometryESProducer)
* old
  https://legianni.web.cern.ch/legianni/cgi-bin/igprof-navigator/materialESProducer/igOLDcpu132/

* new
  https://legianni.web.cern.ch/legianni/cgi-bin/igprof-navigator/materialESProducer/igNEWcpu132/

how many events was this profiling? This somehow looks like more than just one event.
Was the analysis done consistently in the baseline release and in a release with this PR for the old and new, respectively?
Somehow the call sequence like here https://legianni.web.cern.ch/legianni/cgi-bin/igprof-navigator/materialESProducer/igNEWcpu132/798 doesn't make sense (MkFitGeometryESProducer::fillShapeAndPlacement is called directly by edm::global::EDProducerBase::doEvent)

reran validation after the last update
+cpu profiling (need to find MkFitGeometryESProducer)
* old
  https://legianni.web.cern.ch/legianni/cgi-bin/igprof-navigator/materialESProducer/igOLDcpu132/

* new
  https://legianni.web.cern.ch/legianni/cgi-bin/igprof-navigator/materialESProducer/igNEWcpu132/

how many events was this profiling? This somehow looks like more than just one event.
Was the analysis done consistently in the baseline release and in a release with this PR for the old and new, respectively? Somehow the call sequence like here https://legianni.web.cern.ch/legianni/cgi-bin/igprof-navigator/materialESProducer/igNEWcpu132/798 doesn't make sense (MkFitGeometryESProducer::fillShapeAndPlacement is called directly by edm::global::EDProducerBase::doEvent)

I ran igprof on 100 evts - single thread. The release is consistent before and after

I ran igprof on 100 evts - single thread. The release is consistent before and after

I was asking for just one event to see the ES producer startup cost https://github.com/trackreco/cmssw/pull/125#issuecomment-1540272583
Just in case, please rerun the analyzer: the call stack looks strange as if there is an inconsistency

@slava77
I just reran with one event and this is the result

old
new

the MkFitGeometryESProducer::produce is  here (old) and here  (new) .
I am still not sure what to look for in the igprof report, so let me know if there is something specific to look for. Otherwise it seems that I am running the steps correctly.

finally seems that I am able to produce the correct profiling

old
https://legianni.web.cern.ch/legianni/cgi-bin/igprof-navigator/materialESProducer/OLD3/5943
new
https://legianni.web.cern.ch/legianni/cgi-bin/igprof-navigator/materialESProducer/NEW3/449

finally seems that I am able to produce the correct profiling

I'm curious what was the update that made the new case work.

it seems that you need to do igprof-analyse in the correct branch and compiled code! I thought that once profiled I could use whatever CMSSW area

the PR to cmssw (improving this one) is ok now
the profiling also shows a speed up for the material https://legianni.web.cern.ch/legianni/cgi-bin/igprof-navigator/materialESProducer/NEWNEW/3206
the MTV validation is identical http://uaf-10.t2.ucsd.edu/~legianni/single-iter-checkmat/plt_afterMatevz2/

I noticed only now that the CMSSW PR was made with a different topic branch leonardogiannini:Material-fromGeomESProducer
We should use the same branch as in the internal PR to consistently follow the internal and upstream review.

the upstream version of this PR is cms-sw/cmssw#41714


inconsistent matches when capturing group is present

This program
extern crate regex; // 1.0.5
use regex::Regex;

fn main() {
    let text = "foo\nbar\nbaz\n";

    let re = Regex::new(r#"(?m)^[ \n]*[a-z]+[ \n]*$"#).unwrap();
    for c in re.captures_iter(text) {
        println!("{:?}", (c.get(0).unwrap().start(), c.get(0).unwrap().end()));
    }

    println!("-----------------");

    let re = Regex::new(r#"(?m)(^)[ \n]*[a-z]+[ \n]*$"#).unwrap();
    for c in re.captures_iter(text) {
        println!("{:?}", (c.get(0).unwrap().start(), c.get(0).unwrap().end()));
    }
}

outputs
(0, 3)
(3, 7)
(7, 12)
-----------------
(0, 3)
(4, 7)
(8, 12)

but the outputs of each loop should be identical. This is almost certainly a case where the DFA gets it right (the first case) but the Pike VM/backtracker gets it wrong (the second case). My bet is that the compiler is producing bad byte code for the capture group. Taking a look at the byte code:
[andrew@Cheetah regex-debug]$ regex-debug compile '(?m)^[ \n]*[a-z]+[ \n]*$'
0000 Save(0) (start)
0001 StartLine
0002 Split(3, 4)
0003 '\n'-'\n', ' '-' ' (goto: 2)
0004 'a'-'z'
0005 Split(4, 6)
0006 Split(7, 8)
0007 '\n'-'\n', ' '-' ' (goto: 6)
0008 EndLine
0009 Save(1)
0010 Match(0)

[andrew@Cheetah regex-debug]$ regex-debug compile '(?m)(^)[ \n]*[a-z]+[ \n]*$'
0000 Save(0) (start)
0001 Save(2)
0002 StartLine
0003 Save(3)
0004 Split(5, 6)
0005 '\n'-'\n', ' '-' ' (goto: 4)
0006 'a'-'z'
0007 Split(6, 8)
0008 Split(9, 10)
0009 '\n'-'\n', ' '-' ' (goto: 8)
0010 EndLine
0011 Save(1)
0012 Match(0)

If there's an error here, I don't think I see it.
cc @retep998

Here is a somewhat more minimal example I have independently identified.
/(a)\d*\.?\d+\b/
/a\d*\.?\d+\b/
Input: a0.0c.

I'm also running into this issue.  When I place a capture group on a single character capture, sometimes it captures it, and sometimes it doesn't.
The regex I'm using is ((?) with some other capture groups and sometimes the parentheses is captured and sometimes it's not.  I can't seem to find a workaround.  I may have to find another regex library.   It's sad that this bug has been open for two years when it is easily reproducible.

Lol, my regex got changed after I submitted it.  Anyway, it's an escaped parentheses in a capture group with a ? quantifier.
It works on small text, but larger texts causes it to be inconsistent.

@paul-dev8 Why not provide a program that others can reproduce instead of complaining how sad it is that volunteers haven't fixed it yet? Then maybe someone could help with a work around if possible.

There's a sample program on top.  Someone actually went to the effort of isolating the problem for you to obviously make it easy to fix.  But it's languished for two long years.  This library obviously has had a ton of work put into it, but if I find major bugs the first time I try to use it, those should be fixed first before working on "features".  A library fundamentally needs to be correct before anything else.

OK, have it your way, I've blocked you from my account. I have almost no patience for people who try to lecture other volunteers on how they spend their free time, doubly so for when they are wrong. 1) the problem isn't necessarily easy to fix given that the root cause hasn't been identified yet and 2) I've spent the last couple years working on correctness problems instead of "features" (whatever that means).

Hello, @BurntSushi, can I ask if there's any progress on this? Thank you! <3

This will be fixed once #656 lands (along with many other bugs).
I have no specific timeline.


limit length of id in model name to prevent model name becoming too long

Describe your changes
Limited the length of id in the model name to 42 characters, to prevent total model name length exceeding 63 characters and causing an exception on deploy.
Checklist before requesting a review

[X] I updated CHANGELOG.MD with a description of my changes
[X] If the change was to a module, I ran the code validation script (scripts/validate.sh)
[X] If the change was to a module, I have added thorough tests
[X] If the change was to a module, I have added/updated the module's README.md
[X] If a module was added, I added a reference to the module to the repository's README.md
[X] I verified that my code deploys successfully using seedfarmer apply

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

AWS CodeBuild CI Report

CodeBuild project: AIOpsModuleTestsInfrastruct-doMLXEYsnmxr
Commit ID: e5b0feb4939aa3893ac9540ecdf341c4f6380990
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository


What the easiest way to update a long-running fork to use the new workbench?

Let's say I have a long-running fork of a carpentries lesson I want to update to use the new style (@cjfullerton). Or (actually me) I have a lesson which uses the previous carpentries lesson template - what is the least painful way to transition this to use the new workbench format?
The FAQ indicates the easiest way to 'update' your fork is to re-fork, but doesn't offer any other suggestions.
If I decide to use the new format for my lesson and it's not loads of hassle I would like to keep my git history rather than starting again and moving the markdown content into the new template, and updating all the callout etc syntax.
I guess the lack of any further suggestions probably answers the question, but if the answer is simply "it's loads of hassle, just start again" that's ok, and good to have confirmed :)

I don't think it's reflected in the sandpaper-docs documentation yet, but @zkamvar has been very thorough in documenting the tools he used to manage the transitions of official lessons over in the carpentries/lesson-transitions repository: https://github.com/carpentries/lesson-transition#transitioning-carpentries-lessons
That documentation is pretty comprehensive, but I think the process itself is not to be taken lightly. Perhaps you'd like to give it a go and report back? We have been discussing scheduling onboarding sessions for this process, e.g. to help folks working on lessons in the Incubator, and any constructive feedback you can provide on the process and the documentation could be very helpful in making sure those are impactful.

Hi @gcapes,
The easiest way is to convert your fork to use the new format locally, make a new fork, and push one big commit with your changes.

If I decide to use the new format for my lesson and it's not loads of hassle I would like to keep my git history

It is also possible do do this without losing any of the git history (including the styles commits), by making a copy of the repository, renaming _episodes to episodes and then running the transform-lesson.R script (as shown in the filter-and-transform.sh script.

Note
Syntax transformation is done automatically from the transform() function for episodes and the rewrite() function for auxilary markdown files.

You'll have to do some clean up of the other Jekyll folders, but the transformation script takes care of most of the heavy lifting, but again, you will not be able to contribute to or bring in changes from the upstream repo.
You could also just do a full transition, which will keep your content-specific changes and discard the styles changes, but merging will be a hassle because of conflicts from the last two commits.

If you want to be able to merge, it will be a bit of a hassle. You should make sure to use the transition tool from the tag of the release (e.g https://github.com/carpentries/lesson-transition/tree/release_swc/git-novice for the swc/git-novice lesson), and then transition your lesson locally.
From here, you may be able to merge the changes from the upstream fork into your local branch, but there will be a lot of conflicts. I think it is theoretically possible to merge the upstream in to the former HEAD commit of your local transformed lesson and then apply your changes on top.

Thanks both for the replies!
I'll schedule some time to have another read through before deciding what to do :smile:


Issue when running paper trading

I keep getting this error after a few hours of running zenbot.
{ Error: getaddrinfo EAI_AGAIN api.gdax.com:443
at Object.exports._errnoException (util.js:1050:11)
at errnoException (dns.js:33:15)
at GetAddrInfoReqWrap.onlookup [as oncomplete] (dns.js:73:26)
code: 'EAI_AGAIN',
errno: 'EAI_AGAIN',
syscall: 'getaddrinfo',
hostname: 'api.gdax.com',
host: 'api.gdax.com',
port: 443 }

I think it's a network problem.
you could try to run a tool like "forever" to restart zenbot if it crashes. that's what i am doing currently.
simply run
sudo npm install -g forever
forever zenbot.sh trade

zenbot should still handle these kinds of things gracefully.

graceful retries are now a part of GDAX extension


Hot reloading

I think this would have to be a bukkit plugin which could communicate with the compiler to switch out the datapacks as edits are made.
 What do you think of designing the language to support it from the start?

I think hot reloading functionality is a very crucial part for this language.
Thankfully, Minecraft supports a remote control natively (if enabled in server.properties). This allows to send a reload command every time when the user changes the script.
Since no program state changes when the datapack reloads, the program could even continue right at where it was before reloading.

I haven't done much work with hot-reloading but AIUI, it can be much more powerful with explicit support from the language. Many functions take place over multiple ticks, and it'll be important to let them clean themselves up if we want the hot reloading to be reliable.
Mun might be a good reference

That seems a very ambitious.
I think the ability to transfer old data (eg. transfer the old struct of (int, int) to (int, int, bool) without having to restart the datapack) is out of scope, maybe a long term goal.


Make it so you can use run_model.py functionality outside of DeepQA

We made DeepQA pip-installable, but you still can't actually run a model unless you use our scripts, which basically means that you need to fork the code and implement your model inside of DeepQA.  Instead, we should make it so that you can use all of DeepQA from a third-party codebase, including actually running the thing.
And when we do this, we should add a section to the main README that gives a "hello world" example of how to use DeepQA in third-party code.

#334


Should we discontinue OnPre?

Liquid.OnPre is a implementation of Liquid abstractions for an on premises deployment.
Currently, while the project exists and some implementation was made, as we can see from issues such as #95 , #96 and #97, they are pretty raw.
My question is: do we need it? Are there projects using this implementation?
If so, then, what is the proposed architecture for that deployment? FileDb certainly shouldn't be used in production (or anything other than the simplest of tests, as we can see from #95), and messaging is simply not done.
The fact of the matter is that while on Azure, AWS and Google there is usually a single option for each of the services needed, on premises the number is vast. One could be using CouchDb, MongoDb, RavenDb etc. for NoSQL storage, WMQ, RabbitMQ, ApacheMQ etc. for messaging, and god knows how many APM solutions.
Therefore, I think we could either:

Forgo providing OnPre and let customers provide their own implementations, when desired. That would render Liquid less effective on on premises scenarios, but saves us a lot of work maintaining those components.

Decide on a recommended architecture for an on premises deployment, and provide components for that. This means dropping a number of implementations done and providing more solid ones.

I've been following the recent exchange.  In my experience, even with selecting the most likely and most popular components there is a high probability that it won't be usable as-is for any one instance.  But there remains value in having OnPre and so I'm inclined towards option 2.  This is also an excellent opportunity for other contributors.
For the implementations we have we should review them and caveat them for use.  I'm sure there is a good use case for FileDB somewhere (3rd party configuration?) but a MySQL option may be more useful as an implementation example.  We should remove the ones that are simply not implemented or implement them.

While I agree that providing default implementations for this scenario is a good choice, I'm still not convinced that people would use them without replacing at least half of the default services, so, IMHO it's not worth the effort. But I'd love to create extensions (aka cartridges) for them, although I'd not create them inside the Liquid itself (this repository), but rather in separated repositories (just like Serilog does). I'm between option 1 and 2.


Changed args order in README.

@Ronan-

We should choose which one should go first. In the code it's always config then schema, but the CLI is schema then config. Not a big deal, just that consistency is nice.
:+1:


Adds option to run Homebridge insecure

Proposed Changes
Add the possibility to run Homebridge in insecure mode.
This feature was requested.
Related Issues
#91

Closing this PR, was a little to fast.
Instead of rebasing and other issues, I'll open up a new PR.


MSM optimization

For https://github.com/appliedzkp/halo2/pull/40
I removed infinity from the curve implementation data because without it a point neatly takes up 64 bytes of data (a single cache line). I think using (0, 0) instead should also work fine, but let me know if you think this could give issues.

why put the intermediate values in points[i+1].y instead of points[out_idx].y? Another question is that if points[i] = points[i+1] and points[i].y = 0 then 2*points[i].y would be zero which will make acc to be zero. This will make it impossible to inverse the value s for other points.

Since the group generated by G1Affine::generator() is a group of prime order, there is no EC point of order 2. Therefore, if we assume that all points came from this group, then even if points[i] = points[i+1] then points[i].y can never be zero.

why put the intermediate values in points[i+1].y instead of points[out_idx].y?

points[i + 1].y is already used anyway so will be in the cache while points[out_idx].y isn't. I haven't measured how it performs if points[out_idx].y would be used though so I can't say for sure if this matters.


Drop minishift instructions

Changes
This commit drops instructions for minishift since it's not in active development anymore and has been replaced by CRC which does not need any specific instructions. See https://github.com/minishift/minishift#welcome-to-minishift.
/kind cleanup
Submitter Checklist
As the author of this PR, please check off the items in this checklist:

[x] Docs included if any changes are user facing
[x] Tests included if any functionality added or changed
[x] Follows the commit message standard
[x] Meets the Tekton contributor standards (including
functionality, content, code)
[x] Release notes block below has been filled in or deleted (only if no user facing changes)

NONE

ping @vdemeester, WDYT?

/test pull-tekton-pipeline-alpha-integration-tests

/lgtm

/test pull-tekton-pipeline-alpha-integration-tests

/lgtm

Closing and reopening to hopefully unjam EasyCLA.

/retest

/test pull-tekton-pipeline-integration-tests

/test pull-tekton-pipeline-integration-tests


Error occur when drag a conncted node into a GroupCommentNode

Thanks for the bug report!
This has to do with some recent changes to GraphViewBase.
Since this is its own package you can request an older commit where this issue should not appear until we fixed it. Here is the link to the specific version (you can use it directly in the package manager): https://github.com/Gentlymad-Studios/GraphViewBase.git#0ff5f7fb9154e4eebb75c0063fe134451d65d0ef

This has been fixed by @leissler


Fixing Storybook's ESModule dependency error

issue: #137
Testing
Try importing and using react-i18n

@rmshopify  Can you please add a little bit of context about what's happening here? Why are we adding react-transition-group?

@rmshopify Can you please add a little bit of context about what's happening here? Why are we adding react-transition-group?

Oh my bad, I accidentally imported that. Let me delete it real quick.


Expose CLI options

I want to set the --verbose flag, but adding that to options throws an error "Unsupported rule: verbose", since all options are simply handled as rules.

Duplicate of #72


API-Key Authorization returning 403

Link to reproduction
No response
Environment Info
Binaries:
  Node: 21.5.0
  npm: 10.2.4
  Yarn: N/A
  pnpm: N/A
Relevant Packages:
  payload: 3.0.0-beta.106
  next: 15.0.0-canary.104
  @payloadcms/db-postgres: 3.0.0-beta.106
  @payloadcms/email-nodemailer: 3.0.0-beta.106
  @payloadcms/graphql: 3.0.0-beta.106
  @payloadcms/next/utilities: 3.0.0-beta.106
  @payloadcms/plugin-cloud: 3.0.0-beta.106
  @payloadcms/richtext-lexical: 3.0.0-beta.106
  @payloadcms/translations: 3.0.0-beta.106
  @payloadcms/ui/shared: 3.0.0-beta.106
  react: 19.0.0-rc-06d0b89e-20240801
  react-dom: 19.0.0-rc-06d0b89e-20240801
Operating System:
  Platform: darwin
  Arch: arm64
  Version: Darwin Kernel Version 23.1.0: Mon Oct  9 21:28:12 PDT 2023; root:xnu-10002.41.9~6/RELEASE_ARM64_T8103
  Available memory (MB): 8192
  Available CPU cores: 8

Describe the Bug
Behaviour: api-key is not recognised during cURL or fetch requests as req.user always returns as null. Response is 403 - You are not allowed to perform this action
Reproduction Steps
API key enabled collection:
export const Keys : CollectionConfig = {
    slug: 'keys',
    auth: {
        useAPIKey: true,
        disableLocalStrategy: true,
    },
    access: {
        read: hasApiKey
    },
    fields: [
        {
            name: 'title',
            type: 'text',
            required: true
        }
    ]
}

Access control:
export const hasApiKey : Access = ({ req : { user }}) => {
    console.log('the user is', user)
    if (user) {
        return true
    }
    return false
}

cURL request (it's a test api key):
curl -H "Authorization: keys API-Key 362d99e8-6bf8-461a-a55b-1a56c2843906" localhost:3000/api/keys
fetch request:
const API_KEY = '362d99e8-6bf8-461a-a55b-1a56c2843906'

const response = await fetch('http://localhost:3000/api/keys', {
    method: 'GET',
    headers: {
        Authorization: `keys API-Key ${API_KEY}`
    }
})

const data = await response.json()

console.log(data)

Adapters and Plugins
No response

Adding these from the Discord in case others have the same issue. Here's what worked for some people:

Removing access control
Deleting the .next folder and restarting the server

Although, I think access controls should still work. In my mind, the API-Key strategy should authenticate you, populate the req with the user, and then the access controls should take over and run. It seems like this isn't the case?

@akhrarovsaid shouldn't I be able to define a collection in addition to 'users' that has an API-Key only authentication strategy? In this case, my collection 'keys' should be valid?

Here is an example POST request. You need to provide the API key, on the frontend we use uuidv4 to generate the key.


testnet network support - byyz6vdle8xzcar - validator,rpc,api

@carambon , Your Moniker and validator addresses are required, please update the PR with those details

@carambon , Your Moniker and validator addresses are required, please update the PR with those details

Moniker carambon
Validator address akashvaloper18psevzsu4n959xqqf08eas63238nlrhwq62pn0

Moniker carambon
Validator address akashvaloper18psevzsu4n959xqqf08eas63238nlrhwq62pn0


[$250] Chat - User is able to send message with max character limit

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Version Number: 9.0.31-3
Reproducible in staging?: Y
Reproducible in production?: Y
If this was caught during regression testing, add the test name, ID and link from TestRail: https://expensify.testrail.io/index.php?/tests/view/4943661
Email or phone of affected tester (no customers<EMAIL_ADDRESS>Issue reported by: Applause Internal Team
Action Performed:

Navigate to any 1:1 conversation
Enter a text that is over 10k characters but less than 15K characters - You can use Lorem Ipsum generator for this
After the compose box displays an error that the maximum amount of characters is 10k, add attachment
Send the message with the attachment

Expected Result:
User should not be able to send messages over 10k characters
Actual Result:
User is able to send messages over 10k characters if there is added attachment.
Workaround:
Unknown
Platforms:

[ ] Android: Native
[x] Android: mWeb Chrome
[ ] iOS: Native
[ ] iOS: mWeb Safari
[x] MacOS: Chrome / Safari
[ ] MacOS: Desktop

Screenshots/Videos
https://github.com/user-attachments/assets/dc0449a1-b1de-4132-8846-c38f750b9ea4

View all open jobs on GitHub
Upwork Automation - Do Not Edit

Upwork Job URL: https://www.upwork.com/jobs/~021838751947628833125
Upwork Job ID:<PHONE_NUMBER>628833125
Last Price Increase: 2024-10-02

Issue OwnerCurrent Issue Owner: @Pujan92

@anmurali  I haven't added the External label as I wasn't 100% sure about this issue. Please take a look and add the label if you agree it's a bug and can be handled by external contributors

I will review this tomorrow.

@Pujan92 - This still needs your review, can you pls prioritize this?

Sorry for the delay @anmurali .
@anmurali I need your help to decide what behavior we need to proceed because as suggested in proposals there are different ways to solve this error flow.

As @nyomanjyotisa  & @mananjadhav suggested we can disable the send button in the Attachment modal.
As @dominictb suggested, on click of send attachment we should display the error modal.

Also adding an engineer for their input.
🎀👀🎀 C+ reviewed

@Pujan92 I think we should actually go with both @nyomanjyotisa's alternative solutions of disabling the "Add attachment" and "Send" buttons. It seems safer to disable them in both places in the UI.

Regression Test Steps

Open any report
Enter a text with more than 10k characters
Once the composer shows an error of length exceeded, click the + button to add an attachment
Verify that the add attachment option is disabled / send button of attachment modal is disabled

Payment Summary

[ ] @Pujan92 approved $250 via New Dot
[X] @nyomanjyotisa approved $250 via Upwork

$250 approved for @Pujan92