[M] DUP - Archive 2021-2022 Data

DUP is currently storing 100s of thousands of expired passes - this ticket is to "archive" these passes (from 2021-2022) so that it frees up some space in the system as well as improving security and privacy requirements
Acceptance Criteria

[ ] Write a script, Break this out by year (from December 2021), run for each year up to 2023.
[ ] Create automation thingy

Dev Notes

[ ] These passes should be moved to another (new) dynamodb table (archive).
[ ] Users of the admin system need to understand that pass-lookups will no longer work on those passes. If they still want that, we will need to add code/UI to be able to select 'archived' passes
[ ] The script should be able to be reused in following years when we need to archive additional passes

In sprint refinement, Sally indicates that Marshall is the one for us to check with. For data analysis, they use an exported file (for 2021 and all completed DUP years), so don't need it in the system for that.

@LindsayMacfarlane
I am just looking for clarification on when we want this to automatically run and what should be archived. Should I schedule it for January 1st and archive everything over 2 years old? eg: January 1st 2025 it will archive all passes created before January 1st 2023?

@manuji I have run this migration against the test DB so you are good to do you QA in test. I will be making a seperate PR for the automation part of this once we have done migration in PROD so that part of the ticket is not included in this FYI.

Best time to run scripts would be between seasons (November & April)
The data is already too different from our offline "source of truth" so I am ~mostly~ fine with it being archived as is. However, the winter data from the 2021 season used a secondary facility as a workaround (wasn't actually representative of how we would define a facility). It may make sense to reconcile that "P1 & Lower P1 (Weather Dependent)" data with the other data. Tangentially, it would be good to retire that facility from Prod.

@MarshallHenson  Just looking for confirmation on how far back to archive each year. When this runs in April 2025 should it archive all passes before April 2023 or another date?

Chris and I spoke on the phone briefly. No concerns with running it as a (current year - 2) biannual archive in Nov & April, based on the information that we are losing no granularity when archiving and that the data is still accessible via a developer request. @LindsayMacfarlane


donation missing from email reciept

The donation line is missing from emails when a donation is present.

issue resolved


Error : Loading Standard Stash Tab 1...

Hi
Procurement 1.9.7 Initialized.

Authenticating<EMAIL_ADDRESS>                                                    [OK]
Loading characters...                                                                     [OK]
Loading Standard Stash Tab 1...
[Error] Downloading stash for Standard, details logged to DebugInfo.log, please open a ticket at https://github.com/Stickymaddness/Procurement/issues
Help me please

same issue

already solved, everything perfect


Don't upload data for clone/pull

Downloads that are clone or pull shouldn't upload data.

Released in 2.1.0


Atom affects other programs' UIs on multiple desktops

I use MS Desktops (https://technet.microsoft.com/en-us/library/cc817881.aspx) on 64-bit Windows 7 and find that when Atom is running, when I bring other programs to the front, they don't always refresh completely, and I have to click again in the window or scroll the window to force a full refresh.
This seems to be a particular problem when using a desktop other than the default one, and when the programs are not running full-screen. I've had particular problems with the UI not updating in the Arduino IDE, but VS2010 and others also suffer from this.
The screenshot shows empty files in Atom and the Arduino UI. Atom was on top, then I clicked in the edit area in the Arduino IDE to bring it to the front and it drew as shown. Bringing the Arduino IDE to the front of other programs when Atom is not running never shows this problem.
Using Atom 1.0.4 on 64-but Windows 7.

cc @zcbenz

Refs https://github.com/atom/electron/issues/1821.

Using the VirtuaWin virtual desktop manager seems to solve the problem. MS Desktops starts up a new copy of explorer.exe for each desktop, and the programs run isolated within their own desktop environment. With VirtuaWin, all programs run within the same explorer.exe, and the manager handles which programs are displayed within each virtual desktop.
Could the different ways the two multiple desktop managers work be behind this problem?


Where can I find ../experiments/pretrained_models/MSRResNetx4.pth

Hello, I am prompted during training “["Errno 2] No such file or directory: '../experiments/pretrained_models/MSRResNetx4.pth'.”
"Where can I find this .pth file? Thank you."

https://github.com/xinntao/BasicSR/wiki/Model-Zoo

Thank you for your reply

Do we have to make any changes to the code while training from scratch? TIA.


Duplicated InternalResolutionError

At https://arethetypeswrong.github.io/?p=%40ice%2Fapp%403.2.6, problems[4] and problems[6] appear to be identical.

Why is this failing (vite-plugin-pwa)?

Vite has a lot of this problem https://github.com/vitejs/vite/issues/11552

I mean in the website here, a few weeks ago, checking vite-plugin-pwa using the site was working https://arethetypeswrong.github.io/?p=vite-plugin-pwa%400.16.4, with latest changes in the web in this repo it is failing.

InternalResolutionError was just added in #31 to fix #22. This tool is still under development and is learning to detect more kinds of problems 🙂


JP - Updates readme file

... according to the new SBT multi-module structure.
Please, @dialelo @raulraja could you review? Thanks!

LGTM


Not receiving messages over websocket

Hi there,
as I don't know where to ask questions if I did everything correct I thought I might as well simply file an issue. I installed the rabbitmq-websockets plugin as explained in the tutorial and tried out both the integrated web site and the site included in https://github.com/videlalvaro/rmq_ws_test. I was unsuccessful to receive any message through the websocket. The latter project event isn't able to connect although it seems I'm doing everything right.
In parallel to the websocket client I have both an instance of the python emit_log and receive_log publish subscribe programs running to verify the correct functioning of my setup. It works fine.
Also, I can't find any log messages in the standard rabbitmq log file.
Do you have any hints left for me on how to proceed?
Best regards,
Daniel

Perhaps something changed on the Erlang AMQP client. I haven't worked on this project for over half a year so I'm not sure. I'll take a look later.
Maybe you can take a look at this project from the RabbitMQ guys: http://www.rabbitmq.com/blog/2011/09/13/sockjs-websocket-emulation/


Key binding is taken by built-in command

Ctrl+Alt+B seems to be assigned to editor:move-to-previous-subword-boundary by default. Is there any way to choose one over the other?

I don't have that binding. Where does it come from?
You could set a keymap yourself, make sure it has the at least the same specificity as the built in. See https://discuss.atom.io/t/why-do-user-key-bindings-not-take-priority/11740

Same issue after updating to 1.0.8
http://i.imgur.com/UTK0p81.png
That said... none of the F5-F10 keys are taken.
For now ill try to map them to
Function	Shortcut Key
Build	Ctrl + F9
Compile current file	Ctrl + Shift + F9
Run	Ctrl + F10
Build and Run	F9
Rebuild	Ctrl + F11
Which is codeblocks default and doesn't conflict with any Atom core shortcuts.

It appears as by default, editor:move-to-previous-subword-boundary is set to alt-b (See https://github.com/atom/atom/blob/master/keymaps/linux.cson#L98)
Is there something other that might have rebound the keys for you? Since you both have the same issue, it's likely to be another package. Would you mind pasting your installed packages (apm list --installed) ?

Hmm, I think I found it. It appears to be because of https://github.com/atom/atom/blob/master/keymaps/emacs.cson#L9.
This change seems to have been made recently in atom/atom. I've opened an issue to see the developers take on this.


Tracking integration for unconditional-image-generation

Tracking integration of unconditional-image-generation
Note that you're not expected to do all of the following steps. This PR helps track all the steps required to get a new task fully supported in the Hub 🔥

[x] Integration with Inference API. Select at least one of the following:

[x] Added a diffusers pipeline
[x] Added to Community Inference API for 3rd party library
[x] Added to Community Inference API for generic

[ ] Added basic UI elements (icon, order specification, etc)
[x] Added a task page
[ ] Added a widget

Integration guide: https://hf.co/docs/hub/models-tasks

@osanseviero maybe a seed with slider or number would be appropriate as well. It would be confusing to put no input IMHO.


MLDB-1382 upgrade python deps

All python deps are upgraded to their latest version.
A few tweaks were required to match new behaviour.

+1


FR Mobile phone in 07 incorrect

Imported from Google Code issue #438 created by gael.delbos on 2014-03-19T11:07:34.000Z:

What steps will reproduce the problem?

Parse the following number : +33731234567 (using FR region)
Check phone validity

What is the expected output? What do you see instead?
I expect true, but got false.
What version of the product are you using?
libphonenumber 5.9
Please provide any additional information below.
See issue https://code.google.com/p/libphonenumber/issues/detail?id=391 for past exchange.
In the given answers, it was said that as no number existed for 73 and 74, the lib would not accept those number.
One of my coworkers check the ARCEP site (http://www.arcep.fr/index.php?id=interactivenumeros) for other number in 7X and found out that there were no reservation for 79.
My question is why does the lib accept 079 numbers but not 073 and 074?

Phone numbers starting with 07 are valid but only those starting 075 to 079 are available in France.
Gael, you mention ARCEP. On his website, it is clearly said that 075 to 079 are available : http://www.arcep.fr/?id=8146.

The issue has been discussed here : https://groups.google.com/forum/#!topic/libphonenumber-discuss/rjgoPh0PuCY
Let's close the issue.

@dlyongemallo see https://groups.google.com/forum/#!topic/libphonenumber-discuss/rjgoPh0PuCY (link from the latest comment above). I don't see a resolution in that libphonenumber-discuss thread. Has the change been rolled back?

My guess on these wrong number is they are misread 1s as 7s, could be wrongly OCRed pictures or human error. Why? Because in many examples given for these wrong number, it looked like it was for calling business such as pizzerias, which are probably using landlines not mobile.
So +33731234567 is probably more +33131234567

@andyst Yes. It has been fixed correctly in a subsequent release last year. The current metadata is correct.


Question - Could this be used as a programmer for ch32v003fun?

I was wondering, could this USB code be adapted to be used as a programmer for ch32v003fun (for programming another device)?
I know it would be a catch 22 situation, except since I've just bought 100 of these, I could make programmers for my friends.
I have some ESP32S2s so not an issue for me.

It totally could.  It's a bit tricky because both it and the USB subsystem requires very low latency control timing, but it is possible to do with DMA. It would be a fun project to get going.  But it would take learning a little bit about chaining GPIO DMA off of timers. I would love to help someone seek this if they wanted.

Thanks for your reply.
The chips haven't arrived and I have no experience with these yet.
I'd have a look myself if it were simple enough, but maybe its something someone else might be interested in?

It will take some effort, and a logic analyzer, but it should be tractable, I have a reference implementation here - you would need to figure out how to send 1's and a 0's reliably, as well as reading bits. https://github.com/cnlohr/esp32s2-cookbook/blob/master/ch32v003programmer/main/ch32v003_swio.h#L94-L182


chore: add issue template

For: #373 issue tmpl

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

ptal @Agility6

Thanks two of you.


Adding Temperature Converter

🛠 Fixes Issue (Number)
Closes #544
👨💻 Changes proposed
Added temperature conversion calculator between celsius and fahrenheit temperature metrics
✅ Check List (Check all the applicable boxes)

[x] My code doesn't break any part of the project (Zero Octave-Javascript-Projects).
[x] This PR does not contain plagiarized content.
[x] My Addition/Changes works properly and matches the overall repo pattern.
[x] The title of my pull request is a short description of the requested changes.

Add a screenshot of your working project

I have now added the sceenshots


Phase 2 double threads toggle option

Anything else needed for this toggle to make it into master? It should help plotting speeds on tmp constrained / high core count systems that are otherwise limited to only a single instance of the plotter (e.g. server plotting with tmpfs, etc).

yeah need to add a cmd line switch

recommend -m as it is effectively just a multiplier, and you might eventually expand on that if enabling adjustment of threads on other phases.

Looks like this branches off of master prior to pool puzzles, so anyone checking out this branch should be aware that it does not include -c option.


I18n error: ""

Environment

OS version: macOS
Elona Foobar verision: develop

Details

How to reproduce
Die by starving.

I think I fixed this in one of the many I18N PRs. I'll open a small PR for it.


fix typos in FullyQualifiedName

Good catch! I was worried that $namespace and $this->namespace would be rejected by PHP (as namesapce is a reserved keyword), but the tests show that it's ok.


vape crashes me when i use it on the survival game

so i execute vape v4 when i am in the survival game (with syn x) and i just get crashed after like 0.5 seconds when it gets loaded

syn v2 btw


Cleanup fixed FIXMEs

What
Remove FIXMEs that have been fixed to clean up code a bit.
How to review
Code review.
Who can review
not @mtekel

Can you put some context in the description of c0878c17f299318582587fd7d45ceee8b1de0365. E.g commit references?

LGTM now.


[WIP] Zero-Shot Multi-Speaker Tacotron2

Contribution in a nutshell
Hey, this could help our community work with zero-shot multi-speaker text-to-speech
Scope

[ ] Extending single-speaker Tacotron2 with speaker encoding capabilities to generate speech based on input text and speaker identity (embedding)
[ ] Tacotron2 loss function - additional component for speaker consistency

Thank you @pradnya-git-dev for submitting this PR! Your contribution is greatly appreciated as it adds a valuable feature to SpeechBrain. Below are my comments and suggestions:
Readme Updates:

Training Time and GPU Requirements: Please consider adding information in the README regarding the expected training time and GPU requirements for both Zero-Shot Multi-Speaker Tacotron2 and HiFi GAN (Vocoder). This information will be helpful for users who want to utilize these features efficiently.

Best Model in SpeechBrain HF Repo: It would be beneficial to place the current best model on the SpeechBrain Hugging Face (HF) repository and mark it as a work in progress. This will help pretraining in our future work. Additionally, please upload the current best model to the SpeechBrain Dropbox. For detailed instructions on this, please contact me privately.

Recipe Test Failures:

Test Failures: There are test failures in the recipe tests. Specifically, there's an issue with the LibriTTS recipe test, which is failing due to a KeyError ('LJ050-0131'). Please investigate and resolve this issue.

python -c 'from tests.utils.recipe_tests import run_recipe_tests; print("TEST FAILED!") if not(run_recipe_tests(filters_fields=["Dataset"], filters=[["LibriTTS"]], do_checks=True, run_opts="--device=cuda")) else print("TEST PASSED")'
ERROR: Error in LibriTTS_row_03 (recipes/LibriTTS/TTS/mstacotron2/hparams/train.yaml). Check tests/tmp/LibriTTS_row_03/stderr.txt and tests/tmp/LibriTTS_row_03/stdout.txt for more info.
TEST FAILED!
spk_emb = speaker_embeddings[raw_batch[idx]["uttid"]]
KeyError: 'LJ050-0131'

Script Redundancy:

Redundancy in Training Scripts: I'm curious why we need to redefine the training script for VoxCeleb/SpeakerRec (e.g., train_ecapa_tdnn_mel_spec.yaml and train_speaker_embeddings_mel_spec.py). If possible,  the best option would be of reusing the existing train_speaker_embeddings.py script with minor modifications. This can help reduce code duplication and maintenance efforts.

Code Optimization:

Minimize Code Redundancy: There might be a significant overlap between speechbrain/lobes/models/MSTacotron2.py and Tacotron2.py. If not already done, consider redefining in speechbrain/lobes/models/MSTacotron2.py only the classes that need to be modified for the injection of speaker embeddings. This approach will help us minimize code redundancy and maintain cleaner code.

Thank you @pradnya-git-dev for working on this PR! It is an important first step toward zero-shot TTS in SpeechBrain. The quality of the generated speech can be improved, but we will do that in a follow up PR.


Validate set in scheduled_tasks table

Go through table; do tasks exist? Last run outcome a failure? Unusual run time?


Create Ubuntu 16.04 AMI which supports Oracle and OpenJDK JDK 8,9,10 versions

Description:
Currently, we have a single AMI per each JDK version. This will be difficult to manage when the number of different OSes and OS versions and JDKs increase. Thus, need to explore the feasibility of creating a single Ubuntu 16.04 AMI which includes all the supported JDKs.
Related Issues:
#543

Created AMI ami-ef4d9492 for this purpose.

+1. This is the initial step towards this approach. I was also looking at packer. On the long run we need to explore a different option similar to that. Created #625 for tracking it.


Bower Failure with git:// protocol when behind a proxy server

I had this problem before and solved it, but it is BACK with a vengeance in the latest Bower 1.7.1.
Bower fails to download packages when it is behind a proxy.  This used to be solvable by putting a ".git/config" file in the folder with the following:
[url "https://"]
insteadOf = git://
This no longer works.  I was led to believe when I reported this previously that Bower was planning on fixing the issue.  But it has apparently not only NOT fixed it, but caused the previous workaround also to fail.
bower neon-elements#^1.0.0              ECMDERR Failed to execute "git ls-remote --tags --heads git://github.com/PolymerElements/neon-elements.git", exit code of #128 fa
tal: unable to connect to github.com: github.com[0: <IP_ADDRESS>]: errno=No error

Additional error details:
Additional error details:
fatal: unable to connect to github.com:
github.com[0: <IP_ADDRESS>]: errno=No error
user@USER /c/software/react/react-test-sites/polymer1 (master)

I've spent the last month in China and agree that this can be painful. Marked as enhancement as it's not a bug.
@bower/contributors to discuss whether this enhancement should be implemented, if so how, by whom, update labels etc.

it should probably work now. we've also changed all git:// urls to https:// in the registry

Thanks.  I updated to Bower 1.7.9 and ran a bower install behind a known proxy WITHOUT having to reconfigure a GIT config file to change the protocol.  I experienced no problems.
I am very happy that you decided to make this upgrade to Bower.


When i use c++ to link wasmtime library it prompts me such error on arm64

I tried changing the type of build c-api library to make it a static library.
sed -i '14c crate-type=["staticlib"]' crates/c-api/Cargo.toml

export CARGO_TARGET_AARCH64_UNKNOWN_LINUX_GNU_LINKER=aarch64-linux-gnu-gcc
export CC_aarch64_unknown_linux_gnu=aarch64-linux-gnu-gcc

cargo build --target aarch64-unknown-linux-gnu --release --manifest-path crates/c-api/Cargo.toml

When I use gcc -static static link all library，ld return the error
(.text+0x3c): relocation truncated to fit: R_AARCH64_LD64_GOTPAGE_LO15 against symbol `__environ' defined in .bss section in /usr/lib/gcc/aarch64-linux-gnu/10/../../../aarch64-linux-gnu/libc.a(environ.o)

When I used it, I was prompted for such an error. After my investigation, I found that it was caused by linking the wasmtime library. What is the reason for this and how can I fix it

This looks like a generic linker error which is related to a platform-specific limitation. This is probably related to your use of -static on the linker command line, and this may go away if such an option is removed. I don't personally have any experience building static glibc-based binaries but it may be the case that wasmtime is blowing some sort of size limit to prevent linking.
Otherwise though this issue generally doesn't look related to Wasmtime itself but rather just trying to link static Rust executables in general with glibc.

I see that the c-api in the release version is a dynamic link library. Can you provide a static library for the target platform? Or how to compile a library that can be statically linked. xthanks

This problem does not exist on x86_64 machines

My own personal experience of building static binaries with Rust for Linux systems only involves using musl, which is a target that we do not provide precompiled binaries for (and a few things don't work like trap backtraces I think). We do provide libwasmtime.a for the glibc target but I don't know whether it works to build into a static library. My guess would be no but I do not have any experience building static glibc binaries. If you're able to get it working though we could evaluate whether it makes sense to build artifacts for that as well.

Thank you so much

I solved this problem by switching from Debian distribution to fedora. Static linking no longer prompts this problem, but I don't know why. I guess it is caused by the fact that Glibc does not use the -mcmodel=large compile option on some distributions


nixos/dokuwiki: Overhaul for structured settings

Description of changes
This PR is a overhaul of the dokuwiki module towards the concepts laid out in RFC42. Structured settings can be passed via services.dokuwiki.sites.<name>.settings, .<name>.{aclUse,superUser,disableActions} have been deprecated accordingly. Both acl and pluginsConfig now also accept structured settings.
This is related to #209246 and #209253 as part of a larger touch-up of the DokuWiki module, package and tests.
Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[x] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
23.05 Release Notes (or backporting 22.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[x] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[x] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[x] Fits CONTRIBUTING.md.

Hello ! This PR looks really really nice, however it doesn't tackle all the problem we can encounter with the dokuwiki packaging for nixos. Especially the test don't load the css from the template (mainly iirc because the bootstrap template needs to source files from dokuwiki (there are some ../ imports somewhere in the source code of the template).
Steps to see it :
nix-build -A nixosTests.dokuwiki.driverInteractive
QEMU_NET_OPTS="hostfwd=tcp::8888-:80" ./result/bin/nixos-test-driver

Then start one vm in the repl (eg : èdokuwiki_nginx.start()) and browse <IP_ADDRESS>:8888` on your favorite web browser
It could be really nice if this PR also address this problem but I also understand that it is not trivial. When I thought to it several month ago I went into two possible solutions (with the help of @RaitoBezarius ) :

Creating a new derivation with everything packaged together (creating a withTemplate function that return the right derivation that vendors everything)
Patching the template to get the dokuwiki path at runtime through an environment variable (I believe this is quite dirty)

I also may find the motivation to do it now that the main refactoring work is done

Thanks for your feedback!

It could be really nice if this PR also address this problem but I also understand that it is not trivial. When I thought to it several month ago I went into two possible solutions (with the help of @RaitoBezarius ) :

Creating a new derivation with everything packaged together (creating a withTemplate function that return the right derivation that vendors everything)
Patching the template to get the dokuwiki path at runtime through an environment variable (I believe this is quite dirty)

I have implemented something comparable to your first proposal, but opted to make it a bite more flexible. Using dokuwiki.combine it is possible to pass templates and plugins (even tho in my prod deployment all plugins seem to work fine, but that way we can hopefully just prevent issues like these in the future). Without the basePackage, any previous overrides (e.g. dw_with_acronyms) would not get applied, causing the acronyms test to fail.
I am not sure wehter moving everything dokuwiki-building related into the package definition is correct, but having everything package-building-related in one place seemed sensible to me.

Somewhat unrelated since I initially forgot: Pinging @onny and @dali99 as module maintainers for a review.

Thanks for pinging and thank you for working on the Dokuwiki module :) The idea to put the options superuser, useacl into dokuwiki.settings option is a great cleanup :)
Unfortunately the PR seems really big with a lot of changes. Maybe we could split some things up into seperate PRs?
I even would split up the single commit nixos/dokuwiki: Overhaul for structured settings into separate PRs for easier review and to get changes faster merged:

Put change from mkDerivation to overrideAttrs into a separate PR
aclOpts addition into a separate PR
Changes to the examples for packaging themes and plugins into a separate PR

As I said, the changes are really cool :) Would really like to help review it

Only the nested configuration line tpl.mindthedark.autoDark fails. Not sure how to configure parameters like this with the new settings option.

Thanks for pointing that out, that was a small oversight. Is fixed now and the tests now also validate the nested config-generation.

Will the extraConfig option be dropped in the future or is it still required?

Looking at my deployment(s) I would not miss it. In theory one could have settings which e.h. change in regard to the users IP address. But with the config caching employed by Dokuwiki... Not sure how good this would actually work :thinking:
Unless anyone can come p (the more cursed the more interested I am in it) use case which is not covered with the ._raw helper (e.g. different templates based on Users IP-Address, however this would probably be broken by the config caching?) I'd be fine / in favor of also drop-deprecating this.

I need to rebase onto maser anyways, so I'll just throw those deprecation-warnings in while I'm at it.

Let's hope I didn't brick anything in between three rebases :sweat_smile:
Oh an one more thing, how would it be in terms of me becoming a co-maintainer of the module and/or tests? After having touched (what at least feels like) a very seizable portion of the module I'd be kinda interested in taking on some sort of "responsibility" (at least for my fresh bugs). I didn't find some process / documentation so I thought i would just ask ^^

Yeah would be nice, of course!

Result of nixpkgs-review pr 208299 run on x86_64-linux 1

1 test built:

nixosTests.dokuwiki

You could add yourself as a maintainer in a separate PR if you want :)


Add standard capture template

#19 gave me the idea to implement a standard org-capture template, this pull request implements it.

Does this work for you? I just get an org-capture buffer containing
* Invalid capture template


Disable list hyperlink for the currently selected assignment on the dashboard

The links in the list are used to switch between graph summaries. If the summary of one assignment is being displayed, the corresponding link in the list should be disabled.

I'll work on this.


New version: Kiwix.Wikivoyage.Electron version 2.7.6-E

[x] Have you signed the Contributor License Agreement?
[x] Have you checked that there aren't other open pull requests for the same manifest update/change?
[x] This PR only modifies one (1) manifest
[x] Have you validated your manifest locally with winget validate --manifest <path>?

[x] Does your manifest conform to the 1.5 schema?

Note: <path> is the name of the directory containing the manifest you're submitting.

Microsoft Reviewers: Open in CodeFlow

Automatic Validation ended with:

10/31/2023 12:21:56 PM
Installer Verification Analysis Context Information:
Installer https://github.com/kiwix/kiwix-js-pwa/releases/download/v2.7.6-Wikivoyage/Wikivoyage-by-Kiwix-Setup-2.7.6-E.exe
Scan request id: '00000000-0000-0000-0000-000000000000'

All packages are currently failing binary validation. Seems to be a misconfiguration at the winget end.

The all-zero Scan request GUID would seem to support this theory.

/AzurePipelines run


[DOC] Update archive page for v24.04.1 [skip ci]

Update v24.04.1 archive page for Databricks hot fix : “rapids private shim 341db build failure on Databricks 13.3”.
Download page is fixed in: https://github.com/NVIDIA/spark-rapids/pull/10780

build


verify_and_validate parameter ordering question

I'm using 2.0.0-rc2
I did not set any Joken config and my token module is:
defmodule MyApp.Token do
  use Joken.Config, default_signer: nil
end

I'm needing to dynamically pull the signer so I'm using this code to verify and validate
signer = Joken.Signer.create("HS256", dynamic_secret)
{:ok, claims} = MyApp.Token.verify_and_validate(token, signer)

The last line fails with {:error, :empty_signer}. The explicit signer example in the introduction seems to indicate that I can just do MyApp.Token.verify_and_validate(token, signer) but that doesn't seem to work.
I looked into it and saw that the parameter ordering of signer and context is reversed from the order in Joken.verify_and_validate. I don't know which way you want to go, but I wanted to call out the difference. When I changed the function call to MyApp.Token.verify_and_validate(token, %{}, signer) it worked fine. My opinion would be to swap the parameters to allow the example to work and bring it in line with Joken.verify_and_validate. If you would like, I can write up a quick pull request to reverse them.
Thanks!

Awesome! Thanks!
Yeah this was my bad. In Joken.verify_and_validate/5 the signer is the third parameter because we need the token config as the first. You are right. I'd appreciate a PR fixing this.
Just to guess are you using it with JWKS? Is that the reason of your dynamic signer? If it is so, I am awaiting for some more feedback to release 2.0 and then release this other library: https://github.com/victorolinasc/joken_jwks which uses a Joken.Hooks implementation to fetch the signer. I'm using it and it is working out nicely (still no release because hex don't allow me to depend on a rc version).

Thanks for your contribution!
Please, feel free to give us more feedback on the API and I hope joken_jwks works for you too!
We are thinking about creating an organization to collect projects there like joken, joken_jwks, joken_plug or phoenix and finally a joken_crypto to replace erlang-jose and benefit from a speed bump in the hot path using only built-in algorithm in OTP (like RS***, HS*** JWAs)
Cheers!


feat: run supersim anvil nodes in automine

#268  👈 (View in Graphite)
main

This stack of pull requests is managed by Graphite. Learn more about stacking.


Split up gaia main.yml

Fixes #120
I've tested this with inventory-local.yml, and after that completed successfully I tested the faucet by hand to make sure it could read balances. Let me know if other testing is needed.
Steps were copied into new files, but no meaningful modifications were made. At most the order of some of the steps was changed to align with the topic of each new file.

@dasanchez done.


Add Prisma js and MikroORM to Augur

https://github.com/mikro-orm/mikro-orm
https://github.com/prisma/prisma

closed as collection is complete


parameters in XML file comparison

Issue Type
Support
Source
binary
Tensorflow Version
1.15
Custom Code
No
OS Platform and Distribution
Windows 10
Mobile device
No response
Python version
3.7.9
Bazel version
No response
GCC/Compiler version
gcc (MinGW.org GCC-6.3.0-1) 6.3.0
CUDA/cuDNN version
10.0, V10.0.130
GPU model and memory
NVIDIA GeForce RTX 2060 6GB
Hello,
i am a bit unsure about the new xml file i created with a labelling tool. the first example is a tool that doesn't support object tracking, meaning you have to mark each object yourself. in the second example (i use) you can see that more parameters are added. now i wanted to know if there can be any problems with the creation of the tfrecord files?
the normal process is:
xml file -> csv file -> tfrecord
the following scripts are used for this:
https://github.com/EdjeElectronics/TensorFlow-Object-Detection-API-Tutorial-Train-Multiple-Objects-Windows-10/blob/master/xml_to_csv.py /
https://github.com/EdjeElectronics/TensorFlow-Object-Detection-API-Tutorial-Train-Multiple-Objects-Windows-10/blob/master/generate_tfrecord.py
are the parameters ignored by the python script and only read which are defined?
standard xml file:
<annotation>
	<folder>train</folder>
	<filename>IMG_2385.JPG</filename>
	<path>C:\tensorflow_cards\train\IMG_2385.JPG</path>
	<source>
		<database>Unknown</database>
	</source>
	<size>
		<width>378</width>
		<height>504</height>
		<depth>3</depth>
	</size>
	<segmented>0</segmented>
	<object>
		<name>king</name>
		<pose>Unspecified</pose>
		<truncated>0</truncated>
		<difficult>0</difficult>
		<bndbox>
			<xmin>92</xmin>
			<ymin>183</ymin>
			<xmax>223</xmax>
			<ymax>348</ymax>
		</bndbox>
	</object>
</annotation>

new xml file:

<annotation>
  <folder>image</folder>
  <filename>image_14.jpg</filename>
  <source>
    <database>Unknown</database>
    <annotation>Unknown</annotation>
    <image>Unknown</image>
  </source>
  <size>
    <width>720</width>
    <height>720</height>
    <depth></depth>
  </size>
  <segmented>0</segmented>
  <object>
    <name>person</name>
    <truncated>0</truncated>
    <occluded>0</occluded>
    <difficult>0</difficult>
    <bndbox>
      <xmin>281.22</xmin>
      <ymin>688.92</ymin>
      <xmax>323.7</xmax>
      <ymax>718.45</ymax>
    </bndbox>
    <attributes>
      <attribute>
        <name>rotation</name>
        <value>0.0</value>
      </attribute>
      <attribute>
        <name>track_id</name>
        <value>63</value>
      </attribute>
      <attribute>
        <name>keyframe</name>
        <value>True</value>
      </attribute>
    </attributes>
  </object>
</annotation>

@Petros626 TF v1.x is not actively supported. You are using TF v1.15, we recommend you to use TF v2.4 or later version and let us know if you face the issue in latest versions.
Thank you!

@Petros626 TF v1.x is not actively supported. You are using TF v1.15, we recommend you to use TF v2.4 or later version and let us know if you face the issue in latest versions. Thank you!

Yes I know, but I will use this version, because I use a model from the first model zoo. There was no case I was confronted with a problem, I only asking if I use this xml file if the two scripts not working with or the pasted params to the scripts will work.

@Petros626 Please go through this amazing example of converting an xml file to tfrecord file. This should give you a clear understanding. Thanks!


enhancement: add 2 improvements to local search

Improvements:

Add a new flag local_search.trigger. If set to manual, Search will be triggered by pressing enter key or search button; If set to auto,  Search will be triggered by changing input (It's the default behavior, but suffer from lagging when containing many posts in site).
Now results containing whole search text take precedence over other results, and articles containing more whole search texts take precedence over other articles. E.g., if you search "you can", results containing "you can" will be shown before results only containing "you" or "can".

@uchuhimo need to set not manual to default trigger. Manual and? And auto or what?

@uchuhimo nice and Good Job!

@uchuhimo find 1 little bug — esc key not working: https://github.com/iissnan/hexo-theme-next/commit/fa39fdaacb534976d2db294e3143e051810c3ca8

@ivan-nginx I'm a little confused. I cannot find this commit on master. I check the related issue, I find it is pushed into liszd/hexo-theme-next and habren/hexo-theme-next, but not iissnan/hexo-theme-next. What does it means? Is it a feature that will add to master in future? Do I miss anything?

This was add iissnan (esc key search box). I don't know why u cannot find it, try to this link.

@ivan-nginx I have tested it. Esc key will hide search panel, but never clean the search input and search result. Is it what you observe?

@uchuhimo yes, it is. I don't use this Esc key, but i remember what it was added and worked and for now it not worked. I think, need to add Esc key to your event listener:
          if ('auto' === '{{ theme.local_search.trigger }}') {
             input.addEventListener('input', inputEventFunction);
           } else {
             $('.search-icon').click(inputEventFunction);
             input.addEventListener('keypress', function (event) {
               if (event.keyCode === 13) {
                 inputEventFunction();
               }
             });
           }

@ivan-nginx I have fixed it, check https://github.com/iissnan/hexo-theme-next/pull/1621

@uchuhimo hi!
Look, there is 1 bug and 1 improvement for local search:

W3 validator give some errors: Attribute autocapitalize not allowed on element input at this point.

    <div class="local-search-input-wrapper">
      <input autocapitalize="off" autocomplete="off" autocorrect="off" placeholder="Поиск..." spellcheck="false" type="text" id="local-search-input">
    </div>

It is possible to do something like wait, search is now loading if i click on search and it's load for 5-10 seconds because there is big data in search.xml. Something like popup loading, anywhat.

@ivan-nginx

W3 validator give some errors: Attribute autocapitalize not allowed on element input at this point.

autocapitalize is a nonstandard attribute of input, only supported by Chrome and Safari. W3 validator also shows error "Attribute autocorrect not allowed on element input at this point." in my test, because autocorrect is a nonstandard attribute only supported by Safari.
Both of these attributes are introduced in https://github.com/iissnan/hexo-theme-next/commit/27eaf4664f5cf355afc1eacc83bb9494cf7f3ca6 by @Acris . I don't know the best practice to handle such a browser compatibility problem. Should I delete them? Or just leave them there because browser will ignore them if not support them?
Any idea? @ivan-nginx @Acris

@uchuhimo this attributs need in searchbox? For what need autocorrect or autocapitalize? If they not needed, need to delete (or comment) them, i think.

@ivan-nginx Both of these attributes are set to false, so I guess they are not needed. But I want to know why @Acris introduces them before reaching a conclusion.

@ivan-nginx

It is possible to do something like wait, search is now loading if i click on search and it's load for 5-10 seconds because there is big data in search.xml. Something like popup loading, anywhat.

I add a loading animation, please check https://github.com/iissnan/hexo-theme-next/pull/1633

@Acris what u say about bugs in W3?

Hi, this two attributes is only for mobile users, you can find more details on MDN: https://developer.mozilla.org/en-US/docs/Web/HTML/Element/input

@Acris and? Errors in W3 still present. Don't care about it? Need to do something, what u think?

Yes, because autocorrect is a Non-standard attribute . I think we can ignore this error, or, just delete this attribute.

@Acris ignore? I think we cannot ignor any errors. Acris, u not ignore 0.5 pixels in scroll to top, remeber it?) And now u offer to ignore W3 global errors? I dont't belive in this. Need to fix it by anyway.

Well, I'll fix it when I have time (maybe tomorrow).

@Acris ok ok, do not need hurry. But not need ignore this errors too. This is global errors wich are do affect on SEO. And SEO is holy. ;)

@ivan-nginx I've fixed it.

@Acris thank you!

@ivan-nginx Are u updated latest code?

@Acris update was from this patch: https://github.com/iissnan/hexo-theme-next/commit/43d37ff9edf9a18cc994de7548d3d3e41a36c7f5


docs: update development instructions for testing the examples

Actually, I had an error running react-native run-ios with the first example.
Should I open another issue about that @DylanVann ?

The development docs have been updated more recently than this so it doesn't seem needed. Thank you!


Cursor and controlling spotify

Awesome application.
I would appreciate for the cursor to still be visible when the application is open. In its current state it disappears when you hover over the window which can be kinda confusing.
Also, it would be cool if you could skip and pause songs from the within the Spotispy application itself.

I think adding a fadeout timer for the cursor youtube-style shouldn't be too difficult, I'll give it a shot when I have a bit more time.
As for the spotify controls, it would be really hard to make something that interfaces directly with spotify itself, since that would require your login information and a more in-depth use of the spotify API. What I can try, however, is having the app send multimedia playback commands back to the OS sort of like a keyboard, not sure if it'll be possible but worth looking into I guess, also when I get some more free time.


Programatically created polymer-elements do not get enteredView() called in JS

Originally opened as dart-lang/sdk#15523
This issue was originally filed by<EMAIL_ADDRESS>
What steps will reproduce the problem?

Create a polymer element with var el = document.createElement('my-element');
Add it with parent.append(el);
Compile the project with pub build

What is the expected output? What do you see instead?
In dartium, everything works as expected. However, when the code is compiled to Javascript, the programatically created element does not get its enteredView() method called
What version of the product are you using? On what operating system?
Dart VM version: <IP_ADDRESS>_r30188 (Tue Nov 12 01:22:15 2013) on "macos_x64"
polymer-0.9.1+1
Please provide any additional information below.
Enclosed is a small project that demonstrates this issue.

Attachment:
Polydemo_enteredViewBug.tgz (864.18 KB)

 Comment by sgjesse

Added Area-Polymer, Triaged labels.

 Comment by sigmundch

Added Library-Polymer label.

 Comment by jmesserly

Removed Area-Polymer label.
Added area-pkg, Pkg-Polymer labels.

 Comment by sethladd

See also https://groups.google.com/a/dartlang.org/forum/#!topic/web/hTQjRFpSG40

 Comment by jmesserly

Removed Library-Polymer label.

 Comment by sigmundch

This behavior is now more predictable, especially if you wait after Polymer.onReady before calling createElement. I re tested the example in polymer 0.11.0 and it seems to be working, yay!

Added Fixed label.


Update schema release to v0.1.2

What is the context of this PR?
Updates schemas to v1.0.2 including latest content updates and changes.
How to review
Ensure schemas are loaded correctly and work as expected.

Might be worth adding the PR titles to the original release notes on eq-questionnaire-schemas, the numbers don't give a lot away.


⚠ Fetchers has degraded performance

In 2c13f36, Fetchers ($STATUS_URL) experienced degraded performance:

HTTP code: 200
Response time: 275 ms

Resolved: Fetchers performance has improved in d258cbc.


The Xcode build process in mac.dart needs tests

See https://github.com/flutter/flutter/pull/26826
We need to test that method.  It may have been assumed that it was tested in devicelab tests that run flutter build ios and flutter run (for iOS), but those tests were somehow succeeding even though local runs of it failed.

It's tested somewhat already at a higher level with https://github.com/flutter/flutter/blob/3e6fe491f3689973f61f62ceba60908b6c03e14f/packages/flutter_tools/test/general.shard/ios/ios_device_start_nonprebuilt_test.dart
https://github.com/flutter/flutter/blob/3e6fe491f3689973f61f62ceba60908b6c03e14f/packages/flutter_tools/test/commands.shard/hermetic/build_ios_test.dart
but it could use more granular tests.


Fix sigKillProcessesAfterMillis not being set correctly from the constructor.

the ExecutorDataBuilder constructor is usually called when we want a builder out of a preexisting ExecutorData instance, and adding this extra arg should cause compile errors where people are using it -- is nobody actually using this constructor?

Is definitely a bug, but we may be able to just remove that constructor.


feat(client): extract module info from build info for use in 'User-Agent' header

This extracts the module info from the build info of a binary and uses the axiom-go module version in the User-Agent header.
I tested this manually, haven't figured out how to write a test for this. Tests are still part of this module, so it won't recoginze axiom-go as a dependency, even if imported.

Tried to come up with a test but my approach didn't work. Let's not go crazy on this. Tested it manually and it worked.


linux_testing_bcachefs: 4.16.2018.08.03 -> 4.18.2018.08.21

Motivation for this change
Fixes #45769
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[x] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[x] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[x] Fits CONTRIBUTING.md.

@GrahamcOfBorg build bcachefs-tools

No attempt on x86_64-darwin (full log)
The following builds were skipped because they don't evaluate on x86_64-darwin: bcachefs-tools
Partial log (click to expand)

a) For `nixos-rebuild` you can set
  { nixpkgs.config.allowUnsupportedSystem = true; }
in configuration.nix to override this.

b) For `nix-env`, `nix-build`, `nix-shell` or any other Nix command you can add
  { allowUnsupportedSystem = true; }
to ~/.config/nixpkgs/config.nix.

Success on aarch64-linux (full log)
Attempted: bcachefs-tools
Partial log (click to expand)
strip is /nix/store/y4ymnvgxygpq05h03kyzbj572zmh6zla-binutils-2.30/bin/strip
stripping (with command strip and flags -S) in /nix/store/jafq0fmslgvqihxp0dn6hrbfdyn8d1zp-bcachefs-tools-unstable-2018-08-22/sbin
patching script interpreter paths in /nix/store/jafq0fmslgvqihxp0dn6hrbfdyn8d1zp-bcachefs-tools-unstable-2018-08-22
/nix/store/jafq0fmslgvqihxp0dn6hrbfdyn8d1zp-bcachefs-tools-unstable-2018-08-22/etc/initramfs-tools/scripts/local-premount/bcachefs: interpreter directive changed from "/bin/sh" to "/nix/store/fqm2x6kiay1q4vg7pqp4wp17bdijlyc3-bash-4.4-p23/bin/sh"
/nix/store/jafq0fmslgvqihxp0dn6hrbfdyn8d1zp-bcachefs-tools-unstable-2018-08-22/etc/initramfs-tools/hooks/bcachefs: interpreter directive changed from "/bin/sh" to "/nix/store/fqm2x6kiay1q4vg7pqp4wp17bdijlyc3-bash-4.4-p23/bin/sh"
/nix/store/jafq0fmslgvqihxp0dn6hrbfdyn8d1zp-bcachefs-tools-unstable-2018-08-22/sbin/mkfs.bcachefs: interpreter directive changed from "/bin/sh" to "/nix/store/fqm2x6kiay1q4vg7pqp4wp17bdijlyc3-bash-4.4-p23/bin/sh"
/nix/store/jafq0fmslgvqihxp0dn6hrbfdyn8d1zp-bcachefs-tools-unstable-2018-08-22/sbin/fsck.bcachefs: interpreter directive changed from "/bin/sh" to "/nix/store/fqm2x6kiay1q4vg7pqp4wp17bdijlyc3-bash-4.4-p23/bin/sh"
checking for references to /build in /nix/store/jafq0fmslgvqihxp0dn6hrbfdyn8d1zp-bcachefs-tools-unstable-2018-08-22...
moving /nix/store/jafq0fmslgvqihxp0dn6hrbfdyn8d1zp-bcachefs-tools-unstable-2018-08-22/sbin/* to /nix/store/jafq0fmslgvqihxp0dn6hrbfdyn8d1zp-bcachefs-tools-unstable-2018-08-22/bin
/nix/store/jafq0fmslgvqihxp0dn6hrbfdyn8d1zp-bcachefs-tools-unstable-2018-08-22

Let's see if we can make it in time:
@GrahamcOfBorg build linux_testing_bcachefs

Success on x86_64-linux (full log)
Attempted: bcachefs-tools
Partial log (click to expand)
strip is /nix/store/h0lbngpv6ln56hjj59i6l77vxq25flbz-binutils-2.30/bin/strip
stripping (with command strip and flags -S) in /nix/store/sf6m7x3m4vr8x69rqz4vj65nx8xc85c0-bcachefs-tools-unstable-2018-08-22/sbin
patching script interpreter paths in /nix/store/sf6m7x3m4vr8x69rqz4vj65nx8xc85c0-bcachefs-tools-unstable-2018-08-22
/nix/store/sf6m7x3m4vr8x69rqz4vj65nx8xc85c0-bcachefs-tools-unstable-2018-08-22/etc/initramfs-tools/scripts/local-premount/bcachefs: interpreter directive changed from "/bin/sh" to "/nix/store/czx8vkrb9jdgjyz8qfksh10vrnqa723l-bash-4.4-p23/bin/sh"
/nix/store/sf6m7x3m4vr8x69rqz4vj65nx8xc85c0-bcachefs-tools-unstable-2018-08-22/etc/initramfs-tools/hooks/bcachefs: interpreter directive changed from "/bin/sh" to "/nix/store/czx8vkrb9jdgjyz8qfksh10vrnqa723l-bash-4.4-p23/bin/sh"
/nix/store/sf6m7x3m4vr8x69rqz4vj65nx8xc85c0-bcachefs-tools-unstable-2018-08-22/sbin/fsck.bcachefs: interpreter directive changed from "/bin/sh" to "/nix/store/czx8vkrb9jdgjyz8qfksh10vrnqa723l-bash-4.4-p23/bin/sh"
/nix/store/sf6m7x3m4vr8x69rqz4vj65nx8xc85c0-bcachefs-tools-unstable-2018-08-22/sbin/mkfs.bcachefs: interpreter directive changed from "/bin/sh" to "/nix/store/czx8vkrb9jdgjyz8qfksh10vrnqa723l-bash-4.4-p23/bin/sh"
checking for references to /build in /nix/store/sf6m7x3m4vr8x69rqz4vj65nx8xc85c0-bcachefs-tools-unstable-2018-08-22...
moving /nix/store/sf6m7x3m4vr8x69rqz4vj65nx8xc85c0-bcachefs-tools-unstable-2018-08-22/sbin/* to /nix/store/sf6m7x3m4vr8x69rqz4vj65nx8xc85c0-bcachefs-tools-unstable-2018-08-22/bin
/nix/store/sf6m7x3m4vr8x69rqz4vj65nx8xc85c0-bcachefs-tools-unstable-2018-08-22

No attempt on x86_64-darwin (full log)
The following builds were skipped because they don't evaluate on x86_64-darwin: linux_testing_bcachefs
Partial log (click to expand)
Cannot nix-instantiate `linux_testing_bcachefs' because:
error: while evaluating 'callPackageWith' at /private/var/lib/ofborg/builds/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-ndnd/lib/customisation.nix:108:35, called from /private/var/lib/ofborg/builds/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-ndnd/pkgs/top-level/all-packages.nix:14005:28:
while evaluating 'makeOverridable' at /private/var/lib/ofborg/builds/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-ndnd/lib/customisation.nix:67:24, called from /private/var/lib/ofborg/builds/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-ndnd/lib/customisation.nix:112:8:
while evaluating anonymous function at /private/var/lib/ofborg/builds/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-ndnd/pkgs/os-specific/linux/kernel/linux-testing-bcachefs.nix:1:1, called from /private/var/lib/ofborg/builds/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-ndnd/lib/customisation.nix:69:12:
while evaluating 'buildLinux' at /private/var/lib/ofborg/builds/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-ndnd/pkgs/top-level/all-packages.nix:14284:16, called from /private/var/lib/ofborg/builds/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-ndnd/pkgs/os-specific/linux/kernel/linux-testing-bcachefs.nix:3:1:
while evaluating 'callPackageWith' at /private/var/lib/ofborg/builds/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-ndnd/lib/customisation.nix:108:35, called from /private/var/lib/ofborg/builds/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-ndnd/pkgs/top-level/all-packages.nix:14284:23:
while evaluating 'makeOverridable' at /private/var/lib/ofborg/builds/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-ndnd/lib/customisation.nix:67:24, called from /private/var/lib/ofborg/builds/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-ndnd/lib/customisation.nix:112:8:
while evaluating anonymous function at /private/var/lib/ofborg/builds/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-ndnd/pkgs/os-specific/linux/kernel/generic.nix:1:1, called from /private/var/lib/ofborg/builds/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-ndnd/lib/customisation.nix:69:12:
assertion failed at /private/var/lib/ofborg/builds/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/grahamc-ndnd/pkgs/os-specific/linux/kernel/generic.nix:52:1

Failure on aarch64-linux (full log)
Attempted: linux_testing_bcachefs
Partial log (click to expand)
  CC [M]  drivers/gpu/drm/nouveau/nv84_fence.o
  CC [M]  drivers/gpu/drm/nouveau/nvc0_fence.o
  LD [M]  drivers/gpu/drm/nouveau/nouveau.o
  AR      drivers/gpu/drm/built-in.a
  AR      drivers/gpu/built-in.a
  AR      drivers/built-in.a
make[1]: *** [Makefile:146: sub-make] Error 2
make: *** [Makefile:24: __sub-make] Error 2
builder for '/nix/store/n4z5jwqy1cggpwrkzvfpv8knvlxyz3qp-linux-4.18.2018.08.21.drv' failed with exit code 2
error: build of '/nix/store/n4z5jwqy1cggpwrkzvfpv8knvlxyz3qp-linux-4.18.2018.08.21.drv' failed

@Chiiruno please disable aarch64 support for this kernel:
extraMeta.platforms = [ "x86_64-linux" ];

@Mic92 Done.

Well, the kernel builds on my x86_64-linux, but this is more about using it with the FS :-)

Timed out, unknown build status on x86_64-linux (full log)
Attempted: linux_testing_bcachefs
Partial log (click to expand)
  CC [M]  drivers/tty/synclinkmp.o
  CC [M]  drivers/scsi/qla2xxx/qla_mr.o
  CC [M]  drivers/usb/gadget/udc/dummy_hcd.o
  CC [M]  drivers/staging/rtl8192e/rtl8192e/rtl_pm.o
  CC [M]  drivers/staging/rtl8192e/rtl8192e/rtl_ps.o
  CC [M]  drivers/usb/gadget/udc/net2272.o
  CC [M]  drivers/scsi/qla2xxx/qla_nx2.o
  CC [M]  drivers/staging/rtl8192e/rtl8192e/rtl_wx.o
building of '/nix/store/b0w47fp0l4dg46v0fd6pjscz5ndfy9n9-linux-4.18.2018.08.21.drv' timed out after 1800 seconds
error: build of '/nix/store/b0w47fp0l4dg46v0fd6pjscz5ndfy9n9-linux-4.18.2018.08.21.drv' failed

Yes, for me too.
Does nix have a way to streamline filesystem tests in a VM?
Is the build bot overloaded right now by any chance?

It is not overloaded probably but there is a one hour limit, this is ok to fail. I can build locally.

We have tests for the installer and zfs in nixpkgs/nixos/tests. Bcachefs can be added as well.

For this merge I'm fine if the FS now works for you – you did test that, right?  PR with a reasonably written VM test would surely get merged, too.

@vcunat I only tested compilation and what was checked off in the OP.
I'm not savvy enough from nix vm to do that, unfortunately.
I have, however, tested bcachefs before, and it's worked, so I would assume this one does too, but (I hope) this probably means very little.

If you want a VM test, it'll have to wait until tomorrow, but chances are you could merge this now and it would be fine.

I currently cannot test this either.

The build also works on my machine.

Then I'd wait until someone runs the FS with this, on bare metal or VM.

My apologies, I stopped using bcachefs after I lost a lot of data, ironically due to the error this commit supposedly fixes. I'll see what I can do about tests, and at the very least I'll run this in a standard VM now that I have the chance. (Is there a way to easily add an empty disk to a nixos vm, though?)

@vcunat First time making a test, that was surprisingly easy.
Seems to work, this can be merged I think.

@Mic92 All good?


stellar-cli v22.0.1

kick off a new build, so it updates the stellar-cli version.
PS: I was going to make this an empty commit, but apparently there was a file that was not passing the linter, so I updated that.

Preview is available here:http://developers-pr1109.previews.kube001.services.stellar-ops.com


Secondary auto-reboot support

I've just realized (from @Raigi's report) that the aktualizr-auto-reboot recipe can simply be reused for secondary image and if it's in IMAGE_INSTALL_append used for both primary and secondary, it will also take effect on both images.
So maybe I'll just remove this variable and document that properly?

I've just realized (from @Raigi's report) that the aktualizr-auto-reboot recipe can simply be reused for secondary image and if it's in IMAGE_INSTALL_append used for both primary and secondary, it will also take effect on both images. And the corollary is that if both are used together, it creates conflict during file system creation.
So maybe I'll just remove this variable and document that properly?

I suppose, having a single way to configure an auto-reboot is more consistent, on the other hand it will require additional manipulations if the value of this parameter should be different on Primary and Secondary.

So maybe I'll just remove this variable and document that properly?

Yeah, that's probably best.

it will require additional manipulations if the value of this parameter should be different on Primary and Secondary.

True, but we already have that situations for plenty of other configuration variables. An annoying result of using the same build environment for bitbaking images for two different types of build targets.

@mike-sul that's correct.
Just note that if it needs to have different values and be configurable from a single local.conf/site.conf, aktualizr-auto-reboot probably can't be used as is and we'd need to also define a similar variable for the primary image.
But I think that users will generally want to use the same value for both primary and secondary. If they need more flexibility, they can also selectively add aktualizr-auto-reboot to their different images.
I also have the feeling that having many variables to define in local.conf is unidiomatic yocto (for better or worse), compared to using recipes and bbappends.

poky broke today: https://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=8efa405ee0ab9ae0e674fe8bc9551f4367b4c269. There is a fix in master-next, hoping it will come soon.

Did something change in the way image is run in master? I am not able to provision a device anymore when running:
/home/user/meta-updater/scripts/run-qemu-ota --no-gui  --dir /home/user/virtual_master/build/tmp/deploy/images/ --machine qemux86-64 --secondary-network primary-image
I was able to provision a device with the same command from zeus branch.

@Raigi what's the error?

Did something change in the way image is run in master?

You wouldn't be trying to provision a Primary that is expecting a Secondary without launching the Secondary, would you? Otherwise, the networking logic in the test images for Primaries and Secondaries did slightly change a few weeks ago, but we backported that to all the supported release branches. When I manually launch a primary-image and secondary-image, I'm having trouble getting them to talk to each other, but I've gotten it to work at least once.

Summary of discussion with Raigi:
Both of us can get the Primary and Secondary to start talking and successfully provision only if we stop the systemd services and manually restart them. For some reason, they will not connect without doing that, and in my experience, even that isn't always successful. Raigi reports seeing this with this branch and on meta-updater master but none of the release branches. She's reproduced it with OTF and manually. I've reviewed the recent meta-updater CI runs, and while most of them failed for various reasons over the past few days, the Secondary tests always succeeded.
What could be different between OTF and the meta-updater CI? Almost nothing has been merged to master that wasn't already backported to the release branches. @mike-sul and @lbonn can you think of anything that might have changed in other layers or anything else that might be thwarting this?

. Raigi reports seeing this with this branch and on meta-updater master but none of the release branches.

So, can I try the master branch of meta-updater to reproduce it?

. Raigi reports seeing this with this branch and on meta-updater master but none of the release branches.

So, can I try the master branch of meta-updater to reproduce it?

Yes, I saw the same issue there

. Raigi reports seeing this with this branch and on meta-updater master but none of the release branches.

So, can I try the master branch of meta-updater to reproduce it?

Yes, I saw the same issue there
I am on this meta-updater commit in master: 32b5e19b768530f21a0f17db73fb49562d024618

Just did the following on 32b5e19b768530f21a0f17db73fb49562d024618
repo sync
bitbake primary-image
bitbake secondary-image
-- no any primary nor secondary specific parameters are defined in local.conf --
../meta-updater/scripts/run-qemu-ota --no-gui --secondary-network secondary-image
../meta-updater/scripts/run-qemu-ota --no-gui --secondary-network primary-image
The result is successful
`
Mar 09 10:05:08 qemux86-64 aktualizr[225]: Adding Secondary with ECU serial: aad737dafb40f018a65eaa810a04f596a7c02ffaa0a711532d1aaaca78546238 with hardware ID: qemux86-64-sndry
Mar 09 10:05:09 qemux86-64 aktualizr[225]: Provisioned successfully on Device Gateway.
Mar 09 10:05:09 qemux86-64 aktualizr[225]: ECUs have been successfully registered with the server.
Mar 09 10:05:09 qemux86-64 aktualizr[225]: Primary ECU serial: dba4d3cbbdf8820b7b87b01c7bc9297bfcf030fc47d0cd40b6aaec603ba163d2 with hardware ID: qemux86-64
Mar 09 10:05:09 qemux86-64 aktualizr[225]: Device ID: flaky-biersuppe-956
`

@mike-sul It seems that if you start the Primary first your chances of success are much lower.

@mike-sul It seems that if you start the Primary first your chances of success are much lower.

Good catch. I've been starting primary first, then secondary, same for OTF.

@mike-sul It seems that if you start the Primary first your chances of success are much lower.

@patrickvacek Good catch. I've been starting primary first, then secondary, same for OTF.

Just tried a few times and it still works
`
Mar 09 10:50:20 qemux86-64 aktualizr[227]: Found IP secondaries config: (wait_port: 9040 timeout_s: 240)
Mar 09 10:50:20 qemux86-64 aktualizr[227]:    found IP secondary config: (addr: <IP_ADDRESS>:9050)
Mar 09 10:50:20 qemux86-64 aktualizr[227]: Creating IP secondaries...
Mar 09 10:50:20 qemux86-64 aktualizr[227]: Connecting to and getting info about IP Secondary: <IP_ADDRESS>:9050...
Mar 09 10:50:23 qemux86-64 aktualizr[227]: Failed to connect to a secondary: No route to host
Mar 09 10:50:23 qemux86-64 aktualizr[227]: Waiting for connection from 1 secondaries...
Mar 09 10:50:57 qemux86-64 aktualizr[227]: Accepted connection from a secondary: (<IP_ADDRESS>:9050)
Mar 09 10:50:57 qemux86-64 aktualizr[227]: Got info on IP Secondary: hw-ID: qemux86-64-sndry serial: ce06baa87de48aeadba8a6086696051a738451e23291303789a5aaa8d990562b
Mar 09 10:50:57 qemux86-64 aktualizr[227]: Adding Secondary with ECU serial: ce06baa87de48aeadba8a6086696051a738451e23291303789a5aaa8d990562b with hardware ID: qemux86-64-sndry
Mar 09 10:50:57 qemux86-64 aktualizr[227]: Provisioned successfully on Device Gateway.
`

@Raigi Could you please add the following info here

zero level logs of both Primary and Secondary
toml config of both Primary and Secondary
the json config of Secondaries on Primary
output of ip a for both Primary and Secondary

@Raigi Could you please add the following info here
1. zero level logs of both Primary and Secondary

primary_0.txt
secondary_0.txt

2. toml config of both Primary and Secondary

Which toml you mean exactly?

3. the json config of Secondaries on Primary

"primary-config-1.0-r0 do_install: SOTA_SECONDARY_CONFIG hasn't been specified in the local config, generate a default one" - where does this get saved to?

4. output of `ip a` for both Primary and Secondary

primary
root@qemux86-64:/sysroot/home/root# ip a 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue qlen 1000     link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00     inet <IP_ADDRESS>/8 scope host lo        valid_lft forever preferred_lft forever     inet6 ::1/128 scope host         valid_lft forever preferred_lft forever 2: enp0s3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast qlen 1000     link/ether ca:fe:c9:70:70:77 brd ff:ff:ff:ff:ff:ff     inet <IP_ADDRESS>/24 brd <IP_ADDRESS> scope global dynamic enp0s3        valid_lft 85914sec preferred_lft 85914sec     inet6 fec0::c8fe:c9ff:fe70:7077/64 scope site dynamic         valid_lft 86187sec preferred_lft 14187sec     inet6 fe80::c8fe:c9ff:fe70:7077/64 scope link         valid_lft forever preferred_lft forever 3: enp0s5: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast qlen 1000     link/ether ca:fe:05:06:89:84 brd ff:ff:ff:ff:ff:ff     inet <IP_ADDRESS>/24 brd <IP_ADDRESS> scope global enp0s5        valid_lft forever preferred_lft forever     inet6 fe80::c8fe:5ff:fe06:8984/64 scope link         valid_lft forever preferred_lft forever 4: sit0@NONE: <NOARP> mtu 1480 qdisc noop qlen 1000     link/sit <IP_ADDRESS> brd <IP_ADDRESS>
secondary
root@qemux86-64:/sysroot/home/root# ip a 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue qlen 1000     link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00     inet <IP_ADDRESS>/8 scope host lo        valid_lft forever preferred_lft forever     inet6 ::1/128 scope host         valid_lft forever preferred_lft forever 2: enp0s3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast qlen 1000     link/ether ca:fe:6b:3e:10:a9 brd ff:ff:ff:ff:ff:ff     inet <IP_ADDRESS>/24 brd <IP_ADDRESS> scope global dynamic enp0s3        valid_lft 85922sec preferred_lft 85922sec     inet6 fec0::c8fe:6bff:fe3e:10a9/64 scope site dynamic         valid_lft 86234sec preferred_lft 14234sec     inet6 fe80::c8fe:6bff:fe3e:10a9/64 scope link         valid_lft forever preferred_lft forever 3: enp0s5: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast qlen 1000     link/ether ca:fe:53:e2:ef:44 brd ff:ff:ff:ff:ff:ff     inet <IP_ADDRESS>/24 brd <IP_ADDRESS> scope global enp0s5        valid_lft forever preferred_lft forever     inet6 fe80::c8fe:53ff:fee2:ef44/64 scope link         valid_lft forever preferred_lft forever 4: sit0@NONE: <NOARP> mtu 1480 qdisc noop qlen 1000     link/sit <IP_ADDRESS> brd <IP_ADDRESS>

The following error message on Primary means that something is listening on 9040 port on Primary
Creating IP secondaries... Failed to initialize a secondary: bind: Address already in use

Without changing anything, my devices started to provision. It takes quite a while though.
-- Logs begin at Mon 2020-03-09 12:44:17 UTC, end at Mon 2020-03-09 12:45:58 UTC. -- Mar 09 12:44:18 qemux86-64 systemd[1]: Started Aktualizr SOTA Client.  Mar 09 12:44:18 qemux86-64 aktualizr[239]: Connecting to and getting info about IP Secondary: <IP_ADDRESS>:9050... Mar 09 12:45:44 qemux86-64 aktualizr[239]: Failed to connect to a secondary: Connection refused Mar 09 12:45:44 qemux86-64 aktualizr[239]: Waiting for connection from 1 secondaries... Mar 09 12:45:44 qemux86-64 aktualizr[239]: Accepted connection from a secondary: (<IP_ADDRESS>:9050) Mar 09 12:45:44 qemux86-64 aktualizr[239]: Got info on IP Secondary: hw-ID: qemux86-64-sndry serial: 025161204b0d6994aae4af1e13e04387c845cae2e44d300e87e148567acb3615 Mar 09 12:45:44 qemux86-64 aktualizr[239]: Adding Secondary with ECU serial: 025161204b0d6994aae4af1e13e04387c845cae2e44d300e87e148567acb3615 with hardware ID: qemux86-64-sndry Mar 09 12:45:45 qemux86-64 aktualizr[239]: Provisioned successfully on Device Gateway Mar 09 12:45:45 qemux86-64 aktualizr[239]: ECUs have been successfully registered to the server.  It takes quite a while though.
journalctl_aktualizr.txt
Next device creation took veery long.
journalct_aktualizr_long.txt

According to the "long" logs it looks like it has to do with networking in general, I have a few theories but it would be great to learn how to reproduce it.
@patrickvacek can you reproduce it on bagger?

It appears that Raigi's problems are not dependent upon this PR, so I vote to merge this now and work on solving her problems separately.

This one not, but now there are new problems. :D
Having IMAGE_INSTALL_append = " aktualizr-auto-reboot " in local.conf does not seem to have effect on secondary.

@patrickvacek can you reproduce it on bagger?

Yes, that is where I was seeing it this morning.

That's "interesting" that the primary also reboots. It also happened to me during a test today but not the last time I've tried last week...

Will update after https://github.com/advancedtelematic/aktualizr/pull/1594 is (hopefully) merged

This time, only the secondary should reboot.

This time, only the secondary should reboot.

Just to confirm that devices got provisioned,
installing an update on secondary rebooted only secondary.

Does it still take lots of time to provision a device?

Does it still take lots of time to provision a device?

yes, it does

@mike-sul I think these connection problems might also be connected to the failures in test_ip_secondary I'm seeing in ptest (see https://main.gitlab.in.here.com/olp/edge/ota/connect/client/meta-updater/-/jobs/1913879 for example). I'd like to see if the basic retries or whatever we do to improve this make a difference for that as well.

@mike-sul I think these connection problems might also be connected to the failures in test_ip_secondary I'm seeing in ptest (see https://main.gitlab.in.here.com/olp/edge/ota/connect/client/meta-updater/-/jobs/1913879 for example). I'd like to see if the basic retries or whatever we do to improve this make a difference for that as well.

It looks like the issue here https://main.gitlab.in.here.com/olp/edge/ota/connect/client/meta-updater/-/jobs/1913879 is different from the one reported in this PR. In this PR we have the issue with the initial discovery/connection of Primary and Secondary during a device provisioning phase  while in that test Primary cannot get a manifest from Secondary that has been updated and is supposed to be rebooted (or reboot emulated in this case).

It looks like the issue here https://main.gitlab.in.here.com/olp/edge/ota/connect/client/meta-updater/-/jobs/1913879 is different from the one reported in this PR. In this PR we have the issue with the initial discovery/connection of Primary and Secondary during a device provisioning phase while in that test Primary cannot get a manifest from Secondary that has been updated and is supposed to be rebooted (or reboot emulated in this case).

Agreed, but I'm wondering if the problem in that CI run is due to similar connectivity problems after rebooting the Secondary. It could be something with the reboot process instead, though.

It looks like the issue here https://main.gitlab.in.here.com/olp/edge/ota/connect/client/meta-updater/-/jobs/1913879 is different from the one reported in this PR. In this PR we have the issue with the initial discovery/connection of Primary and Secondary during a device provisioning phase while in that test Primary cannot get a manifest from Secondary that has been updated and is supposed to be rebooted (or reboot emulated in this case).

Agreed, but I'm wondering if the problem in that CI run is due to similar connectivity problems after rebooting the Secondary. It could be something with the reboot process instead, though.

Yeah, I think something has changed in the networking or maybe Laurent actually fixed a bug in the IP secondary's logic that tries to connect to Primary at its startup. In the case of localhost/<IP_ADDRESS> connect() call should return almost immediately if nothing listens on the destination port if it's not a localhost then IP Secondary gets stuck at this stage (TCP connection at TCP/IP stack level) for some times (around > 20 sec). In the test we just run Secondary process and do not wait until IP Secondary is ready to server requests instead we just run Aktualizr process and the secondary actually connects to Primary but the following getManifest() call from Primary to Secondary fails which means that Secondary was not ready to serve/listen socket at the call time...
Anyway, I think, I know how we can fix/improve the test but in general, as I stated a few times the current approach of Primary and Secondary discovery is error-prone...


Fix Wrong implementation of u_t(x|z) in Brownian Bridge

fixes #595 and changes the naming

Thanks @selmanozleyen ! I think you need to fix the tests as well to comply with your new variable names

Ok, I made the changes, it should be ready review @michalk8  @marcocuturi

thanks @selmanozleyen :) the preferred way to ping for review is to use the tool up there, in the right, to assign reviewers :)


Spatial lite

Hi there
There is anyway to use Spatialite spatial functions in sql pane?
I have tried with select "fid, st_astext(GEOMETRY) as geom from table;"
but I have the following error message "SQL Error [1]: [SQLITE_ERROR] SQL error or missing database (no such function: st_astext)".
Do you know a way Spatialite extension can be added or recognized by Dbeaver? I'm using Windows 10

As far as I know standard SQLite doesn't support it. However if you keep geometry data in WKT/WKB format then you can see it on map.
Right click on the geometry column->Column View->Set format->Geometry.

Thanks four your answer.
Spatialite is a kind of Sqlite add-on; something similar to spatial extensions for postgres, etc. /wiki/SpatiaLite-on-Windows)
BD Browser for Sqlite supports it:
Spatialite. (https://github.com/fulcrumapp/spatialite-bin, https://github.com/sqlitebrowser/sqlitebrowser
Even GepPackage. https://www.fulcrumapp.com/blog/working-with-geodata/
I don't know if some body has some experiences using Spatialite in Dbeaver.

@serge-rider  st_astext work perfectly but it's not an slite base same has postgresql you need load spatialite module.
http://www.gaia-gis.it/spatialite-2.4.0-4/spatialite-sql-2.4-4.html#p3


Mutation events and Performance

This is not so much a bug, but an opportunity to make lazysizes even better.
Currently 2 mutation event types are being used DOMNodeInserted and DOMAttrModified. It's now recommended to move to using using Mutation Observers instead which are async. More info here: https://developer.mozilla.org/en-US/docs/Web/Guide/Events/Mutation_events

@jaxuk
MutationObserver is already in use. Mutation events are only used as a fallback for IE10.

Ahh ok... I should have looked deeper into the code. It was picked up by scanning with dareboost.com


[main] Use openshift-knative/hack/cmd/generate for generating Dockerfiles

What this PR does / why we need it:
This is a variant of https://github.com/openshift-knative/serving/pull/832 for "main" branch.
Should be merged only after pull/832 is approved.
Which issue(s) this PR fixes:
JIRA: https://issues.redhat.com/browse/SRVKS-1265
Does this PR needs for other branches:

Does this PR (patch) needs to update/drop in the future?:

JIRA:

/hold
For https://github.com/openshift-knative/serving/pull/832 to be approved.

/unhold

@mgencur what is the diff compared to https://github.com/openshift-knative/serving/pull/832 should I test against release-next?

I am going to merge test PR passes.

Test PR passes I will merge.

/lgtm


Updated dependency, removed executable flags

Some housekeeping, does not compile with serde 0.4 which was updated to 0.5

Needs a rebase, but looks good, thanks!

Hm, this appears to have picked up some commits accidentally.

We can now move on serde 0.8 and serde_macros 0.8


Add indication that editing panel can be resized

Currently, you can resize the editing panel in order to see more of the form. This is extremely helpful especially in blueprints like personality quiz and flowchart where there are multiple columns of inputs in a small sidebar.
However, there is no indication that users can resize this panel. We should design an indication that makes this interaction clear to users.

I agree, but wasn't sure how to indicate. Maybe some sort of handle? Let me know what you'd like to add.

This should be good to go on prod.

Lgtm.


IT-1909: Add NLPSandbox VPC to TGW

This PR adds the NLPSandbox VPC to TGW and gives access to mebers of the aws-nlpsandbox-admins JC groiup.

@zaro0508 Just wanted to validate the approach to modifying the stack in NLPSandbox infra to use ssm manager in my comment above.

This account is not needed anymore.


If passing radius to geofirestore.collection, getting empty docs in response.

If passing radius to geofirestore.collection, getting empty docs in response whereas if passing radius 0 getting all
this.geofirestore = new GeoFirestore(this.firestore)        this.query = this.geofirestore.collection("PassengerLocationDb").near({ center: new         firebase.firestore.GeoPoint(35.17506145581017,<PHONE_NUMBER>4244256), radius: 5 })         this.query.onSnapshot((docs) => {             docs.forEach(doc => {                 console.log(doc.data());             })         })

Data and documents near to be structured in a special way in order to make queries. I'd recommend reading the thread in issue #81 to understand, but keeping it simple docs need to be created by geofirestore in order to be queried by geofirestore.


Default to Today's Date When No Date is Provided for New Transactions

Currently, when adding a new transaction using the add command, users must specify a date. To simplify the workflow and improve usability, the CLI should automatically use today's date if no date is explicitly provided.
Proposed Features

Check if a date is provided in the add command input.
If no date is specified, default to the current system date.
Optionally, provide a confirmation message or log indicating that today's date was applied.

Potential Benefits

Reduces the need for manual input, streamlining the process of adding transactions.
Minimizes errors caused by forgetting to specify a date.
Improves overall user experience by handling common use cases automatically.

Released with version v0.0.12


java.lang.Error

My app is reporting this error.
I have a lot of values but only in this case the problem occur.
Could someone help me? Thsnks.
java.lang.Error:
  at com.marcinmoskala.kotlinpreferences.PreferenceHolder$Companion.getPreferencesOrThrowError$preferenceholder_release (PreferenceHolder.kt:86)
  at com.marcinmoskala.kotlinpreferences.bindings.PreferenceFieldBinder.readValue (PreferenceFieldBinder.kt:39)
  at com.marcinmoskala.kotlinpreferences.bindings.PreferenceFieldBinder.getValue (PreferenceFieldBinder.kt:22)
  at com.marcinmoskala.kotlinpreferences.bindings.PreferenceFieldBinder.getValue (PreferenceFieldBinder.kt:12)
  at app.package.utils.helpers.ApplicationPreference.getHomeGridElements (PreferencesHelper.kt)
  at app.package.modules.home.HomeFragment.onCreate (HomeFragment.kt:62)
  at android.support.v4.app.Fragment.performCreate (Fragment.java:2328)
  at android.support.v4.app.FragmentManagerImpl.moveToState (FragmentManager.java:1379)
  at android.support.v4.app.FragmentTransition.addToFirstInLastOut (FragmentTransition.java:1188)
  at android.support.v4.app.FragmentTransition.calculateFragments (FragmentTransition.java:1071)
  at android.support.v4.app.FragmentTransition.startTransitions (FragmentTransition.java:115)
  at android.support.v4.app.FragmentManagerImpl.executeOpsTogether (FragmentManager.java:2379)
  at android.support.v4.app.FragmentManagerImpl.removeRedundantOperationsAndExecute (FragmentManager.java:2337)
  at android.support.v4.app.FragmentManagerImpl.execPendingActions (FragmentManager.java:2244)
  at android.support.v4.app.FragmentManagerImpl.dispatchStateChange (FragmentManager.java:3255)
  at android.support.v4.app.FragmentManagerImpl.dispatchActivityCreated (FragmentManager.java:3205)
  at android.support.v4.app.FragmentController.dispatchActivityCreated (FragmentController.java:195)
  at android.support.v4.app.FragmentActivity.onStart (FragmentActivity.java:597)
  at android.support.v7.app.AppCompatActivity.onStart (AppCompatActivity.java:177)
  at app.package.modules.base.BaseActivity.onStart (BaseActivity.kt:25)
  at android.app.Instrumentation.callActivityOnStart (Instrumentation.java:1270)
  at android.app.Activity.performStart (Activity.java:6689)
  at android.app.ActivityThread.performLaunchActivity (ActivityThread.java:2622)
  at android.app.ActivityThread.handleLaunchActivity (ActivityThread.java:2724)
  at android.app.ActivityThread.-wrap12 (ActivityThread.java)
  at android.app.ActivityThread$H.handleMessage (ActivityThread.java:1473)
  at android.os.Handler.dispatchMessage (Handler.java:102)
  at android.os.Looper.loop (Looper.java:154)
  at android.app.ActivityThread.main (ActivityThread.java:6123)
  at java.lang.reflect.Method.invoke (Native Method)
  at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run (ZygoteInit.java:867)
  at com.android.internal.os.ZygoteInit.main (ZygoteInit.java:757)

PreferenceHelper.kt:
object ApplicationPreference : PreferenceHolder() {
    var homeGridElements: Int by bindToPreferenceField(2)
}

HomeFragment.kt
override fun onCreate(savedInstanceState: Bundle?) {
        super.onCreate(savedInstanceState)
       ...
        gridItemDecoration = GridSpacingItemDecoration(ApplicationPreference.homeGridElements, getActivityContext()?.resources?.getDimensionPixelSize(R.dimen.dm_grid_margin) ?: 0, false)
    }

Are you sure that you've set context before this usage? Like this:
PreferenceHolder.setContext(applicationContext)

A good place is on Application onCreate. Because this error looks like lack of preferences set (although it is wired that message that explains that is not displayed)

Yes, I'm sure.
My Application class starts others libs like Realm and Fabric the same way.
I've been running the app in production by more than 30 days. The error was reported by Playstore 5k times in this period and 99,6% of them occour with Android 7.0, others 0,4% with 7.1 an 8.0. There't reports for Android version below 7.0.
I think that issue has some rlation with the signature mode used to build the APK in the fist versions. I was building with Android Stuidio -> Build Signed APK assistant and using only V1 Signature version.
In my last build I changed the compilation mode to use the new APK Signature Scheme v2 - https://developer.android.com/about/versions/nougat/android-7.0.html#apk_signature_v2 -  This build have been running in production by 5 days and the error did not occour anymore.

That's strange. This subject needs to be investigated.


Azure B2C sample not working when i change it away from root context

Environment

Spring boot starter:

azure-active-directory-b2c-spring-boot-starter

OS Type: Windows

Java version:

1.8

Summary
Was able to get the application working. However, just at the root context. When i try to change the context to /aadb2c/, it fails. It redirects to the login page when i click the sign-in lnk but when i login it just keeps redirecting back to the login page at http://localhost:8080/aadb2c/login.
I saw the note about clearing the cookies. I created a new registration and restarted my computer and cleared the cookies and tried multiple browsers. Still loops back to the login page everytime. If i switch the app back to the root context it will work.
Reproduce steps

go to http://localhost:8080/aadb2c/
redirects to http://localhost:8080/aadb2c/login
I click the signin workflow link and takes me to azure b2c login
enter my credendials at azure b2c login, which signs me in to app
After successful sign-in, redirected to http://localhost:8080/aadb2c/home

Expected Results
After successful sign-in, redirected to http://localhost:8080/aadb2c/home
Actual Results

After successful sign-in, redirected to http://localhost:8080/aadb2c/login
clck the sign-in workflow link again and just keeps bring me to http://localhost:8080/aadb2c/login

Hi Xoryan, can you give me your application.yml in your sample? I will try it later to seek the problem.

Files are uploaded.
application.yml - the version where i have tried to change the context root from the base
application-basecontext-working.yml - the working one where the context root is "/"
context-issue.zip

Can confirm, same issue. With default context, i.e. /, the ?state=qxuvshEj6qMevGaVqYFrai7oALo0V58gkKuoJMOWexg%3d&code=eyJra[...]uQ is processed and the user is signed-in. Once I change my config to server.servlet.context-path=/gateway the very same ?state= request fails by not being processed and the user is redirected to /gateway/login as he/she is not authenticated

Log extract with /gateway as context path set
2019-09-04 16:43:44.218 DEBUG 25952 --- [nio-8080-exec-6] o.s.security.web.FilterChainProxy        : /?state=qZJv[...]d&code=ey[...]OfA at position 15 of 15 in additional filter chain; firing Filter: 'FilterSecurityInterceptor'
2019-09-04 16:43:44.218 DEBUG 25952 --- [nio-8080-exec-6] o.s.s.w.u.matcher.AntPathRequestMatcher  : Checking match of request : '/'; against '/prepare-login'
2019-09-04 16:43:44.218 DEBUG 25952 --- [nio-8080-exec-6] o.s.s.w.a.i.FilterSecurityInterceptor    : Secure object: FilterInvocation: URL: /?state=qZJv[...]d&code=ey[...]OfA; Attributes: [authenticated]
2019-09-04 16:43:44.218 DEBUG 25952 --- [nio-8080-exec-6] o.s.s.w.a.i.FilterSecurityInterceptor    : Previously Authenticated: org.springframework.security.authentication.AnonymousAuthenticationToken@5eafd380: Principal: anonymousUser; Credentials: [PROTECTED]; Authenticated: true; Details: org.springframework.security.web.authentication.WebAuthenticationDetails@fffd3270: RemoteIpAddress: 0:0:0:0:0:0:0:1; SessionId: 54CB5A2D21B8DC418255F722FE1E91E7; Granted Authorities: ROLE_ANONYMOUS
2019-09-04 16:43:44.218 DEBUG 25952 --- [nio-8080-exec-6] o.s.s.access.vote.AffirmativeBased       : Voter: org.springframework.security.web.access.expression.WebExpressionVoter@7683679, returned: -1
2019-09-04 16:43:44.218 DEBUG 25952 --- [nio-8080-exec-6] o.s.b.a.audit.listener.AuditListener     : AuditEvent [timestamp=2019-09-04T14:43:44.218138900Z, principal=anonymousUser, type=AUTHORIZATION_FAILURE, data={details=org.springframework.security.web.authentication.WebAuthenticationDetails@fffd3270: RemoteIpAddress: 0:0:0:0:0:0:0:1; SessionId: 54CB5A2D21B8DC418255F722FE1E91E7, type=org.springframework.security.access.AccessDeniedException, message=Access is denied}]
2019-09-04 16:43:44.219 DEBUG 25952 --- [nio-8080-exec-6] o.s.s.w.a.ExceptionTranslationFilter     : Access is denied (user is anonymous); redirecting to authentication entry point

Note: it reaches the end of the filter chain (first line) without matching any of the filters
Log extract with / as context path set
2019-09-04 17:15:55.971 DEBUG 20020 --- [nio-8080-exec-1] o.s.security.web.FilterChainProxy        : /?state=fv[...]5Q_4%3d&code=eys[...]RA at position 7 of 15 in additional filter chain; firing Filter: 'OAuth2LoginAuthenticationFilter'
2019-09-04 17:15:55.971 DEBUG 20020 --- [nio-8080-exec-1] o.s.s.w.u.matcher.AntPathRequestMatcher  : Checking match of request : '/'; against '/'
2019-09-04 17:15:55.971 DEBUG 20020 --- [nio-8080-exec-1] .s.o.c.w.OAuth2LoginAuthenticationFilter : Request is to process authentication
2019-09-04 17:15:55.977 DEBUG 20020 --- [nio-8080-exec-1] o.s.s.authentication.ProviderManager     : Authentication attempt using org.springframework.security.oauth2.client.authentication.OAuth2LoginAuthenticationProvider
2019-09-04 17:15:55.977 DEBUG 20020 --- [nio-8080-exec-1] o.s.s.authentication.ProviderManager     : Authentication attempt using org.springframework.security.oauth2.client.oidc.authentication.OidcAuthorizationCodeAuthenticationProvider
2019-09-04 17:15:55.980 DEBUG 20020 --- [nio-8080-exec-1] o.s.web.client.RestTemplate              : HTTP POST https://oc[...]l.b2clogin.com/oc[...]l.onmicrosoft.com/oauth2/v2.0/token?p=B2C_1_[...]]LOGIN_FLOW
2019-09-04 17:15:55.980 DEBUG 20020 --- [nio-8080-exec-1] o.s.web.client.RestTemplate              : Accept=[application/json, application/*+json]
2019-09-04 17:15:55.980 DEBUG 20020 --- [nio-8080-exec-1] o.s.web.client.RestTemplate              : Writing [{grant_type=[authorization_code], code=[eys[...]RA], redirect_uri=[http://localhost:8080/], client_id=[...], client_secret=[...]}] as "application/x-www-form-urlencoded;charset=UTF-8"

Note: The 7th filter matches and registers the user as authenticated.
Going to investigate further and comment, if I find anything

I think I found a workaround and maybe it helps identifying the root cause? Not even sure this is an issue with the Azure AD B2C Spring Boot library to be honest or if my thinking is correct.
    @Configuration
    public class OpenIdConnectConfig extends WebSecurityConfigurerAdapter {

        private final AADB2COidcLoginConfigurer configurer;

        @Autowired
        public OpenIdConnectConfig(AADB2COidcLoginConfigurer configurer) {
            this.configurer = configurer;
        }

        protected void configure(HttpSecurity http) throws Exception {
            // @formatter:off
            http
                .authorizeRequests()
                    // ...
                .and()
                    .apply(configurer)
                .and()
                    .oauth2Login()
                    .redirectionEndpoint()
                      .baseUri("/")  // <-- this seems to resolve the issue, at least for me.
            ;
            // @formatter:on
        }
    }

The idea to set the redirection endpoint's base URI to / is based on the following two log entries I've got in the failing condition (context path set to /gateway):
2019-09-04 17:26:31.372 DEBUG 9732 --- [nio-8080-exec-7] o.s.security.web.FilterChainProxy        : /?state=Yz[...]A%3d&code=ey[...]mCw at position 7 of 15 in additional filter chain; firing Filter: 'OAuth2LoginAuthenticationFilter'
2019-09-04 17:26:31.372 DEBUG 9732 --- [nio-8080-exec-7] o.s.s.w.u.matcher.AntPathRequestMatcher  : Checking match of request : '/'; against '/gateway/'

The original request requested /gateway/?state=[...]&code=[...]. The built-in servlet container removes /gateway as this is the servlet's context path, resulting in a request for /?state=[...]&code=[...] that is checked against all registered filter chains. However, at this point OAuth2LoginAuthenticationFilter is still expecting requests for the /gateway path. So, I just changed that expectation to / by setting the redirection endpoint base URI to /.

I tried the above workaround and it didn't work for me. I will wait for the sample and its readme to be updated with option for changing the context root from "/". below is the changes i made to the WebSecurityConfiguration.java file.
    @Override     protected void configure(HttpSecurity http) throws Exception {         http                 .authorizeRequests()                 	.anyRequest()                 	.authenticated()                 .and()                 	.apply(configurer)                	                 .and() // Added the below to try to fix the context root problem.                 	.oauth2Login()                 	.redirectionEndpoint()                 	.baseUri("/")  // <-- this seems to resolve the issue, at least for me.         ;     }

Hi neuqlz, I am wondering if there is an update on this. Have you had a chance to investigate?
Regards,

Hi Xoryan, sorry for the late reply, cause I am busy with other works, I haven't investigated it yet. Once I finish my current works, I will get started. Sorry for the inconvenience.

thanks for the update!

I think if you use the default configuration where the reply-url is "/webContext/home" then in order to apply groggi's solution your code should be changed to:
.oauth2Login() .redirectionEndpoint() .baseUri("/home")

I just tested and It is working. Thanks for the help.


[release/3.1] Unable to use 3.1.113 to build 3.1.114

Trying to use a previously-built 3.1.113 to build the latest 3.1.114 fails:
  [19:26:33.72] Building reference-only assemblies.
  /home/omajid/fedora-git/dotnet3.1/dotnet-v3.1.114-SDK/packages/source-built/coreclr-tools/x64/ilasm /home/omajid/fedora-git/dotnet3.1/dotnet-v3.1.114-SDK/packages/reference/source/microsoft.aspnetcore.app.ref/3.1.10/ref/netcoreapp3.1/Microsoft.AspNetCore.Antiforgery.il -dll -quiet -nologo -output=/home/omajid/fedora-git/dotnet3.1/dotnet-v3.1.114-SDK/packages/reference/staging/microsoft.aspnetcore.app.ref/3.1.10/ref/netcoreapp3.1/Microsoft.AspNetCore.Antiforgery.dll
  /tmp/tmp92b6e7b52a6643f6bf66cad56dc8fdca.exec.cmd: line 2: /home/omajid/fedora-git/dotnet3.1/dotnet-v3.1.114-SDK/packages/source-built/coreclr-tools/x64/ilasm: No such file or directory
/home/omajid/fedora-git/dotnet3.1/dotnet-v3.1.114-SDK/tools-local/init-build.proj(122,5): error MSB3073: The command "/home/omajid/fedora-git/dotnet3.1/dotnet-v3.1.114-SDK/packages/source-built/coreclr-tools/x64/ilasm /home/omajid/fedora-git/dotnet3.1/dotnet-v3.1.114-SDK/packages/reference/source/microsoft.aspnetcore.app.ref/3.1.10/ref/netcoreapp3.1/Microsoft.AspNetCore.Antiforgery.il -dll -quiet -nologo -output=/home/omajid/fedora-git/dotnet3.1/dotnet-v3.1.114-SDK/packages/reference/staging/microsoft.aspnetcore.app.ref/3.1.10/ref/netcoreapp3.1/Microsoft.AspNetCore.Antiforgery.dll" exited with code 127.

Like the error says source-built/coreclr-tools/x64/ilasm doesn't exist, but source-built/coreclr-tools/ilasm does.

FWIW it also fails when bootstrapping with the official 3.1.114 SDK from Microsoft on Arch Linux. Also tried 3.1.112 and 3.1.113 official distributions, is there any SDK where source-built/coreclr-tools/x64/ilasm actually exists?

Actually, it complains about ildasm here, but for the same reasons. I'll just patch Directory.Build.props.

[Triage]:  Not worth fixing anymore as we will be able to use the previous to build the current going forward.  This was an oversite.
Fix is to use a local patch to get to the current version.


Allow phase to be live, and require a phase

This also makes phase default to 'live' when not given because that's generally correct.
This PR is the implementation of alphagov/govuk-content-schemas#114

Added a migration to populate the phase for existing items.