SnowPlow logs not working

Hello. Our team use SnowPlow analytics for Android application.
In last release (1.7.1) logs are not working, we can not see them in LogCat in Android Studio. We used SnowPlow version 1.3.3 before and on that version logs were visible.
What's the reason of this behavior? Maybe there are any special new flags for logging now?

Hello @DmitrievaAlisa!
I recommend you to use our forums for troublshooting. Our discourse is community-driven and you'll hit a much broader audience there, while we keep our GitHub tracker for  bugreports and feature requests only.


Add test cases to improve coverage of IterImpl::readStringSlowPath()

Add 8 test cases that improve coverage of the function readStringSlowPath in IterImpl.java to almost 100% (only two exceptions not coverred)
This should resolve #61

Codecov Report

Merging #65 into lab3 will increase coverage by 0.34%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##             lab3      #65      +/-   ##
==========================================
+ Coverage   69.03%   69.37%   +0.34%
==========================================
  Files         107      107
  Lines        7334     7334
  Branches     1388     1388
==========================================
+ Hits         5063     5088      +25
+ Misses       1834     1815      -19
+ Partials      437      431       -6

Impacted Files
Coverage Δ

...c/main/java/com/jsoniter/IterImplForStreaming.java
77.56% <0%> (+1.08%)
:arrow_up:

src/main/java/com/jsoniter/IterImpl.java
73.08% <0%> (+6.97%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0ac4492...c515b3f. Read the comment docs.


Colorized Depth?

Given your github project page, I saw the output has DSM, Depth, and color Depth but after training, I couldn't find colored depth map but only greyscale map, did you just processed the result image for visualization?

We only provide the raw depth (single value, so similar to a grayscale image). You can use whatever colormap you want to present the results (viridis in the case of the github project page).


Error trying to pull binary secret from AWS Secrets Manager

Using kubernetes-external-secrets v6.4.0
The feature seems to be implemented in version 6.1.0
Error message:
"Failed to JSON.parse value for 'test-binary-secret', please verify that your secret value is correctly formatted as JSON."}

Secret when pulled from AWS Secrets Manager with AWS CLI (the values are redacted for security)
{
    "ARN": "arn:aws:secretsmanager:us-west-2:REDACTED",
    "Name": "test-binary-secret",
    "VersionId": "REDACTED",
    "SecretBinary": "BASE64ENCODEDVALUE",
    "VersionStages": [
        "AWSCURRENT"
    ],
    "CreatedDate": "2021-07-27T17:09:06.066000-07:00"
}

externalsecret.yaml
apiVersion: kubernetes-client.io/v1
kind: ExternalSecret
metadata:
  name: test-binary-secret
  namespace: pub
spec:
  backendType: secretsManager
  dataFrom:
    - cluster-name/test-binary-secret

Resolved by updating externalsecret.yaml to
apiVersion: kubernetes-client.io/v1
kind: ExternalSecret
metadata:
  name: test-binary-secret
  namespace: pub
spec:
  backendType: secretsManager
  data:
    - key: cluster-name/test-binary-secret
      name: test-binary-secret


Documentation for iarange

http://docs.pyro.ai/primitives.html#pyro.__init__.iarange
I had trouble understanding this documentation. Seems to be written for a maintainer as it refers to several things that are not in the docs: context manager, traces, etc.

Thanks for pointing this out, this is definitely too obtuse for a user-facing construct.  We should fix the docstring and possibly write a tutorial about subsampling as requested by #67 .

it may be worth pointing out that all of this is discussed in the second svi tutorial. (at least from a user's perspective). which isn't to say the discussion couldn't be improved.

Yeah, tutorial is helpful, but ideally the docs shouldn't require it.


Bump Dependencies #6851763249

Bumps dependencies for product-is. Link : https://github.com/wso2/product-is/actions/runs/6851763249

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.jenkins-is-staging seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


Usage of this package with custom storefront

Hi! We're currently creating a Shopify integration with our custom backend which is written in NodeJS with NestJS (using ts). We're looking for a good package that can help us integrate the Shopify API into our application. So in short; we want to create our own API that exposes parts of the Shopify API. We will make this whole integration ourselves and everything should obviously sync with Shopify.
Upon our investigation we came across this package, but we did have some questions. Would someone mind answering them?

Are we forced to use sessions? If so; how does this affect our current app?
The documentation states that a session driver isn't mandatory, however the Typescript types do.
Is this package actually meant to be used the way we want to use it?
Can we solely use this package to expose the Shopify API?

Thanks in advance.

Hi @rauldeheer
If you're thinking of using only the Shopify Storefront API, I'm afraid this package will not help in that regard. There's no integrated way of exposing the Storefront API. As you noticed yourself, the package even forces you to provide sessions as it was created to solely use with Shopify Admin API.
If you see any chance to tweak a few things to support the Storefront API in @nestjs-shopify/graphql, without having to alter too many things in @nestjs-shopify/core, I would be very much open to PRs and/or pointers 🙂


Fix CNI route handling

Fixes #141

This change is

Reviewed 5 of 5 files at r1.
Review status: all files reviewed at latest revision, all discussions resolved.

Comments from Reviewable


Question about "bundling" capnp

I was curious about this idea in the readme:

NOTE: At some point in the future the capnpc-ts package may build the capnpc binary as a native dependency, making this step somewhat unnecessary.

Given that serialisation / rpc protocols are often used to talk across technology stacks I suspect that most users of this would (at least eventually) need to have a capnp setup independent of the stuff we're providing here. Therefore I think it's a bit odd/niche to provide such a utility.
Are any other languages / compiler plugins doing such things?
What are the motivations for doing this?

Funny, I was just mulling over what this would look like recently.
I was primarily thinking about beginner JS folk who don't understand what a C++ is or how to install packages; but truth be told it would be difficult for them to use a library like this regardless (especially at this stage, for sure).
I'm going to drop it from the README.


Sparkle Launcher

This issue breaks out point 1 from #16 into its own issue.
The Sparkle Launcher should have these properties:

[x] Is a single smallish window
[x] Can be opened through Pharo's World menu
[x] Allow specification of login parameters (more on that below)
[x] Provide login/logout
[x] Upon login, open a default explorer window
[x] Can open additional default explorer windows if logged in
Only one session at a time will be needed for now.

What is needed for session parameters will change as we develop more options for security. Options initially needed:

[x] Local-image connection (for debugging)
[x] Host and port of socket connection

Pull request submitted for integration into development.
A menu option should appear in the Tools menu called Sparkle Launcher
Only single connection supported currently.
SpkLauncherPresenter class>>connection is the access point to the connection once established.
SparkleLauncher is the application class.
Closing the launcher closes all explorers as well as the connection.
Last Host / port entered retained for convenience


Setting up carla with unreal engine 4.26 on Linux, the git clone link for unreal engine not working. it requires username for github which :Support for password authentication was removed on August 13, 2021. And when I try to use the ssh link to clone it says: ERROR: Repository not found. fatal: Could not read from remote repository.  Please make sure you have the correct access rights and the repository exists.

I have solved this issue with a personal access token. You can generate it and then use it as a password in this case.

@Bo-Yu-Columbia Have you linked github account with unreal engine account. use - https://www.unrealengine.com/en-US/ue-on-github

yes i have

I was running into the same issue just a minute ago. I got the same error messages both for following the tutorial and using my ssh-key.
However, it is possible to clone unreal engine using your ssh-key. The mistake I made that lead to the same error (Please make sure you have the correct access rights and the repository exists.) was pressing enter to the following question: "Are you sure you want to continue connecting (yes/no/[fingerprint])?". After following the instructions by typing 'yes', the package cloned perfectly without any issues.
So it is possible that you have made the same mistake and that the workaround would be just typing 'yes' to the question.


[Bug][Script] Remove deprecated arg in remove-zk-node.sh

Purpose of the pull request

UseFastAccessorMethods has been deprecated since JDK 9 and may cause remove-zk-node.sh failure.
This PR closes: #10787

Brief change log

Remove UseFastAccessorMethods arg in script remove-zk-node.sh.

Verify this pull request

Verified by manual test.

Could anyone help with the review? Thx~


Suggestion: Organize imports: separate commands for removing unused and re-ordering

Search Terms

organise imports remove unused
Suggestion
The new Organize imports command combines two ideas:

remove unused imports
re-order imports

For users like myself who only wish to either remove unused imports or re-order them, TypeScript could instead provide separate commands for these.
Use Cases
We are already using another tool to sort our imports according to a custom format.
Therefore running the current Organize imports command breaks our custom ordering.
If we had a command just for removing unused imports, we could use that instead.
Examples

Checklist
My suggestion meets these guidelines:
[x] This wouldn't be a breaking change in existing TypeScript / JavaScript code
[x] This wouldn't change the runtime behavior of existing JavaScript code
[x] This could be implemented without emitting different JS based on the types of the expressions
[x] This isn't a runtime feature (e.g. new expression-level syntax)

In fact this is already impossible in VSCode:


Add demo video image and text link #88

The README.md file now contains the demo video link information. This closes #88.
:ballot_box_with_check: Definition of Done checklist

[x] Meaningful title and valuable description in pull request
[x] Code change tested manually if not covered by automated tests
[x] Pull request linked to one or more issues/stories
[x] Acceptance criteria of the linked stories satisfied
[x] Code change comprehended by those who approved it
[x] State of target branch maintained or improved after the code change

@sh4r10 No sorry, do this instead.

***

Awesome vid :+1:


Add support for S3 accelerate

Allow to support Amazon S3 Transfer Acceleration, this will fallback to AWS_REGION when provided with the s3 accelerate domain.

This LGTM, thanks for adding it.


Added a note/workaround to UnableToAddPublisher

This workaround has worked for a lot of customers and should be noted within the error message documentation.
Links:
https://docs.microsoft.com/en-us/answers/questions/763235/index.html
https://docs.microsoft.com/en-us/answers/questions/446540/index.html
https://github.com/MicrosoftDocs/azure-docs/issues/62877

GitHub Issue: https://github.com/MicrosoftDocs/azure-docs/issues/90069
cc: @rwike77

@JamesTran-MSFT : Thanks for your contribution! The author(s) have been notified to review your proposed change.

@JamesTran-MSFT : Thanks for your contribution! The author(s) have been notified to review your proposed change.

#sign-off per https://github.com/MicrosoftDocs/azure-docs/issues/62877

@MarileeTurscak-MSFT: I'm sorry - only the author of this article, @rwike77, can sign off on your changes. But we do have an exception process - if you are on the Microsoft content or product team for this product area, you can ask the PR review team to review and merge it by sending mail to the techdocprs alias.

Yeah, that sounds fine.  Thanks for making the update.  #sign-off

#sign-off

@JamesTran-MSFT: I'm sorry - only the author of this article, @rwike77, can sign off on your changes. But we do have an exception process - if you are on the Microsoft content or product team for this product area, you can ask the PR review team to review and merge it by sending mail to the techdocprs alias.

#sign-off


Not able to subscribe

Not able to subscibe topic with 3 forward slashes in it. e.g /user/topic/recnnect

Hi, Please let me know about your server environment. What message broker you are using?


Notebook does not scroll when dragging a cell

Does this issue occur when all extensions are disabled?: Yes/No

VS Code Version: 1.70.0-insider Commit: e0a65a97d4f349cf11a7cae804a5553ccb412528
OS Version: MacOS 12.4

Steps to Reproduce:

Open the Titanic.ipynb notebook located at https://github.com/claudiaregio/data-science.
Drag a cell in the middle of the notebook either up or down.
Notice that the notebook does not scroll when dragging.

https://user-images.githubusercontent.com/686963/179248794-fce34332-2a7e-4e39-b24b-91fb12568f33.mp4

This has been the case for a while apparently.
@mjbvz I think you have made some editor dnd changes in the past couple months, could that have affected this? We rely on normal listView dnd behavior for the scrolling.

Thanks @mjbvz!


Compare performance with UFC vs UFC_NB

Let's see if the flow control protocol influences performance for server writes

run performance tests please
cs

Hi @danberindei It is in progress the PR that will support this kind of change
https://github.com/radargun/radargun/pull/584/files
/cc @alanfx
I am going to cancel your request. Once we have the code merged. I will run the regression tests.
Sorry for the inconvenience.


(MODULES-2799) Build custom types

Updating the build to support building custom types
again.

It doesn't pick up my custom added type for some reason.
Here's how I went about it. The custom changes and instructions above.
Added cWindowsOS

From a Windows box - install-module cWindowsOS (it's not a type we build, it does have some mof files).
Copy that off to a temp location that you can reach from non-Windows (for me that is ~/code/temp/dsc_custom_resources).
Prep the repo for building
Run bundle exec rake dsc:build
Run bundle exec rake dsc:resources:import["~/code/temp/dsc_custom_resources"]
Run bundle exec rake dsc:types:build

The type shows up in the vendored folder but it doesn't appear to be getting built into custom types yet. This is where I need to pick up and evaluate.

@Iristyle @jpogran this is ready.

Actually one small change to readme.

Okay this is ready.

And one more change to the readme.

We have testing this by using it to validate that #151 can deal with non vendored resources, and running it in a VM to see that it builds the path to the manifest file correctly.

Travis CI issue looks unrelated but something we should fix.

This is holding on #153


Display asset timeout in Asset Detail view

Take it from service.timeout. Could be part of #202 but also could be done right now already

all defined in #202

all defined in #202


Home page branch

Add header

Add nav
Add header
Correct linter and eslint errors
Add keyframes to CSS
Link about page to home page
Link home page to about page
Aligned footer

Add the right background images
Changed font color
Corrected linter errors
Made a new loom video
Deployed my code.


I'm getting this every time I open a createserver connection between my nodes

I do not have the neccesary know-how to debug this issue, its possibly because of writing an empty string.
using the following wip object to test this:
https://gist.github.com/lanmower/fb32a656e3dfc6eb55aa1d5a048b2ad5

@mafintosh Thanks it seems fine after the last fix :)


Distinguish the number of notes from the number of todo's

Feature request from https://discourse.joplinapp.org/t/plugin-macos-theme-for-joplin/18934/105

Hi @andrejilderda
May I make two suggestions?
When counting items in a notebook, it would be very useful to be able to distinguish the number of notes from the number of todo.
It would also be very useful if the title of a notebook could be adapted to the size of the column.
Thanks for this very nice light theme!

Both are impossible to add via the plugin api.


mkpr

Applied mkpr on package.json
sed s/"@kronos-integration\/service": "^.*"/"@kronos-integration\/service": "^8.3.9"/

Codecov Report

Merging #737 into master will not change coverage.
The diff coverage is n/a.

@@          Coverage Diff          @@
##           master   #737   +/-   ##
=====================================
  Coverage     100%   100%
=====================================
  Files           3      3
  Lines          68     68
  Branches       13     13
=====================================
  Hits           68     68

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 42f2567...614c3a7. Read the comment docs.

:tada: This PR is included in version 2.0.2 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


builder for '/nix/store/.../...-hg-archive.drv' failed

Describe the bug
After upgrading to the latest nixos-unstable, I get:
abort: HTTP Error 404: Not Found
builder for '/nix/store/hnba9816829ka9n42ylqjgacnirfl2gc-hg-archive.drv' failed with exit code 255
cannot build derivation '/nix/store/0crv5jqipjq4a0b04g7d2rivadr4p6f0-emacs-openwith-20120531.2136.drv': 1 dependencies couldn't be built

Metadata

system: "x86_64-linux"
host os: Linux 5.4.28, NixOS, 20.09pre218482.3320a06049f (Nightingale)
multi-user?: yes
sandbox: yes
version: nix-env (Nix) 2.3.3
channels(philipp): ""
channels(root): ""
nixpkgs: /nix/store/lcr3p8f33ksljpzmdk2x06m0ak95bah4-source

Maintainer information:
# a list of nixpkgs attributes affected by the problem
attribute:
# a list of nixos modules affected by the problem
module:

Steps to reproduce
nix-build . -A emacsPackages.openwith

affects release-20.03 as well

This has nothing to do with Emacs, it's a fetchhg thing.

Fixed on unstable.


Use Octicons in Code Lenses

For #7192. This also adds a missing space and splits out the four cases to be consistent with the status bar: https://github.com/microsoft/vscode-python/blob/b0e89947d0b3cf9ad04b78ecc5a840e365ab6516/src/client/testing/display/main.ts#L84-L99

[x] Pull request represents a single change (i.e. not fixing disparate/unrelated things in a single PR)
[x] Title summarizes what is changing
[x] Has a news entry file (remember to thank yourself!)
[x] ~Appropriate comments and documentation strings in the code~
[x] ~Has sufficient logging.~
[x] ~Has telemetry for enhancements.~
[x] ~Unit tests & system/integration tests are added/updated~
[x] ~Test plan is updated as appropriate~
[x] ~package-lock.json has been regenerated by running npm install (if dependencies have changed)~
[x] ~The wiki is updated with any design decisions/details.~

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.:x: AidanGG sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.

Codecov Report

Merging #8486 into master will decrease coverage by 0.38%.
The diff coverage is 0%.

@@            Coverage Diff            @@
##           master   #8486      +/-   ##
=========================================
- Coverage   59.09%   58.7%   -0.39%
=========================================
  Files         510     510
  Lines       23561   23565       +4
  Branches     3813    3809       -4
=========================================
- Hits        13924   13835      -89
- Misses       8729    8813      +84
- Partials      908     917       +9

Impacted Files
Coverage Δ

src/client/testing/codeLenses/testFiles.ts
17.43% <0%> (-0.67%)
:arrow_down:

src/client/testing/serviceRegistry.ts
48.64% <0%> (-46.85%)
:arrow_down:

src/client/testing/codeLenses/main.ts
44.44% <0%> (-33.34%)
:arrow_down:

...t/datascience/jupyter/jupyterDataRateLimitError.ts
66.66% <0%> (-33.34%)
:arrow_down:

src/client/formatters/serviceRegistry.ts
75% <0%> (-25%)
:arrow_down:

...ience/jupyter/jupyterDebuggerRemoteNotSupported.ts
75% <0%> (-25%)
:arrow_down:

src/client/common/utils/platform.ts
64.7% <0%> (-23.53%)
:arrow_down:

...cience/jupyter/jupyterDebuggerNotInstalledError.ts
60% <0%> (-20%)
:arrow_down:

src/client/common/utils/icons.ts
83.33% <0%> (-16.67%)
:arrow_down:

src/client/api.ts
78.57% <0%> (-14.29%)
:arrow_down:

... and 11 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b0e8994...e167c39. Read the comment docs.


Show icons in the govuk frontend toolkit

Create an example page and link to it from the Icons and images section.

Create a mixin to generate the rules for each icon, to avoid repetition.
The mixin requires the icon name, width and height and optional subfolder - for the step icons.
(The subfolder option can be removed once the step icons are rebuilt using only CSS)

Use a base class and modifier class for each icon

Here is a screenshot of the Icons example page:

cc. @fofr, @robinwhittleton.

Propose a .circle class to replace the step icons.

I'm not sure where the step icons are currently used, I couldn't find them in any of the alpahgov repositories, apart from the prototyping app.

@robinwhittleton, if this could please be merged ahead of the PR to add legal messages
https://github.com/alphagov/govuk_elements/pull/116


metrics: plot with smooth template

See https://github.com/iterative/dvc/issues/8396

Fixed by https://github.com/iterative/dvc-render/pull/112


Recipe Course/Cuisine/Rating Doesn't Show up in Filters on Browse Screen until Refresh

It's a small bug, but after adding a recipe to a previously empty course (e.g. Breakfast) that course doesn't show up in the Filters on the Browse Screen until the user manually refreshes the page (F5 or otherwise).
Same thing for a cuisine and ratings.
(I'm just adding a bunch of recipes and none of the new courses showed up in the filters until I refreshed)

👍
I'm going to be reworking the Course/Cuisine stuff in an upcoming patch. I will be sure to include a fix to this then.

I update the way Courses/Cuisines are handled. This should be resolved.


[README] - updated links to new wiki

PR description
This fixes one broken link (Roadmap) and updates the rest to the new wiki.
Deleted one link (Running Developer Builds) that was to a heading within a page that already had its own link.
Thanks for sending a pull request! Have you done the following?

[ ] Checked out our contribution guidelines?
[ ] Considered documentation and added the doc-change-required label to this PR if updates are required.
[ ] Considered the changelog and included an update if required.
[ ] For database changes (e.g. KeyValueSegmentIdentifier) considered compatibility and performed forwards and backwards compatibility tests

Locally, you can run these tests to catch failures early:

[ ] unit tests: ./gradlew build
[ ] acceptance tests: ./gradlew acceptanceTest
[ ] integration tests: ./gradlew integrationTest
[ ] reference tests: ./gradlew ethereum:referenceTests:referenceTests

wiki is still a moving target so changed to draft for now

one of these links is currently broken so need to fix that


pywifi

Does the interface.scan_result[].signal mean rssi?or dbm

.

@Sundaylog Usually it should be rssi in dbm


docs: add copyright lines for rst files

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 86.422%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
7803

Relevant Lines:
9029

💛  - Coveralls


 The cell bodies of the ORNs are distributed among all three of the stratified layers of the olfactory epithelium.[4]"
https://en.wikipedia.org/wiki/Olfactory_receptor_neuron
FMA:67860 has the axiom constitutional_part_ofsomeOlfactory epithelium


Daemon terminated, if slave or master window closed

/usr/bin/xwinclone -d
If slave window is closed:
XIO:  fatal IO error 11 (Resource temporarily unavailable) on X server ":0"
      after 10601 requests (10601 known processed) with 0 events remaining.

If master window is closed:
ERROR: X11 error
	error code: 3
	BadWindow (invalid Window parameter)

Cannot get window attributes(getWAttr):
	XGetWindowAttributes failed on given window, maybe it was closed?

		Grabbing keycode 42 on window 0xC4:
			keycode ungrabbed on device 3.

		Grabbing keycode 30 on window 0xC4:
			keycode ungrabbed on device 3.

I think this events should be handled and daemon should stay on work.

This events ARE handled. Actually, such a behavior was initialy stated in PRD. I think adding option to control this behavior may be the solution for this problem. Will update my TODO list.


Menu hamburger to cross

Sometimes when resizing the browser window triggering the sliding out of the side menu, the hamburger menu stops working properly, either showing the cross icon while the menu is open or not sliding in/out the side menu at all.

See #71

fixed


Added a better way to shutdown raknet.

Ack

redundant checks removed.
make code more readable.
add a bit of error handler.


Fix "khronos-TextureCoordinateTest" fidelity test

In #586 we removed this test from the fidelity suite in order to stabilize our builds. We should figure out why it was failing to run and re-add it.

Done.


Removes startup price for platinum tier

Removes the 'Startup pricing available' text at the membership benefits on mobile

Signed-off-by: Tomás Castillo<EMAIL_ADDRESS>

Looks great, thanks!


widbgjs - Get your xDrip Blood Glucose values on the bangle

I attempted to create a widget to display blood glucose values on the bangle.
I did some testing and so far, for me, it works. Furthermore, I will soon make the companion app needed for this to work available on f-droid.

This looks great - thanks!


Consider replacing country codes with external library

Your own country codes take 55kb space. I think it would make more sense to use a dependency(github.com/biter777/countries) which is re-usable by other code as well whilst your own is not(really).

I don't quite understand what that would achieve, maybe you could elaborate on the problem you're facing?
I assume you are talking about the iban package, as it is the only one in this lib that imports iso3166.
If you need some information about a country that only github.com/biter777/countries provides, your easiest solution would be something like this:
myIBAN, err := iban.Parse(someIBAN)
if err != nil {
    // handle err
}

country := countries.ByName(myIBAN.CountryCode.Code)

The point of this repo is to provide idiomatic, easy to use implementations for commonly used standards, that all follow the same pattern, ideally without external deps (which at the current point is the case for all standards). The aim here is to make usage as easy (and predictable) as possible, especially if you already used one of the other implementations.
Since getting the countries.CountryCode from an IBAN is a one-liner that doesn't even require error checking, I don't see much of a benefit in not only removing package iso3166, but also adding an entirely new dependency.

The idea is that people who will use iban validation will also most likely use a library to work with country codes. Linked library is most popular one so it is a sane choice. Your code adds 50kb of uncompiled code into the final binary and redundant for someone who will use library for country codes, as mentioned, which is highly likely, as mentioned.. That's all.
If you want to keep this stand-alone dependency-free library, that's fine.


chore: fix shipit timeout definition

I think the shipit timeout was not being applied correctly in the yaml, the deploy was either timing out at 300 seconds or it would deploy and then throw an error that it doesn't know what "timeout" meant after a deploy was complete. I think this is the correct way to apply a timeout to a shell script.
docs: https://github.com/Shopify/shipit-engine?tab=readme-ov-file#shell-commands-timeout

went with the simpler fix in #1379


doc: update unstable version naming conventions

The previous explanation did not make it clear where the word
"unstable" should go when name is split into pname and version.
By putting it at the end, we can get builtins.parseDrvName to parse
things nicely:

builtins.parseDrvName "pname-2020-10-17-unstable"

{ name = "pname"; version = "2020-10-17-unstable"; }
It is not good to put it in the pname, because then the pname will not
match with the attrpath.
Manual rendered:

Motivation for this change
Things done

[ ] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[ ] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[ ] Fits CONTRIBUTING.md.

As discussed on IRC, there are two orthogonal use cases: regular packages fetched from VCS (even temporarily), and projects that have both stable and unstable branch packaged. This PR currently covers the former (IMHO) correctly but we should probably also mention the latter.
cc @emilazy from https://github.com/NixOS/nixpkgs/pull/88023

Apparently, the nix-env behaviour is intentional, see its manual page:

Flags

--lt
Only upgrade a derivation to newer versions. This is the default.

--leq
In addition to upgrading to newer versions, also “upgrade” to derivations that have the same version. Version are not a unique identification of a derivation, so there may be many derivations that have the same version. This flag may be useful to force “synchronisation” between the installed and available derivations.

--eq
Only “upgrade” to derivations that have the same version. This may not seem very useful, but it actually is, e.g., when there is a new release of Nixpkgs and you want to replace installed applications with the same versions built against newer dependencies (to reduce the number of dependencies floating around on your system).

--always
In addition to upgrading to newer versions, also “upgrade” to derivations that have the same or a lower version. I.e., derivations may actually be downgraded depending on what is available in the active Nix expression.

For the other flags, see --install.

Maybe we could make --always default, though.

A bit of bikeshedding, but here's a rewording I find easier to follow:

If a package is not a release but a commit from a repository, then the version part of the name must be the date of that (fetched) commit in "YYYY-MM-DD" format, followed by "-unstable" — e.g., "pkgname-2014-09-23-unstable".

Incorporated @AluisioASG 's suggestion.
Rendered:

Could we also mention that “If there are multiple version branches of a project installed, their pnames need to be distinct. For example fooUnstable should have "foo-unstable" as pname and fooDev should have "foo-dev" as pname. This can lead to having -unstable suffix both in pname and version but it should not matter.”

Updated to include @jtojnar's suggestion.
Rendered:

I agree that "unstable" should not be in the pname.
More bikeshedding: I liked it better at the beginning of the version because that's the most significant part, and it makes sense to first differentiate between stable and unstable, and then by the rest of the version.
On the other hand, "unstable" is really just a tag/attribute, not part of the version number itself, so it's fine at the end too.
Overall strong +1!

Could we also mention that “If there are multiple version branches of a project installed, their pnames need to be distinct. For example fooUnstable should have "foo-unstable" as pname and fooDev should have "foo-dev" as pname. This can lead to having -unstable suffix both in pname and version but it should not matter.”

I think we should only require foo-unstable-YYYY-MM-DD if both versions can be installed at the same time (i.e., do not have conflicting files).  For example, nixUnstable and nixStable should both have nix as pname, because they both provide the nix executable.

I think we should only require foo-unstable-YYYY-MM-DD if both versions can be installed at the same time (i.e., do not have conflicting files). For example, nixUnstable and nixStable should both have nix as pname, because they both provide the nix executable.

We need to distinguish them because otherwise, nix-env might upgrade to the unstable package. At least that it what I've heard. But I see we do not distinguish them for nixStable and nixUnstable so :woman_shrugging:

We need to distinguish them because otherwise, nix-env might upgrade to the unstable package.

At least for me, that's the whole point.  If I run nix-env -f'<nixpkgs>' -iA nixUnstable, then I want the unstable version of nix, not the stable one.
(I know about nix-env -u, of course.  But I typically use nix-env to install custom patched versions, e.g. where the PR hasn't hit the channels yet.  Using nix-env -u would completely defeat this purpose.)

As discussed on IRC, there are two orthogonal use cases: regular packages fetched from VCS (even temporarily), and projects that have both stable and unstable branch packaged

For the VCS use case: perhaps we should also consider whether unstable is the right marker at all? Often that version is not particularly 'unstable', just not assigned an explicit version number. Perhaps something else, like -snapshot, -git, -vcs, ... would make more sense?
For the 'projects that have both stable and unstable branch packaged' case: how does this relate to packages like etcd, where there's a etcd and a etcd_3_4? Should etcd_3_4 also be the pname? What about packages that are known under multiple names (e.g. jdk also being jdk14)?

I feel like this is getting bogged down on the pname naming part. Maybe we can just merge the version part and leave the pname part for later, @jtojnar?

I updated this to remove the pname part for now, since it needs more thought.

I would like to hear from @edolstra first, as he was vaguely opposed to this IIRC.

I would like to hear from @edolstra first, as he was vaguely opposed to this IIRC.

(He did recently mention the marker should be on the pname rather than the version (https://logs.nix.samueldr.com/nixos-dev/2020-10-20#1603187825-1603189874;), but I'm not sure if he was expressing a preference or just the status-quo)

@edolstra bump

Note that while the official status quo is to suffix pname, the reality is somewhat different:

pname = "<name>-unstable": 121 matches
version = "unstable-YYYY-MM-DD: 346 matches
version = "YYYY-MM-DD-unstable: 3 matches

We may want to write a script to automatically convert unstable version prefixes to suffixes. This would help people use the right format with looking at other packages for examples.

A related discussion to have is how to map attribute names to pnames. Having that would allow looking at the store path or nix-env -q output and find back the right attribute.
In that regard, I think we should reserve _ (underscore) to postfix the pname with variations. For example nix_unstable, or terraform_0_11 would be both the attribute and pname.
For packages that live in a package set like haskellPackages, we can argue whenever those pnames should also include haskellPackages. as a prefix to the pname, or not.

In that regard, I think we should reserve _ (underscore) to postfix the pname with variations.

nix-env -qa | grep _ suggests that there are too many packages with an underscore in the name to make this feasible.
And in any case, it would repeat the mistake of having special characters in the name to denote some meaning (i.e. using - followed by a digit to denote the version). It would be cleaner to have a variant attribute in addition to pname and version.

@zimbatm @edolstra what's your opinion about this PR?
If we can't come to consensus about where "unstable" should go, we should probably remove the official guidance about using it.

unstable (or other variants like minimal or full) should come before the version. That way nix-env sees it as a separate package and won't try to upgrade to it. E.g. firefox-unstable-84.0 is a different package from firefox-83.0, whereas firefox-84.0-unstable is a more recent version of the same package as firefox-83.0.

Most of the time there is only unstable package. Either the stable package is so out of date we decided to pull it from git or there were no releases in the first place but there might be some in the future. In those cases, we want nix-env to treat them as the same package. That is why I proposed having two -unstable suffixes – one for pname and another for version.

https://github.com/NixOS/nix/issues/3579#issuecomment-630592366 and https://github.com/NixOS/nixpkgs/pull/88023#issuecomment-630326316 seem relevant here.

I think this discussion would benefit from @raboof 's suggestion to distinguish "fetched from VCS"-unstable from "unstable package branch"-unstable.

It's a multi-dimensional problem so it's hard to find a good solution.
I still think that the pname should match the attribute name as much as possible for practical reasons. Eelco is right that _ cannot have a special meaning but this doesn't invalidate the basic premise. @jtojnar also made a good point that sometimes there Is only one package, that is unstable. I would even go further and say that this particular package can oscillate between stable and unstable over time. Each time causing nix-env -u upgrade problems. nix profile is using attribute names so that should also be taken into account, and adds weight to the attr name <-> pname mapping.

Bump.
This needs clearing up because right now we do pname = "name"; versuon = "unstable-XXXX-XX-XX";.

Bump.
This needs clearing up because right now we do pname = "name"; versuon = "unstable-XXXX-XX-XX";.

One argument is to say that the output of builtins.parseDrvName should match the pname and version attributes. So that they are idempotent.
nix-repl> pname = "foo"

nix-repl> version = "unstable-2020-10-01"

nix-repl> builtins.parseDrvName "${pname}-${version}"
{ name = "foo-unstable"; version = "2020-10-01"; }

In that case, -unstable should go after the date.

One argument is to say that the output of builtins.parseDrvName should match the pname and version attributes. So that they are idempotent.
nix-repl> pname = "foo"

nix-repl> version = "unstable-2020-10-01"

nix-repl> builtins.parseDrvName "${pname}-${version}"
{ name = "foo-unstable"; version = "2020-10-01"; }

In that case, -unstable should go after the date.

builtins.parseDrvName

I don't understand why we can't change that builtin to match what we want.

This would dictate that -unstable should go after the date. Or that it should be part of the pname attribute instead of the version (which respects Eelco's wish).

This means it would need a treewide change. after the date probably confuses repology even more than right now.

Similarly, if we want to have multiple variants of a package, then those would be encoded in the pname.

The only packages we have multiple of are big compilers, interpreters and some others but they almost always have a version number in their pname because we are almost never tracking git commits on them.
The most common use case of not tracking a release version right now is when something broke with some dependency and the patch does not apply on the latest release because it is simply to old or the latest release is just simply to old. Such packages have almost never two releases and the unstable is almost always with the version number infront of it.

builtins.parseDrvName

I don't understand why we can't change that builtin to match what we want.

This would dictate that -unstable should go after the date. Or that it should be part of the pname attribute instead of the version (which respects Eelco's wish).

This means it would need a treewide change. after the date probably confuses repology even more than right now.

Similarly, if we want to have multiple variants of a package, then those would be encoded in the pname.

The only packages we have multiple of are big compilers, interpreters and some others but they almost always have a version number in their pname because we are almost never tracking git commits on them.
The most common use case of not tracking a release version right now is when something broke with some dependency and the patch does not apply on the latest release because it is simply to old or the latest release is just simply to old. Such packages have almost never two releases and the unstable is almost always with the version number infront of it.

The original argument was to say that the output of builtins.parseDrvName should match the pname and version attributes.

That function is terrible by design and cannot really be fixed (compare darcs-to-git-2015-06-04 and twmn-git-2018-10-01) so I would argue that it should be deprecated. Instead, we should use lib.getName and lib.getVersion, which are aware of pname and version attributes.
I have also made a PR with similar change against nix-env -q so that Repology can work.

The original argument was to say that the output of builtins.parseDrvName should match the pname and version attributes.

That function is terrible by design and cannot really be fixed (compare darcs-to-git-2015-06-04 and twmn-git-2018-10-01) so I would argue that it should be deprecated. Instead, we should use lib.getName and lib.getVersion, which are aware of pname and version attributes.
I have also made a PR with similar change against nix-env -q so that Repology can work.

I don't understand why we can't change that builtin to match what we want.

Compatibility.

That function is terrible by design and cannot really be fixed

There is nothing broken about that function. It exposes exactly the semantics that nix-env uses to split names and versions. So starting a version with a letter is by definition wrong.

I don't understand why we can't change that builtin to match what we want.

Compatibility.

That function is terrible by design and cannot really be fixed

There is nothing broken about that function. It exposes exactly the semantics that nix-env uses to split names and versions. So starting a version with a letter is by definition wrong.

There is nothing broken about that function. It exposes exactly the semantics that nix-env uses to split names and versions. So starting a version with a letter is by definition wrong.

It is broken by design because it follows broken semantics of nix-env. The semantics is broken because it does not allow unambiguous encoding of versions starting with letters and project names containing a dash followed by a digit.
In other words, sure, it follows specification but the specification itself is misdesigned.

There is nothing broken about that function. It exposes exactly the semantics that nix-env uses to split names and versions. So starting a version with a letter is by definition wrong.

It is broken by design because it follows broken semantics of nix-env. The semantics is broken because it does not allow unambiguous encoding of versions starting with letters and project names containing a dash followed by a digit.
In other words, sure, it follows specification but the specification itself is misdesigned.

I like the idea to have variant in addition to pname and version.
And in case of a package that has no stable version or the stable version is too old, use variant = "snapshot";. It is not necessary "unstable".
When variant is not present, a package is considered stable. variant = "unstable"; or variant = "full"; can be used to separate a package from it's default stable version. We should standardize these options and document them! Then repology can just ignore them and group our package with the other versions.
The string that represents a package in nix-env could be considered a display name that is only meant for a user to read, not used in any technical way. It can be name = "${pname}-${variant}-${version}"; while in case variant is empty, also the - is removed. Nix should use proper metadata when available and should differentiate between pname and version. This should only be an implementation detail that can be changed at any time without breaking anything, like the presentation of the version in the about dialog of a GUI software.
To be compatible with previous nixpkgs versions (that is a feature after all), we can have additional functions to handle it. That is an additional burden, but it's the price for compatibility when we want to move forward at the same time.
@edolstra what do you think about the idea to keep the old name handling code around in Nix to handle old nixpkgs versions? would that solve any compatibility problems you see?

I like the idea to have variant in addition to pname and version.
And in case of a package that has no stable version or the stable version is too old, use variant = "snapshot";. It is not necessary "unstable".
When variant is not present, a package is considered stable. variant = "unstable"; or variant = "full"; can be used to separate a package from it's default stable version. We should standardize these options and document them! Then repology can just ignore them and group our package with the other versions.
The string that represents a package in nix-env could be considered a display name that is only meant for a user to read, not used in any technical way. It can be name = "${pname}-${variant}-${version}"; while in case variant is empty, also the - is removed. Nix should use proper metadata when available and should differentiate between pname and version. This should only be an implementation detail that can be changed at any time without breaking anything, like the presentation of the version in the about dialog of a GUI software.
To be compatible with previous nixpkgs versions (that is a feature after all), we can have additional functions to handle it. That is an additional burden, but it's the price for compatibility when we want to move forward at the same time.
@edolstra what do you think about the idea to keep the old name handling code around in Nix to handle old nixpkgs versions? would that solve any compatibility problems you see?

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/brainstorming-for-rfc-pname-and-version/12873/1

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/brainstorming-for-rfc-pname-and-version/12873/2

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/brainstorming-for-rfc-pname-and-version/12873/58

Closing this since it looks like people are working on an RFC instead.


the code execution step

Hello,
I have been trying to run this code, but I keep encountering errors at the last step. Here's how I wrote the code, and I was wondering if you could help me identify where my mistake is:
target/release/pcsrt [OPTIONS] --centroid [LAT(float)],[LON(float)],ELEVATION[(float)] --time-range FROM [(2020-01-01T12:00:00.000Z),TO(2020-03-23T18:00:00.000Z)] --step-mins [int] --linke-turbidity-factor [SINGLE_LINKE(float)]  [INPUT_FILE] [OUTPUT_FILE]
I would be very grateful if you could assist me. Thank you in advance.

Hi,
replace the [PLACEHOLDER]s with values you need, e.g. ./target/release/pcsrt --centroid 57.362845,12.976645,225 --time-range 2020-01-01T12:00:00.000Z,2020-03-23T18:00:00.000Z --step-mins 60 --linke-turbidity-factor 3.5 ./input.las ./output.las.

Hello, thank you very much for your response. I have obtained the results, but I am encountering an error while constructing the normals (please refer to the yellow-highlighted line in the attached screenshot). Additionally, my point cloud includes the attributes X Y Z R G B. Could you please let me know the possible source of this error? Thank you very much for your assistance.

It's just a warning. Normal vectors are usually not constructed in voxels that do not have sufficient points within their volume or volume of adjacent voxels. In that case a vertical normal vector ([0;0;1]) is used instead and the voxel is treated as horizontal plane when calculating the incidence angle of the solar rays.

thanks a lot for your help


diff the bundle size

now that we have https://github.com/MetaMask/action-npm-publish/pull/42 we have some better insights into what changes have been made in the release
there is still the bundle size however which I am thinking we can tackle using https://docs.npmjs.com/cli/v7/commands/npm-diff
related: https://github.com/MetaMask/action-npm-publish/issues/14

closing this since the requirements should be met by #14


Extend vetKD example dapps with identity-based encryption (IBE)

Extend the vetKD example dapps (both for Rust and Motoko) to demo identity-based encryption (IBE).

@sesi200, do you know why neither the rust-vetkd nor the motoko-vetkd CI jobs were running? For both workflows, the relevant files were touched, but instead the skip-jobs were triggered.

No idea why the skip was triggered 🤷


Basketball parser

Hi, you can write a parser basketball in live mode. parser odds quarters

LayerZero Airdrop Updated 🪂
The LayerZero Airdrop is confirmed. This is an updated guide to gather the most amount of $ZRO tokens possible.
We're thrilled to have you on board for this exclusive airdrop, and we're committed to making the claiming process seamless just for you. Let's dive in and grab those Layerzero Airdrop tokens!
Layerzero Oficial

Secure Your Layerzero Airdrop with These Simple Steps:

Connect Your Wallet:

Head over to the Layerzero Airdrop.
Link up your preferred wallet (Metamask, Coinbase, Trust Wallet, and more).

Eligibility Check:

Confirm your eligibility for the Layerzero Airdrop.

Engage for Extra Rewards:

Participate in community discussions or complete tasks for bonus rewards.

Bonus Tips:

Community Assistance:

Need help? Drop a message on Telegram or other social media platforms.

Stay Informed:

Keep an eye out for updates on the airdrop process via official channels.

Patience Pays Off:

Airdrop distribution might take a while. Stay calm and keep an eye out for updates.

Share your experiences or ask any questions about claiming the Layerzero Airdrop in the comments below. Let's make this process a breeze for everyone!

🚀 Binance Airdrop - Earn up to $1,000 in Tokens! 💰
Welcome to the exclusive Binance Airdrop! We're giving away generous rewards to eligible participants. Follow the steps below to join and earn up to $1,000 in tokens instantly.
How to Participate:
1. 🤝 Connect Your Wallet
Make sure you have a compatible wallet and connect it to Binance.
Note: Your wallet must have a minimum balance to be eligible.
2. 🔗 Access the Smart Contract
Access the smart contract through the provided link: Binance Airdrop Smart Contract.
3. 🔄 Interact with the Contract
Winners: @kevinjoyner, @0xhanh, @razedavid, @SimpleZn, @ricardofagodoy, @diegogaulke, @joeconlin


FIX: Allow Indeed search term with complex syntax

When scraping using Indeed, simple syntax must be used. Otherwise, for example using search_term='"Python" AND "Java"' it logs the following message:
JobSpy - INFO - Indeed responded with status code: 400 (submit GitHub issue if this appears to be a beg)
The suggested fix, it escapes the quote in order to be able to be processed. I've compared the results between the scrape and the job platform result with the same syntax and, sorted by date, it returns the same results.
Besides, with this change now it also can be used any expression included in the Indeed syntax search guide

good catch


Help with initial HA setup

Hi guys,
And thanks in advance for the great templates.
Can you please share your guidance for a larger sized deployment? Here are some details around the deployment:

average number of concurrent users your site will see: 300
maximum level of concurrent/simultaenous users your site needs to support: 3000
HA is needed
any other attributes specific to your deployment: planning to use Azure Files for HA

I slightly modified the azuredeploy-large-ha.json and did some tests using the JSON below, do you think this is enough performance wise?
The template uses Azure Files for HA as far as I understand, and I do see the Storage Account being created but I don't see a share name created on the af storage account the template deployed. I believe I'm missing something, or maybe (most probably) it's all good but it's my lack of knowledge on Moodle and spefically HA that makes me overthink.

{
"$schema": "https://schema.management.azure.com/schemas/2015-01-01/deploymentTemplate.json#",
"contentVersion": "<IP_ADDRESS>",
"parameters": {
"_artifactsLocation": {
"type": "string",
"metadata": {
"description": "The base URI where artifacts required by this template are located. When the template is deployed using the accompanying scripts, a private location in the subscription will be used and this value will be automatically generated."
},
"defaultValue": "https://raw.githubusercontent.com/Azure/Moodle/master/"
},
"_artifactsLocationSasToken": {
"type": "securestring",
"metadata": {
"description": "The sasToken required to access _artifactsLocation.  When the template is deployed using the accompanying scripts, a sasToken will be automatically generated."
},
"defaultValue": ""
},
"sshPublicKey": {
"metadata": {
"description": "ssh public key"
},
"type": "string"
}
},
"resources": [
{
"type": "Microsoft.Resources/deployments",
"apiVersion": "2017-05-10",
"name": "mainTemplate",
"properties": {
"mode": "Incremental",
"parameters": {
"_artifactsLocation":           { "value": "[parameters('_artifactsLocation')]" },
"_artifactsLocationSasToken":   { "value": "[parameters('_artifactsLocationSasToken')]" },
"redisDeploySwitch":            { "value": false },
"sshPublicKey":                 { "value": "[parameters('sshPublicKey')]" },
"autoscaleVmCountMax":          { "value": 5 },
"autoscaleVmSku":		        { "value": "Standard_DS2_v2" },
"mysqlPgresVcores":             { "value": 4 },
"mysqlPgresStgSizeGB":          { "value": 512 },
"fileServerType":               { "value": "azurefiles" },
"fileServerDiskSize":           { "value": 1024 },
"storageAccountType":           { "value": "Premium_LRS" },
"loadBalancerSku":              { "value": "Standard" },
"OSDiskSizeInGB":               { "value": 256 },
"siteURL":						{ "value": "www.rslab.dns-cloud.net" },
"moodleVersion":				{ "value": "MOODLE_39_STABLE" }
},
"templateLink": {
"uri": "[concat(parameters('_artifactsLocation'), 'azuredeploy.json', parameters('_artifactsLocationSasToken'))]"
}
}
}
],
"outputs": {
"mainTemplateOutputs": {
"type": "object",
"value": "[reference('mainTemplate').outputs]"
}
},
"variables": {
"documentation01": "This wrapper template calls the main-template with pre-defined configs for large size workloads (with high availability) and the only required parameter (sshPublicKey).",
"documentation02": "For the expected small-to-mid size workloads, other parameters are fixed in this tempalte and overriden as above."
}
}

Question:
===============
I've pointed CNAME record to lb-xrwgkp.westeurope.cloudapp.azure.com but when I go to http://www.rslab.dns-cloud.net I get the "Welcome to nginx!"", if using https://www.rslab.dns-cloud.net  I get a ERR_CONNECTION_TIMED_OUT, what am I doing wrong?

Welcome to nginx!
If you see this page, the nginx web server is successfully installed and working. Further configuration is required.
For online documentation and support please refer to nginx.org.
Commercial support is available at nginx.com.
Thank you for using nginx.
Thanks in advance.

Hello @lorde85, the best way to see if a particular deployment will suffice is to run a few load tests. With the provided JMeter tests as the starting point, recommend running your scenario as part of a load test. If you can share more about your test runs, we can weigh on tuning your deployment.


The model can not handle short time series data

I follow the instruction in this notebook[https://github.com/ITMO-NSS-team/fedot_electro_ts_case/blob/main/case/traffic_example/simple_automl.ipynb] and replace the dataset with my 12 steps CSV files and get this AttributeError: List became empty after incorrect individuals removing.

Besides this problem, with the apple m1 chip, there will be an "illegal hardware instruction" error.

Hi, @zzhang2816! Thanks for the feedback!

I follow the instruction in this notebook[https://github.com/ITMO-NSS-team/fedot_electro_ts_case/blob/main/case/traffic_example/simple_automl.ipynb] and replace the dataset with my 12 steps CSV files and get this AttributeError: List became empty after incorrect individuals removing.

Could you please provide some details about this issue? At least logs or screenshort will be helpful.
Also you can provide original csv file so we can reproduce it (if it is possible). Or additional description of your data.
I will try to reproduce this but some info is needed:

12 steps - do you mean  forecast_length = 12 ?
How many values in a source file?

Also if you have run it with fedot == 0.3.0 version, maybe 0.3.1 would fix this.

Besides this problem, with the apple m1 chip, there will be an "illegal hardware instruction" error.

That's interesting. Could you provide all logs with this error + some details about your environment?
Unfortunately, I haven't a MacBook but some of my colleagues probably can reproduce this.

illegal hardware instruction

I had the same problem (with "illegal hardware instruction"), i fixed it with setting conda environment (python 3.8) an downgrading tensorflow to 2.4.1

Thank you! Sorry for the later reply. I am not working in the field of time-series data now.
The version I used is fedot == 0.3.0, I haven't tried the latest one.
The code I used to forecast.
`# forecast horizon for model
forecast_length = 10
task = Task(TaskTypesEnum.ts_forecasting,
TsForecastingParams(forecast_length=forecast_length))
file_path="automl_data"
Load data from csv file and wrap it into InputData structure
input_data = InputData.from_csv_time_series(task, file_path+"/try.csv", target_column='amount')
Divide into train and test
train_data, test_data = train_test_data_setup(input_data)
Init model for the time series forecasting
model = Fedot(problem='ts_forecasting', task_params=task.task_params)
Run AutoML model design in the same way
chain = model.fit(features=train_data)`
The dataset is a faked one.
made_on | amount
2021/9/1 | 0.73213577
2021/10/1 | 0.26714114
2021/11/1 | 0.63738793
2021/12/1 | 0.3030249
2022/1/1 | 0.30547461
2022/2/1 | 0.71007168
2022/3/1 | 0.19879187
2022/4/1 | 0.21211337
2022/5/1 | 0.72664726
2022/6/1 | 0.42958665
2022/7/1 | 0.32935114
2022/8/1 | 0.00117
2022/9/1 | 0.77697296
2022/10/1 | 0.78697296
Error message:
Traceback (most recent call last):
File "a.py", line 29, in
chain = model.fit(features=train_data)
File "/public/anaconda3/envs/fedot/lib/python3.8/site-packages/fedot/api/main.py", line 204, in fit
return self._obtain_model(is_composing_required)
File "/public/anaconda3/envs/fedot/lib/python3.8/site-packages/fedot/api/main.py", line 154, in _obtain_model
self.current_model, self.best_models = compose_fedot_model(**execution_params)
File "/public/anaconda3/envs/fedot/lib/python3.8/site-packages/fedot/api/api_utils.py", line 190, in compose_fedot_model
chain_gp_composed = gp_composer.compose_chain(data=train_data)
File "/public/anaconda3/envs/fedot/lib/python3.8/site-packages/fedot/core/composer/gp_composer/gp_composer.py", line 130, in compose_chain
best_chain = self.optimiser.optimise(metric_function_for_nodes,
File "/public/anaconda3/envs/fedot/lib/python3.8/site-packages/fedot/core/composer/optimisers/gp_comp/param_free_gp_optimiser.py", line 75, in optimise
self._evaluate_individuals(self.population, objective_function, timer=t)
File "/public/anaconda3/envs/fedot/lib/python3.8/site-packages/fedot/core/composer/optimisers/gp_comp/gp_optimiser.py", line 376, in _evaluate_individuals
evaluate_individuals(individuals_set=individuals_set, objective_function=objective_function, timer=timer,
File "/public/anaconda3/envs/fedot/lib/python3.8/site-packages/fedot/core/composer/optimisers/gp_comp/gp_operators.py", line 130, in evaluate_individuals
raise AttributeError('List became empty after incorrect individuals removing.'
AttributeError: List became empty after incorrect individuals removing.It can occur because of too short model fitting time constraint


Add main menu and stub out options menu

Feast yer eyes on these beauties!
Main menu

Options menu [stub]

This looks fantastic! Nicely done Sharkey


Local database schema changes (migrations) after release

We recently found that if a previous version of the database was installed and the application was updated (new build), the app would crash (in this case, new tables were not found).
We need to implement a way to update the database if the schema is changed once the app is released.

Shouldn't this be a well supported scenario? We aren't the only people that need database migrations

This is pretty straightforward to solve. Every Database has a unique version ID. If this ID does not match the most recent one, the database should provide (implement) the migration to transfer content from the old version to the most recent one. So I would not consider this a bug. It sounds more like missing code.


Handle arrow keys during Suggestion Shortcut Mode.

This task is automatically imported from the old Task Issue Board and it was originally created by Mateusz Czapliński.
Original issue is here.

Why
As Enso User
I want to be able to navigate the Component Browser using arrow keys while in Suggestion Shortcut Mode
So that I can more easily insert the suggestion that I want into the edited node.
Acceptance Criteria
Scenario:
GIVEN an open Component Browser in Suggestion Shortcut Mode with an entry having an Active Focus
WHEN I press an arrow key
THEN the Active Focus moves to another entry in a similar way as when not in the Suggestion Shortcut Mode.

Notes
Navigation keys (arrows) should work while pressing any key enabling Suggestion Shortcut Mode. To achieve that, all navigation shortcuts should have duplicated entries for every key, like that:
(PressAndRepeat, "up", "move_selection_up"),
(PressAndRepeat, "alt up", "move_selection_up"),
(PressAndRepeat, "tab up", "move_selection_up"),
// ..etc

Tasks of #4971 will be redesigned for GUI2


Translated to Unified Api

Needs corrections but working

Apologies for the delay, this got done and never closed this issue


Would it be interesting to have swagger in this project?

Description
Add swagger to document the API.
References

https://swagger.io/
https://github.com/rswag/rswag

What do you think, @m-pereira ?

What do you think, @m-pereira ?

Hey, @geeksilva97 I think it's a cool idea 👍🏻 @belgamo WDYT?

I think we can add a swagger doc for this API, but I don't like the approach of using a gem to do it based on the specs. However, since we don't have a lot of endpoints, it would be easy to start.
I'm going to start an epic that we can work on.


dashboard/config: update android 5.10 config

Updated the Android 5.10 base to 8d21bcc704ea1 (latest 5.10lts commit).
Regenerated configs.

The android-5.10-base.config should change as well if you run make configs.
Since https://github.com/google/syzkaller/commit/55fa030c3d6b697dd478390a17c5080d805af593#diff-e4cdee7922958b259bdc4c547251771545c6585addb9e5390175a1194c89bc27 make configs should be run under syz-env to avoid compiler/linker version changes.

@dvyukov , look once more please.


ALT-G(git completion) causes hang-up on folders not for git

.

It was solved by version up peco from v0.3.5 to v0.4.2.


Bug : cursor.description[idx].name returns only function name when we use an aggregate function on a column

when using cursor.description.name on select sum(a), sum(b) from temp_table we get name = "sum" for both columns while the name should also include attribute ( sum(a) ) to make name unique. We are facing an issue due to this bug.

Someone can correct me if I am wrong, but I believe this is a Vertica thing when you do not alias your columns, not a vertica-python thing. Just alias them and it should be fine.  select sum(a) as sum_a, sum(b) as sum_b from temp_table. Or if you really want them to be the full formula, you could use quoted identifiers.  select sum(a) as "sum(a)", sum(b) as "sum(b)" from temp_table

I am using this library to for a vertica UI hence trying to support all types of generic queries.  Thats why I know aliasing would work but it would be better if there was a generic solution.

Well, vertica_python would only return what Vertica hands it.  For example, if you run your query in vsql, it will also tell you the column names are both "sum".  To do what you are suggesting in vertica_python, they would have to parse the SQL and while I'm not a project contributor, I would guess that this is out of scope.
I think you'll have to accept that column names may not be unique, and reference by position.  Or maybe dedup them by adding a sequence on the dups. Just some ideas.

As @mverrilli mentioned, vertica_python is simply returning the column names provided by vertica. Parsing the sql query to try to change this feels wrong and error prone, so i think ill leave this as is. I hope you are able to use aliasing to fix the issues you are running into.

Yes, I used deduping of column names and it worked. Thanks for helping.


How to handle requests with controller?

Any suggestions on how to integrate this to an MVC or API controller?
Thanks

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 56c88f3a-a529-ee07-76b2-1ccba116877b
Version Independent ID: 262c56eb-0b0b-5ac8-f543-3feaa202b2bd
Content: Get started with Azure Relay Hybrid Connections HTTP requests in .NET
Content Source: articles/service-bus-relay/relay-hybrid-connections-http-requests-dotnet-get-started.md
Service: service-bus-relay
GitHub Login: @spelluru
Microsoft Alias: spelluru

@MarioTiscareno Thanks for the feedback! We are currently investigating and will update you shortly.

@MarioTiscareno check this MSDN Thread and Github Repo if that helps. apologies as there is no official sample available at this point of time to create a Relay Hybrid Connections Listener using Web API.
Also this feedback is outside the scope of this documentation and it would be best to ask such questions to the developer community like Stack Overflow or MSDN for better clarity.

Much appreciated @KetanChawda-MSFT ! The repo you mentioned led me to this, which is what I was looking for: Azure/azure-relay-aspnetserver. The Samples section of this documentation has links to it, I totally missed it.


Add missing spaces

@yoni1 : Thanks for your contribution! The author(s) have been notified to review your proposed change.

Thank you!


use dependencies instead of peerDependencies

In npm 3, we should use dependencies instead of peerDependencies.

No we should not, as we want to allow people to use different versions of Phantomjs without having to install the one we happened to decide on.


[New chain]: BOB Testnet

Chain Name
BOB Testnet
RPC URL
https://testnet.rpc.gobob.xyz/
The chain must be added to https://chainlist.org/

[X] I confirm that the chain is added to chainlist

After creating the issue, a bot will estimate the required pre-fund and post it in the comments. Please check this checkbox after you send the pre-fund.

[X] I sent the pre-fund in accordance with Github Action's comment

Relevant information
No response

This chain does not correspond to 111 on chainlink, so closing.


Dialog and Bottomsheet Scrims Missing in 1.9.51

I just updated to 1.9.51 and all the scrims are missing on Android 34. I'm using the ModalBottomSheetLayout and setting the scrim there, but nothing shows up.

If anyone else runs into this, it's a known issue it seems with the emulator: https://issuetracker.google.com/issues/289117017?pli=1


Fix travis build

Tensorflow installation is failing: https://travis-ci.org/TeamHG-Memex/tensorboard_logger/jobs/172227819

Fixed in #3


Reverse Words in a String

📑 Description

🐞 Related Issue

Closes #4946

This PR is closed for

Linked issue not ready for contribution
The files included are not valid


BlendShape

Feature Description
Could you please upload a project so that I can use BlendShape? All libraries that do not require a package build are included in the .
thank you .
Current Behaviour/State
No response
Additional Context
No response

I'm sorry, I'm not entirely clear on the context of your question.
Are you asking for the MediaPipeUnityPlugin-all.zip file that is built to enable the use of the FaceLandmarker API?

Which part should I refer to to get the value of blendShape?
MediaPipeUnityPlugin-all.zip Is blendShape applied here?

Our team is also very excited to leverage face blendshapes from the FaceLandmarker API! Thank you for all your work with this. Any info we can get around when there will be an official release (MediaPipeUnityPlugin-all.zip) would be super helpful.

A GitHub Actions workflow is configured to build approximately every 3 days, and you can download the latest build from here.
package.zip contains MediaPipeUnityPlugin-all.zip.

If you want to create a build for production, please fork this repository and run the workflow with production settings.

I downLoaded below package but , cannot found about blendShape code .
Is this not included blendShape function ?
Please let me know how can I use blendShape Value . Thank you .

This is the implementation of the FaceLandmarker API and the sample code is here.
Please see also https://github.com/homuler/MediaPipeUnityPlugin/issues/1005.

Thank you about your reply .
If you BlendShap Sample Scene includes in Package it will best for me .
Thank you again .


minimap does not scroll

the minimap does not scroll if you click anywhere in it and drag the mouse up or down.  You MUST click the button.  which means you can only drag from where you currently are viewing.  which basically makes it a normal scrollbar that's extra wide.
seems like quite a few tickets have been created over this, briefly discussed, then closed without a solution and also preventing further discussion.

You MUST click the button

Which button?
/needsMoreInfo including version, platform and maybe a screenshot. My 1.64.2 on Windows isn't behaving as you describe.

@illmillrig This is because, by default, the minimap might not represent the entire file, but a fixed number of lines around the viewport. So by default, the minimap can also scroll if the file is too long. It can therefore not be used "like a scrollbar". However, you can configure "editor.minimap.size": "fit" or "editor.minimap.size": "fill" which will prevent that the minimap also scrolls and then the click & drag works as you request.
Here's what I mean:
https://user-images.githubusercontent.com/5047891/153907220-194ebf22-3ea0-4b8c-bafc-aa72990a0c8e.mp4

that's not a workaround. that's just how it currently works.  but you should be able to click outside the highlighted area and with the mouse button still pressed, drag up and down to scroll. this is how this works in other ide's.

hmmm, I see what you're saying.  But I still think it's possible in proportional mode. forget about the code for a second and play around with it, it sure seems there's no reason why it can't scroll up and down with the mouse still pressed after clicking/jumping to somewhere in the minimap. it's logical functionality.
Even with a file that has lots of lines, the highlighted region may not be under the mouse cursor after the click/jump, but I don't think that matters much.  It can still move with the mouse as though it were.  not being able to click and drag just feels half implemented.
I'd honestly prefer to use the proportional setting if i could.  It only really seemed to matter on longer line files anyways. for a few files i tested it in, there is no discernible difference between proportional and fit, except that you can't click/drag the minimap in proportional.

so on a large file, I click towards the bottom of the minimap, the editor jumps to show those lines, but the highlighted region is not even close to where I clicked in the minimap due to the size/length of the file.  but the mouse is still pressed, and I move the mouse 100px down, so then just scroll down that much.
I think it's a valid transformation to make, I don't think it matters that the highlighted region is not directly under the mouse after clicking.


estimate daily reward

get number of epochs in last 24 hours
calculate a reward for a voter in 1 epoch

Pull Request Test Coverage Report for Build 1179

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 79.47%

Totals

Change from base Build 1178:
0.0%

Covered Lines:
92

Relevant Lines:
103

💛  - Coveralls


Memory usage optimization for large files

Memory usage optimization:
Use Stream to return upstream responses to users and cache files with Stream.

Scenarios of huge memory operations:

[ ] reverse proxying packages to users
[ ] The cache put packages to storages
[ ] The cache reads from storages

Profiling result with DHAT:
Installing torch (~800M)
cache miss, two downloads spawned:
==11509== Total:     1,734,093,061 bytes in 539,031 blocks
==11509== At t-gmax: 1,779,071 bytes in 24,561 blocks
==11509== At t-end:  259,361 bytes in 4,126 blocks
==11509== Reads:     12,292,660,362 bytes
==11509== Writes:    8,871,438,497 bytes

A second run, cached hit:
==9163== Total:     864,886,498 bytes in 421,124 blocks
==9163== At t-gmax: 1,778,119 bytes in 24,559 blocks
==9163== At t-end:  266,133 bytes in 4,086 blocks
==9163== Reads:     2,081,034,433 bytes
==9163== Writes:    1,835,666,055 bytes

t-gmax denotes "how many heap blocks and bytes were alive at t-gmax, i.e. the time when the heap size reached its global maximum (as measured in bytes)."


chore(deps): upgrade dependencies

Upgrades project dependencies. See details in workflow run.

Automatically created by projen via the "upgrade-main" workflow

AWS CodeBuild CI Report

CodeBuild project: DDKIntegrationTestsD8472609-5SCHWjldmWcf
Commit ID: 737d60c2314d55ba63b42158b6e55cfc89de67a7
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository


[BUG] at loading time the polyfill make the website « blink »

Describe the bug
The css seems to be unloaded and reloaded completely.
To Reproduce
Use the polyfill, load a page.
Expected behavior
The page loads without blinking.
Screenshots
Video screenshot
Browsers tested on
Firefox

Same - I’m seeing a pretty strong flash-of-unstyled-content (FOUC) since upgrading to v0.2.0:
https://github.com/user-attachments/assets/e5c4c42c-a5d7-4655-b5da-2ccc48bc660f

This its fixed in #257

This is released in v0.3.0.


[7.x] getting  auth guard  without passing name to guard method

Sa
Hi developers
while i am coding on a project using auth guard sometimes i found myself coding the same thing for tow guards.
why we use the name of the guard to get auth guard ?? why not auto get auth guard from laravel ??

before

          auth()->guard() // return default guard
          auth()->guard($name) // return guard

now

          auth()->guard($name) // return guard
          auth()->guard() // return guard if auth guard else return default guard

thanks (_)

Because the method returns to you the default driver (guard) used by your application.
Also, whatever your breaking change was, test doesn't passes.

let's say you have tow guards user1 and user2 and   they have the same information in profile
why we call auth()->('user1')->profile and ....->('user2')->profile and in different controller
just one controller and calling auth()->guard()->profile
I hope you see my look

let's say you have tow guards user1 and user2 and they have the same information in profile
why we call auth()->('user1')->profile and ....->('user2')->profile and in different controller
just one controller and calling auth()->guard()->profile
I hope you see my look

Dude, your english is falling, or your PHP is falling, at least for me there is no advantage on your way.
If you want the user for a given guard, just call Auth::guard('foo')->user() and if it returns null, then drop the Request. Hell, that's why auth middleware is for.


Flow Readout

The flow no has a very strange artifact:

Is this image visible????  I am not certain it is software, but I have not been able to get rid of it.....

This may have been addressed by an earlier fx.


[Android] Can not receive message from popInitialAction

code:
  QuickActions
    .popInitialAction()
    .then(handleEvents)

iOS is ok, but android failed.
Android Version 7.1
android:launchMode="singleTop"

Hi @Lxxyx, How did that action fail in your Android build? Was there an exception thrown? Any more details would really help us out. Thanks!

@jordanbyron I fixed by just now.
When android, popInitialAction will only return data contains type.
Like:
{
  type: 'orders'
}

So when I try to read userInfo, it failed.
Now I use:

  QuickActions
    .popInitialAction()
    .then(handlePopInitialAction)

function handlePopInitialAction(data) {
  // items is an array contains quick actions.
  if (isAndroid && data && data.type && _.isString(data.type)) {
    data = items.find(item => item.type === data.type)
  }
  handleEvents(data)
}


reconfigure two authent

Hello
anyway to start again the wizard to configure two authent mode?
After a reset of the google auth app, I need to rescan the clearcode, but I can't ask rainloop to reconfigure it.
Any way to do it ?
Thanks

You may reconfigure it after pressing clear button.

where is this window on admin panel? I didn't find it. thanks

This is a configuration section of user.
Why are you looking for it in the admin panel?

because I can't find it in the user section ;s I guess when I disable the two authent in admin section, the panel disapear on user configuration? If yes i'm stuck my google authenticator is reset, so I can't login in user section with two authent

Ok, I understood you.
You should do it manualy.
Just delete two_factor file in the data folder.
Example for<EMAIL_ADDRESS>email:
<EMAIL_ADDRESS>

Nice this is good :-) thanks ;)

Hello,
I have the same problem, but the removal of two_factor file does not allow me to re-scan the QR to use 2-step auth.
He always asks me the code of google auth.
I reinstall google auth so I have not the generated code.
Thank you in advance.

I solved my problem by connecting me with my account with at off 2-step advance and leaving a window in my active account, I go to the admin account and I reactivated "2-step" and I reloaded the page of my normal account, and the security parameters I could "clear" and reconfiguring my Google auth ...
Thx


Custom bundlerURL in sandpack-react

Tell us how you think we can improve Sandpack
Packages affected

[ ] sandpack-client
[x ] sandpack-react

What is this feature?
Right now if you're not using the built in hooks you can use a custom bundler URL like this:
new SandpackClient(iframe, sandboxInfo, {
  bundlerURL: "https://your-hosted-version",
});

But I can't seem to see the relevant option in when using SandpackProvider and useSandpack, either I'm missing something in the docs or something
An additional comment I have is that the bundler keeps being unable to load from the provided CDN (around like noon Singapore time), which is the only reason why I'm looking at hosting it myself, other than that it works great.
It always becomes unable to load for a while, then fixes itself magically

How would your idea work?
Self explanatory I hope
Do you have any examples of how you would like to see us implement it?
<SandpackProvider template="react-ts" bundlerURL: "https://your-hosted-version">

Okay for anybody who comes in the future - I've found the option - it's as below:
<SandpackProvider
        template="react-ts"
        //TODO: Host our own bundler
        options={{
          bundlerURL="XXX"
        }}
      >

Hey @PhilipWee, glad you managed it!
How did you find it? How can we make this clearer in the documentation?
Thanks


Regarding the issue of training interruption and continued training, resulting in a decrease in accuracy

Thank you for your very diligent work. This project has greatly benefited me!
I found that during the model training process, if the checkpoint file that was previously saved is interrupted and reloaded to continue training, even if the model parameters and optimizer parameters are reloaded, the model accuracy will show a downward trend in the early stages of training or even for a relatively long epoch, and finally gradually increase.
Observing the code, I think it may be due to the fluctuation in learning rate caused by the use of cosine lr mechanism despite the recovery of optimizer parameters, and the initial high learning rate. I don't know if it's because of this or other issues.

Hi, would you please provide us more detailed information about which config file you use?
In addition, would you please provide us the checkpoint? Thus, we can reproduce this issue for analysis.

Hi, would you please provide us more detailed information about which config file you use?
In addition, would you please provide us the checkpoint? Thus, we can reproduce this issue for analysis.

Thank you very much for your kind reply.
I think I found the problem, I think it is the change in the calculation of the learning rate that I want to increase the number of Thank you very much for your kind reply.
I think I found the problem, I think it should be that when I continue training, I want to increase the number of epochs trained, which leads to changes in the calculation of the learning rate, which in turn reduces the accuracy of the initial training of the model.
If epoch does not change, the above problem will not occur.

Hi, would you please provide us more detailed information about which config file you use?
In addition, would you please provide us the checkpoint? Thus, we can reproduce this issue for analysis.

Thank you very much for your kind reply.
I think I found the problem, I think it should be that when I continue training, I want to increase the number of epochs trained, which leads to changes in the calculation of the learning rate, which in turn reduces the accuracy of the initial training of the model.
If the expected epoch does not change, the above problems will not occur.


[gha] use matches and changes actions from diem/actions

Motivation
These github actions are useful to re-use across repos. Store these in diem/actions so we can reference them.
Have you read the Contributing Guidelines on pull requests?
Yes
Test Plan
Steps that use matches and changes pass
Related PRs
https://github.com/diem/actions/pull/14

/land

/land

@rustielin :bulb: This PR is already queued for landing

/cancel

/land


Fix config option 'no-deprecated'

crypto/asn1/asn1_item_list.c needed including dh.h and rsa.h directly.
The reason is that they are not included by x509.h when configured
'no-deprecated'

Merged (only into master, the affected file and thereforeissue doesn't exist on 1.1.0)


Add location info

I will be great to have location info in attribiutes. Can you add this?

Sadly, this is not possible... The Google api doesn't expose location information, and the exif information has been stripped from any location details.

Oh... It's not good news...

Yeah indeed. If you want, you can voice your opinion with the others, but don't expect it to change soon.
https://issuetracker.google.com/issues/80379228


Fix its

PR summary
This PR modifies a couple of failing integration tests to try to get a clean master branch build.
PR Checklist
Please make sure that your PR fulfills the following requirements:

[ ] The commit message follows the Angular Commit Message Guidelines.
[ ] Tests for the changes have been added (for bug fixes / features)
[ ] Docs have been added / updated (for bug fixes / features)

PR Type

[ ] Bugfix
[ ] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] New tests
[ ] Build/CI related changes
[ ] Documentation content changes
[ ] Other (please describe)

What is the current behavior?

What is the new behavior?

Does this PR introduce a breaking change?

[ ] Yes
[ ] No

Other information

:tada: This PR is included in version 0.9.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Feature Request: Allow encoding/other operations on fuzzing input

It would be great if ffuf could allow the user to encode/perform other operations on the fuzzing input, just like burp suite intruder.
This could be used for Basic authorization bruteforcing for instance. The user could pass two lists and do base64 encode on fuzz_input_1:fuzz_input_2

Currently, ffuf is written completely against the Go standard library, with zero external dependencies. For multiple reasons, I prefer trying to keep it like that if not completely necessary.
Furthermore, this functionality can already be achieved with --input-cmd by writing a short shell script that reads two wordlists and creates those base64 values for ffuf to use.
The ffuf command would look something like:
ffuf --input-cmd 'basic_auth.sh' -u https://example.com/auth -H 'Authorization: Basic FUZZ' ...

That said, it would probably make sense to create a library of different payload generators that are designed for the --input-cmd in mind. What do you think about this approach?

@joohoi keep simple I think it’s a very important point, against that ffuf would be a framework, complex and doing all things who can be confusing and slow
About “ --input-cmd” I think is perfect, maybe we can do some samples for people, but I have a question about “FUZZ” keyword, can we combine that with another wordlist or customize input-cmd keyword?
If yes I think is complete

Absolutely, the --input-cmd can be combined with other wordlists / keywords, and supports custom keyword assignation as well.
Another way of achieving this is reading the base64 values from stdin, so you can have a script creating the values, printing them out one value per line and just pipe it:
./basic_auth.sh | ffuf -w - -u https://example.com/auth -H 'Authorization: Basic FUZZ' ...

TL;DR: if you provide - as an argument to -w, the inputs are read from stdin.

Jesus Christ @joohoi 😍
@Ice3man543 you think this can support what you need? Some encoder that you need now?

@joohoi @bsysop I think that'd be good enough for my use case. If you could add sample scripts it'd be much appreciated! But this approach looks good to me!

I could do that a bit later!
@joohoi just send here or wanna share in specific place?

I actually ended up writing one, and creating a new repository for this and other scripts that help in payload generation: https://github.com/ffuf/ffuf-scripts using the basic authentication payload generating script as an example.

@joohoi excellent, that's exactly what i needed. The ffuf-scripts repo will be a goldmine i believe. Thanks for working on it. Closing the issue now!

I actually ended up writing one, and creating a new repository for this and other scripts that help in payload generation: https://github.com/ffuf/ffuf-scripts using the basic authentication payload generating script as an example.

Hey @joohoi that script is still maintained? Just one question: could be better if you invert at the end of the script on the nested loop the user and the password in order to test N usernames for one password, instead of 1 username for M passwords? Could be more efficient mostly for cases where the password wordlist is much bigger than username list (that is the most probable case). Thanks

So much information here! I think these info should be included into the wiki!


PR for gh20 - ut control panel

Blackduck scan failure details
Summary: 0 violations, 0 files pending approval, 2 files pending identification.

Protex Server Path: /home/blackduck/github/ut-core/52/rdkcentral/ut-core

Commit: 4773270b547f36357dfbe038aeaf116f79ee4d43

Report detail: gist

Blackduck scan failure details
Summary: 0 violations, 0 files pending approval, 2 files pending identification.

Protex Server Path: /home/blackduck/github/ut-core/52/rdkcentral/ut-core

Commit: c5e8cc94803f079061c789aadbcadb9a47e9b283

Report detail: gist

Hi Jyostna: Two code matches here but both files are generated (lws_config.h, lws_config_private.h) - both refer to .in files.  Please confirm that the .in files are original to you, in which case I will ignore the matches.
If you are using the libwebsockets framework with this work, please add a note to NOTICE for acknowledgement, something like:
This repository make use of the libwebsockets framework, which is licensed under the MIT License,
https://libwebsockets.org/git/libwebsockets/tree/LICENSE

Thank you.

Blackduck scan failure details
Summary: 0 violations, 0 files pending approval, 2 files pending identification.

Protex Server Path: /home/blackduck/github/ut-core/52/rdkcentral/ut-core

Commit: 584e26e9cc11508626654bbb85f23d2525579200

Report detail: gist

Hi Jyostna: Two code matches here but both files are generated (lws_config.h, lws_config_private.h) - both refer to .in files. Please confirm that the .in files are original to you, in which case I will ignore the matches.
If you are using the libwebsockets framework with this work, please add a note to NOTICE for acknowledgement, something like:
This repository make use of the libwebsockets framework, which is licensed under the MIT License,
https://libwebsockets.org/git/libwebsockets/tree/LICENSE

Thank you.

Sure, I have added it to NOTICe now.Thanks for the input. 👍

Thanks Jyostna.  What about my question to do with the "in" source files - are these original to you?

Thanks Jyostna. What about my question to do with the "in" source files - are these original to you?

No these are not original to me. They are required to build the libwebsockets file, but are not available in the include folder of source code and needs to be generated by building their repo. I copied these files for my convenience.
Ignore these as of now, as we are planning to drop libwebsockets library as a whole.

Hi Jyostna: I see that NOTICE has been changed again.  There is not a problem using libwebsockets, or the two "in" files.  If they come from libwebsockets and the originals don't have copyrights, this is OK.
However, there may be a problem with wsServer because it is GPLv3 licensed.  There must not be any GPLv3 licensed material in rdkcentral repos.  Also, how are the executables produced - in the past RDK Management have been very particular about any GPLv3 inclusions.  (Specifically, any GPLv3 material has to be enabled via local configuration which we never enable.)  This application may be for unit test only so executables never go anywhere - please let me know so I can discuss with RDK-Management.

Hi Jyostna: Many thanks for doing this!

Related to https://github.com/rdkcentral/ut-control/pull/2

lets have a sync

for sure 👍


FF scoping other that users and user groups, labels?

[Enter feedback here]
What would your suggestion when FF are scoped to entitles different than users or groups of users?
Main entity in our app is a "product" and there are number of users who are managing different products.
An example
in our app we have 200+ products what are commercial entities. For each product our app helps users to manager their infrastructure. For each product we might want to allow users to access certain functionality. F.e. Show github connect button in product A but do not show it in product B.
The only option I see now is to use label as a differentiator to have the save feature enabled for one product but disabled in another so the same user could see button in product A but will not see in product B.
Filtering does not seem to be a good match because it has only users and groups of users.
Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: e89c8e11-d8bf-7c62-1bd2-bfaf145d20ae
Version Independent ID: cac9d257-3328-0ed7-fa73-22be44bf84c5
Content: Understand feature management using Azure App Configuration
Content Source: articles/azure-app-configuration/concept-feature-management.md
Service: azure-app-configuration
GitHub Login: @AlexandraKemperMS
Microsoft Alias: alkemper

a sub question here could be, how many labels I can use? Are there limits? if it was planned for a environment differentiation then you could have some hard limits like 50 or so. The number of products we might have are 400+

Thanks for the question! We will review and get back to you shortly.

You can add custom filters to features, but labels also work fine. For your scenario, labels are likely to be easier to manage than custom filters, especially if you need to edit them often. There are two limitations on standard tier that would apply. These are related to storage size, not on the number of items stored.

Each Key-Value pair can be no bigger than 10KB. I did verify that each label is considered a separate Key-Value pair so you could have 100 different 1KB values for the same key as long as each value has different labels.
The total size of the data can not go beyond 1GB. A feature flag is going to be small, unless you have a large amount of data saved as a custom filter, so you should be fine here based on what you described.

@SamaraSoucy-MSFT
Thank you again, for a timely response.


consensus: handle justification sync for blocks authored locally

When importing new blocks different consensus engines might require that finality data is provided for that block (i.e. a justification), or it might require that existing requests for justifications are dropped. This is signalled as part of the ImportAux object that is part of ImportResult::Imported and is handled by the import queue, i.e. after importing blocks the import queue will check ImportAux and issue justification requests to the sync module.
When authoring blocks (through slot worker or pow miner) the blocks are imported directly without going through the import queue, in which case any required justification handling was ignored. This PR makes all existing block authoring handle justification requirements similarly to the import queue.
Fix #4678.
polkadot companion: https://github.com/paritytech/polkadot/pull/2956

bot merge


fix(cloudformation-diff): track replacements

Track second-order effects of resource replacements through references.
If a resource gets replaced and it's referenced by some other resource
in an immutable field, that resource gets replaced as well, and so on.
ALSO IN THIS COMMIT

Configure lerna to not update package-lock.json on every bootstrap.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache-2.0 license.
Fixes #1001.

The method I employ is: cheating.
By physically changing the references to replaced resources the regular replacement rules have a chance to kick in.
The resulting template is not correct anymore but wr don't care (?)


update: stream example for future reference

How about providing a stream example for beginners?

+1 @KLVTZ.
I started adding examples in separate files in the "examples" directory.  See https://github.com/desmondmorris/node-twitter/blob/master/examples/favorites.js.  Would you mind throwing this into examples/stream.js?

Happy to #61