Latest version reports mutants as killed when they haven't run because of a runner error

I've installed the latest version and have a simple function:
function addOne(a) {
    var b = 1;
    return a + b;
}

And the unit test:
describe('Validator class', function () {
    it('adds 1', function () {
        expect(addOne(10)).toBeTruthy();
    });
});

If I understand correctly, this mutant should not be marked killed since the mutation a - b still will be truthy, so the unit test doesn't fail (and a good unit test should fail).
I found the issue after messing about in the code. If I change IsolatedTestRunnerAdapter.js and change "silent: false" to "silent: true" I can see a lot more useful output that isn't displayed even with logLevel all.
The initial unit tests are run correctly. If I make a failing unit test, it will report that the initial run failed.
FYI I faked the cpu count to 1 for less output, but it also doesn't work with 8 cpu's.
I see something like this:
22 07 2016 12:05:04.105:INFO [karma]: Karma v1.0.0 server started at http://localhost:9231/
22 07 2016 12:05:04.105:INFO [launcher]: Launching browser PhantomJS with unlimited concurrency
22 07 2016 12:05:04.113:INFO [launcher]: Starting browser PhantomJS
22 07 2016 12:05:05.863:INFO [PhantomJS 2.1.1 (Windows 7 0.0.0)]: Connected on socket /#sxiwMmWUhn7RLDb-AAAA with id 16944920
22 07 2016 12:05:06.013:INFO [KarmaTestRunner]: karma run done with  0
[2016-07-22 12:05:06.078] [INFO] Stryker - Initial test run succeeded. Ran 1 tests.
[2016-07-22 12:05:06.095] [INFO] Stryker - 1 Mutant(s) generated
[2016-07-22 12:05:06.098] [INFO] TestRunnerOrchestrator - Creating 1 test runners (based on cpu count)

But then after generating the mutants and trying to run the mutants, I see this:
[2016-07-22 12:05:07.627] [INFO] KarmaTestRunner - using config {"browsers":["PhantomJS"],"frameworks":["jasmine"],"autoWatch":false,"single
Run":false,"detached":false,"files":[{"pattern":"C:\\projects\\mobile-contract-registration\\Web\\App\\.stryker-tmp\\1855138\\test-runner-fi
les8462187\\___testSelection.js","included":true},{"pattern":"C:\\projects\\mobile-contract-registration\\Web\\App\\.stryker-tmp\\1855138\\t
est-runner-files8462187\\src\\directives\\glnlValidate\\Validator.js","included":true},{"pattern":"C:\\projects\\mobile-contract-registratio
n\\Web\\App\\.stryker-tmp\\1855138\\test-runner-files8462187\\src\\unittests\\Validator-spec.js","included":true},{"pattern":"C:\\projects\\
mobile-contract-registration\\Web\\App\\.stryker-tmp\\1855138\\test-runner-files8462187\\src\\directives\\glnlValidate\\Validator.js","inclu
ded":true}],"port":9231}
Msgggg  { type: 3, body: { runOptions: { timeout: 5178.5 } } }
Running
22 07 2016 12:05:07.930:INFO [karma]: Karma v1.0.0 server started at http://localhost:9231/
22 07 2016 12:05:07.932:INFO [launcher]: Launching browser PhantomJS with unlimited concurrency
22 07 2016 12:05:07.939:INFO [launcher]: Starting browser PhantomJS
**No captured browser, open http://localhost:9231/**
22 07 2016 12:05:07.961:INFO [KarmaTestRunner]: karma run done with  1

I messed around a little with ports and such to try to get it to work, but no such luck.
Then I tried changing KarmaTestRunner.js to use Chrome instead of PhantomJS. The initial test run will then run in Chrome and that still works correctly, but then I still get "No captured browser".
So the issue is twofold.
First of all, "No captured browser" basically results in all mutants being killed because the unit test itself isn't actually running, but some other error occurs, namely:
[TypeError: Cannot read property 'error' of null]
No clue where this error occurs. Anyway, when running the test fails like this, it should not report the mutants as killed.
But I would like to solve this issue as well of course. Does anyone have any clue why the initial test run goes fine, but running the mutants returns "No captured browser"? Could be an issue with Karma, but I just don't understand why the initial run is fine and then it fails. Any help would be greatly appreciated.

@Kimpossibru Thanks for your extensive issue
Could you please provide me with version information on your stryker dependencies? This command should do the trick:
npm ls | grep stryker

The reporting of errors as killed was a recent, but deliberate, addition (#120). When creating mutants right now, we might create type errors.
@simondel maybe we should change this behavior? Can we make sure we are not creating type errors when creating mutants?

@nicojs thanks for your quick response. I've run the command and this is the output:
+--<EMAIL_ADDRESS>+--<EMAIL_ADDRESS>+--<EMAIL_ADDRESS>`--<EMAIL_ADDRESS>
I've uploaded the workspace as well: bart-stryker.zip
To run it:
npm install
node node_modules/stryker/bin/stryker -c stryker.conf.js

Output will say:
2 mutants tested.
0 mutants untested.
0 mutants timed out.
2 mutants killed.
Mutation score based on covered code: 100.00%
Mutation score based on all code: 100.00%

Whereas one mutation should be killed and one should not.
The a - b mutation should not be killed since a - b and a + b are both truthy if a is 10 and b is 1.
The block statement mutation should be killed since an empty function will not return something truthy. A nice way to find more output is setting silent: false in IsolatedTestRunnerAdapter.js, this will then again say:
22 07 2016 13:44:31.698:INFO [launcher]: Starting browser PhantomJS
No captured browser, open http://localhost:9241/
22 07 2016 13:44:31.730:INFO [KarmaTestRunner]: karma run done with  1

Found out what the issue was. We've been working hard on the 0.4 release and, apparently, i still had 1 commit in the testrunner-lifecycle branch (should have been in the #125 PR...). I created a new PR for this: #132. After a final review, i'll merge it and create a new release

Awesome, I tried it locally and that fixes it. Thanks!

New release done, v0.4.1
Basically what happens is that we send the run command to karma before it had to time to be initialized.
This initialization step was a new addition. Now we wait for initialization to be fully completed before we start to run tests. It should result in less false positives.
Btw: you can also enable test output with --logLevel trace (command line) or logLevel: 'trace' (config file)

@simondel Do you think we should add an issue to handle errors during mutation run differently? Seems a lot safer.

@nicojs How would you know the difference between a 'good' error (one caused by a mutation) and a bad one? (like in this case)


Configure Azure Pipelines

This pipeline configuration builds the application and produces a build for the Release configuration.

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.:x: ashley1973 sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.


can you use sentinel?

in place of sentry?

No, sorry.

Sentry works fine. I have no reason to change.


Make ceph-client an item on services list

Run the edpm_ceph_client_files EDPM Ansible role only if ceph-client is on the services list. This will undo a previous commit [1] where the same role would run only if there was an extraMounts item with Ceph as the extraVolType.
[1] 5ebd8ad49a6b674c930b24f28f3da4656ac088ef
Jira: OSP-25826

not required for this PR, but it would be nice to document the ceph service here: https://openstack-k8s-operators.github.io/dataplane-operator/composable_services/

I will do that in this patch.

not required for this PR, but it would be nice to document the ceph service here: https://openstack-k8s-operators.github.io/dataplane-operator/composable_services/

done.
https://github.com/openstack-k8s-operators/dataplane-operator/compare/be0a90eb9a6626f779e13aef77014ce96a2b8fee..17819a808d6ecbf66babb931aa98eaa44ff3ca5a

/lgtm

/override rdoproject.org/github-check

/test dataplane-operator-build-deploy-kuttl


Incorrect error message with malformed Fn::Invoke

Oddly, if I have the following:
name: pulumi-ansible-wordpress
runtime: yaml
description: Deploy an EC2 Wordpress server using Pulumi and Ansible.

configuration:
  publicKeyPath:
    type: String
    required: true
  privateKeyPath:
    type: String
    required: true
  dbInstanceSize:
    type: String
    default: db.t3.small
  dbName:
    type: String
    default: wordpressdb
  dbUsername:
    type: String
    default: admin
  dbPassword:
    type: String
    required: true
  ec2InstanceSize:
    type: String
    default: t3.small

variables:
  # Dynamically fetch AZs so we can spread across them.
  availabilityZones:
    Fn::Invoke:
      Function: aws:getAvailabilityZones
  # Dynamically query for the Amazon Linux AMI in this region.
  awsLinuxAmi:
    Fn::Invoke:
      function: aws:ec2:getAmi
      arguments:
        filters:
          - name: name
            values: ["amzn-ami-hvm-*-x86_64-ebs"]
        owners: ["137112412989"] # Amazon
        mostRecent: true

...

I get the following error: error: failed to discover plugin requirements: Pulumi.yaml:8,5-13: Field 'required' does not exist on Object 'configuration.publicKeyPath'; Existing fields are: 'secret', 'type', 'default', and 3 other diagnostic(s).
The thing is this seems to have nothing to do with the real problem. The problem is that the second Fn::Invoke uses lowercase function and argument properties. They need to be uppercase, as in Function and Argument.
Indeed, fixing that makes the seemingly unrelated error go away!

As mentioned in https://github.com/pulumi/pulumi/issues/9890, required is not a valid property, so the error is legit. You can also see and 3 other diagnostic(s) which hides your actual error. Once I fix the required warnings, I get could not load yaml program: failed to load the template: Pulumi.yaml:35,7-41,25: missing function name ('Function'); missing function name ('Function').
I suppose we can use this issue to track improvements to error presentations. Why do we need to hide the warnings under "and 3 other diagnostic(s)"? Can we sort the diagnostics so that errors are ahead of warnings?

I think after landing the fix to #253 in PR #258, we should show all diagnostics.


Automated Package Upgrade

:tada: This PR is included in version 5.0.194 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


[SPARK-30721][SQL] fix DataFrameAggregateSuite when enabling AQE

What changes were proposed in this pull request?

update DataFrameAggregateSuite to make it pass with AQE
Why are the changes needed?

We don't need to turn off AQE in DataFrameAggregateSuite
Does this PR introduce any user-facing change?

no
How was this patch tested?

run DataFrameAggregateSuite locally with AQE on.

cc @maryannxue @JkSelf

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/117832/
Test FAILed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/22594/
Test PASSed.

retest it please

retest this please

Test build #117882 has started for PR 27451 at commit 0ec27c4.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/22644/
Test PASSed.

Test build #117882 has finished for PR 27451 at commit 0ec27c4.

This patch fails due to an unknown error code, -9.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/117882/
Test FAILed.

retest this please

Test build #117926 has started for PR 27451 at commit 0ec27c4.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/22689/
Test PASSed.

Test build #117926 has finished for PR 27451 at commit 0ec27c4.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/117926/
Test PASSed.


Valid history strategy

Description
This PR adds full support for valid_history incremental strategy.
This PR also contains test for valid history as a a full real-time project
Checklist

[ ] I have run this code in development and it appears to resolve the stated issue
[ ] This PR includes tests, or tests are not required/relevant for this PR
[ ] I have updated the CHANGELOG.md with information about my change

@VarunSharma15 , Can you please add an testcase/model with  use_valid_to_time='yes'


Workbook v1.1 / Improved Queries

Added checks for Compute, Storage and Networking.
Also added "quick fix" for Idle Disks.

🛠 Description
Added new features to workbook for Compute, Networking and Storage.
Improved filter by tag.
Added "quick fix" to Idle disks.
Fixes #(issue)
NA
🔬 How has this been tested?

[ ] 🫰 PS -WhatIf / az validate
[ x] 👍 Manually deployed + verified
[ ] 💪 Unit tests

This is a really big change. We should come up with a plan for how to make workbook PRs easier to review. Maybe that just means smaller PRs for now. So much changes there's pretty much no traceability back to older states. We should also talk to the workbook team to see if they have a solution to that.


Do not allow repeated hosts for the same role

Wrote a function to manage hosts: if a host doesn't have 'campaign target' and doesn't have 'Fault injector target', it gets deleted.


Wallet is unable to connect after upgrade

I updated my Phoenix wallet to the new version (2.0.2) and upgraded the wallet itself.
After the upgrade, Phoenix was unable to connect to the network, and saying no internet connection is available, although there is an internet connection in the android device.
I tried to uninstall Phoenix and restore the wallet, and now the app hangs on the "Checking legacy wallet..." screen forever.

Same here

What version of android are you running, and on what device? Are you using a VPN, or a public WiFi (like an hotel/airport/work)?
From this same device, on a browser, can you try accessing this url? https://acinq.co/phoenix/walletcontext.json

I'm using Pixel 4a with Android 13. No VPN, no pubic WiFi.

From this same device, on a browser, can you try accessing this url? https://acinq.co/phoenix/walletcontext.json

When I'm trying to access this url I get Cloudflare captcha page, and need to click the captcha to get the json file. So maybe this is the problem?

Yes, this issue is related to that resource. We are fixing this in the next release. Thanks for your patience

Fixed for me


Adding Github Action workflow for gosec check

Overview
This PR adds the Github Actions workflow to perform a SAST analysis of the Golang project code.
Rollback
Remove the file or fail the PR.
Checklist

[x] PR subject line is prefixed with a ticket ID
[x] PR has a label set

The gosec failure is expected as no Golang project files have been added.  It shows the workflow is working properly.


[Jenkins Source] Github OAuth

Hey guys,
We use Github oauth in Jenkins, therefore, configuring a source with user and API token is not possible for me.
Also - Jenkins jobs and builds can be accessed by non-authenticated users.
Any idea what can I do to use this source?

Are you suggesting that making API key authentication requirement optional would work for you?

Hey @tovbinm
Yep, it will definitely solve my issue

@tovbinm I created this PR, lmk wdyt:
https://github.com/faros-ai/airbyte-connectors/pull/871

Released in https://github.com/faros-ai/airbyte-connectors/releases/tag/v0.4.52

Thank you for the contribution @konfortes


Adición de un dato acerca de capturar excepciones

Se agregó el dato de que se pueden capturar n excepciones.

[x ] I have read freeCodeCamp's contribution guidelines.
[ x] My pull request has a descriptive title (not a vague title like Update index.md)
[ x] My pull request targets the master branch of freeCodeCamp.
[ x] None of my changes are plagiarized from another source without proper attribution.
[ x] My article does not contain shortened URLs or affiliate links.

If your pull request closes a GitHub issue, replace the XXXXX below with the issue number.
Closes #XXXXX

Thank you for your contribution to the page! 👍
We're happy to accept these changes, and look forward to future contributions. 🎉


TC.3.2 All users should be redirected

b858b420e58b3a77886044d8f59b48e2df55c1c6

This task has been finished on the day with posted SHA comment, in the interest of correctly closing the issue (and us having to first learn how to), it has been closed a while after the finishing of the task.

We have in the meantime figured out, that we can not correctly close it once it is done (otherwise the commit is kinda useless).


Images dragged from a browser and drop to obsidian md doesn't get saved to local

Repro steps:

Install this plugin and enable it
Open Edge/Safari(Chrome somehow doesn't support drag and drop to obsidian, not sure if it is an Obsidian bug)
open a page with images in the browser (e.g. https://github.com/Sergei-Korneev/obsidian-local-images-plus/tree/main)
drag an image (like in the description) and drop it to obsidian
the link of the image stay as remote link without being converted to local path

Images being pasted work though.
My environment

Microsoft Edge Version 118.0.2088.61 (Official build) (x86_64)
macOS Version 14.0 (23A344)
Obsidian Version 1.4.16 (Installer 1.4.16)

My Guess
I checked the code and noticed that editor-drop event wasn't registered. Not sure if it is the cause.

2. Chrome somehow doesn't support drag and drop to obsidian

It does. For example on Linux.   The behavior  varies from OS to OS (probably something related browser engines)

Chrome somehow doesn't support drag and drop to obsidian

It does. For example on Linux. The behavior varies from OS to OS (probably something related to browser engines)

like in the description

the description is about local files (disk files)

Thanks! Are you able to reproduce the bug?


Resolve config loading issues

Depends on https://github.com/GeyserMC/Floodgate/pull/507

Does this work for 1.20.4? Thanks.

no, it'll just be for 1.20.5/6 and onwards


Improve Item request processing

Currently the addon isn't correctly tracking when an item doesn't exist. This is causing an excessive number of item info queries when logging in, since the same items are being checked repeatedly.
Testing was done on Classic Era, logging in for the first time after restarting the game.
Before changes, I recorded 242 GET_ITEM_INFO_RECEIVED events over ~85 seconds when the addon loads.
After changes, I recorded 30 GET_ITEM_INFO_RECEIVED events over ~5 seconds when the addon loads.
I've also tested changes on Wrath, but not Retail. As far as I know, the ItemMixin API is unchanged in all game versions.

Thank you!


Segmentation fault upon installing service_identity

I'm using the following:
user@garage2:/$ pip3 --version
pip 9.0.1 from /usr/lib/python3/dist-packages (python 3.6)
user@garage2:/$ python3 --version
Python 3.6.5

This is the output:
user@garage2:~/$ pip3 install --user service_identity
Collecting service_identity
  Using cached https://files.pythonhosted.org/packages/29/fa/995e364220979e577e7ca232440961db0bf996b6edaf586a7d1bd14d81f1/service_identity-17.0.0-py2.py3-none-any.whl
Collecting pyopenssl>=0.12 (from service_identity)
  Using cached https://files.pythonhosted.org/packages/96/af/9d29e6bd40823061aea2e0574ccb2fcf72bfd6130ce53d32773ec375458c/pyOpenSSL-18.0.0-py2.py3-none-any.whl
Collecting attrs (from service_identity)
  Using cached https://files.pythonhosted.org/packages/3a/e1/5f9023cc983f1a628a8c2fd051ad19e76ff7b142a0faf329336f9a62a514/attrs-18.2.0-py2.py3-none-any.whl
Collecting pyasn1 (from service_identity)
  Using cached https://files.pythonhosted.org/packages/d1/a1/7790cc85db38daa874f6a2e6308131b9953feb1367f2ae2d1123bb93a9f5/pyasn1-0.4.4-py2.py3-none-any.whl
Collecting pyasn1-modules (from service_identity)
  Using cached https://files.pythonhosted.org/packages/19/02/fa63f7ba30a0d7b925ca29d034510fc1ffde53264b71b4155022ddf3ab5d/pyasn1_modules-0.2.2-py2.py3-none-any.whl
Collecting cryptography>=2.2.1 (from pyopenssl>=0.12->service_identity)
  Using cached https://files.pythonhosted.org/packages/59/32/92cade62c645756a83598edf56289e9b19aae5370642a7ce690cd06bc72f/cryptography-2.3.1-cp34-abi3-manylinux1_x86_64.whl
Collecting six>=1.5.2 (from pyopenssl>=0.12->service_identity)
  Using cached https://files.pythonhosted.org/packages/67/4b/141a581104b1f6397bfa78ac9d43d8ad29a7ca43ea90a2d863fe3056e86a/six-1.11.0-py2.py3-none-any.whl
Collecting cffi!=1.11.3,>=1.7 (from cryptography>=2.2.1->pyopenssl>=0.12->service_identity)
  Using cached https://files.pythonhosted.org/packages/6d/c0/47db8f624f3e4e2f3f27be03a93379d1ba16a1450a7b1aacfa0366e2c0dd/cffi-1.11.5-cp36-cp36m-manylinux1_x86_64.whl
Collecting idna>=2.1 (from cryptography>=2.2.1->pyopenssl>=0.12->service_identity)
  Using cached https://files.pythonhosted.org/packages/4b/2a/0276479a4b3caeb8a8c1af2f8e4355746a97fab05a372e4a2c6a6b876165/idna-2.7-py2.py3-none-any.whl
Collecting asn1crypto>=0.21.0 (from cryptography>=2.2.1->pyopenssl>=0.12->service_identity)
  Using cached https://files.pythonhosted.org/packages/ea/cd/35485615f45f30a510576f1a56d1e0a7ad7bd8ab5ed7cdc600ef7cd06222/asn1crypto-0.24.0-py2.py3-none-any.whl
Collecting pycparser (from cffi!=1.11.3,>=1.7->cryptography>=2.2.1->pyopenssl>=0.12->service_identity)
Installing collected packages: six, pycparser, cffi, idna, asn1crypto, cryptography, pyopenssl, attrs, pyasn1, pyasn1-modules, service-identity
Successfully installed asn1crypto-0.24.0 attrs-18.2.0 cffi-1.11.5 cryptography-2.3.1 idna-2.7 pyasn1-0.4.4 pyasn1-modules-0.2.2 pycparser-2.19 pyopenssl-18.0.0 service-identity-17.0.0 six-1.11.0
Segmentation fault (core dumped)

Update your pip and try this again. I suspect this is a (long fixed) pip bug.

@reaperhulk yup, true


Xamarin Forms SKGLView not rendering on iOS

Hi
I have a Xamarin.Forms project that renders a 2D map inside a container. The map itself uses an SKCanvasView control to do its drawing, and this works well on iOS, Android and UWP.
I want to switch to an SKGLView to improve performance. The two APIs are almost identical so it's easy to swap in one for the other, and this works on Android and UWP to good effect. The performance boost on Android is particularly significant.
However when I run the same code on iOS I get a black screen and the following error:

Failed to bind EAGLDrawable: <CAEAGLLayer: 0x1c2a3b840> to GL_RENDERBUFFER 1
Failed to make complete multisample framebuffer object 8cd6
Failed to make complete framebuffer object 8cd6

As far as I can tell, this has something to do with rendering on a view that isn't visible, so I've hooked in to Xamarin.Forms OnAppearing and OnDisappearing events to attempt the render only when the view is visible, however it doesn't help.
I don't know if my understanding of the problem is correct, or if it is, are there better ways to solve it. Could you perhaps suggest something?
Thanks

VS bug #770232

I know this is a very old issue, but does anyone know if this is still happening? Does this happen with .NET MAUI.


Created setting for rescaling the timelapse video. This can be helpfu…

This can be helpfull for RPiHQ camera images. (See issue https://github.com/thomasjacquin/allsky/issues/255 and https://github.com/thomasjacquin/allsky/issues/249)

Thank you! I was planning on adding the scale argument at some point but never got the time. I like your use of the config file for that.

Thank you! I was planning on adding the scale argument at some point but never got the time. I like your use of the config file for that.

Tanks for merging! Keep up the good work on this awesome software!

Tanks for merging! Keep up the good work on this awesome software!


Archived repository removed?

Just found out some of deprecated/archived Homebrew taps are entirely removed from GitHub. For example, my personal https://github.com/tomyun/Homebrew-games was once forked from https://github.com/Homebrew/Homebrew-games, but then now it shows up as if it was forked from https://github.com/ziz/homebrew-games which I didn't have any relations.
It's quite astounding that Homebrew decided to erase a part of its history and permanently remove access to old issues/PR which could have been useful for reference. I appreciate your hard work on moving the project forward and totally understand you sometimes need to leave something out, but it's hard to see good reasonings for what just happened this time. As I no longer have access to Slack channel since a while ago, could someone explain how it's been planned for what reasons?

These were removed but these repositories were still showing up and causing issues in bug reports and user errors.
Please always read/fill in the issue template which would direct questions like this to Discourse.


🚀 [Feature Request] - Adding a interactive FAQ section

Is your feature request related to a problem ? Please describe. ✍
Enhancement: Adding an FAQ section
Description
Many Websites have a section of "Frequently asked questions (FAQ's)" sections that highly contributes in improving user-experience. I would really love to contribute by adding and interactive and responsive FAQ section.
Proposed Functionality

A FAQ section that display questions and their answers using accordion functionality.
Users and view the answers of desired FAQ's by clicking on an arrow.

Describe briefly how you would implement this enhancement.
Some steps to implement this enhancement-
1. Step 1: Define an array of objects that holds the questions and answers for the FAQ section.
2. Step 2: Create a new FAQ Accordion component in React.
3. Step 3: Use useState to handle the open/close state of each accordion item.
4. Step 4: FAQ data as props.
5. Step 5: Use Tailwind CSS to style the accordion for a clean and responsive layout
6. Step 6: Import and use the FAQ Accordion component in the required page.

Additional context or screenshots

Please assign me this issue under gssoc'24 extd and hacktoberfest.
Are you contributing for a program?
GSSoC2023, Other
Code of Conduct

[X] I have read and agree to the Contributing Guidelines of this project.

Hmm, not needed but yeah i suggest a issue to you , can you update this github action to gssoc24?

@Devaki01


Specify the current default value for TAILWIND_CLI_DIST_CSS

Also fix minor typos.

Thanks for your contribution.

@oliverandrich, thank you for reviewing and merging this PR. I still see that this project's documentation, hosted at django-tailwind-cli.andrich.me, doesn't yet have these changes. So can you rebuild the docs and deploy these changes?

Just released an update and updated the webpage.


FIN-440: Migrate AddPageMarker and add ClickPublishReliably.

FIN-440

Any news? When will this be completed?


hdf5-blosc: init at 1.0.0

Motivation for this change
This is a library/plugin used for the HDF5 data model utilities that integrates the high-throughput BLOSC compression scheme.
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

This is a semi-automatic executed nixpkgs-review which does not build all packages (e.g. lumo, tensorflow or pytorch)
If you find some bugs or got suggestions for further things to search or run please reach out to SuperSandro2000 on IRC.
Result of nixpkgs-review pr 109326 run on x86_64-linux 1

1 package built:

hdf5-blosc

This is a semi-automatic executed nixpkgs-review which does not build all packages (e.g. lumo, tensorflow or pytorch)
If you find some bugs or got suggestions for further things to search or run please reach out to SuperSandro2000 on IRC.
Result of nixpkgs-review pr 109326 run on x86_64-linux 1

1 package built:

hdf5-blosc


clangd is not found

When try it on fedora35 workstation, got error for clangd not found, and failed to auto format when save file.
Found it need install clang-extra-tools.
建议在install/fedora.sh里面添加安装语句.

sudo dnf install -y clang-extra-tools 这个可以么？

嗯, 可以

ok已经改了


Create documentation site

This has been addressed by #38, but I'm leaving it open until #39 is closed.

Closing now that #39 is wrapped up.


Removed Machine group references

Removed Machine group references

Removed Machine group references

Checking this option will execute the PowerShell in-parallel on all VMs in the Resource Group.
The option to run deployment in parallel has above help string. Do you want to change "Resource group" as "target machine" to be consistent with what you have added in Copy task?


onefetch: 2.18.0 -> 2.18.1

Diff: https://github.com/o2sh/onefetch/compare/2.18.0...2.18.1
Changelog: https://github.com/o2sh/onefetch/blob/v2.18.1/CHANGELOG.md
Description of changes

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[x] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 239655 run on x86_64-linux 1

1 package built:

onefetch


Rebuild for r-base 4.4 and UCRT mingw toolchain

Hi! This is the friendly automated conda-forge-linting service.
I just wanted to let you know that I linted all conda-recipes in your PR (recipe/meta.yaml) and found it was in an excellent condition.
I do have some suggestions for making it better though...
For recipe/meta.yaml:

No valid build backend found for Python recipe for package reasonable using pip. Python recipes using pip need to explicitly specify a build backend in the host section. If your recipe has built with only pip in the host section in the past, you likely should add setuptools to the host section of your recipe.

The previous dependency resolution failure due to the use of m2w64-binutils is now resolved, but there is a new problem now because this recipe depends on a pretty old version of maturin that drags in some very old and incompatible dependencies on Windows.  However, the package appears to be more or less unmaintained (no new updates in almost two years) so it may be difficult to get it to build with newer versions of maturin.

Yeah, I don't know what an effective way forward would be.  The upstream has had a PR merged within the last month or two, so here's hoping for a release...


TCE 0.10 Management Cluster Creation fails "load: name crd not found in module static.lib.yaml"

Bug Report
Trying to boostrap TCE Edition with Existing AVI installation.
Setup fails right after initiating the "tanzu management-cluster create mgmt  --file /Users/adess/.config/tanzu/tkg/clusterconfigs/adxqhx8l8h.yaml" command
Setting up management cluster...
Validating configuration...
Using infrastructure provider vsphere:v0.7.10
Generating cluster configuration...
WARNING: key is not a string: %!s(int=1)WARNING: key is not a string: %!s(int=1)Error: unable to set up management cluster: unable to build management cluster configuration: unable to get template:
- load: name crd not found in module static.lib.yaml
    in <toplevel>
      03_customizations/02_avi/add_akoo.yaml:5 | #@ load("static.lib.yaml", "crd","service")

Expected Behavior
Boostrap of the TCE Cluster should happen and not abort
Steps to Reproduce the Bug
Fully reproducable by running the command "tanzu management-cluster create mgmt  --file /Users/adess/.config/tanzu/tkg/clusterconfigs/adxqhx8l8h.yaml"
Screenshots or additional information and context

Environment Details

Build version (tanzu version): v0.10.1
Deployment (Managed/Standalone cluster): Standalone
Infrastructure Provider (Docker/AWS/Azure/vSphere): vSphere
Operating System (client): MAC

Diagnostics and log bundle
Providing my config file attached below:
´´´
AVI_CA_DATA_B64: LS0tLS1CXXXXXXXXXXXXXXXXXXXXXXXX
AVI_CLOUD_NAME: Default-Cloud
AVI_CONTROL_PLANE_HA_PROVIDER: "true"
AVI_CONTROLLER: avi.haas-523.pez.vmware.com
AVI_DATA_NETWORK: Workload
AVI_DATA_NETWORK_CIDR: <IP_ADDRESS>/24
AVI_ENABLE: "true"
AVI_LABELS: ""
AVI_MANAGEMENT_CLUSTER_VIP_NETWORK_CIDR: <IP_ADDRESS>/24
AVI_MANAGEMENT_CLUSTER_VIP_NETWORK_NAME: Workload
AVI_PASSWORD: encoded:LS0tLS1CXXXXXXXXXXXXXXXXXXXXXXXX
AVI_SERVICE_ENGINE_GROUP: Default-Group
AVI_USERNAME: admin
CLUSTER_CIDR: <IP_ADDRESS>/11
CLUSTER_NAME: mgmt
CLUSTER_PLAN: dev
ENABLE_AUDIT_LOGGING: "false"
ENABLE_CEIP_PARTICIPATION: "false"
ENABLE_MHC: "false"
IDENTITY_MANAGEMENT_TYPE: none
INFRASTRUCTURE_PROVIDER: vsphere
LDAP_BIND_DN: ""
LDAP_BIND_PASSWORD: ""
LDAP_GROUP_SEARCH_BASE_DN: ""
LDAP_GROUP_SEARCH_FILTER: ""
LDAP_GROUP_SEARCH_GROUP_ATTRIBUTE: ""
LDAP_GROUP_SEARCH_NAME_ATTRIBUTE: cn
LDAP_GROUP_SEARCH_USER_ATTRIBUTE: DN
LDAP_HOST: ""
LDAP_ROOT_CA_DATA_B64: ""
LDAP_USER_SEARCH_BASE_DN: ""
LDAP_USER_SEARCH_FILTER: ""
LDAP_USER_SEARCH_NAME_ATTRIBUTE: ""
LDAP_USER_SEARCH_USERNAME: userPrincipalName
OIDC_IDENTITY_PROVIDER_CLIENT_ID: ""
OIDC_IDENTITY_PROVIDER_CLIENT_SECRET: ""
OIDC_IDENTITY_PROVIDER_GROUPS_CLAIM: ""
OIDC_IDENTITY_PROVIDER_ISSUER_URL: ""
OIDC_IDENTITY_PROVIDER_NAME: ""
OIDC_IDENTITY_PROVIDER_SCOPES: ""
OIDC_IDENTITY_PROVIDER_USERNAME_CLAIM: ""
OS_ARCH: amd64
OS_NAME: photon
OS_VERSION: "3"
SERVICE_CIDR: <IP_ADDRESS>/13
TKG_HTTP_PROXY_ENABLED: "false"
TKG_IP_FAMILY: ipv4
VSPHERE_CONTROL_PLANE_DISK_GIB: "20"
VSPHERE_CONTROL_PLANE_ENDPOINT: ""
VSPHERE_CONTROL_PLANE_MEM_MIB: "4096"
VSPHERE_CONTROL_PLANE_NUM_CPUS: "2"
VSPHERE_DATACENTER: /Datacenter
VSPHERE_DATASTORE: /Datacenter/datastore/Tanzu
VSPHERE_FOLDER: /Datacenter/vm/tkg
VSPHERE_NETWORK: /Datacenter/network/Tanzu/Workload
VSPHERE_PASSWORD: encoded:R0J4SmF2dzRPN3A4TjJlZ3RpIQ==
VSPHERE_RESOURCE_POOL: /Datacenter/host/Cluster/Resources
VSPHERE_SERVER: vcsa-01.haas-523.pez.vmware.com
VSPHERE_SSH_AUTHORIZED_KEY: ssh-rsa LS0tLS1CXXXXXXXXXXXXXXXXXXXXXXX
VSPHERE_TLS_THUMBPRINT: 4E:BD:ALS0tLS1CXXXXXXXXXXXXXXXXXXXXXXXX
VSPHERE_USERNAME<EMAIL_ADDRESS>VSPHERE_WORKER_DISK_GIB: "20"
VSPHERE_WORKER_MEM_MIB: "4096"
VSPHERE_WORKER_NUM_CPUS: "2"
´´´

Validated the same result when using a linux-machine to boostrap a mgmt-cluster with AVI (ubuntu 18.04).
Error: unable to set up management cluster: unable to build management cluster configuration: unable to get template:
- load: name crd not found in module static.lib.yaml
    in <toplevel>
      03_customizations/02_avi/add_akoo.yaml:5 | #@ load("static.lib.yaml", "crd","service")

@seemiller do you know who would be best to take a look at this? Looks like a packaging error?

Not a package problem, not sure where this would be coming from yet...

For what it's worth, i ran into this yesterday and got past it by editing pkg/v1/providers/ytt/03_customizations/02_avi/add_akoo.yaml , removing crd from the load static.lib.yaml line so it says
#@ load("static.lib.yaml", "service")
and removing the line that says
--- #@ crd()
I got that from this PR https://github.com/vmware-tanzu/tanzu-framework/pull/821/files
My add_akoo.yaml looks like this now:
`
#@ load("@ytt:data", "data")
#@ load("@ytt:json", "json")
#@ if data.values.PROVIDER_TYPE == "vsphere" and data.values.TKG_CLUSTER_ROLE != "workload" and data.values.AVI_ENABLE and data.values.AVI_CONTROL_PLANE_HA_PROVIDER:
#@ load("static.lib.yaml", "service")
#@ load("rbac.lib.yaml", "role", "role_binding")
#@ load("ako-operator-deployment.lib.yaml", "akoo_deployment", "avi_credentials", "avi_certificate")
--- #@ service()
--- #@ role()
--- #@ role_binding()
--- #@ akoo_deployment()
--- #@ avi_credentials()
--- #@ avi_certificate()
#@ end
`

@vmware-tanzu/pkg-ako-operator-owners This looks like an issue in the AKO package, would you be able to take a look at it?

I am looking into this issue now. This should be an issue that's fixed in the newer release.
At meantime, this issue might be resolved by removing the CRD under $HOME/.tanzu/providers as @nrobbins00 commented above.

I have verified the workaround works and I was able to create a management cluster after the changes.
I have also narrowed down the problem. It seems like the current TCE is not using the latest version of the tanzu-framework. From the commit history https://github.com/vmware-tanzu/tanzu-framework/commits/main/pkg/v1/providers/ytt/03_customizations/02_avi/add_akoo.yaml, I think TCE is using the version from Oct 29, 2021 and the problem got fixed on Nov 2, 2021. This problem should be fixed once the tanzu-framework got updated.


[Bug]: wrong mono font for LaTeX commands

Bug Description
I have used the commanded style-setting plugin to change the Mono font into "DejaVu Sans Mono", so that the math codes in $...$ and $$...$$ are shown in that font. The problem is the LaTeX like commands such as \int are shown in italic text font(in my case is Stix2)
Relevant Screenshot

To Reproduce

input $a^\dagger$
\dagger is shown in the italic text font, while a is shown in the correct mono font as expected

Obsidian Version
0.13.23
Installer Version
0.12.5
Which editor are you using?

[X] New Editor
[ ] Legacy Editor

In which mode(s) does the problem occur? (if applicable)

[ ] Source (Edit)
[ ] Reading (Preview)
[X] Live Preview

Which operating system?

[ ] macOS
[ ] Linux
[X] Windows
[ ] iOS
[ ] Android

Plugin-Specific Problems

[ ] I took note of the specific instructions regarding those plugins.

Checklist

[X] I updated to the latest version of the theme (Settings → Appearance → Themes - Manage → Update).
[X] I made sure that the issue is related to this theme, by checking that the problem does not occur with other themes or the default theme.
[ ] In case I am missing an UI element, I have checked that it cannot be re-enabled with the Style Settings plugin.
[ ] If the bug occured after updating the theme, I read the last couple of entries in the changelog to make sure the bug is not an intentional change. (In that case, there will most likely be a Style Setting to turn it off again.)

Do you have "DejaVu Sans Mono" installed on your system?
Also, could you share the code for the latex code from above, so I can test it?

nevermind, I figured it out, fixed in latest update


ssh ControlPersist freezes go get

What version of Go are you using (go version)?

go1.5 (built using gvm & go1.4.2)

What operating system and processor architecture are you using?

osx 10.9.5, intel core i7, amd64

What did you do?

I was trying to redirect go get to use the ssh address instead of the https address when cloning from a given address, as a proof-of-concept for use inside a company with a private repository host.
I added lines to my  ~/.gitconfig to redirect git clone to use ssh for github.com:
[url "git@github.com:"]
	insteadOf = https://github.com/

Prior to this project I had been using a globally applied ssh ControlPath to persist and reuse ssh connections:
Host *
    ControlMaster auto
    ControlPath ~/.ssh/%r@%h:%p
    CompressionLevel 9
    ControlPersist 2h
    ServerAliveInterval 60

I verified that the ControlPersist setting is what leads to the unexpected behavior, but I don't understand why go get is effected.

What did you expect to see?

in a terminal I execute go get against any go repo
it downloads the source
my terminal is released when it finishes

What did you see instead?

I ran go get
the repository is cloned
my terminal remains busy

additional troubleshooting

I tried with many repositories, and verified that when I disable ControlPersist in my ~/.ssh/config my terminal is freed after the operation (as desired/expected), but then I no-longer have persisted ssh.
If I run git clone with ControlPersist enabled, everything works as expected, including my terminal being relinquished after it finishes cloning.
If I establish an ssh connection first (eg. ControlPath exists for a given host), then run go get with ControlPersist enabled, it works as expected.  So once the master connection is established it works fine.

Verified the same behavior on linux (debian jessie), also core i7, amd64.

From #16104: we could consider setting GIT_SSH_COMMAND='ssh -o ControlMaster=no' before invoking git.
The explanation for the behavior is also in #16104: go get is waiting for standard error to be closed.

Nice find.

Why does go get wait for stderr to be closed?  Can't it just pass in go get's stderr and not worry about it?  That'd also let stderr pass out to the controlling process (e.g. the terminal).

I use ControlMaster as a means of boosting ssh performance by reusing/multiplexing on a single established connection.  It also deals with connection rate limiting.
I would much rather see a fix to how go get handles stderr than an override to a perfectly valid ssh configuration.  The fact that git clone works fine alone clearly shows the problem is with how go get is dealing with its subprocess.
If the objective of go get is to suppress errors from git clone why not just use io.Discard as the stderr, or a bytes.Buffer to collect the output and decide whether to relay it to the tty after execution?

I use ControlMaster as a means of boosting ssh performance by reusing/multiplexing on a single established connection. It also deals with connection rate limiting.

I use it that way too. The most common use-case here is @github itself.
The common workaround to fix this problem is to kill the master process controlling the socket. Unless I am seeing a completely different problem here.
Since the workaround is so simple and can even be automated for builders, I would rather like to have a go get which is not disabling my carefully chosen non-default ssh options.

If ssh goes to background (becomes a master) without closing stderr,
isn't that a classical daemonization bug?

I asked about this behavior on the openssh mailing list a couple of years ago but never got a reply:
https://lists.mindrot.org/pipermail/openssh-unix-dev/2014-January/031975.html
I eventually stopped using controlmaster because of it. There are problems with a lot of software besides go get.

Nice find! I was wondering why things were hanging.
For what it's worth, it looks like a fix will be in OpenSSH 7.3. Good to see a fix go-side though, considering it will take a while before >=7.3 is the norm.
Link to patch, was applied April 2016.


[Network]  Network Test cases for xyz

Refactoring network from org to xyz... Place holder
Development story
https://github.com/openbmc/openbmc/issues/780

https://github.com/openbmc/openbmc-test-automation/issues/429 - Duplicate


"About" Dialog/Popup for additional info

In the profile menu we need an extra entry called "About" where the user can find their current version and maybe a link to this repository to submit a bug if they find one.

A link is not necessary....


Pull region from s3_file attribute

This is basically PR #149 with the merge conflict fixed.
Pinging @TaopaiC @ubiquitousthey @miketheman

RuntimeError
------------
Property content of file[/etc/chef/ohai/hints/ec2.json] cannot be passed a block! If you meant to create a resource named content instead, you'll need to first rename the property.

Could I get some help resolving this error please? Not sure why it thinks it is being passed a block or why the error occurs given that file was not changed in this PR.

The error was introduced in a nightly build of ChefDK which is used in Travis.  I fixed it up on master.

Ah thanks @tas50 - that would explain it! Have resolved the merge conflicts and the build is now passing.

@zl4bv Can you rebase this against master and document it in the readme so others can use it?  Thanks

@tas50 Rebased and documentation added.
Minimally tested with kitchen-docker against the existing test cookbook in the repo:
       Starting Chef Client, version 12.6.0
       Creating a new client identity for s3-file-ubuntu-1404 using the validator key.
       resolving cookbooks for run list: ["aws_test::s3_file"]
       Synchronizing Cookbooks:
         - ohai (2.0.4)
         - aws (2.8.0)
         - aws_test (0.0.1)
       Compiling Cookbooks...
       Recipe: aws::default
         * chef_gem[aws-sdk] action install
           - install version ~> 2.2 of package aws-sdk
         Converging 2 resources
         * chef_gem[aws-sdk] action install (up to date)
       Recipe: aws_test::s3_file
         * aws_s3_file[/tmp/an_file] action create[2016-01-26T07:51:17+00:00] WARN: /tmp/kitchen/cache/cookbooks/aws/providers/s3_file.rb:41:in `block in do_s3_file': property group is declared in both remote_file[/tmp/an_file] and #<#<Class:0x00000001ceb188>:0x0000000c6e12c8>. Use new_resource.group instead. At /tmp/kitchen/cache/cookbooks/aws/providers/s3_file.rb:41:in `block in do_s3_file'

           * remote_file[/tmp/an_file] action create
             - create new file /tmp/an_file

       Running handlers:
       Running handlers complete
       Chef Client finished, 3/4 resources updated in 15 seconds
       Finished converging <s3-file-ubuntu-1404> (0m38.87s).
-----> Setting up <s3-file-ubuntu-1404>...
$$$$$$ Running legacy setup for 'Docker' Driver
       Finished setting up <s3-file-ubuntu-1404> (0m0.00s).
-----> Verifying <s3-file-ubuntu-1404>...
$$$$$$ Running legacy verify for 'Docker' Driver
       Preparing files for transfer
       Transferring files to <s3-file-ubuntu-1404>
       Finished verifying <s3-file-ubuntu-1404> (0m0.00s).
       Finished testing <s3-file-ubuntu-1404> (0m39.37s).


ERR:Tails file failed to upload: Payment Required

when test the demo(https://github.com/hyperledger/aries-cloudagent-python/blob/master/demo/AliceGetsAPhone.md#run-an-instance-of-indy-tails-server)，run the cmd (TAILS_NETWORK=docker_tails-server LEDGER_URL=http://test.bcovrin.vonx.io ./run_demo faber --revocation --events),  there is a Exception: Error: 500: Tails file failed to upload: Payment Required,
why and how to solve ，thanks ！
Faber      | Revocation registry: f9b7280c-4e4b-4c41-911b-3b1633ce001b state: active
Faber      | 2020-08-07 01:53:16,407 aries_cloudagent.admin.server ERROR Handler error with exception: Tails file failed to upload: Payment Required
Faber      |
Faber      | Shutting down
Faber      | Exited with return code 0
Traceback (most recent call last):
File "/home/indy/demo/runners/support/agent.py", line 437, in admin_request
resp.raise_for_status()
File "/home/indy/.pyenv/versions/3.6.9/lib/python3.6/site-packages/aiohttp/client_reqrep.py", line 946, in raise_for_status
headers=self.headers)
aiohttp.client_exceptions.ClientResponseError: 500, message='Tails file failed to upload: Payment Required', url=URL('http://<IP_ADDRESS>:8021/credential-definitions')
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/home/indy/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
"main", mod_spec)
File "/home/indy/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
exec(code, run_globals)
File "/home/indy/demo/runners/faber.py", line 462, in
args.timing,
File "/home/indy/.pyenv/versions/3.6.9/lib/python3.6/asyncio/base_events.py", line 484, in run_until_complete
return future.result()
File "/home/indy/demo/runners/faber.py", line 195, in main
revocation_registry_size=TAILS_FILE_COUNT,
File "/home/indy/demo/runners/support/agent.py", line 196, in register_schema_and_creddef
"/credential-definitions", credential_definition_body
File "/home/indy/demo/runners/support/agent.py", line 471, in admin_POST
response = await self.admin_request("POST", path, data, text, params)
File "/home/indy/demo/runners/support/agent.py", line 440, in admin_request
raise Exception(f"Error: {resp_text}") from e
Exception: Error: 500: Tails file failed to upload: Payment Required

OK - I'm dying to know about this one -- "payment required"???  @nrempel ?

@zbbgit Can you share the logs from the running instance of indy-tails-server?

root@iZ2vcekg07cyl1x0potmotZ:~/rev-reg-demo/indy-tails-server/docker# ./manage start
Starting docker_ngrok-tails-server_1 ...
Starting docker_tails-server_1 ... done
Attaching to docker_ngrok-tails-server_1, docker_tails-server_1
ngrok-tails-server_1  | t=2020-08-10T01:02:01+0000 lvl=info msg="no configuration paths supplied"
ngrok-tails-server_1  | t=2020-08-10T01:02:01+0000 lvl=info msg="using configuration at default config path" path=/home/ngrok/.ngrok2/ngrok.yml
ngrok-tails-server_1  | t=2020-08-10T01:02:01+0000 lvl=info msg="open config file" path=/home/ngrok/.ngrok2/ngrok.yml err=nil
ngrok-tails-server_1  | t=2020-08-10T01:02:01+0000 lvl=info msg="starting web service" obj=web addr=<IP_ADDRESS>:4040
tails-server_1        | ======== Running on http://<IP_ADDRESS>:6543 ========
tails-server_1        | (Press CTRL+C to quit)
ngrok-tails-server_1  | t=2020-08-10T01:02:03+0000 lvl=info msg="tunnel session started" obj=tunnels.session
ngrok-tails-server_1  | t=2020-08-10T01:02:03+0000 lvl=info msg="client session established" obj=csess id=1bf2a44ab644
ngrok-tails-server_1  | t=2020-08-10T01:02:03+0000 lvl=info msg="started tunnel" obj=tunnels name="command_line (http)" addr=http://tails-server:6543 url=http://3a3438219804.ngrok.io
ngrok-tails-server_1  | t=2020-08-10T01:02:03+0000 lvl=info msg="started tunnel" obj=tunnels name=command_line addr=http://tails-server:6543 url=https://3a3438219804.ngrok.io

Can you post logs from the tails server that include a reproduction of the error? I haven't been able to reproduce this error.
I'm thinking there might be some wires crossed when you run the demo. The error shows the agent's port as 8021 ('http://<IP_ADDRESS>:8021/credential-definitions) but the demo instructions have the agent running on port 8020.

Can you post logs from the tails server that include a reproduction of the error? I haven't been able to reproduce this error.
I'm thinking there might be some wires crossed when you run the demo. The error shows the agent's port as 8021 ('http://<IP_ADDRESS>:8021/credential-definitions) but the demo instructions have the agent running on port 8020.

Thanks，solve the problem by restart docker。

One more thought.  Are we returning a 402 HTTP status anywhere?  I found that can mean payment requirement.  I couldn't see anything in the code, but wondered if that was used somewhere.

No, we don't use that code anywhere.


GreyNoise Python SDK / CLI Has Support for Community API

Mostly an FYI, but GreyNoise actually has support for the Community API in the main SDK/CLI. See docs: https://greynoise.readthedocs.io/en/latest/tutorial.html#community-api-users

Sweet! At the time I built this, I was looking only at the github page: https://github.com/GreyNoise-Intelligence/pygreynoise which doesn't list anything about community support (nor is it in the help menu of the cli) and their docs link here: https://developer.greynoise.io/docs/libraries-sample-code
This is much more useful documentation, thank you @koronkowy
Use the official one, people - I have no idea if any if this works anymore lol


Allow sharing of public DMP templates between installations

It would be valuable for a new publicly accessible DMP to be available across all of the installations of DMP Roadmap (e.g. DMPTool, DMP Online's, DMP Tuuli, DMP Assistant, etc.).
There are several ways to handle this (and perhaps others I'm not seeing):

A list of installations could be maintained and an API developed that provides public DMP template data (as JSON). A scheduled rake task could then be run that runs through the list of installations and calls their API to retrieve the latest plans (ActiveJob is a good candidate for this).

Someone or a group of people can be assigned to manage the list of public DMP templates in an online repository. A mechanism could then be built to retrieve public DMP templates from this location rather than the local database. The information could perhaps be made accessible via an RSS feed or JSON/XML. Submissions of new templates would need to be made to the designated maintainers of the list.

We could begin storing publicly accessible DMP templates as files and allow them to become part of the Git repository. Then each time a plan is made public the institution could submit a Pull Request and once merged a notification can be sent out to all of the repositories watchers asking them to pull down the new template. This option could get messy though ... perhaps best managed in a separate repository.

I think option 3 is the easiest to implement. Agreed about the separate repository though.

Two comments:

DMPonline doesn't have the concept of public and private templates. All are public, so we need to check that works for your users and if not add a ticket to your MVP list
There's definitely demand for subscribing to template update feeds and I like the sound of option 2. My only concern is that we don't want to encourage lots of separate installations. We've charged the Finns an annual subscription for additional templates we maintain on their behalf, so perhaps we should charge for this, but that becomes messy if we're not the only ones maintaining public templates. In the US it's much more of a community effort right? Perhaps that's the way we need to go here too?

nope. we should close this and discuss if this is ever something we want to be able to do in light of dmponline subscription.


Stadia Controller triggers recognized as buttons

Plugged in the Stadia Controller via USB, here's what I noticed:

Triggers get recognized as buttons instead of analog.
Right thumb stick has reversed Y and need to be inverted in the configuration. Not a big deal but worth mentioning.
Rumble doesn't work as it says Force feedback is not supported.

I tested the controller against https://gamepad-tester.com/ and all triggers/axis are registered fine, and registering fine in windows "game peripherals" too. Let me know if there's something more I can do to help. I would have tried contribute to the project and do it myself but I don't know anything about C# so thought opening an issue would have been more useful.

Same issue here. Everything else (except rumble and the triggers) works great.
It's the only thing preventing the Stadia controller from working 100% on Windows.

+1 - same problem here. Gamepad-tester as above proves triggers are registering fine.
Rumble also works perfectly fine in reWASD but not in XOutput, so some support for that would be amazing.
If there is anything I can do to help, please let me know.

+1 - same problem here. Gamepad-tester as above proves triggers are registering fine.
Rumble also works perfectly fine in reWASD but not in XOutput, so some support for that would be amazing.
If there is anything I can do to help, please let me know.

I actually ended up buying reWASD as it did exactly what I needed and it does exclusive mode flawlessly. Really suggest that if you want a flawless experience.

I actually ended up buying reWASD as it did exactly what I needed and it does exclusive mode flawlessly. Really suggest that if you want a flawless experience.

reWASD works great. Thank you.

reWASD works great. Thank you.


Fix incorrect redis volumes

Redis will not start with the existing config. You can see in the terminal recap that the volumes config should in fact be ".data:/data".

Proposed changes

Unreleased project version (optional)

Related issues (optional)

Actually, now that I've tried with a swarm on aws, it requires the full /home/docker/data version. Locally it would not work. Ah well, closing this.


Adding new projection - Cupola

Recently Weia Reinboud defined a new asymmetric equal area projection, named Cupola, see this journal paper here.
She has actually written the code herself and I offered to help contribute the Cupola projection to the open source community. Now I am quite proficient with Python, but not that experienced with geodata processing.
I thought that I could implement a projection directly in WKT, but apparently that's not the case? Basically the pseudo-code below is what I want to implement.
# parameters for Cupola
c1 = 0.5253 # part of the equator on intermediate sphere, default = 1
c2 = 0.7264 # sin of angle of polarline; default = 1
c3 = 0.4188 # height of the equator, can be negative, default = 0
c4 = 22.00 # phi of centre projection in degrees, default = 0
c5 = 0.9701 # strech in plane, default = 1

# constants
c6 = 11.023  # central meridian 11.023 degrees, also defines border of the map
c7 = 180.00 # degrees to the right of c6, default = 180
grid = 30 # grid distance in degrees
r2 = 1.61885660611815
w123 = 0.258701109423297
c4r = 0.383972435438752
pc = 0.559562341761853

def cupola_projection(u , v, c1, c2, c5, r2, w123, spc, cpc, qc):
    """
    (phi, lambda) as (lat, lon) in degrees --> (u, v) in radians --> (p, q) in radians on intermediate sphere --> (x, y) cartographic projection.
    """
    spc = sin(pc)
    cpc = cos(pc)
    c6 = c6+(180-c7)
    c6r = pi * c6/180  # c6 in [rad], v of center of projection
    qc = c1*c6r

    # calculate (p, q)
    p = asin(c2*sin(u)+w123)
    sp = sin(p)
    cp = cos(p)
    q = c1*v

    qqc = q-qc
    sqqc = sin(qqc)
    cqqc = cos(qqc)

    # k is Snyder's constant, taken as product with r2:
    r2k = r2 * sqrt(2/(1+spc*sp+cpc*cp*cqqc));

    return (r2k*cp*sqqc*c5, r2k*(cpc*sp-spc*cp*cqqc)/c5)

Can anyone point me in the right direction what the best way is to implement this for the Python geostack. My main aim is to be able to use this projection for drawing choropleth maps.

The best way to get the projection added to pyproj is to add it to PROJ: https://github.com/osgeo/PROJ/. In doing so, you will get it added to GDAL/QGIS/etc.

@snowman2
Thanks, that was my second guess. Have posted a request there, too. https://github.com/OSGeo/PROJ/issues/2706.

Closing for preference to the PROJ issue.


kafka(ticdc): ignore sarama admin create topic exist

What problem does this PR solve?

Issue Number: close #8391
What is changed and how it works?
This is introduced by #8228
ignore topic exist error
Check List
Tests

Unit test
Manual test (add detailed scripts or steps below)

Questions
Will it cause performance regression or break compatibility?
Do you need to update user documentation, design documentation or monitoring documentation?
Release note
`None`

/run-all-tests

/merge

/run-engine-integration-test
/run-kafka-integration-test

/run-engine-integration-test
/run-dm-integration-test


Added a Goodreads example to the demo app.

thanks for this PR but there is 3 commits for one things (git is weird some times)
but to keep history clean could you make another PR with only one commit
you can try to "merge" the commit (with git tricks...)
or faster I think, create a branch feature-goodreads before your commits, apply a patch and commit, make a PR with the branch

Ok, there you go. #204


chosenClass js bin example broken

The example listed in the README.md for the chosenClass option appears to be broken. I can't move any of the items. http://jsbin.com/hunifu/3/edit?html,css,js,console,output
Sorry if there's already an open issue for this. I looked but didn't find anything that seemed like it would cover this.

It looks like it's the delay option to blame. I've opened another issue for that: #1337


Added support for parsing LP binary variables

Since it already supports binary variables in JSON model, I just simply copied code from integer variables parsing because it works.

Thanks!


Disable missing-column row group skipping

What changes are proposed in this pull request?
The optimization to treat a physically missing column as all-null is unsound, if the schema was not already verified to prove that the table's logical schema actually includes the missing column. Disable it until we can add the necessary validation.
How was this change tested?
New unit tests.
Fixes https://github.com/delta-incubator/delta-kernel-rs/issues/434

is breaking-change label/semver test broken? this shouldn't be breaking right? (and in CI i'm seeing some failures from changes not in this PR?)
cc @nicklan @scovich

is breaking-change label/semver test broken? this shouldn't be breaking right? (and in CI i'm seeing some failures from changes not in this PR?)

I think it's just due to out of date base branch. I removed the label and will update; semver can re-add the label if this PR really makes a breaking change.


Align config structure with other public testnet repositories

Align the metadata folder with the structure of other public testnets (holesky, devnets):

Add EL genesis configs (genesis.json, chainspec.json, besu.json)
Remove comments from bootstrap_nodes.txt (not allowed by some clients)
Add yaml version of cl bootnodes list: bootstrap_nodes.yaml (needed by some clients, with comments)
Add el bootnodes list as plain list (enodes.txt) and commented yaml (enodes.yaml)

I've tested the EL genesis files with 3 client pairs (geth/lighthouse, nethermind/lighthouse & besu/lighthouse).
All pairs were able to start sync the mainnet chain with the supplied configs (without using the built in configs)
Rel:
sepolia: https://github.com/eth-clients/sepolia/pull/89
holesky: https://github.com/eth-clients/holesky/pull/111

Add yaml version of cl bootnodes list: bootstrap_nodes.yaml (needed by some clients, with comments)

Add el bootnodes list as plain list (enodes.txt) and commented yaml (enodes.yaml)

An explicit feature of unifying the shape of network metadata was to avoid duplicated yaml/txt files since historically, these were going out of sync with each other.
As such, the better option here would be to raise issues with affected clients instead f duplicating the information - it doesn't matter which of yaml and txt it is, as long as there is one only - there exists no inherent benefit to storing the same information redundantly in two, for this purpose, equivalent formats - it doesn't really matter which one it is as long as there's only one.

Heya @arnetheduck,
Yea, I see the problem with files getting out of sync and tend to agree with the general approach to not duplicate the bootnode files.
However, we can't fully prevent these duplicates for the el bootnodes, as some genesis configurations include the el bootnodes as well (besu.json & chainspec.json).
So, what about if we add a check workflow that runs on PRs to the genesis repositories and checks if the bootnodes are in sync in all files?
That way we can easily ensure these files keep in sync.
I'll also gonna remove the txt files, as the yaml is a properly standardized format that can be parsed with standard tools (taking care of comments, etc.).
Most of the problems I was facing with the missing txt versions is actually coming from our toolings and the way how we pass bootnodes to our devnet clients, so it's not super critical to not have them.

So, what about if we add a check workflow that runs on PRs to the genesis repositories and checks if the bootnodes are in sync in all files?

sounds rube-goldbergish but sure. they could just fix their shit too though.

I'll also gonna remove the txt files, as the yaml is a properly standardized format that can be parsed with standard tools (taking care of comments, etc.).

again, I don't greatly care which, but text file with # for comments is also pretty universally a standard, and an awful lot more simple than a full yaml parser which is probably the reason why most of the tooling you refer to supports that and not the yaml (ie you can easily manipulate it with shell scripts even).

I've removed the txt versions and added a workflow that runs on PRs to main and checks:

the el & cl bootnodes for duplicates
the el bootnodes for consistency across the el genesis files (chainspec.json & besu.json)

@arnetheduck are you fine with that trade off?

not sure why, but actions is not picking up the workflow

I've updated the other two testnet repositories according to the discussion in here :)
(Sorry for merging in the other PRs already, I've actually noticed your comment just during the process of merging those)
Wanna have a last look at these PRs?
https://github.com/eth-clients/sepolia/pull/94
https://github.com/eth-clients/holesky/pull/116


TENANT_ID in IDN_AUTH_SESSION_STORE table is not filled properly

moved from: https://wso2.org/jira/browse/IDENTITY-5935
Some rows in IDN_AUTH_SESSION_STORE table has -1 for TENANT_ID column.

This issue is being closed due to extended inactivity. Please feel free to reopen it if further attention is needed. Thank you for helping us keep the issue list relevant and focused!


Include networking-calico in v3.8.7 release

Also update the URL to GitHub, as all networking-calico releases are
now on GitHub.

Deploy preview for calico ready!
Built with commit 7790af33bddeee4bae454d3d2fe0fd42e01f146a
https://deploy-preview-3367--calico.netlify.com


feat: added GET /list endpoint for both orders and offers

Pull request for this trello task

:tada: This PR is included in version 1.3.0 :tada:
Your semantic-release bot :package::rocket:


Fixed win32 terminal mouse scrolling, no longer needs dll

still todo - make mappings work...
But, I think that will take more time, and I guess no reason to wait on mappings before releasing this, at least we can make basic mouse scrolling feature work.

Sorry about the noise generated by this PR.  John's patch to fix my patch conflicted with this new patch - yay for git.  Anyway, this PR looks right to me now.


Transpile createAsyncQuery from alpaql

Description
We need the babel plugin to transpile alpaql's createAsyncQuery to make it work with SSR.
Type of change

[x] async: Minor: New feature (non-breaking change which adds functionality)

Checklist

[x] I have added a changelog entry, prefixed by the type of change noted above (Documentation fix and Test update does not need a changelog as we do not publish new version)

I'm not sure what the PR is waiting for, but I'm good to merge this.

@9at8 you've got two ✅ , I say merge away!


Idea: built-in middleware/transformations

One scenario for this would be serving web requests and also (for example) processing SQS messages.
For SQS messages, a middleware could wrap those into the request body and send to a configured path (specified via an environment variable).
This would enable having a single Lambda function to handle multiple types of event, using a common HTTP based backend, which is appealing for simplicity.
Thoughts?

Could you tell me a bit more about the use cases? Are you looking for any other event sources other than SQS? What's the schema you would expect?
We are thinking about expending the event sources and convert the events to CloudEvents with HTTP Protocol Binding. Do you think this will cover your use cases?

We are thinking about expending the event sources and convert the events to CloudEvents with HTTP Protocol Binding. Do you think this would cover your use cases?

Yes! This would be amazing. Big fan of CloudEvents and would love to see more AWS services adopt it too.
For some more context around the specific use case, I want to have Lambda process events from SQS via event source mappings (with a batch size of 10, say). If aws-lambda-web-adapter could transform this into an HTTP request, by setting the relevant HTTP CloudEvents using the binary format, and placing the event/context into the request body, my app code can process these events like a regular HTTP request.
One specific thing for SQS is that ideally I would want a way to signal back to SQS when items in the batch failed (https://docs.aws.amazon.com/lambda/latest/dg/with-sqs.html#services-sqs-batchfailurereporting). It seems like for this, the aws-lambda-web-adapter could just return the response body (as JSON) to the caller.

We have a use for this also.  Would love to replace awslambdaric with aws-lambda-web-adapter for all of these projects, it's much easier and simpler to package into lightweight containers.
If it could handle batches into a single HTTP request and let you resolve with a HTTP response would be damn near perfect.

Similar usecase here. We're building services which have an API component and some workers that consume SQS, SNS, etc messages. Because of awslambdaric and the Lambda extensions API, for each of the services we need to build at least two docker images.
Building for receiving events over an HTTP endpoint would also mean our developers don't have to learn about lambda entrypoints.

Also looking for this kind of functionality. We used to do this with @vendia/serverless-express to manage incoming SQS messages as part of our API.
In our case we'd be completely happy if the payload can just be received by our application and our application can decide how to route it accordingly. The issue is that currently even tho an SQS message will run the application when it hits a lambda running web adapter, the body and any other metadata are empty, so we can't process the request.
I'd opened an issue here https://github.com/awslabs/aws-lambda-rust-runtime/issues/765 for this, which was deemed more relevant to this already open issue.

@kueckermann for your use case, do you need to use one function to handle both SQS messages and HTTP requests?

@kueckermann for your use case, do you need to use one function to handle both SQS messages and HTTP requests?

In our use case we have a nest.js application running in lambda. It would be completely fine for us if the request was somehow able to provide the message as a body or even just provide the original body as a header so we can parse is. In the nest application we'd create an interceptor that would detect the request is from sqs and then based on our own sqs message attributes decide what route path to use to process the request.
Main issue for us at the moment is that the body is not available in the request when sqs triggers the lambda.

Got it. We need to update lambda-http crate to pass through the non-http payloads. I'm working on a prototype for this.

Thanks @bnusunny for getting on this. I saw a PR was merged to the rust runtime. So great to see this moving forward, and looking forward to having this feature in a future version of web adapter.

Yes, we are working on it. Hopefully, we could submit a PR next week, if not sooner.


[10.x] Add get method to HTTP Client Response

When you want to get data from response, They didn't method to get a specific field.
Now you can use a specific field easy:
$response = Http::get('https://jsonplaceholder.typicode.com/todos/1');
$response->get('title');

It is not over yet, You can access to value of associative array in response like this 🔥:
$response = Http::get('https://jsonplaceholder.typicode.com/users/1');
$response->get('company.name');

What's the difference with the json method?


Relicense as blue oak

I maintain npm-run-all2 for my own personal ends, as well as the benefit of anyone else who hoped aboard. What do people think about relicensing under blue oak? From my end, I have no qualms, since I have no personal commercial interests in this project.  Is that even allowed?

https://blueoakcouncil.org/license/1.0.0

https://opensource.org/license/blue-oak-model-license states it is a redundant license with more popular alternatives available. I had to google search it as I didn't even know what it was. MIT allows commercial usage https://opensource.org/license/mit

Edited in a URL reference. There is some drama behind the scene iirc about adding a new license, however the improvements around implicit CLAs that sound like nice improvements.

I'm torn on relicensing, especially as that has to be done by the book
I would prefer sticking with what we already have

Ok lets do that then.


Alphabetize list of contributors in updateContributorsInReleaseNotes task

Also read GITHUB_TOKEN from environment var.

@bot-gradle test and merge

OK, I've already triggered a build for you.

Pre-tested commit build cancelled.

@bot-gradle test and merge

OK, I've already triggered a build for you.

Pre-tested commit build failed.

@bot-gradle test and merge

Your PR is queued. See the queue page for details.

There's merge conflict between your PR branch and base branch. Please fix it and try again.

OK, I've already triggered a build for you.

Pre-tested commit build failed.

@bot-gradle test and merge

OK, I've already triggered a build for you.

Pre-tested commit build cancelled.

@bot-gradle test and merge

OK, I've already triggered a build for you.

Pre-tested commit build failed.


az login throwing certificate error

Whenever I use Azure cli to login, I get this following warning.
C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\lib\site-packages\urllib3\connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
Connection verification disabled by environment variable AZURE_CLI_DISABLE_CONNECTION_VERIFICATION
C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\lib\site-packages\urllib3\connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
[Enter feedback here
setting AZURE_CLI_DISABLE_CONNECTION_VERIFICATION to 0 or 1 does not have any impact.
Your documentation is suggesting that I should add the proxy certificate in the pem file. My question is, where can I find the proxy certificate? In my Microsoft edge settings, proxy appears to be disabled and I am working within my company VPN network. In such case, is there any place can I extract the certificate?
Thanks very much.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 2e51daa3-30c5-f449-36a1-9f33c70ca2fc
Version Independent ID: a21e188b-4ff4-0aca-531b-d4b179665be1
Content: Use Azure CLI effectively
Content Source: docs-ref-conceptual/use-cli-effectively.md
Service: azure-cli
GitHub Login: @dbradish-microsoft
Microsoft Alias: dbradish

Thanks for the question! We will review and get back to you shortly.

There are a large number of scenarios where the AZURE_CLI_DISABLE_CONNECTION_VERIFICATION does not resolve this issue.
Your best source of information for getting the certificate information is your corporate IT department. The reason there is no additional information on where to get the certificate is that there is a huge variety in configurations and it's not possible to tell you how to do so for your specific scenario.

@rrjavadev Has this adequately answered your question and I can close this thread or do you have any follow-up issues?

Dear Samara, thanks for your response.  Unfortunately i could not resolve the issue. It would be nice if you could give some pointers on why this issue occurs and what is Azure expecting as a public key. Your documents are not covering in detail about this. So far I have downloaded the public key from Azure portal and added it to the Azure cli pem file. However this did not have any impact. Without fully understanding what is really expected by Azure and where this handshake is happening,  it is difficult to troubleshoot the issue. Thank you.

The certificate needed is probably from your corporate network and has nothing to do with any azure.com certs. If your security policies allow it, logging in from outside your corporate network should also clear the error.
I'm not sure what your level of existing knowledge is, so I may be overexplaining- my goal is only to clear up confusion about why this is happening. I am going to assign this to the doc author to review to see if we can explain it a bit better, but please keep in mind that it's not possible to give a specific location to get the cert in a situation like yours.
There are essentially two types of certificates in play here- self-signed and those issued by a verified certificate authority company (CA). Anyone can make a self-signed cert, whereas CA's have to go through a thorough vetting process. In addition, you have to verify that you own the domain the cert is being issued for when you purchase a cert from a CA. It might be helpful to think of CA-issued certs as a passport- society has collectively decided that it is something you can use to prove your identity.
 Anyone can make one that claims to be anybody. They can encrypt data though, and since CA issued certs can get expensive, self-signed certs are useful in some instances as "good enough" security. Many internal corporate networks use this approach, and that's why they are listed in the article as a common cause for this error.
Every step between the CLI and Azure has to provide proof of identity to be sure no one is trying to steal your login info. Relevant parties here are you, Azure, your VPN, and any other layers your company puts between their VPN and the public internet. It's possible that something has gone wrong along this path and the error is protecting your credentials from an additional malicious party, but that's unlikely.
Azure.com uses a cert issued by a CA, so that can be independently verified and doesn't need to be manually added. However, I can't tell you if your company's network uses a CA cert or any self-signed certs. Your IT department or at least the network administrator should know and have access to the public key.
When the CLI isn't able to verify a certificate from a CA because it is self-signed, it's going to look for the public key in cacert.pem. By adding it there you are essentially the one verifying that the certificate is valid and can be used as proof of identity.

This issue is being closed as no response has been received since March 2021


feat(application): Add the ability to use existing volumes when creating an application

Close #4001

@pull-dog up

So we are not able to change the volume size anymore when existing apps ?

@xAt0mZ good point, do we know if there is a way to do that directly through the volume API ? In that case it would make more sense to be able to change the volume size directly from the volume details view.

Upon saving, persist that information inside the database and automatically send a patch request on each storage class to apply the volume expansion property.

I don't think we want to persist the expansion capability as it's already a value we can retrieve from the storageclass and we want to avoid situations that can create desync between DB and cluster state.

@xAt0mZ indeed but we need to keep in mind that a regular user do not have access to the storageclass API operations.
We could decide in the future to give them access to it but I'd rather go with low permissions in the first version and reflect on that when we'll be discussin kubernetes RBAC.

Functionally OK, I've got a few tweaks to do on the UI.
cc @xAt0mZ for tech review


Using File Pulse with Azure Event Hub

Hi,
It's not really an issue more a request for help. I wanted to do a quick PoC for using FilePulse to parse XML files. I was able to successfully sue the setup proposed in tutorial:
https://dev.to/fhussonnois/streaming-data-into-kafka-s01-e02-loading-xml-file-529i
I successfully used docker setup to run the processing on local host. But I'd like to test this also using Azure Event Hub. So I modified the configs to use the cloud for storing internal sync data
"internal.kafka.reporter.topic":"connect-file-pulse-status",
"internal.kafka.reporter.bootstrap.servers": "************.servicebus.windows.net:9093",

"internal.kafka.reporter.producer.ssl.endpoint.identification.algorithm": "https",
"internal.kafka.reporter.producer.sasl.mechanism":"PLAIN",
"internal.kafka.reporter.producer.security.protocol":"SASL_SSL",
"internal.kafka.reporter.producer.sasl.jaas.config":"org.apache.kafka.common.security.plain.PlainLoginModule required username='$ConnectionString' password='Endpoint=sb://*********.servicebus.windows.net/;SharedAccessKeyName=FilePulse;SharedAccessKey=*********************************';",

"internal.kafka.reporter.consumer.ssl.endpoint.identification.algorithm": "https",
"internal.kafka.reporter.consumer.sasl.mechanism":"PLAIN",
"internal.kafka.reporter.consumer.security.protocol":"SASL_SSL",
"internal.kafka.reporter.consumer.sasl.jaas.config":"org.apache.kafka.common.security.plain.PlainLoginModule required username='$ConnectionString' password='Endpoint=sb://*********.servicebus.windows.net/;SharedAccessKeyName=FilePulse;SharedAccessKey=*********************************';"

This part works perfectly - I see all the file processing status messages in Azure Event Hub. But the data goes still to the localhost Kafka topics. I struggle to find any information where should I put an information about connection for actual data outputs.
Could you help with that?
I'm guessing it should go somewhere to connect-distributed.properties but I'm new to Kafka Connect and got a bit confused especially that there are 4 docker images that are part of the setup.

Hi @Skolim007,
The producer and consumer settings you have overridden with internal.kafka.reporter.producer.* and internal.kafka.reporter.consumer.* are used internally by Connect FilePulse to be able able to synchronize the connector and the tasks responsible for precessing files through the topic connect-file-pulse-status. You configured looks good.
Now you also need to configure the Java producers and consumers used internally by connectors and workers to communicate with Kafka. Here is the documentation: https://docs.confluent.io/current/connect/userguide.html#producer-and-consumer-overrides

Thanks for help!
I modified the JSON request by adding those parameters:
    "producer.override.ssl.endpoint.identification.algorithm": "https",
    "producer.override.sasl.mechanism":"PLAIN",
    "producer.override.security.protocol":"SASL_SSL",
    "producer.override.sasl.jaas.config":"org.apache.kafka.common.security.plain.PlainLoginModule required username='$ConnectionString' password='Endpoint=sb://*****************.servicebus.windows.net/;SharedAccessKeyName=FilePulse;SharedAccessKey=*****************';",

    "consumer.override.ssl.endpoint.identification.algorithm": "https",
    "consumer.override.sasl.mechanism":"PLAIN",
    "consumer.override.security.protocol":"SASL_SSL",
    "consumer.override.sasl.jaas.config":"org.apache.kafka.common.security.plain.PlainLoginModule required username='$ConnectionString' password='Endpoint=sb://*****************.servicebus.windows.net/;SharedAccessKeyName=FilePulse;SharedAccessKey=*****************';",

And then got API error that override is not possible, so I added CONNECT_CONNECTOR_CLIENT_CONFIG_OVERRIDE_POLICY: "All" to docker compose, and this allowed API to accept the request.
But I'm still missing something... the messages do not go to the local kafka any more, but the don't also go to Event Hub :)
I see that status messages go to SCHEDULED->STARTED and then nothing more so I expect there is some "hard" exception.

Do you have an exception in Kafka Connect Worker logs ? Furthermore, if the files have already been processed once by the connector, they will not be processed again. Try to add some new files.

As for uploading new file (with different name) every time - I'm doing that and I'm using Delete Policy so I see when the files are processed (and now they are not removed).
Ad for errors in kafka-connect.log here is what I see:
2020-10-27 14:24:04,480 INFO [StartAndStopExecutor-connect-1-2] Kafka version: 5.5.1-ccs (org.apache.kafka.common.utils.AppInfoParser)
2020-10-27 14:24:04,480 INFO [StartAndStopExecutor-connect-1-2] Kafka commitId: 3c4783aac9e33249 (org.apache.kafka.common.utils.AppInfoParser)
2020-10-27 14:24:04,480 INFO [StartAndStopExecutor-connect-1-2] Kafka startTimeMs:<PHONE_NUMBER>480 (org.apache.kafka.common.utils.AppInfoParser)
2020-10-27 14:24:04,487 INFO [DistributedHerder-connect-1-1] [Worker clientId=connect-1, groupId=compose-connect-group] Finished starting connectors and tasks (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
2020-10-27 14:24:04,490 INFO [task-thread-source-csv-filepulse-00-0] Starting task (io.streamthoughts.kafka.connect.filepulse.source.FilePulseSourceTask)
2020-10-27 14:24:04,490 WARN [kafka-producer-network-thread | connector-producer-source-csv-filepulse-00-0] [Producer clientId=connector-producer-source-csv-filepulse-00-0] Connection to node -1 (broker/<IP_ADDRESS>:29092) terminated during authentication. This may happen due to any of the following reasons: (1) Authentication failed due to invalid credentials with brokers older than 1.0.0, (2) Firewall blocking Kafka TLS traffic (eg it may only allow HTTPS traffic), (3) Transient network issue. (org.apache.kafka.clients.NetworkClient)
2020-10-27 14:24:04,490 WARN [kafka-producer-network-thread | connector-producer-source-csv-filepulse-00-0] [Producer clientId=connector-producer-source-csv-filepulse-00-0] Bootstrap broker broker:29092 (id: -1 rack: null) disconnected (org.apache.kafka.clients.NetworkClient)
2020-10-27 14:24:04,491 INFO [task-thread-source-csv-filepulse-00-0] EnrichedConnectorConfig values:
	file.input.paths = [/tmp/kafka-connect/examples/sample27_1.csv]
	filters = []
	ignore.committed.offsets = false
	internal.kafka.reporter.bootstrap.servers = ************.servicebus.windows.net:9093
	internal.kafka.reporter.id = source-csv-filepulse-00
	internal.kafka.reporter.topic = connect-file-pulse-status
	offset.strategy = name
	task.reader.class = class io.streamthoughts.kafka.connect.filepulse.reader.RowFileInputReader
	topic = musics-filepulse-csv
 (io.streamthoughts.kafka.connect.filepulse.config.TaskConfig$EnrichedConnectorConfig)
2020-10-27 14:24:04,493 INFO [task-thread-source-csv-filepulse-00-0] Registering new store for name : source-csv-filepulse-00 (io.streamthoughts.kafka.connect.filepulse.state.StateBackingStoreRegistry)
2020-10-27 14:24:04,493 INFO [task-thread-source-csv-filepulse-00-0] State store already registered for name : source-csv-filepulse-00 (io.streamthoughts.kafka.connect.filepulse.state.StateBackingStoreRegistry)
2020-10-27 14:24:04,493 INFO [task-thread-source-csv-filepulse-00-0] Getting access on FileStateBackingStore instance for group source-csv-filepulse-00 (io.streamthoughts.kafka.connect.filepulse.state.StateBackingStoreRegistry)
2020-10-27 14:24:04,495 INFO [task-thread-source-csv-filepulse-00-0] RowFileInputReaderConfig values:
	buffer.initial.bytes.size = 4096
	file.encoding = UTF-8
	min.read.records = 1
	read.max.wait.ms = 0
	skip.footers = 0
	skip.headers = 1
 (io.streamthoughts.kafka.connect.filepulse.reader.RowFileInputReaderConfig)
2020-10-27 14:24:04,596 WARN [kafka-producer-network-thread | connector-producer-source-csv-filepulse-00-0] [Producer clientId=connector-producer-source-csv-filepulse-00-0] Connection to node -1 (broker/<IP_ADDRESS>:29092) terminated during authentication. This may happen due to any of the following reasons: (1) Authentication failed due to invalid credentials with brokers older than 1.0.0, (2) Firewall blocking Kafka TLS traffic (eg it may only allow HTTPS traffic), (3) Transient network issue. (org.apache.kafka.clients.NetworkClient)
2020-10-27 14:24:04,597 WARN [kafka-producer-network-thread | connector-producer-source-csv-filepulse-00-0] [Producer clientId=connector-producer-source-csv-filepulse-00-0] Bootstrap broker broker:29092 (id: -1 rack: null) disconnected (org.apache.kafka.clients.NetworkClient)
2020-10-27 14:24:04,749 WARN [kafka-producer-network-thread | connector-producer-source-csv-filepulse-00-0] [Producer clientId=connector-producer-source-csv-filepulse-00-0] Connection to node -1 (broker/<IP_ADDRESS>:29092) terminated during authentication. This may happen due to any of the following reasons: (1) Authentication failed due to invalid credentials with brokers older than 1.0.0, (2) Firewall blocking Kafka TLS traffic (eg it may only allow HTTPS traffic), (3) Transient network issue. (org.apache.kafka.clients.NetworkClient)
2020-10-27 14:24:04,749 WARN [kafka-producer-network-thread | connector-producer-source-csv-filepulse-00-0] [Producer clientId=connector-producer-source-csv-filepulse-00-0] Bootstrap broker broker:29092 (id: -1 rack: null) disconnected (org.apache.kafka.clients.NetworkClient)
2020-10-27 14:24:05,004 WARN [kafka-producer-network-thread | connector-producer-source-csv-filepulse-00-0] [Producer clientId=connector-producer-source-csv-filepulse-00-0] Connection to node -1 (broker/<IP_ADDRESS>:29092) terminated during authentication. This may happen due to any of the following reasons: (1) Authentication failed due to invalid credentials with brokers older than 1.0.0, (2) Firewall blocking Kafka TLS traffic (eg it may only allow HTTPS traffic), (3) Transient network issue. (org.apache.kafka.clients.NetworkClient)
2020-10-27 14:24:05,004 WARN [kafka-producer-network-thread | connector-producer-source-csv-filepulse-00-0] [Producer clientId=connector-producer-source-csv-filepulse-00-0] Bootstrap broker broker:29092 (id: -1 rack: null) disconnected (org.apache.kafka.clients.NetworkClient)
2020-10-27 14:24:05,119 INFO [task-thread-source-csv-filepulse-00-0] WorkerSourceTask{id=source-csv-filepulse-00-0} Source task finished initialization and start (org.apache.kafka.connect.runtime.WorkerSourceTask)
2020-10-27 14:24:05,156 INFO [task-thread-source-csv-filepulse-00-0] Opening new iterator for source : [name='sample27_1.csv', path='/tmp/kafka-connect/examples', size=210, lastModified=1603743954000, inode=2112339, hash=3448802726] (io.streamthoughts.kafka.connect.filepulse.source.FileInputIterable)
2020-10-27 14:24:05,159 INFO [task-thread-source-csv-filepulse-00-0] Starting to read header lines (1) from file sample27_1.csv (io.streamthoughts.kafka.connect.filepulse.reader.RowFileInputIterator)
2020-10-27 14:24:05,160 INFO [task-thread-source-csv-filepulse-00-0] End of file reached - flushing remaining bytes from reader buffer (false). (io.streamthoughts.kafka.connect.filepulse.reader.internal.NonBlockingBufferReader)
2020-10-27 14:24:05,407 WARN [kafka-producer-network-thread | connector-producer-source-csv-filepulse-00-0] [Producer clientId=connector-producer-source-csv-filepulse-00-0] Connection to node -1 (broker/<IP_ADDRESS>:29092) terminated during authentication. This may happen due to any of the following reasons: (1) Authentication failed due to invalid credentials with brokers older than 1.0.0, (2) Firewall blocking Kafka TLS traffic (eg it may only allow HTTPS traffic), (3) Transient network issue. (org.apache.kafka.clients.NetworkClient)
2020-10-27 14:24:05,407 WARN [kafka-producer-network-thread | connector-producer-source-csv-filepulse-00-0] [Producer clientId=connector-producer-source-csv-filepulse-00-0] Bootstrap broker broker:29092 (id: -1 rack: null) disconnected (org.apache.kafka.clients.NetworkClient)
2020-10-27 14:24:06,159 WARN [kafka-producer-network-thread | connector-producer-source-csv-filepulse-00-0] [Producer clientId=connector-producer-source-csv-filepulse-00-0] Connection to node -1 (broker/<IP_ADDRESS>:29092) terminated during authentication. This may happen due to any of the following reasons: (1) Authentication failed due to invalid credentials with brokers older than 1.0.0, (2) Firewall blocking Kafka TLS traffic (eg it may only allow HTTPS traffic), (3) Transient network issue. (org.apache.kafka.clients.NetworkClient)
2020-10-27 14:24:06,160 WARN [kafka-producer-network-thread | connector-producer-source-csv-filepulse-00-0] [Producer clientId=connector-producer-source-csv-filepulse-00-0] Bootstrap broker broker:29092 (id: -1 rack: null) disconnected (org.apache.kafka.clients.NetworkClient)

...
2020-10-27 14:24:18,415 WARN [kafka-producer-network-thread | connector-producer-source-csv-filepulse-00-0] [Producer clientId=connector-producer-source-csv-filepulse-00-0] Bootstrap broker broker:29092 (id: -1 rack: null) disconnected (org.apache.kafka.clients.NetworkClient)
2020-10-27 14:24:19,324 WARN [kafka-producer-network-thread | connector-producer-source-csv-filepulse-00-0] [Producer clientId=connector-producer-source-csv-filepulse-00-0] Connection to node -1 (broker/<IP_ADDRESS>:29092) terminated during authentication. This may happen due to any of the following reasons: (1) Authentication failed due to invalid credentials with brokers older than 1.0.0, (2) Firewall blocking Kafka TLS traffic (eg it may only allow HTTPS traffic), (3) Transient network issue. (org.apache.kafka.clients.NetworkClient)
2020-10-27 14:24:19,324 WARN [kafka-producer-network-thread | connector-producer-source-csv-filepulse-00-0] [Producer clientId=connector-producer-source-csv-filepulse-00-0] Bootstrap broker broker:29092 (id: -1 rack: null) disconnected (org.apache.kafka.clients.NetworkClient)
2020-10-27 14:24:19,488 ERROR [SourceTaskOffsetCommitter-1] WorkerSourceTask{id=source-csv-filepulse-00-0} Failed to flush, timed out while waiting for producer to flush outstanding 1 messages (org.apache.kafka.connect.runtime.WorkerSourceTask)
2020-10-27 14:24:19,489 ERROR [SourceTaskOffsetCommitter-1] WorkerSourceTask{id=source-csv-filepulse-00-0} Failed to commit offsets (org.apache.kafka.connect.runtime.SourceTaskOffsetCommitter)
2020-10-27 14:24:20,281 WARN [kafka-producer-network-thread | connector-producer-source-csv-filepulse-00-0] [Producer clientId=connector-producer-source-csv-filepulse-00-0] Connection to node -1 (broker/<IP_ADDRESS>:29092) terminated during authentication. This may happen due to any of the following reasons: (1) Authentication failed due to invalid credentials with brokers older than 1.0.0, (2) Firewall blocking Kafka TLS traffic (eg it may only allow HTTPS traffic), (3) Transient network issue. (org.apache.kafka.clients.NetworkClient)
2020-10-27 14:24:20,281 WARN [kafka-producer-network-thread | connector-producer-source-csv-filepulse-00-0] [Producer clientId=connector-producer-source-csv-filepulse-00-0] Bootstrap broker broker:29092 (id: -1 rack: null) disconnected (org.apache.kafka.clients.NetworkClient)
2020-10-27 14:24:21,289 WARN [kafka-producer-network-thread | connector-producer-source-csv-filepulse-00-0] [Producer clientId=connector-producer-source-csv-filepulse-00-0] Connection to node -1 (broker/<IP_ADDRESS>:29092) terminated during authentication. This may happen due to any of the following reasons: (1) Authentication failed due to invalid credentials with brokers older than 1.0.0, (2) Firewall blocking Kafka TLS traffic (eg it may only allow HTTPS traffic), (3) Transient network issue. (org.apache.kafka.clients.NetworkClient)

I don't think it is any network issue because messaged for "connect-file-pulse-status" topic get to azure without problems so it must be something different....
I'm quite fresh at this and I have a feeling that I'm doing some basic mistake here....

You have a lot of WARN and ERROR:
2020-10-27 14:24:05,004 WARN [kafka-producer-network-thread | connector-producer-source-csv-filepulse-00-0] [Producer clientId=connector-producer-source-csv-filepulse-00-0] Connection to node -1 (broker/<IP_ADDRESS>:29092) terminated during authentication. This may happen due to any of the following reasons: (1) Authentication failed due to invalid credentials with brokers older than 1.0.0, (2) Firewall blocking Kafka TLS traffic (eg it may only allow HTTPS traffic), (3) Transient network issue. (org.apache.kafka.clients.NetworkClient)

and
2020-10-27 14:24:05,004 WARN [kafka-producer-network-thread | connector-producer-source-csv-filepulse-00-0] [Producer clientId=connector-producer-source-csv-filepulse-00-0] Connection to node -1 (broker/<IP_ADDRESS>:29092) terminated during authentication. This may happen due to any of the following reasons: (1) Authentication failed due to invalid credentials with brokers older than 1.0.0, (2) Firewall blocking Kafka TLS traffic (eg it may only allow HTTPS traffic), (3) Transient network issue. (org.apache.kafka.clients.NetworkClient)

You only have overridden consumer/producer settings for the connector but the workers need to be configured as well.
Add you security configuration to the worker.properties file that you are using:
    "producer.ssl.endpoint.identification.algorithm": "https",
    "producer.sasl.mechanism":"PLAIN",
    "producer.security.protocol":"SASL_SSL",
    "producer.sasl.jaas.config":"org.apache.kafka.common.security.plain.PlainLoginModule required username='$ConnectionString' password='Endpoint=sb://*****************.servicebus.windows.net/;SharedAccessKeyName=FilePulse;SharedAccessKey=*****************';",

    "consumer.ssl.endpoint.identification.algorithm": "https",
    "consumer.sasl.mechanism":"PLAIN",
    "consumer.security.protocol":"SASL_SSL",
    "consumer..sasl.jaas.config":"org.apache.kafka.common.security.plain.PlainLoginModule required username='$ConnectionString' password='Endpoint=sb://*****************.servicebus.windows.net/;SharedAccessKeyName=FilePulse;SharedAccessKey=*****************';"
```

You can then remove all the properties `producer.override.*` and `producer.override.*` from the connector configuration because the connector will inherit the worker configs

Thanks again - I'm using the default docker image provided with the tutorial streamthoughts/kafka-connect-file-pulse:latest  with the docker compose
wget https://raw.githubusercontent.com/streamthoughts/kafka-connect-file-pulse/master/docker-compose.yml
docker-compose up -d

But I have trouble understanding where is location of .properties file that is used as worker.properties in this case?

The connect-file-pulse image is based on the cp-kafka-connect-base. You can override any connect setting using Docker env variables, e.g., CONNECT_PRODUCER_OVERRIDE_SASL_MECHANISM="PLAIN"