Implement per-shim parallel world jar classloader

Signed-off-by: Gera Shegalov<EMAIL_ADDRESS>Contributes to #3232

build

build

build

build

I'm assuming you haven't tested on Databricks unless I'm out of date, I pulled this branch into my branch with dist packaging changes and it fails.  I have fixed it on my branch if we want to wait but we should probably put this and that in close together.

build

I tried this code with spark 3.1.1. I was able to get a UCX shuffle with the changes, so we know it works. Early start worked as well, and executors registered when I expected it. However, I noticed a late print of the following message:
2021-09-08 21:37:29,900 WARN  RapidsShuffleInternalManager:69 - Rapids Shuffle Plugin enabled. Transport enabled (remote fetches will use com.nvidia.spark.rapids.shuffle.ucx.UCXShuffleTransport. To disable the RAPIDS Shuffle Manager set `spark.rapids.shuffle.enabled` to false

Which happened when I needed a shuffle (it seemed). This was on the shell, I had a dataframe that would shuffle, and I asked for collect, so the driver is not initializing this early as it used to. Normally this happens at initialization, near the "here's how you turn off the SQL plugin" piece. In the big picture, it seems like a minor thing that can be corrected later, I don't think it is a show stopper for this PR, since the query still late-initialized the shuffle manager, and produced a plan with the correct shuffle handles for the UCX shuffle to work.

build

build

build


2 beacon connexion screens with IOS on denim

it seems ok on android

I'm not able to reproduce the error anymore.

@hawkbee1 can you close it if it is fine ?

Can not reproduce anymore


csv-parser dependency upgrade

Today you upgraded csv-parser to 1.0.5.     This dependency is auto upgraded when using npm.    However, 1.0.5 has a change of functionality in that you now throw errors when encountering a mismatch between header field counts and data field counts.
While the new behavior is correct, for those people depending on a "stable" version of node-csv, there is now a functionality change to contend with forcing them to either adjust their code or fork node-csv and lock down the version number of csv-parser to 1.0.4.
Specifically in our case if you have a csv like:
header1, header2, header3
value1, value2, value3
value4, value5, value6
We had built code around skipping the blank row, but you now throw an error when encountering the blank row stating that the column counts don't match.

This is being discussed in #74, closing for now, please join the discussion.


Model TS classes need to be held in separate folders inside or outside Migrations folder

Motivation
The Kentico model generator (https://github.com/Kentico/kontent-model-generator-js) allows users to generate TS classes to create strictly typed objects to receive data from the Content Delivery APIs (https://github.com/Kentico/kontent-delivery-sdk-js/blob/master/DOCS.md). However there is no way to maintain a subfolder inside or outside the Migrations folder (https://github.com/Kentico/kontent-migrations-boilerplate/tree/master/Migrations) without running into the following errors during execution of the migration CLI:

Proposed solution
Modify the CLI to allow TS files (typically model classes) to be maintained outside or inside the Migrations folder. There should be a way to set the compiler to allow folders with model files during Transpiling. This will allow easier maintenance of code.

Hi @jp2ld,
I've looked at it and I don't think it's a kontent-cli issue since it's only capable of running JS migrations in the current implementation. It's more a question of setting up the transpilation of TS migrations within the boilerplate. We created the boilerplate just as an example of what migrations you can write and how you can run them. If you have specific requirements, you can customize the boilerplate code. In this case, I think it should be enough to add include in tsconfig.json, see https://www.typescriptlang.org/tsconfig#include.
Can I just ask why you need models from the Delivery API? Are you missing any data in the management API?

Hi!
This issue has gone quiet. 👻
It’s been a while since the last update here.
If we missed anything on this issue or if you want to keep it open, please reply here.
Thanks for being a part of the Kentico community!


Add storage class options for Arc PG Deployment

Fixes https://github.com/microsoft/azuredatastudio/issues/12045
We'll want to revisit the layout so it doesn't require scrolling - but for now this will be enough to unblock private preview customers

Pull Request Test Coverage Report for Build 234674004

0 of 0   changed or added relevant lines in 0 files are covered.
6 unchanged lines in 1 file lost coverage.
Overall coverage decreased (-0.02%) to 39.027%

Files with Coverage Reduction
New Missed Lines
%

extensions/schema-compare/src/dialogs/schemaCompareDialog.ts
6
42.89%

Totals

Change from base Build 234629455:
-0.02%

Covered Lines:
18928

Relevant Lines:
44322

💛  - Coveralls


Pod goes into a crash-loop when using mysql:8.0 image

Operator version: 0.4.0
Run into following errors when using the mysql:8.0 image:
2020-08-25 03:31:05+00:00 [Note] [Entrypoint]: Entrypoint script for MySQL Server 8.0.21-1debian10 started.
2020-08-25 03:31:05+00:00 [ERROR] [Entrypoint]: mysqld failed while attempting to check config
	command was: mysqld --verbose --help
	2020-08-25T03:31:05.296161Z 0 [Warning] [MY-011068] [Server] The syntax 'expire-logs-days' is deprecated and will be removed in a future release. Please use binlog_expire_logs_seconds instead.
2020-08-25T03:31:05.296229Z 0 [ERROR] [MY-000077] [Server] /usr/sbin/mysqld: Error while setting value 'STRICT_TRANS_TABLES,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_AUTO_VALUE_ON_ZERO,NO_ENGINE_SUBSTITUTION,NO_ZERO_DATE,NO_ZERO_IN_DATE,ONLY_FULL_GROUP_BY' to 'sql_mode'.
2020-08-25T03:31:05.299345Z 0 [ERROR] [MY-010119] [Server] Aborting

Is MySQL 8.0 supported by the operator yet? This issue #363 gave the impression that it was supported in versions 0.3.0+.

Hi @couch-potato08, we tried to integrate MySQL 8 but hit some issues and give up. We will try it again. Now it does not work with MySQL 8.


Tokenisation network error in ACH since version 3.48.0

General information

SDK version: 3.48.0
Environment: Sandbox not sure about production yet.
Browser and OS Chrome 75.0.3770.100 (64-bit) on MacOS 10.14.6

Issue description
I am always getting tokenisation error in ACH Direct Debit since version 3.48.0.

Can you pass on the error you are getting? Especially the Braintree request id inside of the details object of the error.
(alternatively you can inspect the network tab to see the request id in the actual request)

Following is the response that I am getting from this call
Request Url: https://payments.sandbox.braintree-api.com/graphql
Request Payload
{"clientSdkMetadata":{"source":"client","integration":"custom","sessionId":"108cbc97-e668-4fb7-a675-a313ac411d22"},"query":"mutation TokenizeUsBankAccount($input: TokenizeUsBankAccountInput!) {  tokenizeUsBankAccount(input: $input) {    paymentMethod {      id      details {        ... on UsBankAccountDetails {          last4        }      }    }  }}","variables":{"input":{"usBankAccount":{"achMandate":"I authorize Braintree to debit my bank account on behalf of My Merchant.","routingNumber":"307075259","accountNumber":"307075259","accountType":"CHECKING","billingAddress":{"streetAddress":"33109 Northeast Morcroft Road","extendedAddress":"","city":"La Center","state":"WA","zipCode":"98629"},"individualOwner":{"firstName":"Haseeb","lastName":"Ahmad"}}}}}
Request Response
{   "extensions" : {     "requestId" : "XeGS8zJZd3BWTXrwBMFpauobVY8zeI4KXXaiz0y09dtjCgh4UesINQ=="   },   "data" : {     "tokenizeUsBankAccount" : null   },   "errors" : [ {     "message" : "A downstream service was unreachable.",     "locations" : [ {       "line" : 1,       "column" : 72     } ],     "path" : [ "tokenizeUsBankAccount" ],     "extensions" : {       "errorType" : "unknown_error",       "errorClass" : "SERVICE_AVAILABILITY"     }   } ] }

FYI, we've figured out this issue and are working on a fix.

We believe it is resolved now. Can you update to 3.52.0 and try again?

Ok will try and close the issue today,
Thanks.


Create a Dockerfile to update e2e snapshots

Right now the instructions to update Playwright snapshots for use in CI are cumbersome. Create a Dockerfile that encapsulates all the steps and makes it easy to do.

Getting an error right now when trying to run all the tests and update snapshots: https://github.com/microsoft/playwright/issues/17876
Looks like it's targeted for a fix in Playwright v1.30. May delay this fix until that is completed...

https://github.com/microsoft/playwright/discussions/13716

Getting an error right now when trying to run all the tests and update snapshots: microsoft/playwright#17876 Looks like it's targeted for a fix in Playwright v1.30. May delay this fix until that is completed...

Do you mean you can also reproduce it?

@wxiaoguang I could on the 1.28 image, but seems to be working fine now in 1.30. Not sure if it was the playwright update, or an update to docker, or what but seems to be fine now.

At the moment I can not reproduce it from my side either. Maybe it has been fixed somehow 😂


[Request] [Deck Manager] Enabling undo and redo  in "Edit Deck" dialog

[ ] Undo and Redo per ⌘ + Z and ⌘ + Shift + Z is definitely needed!

[ ] Would be at best with 20 – 30 increments of re- and undo (since there is a 30 Card count, 30 is the better choice)

I'll try this later tonight

Closed by #470


backend: more metrics for bboltdb transaction

@gyuho @jpbetz
We observed high latency in the commit call. Adding more metrics can help to understand which part of bbolt commit is the root cause.

Added change log and missing prometheus register calls. Merging in greens.

Also replaced metrics naming to _ /cc @xiang90

panic: descriptor Desc{fqName: "etcd_debugging_disk_backend_commit.rebalance_duration_seconds", help: "The latency distributions of commit.rebalance called by bboltdb backend.", constLabels: {}, variableLabels: []} is invalid: "etcd_debugging_disk_backend_commit.rebalance_duration_seconds" is not a valid metric name

@gyuho Thank you!

cc @wenjiaswe


push credentials with 2FA does not work

I entered username/email and password correctly but getting error message
fatal: Authentication failed for 'https://github.com/xxx/my-pihole-lists.git/'
Is this because I have 2FA activated on GitHub?
Any workaround?
thx
Mike

access token works for me
Help docs here

that worked!


Push to docker

It would be nice if you could create the docker user and repository so that others can pull from there.
There is a github workflow to automatically push to dockerhub when a tag is created. So once the account and repo on dockerhub are created, you just need to add DOCKER_USERNAME and DOCKER_PASSWORD to the repo secrets.
The workflow currently assumes username trackwarrior and repo name trackwarrior. If you want to change that to something like gkssjovi/trackwarrior we would need to replace all instances in the workflow, scripts and readme.

How to do that? On docker hub ?
Can you create one ?

In theory I could create the account, but it would be better if the owner of the github repo is also the owner of the dockerhub repo.
You can create an account at https://hub.docker.com/
I think it might be best to name the account trackwarrior, so it's easier for people to remember.
When you created the account, you can create a repository:

The name of the repository should be trackwarrior as well.
Finally, you need to create two repo secrets:

One for DOCKER_USERNAME:

and another one for DOCKER_PASSWORD.
Where DOCKER_USERNAME is your dockerhub username (e.g.: trackwarrior) and DOCKER_PASSWORD is the password you have chosen. These secrets are hidden and only visible to CI.
Finally, just create a tag and push it to the repo:
git tag v1.0.0
git push --tags

The CI will build the docker container and upload it automatically to dockerhub.

@gkssjovi I created the docker account. But I need to either get access to this repository to set the correct password or another way of communicating the password to you. Alternatively, what do you think about creating a github org named trackwarrior to host the code as well? That would give an easier URL to remember and make everything look more streamlined.

To simplify things, I went ahead and created the docker repository and a trackwarrior organization on github. I invited you there as a owner, so you have full rights on everything. I can even remove myself from the org if you dont want me to have permissions.
In the future I can change the docker account to use your e-mail instead of mine, if you want full access to everything.
If that's fine for you, you can update this repositories README to link to the organization repo https://github.com/trackwarrior/trackwarrior and archive afterwards. This makes it easier to know which is the actively worked on/maintained repo.
If that's not what you want, I can remove all those things again, but then you would need to configure those things yourself.

Hello
That is fine with me :)
Please create a pull request for the README.md file
Thx

I already created a pull request for the README.md.
The change is already in the other repository as well.

Now it's merged. I have approved it.
Thank you

It would be nice if we could move all further development to https://github.com/trackwarrior/trackwarrior, as it's the repo that is used for uploading the docker containers as well.


Make it possible to run the graphql unit_tests with the entire suite

Currently you have to run the tests in a two-step approach like this
pytest test/unit_tests/ --ignore=test/unit_tests/graphql && pytest test/unit_tests/graphql

This is because of the autouse fixture fastapi_app_graphql() in test/unit_tests/graphql/conftest.py which attempts to register graphql models, which somehow causes strawberry to find duplicate models. I tried to dig into it a bit with a debugger but could not find the reason.
Would be great if we can make these tests run properly as part of the main suite.

This gets fixed with my PR were the models are re-created with register_graphql and update the GraphQL schema with it.
https://github.com/workfloworchestrator/orchestrator-core/pull/440

This gets fixed with my PR were the models are re-created with register_graphql and update the GraphQL schema with it. #440

Awesome :)


Macro not working in content block with rich text editor

I noticed that macro's aren't working like they should. It renders the exact same content as the one in the richtext editor instead of it creating the content when it's rendering it.
This is how normal tinymce content is saved in the database:
<?UMBRACO_MACRO macroAlias=\"VideoImageWithCaption\" image=\"umb://media/ea0e3fe8608d46638dc1ff274aee5d51\" videoUrl=\"\" caption=\"\" />\n
Teeshfjkhdkjh aldjfk ajsd
\n
f ajksdfk ashdfjkhaskldjflsadf

And this is how the content is saved in the content blocks:

Testdf asdf asdfasdfasdf  adfasdfasdfasdfasdf
\n
 Contact specialist  arrow_forward

The <?UMBRACO_MACRO> element is hidden in the comment for the content blocks, so it doesn't get rendered correctly.

Can you check how macro's are saved in Nested Content (i.e. just add your Content Block dataType to the Homepage or so)? That should be the same as in ContentBlocks. If it does work in NestedContent then I can have a look. If it doesn't work in NestedContent then there is not much we can do either.

Hey @PerplexDaniel,
Yeah, that's one of the things I also checked. This is the full textValue that gets stored in the database when using nested content:
[
  {
    "key": "3748c52e-3b0e-400e-9403-253e7e3d2cdd",
    "name": "Item 1",
    "ncContentTypeAlias": "financialResultsWebcast",
    "title": null,
    "description": "<?UMBRACO_MACRO macroAlias=\"VideoImageWithCaption\" image=\"umb://media/ea0e3fe8608d46638dc1ff274aee5d51\" videoUrl=\"\" caption=\"\" />\n
Teeshfjkhdkjh aldjfk ajsd
\n
f ajksdfk ashdfjkhaskldjflsadf
",
    "video": null,
    "videoBackground": null
  }
]

And this is the full textValue that is stored for the contentBlocks:
{
  "version": 2,
  "header": null,
  "blocks": [
    {
      "id": "428c0aff-6601-484c-b1aa-f37e3eaa8e5c",
      "definitionId": "615ce491-9551-47e6-bc1a-5e0116804dcf",
      "layoutId": "08574c01-53e9-40d2-aa77-d6997ec1bd1b",
      "content": [
        {
          "key": "123f851e-53af-4a89-9f73-9be743da0a7c",
          "name": "Working towards transformation",
          "ncContentTypeAlias": "textSection",
          "title": "Working towards transformation",
          "text": "
Test content
"
        }
      ]
    },
    {
      "id": "7c0d2c92-d360-45ab-aacf-fdd24ca21ea6",
      "definitionId": "615ce491-9551-47e6-bc1a-5e0116804dcf",
      "layoutId": "08574c01-53e9-40d2-aa77-d6997ec1bd1b",
      "content": [
        {
          "key": "72d768d8-ebb4-4de1-9b9c-150e6f269fa2",
          "name": "A successful launch",
          "ncContentTypeAlias": "textSection",
          "title": "A successful launch",
          "text": "
Test Content with Macro
\n
 Contact specialist  arrow_forward
"
        }
      ]
    },
    {
      "id": "f41e0d6d-7dfc-4f73-ac47-0cd8e07460d6",
      "definitionId": "615ce491-9551-47e6-bc1a-5e0116804dcf",
      "layoutId": "08574c01-53e9-40d2-aa77-d6997ec1bd1b",
      "content": [
        {
          "key": "67495fb1-40fa-40b0-9f62-d27a9773f043",
          "name": "The future of Marel Live",
          "ncContentTypeAlias": "textSection",
          "title": "The future of Marel Live",
          "text": "
Macro alias: VideoImageWithCaption
\n
Another test content with macro
"
        }
      ]
    }
  ]
}

Strange, it shouldn't really store anything differently than Nested Content but apparently it does. Will try to have a look at this soon.

Well it seems Umbraco uses a MacroTagParser in their Rich Text Editor property editor to parse their macro tags back and forth. I suppose we will have to somehow call these methods as well for our editor.
Seems like IDataValueEditor.FromEditor() & IDataValueEditor.ToEditor() are probably the place for this, considering this is also where the Rich Text Editor itself does that. So our editor should implement these methods and call Nested Content's FromEditor / ToEditor() methods.
This is similar to how we already implement Validation at this moment. We also call Nested Content's validation method and go from there.
Just putting this info here for later when I'll try if that fixes this. Assuming it will.

@patrickdemooij9 I have included a fix for this issue in 1.5.2-rc.1 which is on NuGet now. Make sure to tick "Include prerelease" to find it. Seems to work now. If you find any issues let me know and I'll fix them before 1.5.2 final.

@patrickdemooij9 FYI I have released 1.5.2. If you didn't have the chance to test it yet and still find issues just let me know and we'll fix in a next release.


[bug] The msi setup wizard needs to close the unrelated programs

Describe the bug
The msi setup wizard needs to close the unrelated programs, what are the configurations to avoid it?

Reproduction
No response
Expected behavior
When installing MSI, do not close the unrelated programs
Platform and versions
> tauri "info"

Environment
  › OS: Windows 10.0.19044 X64
  › Webview2: 103.0.1264.44
  › MSVC:
  › Node.js: 18.4.0
  › npm: 8.12.1
  › pnpm: 7.5.0
  › yarn: Not installed!
  › rustup: 1.24.3
  › rustc: 1.62.0
  › cargo: 1.62.0
  › Rust toolchain: stable-x86_64-pc-windows-msvc

### Stack trace

_No response_

### Additional context

_No response_

On issues like this, please always post the full output of tauri info, because now the most important info, the tauri versions, is missing :/
Anyway this was fixed in one the last release candidate versions, so please update tauri to stable, and remove the target/ dir (or at least all files with a .msm file extension in target/debug/ and target/release/)


Thank you!

Thanks for taking the time to make this little library. It's saving me a lot of time at work.  <3

Awww. 💖


Unable to get admin rights

Installed through Docker.
Used the following docker-compose.yml
`version: '2'
services:
webapp:
image: 4minitz/4minitz:stable
ports:
- 8082:3333
environment:
- MONGO_URL=mongodb://mongo/4minitz
volumes:
- 4minitz_storage:/4minitz_storage
mongo:
image: mongo:4.2
volumes:
- mongo_data:/data/db
volumes:
4minitz_storage:
mongo_data:
`
and used the following settings.json
{
"public": {
"defaultUserProfile": {
"sendAgenda": true,
"sendMinutes": true,
"sendActionItems": true,
"sendInfoItems": false
},
"development": false,
"allowedThemes": [
"default",
"dark",
"gfbio"
]
},
"ldap": {
"enabled": false
},
"email": {
"from": "4minitz<EMAIL_ADDRESS>},
"adminIDs": ["XXXXXXXXX"],
"log": {
"level": "info",
"toConsole": true,
"toFile": {
"filename": "../4minitz.log",
"maxSize": 5242880,
"maxFiles": 10,
"json": false
}
}
}
Obviously, the Admin ID is not XXXXX, is the one I found by registering at the 4Minitz installation and then clicking on "about" and double click at the side of the logo.

Ok, here are the directory contents
~/4Minitz$ dir
4minitz_storage
docker-compose.yml
settings.json
~/4Minitz/4minitz_storage$ dir
4minitz_mongodb
4minitz_settings.json.save
4minitz_settings.json
log
settings.json
settings.json.backup
This is the Docker Compose file located at ~/4Minitz
version: '2'
services:
4minitz:
image: 4minitz/4minitz:stable
ports:
- "8082:3333"
volumes:
- ./4minitz_storage/settings.json:/app/4minitz/imports/settings.json
- 4minitz_storage:/4minitz_storage
environment:
- MONGO_URL=mongodb://mongo/4minitz
mongo:
image: mongo:4.2
volumes:
- mongo_data:/data/db
volumes:
4minitz_storage:
mongo_data:
And this is the Settings file... it's the same settings.json at 4Minitz, settings.json at ~/4Minitz/4minitz_container and also 4minitz_settings.json at 4minitz_container.
Notice my user ID for the Admin and also that I changed the branding for TESTE to see if it would change.
{
"//1": "below option ensures that embedded links in E-Mails and attachments point back t>
"ROOT_URL": "http://localhost:8082",
"//2": ["below option switches off some privacy settings in trusted environments",
            "true: will send a finalize mail to all recipients as one(!) mail, so users >
            "       and will reveal long names and mail addresses of other users",
            "false: will send separate finalize mails to all participants and keep their>
"trustedIntranetInstallation": true,

"//2.0": "Switch on/off the possibility to register new users on the login form",
"forbidClientAccountCreation": false,

"//2.1": ["Array of userID strings that get the admin role - may be an empty array",
          "Admins may register users, de-activate users, send broadcast messages, ...",
          "All admins will receive 'new version exists' emails if update check finds new>
          ],
"adminIDs": ["vwhQimEcduQuQ8ct5"],

"//2.1 branding": ["Via branding you can configure the 'first impression' of your local >
    "topLeftLogoHTML: default is text '4Minitz.com', but you may add HTML that can live >
    "                 You also can embedd a clickable logo image like so:
    "                 Then put the mylogo.png inside /public folder before building or",
    "                 inside build/programs/web.browser/app after building.",
    "                 HINT: If you run 4Minitz in a subfolder like https://www.company.c>
    "                 and you have set URL_ROOT accordingly then you have to put the the>
    "                 in front of your image URL like so:
    "showGithubCorner: default is 'true', but you can switch off the top right github lo>
    "showInfoOnLogin: Specify if you want to show product info bullets on the login scre>
    "createDemoAccount: Specify if webapp shall create a demo account (user=demo, passwo>
    "legalNotice: If enabled, adds a link to the bottom of the login screen and to the a>
    "             This may be switched of for intranet installation.  IN NO E>
            "BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION O>
            "ARISING FROM, OUT OF OR IN CONNECTION WITH THE SERVICE OR THE USE OR OTHER >
        ]
    }
},

"//2.2": "Change name of site",
"siteName": "4Minitz",

"//3": "below option configures if and how to send E-Mails",
"email": {
    "//3.1": "Switch on/off E-Mail sending",
    "enableMailDelivery": false,
    "//3.2": "Choose one of the below mail deliver methods",
    "mailDeliverer": "mailgun|smtp",

    "//3.3": [
        "defaultEMailSenderAddress: if this is an empty string, the sending users mail a>
        "be the 'FROM:' sender of the email. If you specify an email address here, this >
        "will be the 'FROM:' sender of each mails, and the sending user will be inserted>
        "If you set this to empty, please specify fallbackEMailSenderAddress!",
        "(see admin guide for the decision tree)."
    ],

"defaultEMailSenderAddress"<EMAIL_ADDRESS>    "//3.4": [
        "defaultEMailSenderExceptionDomains: an array of domains.",
        "For these domains the defaultEMailSenderAddress will NOT be used.",
        "Use case: Inside your intranet you want to send mails from real user names of y>
        "But if you cooperate with users from other companies inside your 4Minitz, these>
        "users will get trouble sending mail from your 4Minitz to mail addresses",
        "inside their company with their mail address in FROM: header.",
        "This really looks like spam, so it will probably be blocked!."
    ],
    "defaultEMailSenderExceptionDomains": ["yourdomain.de", "yourdomain.com"],

    "//3.5": [
            "fallbackEMailSenderAddress: if sending user has no mail address specified i>
            "this will be 'FROM:' sender.",
            "If defaultEMailSenderAddress is set empty this field must be set with a val>
            "If this setting is empty and user has no mail address in profile, sending e>
            "(see admin guide for the decision tree)."
        ],
    "fallbackEMailSenderAddress"<EMAIL_ADDRESS>
    "smtp": {
        "mailUrl": "smtp://USERNAME:PASSWORD@HOST:PORT/"
    },
    "mailgun": {
        "apiKey": "Your mailgun api key",
        "domain": "Your mailgun domain",
        "apiUrl": "https://api.mailgun.net/v3"
    },

    "//3.6": "Send an e-mail with a verification token to new user when enableMailDelive>
    "sendVerificationEmail": false,

"//3.7": "Enable form to resend the verification token to users e-mail when enableMa>
"showResendVerificationEmailLink": false,
    "//3.8": "Enable form to perform user password reset when enableMailDelivery:true",
    "showForgotPasswordLink": true
},

"//4": "below option to configure default labels. These will be copied to all newly adde>
"defaultLabels": [
    { "name": "Status:RED",     "color": "#ff0000"},
    { "name": "Status:YELLOW",  "color": "#ffff00"},
    { "name": "Status:GREEN",   "color": "#008000"},
    { "name": "Decision",       "color": "#0099ff"},
    { "name": "Proposal",       "color": "#ffff66"},
    { "name": "Draft",          "color": "#ffff66"},
    { "name": "Confidential",   "color": "#cc2222"},
    { "name": "Unclassified",   "color": "#22cc22"},
    { "name": "Issue",          "color": "#cc66ff"},
    { "name": "Milestone",      "color": "#66ff66"},
    { "name": "Escalation",     "color": "#ff9933"}
],

"//5": "MongoDB configuration",
"db": {
    "mongodumpTargetDirectory": "/4minitz_storage/mongodump"
},

"//6": ["LDAP Configuration",
        "details see admin guide: https://github.com/4minitz/4minitz/blob/develop/doc/ad>
        "HINT: please also consider to set the global forbidClientAccountCreation: true >
    ],
"ldap": {
    "enabled": false,
    "propertyMap": {
        "username": "uid",
        "longname": "cn",
       "email": "mail"
    },
    "//1": "Optional, will perform bind with these credentials before searching for user>
    "authentication": {
        "userDn": "admin",
        "password": "password"
    },
    "searchFilter": "(objectClass=user)",
    "serverDn": "OU=people,DC=example,DC=com",
    "serverUrl": "ldaps://ld.example.com:636",
    "allowSelfSignedTLS": false,
    "whiteListedFields": [ "uid", "cn", "department", "employeeNumber", "mail", "mailEna>
    "inactiveUsers": {"strategy": "none"},
    "autopublishFields": [ "cn" ],
    "importOnLaunch": true,
    "importCronTab": false,
    "hideStandardLogin": false,
    "label4Username": "Username (LDAP/AD)",
    "label4Password": "Password"
},

"//7": ["Upload attachment configuration",
        "enabled: true|false to switch on/off upload attachment feature",
        "storagePath: relative path is relative to the app's private/assets folder.",
        "             when testing in developer mode, meteor will erase dir on re-builds>
        "             use absolute path for full control. Make sure meteor user has writ>
        "allowExtensions: regexp '.*' to allow all extensions or pipe separated list lik>
        "denyExtensions: empty string or regexp pipe separated list like 'exe|bat|sh|scr>
        "maxFileSize: maximum allowed bytes per upload file"

    ],
"attachments": {
    "enabled": true,
    "storagePath": "/4minitz_storage/attachments",
    "allowExtensions": ".*",
   "denyExtensions":  "exe|app|bat|sh|cmd|com|cpl|exe|gad|hta|inf|jar|jpe|jse|lnk|msc|m>
    "maxFileSize": 10485760
},

"//8": ["Document Generation",
        "enabled: true|false to switch on/off downloading minute protocols",
        "format: string indicating the file format to be used for protocols. Currently s>
        "targetDocPath: relative path based on the app's private/assets folder, alternat>
        "               assign absolute path. Ensure write access for meteor users!",
        "pathToWkhtmltopdf: only applies if format pdf or pdfa is selected. Contains the>
        "wkhtmltopdfParameters: applies if format pdf or pdfa is selected. Enables you t>
        "pathToGhostscript: only applies if format pdfa is selected. Contains the path t>
        "pathToPDFADefinitionFile: only applies if format is pdfa. Contains the path to >
        "ICCProfileType: only applies if format is pdfa. Represents the type of the icc >
    ],

"docGeneration": {
"enabled": true,
"format": "pdfa",
"targetDocPath": "/4minitz_storage/protocols",
"pathToWkhtmltopdf": "/usr/bin/xvfb-run",
"wkhtmltopdfParameters": "--server-args="-screen 0, 1024x768x24" /usr/bin/wkhtmlto>
"pathToGhostscript": "/usr/bin/gs",
"pathToPDFADefinitionFile": "/PDFA_def.ps",
"ICCProfileType" : "cmyk"
}
}
and finally, the log
Note: you are using a pure-JavaScript implementation of bcrypt.
While this implementation will work correctly, it is known to be
approximately three times slower than the native implementation.
In order to use the native implementation instead, run
meteor npm install --save bcrypt
in the root directory of your application.
Attachments upload feature: ENABLED
attachmentsStoragePath:/4minitz_storage/attachments
Document generation feature: ENABLED
Document Storage Path: /4minitz_storage/protocols
OK, has write access to attachmentsStoragePath
OK, has write access to Document Storage Path
*** Admin IDs:
Th1s1s0nlyADummy1d: unknown ID!
Version: {
"tag": "v1.5.2",
"branch": "master",
"commitlong": "595d9b45f49ceba68398dfcb2daae8c098123f2d",
"commitshort": "595d9b45",
"date": "2018-04-18"
}
*** ROOT_URL: http://localhost:3100
WebApp current working directory:/4minitz_bin/bundle/programs/server
*** ATTENTION ***
There exists an account with user name 'demo'.
If this account was created with the setting 'branding.createDemoAccount',
the password for user 'demo' is also 'demo'.
Please check, if this is wanted for your site's installation.

Strange. This feature did not cause any trouble in the past.

Have you re-imported the changed settings into the docker?
Have you restarted the server afterwards?
Have you checked the log file? If AdminIDs are properly set, you should see the AdminID(s) listed with their user names there. If the AdminID is an unknown you have configured an unknown ID:

I20230405-23:22:28.311(2)? Attachments upload feature: ENABLED
I20230405-23:22:28.382(2)? attachmentsStoragePath:/home/4mins/www/attachments_4mindev
I20230405-23:22:28.383(2)? Document generation feature: ENABLED
I20230405-23:22:28.383(2)? Document Storage Path: /home/4mins/www/protocols_4mindev
I20230405-23:22:28.384(2)? OK, has write access to attachmentsStoragePath
I20230405-23:22:28.384(2)? OK, has write access to Document Storage Path
I20230405-23:22:28.384(2)? *** Admin IDs:
I20230405-23:22:28.385(2)?     bdeJAp3nmZdZEetam: unknown ID!
I20230405-23:22:28.385(2)?     eHXtKh8nqoPkasvMv: adminuser
I20230405-23:22:29.986(2)? Version: {
I20230405-23:22:29.987(2)?     "tag": "v2.0.0-develop",
I20230405-23:22:29.987(2)?     "branch": "develop",
I20230405-23:22:29.988(2)?     "commitlong": "8ad0318b06c21397f52a9cfc4c5d7132a644c6e2",
I20230405-23:22:29.988(2)?     "commitshort": "8ad0318",
I20230405-23:22:29.988(2)?     "date": "2020-05-04"
I20230405-23:22:29.989(2)? }
I20230405-23:22:30.081(2)? *** ROOT_URL: https://develop.4minitz.com

ps, notice that I changed the settings.json... I was using a small one, then I noticed 4Minitz itself had created a template inside 4minitz_storage. Still, all settings.json or 4minitz_settings.json all have my user ID there as well as a test to change the branding.
None worked. It is as if 4Minitz is NOT reading the settings.json or 4minitz_setting.json files.

Only now noticed I could reply directly here
Ok, here are the directory contents
~/4Minitz$ dir
4minitz_storage
docker-compose.yml
settings.json
~/4Minitz/4minitz_storage$ dir
4minitz_mongodb
4minitz_settings.json.save
4minitz_settings.json
log
settings.json
settings.json.backup
This is the Docker Compose file located at ~/4Minitz
version: '2'
services:
4minitz:
image: 4minitz/4minitz:stable
ports:

"8082:3333"
volumes:
./4minitz_storage/settings.json:/app/4minitz/imports/settings.json
4minitz_storage:/4minitz_storage
environment:
MONGO_URL=mongodb://mongo/4minitz
mongo:
image: mongo:4.2
volumes:
mongo_data:/data/db
volumes:
4minitz_storage:
mongo_data:

And this is the Settings file... it's the same settings.json at 4Minitz,
settings.json at ~/4Minitz/4minitz_container and also 4minitz_settings.json
at 4minitz_container.
Notice my user ID for the Admin and also that I changed the branding for
TESTE to see if it would change.
ps, notice that I changed the settings.json... I was using a small one,
then I noticed 4Minitz itself had created a template inside
4minitz_storage. Still, all settings.json or 4minitz_settings.json all have
my user ID there as well as a test to change the branding.
None worked. It is as if 4Minitz is NOT reading the settings.json or
4minitz_setting.json files.
{
"//1": "below option ensures that embedded links in E-Mails and attachments
point back t>
"ROOT_URL": "http://localhost:8082",
"//2": ["below option switches off some privacy settings in trusted
environments",
"true: will send a finalize mail to all recipients as
one(!) mail, so users >
"       and will reveal long names and mail addresses of
other users",
"false: will send separate finalize mails to all
participants and keep their>
"trustedIntranetInstallation": true,
"//2.0": "Switch on/off the possibility to register new users on the
login form",
"forbidClientAccountCreation": false,
"//2.1": ["Array of userID strings that get the admin role - may be an
empty array",
"Admins may register users, de-activate users, send
broadcast messages, ...",
"All admins will receive 'new version exists' emails if
update check finds new>
],
"adminIDs": ["vwhQimEcduQuQ8ct5"],
"//2.1 branding": ["Via branding you can configure the 'first
impression' of your local >
"topLeftLogoHTML: default is text '4Minitz.com', but you may add
HTML that can live >
"                 You also can embedd a clickable logo image like
so:
"                 Then put the mylogo.png inside /public folder
before building or",
"                 inside build/programs/web.browser/app after building.",
"                 HINT: If you run 4Minitz in a subfolder like
https://www.company.c>
"                 and you have set URL_ROOT accordingly then you
have to put the the>
"                 in front of your image URL like so:
"showGithubCorner: default is 'true', but you can switch off the
top right github lo>
"showInfoOnLogin: Specify if you want to show product info bullets
on the login scre>
"createDemoAccount: Specify if webapp shall create a demo account
(user=demo, passwo>
"legalNotice: If enabled, adds a link to the bottom of the login
screen and to the a>
"             This may be switched of for intranet installation.
 IN NO E>
"BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY,
WHETHER IN AN ACTION O>
"ARISING FROM, OUT OF OR IN CONNECTION WITH THE SERVICE OR
THE USE OR OTHER >
]
}
},
"//2.2": "Change name of site",
"siteName": "4Minitz",
"//3": "below option configures if and how to send E-Mails",
"email": {
"//3.1": "Switch on/off E-Mail sending",
"enableMailDelivery": false,
"//3.2": "Choose one of the below mail deliver methods",
"mailDeliverer": "mailgun|smtp",
"//3.3": [
    "defaultEMailSenderAddress: if this is an empty string, the

sending users mail a>
"be the 'FROM:' sender of the email. If you specify an email
address here, this >
"will be the 'FROM:' sender of each mails, and the sending
user will be inserted>
"If you set this to empty, please specify fallbackEMailSenderAddress!",
"(see admin guide for the decision tree)."
],"defaultEMailSenderAddress": @.***",
"//3.4": [
"defaultEMailSenderExceptionDomains: an array of domains.",
"For these domains the defaultEMailSenderAddress will NOT be used.",
"Use case: Inside your intranet you want to send mails from
real user names of y>
"But if you cooperate with users from other companies inside
your 4Minitz, these>
"users will get trouble sending mail from your 4Minitz to mail
addresses",
"inside their company with their mail address in FROM: header.",
"This really looks like spam, so it will probably be blocked!."
],
"defaultEMailSenderExceptionDomains": ["yourdomain.de", "yourdomain.com"],
"//3.5": [
        "fallbackEMailSenderAddress: if sending user has no mail

address specified i>
"this will be 'FROM:' sender.",
"If defaultEMailSenderAddress is set empty this field must
be set with a val>
"If this setting is empty and user has no mail address in
profile, sending e>
"(see admin guide for the decision tree)."
],
"fallbackEMailSenderAddress": @.***",
"smtp": {
    "mailUrl": ***@***.***:PORT/"
},
"mailgun": {
    "apiKey": "Your mailgun api key",
    "domain": "Your mailgun domain",
    "apiUrl": "https://api.mailgun.net/v3"
},

"//3.6": "Send an e-mail with a verification token to new user

when enableMailDelive>
"sendVerificationEmail": false,
"//3.7": "Enable form to resend the verification token to users e-mail when
enableMa>
"showResendVerificationEmailLink": false,
"//3.8": "Enable form to perform user password reset when

enableMailDelivery:true",
"showForgotPasswordLink": true
},
"//4": "below option to configure default labels. These will be copied
to all newly adde>
"defaultLabels": [
{ "name": "Status:RED",     "color": "#ff0000"},
{ "name": "Status:YELLOW",  "color": "#ffff00"},
{ "name": "Status:GREEN",   "color": "#008000"},
{ "name": "Decision",       "color": "#0099ff"},
{ "name": "Proposal",       "color": "#ffff66"},
{ "name": "Draft",          "color": "#ffff66"},
{ "name": "Confidential",   "color": "#cc2222"},
{ "name": "Unclassified",   "color": "#22cc22"},
{ "name": "Issue",          "color": "#cc66ff"},
{ "name": "Milestone",      "color": "#66ff66"},
{ "name": "Escalation",     "color": "#ff9933"}
],
"//5": "MongoDB configuration",
"db": {
"mongodumpTargetDirectory": "/4minitz_storage/mongodump"
},
"//6": ["LDAP Configuration",
"details see admin guide:
https://github.com/4minitz/4minitz/blob/develop/doc/ad>
"HINT: please also consider to set the global
forbidClientAccountCreation: true >
],
"ldap": {
"enabled": false,
"propertyMap": {
"username": "uid",
"longname": "cn",
"email": "mail"
},
"//1": "Optional, will perform bind with these credentials before
searching for user>
"authentication": {
"userDn": "admin",
"password": "password"
},
"searchFilter": "(objectClass=user)",
"serverDn": "OU=people,DC=example,DC=com",
"serverUrl": "ldaps://ld.example.com:636",
"allowSelfSignedTLS": false,
"whiteListedFields": [ "uid", "cn", "department",
"employeeNumber", "mail", "mailEna>
"inactiveUsers": {"strategy": "none"},
"autopublishFields": [ "cn" ],
"importOnLaunch": true,
"importCronTab": false,
"hideStandardLogin": false,
"label4Username": "Username (LDAP/AD)",
"label4Password": "Password"
},
"//7": ["Upload attachment configuration",
"enabled: true|false to switch on/off upload attachment feature",
"storagePath: relative path is relative to the app's
private/assets folder.",
"             when testing in developer mode, meteor will
erase dir on re-builds>
"             use absolute path for full control. Make sure
meteor user has writ>
"allowExtensions: regexp '.*' to allow all extensions or pipe
separated list lik>
"denyExtensions: empty string or regexp pipe separated list
like 'exe|bat|sh|scr>
"maxFileSize: maximum allowed bytes per upload file"
],

"attachments": {
"enabled": true,
"storagePath": "/4minitz_storage/attachments",
"allowExtensions": ".*",
"denyExtensions":
"exe|app|bat|sh|cmd|com|cpl|exe|gad|hta|inf|jar|jpe|jse|lnk|msc|m>
"maxFileSize": 10485760
},
"//8": ["Document Generation",
"enabled: true|false to switch on/off downloading minute protocols",
"format: string indicating the file format to be used for
protocols. Currently s>
"targetDocPath: relative path based on the app's
private/assets folder, alternat>
"               assign absolute path. Ensure write access for
meteor users!",
"pathToWkhtmltopdf: only applies if format pdf or pdfa is
selected. Contains the>
"wkhtmltopdfParameters: applies if format pdf or pdfa is
selected. Enables you t>
"pathToGhostscript: only applies if format pdfa is selected.
Contains the path t>
"pathToPDFADefinitionFile: only applies if format is pdfa.
Contains the path to >
"ICCProfileType: only applies if format is pdfa. Represents
the type of the icc >
],
"docGeneration": {
"enabled": true,
"format": "pdfa",
"targetDocPath": "/4minitz_storage/protocols",
"pathToWkhtmltopdf": "/usr/bin/xvfb-run",
"wkhtmltopdfParameters": "--server-args="-screen 0, 1024x768x24"
/usr/bin/wkhtmlto>
"pathToGhostscript": "/usr/bin/gs",
"pathToPDFADefinitionFile": "/PDFA_def.ps",
"ICCProfileType" : "cmyk"
}
}
and finally, the log
Note: you are using a pure-JavaScript implementation of bcrypt.
While this implementation will work correctly, it is known to be
approximately three times slower than the native implementation.
In order to use the native implementation instead, run
meteor npm install --save bcrypt
in the root directory of your application.
Attachments upload feature: ENABLED
attachmentsStoragePath:/4minitz_storage/attachments
Document generation feature: ENABLED
Document Storage Path: /4minitz_storage/protocols
OK, has write access to attachmentsStoragePath
OK, has write access to Document Storage Path
*** Admin IDs:
Th1s1s0nlyADummy1d: unknown ID!
Version: {
"tag": "v1.5.2",
"branch": "master",
"commitlong": "595d9b45f49ceba68398dfcb2daae8c098123f2d",
"commitshort": "595d9b45",
"date": "2018-04-18"
}
*** ROOT_URL: http://localhost:3100
WebApp current working directory:/4minitz_bin/bundle/programs/server
*** ATTENTION ***
There exists an account with user name 'demo'.
If this account was created with the setting 'branding.createDemoAccount',
the password for user 'demo' is also 'demo'.
Please check, if this is wanted for your site's installation.
Em qui., 6 de jul. de 2023 às 11:47, Wolfram Esser @.***>
escreveu:

Strange. This feature did not cause any trouble in the past.

Have you re-imported the changed settings into the docker?
Have you restarted the server afterwards?
Have you checked the log file? If AdminIDs are properly set, you
should see the AdminID(s) listed with their user names there. If the
AdminID is an unknown you have configured an unknown ID:

I20230405-23:22:28.311(2)? Attachments upload feature: ENABLED
I20230405-23:22:28.382(2)? attachmentsStoragePath:/home/4mins/www/attachments_4mindev
I20230405-23:22:28.383(2)? Document generation feature: ENABLED
I20230405-23:22:28.383(2)? Document Storage Path: /home/4mins/www/protocols_4mindev
I20230405-23:22:28.384(2)? OK, has write access to attachmentsStoragePath
I20230405-23:22:28.384(2)? OK, has write access to Document Storage Path
I20230405-23:22:28.384(2)? *** Admin IDs:
I20230405-23:22:28.385(2)?     bdeJAp3nmZdZEetam: unknown ID!
I20230405-23:22:28.385(2)?     eHXtKh8nqoPkasvMv: adminuser
I20230405-23:22:29.986(2)? Version: {
I20230405-23:22:29.987(2)?     "tag": "v2.0.0-develop",
I20230405-23:22:29.987(2)?     "branch": "develop",
I20230405-23:22:29.988(2)?     "commitlong": "8ad0318b06c21397f52a9cfc4c5d7132a644c6e2",
I20230405-23:22:29.988(2)?     "commitshort": "8ad0318",
I20230405-23:22:29.988(2)?     "date": "2020-05-04"
I20230405-23:22:29.989(2)? }
I20230405-23:22:30.081(2)? *** ROOT_URL: https://develop.4minitz.com
—
Reply to this email directly, view it on GitHub
https://github.com/4minitz/4minitz/issues/585#issuecomment-1623814662,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AZHZ7HFLOPSQH5O5W5HQ22LXO3FYXANCNFSM6AAAAAA2ANSF5E
.
You are receiving this because you authored the thread.Message ID:
@.***>

--
Rogério Penna
(51) 9919-9190
https://rogerpenna.carbonmade.com/
https://www.facebook.com/pixelfinal?ref=hl
http://pixelfinal.blogspot.com

This section of your log file shows, that your adminIDs are not visible inside the docker container - hey are not propagated to the docker file system:
*** Admin IDs:
Th1s1s0nlyADummy1d: unknown ID!

So please double check that the container sees the right storage directory outside the container also inside the container.  This section of the admin guide is relevant:
https://github.com/4minitz/4minitz/blob/develop/doc/admin/adminguide.md#use-your-4minitz-docker-container
Make sure this "outside" directory of the docker compose has the desired settings.json changes:
-v /persistent/data/storage:/4minitz_storage

Then - as written in the above admin guide - restart the container, by CTRL+C and restart.
Then the outside storage directory changes of setings json are re-read by the inside docker contrainer 4minitz instance.
Hope this helps.

This section of your log file shows, that your adminIDs are not visible inside the docker container - hey are not propagated to the docker file system:
*** Admin IDs:
Th1s1s0nlyADummy1d: unknown ID!

I know that. As I mentioned in my reply, (which is a little confusing due to all mixed text), I also changed the settings file to change the BRANDING, and it also did not work. Thus I assume 4Minitz is not reading ANY of my settings file.

So please double check that the container sees the right storage directory outside the container also inside the container. This section of the admin guide is relevant: https://github.com/4minitz/4minitz/blob/develop/doc/admin/adminguide.md#use-your-4minitz-docker-container
Make sure this "outside" directory of the docker compose has the desired settings.json changes:
-v /persistent/data/storage:/4minitz_storage

Then - as written in the above admin guide - restart the container, by CTRL+C and restart. Then the outside storage directory changes of setings json are re-read by the inside docker contrainer 4minitz instance.
Hope this helps.

I will try that. Thanks

Ok, success. I have been able to run 4 Minitz in admin mode after uninstalling it all and using the docker-compose json from the 4Minitz help file.
Here... both the branding modified (TESTE) and also the admin tasks


Ok Solved by installing HTML module .

WTF?? now getting this error
Traceback (most recent call last):
File "linkfinder.py", line 372, in
''' % (html.escape(url), html.escape(url))
AttributeError: 'module' object has no attribute 'escape'


Fixup tests to use rent-exempt accounts

Rent-exempt requirement for accounts is coming down the pipe: https://github.com/solana-labs/solana/pull/22292
Several tests in this repository create rent-paying accounts. Since these account balances appear to be arbitrary, this PR fixes those tests up to use rent-exempt amounts.
@mvines , any concerns here? I didn't see any fundamental reason for these rent-paying accounts.
There are also some stake-pool tests that are failing. Will be addressed in a separate PR.

Merging. Let me know if I've missed something and need to ask for forgiveness and revert...


Sort Images per unused

Hello,
I'd like to feature request something I think should be pretty easy as it's just in the portainer interface.
I'd like to have an aditional column in the images list and move the "Unused" tag to that column and make it sortable.
this way, it would be much faster to delete unused images.

You could use the Filter under Id to only show unused images.

oh wow, i must be blind.
thank you!
issue closed!


New Papers

Hi!
can you add two papers to 2022:
https://scholar.google.de/citations?view_op=view_citation&hl=de&user=VKDX28YAAAAJ&sortby=pubdate&citation_for_view=VKDX28YAAAAJ:k_IJM867U9cC
https://www.biorxiv.org/content/10.1101/660308v4
Thank you!

Hi
I have added https://www.biorxiv.org/content/10.1101/660308v4. But could not view or download this paper https://scholar.google.de/citations?view_op=view_citation&hl=de&user=VKDX28YAAAAJ&sortby=pubdate&citation_for_view=VKDX28YAAAAJ:k_IJM867U9cC.

Can you send the pdf version?

https://antonio-schettino.com/publication/govaart-eeg-erp-prereg-template-2022/govaart-eeg-erp-prereg-template-2022.pdf


Fix type check

I fixed existing type check of functions. It includes following changes:

Split type_check.expect calls for ndim checking and shape checking, since, if the ndim is too small, the corresponding shape accessing is failed outside of the type checking utility, which ends up with unfriendly messages.
I fixed the type specification of Linear function, which must accept arrays with more than two dimensions. It enables us to directly input to Linear function an array with spatial dimensions.

Can you add test for the case for more than two dimensions?

It is better to check if examples run properly.

Fix the test https://github.com/pfnet/chainer-test/blob/master/test_example.sh

:+1:

I added tests to test_linear.py for inputs with more than two dimensions.

And, I'll make lazy-evaluation mechanism for the problem 1.

Good, that will make the type checking code smarter.


Add requestSubmit() polyfill by default

So we can rely on requestSubmit everywhere and know it'll work on Safari.

Should add documentation too that this is the way to do it.

Great to see this by default. It looks like this is the polyfill by javan, which seems to have an issue on iOS Safari so not entirely bulletproof yet. Thought it's worth noting here in case others run into similar issues.


ScullyRoutesService observables filtering for wrong property

🐞 Bug report
Description
When trying to use ScullyRoutesService observables such as available$ or unPublished$ it seem that there are two different property names being used for telling wether a post is published or not.
e.g. ScullyRoutesService
...
 available$ = this.allRoutes$.pipe(
    map(list => list.filter(r => (r.hasOwnProperty('published') ? r.published !== false : true))),
    shareReplay({refCount: false, bufferSize: 1})
  );
...

Looking at the JSON of the produced scully-routes.json however I found that this property in fact is called publish. As a consequence of this all posts are always available.
🔬 Minimal Reproduction
Actually this is reproducible with the most basic setup:

Create project with scully as described in: https://github.com/scullyio/scully/blob/master/docs/getting-started.md
Create a post: ng g @scullyio/init:post --name="This is my post"
This post should be created with publish: false
Subscribe to ScullyRoutesService.available$. Despite not being published it is being shown in the list.

💻Your Environment
Angular Version:
Angular CLI: 9.0.2
Node: 10.16.3
OS: darwin x64

Angular: 9.0.1
... animations, common, compiler, compiler-cli, core, forms
... language-service, platform-browser, platform-browser-dynamic
... platform-server, router
Ivy Workspace: Yes

Package                                    Version
--------------------------------------------------------------------
@angular-devkit/architect                  0.900.2
@angular-devkit/build-angular              0.900.2
@angular-devkit/build-ng-packagr           0.900.2
@angular-devkit/build-optimizer            0.900.2
@angular-devkit/build-webpack              0.900.2
@angular-devkit/core                       9.0.2
@angular-devkit/schematics                 9.0.2
@angular/cli                               9.0.2
@angular/http                              7.2.16
@ngtools/webpack                           9.0.2
@nguniversal/express-engine                v8.2.6
@nguniversal/module-map-ngfactory-loader   8.1.1
@schematics/angular                        9.0.2
@schematics/update                         0.900.2
ng-packagr                                 9.0.1
rxjs                                       6.5.4
typescript                                 3.7.5
webpack                                    4.41.2

Scully Version:

    "@scullyio/init": "0.0.23",
    "@scullyio/ng-lib": "0.0.18",
    "@scullyio/scully": "0.0.75",

🔥 Exception or Error

@mchl18 I'm going to look deeper into this before I will merge your PR.
I see your issue. However, the current setup is working in our tests. I want to know why, before I'll merge your pr.

I just set this Pr up in kind of a rush. I wanna dig deeper into this and maybe even write some tests for the angular service

Your PR is merged, so I'm going to close the issue.
Turned out, the schematics where out of sync, and that was not where I was looking.


Return pretty error when no pubspec was found in the dir tree

Fixes #33.

also i'm not a fan of testify, i think stdlib is enough, but yeah, I'm just complaining for reason now. ignore me


Close Page error

The closepage behaviour is broken by this widget in my project mendix v9.9.1

fix in https://github.com/engalar/mendix-pluggable-widget-PrintScreen


BART training time

May I know how much time BART pre-training took in which GPU configuration? I can see in the paper its written 500K steps with batch size 8k but I want to know the time it took. Many thanks.

The time can depend on the type and numbers of gpus. We trained for around 11-12 days on #256 gpus.


Editing emoji assets?

Maybe this would be better as a wiki or README entry, but for now - what editors and associated font configurations are known to be good for editing Assets?

I usually use VSCode and PureScript IDE extension.
https://marketplace.visualstudio.com/items?itemName=nwolverson.ide-purescript
Thanks to the IDE, I can check syntax and type errors on the editor every time I save my codes. awesome!
For editing emoji assets, so far I’m satisfied with just copy and paste.
https://unicode.org/emoji/charts/full-emoji-list.html
Or it may be useful to install some extensions which help emoji input.
https://marketplace.visualstudio.com/items?itemName=bierner.emojisense
As for fonts, I have no idea what is good at the moment, so I leave it to each usage environment.
I usually use macOS 10.15 and Chrome browser.

I will update a Wiki or README if I finish organizing it a little more.


ref and hyp in Speech2TextCTCTask

Bug report
ref and hyp should be swapped, else ref saves the hypotheses and hyp saves the references.
https://github.com/s3prl/s3prl/blob/610fe98214e77b84e05d17c716280e326abb61ec/s3prl/task/speech2text_ctc_task.py#L204-L211

Wow, how did this happen...
Thanks for reporting, I can fix that today. (Or you can also send a PR if you want.)


In ix-pane component, ix-pane header title doesnt show the entire title content after exceeding a limit

Prerequisites

[X] I have read the Contributing Guidelines.
[X] I have not leaked any internal/restricted information like screenshots, videos, code snippets, links etc.

What happened?
ix-pane title/header is not shown completely after exceeding certain limit

What type of frontend framework are you seeing the problem on?
Angular
Which version of iX do you use?
v2.4.1
Code to produce this issue.
<ix-pane class="search-result__ix-pane" [heading]="Capabiility Details of Industrial Edge - Cloud Connector" slot="right" [size]="paneSize" [hideOnCollapse]="true" [expanded]="expanded"
    id="search-result__ix-pane" (expandedChanged)="expandedChanged($event)">
/ix-pane>

Hi @vamshisai98, thanks for reaching out! Actually, this behavior is intentional. I’ve also consulted with our UX colleagues, and they advised that headings should generally be kept concise.

@vamshisai98 A possible solution that is also used in other applications is to keep the title short and use a separate field in the content below to show the name of the entity. Best, Felix


Drop dotnet:8.0-bullseye due to upstream unavailability

Fixes https://github.com/devcontainers/images/actions/runs/6882081495/job/18719819258#step:6:3594
Opened https://github.com/dotnet/dotnet-docker/issues/5001 as dotnet images for 8.0-bullseye are unavailable.

From https://github.com/dotnet/dotnet-docker/discussions/5002#discussioncomment-7581104, hence, we won't add support for dotnet:8.0-bullseye

according to our supported platforms documentation, we support the latest stable version of Debian at the time of a .NET major release as well as any new stable Debian versions as they are released. Since the latest stable version of Debian is Bookworm, we won't be offering Bullseye images for .NET 8.


CVE-2023-4863

Per CVE-2023-4863 , "Heap buffer overflow in WebP in Google Chrome prior to 116.0.5845.187 allowed a remote attacker to perform an out of bounds memory write via a crafted HTML page."
Is Kiwi Browser affected? The latest version is 116.0.5845.72 which is below the fixed version of Chrome.

Is Kiwi Browser affected? The latest version is 116.0.5845.72 which is below the fixed version of Chrome.

To my knowledge Yes, and i really hope the devs would soon release an update
For more info please check this out https://www.bleepingcomputer.com/news/security/google-assigns-new-maximum-rated-cve-to-libwebp-bug-exploited-in-attacks/

There's a second vuln, regarding the VP8 video encoder: https://nvd.nist.gov/vuln/detail/CVE-2023-5217
Really do hope Kiwi releases an emergency update. These two are pretty dangerous in the wild and everything needs to be updated ASAP.

 Last activity from sole developer was over a month ago, and this really kills my ability to depend on Kiwi to keep its users safe. Since the end of Firefox Fennec, I have struggled to find any mobile browser with the same features and flexibility, including:

Full extension support without jumping through hoops
Bookmarks list as home page with proper forward/back navigation through folders
Desktop style tab bar
Printing/save to PDF support
Ability to turn off clould/tracking/telemetry

All Firefox variants and derivatives are lacking in at least one of these. I hope Kiwi can find a way to be a bit more sustainable and dependable, because it's really the only one out there that I find usable.

Unfortunately, something like this was about to happen. No one can expect a single developer to react to ciritical bugs all the time - they have their "other life", vacation, illness, ... This makes the "one devloper" model unsuitable for a critical app with a large attack surface. Depsite knowing that risk, I embraced Kiwi because I do not know of any alternative (a Chromium based browser with full extension support).
Firefox destroyed their Android version when they changed from Fennec to Fenix over 3 years ago. To this day, Fenix is still a joke.


Unreleased directories are sorted incorrectly in ChangelogExporter

Read .2.x.x and .3.x.x directories are passed to the changelog template in ChangelogExporter in incorrect order, that is, .2.x.x first and then .3.x.x, whereas it should have been the other way round.

Fixed in d55e01107b2aaef3393375516dd9d897abeba241.


Support for cyclecloud_slurm_version 3.0.4

support for the latest slurm-cyclecloud version 3.0.4 see https://github.com/Azure/cyclecloud-slurm

autoscaling is done by the azslurm python script
scheduler packages are installed thru the CC packaged script
add new property in the cyclecloud slurm template to store package names
need to specify slurm.use_pcpu = false
merge slurmclient and slurmserver ansible roles in the slurm role
slurm version supported depends on the cyclecloud_slurm_version value

[20.11.9 | 22.05.3] with cyclecloud_slurm_version==2.7.x
[22.05.9 | 23.02.5] with cyclecloud_slurm_version==3.0.x.

cyclecloud_slurm_version supported are 2.7.0-2.7.2, 3.0.4

close #1623

@ltalirz @matt-chan


Fix namespace issues caused by CsWin32 upgrade

Description
This fixes an issue similar to https://github.com/microsoft/CsWin32/issues/532, in the same way that https://github.com/microsoft/WindowsAppSDK-Samples/pull/197 does.
Target Release
1.2
Checklist

[X] Samples build clean with no warnings or errors.
[X] I have commented on my PR /azp run SamplesCI-<FeatureName> to have the CI build run on my branch for each of my FeatureName my PR is modifying. This must be done on the latest commit on the PR before merging to ensure the build is up to date and accurate. Warning: the PR will not block automatically if this is not run due to '/azp run' limitation on triggering more than 10 pipelines.

/azp run SamplesCI-SelfContainedDeployment, SamplesCI-Input, SamplesCI-DeploymentManager, SamplesCI-CustomControls


Only flying NPCs should cause waves when they sink, or at least cause bigger waves.

Think it is pretty solid now. Closing.


Problem with UTF-8 encoding

Hi @stevebauman !
Some users in my Active Directory have 'ñ' character in his username.
The problem is when the username is get from the server:
$request->server($auth[$key])
https://github.com/Adldap2/Adldap2-Laravel/blob/6c7a671df1c7e4ba412ba01c6a6b60d4fa1994ee/src/Middleware/WindowsAuthenticate.php#L53
It returns 'ñ' like strange symbol. I think that it is a codification problem. Maybe a server configuration problem?
In anyway, encoding to UTF-8 it works for me:
if ($account = $request->server($auth[$key])) {
      $account = utf8_encode($account);
      // ...
}

Thank you!

Operating System: Windows Server 2008
PHP Version: 5.6.8
Lavarel Version: 5.4.23
Adldap2-Laravel Version:  2.1

Thank you!
Woow, that is fast !

Hi @munfor, thanks for letting me know! No problem at all :).
However, this fix will be released in v3.1 since it will come with a new configuration option (see: link).
This will be released in the coming days. Just need to finish the documentation for this option.


Does SWR supports code and data preloading

When you enable suspense , how do SWR fetches both data and code parallelly to support code and data preloading

When you enable Suspense it will

Check if the data is already cached outside an effect
If it’s not then trigger a fetch
Then throw the promise so Suspense will cache it
If the data it’s ready, or when the promise resolves, it will return the data or error

The idea of the suspense mode is that you never receive data as undefined, your component got suspended and you handle the fallback using React.Suspense instead.
You can check how it works starting here https://github.com/zeit/swr/blob/master/src/use-swr.ts#L448
It doesn’t handle code preloading

react-query has a prefetchQuery function for doing data pre-fetch, this would be 💯 to have with swr: https://github.com/tannerlinsley/react-query#prefetchQuery

You could do that using mutate.
import { mutate } from "swr";

mutate("/api/resource/1", {}, true);

The last true (which is the default value so you don't really need it) will tell SWR to revalidate that data, so you pass an empty data and then let SWR fetch the real one for you.
You could also actually fetch the data and then run mutate.
import { mutate } from "swr";

const data = await fetch("/api/resource/1").then(res => res.json();
mutate("/api/resource/1", data, false);

In this case since we already fetched the data we tell mutate to don't revalidate it, it will do it however once a component requiring this data is rendered tho.

brilliant! i'm totally wrapping that up into a util

actually, digging into the source a bit, I don't think using mutate would behave the same. If we are pre-fetching, then the hook hasn't been called yet, so there is no CACHE_REVALIDATOR for the key set yet. The idea with pre-fetch being that we would be able to start loading data before the component rendered.

@tamagokun it does. Because it will set the cache before component mounts.
Although we’re working on another option to make prefetching even more easier and faster (as I explained here https://github.com/zeit/swr/issues/11#issuecomment-551371673).

I see, looking at those examples, the first mutate wouldn't start the fetch until the hook was created, but the 2nd one would definitely work. Looking forward to see what comes out of #11 :v:


stopSystem doesn't work well with python nodes

Modified stopSystem to kill every python task when run. This is probably bad.

Fixed.


pc-updatemanager incorrect setting for pkg-static  (Trident-x64-20180831.iso )

New install of Trident-x64-20180831.iso
Added pc-updatemanager via pkg install pc-updatemanager.
Installed pc-updatemanager complains that "/usr/local/sbin/pkg-static: not found".
It's actually located at /usr/sbin/pkg-static.
Check the setting for "PKG_CMD"

As a quick workaround, you can   ln -s /usr/sbin/pkg-static  /usr/local/sbin/pkg-static
before you start mucking around with packages

The pc-updatemanager utility was depricated in TrueOS 18.06, and replaced by the trueos-update utility (along with other changes such as pkg getting moved into the base OS - hence the path change).


Remove unnecessary clamp

Hope I'm not missing anything here, otherwise I'm glad to learn :)
The examples at least look the same to me, but I didn't check all of them.

It does make a difference.
mix(c1,c2,lambda) internally is just calculated as (lambda * c1 + (1-lambda) * c2).
If lambda is outside of the range of (0,1), the resulting color can be weird, as it is not in between the colors
Look at the alternative mesh in swap_grass_mesh where points of the mesh can be lower than in the default mesh.
You'll see that the bottom part will becomes black. ( even though the bottom color is dark green)

Ah, I see. Could one then divide by the grass blade height to normalize it?

Yes, already tried that. The problem is that we don't know the highest point of the grass mesh.
(at least when a custom mesh is used

However you are right. The color gradient should be normalized over the blade

Aaaah I see!
Also, minor point I just noticed: the code right now colors over the y axis. This wouldn't work in a game like Super Mario Galaxy, where we have round planets. This is why generally in my 3D code, I pass an up vector that is defaulted to Vec3::Y instead :)
But that is quite a niche demand.
Closing this PR because of the discussion above

I see. This is true, however when using heightmaps in the future there is no way we could support round planets anyway ( I guess)
If you see something like that you can also open a small issue, this way we can keep track of things like that for the future.
(I tend to always forget something like that after a couple of days :smile: )


Azure VM rotation leave unassigned NiC & Volumes

The Rotation of nodes or deletion of nodes sometimes leave NiC and Volumes unattached.
Also, the nodes are sometimes not disappearing out of the node list in the cluster, because the finalizer does not finish.
It appears the VM is removed by Azure but then the machine controller finalizers are failing because the NiC and the disc are no longer related to the already deleted VM.
According to Microsoft you can add an option to delete the VM always with nic and volume.
Dead Nodes with broken finalizer:

Unassigned Discs & Nics in Azure

What should happen, machines should be removed without any nics and volumes left behind.

@mfahlandt which KKP version did you face this issue on?

We tried fixing this with https://github.com/kubermatic/machine-controller/pull/1286 but that PR was never back-ported. So it's highly likely that this issue is not there in the latest master.

@mfahlandt The issue isn't reproducable on my end, so I will close the issue for now and port back #1286 to earlier versions.
If this issue persists, please reopen the issue.

@shatoboar I think this issue still persists, check out resource group kubernetes-xbhhw5bqxz in our Azure subscription for example. There's a NIC leftover in there.

I tested it with 2.19 multiple versions.

re:

It appears the VM is removed by Azure but then the machine controller finalizers are failing because the NiC and the disc are no longer related to the already deleted VM.

I don't think that is the problem because both NICs and public IPs are identified as "related" via tags on those resources. So the VM not existing anymore should not impact MC's ability to identify those resources as related.

So in 2.19 the fix was never backported. But for 2.20 and master we were not able to reproduce this issue.
The issue mainly is from KKP side and not from MC. So it'll probably be converted in another ticket for KKP. That's my opinion.

re:

It appears the VM is removed by Azure but then the machine controller finalizers are failing because the NiC and the disc are no longer related to the already deleted VM.

I don't think that is the problem because both NICs and public IPs are identified as "related" via tags on those resources. So the VM not existing anymore should not impact MC's ability to identify those resources as related.

This is the funny part. When you take a look at the screenshot Azure removes the relation from the NiC and the Disc. Idk if that is happening because we remove the vm but usually the leftovers have no relation anymore. This then might also be the reason why the finalizers fail, because it can not find the vm anymore.

@mfahlandt but that's what I mean, the attachment that Azure creates is not used to identify the resources that need deletion. It's done via a custom tag that MC adds to all resources belonging to a specific Machine. So attachments should play no role.

@embik @mfahlandt I'll highly recommend that let's open up a dedicated ticket for KKP; fix azure cleanup. And then let's investigate it by following the complete lifecycle for a cluster.

@ahmedwaleedmalik agreed


[Suggestion] non-creative "staged/tier" Flux Sponges

I do love on how Thaumcraft is growing up to be, yet would love to see a non-creative way to thin out the flux without being too Over powered. When I saw the Creative Flux Sponge and how it works, it got me thinking.
Having a stage/tier type flux sponge. Each with their own limit.
Plus adding to the equation, 2 types of Flux tanks
And variations of the already existing Tubes as Flux Tubes
For this,
Crafting and Ability
One obvious way to create a flux sponge is using Sponges, but the lowest tier would use Yellow Wool. (I will say shards, but it's Vis Crystals)
I have 4 tiers in mind.

Tier 1: 1 Use sponge, it gets destroyed as soon as it is used, Flux gathered is destroyed. As for crafting it uses a lot of Ordo, Aqua, and Ignis.  1 yellow sponge at the center, and 3 Vacuos Shard same crafting shape as a bucket.

Tier 2: 1 use Sponge, but gathers double the flux then Tier 1, and stores it, but destroys once emptied. Same recipe as Tier 1, but uses a minecraft sponge, instead of the yellow wool. Reason which I won't change the recipe much is that to get sponges usually we get them in underwater temples. Unless a mod that makes them easier to get.

Tier 3: Low Storage Sponge, won't be destroyed. Stores as much as a tier 2 sponge. Crafted using the Infusion Altar, Sponge in the center, 3 Vacuos Shards, 1 bucket, and 2 Praecantatio shards. Uses 1 whole Jar of Ordo, Aqua, and Ignis' Essentia.

Tier 4: High Storage Sponge, won't be destroyed. Stores 10 times more then a tier 2 sponge. Crafted using the Infusion Altar, Tier 3 Flux Sponge in the center, 3 Tier 1 Flux Tank. Uses 2 whole Jar of Ordo, Aqua, Ignis' Essentia. and 1 whole Jar of Vacuos, and Praecantatio Essentia.

Tank Tier 1: Can fill up with flux Gas, it will let out all it's contained flux if broken, or moved. Can't be piped. Usually for quick cleanup. Crafted using Arcane Workbench, Magic Tallow Surrounded with 4 Vacuos Shards in the corners, a crucible at the bottom, and 3 Glass blocks. Giving more use to the Magic Tallow, as a way to store the flux as an sort of a seal.

Tank Tier 2: Same as above, but won't lose it's contained flux. Can be piped with pipes specified to move flux. Crafted using an Infusion Altar, Tier 1 Flux Tank in the center, 4 Directional Flux Tubes, and 2 Mirrored Glass, 1 Thaumometer, 1 redstone comparator. The idea behind the Mirrored Glass is that it's a magical glass, can be used to prevent flux from escaping, as with the Thaumometer, plus the effect of the Thaumometer makes it easier to monitor the Tank with diverse ways to for redstone signals (Such as emit when empty, full, 1/2 full and so on). Plus it's the only See-Through object.

Flux Tube Variety: Making it simple: Just add any Essentia Tube with a Vishroom, and Silverwood Plank.

Reason for using Gas instead of Liquid
Mainly due that many mods does use liquids mostly for pipes, in case of Gas, It's less used and even rarer to pipe, though I would think it's still possible so I am stretch in using the "Essentia" instead of Gas, but it can't be used for Infusion Crafting.
Anyhow, I want to avoid using other mod piping. And perhaps a way to convert the flux into it's liquid form. Using only Thaumcraft system.

I love this idea and think maybe there can be an addition as well. Since vitium essentia is kind of hard to get and pretty much requires tainted land somewhere and for you to go mine it and smelt it and get a little bit of vitium, one could refine the gathered flux. The easiest way I can think of would just be with the crystalizer. This would avoid having to put a new machine in the mod that turns flux into liquid vitium. This may defeat the purpose and be just as much work as mining taint, but that is just a thought. Perhaps the centrifuge could be of help in turning flux into vitium. That way its still in liquid form and doesn't require any smelting. But its output would be very small. Only maybe like 20% of flux actually turns into liquid vitium. I feel like this is a good exchange since vitium is useful later on, and requires that you pump lots of flux into the aura to get even a usable amount of vitium.

Yea
The main idea is both, cleaning flux and even using the flux itself, I also though that in early game it shouldn't be a too OP method, in which that it cost more then later on in-games, but it at least helps in clearing out the flux in the environment.
Plus taking your idea into account, it does improve on the idea of having the 2 tanks, 1 for storage only, the other which can be used for a production system.

Please put this bit.ly/TCSuggestions

Ok, moved it, with the reply


[Feature Request]: Export/Backup Shelves in folders & Markdown files

Describe the feature you'd like
I recently stated using this project and I have to say it's very well thought and maintained.
Well done!
I'm a user of Obsidian and I'm transferring all my notes and structure to BookStack.
It would be extremely helpful to be able to export/backup all the Shelves (complete with books, pages and chapters) in folders & Markdown files.
Markdown is a future proof file type that works across all OS.

Markdown is a non proprietary, future-proof file type that works across all OS, software and devices, so that will be helpful to all who use markdown for writing their notes, thoughts, documentation etc.
Additional context
No response

Thanks for the request and kind feedback @manosioa.
The trouble that I have with such export requests is that the exact configuration and format of exports can vary quite a lot depending on use-case, and introducing a vast array of options for export can be a burden on maintenance.
These kinds of operations are why we have the REST API, which includes some endpoints for exporting to various formats (Including markdown). We have a repo with examples of using the API for various tasks. The export all books script may be of particular interest for this case.
If handy with typescript you could even build an obsidian extension to consume this API to import content in directly.

Hi @ssddanbrown
Just found this thread while searching the web.
I and I guess many others do this, have basically my whole build guide to my complete homelab on bookstack, so if my homelab ever gets wiped out I'd technically also loose any bookstack guides, to be able to rebuild the homelab.
I ofc. have a backup of bookstack externally, however i'd still prefer a cron job, that for example backups weekly my full bookstack shelves into shelf->folder, book -> folder, page group-> filename prefix, page -> file format, while keeping links to the image.
For me that won't matter if I could just read it in an emergency and this way slowly get up stuff, to then import full bookstack backups,
That'd be awesome, thanks!

@CrazyWolf13 if it helps I have a script here to export all books: https://github.com/BookStackApp/api-scripts/tree/main/php-export-all-books
Could set that up and schedule it via cron daily or so.

I have a script here to export all books: https://github.com/BookStackApp/api-scripts/tree/main/php-export-all-books

Sounds good, thanks!
How do I use it on my instance?
Is that file already on bookstack installation?

@CrazyWolf13 if it helps I have a script here to export all books: https://github.com/BookStackApp/api-scripts/tree/main/php-export-all-books
Could set that up and schedule it via cron daily or so.

@CrazyWolf13 if it helps I have a script here to export all books: https://github.com/BookStackApp/api-scripts/tree/main/php-export-all-books
Could set that up and schedule it via cron daily or so.

Hello thanks you for the script, i really need a try on it. As i am really bad at coding (reaaaaaallly) Can you tell me if your script IS able to "copy" external link too. I explain : i have screen capture on m'y page. I also want it with my md file ?


[DON'T MERGE] CI

What changes were proposed in this pull request?

Why are the changes needed?

Does this PR introduce any user-facing change?

How was this patch tested?

I filed a JIRA at https://issues.apache.org/jira/browse/SPARK-39959

should not be associated with SPARK-39902, I tried to revert it but still fail

https://github.com/LuciferYang/spark/runs/7645272948?check_suite_focus=true

It's very likely a dependency problem from R doc generation

FYI: https://github.com/apache/spark/pull/37399


Issue when parsing single 'Y' format

Hi,
moment('5.12.2015', 'D.M.Y').year() is giving 2016 (incorrect)
while
moment('5.12.2015', 'D.M.YYYY').year() is giving 2015 (correct)
Is single character year unsupported? Or is it a bug?
We are using locale strings from angular, and noticed the bug because of the year change.
Thanks.

Seems that the regexes object contains an entry for "Y" while formatTokenFunctions does not.

The docs would suggest that 'Y' isn't a valid input for year. You should use 'YY' or 'YYYY'.

Im also seeing bugs with formatting in v2.11.0. When doing
moment(1441065600000).format('MMM')
I get 'sept' returned which is wrong. It should be 'sep'. (all other months work fine)

@michaelgeorgeattard you're absolutely right. The problem is that Y is not a format token, and this basically means its useless as a parse token.
@digitalgears this is completely unrelated. There are other discussions for Sep vs Sept, and I'll revert the code to using Sep in 2.11.1

Close in favor of #2868.


Move to SmallRye

For the 3.0 release, we want to move Jandex to SmallRye (and use the automated release process SmallRye has). Ideally, all Jandex repos (this one, the typeannotation-test, and the Maven plugin) would be brought into one (covered by #122).
The groupId would change from org.jboss[.jandex] to io.smallrye (or io.smallrye.jandex, but I'd probably prefer the first one :-) ). The artifactIds or packages wouldn't change (so packages would still be org.jboss.jandex), as that would be too big of a break.
EDIT: as part of this, also rename the master branch to main.

I don't think everyone will get the individual notifications from GitHub, maybe worth forwarding to the wildfly-dev list?

I agree, but I also think we should do that after the 2.4.0.Final release. I mean -- what I just added to the 2.4.0.Final milestone was originally referred to as 3.0. Then we decided we should call it 2.4, as there's nothing breaking, and do a 3.0 with some breakages that are needed (including this one). I think that makes most sense, but until that is actually done, I'd like to leave the door open :-)

+1 whenever makes more sense.

@Ladicek moving to Smallrye sounds like a wonderful idea, +1 to that. About the package name, I wonder if that wouldn't be an opportunity to introduce some major API changes (eg. introduce a new API under io.smallrye.jandex and keep the original API under org.jboss.jandex)?

I'm not sure we want to have 2 APIs. Also current implementation relies heavily on package-private methods, which precludes such split. I think we'll just live with some breaking changes :-)

All the changes required in the code base (groupId and parent POM) are now done on the smallrye branch. I'm not closing this issue because Jandex is still under the wildfly org. I believe we should transfer this repo to the smallrye org when the 3.0 release is almost ready. In the meantime, the changes for the 3.0 release should be done as PRs against the smallrye branch.

I just moved the Jandex repository to the smallrye GitHub org in preparation for a 3.0.0-RC1 release. Hence this is done for good.

If my understanding is correct, we can consider the org.jboss.jandex group-id moved to io.smallrye.jandex?
I'm working on Maven oga plugin, a plugin that alerts developers when an artifact moved to new coordinates, but the affected pom files do not offer the relocation information. This is based on a huge list of coordinates migrations and, I would like to know your opinion before adding the migration rule(s) for Jandex. Thanks!

If my understanding is correct, we can consider the org.jboss.jandex group-id moved to io.smallrye.jandex?

No. The artifacts are moved like this:
org.jboss:jandex -> io.smallrye:jandex
org.jboss.jandex:jandex-maven-plugin -> io.smallrye:jandex-maven-plugin
See https://smallrye.io/blog/jandex-3-0-0/ for more.

I'm working on Maven oga plugin, a plugin that alerts developers when an artifact moved to new coordinates, but the affected pom files do not offer the relocation information.

We do have relocations in place for org.jboss:jandex. Does it not work?

This is based on a huge list of coordinates migrations and, I would like to know your opinion before adding the migration rule(s) for Jandex.

See above.
Thanks for reaching out, please let me know if you need more information!


[BUG] Unable to change the basemap_style

Context
After reading through the documentation and examples I am unable to change the basemap_style to 'DarkMatter'.
The following code displays a map, but just removes all basemap's rather than replacing the default one with Carto's DarkMatter.
fires = ScatterplotLayer.from_geopandas(gdf)
map = Map(layers=[fires], _height=800, basemap_style = "DarkMatter")
fires.get_fill_color = "#eb0000"
fires.radius_scale = 500
map

It's almost certainly an issue of me not understanding the API docs on basemap_style, but it would be helpful to have some sample code or to show one of the examples with a different basemap.
Resulting behaviour, error message or logs
Describe what happened:
using the basemap_style = "DarkMatter" option removes all baseman's rather than changing it from the default
Environment

OS: MacOS 14.1
Browser: Safari
Lonboard Version: 0.8.0]

The string is not the name of the basemap style; it's the URL where the style is located. You can use CartoBasemap as a helper to not need to recall the URL.
from lonboard.basemap import CartoBasemap
from lonboard import Map

Map(layers=[], basemap_style=CartoBasemap.DarkMatter)

if you print the value of that enum variant, you can see the URL it points to:
print(CartoBasemap.DarkMatter.value)
# https://basemaps.cartocdn.com/gl/dark-matter-gl-style/style.json

So it would also work if you passed that str into the Map directly
from lonboard.basemap import CartoBasemap
from lonboard import Map

Map(
    layers=[],
    basemap_style="https://basemaps.cartocdn.com/gl/dark-matter-gl-style/style.json",
)

We can probably make a better error message by asserting that the str input to basemap_style is a URL of some kind


Juicer pre create .hic

Hi,
I also follow this command to run jucer to create a .hic file
java -Xmx2g -jar juicebox_tools.jar pre data/test.txt.gz data/test.hic hg19
I want to know what kind of normalization is used by the above-mentioned command.
if not, can I apply ICE to normlize the .hic file generated by   java -Xmx2g -jar juicebox_tools.jar pre

Vanilla Coverage (VC), Square Root of Vanilla Coverage (VC_SQRT), and actual matrix balancing (KR or SCALE).
Please use the forum (aidenlab.org/forum.html for general questions)


MCMC improvements

Copied from email with @lloigor and @tbranck28 2020-04-09:

[ ] predict needs to integrate over the MCMC chain.
[ ] Working with MCMC chains should be revisited to make it much easier to work with multiple chains and perform things like burnin/thinning when reading a chain rather than on output.
[ ] automatic MCMC convergence criteria calculation
[ ] a run mode that will run until some convergence criteria are met rather than fixed # of samples
[ ] automatic traceplot generation.

All but the last point are handled by Turing (and the last is close by Turing). Just need to hook up the pipes.


Dev

Syncing branches

Created main branch, removed master, changed workflow files. dev needs to be merged into main.


nixpkgs-unstable blocked by failing inkscape on darwin

Describe the bug
See https://hydra.nixos.org/job/nixpkgs/trunk/unstable#tabs-constituents.
https://hydra.nixos.org/job/nixpkgs/trunk/inkscape.x86_64-darwin
https://hydra.nixos.org/build/116949829
It appears numpy is failing on darwin https://hydra.nixos.org/build/116949583.
cc @jonringer @FRidh

It appears numpy is failing on darwin https://hydra.nixos.org/build/116949583.

I believe this one is before #85636 was merged.
The new failure is:
Original error was: dlopen(/nix/store/b1b1g8vq6ij23pcyi6k2ik1p9pfszrmv-python3.7-numpy-1.18.1/lib/python3.7/site-packages/numpy/core/_multiarray_umath.cpython-37m-darwin.so, 2): Library not loaded: liblapacke.dylib
  Referenced from: /nix/store/b1b1g8vq6ij23pcyi6k2ik1p9pfszrmv-python3.7-numpy-1.18.1/lib/python3.7/site-packages/numpy/core/_multiarray_umath.cpython-37m-darwin.so
  Reason: image not found

builder for '/nix/store/hzqbrirlqj6yicf0al4j9g7ryc24ralb-python3.7-numpy-1.18.1.drv' failed with exit code 1

cc @matthewbauer

I don't see a .so being explicitly referenced in the nix expression, there's probably something that needs to be patched for darwin to look for the correct shared-library extension.

This was https://github.com/NixOS/nixpkgs/pull/83888, specifically the install_name_tool invocations.


Save transformations

@luis11011 we talk about using macro/actions to save instructions from the sidebar to be used in another Bumblebee project.
I think the simple solution is to save the whole batch of instructions to the macro (except the data loading part).
All the macros could be presented as a list that could be accessed through a button in the toolbar.

Duplicated #146


Allow "page" route parameter to be used in Mvc controllers

Fixes #6660

Doesn't build as yet because the feed isn't ready, but all I did was cherry-pick the commit from dev.


Add neonKUBE PriorityClass definitions to the cluster and set pod priorities

PriorityClass is a Kubernetes resource that identifies a priority class integer with a name.  These can be assigned to a pod spec and will be used by the Kubernetes scheduler to prioritize which pods get evicted next from a node experiencing disk or memory pressure.
https://kubernetes.io/docs/concepts/scheduling-eviction/pod-priority-preemption/
Priority values are non-zero integers.  Pods with lower priority will be evicted first.  By default, pods have their priority set to zero (but a PriorityClass can be configured as the default).
Kubernetes redefines two priority classes for its own use:

system-node-critical:<PHONE_NUMBER> (or 2,000,001,000)
system-cluster-critical:<PHONE_NUMBER>

system-node-critical is used for the critical Kubernetes static pods hosting components like kube-scheduler, kube-api-server, etcd,... i.e. pods that simply must be running for the node to be part of the cluster.
system-cluster-critical is used for cluster oriented services such as the kube-scheduler.
I've gone ahead and defined some standard priority classes to be used for our services as well as some for users.  Users can create their own priority classes of course, but I figure that it would be nice to have some starter classes that users can set out-of-the-box:
neon-operator       900008000
neon-network        900007000
neon-storage        900006000
neon-data           900005000
neon-api            900004000
neon-app            900003000
neon-monitor        900002000

user-veryhigh            5000
user-high                4000
user-medium              3000 <--- the global default
user-low                 2000
user-verylow             1000

The neon- prefixed priorities are reserved for our services where:

neon-operator is intended for neon-node-operator and neon-cluster-operator.  The idea is that these need to be alive to detect and hopefully resolve cluster problems (in the future)
neon-storage is intended for critical data storage (OpenEBS components)
neon-data is intended for critical data components like neon-system-db and Harbor
neon-network is intended for CNI and other networking components
user- priorities are intended for user pods

The user priorities are similar:

user-data: used for user databases
user-api: used for user API servers
user-app: used for user applications

The logic here is that if the user loses the database, their API services and application services will all fail and if the user loses API services, then all of the related applications will fail,  There's also likely to be more api/app pods than database pods and being stateless, the api/app pods are more free to relocate to other nodes so we'd much rather have those evicted than a database pod which may be tied to a node by a host volume.

[x] Provision these priority classes during cluster setup

We also need to set PriorityClass for all of our pods.  Note that these are defined as constants in:
https://github.com/nforgeio/neonKUBE/blob/master/Lib/Neon.Kube/Kubernetes/PriorityClass.cs
system-node-critical<PHONE_NUMBER>)

neon-etcd-proxy: the API server will be effectively offline without this
etcd-cluster same: no API server without this
calico
istio

system-cluster-critical<PHONE_NUMBER>)

coredns

neon-operator (900008000)

neon-node-agent
neon-cluster-operator
node-problem-detector

neon-network (900007000)

cert-manager
neon-acme

neon-storage (900006000)

openebs
openebs-cstor-operator
We'll also need to configure the OpenEBS operator to use this neon-storage for the pods it deploys
minio (operator created pods too?)

neon-data (900005000)

redis-ha
postgres-operator  (operator created pods too?)
harbor

neon-api (900004000)

neon-sso-session-proxy
dex
glauth
oauth2-proxy

neon-app (900003000)

kubernetes-dashboard
neon-dashboard
kiali
reloader
grafana
grafana-agent

neon-monitor (900002000)

cortex
kube-state-metrics
loki
tempo

neon-cli modifications:

[x] We need the newish --check option to report any images used in pods that have PriorityClass=0
[x] Add a neon cluster check command that also performs these checks

It looks like we'll need to implement a mutating admission webhook to set the harbor priority classes.  There doesn't appear to be a way to do this with the stock harbor operator.

It turns out that we don't need a mutating web hook after all: the harbor issue was due to operator error (I wasn't uploading helm charts while building a cluster with an out of date node image).

DONE

REOPENING: I realized that this is working only because I recently fixed a bug where I wasn't setting the user-medium priority class as default.  After I fixed that, the neon cluster setup --priority-class passes incorrectly because it looking for pods with no priority class, but now pods deployed without a priority will default to ** user-medium**.
I'm going to fix the check to look for any pods with priority less than neon-min and I'll add neon-min=9000002000 and neon-max=999999999 as additional priority classes,
This also means that we will need the mutating webhook after all.

Closing: going to track this here: #1612


[May 31] Meet to discuss workflow management system comparison & make a decision

Discussed the rubric (https://docs.google.com/spreadsheets/d/1u6YZDZKYfj-XZnXa2OfWqxQd3H4Mli3f_EC3eQXrdKI/edit#gid=0) and the team has landed on Airflow.


IRC Users joining/parting/quiting

I love Discord-IRC, but one of my major gripes with it is that IRC join/part/quit events aren't outputted to discord. I've just been manually changing my local files, but it's a bit irritating to do whenever I update. It would be great if this functionality came installed!
I have implemented this functionality in this branch. Feel free to change it as needed.
As a sidenote, I love the refactor that this code has received! It looks much cleaner.

Definitely this. Would be nice.

Will this gonna be implemented or not???

Wondering the same.

We need a review on that to make merging possible, i cannot do it because i ain't coder at all. at least i tried to merge by myself but i failed so i am waiting for someone to merge it

let's see if that will work))) 52 upvote and 0 downvotes definantly deserve the request to be merged... still i dont much know how github works

have the devs given up on this project?

Merged this PR into our fork, thank you very much @Ratismal !
To get this PR working, I had to make a few changes to the code.

@RoyCurtis Thanks i hope you will ressurect this project!

I don't think this project needs resurrecting, since the last commit was only 8 days ago. I also don't intend on taking over or providing support; that is purely just for our needs :)

Glad you got it working @RoyCurtis.
Considering how the last commit was to merge a 14 day old PR, and this PR was from over a year ago to implement basic events, I think there's little hope in the developers merging it.
I'd recommend any developers to manually integrate IRC support into their projects. If you're not a developer, you'll just have to make do.

Hm, is there a particular reason this PR hasn't been merged? (Maybe because it seems to lack tests?)

Well, I rebased this anyway (and updated bits of it to use the format of the new code), then added tests and extracted the bit that finds the discord channel, and overall hopefully it'll be readily mergeable.

Sorry that I haven't replied to this! The reason I didn't merge it originally was the lack of tests and the on by default behavior (needs to be behind a configuration option).
Let's try to get #207 merged. Thank you for your contribution @Ratismal.

Released in 2.3.0 - enable by setting ircStatusNotices to true in your config.