[Bug] [RestAPI] java.lang.ClassNotFoundException: com.mysql.cj.jdbc.Driver

Search before asking

[X] I had searched in the issues and found no similar issues.

What happened
when i use RestAPI to submit job. the job is mysql to console.
when the server cluster startup, the first time run is ok, but the next round will failed and got
java.lang.ClassNotFoundException: com.mysql.cj.jdbc.Driver error.
SeaTunnel Version
2.3.4
SeaTunnel Config
{
    "env": {
        "execution.parallelism": 2,
        "job.mode": "BATCH",
        "checkpoint.interval": 15000
    },
    "source": [
        {
            "url" : "jdbc:mysql://<IP_ADDRESS>:3306/st_poc?allowMultiQueries=true&useUnicode=true&characterEncoding=UTF-8&serverTimezone=Asia/Shanghai&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&useSSL=false",
            "driver" : "com.mysql.cj.jdbc.Driver",
            "connection_check_timeout_sec" :  100,
            "user" : "root",
            "password" : "123456",
            "query" : "select * FROM topic_01",
            "plugin_name" : "Jdbc"
        }
    ],
    "sink": [
        {
            "plugin_name": "Console"
        }
    ]
}

### Running Command

```shell
call `/hazelcast/rest/maps/submit-job` api to submit the job

Error Exception
java.lang.RuntimeException: java.lang.ClassNotFoundException: com.mysql.cj.jdbc.Driver
        at org.apache.seatunnel.api.table.factory.FactoryUtil.createAndPrepareSource(FactoryUtil.java:71) ~[seatunnel-starter.jar:2.3.4]
        at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.parseSource(MultipleTableJobConfigParser.java:320) ~[seatunnel-starter.jar:2.3.4]
        at org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.parse(MultipleTableJobConfigParser.java:181) ~[seatunnel-starter.jar:2.3.4]
        at org.apache.seatunnel.engine.server.rest.RestJobExecutionEnvironment.getLogicalDag(RestJobExecutionEnvironment.java:76) ~[seatunnel-starter.jar:2.3.4]
        at org.apache.seatunnel.engine.server.rest.RestJobExecutionEnvironment.build(RestJobExecutionEnvironment.java:99) ~[seatunnel-starter.jar:2.3.4]
        at org.apache.seatunnel.engine.server.rest.RestHttpPostCommandProcessor.handleSubmitJob(RestHttpPostCommandProcessor.java:136) ~[seatunnel-starter.jar:2.3.4]
        at org.apache.seatunnel.engine.server.rest.RestHttpPostCommandProcessor.handle(RestHttpPostCommandProcessor.java:82) ~[seatunnel-starter.jar:2.3.4]
        at org.apache.seatunnel.engine.server.rest.RestHttpPostCommandProcessor.handle(RestHttpPostCommandProcessor.java:60) ~[seatunnel-starter.jar:2.3.4]
        at com.hazelcast.internal.ascii.TextCommandServiceImpl$CommandExecutor.run(TextCommandServiceImpl.java:402) ~[seatunnel-starter.jar:2.3.4]
        at com.hazelcast.internal.util.executor.CachedExecutorServiceDelegate$Worker.run(CachedExecutorServiceDelegate.java:217) ~[seatunnel-starter.jar:2.3.4]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[?:1.8.0_121]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) ~[?:1.8.0_121]
        at java.lang.Thread.run(Thread.java:745) [?:1.8.0_121]
        at com.hazelcast.internal.util.executor.HazelcastManagedThread.executeRun(HazelcastManagedThread.java:76) ~[seatunnel-starter.jar:2.3.4]
        at com.hazelcast.internal.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:102) ~[seatunnel-starter.jar:2.3.4]
Caused by: java.lang.ClassNotFoundException: com.mysql.cj.jdbc.Driver
``

Zeta or Flink or Spark Version
zeta
Java or Scala Version
No response
Screenshots
No response
Are you willing to submit PR?

[ ] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

#6477 can solve this issue


test: experimental use of 1password for test secrets

The Issue
Experiment with using 1Password for secrets required in tests
This first attempt does only TestPlatformPull
How This PR Solves The Issue
Manual Testing Instructions
Automated Testing Overview

Release/Deployment Notes

I didn't mean to target this at ddev/ddev. Experiment ongoing on ddev-test/ddev


ContainerView ancestor warning is not alway correct

Will disable this warning for now because the imageViews don't necessarily have to be direct ancestors of the view they are presented in.


Can you provide redis-sentinel samples?

Thanks to the author for providing java-operator-sdk, I now need an example of redis sentinel. The specific logic is that three sentinel nodes manage multiple sets of master-slave, and master-slave can be dynamically added and deleted according to the situation. I don’t know if the author can provide this example What? Greatful!

@objcoding I'm sorry but currently we don't have a bandwidth at this point of time.

@objcoding I'm sorry but currently we don't have a bandwidth at this point of time.

ok, thank you.

I will close this issue as we wont be providing samples for specific technologies as samples are meant to demonstrate framework features. If you'd implement an operator for redis yourself @objcoding using the java-operator-sdk we're happy to help!


Adding empty label selector for prom service monitor selector

Introduced in #2465 the service monitor selector in the Prometheus configuration was marked wrongly,hence it was scraping metrics from only k8s-service-monitor. Adding an empty service monitor selector scrapes metrics from all Service monitors  present in the namespace.
List of Service Monitors present in the namespace
k8s-metrics-service-monitor
noobaa-mgmt-service-monitor
ocs-metrics-exporter
odf-operator-controller-manager-metrics-monitor
rook-ceph-exporter
rook-ceph-mgr
s3-service-monitor

/cherry-pick release-4.16


Is there an example of an item with a card layout with multiple fields?

How would I create a kanban item with the following structure:
Title: Present delivery
Owner: rouilj  <avatar image of rouilj>
Due date: 2020-12-25

It looks like the title property is a single line text string. I can add the owner, dueDate
ownerAvatar as custom properties, but how do I get them displayed in the item/card?
Can the
customHandler       : "+ %s"// your entirely customized handler. Use %s to position item title

property be used in some way to format the item? I don't see any doc on the customHander but
I assume it is meant to provide a handle to click on to start drag and drop. Otherwise the whole item/card accepts a click to drag and drop.

@rouilj did you find anything on how to do this ?  I want to do the same, can't see any obvious way to do so

Hi rbmcgowan:
In message<EMAIL_ADDRESS>rbmcgowan writes:

@rouilj did you find anything on how to do this ?  I want to do the
same, can't see any obvious way to do so

Didn't find a way to do this. Waiting on a response from the
developer.
--
-- rouilj
John Rouillard
My employers don't acknowledge my existence much less my opinions.

If you want customize the card content, you can insert your html in title properties of boards object.
Here ana example:
"item"  : [                           // item of this board
            {
                "id"    : "item-id-1",
                "title" : "
Hello Boys
"            // title of the item
                "class" : ["myClass",...]
            },
            ...
]

thanks for the response @riktar, appreciated.

Ah ok. Is the title injected with innerHTML into the card? I'll give it shot thanks.


Author affiliations not extracted correctly

Attached is an example of a paper (when converted to PDF in LibreOffice) where author affiliations are orphaned from their associated authors (i.e. a separate <author> is present with a nested <affiliation>) as well some of the affiliations being missing altogether. I also noted the last author has not been extracted at all. This was using the /processHeaderDocument endpoint.
Manuscript (1).docx
Manuscript (1).pdf

Here is another example where there are orphaned affiliations are extracted from a manuscript. I'm guessing in this specific case the line numbers could be throwing the extraction heuristics off, but I'm not sure?:
671727.full.pdf

Another example. I am attaching this one as an extreme example, and I acknowledge there may not be anything sensible that Grobid can do considering there's no actual cross-referencing in the manuscript between the authors and their affiliations. I.e. it's a layout a human can understand easily, but ML maybe less-so:
(asce)1532-3641(2001)1&3c1(21).pdf

Another example of poorly extracted title, authors and affiliations. Also the abstract has failed to be extracted at all. This was using the /processHeaderDocument endpoint. I think the running theme with at least some of these documents seems to be the inclusion of line numbers throwing off Grobid?
latex 1.pdf

Thanks a lot @danielrbrowne for the problematic use cases, it's useful to have them together with a description of the issues.
Indeed the review format with line number is not something supported well by GROBID for the moment and would require some more layout analysis/features. It's not a problem of heuristics, it's really breaking the machine learning which is trained in uninterrupted field sequences. These line numbers explain most of the errors I think (usually fields not interrupted by these numbers are pretty okay).
Regarding the first document, the layout of the header looks simple for us, but a bit unusual when compared to the existing training data (affiliation without address or country like the NIEHS for example). It's an interesting case which could be typically tackled I think by adding a couple examples like that in the training data.
About the third, I think GROBID is doing great given the "no worry" affiliation list without any cross-referencing - this is really a layout never seen in the training data. Covering that would be a more long term goal I think (affiliation attachment is heuristics-based).
Current header model need to be reworked entirely, it's the oldest model and there are quite a lot of new information and improvement that could be used now - in particular new reading order from PDF, spacing, etc. The open issue on this is from 2016 ...
https://github.com/kermitt2/grobid/issues/136
It requires quite a lot of work, in particular updating all the existing training data, so it's hard to plan/execute given that this project remains a side work for the contributors. It's easier to realize small "low hanging fruit" tasks :)
Thanks again for all these test cases, they are always welcome.


[Dissicussion] Rename the command terminusdb to tdbp

terminusdb is a command used by the backend cli, so to avoid confusion the click CLI tool in Python client is proposed to renamed as tdbp (my choice, feel free to propose others) Should be done in the next minor release.
I would rather to not rename it if it is not a must, cause I will have to go to all the tutorials and old demos (some could be video recordings) to change it (or make a remark about the change). I wonder if a user who is using both, can they rename this one as something else locally?
Would like to hear more thought about it

Perhaps the backend command should be terminusdb-ctrl.

Python won't change.


cd documentation added

A short description of our CD process

@edublancas @idomic can't add you as reviewers


Suggestion: Control panels & Variacs

control panels like the ones in industrial wiring

https://www.youtube.com/watch?v=hV0cN20vCMY
These?

This might end up in a logic sub mod.

https://www.youtube.com/watch?v=hV0cN20vCMY These?

yep

woah those 3d models are cool


Added Swedish translation to Github fork

Hi,
I'm not very good with GitHub, but I forked your project and added Swedish translation (sv.json) to the dev-branch:
https://github.com/jockebq/dreame-vacuum/tree/swedish-language-support
I think I did a pull request, but I don't know if this goes to you automatically.
Please add this in the next beta release.
Thank you!

Tried updating to Beta 15. But got this issue:
Error while loading /config/custom_components/dreame_vacuum/translations/sv.json: unexpected character: line 133 column 11 (char 4369)
Cannot find anything wrong with that line?

That line had missing " at the and but I have fixed it on the release. You have probably still be using your version and not the file that I have commited.

Nope, I am using the one you commited. Removed the integration completely, and installed it via Hacs, still get the error:
Error while loading /config/custom_components/dreame_vacuum/translations/sv.json: unexpected character: line 133 column 11 (char 4369)

You are the one who created the file, why are you asking me?

I am sorry, just trying to help with translating the project. You can remove the file if you wish.
I found out that there was a comma missing from line 132.


Change alerts to uikit

Thanks for this @bestmomo  and sorry for the extreme delay in responding. The changes you've noted have been included in a past release.


Books: add icon next to the title or put them in a separate sub section

What?
My idea here is to "warn" the reader that particular item on the list is a book and not just link to any online resource.
Why?
Because in order to read the book you have to buy it and it's usually much more to read than in any resource on the internet like an article, youtube movie, presentation etc.
What do you think?

Side question - does this mean that we only want to have books in here? I am asking because I was thinking about adding some internet resources here, links to interesting articles, etc. So juts to clarify -is this ok?

IMO "book" is only one of many types, but it's different :) Personally I would like to have here as many "online" resources as possible and books as a "special" resource - that's why I would like to mark them. Books are great extension to the topic for people who want's do spend their time and money to dig dipper.
I am not sure if it's clear for you :P

Clear! And I think it's a good idea :) +1

By "icons" you mean a book cover picture? Or just a generic symbol like this: 📖?

Generic symbol like 📖 is enough for me 🤟

Thanks @kat-kap for completing this task :)


Is it possible to wrapping emulator window view inside vscode?

I'm a mobile developer and always running emulator/simulator daily, as for now i usually doing this layout for development

but when i'm browse something and get back to vscode, i need to CMD[ALT]+TAB to select vscode and emulator
as i see View->Apperance->Secondary Side Bar have an ability to view "something" like this

i want to attach emulator into this view and maybe here's the final result I'm expected

is it possible to show emulator view inside vscode like this? so i don't need to open vscode and emulator to show side-by-side

You can create View that contains Webview (see https://code.visualstudio.com/api/extension-guides/web view) but you would need a way to stream video from and events to emulator.
Electron won't allow to embed random window.

@mjbvz, could you please help triage this issue? Thank you!

Closing as by-design as explained by @IllusionMH's answer


php 7 and mcrypt

A bit new to DrupalVM, so I'm probably missing something obvious, but I can't seem to get mcrypt to work on my CentOS 7 PHP 7 box. I've tried adding the remi repo for mcrypt (php70-php-mcrypt.x86_64) but PHP doesn't see it after restarting apache. Any idea what's going on? mcrypt is an option in the ldap suite of Drupal modules.
Thanks.

I know a few other people were asking about this as well. I haven't had a chance to test getting mcrypt on CentOS 7—but if you just set your list of PHP packages inside config.yml to the following, then vagrant provision again, does that work?
php_packages:
  - php
  - php-cli
  - php-common
  - php-devel
  - php-fpm
  - php-gd
  - php-imap
  - php-ldap
  - php-mbstring
  - php-opcache
  - php-pdo
  - php-pear
  - php-pecl-apcu
  - php-xml
  - php-xmlrpc
  - php-mcrypt

Yes, that worked. Awesome, thanks for the very fast working fix!

No problem!


Fixes TimedProgressMessenger's CFL display

For some reason output was always 0 before this change

It looks like maybe the CFL objects were built with dt=0, and then dt was not updated? This could warrant an improvement in the UI for the CFL objects. But it's not urgent. Probably what would really be useful for users is a function like
cfl(simulation) = # calculate cfl

and maybe the more specific versions
advective_cfl(simulation) = ...
diffusive_cfl(simulation) = ...

Then users don't have to create the objects AdvectiveCFL, etc.
Another comment which is unrelated to this PR is that I think "LES` really means "variable diffusivity". There are models that most people might not call "LES" which still have a variable diffusivity.

I agree on all fronts.
About the LES nomenclature: I couldn't find a better name that was more accurate. Naming the option variable_diffusivity, or eddy_diffusivity didn't seem like it would be user-friendly to me. Do you have suggestions?
I get we could also inspect typeof(model.closure) and choose appropriately inside the progress messenger function, scrapping the LES option altogether...

Maybe a kwarg that allows users to pass fields for which they'd like to see statistics? eg
messenger = TimedProgressMessenger(summarize=model.diffusivity_fields)

(Or any other named tuple). Then users can pass diffusivity fields (and an example in the docs can illustrate this) or named tuples of fields. We could start by just printing the maximum value of the fields as a "summary", but could expand d in the future to min, max, mean, or whatever. That'd be easy to support, and is flexible.


⚠ Secret Website 3 has degraded performance

In 98b9811, Secret Website 3 ($SECRET_WEBSITE_3) experienced degraded performance:

HTTP code: 200
Response time: 1930 ms

Resolved: Secret Website 3 performance has improved in b2f8604.


Proc::Async.Supply not documented

Zoffix 	I thought you could merge STDOUT/STDERR with Proc::Async... looks like the info's gone from the docs, even though the code has $!merge_blah blah in it
jnthn 	It's just .Supply

As far as I know it's broken and shouldn't be mentioned. Let's find the ticket ID maybe.

Broken where? The docs site documents the language.

Broken in rakudo. Yeah, it documents the language, but suggesting things that are outright broken is not going to do any good.
The ticket is here: RT #131763. That said, I think I cannot reproduce it on HEAD. Trying.

OK. Seems that RT #131763 is resolved (but stress tests are needed), so I guess there's no problem documenting this.
For further discussion on documenting rakudo issues see https://github.com/perl6/doc/issues/1486


[Question]  NPM link works only when cache is set to false

What I am trying to do :
I have a shared package as a node module that is added as a dependency in the parent app. During the development of the shared module, in the past, I usually npm link the shared module and then npm link modue-name in the parent app so I can see my changes right away rather than having to publish it. This speeds up development process as I have webpack watcher running at both ends. Any change the shared module is picked up by the watcher running in the parent app and I can right away see the changes in UI.
Version used : Webpack V4.x.x
What is the issue :
However, after updating Webpack to V5 (5.37.0), I noticed that the parent app was able to watch for dependencies and build the files but I was not able to see the changes in UI. I did some research and it seems to be an issue with Webpack caching. After setting the cache: false it just worked fine but now the watch takes couple of minutes and is trying to build the entire codebase for a single line change.
What I need help with
Is there a cache config I can set where it can watch for "linked modules using npm link" and rebuild quickly just like it does when I make a file change in the parent application?
Other things I did to get npm link working :
Along with the cache config, I had to also update the watchOptions and remove this ignored: /node_modules/,. I know we can use anymatch, regex and not ignore specific node_modules.
Thank you!

After setting the cache: false it just worked fine but now the watch takes couple of minutes and is trying to build the entire codebase for a single line change.

Since the rebuild does not use cache anymore it is slow. You should remove your package from immutablePaths and managedPaths https://webpack.js.org/configuration/other-options/#immutablepaths

Could you provide your webpack.config please?


Vite: custom tsconfig paths are not respected when I pass getLoadContext to the Cloudflare Proxy plugin

Reproduction
According to the docs i have to pass getLoadContext to remix

You must pass in getLoadContext to both the Cloudflare Proxy plugin and the request handler in functions/[[path]].ts, otherwise you'll get inconsistent load context augmentation depending on how you run your app.

I have a path setting in the tsconfig.json
{
 ...
  "compilerOptions": {
    ...
    "paths": {
      "~/*": ["./app/*"]
    },
  },
}

This is my vite.config.ts:
import path from 'node:path';

import { vitePlugin as remix, cloudflareDevProxyVitePlugin as remixCloudflareDevProxy } from '@remix-run/dev';
import { installGlobals } from '@remix-run/node';
import { defineConfig } from 'vite';
import tsconfigPaths from 'vite-tsconfig-paths';

import { getLoadContext } from './load-context';

installGlobals();

export default defineConfig({
  resolve: {
   // This also doesn't help
    alias: {
      '~/': path.resolve(__dirname, 'app/'),
    },
  },
  // this fails with "Error [ERR_MODULE_NOT_FOUND]: Cannot find package '~' imported from ..."
  plugins: [tsconfigPaths(), remixCloudflareDevProxy({ getLoadContext }), remix()],
});

System Info
System:
    OS: macOS 12.6.3
    CPU: (8) arm64 Apple M1 Pro
    Memory: 10.73 GB / 32.00 GB
    Shell: 5.8.1 - /bin/zsh
  Binaries:
    Node: 18.16.1 - ~/.nvm/versions/node/v18.16.1/bin/node
    Yarn: 1.22.19 - /opt/homebrew/bin/yarn
    npm: 9.5.1 - ~/.nvm/versions/node/v18.16.1/bin/npm
    pnpm: 8.14.1 - ~/.nvm/versions/node/v18.16.1/bin/pnpm
  npmPackages:
    @remix-run/cloudflare: ^2.8.1 => 2.8.1
    @remix-run/cloudflare-pages: ^2.8.1 => 2.8.1
    @remix-run/dev: ^2.8.1 => 2.8.1
    @remix-run/react: ^2.8.1 => 2.8.1
    @remix-run/router: ^1.15.3 => 1.15.3
    @remix-run/server-runtime: ^2.8.1 => 2.8.1
    @remix-run/testing: ^2.8.1 => 2.8.1
    vite: ^5.1.6 => 5.1.6

Used Package Manager
pnpm
Expected Behavior
custom paths must be respected when I pass getLoadContext to the Cloudflare Proxy plugin
Actual Behavior
i got error:
"Error [ERR_MODULE_NOT_FOUND]: Cannot find package '~' imported from ..."

It would be useful to see your full tsconfig.json and package.json.
I ran into a similar issue but solved it since, I just can't remember how but I think it had to do with tsconfig.json and/or package.json.

I faced the same problem. I think this is due to the fact that vite does not allow the use of tsconfig paths in vite.config.ts
https://github.com/vitejs/vite/issues/10063

@jebenois
tsconfig.json:
{
  "include": ["remix.env.d.ts", "**/*.ts", "**/*.tsx", "server.ts", "**/*.jsx"],
  "exclude": ["node_modules"],
  "compilerOptions": {
    "lib": ["DOM", "DOM.Iterable", "ES2022"],
    "isolatedModules": true,
    "esModuleInterop": true,
    "jsx": "react-jsx",
    "moduleResolution": "node",
    "resolveJsonModule": true,
    "target": "ES2022",
    "strict": true,
    "allowJs": true,
    "forceConsistentCasingInFileNames": true,
    "baseUrl": ".",
    "skipLibCheck": true,
    "types": [
      "@cloudflare/workers-types/2023-09-04",
      "node",
<EMAIL_ADDRESS>      "jest",
      "@testing-library/jest-dom"
    ],
    "paths": {
      "~/*": ["./app/*"]
    },
    // Remix takes care of building everything in `remix build`.
    "noEmit": true
  },
  "sourceMap": true
}

package.json (remix dependencies versions are overriden at monorepo root side we're using pnpn)
{
  "name": "app-name",
  "version": "0.0.0",
  "sideEffects": false,
  "private": true,
  "scripts": {
    "build": "remix build",
    "deploy": "wrangler pages publish public",
    "dev": "remix dev --manual -c \"pnpm start\"",
    "dev:debug": "node --inspect-brk ../../node_modules/.pnpm/@remix-run+dev@2.0.1_@types+node@20.8.3_react-dom@18.2.0_typescript<EMAIL_ADDRESS>dev --sourcemap --manual -c \"pnpm start\"",
    "start": "wrangler pages dev --local --live-reload --port 8087 --compatibility-date=2023-09-04 ./public",
    "lint": "eslint --fix --ext .ts,.tsx ./app",
    "typecheck": "tsc",
    "pw-start": "npx playwright test ./tests --config=./tests/resiliency-tests/playwright.config.ts --workers=1 --ui",
    "resiliency-test": "NODE_ENV=staging pnpm run pw-start",
    "resiliency-dev": "set NODE_ENV=staging && pnpm run pw-start",
    "test": "jest",
    "test:coverage": "jest --collectCoverage --coverageReporters html",
    "lighthouse": "lhci autorun",
    "swc": "node transpile_swc.js"
  },
  "dependencies": {
    "@elastic/apm-rum": "^5.12.0",
    "@emotion/cache": "^11.11.0",
    "@emotion/react": "^11.11.1",
    "@emotion/server": "workspace:*",
    "@emotion/styled": "^11.11.0",
    "@kingmakers-tech/bff-sportsbook": "0.0.56",
    "@kingmakers-tech/bff-strapi": "^0.0.1",
    "@kingmakers-tech/clientside-coupon": "workspace:^1.0.0",
    "@kingmakers-tech/clientside-coupon-utils": "workspace:^1.0.0",
    "@kingmakers-tech/flexicut-clientside-coupon": "workspace:^1.0.0",
    "@kingmakers-tech/normal-clientside-coupon": "workspace:^1.0.0",
    "@kingmakers/gtm": "workspace:*",
    "@kingmakers/remix-island": "workspace:*",
    "@kingmakers/ui": "workspace:*",
    "@kingmakers/vwo": "workspace:*",
    "@microsoft/signalr": "^7.0.0",
    "@mui/base": "^5.0.0-beta.24",
    "@mui/icons-material": "^5.14.11",
    "@mui/lab": "5.0.0-alpha.146",
    "@mui/material": "^5.14.11",
    "@mui/utils": ">= 5",
    "@mui/x-date-pickers": "^5.0.20",
    "@remix-run/cloudflare": "^2.0.1",
    "@remix-run/cloudflare-pages": "^2.0.1",
    "@remix-run/react": "^2.0.1",
    "@remix-run/server-runtime": "^2.0.1",
    "@typeform/embed-react": "^2.22.0",
    "clsx": "^2.0.0",
    "cookie": "0.5.0",
    "core-js": "^3.36.0",
    "date-fns": "^3.3.1",
    "dayjs": "^1.11.8",
    "deepmerge": "^4.3.1",
    "lodash.debounce": "^4.0.8",
    "markdown-to-jsx": "^7.2.1",
    "react": "^18.2.0",
    "react-dom": "^18.2.0",
    "react-iframe": "^1.8.5",
    "react-is": "^18.2.0",
    "react-use": "^17.4.0",
    "remix-utils": "^7.5.0",
    "use-local-storage-state": "^19.1.0",
    "use-session-storage-state": "^18.2.0",
    "zod": "^3.21.4"
  },
  "peerDependencies": {
    "eslint": ">= 8",
    "miniflare": ">= 2",
    "wrangler": ">= 2"
  },
  "devDependencies": {
    "@cloudflare/workers-types": "^4.20230914.0",
    "@kingmakers/eslint-config": "workspace:*",
    "@kingmakers/tsconfig": "workspace:*",
    "@lhci/cli": "^0.13.0",
    "@playwright/test": "^1.37.1",
    "@remix-run/dev": "^2.0.1",
    "@remix-run/router": "^1.9.0",
    "@remix-run/testing": "^2.5.0",
    "@swc/core": "^1.4.6",
    "@testing-library/jest-dom": "^6.4.2",
    "@testing-library/react": "^14.2.1",
    "@types/cookie": "^0.5.2",
    "@types/css-mediaquery": "^0.1.4",
<EMAIL_ADDRESS>"^0.0.18",
    "@types/jest": "^29.5.5",
<EMAIL_ADDRESS>"^4.0.7",
    "@types/node": "^20.3.1",
    "@types/react": "^18.2.12",
    "@types/react-dom": "^18.2.5",
    "cross-env": "^7.0.3",
    "css-mediaquery": "^0.1.2",
    "dotenv": "^16.3.1",
    "jest": "^29.7.0",
    "jest-environment-jsdom": "^28.1.3",
    "prop-types": "^15.8.1",
    "typescript": "^5.2.2"
  },
  "lint-staged": {
    "app/**/*.{js,jsx,ts,tsx}": [
      "eslint --fix"
    ]
  }
}

any update on this? I can't use paths.

I think what fixed it for me was to create a workspace in VS code.

Here are a couple workarounds for this.

You can use nodemon to build the remix app and start the wrangler every time there's a file change, but that won't have HMR.

// package.json
"build": "remix vite:build",
"start": "wrangler pages dev ./build/client",
"preview": "npm run build && npm run start",
"dev": "nodemon --watch ./app/** --watch ./load-context.ts --ext js,json,ts,tsx --exec \"npm run preview\"",

Use hono  and its @hono/vite-dev-server plugin instead of the native remix cloudflareDevProxyVitePlugin to run the dev server.
Here's the example on how to use hono as a dev server in remix: https://github.com/yusukebe/hono-and-remix-on-vite

I'm having the same issue here. I need to use vite. NOT wrangler, as wrangler cpu profling and debugging is currently broken.

Vite currently has issues importing TS files with path aliases from the vite.config.ts file. My digging led me to https://github.com/vitejs/vite/issues/5370. As a workaround you can run remix vite:dev through tsx.

Add the tsx dependency
Update your dev script to: "NODE_OPTIONS=\"--import tsx/esm\" remix vite:dev"

Tried out the tsx workaround shared by JoshStwrt above https://github.com/remix-run/remix/issues/9171#issuecomment-2119120941 fixed the issue for me.
To help fixing the root cause here are some details,
I came across the same issue while trying out the remix + cloudflare workers example and passing getLoadContext to the cloudflareDevProxyVitePlugin in the vite.config.ts file.
I am not sure if this issue is related to Vite or Vite importing with tsconfig paths because,

When I don't pass the getLoadContext to the cloudflareDevProxyVitePlugin the remix + cloudflare workers example with vite config seems to be working with the tsconfig paths.
I have also tried out the remix + tailwindcss example where tsconfig paths with vite config working as well here.

So it looks like as soon as we pass getLoadContext to the cloudflareDevProxyVitePlugin in the vite.config.ts file only then it's breaking importing with tsconfig paths. By looking at the cloudflareDevProxyVitePlugin code declaration my guess is that cloudflareDevProxyVitePlugin is overriding and breaking the vite importing with tsconfig paths behaviour when we are passing getLoadContext in the vite.config.ts file.


req.ip is undefined when it's a Socket request

Sails version: 1.0.0-37
Node version: 6.11.1
NPM version: 3.10.10
DB adapter name: N/A
DB adapter version: N/A
Operating system: Centos 7 (3.10.0-514.el7.x86_64)

Hi,
In version 1 of Sails, the Socket.IO library is at the version 1.7.3 and prevents the sails-hook-sockets from properly getting the IP address of the request. The socket.handshake object got updated so that the IP is at socket.handshake.address instead of socket.handshake.address.address.
I'm going to do a PR soon regarding this, but there's also a small IP spoofing risk in the current implementation because of #1517. The 'x-forwarded-for' header is always used so anybody relying on req.ip in there implementation can have the wrong ip address of the socket client if a client manually populates the header.
A solution could be to check if app.hooks.http.app.settings['trust proxy'] is true and proceed.

Here's the PR : https://github.com/balderdashy/sails-hook-sockets/pull/36

Merged.  Great work @Maelstrom96!


Can't build PSOL

pagespeed/automatic/Makefile has:
MOD_PAGESPEED_ROOT = $(shell cd ../../..; pwd)

This was right for 1.9 when it was in net/instaweb/automatic but now that it's in pagespeed/automatic it should be just cd ../...

Fixed in 4b6a082ad53651670e21b465c3a725794203f4e6


Request: Docker Image

It would be nice to create a docker image to run workloads on Kubernetes. I'm going to try to create my own ubuntu (not sure about alpine or how that works) based bend+hvm image and see where that leads.

Bend is a programming language- once the result is compiled, what containerization is needed is up to you..
Are you attempting to make a docker image to compile code?

I'm making a docker image for future Bend workloads that may require provisioning of GPU resources (such if you want to send a workload to a server, it would make the code more portable as a base image). This is obviously a lower priority than some of the other issues, but it's more of a long term request.

I don't have that much experience with Docker but it shouldn't be too hard.
For a docker image to bel able to build HVM and Bend you need basically just an environment with nightly rust and cargo.
If you want to have the C runtime you need posix libraries for ptheads and time.h and a C compiler.
For the cuda runtime you need to have the cuda sdk and nvcc.

I don't have that much experience with Docker but it shouldn't be too hard. For a docker image to bel able to build HVM and Bend you need basically just an environment with nightly rust and cargo. If you want to have the C runtime you need posix libraries for ptheads and time.h and a C compiler. For the cuda runtime you need to have the cuda sdk and nvcc.

I could PR a Dockerfile over, traditionally with Python or Node it's in a separate repo but I'll PR it to this repo and I'll link it to this issue.

TBH - what I really want is QEMU here. Ability to simulate the program on several architectures at once with God level visibility even into kernel space.  Double bonus if you can ship as a jslinux style WASM QEMU so you can always execute in the browser as a fallback.  For jslinux style you have to host a static web proxy somewhere outside the browser but not big deal.

TBH - what I really want is QEMU here. Ability to simulate the program on several architectures at once with God level visibility even into kernel space.  Double bonus if you can ship as a jslinux style WASM QEMU so you can always execute in the browser as a fallback.  For jslinux style you have to host a static web proxy somewhere outside the browser but not big deal.

I mean, you could always use buildx to do multi level arch builds per container but I would agree that the closer to the hardware the better for performance. I would love to start doing ships of container and qemu images for testing HPC builds.

Hey if anyone want's to create a docker image of this, let me know the requirements and I will make it for you and do a pr

There is one here already which uses the multi-stage approach on the Ubuntu images (devel/runtime) provided by Nvidia on Docker Hub. It's working fine but anything than minimal.. (Link to my repo with Dockerfile etc.)


Can't read unknown Tag

(1001,041e) ST [Date:<PHONE_NUMBER>5552[^]Date:<PHONE_NUMBER>3201[^]Date:<PHONE_NUMBER>2420[^]] #  70, 1 Unknown Tag & Data
Attempting to read in rust fails with:
Error: ParseMetaDataSet { source: UndefinedValueLength { tag: Tag(0x0022, 0x0016), backtrace: Backtrace(()) } }
dcmtk - dcmdump works fine to read the above tag which is where the line came from above.

Update - sorry this is actually related to the DICOM files being used. Depending on the file I get the above error unrelated to the tag I specified in the above comment.
Also I get a failed to fill whole buffer error on others, but have no problem reading the same files with dcmtk dcmdump

Could you provide a minimal example of the code which you were trying?
Still, I suspect that the problem is equivalent to #83. open_file can only open complete DICOM files with preamble and file meta group. In order to read a simple DICOM data set, you would need to use one of the InMemDicomObject::read_dataset functions, which are available upstream (#84) but not released yet.

Closing as a duplicate of #83, as it is very likely that caused by an attempt to read a file without a preamble, which in this case needs to be done with separate methods. Please file a new issue with a concrete example if the problem persists.


Fixes issue with late-binding inside closure

It was getting the last value of v instead of the specific value at the time.
So I noticed this happening when I performed the fallowing:
boilr template use <template> <targe> -f

So -f should use the defaults without prompting... what happend was dat it would fill in the last value inside the project.json and fill that in on all spots.

BTW the same might be happening here: https://github.com/tmrts/boilr/blob/master/pkg/template/template.go#L119-L138 But didn't touched that because not sure what it does and it seems to work?

I just went on and hard-forked...


Add option to generate sitemap

Search Terms
sitemap
Problem
TypeDoc has no way to generate a sitemap.
Suggested Solution
I wonder if TypeDoc could generate a sitemap for the generated output. It would probably require specifying the base path.

I just published a sitemap plugin. Works great! https://github.com/karmaniverous/typedoc-plugin-sitemap


Dates from DB2 on IBM i are displayed as "null"

I'm using DBeaver 4.3.4
I connect to an IBM i system running V7R1.
I've created a dummy file containing a field of type "date"
When the date is before 1940-01-01, it displays an "null", even when the date is correct.
Here's the contents of my file:

and here's what DBeaver displays:

Is this a question of settings somewhere or is this a bug ?
Thanks for your help.

I think there should be some errors when DBeaver reads these values.
Please check Error Log view or error/debug logs (https://github.com/dbeaver/dbeaver/wiki/Log-files).

I had previously made some tests changing some of the drivers settings (tab Adv. Parameters, Formatting) but without success.
I've changed the date format and date separator in the driver's properties and it works fine.

By the way, serge-rider, I didn't find anything relevant in the logs.  Thanks for your help.

Thanks for information!

Just a FYI on this. The date separator property is ignored when the date format is iso. And just to maintain consistency, I like to set time format to iso as well.


Hotfix sortable odm without orm

Fix issue #1277.
Allow the use of sortable extension in MongoDB without installing the ORM.

thanks, I do not use extensions much recently, forgot about sortable + mogodb support :)

Could you create a new tag with the last fixes? thx.


Very high latency / judder on egui_wgpu + Vulkan + X11

Describe the bug
On X11, with egui_wgpu and Vulkan, with present_mode set to the default of PresentMode::AutoVsync (which resolves to PresentMode::Fifo, there is far more latency than the 3 frames' worth that wgpu claims, and there seem to be occasional "blips" where the framerate tries to catch up:
https://github.com/user-attachments/assets/d46cccb8-0e31-4038-82e0-990ce0eb20be
To Reproduce
Steps to reproduce the behavior:

Run the egui demo app with wgpu, on Linux, within an X11 session
Try dragging a slider, or a similar "mouse-following" widget
Observe the latency and hitches

Expected behavior
There should be a reasonably low amount of latency
Screenshots
See above
Desktop (please complete the following information):

OS: Fedora 40 on Xfce, w/ NVIDIA

More Information
The examples within the wgpu repository seem to run without any judder, which makes me suspect something in egui_wgpu.

With the CPU graph in the demo app, you can see a bit more of the weird frame pacing I'm talking about. There are these weird gaps in the graph:
https://github.com/user-attachments/assets/230f9d5c-e221-4a97-9a4f-6f715535ab98

I think what's going on here is that the frame pacing is slightly too fast (notice how it seems to be around 62 FPS in the above recording). This means that frames are submitted to the queue more quickly than they are popped from it, causing ever-increasing latency since the later frames take longer to reach the front of the queue. The judders/gaps are caused by it "catching up" and not submitting any more frames to the queue until all the current ones are processed.

It seems this goes a bit deeper. With compositing disabled, the issue appears only on eframe. With compositing enabled, it is reproducible in the wgpu demos as well. I'm using XFCE (with xfwm4), for reference.

Is this a duplicate of https://github.com/emilk/egui/issues/5037 ?

Looking at the actual frame times, this actually happens in the wgpu demos always. Disabling compositing somehow hides it.


Allow for inputProps.style to take effect

Summary
inputProps.style is not passed into input but is a valid prop
// propose using array style with props.style having the final say
style={[Platform.OS === 'web' ? { outline: 'none' } : {}, props.style]}

This will allow better flexibility for users to allow the parent component to be control when needed.
For example: { "resize": "auto" } for TextArea in web

Is there a way to set { "resize": "auto" } for web on Textareas?


Android Basics: polished-user-experience

URL of codelab
In which task and step of the codelab can this issue be found?
Describe the problem
Steps to reproduce?

Go to...
Click on...
See error...

Versions
Android Studio version:
API version of the emulator:
Additional information
Include screenshots if they would be useful in clarifying the problem.

Instead of :
...
app:layout_constraintStart_toEndOf="@+id/icon_service_question"
android:layout_marginStart="16dp"
app:layout_constraintTop_toBottomOf="@+id/cost_of_service" />
You have used:
...
app:layout_constraintStart_toStartOf="@+id/cost_of_service" />
which is not correct

Issue resolved

Issue resolved


gin data for CED has non-electrical series data

Hi, I am looking at the gin data for CED and I found the following:
# This generates an error
from pathlib import Path
from spikeinterface.extractors import CedRecordingExtractor

DATA_PATH = Path("/home/heberto/ephy_testing_data/")
file_path = DATA_PATH / "spike2" / "m365_1sec.smrx"
recorder = CedRecordingExtractor(file_path=file_path, stream_id=None)

recorder.neo_reader.header["signal_channels"][-10:]

The output is:
array([('RhdD-59', '62', 30030.03003003, 'int16', 'mV', 1.95312500e-04, 0.  , '0'),
       ('RhdD-60', '63', 30030.03003003, 'int16', 'mV', 1.95312500e-04, 0.  , '0'),
       ('RhdD-61', '64', 30030.03003003, 'int16', 'mV', 1.95312500e-04, 0.  , '0'),
       ('RhdD-62', '65', 30030.03003003, 'int16', 'mV', 1.95312500e-04, 0.  , '0'),
       ('RhdD-63', '66', 30030.03003003, 'int16', 'mV', 1.95312500e-04, 0.  , '0'),
       ('CED_Mech', '67', 30030.03003003, 'int16', 'g', 2.04467773e-03, 0.  , '0'),
       ('LFP', '68', 30030.03003003, 'int16', 'V', 5.03540039e-05, 1.65, '0'),
       ('MechTTL', '70', 30030.03003003, 'int16', 'V', 5.03540039e-05, 1.65, '0'),
       ('MechStim', '71', 30030.03003003, 'int16', 'V', 5.03540039e-05, 1.65, '0'),
       ('Laser', '72', 30030.03003003, 'int16', 'V', 5.03540039e-05, 1.65, '0')],
      dtype=[('name', '<U64'), ('id', '<U64'), ('sampling_rate', '<f8'), ('dtype', '<U16'), ('units', '<U64'), ('gain', '<f8'), ('offset', '<f8'), ('stream_id', '<U64')])

So, some of the channels are not electrical series. We have events, laser and mechanical stimulation. Plus, channel 68 is LFP.  It appears to me that these channels should not be written as an electrical series but I don't know how standard the channel naming is and how to deal with it. Maybe someone who knows the format more could advice.
Related:
https://github.com/NeuralEnsemble/python-neo/issues/1133

The project that used this data can be found here for reference on how to map this to NWB: https://github.com/catalystneuro/mease-lab-to-nwb/blob/main/mease_lab_to_nwb/convert_ced/cedstimulusinterface.py
Now, if you're saying that the new neo/SI version loads ALL those channels, then yeah we definitely need to restore the smrx_channel_indices argument to specify (mainly through peeling off using a SubRecording), through we ought to at least support a default of writing all the RhD channels which are clearly neurophysiology recordings of the classic sense.
Now, all of these are technically 'ElectricalSeries' since they are in voltages, but they wouldn't have linked pynwb.Electrodes (only for ecephys channels) and as such are added as pynwb.TimeSeries with 'V' units.

(in the sense that Cambridge Electronic Design consistently uses those names):

I believe the user controls those channel names, so not entirely reliable. But anything with an Rhd text in the name is definitely a neural electrode (intan board/probe).

Yes, neo version loads ALL those channels, but so did the old version without the smrx_channel_ids argument.

OK so we just have to split them at the data interface level, then. My point being I don't think the design of the class method for getting channels ids and then passing them into the __init__ as smrx_channel_ids was the best way to go. Perhaps a post-__init__ function for deciding, after the extractor is initialized, how to subset the channels for neural data? And this could be done without user intervention when the neural channels are of a form we can identify (like Rhd). The Stim channels would always rely on a secondary interface regardless so our primary CED interface doesn't need to deal with them.

I don't think this is correct. One of them (channel 67) has units of grams.

Good eye - CED_mech is definitely not electrical!


chore(release): 1.17.1

See README

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

comment: We also need to update the hardcoded web client version in eventCache and/or automate getting the web client version.
Ref

question: Shouldn't we be merging this onto the 1.17 branch instead of mainline since its a patch version?


Error occurred while executing /bal command.

When ever I running a /bal command I get this error. I am running sponge api 6.1 minecraft 1.11.2

Scratch that its any time I run any command.

Does it occur with other plugins or just Total Economy?

Just total Economy.

it was working before and just started doing this.

What version of Total Economy?

Also please send the console log

TotalEconomy-1.7.1
latest.log

Send the log in a gist please: https://gist.github.com/

https://gist.github.com/rockclimber36/c4ea471b34899dcda657d6bc7058ae36
Line 171

https://gist.github.com/rockclimber36/c4ea471b34899dcda657d6bc7058ae36
Line 171

I'm not seeing anything related to Total Economy in the console. Do you have another plugin that may be conflicting with Total Economy?

Nope.

This is what comes up in counsel when I type /bal. Netty Epoll Server IO #7/ERROR io.netty.handler.codec.EncoderException: String too big (was 32779 bytes encoded, max 32767)

That seems to be an error with Netty, not Total Economy. I'd check with them.

Actually, what plugins do you have installed?

Please re-install Sponge in a second environment and see if the error also occurs there.

ActiveTime-s6.0-v1.2.4.jar
AdminShop-1.10.2-1.8.2-universal.jar
BetterCommandSigns-0.0.4.jar
BetterKits-0.9.6.jar
CatClearLag-0.8.jar
ChatUI-1.0.0.jar
CmdCalendar-mc1.10.2-v1.1.2.jar
CmdControl-s6.0-v1.0.1.jar
CommandBooks-v1.4.0.jar
walletdrop-5.2.0-0.2.3.jar
XtraPunish-2.0.jar
TotalEconomy-1.7.1.jar
Nucleus-1.1.3-LTS-S6.0-MC1.11.2-plugin.jar
nuvotifier-universal-2.3.4.jar
PlaceholderAPI-4.1.jar
projectcore-5.2.0-0.1.5.jar
pwnfilter-3.4.0.jar
RankUpper-2.2.2-b133_Sponge.jar
spongeforge-1.11.2-2476-6.1.0-BETA-2712.jar

Thats a list of plugins I have.

Im getting a error from the server
31.10 14:44:15 [Server] Server thread/ERROR [Sponge]: Error occurred while executing command 'bal' for source GCEntityPlayerMP['rockclimber36'/10891, l='Hub', x=18.75, y=82.50, z=56.29]: org/apache/commons/lang3/text/StrLookup
31.10 14:44:15 [Server] INFO java.lang.LinkageError: org/apache/commons/lang3/text/StrLookup
31.10 14:44:15 [Server] INFO at org.apache.commons.lang3.text.StrSubstitutor.(StrSubstitutor.java:264) ~[minecraft_server.1.11.2.jar:?]
31.10 14:44:15 [Server] INFO at com.erigitic.util.MessageManager.getMessage(MessageManager.java:103) ~[MessageManager.class:?]
31.10 14:44:15 [Server] INFO at com.erigitic.commands.BalanceCommand.execute(BalanceCommand.java:85) ~[BalanceCommand.class:?]

Do you happen to have a messages_en.conf file in the totaleconomy folder?

Also, I just tested this on the latest version of Sponge Forge for 1.11.2 and I am not able to recreate the issue. Were you able to get around to doing what @MarkL4YG said?

And what's in your main configuration file?

The exception from the image suggests class file duplication. Either the Sponge installation got currupted with two distributions of that apache library, a plugin falsely ships its own copy or two plugins happen to ship that lib.
That's why I asked for clean-install results as we may be able to rule out some of the possibilities here.

@rockclimber36 Were you able to get this fixed?

Closing this issue as it's been over a month since a response. If this is still an issue @rockclimber36, I'll reopen it.


[otbn] New CTRL register can't be set by software

Commit d151e08f78 added a new CTRL register, which causes lots of failures in our automated CSR testing. I think the design is that this register can be updated by software, but only when OTBN is idle. At the moment, it can't be updated at all:
  // otbn.sv, line 597
  assign hw2reg.ctrl.d = 1'b0;

@GregAC: Have I correctly understood what's going on?

The actual implementation is found here: https://github.com/lowRISC/opentitan/pull/8509 the first commit was meant to be spec only so things were tied off.

Oh, I see. Unfortunately, the stubbed version broke our nightly testing :-) Could you chase up reviewers there and either get it merged or, if that's not going to be possible today, push up a patch that excludes this CSR from the automated tests?

push up a patch that excludes this CSR from the automated tests?

I'll do this


React-ui: Display statistics in Block viewer

Related to #3112

[ ] I added CHANGELOG entry for this change.
[ ] Change is not relevant to the end user.

Changes

Display refreshedAt, total blocks, and blocks in each group in the Block viewer
Verification

Checked it in the browser

This is how it looks like.

@bwplotka This implements the 5th item of #3112. Please take a look 🙂


Update README.md

Simple Array Sum
https://www.hackerrank.com/challenges/simple-array-sum/problem?h_r=next-challenge&h_v=zen
Closing Issue/Referencing Issue
issue reference (#)
Changes Made In Pull Request

simple array sum
https://www.hackerrank.com/challenges/simple-array-sum/problem?h_r=next-challenge&h_v=zen


Not detecting (newbie here)

Hello sir,
Thanks a LOT for your work this is exactly what I am looking for.
So I am new to everything HA, coding etc.. and I do not know much.
I run HA on RPi 5 as an OS.
I am having a Tapo camera C200 which I can stream via rtsp on HA.
I have installed : Ha-cam-tag --> all ok
In my /homeassistant/configuration.yaml
I have inserted the below code: I am not sure why to use API here, thus I added # to leave it as a comment (maybe a mistake??)

I have replaced some of the userid and password acaractere by black marker, however please note that the user id is an email address, and the password ends by an @ (in case this would be the issue). Again, I am able to stream the camera on HA dashboard (even using Go2RTC).
I am showing a qr code in front of the camera (more or less far away and in every possible position) but I have no log in the HA events...
Could you please tell me what I am doing wrong. and again sorry for the newbie queries.
Thanks,

this is my HA version

as well i got this error :

some logs:
Info
Configuration
Log
Streaming Camera Tag Detection
[tcp @ 0x7f97591880] Failed to resolve hostname camera-ip-address: Name has no usable address
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:2769 handleMessage OpenCV | GStreamer warning: your GStreamer installation is missing a required plugin
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:2785 handleMessage OpenCV | GStreamer warning: Embedded video playback halted; module uridecodebin130 reported: No URI handler implemented for "rtsp".
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:1679 open OpenCV | GStreamer warning: unable to start pipeline
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:1164 isPipelinePlaying OpenCV | GStreamer warning: GStreamer: pipeline have not been created
<EMAIL_ADDRESS>global cap.cpp:166 open VIDEOIO(CV_IMAGES): raised OpenCV exception:
OpenCV(4.8.1) /home/buildozer/aports/community/opencv/src/opencv-4.8.1/modules/videoio/src/cap_images.cpp:253: error: (-5:Bad argument) CAP_IMAGES: can't find starting number (in the name of file): rtsp://camera-ip-address/ in function 'icvExtractPattern'
[tcp @ 0x7f97591880] Failed to resolve hostname camera-ip-address: Name has no usable address
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:2769 handleMessage OpenCV | GStreamer warning: your GStreamer installation is missing a required plugin
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:2785 handleMessage OpenCV | GStreamer warning: Embedded video playback halted; module uridecodebin131 reported: No URI handler implemented for "rtsp".
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:1679 open OpenCV | GStreamer warning: unable to start pipeline
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:1164 isPipelinePlaying OpenCV | GStreamer warning: GStreamer: pipeline have not been created
<EMAIL_ADDRESS>global cap.cpp:166 open VIDEOIO(CV_IMAGES): raised OpenCV exception:
OpenCV(4.8.1) /home/buildozer/aports/community/opencv/src/opencv-4.8.1/modules/videoio/src/cap_images.cpp:253: error: (-5:Bad argument) CAP_IMAGES: can't find starting number (in the name of file): rtsp://camera-ip-address/ in function 'icvExtractPattern'
[tcp @ 0x7f97591880] Failed to resolve hostname camera-ip-address: Name has no usable address
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:2769 handleMessage OpenCV | GStreamer warning: your GStreamer installation is missing a required plugin
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:2785 handleMessage OpenCV | GStreamer warning: Embedded video playback halted; module uridecodebin132 reported: No URI handler implemented for "rtsp".
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:1679 open OpenCV | GStreamer warning: unable to start pipeline
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:1164 isPipelinePlaying OpenCV | GStreamer warning: GStreamer: pipeline have not been created
<EMAIL_ADDRESS>global cap.cpp:166 open VIDEOIO(CV_IMAGES): raised OpenCV exception:
OpenCV(4.8.1) /home/buildozer/aports/community/opencv/src/opencv-4.8.1/modules/videoio/src/cap_images.cpp:253: error: (-5:Bad argument) CAP_IMAGES: can't find starting number (in the name of file): rtsp://camera-ip-address/ in function 'icvExtractPattern'
[tcp @ 0x7f97591880] Failed to resolve hostname camera-ip-address: Name has no usable address
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:2769 handleMessage OpenCV | GStreamer warning: your GStreamer installation is missing a required plugin
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:2785 handleMessage OpenCV | GStreamer warning: Embedded video playback halted; module uridecodebin133 reported: No URI handler implemented for "rtsp".
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:1679 open OpenCV | GStreamer warning: unable to start pipeline
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:1164 isPipelinePlaying OpenCV | GStreamer warning: GStreamer: pipeline have not been created
<EMAIL_ADDRESS>global cap.cpp:166 open VIDEOIO(CV_IMAGES): raised OpenCV exception:
OpenCV(4.8.1) /home/buildozer/aports/community/opencv/src/opencv-4.8.1/modules/videoio/src/cap_images.cpp:253: error: (-5:Bad argument) CAP_IMAGES: can't find starting number (in the name of file): rtsp://camera-ip-address/ in function 'icvExtractPattern'
[tcp @ 0x7f97591880] Failed to resolve hostname camera-ip-address: Name has no usable address
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:2769 handleMessage OpenCV | GStreamer warning: your GStreamer installation is missing a required plugin
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:2785 handleMessage OpenCV | GStreamer warning: Embedded video playback halted; module uridecodebin134 reported: No URI handler implemented for "rtsp".
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:1679 open OpenCV | GStreamer warning: unable to start pipeline
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:1164 isPipelinePlaying OpenCV | GStreamer warning: GStreamer: pipeline have not been created
<EMAIL_ADDRESS>global cap.cpp:166 open VIDEOIO(CV_IMAGES): raised OpenCV exception:
OpenCV(4.8.1) /home/buildozer/aports/community/opencv/src/opencv-4.8.1/modules/videoio/src/cap_images.cpp:253: error: (-5:Bad argument) CAP_IMAGES: can't find starting number (in the name of file): rtsp://camera-ip-address/ in function 'icvExtractPattern'
[tcp @ 0x7f97591880] Failed to resolve hostname camera-ip-address: Name has no usable address
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:2769 handleMessage OpenCV | GStreamer warning: your GStreamer installation is missing a required plugin
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:2785 handleMessage OpenCV | GStreamer warning: Embedded video playback halted; module uridecodebin135 reported: No URI handler implemented for "rtsp".
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:1679 open OpenCV | GStreamer warning: unable to start pipeline
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:1164 isPipelinePlaying OpenCV | GStreamer warning: GStreamer: pipeline have not been created
<EMAIL_ADDRESS>global cap.cpp:166 open VIDEOIO(CV_IMAGES): raised OpenCV exception:
OpenCV(4.8.1) /home/buildozer/aports/community/opencv/src/opencv-4.8.1/modules/videoio/src/cap_images.cpp:253: error: (-5:Bad argument) CAP_IMAGES: can't find starting number (in the name of file): rtsp://camera-ip-address/ in function 'icvExtractPattern'
[tcp @ 0x7f97591880] Failed to resolve hostname camera-ip-address: Name has no usable address
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:2769 handleMessage OpenCV | GStreamer warning: your GStreamer installation is missing a required plugin
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:2785 handleMessage OpenCV | GStreamer warning: Embedded video playback halted; module uridecodebin136 reported: No URI handler implemented for "rtsp".
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:1679 open OpenCV | GStreamer warning: unable to start pipeline
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:1164 isPipelinePlaying OpenCV | GStreamer warning: GStreamer: pipeline have not been created
<EMAIL_ADDRESS>global cap.cpp:166 open VIDEOIO(CV_IMAGES): raised OpenCV exception:
OpenCV(4.8.1) /home/buildozer/aports/community/opencv/src/opencv-4.8.1/modules/videoio/src/cap_images.cpp:253: error: (-5:Bad argument) CAP_IMAGES: can't find starting number (in the name of file): rtsp://camera-ip-address/ in function 'icvExtractPattern'
[tcp @ 0x7f97591880] Failed to resolve hostname camera-ip-address: Name has no usable address
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:2769 handleMessage OpenCV | GStreamer warning: your GStreamer installation is missing a required plugin
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:2785 handleMessage OpenCV | GStreamer warning: Embedded video playback halted; module uridecodebin137 reported: No URI handler implemented for "rtsp".
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:1679 open OpenCV | GStreamer warning: unable to start pipeline
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:1164 isPipelinePlaying OpenCV | GStreamer warning: GStreamer: pipeline have not been created
<EMAIL_ADDRESS>global cap.cpp:166 open VIDEOIO(CV_IMAGES): raised OpenCV exception:
OpenCV(4.8.1) /home/buildozer/aports/community/opencv/src/opencv-4.8.1/modules/videoio/src/cap_images.cpp:253: error: (-5:Bad argument) CAP_IMAGES: can't find starting number (in the name of file): rtsp://camera-ip-address/ in function 'icvExtractPattern'
[tcp @ 0x7f97591880] Failed to resolve hostname camera-ip-address: Name has no usable address
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:2769 handleMessage OpenCV | GStreamer warning: your GStreamer installation is missing a required plugin
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:2785 handleMessage OpenCV | GStreamer warning: Embedded video playback halted; module uridecodebin138 reported: No URI handler implemented for "rtsp".
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:1679 open OpenCV | GStreamer warning: unable to start pipeline
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:1164 isPipelinePlaying OpenCV | GStreamer warning: GStreamer: pipeline have not been created
<EMAIL_ADDRESS>global cap.cpp:166 open VIDEOIO(CV_IMAGES): raised OpenCV exception:
OpenCV(4.8.1) /home/buildozer/aports/community/opencv/src/opencv-4.8.1/modules/videoio/src/cap_images.cpp:253: error: (-5:Bad argument) CAP_IMAGES: can't find starting number (in the name of file): rtsp://camera-ip-address/ in function 'icvExtractPattern'
[tcp @ 0x7f97591880] Failed to resolve hostname camera-ip-address: Name has no usable address
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:2769 handleMessage OpenCV | GStreamer warning: your GStreamer installation is missing a required plugin
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:2785 handleMessage OpenCV | GStreamer warning: Embedded video playback halted; module uridecodebin139 reported: No URI handler implemented for "rtsp".
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:1679 open OpenCV | GStreamer warning: unable to start pipeline
[<EMAIL_ADDRESS>global cap_gstreamer.cpp:1164 isPipelinePlaying OpenCV | GStreamer warning: GStreamer: pipeline have not been created
<EMAIL_ADDRESS>global cap.cpp:166 open VIDEOIO(CV_IMAGES): raised OpenCV exception:
OpenCV(4.8.1) /home/buildozer/aports/community/opencv/src/opencv-4.8.1/modules/videoio/src/cap_images.cpp:253: error: (-5:Bad argument) CAP_IMAGES: can't find starting number (in the name of file): rtsp://camera-ip-address/ in function 'icvExtractPattern'

Hi, it looks like you put the configuration for the add-on in the main Home Assistant config. It should go in the addon configuration itself:

thanks for your reply.
I got this in the log.

this is the Qr code i am showing to the camera

this is my config :
*can't put anything in device id without having an error so I left it blanck

I am using a Tapo camera C200 for the test.

I have as well this message

You can leave the device id as the default unless you have a specific use case for it in your automations.
From these logs, it looks like the rtsp stream isn't working. If you try to load the same URL in something like VLC, can you view it?
Do you see anything else in the add on logs, maybe a "401 Unauthorized" error or similar? Since your stream appears to require user:password auth, it may be an issue with how that is handled. If this is the case I will have to set something up to test it.

hi, thanks for replying,
The rtsp is working fine in VLC and in HA too. I am using Go2RTC and RTSPtoWebRTC
there is no special character in the user and password of the camera :
user is : tapocamera
password is : bobcat
i am using the same URL to stream in VLC for example.
I noticed the add-on is using quiet a lot the CPU, if ever it helps to troubleshoot :

I do not see "401 Unauthorized" in the logs.
Thanks for your support,

I think the CPU usage is because the detector thread tries to process frames as fast as the streaming thread reads them, and in this case it seems to be sending a series of empty frames. I should probably add a rate limiter to prevent that.
Thanks for the details, I will try to see if I can reproduce the error. It may take some time, sorry about the wait.

ok, no issue. thanks for the follow up.


Disable the config of encoding path in git

The PR is to fix: https://dev.azure.com/azure-sdk/public/_build/results?buildId=1363756&view=logs&j=bc67675d-56bf-581f-e0a2-208848ba68ca&t=27a9db8a-8f0c-5ed5-0322-7c4d0e71b2e0
If the path contains special char, we scan the parent folder instead of the path
Testing pipeline:https://dev.azure.com/azure-sdk/public/_build/results?buildId=1369441&view=logs&s=6884a131-87da-5381-61f3-d7acc3b91d76
command config
https://dev.azure.com/azure-sdk/public/_build/results?buildId=1369513&view=logs&s=6884a131-87da-5381-61f3-d7acc3b91d76

The following pipelines have been queued for testing:java - templatejava - template - testsjs - templatenet - templatenet - template - testspython - templatepython - template - tests You can sign off on the approval gate to test the release stage of each pipeline. See eng/common workflow

The following pipelines have been queued for testing:java - templatejava - template - testsjs - templatenet - templatenet - template - testspython - templatepython - template - tests You can sign off on the approval gate to test the release stage of each pipeline. See eng/common workflow

The following pipelines have been queued for testing:java - templatejava - template - testsjs - templatenet - templatenet - template - testspython - templatepython - template - tests You can sign off on the approval gate to test the release stage of each pipeline. See eng/common workflow

The following pipelines have been queued for testing:java - templatejava - template - testsjs - templatenet - templatenet - template - testspython - templatepython - template - tests You can sign off on the approval gate to test the release stage of each pipeline. See eng/common workflow

The following pipelines have been queued for testing:java - templatejava - template - testsjs - templatenet - templatenet - template - testspython - templatepython - template - tests You can sign off on the approval gate to test the release stage of each pipeline. See eng/common workflow

The following pipelines have been queued for testing:java - templatejava - template - testsjs - templatenet - templatenet - template - testspython - templatepython - template - tests You can sign off on the approval gate to test the release stage of each pipeline. See eng/common workflow

The following pipelines have been queued for testing:java - templatejava - template - testsjs - templatenet - templatenet - template - testspython - templatepython - template - tests You can sign off on the approval gate to test the release stage of each pipeline. See eng/common workflow

The following pipelines have been queued for testing:java - templatejava - template - testsjs - templatenet - templatenet - template - testspython - templatepython - template - tests You can sign off on the approval gate to test the release stage of each pipeline. See eng/common workflow

The following pipelines have been queued for testing:java - templatejava - template - testsjs - templatenet - templatenet - template - testspython - templatepython - template - tests You can sign off on the approval gate to test the release stage of each pipeline. See eng/common workflow

Hmm, this seems to be stuck @sima-zhu


golangci: remove deprecated linters

Signed-off-by: rakeshgm<EMAIL_ADDRESS>

What are the replacements for these deprecated linters?

i see these  warnings when running lint
make lint
testbin/golangci-lint run ./... --config=./.golangci.yaml
WARN [runner] The linter 'varcheck' is deprecated (since v1.49.0) due to: The owner seems to have abandoned the linter. Replaced by unused.
WARN [runner] The linter 'maligned' is deprecated (since v1.38.0) due to: The repository of the linter has been archived by the owner. Replaced by govet 'fieldalignment'.
WARN [runner] The linter 'scopelint' is deprecated (since v1.39.0) due to: The repository of the linter has been deprecated by the owner. Replaced by exportloopref.
WARN [runner] The linter 'ifshort' is deprecated (since v1.48.0) due to: The repository of the linter has been deprecated by the owner.
WARN [runner] The linter 'structcheck' is deprecated (since v1.49.0) due to: The owner seems to have abandoned the linter. Replaced by unused.
WARN [runner] The linter 'deadcode' is deprecated (since v1.49.0) due to: The owner seems to have abandoned the linter. Replaced by unused.
WARN [runner] The linter 'golint' is deprecated (since v1.41.0) due to: The repository of the linter has been archived by the owner. Replaced by revive.

For the unused replacements we need to look at other unused options to enable as well, did a few tests with and without the following patch for clarity:
diff --git a/.golangci.yaml b/.golangci.yaml
index 9640bfa..a4ede99 100644
--- a/.golangci.yaml
+++ b/.golangci.yaml
@@ -33,6 +33,12 @@ linters-settings:
   wsl:
     allow-trailing-comment: true
     enforce-err-cuddling: true
+  unused:
+    #field-writes-are-uses: false # Needs code fixes
+    # exported-is-used: false; Usage causes panic, IGNORE
+    # exported-fields-are-used: false # Usage does not really catch this!
+    #parameters-are-used: false; Needs code fixes (unparam?)
+    local-variables-are-used: false # Not able to trigger this, other checks fail earlier
   revive:
     ignore-generated-header: false
     severity: error
@@ -99,7 +105,6 @@ linters:
     - bidichk
     - bodyclose
     - cyclop
-    - deadcode
     - decorder
     #  - depguard
     - dogsled
@@ -151,7 +156,6 @@ linters:
     - rowserrcheck
     - scopelint
     - sqlclosecheck
-    - structcheck
     - stylecheck
     - tenv
     - testpackage
@@ -162,7 +166,6 @@ linters:
     - unparam
     - unused
     - usestdlibvars
-    - varcheck
     #  - wastedassign
     - whitespace
     - wsl
diff --git a/controllers/drcluster_controller.go b/controllers/drcluster_controller.go
index d542bd0..2384877 100644
--- a/controllers/drcluster_controller.go
+++ b/controllers/drcluster_controller.go
@@ -1281,7 +1281,7 @@ func setDRClusterUnfencingFailedCondition(conditions *[]metav1.Condition, observ
 // Unfence operation, unfence = true, fence = false, clean = false
 // TODO: Remove the linter skip when this function is used
 //
-//nolint:deadcode,unused
+//nolint:unused
 func setDRClusterCleaningFailedCondition(conditions *[]metav1.Condition, observedGeneration int64, message string) {
        setStatusCondition(conditions, metav1.Condition{
                Type:               ramen.DRClusterConditionTypeFenced,

I think going forward we should:
* delete the lines that correspond to deprecated linters

* comment those linters which we want to reenable later

Please delete the lines instead of commenting them. I have also included comments where I provide replacement for these linters, you can include that information in the commit message and PR description.

A word of warning here, we cannot just remove deprecated linters, we need to understand how to use the replacements. For example in this case just using unused may not be enough. Without that information reviewing the PR becomes more difficult.

Just to round this off, we should remove deprecated linters so that is good, but our linter story is a bit of a mess post disabling a bunch in bulk and not adding them back or looking at linter options and ensuring they cover what we want.
So when removing linters from the list we need to be extra careful to ensure the right tools are added and in place, or we have recorded issues covering the same.
My default is to always enable all and the disable things that we potentially do not want (in areas like govet or revive especially).


Peer network

Hey!
I've been thinking about how to solve the problem of a peer-to-peer group chat between a significant number of users without overloading the network: if I'm in a room with 1000 people, I don't want my browser to open 999 connections.
If I'm understanding the code correctly, does friends just open a connection to every other peer like I just described? https://github.com/moose-team/friends-swarm/blob/02bc0e186a65a5fb20b617ccd23c4614199f3039/swarm.js#L100-L120
This feels like it's going to be a super interesting problem to solve: have any of you thought about it before or know anything about the topic?

Its possible to pass maxPeers to limit the number of connections. Here is where friends does it.
maxPeers is an option exposed by webrtc-swarm.
👍

What happens when the number of users exceeds 20?


[chore] Load testing, including thumbnail server speed, IIIF,etc.

See comparison times for top keywords searched in Calisphere: https://docs.google.com/spreadsheets/d/12oailNshmaaSabXwaMupniZreR-VCZUmwSpaDEZlFsg/edit#gid=502686028

Crop / Clip server is super robust.
Threw 200 simultaneous users at it, ~100 req/sec and it didn't even blink. Avg response time under heavy load  was ~125ms.

Type
Name
# Requests
# Fails
Median (ms)
95%ile (ms)
99%ile (ms)
Average (ms)
Min (ms)
Max (ms)
Average size (bytes)
Current RPS
Current Failures/s

GET
/clip500x500
14916
4
51
230
460
82.08
11
1519
49031.11
39.2
0

GET
/crop120x120
7405
1
52
220
430
87.51
12
1747
6829.34
18.7
0

GET
/crop210x210
7550
4
59
230
420
91.89
12
1485
17903.42
19.4
0.1

Aggregated
29871
9
53
230
440
85.91
11
1747
30701.69
77.3
0.1


Validate token type before calling native module

if the token type isn't string, we'll receive unhandled exception that isn't possible to catch

solves #82


Win Icon

Does this engine have winning icon support and if it doesn't then how do I add it in haxe script cause I know this engine relies in haxe script

yes there is support

its supported automatically


LTS Java 17 officially support

I do not see any mentions of compatibility with Java 17.
Can you please tell is LTS Java 17 officially supported?

Hi @boskokg,
as of version 1.6.3 we are fully Java 17 compatible as has been fixed by https://github.com/Blazebit/blaze-persistence/issues/1361

Thank you,
Can you please write that in the Documentation ()


Charging sometimes limites itself MinCurrent

see https://gathering.tweakers.net/forum/list_message/77697986#77697986
Try this version, it is a release candidate for v3.5 and it has the phase detection removed so there is no switching of override_currents anymore:
firmware3.5-f4479b0192b.zip

Although we haven't done a lot of actual charging sessions (car remains connected though), so far the override current hasn't been adjusted since running the RC version.

I charged 360 kWh without any override current issue's so far. Will give a new update in 2 weeks

Still no issue's the last 2 weeks

Ok then I call this bug resolved in 3.5.0-RC0


Only allow the author that requested the help command to react

The suggested modification ensures that only the author who initiated the help command can interact with the button. This prevents anyone else from deleting or modifying the page of the embed.

bug

First time i was using this github feature and i confused myself
Please don’t look at this one i opened a new one


Added OpenAI structured output call example and helper response format generator

New test example that sends a structured output request to OpenAI, parses the response JSON and instantiates a Person class.
Added a helper fn to the library for response format generation from the schema creation

@ajdroid I've refactored the handling of schemas a bit to make them easier to use in GDScript, let me know what you think.
Essentially, individual schemas are now Godot Objects (type GodotSchema), and the methods instantiate/open_ai_response are invoked on the schemas themselves, not the library.


Add add_num_samples to LLMBlock config

(Depends on #120)
Two pipelines include an LLMBlock which use {num_samples} in their instructions to the teacher model. There needs to be some way to configure the LLMBlock so that num_samples will be included, but as per #82 (commit a01b04e) the value of num_samples should be based on the num_instructions_to_generate parameter.

I'm OK with this as a step toward the need to pull runtime configuration out of the flow configuration.
I do wonder if it could be even simpler and num_samples is just always set instead of having it configured like this. Doing it this way seems to be the safer change for the moment, since it maintains existing behavior.

Yep, this is firmly in the realm of "I don't feel safe touching this right now" for me

Thanks for the review @russellb! Closing in favor of just merging #86 in one shot


webhooks: Ignore actions

I'm not a fan of removing the fixtures; we did real work to capture those fixtures, and they'll be very useful if we ever decide to support those events in the future.

I'm not a fan of removing the fixtures; we did real work to capture those fixtures, and they'll be very useful if we ever decide to support those events in the future.

As Steve noted, GitHub documents fixtures on their own documentation; I'm OK with removing the fixtures perhaps with the addition of a comment above the IGNORED_EVENTS section of the webhook mentioning that GitHub documents payloads and one can just download the payloads from their website, if that process works?

Ready for review again.  See https://chat.zulip.org/#narrow/stream/127-integrations/topic/github.3A.20team.20.2F.20edited for discussion about whether we send multiple messages on team/edited, which may influence the naming decision for Helper.

This is great, merged, thanks @showell!  We can adjust the name for Helper in a follow-up PR as its meaning becomes more clear.


papirus-icon-theme: 20210302 -> 20210401

Motivation for this change
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[x] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 118422 at d93aa48c run on aarch64-linux 1

2 packages built successfully:

papirus-icon-theme
papirus-maia-icon-theme

1 suggestion:

warning: missing-phase-hooks
installPhase should probably contain runHook preInstall and runHook postInstall.
Near pkgs/data/icons/papirus-icon-theme/default.nix:27:3:
   |
27 |   installPhase = ''
   |   ^


Consider logging a warning if @CrossOrigin is on a non-OPTIONS method (or revise existing error message)

Environment Details

Helidon Version: 2.x
Helidon SE or Helidon MP MP
JDK version:
OS:
Docker version (if applicable):

Problem Description
We ask Helidon MP app developers to CORS-enable their endpoints by adding @CrossOrigin annotations to @OPTIONS methods on their JAX-RS resource classes. If they incorrectly add the annotation to the non-OPTIONS endpoints, Helidon logs a mysterious error:
java.lang.IllegalArgumentException: Could not locate expected CORS information while preparing response to request RequestAdapterMp{path=/network/nodes, method=GET, headers={Origin=[http://localhost:8000], Accept=[application/json, text/plain, */*], Connection=[keep-alive], Referer=[http://localhost:8000/], User-Agent=[Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36], Sec-Fetch-Dest=[empty], Sec-Fetch-Site=[same-site], Host=[localhost:7001], Accept-Encoding=[gzip, deflate, br], Sec-Fetch-Mode=[cors], sec-ch-ua=["Google Chrome";v="95", "Chromium";v="95", ";Not A Brand";v="99"], sec-ch-ua-mobile=[?0], sec-ch-ua-platform=["macOS"], Accept-Language=[en-US,en;q=0.9]}}
        at io.helidon.webserver.cors.CorsSupportHelper.lambda$prepareResponse$3(CorsSupportHelper.java:355)
        at java.base/java.util.Optional.orElseThrow(Optional.java:408)
        at io.helidon.webserver.cors.CorsSupportHelper.prepareResponse(CorsSupportHelper.java:355)
        at io.helidon.webserver.cors.CorsSupportBase.prepareResponse(CorsSupportBase.java:90)
        at io.helidon.microprofile.cors.CorsSupportMp.prepareResponse(CorsSupportMp.java:72)
        at io.helidon.microprofile.cors.CrossOriginFilter.filter(CrossOriginFilter.java:76)
...

This error could occur in other circumstances, but developers typically see it if they have annotated the wrong method.
Although our doc is pretty clear, it might be worth adding a runtime warning if developers have misplaced the @CrossOrigin annotation.
Steps to reproduce
TBD

It could even be a fatal error at startup or during annotation processing I suppose.

So what is the solution? I have a DELETE method and when I create a OPTIONS like
@Path("/removeFavLocation/{id}")
@OPTIONS
public void optionsForRemoveFromFavorite() {
}
No matter if I add CROSSORIGIN or not, I get the same error. What I am doing wrong?

@AbhideepChakravarty Are you not using CORS at all? If so, you should be able to exclude it from you classpath I suppose.

@AbhideepChakravarty Some quick testing shows that in order to get that exception in the logs the following conditions likely hold:

@OPTIONS without @CrossOrigin on a method
Helidon CORS in the classpath
Helidon determines a request is not normal, i.e. it is a CORS request

For (3), Helidon checks if ORIGIN is absent or if present that it contains the same info as the HOST header (sort of). Perhaps you can share the request that is triggering the exception for further analysis.

@AbhideepChakravarty Any chance you can share more info about that request?

I got the issue. I need up with http method on the client side and created mess. When I corrected things, everything worked fine. But I am not yet sure what was the root cause of the problem. As the original post, a warning it critical error would help, if given with proper reason.

@AbhideepChakravarty As explained above, I think somehow your requests included an ORIGIN header for some reason (maybe accidentally?). I suggest that we close this issue for now then and re-open with more information at a later time.

Sure we can do that. If we can find a way to reproduce it and document it properly, we should open it.

The original purpose of the issue remains - warning or failing during start-up if the developer has placed a @CrossOrigin annotation on a non-OPTIONS method, so I'm re-opening the issue.


Refactors templater to support adding additional easier

Issue #, if available:
Description of changes:
Change the templater code to be more functional to make adding additional ones simpler.  The resulting changes are for the most part just adding the al- in the name and file renames.
This also adds python as a temptable version and a 3.7 version.
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

/approve


Add the _id of the file just persisted to the context

Hi,
this PR relates to: https://issues.apache.org/jira/browse/CAMEL-9836

Thanks for the PR it has been merged. Do you mind closing this?

done! thanks Claus!


[advice] use glm reader from node.js

Hello :)
I'm trying to parse a gml document, and convert it to GeoJSON, from Node.js
I tried to import OpenLayers, and shim it using webpack (shimming window, document, etc.)
But for the specific case of gml reader, this uses a "dom"-like API for xml.
Is there a way to use GML reader, and GeoJSON writer, from Node.js (without a DOM implementation) ?

I use jsdom and xmlserializer to read gml with OpenLayers in Node.js.

😱 can you please provide some example or something ?

Also, how did you install openlayers ? (ol or openlayers package ?)

Did you transpile something ?

I transpile ol package to es5. You can see my setup in geomangler.

Hey @afogelberg thanks about it 😄
As far as I can see, you actually patch global with XmlSerialiser and dom to make OpenLayer work, and transpile OpenLayer on postinstall script that's it ?

That's is @cyrilchapon :thumbsup:


Refresh handling

I didn't really know where to go for a question, so I just opened an issue. Feel free to close.
How do you handle when a user refreshes the page... by accident? I find myself getting a 404.
Before refresh

After refresh

Can you please give a little bit more details about the code that you are using.

How did you reach the /test1 route. Is it via Navigo's navigate method. If yes what are your registered routes.
Is the backend a nodejs app. If yes then do you forward every request to your index.

My assumption is that your backend is not forwarding all the request to the same html content. If that was the case then you have to see your main html content (at least). Here is an article that describes why you have to forward all the request to the same html file. It's kinda critical to make the client-side routing works.

I immediately thought about that, once I finished writing but I couldn't respond until now. You are absolutely right. All requests must be forwarded to the same html file, otherwise client-side routing just will not work. In my example, I didn't have that forwarding. I was simply using SimpleHTTPServer to test.

:+1:


ReferenceError: CKEDITOR is not defined

Hey,
i am new in using the filemanger and after installation I get this error, when using the brwoser inspector:

ReferenceError: CKEDITOR is not defined

Generally, is it possible to use the filemanger in Django 2.1.7?

As of now, it is only compatible with django<2.


Fixing issue of empty iter in flatten stops prematurely

Fixing issue of empty iter in flatten stops prematurely

thanks for the fix @Gekctek

Update the mops version to 0.2.2


Spring-security-oauth2-authorization-server0.4.0 and springboot2.6.14 compatibility issues

I use springboot2.6.14 to dock spring-security-oauth2-authorization-server0.4.0.
I use this interface to apply for a token: http://oauth2-server.com:9000/oauth2/token?grant_type=client_credentials
Use the pre-set interface of the request: http://oauth2-resource.com:8001/res2
The result is that the request fails and will be executed to AccessDeniedHandler，access denied.
But I use spring-security-oauth2-authorization-server0.2.3, then the request is OK.
I checked because 0.2.3 uses spring-security-oauth2-resource-server5.8.0, and springboot2.6.14 uses spring-security-oauth2-resource-server5.6.9
My authorization-server configuration is:
private RegisteredClient createRegisteredClient(final String clientId) {
TokenSettings tokenSettings = TokenSettings.builder()
.accessTokenTimeToLive(Duration.ofDays(365))
//.reuseRefreshTokens(false)
.build();
ClientSettings clientSettings = ClientSettings.builder()
.requireAuthorizationConsent(false)
.build();
return RegisteredClient
.withId(UUID.randomUUID().toString())
.clientId("micro_service")
.clientSecret(PasswordEncoderFactories.createDelegatingPasswordEncoder().encode("123456"))
.clientName("micro_service")
.clientAuthenticationMethod(ClientAuthenticationMethod.CLIENT_SECRET_BASIC)
.authorizationGrantType(AuthorizationGrantType.CLIENT_CREDENTIALS)
.redirectUri("http://<IP_ADDRESS>:8001")
.redirectUri("http://<IP_ADDRESS>:8002")
.scope("all")
.tokenSettings(tokenSettings)
.clientSettings(clientSettings)
.build();
}
My resource-server configuration is:
@Bean
SecurityFilterChain jwtSecurityFilterChain(HttpSecurity http) throws Exception {
SimpleAccessDeniedHandler accessDeniedHandler = new SimpleAccessDeniedHandler();
SimpleAuthenticationEntryPoint authenticationEntryPoint = new SimpleAuthenticationEntryPoint();
    return http
            .sessionManagement().sessionCreationPolicy(SessionCreationPolicy.STATELESS)
        .and()
            .authorizeRequests()
            .antMatchers("/res1").hasAnyAuthority("SCOPE_read","SCOPE_all")
            .antMatchers("/res2").hasAnyAuthority("SCOPE_write","SCOPE_all")
            .anyRequest().authenticated()
         .and()
            .exceptionHandling(exceptionConfigurer -> exceptionConfigurer
                    .accessDeniedHandler(accessDeniedHandler)
                    .authenticationEntryPoint(authenticationEntryPoint)
            )
            .oauth2ResourceServer(resourceServer -> resourceServer
                    .accessDeniedHandler(accessDeniedHandler)
                    .authenticationEntryPoint(authenticationEntryPoint)
                    .jwt()
            )
            .build();
}

Why does the GA version of springboot2.6.14 not provide the corresponding authorization-server GA version.
I hope that each GA version of springboot has a corresponding GA version of authorization-server,
Now authorization-server is an independent application, separated from springcloud,
I believe that now everyone basically uses springboot for web development, and the development version of authorization-server should correspond to springboot
I can't adapt the 0.4.0-GA version of authorization-server through the GA version of springboot2.6.14
I also want to ask, which springboot version does the 0.4.0 version of authorization-server correspond to?
Which springboot version does the 1.0.0 version of authorization-server correspond to?

@Lvbuqing The 0.4.0 release is compatible with Spring Boot 2.7.5, as indicated by the default-authorizationserver sample. Please use Spring Boot 2.7.5+.
NOTE: The 1.0.0 release is compatible with Spring Boot 3.0.0+.

Why does the GA version of springboot2.6.14 not provide the corresponding authorization-server GA version.

There currently is no Spring Authorization Server integration with Spring Boot. However, this is in the works via gh-673. We're targeting Spring Boot 3.1 to include auto-config and custom properties for Spring Authorization Server.


Update Blitz / performance

website:
https://putyourlightson.com/plugins/blitz
https://plugins.craftcms.com/blitz
https://github.com/putyourlightson/craft-blitz
examples:
https://imagecomics.com/
https://www.transparency.org/en/
https://thebreakthrough.org/
https://www.impraise.com/

Hey, If there is a comment everywhere:
"html": "<!-- Cached by Blitz on",
But for example, 80% have js, or header
headers: {
"X-Powered-By": "^Blitz$"
},
"js": {
Blitz: "",
"blitzReplace": ""
},
How will the Wappalyzer work after it first sees the header or js with 100% confidence, then the html check will not start?

@nurbek91 All the checks will run even if it's already at 100% confidence. This is mainly because some of the other patterns may be needed to find a version number.

@nurbek91 All the checks will run even if it's already at 100% confidence. This is mainly because some of the other patterns may be needed to find a version number.

ah, ok thanks!


catalog: Improve alter column type

This commit adds support for altering a column type into an array and a new test to ensure that the generated code is valid.
This was working prior to v1.4.0 and may have been introduced by the refactor of the compiler.

Thank you for the perfect PR: short, easy to review, and tested!


Feature Request: Provide a way for non admins to display security groups associated with their spaces

It would be really useful if I as a non admin user had a way to see the security groups and their rules for a given space I am a member of.
I created a CC issue (https://github.com/cloudfoundry/cloud_controller_ng/issues/288) but @fraenkel correctly pointed out that security groups are returned as a part of a space already they're just not being used by the CLI.  The current CLI commands appear to be using admin only endpoints instead of getting the data from the space.

The newest CLI has this feature.
see the merged Pull Request


Ensure Web3 Error Handling Works For All Cases

No Support Found
No RPC Connection
No Account
No Network Connection (Privacy Mode)
Declining Network Connection
No Funds
Nonce Mismatch
Signing Capabilities Unavailable

Have the user send a signed message to this app's DAO? Allows network to see user count?

Is this still an issue with the new move to migration repo?

Subsumed under 200


Add standardize to mol2 output

The molecule_to_mol2 function uses a high-level writer,
which overwrites atomic properties such as atom names in an effort to standardize them.
Sometimes it is desirable to keep the atom names provided in the input.
This change addresses the need by:

An option called standardize is added to molecule_to_mol2
(Some) functions that depend on it have been updated to
make it accessible.
Tests of the mol2 reading have been added to validate
that behavior is as expected.

Looks good to me! Merge when ready.


add classes API documentation

Yes, some basic autogenerated API docs would be great to help fully exploit this library.


fix: make generated types prettier

This PR makes prettier --check pass on the generated worker-configuration.d.ts file by removing trailing whitespaces and replacing tabs with 4 whitespaces.
// Generated by Wrangler on Mon Nov 28 2022 09:15:37 GMT-0800 (Pacific Standard Time)
interface Env {
-	DB: D1Database;
+    DB: D1Database;
}

It's worth noting the Accessibility Issues from using spaces over tabs.

See https://github.com/cloudflare/wrangler2/issues/1298 as well.
I'd instead recommend configuring your Prettier to accept (and use) tabs.

Sure! Came here from https://github.com/cloudflare/templates/ which doesn't allow tabs and it raises errors with the generated types. The trailing whitespace is definitely an issue though. Should I reduce my PR to fixing that issue?

Yeah the wrangler repo uses tabs for indentation, as do all of the templates in the templates in the repo (as defined by the prettier config in the root), but seems they don't ship their own prettierrc or editorconfig with each template, so you're likely just getting the default prettier settings.
Shipping a config with each template that includes tabs by default would probably be a good idea. But for now, I'd definitely recommend reducing your PR to only fix the trailing whitespace issue.

Tabs seem less prevalent in TS world (e.g., tsc --init generates a space-indented file).

Hopefully not for much longer with prettier likely defaulting to tabs in the next major version, and a lot of other tooling realisting the accessibility benefits of tabs.

Just to confirm this PR is not just removing the trailing whitespace?

@JacobMGEvans it's just removing the trailing whitespace. After discussing the issue, tabs in the generated output will remain.


Support for failed chunk requests

I'm running Kerchunk at scale across TB's of NetCDF data and have noticed a consistent issue in my process for validation, where certain comparisons between NetCDF and Kerchunk data fails.
I've found when doing a max, min and mean comparison between arrays of arbitrary sizes, occasionally two of the three test fail, typically the mean comparison and one of the other two. I believe this is explained if the Kerchunk array has more NaN/near-zero values, so a max or min comparison may still work, but the mean comparison will fail. This I think is because of chunk requests being refused or failing, which results in that part of the array being left empty (near-zero).
I know the array chunks come out as near-zero when the chunk request goes wrong because these values can cause an overflow error in certain cases like when decoding time values, because the values are so low (10^-300). Over a set of 1000 datasets (100+ NetCDF files in each), I'm finding this problem affects ~10% of the datasets, with no dependency on type of dataset or anything. This issue comes up at random and is only detectable by direct comparison to the native data, or if it causes an error in decoding.
This could be a major issue with using Kerchunk at such a wide scale, and there really needs to be some kind of check within fsspec at the point of making a request, to ensure the correct type of data was received.

Another person in my group has pointed out these lines in the kerchunk source, which I'd assume would also be present in fsspec, where the numpy array being served is initialised as empty (slightly faster, but leaves the array with some VERY small values until properly filled) I think for failed chunk requests, the empty array is left empty but nothing is logged to state this.
I'm pulling together an example now which I will post later, and I'll see if it has a correlation with the number of chunks being requested (highly likely since more chunks = more chance for a failure)
https://github.com/search?q=repo%3Afsspec%2Fkerchunk .empty(&type=code

This is what happens when you try to open a local Kerchunk file with remote links, with no WiFi connection. If something like this happens for even 1 in 1 million requests with no reporting, it could have significant implications.

referenceFS is supposed to return ReferenceNotReachable for the case that we know a reference exists (it's in the reference set) but loading it failed. Here is one occurrance: https://github.com/fsspec/filesystem_spec/blob/master/fsspec/implementations/reference.py#L790
This exception is a subclass of RuntimeError, specifically so that it shouldn't be caught by any conversion to KeyError. In zarr, a KeyError means "does not exist, so fill with the replacement value", and for most stores, an IOError would get transformed to KeyError for this reason.
It would be good to add logging or otherwise debug what actually happens during the missing chunks. Turning on the "fsspec.reference" logger and whichever backend hosts the data (gcsfs? s3fs?) would be a good start.
You didn't say, is this happening in a single node? How many threads/processes are in play?

Thanks for the advice, how do I turn on logging in fsspec.reference? Is there a keyword to add to fsspec.get_mapper?
This is across multiple nodes in a cluster, local machine and a few VMs I've tried it on a remote cluster.

I see your example ReferenceNotReachable call. I can see my requests are awaited in implementations.http _cat_file (ln 231), and I tried looking at the call in implementations.reference _cat_file (ln 708) but the request doesn't seem to be coming from there, it must be from somewhere else where this is not caught in the same way.

fsspec.utils.setup_logging(logger_name="fsspec.reference")

but you will need to run this on all processed (e.g., with dask client.run()).

I've set up a script locally with a scenario that I can now run that does one of two things. If I'm connected to WiFi the dataset loads after ~30 seconds no problem. If I disconnect and rerun, I trigger a decode error in pandas which carries through into xarray as an OverflowError (tiny values being decoded). Logging doesn't seem to reveal anything, I get a lot of:
2024-04-11 15:02:37,967 - fsspec.reference - DEBUG - _cat_common -- cat: time/23724
2024-04-11 15:02:37,967 - fsspec.reference - DEBUG - _cat_common -- Reference: time/23724 => https://dap.ceda.ac.uk/badc/cmip6/data/CMIP6/CMIP/BCC/BCC-ESM1/historical/r1i1p1f1/day/rsus/gn/v20181220/rsus_day_BCC-ESM1_historical_r1i1p1f1_gn_19500101-20141231.nc, offset 777976576, size 8

and I can see where await _cat_file is triggered because I added a logger message at that point. But nothing else happens after that before the overflow is triggered.

You should also enable "fsspec.http" in that case - maybe it has something useful to tell.

Narrowed the issue down to a parameter on_error which is set to "return" not "raise" at a given point, which leads to the overflow issue. I'm digging through the traceback to see where this comes from, as some calls do have "raise" as the option while the very first one with "return" causes the issue.

"return" is supposed to be the right thing, so that further up the stack, code can decide whether the specific exception counts as a KeyError (i.e., missing values) or something to raise. If it were "raise", the only option would be to catch the exception, but then you have no data.
Another thing to try to find out: the HTTP request itself should be retriable, but there are many failure channels, so it's possible that something like a 500 (server busy) actually should never fail, just go slowly.

https://github.com/zarr-developers/zarr-python/pull/1604 was recently merged, does that help?

Looks like that does seem to work with my local test, thanks for that! I'll add here if I encounter more issues of this type, I should know soon if this works for the other files too.