keylime_verifier fails to start on Ubuntu 18.04 (on Z) due to SQLAlchemy

Environment

OS / version: Ubuntu 18.04
Processor architecture: Z
TPM Manufacturer: None
Keylime version: git master (1766957a748)

# pip3 freeze
alembic==1.4.3
asn1==2.4.1
asn1crypto==1.4.0
astroid==1.6.0
certifi==2020.6.20
cffi==1.14.3
chardet==3.0.4
colorama==0.4.4
command-not-found==0.3
coverage==4.5.2
cryptography==3.3.1
decorator==4.4.2
distro-info==0.0.0
enum-compat==0.0.3
green==2.13.0
idna==2.10
importlib-metadata==1.7.0
isort==4.3.4
jeepney==0.4.3
keylime @ file:///home/stefanb/keylime
keyring==21.4.0
keyrings.alt==3.4.0
language-selector==0.1
lazy-object-proxy==1.3.1
logilab-common==1.4.1
lxml==4.6.1
M2Crypto==0.36.0
Mako==1.1.3
MarkupSafe==1.1.1
mccabe==0.6.1
netifaces==0.10.9
numpy==1.19.2
olefile==0.46
paramiko==2.0.0
Pillow==5.1.0
plumbum==1.6.9
pyasn1==0.4.8
pycodestyle==2.3.1
pycparser==2.20
pycrypto==2.6.1
pygobject==3.26.1
pylint==1.8.3
python-apt==1.6.5+ubuntu0.4
python-dateutil==2.8.1
python-editor==1.0.4
pyxdg==0.25
PyYAML==3.12
pyzmq==19.0.2
requests==2.24.0
rpyc==3.4.4
scipy==0.19.1
SecretStorage==3.1.2
simplejson==3.17.2
six==1.15.0
SQLAlchemy==1.3.19
termstyle==0.1.11
tornado==6.0.4
ufw==0.36
Unidecode==1.1.1
urllib3==1.25.10
wrapt==1.9.0
zipp==3.1.0

Description
Start of keylime_verifier fails like this:
 /usr/local/bin/keylime_verifier
Using config file /etc/keylime.conf
2021-03-15 12:34:06.040 - keylime.keylime_db - WARNING - database_url is not set, using deprecated database configuration options
2021-03-15 12:34:06.095 - keylime.keylime_db - WARNING - database_url is not set, using deprecated database configuration options
2021-03-15 12:34:06.096 - alembic.env - INFO - Migrating database cloud_verifier
2021-03-15 12:34:06.096 - alembic.runtime.migration - INFO - Context impl SQLiteImpl.
2021-03-15 12:34:06.097 - alembic.runtime.migration - INFO - Will assume non-transactional DDL.
2021-03-15 12:34:06.100 - alembic.runtime.migration - INFO - Running upgrade  -> 8a44a4364f5a, Initial database migration
2021-03-15 12:34:06.105 - alembic.runtime.migration - INFO - Running upgrade 8a44a4364f5a -> eeb702f77d7d, allowlist rename
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/engine/base.py", line 1277, in _execute_context
    cursor, statement, parameters, context
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/engine/default.py", line 593, in do_execute
    cursor.execute(statement, parameters)
sqlite3.OperationalError: near "ima_whitelist": syntax error

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/bin/keylime_verifier", line 8, in <module>
    sys.exit(main())
  File "/usr/local/lib/python3.6/dist-packages/keylime/cmd/verifier.py", line 19, in main
    keylime.cmd.migrations_apply.apply('cloud_verifier')
  File "/usr/local/lib/python3.6/dist-packages/keylime/cmd/migrations_apply.py", line 31, in apply
    alembic.config.main(argv=alembic_args)
  File "/usr/local/lib/python3.6/dist-packages/alembic/config.py", line 581, in main
    CommandLine(prog=prog).main(argv=argv)
  File "/usr/local/lib/python3.6/dist-packages/alembic/config.py", line 575, in main
    self.run_cmd(cfg, options)
  File "/usr/local/lib/python3.6/dist-packages/alembic/config.py", line 555, in run_cmd
    **dict((k, getattr(options, k, None)) for k in kwarg)
  File "/usr/local/lib/python3.6/dist-packages/alembic/command.py", line 298, in upgrade
    script.run_env()
  File "/usr/local/lib/python3.6/dist-packages/alembic/script/base.py", line 489, in run_env
    util.load_python_file(self.dir, "env.py")
  File "/usr/local/lib/python3.6/dist-packages/alembic/util/pyfiles.py", line 98, in load_python_file
    module = load_module_py(module_id, path)
  File "/usr/local/lib/python3.6/dist-packages/alembic/util/compat.py", line 184, in load_module_py
    spec.loader.exec_module(module)
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/usr/local/lib/python3.6/dist-packages/keylime/migrations/env.py", line 147, in <module>
    run_migrations_online()
  File "/usr/local/lib/python3.6/dist-packages/keylime/migrations/env.py", line 127, in run_migrations_online
    context.run_migrations(engine_name=name)
  File "<string>", line 8, in run_migrations
  File "/usr/local/lib/python3.6/dist-packages/alembic/runtime/environment.py", line 846, in run_migrations
    self.get_context().run_migrations(**kw)
  File "/usr/local/lib/python3.6/dist-packages/alembic/runtime/migration.py", line 522, in run_migrations
    step.migration_fn(**kw)
  File "/usr/local/lib/python3.6/dist-packages/keylime/migrations/versions/eeb702f77d7d_allowlist_rename.py", line 20, in upgrade
    globals()["upgrade_%s" % engine_name]()
  File "/usr/local/lib/python3.6/dist-packages/keylime/migrations/versions/eeb702f77d7d_allowlist_rename.py", line 41, in upgrade_cloud_verifier
    op.alter_column('verifiermain', 'ima_whitelist', new_column_name='allowlist', existing_type=sa.Text(length=429400000), existing_nullable=True)
  File "<string>", line 8, in alter_column
  File "<string>", line 3, in alter_column
  File "/usr/local/lib/python3.6/dist-packages/alembic/operations/ops.py", line 1779, in alter_column
    return operations.invoke(alt)
  File "/usr/local/lib/python3.6/dist-packages/alembic/operations/base.py", line 373, in invoke
    return fn(self, operation)
  File "/usr/local/lib/python3.6/dist-packages/alembic/operations/toimpl.py", line 56, in alter_column
    **operation.kw
  File "/usr/local/lib/python3.6/dist-packages/alembic/ddl/impl.py", line 233, in alter_column
    existing_nullable=existing_nullable,
  File "/usr/local/lib/python3.6/dist-packages/alembic/ddl/impl.py", line 141, in _exec
    return conn.execute(construct, *multiparams, **params)
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/engine/base.py", line 1011, in execute
    return meth(self, multiparams, params)
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/sql/ddl.py", line 72, in _execute_on_connection
    return connection._execute_ddl(self, multiparams, params)
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/engine/base.py", line 1073, in _execute_ddl
    compiled,
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/engine/base.py", line 1317, in _execute_context
    e, statement, parameters, cursor, context
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/engine/base.py", line 1511, in _handle_dbapi_exception
    sqlalchemy_exception, with_traceback=exc_info[2], from_=e
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/util/compat.py", line 182, in raise_
    raise exception
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/engine/base.py", line 1277, in _execute_context
    cursor, statement, parameters, context
  File "/usr/local/lib/python3.6/dist-packages/sqlalchemy/engine/default.py", line 593, in do_execute
    cursor.execute(statement, parameters)
sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) near "ima_whitelist": syntax error
[SQL: ALTER TABLE verifiermain RENAME ima_whitelist TO allowlist]
(Background on this error at: http://sqlalche.me/e/13/e3q8)

I had this running on 'Z' before but hadn't followed the git tree in a while. Troubles started when upgrading to master and DB update/migration failed. The above is now a result of me removing the sqlite database files entirely.

What version of SQLite are you running? I didn't realize that column renaming support is relatively new (v3.25.0) for sqlite, so we might have to go with the batch_op approach that we use for things like DROP COLUMN for sqlite.

@mpeters
$ dpkg --list | grep qlit
ii  libsqlite0                             2.8.17-14fakesync1                     s390x        SQLite 2 shared library
ii  libsqlite3-0:s390x                     3.22.0-1ubuntu0.4                      s390x        SQLite 3 shared library
ii  sqlite3                                3.22.0-1ubuntu0.4                      s390x        Command line interface for SQLite 3

@stefanberger can you see if https://github.com/keylime/keylime/pull/587 fixes this for you?

Well, hold off, it's not working in CI. Tracking down why

This issue is now resolved.


Split RegisterTopRootEvents from the rest of the tools collection

Is your feature request related to a problem? Please describe.
I am building a custom input and need the static method RegisterTopRootEventsfor that.
Currently i have to import the whole Tools class to use this method, something like this:
import { Tools } from "@babylonjs/core/Misc/tools";

This contains a lot of code which i don't need for my purpose and blows up the final budle size.
Describe the solution you'd like
I would like to be able to only import the RegistrationTools (?) part of the Tools class that would allow me to use tree shaking and reduce the bundle size.
Maybe it can be done just like with the screenshot tools, that can be imported like i stated above or with the following statement:
 import { ScreenshotTools } from "@babylonjs/core/Misc/screenshotTools";

I haven't found something like that for my use case yet.
Discussion
You must provide a link to the forum post where the initial discussion happened

Discussion
You must provide a link to the forum post where the initial discussion happened

Please discuss on the forum first


CloudFormation backend?

Now that CloudFormation supports ECS resources, we could use CloudFormation directly as a backend, rather than using the ECS/ELB/Route53 API's directly. This would remove a lot of nitty gritty manual work like changing listeners and healthchecks.

The more I think about this the better it sounds. I think there's a couple of key advantages here:

The biggest advantage is that we can templatize deployments. We can provide a base text/template for a cloudformation stack that takes in a service.App as data and creates the ECS services, linked ELB's, etc but this will allow people to add additional resources to each stack that gets created, even custom resources for provisioning third party services (e.g. kinesis streams, honeybadger projects, papertrail/sumo drains, etc) making it far more extensible than the current backend.
We'd ultimately end up removing a lot of code since we'd only need to generate a cloudformation template and talk to one API.
Adding support for automatically adding attached resources (RDS), would be really easy.

I think the only drawback is the migration from the old backend to the new backend. We could add a Migration implementation of service.Manager that uses the new cloudformation backend, and ensures the old ECS/ELB's are destroyed.

In practice how does updating a task definition work in CloudFormation? It the docs it says changing the docker image you have deployed requires replacing the entire Task but does that manifest as a new version of a task or as destroying the task entirely and recreating it?

CloudFormation will create a new task definition with a random name (it doesn't create a new revision of the existing task definition), which would be fine for Empire since we never actually use the revision directly.

Also, if we do implement a cloudformation backend, we'd continue to maintain the existing backend and eventually deprecate it depending on how the new backend works.

I kind of like this idea since being able to create new RDS instances and stuff when you deploy your app would be pretty handy sometimes. It does feel a little bit like feature creep at this stage though. I guess this is mostly because we'd rather use Terraform for managing these kind of things right now but that might not be a great reason to dislike this idea.
I have some vague idea of the concept of a "provisioning container" which Empire could execute on each deploy in some context with just enough IAM permissions to create or update the rest of the service. This would decouple Empire (the current service) from any particular provisioning scheme and would make it mostly a system that managed access controls. This has the advantage of meaning Empire can run with fewer permissions and would also potentially make the actual provisioning system pluggable. This could also be called an even more extreme example of feature creep I suppose :)

That's an interesting idea. If I'm understanding correctly, basically an implementation of the service.Manager interface that might just call out to a Docker container, and when you configure Empire, you could pass it a Docker image to run. Kinda like a loose plugin system for the backends.
That actually sounds like it could be really awesome. It would make extending Empire's provisioning to suit your own needs a lot easier, without needing to merge anything in here, since the actual backend implementations could be externalized and maintained separately.

Just spewing a few more thoughts:
Maybe the best thing to do is just to define an HTTP version of the service.Manager interface (e.g. POST /apps, DELETE /apps/:id, GET /apps/:id/instances, PATCH /apps/:id/processes/:type, DELET /apps/:id/instances/:task). The default backend can just assume that the backend API is available at http://backend. For most cases, I think just starting Empire with docker and linking to the backend container would suffice (e.g. docker run -link backend remind101/empire).
This would provide a lot of flexibility; if you're not using docker to run Empire, that's fine and you can just point Empire to the location of the backend.
I think before we settled on a spec for the API, I'd want to do a little investigation on whether the interface will work well enough for other potential backends (e.g. GCE, Kubernetes, Swarm).

Another potential benefit to externalizing this interface: Building a cron scheduler would be pretty easy. A separate cron service could easily hit the /apps/:id/run endpoint to run the task.


AttributeError: 'TestRun' object has no attribute 'set_custom_field'

set_custom_field method is missing from TestRun class.  Refer below code -
from pylero.test_run import TestRun

project="test"
test_run_id="testrun"
template="test"
status="inprogress"

tr = TestRun.create(project_id=project, test_run_id=test_run_id, template=template)

tr.status = status

arch = tr.get_custom_field("arch")
print(f"arch :: {arch}")
print(f"arch.key :: {arch.key}")
print(f"arch.value :: {arch.value}")

tr.set_custom_field("arch", "i386")

tr.update()

Getting below error -
arch :: <pylero.custom.Custom object at 0x7f7195b629e0>
arch.key :: arch
arch.value :: None
Traceback (most recent call last):
  File "/home/vamahaja/Codes/debug/pylero-01.py", line 17, in <module>
    tr.set_custom_field("arch", "i386")
AttributeError: 'TestRun' object has no attribute 'set_custom_field'. Did you mean: '_set_custom_field'?

Below code is working -
from pylero.test_run import TestRun

project="test"
test_run_id="testrun"
template="test"
status="inprogress"

tr = TestRun.create(project_id=project, test_run_id=test_run_id, template=template)

tr.status = status
tr.arch = "i386"

arch = tr.get_custom_field("arch")
print(f"arch :: {arch}")

tr.update()

Mark resolve as it works with directly setting custom field with update attribute value


Post reloads after upvoting

Expected behavior
No visible action with the post except the stats change should occur.

The gif is from the stable version.
Actual behavior
The post reloads if a user upvotes a post.

How to reproduce

Open a post on staging.busy.org
Upvote the post

Browser: Chrome
Operating system: Windows 10

This issue still occur, we will need a hotfix for it.

Patch.
diff --git a/src/client/post/postsReducer.js b/src/client/post/postsReducer.js
index 9a911c2..fac05d9 100644
--- a/src/client/post/postsReducer.js
+++ b/src/client/post/postsReducer.js
@@ -81,6 +81,7 @@ const posts = (state = initialState, action) => {
       };
     }
     case postsActions.GET_CONTENT.START:
+      if (action.meta.afterLike) return state;
       return {
         ...state,
         postsStates: {


When pre-populating the select-items-label value is ignored

When I'm pre-populating the list, the value of the select-items-label is ignored. If i remove the items from the list my selected label is used.

Hi Josh,
could you maybe create a reproducible codepen such that I can have a look at it? This way it is hard to reproduce as I cannot guess your configuration and with a codepen this is isolated and easily reproducible.
Thanks and sorry for the late response,
Guy

cannot confirm.
'<ion-item class="item-divider" ng-show="viewModel.searchItems.length > 0">{{viewModel.selectItemsLabel}}</ion-item>',

the opposite should be the case?

My apologizes for the delay as well.
I had resolved this issue while overriding the default template with my own. As I tried to recreate using the default template, I was unable to recreate. I suspect I had erroneously seen this "defect" while transitioning from the default template to my own.
My apologizes for the false positive and I really do appreciate the work you've done in this component.

Hi Josh,
ok nice that it works now :).
Thanks and regards,
Guy


Add Japanese localization - nightly

I also think that this beta version is wonderful. There were some parts where localization was not applied correctly, but personally, I do not consider it a major issue. I am very satisfied with the appearance and functionality, so I will continue to use this version for a while, as long as I don't encounter any major troubles.

Hi,
I apologize for the late reply. I tried to check, but I don't have a device that supports Jailbreak or TrollStore.
So I can not handle .deb files.

I will check on it right away.

I see. Either way, I like the second color option. Thank you always.

Yes, I agree.
I think there is a demand among those who would like to customize the color of YouTube app to their preferences.

I hope everything’s gonna be fine👍

YouTube Reborn’s Best Customization 👀

wow! I'll try it out next time.
This is a separate matter, but I have a few questions about YouTube Reborn(v19.02.1-5.0.0 Beta 4.5).
First, the interior of REORDER_TABS is not displayed. (Screenshot-1) Is this due to the Japanese localization?
Screenshot-1

Second, about the APP_VERSION_SPOOFER section. (Screenshot-2) The toggle is gone, but is it because the function is duplicated with YouTubeRebornPlus, and you plan to delete one of them?
Screenshot-2

Third, the localization does not seem to be reflected in the DISABLE of Sponsor Block Options. (Screenshot-3)
Screenshot-3

Fourth, about DISABLE_PINCH_TO_ZOOM. This is a new feature that has been added to Reborn, but is it a different option from the option that already exists in YouTubeRebornPlus?
Also, should I create an issue for these (grouped or individually)?
I apologize if this is on my side issue, such as my app sign.
P.S.
I will update the translation later.Thank you always!

Thank you for your kind answer🧡

Congratulations!! I will update the translation later.


[NIN] Minor ninja issues

There are some weaving issues with ninja which might cause some GCD to be missed during kunai window. There is also some ninki being wasted when using Metsui. For Metsui, maybe use a bava to dump any ninki if around 50 in order to avoid overcapping before using Metsui.
Provided the log below testing on a training dummy.
xivanalysis
https://xivanalysis.com/fflogs/a:CY8a9vWQ3pRPfG47/6/3
Debug
WrathDebug.txt

After looking at the code, it seems the issue with the ninki might be related to this part.
                        if (IsEnabled(CustomComboPreset.NIN_ST_AdvancedMode_Bhavacakra) &&                             ((NINHelper.TrickDebuff && gauge.Ninki >= 50) || (useBhakaBeforeTrickWindow && gauge.Ninki >= 85)) &&                             (IsNotEnabled(CustomComboPreset.NIN_ST_AdvancedMode_Mug) || (IsEnabled(CustomComboPreset.NIN_ST_AdvancedMode_Mug) && IsOnCooldown(Mug))) &&                             Bhavacakra.LevelChecked())                             return OriginalHook(Bhavacakra);
It will try to hold ninki for trick attack, which makes sense, but it seems it will hold it even if capped, causing you to waste some of the ninki generated by your 123 combo, which can add to a lot over the course of a fight.

I believe I found what the Ninki issue is. Turns out there isn't a check for the amount of Ninki the player has before using Mug/Dokumori. For mug there is no issue but Dokumori gives you 40 Ninki on used, causing you to overcap.

At least to me those changes make good sense, particularly the ninki reduction, especially so with pending CanDelayedWeave updates to make it a bit smoother/more reliable.
Ping me on Discord when you have that made, and I'll review both your PRs to try to get them moving again.

#219 closed this.


Cannot run 'bundle'

I am using the directions from the Novice install guide.  I originally tried the manual install guide, but after "manually" working through countless errors in the install guide, I encountered this issue which forced me to switch to the novice install, which was also present in the novice install.
https://github.com/cantino/huginn/wiki/Novice-setup-guide
With the manual install, I tried to run "rake secret", and it told me some gem or other wasn't installed, and to run 'bundle install', which failed due to permissions.  Then I tried to run "sudo bundle install", which gave me a warning that seemed important so I stopped.  Then I manually installed about 30 gems trying to fix the error, but the list of missing gems seems to be neverending.  I tried reinstalling bundler and doing tons of other things before giving up.
Switching to the novice setup, and running "bundle", I am getting this error (again):

[!] There was an error parsing `Gemfile`: Could not load huginn settings from .env file.. Bundler cannot continue.

 #  from /var/www/html/huginn/Gemfile:14
 #  -------------------------------------------
 #  require File.join(File.dirname(__FILE__), 'lib/gemfile_helper.rb')
 >  GemfileHelper.load_dotenv do |dotenv_dir|
 #    path dotenv_dir do
 #  -------------------------------------------

I don't know what I could have missed here, as I followed both sets of directions exactly, but I could really use some help here.

Hopefully this is a well-known problem with a well-known fix.  All I did was follow what appeared to be some very simple directions in the novice install.

Hi @AumCoin, did you copy .env.example to .env and edit it yet before running the bundle command?

When i copy .env.example to .env, it warns No such file or directory.

@lionel-ace Are you in the correct folder? .env.example should be present in /home/huginn/huginn.


Colab TPU example

We need to add a TPU example on Colab. Then add a ref link to the readme file

@Cdk29 Hi here is an example. It worked fine. Very soon, I will submit the next release to CRAN (tpu support). https://colab.research.google.com/drive/1PiBECDM552No-5apVIB8LqUSdSqqJSi-?usp=sharing

@Cdk29 Hi here is an example. It worked fine. Very soon, I will submit the next release to CRAN (tpu support). https://colab.research.google.com/drive/1PiBECDM552No-5apVIB8LqUSdSqqJSi-?usp=sharing

Oh nice. Sorry I am not really reactive, most of my coding time goes into the cassava comp. I am glad to see this, I think I will use it for some Knoledge Distillation approach :-)

Oh nice. Sorry I am not really reactive, most of my coding time goes into the cassava comp. I am glad to see this, I think I will use it for some Knoledge Distillation approach :-)


[Client] Multiplayer screen (lobby)

Show a waiting screen lobby where you can see and chat with other users while a game is already ongoing.
Once ongoing game ends, previous players enter waiting lobby.
If more than 1 person readies up, countdown begins for another game.
Everyone who readied up, will join the next game.

done

done


Add duplicate_underscore_argument

What it does
Checks for function arguments having the similar names differing by an underscore.
Why is this bad?
It affects code readability.
Example
fn foo(a: i32, _a: i32) {}

Use instead:
fn foo(a: i32, _b: i32) {}

https://rust-lang.github.io/rust-clippy/master/index.html#/duplicate_underscore_argument

Hi, can I take this?

sure can you join the telegram group as well so i can help if you're stuck or don't know how to start ? https://t.me/cairolint


Range selection is happening different cells

IMPORTANT - BEFORE CREATING YOUR ISSUE PLEASE READ THE FOLLOWING:
*. Using the latest version.
First of all Thanks for creating an amazing library.
I want to create a calendar like the below screenshot

You can find my source code is here: https://github.com/yasheedv/JTAppleCalendarDemo
I created a range selection. But Im getting the following issues. Please help me to find a solution for this.

I selected April 30 to May 2 and getting the following

Selected May-5 to May 31

June 14 to July 1

will take a look

Hii.. Any updates ?

ok. i only now had a chance to look at this. Sorry for the late response.

I selected April 30 to May 2 and getting the following
You have shown me the image of what you have. But can you show me what you want it to look like?

Keep in mind, that showing me the wrong image, does not make me understand what should be the right image. Many developers have different designs in mind.

Selected May-5 to May 31
Same thing here. What should it look like? I see in the image that your indates for the month of June is selected. Should it be invisible? visible?

June 14 to July 1
This is the only image that seems obvious to me that there is an error. Because i assume you do not want two end selections.  But can you help me understand for # 1 and # 2?

Ive finally got around to this.
Your code was too complex for me to go through, so i created a range selection example for you.
Download the github project and run the attached sample project.
On the fourth option, you will see rangeSelection example.

will close this issue.
Let me know if youre still experiencing problems.

Just to follow up on this in case anyone else is experiencing this issue.  In example 1 and 2, it seems like the OP was trying to not show the range indication on dates outside of the valid calendar days in a month.  To achieve this you can simply check cellState.dateBelongsTo == .thisMonth when configuring your cells.


Orca in a browser

Hi,
I created a very simple browser-based build of Orca for online experiments. I think it might be valuable to have Orca accessible without having to download/install anything. (If you decide to merge this, just enable Github Pages for your repo and you will have a built-in hosted version.)
What I did:

used Rollup to bundle Orca's source files into one file,
duplicated and edited the main HTML file,
provided dummy mocks for fs, path, electron, node-osc and dgram (these modules have no straightforward browser alternative)

Some of these modules can be re-implemented using browser APIs. I would like to find a suitable dgram alternative as well, because my goal is to make Pilot available in a browser as well.
To update this build when Orca's source changes:

cd browser
npm i
npm run rollup

I don't want to use rollup, but if you want a browser version, I can make one. I've done the same thing to Dotgrid before, I'll get rid of the requires and move things in the index. Give me a few days :)

Interesting; is there any particular reason you want to evade rollup?
If you want, I can submit a PR that replaces require with ES6 import/export. That would maintain the current dependency tree (no globals) while being compatible with modern browsers. (Hopefully Electron is up-to-date enough to support module scripts.)

Actually what I want to evade is to bring modules in orca when something can be done without. If you can do this in a way that does not include new modules, I would totally merge that yes.

I am not sure I completely understand the last comment. What exactly do you mean by modules? Additional NPM dependencies/tooling?
In my comment, I used modules to describe the ES6 import/export interface that would be used instead of your current require (that is nodejs-specific and not understood by browsers).
Converting your code to ES6 modules would be a matter of replacing exports.XYZ with export XYZ and require(XYZ) with import XYZ.
However, even with browser-compliant modularization in place, it is generally recommended to bundle source files into one, to reduce the amount of HTTP requests. This step is not mandatory, but cannot be done without tooling support. (Rollup is one of these tools, but there are others -- browserify, webpack, ...)

What exactly do you mean by modules? Additional NPM dependencies/tooling?

Yes, right now the only module besides electron is node-osc which I have been rewriting especially for Orca.

However, even with browser-compliant modularization in place, it is generally recommended to bundle source files into one, to reduce the amount of HTTP requests. This step is not mandatory, but cannot be done without tooling support. (Rollup is one of these tools, but there are others -- browserify, webpack, ...)

I understand, but I prefer not to do this with the hundredrabbits projects.

I understand, but I prefer not to do this with the hundredrabbits projects.

I see and respect that. I would just like to mention that my PR does not touch your package.json in the desktop/ subdirectory; I created a separate browser/ subdirectory with its own package.json that only uses NPM to install bundling tools. None of those is needed to run the resulting content.
If this is still too problematic for you, I can remove (or git-ignore) the NPM stuff and only add the created bundle.js to the repository. Then, when you push updates to master, I would re-bundle on my machine and push the updated browser bundle.
Finally, if none of the above variants are okay for you, I would try to submit a PR with require replaced with import and see how that works.

Finally, if none of the above variants are okay for you, I would try to submit a PR with require replaced with import and see how that works.

That would be best, I think this could be done in a very lean way, and sharing the maximum number of files. No bundling, no npm. You can have a look at Dotgrid for what I have in mind, the difference between the electron and web version, besides their index.html, is just a single file.

You can have a look at Dotgrid for what I have in mind, the difference between the electron and web version, besides their index.html, is just a single file.

Right, this is always a possibility. But this approach has three disadvantages:

you lose your current dependency tree,
everything is global,
the browser does many requests.

I hope that my ES6-modules proposal would cure the first two problems. I will close this PR once I have the discussed version ready and pushed.

I can totally live with these three disadvantages. I didn't realize that ES6 modules would work in the browser until today! That's pretty amazing.

I didn't realize that ES6 modules would work in the browser until today! That's pretty amazing.

Right! Current Electron is 5.0.1, based on Chromium 73. According to caniuse, ES6 modules are available from Chrome 61, so this might work nicely.

I'm actually pretty excited for this. Keep me posted, let me know if you have any question :)


Allowing number of replicas to be configurable

https://github.com/rancher/helm-project-operator/issues/42
adding the ability to configure replicas in Helm Project Operator

Probably need to bump the Drone.yml to rancher/dapper:v0.6.0


Electrum XVG 2.4.1 Wallet problem

I withdrew some xvg to the Electrum XVG 2.4.1 Wallet and it's not there. I think the wallet is failing to sync and i used both servers available. verge.xyz, and XVG.stream. any help would be great thanks.

Got it sorted i changed the server a few times and it worked

👍 mind closing this?


Add support to specify external JEST config js or json file to update…

… converage

Hi @mxshrestha, thanks for the PR. I wanted to refactor some parts of the code anyway, so I added new flag to the mainline.

Published as v1.1.0


GUI Filtering and exclusions

Currently cant edit a file in GUI if it has filters or exclusions - even though you can create one.
Also creating filters with the Active flag set doesn't work; the XML has
<Active>0</Active>

fixed in #78


Not Compatible with Sodium 0.5.6

Sodium 0.5.6 released 12 hours ago as of this issue, want to notify if you didn't know.

You can use this file to run a previous version of Indium with Sodium 0.5.6 until the developer fixes it themselves.
Just place this file in a folder that contains configs of other mods (.minecraft/config) and Indium will work.
All I did was change the requirement of version 0.5.5 to a version that is equal to or greater than 0.5.6.
fabric_loader_dependencies.json

Same here

comp500 this very moment with such kind of issues:

Same here

Oops! Now we got 0.5.7 :v

life's hard....time to touch some grass folks until this gets fixed

https://fabricmc.net/wiki/tutorial:dependency_overrides
Override it. It seems to work. But there are some glitches
For reference:
"nvidium": {
  "-depends": {
    "sodium": "IGNORED"
  }
},
"indium": {
  "-depends": {
    "sodium": "IGNORED"
  }
},
"sodium": {
  "-breaks": {
    "indium": "IGNORED"
  }
}

I don't recommend this. Some glitches would hurt players with huge mod lists.

Sodium version 0.5.7 fixed a critical issue for my modpack, it would be awesome to get Indium updated soon as I'd need to publish my modpack asap ahah

Incompatible mods found!
net.fabricmc.loader.impl.FormattedException: Some of your mods are incompatible with the game or each other!
A potential solution has been determined, this may resolve your problem:
- Replace mod 'Sodium' (sodium) 0.5.7+mc1.20.1 with version 0.5.7 or version 0.5.8 that is compatible with:
- indium, any version
- Replace mod 'Indium' (indium) 1.0.27+mc1.20.1 with any version that is compatible with:
- sodium, version 0.5.7 or version 0.5.8
More details:
- Mod 'Indium' (indium) 1.0.27+mc1.20.1 requires version 0.5.3 of mod 'Sodium' (sodium), but only the wrong version is present: 0.5.7+mc1.20.1!
- Mod 'Sodium' (sodium) 0.5.7+mc1.20.1 is incompatible with version 1.0.27 or earlier of mod 'Indium' (indium), but a matching version is present: 1.0.27+mc1.20.1!
at net.fabricmc.loader.impl.FormattedException.ofLocalized(FormattedException.java:51)
at net.fabricmc.loader.impl.FabricLoaderImpl.load(FabricLoaderImpl.java:195)
at net.fabricmc.loader.impl.launch.knot.Knot.init(Knot.java:146)
at net.fabricmc.loader.impl.launch.knot.Knot.launch(Knot.java:68)
at net.fabricmc.loader.impl.launch.knot.KnotClient.main(KnotClient.java:23)
Its one error for the other error. Changing as the details suggest makes other stuff break

fabric_loader_dependencies.json
Use this file to get Indium working with Sodium version 0.5.7.
Just place it in the folder with the configs of other mods (by default this is .minecraft/config)

fabric_loader_dependencies.json Use this file to get Indium working with Sodium version 0.5.7. Just place it in the folder with the configs of other mods (by default this is .minecraft/config)

Is this part of the fabric_loader_dependencies necessary?
        "fabricloader": {
            "+depends": {
                "fabricloader": ">=0.15.6"
            }
        },
        ```

fabric_loader_dependencies.json Use this file to get Indium working with Sodium version 0.5.7. Just place it in the folder with the configs of other mods (by default this is .minecraft/config)

Is this part of the fabric_loader_dependencies necessary?
        "fabricloader": {
            "+depends": {
                "fabricloader": ">=0.15.6"
            }
        },

idk, it's from FO modpack.

Is this part of the fabric_loader_dependencies necessary?

No.

5.8 now gamers

@Tapacywka Thx, it worked!

can confirm the dependency override by @Tapacywka works and doesnt require the fabricloader part (:

Change the Indium dependency inside of Sodium to an older version than the latest released Indium for proper compatibility. This can be done via WinRAR. I have yet to identify any issues with Indium and Sodium 0.5.8.

yea or just use sodium 0.5.3 and the newest indium i guess... works fine for me

yea or just use sodium 0.5.3 and the newest indium i guess... works fine for me

Latest Indium support sodium 0.5.5
But many other mods need sodium 0.5.7 or higher

It is better not to change the sodium/indium dependencies so that there are no errors with mods. Emotecraft does not work correctly with it and a number of others, reaching the wrong display of player skins with endless errors in the logs.

fabric_loader_dependencies.json Use this file to get Indium working with Sodium version 0.5.8. Just place it in the folder with the configs of other mods (by default this is .minecraft/config)

This is the only more or less adequate option to use 0.5.8 Sodium together with Indium. Please do not change anything inside the .jar files of the mods themselves.  You may break compatibility with other mods or cause unpredicable errors.


[Feature] Add an export to CSV option

The data is basically already formatted correctly anyway. Exporting to a CSV would allow people to get a copy of what they have without having to reload the script every time.

I will be working on this shortly. Was already considering it, but since you asked so nicely, I will definitely do it :D

Looking forward to it!

Added in latest commit. Can save to CSV for both View and Counts.


Add link to Telegram in the footer

As explained here https://github.com/btcpayserver/btcpayserver/issues/4158 we should add a link to our official telegram chat in the Footer.  https://t.me/btcpayserver
I also think we should rename chat to "Mattermost" or "Mattermost Chat"? But that can be done in a a different issue/pr.

Hey, I want to contribute to this issue. Can I work on this issue? If yes, could you please assign it to me.

Sure @sreejasaha19 feel free to :)

I think it's already done by someone https://github.com/btcpayserver/btcpayserver/pull/4160

I already publish PR yesterday evening, I don't get if I need also to rename the Mattermost reference

No this PR you referred to is for server itself, and this issue is for btcpayserver.org

No this PR you referred to is for server itself, and this issue is for btcpayserver.org

oh yes, I just noticed

As explained here btcpayserver/btcpayserver#4158 we should add a link to our official telegram chat in the Footer. https://t.me/btcpayserver
I also think we should rename chat to "Mattermost" or "Mattermost Chat"? But that can be done in a a different issue/pr.

Here it's already written "Mattermost", where are you referring to "chat"?


Support Linux framebuffer and input system

This pull request introduces Linux framebuffer backend and mouse event handling for Mado.
To test the program, simply type:
$ sudo ./demo-fbdev

Mado will automatically switch the virtual terminal. (For most case, it should be VT3)
The user should see the following result on the screen:

After finished testing, the user can switch back to the desktop with Ctrl+Alt+F1.

I believe we need to modify the twin_create() interface to support passing device path to the Linux framebuffer backend.
So far, I haven't found an elegant solution for this.
If you have any insights on this issue, please let me know.

Rebase the latest main branch and utilize the new backend interface and build-time configurations.

Rebased to the latest main branch as requested.

I believe we need to modify the twin_create() interface to support passing device path to the Linux framebuffer backend.
So far, I haven't found an elegant solution for this.

Simply use environment variable such as "FRAMEBUFFER".

We can now run sample program with Linux framebuffer using:
sudo FRAMEBUFFER=/dev/fb0 ./demo-fbdev

Let's also handle the mouse events, here is a simple code we can use:
https://gist.github.com/shengwen-tw/f8c95c881185ef06b6b60c78cefa156b

Let's also handle the mouse events, here is a simple code we can use: https://gist.github.com/shengwen-tw/f8c95c881185ef06b6b60c78cefa156b

Consider the following:
#include <fcntl.h>
#include <stdio.h>
#include <stdlib.h>
#include <string.h>
#include <unistd.h>

#include <twin.h>

typedef struct _twin_linux_input {
    twin_screen_t *screen;

    int fd;
    char residual[2];
    int res_cnt;
    int btns;
    int x, y;
} twin_linux_input_t;

static void _twin_linux_input_check_bounds(twin_linux_input_t *tm)
{
    if (tm->x < 0)
        tm->x = 0;
    if (tm->x > tm->screen->width)
        tm->x = tm->screen->width;
    if (tm->y < 0)
        tm->y = 0;
    if (tm->y > tm->screen->height)
        tm->y = tm->screen->height;
}

static bool twin_linux_input_events(int file, twin_file_op_t ops, void *closure)
{
    twin_linux_input_t *tm = closure;
    char evts[34];
    int n = tm->res_cnt;
    twin_event_t tev;

    if (n)
        memcpy(evts, tm->residual, n);
    n += read(file, evts + n, 32);

    for (char *ep = evts; n >= 3; n -= 3, ep += 3) {
        int dx, dy, btn;
        dx = ep[1];
        if (ep[0] & 0x10)
            dx -= 256;
        dy = ep[2];
        if (ep[0] & 0x20)
            dy -= 256;
        dy = -dy;

        /* only one btn is handled */
        btn = ep[0] & 0x1;
        if (dx || dy) {
            tm->x += dx, tm->y += dy;
            _twin_linux_input_check_bounds(tm);
            tev.kind = TwinEventMotion;
            tev.u.pointer.screen_x = tm->x;
            tev.u.pointer.screen_y = tm->y;
            tev.u.pointer.button = tm->btns;
            twin_screen_dispatch(tm->screen, &tev);
        }
        if (btn != tm->btns) {
            tm->btns = btn;
            tev.kind = (btn & 0x1) ? TwinEventButtonDown : TwinEventButtonUp;
            tev.u.pointer.screen_x = tm->x;
            tev.u.pointer.screen_y = tm->y;
            tev.u.pointer.button = tm->btns;
            twin_screen_dispatch(tm->screen, &tev);
        }
    }
    tm->res_cnt = n;
    if (n)
        memcpy(tm->residual, ep, n);

    return true;
}

/*
 * Create the Linux input driver. At present, only mouse is supported.
 * @file: device file to open, pass NULL for default
 */
twin_linux_input_t *twin_linux_input_create(const char *file,
                                            twin_screen_t *screen)
{
    twin_linux_input_t *tm = calloc(1, sizeof(twin_linux_input_t));
    if (!tm)
        return NULL;

    if (!file)
        file = "/dev/input/mice";

    tm->screen = screen;
    tm->x = screen->width / 2;
    tm->y = screen->height / 2;
    tm->fd = open(file, O_RDONLY);
    if (tm->fd < 0) {
        free(tm);
        return NULL;
    }

    twin_set_file(twin_linux_input_events, tm->fd, TWIN_READ, tm);

    return tm;
}

/* destroy the Linux input driver */
void twin_linux_input_destroy(twin_linux_input_t *tm)
{
    close(tm->fd);
    free(tm);
}

At present, only mouse is supported. Then, you can hook via twin_linux_input_create(NULL, tx->screen);

A draft version with mouse event support has been uploaded.
However, the graphics rendering update rate is not ideal and can be improved.

A draft version with mouse event support has been uploaded. However, the graphics rendering update rate is not ideal and can be improved.

We shall introduce poll(2) to monitor events. See #4 .

I identified the bottleneck of the rendering performance was dragged by the following code:
static void _twin_fbdev_put_span(twin_coord_t left,
                                 twin_coord_t top,
                                 twin_coord_t right,
                                 twin_argb32_t *pixels,
                                 void *closure)
{
...
+    memcpy(tx->fbdev_raw, tx->pixels,
+           sizeof(uint32_t) * screen->width * screen->height);
}

However, if we directly write the pixels to the memory mapped by mmap, the responsiveness will be ideal:
twin_context_t *twin_fbdev_init(int width, int height)
{
...
    /* Create memory mapping for accessing the framebuffer */
    tx->fbdev_raw = mmap(NULL, width * height * info.bits_per_pixel / 8,
                         PROT_READ | PROT_WRITE, MAP_SHARED, tx->fd, 0);
    if (tx->fbdev_raw == MAP_FAILED) {
        printf("error : failed calling mmap()\n");
        goto bail_fd;
    }

    /* Create buffer space for TWIN */
    // tx->pixels = malloc(width * height * sizeof(uint32_t));
+    tx->pixels = tx->fbdev_raw;
...
}

I'm not sure if this is a good approach since many Graphical User Interface libraries seems adopt the double-buffering approach.

A draft version has been pushed, improving framebuffer writing and handling VT settings.
Since the following code will disable command-line input (including Ctrl+C), we should consider either supporting keyboard event handling or adding a dedicated button to terminate Mado.
static bool twin_vt_setup(twin_fbdev_t *tx)
{
...
    /* XXX: Warning: currently there is no way to stop the program
     * once the KD_GRAPHICS mode is set, consider to comment out
     * the following code to prevent from rebooting the system
     */
   if (ioctl(tx->vt_fd, KDSETMODE, KD_GRAPHICS) < 0) {
       printf("Failed to set KD_GRAPHICS mode.\n");
    }

    return true;
}

We may also want to support VT switching that suspends or resumes the framebuffer writing in the later version.

Also, from now on, we can just execute the Mado from the desktop graphics environment without having to press Ctrl+Alt+F3 first, since it will automatically switch the virtual terminal by itself.

Is it quite interesting that seems Ubuntu allocates VT2 for wayland or X11 server:
$ ps -aux | grep tty
shengwen    1509  0.0  0.0 171148  5376 tty2     Ssl+ 22:33   0:00 /usr/libexec/gdm-wayland-session env GNOME_SHELL_SESSION_MODE=ubuntu /usr/bin/gnome-session --session=ubuntu

This implies that Ctrl+Alt+Fn does not necessary switch to VT n directly.
Also, Ctrl+Alt+F1 is essentially designed for switching to the VT of the desktop graphics environment (i.e., VT2), and Ctrl+Alt+F2 is not assigned with functionality.
Reference: What is the purpose of /usr/lib/xorg/Xorg vt2 -displayfd 3?

This implies that Ctrl+Alt+Fn does not necessary switch to VT n directly.

The composite key to trigger VT switching is not fixed, meaning the behavior can vary significantly between Linux distributions. Mado is not necessarily designed to co-exist with the X server or Wayland display server. Instead, it is intended to operate with the Linux framebuffer, similar to FBUI. You can include a note about VT switching without specifying the exact keystrokes.

I defer to @alanjian85 for confirmation of the proposed Linux framebuffer and input subsystem support.

Thank @shengwen-tw for contributing!


Fix LLC consumer to handle segment build fails gracefully

If segment build fails then we used throw NPE while tyring to delete a null file name.
Fixed the condition, and added a test.
We now handle the condition gracefully, and also set LLC_PARTITION_CONSUMING gauge to 0
so that we can alert on the partition that stopped consumption.

Codecov Report

Merging #2499 into master will decrease coverage by 0.03%.
The diff coverage is 100%.

@@            Coverage Diff             @@
##           master    #2499      +/-   ##
==========================================
- Coverage   69.42%   69.38%   -0.04%
==========================================
  Files         848      848
  Lines       39530    39531       +1
  Branches     5327     5328       +1
==========================================
- Hits        27444    27429      -15
- Misses      10297    10308      +11
- Partials     1789     1794       +5

Impacted Files
Coverage Δ

...manager/realtime/LLRealtimeSegmentDataManager.java
68.93% <100%> (+0.64%)
:arrow_up:

...a/manager/realtime/RealtimeSegmentDataManager.java
50% <0%> (-50%)
:arrow_down:

...in/pinot/core/query/pruner/ValidSegmentPruner.java
57.14% <0%> (-28.58%)
:arrow_down:

.../impl/dictionary/FloatOnHeapMutableDictionary.java
80% <0%> (-13.34%)
:arrow_down:

...impl/dictionary/DoubleOnHeapMutableDictionary.java
68.88% <0%> (-6.67%)
:arrow_down:

.../impl/dictionary/LongOffHeapMutableDictionary.java
87.27% <0%> (-5.46%)
:arrow_down:

...impl/dictionary/FloatOffHeapMutableDictionary.java
87.27% <0%> (-5.46%)
:arrow_down:

...not/core/query/pruner/DataSchemaSegmentPruner.java
53.65% <0%> (-4.88%)
:arrow_down:

...nsport/netty/PooledNettyClientResourceManager.java
85.1% <0%> (-4.26%)
:arrow_down:

...e/impl/dictionary/LongOnHeapMutableDictionary.java
93.33% <0%> (-2.23%)
:arrow_down:

... and 13 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update cc5ef44...ed5c60d. Read the comment docs.


補例外的型態

Coverage increased (+0.004%) to 65.826% when pulling 0581b1d621834eb6ff506c8261f5f11c37407422 on 修except排版錯誤 into eb1947a1b91c9d29606dee1a232e275efc9426bc on master.


Fixed unicode char handling in Uris in Cosmos Http Client

Description
Cosmos Http client incorrectly uses URI.toString instead of URI.toASCIIString when constructing the Netty Http request - resulting in incorrect handling of Unicode chars in a Uri on the wire. Using URI.toASCIIString instead fixes this.
All SDK Contribution checklist:

[x] The pull request does not introduce [breaking changes]
[x] CHANGELOG is updated for new features, bug fixes or other significant changes.
[x] I have read the contribution guidelines.

General Guidelines and Best Practices

[x] Title of the pull request is clear and informative.
[x] There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, see this page.

Testing Guidelines

[x] Pull request includes test coverage for the included changes.


Facebook Bridge doesn't work?

Describe the bug
When I updated my facebook feed, The rss reader asked me to log in.
Then I checked the feed, It said "This bridge is not whitelisted."
And I found website of rss-bridge say facebook Bridge is inactive(https://bridge.suumitsu.eu/?show_inactive=1).
Does Facebook Bridge not to work now?
Desktop (please complete the following information):

OS: windows 10
Browser: chrome
Version: 85.0.4183.83

Use other instance, where Facebook is whitelisted. Here some of them: https://github.com/RSS-Bridge/rss-bridge/wiki/Public-hosts


Signing issue when opening OpenRefine on MacOS has reappeared with release 3.7 beta2

The signing issue on MacOS was previously fixed (i.e. Mac users needing to right-click the application upon opening it first) but it unfortunately seems to have reappeared with release 3.7 beta2. :(

Versions

Operating System: MacOS 13.1 Ventura
OpenRefine: 3.7 beta2

Additional context
Not sure if this is relevant to the issue at all, but I'm using OR on a very new M2 chip Mac.

This, and this report seem to indicate that the packaging pipeline for snapshots and releases could be slightly different. I need to investigate the CI to see where that makes a difference.

I could also reproduce this locally.

The build logs seem to indicate that notarization succeeded:
[INFO] --- maven-antrun-plugin:3.1.0:run (generate-dmg) @ packaging ---
[INFO] Executing tasks
[INFO]      [exec] OpenRefine 3.7-beta2/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/jli/libjli.dylib: replacing existing signature
[INFO]      [exec] Codesigning JAR file: sqlite-jdbc-<IP_ADDRESS>.jar
[INFO]      [exec] OpenRefine.app/Contents/Resources/webapp/extensions/database/module/MOD-INF/lib/tmp/org/sqlite/native/Mac/aarch64/libsqlitejdbc.jnilib: replacing existing signature
[INFO]      [exec] OpenRefine.app/Contents/Resources/webapp/extensions/database/module/MOD-INF/lib/tmp/org/sqlite/native/Mac/aarch64/libsqlitejdbc.jnilib: signed Mach-O thin (arm64) [libsqlitejdbc]
[INFO]      [exec] OpenRefine.app/Contents/Resources/webapp/extensions/database/module/MOD-INF/lib/tmp/org/sqlite/native/Mac/x86_64/libsqlitejdbc.jnilib: replacing existing signature
[INFO]      [exec] Codesigning file libsqlitejdbc.jnilib
[INFO]      [exec] Codesigning file libsqlitejdbc.jnilib
[INFO]      [exec] OpenRefine.app/Contents/Resources/webapp/extensions/database/module/MOD-INF/lib/tmp/org/sqlite/native/Mac/x86_64/libsqlitejdbc.jnilib: signed Mach-O thin (x86_64) [libsqlitejdbc]
[INFO]      [exec] Codesigning JAR file: jython-standalone-2.7.3.jar
[INFO]      [exec] Codesigning file libjansi.jnilib
[INFO]      [exec] OpenRefine.app/Contents/Resources/webapp/extensions/jython/module/MOD-INF/lib/tmp/META-INF/native/osx/libjansi.jnilib: signed Mach-O universal (i386 x86_64) [libjansi]
[INFO]      [exec] OpenRefine.app/Contents/Resources/webapp/extensions/jython/module/MOD-INF/lib/tmp/jni/Darwin/libjffi-1.2.jnilib: replacing existing signature
[INFO]      [exec] Replacing OpenRefine.app/Contents/Resources/webapp/extensions/jython/module/MOD-INF/lib/tmp/jni/Darwin/libjffi-1.2.jnilib by /Users/runner/work/OpenRefine/OpenRefine/packaging/apple_certs/libjffi-1.2.jnilib
[INFO]      [exec] Codesigning file libjffi-1.2.jnilib
[INFO]      [exec] OpenRefine.app/Contents/Resources/webapp/extensions/jython/module/MOD-INF/lib/tmp/jni/Darwin/libjffi-1.2.jnilib: signed Mach-O universal (x86_64 arm64) [libjffi-1]
[INFO]      [exec] Conducting pre-submission checks for openrefine-mac-3.7-beta2.dmg and initiating connection to the Apple notary service...
[INFO]      [exec] Submission ID received
[INFO]      [exec]   id: 22721cbe-4eba-47c2-8cb9-a0033da38e78
[INFO]      [exec] Successfully uploaded file
[INFO]      [exec]   id: 22721cbe-4eba-47c2-8cb9-a0033da38e78
[INFO]      [exec]   path: /Users/runner/work/OpenRefine/OpenRefine/packaging/target/openrefine-mac-3.7-beta2.dmg
[INFO]      [exec] Waiting for processing to complete. Wait timeout is set to 600.0 second(s).
[INFO]      [exec]
[INFO]      [exec] Current status: In Progress...Current status: In Progress....Current status: In Progress.....Current status: In Progress......Current status: In Progress.......Current status: In Progress........Current status: In Progress.........Current status: In Progress..........Current status: In Progress...........Current status: In Progress............Current status: In Progress.............Current status: In Progress..............Current status: In Progress...............Current status: In Progress................Current status: In Progress.................Current status: In Progress..................Current status: In Progress...................Current status: In Progress....................Current status: In Progress.....................Current status: In Progress......................Current status: In Progress.......................Current status: In Progress........................Current status: In Progress.........................Current status: In Progress..........................Current status: In Progress...........................Current status: In Progress............................Current status: In Progress.............................Current status: In Progress..............................Current status: In Progress...............................Current status: In Progress................................Current status: In Progress.................................Current status: In Progress..................................Current status: Accepted...................................Processing complete  id: 22721cbe-4eba-47c2-8cb9-a0033da38e78
[INFO]      [exec]   status: Accepted
[INFO]      [exec]
[INFO]      [exec] Processing: /Users/runner/work/OpenRefine/OpenRefine/packaging/target/openrefine-mac-3.7-beta2.dmg
[INFO]      [exec] Processing: /Users/runner/work/OpenRefine/OpenRefine/packaging/target/openrefine-mac-3.7-beta2.dmg
[INFO]      [exec] The staple and validate action worked!

The codesign utility confirms that it is signed but not notarized correctly, I am not sure why.
user@users-Mac-mini other % codesign --verify --test-requirement="=notarized" -vvv OpenRefine.app
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/bin/rmid
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/bin/rmid
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/bin/jaotc
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/bin/jaotc
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/bin/unpack200
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/bin/unpack200
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/bin/jfr
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/bin/jfr
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/bin/rmiregistry
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/bin/rmiregistry
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/bin/jrunscript
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/bin/jrunscript
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/bin/java
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/bin/java
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/bin/pack200
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/bin/pack200
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/bin/keytool
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/bin/keytool
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/bin/jjs
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/bin/jjs
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/NOTICE
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/NOTICE
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/release
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/release
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libnio.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libnio.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libnet.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libnet.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libinstrument.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libinstrument.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libzip.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libzip.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libfreetype.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libfreetype.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/psfontj2d.properties
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/psfontj2d.properties
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/fontconfig.properties.src
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/fontconfig.properties.src
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libsplashscreen.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libsplashscreen.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libmanagement_ext.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libmanagement_ext.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libjimage.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libjimage.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libj2pkcs11.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libj2pkcs11.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libdt_socket.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libdt_socket.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/jvm.cfg
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/jvm.cfg
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/jli/libjli.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/jli/libjli.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/security/cacerts
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/security/cacerts
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/security/blocked.certs
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/security/blocked.certs
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/security/default.policy
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/security/default.policy
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/security/public_suffix_list.dat
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/security/public_suffix_list.dat
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/jfr/profile.jfc
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/jfr/profile.jfc
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/jfr/default.jfc
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/jfr/default.jfc
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libosxui.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libosxui.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libosxkrb5.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libosxkrb5.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/tzdb.dat
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/tzdb.dat
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libjdwp.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libjdwp.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libmanagement_agent.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libmanagement_agent.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/librmi.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/librmi.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libsunec.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libsunec.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/server/libjsig.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/server/libjsig.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/server/Xusage.txt
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/server/Xusage.txt
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libawt_lwawt.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libawt_lwawt.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/server/libjvm.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/server/libjvm.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libjavajpeg.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libjavajpeg.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libmanagement.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libmanagement.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libjsound.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libjsound.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libj2pcsc.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libj2pcsc.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libmlib_image.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libmlib_image.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libjsig.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libjsig.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libjawt.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libjawt.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libprefs.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libprefs.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libfontmanager.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libfontmanager.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/jrt-fs.jar
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/jrt-fs.jar
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/fontconfig.bfc
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/fontconfig.bfc
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libextnet.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libextnet.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/jspawnhelper
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/jspawnhelper
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libjaas.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libjaas.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libosxsecurity.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libosxsecurity.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libverify.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libverify.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/liblcms.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/liblcms.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/psfont.properties.ja
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/psfont.properties.ja
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libj2gss.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libj2gss.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libjava.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libjava.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/modules
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/modules
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/classlist
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/classlist
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libawt.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libawt.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libunpack.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libunpack.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libosxapp.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libosxapp.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libosx.dylib
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/lib/libosx.dylib
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/logging.properties
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/logging.properties
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/sound.properties
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/sound.properties
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/security/java.policy
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/security/java.policy
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/security/policy/unlimited/default_US_export.policy
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/security/policy/unlimited/default_US_export.policy
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/security/java.security
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/security/java.security
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/security/policy/unlimited/default_local.policy
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/security/policy/unlimited/default_local.policy
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/security/policy/limited/default_US_export.policy
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/security/policy/limited/default_US_export.policy
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/security/policy/README.txt
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/security/policy/README.txt
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/security/policy/limited/exempt_local.policy
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/security/policy/limited/exempt_local.policy
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/security/policy/limited/default_local.policy
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/security/policy/limited/default_local.policy
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/net.properties
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/net.properties
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/management/management.properties
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/management/management.properties
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/management/jmxremote.password.template
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/management/jmxremote.password.template
--prepared:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/management/jmxremote.access
--validated:/Users/user/Downloads/OpenRefine.app/Contents/PlugIns/JRE/Contents/Home/jre/conf/management/jmxremote.access
OpenRefine.app: valid on disk
OpenRefine.app: satisfies its Designated Requirement
test-requirement: code failed to satisfy specified code requirement(s)

@trnstlntk if you have a chance to try out 3.7-beta5, it would be great to know if the signing issue is still present there.

@trnstlntk if you have a chance to try out 3.7-beta5, it would be great to know if the signing issue is still present there.

It looks fixed on my side! 👍 Operating System: MacOS 13.1 Ventura, downloaded and opened beta5 without the need to right-click.

Amazing, thanks for the confirmation!


Seamless-immutable & immutable.js

Seamless immutable is trying to transform an immutable.js object when the state is merged/updated.
Would it be possible to add a condition to not touch any immutable.js objects?

I considered it, but I don't think this makes sense from a design perspective.
I think it's important that the contents of a seamless-immutable value be actually immutable unless there are extremely good reasons for them not to be. The more exceptions to that rule that exist (currently Dates, functions, and React components - all for specific practical reasons that come up very often), the harder debugging gets.
Considering almost everyone either uses Immutable.js or seamless-immutable, not both at once, I don't think this comes up anywhere near enough to justify special-casing.
Thanks for bringing it up though!

In my use case, I'm using both Immutable.js and seamless-immutable, because I'm using Draft.js, which use Immutable.js but in the rest of my application uses seamless-immutable.
I was able to prevent seamless-immutable to change the immutable.js structure by adding a __immutable_invariants_hold property and a asMutable function on my object but this is a very hacky solution.
In a more general case though, what is the best way to add "complex" objects (in opposite of plain objects) in a seamless-immutable structure? I agree an immutable structure should be plain objects only but sometimes I have to put a complex object in there :/

I'm also working with Draft.js and have the same issue!
I wonder if a solution to #142 might be able to accomodate this use case too, via a slight API tweak.


examples?

I have compiled this and see there is an examples directory. Just to test it out, can you tell me how to run the simplest example? i.e. "caffe test model=???"
Edit: I got it working. I followed the directions from here: https://github.com/BVLC/caffe/tree/master/examples/cifar10
and whenever it said to use a .sh file, I opened it in a text editor and followed the steps by hand.

hi,buddy,I use the caffe-windows and come across the problem,too-I don't know how to run the .sh file. It promotes that wget not found, then I install the Cygwin because it can run the shell script on Windows,I got stuck in caffe on windows...


Issue exposing Node HTTP/REST API

I'm trying to expose the node HTTP/REST API port 9200 outside the cluster the same way I expose the dashboards service by pointing the service to a load balancer.  Setup is AWS EKS with aws load balancer controller.
If I set any of these parameters to false, the cluster doesn't deploy:
spec:
  security:
    config:
    tls:
       http:
         generate: true
       transport:
         generate: true
         perNode: true
  general:
    httpPort: 9200
    serviceName: dl-opensearch-1-svc
    version: 2.3.0
    pluginsList: ["repository-s3"]
    drainDataNodes: true

But if I deploy the cluster as is and modify the service to point to the network load balancer (which hosts the TLS certificate) and access the endpoint, the master logs show the following errors:
[2022-12-06T23:09:57,119][ERROR][o.o.s.s.h.n.SecuritySSLNettyHttpServerTransport] [dl-opensearch-1-masters-0] Exception during establishing a SSL connection: io.netty.handler.ssl.NotSslRecordException: not an SSL/TLS record: 474554202f20485454502f312e310d0a486f73743a206f70656e7365617263682d696e67726573732d316135623465623430623038376166352e656c622e75732d656173742d312e616d617a6f6e6177732e636f6d3a393230300d0a436f6e6e656374696f6e3a206b6565702d616c6976650d0a43616368652d436f6e74726f6c3a206d61782d6167653d300d0a7365632d63682d75613a2022476f6f676c65204368726f6d65223b763d22313037222c20224368726f6d69756d223b763d22313037222c20224e6f743d413f4272616e64223b763d223234220d0a7365632d63682d75612d6d6f62696c653a203f300d0a7365632d63682d75612d706c6174666f726d3a202257696e646f7773220d0a557067726164652d496e7365637572652d52657175657374733a20310d0a557365722d4167656e743a204d6f7a696c6c612f352e30202857696e646f7773204e542031302e303b2057696e36343b2078363429204170706c655765624b69742f3533372e333620284b48544d4c2c206c696b65204765636b6f29204368726f6d652f3130372e302e302e30205361666172692f3533372e33360d0a4163636570743a20746578742f68746d6c2c6170706c69636174696f6e2f7868746d6c2b786d6c2c6170706c69636174696f6e2f786d6c3b713d302e392c696d6167652f617669662c696d6167652f776562702c696d6167652f61706e672c2a2f2a3b713d302e382c6170706c69636174696f6e2f7369676e65642d65786368616e67653b763d62333b713d302e390d0a5365632d46657463682d536974653a206e6f6e650d0a5365632d46657463682d4d6f64653a206e617669676174650d0a5365632d46657463682d557365723a203f310d0a5365632d46657463682d446573743a20646f63756d656e740d0a4163636570742d456e636f64696e673a20677a69702c206465666c6174652c2062720d0a4163636570742d4c616e67756167653a20656e2d55532c656e3b713d302e390d0a0d0a
io.netty.handler.ssl.NotSslRecordException: not an SSL/TLS record: 474554202f20485454502f312e310d0a486f73743a206f70656e7365617263682d696e67726573732d316135623465623430623038376166352e656c622e75732d656173742d312e616d617a6f6e6177732e636f6d3a393230300d0a436f6e6e656374696f6e3a206b6565702d616c6976650d0a43616368652d436f6e74726f6c3a206d61782d6167653d300d0a7365632d63682d75613a2022476f6f676c65204368726f6d65223b763d22313037222c20224368726f6d69756d223b763d22313037222c20224e6f743d413f4272616e64223b763d223234220d0a7365632d63682d75612d6d6f62696c653a203f300d0a7365632d63682d75612d706c6174666f726d3a202257696e646f7773220d0a557067726164652d496e7365637572652d52657175657374733a20310d0a557365722d4167656e743a204d6f7a696c6c612f352e30202857696e646f7773204e542031302e303b2057696e36343b2078363429204170706c655765624b69742f3533372e333620284b48544d4c2c206c696b65204765636b6f29204368726f6d652f3130372e302e302e30205361666172692f3533372e33360d0a4163636570743a20746578742f68746d6c2c6170706c69636174696f6e2f7868746d6c2b786d6c2c6170706c69636174696f6e2f786d6c3b713d302e392c696d6167652f617669662c696d6167652f776562702c696d6167652f61706e672c2a2f2a3b713d302e382c6170706c69636174696f6e2f7369676e65642d65786368616e67653b763d62333b713d302e390d0a5365632d46657463682d536974653a206e6f6e650d0a5365632d46657463682d4d6f64653a206e617669676174650d0a5365632d46657463682d557365723a203f310d0a5365632d46657463682d446573743a20646f63756d656e740d0a4163636570742d456e636f64696e673a20677a69702c206465666c6174652c2062720d0a4163636570742d4c616e67756167653a20656e2d55532c656e3b713d302e390d0a0d0a
	at io.netty.handler.ssl.SslHandler.decodeJdkCompatible(SslHandler.java:1215) ~[netty-handler-4.1.79.Final.jar:4.1.79.Final]
	at io.netty.handler.ssl.SslHandler.decode(SslHandler.java:1285) ~[netty-handler-4.1.79.Final.jar:4.1.79.Final]
	at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:510) ~[netty-codec-4.1.79.Final.jar:4.1.79.Final]
	at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:449) ~[netty-codec-4.1.79.Final.jar:4.1.79.Final]
	at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:279) ~[netty-codec-4.1.79.Final.jar:4.1.79.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.79.Final.jar:4.1.79.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.79.Final.jar:4.1.79.Final]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.79.Final.jar:4.1.79.Final]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) [netty-transport-4.1.79.Final.jar:4.1.79.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.79.Final.jar:4.1.79.Final]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.79.Final.jar:4.1.79.Final]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) [netty-transport-4.1.79.Final.jar:4.1.79.Final]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) [netty-transport-4.1.79.Final.jar:4.1.79.Final]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:722) [netty-transport-4.1.79.Final.jar:4.1.79.Final]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:623) [netty-transport-4.1.79.Final.jar:4.1.79.Final]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:586) [netty-transport-4.1.79.Final.jar:4.1.79.Final]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:496) [netty-transport-4.1.79.Final.jar:4.1.79.Final]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) [netty-common-4.1.79.Final.jar:4.1.79.Final]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.79.Final.jar:4.1.79.Final]
	at java.lang.Thread.run(Thread.java:833) [?:?]

It would seem at the very least one should be able to set this to false, but provision the other internal self signed certs.
  security:
    config:
    tls:
       http:
         generate: true

Is there any way to accomplish this?  I was able to do this for the dashboards with no issues:
  dashboards:
    tls:
      enable: false
      generate: false
    version: 2.3.0

Thanks

Hi @jernster. Do I understand correctly that you want to do TLS termination in the AWS loadbalancer and use an unencrypted connection between the loadbalancer and opensearch?
That is not possible with the operator. You cannot disable TLS for opensearch. As such any loadbalancer or ingress you deploy in front of opensearch must always use HTTPS to talk to opensearch.

Hi @swoehrl-mw
It seems the key part of the documentation is this:
Directly exposing the node HTTP port outside the Kubernetes cluster is not recommended. Rather than doing so, you should configure an ingress. The ingress can then also present a certificate from an accredited CA (for example LetsEncrypt) and hide self-signed certificates that are being used internally. In this way, the nodes should be supplied internally with properly signed certificates.
It seems I am doing this by creating the nlb as the ingress.
I don't want to provide my own certificates inside the cluster because it's eks, the host names are unique and can change frequently.  The nlb hosts a certificate with a SAN that I want to represent as the http/rest hostname, and is communicating to opensearch over TLS as shown here:

Ultimately we want to expose the http/rest api so we're able to issue curl commands and such outside of the dashboards, or for apps that might need to communicate with the cluster outside kubernetes.

@jernster Can you please share the (complete) service/ingress definition you are using to expose opensearch along with your opensearch cluster yaml?

I don't want to provide my own certificates inside the cluster because it's eks

That is why the operator can generate self-signed certificates for internal communication so you don't need to provide them. These use the pod names, so are stable. Your own certificate only comes into play at the ingress/Loadbalancer level.

Hi @jernster. I believe you are missing the annotation to tell the loadbalancer to speak https to its pods:
service.beta.kubernetes.io/aws-load-balancer-backend-protocol: https
(as described in the k8s loadbalancer docs).
You might run into another problem if the NLB needs to verify the cert of the pod, but I'm not deep enough into EKS and NLB to know how to configure that (that option is often called along the lines of insecure verification).
Another point: Did you edit the Service object as created by the operator? That is not a good idea as that can be overwritten any time by the operator. Instead you should create your own Service object so it does not get overwritten by the operator.

Hi @swoehrl-mw,
Something like this?  This contains all the modifications I'm making when I edit the service directly - everything else should just be there from when the cluster is provisioned.
FYI the contents below creates a working nlb load balancer which solves the issue which sparked creation of the issue.
apiVersion: v1
kind: Service
metadata:
  annotations:
    service.beta.kubernetes.io/aws-load-balancer-backend-protocol: ssl
    service.beta.kubernetes.io/aws-load-balancer-name: opensearch-ingress
    service.beta.kubernetes.io/aws-load-balancer-nlb-target-type: ip
    service.beta.kubernetes.io/aws-load-balancer-ssl-cert: arn:aws:acm:xxx
    service.beta.kubernetes.io/aws-load-balancer-ssl-ports: "9200"
    service.beta.kubernetes.io/aws-load-balancer-type: external
  name: dl-opensearch-1-svc
  namespace: opensearch
spec:
  type: LoadBalancer

Interestingly it doesn't create any listeners at all, but creates the functionality I need and uses the certificate specified.

The thing with just applying this service manifest (assuming the service is in the state it is after initial deployment) is that the service still needs to be edited to change the ClusterIP to LoadBalancer after it actually completes provisioning.  It adds this part to the service as soon as it's applied the first time, but the type doesn't update on its own automatically, so the service needs to be manually edited, or the manifest needs to be re-applied after the load balancer finishes provisioning.
status:
  loadBalancer:
    ingress:
    - hostname: xxx.amazonaws.com

FYI the contents below creates a working nlb load balancer which solves the issue which sparked creation of the issue.

Good to hear. Can we consider this issue resolved?

The thing with just applying this service manifest [...]

To clarify: You are applying this service manifest over the one created by the operator (which creates a type ClusterIP)?
As I stated before, please use a separate service (e.g. named dl-opensearch-1-lb). That way you are not influenced by what the operator does to its service and because you create it with the correct type in the first place there should be no problems with an incomplete change as you described either.

To clarify: You are applying this service manifest over the one created by the operator (which creates a type ClusterIP)? As I stated before, please use a separate service (e.g. named dl-opensearch-1-lb). That way you are not influenced by what the operator does to its service and because you create it with the correct type in the first place there should be no problems with an incomplete change as you described either.

Would this not create some sort of conflict with the existing service though?
It would essentially duplicate this part:
  ports:
  - name: http
    nodePort: 31921
    port: 9200
    protocol: TCP
    targetPort: 9200


Correlation in cost volume

https://github.com/haofeixu/aanet/blob/f27ec42e3c3c8482d1ca49076ed56b1993aa1028/nets/cost.py#L40-L48
Hi there,
The paper looks great. Thanks for releasing your code! I noticed that in the "correlation" type of cost volume construction, you used the mean of the elementwise product of two feature vectors instead of the traditional dot product, which DispNetC and FlowNet (the original) used. Of course, this is just a scaled version. Can you talk about why you scaled it this way? Thank you!

Hi @jbohnslav ,
Thanks for your interest! Our intuition is that the scaled version can potentially prevent very large values, but the actual difference may be very small.

Thanks! It's certainly easier to read this way, and should hopefully be less dependent on the dimensionality of your input features to the cost volume. Thanks again for the code and paper.

This correlation, if I am right, first appeared in gwcnet
https://github.com/xy-guo/GwcNet/blob/0987074f48b098c6e975a58ca5aacf233b0fb0eb/models/submodule.py#L44-L63
The code is almost the same. Don't know if it's actually the first though, if I'm wrong correct me.

It was already used in PWC-Net (https://arxiv.org/abs/1709.02371) before.


change !cancel to work at any time

at the risk of unintended side effects, allow moderators+ to use cancel at any time, in cases when the command queue gets stuck, same could be done for stop

I've added !skipcommand and I think it covers this request.


create a way to add some additional params to redirect url

Hi! I very like you library for lightweight. But custom auth server in my company wants to have some specific user info form redirect URL. Like deviceId, analytics systems id and other. And i don't see possibility do that with this lib.

Looks good! just some lint errors now

Looks good! just some lint errors now

Fixed :) All green now

👋 @evert, just checking if you have any plans to release a 2.2.4 version of the client with this change anytime soon?

Lets do it!

Done


Supported disk image formats could be updated in the documentation and in the --help option

Hi Keir,
The gw read --help command lists some supported file suffixes that are actually not supported with the read command:
.a2r, .d88, .dcp, .dim, .fdi, .ipf, .td0
And the documentation lists some "write only" disk image formats that the read command does actually support:
.hdm, .xdf, .dsk, .edsk

Yes this has turned into a mess. I also need to update the wiki with all new supported image types.

While (when) at it, how about some documentation about disk formats per physical media type ? This could be useful when having to guess the what format the actual content is.
I'm still working on my "guess-format" shell script, untouched since 25 Oct (and really deserving this version tag):
$VER: gw-guess-format 0.1 Final Edition (yeah, really) Update 4 (25.10.2023)
That script uses a file containing the formats to use for the guessing. I have a "formats-all" which probably is incorrect (because of documentation and --help being incomplete) and a "formats" which contains a limited set of formats I want to try when guessing, simple enough:
amiga.amigados adf amiga.amigados_hd adf mac.400 ima mac.800 ima ibm.720 img ibm.1440 img
Where I have the first part being added to the output filename (to keep it unique) and the second part as file extension.

Fixed the wiki. Not sure about fixing gw read --help, it's a bit of a pain and the command fails early with a clear error message for the few unsupported formats.