Pre-production integration and validation of WMAgent containerization solution

Impact of the new feature
WMAgent
Is your feature request related to a problem? Please describe.
Once we are ready with the required developments, we need to integrate the multiple containers (for databases and WMAgent) and run an integration and pre-production validation.
Describe the solution you'd like
Run pre-production validation of the new WMAgent deployment model based on docker images.
The following checklist is supposed to cover the most common and important features, and each one of these items must be validated.
AT CERN:

[ ] CouchDB manage status/stop/start/restart
[ ] Oracle prompt use manage db-prompt wmagent
[ ] Data persistence - and logs - between CouchDB container restarts
[ ] Proxy renewal setup
[ ] Cronjob setup
[ ] Configuration tweaks for a testbed agent (e.g. Rucio url, MaxRetries)
[ ] Configuration tweaks for a production agent (e.g. Rucio url, MaxRetries)
[ ] Opportunistic resources

in addition to the following workflow-related tests:

[ ] Run a Monte Carlo from scratch
[ ] Run a workflow with pileup data
[ ] Run a ReReco workflow
[ ] Abort a workflow with jobs in condor
[ ] Force complete a workflow with jobs in condor
[ ] Run a workflow that creates Rucio output data placement
[ ] Force JobStatusLite to kill jobs in Condor
[ ] Update a workflow priority and ensure Pending jobs in the condor pool are properly updated as well

then in an agent at CERN:

[ ] Deploy an agent + couchdb + oracle from scratch - and run 1 workflow
[ ] Restart the agent container - and run another workflow
[ ] Restart CouchDB container - and run another workflow
[ ] Restart the whole node while containers are running and see how resilient the system is
[ ] Create a patch tag at the WMCore repository, build the new Docker image, upload it to CERN registry and then redeploy on the previously running agent. A re-initialization process from scratch must NOT start if the new tag is a patch version or a release candidate.

AT FNAL:

[ ] CouchDB manage status/stop/start/restart
[ ] MariaDB manage status/stop/start/restart
[ ] MariaDB prompt use manage db-prompt wmagent
[ ] Data persistence - and logs - between CouchDB container restarts
[ ] Data persistence - and logs - between MariaDB container restarts
[ ] Proxy renewal setup
[ ] Cronjob setup
[ ] Configuration tweaks for a testbed agent (e.g. Rucio url, MaxRetries)
[ ] Configuration tweaks for a production agent (e.g. Rucio url, MaxRetries)
[ ] Opportunistic resources

in addition to the following workflow-related tests:

[ ] Run a Monte Carlo from scratch
[ ] Run a workflow with pileup data
[ ] Run a ReReco workflow
[ ] Abort a workflow with jobs in condor
[ ] Force complete a workflow with jobs in condor
[ ] Run a workflow that creates Rucio output data placement
[ ] Force JobStatusLite to kill jobs in Condor
[ ] Update a workflow priority and ensure Pending jobs in the condor pool are properly updated as well

lastly, in a Fermilab agent:

[ ] Deploy an agent + couchdb + mariadb from scratch - and run 1 workflow
[ ] Restart the agent container - and run another workflow
[ ] Restart CouchDB container - and run another workflow
[ ] Restart MariaDB container - and run another workflow
[ ] Restart the whole node while containers are running and see how resilient the system is (probably not possible at FNAL)
[ ] - [ ] Create a patch tag at the WMCore repository, build the new Docker image, upload it to CERN registry and then redeploy on the previously running agent. A re-initialization process from scratch must NOT start if the new tag is a patch version or a release candidate.

NOTE that all these tests need to be performed with an official image uploaded to CERN registry, once we have identified a stable image to perform such tests.
Describe alternatives you've considered
We can request the T0 team to run Tier0 related validations as well.
Additional context
Sub-task for this meta issue: https://github.com/dmwm/WMCore/issues/11314

For clarification and future reference, the plan is that @todor-ivanov will work on the CERN side, and me on the FNAL one.

@todor-ivanov @anpicci I have updated the original description of this issue and made a check list of everything that needs to be considered during this evaluation phase. Please let me know if anything needs further clarification; likewise, if you see important tests that are not in the checklist, please add them.
Note that we are not yet ready to start this validation, as there has been changes made this week and a few others are still under development.

@amaltaro thanks! I am currently working on the last 4 points in the list you provided, have you had the chance to look at the error I am getting when injecting a workflow?

@anpicci thanks for looking into those. However, I do think we will have to repeat those tests in the next days, as there has been many changes involving the containers in the last days (and a few more coming up really soon).
About the USER error, I will give the other FNAL node a try as well. But as we are discussing on mattermost, it's strange that it only happens in the FNAL node.

Hi @amaltaro, I know that we aren't already at a point where we can run the final tests, but I started to play a bit with them for my education.
For CouchDB, I see that the manage stop has no real effect on the database. I have tried nevertheless to run manage status and manage restart, and I am reporting what I get in both cases:
manage status
3.2.2 is RUNNING
[{"node":"nonode@nohost","pid":"<0.13653.381>","process_status":"waiting","changes_pending":0,"checkpoint_interval":120000,"checkpointed_source_seq":"27-g1AAAACLeJzLYWBgYMpgTmHgzcvPy09JdcjLz8gvLskBCScyJNX___8_K4M5kT0XKMCemGyamGqciq4Yh_Y8FiDJ0ACk_kNNEQGbkmZskppmaISuJwsAen0rJw","continuous":true,"database":"shards/80000000-ffffffff/_replicator.1715183192","doc_id":"a305436349958fbda15e56711d87ba36","doc_write_failures":0,"docs_read":16,"docs_written":16,"missing_revisions_found":16,"replication_id":"1f8e8cac41eb6149332bbbd1225b6b65+continuous","revisions_checked":16,"source":"http://<IP_ADDRESS>:5984/wmagent_summary/","source_seq":"27-g1AAAACLeJzLYWBgYMpgTmHgzcvPy09JdcjLz8gvLskBCScyJNX___8_K4M5kT0XKMCemGyamGqciq4Yh_Y8FiDJ0ACk_kNNEQGbkmZskppmaISuJwsAen0rJw","started_on":1716238328,"target":"https://cmsweb-testbed.cern.ch/couchdb/wmstats/","through_seq":"27-g1AAAACLeJzLYWBgYMpgTmHgzcvPy09JdcjLz8gvLskBCScyJNX___8_K4M5kT0XKMCemGyamGqciq4Yh_Y8FiDJ0ACk_kNNEQGbkmZskppmaISuJwsAen0rJw","type":"replication","updated_on":1716368304,"user":null},{"node":"nonode@nohost","pid":"<0.14469.381>","process_status":"waiting","changes_pending":0,"checkpoint_interval":120000,"checkpointed_source_seq":"228-g1AAAACLeJzLYWBgYMpgTmHgzcvPy09JdcjLz8gvLskBCScyJNX___8_K4M5MSAXKMCelJRoamhkjq4Yh_Y8FiDJ0ACk_kNNmQI2xdwyKcXSOAVdTxYAg-QrmA","continuous":true,"database":"shards/00000000-7fffffff/_replicator.1715183192","doc_id":"a305436349958fbda15e56711d87d0e6","doc_write_failures":0,"docs_read":185,"docs_written":185,"missing_revisions_found":185,"replication_id":"326d9d2c703ae43767df3bb3b05b91fa+continuous","revisions_checked":203,"source":"http://<IP_ADDRESS>:5984/workqueue_inbox/","source_seq":"228-g1AAAACLeJzLYWBgYMpgTmHgzcvPy09JdcjLz8gvLskBCScyJNX___8_K4M5MSAXKMCelJRoamhkjq4Yh_Y8FiDJ0ACk_kNNmQI2xdwyKcXSOAVdTxYAg-QrmA","started_on":1716238325,"target":"https://cmsweb-testbed.cern.ch/couchdb/workqueue/","through_seq":"228-g1AAAACLeJzLYWBgYMpgTmHgzcvPy09JdcjLz8gvLskBCScyJNX___8_K4M5MSAXKMCelJRoamhkjq4Yh_Y8FiDJ0ACk_kNNmQI2xdwyKcXSOAVdTxYAg-QrmA","type":"replication","updated_on":1716368248,"user":null},{"node":"nonode@nohost","pid":"<0.3163.415>","process_status":"waiting","changes_pending":0,"checkpoint_interval":120000,"checkpointed_source_seq":"144168-g1AAAACheJzLYWBgYMpgTmEQTM4vTc5ISXIwNDLXMwBCwxyQVCJDUv3___-zMpiTGBi6j-QCxdhNEs3TzCxMsenBY1IeC5BkaABS_2EGMi5PARtonJJkYJJkhk1rFgBY4Sqt","continuous":true,"database":"shards/80000000-ffffffff/_replicator.1715183192","doc_id":"a305436349958fbda15e56711d87c6e6","doc_write_failures":0,"docs_read":18,"docs_written":18,"missing_revisions_found":18,"replication_id":"28c6915117e0403ca970b050ed2feb37+continuous","revisions_checked":203,"source":"https://cmsweb-testbed.cern.ch/couchdb/workqueue/","source_seq":"144168-g1AAAACheJzLYWBgYMpgTmEQTM4vTc5ISXIwNDLXMwBCwxyQVCJDUv3___-zMpiTGBi6j-QCxdhNEs3TzCxMsenBY1IeC5BkaABS_2EGMi5PARtonJJkYJJkhk1rFgBY4Sqt","started_on":1716323218,"target":"http://<IP_ADDRESS>:5984/workqueue_inbox/","through_seq":"144168-g1AAAACheJzLYWBgYMpgTmEQTM4vTc5ISXIwNDLXMwBCwxyQVCJDUv3___-zMpiTGBi6j-QCxdhNEs3TzCxMsenBY1IeC5BkaABS_2EGMi5PARtonJJkYJJkhk1rFgBY4Sqt","type":"replication","updated_on":1716368259,"user":null}]
Replication 'id=a305436349958fbda15e56711d87ba36 source=http://cmsdataops:Someslc7Senha@<IP_ADDRESS>:5984/wmagent_summary target=https://cmsweb-testbed.cern.ch/couchdb/wmstats filter=WMStatsAgent/repfilter' unknown.
Replication 'id=a305436349958fbda15e56711d87c6e6 source=https://cmsweb-testbed.cern.ch/couchdb/workqueue target=http://cmsdataops:Someslc7Senha@<IP_ADDRESS>:5984/workqueue_inbox filter=WorkQueue/queueFilter' unknown.
Replication 'id=a305436349958fbda15e56711d87d0e6 source=http://cmsdataops:Someslc7Senha@<IP_ADDRESS>:5984/workqueue_inbox target=https://cmsweb-testbed.cern.ch/couchdb/workqueue filter=WorkQueue/queueFilter' unknown.

manage restart
Stopping CouchDB service...
Which couchdb: /opt/couchdb/bin/couchdb
  With configuration directory: /data/srv/couchdb/3.2.2/config
  With logdir: /data/srv/couchdb/3.2.2/logs
  nohup couchdb -couch_ini /data/srv/couchdb/3.2.2/config >> /data/srv/couchdb/3.2.2/logs/couch.log 2>&1 &
(CouchDB-3.2.2) [cmsdataops@cmssrv810:data]$ manage status
3.2.2 is RUNNING
[{"node":"nonode@nohost","pid":"<0.13653.381>","process_status":"waiting","changes_pending":0,"checkpoint_interval":120000,"checkpointed_source_seq":"27-g1AAAACLeJzLYWBgYMpgTmHgzcvPy09JdcjLz8gvLskBCScyJNX___8_K4M5kT0XKMCemGyamGqciq4Yh_Y8FiDJ0ACk_kNNEQGbkmZskppmaISuJwsAen0rJw","continuous":true,"database":"shards/80000000-ffffffff/_replicator.1715183192","doc_id":"a305436349958fbda15e56711d87ba36","doc_write_failures":0,"docs_read":16,"docs_written":16,"missing_revisions_found":16,"replication_id":"1f8e8cac41eb6149332bbbd1225b6b65+continuous","revisions_checked":16,"source":"http://<IP_ADDRESS>:5984/wmagent_summary/","source_seq":"27-g1AAAACLeJzLYWBgYMpgTmHgzcvPy09JdcjLz8gvLskBCScyJNX___8_K4M5kT0XKMCemGyamGqciq4Yh_Y8FiDJ0ACk_kNNEQGbkmZskppmaISuJwsAen0rJw","started_on":1716238328,"target":"https://cmsweb-testbed.cern.ch/couchdb/wmstats/","through_seq":"27-g1AAAACLeJzLYWBgYMpgTmHgzcvPy09JdcjLz8gvLskBCScyJNX___8_K4M5kT0XKMCemGyamGqciq4Yh_Y8FiDJ0ACk_kNNEQGbkmZskppmaISuJwsAen0rJw","type":"replication","updated_on":1716368424,"user":null},{"node":"nonode@nohost","pid":"<0.14469.381>","process_status":"waiting","changes_pending":0,"checkpoint_interval":120000,"checkpointed_source_seq":"228-g1AAAACLeJzLYWBgYMpgTmHgzcvPy09JdcjLz8gvLskBCScyJNX___8_K4M5MSAXKMCelJRoamhkjq4Yh_Y8FiDJ0ACk_kNNmQI2xdwyKcXSOAVdTxYAg-QrmA","continuous":true,"database":"shards/00000000-7fffffff/_replicator.1715183192","doc_id":"a305436349958fbda15e56711d87d0e6","doc_write_failures":0,"docs_read":185,"docs_written":185,"missing_revisions_found":185,"replication_id":"326d9d2c703ae43767df3bb3b05b91fa+continuous","revisions_checked":203,"source":"http://<IP_ADDRESS>:5984/workqueue_inbox/","source_seq":"228-g1AAAACLeJzLYWBgYMpgTmHgzcvPy09JdcjLz8gvLskBCScyJNX___8_K4M5MSAXKMCelJRoamhkjq4Yh_Y8FiDJ0ACk_kNNmQI2xdwyKcXSOAVdTxYAg-QrmA","started_on":1716238325,"target":"https://cmsweb-testbed.cern.ch/couchdb/workqueue/","through_seq":"228-g1AAAACLeJzLYWBgYMpgTmHgzcvPy09JdcjLz8gvLskBCScyJNX___8_K4M5MSAXKMCelJRoamhkjq4Yh_Y8FiDJ0ACk_kNNmQI2xdwyKcXSOAVdTxYAg-QrmA","type":"replication","updated_on":1716368368,"user":null},{"node":"nonode@nohost","pid":"<0.3163.415>","process_status":"waiting","changes_pending":0,"checkpoint_interval":120000,"checkpointed_source_seq":"144170-g1AAAACheJzLYWBgYMpgTmEQTM4vTc5ISXIwNDLXMwBCwxyQVCJDUv3___-zMpiTGBi6j-YCxdhNEs3TzCxMsenBY1IeC5BkaABS_2EGMi5PBRtonJJkYJJkhk1rFgBZdiqv","continuous":true,"database":"shards/80000000-ffffffff/_replicator.1715183192","doc_id":"a305436349958fbda15e56711d87c6e6","doc_write_failures":0,"docs_read":18,"docs_written":18,"missing_revisions_found":18,"replication_id":"28c6915117e0403ca970b050ed2feb37+continuous","revisions_checked":203,"source":"https://cmsweb-testbed.cern.ch/couchdb/workqueue/","source_seq":"144170-g1AAAACheJzLYWBgYMpgTmEQTM4vTc5ISXIwNDLXMwBCwxyQVCJDUv3___-zMpiTGBi6j-YCxdhNEs3TzCxMsenBY1IeC5BkaABS_2EGMi5PBRtonJJkYJJkhk1rFgBZdiqv","started_on":1716323218,"target":"http://<IP_ADDRESS>:5984/workqueue_inbox/","through_seq":"144170-g1AAAACheJzLYWBgYMpgTmEQTM4vTc5ISXIwNDLXMwBCwxyQVCJDUv3___-zMpiTGBi6j-YCxdhNEs3TzCxMsenBY1IeC5BkaABS_2EGMi5PBRtonJJkYJJkhk1rFgBZdiqv","type":"replication","updated_on":1716368380,"user":null}]
Replication 'id=a305436349958fbda15e56711d87ba36 source=http://cmsdataops:Someslc7Senha@<IP_ADDRESS>:5984/wmagent_summary target=https://cmsweb-testbed.cern.ch/couchdb/wmstats filter=WMStatsAgent/repfilter' unknown.
Replication 'id=a305436349958fbda15e56711d87c6e6 source=https://cmsweb-testbed.cern.ch/couchdb/workqueue target=http://cmsdataops:Someslc7Senha@<IP_ADDRESS>:5984/workqueue_inbox filter=WorkQueue/queueFilter' unknown.
Replication 'id=a305436349958fbda15e56711d87d0e6 source=http://cmsdataops:Someslc7Senha@<IP_ADDRESS>:5984/workqueue_inbox target=https://cmsweb-testbed.cern.ch/couchdb/workqueue filter=WorkQueue/queueFilter' unknown.
(CouchDB-3.2.2) [cmsdataops@cmssrv810:data]$ manage stop
Stopping CouchDB service...

What I read in the CouchDB elog
[info] 2024-05-22T09:12:04.901281Z nonode@nohost <0.31383.450> -------- Starting index update for db: shards/80000000-ffffffff/workqueue.1715183197 idx: _design/WorkQueue
[info] 2024-05-22T09:12:04.967377Z nonode@nohost <0.31383.450> -------- Index update finished for db: shards/80000000-ffffffff/workqueue.1715183197 idx: _design/WorkQueue
[notice] 2024-05-22T09:12:22.035233Z nonode@nohost <0.17303.402> 236a03a418 <IP_ADDRESS>:5984 <IP_ADDRESS> cmsdataops GET /workqueue_inbox/_changes?filter=WorkQueue%2FqueueFilter&parentUrl=https%3A%2F%2Fcmsweb-testbed.cern.ch%2Fcouchdb%2Fworkqueue&childUrl=http%3A%2F%2Fcmssrv810.fnal.gov%3A5984&feed=continuous&style=all_docs&since=%22228-g1AAAACLeJzLYWBgYMpgTmHgzcvPy09JdcjLz8gvLskBCScyJNX___8_K4M5MSAXKMCelJRoamhkjq4Yh_Y8FiDJ0ACk_kNNmQI2xdwyKcXSOAVdTxYAg-QrmA%22&timeout=300000 200 ok 300004
[notice] 2024-05-22T09:12:34.413893Z nonode@nohost <0.9612.451> 297a8a217b <IP_ADDRESS>:5984 <IP_ADDRESS> undefined POST /_session 200 ok 3
[notice] 2024-05-22T09:12:34.415280Z nonode@nohost <0.9612.451> 7db9c3d007 <IP_ADDRESS>:5984 <IP_ADDRESS> cmsdataops GET /workqueue_inbox/ 200 ok 1
[notice] 2024-05-22T09:12:34.417921Z nonode@nohost <0.9612.451> b95a24c766 <IP_ADDRESS>:5984 <IP_ADDRESS> cmsdataops GET /workqueue_inbox/_design/WorkQueue 200 ok 2
[notice] 2024-05-22T09:12:37.013854Z nonode@nohost <0.9612.451> db20f6e965 <IP_ADDRESS>:5984 <IP_ADDRESS> undefined POST /_session 200 ok 1
[notice] 2024-05-22T09:12:37.015289Z nonode@nohost <0.9612.451> e8c86cc2d5 <IP_ADDRESS>:5984 <IP_ADDRESS> cmsdataops GET /wmagent_summary/ 200 ok 1
[notice] 2024-05-22T09:12:37.016550Z nonode@nohost <0.9612.451> 05095ccba5 <IP_ADDRESS>:5984 <IP_ADDRESS> cmsdataops GET /wmagent_summary/_design/WMStatsAgent 200 ok 1
[info] 2024-05-22T09:13:04.831266Z nonode@nohost <0.249.0> -------- Preflight check: Checking For Monsters

[info] 2024-05-22T09:13:04.833432Z nonode@nohost <0.249.0> -------- Preflight check: Asserting Admin Account

[info] 2024-05-22T09:13:04.836510Z nonode@nohost <0.249.0> -------- Apache CouchDB 3.2.2 is starting.

[info] 2024-05-22T09:13:04.836584Z nonode@nohost <0.250.0> -------- Starting couch_sup
Failure to start Mochiweb: eaddrinuse
[error] 2024-05-22T09:13:04.897103Z nonode@nohost <0.339.0> -------- CRASH REPORT Process  (<0.339.0>) with 0 neighbors exited with reason: eaddrinuse at gen_server:init_it/6(line:401) <= proc_lib:init_p_do_apply/3(line:226); initial_call: {mochiweb_socket_server,init,['Argument__1']}, ancestors: [couch_secondary_services,couch_sup,<0.249.0>], message_queue_len: 0, links: [<0.326.0>], dictionary: [], trap_exit: true, status: running, heap_size: 6772, stack_size: 28, reductions: 42868
[error] 2024-05-22T09:13:04.897289Z nonode@nohost <0.339.0> -------- CRASH REPORT Process  (<0.339.0>) with 0 neighbors exited with reason: eaddrinuse at gen_server:init_it/6(line:401) <= proc_lib:init_p_do_apply/3(line:226); initial_call: {mochiweb_socket_server,init,['Argument__1']}, ancestors: [couch_secondary_services,couch_sup,<0.249.0>], message_queue_len: 0, links: [<0.326.0>], dictionary: [], trap_exit: true, status: running, heap_size: 6772, stack_size: 28, reductions: 42868
[error] 2024-05-22T09:13:04.897372Z nonode@nohost <0.326.0> -------- Supervisor couch_secondary_services had child httpsd started with chttpd:start_link(https) at undefined exit with reason eaddrinuse in context start_error
[error] 2024-05-22T09:13:04.897462Z nonode@nohost <0.326.0> -------- Supervisor couch_secondary_services had child httpsd started with chttpd:start_link(https) at undefined exit with reason eaddrinuse in context start_error
[error] 2024-05-22T09:13:04.898683Z nonode@nohost <0.250.0> -------- Supervisor couch_sup had child couch_secondary_services started with couch_secondary_sup:start_link() at undefined exit with reason {shutdown,{failed_to_start_child,httpsd,eaddrinuse}} in context start_error
[error] 2024-05-22T09:13:04.898965Z nonode@nohost <0.250.0> -------- Supervisor couch_sup had child couch_secondary_services started with couch_secondary_sup:start_link() at undefined exit with reason {shutdown,{failed_to_start_child,httpsd,eaddrinuse}} in context start_error
[error] 2024-05-22T09:13:04.899907Z nonode@nohost <0.249.0> -------- Error starting Apache CouchDB:

    {error,{shutdown,{failed_to_start_child,couch_secondary_services,{shutdown,{failed_to_start_child,httpsd,eaddrinuse}}}}}

[error] 2024-05-22T09:13:04.900245Z nonode@nohost <0.248.0> -------- CRASH REPORT Process  (<0.248.0>) with 0 neighbors exited with reason: {{shutdown,{failed_to_start_child,couch_secondary_services,{shutdown,{failed_to_start_child,httpsd,eaddrinuse}}}},{couch_app,start,[normal,[]]}} at application_master:init/4(line:138) <= proc_lib:init_p_do_apply/3(line:226); initial_call: {application_master,init,['Argument__1','Argument__2',...]}, ancestors: [<0.247.0>], message_queue_len: 1, links: [<0.247.0>,<0.16.0>], dictionary: [], trap_exit: true, status: running, heap_size: 610, stack_size: 28, reductions: 220
[error] 2024-05-22T09:13:04.900371Z nonode@nohost <0.248.0> -------- CRASH REPORT Process  (<0.248.0>) with 0 neighbors exited with reason: {{shutdown,{failed_to_start_child,couch_secondary_services,{shutdown,{failed_to_start_child,httpsd,eaddrinuse}}}},{couch_app,start,[normal,[]]}} at application_master:init/4(line:138) <= proc_lib:init_p_do_apply/3(line:226); initial_call: {application_master,init,['Argument__1','Argument__2',...]}, ancestors: [<0.247.0>], message_queue_len: 1, links: [<0.247.0>,<0.16.0>], dictionary: [], trap_exit: true, status: running, heap_size: 610, stack_size: 28, reductions: 220
[info] 2024-05-22T09:13:04.900449Z nonode@nohost <0.16.0> -------- Application couch exited with reason: {{shutdown,{failed_to_start_child,couch_secondary_services,{shutdown,{failed_to_start_child,httpsd,eaddrinuse}}}},{couch_app,start,[normal,[]]}}
[info] 2024-05-22T09:13:04.900511Z nonode@nohost <0.16.0> -------- Application couch exited with reason: {{shutdown,{failed_to_start_child,couch_secondary_services,{shutdown,{failed_to_start_child,httpsd,eaddrinuse}}}},{couch_app,start,[normal,[]]}}
{"Kernel pid terminated",application_controller,"{application_start_failure,couch,{{shutdown,{failed_to_start_child,couch_secondary_services,{shutdown,{failed_to_start_child,httpsd,eaddrinuse}}}},{couch_app,start,[normal,[]]}}}"}
Kernel pid terminated (application_controller) ({application_start_failure,couch,{{shutdown,{failed_to_start_child,couch_secondary_services,{shutdown,{failed_to_start_child,httpsd,eaddrinuse}}}},{couc

Crash dump is being written to: erl_crash.dump...[notice] 2024-05-22T09:13:09.008233Z nonode@nohost <0.9923.451> 6e221510ae <IP_ADDRESS>:5984 <IP_ADDRESS> cmsdataops GET /workqueue/_design/WorkQueue/_view/elementsDetailByWorkflowAndStatus?reduce=false&stale=update_after 200 ok 3
[notice] 2024-05-22T09:13:27.178022Z nonode@nohost <0.9272.436> bf96027783 <IP_ADDRESS>:5984 <IP_ADDRESS> cmsdataops GET /wmagent_summary/_changes?filter=WMStatsAgent%2Frepfilter&feed=continuous&style=all_docs&since=%2227-g1AAAACLeJzLYWBgYMpgTmHgzcvPy09JdcjLz8gvLskBCScyJNX___8_K4M5kT0XKMCemGyamGqciq4Yh_Y8FiDJ0ACk_kNNEQGbkmZskppmaISuJwsAen0rJw%22&timeout=300000 200 ok 300003
[notice] 2024-05-22T09:13:35.421756Z nonode@nohost <0.9612.451> 06b1fb622d <IP_ADDRESS>:5984 <IP_ADDRESS> undefined POST /_session 200 ok 1
[notice] 2024-05-22T09:13:35.423044Z nonode@nohost <0.9612.451> 6d5d2a3f69 <IP_ADDRESS>:5984 <IP_ADDRESS> cmsdataops GET /workqueue_inbox/ 200 ok 1
[notice] 2024-05-22T09:13:35.425577Z nonode@nohost <0.9612.451> de6e5e51bc <IP_ADDRESS>:5984 <IP_ADDRESS> cmsdataops GET /workqueue_inbox/_design/WorkQueue 200 ok 2

When restarting CouchDB, it seems like there is a crash. Is it relevant for us?

Thanks for reporting this, @anpicci . This issue has been fixed yesterday or the day before, but the image is yet to be recreated. We have other changes in the pipeline, so I am waiting for those to be ready/reviewed before building a new image.

We have covered all of the items in the check-list, other than the cron setup, which is being addressed/tested with https://github.com/dmwm/WMCore/issues/12000
Thanks to Andrea and everyone else who helped with this validation!


Re-implemented texture action for scene import

Removed dud "Shared" option and added option to import textures to the same folder as the source, or to just use them without importing (flags may need to be applied manually).
I did this so that I can have blender models and textures living directly within the project tree, simplifying my asset pipeline.
Preview of the UI change:

Actually, should I undo the second commit so that it can be backported to the 2.1 branch?

Deleted so that I can rework this PR for the 2.1 branch.


Implement favourite, unfavourite and listFavourite Command

Favourite and unfavourite companies

View favourited companies

Closed by #137.


RangeError (index): Invalid value: Not in inclusive range 0..59: 88

I am receiving the following error:
[VERBOSE-2:dart_vm_initializer.cc(41)] Unhandled Exception: RangeError (index): Invalid value: Not in inclusive range 0..59: 88
#0      List.[] (dart:core-patch/growable_array.dart:264:36)
#1      GifController._runNextFrame (package:gif_view/src/gif_controller.dart:46:33)
#2      GifController._run (package:gif_view/src/gif_controller.dart:33:9)
#3      GifController.play (package:gif_view/src/gif_controller.dart:94:7)
#4      GifController.configure (package:gif_view/src/gif_controller.dart:119:9)
#5      GifViewState._loadImage (package:gif_view/gif_view.dart:272:18)
<asynchronous suspension>

The following RangeError was thrown building GifView(dirty, state: GifViewState#e8d50(tickers:
tracking 1 ticker)):
RangeError (index): Invalid value: Not in inclusive range 0..59: 88

The relevant error-causing widget was:
  GifView
  GifView:file:///Users/daverin/Simulon/simulon-app/lib/ui/zen/components/zen_capture_guide/dialogs/giff_dialog.dart:102:44

When the exception was thrown, this was the stack:
#0      List.[] (dart:core-patch/growable_array.dart:264:36)
growable_array.dart:264
#1      GifController.currentFrame (package:gif_view/src/gif_controller.dart:71:39)
gif_controller.dart:71
#2      GifViewState.build (package:gif_view/gif_view.dart:213:25)
gif_view.dart:213
#3      StatefulElement.build (package:flutter/src/widgets/framework.dart:5409:27)
framework.dart:5409
#4      ComponentElement.performRebuild (package:flutter/src/widgets/framework.dart:5297:15)
framework.dart:5297
#5      StatefulElement.performRebuild (package:flutter/src/widgets/framework.dart:5462:11)
framework.dart:5462
#6      Element.rebuild (package:flutter/src/widgets/framework.dart:5016:7)
framework.dart:5016
#7      BuildOwner.buildScope (package:flutter/src/widgets/framework.dart:2779:19)
framework.dart:2779
#8      WidgetsBinding.drawFrame (package:flutter/src/widgets/binding.dart:916:21)
binding.dart:916
#9      RendererBinding._handlePersistentFrameCallback (package:flutter/src/rendering/binding.dart:360:5)
binding.dart:360
#10     SchedulerBinding._invokeFrameCallback (package:flutter/src/scheduler/binding.dart:1297:15)
binding.dart:1297
#11     SchedulerBinding.handleDrawFrame (package:flutter/src/scheduler/binding.dart:1227:9)
binding.dart:1227
#12     SchedulerBinding._handleDrawFrame (package:flutter/src/scheduler/binding.dart:1085:5)
binding.dart:1085
#13     _invoke (dart:ui/hooks.dart:170:13)
hooks.dart:170
#14     PlatformDispatcher._drawFrame (dart:ui/platform_dispatcher.dart:401:5)
platform_dispatcher.dart:401
#15     _drawFrame (dart:ui/hooks.dart:140:31)
hooks.dart:140

await showModal(
  context: context,
  configuration: const FadeScaleTransitionConfiguration(
    transitionDuration:
        AnimationConstants.lightCaptureDrawerOpenClose,
    reverseTransitionDuration:
        AnimationConstants.standardZenDuration,
  ),
  builder: (context) => GuideDialog(
        dialogPage: GiffDialog(
          gif: 'assets/gifs/walk_up.gif',
          title: 'Stand near action area',
          body:
              'Position yourself near the area where you plan to add 3D assets.',
          actionFunction: (dialogContext) {
            DialogNavigator.of(dialogContext).push(
              FluidDialogPage(
                builder: (_) => GiffDialog(
                  gif: 'assets/gifs/exposure_calibration.gif',
                  title: 'Set the exposure',
                  body:
                      'Calibrate your camera\'s exposure by aiming at the brightest area.',
                  actionFunction: (innerDialogContext) {
                    ref
                        .read(
                            cubeCaptureStateProvider.notifier)
                        .startUIDelay();
                    ref
                        .read(workspaceStateProvider.notifier)
                        .guideStandingInCentreNextStep();
                    Navigator.pop(context);
                  },
                  actionText: 'Got it',
                ),
              ),
            );
          },
          actionText: 'I\'m here',
        ),
      ));

The error is not consistent.  It seems to be mixing up the gif data of different widgets. The 0..59 range it references belongs to the assets/gifs/exposure_calibration.gif yet this is being thrown when displaying  assets/gifs/walk_up.gif.

Facing a similar issue, has a solution been found?

Error is still there, sir. but it doesn't show a red screen for the error, just a gif-sized blank and grayed out. logcat does not display any error messages.
"How can I use a global widget to access a different asset path in gif_view?"
the question generates an error condition as described earlier

Facing a similar issue, has a solution been found?


Do not use a Symfony Form to delete an article

Because it's simpler without a SF Form

@lyrixx thanks for simplifying this feature!


Add beneficiary VASP ID and originating VASP ID to transaction request

The demo UI requires the user to select an originating and beneficiary VASP. It would be nice to pass these along and have basic validation done:

assert the originating vasp is the RVASP receiving the transaction request
assert the originating wallet is hosted on the originating vasp
ensure the beneficiary wallet is hosted on the beneficiary vasp

Original issue: https://github.com/bbengfort/rvasp/issues/2

@ayyoitsp - right now if the account field isn't a wallet or email address for the originating VASP you should already get an error. I will add the originating VASP ID - but that feels a little redundant.
As for the beneficiary address - I've also added that to direct the rVASP where to send the request to, however for the verification part - don't we want to enable the TRISA error where the request is sent to the wrong VASP? I think that could be interesting for demo purposes.


add projection definition as WKT to json used to seed the grid table …

…in IWDS
projection definitions were gathered from ARD for HI, AK, and CU using gdal's gdalsrsinfo utility

Do you think we should do anything with lcmap-chipmunk/test/resources/grid.fixture.edn?
(idk)

@davidvhill its not being used. I'd be happy to remove it. just say the word, and I can make it part of this PR

@davidvhill that previous comment is incorrect. those edn files under /test are being used. I thought you were talking about the edn files under /resources at the top level
https://github.com/USGS-EROS/lcmap-chipmunk/blob/develop/resources/grid.conus.edn


Add mail notification for csv-vpts generation failures

[ ] if transfer of daily/monthly fails (raising exception) -> ALERT implemented by @TheJenne18
[ ] If transfer does not find any files to add to bucket, @stijnvanhoey pushes this to SNS-topic on which @TheJenne18 can setup a alert for this incoming message.


A problem in .include directive in a configuration file.

Hi, try the following commands.
$ touch a.cnf
$ mkdir sub1 && cd $_
$ echo ".include ../a.cnf" > b.cnf
$ mkdir sub2 && cd $_
$ echo ".include ../b.cnf" > c.cnf
$ openssl ca -config ./c.cnf
      (Error messages like the next)
$ openssl ca -config ../b.cnf
Using configuration from ../b.cnf
variable lookup failed for ca::default_ca
4007E9D4017F0000:error:80000002:system library:process_include:No such file or directory:../crypto/conf/conf_def.c:822:calling stat(../a.cnf)
4007E9D4017F0000:error:0700006C:configuration file routines:NCONF_get_string:no value:../crypto/conf/conf_lib.c:315:group=ca name=default_ca

../a.cnf can't be found.
Version: OpenSSL 3.0.15 3 Sep 2024 (Library: OpenSSL 3.0.15 3 Sep 2024)

I'm sorry, I forgot the following error message.
Using configuration from ../b.cnf
variable lookup failed for ca::default_ca
40072D1FAA7F0000:error:80000002:system library:process_include:No such file or directory:../crypto/conf/conf_def.c:822:calling stat(../a.cnf)
40072D1FAA7F0000:error:0700006C:configuration file routines:NCONF_get_string:no value:../crypto/conf/conf_lib.c:315:group=ca name=default_ca

I'm sorry, I forgot the following error message.
Using configuration from ../b.cnf
variable lookup failed for ca::default_ca
40072D1FAA7F0000:error:80000002:system library:process_include:No such file or directory:../crypto/conf/conf_def.c:822:calling stat(../a.cnf)
40072D1FAA7F0000:error:0700006C:configuration file routines:NCONF_get_string:no value:../crypto/conf/conf_lib.c:315:group=ca name=default_ca

Thank you very much.
My study was not enough.


seq_along supported in DSL but not documented

It looks like we can use seq_along (but not seq_len) in run code, but I don't think we document this.
I will add to manual. @perrydv let me know of anything I should know that I might not ;)

done for 0.6-11 manual


gcloud doesn't install on ARM

I tried to install on a BeagleBone Green
npm WARN package.json<EMAIL_ADDRESS>No repository field.
npm WARN package.json<EMAIL_ADDRESS>No README data
npm WARN package.json<EMAIL_ADDRESS>license should be a valid SPDX license expression

><EMAIL_ADDRESS>install /root/client/node_modules/gcloud/node_modules/hash-stream-validation/node_modules/fast-crc32c/node_modules/sse4_crc32
> node-gyp rebuild

gyp ERR! configure error
 stack Error: EACCES, mkdir '/root/client/node_modules/gcloud/node_modules/hash-stream-validation/node_modules/fast-crc32c/node_modules/sse4_crc32/build'
gyp ERR! System Linux 3.8.13-bone71.1
gyp ERR! command "nodejs" "/usr/bin/node-gyp" "rebuild"
gyp ERR! cwd /root/client/node_modules/gcloud/node_modules/hash-stream-validation/node_modules/fast-crc32c/node_modules/sse4_crc32
gyp ERR! node -v v0.10.42
gyp ERR! node-gyp -v v0.12.2
gyp ERR! not ok
npm WARN optional dep failed, continuing<EMAIL_ADDRESS>-
><EMAIL_ADDRESS>install /root/client/node_modules/gcloud/node_modules/grpc
> node-pre-gyp install --fallback-to-build

sh: 1: node-pre-gyp: Permission denied
npm ERR! Linux 3.8.13-bone71.1
npm ERR! argv "/root/opt/node-v4.4.3-linux-armv7l/bin/node" "/root/opt/node-v4.4.3-linux-armv7l/bin/npm" "install" "gcloud"
npm ERR! node v4.4.3
npm ERR! npm  v2.15.1
npm ERR! file sh
npm ERR! code ELIFECYCLE
npm ERR! errno ENOENT
npm ERR! syscall spawn

npm ERR<EMAIL_ADDRESS>install: `node-pre-gyp install --fallback-to-build`
npm ERR! spawn ENOENT
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>install script 'node-pre-gyp install --fallback-to-build'.
npm ERR! This is most likely a problem with the grpc package,
npm ERR! not with npm itself.
npm ERR! Tell the author that this fails on your system:
npm ERR!     node-pre-gyp install --fallback-to-build
npm ERR! You can get information on how to open an issue for this project with:
npm ERR!     npm bugs grpc
npm ERR! Or if that isn't available, you can get their info via:
npm ERR!
npm ERR!     npm owner ls grpc
npm ERR! There is likely additional logging output above.

npm ERR! Please include the following file with any support request:
npm ERR!     /root/client/npm-debug.log

Seems like a permissions error. Try searching around for "sh: 1: node-pre-gyp: Permission denied" and see if you can find a solution that makes sense for your environment.

Since it's a grpc issue I filed a bug there instead.
https://github.com/grpc/grpc/issues/6302

Yah, it's probably that I am trying to install modules as the root user. Lots of packages don't let you do that.


Missing setuptools in dev dependencies?

It seems to me that setuptools should be listed in the list of dev dependencies in pyproject.toml because it's used by some fixtures in tests.

Can you point out what exact fixtures are depending on setuptools?

I see these two files importing setuptools:

tests/fixtures/projects/demo-cextension/build.py
tests/fixtures/projects/demo-cextension-in-src/build.py

I see these two files importing setuptools:

tests/fixtures/projects/demo-cextension/build.py
tests/fixtures/projects/demo-cextension-in-src/build.py

Yes they are, would you like to contribute?


DXVK Broken (Upstream issue)

DXVK is broken from upstream nixpkgs due to the transition to GCC 13 see (NixOS/nixpkgs#283642). We may want to consider pinning a nixpkgs version for DXVK or make changes to compile with GCC12. Looks like github:NixOS/nixpkgs/b01852a162216ff5521c43254986fe3048a35f56 is the last working commit for nixos-unstable-small

I think I'm running into this issue with Star Citizen, is there a workaround I can use until upstream is fixed?

@meenzen You can use overlays and override the DXVK version. An example can be found in nix-citizen

PR has been merged upstream not quite to nixpkgs-unstable
https://nixpk.gs/pr-tracker.html?pr=302187

Issue can be closed w/ next flake update.

Fixed by a8152ec


taggedunion: Use tagattrname in internally tagged json marshal

This commit fixes the support for changing the tag attribute name on internally tagged enums.
Previously, given the following enum declaration:
type (
	Foo struct{ A int }
	Bar struct{ B int }
)

// #[go.TaggedUnion "json":"internal", "tag":"AAAAAAA", "names":[]]
type _Something interface{ Foo | Bar }

We produced the following json:
{"type":"Bar","B":0}

In goTaggedUnionJSONInternallyTagged we hard-coded the tag attr name to type, so lets use the tagAttrName param instead.
We now produce the following, correct, json:
{"AAAAAAA":"Bar","B":0}

The UnMarshal side of things already works correctly.

We may want to use type as a default when the user does not supply a tagName themselves.
Or we bail out when we should produce a internally tagged json without a tagName given


Go to definition not working: "No definition found for 'variable'"

VS Code Version: 1.55.2
OS Version: Arch Linux

Steps to Reproduce:

Create a new empty python file.
Create a simple function and call it.

Does this issue occur when all extensions are disabled?: I think that depends of python extension so i can disable it and test it.

First of all sorry for my english.
Since last week "Go to definition" is not working anymore for python files in my VSCode.
A simple example:

Any help will be appreciate :)
Thank you in advanced :)

/extPython


Pages:add scientific content

from status presentation:

[x] Timetable with sources (Interactive ?) (F. 7)
[x] Terms (F. 8)
[x] Grand Challenges and how ReFlex addresses these
[x] Shape-Change Continuum
[x] Models: Data Types
[x] Models: Task Taxonomy
[x] Models: parallel coords (F.48)
[x] Models: Intro - english graphic from status presentation
[x] parallel coords: with reference numberings, complete references on task taxonomy page
[x] update references graph: incorrect years

closed by #297


[TENSOR]: Fix copy constructor

Thanks for contributing to TVM!   Please refer to guideline https://tvm.apache.org/docs/contribute/ for useful information and tips. After the pull request is submitted, please request code reviews from Reviewers by @ them in the pull request thread.

@icemelon9 @zhiics  could you take a look?

Thanks @gaurav1086


Exams by Daria Rabiichuk

count.js and zip.js tasks

Excellent!!! I really like the way you changed the code in zip.js


Issue with libraryfolders.vdf

My libraryfolders.vdf is in ~/.steam/steam/steamapps/, but it's looking for it in /.steam/steam/config/ instead.
❯ sif --verbose
Working with Papirus-Dark icon theme.

[ok] Found Steam installation directory:
   - /home/yochanan/.steam/steam

[ok] Found Steam configuration file:
   - /home/yochanan/.steam/steam/config/config.vdf

Traceback (most recent call last):
  File "/usr/bin/sif", line 349, in <module>
    library_folders = get_steam_libraries()
  File "/usr/bin/sif", line 59, in get_steam_libraries
    libraries_config = vdf.load(open(STEAM_INSTALL_DIR + '/config/libraryfolders.vdf'))
FileNotFoundError: [Errno 2] No such file or directory: '/home/yochanan/.steam/steam/config/libraryfolders.vdf'

I symlinked it to ~/.steam/steam/config/, but it doesn't seem to like my file:
Working with Papirus-Dark icon theme.

[ok] Found Steam installation directory:
   - /home/yochanan/.steam/steam

[ok] Found Steam configuration file:
   - /home/yochanan/.steam/steam/config/config.vdf

Traceback (most recent call last):
  File "/usr/bin/sif", line 349, in <module>
    library_folders = get_steam_libraries()
  File "/usr/bin/sif", line 61, in get_steam_libraries
    for library in libraries_config['libraryfolders'].values():
KeyError: 'libraryfolders'

My libraryfolders.vdf:
"LibraryFolders"
{
	"TimeNextStatsReport"		"1623265925"
	"ContentStatsID"		"3289963266067000499"
	"1"		"/mnt/storage/Games/steam"
}

Manjaro GNOME
sif-git r101.f3354aa-1
steam-manjaro <IP_ADDRESS>-1
steam-native <IP_ADDRESS>-2

Hello, thank you for reporting this!
It's very strange. I just tested it on Manjaro and Gentoo and I have both files ~/.steam/steam/config/libraryfolders.vdf and ~/.steam/steam/steamapps/libraryfolders.vdf and they are exactly the same. But both for some reason use different syntax than your file does.
My libraryfolders.vdf file:
"libraryfolders"
{
	"contentstatsid"		"-7679687468067839144"
	"1"
	{
		"path"		"/media/ivo/manjarohome/home/ivo/.local/share/Steam"
		"label"		""
		"contentid"		"7328791404652866639"
		"totalsize"		"40958427136"
		"apps"
		{
		}
	}
	"2"
	{
		"path"		"/media/ivo/storage/SteamLibrary"
		"label"		""
		"contentid"		"4489297710320386189"
		"totalsize"		"206613708800"
		"apps"
		{
			"8870"		"18104795465"
			# shortened
		}
	}
	"3"
	{
		"path"		"/media/ivo/ssd-storage/SteamLibrary"
		"label"		""
		"contentid"		"971097219502658197"
		"totalsize"		"622768160768"
		"apps"
		{
			"220"		"3766825842"
			# shortened
		}
	}
}

Are you subscribed to Steam beta program? For me, SIF works fine with both, but I would really like to know if that changes anything for you. It's just a few clicks in Steam settings and you can unsubscribe anytime.

The main question is, if this problem is only some kind of anomaly on your local Steam installation or it can affect more users and I should implement some sort of patch to distinguish two types of libraryfolders.vdf.

I made some fixes so the script should no longer crash with an exception for you, but in its current state, it will not detect any games in your "/mnt/storage/Games/steam" library, if you have any installed.

Are you subscribed to Steam beta program?

Nope.

it will not detect any games in your "/mnt/storage/Games/steam" library

That's where all my games are installed.
❯ sif --verbose
Working with Papirus-Dark icon theme.

[ok] Found Steam installation directory:
   - /home/yochanan/.local/share/Steam

[ok] Found Steam configuration file:
   - /home/yochanan/.local/share/Steam/config/config.vdf

[ok] Found Steam libraryfolders.vdf file:
   - /home/yochanan/.local/share/Steam/config/libraryfolders.vdf

[ok] Found Steam library folders:
   - /home/yochanan/.local/share/Steam/steamapps

[ok] Found Steam localconfig.vdf file:
   - /home/yochanan/.local/share/Steam/userdata/19564705/config/localconfig.vdf

[ok] Found wm-class-database file:
   - /opt/sif/database.json

No games found to fix.

This SIF output is with Steam beta? I see it found config/libraryfolders.vdf. Can you provide content of this file with Steam beta? I guess it changed.

As I said I am not using Steam beta. Yes, that was the symlink I made.

And can you try Steam beta? As I said, you can anytime come back to Steam stable.

https://github.com/BlueManCZ/SIF/commit/6ae77edc8a14fa1ce533164a0099785755036d9c Alright, it should work now for you even without Steam beta. Can you test it, please?

It's working now, thanks.
❯ sif --verbose
Working with Papirus-Dark icon theme.

[ok] Found Steam installation directory:
   - /home/yochanan/.local/share/Steam

[ok] Found Steam configuration file:
   - /home/yochanan/.local/share/Steam/config/config.vdf

[ok] Found Steam libraryfolders.vdf file:
   - /home/yochanan/.local/share/Steam/steamapps/libraryfolders.vdf

[ok] Found Steam library folders:
   - /home/yochanan/.local/share/Steam/steamapps
   - /mnt/storage/Games/steam/steamapps

[ok] Found Steam localconfig.vdf file:
   - /home/yochanan/.local/share/Steam/userdata/19564705/config/localconfig.vdf

[ok] Found wm-class-database file:
   - /opt/sif/database.json

[!!] Creating target directory.
[ok] Successfully created the directory:
   - /home/yochanan/.local/share/applications/steam-icons-fixed
Creating .desktop files in /home/yochanan/.local/share/applications/steam-icons-fixed

 489830   - The Elder Scrolls V: Skyrim Special Edition (/home/yochanan/.local/share/applications/steam-icons-fixed/The-Elder-Scrolls-V:-Skyrim-Special-Edition.desktop)

It appears the WM_CLASS is just the Steam game ID, right? It's 261640. However, there's nothing to fix with that game.

It appears the WM_CLASS is just the Steam game ID, right?

I don't know, I don't own the game. If xprop WM_CLASS returns only the game ID, then it's only the game ID. Can you confirm this?

However, there's nothing to fix with that game.

What do you mean? I guess it doesn't use a Papirus icon as default runtime icon, or does it?

It's BorderlandsPreSequel, turns out.
The Papirus icon is already used, SIF isn't necessary. Nothing to fix.

Alright, interesting. Thank you.


Make A Lock function

Hi, I found your application and it's awesome, so I just want to voice my opinion, maybe you should put lock function when watching the video, so that there would no any disturbance like unintentionally pause or fast forward the video

@AmirunAzwar Thanks, i will consider it.


Point to lab

Overview
TL;DR

Questions
<If relevant, write a list of questions that you would like to discuss related to the changes that you have made.>
Next Steps
<If incomplete, create a task list of items that are still being worked on within the Pull Request.>
Review
<If complete, or ready for :eyes:, use @mentions for quick questions, specific feedback, and progress updates.>

👋 @MashuAjmera  ! Can you please help us understand what you're hoping to accomplish with this pull request?
Closing out for now, but please leave a comment or re-open with a more detailed description at your convenience.


Improvements to E2E test apps

Spin-off from https://github.com/dapr/dapr/pull/4903
It contains misc improvements to E2E test apps, including:

More relying on env vars so it's easier to run the test apps locally and not just in a k8s cluster (that helped me a lot while working on #4903)
More code reuse

/ok-to-test

/ok-to-test

/ok-to-test

/ok-to-test


Migrate to cats-effect 3.x and fs2 3.x

This PR migrates fs2-mqtt to the latest cats-effect and fs2 versions. This of course breaks compatibility with CE2 and fs2 2.x.
Problems:

I converted the LocalPublisher example from Monix to ZIO as Monix doesn't support CE3.
I rewrote the TickerSpec to use the TestControl from CE3, but the test doesn't work. The Ticker itself seems to work just fine, so it must have something to do with my inability to use the TestControl properly.
In Transport I had some issues caused by the removal of timeouts and close from fs2's Socket.

This is a bit of a pleasant surprise. To tell the truth I've neglected this small project for a while. This was due to my inability to understand how a Scala library maintainer should manage bumping fundamental dependencies like cats-effect.
When I decided to support Scala3, I wanted fs2-mqtt available for Scala2 as well and this was quite an easy task. But how do people from fs2for example handle compatibility with both cats-effect 2 & 3? I mean do they say up to version x it goes with cats-effect 2, and from version y it goes with cats-effect 3?
I also really wanted to keep an example using Monix along with ZIO. For me this was all the point of going tagless final using only cats-effect type classes. But anyway, if Monix doesn't support fs2 3.x...  ¯\_(ツ)_/¯

The situation with CE2 to CE3 migration is rough. There is no way to "cross-compile" one codebase to CE2 and CE3. The two approaches I see out in the wild are:

Use CE2 until version X. Use CE3 starting from X+1 and never look back.
Examples:

cats-retry uses CE2 until 2.1.1 and CE3 starting from 3.0.0
pureconfig-cats-effect uses CE2 until 0.14.1 and CE3 starting from 0.15.0

Keep maintaining a CE2 seriess/branch. While developing new stuff on CE3.
Examples:

fs2 3.x uses CE3 and all new development happens on that version, but fs2 2.5.x which supports CE2 keeps getting bugfix releases
http4s 0.23.x uses CE3 and 0.22.x uses CE2. They are maintained and released in pararell. 0.22.x gets all the bugfixes, and some of the new stuff, but not all of it.

Two exampels for each may not be much, but you can see a pattern. 1. is taken by small libraries, or libraries which don't have CE at their core (they just integrate with it). Approach 2. is taken by large libraries at the core of the ecosystem, which have large user-bases taking long time to migrate, and which have the maintainer capacity to support two (or more in case of http4s) branches.
The monix situation is unclear. It may support CE3 one day (https://github.com/monix/monix/issues/1502). But I can imagine the migration effort is dounting.
IMO tagless-final is still worth it. There's at least IO and ZIO that are compatibile with it, and when Monix caches up it will be too.
It's your library, so if you prefer to stay on CE2 longer, because you need it in you project etc. I'll understand and I won't push ;). I needed MQTT in my CE3 project, so I had to do the legwork anyway. Once it was done, PRing it was a natural consequence.

I'm really happy you've done all the work to go CE3 and I've no personal use of a CE2 version. It was more a project about learning stuff like how to write a purely functional effecting library, using tagless final or how to manage such a thing in the Scala ecosystem.
I'm not sure either if anyone anywhere is using it as it is today. So as you've found an interest in it, I'll be of course happy to merge your work. I'll do then a major release and some extra work at least to use IO on one of the examples.

I've figured out how to fix the TickerSpec! As it's said in the CE3 documentation TestControl should be seen as a kind of debugger to step through the fiber's activation. As the ticker is based on 1 second ticks, to go through the tests we have "step" many times, and I've introduced a helper function for that.
I've rewritten the example previously based on Monix with IO which is an immediate adaptation. Zero effort in comparison with ZIO.
I've merged your PR into master by hand, so I'll close it without further ceremony. Thanks a lot for your help.


How to export old, posted messages in Company Communicator v3

Hi @gsv022
We have the old company communicator version 3 in production that will decommission soon as a fresh new dedicated installation (NOT an upgrade from v3) of Company Communicator v5.5 instance will be scheduled next Thursday 14th on the production tenant.
My question is if the end-users want to have back up copy/export of all the old messages in company communicator version 3, before the messages gets deleted to be replaced with the new data storage in v5, what is the best approach to export all the messages as CSV/ZIP format in the current version 3?

Thanks and look forward to your reply this week before next week.
kind regards
David

Hi @David-Liong ,
Thanks for the patience.

Could you please let us know the reason for taking back up of old(v3) instance.

Hi @gsv022
The reason is because the organisation has a retention policy to keep archive data for certain period of time.
So they like to align the policy with the company communicator app, which is why I have raise this request, to verify if there is an easy way to backup sent messages and exported it out to file .e.g csv, etc..

Hi @David-Liong ,
We would recommend to go with downloading the sent messages in CSV format only.


Improve jlink-image error message when jmod files missing

Some JDK distributions (e.g. on *nix) do not contain the *.jmod files and so cannot be used by this tool. The error message is a bit cryptic and needs improvement:
Not a valid JDK (java.base.jmod not found): /usr/lib/jvm/java-11-openjdk-<IP_ADDRESS>-1.0.1.el7.x86_64

On some systems, it appears that jmod files are distributed as a separate package, e.g.
$ yum list | grep jmods
java-11-openjdk-jmods.x86_64          1:<IP_ADDRESS>-0.0.1.el7_9
java-11-openjdk-jmods.i686            1:<IP_ADDRESS>-0.0.1.el7_9
java-11-openjdk-jmods-debug.i686      1:<IP_ADDRESS>-1.0.1.el7
java-11-openjdk-jmods-debug.x86_64    1:<IP_ADDRESS>-1.0.1.el7
java-latest-openjdk-jmods.x86_64      1:<IP_ADDRESS>-2.rolling.el7
java-latest-openjdk-jmods-debug.x86_64

As far as I can tell, this is only for OpenJDK builds distributed as RPMs. We should let the user know about this where it makes sense (e.g. if yum is available on the PATH and the JVM is OpenJDK), as it was certainly not intuitive to me.

In Debian/Ubuntu derivatives, the jmods are in the corresponding '-jdk-headless- package, not specifically in a jmods only package, e.g. https://packages.debian.org/search?mode=filename&suite=buster&section=all&arch=any&searchon=contents&keywords=jmod


Fun fact: reset.css overrides the table's border-collapse property

There are a few ways of fixing this issue:

Set border-collapse property to !important
Set border-collapse property in d2l-table-wrapper
Move all styles to d2l-table-wrapper. I was thinking of doing this
already. The reason I didn't was because it would make custom styling of
tables weird

To reproduce:
Add
<link rel="stylesheet" type="text/css" href="https://s.brightspace.com/lib/reset-css/1.1.0/reset.css">

to the <head> of demo/index.html. Then
npm install
polymer serve
open http://localhost:8080/components/d2l-table/demo/

Here is a screenshot of the issue (only when ShadowDOM is enabled):
With ShadowDOM (notice the sharp corners):

Without ShadowDOM (notice the round corners):

@dlockhart @omsmith Thoughts about the solution? What do you think about putting more/all the styles in the d2l-table-wrapper?

So, :host means take whatever the containing-page's style is, as per regular css rules right?

@omsmith Yes, the :host selector has lower specificity than the tag name.

I guess my thought is, if we rely on border-collapse: separate for our rounded corners to work, do we want it to be overridable?

No we don't want it overridable. I guess then the only difference in moving it to d2l-table-wrapper would be making it more overridable, which we don't want.

I'm never a big fan of using !important, so I think I'd prefer a solution that doesn't need it. I'm a little confused about why this is a bug at all, and only when shadow DOM is on. Is the reset stylesheets rule somehow more specific than the :host one?

Is there a way to not use :host (and also not another css class)?

@dlockhart. Correct. The reset.css contains a selector like this:
table {
	border-collapse: collapse;
}

Which has higher specificity than the :host selector

@omsmith. Not without moving the styles to the d2l-table-wrapper

And that's because table is the outer element, and there's no way to reference the top-level element without it also becoming overridable?

@omsmith Correct.

That seems dumb

I think the purpose is so that the components are more customizable, which we don't want in this case. So yeah, it's dumb.

@dlockhart Do you know of any way of selecting the top-level element with greater specificity?

Does switching it to :host(table) { ... } make it more specific? Otherwise I'm down for either the !important solution (since we're actually saying this rule IS important) or moving it to the wrapper (our own version of a reset stylesheet).

No, I tried that, which is a bit weird.

Sort of. The host can mess with the element itself that is not protected by ShadowDOM.

What we want tables to do is opposite what we want Polymer to do. Maybe we should look at using the custom elements API directly?

@omsmith in this case we're doing something kind of weird in that we're just extending the table element (<table is="d2l-table">) and the parent page is totally allowed to go table { color: red; } to mess with our "element". That normally what you kind of want with WCs.

@awikkerink kind of hacky, but what about :host([is="d2l-table"])?

I don't think that would work...
Another thought is
ready: function() {
this.style = ...;
}

@dlockhart Actually, :host([is="d2l-table"]) does work!

I think I'm okay with this for now. I would like to look into this more this leap sprint

@Surekh?

LGTM!


[ACS JobRouter] Python sdk customizations

Python SDK Customizations. Teams post (internal)

@iscai-msft can you please review these changes?


When converting pdf to json, the Chinese font name is garbled

When converting pdf to json, the Chinese font name is garbled
qpdf --json-output test.pdf out3.json
"obj:8 0 R": {
"value": {
"/BaseFont": "/FPWNDA+    ",
"obj:14 0 R": {
"value": {
"/BaseFont": "/FPOHHT+      ͤ ڼ   "
test.pdf
,

The problem is that QPDF JSON doesn't properly encode PDF name objects that contain non-Unicode characters. Somehow I managed to overlook this possibility. I'll get this fixed.

Starting with qpdf 11.7.0, any name whose canonical form is not valid UTF-8 will be represented as n: followed by the name in PDF syntax. This doesn't break compatibility because strings starting with n: are not currently valid, and json output by qpdf < 11.7.0 in this case will be invalid JSON though qpdf json will still read it.


[Draft] Expose well-known certificate subject fields in Lua filter

Commit Message: expose well-known certificate subject fields in Lua filter for https://github.com/envoyproxy/envoy/issues/35524
Additional Description:
Risk Level: low
Testing:
Docs Changes:
Release Notes:
Platform Specific Features:
[Optional Runtime guard:]
[Optional Fixes #Issue]
[Optional Fixes commit #PR or SHA]
[Optional Deprecated:]
[Optional API Considerations:]

@ggreenway this is the draft PR.

@zhishi thanks for posting this. Yes, I think this looks like a good way to model the the lua API for this; this all looks reasonable.

@ggreenway then I'll start working on the unit test and change it to a formal PR. thanks for reviewing!

@ggreenway  I have added unit test and the PR is good for review. I still have question about how to update document for the added interface, will that be automatically generated from comments or I should update some doc file in somewhere?

@ggreenway I have added unit test and the PR is good for review. I still have question about how to update document for the added interface, will that be automatically generated from comments or I should update some doc file in somewhere?

Docs need to be written manually. Current docs are here: https://raw.githubusercontent.com/envoyproxy/envoy/refs/heads/main/docs/root/configuration/http/http_filters/lua_filter.rst

@ggreenway I have addressed comment and updated document. Do you think we should also include other well-known fields this time or only add it when someone need it in future?

@ggreenway I have addressed the comments. For some reason the CI job Envoy/Checks always fail on step ./ci/do_ci.sh coverage:
Run rm -rf "$TMP_STDOUT"
Run failed
Error: Process completed with exit code 1.
I feel it's not related with my change.

@ggreenway I have addressed the comments. For some reason the CI job Envoy/Checks always fail on step ./ci/do_ci.sh coverage: Run rm -rf "$TMP_STDOUT" Run failed Error: Process completed with exit code 1.
I feel it's not related with my change.

If you scroll up a little ways in the coverage log, you'll see
Code coverage 96.6 is good and higher than limit of 96.1
Checking per-extension coverage
Per-extension coverage failed:
Code coverage for source/common/tls is lower than limit of 95.3 (95.2)

I think this is due to your change. Please add more test coverage.
/wait

There's a merge conflict.  Please merge main into your PR branch and push.
/wait

Also, I just re-worked how data is cached to counter-act the growing memory use per connection in https://github.com/envoyproxy/envoy/pull/36767. You'll need to integrate into that. But as I said earlier, I think it would make sense to return the unique_ptr by value, and NOT hold it in the ConnectionInfoImplBase at all.

oh, that's a good change, let me integrate it.

Also, I just re-worked how data is cached to counter-act the growing memory use per connection in #36767. You'll need to integrate into that. But as I said earlier, I think it would make sense to return the unique_ptr by value, and NOT hold it in the ConnectionInfoImplBase at all.

do you mean don't want cache the ParsedX509Name object at all, just generate it every time when the function is called?

actually, based on your code change, when I return a unique_ptr, it will return a const unique_ptr& to caller, so it's still cached and won't be deleted by caller, is my understanding right?

I'm debating whether it's useful to cache the object; but if non-lua accessors are added, it may be worthwhile.
The internal getCachedValueOrCreate could return a unique_ptr<>&, but parsedSubjectPeerCertificate() should not.

I feel it won't hurt to cache the object, because even connectionInfo don't cache it, the lua wrapper will still cache it anyway. and in typical usage the lua filter written by user (my use case at least) will be in the route level, which will be called on every requests go through that connection, so this function will be called multiple times.

I feel it won't hurt to cache the object, because even connectionInfo don't cache it, the lua wrapper will still cache it anyway. and in typical usage the lua filter written by user (my use case at least) will be in the route level, which will be called on every requests go through that connection, so this function will be called multiple times.

Good point; I agree it makes sense to cache.

@ggreenway I have updated the code with your change, and I think the code is more cleaner with your cache interface. since this change several places in my code, may need your review all the changes again. thanks.


Improve documentation of cms rules

The custom patch is needed because the docstrings of decorated functions are not automatically included by the automodule directive and need an explicit autofunction.
Fixes #333

I opened  #453 as follow-up issue.


travis build config update

upgrade pip and setuptools on travis and improve caching.

Looks like build time went down from 4 min 58 sec to 3 min 40 sec with this PR.

This is awesome :)

hehe yes! when btc's above 4k again it'll be complete ;)


Feature: Title in the menu needs to be in OpenSans font

Type of feature
🐛 Fix
Current behavior

The open sauced landing page has the correct font.

https://github.com/open-sauced/landing-page/blob/main/tailwind.config.js#L39
Suggested solution

Install Open Sans font (weight 400) in the tailwind.config.
Update the font family for the title. here: https://github.com/open-sauced/hot/blob/main/src/components/PrimaryNav.tsx#L25
Kerning between letters is -6% (in figma) not sure how that translate in CSS

Additional context
No response
Code of Conduct

[X] I agree to follow this project's Code of Conduct

Contributing Docs

[X] I agree to follow this project's Contribution Docs

.take

Is it still open i want to take it.

Is it still open i want to take it.

@dinnyscript already took it

Hi everyone. is this issue still open ?? Would love to take it.

Hi everyone. is this issue still open ?? Would love to take it.

Currently, it's already assigned to @dinnyscript

Hi everyone. is this issue still open ?? Would love to take it.

Currently, it's already assigned to @dinnyscript

ok thanks

Hey,
For the font kerning, I could not find a way to set a certain value for it in CSS - I think the best alternative is letter-spacing, although it is not exactly the same thing. I have used tailwind's tracking-tighter to achieve the effect. Here is the current behavior:

Let me know if this is fine. Thanks!

Hey,
For the font kerning, I could not find a way to set a certain value for it in CSS - I think the best alternative is letter-spacing, although it is not exactly the same thing. I have used tailwind's tracking-tighter to achieve the effect. Here is the current behavior:

Let me know if this is fine. Thanks!

Do you have a PR for that? Also, kerning would be set from the font weight additional options we are loading from google fonts (that would be in the vite.config.ts file)

I just created a PR for the issue. For the font kerning, I checked the vite.config.ts file although I am still unsure on how to continue. Any help would be appreciated.

Did you take a look at the landing-page repo. All of the above is achieved there.

It seems the landing-page repo uses a .svg file for the logo?

Ah that makes sense. Perhaps we do that instead, sorry for the runaround on this.

Looking at Figma font pairings, that is clearly not 16px normal weight: https://www.figma.com/file/OWzJRZoB7I2KXCppuzuq0v7E/Open-Sans-Pairings/duplicate?node-id=0%3A1
We should add 600 or 900 weight and potentially make it bigger even. At 16 pixels bold it might still be skinnier than in the OP screenshot but it should do the trick and look good in the preview! 🍕
That should fix the font, from a technical perspective, it doesn't make sense to wrap the text around in an SVG image as that would just be markup with better CSS, we should add some classes, drop shadows, transitions, etc on the element itself with tailwind utilities.

Here is the title with 900 weight and tracking-tighter:

Does this look ok?

Here is the title with 900 weight and tracking-tighter:
Does this look ok? It is definitely not as bold as the OP screenshot however

Amazing! I like it, you can also try with text-xl (20px) and see if that is better! 🍕 Go with your gut feeling IMHO

Got it, I will try some different text sizes and then set the PR for review. Thanks!


Transparent material is not rendered through another transparent material

Godot version:

v3.0.6.stable.official
OS/device including version:

Pop!_OS 17.10 (Artful Aardvark)
Issue description:

I have multiple materials applied to 3D models (meshes). 2 of those materials use transparency to create windows. The problem is that when I look through one of the windows (one of the transparent materials) at a model that uses the other material, the surface of the material is not visible. It happens both ways (looking through material A window at material B surfaces and the other way around).
Here is a screenshot with 2 quad meshes that use my materials:

Both meshes are square, and you can see that the further mesh is not visible through the closer one.
Steps to reproduce:
I've created a simple project in Godot that uses a very simple material (just one PNG file with transparency for albedo and transparent flag), and everything was fine. I think the problem is either with my materials' settings or with the PNG files I've used. I need help figuring out where to look for the problem.
Minimal reproduction project:

Please let me know if you need additional information about the materials. I assume that I'm missing some settings that might be obvious to more experienced users. If the problem is more complicated, I think I'll be able to provide the materials in a ZIP file for you to investigate.

IIRC transparency sorting in Godot is done based on mesh origins, therefore transparency won't work correctly on objects that with distance between them smaller than object's dimensions (can be partially mitigated by sorting individual triangles instead of meshes, but will significantly degrade performance, probably to unusable level). And transparency definitely won't work with overlapping or self-overlapping objects (AFAIK unsolvable with polygonal graphics at all).
It's not a bug rather rendering technique limitation.

And transparency definitely won't work with overlapping or self-overlapping objects (AFAIK unsolvable with polygonal graphics at all).

Order-independent transparency techniques can be used, but they are computationally expensive.

Related issues: #7243, #15873, #19126, #19269, #21050, #21690

Any information related to this and Vulkan? Controversial Reddit post
This is still an irritating issue in my game.

There is this version of OIT that could be implemented in GLES3. It seems performance friendly too.
http://casual-effects.blogspot.com/2014/03/weighted-blended-order-independent.html?m=1


update clap derive

bump: deps
update: to use clap-derive (and only use root if necessary)

doing some maintenance while proposing this for NixOS: https://discourse.nixos.org/t/better-wifi-ux-on-the-non-graphical-installer/23030

Thank you very much and sorry my delay to merge this.

@blaggacao Thank you very much for all patches! Could you share with me more information about the proposal you made for NixOS?
Also if you are interested on work with me to maintain ifwifi, I would be more than happy to give you written access to this repository.

@blaggacao Also, if you guys need any specific feature to make ifwifi as the default cli for NixOS, let me know and I can try to implement it.
Best,

The result was that we probable should stick with nmtui, or some other tool I don't remember, now. Still, I think I'll use iwifi for my personal machines. Thanks for cutting a release!


Line between additional solar production and solar production does not take on color.

Line between additional solar production and solar production does not take on color.
The line with the specification: Color of the line between additional solar production and solar production (default: empty)
always remains at the default yellow and cannot be adjusted

Works as expected:

Working here is not right.
Look at the pictures

Will have a look into that tomorrow and come back.


map EIA plant-parts to constituent generator plant-parts

We need a way to know what "generator plant-parts" make up each of the plant-part records. A generator plant-part is a plant-part record with plant_part == "plant_gen" - or generators/utility ownership records.
The way I'd suggest going about this is to take the full plant-part list and iterate over each of the plant-part types using PLANT_PARTS_ORDERED or PLANT_PARTS. Each plant-part type has it's own set of base ID columns/primary key columns which are enumerated in the PLANT_PARTS dictionary. There are additional ID/PK columns to use which include ownership, report date and operational status (IDX_TO_ADD and IDX_OWN_TO_ADD).
With each plant-part group's ID/PK cols, you can merge in the generator plant-part records.  Then you can concatenate each of the plant-part type dfs and grab just the two record_id_eia columns.
.... after things about this here, I may have already effectively solved for this with this method in the rmi repo that I've been using for another application. The df_to_scale in this case could effectively be the whole plant-part list and the self.plant_part would be "plant_gen". And we'd want no data columns so cols_to_keep could be an empty list. It might take some tweaking/generalizing to make this specific method work in this application. Or it could just be a helpful guide.
(you'll need to branch off of the mul_eia branch until we actually we get #952 merged into dev)

I tried it and it looks like it literally just does the thing.... there is some required setup here that would not be need if we extracted the main functionality out of it's current context
from pudl_rmi.connect_deprish_to_ferc1 import *
scaler_fe = (
    PlantPartScaler(
        treatments=META_FERC1_EIA,
        ppl_pk=['record_id_eia'],
        data_set_pk_cols=['record_id_ferc1'],
        plant_part='plant_gen'
    )
)

outputs (record_id_eia_og in this context is the plant_parts and record_id_eia are the constituent generators):


Upstream merge

Just a simple upstream merge without any conflicts to solve. It compiles.

been meaning to touch this myself, not entirely fond of some of the upstream changes and wanted to see if they got any comments surrounding forge, as I know that forge support is disabled by default now, which seems like a bad default, especially as a fork which attempts to provide some sanity to forge...

Sadly I don't have the time at the moment to make this merge (would require looking into the changes, etc). While I can agree with a toggle for Forge support, Waterfall will enable this by default.
We will need to go over all of our Forge-related patches to ensure that they work with the new toggles, in addition to looking into whatever other changes upstream have made.
If nobody does the merge in full by the weekend, I'll sort it out ;)

I did say the weekend, so I'm only slightly late. Enjoy! https://github.com/WaterfallMC/Waterfall/commit/f539c023a30ff59a3c0890e8e1fc12c9af041711


Errors on console when including ibm-common.js

We followed the instructions for building IBM.com pages:
https://github.com/carbon-design-system/ibm-dotcom-library/blob/master/docs/building-for-ibm-dotcom.md
Now we see errors on the console:

Are these severe errors or can we ignore them?

I forgot to mention that we see the error in our development environment: www.blueworkscloud.com
We didn't try it in our production environment yet: www.bpm.ibmcloud.com
Maybe we should use a different //1.www.s81c.com/common/stats/ibm-common.js include for a development environment after all? Or just ignore the errors?

Hi @KJaspers, are you using an ad blocker? Many elements of ibm-common will be blocked if you are. Is it possible to check with ad blockers disabled, or on another browser?

No response from the adopter.  Closing


Sheet Xml c without r

Normal data like :
<?xml version="1.0" encoding="utf-8"?>
<worksheet xmlns:r="http://schemas.openxmlformats.org/officeDocument/2006/relationships"
    xmlns="http://schemas.openxmlformats.org/spreadsheetml/2006/main">
    <dimension ref="A1:B2" />
    <sheetViews>
        <sheetView workbookViewId="0" />
    </sheetViews>
    <sheetFormatPr defaultRowHeight="15" />
    <sheetData>
        <row r="1">
            <c r="A1" s="0" t="s">
                <v>0</v>
            </c>
            <c r="B1" s="0">
                <v>44257.384891898146</v>
            </c>
        </row>
        <row r="2">
            <c r="A2" s="0">
                <f>=MID(A1, 7, 5)</f>
            </c>
            <c r="B2" s="0">
                <v>123</v>
            </c>
        </row>
    </sheetData>
    <headerFooter />
</worksheet>

But simple data will like :
<?xml version="1.0" encoding="utf-8"?>
<x:worksheet xmlns:x="http://schemas.openxmlformats.org/spreadsheetml/2006/main">
    <x:sheetData>
        <x:row>
            <x:c t="n">
                <x:v>1</x:v>
            </x:c>
            <x:c t="str">
                <x:v>"<>+}{\nHello World</x:v>
            </x:c>
            <x:c t="b">
                <x:v>1</x:v>
            </x:c>
            <x:c t="d">
                <x:v>2021-03-02T08:47:12</x:v>
            </x:c>
        </x:row>
        <x:row>
            <x:c t="n">
                <x:v>1</x:v>
            </x:c>
            <x:c t="str">
                <x:v>"<>+}{\nHello World</x:v>
            </x:c>
            <x:c t="b">
                <x:v>1</x:v>
            </x:c>
            <x:c t="d">
                <x:v>2021-03-02T08:47:12</x:v>
            </x:c>
        </x:row>
    </x:sheetData>
</x:worksheet>

CloseXML not support c without r, it'll show Input string was not in a correct format.

   at System.Number.ThrowOverflowOrFormatException(ParsingStatus status, TypeCode type)
   at ClosedXML.Excel.XLWorkbook.LoadCells(SharedStringItem[] sharedStrings, Stylesheet s, NumberingFormats numberingFormats, Fills fills, Borders borders, Fonts fonts, Dictionary`2 sharedFormulasR1C1, XLWorksheet ws, Dictionary`2 styleList, Cell cell, Int32 rowIndex) in C:\projects\closedxml\ClosedXML\Excel\XLWorkbook_Load.cs:line 1664
   at ClosedXML.Excel.XLWorkbook.LoadRows(Stylesheet s, NumberingFormats numberingFormats, Fills fills, Borders borders, Fonts fonts, XLWorksheet ws, SharedStringItem[] sharedStrings, Dictionary`2 sharedFormulasR1C1, Dictionary`2 styleList, Row row) in C:\projects\closedxml\ClosedXML\Excel\XLWorkbook_Load.cs:line 2121
   at ClosedXML.Excel.XLWorkbook.LoadSpreadsheetDocument(SpreadsheetDocument dSpreadsheet) in C:\projects\closedxml\ClosedXML\Excel\XLWorkbook_Load.cs:line 266
   at ClosedXML.Excel.XLWorkbook.LoadSheets(String fileName) in C:\projects\closedxml\ClosedXML\Excel\XLWorkbook_Load.cs:line 43
   at ClosedXML.Excel.XLWorkbook.Load(String file) in C:\projects\closedxml\ClosedXML\Excel\XLWorkbook_Load.cs:line 33
   at ClosedXML.Excel.XLWorkbook..ctor(String file, XLEventTracking eventTracking) in C:\projects\closedxml\ClosedXML\Excel\XLWorkbook.cs:line 718
   at ClosedXML.Excel.XLWorkbook..ctor(String file) in C:\projects\closedxml\ClosedXML\Excel\XLWorkbook.cs:line 709
   at UserQuery.Main() in C:\Users\Wei\AppData\Local\Temp\LINQPad6\_zeygkceo\tqolpc\LINQPadQuery:line 5
   at LINQPad.ExecutionModel.ClrQueryRunner.Run()
   at LINQPad.ExecutionModel.Server.RunQuery(QueryRunner runner)

Try EPPLUS also not support c without r, it'll show Input string was not in a correct format.

It looks like can not support it. because it need more check logic costing.

Try NPOI also not support c without r

ExcelDataReader can read

It can read first row to know maxColumnIndex

<?xml version="1.0" encoding="utf-8"?>
<x:worksheet xmlns:x="http://schemas.openxmlformats.org/spreadsheetml/2006/main">
    <x:sheetData>
        <x:row>
            <x:c t="n">
                <x:v>1</x:v>
            </x:c>
            <x:c t="str">
                <x:v>"<>+}{\nHello World</x:v>
            </x:c>
            <x:c t="b">
                <x:v>1</x:v>
            </x:c>
            <x:c t="d">
                <x:v>2021-03-16T16:59:12</x:v>
            </x:c>
            <x:c s="1">
                <x:v>44271.70778590278</x:v>
            </x:c>
        </x:row>
        <x:row>
            <x:c t="n">
                <x:v>1</x:v>
            </x:c>
            <x:c t="str">
                <x:v>"<>+}{\nHello World</x:v>
            </x:c>
            <x:c t="d">
                <x:v>2021-03-16T16:59:12</x:v>
            </x:c>
            <x:c s="1">
                <x:v>44271.70778590278</x:v>
            </x:c>
        </x:row>
    </x:sheetData>
</x:worksheet>

<?xml version="1.0" encoding="utf-8"?>
<x:worksheet xmlns:x="http://schemas.openxmlformats.org/spreadsheetml/2006/main">
    <x:sheetData>
        <x:row>
            <x:c t="n">
                <x:v>1</x:v>
            </x:c>
            <x:c s="1">
                <x:v>44271.798862407406</x:v>
            </x:c>
        </x:row>
        <x:row>
            <x:c t="n">
                <x:v>1</x:v>
            </x:c>
            <x:c t="str">
                <x:v>"<>+}{\nHello World</x:v>
            </x:c>
            <x:c t="b">
                <x:v>1</x:v>
            </x:c>
            <x:c t="d">
                <x:v>2021-03-16T19:10:21</x:v>
            </x:c>
            <x:c s="1">
                <x:v>44271.79886243056</x:v>
            </x:c>
        </x:row>
    </x:sheetData>
</x:worksheet>


Ignore dir / files (using gitignore?)

Hi and thanks for your plugin :).
Is there some way to ignore a directory when using :FzfLua files? For example fzf.vim offers exclusion based on gitignore.
kind regards, Timon

FzfLua files does use .gitignore to ignore files, at least it does for me. There's also FzfLua git_files you could try out, but it lists out all files in the repository, without regard for your current directory.

Weird, it doesn't seem to work for me. Are you using any settings to enable it?

Weird, it doesn't seem to work for me. Are you using any settings to enable it?

No specific setting required but you can override whatever you want, take a look at all the default files options in the README, it used fd if found, then rg and lastly find, whatever comes back from the command is what you’ll see in the interface, test what works best for you in the shell and then you can set the cmd argument, for example:
lua require'fzf-lua'.files({ cmd = "rg --color=never --files --hidden --follow -g '!.git'" })

Installing rg fixed my issue, so I suspect the git filtering might be broken for find (?). If you want I can confirm that and provide more details.

Thanks for the help guys! :+1:

Closing this for now :)

Default find command is find -type f -not -path '*/\.git/*' -printf '%P\n' but it does require GNU find so that might have been the issue, in any even having rg installed is recommended and also much better integrated with the different grep providers (better performance, glob support, etc).

edit: there was a syntax error in my gitignore, that's probably the cause (?)

Not sure if that was the issue as find doesn’t check gitignore at all, the default find command ignores the git folder not gitignore, this functionality isn’t supported by find.

Thanks, that makes sense.


Dylib Hijack not working

EmPyre Version
1.0.1
OS Information (Linux flavor, Python version)
Darwin 15.6.0 Darwin Kernel Version 15.6.0: Mon Aug 29 20:21:34 PDT 2016; root:xnu-3248.60.11~1/RELEASE_X86_64 x86_64
Aka El Capitan
Expected behavior and description of the error, including any actions taken immediately prior to the error. The more detail the better.
The Dylib Hijacker scanner and Creator do not work.  The scanner produces no output.  When I run --debug and copy the code onto the host, it works.  But not from the server.
Same goes for the Hijacker.  Nothing in the console.  Ran on the host, it "seems" to work.
Screenshot of error, embedded text output, or Pastebin link to the error

Scanner module ran Locally.  Seems to work.
Config of CreateHijacker:
 Name                Required    Value
  ----                --------    -------
  LittleSnitch        True        True
  VulnerableRPATH     True        /Applications/Xcode.app/Contents/Frameworks/DVTFoundation.framework/Versions/A/DVTFoundation
  Agent               True        None
  Listener            True        newtest
  LegitimateDylibPath True        /Applications/Xcode.app/Contents/SharedFrameworks/DVTFoundation.framework/DVTFoundation
  UserAgent           False       default
  Arch                True        x64

Sceenshot of the debug script run on the host.  Output shows that it was successful.  Evil Dylib shows up where it is supposed to be.  Running Xcode does not spawn listener.

I tested this and it looks like the Dylib isn't being created properly. I'll have to review the logic for that and get back to you.

@n00py Can you test this again in the dev branch? I just pushed some code that hopefully fixes the CreateHijacker module.
In regards to the HijackScanner, how long did you wait to view the results? The scan takes roughly 3-4 mins with default settings, depending on the number of dylibs/macho's binaries present on the system. Can you try the scanner module again and wait 3-5 mins for output? Let me know.

Just tried, still no luck.
git clone -b dev https://github.com/adaptivethreat/EmPyre.git
Server is Debian 8
Host is El Capitan
Spartan@Leo:/Applications/Xcode.app/Contents/Frameworks/DVTFoundation.framework/Versions/A$ ls -lah
total 24
drwxr-xr-x  3 root  wheel   102B Oct  3 20:03 ./
drwxr-xr-x  3 root  wheel   102B Sep 29 22:11 ../
-rwxrwxrwx  1 root  wheel   8.8K Oct  3 20:03 DVTFoundation*
Spartan@Leo:/Applications/Xcode.app/Contents/Frameworks/DVTFoundation.framework/Versions/A$
I get no output in the terminal for either script.
It's still creating the Dylib, at least.  Maybe it's just me.

Ok, after some testing and review of the module code, the dylib's are being created properly. It looks like the issue may be with Xcode itself. I am currently using Xcode v8. I know that the hijack worked for the previous version. Can you try to use the CreateHijacker module for another vulnerability? I was able to successfully hijack the PhotoStreamAgent for iPhoto. Additionally, can you set the env variable for DYLD_PRINT_RPATHS with export DYLD_PRINT_RPATHS="1"? After completing, the module, be sure the open the application through terminal. The output should show whether the rpath leading to the hijacker successfully expanded or not. I will try to review the release notes for the new version and any recent patches to pinpoint if there has been any changes specific to dylib hijacking vulnerabilities. Keep in mind that dylib hijacks vary depending on the application and how library functions are called upon. So you may find that some hijacks don't work at all or only work when certain functionality is used.
In regards to the HijackScanner I am not able to reproduce this issue. I receive output from the module after waiting roughly 4 minutes. I am going to test the module on OSX El Capitan at some point today.

I'm going to go ahead and close this.


Change chat tab title

Add an option to change chat tab title (only for private)

The configuration of the chat names etc. is currently on the website, since there's a lot of additional options avaible. Link to those settings should be beneath the login-form.


Small improvements

Went through my markdown file and implemented some stuff:

Improved native menu: More accelerators and "Reveal in Finder" for markdown file and template folder
directly overwrite the global Reveal object, so users don't have to call RevealEditor.initialize etc.
Also overwrite the configure function with our custom options.
Introduce a variable MOONSLIDE_ENV, which is one of the values preview-small, preview-fullscreen, export so users can customize their entry script.

Don't merge yet, still has some problems, I noticed


Question: connecting to a multi-CPO/multi-eMSP platforms

Have you taken into account the connection to a multi-CPO or multi-eMSP platforms?
As I can see, the library is using the platformUrl as an identifier for finding the platform in the repo.
If a part wants to connect to another part that is in a platform that provides a service to many CPOs or eMSPs, the platformUrl may be the same, but the identifier will be the Authorization token and the country_code and party_id fields.

PlatformRepository is only used by the ocpi-toolkit to handle credentials-related subjects (checking tokens, using tokens, handshake with a partner). In every one of these subjects, a partner is identified by its platform url. So I think it's right to identify a partner by its URL for these use cases. In the credentials object, a partner can send multiple CredentialsRole, so if a partner has differents roles, it should send all its roles through the roles fields during registration (this information will be stored in 0.0.15).
Then, it's up to the person that uses the ocpi-toolkit lib to extend PlatformRepository and add their own methods if needed. Example: searchOnePlatformByCountryCodeAndPartyId(...)
That was the initial approach, but we may be wrong. It works well in our test scenarios.

The case where it may not work is when a partner, let's say partner-a.com registers as CPO, and then wants to register as eMSP separately. In that case, the platformUrl will be the same.
I thought that our approach was enough given the fact that a partner can send many CredentialRole during registration. So every partner, identified by their url should register only once.
Can you describe precisely the case where our approach would not work ?

Forget it. I got confused with 2.1.1. In 2.2.1 it is already explained correctly in section "7.3.1. Credentials object":

A platform can have the same role more than once, each with its own unique party_id and country_code, for example when a CPO provides 'white-label' services for 'virtual' CPOs.

Thanks for your response.


block_on RFC

We saw https://github.com/rust-lang/rust/pull/65875 closed and requiring an RFC. The working group should probably pick this up.

I believe that if we can get a block_on that makes the whole async/await zero cost then this can be really amazing, and then libraries can default to async functions and you can easily convert those to blocking by calling block_on (and maybe in the future it could be part of the language).
Is this even feasible?
Can this:
async fn something(inputs) -> return;

fn main() {
   block_on(something(...));
}

optimize the same as this?
fn something(input) -> return;

fn main() {
something(...);
}

Right now futures_executor::block_on is 100% not zero cost even for the simplest functions.
async: https://play.rust-lang.org/?version=stable&mode=release&edition=2018&gist=42ad7fb49c98eba138816825153b37ae
regular: https://play.rust-lang.org/?version=stable&mode=release&edition=2018&gist=42ad7fb49c98eba138816825153b37ae
(look at the ASM difference)

I believe that if we can get a block_on that makes the whole async/await zero cost then this can be really amazing, and then libraries can default to async functions and you can easily convert those to blocking by calling block_on (and maybe in the future it could be part of the language, which will then remove the need for a separate async-std).

Doing something "async", e.g. non-blocking I/O, but then blocking is often more costly than doing blocking I/O. So I don't think this is possible for many operations.


Add Crucible and Tumbaga

Crucibles are crafting stations that convert multiple items and some kind of magic energy into other items or brews

[ ] Add a crucible
[ ] Add Tumbaga - copper and gold alloy

Ideas for crucible recipes:

Chorus fruits from something like ender pearls + magic item, so that you can craft Comet Warp focus earlier in the game

 Add Crucible


Unable to find a pod with name, author, summary, or description matching KSPhotoBrowser

Unable to find a pod with name, author, summary, or description matching KSPhotoBrowser
gem
version:2.6.7
source: https://gems.ruby-china.org/
cocoapods
version:1.2

pod 'KSPhotoBrowser', :git => 'https://github.com/skx926/KSPhotoBrowser'

You can run commands below line by line and then retry:
pod setup
rm ~/Library/Caches/CocoaPods/search_index.json


s/consumergoup/consumergroup/g

This Pull Request fix a typo while logging consumer metadata.

Thanks!


Possible to disable JWT authorization for testing?

Hey,
I am using your excellent library to add JWT based authorization to my FastAPI app. But now I am at a point where I would like to add unit test to my project to check my routes. And for this I would like to disable authorization.
Based on my research this should be doable with app.dependency_overrides , see https://fastapi.tiangolo.com/advanced/testing-dependencies/.
But because we are not actually passing a method to Security I am not sure what to override. I tried passing the same Depends(get_access_security()) code with which I created the dependency annotation into the override, but this does not work.
Therefore I wanted to ask what exactly I should override or if there is another option to disable authorization for my testing purposes.
Below are the relevant snippets from my source code.
config.py
@lru_cache
def get_access_security() -> JwtAccessBearerCookie:
    """Return an JWT access security object to generate and test access tokens.

    Returns:
        JwtAccessBearerCookie: The access security.
    """
    return JwtAccessBearerCookie(
        secret_key=settings.secret_key,
        auto_error=True,
        access_expires_delta=settings.access_expires_delta,
    )

AccessSecurityDependency = Annotated[
    JwtAuthorizationCredentials,
    Depends(get_access_security()),
]

route
 @router.patch(
        "/api/calibration-order/id/{id}",
        response_model=CalibrationOrder,
        response_model_exclude_unset=True,
    )
    async def update_calibration_order_by_id(
        id: str,
        patch: list[dict],
        credentials: AccessSecurityDependency,
    ) -> CalibrationOrder:

py test fixture
@pytest.fixture()
def client_authenticated() -> Generator[TestClient, Any, None]:
    """
    Pytest fixture that yields an instance of TestClient which skips the authentication.

    Yields:
        Generator[TestClient, Any, None]: An instance of the TestClient.
    """

    def get_access_security_override() -> None:
        return None

    app.dependency_overrides[
        Depends(get_access_security())
    ] = get_access_security_override
    with TestClient(app) as c:
        yield c

you can try switch auto_error to false

My problem was that I could not override the original security dependency. I guess setting auto_error always to False and adding a new dependency, which I can then override, atop of this library could work.  🤔
But I already choose  to just reimplement the functionality as functions instead of classes, so that I can override them with FastAPIs
dependency_overrides.
Thanks for the suggestion though 👍


z-index position problem when put control in modal window

When add the component in a modal window, the clock canvas selection not appears.  When the modal window close, then the canvas appears.

I guess the Z-index is lower than the window and it gets hidden in the background.
I'll look into it.

I fix the problem in the application that i develope.
I fixed adding z-index in the next panel class, like other components do in vaadin styles.
.c-TimeSelector-popup {
background-color: white;
z-index: 90000;
}


get_class_hash_at syscall

System call that allows getting the class hash of a given address. Closed by https://github.com/starkware-libs/cairo/pull/6407


Fix 3D move_and_slide with stop_on_slope

Fixes #28412
KinematicBody::move_and_slide with p_stop_on_slope = true was reversing the entirety of the movement deemed as sliding on a slope, instead of just the movement along the plane defined by p_floor_direction, causing the body to hover above a ground collider in certain cases, then noticeably snap down to it when the movement changed.
Also applies to 3.1

KinematicBody::move_and_slide_with_snap also has the same option for p_stop_on_slope so it's worth checking that function too.
https://github.com/godotengine/godot/blob/81f62d68c2e2f244671ecfa31e6e12809bfe2f4d/scene/3d/physics_body.cpp#L1262

I've looked at KinematicBody::move_and_slide_with_snap before, but didn't see anything out of the ordinary. On the closer inspection, that bit you've highlighted does indeed "ensure that motion happens on floor direction", but the new motion isn't a projection, so it will be different length than it should.
Might be related to #24874

I can confirm that it fixes #28412, so let's merge.
For the reference, the change to stop_on_slope_with_snap doesn't seem to solve #24874.

Thanks!


Re-apply "SwiftSyntax: Teach SwiftSyntax to use SourceKitd to serialize syntax trees. (#14424)"

@swift-ci please smoke test

@swift-ci please test source compatibility

@swift-ci please test source compatibility

@swift-ci please test source compatibility

@swift-ci please smoke test

@swift-ci please smoke test

@swift-ci please test

@swift-ci please test source compatibility

Build failed
Swift Test OS X Platform
Git Sha - b68deb099c7c06068bf9faf8c9c38569650dc5f3

@swift-ci please test

Build failed
Swift Test Linux Platform
Git Sha - 03a00ed56887ab9a5934a4030cd82c4da04dbbf1

Build failed
Swift Test OS X Platform
Git Sha - 03a00ed56887ab9a5934a4030cd82c4da04dbbf1

@swift-ci please smoke test

@swift-ci please smoke test

@swift-ci please test source compatibility

@swift-ci please test source compatibility

@swift-ci Please clean test

Build failed
Swift Test OS X Platform
Git Sha - 03a00ed56887ab9a5934a4030cd82c4da04dbbf1

Build failed
Swift Test Linux Platform
Git Sha - 03a00ed56887ab9a5934a4030cd82c4da04dbbf1

@swift-ci please test source compatibility

@swift-ci please smoke test

@swift-ci please test source compatibility

@swift-ci please test source compatibility

@swift-ci please smoke test

@swift-ci please test source compatibility

@swift-ci please test

Build failed
Swift Test Linux Platform
Git Sha - a5a58f8e264f83f9adb9eb0f5dc3566a94cf5b30

@swift-ci Please test OS X platform

Build failed
Swift Test OS X Platform
Git Sha - a5a58f8e264f83f9adb9eb0f5dc3566a94cf5b30

All tests passed. 🚢

Testing for the source compatibility suite is broken with
/Users/buildnode/jenkins/workspace-private/swift-PR-source-compat-suite/swift/tools/SwiftSourceKitClient/SourceKitdClient.swift:15:8: error: no such module 'sourcekitd'
import sourcekitd
       ^

I think it might be a missing dependency somewhere.

@nkcsgexi , I had to revert this and https://github.com/apple/swift/pull/14497 in https://github.com/apple/swift/pull/14499, because the source compatibility suite testing was broken with the error above. Sorry :(

@DougGregor thank you for reverting! I remember I've tested the source compatibility suite and the tests passed : (
I'll take a look today.


Special handling for the write ledger

Signed-off-by: Ian Costanzo<EMAIL_ADDRESS>Issue https://github.com/hyperledger/aries-cloudagent-python/issues/2002

@6U-U9

Codecov Report

Merging #2030 (2309522) into main (6629d7d) will decrease coverage by 0.00%.
The diff coverage is 83.33%.

@@            Coverage Diff             @@
##             main    #2030      +/-   ##
==========================================
- Coverage   93.49%   93.48%   -0.01%
==========================================
  Files         539      539
  Lines       34637    34646       +9
==========================================
+ Hits        32383    32389       +6
- Misses       2254     2257       +3

Looking into the following error reported by @shaangill025 :
Hi Ian, regarding PR#2030, sorry I didn’t have my multi_ledger_config setup correctly earlier but upon testing again, I get the following error:
Traceback (most recent call last):
  File "/home/indy/aries_cloudagent/ledger/indy.py", line 639, in fetch_credential_definition
    ) = await indy.ledger.parse_get_cred_def_response(response_json)
  File "/home/indy/.pyenv/versions/3.6.13/lib/python3.6/site-packages/indy/ledger.py", line 682, in parse_get_cred_def_response
    parse_get_cred_def_response.cb)
  File "/home/indy/.pyenv/versions/3.6.13/lib/python3.6/asyncio/futures.py", line 327, in __iter__
    yield self  # This tells Task to wait for completion.
  File "/home/indy/.pyenv/versions/3.6.13/lib/python3.6/asyncio/tasks.py", line 250, in _wakeup
    future.result()
  File "/home/indy/.pyenv/versions/3.6.13/lib/python3.6/asyncio/futures.py", line 243, in result
    raise self._exception
indy.error.LedgerNotFound

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/indy/aries_cloudagent/core/event_bus.py", line 121, in notify
    await processor()
  File "/home/indy/aries_cloudagent/messaging/credential_definitions/routes.py", line 527, in on_cred_def_event
    endorser_connection_id=endorser_connection_id,
  File "/home/indy/aries_cloudagent/revocation/indy.py", line 64, in init_issuer_registry
    raise RevocationNotSupportedError("Credential definition not found")
aries_cloudagent.revocation.error.RevocationNotSupportedError: Credential definition not found


Automated cherry pick of #9470

Cherry pick of #9470 on release-6.3.
/cc  @pablovelezvidal
NONE

Will try to auto merge this PR once all tests and checks are passing. This might take up to an hour.

Trying to auto merge this PR.

Pull Request successfully merged
SHA: 4aa5eb785d4bbae6c147b29d659217702c73f504


Tests: state loader tests

Description
Add more tests for state loader.

For contributor use:

[x] Targeted PR against master branch
[ ] Linked to Github issue with discussion and accepted design OR link to spec that describes this work
[x] Code follows the standards mentioned here
[x] Updated relevant documentation
[x] Re-reviewed Files changed in the Github PR explorer
[x] Added appropriate labels

Codecov Report

Merging #412 (25ab3b9) into master (f3eb6a1) will increase coverage by 0.26%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master     #412      +/-   ##
==========================================
+ Coverage   55.24%   55.50%   +0.26%
==========================================
  Files          36       36
  Lines        1906     1906
==========================================
+ Hits         1053     1058       +5
+ Misses        718      711       -7
- Partials      135      137       +2

Flag
Coverage Δ

unittests
55.50% <ø> (+0.26%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

pkg/flowkit/state.go
60.41% <0.00%> (+5.20%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f3eb6a1...25ab3b9. Read the comment docs.