Malformed maven project while building context

I've tried to install latest upstream Camel K and the default contexts are not being created because of an error:
[ERROR] [ERROR] Some problems were encountered while processing the POMs:
  | [ERROR] Malformed POM /tmp/builder-441205255/maven/pom.xml: Expected root element 'project' but found 'Project' (position: START_TAG seen ...ng="UTF-8"?>\n<Project xmlns="" xmlns:xsi="" xsi:schemaLocation="">... @2:54)  @ /tmp/builder-441205255/maven/pom.xml, line 2, column 54
  | [ERROR] 'modelVersion' is missing. @ line 3, column 17
  | [FATAL] 'groupId' is missing. @ line 4, column 12
  | [FATAL] 'artifactId' is missing. @ line 5, column 15
  | [FATAL] 'version' is missing. @ line 6, column 12
  | @
  | [ERROR] The build could not read 1 project -> [Help 1]
  | [ERROR]
  | [ERROR]   The project [unknown-group-id]:[unknown-artifact-id]:[unknown-version] (/tmp/builder-441205255/maven/pom.xml) has 5 errors
  | [ERROR]     Malformed POM /tmp/builder-441205255/maven/pom.xml: Expected root element 'project' but found 'Project' (position: START_TAG seen ...ng="UTF-8"?>\n<Project xmlns="" xmlns:xsi="" xsi:schemaLocation="">... @2:54)  @ /tmp/builder-441205255/maven/pom.xml, line 2, column 54 -> [Help 2]
  | [ERROR]     'modelVersion' is missing. @ line 3, column 17
  | [ERROR]     'groupId' is missing. @ line 4, column 12
  | [ERROR]     'artifactId' is missing. @ line 5, column 15
  | [ERROR]     'version' is missing. @ line 6, column 12
  | [ERROR]
  | [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
  | [ERROR] Re-run Maven using the -X switch to enable full debug logging.
  | [ERROR]
  | [ERROR] For more information about the errors and possible solutions, please read the following articles:
  | [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
  | [ERROR] [Help 2] http://cwiki.apache.org/confluence/display/MAVEN/ModelParseException

I've noticed it too. I think this is only the spring-boot context that is not right. The others work as expected.

We need to fix it but I would recommend to remove spring boot as part of the default context in any case


Add appendObjectName

Currently, the only way I can find to mutate an object with a collection is to update the collection and insert my new member of the collection along with the existing members.
Is it possible to have a mutation to append a list?

This is currently tracked in https://github.com/realm/realm-graphql-service/issues/28. It's not currently possible, but we're exploring options to enable that. In theory, it shouldn't be too hard to do but hasn't been prioritized yet.


v0.2.0

Codecov Report

Merging #2333 (c04a9a0) into main (0036180) will decrease coverage by 0.01%.
Report is 4 commits behind head on main.
The diff coverage is n/a.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2333      +/-   ##
==========================================
- Coverage   64.81%   64.80%   -0.01%
==========================================
  Files         129      129
  Lines       15171    15171
==========================================
- Hits         9833     9832       -1
- Misses       5338     5339       +1

Hey, do you want me to update the MirgationGuide.md file for this? Or is it fine to leave it as it is for now?

@YJDoc2 I forgot about it 🤦♂May I ask you to do it? But it is not rushing because we can update it after releasing v0.2.0

Changes that will occur for properly running in rootless mode : TODO (@YJDoc2)

@YJDoc2 I forgot about it 🤦♂May I ask you to do it? But it is not rushing because we can update it after releasing v0.2.0

I'll open a PR in few minutes, it is not a big change.

@utam0k https://github.com/containers/youki/pull/2334 :eyes:
Also I think for this PR (releasing 0.2.0) feature label would be more appropriate than cleanup.


catppuccin is broken due to the rewrite with palettes

the theme had a big rewrite because it supports palettes now.
cannot load it anymore :(

fixed via https://github.com/abzcoding/lvim/commit/040a3274a288d1b71bef3c8324d41aa39d81fe2c

have you tried it?
space s c and when i select catppuccin i get this. all other themes are working
E5108: Error executing lua .../start/telescope.nvim/lua/telescope/builtin/internal.lua:973: Vim(lua):E5108: Error executing lua ...ack/packer/opt/catppuccin/lua/catp
puccin/core/mapper.lua:219: module 'catppuccin.core.palettes.init' not found:
        no field package.preload['catppuccin.core.palettes.init']
        no file '/nix/store/2i8966gpj3b464mlar7lp4hnpynb6f5n-luajit-2.1.0-2022-04-05-env/share/lua/5.1/catppuccin/core/palettes/init.lua'
        no file '/nix/store/2i8966gpj3b464mlar7lp4hnpynb6f5n-luajit-2.1.0-2022-04-05-env/share/lua/5.1/catppuccin/core/palettes/init/init.lua'
        no file '/Users/luxus/.cache/lvim/packer_hererocks/2.1.0-beta3/share/lua/5.1/catppuccin/core/palettes/init.lua'
        no file '/Users/luxus/.cache/lvim/packer_hererocks/2.1.0-beta3/share/lua/5.1/catppuccin/core/palettes/init/init.lua'
        no file '/Users/luxus/.cache/lvim/packer_hererocks/2.1.0-beta3/lib/luarocks/rocks-5.1/catppuccin/core/palettes/init.lua'
        no file '/Users/luxus/.cache/lvim/packer_hererocks/2.1.0-beta3/lib/luarocks/rocks-5.1/catppuccin/core/palettes/init/init.lua'
        no file '/nix/store/2i8966gpj3b464mlar7lp4hnpynb6f5n-luajit-2.1.0-2022-04-05-env/lib/lua/5.1/catppuccin/core/palettes/init.so'
        no file '/Users/luxus/.cache/lvim/packer_hererocks/2.1.0-beta3/lib/lua/5.1/catppuccin/core/palettes/init.so'
        no file '/nix/store/2i8966gpj3b464mlar7lp4hnpynb6f5n-luajit-2.1.0-2022-04-05-env/lib/lua/5.1/catppuccin.so'
        no file '/Users/luxus/.cache/lvim/packer_hererocks/2.1.0-beta3/lib/lua/5.1/catppuccin.so'
stack traceback:
        [C]: in function 'require'
        ...ack/packer/opt/catppuccin/lua/catppuccin/core/mapper.lua:219: in function 'apply'
        .../site/pack/packer/opt/catppuccin/lua/catppuccin/main.lua:18: in function 'load'
        .../site/pack/packer/opt/catppuccin/lua/catppuccin/main.lua:30: in function 'main'
        .../site/pack/packer/opt/catppuccin/lua/catppuccin/init.lua:4: in function 'load'
        [string ":lua"]:1: in main chunk
        [C]: in function 'cmd'
        .../start/telescope.nvim/lua/telescope/builtin/internal.lua:973: in function 'run_replace_or_original'
        ...packer/start/telescope.nvim/lua/telescope/actions/mt.lua:65: in function 'select_default'
        /Users/luxus/.config/lvim/lua/user/telescope.lua:13: in function '_multiopen'
        /Users/luxus/.config/lvim/lua/user/telescope.lua:44: in function 'key_func'
        ...k/packer/start/telescope.nvim/lua/telescope/mappings.lua:242: in function 'execute_keymap'
        [string ":lua"]:1: in main chunk
stack traceback:
        [C]: in function 'cmd'
        .../start/telescope.nvim/lua/telescope/builtin/internal.lua:973: in function 'run_replace_or_original'
        ...packer/start/telescope.nvim/lua/telescope/actions/mt.lua:65: in function 'select_default'
        /Users/luxus/.config/lvim/lua/user/telescope.lua:13: in function '_multiopen'
        /Users/luxus/.config/lvim/lua/user/telescope.lua:44: in function 'key_func'
        ...k/packer/start/telescope.nvim/lua/telescope/mappings.lua:242: in function 'execute_keymap'
        [string ":lua"]:1: in main chunk

@luxus if you want to dynamically load catpuccin using <leader>sc , you need to make sure that it is loaded and configured already, therefore you would need these changes
diff --git a/lua/user/plugins.lua b/lua/user/plugins.lua
index 929bb1c..a818350 100644
--- a/lua/user/plugins.lua
+++ b/lua/user/plugins.lua
@@ -38,11 +38,12 @@ M.config = function()
       end,
       config = function()
         require("user.theme").catppuccin()
-        vim.cmd [[colorscheme catppuccin]]
+        -- vim.cmd [[colorscheme catppuccin]]
       end,
       cond = function()
-        local _time = os.date "*t"
-        return (_time.hour >= 17 and _time.hour < 21) and lvim.builtin.time_based_themes
+        return true
+        -- local _time = os.date "*t"
+        -- return (_time.hour >= 17 and _time.hour < 21) and lvim.builtin.time_based_themes
       end,
     },
     {

otherwise, it would only work between 17 and 21

thank, i was irritated because this only happened with cappuccin

i still not get it working as a main theme
https://github.com/luxus/lvim/commit/8c3459675b223b2411cbae88508af4367cdcccd3

@luxus For me I have this in my catpuccin() within theme.lua and it's loading up for me. Possibly you can see if this works for you as well.
M.catppuccin = function()
  local catppuccin = require "catppuccin"
  catppuccin.setup {
    transparent_background = true,
    dim_inactive = {
      enabled = true,
      shade = "dark",
      percentage = 0.25,
    },
    term_colors = false,
    styles = {
      comments = { "italic" },
      keywords = { "italic" },
      loops = { "bold" },
      types = { "bold" },
    },
    integrations = {
      lsp_trouble = true,
      lspsaga = true,
      nvimtree = {
        enabled = true,
        transparent_panel = true,
      },
      which_key = true,
      lightspeed = lvim.builtin.motion_provider == "lightspeed",
      hop = lvim.builtin.motion_provider == "hop",
      notify = true,
      navic = true,
      ts_rainbow = true,
    },
  }
end

Using newer formatting, you can comment out the extensions you don't need
Inside of plugin:
    {
      "catppuccin/nvim",
      as = "catppuccin",
      config = function()
        require("user.theme").catppuccin()
      end,
    },

Then for lvim configuration on theme setting in config.lua
lvim.colorscheme = "catppuccin"


Example on how to test a function

In the examples here, I think it misses one that shows how to test a specific function in a script.
For example, in a directory organised like that, as describe in your quickstart guide,
.
├── lib
│   └── bashunit
├── example.sh
└── tests
    └── example_test.sh

I am not sure what I have to write in example_test.sh to test a function in example.sh. Should I source example.sh ? But according to your own tests (for example  here)  it doesn't seem to be the case.

Hello @pmusset ! First of all, thank you very much for using bashunit!
You are correct, you should add source example.sh at the beginning of your example_test.sh, personally, I recommend you do it within the set_up function.
function set_up() {
  source example.sh
}

This way, all the functions within the file will be loaded from scratch before each test inside that file is executed.
In the example you mentioned, we are not using source because bashunit uses itself for testing, so it doesn't need to import its own functions as they have already been imported previously in the runtime.
But the standard is to have to do it.
I hope I have resolved your doubts and if you have any other questions do not hesitate to let us know.

I also wanted to thank you for giving us feedback on the example @pmusset . You are absolutely right. I will add it as soon as possible, but if you want, you can do it yourself and make us a PR, we would really appreciate it a lot.

Thanks for your feedback, @pmusset. I created this PR to split the example into two: one to test bash functions and another to test an executable bash script. Does this helps?

@pmusset, that would depend on the way you are designing your logic.
There is no right or wrong here, and for either way, you can have tests for it.
My personal preference:

I prefer to have isolated functions and test them from an isolated perspective for small/unit tests.
And then, also some more generic tests which need to be "sourcing" the whole file as that's how you execute a bash script in the end.

Closed as the question was answered and the example code was improved here https://github.com/TypedDevs/bashunit/pull/234


html char code displayed

Hello,
I noticed a problem with the FR translation in Zulip 5.6. It seems that the ' char is not well displayed (at least at some place).

Users => Manage user =>

Should be "Désactiver l'utilisateur"

Manage Streams => General => Add subscribers

Should be "Ajouter des abonnés. Utilisez le groupe d'utilisateurs ou #nomducanal pour ajouter des abonnés en masse.""

Manage Streams => Add a stream => Choose subscribers

Should be "Ajouter des abonnés. Utilisez le groupe d'utilisateurs ou #nomducanal pour ajouter des abonnés en masse."

@zulipbot claim

The next step here is to check whether this bug is still reproducible.

Hello,
In 8.0-dev-1582-g8867db3532 it seems to be ok.

Manage Streams => General => Add subscribers
Manage Streams => Add a stream => Choose subscribers

This tow are ok, I was not able to check for Users => Manage user => in the zulip public chat.
I think we can close this issue.
Thank you.


Major rework: more lean, concise, comprehensible, and secure.

Verified locally on three distinct machines that everything is working as expected.


Fix whitebalance and boost brightness a bit

What would be the white-balance calibration process? And can we save the values somehow so we don't have to run it on every pi-boot..?


Error: cannot find attribute max_ Length in this scope

Setup
Versions

Rust: rustc 1.74.0-nightly (b4e54c6e3 2023-09-11)
Diesel: lastest
Database: mysqlnd 8.1.2
Operating System Windows 10 MSVC

Feature Flags

mysql
numerical
serde_json
uuid

/
/
Problem Description
Previously, using diesel migration run can be used
But there was an error updating Nightly on September 11, 2023
Error: cannot find attribute max_ Length in this scope
-->Src schema.rs:66:11
|
66 | # [max_length=64]
|^^^^^^^^^^
Find the problem
I have a definition similar to this
Diesel:: table! {
Once (a){
#[max_length=64]
a>Varchar,
b -> Nullable,
c ->Timestamp,
d ->Nullable,
e ->Integer,
#[max_length=255]
f ->Varchar,
#[max_length=255]
g ->Nullable,
}
}
All errors here are similar.
I have already configured libMySQL and completed the architecture of the MySQL server. In fact, I was able to use it normally a month ago.
Thank you for any help you have given me
I have checked all examples and issues, and I may not be familiar with diesel, so I cannot find a feasible solution.
May I ask if I am missing any steps?
What are you trying to accomplish?
I hope the compilation is successful
What is the expected output?
What is the actual output?
Error: cannot find attribute max_ Length in this scope
-->Src schema.rs:66:11
|
66 | # [max_length=64]
|^^^^^^^^^^
Are you seeing any additional errors?
no
Steps to reproduce
DROP TABLE IF EXISTS smthin;
CREATE TABLE smthin(
a VARCHAR(32) NOT NULL   COMMENT 'uuid' ,
b FLOAT(24,4) NOT NULL  DEFAULT 0 COMMENT 'number' ,
c VARCHAR(32) NOT NULL   COMMENT 'createor' ,
d TIMESTAMP NOT NULL  DEFAULT CURRENT_TIMESTAMP COMMENT 'ctime' ,
e TIMESTAMP NOT NULL  DEFAULT CURRENT_TIMESTAMP COMMENT 'rtime' ,
f VARCHAR(32)   DEFAULT 'NULL' COMMENT 'uor' ,
g TIMESTAMP NOT NULL  DEFAULT CURRENT_TIMESTAMP COMMENT 'uptime' ,
PRIMARY KEY (a)
)  COMMENT = 'somethings';
powershell input:
diesel migration generate create_posts
Creating migrations\2023-09-13-132744_create_posts\up.sql
Creating migrations\2023-09-13-132744_create_posts\down.sql
PS X:\Project\RustProject\a> diesel migration run
Running migration 2023-09-13-132744_create_posts
cargo build
-----Some of the same mistakes
--> src\schema.rs:220:11
|
220 |         #[max_length = 255]
|           ^^^^^^^^^^
error: cannot find attribute max_length in this scope
-----Some of the same mistakes
Checklist

[x] I have already looked over the issue tracker and the discussion forum for similar possible closed issues.

[ ] This issue can be reproduced on Rust's stable channel. (Your issue will be
closed if this is not the case)
[x] This issue can be reproduced without requiring a third party crate

That seems like you use an incompatible version combination of diesel and diesel-cli. While diesel maintains backward compatibility to old diesel-cli versions, it does not maintain forward compatibility to new versions. That also indicates that you inaccurate version description (latest) is not actually the latest version. Its always helpful to be more accurate there.
Closed as this is an user error.


{Role} az ad sp create-for-rbac: Stop setting identifierUris on app

Context
az ad sp create-for-rbac creates an app for the service principal. The command specifies idefntifierUris on the app:

if --name <name> is provided, identifierUris will be set to http://<name>
if --name <name> is not provided, identifierUris will be set to http://azure-cli-%Y-%m-%d-%H-%M-%S

Per https://identitydocs.azurewebsites.net/static/v2/first_party_alert_appiduri_verifieddomain.html, AAD will block app creation with invalid idefntifierUris in the near future (planned to be end of June). Valid forms are:
Valid api schemes:

api://{appId}
api://{tenantId}/{appId}
api://{tenantId}/{string}

Other Uri schemes:

https://{verifiedCustomerDomain}/{string}
https://{string}.{verifiedCustomerDomain}
https://{string}.{verifiedCustomerDomain}/{string}

Changes
az ad sp create-for-rbac shouldn't make any assumption and derive identifierUris from --name as identifierUris can be unspecified, so CLI will not use --name to derive identifierUris to create the app anymore. The app will be created without identifierUris to avoid being blocking by AAD.
Before:
> az ad sp create-for-rbac --skip-assignment
{
  "appId": "749a8a29-008d-4d1a-b28e-105a086cadc8",
  "displayName": "azure-cli-2021-05-31-08-38-15",
  "name": "http://azure-cli-2021-05-31-08-38-15",    <<<<
  "password": "AYii...",
  "tenant": "54826b22-38d6-4fb2-bad9-b7b93a3e9c5a"
}

The name property in the output is a property invented by Azure CLI itself (the service principal object doesn't have a name property). It maps to servicePrincipalNames which is a combination of idefntifierUris and appId:
> az ad sp show --id 749a8a29-008d-4d1a-b28e-105a086cadc8
  ...
  "servicePrincipalNames": [
    "http://azure-cli-2021-05-31-08-38-15",
    "749a8a29-008d-4d1a-b28e-105a086cadc8"
  ],

So we switch the value of name from identifierUri to appId. We are deprecating it and will remove it in the future.
After:
> az ad sp create-for-rbac --skip-assignment
{
  "appId": "5545b0f9-c100-488c-a55a-02719313f1b2",
  "displayName": "azure-cli-2021-05-31-08-37-30",
  "name": "5545b0f9-c100-488c-a55a-02719313f1b2",    <<<<
  "password": "j4Vu...",
  "tenant": "54826b22-38d6-4fb2-bad9-b7b93a3e9c5a"
}

> az ad sp show --id 5545b0f9-c100-488c-a55a-02719313f1b2
  ...
  "servicePrincipalNames": [
    "5545b0f9-c100-488c-a55a-02719313f1b2"
  ],

Con: This introduces inconsistency:

--name in the input command is used as displayName, while
name property in output represents servicePrincipalNames

Idempotence
az ad sp create-for-rbac is idempotent when the same --name (used as displayName) is provided. az ad sp create-for-rbac --name can be run multiple times:

Only the first execution creates new service principal and app
Following executions update the service principal/app with that displayName

This behavior differs from New-AzADServicePrincipal which creates a new service principal on each execution.
Limitation
Many customers are still using older versions of Azure CLI/PowerShell and we do not have control over their migration plan. This BREAKING CHANGE on AAD service side will affect users who are still using older version of Azure CLI/PowerShell.
Equivalent changes on Azure PowerShell

Changes made to New-AzADServicePrincipal: https://github.com/Azure/azure-powershell/pull/14952
Design spec: https://github.com/Azure/azure-powershell-cmdlet-review-pr/issues/895

History Notes
[Role] BREAKING CHANGE:  az ad sp create-for-rbac: --name is now only used as the displayName of the app. It is not used to generate identifierUris anymore. name in the output is now the same as appID (servicePrincipalNames) and deprecated.

Role

LGTM if all tests pass


Add Partial Content Delivery

This commits adds Partial Content Delivery, as asked in issue #93. This
enables the "Accept-Ranges" header on all files delivered via
static. It is possible to ask only a certain portion of bytes like
explicitely described in RFC 7233. Of the 3 ways to ask for a range of
bytes (byte x to byte y, everything from byte x to end of file, last y
bytes from end of file), every one of them is implemented, but if a
request is to ask multi ranges in a same request, this implementation
will only account the first range.
---- end of commit ----
Quite a big PR I have here, I hope it's not too much hassle. If you think there are better ways to structure my code, please tell me I'll fix that right away ! What is good coding to me might not be for iron, and I'm fine with that !
So basically it closes partially #93 . It works for a single range, but multiple ranges are not yet supported (that's why it doesn't close #93 totally in my opinion). Video seeking works fine though, in firefox, chrome or mpv, or whatever.
I'm missing tests as well, and I'd like support on that part. I must say that I'm not familiar with iron_test and your way of testing, and I don't really know what to test either. So if someone could comment on that part, that'd be nice.

This change is

Anything we can do to help support you in landing this PR?

If someone could help me on the test part of this PR, that's be great. I don't ask for anyone else to implement the tests themselves (although that'd be great), but if someone could give me a hint as to what to use in iron_test precisely, and which use cases require tests for this PR to land, that'd be a huge help.

Right, so I think you should be able to use ProjectBuilder like in the other tests (e.g. here: https://github.com/iron/staticfile/blob/master/tests/static.rs#L16) to create an app, a file and send a request that only accesses a range of that file and asserts that it only gets the range back.

It looks like https://github.com/iron/staticfile/pull/98#issuecomment-313885019 follows up on this so closing in favor of it.


Add custom df tags

Added get_custom_tag and set_custom_tag to the item class to get and set custom df tags. It functions the same as if you were to run the command /item tag set <tag_name> <tag_value> while holding an item in df. I modeled the functions after get_tag and set_tag in the Item class of mcitemlib.

I'd thought about adding something like this before, but I want the main purpose of this module to be for making DiamondFire templates, not items related to DF. If you're making a template that requires complicated items, you would be better off just making those items in game anyways, because items represented in any textual format get verbose very quickly. If you still need this kind of functionality, you can always extend the item class. Still, thank you for your request!


Hotfix/v0.1.1

Coverage report

This PR does not seem to contain any modification to coverable code.


Cannot attach Cassandra-Connector

Hi ,
I am trying to run the crossdata-client-examples by installing Crossdata-0.3.0-RC3-SNAPSHOT,
Started Crossdata server first and then started shell, then i started connectors of Cassandra and Deep.
After that i added DATASTORE, ATTACHED CLUSTER, ADDED CONNECTOR
While adding CONNECTOR i faced an exception:
[Driver] 30-05-2015 14:48:43.291 [ERROR|BasicDriver$] CrossdataManifest couldn't be parsed
Error parsing manifest:
com.stratio.crossdata.common.exceptions.ManifestException: javax.xml.bind.UnmarshalException

with linked exception:
[org.xml.sax.SAXParseException; lineNumber: 8; columnNumber: 13; cvc-complex-type.2.4.a: Invalid content was found starting with element 'Native'. One of '{RequiredProperties, OptionalProperties, SupportedOperations, Functions}' is expected.]

and then i deleted the true from the pom file..... after that connector is added sucessfully.
When i do Attach Connector to Cluster i got an error:
xdsh:root> ATTACH CONNECTOR CassandraConnector TO cassandra_prod WITH OPTIONS {'DefaultLimit': '1000'};
[Driver] 30-05-2015 14:52:16.061 [INFO|Shell] Query 77fd362c-5b75-4a85-ad79-7c289e71d147 in progress
xdsh:root>
Result: The operation for query 77fd362c-5b75-4a85-ad79-7c289e71d147 cannot be executed:
Connector connector.CassandraConnector is not connected.
When i give DESCRIBE CONNECTORS it shows:
xdsh:root:catalogTest> describe connectors;
[Driver] 30-05-2015 15:35:23.939 [INFO|Shell]
Connector: connector.CassandraConnector	OFFLINE	[]	[datastore.Cassandra]	UNKNOWN
Connector: connector.DeepConnector	ONLINE	[cluster.cassandra_prod, cluster.cassandra_clust]	[datastore.elasticsearch, datastore.cassandra, datastore.mongo, datastore.hdfs, datastore.jdbc, datastore.aerospike]	[akka.tcp://CrossdataServerCluster@<IP_ADDRESS>:34372/user/ConnectorActor/]
But i have Started both Cassandra and Deep connector by using the command:
target/cassandra-connector-0.4.0-SNAPSHOT/bin/cassandra-connector-0.4.0-SNAPSHOT start
target/stratio-connector-deep-0.4.0-SNAPSHOT/bin/stratio-connector-deep-0.4.0-SNAPSHOT start
Please help me what's gone wrong in this.
Thanks!

Hi Austin,
which version of the Cassandra Connector are you using?

Hi Austin,
The problem is you are using incompatible versions between Crossdata and Cassandra Connector.
You have two different solutions:

You can use our brand new release of Crossdata and Cassandra Connector (version 0.3.0). You can obtain those versions of the 0.3.0-RELEASE tag as well as the branch0.3. If you will do that you can follow the stepts that you did before without any problem.

You can use our new 0.4.0-SNAPSHOT version of Crossadata, and the same version of Cassandra Connector, (obtain that of the master of github project) and you can avoid the steps of the ADD DATASTORE and ADD CONNECTOR because this steps will execute automatically.

Please tell me if you have any more problems.

Hi,
I am using crossdata cassandra-connector 0.4.0 SNAPSHOT
On May 30, 2015 5:30 PM, "Miguel Angel Fernandez Diaz" <
<EMAIL_ADDRESS>wrote:

Hi Austin,
which version of the Cassandra Connector are you using?
—
Reply to this email directly or view it on GitHub
https://github.com/Stratio/stratio-connector-cassandra/issues/2#issuecomment-107031509
.

Hi Austin,
as my colleague jjlopezm said, you should use a version 0.3.X of Crossdata with a version version 0.3.X of the Cassandra Connector or a version 0.4.X of Crossdata with a version 0.4.X of the Cassandra Connector.
Please, let us know if this solves the issue.

Hi Miguel & Jjlopezm,
Thanks for your suggestions, i changed the version of Cassandra connector to 0.3.0 now its working fine.
Thank you!


Partial ROCm support for AMD Rdeon SSG Pro ?

Hey guys, after several GitHub issues :
here https://github.com/ROCmSoftwarePlatform/Tensile/issues/300 and
https://github.com/baidu-research/DeepBench/issues/105
I am under impression that, ROCm support for AMD SSD Pro is not fully operational. I also got to know that AMD SSD Pro is not one of the flagship deep learning GPUs. ROCm support should be generalised across entire range of radeon GPUs so that every faction can use it properly not just certain brands of radeon instinct GPUs. I have AMD Radeon Instinct SSD Pro and ROCm does not behave as intended with roubles giving me 1/10 of performance of MI25. I can extract 90% performance of GCN assembly level code but not from ROCm framework.
Why it is like this ? Any specific reason to do that ?

Hi @computingdolas ,
This seems to be a duplicate of the question you've asked in those other issues you raised. Your question seems to be: why does a particular piece of software running on top of ROCm not perform well. That is a question for that piece of software, I believe. The ROCm issue tracker shouldn't be a clearinghouse for questions about every piece of software that runs on top of it.
I believe that @sunway513 is incorrect to state that the Radeon SSG Pro is unsupported in the ROCm stack. ROCm may not support e.g. the on-board SSG memory, but I believe we still support it as a Vega 10 GPU. @dagamayank mentioned in his response that it is not currently an optimization target for AMD's deep learning software frameworks. Those are slightly different things.
If those issues come back with information indicating that there is a problem elsewhere in the ROCm stack, please feel free to open an issue related to that. At the moment, I'm closing this as a duplicate of issues reported elsewhere.

I think you misunderstood my question ? Let me reframe, why it is AMD SSD Pro is not currently a optimisation target although having same underlying architecture. Does this question does not bother how ROCm functions and its optimisation target architectures ?

I understand the question, and I'm saying that, from a technical perspective, this question is better suited for the deep learning frameworks, MIOpen, Tensile, or rocBLAS (depending on where the issue is manifesting). If they find that the performance regression is within their code, it is those projects that will need to track any fixes. If the problem lies elsewhere in the software stack (e.g. if something in the ROC runtime is causing this issue), then I'm OK re-raising this issue here with enough technical details to help target the bug report to the proper sub-project. At the moment, I believe the proper target of the report is the
From the perspective of "why is AMD not targeting the Radeon Pro SSG as an optimization target for MI workloads", I cannot comment on that.

Ok I understand that @jlgreathouse but I am really not happy with way that full ROCm support is available only for limited number of AMD GPUs.

@computingdolas  I am sorry your unhappy,  The required driver for RadeonPro  SSG is our AMDGPUpro driver.   ROCm should run on the Vega10 ASIC on board.   Now ROCm primary mission is not as a workstation driver, but for headless servers.  So when we enable solution like this we have to look at more robust and scalable solution then being used in the current AMDGPUpro driver which is the primary driver for this card.   And the solution has to work with our Radeon Instinct Product with Multiple GPU as well.
RadeonPro SSG  is workstation card,  Vega10 ASIC + PLX + SSD which Share PCIe Bus to the host.   What were you expecting was the benefit of SSG Card with Deep Learning.  The filesystem for Linux still needs CPU intervention so you now sharing the PCIe bus for SSD and GPU.  So current benefit is limited due to this issue above where we get PCIe conflicts using the current limits OS stack.
We have been exploring a proper solution for GPU and SSD communicate via more of Persistent Memory API supporting NVMe devices, but this is still a work in progress.  But we have to design for larger scale solution aka when multiple NVMe devices behind much larger  PCIe Switch on motherboard and also utilizing extra lanes of newer CPUs.  Also, deal with Multiple PCIe Root I/O.
Please be patient as we look this problem for the Domian we focused on for ROCm driver.  Deep Learning and HPC.
One thing AMDGPUpro will get the Full Deep Learning support, it just resourcing, focus and timing issue.   But you have it on AMDGPUpro Linux and Windows in the future.


29d1bb8 broke "open_with_trouble" functionality

Did you check docs and existing issues?

[X] I have read all the trouble.nvim docs
[X] I have searched the existing issues of trouble.nvim
[X] I have searched the existing issues of plugins related to this issue

Neovim version (nvim -v)
NVIM v0.11.0-dev-3317+ga9c89bcbf-Homebrew
Operating system/version
MacOS 14.5
Describe the bug
After upgrading to https://github.com/folke/trouble.nvim/commit/29d1bb81adc847e89ddbbf5b11ff0079daf7cc0a, open_with_trouble from telescope is empty.
I tried older commits and that one is the first one presenting the issue.
Here is my trouble config for reference: https://github.com/bellini666/dotfiles/blob/master/vim/lua/plugins.lua#L78
Steps To Reproduce

Use the latest version in main with my config
Search something with trouble
Use open_with_trouble functionality

Expected Behavior
Results to appear on trouble
Repro
-- DO NOT change the paths and don't remove the colorscheme
local root = vim.fn.fnamemodify("./.repro", ":p")

-- set stdpaths to use .repro
for _, name in ipairs({ "config", "data", "state", "cache" }) do
  vim.env[("XDG_%s_HOME"):format(name:upper())] = root .. "/" .. name
end

-- bootstrap lazy
local lazypath = root .. "/plugins/lazy.nvim"
if not vim.loop.fs_stat(lazypath) then
  vim.fn.system({ "git", "clone", "--filter=blob:none", "https://github.com/folke/lazy.nvim.git", lazypath, })
end
vim.opt.runtimepath:prepend(lazypath)

-- install plugins
local plugins = {
  "folke/tokyonight.nvim",
  "folke/trouble.nvim",
  -- add any other plugins here
}
require("lazy").setup(plugins, {
  root = root .. "/plugins",
})

vim.cmd.colorscheme("tokyonight")
-- add anything else here

Have you tried reading the trouble docs?
There's literally a section on Telescope in there....

Have you tried reading the trouble docs? There's literally a section on Telescope in there....

Hey folke,
Sorry, I think in a hurry the issue was not properly explained.
I know how to open with telescope and I have been using it for ages. The specific commit I linked here broke it. If I revert to the commit before that it works fine.
I can make a video later showing what is happening, but in short trouble opens but the results appear empty

Maybe related to commit 4eaaf9cf8b967010998ccfc4af525b3e6d70b8b5

Maybe related to commit 4eaaf9c

Not sure. I bisect the issue to the specific commit that I linked here.
Taking a quick look at it it doesn't make sense, but checking out the exact previous version, which does also contain that change you linked here, makes it still work fine

ok, sorry, didn't read that correctly.
Probably your deafult fold settings? I'll see to revert that commit and do it differently

ok, sorry, didn't read that correctly.
Probably your deafult fold settings? I'll see to revert that commit and do it differently

Np 😊
And regarding default fold settings, not sure... I have vim.opt.foldenable = false in my options as I don't like folds.
Let me know if you want me to try something locally here. I'll also try some options and let you know if I discover anything...

I think I was able to fix it. Would be great if you can confirm!

I think I was able to fix it. Would be great if you can confirm!

Tested it, the error is still there :(
I don't know if this will be helpful, but this is a video of the issue happening:
https://github.com/folke/trouble.nvim/assets/134025/b48b4b64-0672-47bf-9ad0-4200fa900776
This is a video of the same reproduction but forcing lazy to install https://github.com/folke/trouble.nvim/commit/13ad95902cf479b0fa091a77368af0e03b486fe3 (the commit before the broken one)
https://github.com/folke/trouble.nvim/assets/134025/130c5d2f-695a-46a8-8381-3e96e774c1d0
Let me know if that doesn't help and I'll try to create the MRE

My bad, can you check again?

My bad, can you check again?

Fixed now! :)
Thanks folke!


add users#update route

okay yeah, the if/else is presently unnecessary, but it will be maybe?

Coverage decreased (-56.0%) to 0.0% when pulling fbacb701b0f38f395071db1fae90c9c62212f827 on update-user into 754d089949d375270d58ca8c5496a21d3f2c7e34 on master.

Coverage decreased (-6.0%) to 50.0% when pulling 6d22c566e2f128047ba3c91a700ed9c6ca28ed23 on update-user into 754d089949d375270d58ca8c5496a21d3f2c7e34 on master.


new-router compatibility (spike - don't merge)

This demonstrates a potential way to make integrating with the new router api a little bit easier.
The $bindTo() method of a firebase object will now accept a component, so you can do this:
function EditMessageController($routeParams, $firebaseObject){
  this.messageId = $routeParams.messageId;
  var ref = new Firebase("https://fbbug.firebaseio.com/messages/" + this.messageId);
  var sync = $firebaseObject(ref);
  sync.$bindTo(this, 'message');
}

instead of the hacky workaround discussed in #597
It introduces a new module that should be published as a separate distributable (it forces a dependency on angular-new-router).

I should mention that there is an example grunt target that demonstrates usage of the new router.
I'm really just poking around and playing around with the new router here. This definitely should not be merged, but I thought it might be a good way to get a discussion going on how to better support new router (aka ComponentRouter).

@jamestalmage I think it would be better to actually bind to this and instead of listening for the $destroy event, hook to disconnect and do any cleanup there since $scope is no longer usable with the new router.
Just a suggestion though, not sure if it can be accomplished.

That is exactly what this PR accomplishes

@jamestalmage I thought that it binds to a property on this (not this itself), the one you specify as the second param (in your example message).

I am not sure how/why you would want to merge directly on to the controller itself. It would be impossible when it came time to sync changes back to firebase. How would we know which properties on the controller you want synced to firebase, and which ones are just needed for controller operations?

@jamestalmage your point makes perfect sense :)
Though it would not be impossible to sync back changes to firebase, Object.observe can be used for that, but of course not currently supported by other than Chrome and Opera.

I'm concerned about the bandwidth of supporting two versions of routers. Not happy with the options at present and also not comfortable with the level of documentation they have provided for integrating the router.
I'm currently not planning to add any support into AngularFire for $bindTo with the new router. It's too easy to just skip $bindTo and call $save(); I don't feel the value here is worth the complexity and bandwidth at our end--which is limited.
This feels like something better tackled in a blog/gist/fork. Feel free to change my mind.

Closing this PR for now as open PRs make my project look outdated to our internal tools. We can reopen if discussion dictates.


limit morphic to trivial analysis to avoid inplace mutation bugs

Surprisingly this actually increases perf of some benchmarks. My guess is that it fixes bugs during looping and thus reduces work. Specifically cFold and derive see minor gains ~1.5%; rBTreeCk sees a big gain ~4%. NQueens is the only benchmark that sees a lost at ~2%.
False interpreter also see a 0-5% perf improvement depending on the exact input. That said, the improvement was noisy.
ref #7367

@Anton-4 can we merge this?


Cannot install npm packages after installing Git for Windows

After installation of Git for Windows I can no longer install npm packages I get the following error. This is unfortunately going to make me fail my final project at college as I have not time to fix before submission.
2674 verbose stack Error: exited with error code: 128
2674 verbose stack     at ChildProcess.onexit (C:\Program Files\nodejs\node_modules\npm\node_modules\mississippi\node_modules\end-of-stream\index.js:39:36)
2674 verbose stack     at emitTwo (events.js:126:13)
2674 verbose stack     at ChildProcess.emit (events.js:214:7)
2674 verbose stack     at Process.ChildProcess._handle.onexit (internal/child_process.js:198:12)
2675 verbose cwd C:\Users\draym\udemy-eth\test
2676 verbose Windows_NT 10.0.17134
2677 verbose argv "C:\Program Files\nodejs\node.exe" "C:\Program Files\nodejs\node_modules\npm\bin\npm-cli.js" "install"
2678 verbose node v8.9.4
2679 verbose npm  v5.6.0
2680 error Error while executing:
2680 error C:\Program Files\Git\mingw64\bin\git.EXE ls-remote -h -t git://github.com/frozeman/WebSocket-Node.git
2680 error
2680 error fatal: unable to look up github.com (port 9418) (Either the application has not called WSAStartup, or WSAStartup failed. )
2680 error
2680 error exited with error code: 128
2681 verbose exit [ 1, true ]

I was able to fix this by doing the following:
git config --global url."https://".insteadOf git://


Efficient Bayesian ridge regression

Using 100 KDE features and all the categorical variables, I end up with a dataset that's 840x6578 so I'm inclined to do ridge regression. I tried to implement it in Stan but it's taking forever to sample the 6578 parameters, I think because there's so much correlation among the covariate. One trick that speeds things up greatly is to do a QR decomposition in R (see https://github.com/stan-dev/rstanarm/issues/30) and then learn 840 parameters based on an orthogonal design matrix. This works great, but I'm not sure how to recover the original 6578 parameters. But in any case, this might all be moot, as even with 6578 parameters I don't really know how to read off something like effect sizes / percent of variance explained. So now I'm thinking I should just do good old fashioned forward stepwise regression. But even that is slow with Stan--i.e. at the moment I've got a matrix that 840x100 because I want to use the 100 KDE features for the age variable.
So should I forget Stan? Or do something else? Interestingly, the GP regression perspective on this is efficient in Stan: considering a linear kernel, the covariance K becomes 840x840 and you just sample the observations:
y ~ N(0, K + \sigma^2 I)

But again this doesn't give us a clear interpretation of which are the important variables. So maybe I should really just do group lasso? I guess there are some group lasso packages in R to try...

update: found a bug with the KDE features, maybe this will work better after I fix that

OK, it's better but still pretty damn slow. @Yu-Xiang what do you think about implementing ORF?


⚠ Mobitopup has degraded performance

In d6f31e0, Mobitopup (https://napcard.voz.tech) experienced degraded performance:

HTTP code: 200
Response time: 3995 ms

Resolved: Mobitopup performance has improved in bc2a7c6 after 421 days, 6 hours, 15 minutes.


Pretty-print tables in Markdown

Addressing #16.

Thanks, I tweaked the code a bit to avoid some temporary strings and to support Unicode better and merged it.

@rsc, thank you for the comment and the changes. I've fixed the Unicode-vs-string error in other code bases, can't believe I missed that :) I also see what you did to obviate the temp strings. Thanks!


newbie question

Is anybody running it and is it working well?
Cheers

Zenbot and Zenbrain work great and have lots of interesting features. You should know that this is a open project with lots left to be done. If you are looking for something that you can put in an api key and let it make money for you, well...this isn't what you are looking for.
If you are looking for a framework to develop your own custom trade logic on then this is a great place to  start.

Because I wanted to implement it a while ago but there was issues with Poloniex, and there were discussions of it working and not working.

@mountaindrifter but you have some sample strategies with which I can start trying the bot?
I'm a programer, but I know nothing about technical analysis. I would love to contribute with Zenbot, but first I need to get in.

The main repo already has a RSI based, pseudo day trade logic. It is a good place to start, but I would recommend working out your own. If you just load up the stock logic there is a good chance you will not make more than just hodling. If you know programming but not TA, that may be a good place to start.
This will be a personal choice. What type of trading are you looking to do? HFT, swing, position, day, etc? I would recommend coming up with a plan for how you would like to trade first then developing the logic. I also highly recommend building in some panic/exit strategy catches to protect yourself when trading outside the sandbox.
My point here is in response to the OP. Zenbot works well as an engine, but you will want to understand trading and develop a more complex logic.

@mountaindrifter thanks for your reply.
Actually I don't know which strategy I would like to do. I know nothing about it. I just want to multiply my BTCs :P
Would be awesome to have a kind of strategy bucket, where people can suggest some strategies to start trading.

I also highly recommend building in some panic/exit strategy catches to protect yourself when trading outside the sandbox.

Do you have a sample code to stop loss in a way that I don't loss the amount I funded?

Zenbot is working well on my machine, but I simply don't know how it works. Also I didn't find a simple guide to know what I can do with it.

Zenbot is working well on my machine, but I simply don't know how it works. Also I didn't find a simple guide to know what I can do with it.
@tregismoreira on what machine are you?
I've tried Fedora 23-25 servers, Ubuntu 16 servers and happen to have common errors with microtime or coinbase ws

I too have errors with microtime.
I tried using Ubuntu 18 Desktop, Windows with docker but it always error with microtime.
How to solve this? Which OS n version you guys to deploy this bot?

I have the solutions.
Fedora 25 server x64:
you need install 'nodejs nodejs-devel mongodb-org mongodb-org-server npm' in order to install without errors.

Zenbot 4 is out, so I'm cleaning up 3.x issues. Please use and test 4, thanks!


Improve formatting of floating point numbers

This PR is a fix for https://github.com/ocurrent/current-bench/issues/125

Thanks @punchagan for the review and also for sharing the article about the git commits I'll keep that in mind next time :D

Thanks for clarifying! This is a great point, the only solution that I can think to solve this issue is to normalize the display data because I don't know how to access the displayed value specifically in the graph :)

Looks like this wasn't taken care of, @shubhamkumar13? We could do this work as a second PR for #125 before closing it or create a separate issue, if that's preferred.


Establish docker for project

This issue should not be taken into development prior to 'Initial development' project finalization, as this is an enhancement, while the idea of initial development - create minimal stable DAL, BLL and test presentation for it to have some frame to base upon in the process of working on more specialized projects.
In order to have proper microservice architecture, we should establish Docker and make separated images for each microservice in order to have a guarantee in total isolation of inner business logic of each service from the logic of other services.

Docker compose was created and configured in #87. But for now, I am unable to work with it because of some hardware issues I have: I don't have sufficient resources to debug that many containers. I suggest we postpone this one and focus on the development itself. I will leave Docker Compose project as is for now and will unload it to make sure it does not bring errors in developments process.


Wont open,

This window will open than close and the game will also close and refuse to open

Not compatible with 2.201


fix(catalog-management): update catalog management examples after recent api changes

PR summary
Examples are aligned to the recent Api changes.
Worth to consider to merge this PR after https://github.com/IBM/platform-services-java-sdk/pull/108
PR Checklist
Please make sure that your PR fulfills the following requirements:

[x] The commit message follows the Angular Commit Message Guidelines.
[x] Tests for the changes have been added (for bug fixes / features)
[ ] Docs have been added / updated (for bug fixes / features)

Current vs new behavior

Does this PR introduce a breaking change?

[ ] Yes
[x] No

Other information

:tada: This PR is included in version 0.18.15 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Tensorflow: TFLiteConverter (Saved Model -> TFLite) in SSD_mobilenet_v2_2

System information

OS Platform and Distribution: Linux Ubuntu 18.04
TensorFlow installed from (source or binary):  pip install
TensorFlow version (or github SHA if from source): 2.3.1

I have installed tensorflow 2.3.1, my ssd_mobile_net_v2_2 was downloaded from https://tfhub.dev/tensorflow/ssd_mobilenet_v2/2. I want to convert this model to tf_lite version. My code is:

But error occurs:
tensorflow.lite.python.convert.ConverterError: :0: error: loc("Func/StatefulPartitionedCall/input/_0"): requires all operands and results to have compatible element types :0: note: loc("Func/StatefulPartitionedCall/input/_0"): see current operation: %1 = "tf.Identity"(%arg0) {device = ""} : (tensor<1x320x320x3x!tf.quint8>) -> tensor<1x320x320x3xui8>

it seems I need to set the input-data-type, but I don't know how to do that.
Thanks a lot for your replying.

@ZuyongWu,
I was able to reproduce the error with TF v2.3.
However, looking this comment from a similar issue, I was able to convert the model with TF-nightly. Please find the attached gist. Thanks!

@ZuyongWu,
I was able to reproduce the error with TF v2.3.
However, looking this comment from a similar issue, I was able to convert the model with TF-nightly. Please find the attached gist. Thanks!

Hi, I have tried it in latest tf-nightly 2.5.0, however, the input_shape prints [1 1 1 3]

@ZuyongWu,
Please check this updated gist which lists the files after the conversion. Thanks!

Didn't work for me. Remains with [1 1 1 3] input size. :(

@ZuyongWu,
Please check this updated gist which lists the files after the conversion. Thanks!

Didn't work for me. Remains with [1 1 1 3] input size. :(

@ZuyongWu,
Please check this updated gist which lists the files after the conversion. Thanks!

Didn't work for me. Remains with [1 1 1 3] input size. :(

@ricardoantonello
Could you please submit a new issue from this link and fill in the template, so that we can track the issue there. Thanks!

Didn't work for me. Remains with [1 1 1 3] input size. :(

@ricardoantonello
Could you please submit a new issue from this link and fill in the template, so that we can track the issue there. Thanks!

Didn't work for me. Remains with [1 1 1 3] input size. :(

@ricardoantonello
Could you please submit a new issue from this link and fill in the template, so that we can track the issue there. Thanks!

Hi,
I finally solve the issue using export_tflite_graph_tf2.py
Thanks!

Didn't work for me. Remains with [1 1 1 3] input size. :(

@ricardoantonello
Could you please submit a new issue from this link and fill in the template, so that we can track the issue there. Thanks!

Hi,
I finally solve the issue using export_tflite_graph_tf2.py
Thanks!

@ricardoantonello we are seeing the same problem. Could you explain how you solved your problem? For example, what script are you using, how did you run it, and what version of TensorFlow are you using? That would be much appreciated!

@ricardoantonello we are seeing the same problem. Could you explain how you solved your problem? For example, what script are you using, how did you run it, and what version of TensorFlow are you using? That would be much appreciated!

@ricardoantonello Thanks! I've confirmed that using export_tflite_graph_tf2.py fixes the issue in TF 2.4.

@ricardoantonello Thanks! I've confirmed that using export_tflite_graph_tf2.py fixes the issue in TF 2.4.

@ricardoantonello we are seeing the same problem. Could you explain how you solved your problem? For example, what script are you using, how did you run it, and what version of TensorFlow are you using? That would be much appreciated!

Hi, i used de checkpoints i have trainning before, and the instructions here:
python object_detection/export_tflite_graph_tf2.py
--pipeline_config_path path/to/ssd_model/pipeline.config
--trained_checkpoint_dir path/to/ssd_model/checkpoint
--output_directory path/to/exported_model_directory
pipeline_config_path is the same config file i used to trainning.
My version: TF 2.4 Gpu
Good luck!

@ricardoantonello we are seeing the same problem. Could you explain how you solved your problem? For example, what script are you using, how did you run it, and what version of TensorFlow are you using? That would be much appreciated!

Hi, i used de checkpoints i have trainning before, and the instructions here:
python object_detection/export_tflite_graph_tf2.py
--pipeline_config_path path/to/ssd_model/pipeline.config
--trained_checkpoint_dir path/to/ssd_model/checkpoint
--output_directory path/to/exported_model_directory
pipeline_config_path is the same config file i used to trainning.
My version: TF 2.4 Gpu
Good luck!


Highlight documentation needs updating to suggest strong tag

The highlight example has been updated in this PR to use <stong> tags. This has not been reflected in the documentation

This PR being merged has changed the implementation slightly. So the documentation will need to be updated to take into account this.

Docs updated on Service manual.


Make compatible with Toil 6.2+

A recent pr changed the internal argument structure of some functions that the TES batch system plugin inherits, so this updates them to match. This does mean that the plugin will not work for versions 6.1 and below.

Is there CI here?

Sadly no. We have https://github.com/DataBiosphere/toil/issues/4879 for adding CI for the plugin API itself on the Toil side, and I brought over the Gitlab CI script, but I think I never actually set up the Gitlab side to run it.

OK, I've now hooked up the CI and it looks like it fails because the breaking change in Toil hasn't been released yet.
We probably need to bump the next Toil version to 7.0.

It also looks like the plugin doesn't currently work, at least with the latest master branch of Toil:
node                 EXECUTOR_STDERR
attempt              0
index                0
stderr               [2024-04-26T16:16:29+0000] [MainThread] [D] [toil.statsAndLogging] Suppressing the following loggers: {'charset_normalizer', 'boto', 'dill', 'bcdocs', 'boto3', 'kubernetes', 'docker', 'websocket', 'google', 'requests_oauthlib', 'requests', 'botocore', 'oauthlib', 'urllib3'}
                     [2024-04-26T16:16:29+0000] [MainThread] [D] [toil.batchSystems.contained_executor] Starting executor
                     [2024-04-26T16:16:29+0000] [MainThread] [E] [toil.batchSystems.contained_executor] Exception while unpickling task:
                     Traceback (most recent call last):
                       File "/usr/local/lib/python3.12/dist-packages/toil/batchSystems/contained_executor.py", line 91, in executor
                         job = pickle.loads(base64.b64decode(sys.argv[1].encode('utf-8')))
                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
                     AttributeError: Can't get attribute 'JobBodyReference' on <module 'toil.job' from '/usr/local/lib/python3.12/dist-packages/toil/job.py'>

@stxue1 That looks like maybe the Toil inside the container being run on TES is not the same Toil as the leader is.

@stxue1 Maybe we also changed the argument order in toil.batchSystems.contained_executor?

Did some testing against right before we removed TES from Toil. Seems like the 'userScript' key never existed prior to TES's removal.
With Toil at commit 2068c760618c8835cee42461f904cd0f9b640cc6, the unpickled job object is:
<class 'dict'>
{'command': 'mktemp -d'}

At the latest commit in master:
<class 'dict'>
{'command': 'mktemp -d', 'userScript': JobDescription( **{'_config': None, '_requirementOverrides': {'memory': 100000000, 'cores': 1, 'disk': 1000, 'preemptible': False, 'accelerators': []}, 'local': False, 'jobName': 'test3', 'unitName': '', 'displayName': '', 'jobStoreID': '3', '_body': None, '_remainingTryCount': None, 'filesToDelete': [], '_merged_job_names': [], 'predecessorNumber': 0, 'predecessorsFinished': set(), 'childIDs': set(), 'followOnIDs': set(), 'successor_phases': [set(), set()], 'serviceTree': {}, 'logJobStoreFileID': None, '_job_version': 0, '_job_version_writer': 0} )}

Maybe we recently changed how jobs are pickled/unpickled around?

@stxue1 Maybe we also changed the argument order in toil.batchSystems.contained_executor?

I think we mainly added more arguments.
At 2068c760618c8835cee42461f904cd0f9b640cc6:
argv: ['/usr/local/bin/_toil_contained_executor', 'gAWVGgAAAAAAAAB9lIwHY29tbWFuZJSMCW1rdGVtcCAtZJRzLg==']

decoded: b'\x80\x05\x95\x1a\x00\x00\x00\x00\x00\x00\x00}\x94\x8c\x07command\x94\x8c\tmktemp -d\x94s.'

Now:
argv: ['/usr/local/bin/_toil_contained_executor', 'gAWV/QEAAAAAAAB9lCiMB2NvbW1hbmSUjAlta3RlbXAgLWSUjAp1c2VyU2NyaXB0lIwIdG9pbC5qb2KUjA5Kb2JEZXNjcmlwdGlvbpSTlCmBlH2UKIwHX2NvbmZpZ5ROjBVfcmVxdWlyZW1lbnRPdmVycmlkZXOUfZQojAZtZW1vcnmUSgDh9QWMBWNvcmVzlEsBjARkaXNrlE3oA4wLcHJlZW1wdGlibGWUiYwMYWNjZWxlcmF0b3JzlF2UdYwFbG9jYWyUiYwHam9iTmFtZZSMBXRlc3QzlIwIdW5pdE5hbWWUjACUjAtkaXNwbGF5TmFtZZRoFowKam9iU3RvcmVJRJSMATOUjAVfYm9keZROjBJfcmVtYWluaW5nVHJ5Q291bnSUTowNZmlsZXNUb0RlbGV0ZZRdlIwRX21lcmdlZF9qb2JfbmFtZXOUXZSMEXByZWRlY2Vzc29yTnVtYmVylEsAjBRwcmVkZWNlc3NvcnNGaW5pc2hlZJSPlIwIY2hpbGRJRHOUj5SMC2ZvbGxvd09uSURzlI+UjBBzdWNjZXNzb3JfcGhhc2VzlF2UKGgmaCRljAtzZXJ2aWNlVHJlZZR9lIwRbG9nSm9iU3RvcmVGaWxlSUSUTowMX2pvYl92ZXJzaW9ulEsAjBNfam9iX3ZlcnNpb25fd3JpdGVylEsAdWJ1Lg==']

decoded: b'\x80\x05\x95\xfd\x01\x00\x00\x00\x00\x00\x00}\x94(\x8c\x07command\x94\x8c\tmktemp -d\x94\x8c\nuserScript\x94\x8c\x08toil.job\x94\x8c\x0eJobDescription\x94\x93\x94)\x81\x94}\x94(\x8c\x07_config\x94N\x8c\x15_requirementOverrides\x94}\x94(\x8c\x06memory\x94J\x00\xe1\xf5\x05\x8c\x05cores\x94K\x01\x8c\x04disk\x94M\xe8\x03\x8c\x0bpreemptible\x94\x89\x8c\x0caccelerators\x94]\x94u\x8c\x05local\x94\x89\x8c\x07jobName\x94\x8c\x05test3\x94\x8c\x08unitName\x94\x8c\x00\x94\x8c\x0bdisplayName\x94h\x16\x8c\njobStoreID\x94\x8c\x013\x94\x8c\x05_body\x94N\x8c\x12_remainingTryCount\x94N\x8c\rfilesToDelete\x94]\x94\x8c\x11_merged_job_names\x94]\x94\x8c\x11predecessorNumber\x94K\x00\x8c\x14predecessorsFinished\x94\x8f\x94\x8c\x08childIDs\x94\x8f\x94\x8c\x0bfollowOnIDs\x94\x8f\x94\x8c\x10successor_phases\x94]\x94(h&h$e\x8c\x0bserviceTree\x94}\x94\x8c\x11logJobStoreFileID\x94N\x8c\x0c_job_version\x94K\x00\x8c\x13_job_version_writer\x94K\x00ubu.'

Though I'm not sure why calling register would fail, as I'd expect that that behavior wouldn't change if we always do pass around a JobDescription object.

It also looks like toil-wdl-runner with --batchSystem=tes is unable to run:
Traceback (most recent call last):
  File "/usr/local/bin/_toil_worker", line 8, in <module>
    sys.exit(main())
             ^^^^^^
  File "/usr/local/lib/python3.12/dist-packages/toil/worker.py", line 760, in main
    job_store = Toil.resumeJobStore(options.jobStoreLocator)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/dist-packages/toil/common.py", line 1026, in resumeJobStore
    jobStore.resume()
  File "/usr/local/lib/python3.12/dist-packages/toil/jobStores/fileJobStore.py", line 130, in resume
    raise NoSuchJobStoreException(self.jobStoreDir, "file")
toil.jobStores.abstractJobStore.NoSuchJobStoreException: The job store 'file:/home/heaucques/Documents/wdl-conformance-tests/jobstore-please-delete' does not exist, so there is nothing to restart.

I've put the folder in the whitelist:
Server:
  BasicAuth:
    - User: toil
      Password: helloworld
RPCClient:
  User: toil
  Password: helloworld
LocalStorage:
  AllowedDirs:
    - /home/heaucques/Documents/wdl-conformance-tests/
    - /home/heaucques/Documents/wdl-conformance-tests/jobstore-delete-me
    - /home/heaucques/.aws
Compute: manual

Which should be giving funnel access to the folder/jobstore as the following TES task works:
{
  "name": "Hello world",
  "inputs": [{
    "url": "file:///home/heaucques/Documents/wdl-conformance-tests/jobstore-delete-me",
    "path": "/inputs/hello.txt"
  }],
  "outputs": [{
    "url": "file:///home/heaucques/Documents/wdl-conformance-tests/a.txt",
    "path": "/outputs/hello-out.txt"
  }],
  "executors": [{
    "image": "alpine",
    "command": ["cat", "/inputs/hello.txt"],
    "stdout": "/outputs/hello-out.txt"
  }]
}

It looks like inside contained_executor.py in executor(), it is unable to access the whitelisted directories (os.path.exists(folder) returns False).
The docstring says that executor() runs inside the Toil container. My guess is that funnel permits access to the whitelisted directories, but since we're running Toil inside a docker container, those directories don't get carried/mounted through; we are telling funnel to run some command inside a docker container inside funnel. Maybe the plugin should deal with this by carrying those whitelist rules through? But this isn't the only filesystem the plugin would have to deal with: https://ohsu-comp-bio.github.io/funnel/docs/storage/local/ (ex: S3 doesn't work as no credentials are provided).
I believe this also isn't the only server/app to run TES, so some behaviors of funnel may not carry over, for better and for worse (ex: Funnel attempts to always hard link or copy files, do other apps use soft links and will that break anything, such as if we try to mount directories into the container?)

Oh, I think we never got TES working with local job stores for exactly this reason; it only ever worked with the network-based ones, and of those I think we only ever really tested AWS. The TES storage system lets you give files in those directories to tasks as inputs, but it doesn't just let the tasks see those directories as mounted.

Oh, I think we never got TES working with local job stores for exactly this reason; it only ever worked with the network-based ones, and of those I think we only ever really tested AWS.

Does this mean that Toil is unable to use any jobstores under TES, including AWS buckets? Or should AWS buckets work, for things such as toil-wdl-runner?

The AWSJobStore should work under TES.

Alright, currently that doesn't work as TES doesn't think it can import ~/.aws. However, even if I force the import, at least toil-wdl-runner fails:
	  File "/usr/local/lib/python3.12/dist-packages/toil/wdl/wdltoil.py", line 1745, in run
	    os.makedirs(os.environ['MINIWDL__SINGULARITY__IMAGE_CACHE'], exist_ok=True)
	  File "<frozen os>", line 225, in makedirs
	OSError: [Errno 30] Read-only file system: '/root/.cache/miniwdl'

Does TES mount the Docker image as read only? Inside the container, it looks like the / directory is mounted as read-only:
overlay / overlay ro...

Which I can only replicate when running the container with docker run --read-only --rm quay.io/stxue/toil:7.0.0a1-c5232d3b2eec1fe0ac8fe3d529e6d80b017e2e3b-dirty-py3.12 cat /proc/mounts | grep " / "

It's possible TES mounts the Docker container as read-only. I don't think we've tested WDL execution in TES before; I think we tried it with CWL, before the current MiniWDL-based WDL interpreter. Maybe toil-wdl-runner doesn't work with a read-only home directory, or doesn't work with a read-only home directory unless you set the environment variables that control where MiniWDL tries to cache stuff to a writable location, such as something under /tmp.
I think I had it working with the host AWS credentials mounted over to the TES containers. But the logic for that assumes .aws is at the same path on the Toil leader as it is on the TES server, and that the TES server is configured to let tasks mount that path.

Shifting the SINGULARITY_CACHEDIR and MINIWDL__SINGULARITY__IMAGE_CACHE to /tmp gets toil-wdl-runner farther, but crashes as it can't set namespaces. I believe this is something we circumvent in our launch-cluster command by removing restrictions through customizing our docker command.
https://github.com/DataBiosphere/toil/blob/5d436d3b094dc3bec017a770c7fe04ce2f345267/src/toil/provisioners/abstractProvisioner.py#L820
I'll either have to see if TES allows me to adjust docker commands or if I can find a solution to avoid needing namespaces.

But the logic for that assumes .aws is at the same path on the Toil leader as it is on the TES server, and that the TES server is configured to let tasks mount that path.

Although for some reason, even though the paths should match, the server isn't able to realize that it's one of it's provided storage paths.
>>> t.get_service_info()
class ServiceInfo
class ServiceInfo
ServiceInfo(name='Funnel', doc='git commit: 43b289a\ngit branch: master\ngit upstream: git@github.com:ohsu-comp-bio/funnel.git\nbuild date: 2020-12-09T21:52:48Z\nversion: 0.10.1', storage=None)

It does look like the container is read-only though, the Funnel logs has something that looks suspicious
<div style="padding: 20px 0px 0px;">
level | info
-- | --
msg | Running command
timestamp | 2024-05-01T12:54:06.415652688-07:00
task_attempt | 0
executor_index | 0
cmd | docker run -i --read-only --rm -e OMP_NUM_THREADS

</div>

I suspect this is the command running the container as -e has also been passing my environmental variables through


Decoding error: VectorType not supported yet

This error impacts only the vectorized decoder:
MltDecoderTest > currentlyFailingBingDecoding1() FAILED
    java.lang.IllegalArgumentException: VectorType not supported yet: CONST
        at com.mlt.decoder.vectorized.VectorizedPropertyDecoder.decodeToRandomAccessFormat(VectorizedPropertyDecoder.java:169)
        at com.mlt.decoder.MltDecoder.decodeMlTileVectorized(MltDecoder.java:165)
        at com.mlt.decoder.MltDecoderTest.testTile(MltDecoderTest.java:199)
        at com.mlt.decoder.MltDecoderTest.currentlyFailingBingDecoding1(MltDecoderTest.java:72)

One curious thing about this failure to note: it replicates in the unit tests for the decoder. But I could not replicate with the encode.jar command. When I saw this I then modified the encode.jar to encode the tile in the same way as the decoder unit tests encode the MLT but I was still not able to replicate. So I figure that means either there was a difference still in the way the encode.jar did encoding or something more subtle is happening causing a difference in code paths during decoding.


Latest improvements to the APIM 3.2.0 under update 2.0

This ticket is created to track the latest improvements to APIM 3.2.0 under update 2.0. Following issues are tracked here.
https://github.com/wso2/product-apim/issues/9324
https://github.com/wso2/product-apim/issues/9345
https://github.com/wso2/product-apim/issues/9329
https://github.com/wso2/product-apim/issues/9328"
https://github.com/wso2/product-apim/issues/9368
https://github.com/wso2/product-apim/issues/9372
https://github.com/wso2-extensions/apim-km-keycloak/issues/23
https://github.com/wso2/product-apim/issues/9442
https://github.com/wso2/product-apim/issues/9451
https://github.com/wso2/product-apim/issues/9461
https://github.com/wso2/product-apim/issues/9341
https://github.com/wso2/product-apim/issues/9365
https://github.com/wso2/product-apim/issues/9340
https://github.com/wso2/product-apim/issues/9339
https://github.com/wso2/product-apim/issues/9325
https://github.com/wso2/product-apim/issues/9385
https://github.com/wso2/product-apim/issues/9301
https://github.com/wso2/product-apim/issues/9387
https://github.com/wso2/product-apim/issues/9288
https://github.com/wso2/product-apim/issues/9463
https://github.com/wso2/product-apim/issues/8079
"https://github.com/wso2/product-apim/issues/9528
https://github.com/wso2/product-apim/issues/9529
https://github.com/wso2/product-apim/issues/9520
https://github.com/wso2/product-apim/issues/9491
https://github.com/wso2/product-apim/issues/9328
https://github.com/wso2/product-apim/issues/9329
https://github.com/wso2/carbon-apimgt/issues/9375
https://github.com/wso2/product-apim/issues/9545
https://github.com/wso2/product-apim/issues/9541
https://github.com/wso2/product-is/issues/10016"
https://github.com/wso2/product-apim/issues/8389
https://github.com/wso2/product-apim/issues/9573
https://github.com/wso2/product-apim/issues/9554
https://github.com/wso2/product-apim/issues/9536
https://github.com/wso2/product-apim/issues/7885
https://github.com/wso2/product-apim/issues/9479

#9324 the issue still persists. I tried to override with the following and t did not reflect
palette: { background: { appBar: '#f2f2f2', appBarSelected: '#85c441', leftMenu: '#f2f2f2', leftMenuActive: '#f2f2f2', drawer: '#1a1f2f', activeMenuItem: '#008ea9', }, }

#9324 the issue still persists. I tried to override with the following and t did not reflect
palette: { background: { appBar: '#f2f2f2', appBarSelected: '#85c441', leftMenu: '#f2f2f2', leftMenuActive: '#f2f2f2', drawer: '#1a1f2f', activeMenuItem: '#008ea9', }, }

Closing the issue as the updates are released


[KARAF-7766] Require Java 11 at runtime

Enforce JVM version 11 on startup. Also simplify ./bin/karaf(.bat).
Signed-off-by: Robert Varga<EMAIL_ADDRESS>

@wborn have I missed anything?

@rovarga does this fix the script error about "[" being misused?


Streaming XLSX reader optimizations

There are some potential optimizations we can do when reading XLSX files from an InputStream to reduce memory usage and/or not need to use a temporary file.
One optimization would be to read the XLSX file byte by byte. An XLSX file is simply a ZIP archive containing XML files and other interesting things, that make the format work, but we only care about the following files:

xl/_rels/workbook.xml.rels: Tells us what the filenames are inside the archive for each object ID. If we don't have this, we can usually guess though, as most software that saves to XLSX use standard filenames for things.
xl/sharedStrings.xml: This file is very important, and contains a table of text data that cells often point to, instead of storing the cell contents directly. If we don't read this most cells will be empty.
xl/workbook.xml: Contains a list of sheets in the workbook and other metadata. We can ignore this if we don't care about sheet titles or sheet order.
xl/worksheets/*.xml: Contains the actual sheets, rows, and cells. Usually these are named sheet1.xml, sheet2.xml, sheet3.xml etc, but this is not a guarantee. We can infer sheet order based on filenames if we don't have the workbook metadata.

The problem with zip files is that instead of having a header, they have a trailer at the end of the file instead where all of the files are located in the archive. With a read-once InputStream, by the time we get to the trailer, we can't read any files any more. Fortunately, we can work around this by ignoring the trailer entirely and reading each entry's "header", which includes that entry's filename.
This poses a new problem: we are dependent on the order in which files were written to the zip file. If sheet2.xml shows up in the archive before sheet1.xml, we might read the second sheet first. Even worse, if sharedStrings.xml is the last entry in the archive, then we have to consume the entire archive before we can begin reading any rows!
I propose a "graceful degradation" approach, where XLSX files with an optimal layout will use constant memory similar to the XLS reader, but sub-optimal XLSX files may use more memory or even a temporary file.
We can read the archive entries in order, and alter our behavior depending on the filename encountered:

If we encounter xl/_rels/workbook.xml.rels, do parse it and store it in memory for later.
If we encounter xl/workbook.xml, do parse it and store it in memory, for the purposes of knowing the proper name of each worksheet, but only if we already parsed the rels file (it is useless otherwise).
If we encounter xl/sharedStrings.xml, parse it and store it in memory.
If we encounter a file in the xl/worksheets/ directory:

If we have not encountered the shared strings table yet, fall back to "tempfile mode" by writing all entries to disk until we reach the shared strings.
If we have not parsed the workbook file yet, guess the sheet name by its filename.
Begin reading and returning rows from this sheet.

A disadvantage of this approach is that sheets are never read in their designated order, but rather in the order they appear in the file. In addition, we still use a tempfile if the shared strings do not appear before all sheet files inside the archive, because we cannot properly read the sheet files without it.

This sounds great!  Do you have any idea how often XLSXs are actually laid out in the optimal layout in the wild?  Would be interesting to know how things end up in the order they do, and whether or not Excel and other XLSX manipulation tools consider the ordering of these files.

I checked a couple of XLSX files in my documents and they all have the shared strings table near the top, though a few had the workbook and rels after the actual sheets.
They are laid out in the order they are added to the archive, so it would depend on the actual code. I'd be surprised if the same tool sometimes produced different orders. I bet the differences are from different versions of Excel.

With some major extrapolation of our small sample size, I'd say optimizing 84% of XLSXs would still be pretty great 😄


Masthead:  Persistently visible searchfield in Masthead searchbar

The problem
Hello, we are using the Masthead component with searchbar.
Currently, we can use the searchOpenOnload prop to make sure that the searchbar is open after the page loads.
However, if the user clicks elsewhere on the page, the searchbar gets closed.
The solution
We would like the Masthead searchbar field to be visible constantly, no matter the user's interaction with the page.
Example can be seen on https://www.ibm.com/search?lang=en&cc=us&q=api
Additional information
This feature is requested by the Knowledge Center team.

Next steps:  functional specs update, no visual design needed, dev & QA, web site content updates made in overall web site work.

JC can contribute the code during their next sprint which begins next week.  (Feb 22 - Mar 5)


take away tags from beacon

I don't want the suppliers or public to see what categories we are tagging the opportunities with.  sometimes we are over tagging with items that may or may not be covered in the RFP.  We don't want those tags displaying unless you are a city worker logged in (or if that's too hard just take away display from all users...I can always see when I edit the opportunity)

still seeing tags when I went to beacon, clicked on an opportunity, and wasn't logged in as admin

Change is merged into master, but the next deploy will also involve the much larger change involving the new logins with passwords. Therefore, I want to do a rollout over a weekend with an email to all users, or whatever rollout plan you think is appropriate.


Dell 27 inch monitor USB port not charging

This product
Not sure when it's not chargning.

No desire to address.


Push notification is not being delivered to device

When I require this package via composer it gives me dependency error for openssl. Now I have updated version of openssl on my mac but it is still giving this error;
Your requirements could not be resolved to an installable set of packages.

  Problem 1
    - Installation request for wrep/notificato ^1.2 -> satisfiable by wrep/notificato[1.2.0].
    - wrep/notificato 1.2.0 requires lib-openssl * -> the requested linked library openssl has the wrong version installed or is missing from your system, make sure to have the extension providing it.

I is not clear from the message that which openssl version is required. Here my current version of openssl;
OpenSSL 1.0.2h  3 May 2016
Please let me know if can change any version to make it work?

If you look at the phpinfo() output, does that mention the OpenSSL library? If it does it should be correctly linked and loaded, if it doesn't PHP is probably installed without OpenSSL linked.

@mac-cain13 thank you for responding. I have installed and used this library to send push notification to apple passbook in order to update installed coupon on device. Here is the feedback output;

It doesn't seem to be unsuccessful but coupon is not being updated on device. No message is being received on device.

The feedback service is telling you that that particular device did unregister from APNS and you cannot send push messages to it anymore. That you can use the feedback service without errors doesn't tell you anything about whether pushes are correctly delivered or not.
Do you get any errors when you send a push? If so what errors. What is your code sending the push and does the passbook pass register with your server correctly?

Device has been registered correctly and that pass is being updated when I try to update it from passbook application using pull to refresh. Here is my code for sending push notification.
$notificato = new Notificato(base_path().'/config/ios-push-notification-certificates/production/ProductionCertificate.pem', 'mypassphrase');

        // Now we get a fresh messagebuilder from Notificato
        //  This message will be send to device with pushtoken 'fffff...'
        //  it will automaticly be associated with the default certificate
        //  and we will set the red badge on the App icon to 1
        $message = $notificato->messageBuilder()
                                ->setDeviceToken('b2ae8b68fff1fbbe957b8b8f703744794d89f09d45f69b2d847a26c3b064e268')
                                ->setBadge(1)
                                ->build();

        // The message is ready, let's send it!
        //  Be aware that this method is blocking and on failure Notificato will retry if necessary
        $messageEnvelope = $notificato->send($message);

        // The returned envelope contains usefull information about how many retries where needed and if sending succeeded
        // Now read all "tuples" from the feedback service, be aware that this method is blocking
        $tuples = $notificato->receiveFeedback();

        // The tuples contain information about what device unregistered and when it did unregister.
        //  Don't forget to check if the device reregistered after the "invaidated at" date!
        foreach ($tuples as $tuple)
        {
            echo 'Device ' . $tuple->getDeviceToken() . ' invalidated at ' . $tuple->getInvalidatedAt()->format(\DateTime::ISO8601) . PHP_EOL;
        }
        dd($messageEnvelope->getFinalStatusDescription());


Support read-only mode in pod security context

Currently, enabling read-only mode in the security context for the UI pod causes it to crash.
This is because the UI uses server-side rendering and must write compiled files to the local filesystem. We should mount the directory for the compiled files as a volume to fix this.

Additional Context:
Pod Security Context:
securityContext:
    readOnlyRootFilesystem: true
    allowPrivilegeEscalation: false
    privileged: false

Pod Logs
$ kubectl logs studio-ui-7689b48fb9-k4m29 -n iterative-studio
No certificates to update
yarn run v1.22.19
warning Skipping preferred cache folder "/home/node/.cache/yarn" because it is not writable.
warning Selected the next writable cache folder in the list, will be "/tmp/.yarn-cache-1000".
$ node scripts/prepare-build.js && next start
warning Cannot find a suitable global folder. Tried these: "/usr/local, /home/node/.yarn"
node:internal/fs/utils:347
    throw err;
    ^

Error: EROFS: read-only file system, open '/app/.next/server/pages/404.html'
    at Object.openSync (node:fs:590:3)
    at Object.writeFileSync (node:fs:2202:35)
    at walk (/app/scripts/prepare-build.js:66:10)
    at Object.<anonymous> (/app/scripts/prepare-build.js:71:1)
    at Module._compile (node:internal/modules/cjs/loader:1191:14)
    at Object.Module._extensions..js (node:internal/modules/cjs/loader:1245:10)
    at Module.load (node:internal/modules/cjs/loader:1069:32)
    at Function.Module._load (node:internal/modules/cjs/loader:904:12)
    at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:81:12)
    at node:internal/main/run_main_module:22:47 {
  errno: -30,
  syscall: 'open',
  code: 'EROFS',
  path: '/app/.next/server/pages/404.html'
}
error Command failed with exit code 1.
info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.


Wrong detection for unused variables with compact()

I get the violation: Avoid unused local variables such as '$whatever' while being used in compact('whatever')

Here is another example of this where it happens with double quotes, but not single quotes:
https://github.com/zippy1981/phpmd_bugs/tree/compactBug

Should be fixed in PHPMD 2.6.0:


HIVE-26512: ST_GeometryProcessing is incorrectly registered as function.

Remove the unused udf function from being registered, it is just a wrapper class, no need to register and have runtime issues while using it.

+1


Not connecting

Tibialyzer won't connect for me no matter what. I've tried using 1.4.2, 1.4.3, <IP_ADDRESS> and none work.
I've tried running as administrator and opening my Tibia 11 client etc. Nothing works. I've added my names as well. It recognises when I open Tibia, because the red status bar changes to green. But regardless of what order I open them in, it won't work. If I open the summary screen, it just shows names that aren't related to me (which I assume means the program thinks I'm not actively playing).
Any help?
Few screen shots.
Tibia 11 closed (red status bar)
https://puu.sh/wpnTn/6ee27b9157.png
Tibia 11 open (green status bar)
https://puu.sh/wpnSP/7644fc1088.png
Summary window with Tibia open (opening Tibialyzer both before and after opening client)
https://puu.sh/wpnVp/14dbda729b.png
Thanks in advance.

Same problem to me !!!
Even I opened tibia11 without battle eye, but just dont work.
Please someone can help us?

i have exacly the same problem. It occured to me only after last tibia client update though :<

I actually just tried to use this for the first time and have wrecked my brain over this for about 12 hours now haha. I sure hope the owner can help us out! Thanks so much in advance!


Using coffee-script for gulpfile will break with the next release of CS

With the next release of CS, requiring coffee-script won't autoregister .coffee extensions. Instead, requiring coffee-script/register will be required.
This can be fixed by changing the README when the time comes, but I'd opt for a different solution, that would allow .coffee config without having to specify the registration every time (short of an alias).
See https://github.com/jashkenas/coffee-script/pull/3279

Out of box support for CS doesn't seem to work for me without a local installation of CS. Is anybody else seeing this?

@bioball AFAIK it is expected behaviour.

You have to install coffee-script to be able to use it.


Typo: Missing an article

Minor edit for readability.

Whoops, actually I clicked the wrong button xD will be merged, thanks so much for your help!! :)

Ha! It happens - no worries :)

☝ I added the branch back


Live Streams

Sometimes I use this extension to keep up with live videos.
The live stream is sometimes delayed a little, so I set the speed on "Fastest" until
the stream starts to stop and play several times, then I know this is because this is
already the real-time live stream, so I set the speed back to normal.
So the issue here is that I don't want the stream to keep stopping and playing when there is no delay.
My suggestion is: when the stream is delayed and I set the speed to "fastest" and reaches the real-time live stream
the speed sets itself back to normal automatically
Sorry if this is not organized but I am still a beginner in the industry :).

@01H2A Sorry for the late reply.
I think that's a great idea! Hope someone could come in and explore how to do this!


Visual Basic

Hi,
is this working also with visual basic?
I've tried it and it give me this error "Unable to resolve generated expression"
i use readonly property marked with Projectables
thank you

Unfortunately no, the source generator only supports C#


[Event Request] Codeunit 80 "Sales-Post" - OnBeforeAdjustPrepmtAmountLCY

Please add the following Event OnBeforeAdjustPrepmtAmountLCY to Codeunit 80 "Sales-Post"
    local procedure AdjustPrepmtAmountLCY(SalesHeader: Record "Sales Header"; var PrepmtSalesLine: Record "Sales Line")
<...>
    begin
        //>> New event
        IsHandled := false;
        OnBeforeAdjustPrepmtAmountLCY(SalesHeader, PrepmtSalesLine, IsHandled);
        if IsHandled then
            exit;
        //<< End

        if PrepmtSalesLine."Prepayment Line" then begin

    [IntegrationEvent(false, false)]
    local procedure OnBeforeAdjustPrepmtAmountLCY(SalesHeader: Record "Sales Header"; var PrepmtSalesLine: Record "Sales Line"; var IsHandled: Boolean)
    begin
    end;

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. Please do not reply to this, as we do not monitor closed issues. If you have follow-up questions or requests, please create a new issue where you reference this one.
Build ID: 13411.


[Feature proposal] Ignore files for snapshot_download

I use the snapshot_download method to download all model files for sentence-transformers.
@patrickvonplaten converted the transformers models to flax and added them to the respective repository, e.g. for the LaBSE model:
https://huggingface.co/sentence-transformers/LaBSE/tree/main
Right now when you load the LaBSE model with sentence-transformers, the flax_model.msgpack is also downloaded, but never used (only the pytorch files are used).  This adds another 1.8 GB to the download and to the storage requirement. This gets potentially worse if models are converted to further formats, e.g. to tensorflow.
Would it make sense to add a blacklist / whitelist parameter for the snapshot_download method? So that you can control which files should be checked out? Potentially also with wildcard, e.g. only download '.json' and '.bin' files?
Or do you know a better way how you could determine which files are needed and must be downloaded by your library? For sentence-transformers, the number of files you must download can greatly vary from model to model, i.e. using cached_download on a fixed set of files would not be possible.

Drafted a first version that ignores any *.msgpack file:
https://github.com/UKPLab/sentence-transformers/blob/312be2a90a8779daecf9113a319b576588c2ab91/sentence_transformers/util.py#L379
Not yet really happy about the solution, because it will fail if the flax file gets a different extension or when other model types (tensorflow) are added.

For sentence-transformers, the number of files you must download can greatly vary from model to model

But each model does not know the list of files it needs? (haven't dived into sentence-transformers too much, so I'm curious)
In any case, if required by the use case, a black/whitelist of patterns in snapshot_download wouldn't be shocking to me

A sentence-transformers model is like a tree: A model consists of a variable number of sequential modules, and each module can branch to multiple sub-modules (which could again branch).  The setup is quite similar to the functional API from Keras:
https://keras.io/guides/functional_api/
Each layer has its own files. One layer is e.g. AutoModel and AutoTokenizer from transformers. Which files the different tokenizers were saving changed quite significant overtime.
So it is hard to know a-priori which files are needed by the model.
One way could be to create an overview.json file with all the files that belong to the model. Files later added would be ignored. But this would also be quite prone to errors to updates, e.g. when you just update the tokenizer which creates some new (required) files.

Thanks for the explanation. yes it is very similar to what AllenNLP is doing if I understand correctly


[$500] Chat - Keyboard is displayed on header menu screen after sending a file larger than 24 MB

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Version Number: 1.4.0-0
Reproducible in staging?: Y
Reproducible in production?: N
If this was caught during regression testing, add the test name, ID and link from TestRail:
Email or phone of affected tester (no customers):
Logs: https://stackoverflow.com/c/expensify/questions/4856
Expensify/Expensify Issue URL:
Issue reported by: Applause-Internal Team
Slack conversation: @
Action Performed:
Pre-requisite: user must be logged in.

Go to any chat.
Try to send a file larger than the 24 MB limit.
Close the "Attachment too large" modal.
Tap on the chat header.

Expected Result:
The header menu screen should be completely displayed without any issues.
Actual Result:
The keyboard is displayed on the screen.
Workaround:
Unknown
Platforms:

Which of our officially supported platforms is this issue occurring on?

[x] Android: Native
[x] Android: mWeb Chrome
[x] iOS: Native
[x] iOS: mWeb Safari
[ ] MacOS: Chrome / Safari
[ ] MacOS: Desktop

Screenshots/Videos
https://github.com/Expensify/App/assets/115492554/102cc1b4-462d-4f77-befa-3c0ebf636fff

View all open jobs on GitHub
Upwork Automation - Do Not Edit

Upwork Job URL: https://www.upwork.com/jobs/~014dbc5e01561f3f10
Upwork Job ID:<PHONE_NUMBER>215246336
Last Price Increase: 2023-11-16

Not repro in prod
https://github.com/Expensify/App/assets/115492554/d7d46d55-6c8b-48ba-993a-d1138ab740e3

@dukenv0307 this is marked as deploy blocker. What is offending PR?

@ntdiary sure thanks

Hmm, https://github.com/Expensify/App/pull/30864 was deployed to production yesterday so should be repro on production as well.

We can confirm if it's false alarm by reverting that PR locally.

As the original issue is edge case and not that critical, I suggest to revert to unblock deploy

Don't mind me, just going to remove and re-add the deploy blocker label to test something

If I am not wrong, you're testing the fix of not posting deploy blocker in slack channel 😀

:wave: Friendly reminder that deploy blockers are time-sensitive ⏱ issues! Check out the open StagingDeployCash deploy checklist to see the list of PRs included in this release, then work quickly to do one of the following:

Identify the pull request that introduced this issue and revert it.
Find someone who can quickly fix the issue.
Fix the issue yourself.

lol I already reviewed the PR, so I am going to reassign

Please assign me as well based on https://github.com/Expensify/App/issues/31426#issuecomment-1814359870

The fix for this has been verified on staging

Reminder set to pay, please take a look at the BZ steps when you have a chance @situchan 🙇

@dukenv0307 Nothing left here.
I think @ishpaul777 and @eVoloshchak will work on new PR in https://github.com/Expensify/App/issues/29379.

Payment summary:
$500 - @situchan C+

Paid, contract ended, do we need BZ steps here @situchan ?

The offending PR author/reviewer are already aware of this regression.
The bug was caught by QA team so no more regression test is needed.
So I think we can complete BZ checklist with this info.


Add support for Input Methods

Hello Tomas,
What would be the best way to incorporate multiple language inputs? What would be the best way to handle this?
I think languages like Spanish or Greek wouldn't be too hard to do. One could remap the KeyTyped events to insert the correct letter in their respective alphabets.
For other languages (like Chinese using PinYin or some other input method), this wouldn't work. For my purposes, I don't need support for a more complex language, just the simpler ones. However, finding a way to incorporate the system's input method would prevent each developer from having to create 1) a separate KeyTyped events remapping for each language used and 2) a method to switch from one keyboard layout to another, depending on what the user needs.

Hi Jordan,
different keyboard layouts, like Spanish or Greek, should just work. Is that not your experience? JavaFX's KeyTyped event already contains a keyboard layout-dependent character. Input methods and right-to-left (or bidirectional) text is not supported.

Sorry, I only meant input methods. I'm using a US keyboard layout, but if I wanted to quickly hop over to a Spanish/Greek/Chinese input method, it won't register.

I don't have any experience using input methods. A good place to start would be to look at what JavaFX's TextArea does.

I looked into TextArea and input methods in general. Here's what I found.
First, there's a specific Event for this: InputMethodEvent.
Second, the API says that the event is delivered to the Node that extends TextInputControl, which TextArea extends and which RichTextFX does not extend (it extends Control). I'm not sure what the underlying code is in TextInputControl.

The problem is that an area's InputMethodRequests value is null. Any InputMethodEvent won't be registered until this gets taken care of. My workaround is to "steal" a TextArea's InputMethodRequests (an instance of TextInputControlSkin). However, I don't fully understand the implementation of this (as you can see below). So, I hope you have more insight as to how to do this better. :-)
(Also, I know this isn't Java, but you can still see what I'm doing. I apologize in advance!)
import static groovyx.javafx.GroovyFX.start
start {
    stage(id: "stage", title: "Hello", primary: true, visible: true) {
        scene(width: 500, height: 500) {
            vbox(id: "vbox") {
                textArea(id: "textArea")
            }
        }
    }
    def richArea = new InlineCssTextArea()

    // richArea's InputMethodRequests is null.
    assert richArea.getInputMethodRequests() == null

    // "Stealing" the InputMethodRequests from a TextArea will work. However,
    //  it must already be initialized:

    // Won't work, and I'm not sure why. It's probably an issue with using GroovyFX...
    def badArea = new TextArea()
    vbox.getChildren().add(badArea)
    assert badArea.getInputMethodRequests() == null
    vbox.getChildren().remove(badArea)

    // Will work, but I'm not sure why it does rather than 'badArea'
    // textArea's InputMethodRequests is an instance of TextInputControlSkin
    assert textArea.getInputMethodRequests() != null
    richArea.setInputMethodRequests(textArea.getInputMethodRequests())

    // remove unneeded textArea and add richArea
    vbox.getChildren().remove(textArea)
    vbox.getChildren().add(richArea)

    // Now that richArea has an InputMethodRequests value, InputMethodEvents
    //  will register if a handler/filter is used. It won't without it.

    // NOTE: This handler only inserts the finished text. It doesn't insert the
    //  text that a user is still 'composing,' and replace this 'composed' text with the finished text.
    richArea.setOnInputMethodTextChanged({ e ->
        if (e.committed != "") {
            richArea.insertText(richArea.caretPosition, e.committed)
        }
    })
}

Thanks for posting back your workaround!

No problem!

I'm reopening this to add official support for this out-of-box.

As a Chinese user, I guess people who use the most commonly used input method of China, Pinyin, would like to see the candidate window (for picking possible words) just below the caret.
Below is a sample input of Chinese characters “你好” (Greetings) using Pinyin in macOS Pages, the candidate window appears just below the caret and before the first input character (which is also the initial caret position).

The workaround above works pretty well! But it doesn't show the candidate window in the place where the candidate window should be. To fix this, @JordanMartinez points out that Caret#getCaretBounds() can be used to get the caret's position on screen in #753. By passing the  rich text area to the InputMethodRequestsObject, the InputMethodRequestsObject#getTextLocation(int) can be modified to show the effect presented above:
    @Override
    public Point2D getTextLocation(int offset) {
        // a very rough example, only tested under macOS
        Optional<Bounds> caretPositionBounds = area.getCaretBounds();
        if (caretPositionBounds.isPresent()) {
            Bounds bounds = caretPositionBounds.get();
            return new Point2D(bounds.getMaxX() - 5, bounds.getMaxY());
        }

        throw new NullPointerException();
    }

Hi there,
I tested the workaround and it works. Great thanks.
I modified the code a bit to replace selected text with text commited
richArea.setOnInputMethodTextChanged({ e ->
        if (e.committed != "") {
            richArea.replaceSelection("")
            richArea.insertText(richArea.caretPosition, e.committed)
        }
    })

As for the candidate window, I found that only macOS can display it correctly. Native TextArea has this problem as well. The candidate window is at the lower-right under Windows 10 and is at the lower-left area of the application under Linux. I tested on JRE 1.8.

Another problem is that the composed text is not showing correctly.
The correct example:


Report I/O format errors only once; not for every test case

Resolved partially or wholly in 453b16869b559bbcdccdd8063d98f3e9509ebf64.


Landing page cannot display resource-specific metadata on latest dev branch

I checked out latest dev branch and accidentally found Ref Time Series can not display resource-specific metadata. Then I created a Raster, a Geog. Feature and a Model Program (I didn't try other res types yet). They are having the same issue. We guess this may be related to the recent refactoring of landing page. @mauriel133

@mjstealey, it seems that  django does not process blocks in included templates. Do you know a workaround for this? Otherwise I can just move the code back to genericresource.html.
http://stackoverflow.com/questions/9633387/django-using-blocks-in-included-templates

Do you know a workaround for this?

@ironfroggy would be better equipped to answer this question.

@mauriel133 I suggest just to move the code snippet that includes block extended_metadata and block extra_section from content-tabs.html back into genericresource.html for specific resource types to extend the block content to get it work first for now with comment indicating the reason for future reference.

@zhiyuli, can you verify if the issue is solved?

tested on www. closed


Enhancement on e-learning page

I would like to enhance the e-learning page by

Improving the navbar
Changing the fonts since the text isn't visible

@Spyder15 @SahityaRoy, please assign me this issue

@manika137 you can go ahead


Handle malformed URLs when stripping URL creds in couch_replicator

Previously there was an error thrown which prevented emitting _scheduler/docs responses. Instead of throwing an error, return null if the URL cannot be parsed.
This is a back-port to 3.x. of the PR on master https://github.com/apache/couchdb/pull/3138

@nickva if I don't put this in 3.1.1 is it crucial? I've already finished the release notes, is why I ask.

To be clear, still backport this. It just might not make 3.1.1.

@wohali thanks for taking a look, it's not as critical I think. Users can mitigate the error by simply deleting the malformed document from their _replicator dbs, so let's stick with what we have for 3.1.1 already.