Standardize working groups repositoryoy structure

Hello everyone,
We are trying to make a standard and uniform repository structure for all working groups of CHAOSS. This will make things easier for new members. See this document to know details about the proposed repo structure.
Please provide your feedback or concern about this proposal.

This is currently being worked on at the CHAOSS community level. There will be separate folders for completed metrics. Incomplete, unreleased metrics will only be in Google Documents.  These documents can be found in this spreadsheet: https://docs.google.com/spreadsheets/d/1tAGzUiZ9jdORKCnoDQJkOU8tQsZDCZVjcWqXYOSAFmE/edit#gid=1004270137


Release 1.2.0

[ ] travis builds passing
[ ] assess test coverage
[ ] close final issues

[ ] update the ui sample image

[ ] add a note on browser autostart
[ ] add a note on cmdline imports
[ ] add a note on default port 0

[ ] add javadoc

Release scheduled for tonight.

[ ] create release notes


Fix flake8 errors

We need to fix all flake8 errors ASAP.
git clone git@github.com:AIcrowd/real_robots.git
cd real_robots
pip install -e .
pip install requirements_dev.txt

flake8 .

should throw a lot of errors along the lines of :
./setup.py:15:1: E302 expected 2 blank lines, found 1
./setup.py:41:80: E501 line too long (82 > 79 characters)
./real_robots/__init__.py:12:1: F401 '.evaluate.evaluate' imported but unused
./real_robots/__init__.py:15:5: E128 continuation line under-indented for visual indent
./real_robots/__init__.py:16:1: E124 closing bracket does not match visual indentation
./real_robots/__init__.py:19:5: E128 continuation line under-indented for visual indent
./real_robots/__init__.py:20:1: E124 closing bracket does not match visual indentation
./real_robots/__init__.py:30:1: E302 expected 2 blank lines, found 1
...
...
and so on

all of them have to be individually dealt with to ensure we have a clean and maintainable code base.

Fixed with https://github.com/AIcrowd/real_robots/pull/4


Are there alternatives for downloading the models?

Hi,
I'm having a lot of issues downloading the models from the provided (baidu) link. Are there alternative sources for downloading the models? If not, would you be able to tell me how to download them from baidu? I've installed the required netdisk app on my local machine but I can't sign-in to download the models.
Thanks.

Hello,
I understand that accessing Baidu Netdisk can indeed be challenging in some regions, and unfortunately, I don't have experience in this area. You might want to try using a proxy. In order to share the models, which total over 300GB, through an alternative channel, I've set up a personal cloud storage. However, please note that the download speed might be limited. You can download the relevant files as needed from this link: https://gofile.me/7jg8U/wd40SgA0W

Hi, thanks for your quick response. We are having trouble downloading from that service; is it possible you can upload the models to this shared folder on onedrive? https://utoronto-my.sharepoint.com/:f:/g/personal/avery_laird_mail_utoronto_ca/EplPraBfJAxNgbmLPMglOicBDy1sLGOBGgBJ4cH23_IQtQ?e=y6y5Tn
I think no proxy should be required in that case. Thanks a lot for your help.

Hi, files have been uploaded.

Thank you very much!


Odoo 16 Editing Webseite

"I have a problem with Odoo 16. I am using Odoo 16 with Nginx Proxy Manager, and accessing the site works without any issues. However, when I try to edit the website in Odoo, the page doesn't load in the editor anymore. If I edit the page without the proxy, it works."

Where i can put
add_header 'Content-Security-Policy' 'upgrade-insecure-requests';

you need to ssh into the nginx proxy and manually edit the proxy_host in /opt/nginx-proxy-manager/data/nginx/proxy_hosts/number.conf and edit that file and add it under locations.


Default driver type Inference for pandas DataFrames

I think R pins has broader automatically guessing types (e.g. will default to RDS). Let's automatically store pandas DataFrames as CSV for now, so that the docs don't need to constantly specify type="csv".
TODO: discuss how people feel about R pins automatic type guessing just to double check

It seems like the type guessing works well for folks. We haven't had a lot of problems or complaints.

Ah thanks--I think one challenge for pins py is that our version of RDS is joblib, which has our careful read opt-in behaviors. Any sense for a good behavior if objects are e.g. lists or dictionaries? (Could also explicitly require a type in that or just default to joblib).

Let's match R pins' behavior roughly

JSON: builtin python types like list, dict
CSV: pandas DataFrame
joblib: everything else


[Bug] Issue while running facebook_ads transformations with new schema or for a new instance or environment

Is there an existing issue for this?

[X] I have searched the existing issues

Describe the issue
We are facing a facebook_ads issue when we try to build new facebook_ads dbt transformations in a new environment or instance. Because of this issue, we were blocked to build the full ad_reporting model of version 0.7.0 in the new environment which we created.
We tried to find the root cause for this but we couldn't find the actual issue.
Here is the actual error that we are getting when we tried to create Facebook_ads transformations in schema or instance or environment.
Here is the actual error that we are getting when we tried to create Facebook_ads transformations in schema or instance or environment.
Error message -
Completed with 1 error and 0 warnings:
 Runtime Error in model facebook_ads__creative_history_prep (models\intermediate\facebook_ads__creative_history_prep.sql)
 404 Not found: Dataset gcp-ftd-bi-sandbox:bi_chandu_practice_v3_facebook_ads_creative_history was not found in location US

Relevant error log or model output
03:21:04  Found 147 models, 117 tests, 0 snapshots, 0 analyses, 785 macros, 0 operations, 0 seed files, 117 sources, 0 exposures, 0 metrics
03:21:04
03:21:08  Concurrency: 16 threads (target='dev')
03:21:08
03:21:08  1 of 17 START view model bi_chandu_practice_v3_facebook_ads_source_v2.stg_facebook_ads__account_history_tmp  [RUN]
03:21:08  2 of 17 START view model bi_chandu_practice_v3_facebook_ads_source_v2.stg_facebook_ads__ad_history_tmp  [RUN]
03:21:08  3 of 17 START view model bi_chandu_practice_v3_facebook_ads_source_v2.stg_facebook_ads__ad_set_history_tmp  [RUN]
03:21:08  4 of 17 START view model bi_chandu_practice_v3_facebook_ads_source_v2.stg_facebook_ads__basic_ad_tmp  [RUN]
03:21:08  5 of 17 START view model bi_chandu_practice_v3_facebook_ads_source_v2.stg_facebook_ads__campaign_history_tmp  [RUN]
03:21:08  6 of 17 START view model bi_chandu_practice_v3_facebook_ads_source_v2.stg_facebook_ads__creative_history_tmp  [RUN]
03:21:10  4 of 17 OK created view model bi_chandu_practice_v3_facebook_ads_source_v2.stg_facebook_ads__basic_ad_tmp  [OK in 2.18s]
03:21:10  2 of 17 OK created view model bi_chandu_practice_v3_facebook_ads_source_v2.stg_facebook_ads__ad_history_tmp  [OK in 2.19s]
03:21:10  6 of 17 OK created view model bi_chandu_practice_v3_facebook_ads_source_v2.stg_facebook_ads__creative_history_tmp  [OK in 2.18s]
03:21:10  7 of 17 START table model bi_chandu_practice_v3_facebook_ads_source_v2.stg_facebook_ads__basic_ad  [RUN]
03:21:10  8 of 17 START table model bi_chandu_practice_v3_facebook_ads_source_v2.stg_facebook_ads__ad_history  [RUN]
03:21:10  9 of 17 START table model bi_chandu_practice_v3_facebook_ads_source_v2.stg_facebook_ads__creative_history  [RUN]
03:21:11  5 of 17 OK created view model bi_chandu_practice_v3_facebook_ads_source_v2.stg_facebook_ads__campaign_history_tmp  [OK in 2.25s]
03:21:11  3 of 17 OK created view model bi_chandu_practice_v3_facebook_ads_source_v2.stg_facebook_ads__ad_set_history_tmp  [OK in 2.25s]
03:21:11  10 of 17 START table model bi_chandu_practice_v3_facebook_ads_source_v2.stg_facebook_ads__campaign_history  [RUN]
03:21:11  11 of 17 START table model bi_chandu_practice_v3_facebook_ads_source_v2.stg_facebook_ads__ad_set_history  [RUN]
03:21:11  1 of 17 OK created view model bi_chandu_practice_v3_facebook_ads_source_v2.stg_facebook_ads__account_history_tmp  [OK in 2.43s]
03:21:11  12 of 17 START table model bi_chandu_practice_v3_facebook_ads_source_v2.stg_facebook_ads__account_history  [RUN]
03:21:16  12 of 17 OK created table model bi_chandu_practice_v3_facebook_ads_source_v2.stg_facebook_ads__account_history  [CREATE TABLE (7.0 rows, 288.0 Bytes processed) in 5.02s]
03:21:16  8 of 17 OK created table model bi_chandu_practice_v3_facebook_ads_source_v2.stg_facebook_ads__ad_history  [CREATE TABLE (23.2k rows, 2.8 MB processed) in
5.35s]
03:21:16  7 of 17 OK created table model bi_chandu_practice_v3_facebook_ads_source_v2.stg_facebook_ads__basic_ad  [CREATE TABLE (115.9k rows, 6.2 MB processed) in 5.49s]
03:21:16  10 of 17 OK created table model bi_chandu_practice_v3_facebook_ads_source_v2.stg_facebook_ads__campaign_history  [CREATE TABLE (815.0 rows, 60.7 KB processed) in 5.36s]
03:21:16  11 of 17 OK created table model bi_chandu_practice_v3_facebook_ads_source_v2.stg_facebook_ads__ad_set_history  [CREATE TABLE (6.0k rows, 538.9 KB processed) in 5.50s]
03:21:16  9 of 17 OK created table model bi_chandu_practice_v3_facebook_ads_source_v2.stg_facebook_ads__creative_history  [CREATE TABLE (16.5k rows, 12.3 MB processed) in 5.70s]
03:21:16  13 of 17 START view model bi_chandu_practice_v3_facebook_ads_v2.facebook_ads__creative_history_prep  [RUN]
03:21:17  13 of 17 ERROR creating view model bi_chandu_practice_v3_facebook_ads_v2.facebook_ads__creative_history_prep  [ERROR in 1.13s]
03:21:17  14 of 17 SKIP relation bi_chandu_practice_v3_facebook_ads_v2.facebook_ads__ad_adapter  [SKIP]
03:21:17  15 of 17 SKIP relation bi_chandu_practice_v3_facebook_ads_v2.facebook_ads__account_report  [SKIP]
03:21:17  16 of 17 SKIP relation bi_chandu_practice_v3_facebook_ads_v2.facebook_ads__ad_set_report  [SKIP]
03:21:17  17 of 17 SKIP relation bi_chandu_practice_v3_facebook_ads_v2.facebook_ads__campaign_report  [SKIP]
03:21:17
03:21:17  Finished running 7 view models, 10 table models in 13.23s.
03:21:18
03:21:18  Completed with 1 error and 0 warnings:
03:21:18
03:21:18  Runtime Error in model facebook_ads__creative_history_prep (models\intermediate\facebook_ads__creative_history_prep.sql)
03:21:18    404 Not found: Dataset gcp-ftd-bi-sandbox:bi_chandu_practice_v3_facebook_ads_creative_history was not found in location US
03:21:18
03:21:18    Location: US
03:21:18    Job ID: 9ac7911f-7b36-492c-ab55-3d9bfd89152b
03:21:18
03:21:18
03:21:18  Done. PASS=12 WARN=0 ERROR=1 SKIP=4 TOTAL=17

Expected behavior
The model should not give any errors and all the dependencies should get created automatically by the facebook_ads itself
dbt Project configurations
vars:
  api_source: google_ads
  ad_reporting__pinterest_enabled: True
  ad_reporting__microsoft_ads_enabled: True
  ad_reporting__linkedin_ads_enabled: False
  ad_reporting__google_ads_enabled: True
  ad_reporting__twitter_ads_enabled: False
  ad_reporting__facebook_ads_enabled: True
  ad_reporting__snapchat_ads_enabled: True
  ad_reporting__tiktok_ads_enabled: True

  facebook_ads_schema: bi_landing_fivetran_facebook_ads_v2
  facebook_ads_database: gcp-ftd-data-int-prod
  tiktok_ads_schema: bi_landing_fivetran_tiktok_ads
  tiktok_ads_database: gcp-ftd-data-int-prod
  pinterest_schema: bi_landing_fivetran_pinterest_ads
  pinterest_database: gcp-ftd-data-int-prod
  snapchat_schema: bi_landing_fivetran_snapchat_ads_v2
  snapchat_database: gcp-ftd-data-int-prod
  google_ads_schema: bi_landing_fivetran_google_adv
  google_ads_database: gcp-ftd-data-int-prod
  microsoft_ads_schema: bi_landing_fivetran_microsoftads_v2
  microsoft_ads_database: gcp-ftd-data-int-prod

models:

  bigdata:
    # Config indicated by + and applies to all files under models/example/
    example:
      +materialized: view
    marketing:
      +materialized: view
  # disable both pinterest models if not using pinterest ads
  pinterest:
    enabled: true
    +schema: pinterest
  pinterest_source:
    enabled: true
    +schema: pinterest_source

  # disable both microsoft ads models if not using microsoft ads
  microsoft_ads:
    +schema: microsoft_ads_v2
  microsoft_ads_source:
    +schema: microsoft_ads_source_v2

  # disable both linkedin ads models if not using linkedin ads
  linkedin:
    enabled: false
  linkedin_source:
    enabled: false

  # disable both twitter ads models if not using twitter ads
  twitter_ads:
    enabled: false
  twitter_ads_source:
    enabled: false

  # disable all three facebook ads models if not using facebook ads
  facebook_ads:
    enabled: true #IF YOU ARE USING FACEBOOK, DELETE THIS CONFIG, DO NOT SIMPLY SET TO TRUE
    +schema: facebook_ads_v2
  facebook_ads_source:
    enabled: true #IF YOU ARE USING FACEBOOK, DELETE THIS CONFIG, DO NOT SIMPLY SET TO TRUE
    +schema: facebook_ads_source_v2
  #facebook_ads_creative_history:
  #  enabled: true #IF YOU ARE USING FACEBOOK, DELETE THIS CONFIG, DO NOT SIMPLY SET TO TRUE
  #  +schema: facebook_ads

  # disable both google ads models if not using google ads
  google_ads:
    #enabled: true #IF YOU ARE USING GOOGLE ADS, DELETE THIS CONFIG, DO NOT SIMPLY SET TO TRUE
    +schema: google_ads
  google_ads_source:
    #enabled: true #IF YOU ARE USING GOOGLE ADS, DELETE THIS CONFIG, DO NOT SIMPLY SET TO TRUE
    +schema: google_ads_source

  # disable both snapchat ads models if not using snapchat ads
  snapchat_ads:
    enabled: true
    +schema: snapchat_ads_v2
  snapchat_ads_source:
    enabled: true
    +schema: snapchat_ads_source_v2

  # disable both tiktok ads models if not using tiktok ads
  tiktok_ads:
    enabled: true
    +schema: tiktok_ads
  tiktok_ads_source:
    enabled: true
    +schema: tiktok_ads_source

Package versions
packages:

package: fivetran/ad_reporting
version: 0.7.0

What database are you using dbt with?
bigquery
dbt Version
1.1.1
Additional Context

Are you willing to open a PR to help address this issue?

[ ] Yes.
[ ] Yes, but I will need assistance and will schedule time during our office hours for guidance
[ ] No.

Hi @chandu98 thank you for opening this issue. I was curious about one piece in particular before diving too deep into a possible solution.
I am curious that the error log looks like it is searching for the table in the the *_v3 schema. However, the schemas in your dbt_project.yml seem to all be *_v2. Are there additional configs that are being used that are not shown in the bug description?

Hi @chandu98 as this bug as been left stale for a period of time, and I am unsure what may be causing the issue at hand and believe this may be a config issue within your dbt_project.yml. As such, I will close this bug report.
If anyone else encounters the same issue, please feel free to reopen this bug report.


Feature: add customizable message condition

add that the message when you set a condition or you can't go up a level can be customizable for each level.

add that the message when you receive exp to use the display instead of the one you are currently using.
Since for when the name takes space to use the current one is ugly because in my case Paradox_Hierarchy instead of Paradox Hierarchy that is the display, besides it would be nice to be able to edit that message by level system.
I have to use the command /akarilevel exp add %player_name%  , because in the lobby is the only way I can give them xp.

It seems you might want to use the display name of the level groups instead of their edit names in these messages.

In the latest build, the default language files have been changed. Please regenerate them or refer to this to avoid variable confusion in the messages.

Additionally, you might want to use hex colors in the lang files. TabooLib Components might help solve your issue.
Here is an example:
example-json:   ==: JSON   text: '你好，朋友！感谢您使用 [&9&nTabooLib Components] 复合文本!'   args:     - url: 'https://plugins.ptms.ink/function/components/'
Example
For colors, you can use codes like &9&l or &{#FF0000}. These are not shown here for brevity.

Additionally, you might want to use hex colors in the lang files. TabooLib Components might help solve your issue.
Here is an example:
example-json:
  ==: JSON
  text: '你好，朋友！感谢您使用 [&9&nTabooLib Components] 复合文本!'
  args:
    - url: 'https://plugins.ptms.ink/function/components/'

For colors, you can use codes like &9&l or &{#FF0000}. These are not shown here for brevity.

add that the message when you receive exp to use the display instead of the one you are currently using.
Since for when the name takes space to use the current one is ugly because in my case Paradox_Hierarchy instead of Paradox Hierarchy that is the display, besides it would be nice to be able to edit that message by level system.
I have to use the command /akarilevel exp add %player_name% , because in the lobby is the only way I can give them xp.

Okay, and this? @CPJiNan

I just found that the maximum experience is<PHONE_NUMBER>, is it possible to increase the limit?

I just found that the maximum experience is<PHONE_NUMBER>, is it possible to increase the limit?
it would also be nice to be able to use advanced formulas

The variable type for level and experience has been changed from Int to Long in the latest build

I just found that the maximum experience is<PHONE_NUMBER>, is it possible to increase the limit?
it would also be nice to be able to use advanced formulas

The variable type for level and experience has been changed from Int to Long in the latest build.

Regarding your request to "separately check if different conditions are met and execute different actions," here is an example:

The "Condition" config item will evaluate the Kether script and check its return values. This allows you to use if-else statements to send messages to players based on the conditions.

Regarding your request to "separately check if different conditions are met and execute different actions," here is an example:

The "Condition" config item will evaluate the Kether script and check its return values. This allows you to use if-else statements to send messages to players based on the conditions.

I just found that the maximum experience is<PHONE_NUMBER>, is it possible to increase the limit?
it would also be nice to be able to use advanced formulas

The variable type for level and experience has been changed from Int to Long in the latest build.

okey, thx

Regarding your request to "separately check if different conditions are met and execute different actions," here is an example:

The "Condition" config item will evaluate the Kether script and check its return values. This allows you to use if-else statements to send messages to players based on the conditions.

ok and with that it does not send me the message of the en_US file that I told you about? the levelup-fail

is that already added or not yet? I just tried it and it doesn't work.

I don't know how to do the math but I have this formula for level 5 Exp: "20 / %level% + 100 * 2" and the result it gives is

Regarding your request to "separately check if different conditions are met and execute different actions," here is an example:

The "Condition" config item will evaluate the Kether script and check its return values. This allows you to use if-else statements to send messages to players based on the conditions.

ok and with that it does not send me the message of the en_US file that I told you about? the levelup-fail

It seems that your experience formula rather than the upgrade condition is the problem. When using the default formula, it seems that the custom message can be received normally.

Regarding your request to "separately check if different conditions are met and execute different actions," here is an example:

The "Condition" config item will evaluate the Kether script and check its return values. This allows you to use if-else statements to send messages to players based on the conditions.

ok and with that it does not send me the message of the en_US file that I told you about? the levelup-fail

I tested using almost the same configuration as yours, and it seems that your experience formula rather than the upgrade condition is the problem.
When using the default formula, it seems that the custom message can be received normally.

if I was testing and if it seems to be problem the formula since for example if I put a formula in which it gives decimals is where the problem is since for example this formula (100 * 2 ) * (21 / 7) gave me well osea 600, but if I change 7 by 8 or %level% and gives me the value of the image that you pass before, as it gives decimals and gives error and then when you level up having this formula (100 * 2 ) * (21 / %level%) does not update well and does not allow level up even if you have<PHONE_NUMBER>0 exp points.

It seems that the decimal point in your calculated result is missing.
Maybe you can try the JavaScript parseInt() function.
As for the sin value, I think you can try Math.sin().

then how should be the formula using javascript and math.sin()?

then how should be the formula using javascript and math.sin()?

Maybe you can try the JavaScript Number.toFixed() function.
For example:
(12.5).toFixed()

As for the sin value, I think you can try Math.sin().
(Math.sin(1)*100).toFixed()

ok, thank you very much, I will try the last snapshot with all this, and if I find any problem, I will let you know.
by the way the command to give exp the maximum that it allows to put is<PHONE_NUMBER> and now the limit of exp is greater, it would not be his serious that it allows to put the maximum that if I am not mistaken it is<PHONE_NUMBER>854775807

ok, thank you very much, I will try the last snapshot with all this, and if I find any problem, I will let you know.
by the way the command to give exp the maximum that it allows to put is<PHONE_NUMBER> and now the limit of exp is greater, it would not be his serious that it allows to put the maximum that if I am not mistaken it is<PHONE_NUMBER>854775807

It has been fixed in the latest build.

okey, thx

okey, thx, then you can close the issue, so if you want anything else I will open another issue, by the way where is the repo of the wiki to help with the translation etc ...

OK.
Here is the repository: https://github.com/CPJiNan/Wiki, and here is the plugin documentation: https://cpjinan.github.io/Wiki/.
I would greatly appreciate it if you could help with the translation.


Features/oozie scheduler

I have taken @ljank great work and fixed last few comments given by @paulbramsen.
In addition I merged it with master since it was lagging behind and added the app-conf/SchedularConf.xml example of usage.

Added support for (not in) authenticated oozie client

@NoamShaish, thanks for taking this up.
I have a couple of issues with this.
For the Dr. Elephant features, especially the Flow/Job history to work correctly, the 4 ids (jobDefId, jobExecId, flowDefId and flowExecId) have to be defined correctly. Check this section. I don't think that the current Ids defined in this PR addresses them correctly.
Here is my take on this:
In Oozie, we may run a flow with or without a coordinator. When we want to run a single execution of a flow, we can run it without configuring a coordinator. And when we want the job to run frequently, which is when the history makes sense, we need schedule it using the coordinator. So based on these two different ways of running a flow, we need to properly compute the IDs. The below Ids according to me work perfectly fine.
If Coordinator scheduled,
Job Reference ID:   C_ID-ActionName-Depth
Job Execution ID:  Oozie Job ID
Flow Reference ID:  Coordinator ID = C_ID
Flow Execution ID: Coordinator Action ID = C_ID@1
If not scheduled by a coordinator,
Job Reference ID: Oozie Job ID
Job Execution ID:  Oozie Job ID
Flow Reference ID:  Super Parent Oozie job ID
Flow Execution ID:  Super Parent Oozie job ID
We can get all the above information by enabling 'oozie.action.jobinfo.enable' in Oozie. Take a look at OOZIE-1658, OOZIE-2344 and OOZIE-2346. I'll attach my implementation of this below. My class may be a little outdated.
Let me know if I misunderstood something.

The URLs in the below class may not make sense if the UI is not enabled. We can configure the template as you did in SchedulerConf.xml
/**
 * This class provides methods to load information specific to the Oozie scheduler.
 */
public class OozieScheduler implements Scheduler {

  private static final Logger logger = Logger.getLogger(OozieScheduler.class);

  public static final String SCHEDULER_NAME = "oozie";
  public static final String OOZIE_JOB_ID = "oozie.job.id";
  public static final String OOZIE_JOB_INFO = "oozie.job.info";

  // Properties inside OOZIE_JOB_INFO
  public static final String OOZIE_WF_COORD_ID = "coord.id";
  public static final String OOZIE_WF_DEPTH = "wf.depth";
  public static final String OOZIE_JOB_SUPER_PARENT = "wf.superparent.id";
  public static final String OOZIE_ACTION_NAME = "action.name";
  public static final String OOZIE_NOTIFICATION_URL = "mapreduce.job.end-notification.url";

  public static final String QUERY_JOB_PARAM = "?job=";
  public static final String QUERY_JOB_CALLBACK = "callback?id=";

  private String jobDefId;
  private String jobExecId;
  private String flowDefId;
  private String flowExecId;

  private String jobDefUrl;
  private String jobExecUrl;
  private String flowDefUrl;
  private String flowExecUrl;

  private String jobName;
  private int workflowDepth;

  public OozieScheduler(String appId, Properties properties) {
    if (properties != null) {
      loadInfo(appId, properties);
    } else {
      // Use default value of data type
    }
  }

  private void loadInfo(String appId, Properties properties) {
    if (properties.get(OOZIE_JOB_ID) == null || properties.getProperty(OOZIE_JOB_INFO) == null) {
      throw new RuntimeException(appId + " doesn't have the right configurations for Oozie support.");
    }

    String oozieJobId = properties.get(OOZIE_JOB_ID).toString();

    Map<String, String> oozieJobProperties = Utils.parseCsKeyValue(properties.getProperty(OOZIE_JOB_INFO));
    String superParentJobId = oozieJobProperties.get(OOZIE_JOB_SUPER_PARENT);
    String coordId = oozieJobProperties.get(OOZIE_WF_COORD_ID);
    String actionName = oozieJobProperties.get(OOZIE_ACTION_NAME);
    String depth = oozieJobProperties.get(OOZIE_WF_DEPTH);

    // Update the 4 ids (flowDefId, flowExecId, jobDefId, and jobExecId)
    if (coordId != null) {
      // Construct the jobExecId as <coordId>-<actionName>-<depth> to ensure this correctly filters all
      // mr jobs triggered by a job for a particular execution. In oozie, actionNames are not unique in the
      // entire flow. They are unique only at a particular workflow level. In order to distinguish between
      // two actions having the same actionName, we include the depth in this id.
      if (actionName == null || depth == null) {
        throw new RuntimeException(appId + " doesn't have the right configurations for Oozie support.");
      }
      jobExecId = coordId.substring(0, coordId.lastIndexOf('@')) + "-" + actionName + "-" + depth;
      flowDefId = coordId.substring(0, coordId.lastIndexOf('@'));
    } else {
      jobExecId = oozieJobId;
      flowDefId = superParentJobId;
    }
    jobDefId = oozieJobId;
    flowExecId = superParentJobId;

    // Example: notification url = http://host:port/oozie/callback?id=0000001-1...@mr-node&status=$jobStatus
    String notificationUrl = properties.get(OOZIE_NOTIFICATION_URL) != null ?
        properties.get(OOZIE_NOTIFICATION_URL).toString() : null;

    if (notificationUrl != null && notificationUrl.contains(QUERY_JOB_CALLBACK)) {
      String baseUrl = notificationUrl.substring(0, notificationUrl.indexOf(QUERY_JOB_CALLBACK));
      jobExecUrl = baseUrl + QUERY_JOB_PARAM + oozieJobId;
      jobDefUrl = baseUrl + QUERY_JOB_PARAM + oozieJobId;
      flowExecUrl = baseUrl + QUERY_JOB_PARAM + superParentJobId;
      flowDefUrl = baseUrl + QUERY_JOB_PARAM + superParentJobId;
    } else {
      logger.warn("Couldn't calculate the job and flow links for " + appId + ". Make sure the notification url is"
          + "injected into the job conf.");
    }

    workflowDepth = oozieJobProperties.get(OOZIE_WF_DEPTH) != null ?
        Integer.parseInt(oozieJobProperties.get(OOZIE_WF_DEPTH)) : 0;
    jobName = actionName;
  }

  @Override
  public String getSchedulerName() {
    return SCHEDULER_NAME;
  }

  @Override
  public String getJobDefId() {
    return jobDefId;
  }

  @Override
  public String getJobExecId() {
    return jobExecId;
  }

  @Override
  public String getFlowDefId() {
    return flowDefId;
  }

  @Override
  public String getFlowExecId() {
    return flowExecId;
  }

  @Override
  public String getJobDefUrl() {
    return jobDefUrl;
  }

  @Override
  public String getJobExecUrl() {
    return jobExecUrl;
  }

  @Override
  public String getFlowDefUrl() {
    return flowDefUrl;
  }

  @Override
  public String getFlowExecUrl() {
    return flowExecUrl;
  }

  @Override
  public int getWorkflowDepth() {
    return workflowDepth;
  }

  @Override
  public String getJobName() {
    return jobName;
  }
}

@akshayrai I tend to agree with you that currently the configurations are not optimal.
But on the other hand I think the following configuration will be better:
If Coordinator scheduled,
Job Reference ID: Job AppName
Job Execution ID: Oozie Job ID
Flow Reference ID: Coordinator Job name
Flow Execution ID: Coordinator Action ID = C_ID@1
If not scheduled by a coordinator,
Job Reference ID: Job AppName
Job Execution ID: Oozie Job ID
Flow Reference ID: Super Parent Job AppName
Flow Execution ID: Super Parent Oozie job ID
This way we will get a meaningful names in UI and support sub-workflow without forcing users any special configurations.

@NoamShaish, the values you mentioned should be fine as long as the App Names and Job Names are unique across all the jobs and actions. Otherwise Dr. Elephant can mix things up while trying to group and aggregate the historical jobs. I am not sure if AppNames and JobNames are unique, are they?

@akshayrai AppName is the name from the workflow XML attribute.
As far as I understand "Job Reference ID"/ "Job Definition ID" and "Flow Reference ID"/"Flow Definition ID" should be unique cross executions.
For example if I stop the coordinator in order to upgrade my actual job and than start it again I will get a new coordinator id. If I use the coordinator ID as definition ID than the different coordinators wont be aggregated even though they are the same.
By using AppName which is the logic identification of the flow (or job) set at the workflow.xml or coordinator.xml I achieve the users logical definition.
Consider that I will not receive from Dr-Elephant a not supported action id (for example :start:, ssh, fs etc.)
I will add action to "Job Definition ID" in order to solve multiple supported action in same workflow.

@NoamShaish, I am a little confused when you say "unique across executions". Let me clarify so that both of us understand what exactly is the requirement here for Dr. Elephant.
"Job Reference ID" and "Flow Reference ID" should be the same for all executions of a specific job/flow(which I am sure you agree) but they should be unique across different jobs/flows. In other words, we cannot have two different jobs/flows to have the same Job/Flow Reference ID. That is why I asked if the logical JobNames and AppNames are unique to a specific job/flow?
I agree with your point when you say somebody stops the coordinator and restarts, it gets a different coordinator id. However, in that case, since it gets a different execution id, we have to consider it as a new separate execution.

@akshayrai lets see if I understand:
different occurrences of the same flow (coordinator restart/manual workflow committed multiple times) should be aggregated separately.
I wish as a user to see job history and configuration issues, the scheduler is not what interest me, thats just a delivery mechanism. Oozie in this case is a bit more than scheduler I agree but, I want to fine tune my jobs/flows not the Oozie jobs...
Ill try to make a code analogy:
Flow Reference Id = Class
Flow Execution Id = Instance
Job Reference Id = Field name
Job Execution Id = Field value
then when aggregating Flow reference I wish to see all history cross instances?
I want to know if my class uses too much memory or if a field should be integer and not long.

I hope it make sense

I agree with your viewpoint.
But I think the point your trying to miss is that, say if two different users create their own job/flow with the same AppName or JobName, then we want a way to distinguish them unless users are not allowed to reuse the AppName and JobName. Are these names globally unique?

@akshayrai Seems like the ever lasting battle of usability versus user usage protection.
Lets try a third approach: user awareness
By default we will use the Oozie uniqueness as you suggested.
In addition I'll add a boolean property appNameUniqueness. This property should be used only when one can be sure all appNames are unique across Oozie users.
If appNameUniqueness == false (default value):
Coordinator scheduled:
Job Reference ID: C_ID-ActionName-Depth
Job Execution ID: Oozie Job ID
Flow Reference ID: Coordinator ID = C_ID
Flow Execution ID: Coordinator Action ID = C_ID@1
Manual committed:
Job Reference ID: Oozie Job ID
Job Execution ID: Oozie Job ID
Flow Reference ID: Super Parent Oozie job ID
Flow Execution ID: Super Parent Oozie job ID
If appNameUniqueness == true:
Coordinator scheduled,
Job Reference ID: Job AppName-ActionName
Job Execution ID: Oozie Job ID
Flow Reference ID: Coordinator Job name
Flow Execution ID: Coordinator Action ID = C_ID@1
Manual committed:
Job Reference ID: Job AppName-ActionName
Job Execution ID: Oozie Job ID
Flow Reference ID: Super Parent Job AppName
Flow Execution ID: Super Parent Oozie job ID

Sounds good to me. Thanks @NoamShaish.

@NoamShaish, can you update the PR with the changes we agreed upon?

@akshayrai sorry for the delay there is holidays here these days. I hope to get to it by the end of the week

@NoamShaish, any update on this?

@akshayrai will be done this weekend

+1 @NoamShaish, shall I merge this?

@akshayrai is it a question for me?

Merged! Thanks @NoamShaish


Disabling ripples causing errors

Bug, feature request, or proposal:
Bug
What is the expected behavior?
No console errors
What is the current behavior?
Uncaught TypeError: Cannot read property 'launch' of undefined
this._focusedRipple = this._ripple.launch
What are the steps to reproduce?
https://plnkr.co/edit/M1FwZpvoSKW1z3YGAJ2P
What is the use-case or motivation for changing an existing behavior?
Shouldn't cause errors
Which versions of Angular, Material, OS, browsers are affected?
Angular 4.0.2
Material beta.3
Is there anything else we should know?

Should be fixed with https://github.com/angular/material2/commit/e22b55e811b867f3015500b800595f68e079985b


Train with custom data on bert question answering

Hi all
I have trained bert question answering on squad v 1 data set. As I was using colab which was slow . so I used 5000 examples from squad and trained the model which took 2 hrs and gave accuracy of 51%. My question is that

As i saved pytorch_bin file after trainining. Can i use this new bin file and again train next 5000 from squad.should i replace this bin file with old pytorch bin file created in uncased folder. What steps i need to follow

i have a custom data. To train on custom qyestion answer. Do i need to include same dataset(append) in squad / put this new file in training data=custom data.? How can i leverage squad trained model to further train on custom data

can anybody help me with script to convert my data to squad format

Detailed steps are appreciated fo leveraging squad traines model and train for custom data on top of same

You can put the pytorch_model.bin file that was output from your finetuning on squad in some other folder and set that folder as the bert_model='path/to/this/folder'. The folder needs to have the files bert_config.json and vocab.txt from the first pretrained model you used though.
I think you can first train on squad, then use the model to further train on your custom QA dataset, using that model (i.e. set bert_model as explained in 1.)
You can read the squad training data with:

import json
input_file = 'train-v1.1.json'
with open(input_file, "r", encoding='utf-8') as reader:
    input_data = json.load(reader)["data"]

The input data, under the top level "data" tag, holds "paragraphs" tags, which in turn holds texts in "context" tags, and questions and answers in "qas" tags. You can check the structure of the texts/questions/answers like this.
from pprint import pprint
pprint(input_data[0])

{'paragraphs': [{'context': 'Architecturally, the school has a Catholic '
                            "character. Atop the Main Building's gold dome is "
                            'a golden statue of the Virgin Mary. Immediately '
                            'in front of the Main Building and facing it, is a '
                            'copper statue of Christ with arms upraised with '
                            'the legend "Venite Ad Me Omnes". Next to the Main '
                            'Building is the Basilica of the Sacred Heart. '
                            'Immediately behind the basilica is the Grotto, a '
                            'Marian place of prayer and reflection. It is a '
                            'replica of the grotto at Lourdes, France where '
                            'the Virgin Mary reputedly appeared to Saint '
                            'Bernadette Soubirous in 1858. At the end of the '
                            'main drive (and in a direct line that connects '
                            'through 3 statues and the Gold Dome), is a '
                            'simple, modern stone statue of Mary.',
                 'qas': [{'answers': [{'answer_start': 515,
                                       'text': 'Saint Bernadette Soubirous'}],
                          'id': '5733be284776f41900661182',
                          'question': 'To whom did the Virgin Mary allegedly '
                                      'appear in 1858 in Lourdes France?'},
                         {'answers': [{'answer_start': 188,
                                       'text': 'a copper statue of Christ'}],
                          'id': '5733be284776f4190066117f',
                          'question': 'What is in front of the Notre Dame Main '
                                      'Building?'},
                         {'answers': [{'answer_start': 279,
                                       'text': 'the Main Building'}],
                          'id': '5733be284776f41900661180',
                          'question': 'The Basilica of the Sacred heart at '
                                      'Notre Dame is beside to which '
                                      'structure?'},
                         {'answers': [{'answer_start': 381,
                                       'text': 'a Marian place of prayer and '
                                               'reflection'}],
                          'id': '5733be284776f41900661181',
                          'question': 'What is the Grotto at Notre Dame?'},
                         {'answers': [{'answer_start': 92,
                                       'text': 'a golden statue of the Virgin '
                                               'Mary'}],
                          'id': '5733be284776f4190066117e',
                          'question': 'What sits on top of the Main Building '
                                      'at Notre Dame?'}]},
                {'context': "As at most other universities, Notre Dame's ....

(many more context and qas tags are printed here)

@navdeep1604 or @maxlund  or @thomwolf :  Was a custom training done and tested? We faced few issues like:

After training, previous correct questions started getting wrong.
All questions are started answering same answer
All questions started answering something wrong

Would anyone like to share observations, if same or different problems faced. And curious to know what actions or tricks were made to fix these issues.

This might help you setup a QA system with custom data, it's built on top of this repo: https://github.com/cdqa-suite/cdQA

Hi @SandeepBhutani ,
I faced similar issue, since my custom training data (240 QA pairs) was very less.

Hi, for anyone who has made a custom QA dataset, how did you go about get the start position and end position for the answers or did you already have them easily accessible? I have a large dataset set of questions with corresponding context given by people; however, I don't have the specific answers as there can be many acceptable answers. My goal is to determine whether the context contains an answer to the question (similar to squad 2.0). Preliminary results after fine tuning on Squad 2.0 weren't super great so I wanted to add more examples. Any recs on how I could label my data in the correct format for say a bert or would I need to crowd source labels from a vendor?

Thanks for the link @andrelmfarias . I was looking over it and it seems extremely useful for sure. Seems like it will take a long time to generate a large corpus of training data but nevertheless its seems quite helpful. Thanks!

Hi @andrelmfarias, thank you for sharing this great resource!
The cdQA-suite seems to cater to a specific kind of question answering, as described in your Medium article. To summarise, it looks for the answer to a question from a collection of documents -- all these documents most likely contain different kinds of information regarding a particular topic. For example, a system built using cdQA could contain 10 different documents regarding 10 different historical periods, and you could ask it a question about any of these time periods, and it would search for the relevant answer within these 10 documents.
However, if the system you want to build is such: you have 10 court orders, and you want to ask the system the same set of questions for each court order. For example:

When was the order filed?
Who filed the order?
Who was the order filed against?
Was there a settlement?

In this case, I wouldn't want the system to search through every document, but instead look for answers within the document itself. Exactly like SQuaD 2.0.
My assessment is that I wouldn't be able to build such a system using cdQA but I could use the cdQA annotator to build my dataset. Is that a sound assessment?
Also, I'm curious to hear your thoughts on how feasible it would be to expect good results when the context is rather long (anywhere between 2-10 pages).
Thank you :)

Hi @rsomani95 ,
As your questions are related particularly to cdQA I opened an issue with your questions in our repository to avoid spamming here: https://github.com/cdqa-suite/cdQA/issues/275
I just answered them there.


Change: p_str, p_strc

By default p_str and p_strc only parses a single string that was passed to it. It makes sense that the user can provide
muliple strings and those are all put together with p_or.
So instead of
my $sign = p_or( p_strc('+'), p_strc('-') );

someone just can write.
my $sign = p_strc('+', '-');

same goes for p_str. anding multiple strings together anyway makes no sense. Then you just parse one string.

Work finished. Using p_str, p_strc this way also makes the parsing faster.


[SPARK-45786][SQL] Fix inaccurate Decimal multiplication and division results

What changes were proposed in this pull request?
This PR fixes inaccurate Decimal multiplication and division results.
Why are the changes needed?
Decimal multiplication and division results may be inaccurate due to rounding issues.
Multiplication:
scala> sql("select  -14120025096157587712113961295153.858047 * -0.4652").show(truncate=false)
+----------------------------------------------------+
|(-14120025096157587712113961295153.858047 * -0.4652)|
+----------------------------------------------------+
|6568635674732509803675414794505.574764              |
+----------------------------------------------------+

The correct answer is<PHONE_NUMBER>732509803675414794505.574763
Please note that the last digit is 3 instead of 4 as
scala> java.math.BigDecimal("-14120025096157587712113961295153.858047").multiply(java.math.BigDecimal("-0.4652"))
val res21: java.math.BigDecimal =<PHONE_NUMBER>732509803675414794505.5747634644

Since the factional part .574763 is followed by 4644, it should not be rounded up.
Division:
scala> sql("select -0.172787979 /<PHONE_NUMBER>45018957788294905796.5").show(truncate=false)
+-------------------------------------------------+
|(-0.172787979 /<PHONE_NUMBER>45018957788294905796.5)|
+-------------------------------------------------+
|-3.237521E-31                                    |
+-------------------------------------------------+

The correct answer is -3.237520E-31
Please note that the last digit is 0 instead of 1 as
scala> java.math.BigDecimal("-0.172787979").divide(java.math.BigDecimal("533704665545018957788294905796.5"), 100, java.math.RoundingMode.DOWN)
val res22: java.math.BigDecimal = -3.237520489418037889998826491401059986665344697406144511563561222578738E-31

Since the factional part .237520 is followed by 4894..., it should not be rounded up.
Does this PR introduce any user-facing change?
Yes, users will see correct Decimal multiplication and division results.
Directly multiplying and dividing with org.apache.spark.sql.types.Decimal() (not via SQL) will return 39 digit at maximum instead of 38 at maximum and round down instead of round half-up
How was this patch tested?
Test added
Was this patch authored or co-authored using generative AI tooling?
No

test: https://github.com/kazuyukitanimura/spark/actions/runs/6775292999/job/18414265284

Merged to master/3.5/3.4. Thank you, @kazuyukitanimura .
Could you make a backporting PR to branch-3.3 too?

Thank you all

Could you make a backporting PR to branch-3.3 too?

I will @dongjoon-hyun


Removed x_by fields from API v2 response

refs #10286
The first commit just contains a pre-refactoring, which was needed to easily modify the API v2 expected responses. No need to outsource to master, you can look at each commit individually.
Second commit removes x_by  fields from all API v2 endpoints. We will work on a new feature which will replace x_by fields. Issue is coming soon.

Upcoming PR's for #10286:

store owner user id if integrations update a resource (super hot fix, super temporary, quick and dirty)
proper deprecation of x_by fields in code base and for docs

@gargol Could you please give me a review tomorrow? Thanks :)


Invalid URL 'gpt-3.5-turbo/fine_tuning/jobs': No scheme supplied. Perhaps you meant https://gpt-3.5-turbo/fine_tuning/jobs?

Describe the bug
When using fine tuning I uploaded a file with success and when creating a job using the resulting job id I get this error:
Error communicating with OpenAI: Invalid URL 'gpt-3.5-turbo/fine_tuning/jobs': No scheme supplied. Perhaps you meant https://gpt-3.5-turbo/fine_tuning/jobs?
To Reproduce
This is the python code I'm running:
response = openai.FineTuningJob.create(training_file_id, model)
for model I'm using "gpt-3.5-turbo"
I'm using openai library version 0.28.1
Code snippets
No response
OS
linux
Python version
3.11
Library version
0.28.1

@Rugaliz I am interested.

Please upgrade to the v1 of this package.
The problem may have been that you had set the base url to be a model.


Added "Machine Learning for Software Engineers"

@ZuzooVn this looks great!!! Nice work on your guide.
(BTW Ignore the 'build failure,' that is something  I will figure out (unrelated for your change).)
Would you mind linking back to Dive into Machine Learning on your guide as well? Perhaps in the Resources section?

I linked your great tutorial.


access to mapped network driver or shared folders?

I got some shared folders and

map them to network drivers. But I cannot find these drivers in /mnt .Is there something i missed?
use mklink, then I got  ' bash: cd: main: Input/output error '
Is there any way to use them in bash?

There is also a UserVoice topic related to this.  I've voted for it because this is most definitely something I'll be needing as well.
https://wpdev.uservoice.com/forums/266908-command-prompt-console-bash-on-ubuntu-on-windo/suggestions/13313280-access-to-network-shares-and-removable-drives

It would be nice to see added Network Drives listed in the /mnt directory. So once you add a network drive on the windows side, its configured to pull in the new added drive in the /mnt directory.

While it's only a partial workaround (since cifs-utils doesn't succeed in mounting the drive), in the interim it's worth noting that Samba (the smbclient package) works perfectly under WSL and will let you at least move files back and forth from SMB/CIFS network shares.

I've found two places (@cerebrate's comment included) that say smbclient works perfectly. This is not the case for me. I get the following error when I try smbclient:
ERROR: Could not determine network interfaces, you must use a interfaces config line
Any ideas on how to fix this?

Wait... seems like I may have just found the answer. A line in /etc/samba/smb.conf that declares the default interface to use just had to be uncommented.

Just out of curiosity @pvenky, what interface name did you use? I tried eth0 because I can't seem to list my network interfaces (ifconfig or ip link return errors) and that still doesn't work.

@acastaner I can't use ifconfig either (and I think that is a known limitation). However, the line in smb.conf does say eth0. This is the line
interfaces = <IP_ADDRESS>/8 eth0

I'm having the same issue with mounting a share.

For reference, my interfaces line is:
interfaces = lo eth0 eth1
(Both eth0 and eth1 since my machine has two network cards, one wired, one wireless.) I believe that including the loopback interface, lo, is necessary for this to work properly - if you haven't included it by name, try that?

I have tried both <IP_ADDRESS>/8 eth0 and lo eth0, but when I run smbclient the OS still tells me it can't find any network interface:

arnaud@CLAVAIN:~$ smbclient
WARNING: The "syslog" option is deprecated
WARNING: no network interfaces found

So not sure what's happening here or how to troubleshoot.

Oh! Have you tried using smbclient to connect to a server anyway, though? You'll always get the no-network-interfaces-found warning (since the relevant ways to find them aren't yet part of WSL), but if you specify the interfaces explicitly, that doesn't matter and you can safely ignore the warning. My setup produces those same warnings every time I run smbclient, but it connects and moves files about just fine.

Ah, right, actually trying to connect and ignore the error seems to work, I can ls the files. Nice. Still doesn't solve my issue though since I need to be able to rsync, but it's good to know this works.

@acastaner Hm. You could work around that by running rsync as a daemon at one end or the other, maybe? I believe both cwRsync and DeltaCopy can support that for Windows.

I also need this. Can't use WSL at work until network drives can be accessed directly. As a workaround, cygwin works for now but the performance is horrible compared to WSL.

smbclient -L localhost --option='interfaces = eth0' works fine for me.
I can't seem to connect to the administrative shares (C$, Admin$) but this is probably some other registry or configuration issue. If I share a folder on the same machine, I can access it (this would be more interesting the other way around, having a Samba share accessed through Windows).

@GSam That command works for me, I am also able to browse the shares apart from the windows shares C$, Admin$ etc.
I just need to be able to mount the share then I would be able to actually use Bash On Windows, at this point it's useless for me as all development files are on a shared raid server.
Currently using cygwin however having some issues with that, something I believe Bash on Windows would fix.

@Ferrisbane I seem to have just figured out how to get the Samba file server somewhat working in Bash on Windows. That may very well be a plausible alternative to mounting the shares.

Just tried mapping a network drive and looking for it in /mnt. It is not working properly (as expected since this item is still open). Any idea of when this might be fixed?

1

I can not see any interest from MS in this...
All they have said (about half a year ago - see link below):

"on our backlog, but not currently scheduled"

This feature is (in my eyes) the most important,
forget tabbed windows (currently voted higher than this)... that's just nice to have.
The ability to mount network shares is required for most people Bash on Windows is aimed at (Developers), without this feature bash on windows is completely useless.
You can view/vote on the feature here:
uservoice - mount-nfs-sshfs-samba-smb-network-drives

@Ferrisbane - a lot can change in a year.  We understand that this is a required scenario for many of our users and are looking at adding this support soon.

That would be awesome! Even if we just had fuse support, I think we could make everything else happen.

Here's another vote for this feature.  Having bash access to CIFS mounted filesystems will be great for Sysadmins as well.
Thanks for the great work WSL team.

Looks like this feature is happening! Insider Build 16176 says it can mount network drives and network locations using the drvfs in WSL. I'm assuming this will work for NFS drive mounts, too.
$ sudo mkdir /mnt/d
$ sudo mount -t drvfs D: /mnt/d

@mattjanssen yes but it does not yet work for shared folders (vmware).

@mattjanssen Any ideas on when that insider build will go public/beta?

You can vote on the UserVoice issue for shared folders here

@laktak That looks like a different issue altogether.

The OP here was:

I got some shared folders and map them to network drivers. But I cannot find these drivers in /mnt .Is there something i missed?

Mounting CIFS shares was added in Insider Build 16176 and released Fall Creators Update 16299. The blog post is here. For other scenarios (meaning different Windows filesystem drivers) see #579 #2896 #2999 #2163 and the like.


Cypress/E2E: Automate test community listed test cases

Issues Automated:

MM-T423 Online Status - Statuses update in center, in member icon drop-down, and in DM LHS sidebar
MM-T244 Webapp: Post menu item Mark as Unread appearance
MM-T1615 Pasting code block text into external apps does not include line numbers
MM-T257 Mark as Unread when bringing window into focus
MM-T669 Custom slash command in DM and GM
MM-T2367 Compact view

Hello @yasserfaraazkhan,
Thanks for your pull request! A Core Committer will review your pull request soon. For code contributions, you can learn more about the review process here.

E2E tests not automatically triggered, because PR has no approval yet. Please ask a developer to review and then try again to attach the QA label.

/e2e-test

Successfully triggered e2e testing!
https://git.internal.mattermost.com/qa/cypress-ui-automation/-/pipelines/206755

/e2e-test INCLUDE_FILE="custom_slash*, slash_commands*, mark_as*, copy_post*, check_user*, channel_scroll*"

@josephbaylon Thank you!!  🙌
I've pushed the suggested changes.

/update-branch

Thanks @yasserfaraazkhan
Great Job 👍

/release-note-none

/e2e-test INCLUDE_FILE="slash_commands_spec.js,mark_as_unread_spec.js,copy_post_text_spec.js,check_user_status_spec.js,channel_scroll_spec.js"

Triggering e2e testing with options:
&map[INCLUDE_FILE:slash_commands_spec.js,mark_as_unread_spec.js,copy_post_text_spec.js,check_user_status_spec.js,channel_scroll_spec.js]

Successfully triggered e2e testing!
https://git.internal.mattermost.com/qa/cypress-ui-automation/-/pipelines/211512

/e2e-test INCLUDE_FILE="slash_commands_spec.js,mark_as_unread_spec.js,copy_post_text_spec.js,check_user_status_spec.js,channel_scroll_spec.js"

Triggering e2e testing with options:
&map[INCLUDE_FILE:slash_commands_spec.js,mark_as_unread_spec.js,copy_post_text_spec.js,check_user_status_spec.js,channel_scroll_spec.js]

Successfully triggered e2e testing!
https://git.internal.mattermost.com/qa/cypress-ui-automation/-/pipelines/211528


test(seed): Add Test for Unique Challenge Titles

Pre-Submission Checklist

[x] Your pull request targets the staging branch of freeCodeCamp.
[x] Branch starts with either fix/, feature/, or translate/ (e.g. fix/signin-issue)
[x] You have only one commit (if not, squash them into one commit).
[x] All new and existing tests pass the command npm test. Use git commit --amend to amend any fixes.

Type of Change

[x] Small bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds new functionality)
[ ] Breaking change (fix or feature that would change existing functionality)
[ ] Add new translation (feature adding new translations)

Checklist:

[x] Tested changes locally.
[ ] Addressed currently open issue (replace XXXXX with an issue no in next line)

Closes ####
Description

Due to the recent problem with two challenges having the same title, I
added a check for unique titles to the test suite so that hopefully
won't happen again.
Addresses a comment in issue #16906, which was recently closed.
BREAKING CHANGE: None

I quickly tested this and they are now loading with no errors. I tried the 'Find the Symmetric Difference' challenge and it works fine.

@scissorsneedfoodtoo Awesome! Thanks for writing a test for this!
@Bouncey could you QA this when you get a chance?

@QuincyLarson, my pleasure! Glad I could help out a bit.
@Bouncey, thank you for the merge! However, I saw your suggestion above and would like to incorporate those changes. Let me know what you think whenever you can.


Ubuntu build doesn't work.

First Tauri project (and first time using gh actions) so please bear with me.
I'm using this workflow file which is just a slight variation of the one in the usage example.
After the action runs for all platforms, the artifacts can be downloaded from the repository "releases" page, but:
1- The downloadable for Ubuntu ( ollama-grid-search_0.0.0_amd64.deb ) installs, but nothing happens when you run it, like it quits immediately... the appimage version runs fine, though.
More info:

The app runs if I manually build it on my local machine (Ubuntu 22.04)
The appimage file size is 72 Mb (and pretty close to the runable binary), but the deb file is only 4.5Mb (not sure if that matters)
Haven't tested the windows or mac installs yet.

I would greatly appreciate any help and instructions in case I am missing something here. Thank you!

Hi, can you try starting the app from inside a terminal? Basically just type ollama-grid-search into the terminal (should work after installing it via the deb).
I hope this will give you some error message.

It threw this error:

ollama-grid-search: error while loading shared libraries: libssl.so.1.1: cannot open shared object file: No such file or directory

Here's the summary i gave on this error: https://github.com/tauri-apps/tauri/issues/4470#issuecomment-1170342732 - you can try adding the "native-tls-vendored" feature flag to the tauri dependency in cargo.toml

TY!

you can try adding the "native-tls-vendored" feature flag to the tauri dependency in cargo.toml

Would that dependency be "reqwest"? It's the only one that makes http calls in this project (I think).
Here's the Csrgo.toml:
https://github.com/dezoito/ollama-grid-search/blob/main/src-tauri/Cargo.toml

Ahhh, i see, your project doesn't even enable any tauri feature that pulls in reqwest, so it makes sense this didn't help.
The rustls workaround would still be worth a try if you didn't try it already.
ollama-rs = { version = "0.1.7", default-features = false, features = ["rustls"] }

Thanks man. I'll give this a try.
For anyone else reading, I can confirm that the installers work on Windows, Mac, and on older Ubuntu versions.

@FabianLars, that works... thanks a ton!


Add send_application_question audit event type

A more general version of send_g7_application_question event for
other framework types.

:+1:


Add readme note about packages to avoid in non-nixos

I've been getting a lot of segfaults when using home-manager on Ubuntu (a secondary box after a NixOS one) and have recently discovered that it's due to adding gcc7 (specifically gcc7.out) and maybe coreutils to my package list. In this scenario, I had both ~/.nix-profile/bin taking precedence in my PATH, and ~/.nix-profile/lib taking precedence in my LD_LIBRARY_PATH. My assumption is that somewhere there was a mix-up in compiling either Ubuntu's gcc was linking to nix's libraries or vice versa.
Long story short! I think that it might be worth putting a warning somewhere -- not sure where you think this would be appropriate.

Sorry about the little delay 🙂
Is this still an issue? If so then I think the FAQ might be a good place. Something like "Why do I get segfaults on Ubuntu?"

Thanks for following up! I ended up fixing the issue -- the problem was more of a nixpkgs-related problem than a home-manager-related one. I think a README warning would be nice, but I don't think this kind of warning should live in home-manager.
A home-manager solution to this problem could include verifying if you are working on a non-nixos box and, if so, warning a user if a nix-based gcc takes precedence in their PATH... but maybe this should only happen if more people sympathize with this scenario and file a separate issue with this proposal.
I don't think any further action needs to happen here!


Seaclouds creation of files and folders around the system.

https://github.com/SeaCloudsEU/SeaCloudsPlatform/blob/master/discoverer/src/main/java/eu/seaclouds/platform/discoverer/core/Discoverer.java#L48
sets up the address to create a folder in the user HOME.
Use "target" folder whenever possible.

@perezp since now we use a database service I think that this can be close.

@PaoloCifariello Right


Added CUDA support through cupy

Used cupy for GPU-accelerated numpy operations.
Almost one to one correspondence with numpy, copied ops_cpu.py to ops_gpu.py with cupy instead of numpy.
 This would have to be added as a different arch

What about non Nvidia GPUs? This would have to be added as a different arch

Separated cuda as new ops, can be installed in tinygrad[cuda].

Hmm, I mean it should be supported like ops_cuda, it shouldn't require a separate install.

Hmm, I mean it should be supported like ops_cuda, it shouldn't require a separate install.

It is supported as ops_cuda, But I added cupy dependency like pyopencl in setup.py
 extras_require={
        'gpu': ["pyopencl", "six"],
        'cuda': ["cupy", "six"]

So is this just a copy of ops_cpu? Is there a clever way to do this with less lines?

I'd merge something like this, but with much less lines! Check out what I did for TORCH


deconz 6.1.1 does't allow lights control

Previous issue remains after update to 6.1.1: Deconz add-on starts and I can open UI, and IKEA lights are detected, but cannot trigger any action on them. Also cannot add new lights from discovery.
Tried to restart Hassio and behaviour is the same

Hi,
what does the logging say?

Hi,
what does the logging say?

When I start the add-on I get successful logs:
[08:55:44] INFO: Successfully send discovery information to Home Assistant.
08:55:33:976 HTTP Server listen on address <IP_ADDRESS>, port: 40850, root: /usr/share/deCONZ/webapp/
08:55:33:984 CTRL. 3.27.208:55:34:092 dev /dev/ttyAMA0
08:55:34:092 COM: /dev/ttyACM0 / serialno: DE2138008
08:55:34:092 COM: --dev: /dev/ttyACM0 (ConBee II)
08:55:34:092 ZCLDB init file /data/.local/share/dresden-elektronik/deCONZ/zcldb.txt
08:55:34:269 parent process s6-supervise
08:55:34:269 gw run mode: docker/hassio
08:55:34:269 GW sd-card image version file does not exist: /data/.local/share/dresden-elektronik/deCONZ/gw-version
08:55:34:286 DB sqlite version 3.27.2
08:55:34:287 DB PRAGMA page_count: 36
08:55:34:287 DB PRAGMA page_size: 4096
08:55:34:287 DB PRAGMA freelist_count: 0
08:55:34:287 DB file size 147456 bytes, free pages 0
08:55:34:287 DB PRAGMA user_version: 6
08:55:34:287 DB cleanup
08:55:34:313 DB create temporary views
08:55:34:352 don't close database yet, keep open for 900 seconds
08:55:34:353 started websocket server at port 8081
08:55:34:361 found node plugin: libde_rest_plugin.so - REST API Plugin
08:55:34:364 found node plugin: libde_signal_plugin.so - Signal Monitor Plugin
08:55:39:365 found node plugin: libstd_otau_plugin.so - STD OTAU Plugin
08:55:39:402 dev /dev/ttyAMA0
08:55:39:402 COM: /dev/ttyACM0 / serialno: DE2138008
08:55:39:402 COM: --dev: /dev/ttyACM0 (ConBee II)
08:55:39:763 dev /dev/ttyAMA0
08:55:40:179 Announced to internet https://phoscon.de/discover
08:55:40:179 discovery server date: Tue, 21 Jul 2020 07:55:40 GMT
08:55:40:179 	 local time seems to be ok
08:55:40:179 discovery found version 2.04.35 for update channel stable
08:55:40:179 discovery updated announce interval to 45 minutes
08:55:47:116 New websocket <IP_ADDRESS>:60968 (state: 3)
08:55:49:270 dev /dev/ttyAMA0
08:55:49:270 COM: /dev/ttyACM0 / serialno: DE2138008
08:55:49:270 COM: --dev: /dev/ttyACM0 (ConBee II)
PROTO: CRC error
PROTO: CRC error
08:55:49:317 Device firmware version 0x264A0700
08:55:49:321 unlocked max nodes: 200
08:55:49:393 Device protocol version: 0x010B
08:55:49:402 new node - ext: 0x00212effff05192a, nwk: 0x0000
08:55:49:463 SensorNode 5 set node 0x00158d00047deed7
08:55:49:463 SensorNode 6 set node 0x00158d00047deed7
08:55:49:463 SensorNode 7 set node 0x00158d00047deed7
08:55:49:464 SensorNode 23 set node 0x00158d00048640a4
08:55:49:465 SensorNode 24 set node 0x00158d00048640a4
08:55:49:465 SensorNode 25 set node 0x00158d00048640a4
08:55:49:466 SensorNode 29 set node 0x00158d00047def11
08:55:49:466 SensorNode 30 set node 0x00158d00047def11
08:55:49:466 SensorNode 31 set node 0x00158d00047def11
08:55:49:467 SensorNode 26 set node 0x00158d0004863fa0
08:55:49:467 SensorNode 27 set node 0x00158d0004863fa0
08:55:49:468 SensorNode 28 set node 0x00158d0004863fa0
08:55:49:470 don't close database yet, keep open for 900 seconds
08:55:49:470 LightNode 1: Dimmable light 1 added
08:55:49:475 don't close database yet, keep open for 900 seconds
08:55:49:475 LightNode 5: Dimmable light 5 added
08:55:49:478 don't close database yet, keep open for 900 seconds
08:55:49:478 LightNode 6: Dimmable light 6 added
08:55:49:559 Current channel 15
08:55:49:575 CTRL ANT_CTRL 0x03
08:55:49:599 Device protocol version: 0x010B
08:55:49:647 Current channel 15
08:55:49:663 CTRL ANT_CTRL 0x03
08:55:49:687 Device protocol version: 0x010B
08:55:49:735 Current channel 15
08:55:49:751 CTRL ANT_CTRL 0x03
08:55:49:779 NET ZDO start network status 0xC4
08:55:50:215 dev /dev/ttyAMA0
08:55:50:216 GW update firmware found: /usr/share/deCONZ/firmware/deCONZ_ConBeeII_0x26580700.bin.GCF
08:55:50:216 GW firmware version: 0x264a0700
08:55:50:216 GW firmware version shall be updated to: 0x26580700

I Then start receiving some attempts to connect to network
08:56:14:178 try to reconnect to network try=3
08:56:14:186 Device protocol version: 0x010B
08:56:14:241 Current channel 15
08:56:14:257 CTRL ANT_CTRL 0x03
08:56:14:281 Device protocol version: 0x010B
08:56:14:329 Current channel 15
08:56:14:345 CTRL ANT_CTRL 0x03
08:56:14:369 NET ZDO start network status 0xC4
08:56:19:177 try to reconnect to network try=4
08:56:19:185 Device protocol version: 0x010B
08:56:19:234 Current channel 15
08:56:19:250 CTRL ANT_CTRL 0x03
08:56:19:274 Device protocol version: 0x010B
08:56:19:322 Current channel 15
08:56:19:338 CTRL ANT_CTRL 0x03
08:56:19:362 NET ZDO start network status 0xC4
08:56:24:178 try to reconnect to network try=5
08:56:24:187 Device protocol version: 0x010B
08:56:24:236 Current channel 15
08:56:24:252 CTRL ANT_CTRL 0x03
08:56:24:276 Device protocol version: 0x010B
08:56:24:324 Current channel 15
08:56:24:340 CTRL ANT_CTRL 0x03
08:56:24:364 NET ZDO start network status 0xC4
08:56:29:177 try to reconnect to network try=6

When trying to control the lights from within the Deconz add-on I get the following:

08:58:26:275 Device proto<IP_ADDRESS> - - [21/Jul/2020:07:58:29 +0000] "GET /pwa/index.html HTTP/1.1" 200 107399 "http://<IP_ADDRESS>:8123/hassio/ingress/core_deconz" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:29 +0000] "GET /pwa/developer.js HTTP/1.1" 404 142 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:29 +0000] "GET /api/59C37F236F/config?=1595318309348 HTTP/1.1" 200 6831 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:29 +0000] "GET /api/59C37F236F/config?=1595318309349 HTTP/1.1" 200 6831 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:29 +0000] "GET /api/59C37F236F/groups?=1595318309350 HTTP/1.1" 200 396 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:29 +0000] "GET /api/59C37F236F/lights?=1595318309351 HTTP/1.1" 200 1200 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:29 +0000] "GET /api/59C37F236F/sensors?=1595318309352 HTTP/1.1" 200 4807 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:29 +0000] "GET /api/59C37F236F/config?=1595318309353 HTTP/1.1" 200 6831 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:33 +0000] "PUT /api/59C37F236F/lights/5/state HTTP/1.1" 200 231 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:33 +0000] "GET /api/59C37F236F/lights/5?=1595318309354 HTTP/1.1" 200 412 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:34 +0000] "PUT /api/59C37F236F/lights/6/state HTTP/1.1" 200 231 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:34 +0000] "GET /api/59C37F236F/lights/6?=1595318309355 HTTP/1.1" 200 412 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:34 +0000] "PUT /api/59C37F236F/lights/1/state HTTP/1.1" 200 231 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:34 +0000] "GET /api/59C37F236F/groups?=1595318309356 HTTP/1.1" 200 396 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:34 +0000] "GET /api/59C37F236F/lights/1?=1595318309357 HTTP/1.1" 200 394 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:34 +0000] "GET /api/59C37F236F/lights?=1595318309358 HTTP/1.1" 200 1200 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:34 +0000] "GET /api/59C37F236F/sensors?=1595318309359 HTTP/1.1" 200 4807 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:34 +0000] "GET /api/59C37F236F/config?_=1595318309360 HTTP/1.1" 200 6831 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:36 +0000] "GET /websocket HTTP/1.1" 101 4 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"

08:56:24:364 NET ZDO start network status 0xC4

0xC4 is an NWK_STARTUP_FAILURE_STATUS, which means it has issues setting up / hooking up the Zigbee network.
This is usually caused by interference and is a known issue with the ConBee's. Maybe the latest version of deCONZ itself made this worse?
Anyways, usually trying another USB port (on a different place of your device) or using a USB extension cord (as advised by dresden in their installation guide) solved that.

I've lost connection too after yesterdays update to 6.1.
Maybe the error codes should be brought upp to modern standards, for user friendliness, those cryptic hexadecimals belongs to times of bluescreens.
Can you decode mine?
[12:04:04] INFO: Running the IKEA OTA updater... [12:04:04] INFO: Running the deCONZ OTA updater... [12:04:04] INFO: Starting udevd... [14:04:04] INFO: Waiting for device... [12:04:04] INFO: Can't fetch data from osram! [14:04:08] INFO: Starting VNC server... [14:04:12] INFO: Waiting for VNC to start [14:04:12] INFO: Starting the deCONZ gateway... libpng warning: iCCP: known incorrect sRGB profile [12:04:13] INFO: Starting Nginx... 2020/07/21 12:04:13 [notice] 355#355: using the "epoll" event method 2020/07/21 12:04:13 [notice] 355#355: nginx/1.14.2 2020/07/21 12:04:13 [notice] 355#355: OS: Linux 4.19.127-v7l 2020/07/21 12:04:13 [notice] 355#355: getrlimit(RLIMIT_NOFILE): 1048576:1048576 2020/07/21 12:04:13 [notice] 355#355: start worker processes 2020/07/21 12:04:13 [notice] 355#355: start worker process 962 [14:04:23] INFO: Successfully send discovery information to Home Assistant. 14:04:13:713 HTTP Server listen on address <IP_ADDRESS>, port: 40850, root: /usr/share/deCONZ/webapp/ 14:04:13:729 CTRL. 3.27.214:04:13:838 dev /dev/ttyAMA0 14:04:13:838 COM: /dev/ttyACM0 / serialno: DE1962021 14:04:13:838 COM: --dev: /dev/ttyACM0 (ConBee II) 14:04:13:838 ZCLDB init file /data/.local/share/dresden-elektronik/deCONZ/zcldb.txt 14:04:13:956 parent process s6-supervise 14:04:13:956 gw run mode: docker/hassio 14:04:13:956 GW sd-card image version file does not exist: /data/.local/share/dresden-elektronik/deCONZ/gw-version 14:04:13:956 sd-card cid:<PHONE_NUMBER>33324780ffffffff013200 14:04:13:958 DB sqlite version 3.27.2 14:04:13:958 DB PRAGMA page_count: 45 14:04:13:958 DB PRAGMA page_size: 4096 14:04:13:958 DB PRAGMA freelist_count: 2 14:04:13:958 DB file size 184320 bytes, free pages 2 14:04:13:959 DB PRAGMA user_version: 6 14:04:13:959 DB cleanup 14:04:13:959 DB create temporary views 14:04:13:987 don't close database yet, keep open for 900 seconds 14:04:13:988 started websocket server at port 8081 14:04:13:992 found node plugin: libde_rest_plugin.so - REST API Plugin 14:04:13:994 found node plugin: libde_signal_plugin.so - Signal Monitor Plugin 14:04:19:845 found node plugin: libstd_otau_plugin.so - STD OTAU Plugin 14:04:19:888 dev /dev/ttyAMA0 14:04:19:888 COM: /dev/ttyACM0 / serialno: DE1962021 14:04:19:888 COM: --dev: /dev/ttyACM0 (ConBee II) 14:04:20:101 dev /dev/ttyAMA0 14:04:20:147 New websocket <IP_ADDRESS>:33764 (state: 3)  14:04:20:405 Announced to internet https://phoscon.de/discover 14:04:20:406 discovery server date: Tue, 21 Jul 2020 12:04:20 GMT 14:04:20:406 	 local time seems to be ok 14:04:20:406 discovery found version 2.04.35 for update channel stable 14:04:30:055 dev /dev/ttyAMA0 14:04:30:055 COM: /dev/ttyACM0 / serialno: DE1962021 14:04:30:055 COM: --dev: /dev/ttyACM0 (ConBee II) 14:04:30:103 dev /dev/ttyAMA0 14:04:30:103 GW update firmware found: /usr/share/deCONZ/firmware/deCONZ_ConBeeII_0x26580700.bin.GCF 14:04:30:103 GW firmware version: 0x00000002 14:04:30:579 device state timeout ignored in state 2 14:04:31:531 device state timeout ignored in state 2 14:04:32:497 device state timeout ignored in state 2 14:04:33:497 device state timeout ignored in state 2 14:04:34:497 device state timeout ignored in state 2 14:04:35:497 device state timeout (handled) 14:04:35:512 device disconnected reason: 1, index: 0 14:04:35:997 wait reconnect 15 seconds 14:04:35:997 void zmMaster::handleStateIdle(zmMaster::MasterEvent) not connected goto OFF state 14:04:35:997 device state timeout ignored in state 1 14:04:36:998 wait reconnect 14 seconds 14:04:37:998 wait reconnect 13 seconds 14:04:38:997 wait reconnect 12 seconds 14:04:38:997 start reconnect to network 14:04:39:998 wait reconnect 11 seconds 14:04:40:054 dev /dev/ttyAMA0 14:04:40:998 wait reconnect 10 seconds 14:04:41:997 wait reconnect 9 seconds 14:04:42:998 wait reconnect 8 seconds 14:04:43:998 failed to reconnect to network try=1 14:04:43:998 wait reconnect 7 seconds 14:04:44:997 wait reconnect 6 seconds 14:04:45:998 wait reconnect 5 seconds 14:04:46:998 wait reconnect 4 seconds 14:04:47:997 wait reconnect 3 seconds 14:04:48:998 failed to reconnect to network try=2 14:04:48:998 wait reconnect 2 seconds 14:04:49:997 wait reconnect 1 seconds 14:04:50:052 dev /dev/ttyAMA0 14:04:50:052 COM: /dev/ttyACM0 / serialno: DE1962021 14:04:50:052 COM: --dev: /dev/ttyACM0 (ConBee II) 14:04:50:540 device state timeout ignored in state 2 14:04:51:498 device state timeout ignored in state 2 14:04:52:497 device state timeout ignored in state 2 14:04:53:497 device state timeout ignored in state 2 14:04:53:998 try to reconnect to network try=3 14:04:55:497 device state timeout ignored in state 2 14:04:56:497 device state timeout (handled) 14:04:56:505 device disconnected reason: 1, index: 0 14:04:56:997 wait reconnect 15 seconds 14:04:56:997 void zmMaster::handleStateIdle(zmMaster::MasterEvent) not connected goto OFF state 14:04:56:997 device state timeout ignored in state 1 14:04:57:997 wait reconnect 14 seconds 14:04:58:997 failed to reconnect to network try=4
Running on fully patched Hassio, RPI4

Hi,
what does the logging say?

When I start the add-on I get successful logs:
[08:55:44] INFO: Successfully send discovery information to Home Assistant.
08:55:33:976 HTTP Server listen on address <IP_ADDRESS>, port: 40850, root: /usr/share/deCONZ/webapp/
08:55:33:984 CTRL. 3.27.208:55:34:092 dev /dev/ttyAMA0
08:55:34:092 COM: /dev/ttyACM0 / serialno: DE2138008
08:55:34:092 COM: --dev: /dev/ttyACM0 (ConBee II)
08:55:34:092 ZCLDB init file /data/.local/share/dresden-elektronik/deCONZ/zcldb.txt
08:55:34:269 parent process s6-supervise
08:55:34:269 gw run mode: docker/hassio
08:55:34:269 GW sd-card image version file does not exist: /data/.local/share/dresden-elektronik/deCONZ/gw-version
08:55:34:286 DB sqlite version 3.27.2
08:55:34:287 DB PRAGMA page_count: 36
08:55:34:287 DB PRAGMA page_size: 4096
08:55:34:287 DB PRAGMA freelist_count: 0
08:55:34:287 DB file size 147456 bytes, free pages 0
08:55:34:287 DB PRAGMA user_version: 6
08:55:34:287 DB cleanup
08:55:34:313 DB create temporary views
08:55:34:352 don't close database yet, keep open for 900 seconds
08:55:34:353 started websocket server at port 8081
08:55:34:361 found node plugin: libde_rest_plugin.so - REST API Plugin
08:55:34:364 found node plugin: libde_signal_plugin.so - Signal Monitor Plugin
08:55:39:365 found node plugin: libstd_otau_plugin.so - STD OTAU Plugin
08:55:39:402 dev /dev/ttyAMA0
08:55:39:402 COM: /dev/ttyACM0 / serialno: DE2138008
08:55:39:402 COM: --dev: /dev/ttyACM0 (ConBee II)
08:55:39:763 dev /dev/ttyAMA0
08:55:40:179 Announced to internet https://phoscon.de/discover
08:55:40:179 discovery server date: Tue, 21 Jul 2020 07:55:40 GMT
08:55:40:179 	 local time seems to be ok
08:55:40:179 discovery found version 2.04.35 for update channel stable
08:55:40:179 discovery updated announce interval to 45 minutes
08:55:47:116 New websocket <IP_ADDRESS>:60968 (state: 3)
08:55:49:270 dev /dev/ttyAMA0
08:55:49:270 COM: /dev/ttyACM0 / serialno: DE2138008
08:55:49:270 COM: --dev: /dev/ttyACM0 (ConBee II)
PROTO: CRC error
PROTO: CRC error
08:55:49:317 Device firmware version 0x264A0700
08:55:49:321 unlocked max nodes: 200
08:55:49:393 Device protocol version: 0x010B
08:55:49:402 new node - ext: 0x00212effff05192a, nwk: 0x0000
08:55:49:463 SensorNode 5 set node 0x00158d00047deed7
08:55:49:463 SensorNode 6 set node 0x00158d00047deed7
08:55:49:463 SensorNode 7 set node 0x00158d00047deed7
08:55:49:464 SensorNode 23 set node 0x00158d00048640a4
08:55:49:465 SensorNode 24 set node 0x00158d00048640a4
08:55:49:465 SensorNode 25 set node 0x00158d00048640a4
08:55:49:466 SensorNode 29 set node 0x00158d00047def11
08:55:49:466 SensorNode 30 set node 0x00158d00047def11
08:55:49:466 SensorNode 31 set node 0x00158d00047def11
08:55:49:467 SensorNode 26 set node 0x00158d0004863fa0
08:55:49:467 SensorNode 27 set node 0x00158d0004863fa0
08:55:49:468 SensorNode 28 set node 0x00158d0004863fa0
08:55:49:470 don't close database yet, keep open for 900 seconds
08:55:49:470 LightNode 1: Dimmable light 1 added
08:55:49:475 don't close database yet, keep open for 900 seconds
08:55:49:475 LightNode 5: Dimmable light 5 added
08:55:49:478 don't close database yet, keep open for 900 seconds
08:55:49:478 LightNode 6: Dimmable light 6 added
08:55:49:559 Current channel 15
08:55:49:575 CTRL ANT_CTRL 0x03
08:55:49:599 Device protocol version: 0x010B
08:55:49:647 Current channel 15
08:55:49:663 CTRL ANT_CTRL 0x03
08:55:49:687 Device protocol version: 0x010B
08:55:49:735 Current channel 15
08:55:49:751 CTRL ANT_CTRL 0x03
08:55:49:779 NET ZDO start network status 0xC4
08:55:50:215 dev /dev/ttyAMA0
08:55:50:216 GW update firmware found: /usr/share/deCONZ/firmware/deCONZ_ConBeeII_0x26580700.bin.GCF
08:55:50:216 GW firmware version: 0x264a0700
08:55:50:216 GW firmware version shall be updated to: 0x26580700

I Then start receiving some attempts to connect to network
08:56:14:178 try to reconnect to network try=3
08:56:14:186 Device protocol version: 0x010B
08:56:14:241 Current channel 15
08:56:14:257 CTRL ANT_CTRL 0x03
08:56:14:281 Device protocol version: 0x010B
08:56:14:329 Current channel 15
08:56:14:345 CTRL ANT_CTRL 0x03
08:56:14:369 NET ZDO start network status 0xC4
08:56:19:177 try to reconnect to network try=4
08:56:19:185 Device protocol version: 0x010B
08:56:19:234 Current channel 15
08:56:19:250 CTRL ANT_CTRL 0x03
08:56:19:274 Device protocol version: 0x010B
08:56:19:322 Current channel 15
08:56:19:338 CTRL ANT_CTRL 0x03
08:56:19:362 NET ZDO start network status 0xC4
08:56:24:178 try to reconnect to network try=5
08:56:24:187 Device protocol version: 0x010B
08:56:24:236 Current channel 15
08:56:24:252 CTRL ANT_CTRL 0x03
08:56:24:276 Device protocol version: 0x010B
08:56:24:324 Current channel 15
08:56:24:340 CTRL ANT_CTRL 0x03
08:56:24:364 NET ZDO start network status 0xC4
08:56:29:177 try to reconnect to network try=6

When trying to control the lights from within the Deconz add-on I get the following:

08:58:26:275 Device proto<IP_ADDRESS> - - [21/Jul/2020:07:58:29 +0000] "GET /pwa/index.html HTTP/1.1" 200 107399 "http://<IP_ADDRESS>:8123/hassio/ingress/core_deconz" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:29 +0000] "GET /pwa/developer.js HTTP/1.1" 404 142 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:29 +0000] "GET /api/59C37F236F/config?=1595318309348 HTTP/1.1" 200 6831 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:29 +0000] "GET /api/59C37F236F/config?=1595318309349 HTTP/1.1" 200 6831 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:29 +0000] "GET /api/59C37F236F/groups?=1595318309350 HTTP/1.1" 200 396 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:29 +0000] "GET /api/59C37F236F/lights?=1595318309351 HTTP/1.1" 200 1200 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:29 +0000] "GET /api/59C37F236F/sensors?=1595318309352 HTTP/1.1" 200 4807 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:29 +0000] "GET /api/59C37F236F/config?=1595318309353 HTTP/1.1" 200 6831 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:33 +0000] "PUT /api/59C37F236F/lights/5/state HTTP/1.1" 200 231 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:33 +0000] "GET /api/59C37F236F/lights/5?=1595318309354 HTTP/1.1" 200 412 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:34 +0000] "PUT /api/59C37F236F/lights/6/state HTTP/1.1" 200 231 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:34 +0000] "GET /api/59C37F236F/lights/6?=1595318309355 HTTP/1.1" 200 412 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:34 +0000] "PUT /api/59C37F236F/lights/1/state HTTP/1.1" 200 231 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:34 +0000] "GET /api/59C37F236F/groups?=1595318309356 HTTP/1.1" 200 396 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:34 +0000] "GET /api/59C37F236F/lights/1?=1595318309357 HTTP/1.1" 200 394 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:34 +0000] "GET /api/59C37F236F/lights?=1595318309358 HTTP/1.1" 200 1200 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:34 +0000] "GET /api/59C37F236F/sensors?=1595318309359 HTTP/1.1" 200 4807 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:34 +0000] "GET /api/59C37F236F/config?_=1595318309360 HTTP/1.1" 200 6831 "http://<IP_ADDRESS>:8123/api/hassio_ingress/tNk17Z038wOhZwGSt_DHU7Fb1WXUZ89Q6nTLgxbcOus/pwa/index.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"
<IP_ADDRESS> - - [21/Jul/2020:07:58:36 +0000] "GET /websocket HTTP/1.1" 101 4 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15"

@evvk 14:04:56:997 void zmMaster::handleStateIdle(zmMaster::MasterEvent) not connected goto OFF state
Means its not connected. Do you use a extension cable? if not please do, otherwise open a own issue.

Maybe the error codes should be brought upp to modern standards, for user friendliness

Good feedback, however, add-ons wrap existing applications, in this case deCONZ from dresden. I would recommend on opening/raising an issue with them for that suggestion.
As for your error, it seems like there is an issue connecting to your USB stick. It can be in use already? Or maybe not properly released. Re-plugging might help, worst case a reboot.

No, ordering one.
It's been very stable for ~10months until yesterday.

Is it plugged in correctly? Did you change slots? Maybe cleaning a slot might help.
For that error description, you can make a request

Thank you for looking. Changed the USB port (already had a usb extension) and it's now working


AutoSizer: width is not updating on RTL

Bug Report
What is the current behavior?
AutoSizer is not properly updating width, when used in RTL element. There are two problems:

start with full screen width and try to resize screen to set smaller width - width should be decreasing, sometimes it updates, but you need to resize a lot.
set screen width to some small number, e.g. 200px. Then resize slowly, so width should increase pixel after pixel, but it will skip most of width changes.

Reproducible demo:
https://codesandbox.io/s/fancy-sky-corn0
What is the expected behavior?
Width should be updated correctly on RTL
Which versions of React and react-virtualized, and which browser / OS are affected by this issue?
| Browser: Chrome 83
| OS: WIndows
| React: 16.12.0
| React DOM: 16.12.0
| react-virtualized: 9.21.2

bump


Further hydrogen colours

Description of the issue
We already included:

green hydrogen: renewable electrolytic hydrogen
grey hydrogen: fossil steam reforming hydrogen
blue hydrogen: abated steam reforming hydrogen

However, the types of hydrogen in discussion gets more and more and there now is almost a full rainbow. E.g. this source has additionally:

black and brown hydrogen: hydrogen from hard coal (black) or lignite (brown)
pink hydrogen/red/purple hydrogen: electrolytic hydrogen using electricity from nuclear power plants
turquoise hydrogen: methane pyrolysis producing hydrogen and solid carbon
yellow hydrogen: hydrogen from electrolysis using solar energy (so a subtype of green hydrogen).

Do we want to add those concepts? If so, I suggest (as in issue #1013 / PR #1443) to use the colours only as alternative labels.
Ideas of solution
If you already have ideas for the solution describe them here
Workflow checklist

[ ] I discussed the issue with someone else than me before working on a solution
[ ] I already read the latest version of the workflow for this repository
[ ] The goal of this ontology is clear to me

I am aware that

[ ] every entry in the ontology should have a definition
[ ] classes should arise from concepts rather than from words

Two proposals for the more easy ones:

nuclear electrolytic hydrogen (pink hydrogen): Nuclear electrolytic hydrogen is electrolytic hydrogen that is produced with nuclear electrical energy.
'nuclear electrolytic hydrogen' EquivalentTo: 'electrolytic hydrogen'  and ('physical output of' some ('water electrolysis process' and ('has energy input' some 'nuclear electrical energy')))
solar electrolytic hydrogen (yellow hydrogen): Solar electrolytic hydrogen is electrolytic hydrogen that is produced with solar electrical energy.
'solar electrolytic hydrogen' EquivalentTo: 'electrolytic hydrogen'  and ('physical output of' some ('water electrolysis process' and ('has energy input' some 'nuclear electrical energy')))

Further new classes used in the definitions above:

nuclear electrical energy: Nuclear electrical energy is electrical energy with a nuclear origin. Parallel to renewable electrical energy, but this definition depends on #1491.
solar electrical energy: Solar electrical energy is electrical energy that is energy output of a solar energy transformation.

The proposals look fine to me.


Automarket

MANDATORY FOR MERGING :

[x] add default mint price info in mint modal
[x] add Price display in Nft details
[x] add sell button ( Approve & setPrice => refresh after setting price )
[x] add buy button in Nft details if not owner
[x] add burn button on Nft detail page ( remove burned nft from store and local storage after burn )
[x] add Transfer to addresse dEaD if burn function not defined in nft collection
[x] Disable Transfer button when not effective
[x] Get Price and royalties infos when not owner to permit buy function working ( with hash of the nft in url on first load nft.collection had only chainId and address. if reloaded brother, nft.collection becomed full hydratated)
[x] display sell button only on OpenNFTsV4 template
[x] display "sell on OpenSea" button
[x] refresh owner and buttons after buy
[x] display royalty infos on nft mint modale
[x] add royalty infos fields in collection create and clone collection with thoses params
[x] add setApprovalForAll in NftSell & check Approval
[x] add optional set default collection price or default royalty infos at collection creation

OPTIONAL FEATURES OR AFTER MERGING :

[x] Refresh after transfer
[x] Burn Nft buyed (owner of nft, not owner of collection)
[x] make price component to filter Ether format
[ ] make royalty percentage component to filter input from % => base point
[ ] Listen Events after buy to refresh nfts of ex owner of a buyed nft
[ ] integrate new models from Alex
[ ] test OpenSea Approve / OpenNFTsV4 approve

done