policy: Add PolicyRepository interface

In this commit, a new interface (PolicyRepository) in pkg/policy is added, used and referenced outside pkg/policy.
The policy.Repository struct is refactored to exclude directly exporting struct fields, but to instead use accessor methods.
Related to modularizing network policies:

https://github.com/cilium/cilium/issues/23767
https://github.com/cilium/cilium/issues/33360

Note: No user facing changes. No changes to the code behavior.
Signed-off-by: Dorde Lapcevic<EMAIL_ADDRESS>

/test

Thank you @squeed for the review and suggestions.
As we discussed, let's try to make smaller steps to gradually get this into a better state.
I want to conclude this PR, and then refactor and clean up more of it with continuous incremental improvements.

/test

/test

/ci-e2e-upgrade

/ci-ipsec-upgrade

Rebased and resolved conflicts.

/test

/ci-e2e-upgrade

@dlapcevic Yes, main was broken. https://github.com/cilium/cilium/pull/35391 should have fixed it. I think you'll need to rebase.

Rebased.

/test


OpenTelemetry Container App AzureVMResourceDetector Exception

azure-monitor-opentelemetry:
1.1.0:
Linux:
3.9:

Describe the bug
Auto instrumentation of FastAPI Python in Azure Container App results in a error:
WARNING:Exception  in detector <opentelemetry.resource.detector.azure.vm.AzureVMResourceDetector object at 0x7f011e043ac0>, ignoring
The error pointing to the AzureVM detector seems random to me.
To Reproduce
Steps to reproduce the behavior:

Create Container App Environment, configure logging to Azure Monitor and the correct log workspace you want to use for application insights as well
Create container App with an image with the code in the appendix
Set Environment variable APPLICATIONINSIGHTS_CONNECTION_STRING to a valid app insights instance
The replica will not activate and log : WARNING:Exception  in detector <opentelemetry.resource.detector.azure.vm.AzureVMResourceDetector object at 0x7f011e043ac0>, ignoring

main.py:
from typing import Union
import logging
import os

from opentelemetry.trace import (
    SpanKind,
    get_tracer_provider,
    set_tracer_provider,
)
from opentelemetry.propagate import extract

from fastapi import FastAPI, HTTPException

from azure.monitor.opentelemetry import configure_azure_monitor

# Import the tracing api from the `opentelemetry` package.
from opentelemetry import trace

logging.basicConfig(format = "%(asctime)s:%(levelname)s:%(message)s", level = logging.WARNING)
logger = logging.getLogger(__name__)

# Configure OpenTelemetry to use Azure Monitor with the specified connection
# string.
configure_azure_monitor(
    #connection_string = os.environ["APPLICATIONINSIGHTS_CONNECTION_STRING"],
    connection_string = os.getenv("APPLICATIONINSIGHTS_CONNECTION_STRING")
    instrumentation_options = {"azure_sdk": {"enabled": False}}
    disable_offline_storage=True
)

tracer = trace.get_tracer(__name__,
                          tracer_provider=get_tracer_provider())

# Start a new span with the name "hello". This also sets this created span as the current span in this context. This span will be exported to Azure Monitor as part of the trace.
with tracer.start_as_current_span("hello"):
    print("Hello, World!")

app = FastAPI()

@app.get("/")
def read_root():
    return {"Hello": "World"}

@app.get("/testroute")
def read_root():
    with tracer.start_as_current_span(
        "error_test_request",
        #context=extract(request.headers),
        kind=SpanKind.SERVER
    ):
        logger.error("Error test endpoint was reached. . .")
        raise HTTPException(status_code=500, detail="Inernal Error")
        return {"message": "Error Test!"}

@app.get("/items/{item_id}")
def read_item(item_id: int, q: Union[str, None] = None):
    return {"item_id": item_id, "q": q}

Dockerfile:
FROM python:3.9
WORKDIR /
COPY ./requirements.txt /requirements.txt
RUN pip install --no-cache-dir --upgrade -r /requirements.txt
COPY ./ /
CMD ["uvicorn", "main:app", "--host", "<IP_ADDRESS>", "--port", "80"]

requirements.txt:
annotated-types==0.6.0
anyio==3.7.1
asgiref==3.7.2
azure-core==1.29.5
azure-core-tracing-opentelemetry==1.0.0b11
azure-monitor-opentelemetry==1.1.0
azure-monitor-opentelemetry-exporter==1.0.0b19
certifi==2023.11.17
charset-normalizer==3.3.2
click==8.1.7
Deprecated==1.2.14
exceptiongroup==1.2.0
fastapi==0.104.1
fixedint==0.1.6
h11==0.14.0
httptools==0.6.1
idna==3.4
importlib-metadata==6.8.0
isodate==0.6.1
msrest==0.7.1
oauthlib==3.2.2
opentelemetry-api==1.21.0
opentelemetry-instrumentation==0.42b0
opentelemetry-instrumentation-asgi==0.42b0
opentelemetry-instrumentation-dbapi==0.42b0
opentelemetry-instrumentation-django==0.42b0
opentelemetry-instrumentation-fastapi==0.42b0
opentelemetry-instrumentation-flask==0.42b0
opentelemetry-instrumentation-psycopg2==0.42b0
opentelemetry-instrumentation-requests==0.42b0
opentelemetry-instrumentation-urllib==0.42b0
opentelemetry-instrumentation-urllib3==0.42b0
opentelemetry-instrumentation-wsgi==0.42b0
opentelemetry-resource-detector-azure==0.1.0
opentelemetry-sdk==1.21.0
opentelemetry-semantic-conventions==0.42b0
opentelemetry-util-http==0.42b0
packaging==23.2
pydantic==2.5.2
pydantic_core==2.14.5
python-dotenv==1.0.0
PyYAML==6.0.1
requests==2.31.0
requests-oauthlib==1.3.1
six==1.16.0
sniffio==1.3.0
starlette==0.27.0
typing_extensions==4.8.0
urllib3==2.1.0
uvicorn==0.24.0.post1
uvloop==0.19.0
watchfiles==0.21.0
websockets==12.0
wrapt==1.16.0
zipp==3.17.0

Expected behavior
The container app sends logs and metrics to Azure Monitor and the replica is healthy.
Screenshots

When I comment out the following part, the container replica is healthy, I can call the API.
configure_azure_monitor(
    #connection_string = os.environ["APPLICATIONINSIGHTS_CONNECTION_STRING"],
    connection_string = os.getenv("APPLICATIONINSIGHTS_CONNECTION_STRING")
    instrumentation_options = {"azure_sdk": {"enabled": False}}
    disable_offline_storage=True
)

Hey, thanks for the feedback. @lzchen. @jeremydvoss, do you know what's causing this issue?

@pvaneck No. The problem here is that for some reason the error is not actually explained. Notice the double-space where the error message should show. It is as if a blank "Exception()" is called somewhere. That being said, OpenTelemetry Resource is designed to call the detectors and ignore it if it fails. So, this does not affect the app running.

We have release azure-monitor-opentelemetry=1.1.1 . This includes the ability to disable resource detectors. For instance, in order to disable the VM detector, but leave the App Service detector on, the customer can set their environment variable OTEL_EXPERIMENTAL_RESOURCE_DETECTORS="azure_app_service"
Let me know if this solves the problem.

Thanks @jeremydvoss, for now we deployed version 1.0.0b16. We will update to the new version, I'll give an update here.

We have release azure-monitor-opentelemetry=1.1.1 . This includes the ability to disable resource detectors. For instance, in order to disable the VM detector, but leave the App Service detector on, the customer can set their environment variable OTEL_EXPERIMENTAL_RESOURCE_DETECTORS="azure_app_service"
Let me know if this solves the problem.

what to set in azure container apps? OTEL_EXPERIMENTAL_RESOURCE_DETECTORS="azure_app_service"

@litan1106
Yes set it to the same value for now. This is just a workaround to block the error message from appearing.

@litan1106
Yes set it to the same value for now. This is just a workaround to block the error message from appearing.

yes, we are using OTEL_EXPERIMENTAL_RESOURCE_DETECTORS="azure_app_service" locally as well since we are using a local app insights too

Still have this problem even if I upgraded the version
Name: azure-monitor-opentelemetry
Version: 1.1.1
Summary: Microsoft Azure Monitor Opentelemetry Distro Client Library for Python

Just writing to say I have the same issue. Almost exact same setup as OP.  azure-monitor-opentelemetry = "^1.1.1"
Fixed it for now by hardcoding the OTEL_EXPERIMENTAL_RESOURCE_DETECTORS env variable, but this is suboptimal.

@Freshchris01 Please try with the latest version of opentelemetry-resource-detector-azure==0.1.1
https://pypi.org/project/opentelemetry-resource-detector-azure/0.1.1/

The new azure-monitor-opentelemetry==1.2.0 includes a couple improvements to the resource detector. If you are still having issues, upgrade to this version and let us know if your issue persists.

Hello, it still exists but the function app does not fail. However, I can't be certain if that is preventing logs to be propagated to the Application insights.

@vipinanandcpp
I'll be a bit clearer: Resource Detector errors such as the AzureVMResourceDetector warning you mentioned are ignored and do not crash the app or prevent telemetry from flowing. The was a bug that could cause the app to hang inside AzureVMResourceDetector preventing it from starting. That should be fixed by the recent release. However, if telemetry is not exporting to Application Insights even after this is fixed, there is likely an unrelated issue with your set up.

Regarding the confusing warning message itself, I believe I have discovered the source: The concurrent.futures system that the OpenTelemetry SDK is using to run the resource detectors is not working correctly for processes that can take longer than 5 seconds.
I have made an issue in the OTel repo to track this.
Again this is unrelated to whether your telemetry is exporting or not.

The issue stems from an unclear timeout in the OTel SDK. My fix will be in the next release. In order to not trigger the 5 second timeout, the VM Resource Detector now sets its own timeout to 4s. Please update to opentelemetry-resource-detector-azure=0.1.3


Crash on attempting to add a non-existing file

Steps to reproduce:

Select or capture a file, fill in mandatory fields;
Close the application and delete the selected file from the filesystem;
Open the application and click 'Add to anki'.

The steps are like this for me:

Select some files in MI2A
Without closing the application switch to another application
Remove some of the selected files from the file system
Switch back to MI2A

The application MI2A crashed immediately on switching to it, without any additional input from me. I would not be able to click "Add to Anki" or anything else anyway, because it crashed before I was able to do anything.

The same issue is reproduced when user renamed selected files from the file system.
The application MI2A crashed immediately on switching to it. See screenshot.

Tested:

correct error is displayed for user when file is deleted/renamed
user should select new/again


A shader editor and javascript and c# support (if possible)

What feature do you want to get added on the base engine?
A shader editor for the pals that dont know how to make a shader and javascript and c# support (if possible)
To test your sight, and reliability, please select the option of what should NOT be requested.
Stage Editor, 6K+ support, and winning icons.

💀

(wont-do) moment

shader editor? nah, text editor is better
also Javascript and C# support isn't possible in haxe im pretty sure

I'm pretty sure that Javascript and C# support isn't possible in haxe

Haxe can build cross-platform applications targeting JavaScript, C++, C#, Java, JVM, Python, Lua, PHP, Flash, and allows access to each platform's native capabilities. Haxe has its own VMs (HashLink and NekoVM) but can also run in interpreted mode. Code written in Haxe can be compiled to any target Haxe supports. (Source: https://haxe.org/#:~:text=Haxe can build cross-platform,to any target Haxe supports.)

I'm pretty sure that Javascript and C# support isn't possible in haxe

Haxe can build cross-platform applications targeting JavaScript, C++, C#, Java, JVM, Python, Lua, PHP, Flash, and allows access to each platform's native capabilities. Haxe has its own VMs (HashLink and NekoVM) but can also run in interpreted mode. Code written in Haxe can be compiled to any target Haxe supports. (Source: https://haxe.org/#:~:text=Haxe can build cross-platform,to any target Haxe supports.)

We want suggestions, not trash bloats.

I get what you were trying to do with Shader Editor, you initially had the idea that it is revolutionary.
It really isn't suggestive. But we'll see.

About the JavaScript and C# support, you can run Haxe code already. Just type in runHaxeCode() and put your code inside the parentheses. Don't forget about the quotes. ("")

I'm pretty sure that Javascript and C# support isn't possible in haxe

Haxe can build cross-platform applications targeting JavaScript, C++, C#, Java, JVM, Python, Lua, PHP, Flash, and allows access to each platform's native capabilities. Haxe has its own VMs (HashLink and NekoVM) but can also run in interpreted mode. Code written in Haxe can be compiled to any target Haxe supports. (Source: https://haxe.org/#:~:text=Haxe can build cross-platform,to any target Haxe supports.)

no not the targets, the file support in a similar way of lua

ShaderToy


Backend: Welcome email for New Subscribers added

Issue that this pull request solves
Closes: #1120
Proposed changes
For every new user, welcome email added for new subscriber added.
Types of changes
Put an x in the boxes that apply

[x] New feature (non-breaking change which adds functionality)

Screenshots

Other information
Any other information that is important to this pull request

Hey @Kajol-Kumari
Please review and merge it


Browse channels page needs animated GIFs for mobile app workflows

Context
To help visual learners learn how to perform tasks using the Mattermost mobile app, add visuals and short animated GIFs on the Browse channels page.
Parent Issue: #6657
Docs Request

Add appropriate visuals/GIFs for all the steps in the Browse Channels section under the mobile app tab.

Additional Notes

Use the latest Mattermost mobile app and the standard Mattermost Denim theme to capture all workflows.
Avoid drawing lines, arrows, boxes, or callouts on images.
Don't forget to include ALT Text descriptions for all new image assets.
Use existing docs pages with images as a starting point for code guidance. The Docs team can help provide RST syntax support for publication.
Save static image files in PNG format within the docs repository's /images directory.

QA Validation Criteria
In a generated docs preview:

Visiting the docs page results in appropriate new mobile-specific screenshots in each subsection from the Mobile tab.

@cwarnermm Please assign this issue to me. Thanks.


feat(api): export methods

export methods to be used outside vuejs context
closes #56

:tada: This PR is included in version 1.3.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Error in node.js

When I upload a file I obtain this error in the node.js server:
PUT /api/tptalent/account/56013e691be0e0670d000001 200 12.925 ms - 1229
ReferenceError: _ is not defined
at uploadFile (/var/lib/openshift/55c498422d52715e590000a8/app-root/runtime/repo/api/routesTPTalent.js:794:17)
at callbacks (/var/lib/openshift/55c498422d52715e590000a8/app-root/runtime/repo/node_modules/express/lib/router/index.js:164:37)
at param (/var/lib/openshift/55c498422d52715e590000a8/app-root/runtime/repo/node_modules/express/lib/router/index.js:138:11)
This line in the code is :
var data = _.pick(req.body, 'type')
Thanks

This plugin is a client side library. For node.js questions post it on stackoverflow or nodejs issues.


[BEAM-5717] Only pass PR ID to Gradle if available

Our Jenkins pre-commit jobs pass a githubPullRequestId property into to
Gradle invocation when invoked in the context of a pull-request. This
allows PR-specific functionality, such as staging the website at a GCS
sub-directory based on the PR number.
Currently the Jenkins jobs is setting this parameter regardless of
whether there is actually a PR ID available, passing in garbage when
there is no associated PR. As a result, downstream Gradle tasks were
trying to use this garbage and failing.
This change only passes the githubPullRequestId parameter if there is
indeed an associated PR.

Follow this checklist to help us incorporate your contribution quickly and easily:

[ ] Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

It will help us expedite review of your Pull Request if you tag someone (e.g. @username) to look at it.
Post-Commit Tests Status (on master branch)

Lang
SDK
Apex
Dataflow
Flink
Gearpump
Samza
Spark

Go

---
---
---
---
---
---

Java

Python

---

---
---
---

Run Seed Job

Run Seed Job

Run Website_Stage_GCS Precommit

I see now the job invoked gradle without the PR identifier, even though the job has the ghprbPullId property set. Investigating..

Run Seed Job

Run Seed Job

Run Seed Job

Run Seed Job

Failed again:
ERROR: (PrecommitJobBuilder.groovy, line 106) No such property: binding for class: javaposse.jobdsl.dsl.helpers.step.GradleContext

Run Seed Job

Run Seed Job

Run Website_Stage_GCS Precommit

Run Website_Stage_GCS Precommit

The Jenkins job is now correctly sending the PR ID to gradle:
gradlew --info --continue --max-workers=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -PgithubPullRequestId=6655 :beam-website:stageWebsite

The job is now fails with:
gsutil -m cp -r /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Website_Stage_GCS_Phrase/src/build/website/generated-gcs-content gs://apache-beam-website-pull-requests/6655
BucketNotFoundException: 404 gs://apache-beam-website-pull-requests bucket does not exist.

Investigating now; this appears to be a separate issue.

It appears the bucket indeed got deleted, probably by a previous version of this job which was incorrectly passing an empty PR ID.  I'll add a check.

The latest run passes and the uploaded content is available on GCS: http://apache-beam-website-pull-requests.storage.googleapis.com/6655/index.html
@alanmyrvold PTAL

It appears that this is now never sending the PR ID to gradle. It looks like the problem is that the PR binding is happening during the Seed Job job creation, and not during the PR itself. Investigating.


fix: login/signup buttons do not show up

This PR resolves PHIRE-274
Description
Replaces reanimated code with Moti to avoid issues like the bug ticket mentioned above.
First Launch iOS:
https://github.com/artsy/eigen/assets/21178754/7db8ad3b-4b00-48fa-87c4-d28c572a2c44
After Logout iOS:
https://github.com/artsy/eigen/assets/21178754/311d67b9-b611-4133-9a52-1f93ba69d3ec

PR Checklist

[x] I have tested my changes on iOS and Android.
[x] I hid my changes behind a feature flag, or they don't need one.
[x] I have included screenshots or videos, or I have not changed the UI.
[x] I have added tests, or my changes don't require any.
[x] I added an app state migration, or my changes do not require one.
[x] I have documented any follow-up work that this PR will require, or it does not require any.
[x] I have added a changelog entry below, or my changes do not require one.

To the reviewers 👀

[ ] I would like at least one of the reviewers to run this PR on the simulator or device.

Changelog updates
Changelog updates

Cross-platform user-facing changes

login/signup buttons do not show up - gkartalis

iOS user-facing changes

Android user-facing changes

Dev changes

Need help with something? Have a look at our docs, or get in touch with us.

We also tested with @MrSltun and looked great!


Can't use get_device_prop when Android device is plugging

When one Android device and one iOS device plug simultaneously, mobiledevice get_device_prop just output '!AMDeviceIsPaired'.

Have you tried listing devices first with list_devices ?

Yeah, list_devices works, then I use '-u' option, but I get nothing but '!AMDeviceIsPaired'.

And how many devices are there listed?

Just one Android device and one iOS device.
Details:
mobiledevice version
=> 2.0.0
mobiledevice list_devices
=> f5e93e1226e1aab9157bac6d1377630496a394f3
mobiledevice get_device_prop -u f5e93e1226e1aab9157bac6d1377630496a394f3 ProductVersion
=> !AMDeviceIsPaired
mobiledevice get_device_prop -u f5e93e1226e1aab9157bac6d1377630496a394f3 ProductType
=> !AMDeviceIsPaired

After I pull up the Android device, everything become OK.

My fault. I need trust the device. Very Sorry!


Double precision discrepancy in integrity checksum

Figure out what's up with getting different values/rounding when parsing compared to writing it back. Specifically regarding integrity checksums so far.

Think this boils down to double rounding when parsing, and probably of no significance? Any edited file should have a different link number and checksum either way. As long as it produces valid files I guess this can be ignored as it's only an internal check (?), but will investigate more when other things are done.


Training using training data and validation CSV caused errors

When using "train" command with training and validation data will cause inappropriate attribute access violation for Dataframe.
I was running ludwig on Windows 10 and Python 3.6.8.
ludwig train --data_train_csv data_train.csv --data_validation_csv data_val.csv -mdf model.yaml

Using training raw csv, no hdf5 and json file with the same name have been found
Building dataset (it may take a while)
Loading training csv...
done
Loading validation csv..
done
Loading test csv..
done
Concatenating csvs..
done
Traceback (most recent call last):
File "d:\python\python36\lib\runpy.py", line 193, in _run_module_as_main
"main", mod_spec)
File "d:\python\python36\lib\runpy.py", line 85, in run_code
exec(code, run_globals)
File "D:\Python\python36\Scripts\ludwig.exe_main.py", line 9, in
File "d:\python\python36\lib\site-packages\ludwig\cli.py", line 86, in main
CLI()
File "d:\python\python36\lib\site-packages\ludwig\cli.py", line 64, in init
getattr(self, args.command)()
File "d:\python\python36\lib\site-packages\ludwig\cli.py", line 70, in train
train.cli(sys.argv[2:])
File "d:\python\python36\lib\site-packages\ludwig\train.py", line 663, in cli
full_train(**vars(args))
File "d:\python\python36\lib\site-packages\ludwig\train.py", line 224, in full_train
random_seed=random_seed
File "d:\python\python36\lib\site-packages\ludwig\data\preprocessing.py", line 487, in preprocess_for_training
random_seed=random_seed
File "d:\python\python36\lib\site-packages\ludwig\data\preprocessing.py", line 90, in build_dataset_df
global_preprocessing_parameters
File "d:\python\python36\lib\site-packages\ludwig\data\preprocessing.py", line 165, in build_data
preprocessing_parameters
File "d:\python\python36\lib\site-packages\ludwig\features\image_feature.py", line 57, in add_feature_data
csv_path = os.path.dirname(os.path.abspath(dataset_df.csv))
File "d:\python\python36\lib\site-packages\pandas\core\generic.py", line 5067, in getattr
return object.getattribute(self, name)
AttributeError: 'DataFrame' object has no attribute 'csv'

This may be a bug, @ydudin3 can you please look into this?
In the meantime, as a workaround I would suggest you to concatenate your CSVs and adding a column named split contaning a value 0 for the training datapoints, 1 for validation and 2 for test if you have any. This script does it for you: https://github.com/uber/ludwig/blob/master/ludwig/data/concatenate_datasets.py

Hi @allenkao , we pushed a pull request #125 that should solve your issue. Can you please test with the current code on master and confirm that that's the case?

Closing this as it is likely solved, please reopen if that's not the case.


Handle hoc-react-loader hot reload in examples

I suggest lerna to handle this

It would be great indeed.
And I'm waiting to see how you add that in the project so I can learn it :)

This handle by yarn workspaces


fix mask.py

fix for #410
will work if you have cocoapi installed.

similar to unmerged PR in #466, but there were a lot of unnecessary changes there.

this actually did not work... with a blank fresh copy of the project I am seeing
(pytorch1_py37_tut) emcp@emcp-corei7-2600k:/media/latest_mount/Dev/git/jwyang/faster-rcnn.pytorch$ vim lib/pycocotools/mask.py
(pytorch1_py37_tut) emcp@emcp-corei7-2600k:/media/latest_mount/Dev/git/jwyang/faster-rcnn.pytorch$ python trainval_net.py --net res101 --dataset pascal_voc --cuda --bs 2
Traceback (most recent call last):
  File "trainval_net.py", line 27, in <module>
    from roi_data_layer.roidb import combined_roidb
  File "/media/latest_mount/Dev/git/jwyang/faster-rcnn.pytorch/lib/roi_data_layer/roidb.py", line 9, in <module>
    from datasets.factory import get_imdb
  File "/media/latest_mount/Dev/git/jwyang/faster-rcnn.pytorch/lib/datasets/factory.py", line 15, in <module>
    from datasets.coco import coco
  File "/media/latest_mount/Dev/git/jwyang/faster-rcnn.pytorch/lib/datasets/coco.py", line 23, in <module>
    from pycocotools.coco import COCO
  File "/media/latest_mount/Dev/git/jwyang/faster-rcnn.pytorch/lib/pycocotools/coco.py", line 60, in <module>
    from . import mask
  File "/media/latest_mount/Dev/git/jwyang/faster-rcnn.pytorch/lib/pycocotools/mask.py", line 3, in <module>
    from pycocotools._mask import _mask
ModuleNotFoundError: No module named 'pycocotools._mask'

similar to unmerged PR in #466, but there were a lot of unnecessary changes there.

those updates brought the latest version into the project.. and it worked when I performed it.

@EMCP
Thanks for pointing this out.
Yes, i found it doesn't work.. let me look into this.
(another quick workaround is commenting out import mask in the script if you're just doing binding box detection..)


no devices after re-install "Homematic(IP) local" custom component (via HACS)

DONT'T DELETE THIS.
Please answer all questions as good as possible.
Language: english/german
both
Make sure you have read the documentation at https://github.com/danielperna84/custom_homematic#custom_homematic.
yes
Make sure you have read the release notes at https://github.com/danielperna84/custom_homematic/releases.
yes
Make sure you are running the latest version of the custom_component (and Home Assistant) before reporting an issue.
yes
custom_component version (if applicable):
1.14.2
known last working custom_component version (if applicable):
1.14.2
Home Assistant version (if applicable):
2022.8.4
(supervised mode on debian in qemu-vm, raspberrymatic as addon (docker)
CCU version:

Model HA-Addon:
OS RaspberryMatic
Version: <IP_ADDRESS>20521

Problem-relevant configuration:
Do you use tls? no
Do you use callback? no
Do you use username and password? yes
Which interfaces do you use (hmip/bidcos/wired)? bidcos
Identifying Homematic RF-Hardware: ......HmRF<EMAIL_ADDRESS>HmIP<EMAIL_ADDRESS>OK
Updating Homematic RF-Hardware: RPI-RF-MOD: 4.4.22, not necessary, OK
Describe the bug
A clear and concise description of what the bug is.
After a crash, I had to re-.install the custom component via HACS. After that, all my HM devices are gone.
The old entities are still there, though.
To Reproduce
Steps to reproduce the behavior:

delete custom component
install custom component via HACS
configure as before
look for devices - all gone

Screenshots (if applicable)

CCU firewall
integrations view
device view
enity view

Relevant HA log entries (full log)
Logger: hahomematic.central_unit
Source: runner.py:119
First occurred: 21:39:32 (220 occurrences)
Last logged: 22:07:03
check_connection: No clients exist. Trying to create clients for server RaspberryMatic
_create_clients: Interface: BidCos-RF is not available for backend.
_create_clients: Interface: VirtualDevices is not available for backend.
_create_clients: Interface: HmIP-RF is not available for backend.
Logger: hahomematic.json_rpc_client
Source: runner.py:119
First occurred: 21:39:32 (660 occurrences)
Last logged: 22:07:03
_do_login: Unable to open session: {'name': 'JSONRPCError', 'code': 501, 'message': 'invalid credentials or too many sessions'}
_post_script: Error while logging in via JSON-RPC.
_post: Error while logging in via JSON-RPC.
Logger: pyhomematic._hm
Source: components/homematic/entity.py:269
First occurred: 21:39:31 (56 occurrences)
Last logged: 22:07:01
ServerThread.jsonRpcLogin: Unable to open session.
Logger: homeassistant.components.climate
Source: components/homematic/climate.py:71
Integration: Klima (documentation, issues)
First occurred: 21:39:32 (2 occurrences)
Last logged: 21:39:32
Error adding entities for domain climate with platform homematic
Error while setting up homematic platform for climate
Traceback (most recent call last):
File "/usr/src/homeassistant/homeassistant/helpers/entity_platform.py", line 428, in async_add_entities
await asyncio.gather(*tasks)
File "/usr/src/homeassistant/homeassistant/helpers/entity_platform.py", line 673, in _async_add_entity
await entity.add_to_platform_finish()
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 776, in add_to_platform_finish
self.async_write_ha_state()
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 532, in async_write_ha_state
self._async_write_ha_state()
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 570, in _async_write_ha_state
state = self._stringify_state(available)
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 538, in _stringify_state
if (state := self.state) is None:
File "/usr/src/homeassistant/homeassistant/components/climate/init.py", line 217, in state
if self.hvac_mode is None:
File "/usr/src/homeassistant/homeassistant/components/homematic/climate.py", line 71, in hvac_mode
if self.target_temperature <= self._hmdevice.OFF_VALUE + 0.5:
TypeError: '<=' not supported between instances of 'str' and 'float'
Dieser Fehler wurde von einer benutzerdefinierten Integration verursacht
Logger: hahomematic.central_unit
Source: custom_components/homematicip_local/control_unit.py:109
Integration: Homematic(IP) Local (documentation, issues)
First occurred: 21:39:29 (3 occurrences)
Last logged: 21:39:32
_create_clients: Interface: BidCos-RF is not available for backend.
_create_clients: Interface: VirtualDevices is not available for backend.
_create_clients: Interface: HmIP-RF is not available for backend.
Logger: pyhomematic._hm
Source: /usr/local/lib/python3.10/site-packages/pyhomematic/_hm.py:429
First occurred: 21:39:21 (3 occurrences)
Last logged: 21:39:22
RPCFunctions.addDeviceNames: Unable to open session.

**Diagnostic Information (available on every device)**

see attached file
config_entry-homematicip_local-b5165bd08fa134951e7e41c00d77edbf.json.txt

**Expected behavior**
Re-populate all devices and entities from RaspberryMatic after re-install of the custom component.

**Additional context**
Add any other context about the problem here.

why is there a "too many sessions" error in the log?

can I do anything about that???

one more diagnose file
config_entry-homematicip_local-b5165bd08fa134951e7e41c00d77edbf.json (1).txt

What are you trying to do?
Do you migrate from Homematic (core) to Homematic(IP) local? See hints in this discussion how people migrate.
Your log is a mixture Homematic (core) and Homematic(IP) local entries, and that is not helpful.
For better analysis you should disable/delete the old integration.
The root cause of your trouble is that, something messed up with your ccu
The CCU allows a very limit pool of session (~4), and i only can say for Homematic(IP) local that we need one session.
Other sessions might be blocked by the old integration or other clients like apps or the WebUI. There also might be some stale session, that haven't been released in the past.
Restart  your CCU and ensure that your CCU/RaspberryMatic Addon is running without issues should be a first step.

I have deleted the old standard Homematic integration before even installing the RaspberryMatic Addon and "Homematic(IP) local". And yes, I did reboot.
I cannot disabled or delete the old integration because it is not installed, I did delete it.
The CCU is the RaspberryMatic addon - that's a full raspberrymatic running as docker on the same debian as the HA docker (as AddOn in HA.
I never had a real hardware CCU.
The RaspberryMatic seems to run just fine, I cannot find any errors or system  messages within the rapberrymatic.
As there is no old homematic integration in the system installed, what can cause the "too many session" and why do the HM-CC-DN-RT TRVs show ab as integration "Homematic" and not "Homematic(IP) local" even when there is NO old homematic intergration anywhere to be found within the system.
How can I check and verify that there are no remains of the old homematic integration left in HA?

according to HA, there is no old homematic integration....
{
"home_assistant": {
"installation_type": "Home Assistant Supervised",
"version": "2022.8.4",
"dev": false,
"hassio": true,
"virtualenv": false,
"python_version": "3.10.5",
"docker": true,
"arch": "x86_64",
"timezone": "Europe/Berlin",
"os_name": "Linux",
"os_version": "5.10.0-16-amd64",
"supervisor": "2022.08.3",
"host_os": "Debian GNU/Linux 11 (bullseye)",
"docker_version": "20.10.17",
"chassis": "vm",
"run_as_root": true
},
"custom_components": {
"hacs": {
"version": "1.26.2",
"requirements": [
"aiogithubapi>=22.2.4"
]
},
"climate_group": {
"version": "0.4.2",
"requirements": []
},
"holidays": {
"version": "1.8.0",
"requirements": [
"python-dateutil>=2.8.2",
"holidays>=0.14.2"
]
},
"openwrt": {
"version": "0.0.1",
"requirements": []
},
"homematicip_local": {
"version": "1.14.2",
"requirements": [
"hahomematic==2022.8.7"
]
},
"truenas": {
"version": "1.0.1",
"requirements": []
},
"nodered": {
"version": "1.0.9",
"requirements": []
},
"ai_thermostat": {
"version": "0.9.3",
"requirements": []
},
"browser_mod": {
"version": "1.5.3",
"requirements": []
},
"better_thermostat": {
"version": "1.0.0-beta14",
"requirements": []
},
"ferienapidotde": {
"version": "0.2.3",
"requirements": [
"ferien-api==0.3.6"
]
},
"climate_scheduler": {
"version": "0.1.0",
"requirements": []
},
"webrtc": {
"version": "v2.3.1",
"requirements": []
},
"gismeteo": {
"version": "2.5.0",
"requirements": []
},
"frigate": {
"version": "2.3",
"requirements": []
},
"zha_toolkit": {
"version": "v0.8.11",
"requirements": []
},
"reversotts": {
"version": "1.0.2",
"requirements": [
"pyttsreverso==0.4"
]
},
"picotts_remote": {
"version": "1.0.1",
"requirements": []
},
"scheduler": {
"version": "v0.0.0",
"requirements": []
},
"dwd_weather": {
"version": "1.2.22",
"requirements": [
"simple_dwd_weatherforecast==1.1.5",
"markdownify==0.6.5"
]
},
"shelly": {
"version": "1.0.1",
"requirements": [
"pyShelly==1.0.2",
"paho-mqtt==1.6.1",
"websocket-client"
]
},
"opnsense": {
"version": "0.1.0",
"requirements": [
"mac-vendor-lookup>=0.1.11"
]
},
"dwains_dashboard": {
"version": "3.2.0",
"requirements": []
}
},
"integration_manifest": {
"domain": "homematicip_local",
"name": "Homematic(IP) Local",
"config_flow": true,
"documentation": "https://github.com/danielperna84/custom_homematic",
"issue_tracker": "https://github.com/danielperna84/hahomematic/issues",
"requirements": [
"hahomematic==2022.8.7"
],
"ssdp": [
{
"manufacturer": "EQ3",
"manufacturerURL": "http://www.homematic.com"
}
],
"zeroconf": [],
"homekit": {},
"dependencies": [],
"codeowners": [
"@danielperna84",
"@SukramJ"
],
"iot_class": "local_push",
"loggers": [
"hahomematic"
],
"version": "1.14.2",
"is_built_in": false
},
"data": {
"config": {
"entry_id": "b5165bd08fa134951e7e41c00d77edbf",
"version": 1,
"domain": "homematicip_local",
"title": "RaspberryMatic",
"data": {
"instance_name": "RaspberryMatic",
"host": "de838cd8-raspberrymatic",
"username": "REDACTED",
"password": "REDACTED",
"tls": false,
"verify_tls": false,
"callback_host": null,
"callback_port": null,
"json_port": null,
"interface": {
"HmIP-RF": {
"port": 2010
},
"BidCos-RF": {
"port": 2001
},
"VirtualDevices": {
"port": 9292,
"path": "/groups"
}
}
},
"options": {},
"pref_disable_new_entities": false,
"pref_disable_polling": false,
"source": "user",
"unique_id": "unknown",
"disabled_by": null
},
"platform_stats": {},
"devices": []
}
}

I cannot disabled or delete the old integration because it is not installed, I did delete it.

This is definitly not correct. These logs are from the old integration:

File "/usr/src/homeassistant/homeassistant/components/homematic/climate.py", line 71, in hvac_mode
if self.target_temperature <= self._hmdevice.OFF_VALUE + 0.5:
TypeError: '<=' not supported between instances of 'str' and 'float'

Logger: pyhomematic._hm
Source: components/homematic/entity.py:269
First occurred: 21:39:31 (56 occurrences)
Last logged: 22:07:01
ServerThread.jsonRpcLogin: Unable to open session.
Logger: homeassistant.components.climate
Source: components/homematic/climate.py:71
Integration: Klima (documentation, issues)
First occurred: 21:39:32 (2 occurrences)
Last logged: 21:39:32
Error adding entities for domain climate with platform homematic
Error while setting up homematic platform for climate
Traceback (most recent call last):
File "/usr/src/homeassistant/homeassistant/helpers/entity_platform.py", line 428, in async_add_entities
await asyncio.gather(*tasks)
File "/usr/src/homeassistant/homeassistant/helpers/entity_platform.py", line 673, in _async_add_entity
await entity.add_to_platform_finish()
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 776, in add_to_platform_finish
self.async_write_ha_state()
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 532, in async_write_ha_state
self._async_write_ha_state()
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 570, in _async_write_ha_state
state = self._stringify_state(available)
File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 538, in _stringify_state
if (state := self.state) is None:
File "/usr/src/homeassistant/homeassistant/components/climate/init.py", line 217, in state
if self.hvac_mode is None:
File "/usr/src/homeassistant/homeassistant/components/homematic/climate.py", line 71, in hvac_mode
if self.target_temperature <= self._hmdevice.OFF_VALUE + 0.5:
TypeError: '<=' not supported between instances of 'str' and 'float'

Logger: pyhomematic._hm
Source: /usr/local/lib/python3.10/site-packages/pyhomematic/_hm.py:429
First occurred: 21:39:21 (3 occurrences)
Last logged: 21:39:22
RPCFunctions.addDeviceNames: Unable to open session.

The old integration is still configured in configuration.yaml.

OK... so when you delete the old homematic integration, as I did, the config stays in configuration.yaml.
OK, I removed that.
Does not help
Logger: hahomematic.central_unit
Source: runner.py:119
First occurred: 09:18:25 (24 occurrences)
Last logged: 09:20:59

check_connection: No clients exist. Trying to create clients for server RaspberryMatic
_create_clients: Interface: VirtualDevices is not available for backend.
_create_clients: Interface: BidCos-RF is not available for backend.
_create_clients: Interface: HmIP-RF is not available for backend.

Logger: hahomematic.json_rpc_client
Source: runner.py:119
First occurred: 09:18:25 (72 occurrences)
Last logged: 09:20:59

_do_login: Unable to open session: {'name': 'JSONRPCError', 'code': 501, 'message': 'invalid credentials or too many sessions'}
_post_script: Error while logging in via JSON-RPC.
_post: Error while logging in via JSON-RPC.

Dieser Fehler wurde von einer benutzerdefinierten Integration verursacht

Logger: hahomematic.json_rpc_client
Source: custom_components/homematicip_local/control_unit.py:642
Integration: Homematic(IP) Local (documentation, issues)
First occurred: 09:20:46 (8 occurrences)
Last logged: 09:20:46

_do_login: Unable to open session: {'name': 'JSONRPCError', 'code': 501, 'message': 'invalid credentials or too many sessions'}
_post_script: Error while logging in via JSON-RPC.

Dieser Fehler wurde von einer benutzerdefinierten Integration verursacht

Logger: hahomematic.central_unit
Source: custom_components/homematicip_local/control_unit.py:109
Integration: Homematic(IP) Local (documentation, issues)
First occurred: 09:18:24 (3 occurrences)
Last logged: 09:18:25

_create_clients: Interface: VirtualDevices is not available for backend.
_create_clients: Interface: BidCos-RF is not available for backend.
_create_clients: Interface: HmIP-RF is not available for backend.

Dieser Fehler wurde von einer benutzerdefinierten Integration verursacht

Logger: hahomematic.json_rpc_client
Source: custom_components/homematicip_local/control_unit.py:109
Integration: Homematic(IP) Local (documentation, issues)
First occurred: 09:18:24 (12 occurrences)
Last logged: 09:18:25

_do_login: Unable to open session: {'name': 'JSONRPCError', 'code': 501, 'message': 'invalid credentials or too many sessions'}
_post_script: Error while logging in via JSON-RPC.
_post: Error while logging in via JSON-RPC.

What else has to be removed/deleted/changed ?
or is there anything else within RaspberryMatic to change?  The RaspberryMatic itself shows normal operation without any errors or warnings.

Did you restart RM?
What about your credentials? Are there any special characters inside.
Please add the RM Addon log.

Any updates?

Looks like this can be closed.


Insert mode by default for new files

Would be awesome to see this at least as a setting.

yes!

yes please!

Can this be added?


test: use match_mode=:any  in PackageBundler log tests

Using match_mode=:any, since it's possible for the Pkg operations to produce other additional log messages, breaking the PackageBundler tests.

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 40.61%. Comparing base (077bcdd) to head (09774e2).

Additional details and impacted files
@@             Coverage Diff             @@
##             main      #50       +/-   ##
===========================================
- Coverage   79.16%   40.61%   -38.56%
===========================================
  Files          16       16
  Lines        2251     2221       -30
===========================================
- Hits         1782      902      -880
- Misses        469     1319      +850

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


added composer section extra for package discovery

New feature in Laravel 5.5 that allows for automatic package discovery.
Reduces the steps that need to be taken in order to install the package.
Tested by adding this fork as a repository in a projects composer.json and install laravel-apidoc-generator as a dependency.

Codecov Report

Merging #237 into master will increase coverage by 0.14%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##             master     #237      +/-   ##
============================================
+ Coverage      79.4%   79.55%   +0.14%
- Complexity      206      226      +20
============================================
  Files             7        7
  Lines           709      719      +10
============================================
+ Hits            563      572       +9
- Misses          146      147       +1

Impacted Files
Coverage Δ
Complexity Δ

.../Mpociot/ApiDoc/Commands/GenerateDocumentation.php
68.67% <0%> (-0.04%)
56% <0%> (+8%)

src/Mpociot/ApiDoc/Postman/CollectionWriter.php
100% <0%> (ø)
12% <0%> (+6%)
:arrow_up:

...rc/Mpociot/ApiDoc/Generators/AbstractGenerator.php
88.88% <0%> (+0.11%)
92% <0%> (+4%)
:arrow_up:

src/Mpociot/ApiDoc/Generators/LaravelGenerator.php
86.11% <0%> (+0.19%)
43% <0%> (+2%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 2d4cf80...42c632e. Read the comment docs.


voldemort-shell support for properties file overrides

Adding the ability to pass in a properties file to the voldemort-shell to override default client config settings. This is not intended to include support for the AdminClient features in the voldemort-shell at this point in time.
New help output:
[nobody@null voldemort]$ bin/voldemort-shell.sh --help
Usage: voldemort-shell.sh store_name bootstrap_url [command_file] [options]
Option                               Description
------                               -----------
--client-zone-id <Integer: zone-id>  Client zone id for zone routing
--config-file <file>                 A properties file that contains client
                                       config properties
--help                               Print this help message
--voldemort-shell <script_suffix>    Suffix of shell script; used to format
                                       help output. Examples of script
                                       suffixes: sh, bat, app

Normal run without a properties file:
[nobody@null voldemort]$ bin/voldemort-shell.sh stotch_test_3 tcp://voldemort-test-cluster.dev.demo.null:10103 --client-zone-id 0
[18:49:38,229 voldemort.common.service.VoldemortService] INFO Starting scheduler-service [main]
[18:49:38,279 voldemort.client.ZenStoreClient] INFO Bootstrapping metadata for store stotch_test_3 [main]
[18:49:38,557 voldemort.client.AbstractStoreClientFactory] INFO Client zone-id [0] Attempting to get raw store [stotch_test_3]  [main]
[18:49:39,378 voldemort.client.ZenStoreClient] INFO Creating system stores for store stotch_test_3 [main]
[18:49:39,379 voldemort.client.AbstractStoreClientFactory] INFO Client zone-id [0] Attempting to get raw store [voldsys$_client_registry]  [main]
[18:49:39,388 voldemort.client.AbstractStoreClientFactory] INFO Client zone-id [0] Attempting to get raw store [voldsys$_metadata_version_persistence]  [main]
[18:49:39,394 voldemort.client.AbstractStoreClientFactory] INFO Client zone-id [0] Attempting to get raw store [voldsys$_store_quotas]  [main]
[18:49:39,604 voldemort.client.ZenStoreClient] INFO Metadata version check thread started. Frequency = Every 5000 ms [main]
[18:49:39,909 voldemort.client.scheduler.ClientRegistryRefresher] INFO Initial version obtained from client registry: version(1:1) ts:1446518979908 [main]
[18:49:39,909 voldemort.client.ZenStoreClient] INFO Client registry refresher thread started, refresh interval: 43200 seconds [main]
[18:49:39,909 voldemort.client.ZenStoreClient] INFO Voldemort client created: .stotch_test_3@null:nobody/git/stotch/voldemort
bootstrapTime=1446518979399
context=
deploymentPath=nobody/git/stotch/voldemort
localHostName=null
sequence=0
storeName=stotch_test_3
updateTime=1446518978233
releaseVersion=1.10.2
clusterMetadataVersion=0
max_connections=50
max_total_connections=500
connection_timeout_ms=500
socket_timeout_ms=5000
routing_timeout_ms=5000
client_zone_id=0
failuredetector_implementation=voldemort.cluster.failuredetector.ThresholdFailureDetector
failuredetector_threshold=95
failuredetector_threshold_count_minimum=30
failuredetector_threshold_interval=300000
failuredetector_threshold_async_recovery_interval=10000
 [main]
[18:49:40,213 voldemort.client.AbstractStoreClientFactory] INFO Client zone-id [-1] Attempting to get raw store [voldsys$_metadata_version_persistence]  [main]
[18:49:40,459 voldemort.store.routed.PipelineRoutedStore] WARN Client Zone is not specified. Default to Zone 0. The servers could be in a remote zone [main]
[18:49:40,459 voldemort.client.AbstractStoreClientFactory] INFO Client zone-id [-1] Attempting to get raw store [voldsys$_store_quotas]  [main]
[18:49:40,544 voldemort.store.routed.PipelineRoutedStore] WARN Client Zone is not specified. Default to Zone 0. The servers could be in a remote zone [main]
Established connection to stotch_test_3 via tcp://voldemort-test-cluster.dev.demo.null:10103
> get '0'
null
> put '0' '"test0"'
> get '0'
version(2:1) ts:1446519001878: test0
> delete '0'

Example properties file:
[nobody@null voldemort]$ cat ~/tmp/client.properties
connection_timeout_ms=1000
socket_timeout_ms=1000
routing_timeout_ms=1000
max_connections=5
max_total_connections=10

Running with the properties file:
[nobody@null voldemort]$ bin/voldemort-shell.sh stotch_test_3 tcp://voldemort-test-cluster.dev.demo.null:10103 --client-zone-id 0 --config-file ~/tmp/client.properties
[19:08:06,793 voldemort.common.service.VoldemortService] INFO Starting scheduler-service [main]
[19:08:06,843 voldemort.client.ZenStoreClient] INFO Bootstrapping metadata for store stotch_test_3 [main]
[19:08:07,116 voldemort.client.AbstractStoreClientFactory] INFO Client zone-id [0] Attempting to get raw store [stotch_test_3]  [main]
[19:08:07,913 voldemort.client.ZenStoreClient] INFO Creating system stores for store stotch_test_3 [main]
[19:08:07,914 voldemort.client.AbstractStoreClientFactory] INFO Client zone-id [0] Attempting to get raw store [voldsys$_client_registry]  [main]
[19:08:07,922 voldemort.client.AbstractStoreClientFactory] INFO Client zone-id [0] Attempting to get raw store [voldsys$_metadata_version_persistence]  [main]
[19:08:07,927 voldemort.client.AbstractStoreClientFactory] INFO Client zone-id [0] Attempting to get raw store [voldsys$_store_quotas]  [main]
[19:08:08,140 voldemort.client.ZenStoreClient] INFO Metadata version check thread started. Frequency = Every 5000 ms [main]
[19:08:08,509 voldemort.client.scheduler.ClientRegistryRefresher] INFO Initial version obtained from client registry: version(1:1, 13:2) ts:1446520088508 [main]
[19:08:08,509 voldemort.client.ZenStoreClient] INFO Client registry refresher thread started, refresh interval: 43200 seconds [main]
[19:08:08,509 voldemort.client.ZenStoreClient] INFO Voldemort client created: .stotch_test_3@null:nobody/git/stotch/voldemort
bootstrapTime=1446520087933
context=
deploymentPath=nobody/git/stotch/voldemort
localHostName=null
sequence=0
storeName=stotch_test_3
updateTime=1446520086797
releaseVersion=1.10.2
clusterMetadataVersion=0
max_connections=5
max_total_connections=10
connection_timeout_ms=1000
socket_timeout_ms=1000
routing_timeout_ms=1000
client_zone_id=0
failuredetector_implementation=voldemort.cluster.failuredetector.ThresholdFailureDetector
failuredetector_threshold=95
failuredetector_threshold_count_minimum=30
failuredetector_threshold_interval=300000
failuredetector_threshold_async_recovery_interval=10000
 [main]
[19:08:08,809 voldemort.client.AbstractStoreClientFactory] INFO Client zone-id [-1] Attempting to get raw store [voldsys$_metadata_version_persistence]  [main]
[19:08:09,055 voldemort.store.routed.PipelineRoutedStore] WARN Client Zone is not specified. Default to Zone 0. The servers could be in a remote zone [main]
[19:08:09,056 voldemort.client.AbstractStoreClientFactory] INFO Client zone-id [-1] Attempting to get raw store [voldsys$_store_quotas]  [main]
[19:08:09,143 voldemort.store.routed.PipelineRoutedStore] WARN Client Zone is not specified. Default to Zone 0. The servers could be in a remote zone [main]
Established connection to stotch_test_3 via tcp://voldemort-test-cluster.dev.demo.null:10103
> put '0' '"test0"'
> get '0'
version(2:1) ts:1446520095984: test0
> delete '0'

Note the changes in the client config above match those of the properties file.
Batched commit messages:
Removing the redundant argument check so that the VoldemortClientShell.java option parser can be used to query help

Removing the redundant argument check so that the VoldemortClientShell.java option parser can be used to query help

Augmented help and added an option for passing in a properties file

The shell now passes in an option that tells VoldemortClientShell that it is being called from voldemort-shell.sh so that it can properly format the help output

The shell now passes in an option that tells VoldemortClientShell that it is being called from voldemort-shell.sh so that it can properly format the help output

Made help for --voldemort-shell option more 'helpful'

Mistakenly bumped up a greaterthan check on the positional arguments ... Rolling that back

Rewording --help helper text to be more helpful

Looks good to me, please merge it in.


[i18n] Render-link fix: prepend lang code when page exists

Fixes #5553
Render-link hook: adds the language code prefix to absolute paths of links that appear in non-en pages

As a consequence of this fix, link-check failures are now reported and will need to be fixed.

Adds IgnoreDir regexs so that the offending non-en are temporarily excluded from link-checking

In summary, this PR will help:

Identify missing heading IDs in new non-en pages as soon as the new page is submitted.
Provide a better UX: non-en locale page navigation will stay in the locale even if fallback pages are visited.


ClusterParameterGroup no longer exists

In the generated fargate stack definition it references ClusterParameterGroup here: https://github.com/awslabs/aws-rails-provisioner/blob/master/templates/fargate_stack.mustache#L37 and here: https://github.com/awslabs/aws-rails-provisioner/blob/master/templates/fargate_stack.mustache#L37
This gives the following error:
lib/rails-foo-fargate-stack.ts:37:43 - error TS2339: Property 'ClusterParameterGroup' does not exist on type 'typeof import("/Users/nweinmeister/Programming/FDIC/test-rails-deploy/cdk-sample/node_modules/@aws-cdk/aws-rds/lib/index")'.

37         const clusterParameterGroup = rds.ClusterParameterGroup.fromParameterGroupName(
                                             ~~~~~~~~~~~~~~~~~~~~~

ClusterParameterGroup no longer exists. I manually replaced it with rds.ParameterGroup and it works fine.
I'm happy to submit a PR to replace this if necessary.

Are you using the latest CDK? That's strange that it would be removed, that sounds like a breaking change.

We're happy to take a PR to replace it with ParameterGroup.

Related to https://github.com/aws/aws-cdk/pull/8959
https://github.com/aws/aws-cdk/releases/tag/v1.52.0

Hey @nweinmeister,
You are correct, ClusterParameterGroup was removed in the last release due to being a functional duplicate of ParameterGroup.
They should be hot-swappable but lmk if they aren't!
😸 😷

https://github.com/awslabs/aws-rails-provisioner/commit/6567d128235f26c1c81c92113f07dfdf41600ee8

@mullermp Sorry missed your comments earlier. But thanks for fixing that! Definitely liking this gem so far for our infrastructure setup 👍

Hi,
my old code is breaking now:
const dbParameterGroup = new rds.ClusterParameterGroup(this, "dbParameterGroup", {
     description: "Postgres SSL Enabled Parameter Group",
     family: postgresDatabaseParameterGroupFamily,
     parameters: {
       "max_connections": "100",
       "rds.force_ssl": "1",
       "ssl": "1",
     },
   });


Calico node liveness probe stuck

calico-node command stuck when execute liviness & readiness probe, it's a random event, about once after a thousand executions.
some warning event "command "/bin/calico-node -felix-ready -bird-ready" timed out" will be reported when stuck happened.
for locate the problem, I did the following checks:
ps -ef | grep calico-node
root	2083181	3924226	0	Nov06	?		00:00:20	/bin/calico-node -felix-ready -bird-ready
root	2105362	3924226	0	Nov06	?		00:00:19	/bin/calico-node -felix-live -bird-live
root	2109589	3924226	0	Oct27	?		00:01:14	/bin/calico-node -felix-live -bird-live
root	2290211	3924226	0	Sep20	?		00:04:40	/bin/calico-node -felix-ready -bird-ready
root	2322499	3924226	0	Sep27	?		00:03:59	/bin/calico-node -felix-live -bird-live
root	2332284	3924226	0	Sep11	?		00:05:35	/bin/calico-node -felix-live -bird-live
root	2360071	3924226	0	Sep22	?		00:04:29	/bin/calico-node -felix-live -bird-live
root	2818591	2806086	0	Nov06	pts/1	00:00:20	/bin/calico-node -bird-live

(There's a lot of similar processes here, and I've only intercepted a small part of them)
It is certain that each time the process is suspended, the operating system will have an additional check process, which may cause problems such as memory leakage. We have to restart the calico every 3 month to ensure normal running.
we also use delve tools to debug, two suspicious deadlock goroutine found
[stack.txt](https://github.com/projectcalico/calico/files/14023174/stack.txt)

(dlv) bt
 0  0x00000000004463f6 in runtime.gopark
    at /usr/local/go-cgo/src/runtime/proc.go:367
 1  0x00000000004138ec in runtime.chanrecv
    at /usr/local/go-cgo/src/runtime/chan.go:576
 2  0x0000000000413358 in runtime.chanrecv2
    at /usr/local/go-cgo/src/runtime/chan.go:444
 3  0x000000000080861b in github.com/prometheus/client_golang/prometheus.(Registry).Register
    at /go/pkg/mod/github.com/prometheus/client_golang@v1.12.1/prometheus/registry.go:288
 4  0x0000000000809453 in github.com/prometheus/client_golang/prometheus.(Registry).MustRegister
    at /go/pkg/mod/github.com/prometheus/client_golang@v1.12.1/prometheus/registry.go:402
 5  0x00000000018a9a38 in github.com/prometheus/client_golang/prometheus.MustRegister
    at /go/pkg/mod/github.com/prometheus/client_golang@v1.12.1/prometheus/registry.go:178
 6  0x00000000018a9a38 in github.com/projectcalico/calico/felix/wireguard.init.0
    at /go/src/github.com/projectcalico/calico/felix/wireguard/metrics_linux.go:59
 7  0x0000000000453323 in runtime.doInit
    at /usr/local/go-cgo/src/runtime/proc.go:6498
 8  0x0000000000453271 in runtime.doInit
    at /usr/local/go-cgo/src/runtime/proc.go:6475
 9  0x0000000000453271 in runtime.doInit
    at /usr/local/go-cgo/src/runtime/proc.go:6475
10  0x0000000000445fe6 in runtime.main
    at /usr/local/go-cgo/src/runtime/proc.go:238
11  0x00000000004759c1 in runtime.goexit
    at /usr/local/go-cgo/src/runtime/asm_amd64.s:1581

(dlv) bt
 0  0x00000000004463f6 in runtime.gopark
  at /usr/local/go-cgo/src/runtime/proc.go:367
 1  0x000000000045710c in runtime.goparkunlock
  at /usr/local/go-cgo/src/runtime/proc.go:372
 2  0x000000000045710c in runtime.semacquire1
  at /usr/local/go-cgo/src/runtime/sema.go:144
 3  0x0000000000471805 in sync.runtime_Semacquire
  at /usr/local/go-cgo/src/runtime/sema.go:56
 4  0x000000000048d791 in sync.(WaitGroup).Wait
  at /usr/local/go-cgo/src/sync/waitgroup.go:130
 5  0x0000000001873cd9 in github.com/mdlayher/netlink.(lockedNetNSGoroutine).stop
  at /go/pkg/mod/github.com/mdlayher/netlink@v1.1.0/conn_linux.go:761
 6  0x0000000001873cd9 in github.com/mdlayher/netlink.(sysSocket).Close
  at /go/pkg/mod/github.com/mdlayher/netlink@v1.1.0/conn_linux.go:511
 7  0x0000000001872425 in github.com/mdlayher/netlink.(conn).Close
  at /go/pkg/mod/github.com/mdlayher/netlink@v1.1.0/conn_linux.go:189
 8  0x0000000001877648 in github.com/mdlayher/netlink.(Conn).Close
  at /go/pkg/mod/github.com/mdlayher/netlink@v1.1.0/conn.go:109
 9  0x0000000001877648 in github.com/mdlayher/genetlink.(Conn).Close
  at /go/pkg/mod/github.com/mdlayher/genetlink@v1.0.0/conn.go:49
10  0x000000000187965c in golang.zx2c4.com/wireguard/wgctrl/internal/wglinux.initClient
  at /go/pkg/mod/golang.zx2c4.com/wireguard/wgctrl@v0.0.0-20200324154536-ceff61240acf/internal/wglinux/client_linux.go:44
11  0x000000000187953e in golang.zx2c4.com/wireguard/wgctrl/internal/wglinux.New
  at /go/pkg/mod/golang.zx2c4.com/wireguard/wgctrl@v0.0.0-20200324154536-ceff61240acf/internal/wglinux/client_linux.go:37
12  0x0000000001880c3d in golang.zx2c4.com/wireguard/wgctrl.newClients
  at /go/pkg/mod/golang.zx2c4.com/wireguard/wgctrl@v0.0.0-20200324154536-ceff61240acf/os_linux.go:17
13  0x0000000001880f9d in golang.zx2c4.com/wireguard/wgctrl.New
  at /go/pkg/mod/golang.zx2c4.com/wireguard/wgctrl@v0.0.0-20200324154536-ceff61240acf/client.go:22
14  0x0000000001880f9d in github.com/projectcalico/calico/felix/netlinkshim.NewRealWireguard
  at /go/src/github.com/projectcalico/calico/felix/netlinkshim/wireguard.go:31
15  0x00000000018aa607 in github.com/projectcalico/calico/felix/wireguard.(Metrics).getWireguardClient
  at /go/src/github.com/projectcalico/calico/felix/wireguard/metrics_linux.go:154
16  0x00000000018aa6b6 in github.com/projectcalico/calico/felix/wireguard.(Metrics).getDevices
  at /go/src/github.com/projectcalico/calico/felix/wireguard/metrics_linux.go:164
17  0x00000000018a9a85 in github.com/projectcalico/calico/felix/wireguard.(Metrics).Describe
  at /go/src/github.com/projectcalico/calico/felix/wireguard/metrics_linux.go:77
18  0x0000000000808f2b in github.com/prometheus/client_golang/prometheus.(Registry).Register.func1
  at /go/pkg/mod/github.com/prometheus/client_golang@v1.12.1/prometheus/registry.go:277
19  0x00000000004759c1 in runtime.goexit
  at /usr/local/go-cgo/src/runtime/asm_amd64.s:1581

Possible Solution
We found some similar problems, presumably because the dependency software version is older, but the complete evidence chain is not formed.
https://github.com/mdlayher/netlink/issues/162
https://github.com/mdlayher/netlink/pull/169
https://github.com/mdlayher/netlink/pull/169/commits/2cb26ba384f49b3beaa91decad0e6edd70a36749
When the correlation problem is solved, so is this problem.
https://github.com/projectcalico/calico/issues/7833
Your Environment

Calico version
3.23.3 (commitID: ba2024f730dbb24753f198f730583294733a7122)
Orchestrator version (e.g. kubernetes, mesos, rkt):
kubernetes
Operating System and version:
kylin v10 x86

@zzzzoy Can you try with the latest version of calico - v3.27 and see if the problem still persists?

@zzzzoy  -felix-ready -bird-ready checks for the status of BIRD (out BGP engine). If it is unhealthy, there is something wrong with you BGP config, and you need to check it. If you look into the calico node logs, you probably find some logs about BIRD.

Closing this. Feel free to reopen.

@zzzzoy  -felix-ready -bird-ready checks for the status of BIRD (out BGP engine). If it is unhealthy, there is something wrong with you BGP config, and you need to check it. If you look into the calico node logs, you probably find some logs about BIRD.

@mazdakn Hello. -felix-ready -bird-ready check is OK(mostly. because sometime it gets stuck for no reason). no related exception logs found in calico-node or cni logs. It looks like an exception call triggered the deadlock.

@zzzzoy  -felix-ready -bird-ready checks for the status of BIRD (out BGP engine). If it is unhealthy, there is something wrong with you BGP config, and you need to check it. If you look into the calico node logs, you probably find some logs about BIRD.

@sridhartigera We are currently unable to perform the change action in the environment where the issue occurred. And we tried to reproduce this issue on a test cluster with the same OS, but without success.


Update sane to the latest version and refresh lockfile

The version of sane currently being used pulls in other dependencies
that have known security issues. Update to the latest version of
sane to fix this. More info here:
https://github.com/pinterest/esprint/issues/92
Also refresh the lockfile (delete and regenerate) to grab the latest
versions of all dependencies.
(An apparent side-effect of this is an increase in the pass rate of
the unit tests. A few are still failing though.)

That's already done in master now.


Challenges should not auto-run

A simple way to replicate the problem, taking a random challenge:
https://www.freecodecamp.com/challenges/understanding-boolean-values#?solution=alert("BOO!")
This not only pops up an alert, it does it twice.  It shouldn't even be running it at all, unless and until the submit button (or ctrl-enter) requests it.  All the problems people have with infinite loops, and the magic URL parameters people have to enter to prevent them, can be prevented if FCC simply refrains from auto-running user code in the first place.  Infinite loops could then be broken out of by simply hitting refresh.

Related to #5072.

I like this idea. If implemented will help a ton of common issues. But mostly will not count once we have reactified challenge editor in place.
/cc @BerkeleyTrue


Fix PrefetchBehavior comment

@ryanflorence: "In the spirit of “you own the network tab” we don’t prefetch by default"
Fixes code comment at type PrefetchBehavior to correctly describe the default behavior of the Remix Link and NavLink components.

Sorry for not getting to this sooner, looks like another commit changed the wording here. Thanks!


Include OpenAerialMap as imagery source

OpenAerialMap is a wonderful project that offers people a way to upload their aerial footage (mostly drone imagery) for other people to access. As of today, OEM has AFAIK not been implemented natively in any major editor, but I think this is a considerable omission. OEM offers resolutions that no other imagery source can, and it can be updated by anyone with the necessary equipment at any time. Adding OEM support to iD would strengthen both projects, as it would give editors fresh, detailed imagery and give OEM contributors more incentive to contribute, as they know their work will find its way on the map. Especially for areas in the third world that don't have public local government surveys and very out of date satelite data, OEM + iD would give people a very easy way to contribute massively.
Two considerations to take into account right off the bat, however:

OEM has, obviously, very low coverage, as all the imagery is manual labour by normal individuals, not some great regional, national or global survey. This doesn't have to be a problem, though. As with other local imagery sources, it should only be offered when imagery is available for a location.
There might be multiple images of the same location. There's nothing preventing multiple people from uploading their imagery of the same place, which, in principle, is good. However, iD will have to find a way to deal with that. One option would be to offer a dropdown when clicking the imagery source, but I'm sure people can come up with other, better solutions. This doesn't need to be fancy in my opinion, but it's something to solve.

Another approach is described in https://github.com/hotosm/OpenAerialMap/issues/136 and https://github.com/osmlab/editor-layer-index/issues/509 which would be to add OAM to ELI in some (semi) automated manner so that all ELI consumer like iD can use it automatically.

Does iD support loading multiple layers at the same time?

Does iD support loading multiple layers at the same time?

It can switch between several background, including a custom one, but not at the same time. If you need that feature, you should look into the JOSM editor.

I'd like to add that OpenAerialMap (OAM) support is missing in iD, and OSM is missing an opportunity to provide contributors with (possibly) better sources for imagery. This is probably not an issue for experienced mappers, but for newer contributors, many may think that all they have is whatever is listed in the available background.
Another plus for using imagery from the OAM project is that all imagery, by default, gives special tracing permission for OpenStreetMap contributors
However, not all OAM contributors has bothered to add their imagery to the editor layer index (ELI), so perhaps, for a better user experience for iD users, they can be given an ability to select whatever OAM imagery dataset is avaible for the area their editing?
This obviates the need for OAM contributors to manually submit their project to ELI, which can take weeks, usually.

ELI is not a dumpster, if iD supports reading multiple imageries simultaneously, that’d be great to have OAM added. Otherwise, OAM will not work well.
If your imagery covers a very small place like a new parking lot or few new buildings, they are not worth being added to ELI just for better experience. Also, no one examines OAM’s quality, unlike commercial imageries or government imageries.

Well, I’m just saying here. Our goal is the same, making OSM better. But, instead of adding thousands of imageries on the same website, we need to push iD to have this issue solved as a better solution.

Good to see you qualify that statement  :+1:
You're correct, the contributor community's goal is to improve OpenStreetMap. Unfortunately (or fortunately), the huge ecosystem of OSM-centric , -related tools are not conveniently usable for most mappers.
Without being specific about the quality or fitness of purpose of any OAM-hosted imagery, iD can certainly add the necessary caveats about their use, in case they want to make resource more accessible.

Should this be closed given it was implemented on ELI?

That seems reasonable, thanks


cheatminimap - photograph map unable to get out

using your minimap mod,  works great
i seen an option for photograph map (hit U) in cfg file so gave it a try.
was unable to escape from the map using u again nor esc or any other way i thought reasonable.
now my char is stuck in a perpetual movement rearwards.
I can no longer play the game.  this persists after exiting the game as well..
( i even removed the plugin and cfg file, still was stuck)
update...
ok, finally got out of it,  it took a death to make it happen...   i could only hold myself in place by using the space bar
also, would be interested in being able to have markable points, so i can mark where i put down a building,
(hit a key and current location drops a dot and saves it, hit another key and closest dot gets removed)
hopefully something simple like this can be done
thanks

The U mode is not for gameplay or for players. I use it to take a photo of the entire map and it leaves the game in an unplayable state. Don't save and use Alt+F4 to quit.
I don't want to have the minimap bloated with icons so I won't add new stuff to it for now.

hey David,
thanks for the reply.
might want to mention not to use it or remove the photographmap defined entry in the cfg file.
I thought I had lost that play thru until I died and all was back to normal.
thanks for all the great mods.  wish I could program these things..
Get TypeApp for Android
On Oct 23, 2022, 1:08 AM, at 1:08 AM, David Karnok @.***> wrote:

The U mode is not for gameplay or for players. I use it to
take a photo of the entire map and it leaves the game in an unplayable
state. Don't save and use Alt+F4 to quit.
I don't want to have the minimap bloated with icons so I won't add new
stuff to it for now.
--
Reply to this email directly or view it on GitHub:
https://github.com/akarnokd/ThePlanetCrafterMods/issues/28#issuecomment-1288032269
You are receiving this because you authored the thread.
Message ID:
@.***>


Develop Wire-frames for overall app design

[ ] Login Page
[ ] SignUp Page
[ ] Home Page
[ ] Survey Page
[ ] Database Page
[ ] Drop-down Menu
[ ] Logo


Feature request for easier regulatory permitting of PX4

It has come to my attention for the sake of commercial operation and permitting a more advanced geofence feature can make permitting PX4 much easier in North America.
A prevent breach option when setting up the geofence would be ideal. The 3DR Solo and DJI copters all have this feature.  It would be great if PX4 had this for copters and planes.

Can you expand on how this would be different than the current geofence? Do you want the current functionality but the fence to be more intelligent so it takes control before breach instead of after?
Or are you talking about adding keep out areas?

If the geofence is set to 100m if the plane hits 100 to 101m then it pushes the plane back down to 100m rather than just saying it breached by X amount or go into loiter.
For distance it prevents a breach if it breaches it turns it back into the geofence area and contains it.

So it sounds like the geofence max vertical distance should also be an altitude cap. That would apply in any mode that controls altitude, but you'd still get the current behaviour if you exceeded in manual/stabilized.
Isn't the distance behaviour that you described what happens now if you've set the "geofence violation action" to RTL? One possible improvement here is making it more intelligent so it takes over in time to stop you from breaching the fence, but that's a bit harder to implement with the current polygon geofence.

Yes I think you have nailed it there with the altitude cap.

Hey, this issue has been closed because the label status/STALE is set and there were no updates for 30 days. Feel free to reopen this issue if you deem it appropriate.
(This is an automated comment from GitMate.io.)


没有使用 0x5002合约的文档，也没有 0x5002合约的sol 加入到版本中

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Describe the solution you'd like
A clear and concise description of what you want to happen.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.

这个合约用于压测，请参考这里https://fisco-bcos-documentation.readthedocs.io/zh_CN/latest/docs/app_dev/transaction_parallel.html#id6


Try to updaate but not loading now

Hi
I try to update to latest version of wallet ..everything done successful ..but now the wallet is not opening ..
When i click the wallet icon it blink for 2-3 second then nothing is happening  ..
i try to uninstall it and reinstall but same problem persist ..Now old version is also not working also .. do you know what is the problem ..
also i am not getting error  also solve it can you tell any solution

Does it crash with the last version? 7.4.9

Loading problems should be fixed in 7.5.0
https://github.com/clemahieu/raiblocks/releases/tag/V7.5.0

now wallet is not unlocking ..its say lock ..i tyr to unlock it but its not working


Add missing dependencies for docker-based documentation building via pkg

Fixes #3546

What does this PR (Pull Request) do?

[x] This PR fixes #3546

Which Traffic Control components are affected by this PR?

Documentation

What is the best way to verify this PR?

Run ./pkg docs and verify you get a docs tarball.
If this is a bug fix, what versions of Traffic Ops are affected?

master (6cf10c9)

The following criteria are ALL met by this PR

[ ] This PR includes tests OR I have explained why tests are unnecessary
[ ] This PR includes documentation OR I have explained why documentation is unnecessary
[x] This PR includes an update to CHANGELOG.md OR such an update is not necessary
[ ] This PR includes any and all required license headers
[ ] This PR ensures that database migration sequence is correct OR this PR does not include a database migration
[x] This PR DOES NOT FIX A SERIOUS SECURITY VULNERABILITY (see the Apache Software Foundation's security guidelines for details)

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/trafficcontrol-PR/3621/
Test PASSed.


Socket connection

node disconnect after app closed so how is it possible to node connect always no matter , app is in background or closed?

You'd have to use services (Foreground services) or PARTIAL_WAKE_LOCK (it affects battery life). I think there are other solutions but it depends on your app and strategies.


docs: Add advanced installation section for Private Clusters and APIServer Request Throttling

Fixes #N/A
Description
This adds a section to the Getting Started/Installation guide around installing Karpenter using a private cluster as well as installing Karpenter to prevent request throttling with FlowSchemas and PriorityLevelConfigurations.
There is a follow-up task here which involves adding the spec.instanceProfile suggestion to the v0.32 and docs links when we do the v0.32.2 release since that suggestion isn't valid now but will be once we do the patch release.
How was this change tested?
Does this change impact docs?

[x] Yes, PR includes docs updates
[ ] Yes, issue opened: #
[ ] No

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

This PR adds the FlowSchemas that were originally proposed inside of: https://github.com/aws/karpenter/issues/4168. This should help with apiserver contention when there are ill-behaving components that are making expensive requests within workload-low.


[PR for view only] Bring CoreRT and CoreCLR  CoreLibs into sync for SerializationInfo

I'm creating this PR so it's easier for reviewers of PR https://github.com/dotnet/coreclr/pull/18102 to see how the SerializationInfo file changes in corert.
After coreclr PR above gets merged I will remove this file from src folder.

LGTM.


PG: Add Support for GroupBy's Cube, Rollup and Grouping Set

This Adds support for new syntax added to PG 9.5, namely, CUBE, ROLLUP and GROUPING SET by augmenting PostgreSQL's Visitor with the appropriate unary nodes.
An additional node type GroupingElement has been added as a unary node to allow forcing parenthesis grouping for other syntactic nodes parameters, since parenthesis are significant for CUBE, ROLLUP and GROUPING SET semantics.

I think the correct semantic is GROUPING SETS (with a final S) regarding to the documentation: https://wiki.postgresql.org/wiki/What's_new_in_PostgreSQL_9.5#GROUPING_SETS.2C_CUBE_and_ROLLUP
Or have I misunderstood something ?

@akarzim You're correct


(#2752) Stub File.readable? for Devuan/Arch Linux

This is required to run the test suite on Devuan/Arch Linux boxes.

Can one of the admins verify this patch?

rubocop failure will be fixed in https://github.com/puppetlabs/facter/pull/2754


Editing one playground test has a turn around time of 20s

I think a fair portion of this time is setting up RBE which probably cost more time to setup than it saves when just compiling one file.  There is also 4.4 seconds before VSCode even appears to be launching the build and 5 seconds between it finishing and the playground actually showing.
Also note that the C++ Test Mate is only building the impeller_unittests target, so it's just linking one thing.
steps to reproduce

open the engine.workspace
execute one of the playground impeller_unittests tests
edit the test
execute the test again
notice it takes 20 seconds before the playground displays

expected results
I think I would expect it to be about twice as fast.
video
https://github.com/user-attachments/assets/82f372cd-91fa-4a16-9c91-4d5b7a2432fb

flutter % time et build -c host_debug_unopt_arm64 //flutter/impeller:impeller_unittests
[2024-10-09T15:38:27.974][macos/host_debug_unopt_arm64: GN]: OK
[2024-10-09T15:38:29.203][macos/host_debug_unopt_arm64: RBE startup]: Proxy started successfully.
[2024-10-09T15:38:34.436][macos/host_debug_unopt_arm64: ninja]: 100.0% (3/3) LINK ./impeller_unittests
[2024-10-09T15:38:34.439][macos/host_debug_unopt_arm64: ninja]: OK
[2024-10-09T15:38:34.786][macos/host_debug_unopt_arm64: RBE shutdown]: Actions completed: 1 (1 cache hit)
$ENGINE/flutter/bin/et build -c host_debug_unopt_arm64   4.49s user 1.30s system 70% cpu 8.230 total

Fwiw I get a much smaller number.
If you wanted to determine if RBE is the cause of your slowdown, you could try this patch:
diff --git a/engine.code-workspace b/engine.code-workspace
index 491b6a4451..4db6032ba5 100644
--- a/engine.code-workspace
+++ b/engine.code-workspace
@@ -235,6 +235,7 @@
         "command": "./flutter/bin/et",
         "args": [
           "build",
+          "--build-strategy=local",
           "-c",
           "host_debug_unopt_arm64",
           "//flutter/impeller:impeller_unittests"

18s with the local build for me.  Drat, that probably isn't worth chasing.  I was hoping this would be an easy fix of just selectively ignoring RBE.

You might need a laptop upgrade if it takes 18s to build a unit test locally 😁


CSS based cube gizmo

starting with something like this and make it a webcomponent with shadow dom. There will be more iterations, but start with a simple one that has top,left,bottom,right,back,front
It is partially implemented in prototype branch, time to move to main.
interesting nasty issue with shadow dom if innerHTML is used in wrong way, css variables fail to work as expected (at least as expected by me)
if I use
export class Gizmo extends HTMLElement {
  #root
  connectedCallback() {
    this.#root = this.attachShadow({ mode: 'open' })
    this.innerHTML = `
.....

it works ok, but css variables are not working for inner elements
and to fix it innerHTML needs to be called on shadowRoot
export class Gizmo extends HTMLElement {
  #root
  connectedCallback() {
    this.#root = this.attachShadow({ mode: 'open' })
  connectedCallback() {
    this.#root = this.attachShadow({ mode: 'open' })
    this.#root.innerHTML = `
.....

nice tutorial on one of my fav sites: https://css-tricks.com/an-introduction-to-web-components/
this.#root.innerHTML = `
.....

nice tutorial on: https://css-tricks.com/an-introduction-to-web-components/

https://user-images.githubusercontent.com/2480762/202876453-91cef59c-0298-4d46-b871-b32555f7487b.mp4
html based web-component with shadow-dom ... the calculactions are getting the desired behaviour, I just need to align what iw shat, up, down, rotation where
the css transform to get right behaviour must mix axes, so I need revisit my calculations or naming scale3d(0.8,0.8,0.8) rotateX(${ry}rad) rotateY(${-rz}rad)

important nuance regarding 2 computer graphics and XY https://developer.mozilla.org/en-US/docs/Web/CSS/transform-function
In the Cartesian coordinate system, a two-dimensional point is described using two values: an x coordinate (abscissa) and a y coordinate (ordinate). This is represented by the vector notation (x, y).

In CSS (and most computer graphics), the origin (0, 0) represents the top-left corner of any element. Positive coordinates are down and to the right of the origin, while negative ones are up and to the left. Thus, a point that's 2 units to the right and 5 units down would be (2, 5), while a point 3 units to the left and 12 units up would be (-3, -12).

The initial version is almost ready

Initial implementaion looks decent and has some docs in readme, including a start of a demo page to be later included in main gihub page


description for protocol sniffing

Please provide a description for what this PR is for.
And to help us figure out who should review this PR, please
put an X in all the areas that this PR affects.
[ ] Configuration Infrastructure
[ ] Docs
[ ] Installation
[x] Networking
[ ] Performance and Scalability
[ ] Policies and Telemetry
[ ] Security
[ ] Test and Release
[ ] User Experience
[ ] Developer Infrastructure

@crazyxy: The following test failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

integ-new-install-k8s-presubmit-tests-master
57de3ac9c22054fec99662082e3c48dd06940d15
link
/test integ-new-install-k8s-presubmit-tests-master

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@crazyxy: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

integ-new-install-k8s-presubmit-tests-master
57de3ac9c22054fec99662082e3c48dd06940d15
link
/test integ-new-install-k8s-presubmit-tests-master

istio-unit-tests-master
57de3ac9c22054fec99662082e3c48dd06940d15
link
/test istio-unit-tests-master

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@crazyxy: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

integ-new-install-k8s-presubmit-tests-master
57de3ac9c22054fec99662082e3c48dd06940d15
link
/test integ-new-install-k8s-presubmit-tests-master

istio-unit-tests-master
57de3ac9c22054fec99662082e3c48dd06940d15
link
/test istio-unit-tests-master

istio-racetest-master
57de3ac9c22054fec99662082e3c48dd06940d15
link
/test istio-racetest-master

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@crazyxy: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

istio-unit-tests-master
57de3ac9c22054fec99662082e3c48dd06940d15
link
/test istio-unit-tests-master

istio-racetest-master
57de3ac9c22054fec99662082e3c48dd06940d15
link
/test istio-racetest-master

integ-new-install-k8s-presubmit-tests-master
14d52c591671e51b04e92c7eb83e1efe92d36e7e
link
/test integ-new-install-k8s-presubmit-tests-master

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@crazyxy: The following tests failed, say /retest to rerun them all:

Test name
Commit
Details
Rerun command

istio-racetest-master
57de3ac9c22054fec99662082e3c48dd06940d15
link
/test istio-racetest-master

integ-new-install-k8s-presubmit-tests-master
14d52c591671e51b04e92c7eb83e1efe92d36e7e
link
/test integ-new-install-k8s-presubmit-tests-master

istio-unit-tests-master
14d52c591671e51b04e92c7eb83e1efe92d36e7e
link
/test istio-unit-tests-master

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.


Conversion Script

What is the issue?
I am trying to run the conversion script as shown in the example for conversion to gguf.
What did you expect to see?
python llm/llama.cpp/convert.py ./model --outtype f16 --outfile converted.bin

Loading model file model/model-00001-of-00002.safetensors
Traceback (most recent call last):
  File "/Users/stevecefali/omoide/ollama/llm/llama.cpp/convert.py", line 1523, in <module>
    main()
  File "/Users/stevecefali/omoide/ollama/llm/llama.cpp/convert.py", line 1455, in main
    model_plus = load_some_model(args.model)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/stevecefali/omoide/ollama/llm/llama.cpp/convert.py", line 1344, in load_some_model
    models_plus.append(lazy_load_file(path))
                       ^^^^^^^^^^^^^^^^^^^^
  File "/Users/stevecefali/omoide/ollama/llm/llama.cpp/convert.py", line 966, in lazy_load_file
    raise ValueError(f"unknown format: {path}")
ValueError: unknown format: model/model-00001-of-00002.safetensors

Steps to reproduce
git clone git@github.com:ollama/ollama.git ollama
cd ollama
git submodule init
git submodule update llm/llama.cpp
python3 -m venv llm/llama.cpp/.venv
source llm/llama.cpp/.venv/bin/activate
pip install -r llm/llama.cpp/requirements.txt
make -C llm/llama.cpp quantize
git lfs install
git clone https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1 model
python llm/llama.cpp/convert.py ./model --outtype f16 --outfile converted.bin

Are there any recent changes that introduced the issue?
No response
OS
No response
Architecture
No response
Platform
No response
Ollama version
No response
GPU
No response
GPU info
No response
CPU
No response
Other software
No response

@scefali what model are you trying to convert? You probably want to use convert-hf-to-gguf.py if you're converting from safetensors.


Missing package when trying to launch Rviz

Please provide the following information:

OS: Ubuntu 20.04
ROS Distro: Humble 1.2
Built from source or installed:
Package version:

Expected behaviour
I am new to ROS and Turtlebot and so I want to map the room I am in. Everything has worked so far, but I am having trouble with launching Rviz2. I want to be able to visualize the map as the guide states.
Actual behaviour
I am able to run SLAM, but when I run the code:
ros2 launch turtlebot4_viz view_robot.launch.py
I get the error:
Package 'turtlebot4_viz' not found: "package 'turtlebot4_viz' not found, searching: ['/opt/ros/humble']"
As the error states, I do not have the package "turtlebot4_viz" which I understand. My problem is how do I get the package. Everything has worked so far and I can't find anyone who has had a similar problem.
To Reproduce
Provide the steps to reproduce:

launch SLAM by: ros2 launch turtlebot4_navigation slam.launch.py
Open new terminal and try to launch Rviz by: ros2 launch turtlebot4_viz view_robot.launch.py
Error: Package 'turtlebot4_viz' not found: "package 'turtlebot4_viz' not found, searching: ['/opt/ros/humble']"

Other notes
When looking at other tutorials everyone seem to be able to just launch Rviz after launching SLAM. I do source my ROS2 environment so that is not the issue.

I did the setup again and running sudo apt install ros-humble-turtlebot4-desktop seems to have solved the issue. Thanks


Initialize beacon light client from checkpoint

Refactoring including:

rename InitialUpdate to CheckPointUpdate
rename HeaderUpdate to ExecutionHeaderUpdate

Extrinsic added:

check_point_update
deactivate_bridge

Essentially InitialUpdate is just a CheckPoint for initialization, it's possible we do checkpoint any time at runtime(e.g. checkpoint after a routine maintenance or emergency which cause bridge stopped for a long time).
https://github.com/Snowfork/cumulus/pull/23 required
Fixes: SNO-429

Seems there is no Sudo or Democracy pallet in cumlus bridge, so would assume check_point_update which requires sudo authority can only be triggered from relaychain by XCM.
To make e2e test easy, we keep the GenesisConfig.

requires sudo authority can only be triggered from relaychain by XCM

Working on a script for this. Will PR shortly.

Working on a script for this. Will PR shortly.

https://github.com/Snowfork/snowbridge/pull/829

@alistair-singh Thanks, that's exactly what I need.
https://github.com/Snowfork/snowbridge/blob/feceb0aef2fd0143ec5db68fc6f52eae15603766/core/packages/test/scripts/configure-statemine.sh#L30C25-L50

I would rather not reduce the slot time. Clara reverted that optimization for several reasons I can't remember.

It's different. Last time what we change is SLOTS_PER_EPOCH from 32 to 8 which will impact the generation of ancetry proof whereas change SECONDS_PER_SLOT won't.

I would rather not reduce the slot time. Clara reverted that optimization for several reasons I can't remember.

It's different. Last time what we change is SLOTS_PER_EPOCH from 32 to 8 which will impact the generation of ancestry proof whereas change SECONDS_PER_SLOT won't.

Does this mean geth will produce an execution header every 2 seconds? If so, this could cause the light client to fall behind importing execution headers every 2 seconds (due to the overhead of BLS signature verification).

Does this mean geth will produce an execution header every 2 seconds? If so, this could cause the light client to fall behind importing execution headers every 2 seconds (due to the overhead of BLS signature verification).

Yes, that's true. But the hack is for minimal spec and dev use only and we will not deploy these hacked config to any public network. It did help for fast check basic function like beacon/beefy work as expected so I would prefer keep it, also add an env config in this commit and will not enable fast mode by default.
https://github.com/Snowfork/snowbridge/pull/828/commits/dc488f007d50e558b8593371d6124484c3910f63

@vgeddes @yrong Just mentioning, I would rather we not deviate from the official spec minimal config, since it a standard spec that all the client implementation uses. Speeding up those configs may save time with testing, but we lose time with development since it has wasted some time figuring out why some proofs fail, only to find because the spec is different. I'd wager that more cases like this will occur if we deviate from the standard spec in the future.

@vgeddes @yrong Just mentioning, I would rather we not deviate from the official spec minimal config, since it a standard spec that all the client implementation uses. Speeding up those configs may save time with testing, but we lose time with development since it has wasted some time figuring out why some proofs fail, only to find because the spec is different. I'd wager that more cases like this will occur if we deviate from the standard spec in the future.

That's a good point @claravanstaden. I see that these config parameters are all tightly related, and decreasing the slot time may interfere with ancestry proofs and the SLOTS_PER_HISTORICAL_ROOT setting.
@yrong can you revert this change please. Since it is disabled by default, I think no one will actually use it anyway.


[Challenge] Monotonic Array

Monotonic Array
Write a function that takes in an array of integers and returns a Boolean representing whether the array is monotonic. An array is said to be monotonic if its elements, from left to right, are entirely non-increasing or entirely non-decreasing (don't worry, I'll make this very clear with examples!)
Arrays containing only the same element are also said to be monotonic because they are both entirely non-increasing and entirely non-decreasing.
Non-increasing elements aren't necessarily exclusively decreasing; they simply don't increase. Similarly, non-decreasing elements aren't necessarily exclusively increasing; they simply don't decrease.
Note that empty arrays and arrays of one element are monotonic.
Business Rules/Errata

Your function should accept an input array and return a Boolean if the array is monotonic. The input array can be any length -- including 0!
An array of length 0 or 1 is said to be monotonic.
Subsequent numbers that are equal do not change the description of an array. For example, [1, 2, 3, 3] is an increasing monotonic array because the numbers are never decreasing.
Arrays containing only the exact same element multiple times (IE duplicates) are monotonic.
If an array is monotonic, the function should return True, otherwise it should return False.
Bonus: You should be able to determine if an array is monotonic from a single pass through the array, one iteration through the array should be sufficient in the optimal solution.
Bonus: The optimal solution also uses constant space - no intermediate data structures are required.
Optimal: O(N) time | O(1) space - where N is the length of the array

Examples
is_monotonic([]) // True
is_monotonic([1]) // True
is_monotonic([1, 2]) // True
is_monotonic([2, 2, 2, 2]) // True
is_monotonic([-5, -4, -3, -2, -1, 0, 1]) // True
is_monotonic([2, 1, 2, 3, 4, 5]) // False
is_monotonic([1, 1, 0, 0, -1, -1, -2, -2]) // True
is_monotonic([5, 4, 3, 3, 3, 2, 1]) // True

This one is easy


Feature/cit 508/simplify logging

Proposed changes
Simplification of logging
Types of changes
What types of changes does your code introduce to thin-edge.io?
Put an x in the boxes that apply

[ ] Bugfix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Improvement (general improvements like code refactoring that doesn't explicitly fix a bug or add any new functionality)
[ ] Documentation Update (if none of the other choices apply)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)

Paste Link to the issue

Checklist
Put an x in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your code.

[ ] I have read the CONTRIBUTING doc
[ ] I have signed the CLA (in all commits with git commit -s)
[ ] I ran cargo fmt as mentioned in CODING_GUIDELINES
[ ] I used cargo clippy as mentioned in CODING_GUIDELINES
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] I have added necessary documentation (if appropriate)

Further comments
If this is a relatively large or complex change, kick off the discussion by explaining why you chose the solution you did and what alternatives you considered, etc...

Codecov Report

Merging #427 (75024e8) into main (cebb8e3) will decrease coverage by 1.34%.
The diff coverage is 20.12%.

@@            Coverage Diff             @@
##             main     #427      +/-   ##
==========================================
- Coverage   63.98%   62.64%   -1.35%
==========================================
  Files         106      106
  Lines        6820     6743      -77
==========================================
- Hits         4364     4224     -140
- Misses       2456     2519      +63

Impacted Files
Coverage Δ

mapper/tedge_mapper/src/az_mapper.rs
0.00% <0.00%> (ø)

mapper/tedge_mapper/src/c8y_mapper.rs
0.00% <0.00%> (ø)

mapper/tedge_mapper/src/collectd_mapper/mapper.rs
0.00% <0.00%> (ø)

mapper/tedge_mapper/src/collectd_mapper/monitor.rs
0.00% <0.00%> (ø)

mapper/tedge_mapper/src/main.rs
0.00% <0.00%> (ø)

mapper/tedge_mapper/src/mapper.rs
0.00% <0.00%> (ø)

mapper/tedge_mapper/src/sm_c8y_mapper/mapper.rs
9.27% <0.00%> (-0.10%)
:arrow_down:

sm/plugin_sm/src/plugin.rs
54.70% <ø> (-0.66%)
:arrow_down:

sm/plugin_sm/src/plugin_manager.rs
50.60% <ø> (-2.41%)
:arrow_down:

sm/tedge_agent/src/agent.rs
0.00% <0.00%> (ø)

... and 16 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update cea1f56...75024e8. Read the comment docs.