ARROW-2537: [Ruby] Import

Imported from:

https://github.com/red-data-tools/red-arrow
https://github.com/red-data-tools/red-arrow-gpu

@kou, this is great, thank you! Since this is a large code import, we will want to go through the IP clearance process like with Go recently http://incubator.apache.org/ip-clearance/. This should not be too painful but will require a vote on the mailing list and then a lazy consensus clearance vote on general@incubator

@wesm OK. I'll read the document.

@wesm I read the document. I think that I don't have "incubator karma". Can you help me to process this?

IP Clearance processing must be executed either by an Officer or a Member of the ASF. If you are not an Officer or a Member, please contact your project chair who will find an appropriate volunteer. Incubator karma is also required. Please request karma from the incubator pmc if you do not have it.

I filled some fields:
Title:
Arrow Ruby Library Intellectual Property (IP) Clearance Status
Description:
The Arrow Ruby Library is a Ruby language bindings of the Apache Arrow columnar format
Project info:
he Apache Arrow PMC will be responsible for the code.
It will be integrated into the Apache Arrow project, into a new Ruby area of the main Arrow source tree and build system.
The following people will be managing this contribution:

TBD
...

Completed tasks are shown by the completion date (YYYY-MM-dd).
Identify the codebase:

Origin: https://github.com/red-data-tools/red-arrow as at commit ID abb0d3c0349c94189a700c25ab7ca97b17b09a6f and https://github.com/red-data-tools/red-arrow-gpu as at commit ID 29025cfdc92135fd81b42fbdc29497466a7454aa.
Submitted to Apache Arrow as GitHub pull request https://github.com/apache/arrow/pull/1990

Copyright:
Identify name recorded for software grant: Ruby Bindings of Apache Arrow
Verify distribution rights:
Corporations and individuals holding existing distribution rights:

Kouhei Sutou

DISCUSS: https://github.com/red-data-tools/red-arrow/commit/701386c16eec1aa72d3c349ae58a8ff94945862f is only a commit made by me. It just fix a URL. Is there a copyright of mikisou? If there is a copyright of him, I'll contact to him.
Generally, the result of checking off these items will be a Software Grant, CLA, and Corporate CLA for ASF licensed code, which must have no dependencies upon items whose licenses that are incompatible with the Apache License.
Organizational acceptance of responsibility for the project:
Related votes:

TBD

hi @kou -- yes, I will help you with the IP clearance. I'm an ASF Member now so I believe I have enough karma to make changes to the IP clearance files.
First, we need to have a PMC vote to accept the Ruby bindings. I'm going to start this now on the mailing list. We can get the IP clearance page set up while that is running, so we can have the Incubator clearance vote next week and then merge the PR.
Sorry for the delay; I have been traveling the last week and not available much on e-mail or GitHub

Thanks! I understand the schedule.

Sorry for the delay; I have been traveling the last week and not available much on e-mail or GitHub

No problem. Thanks for your help.

The IP clearance vote has passed. I'm going to rebase this and review, and merge on a green build if there are no problems

Codecov Report

Merging #1990 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #1990   +/-   ##
=======================================
  Coverage   86.33%   86.33%
=======================================
  Files         242      242
  Lines       41103    41103
=======================================
  Hits        35487    35487
  Misses       5616     5616

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5c5e95a...cb41c7a. Read the comment docs.

+1


Give BUILTIN/Users ReadAndExecute permission

This is so an unprivileged user in a container can read and execute buildpack / lifecycle binaries from the executor_cache
The change is compatible with garden-windows 2012 and 2016 as we are only adding permissions to the cache directory

Thanks, @sesmith177! Sounds reasonable, prioritizing for the Diego team to review.
Best,
Eric

For context, this is required since the windows bosh agent sets the permissions of /var/vcap to be readable, writable and executable only by system users and admins. this used to work on windows 2012 since bind mounts are doing a copy into the container, but 2016 have real bind mounts and  which inherit the permissions of the host directory. this causes cached artifacts (e.g. lifecycle and buildpack) not to be accessible inside the container.


downstream rke2 cluster goes to provisioning state when upgrading rancher from 2.6.4 -> 2.6.5-rc2

Rancher Server Setup

Rancher version: v2.6.5-rc2
Installation option (Docker install/Helm Chart): docker

If Helm Chart, Kubernetes Cluster and version (RKE1, RKE2, k3s, EKS, etc):

Proxy/Cert Details:

Information about the Cluster

Kubernetes version: any
Cluster Type (Local/Downstream): downstream

If downstream, what type of cluster? (Custom/Imported or specify provider for Hosted/Infrastructure Provider): rke2, any cluster type

User Information

What is the role of the user logged in? (Admin/Cluster Owner/Cluster Member/Project Owner/Project Member/Custom): standard user, cluster owner

Describe the bug
when upgrading the rancher server from 2.6.4 -> 2.6.5-rc2 the downstream cluster goes into a provisioning state. (rke1 clusters go into an unavailable state) before coming back to an active state
To Reproduce

deploy rancher 2.6.4
deploy an rke2 downstream cluster
upgrade rancher to 2.6.5-rc2

Result
the downstream cluster goes into a provisioning state with the below logs:
[INFO ] configuring bootstrap node(s) custom-59e5e92a772a: waiting for plan to be applied
[INFO ] provisioning done

after which, it comes back to an active state.
Expected Result
cluster should not enter provisioning state upon upgrading.

For now considering this release-blocker as we really want to try to fix this logic before going GA with RKE2. If the initial attempt to fix it is not successful, we can remove the label and address in 2.6.6.

Transferring to @Oats87 following the closure of previous approach from https://github.com/rancher/rancher/pull/37482

@Oats87 While driving, I realized that the approach we discussed on Slack won't fix the issue without more changes.
We talked about adding a Remove field to the File in a node plan. This won't work for if the manifest is still updated when the Rancher version is updated. The file still needs to be "blanked" before adding the Remove = true field.

Test Environment:
Rancher version: v2.6-head b919539
Rancher cluster type: HA
Docker version: 20.10
Downstream cluster type: RKE2 node driver cluster

Testing:
Tested this issue with the following steps:

Deploy rancher 2.6.4
Deploy an RKE2 downstream cluster
Upgrade rancher to 2.6-head

Result
The cluster goes into an Error state for a bit with these errors but were not logged in the provisioning log.

@Oats87 could you take a look? If this is expected then could we log the errors as well?

@timhaneunsoo so is the behavior you saw that the cluster went into this "Error" state, but the upgrade did in fact happen properly?
I wonder if we need to clean up that error message to make it look less "scary". That error message is more or less expected when the cluster-agent is not connected properly.

Yes, the upgrade was successful. It would be nice to make the error message look less scary.

Issue regarding logging can be tracked in 38249 Closing this issue as fix confirmed.


Introduce dev-doc for process management

ilab should be able to run detached processes, re-attach to them, and monitor them. This document introduces a first iteration of that process management

This has been open for about a month now with two approvals. I am going to merge this as is, but I welcome and amendments in follow up PRs


fix(proxy): Add appProtocol as optional field to kong service TLS port

Raised case no. 00042199
When configuring a GCP internal application load balancer for Kong via the networking.gke.io/v1 API, the appProtocol field for the kong service needs to set for GCP to correctly set the backend protocol to HTTPS. I have verified this by editing the chart and can confirm that this fixes the issue. Unfortunately, appProtocol was removed from the chart on 19/01/23 to fix AKS loadbalancer: https://github.com/Kong/charts/pull/705/files.
This change would allow the appProtocol field to be set optionally, so that both cases would work.
Checklist
[Place an '[x]' (no spaces) in all applicable fields. Please remove unrelated fields.]

[x] PR is based off the current tip of the main branch.
[x] Commits follow the Kong commit message guidelines

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Hi @czeslavo, I have now signed the CLA. Thank you for your quick response on this one.

I have added another commit to allow setting of appProtocol for the http port as well. Please update any necessary files to accommodate this. Thanks


Setup the usage of env variables to store backend url

This is needed, so each one of us can use his own rest service locally.
For this to work each one of you has to create a file app.config.js in the /client directory with the following content:
export default ({ config }) => ({
  expo: {
    ...config,
    extra: {
      BACKEND_URL: "//localhost:8080",
    },
  },
});

You may need to replace the string "localhost:8080" to point to your google cloud service.
Then it would look like this
export default ({ config }) => ({
  expo: {
    ...config,
    extra: {
      BACKEND_URL: "//your-app-name-291014.appspot.com/rest/",
    },
  },
});

@CodyAc86 Please dont forget to do this.


COMPAT: some compatibility fixes with new numpies

@tacaswell @mdboom, using mpl 1.5.0 here. I was turning on deprecation warnings. (we get a bunch of these in test suite), known issue?
cc @TomAugspurger
======================================================================
ERROR: test_ts_area_lim (pandas.tests.test_graphics.TestSeriesPlots)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "pandas/tests/test_graphics.py", line 612, in test_ts_area_lim
    ax = self.ts.plot.area(stacked=False, x_compat=True)
  File "pandas/tools/plotting.py", line 3688, in area
    return self(kind='area', **kwds)
  File "pandas/tools/plotting.py", line 3564, in __call__
    **kwds)
  File "pandas/tools/plotting.py", line 2643, in plot_series
    **kwds)
  File "pandas/tools/plotting.py", line 2439, in _plot
    plot_obj.generate()
  File "pandas/tools/plotting.py", line 1032, in generate
    self._post_plot_logic_common(ax, self.data)
  File "pandas/tools/plotting.py", line 1160, in _post_plot_logic_common
    fontsize=self.fontsize)
  File "pandas/tools/plotting.py", line 1208, in _apply_axis_properties
    labels = axis.get_majorticklabels() + axis.get_minorticklabels()
  File "/Users/jreback/miniconda/lib/python2.7/site-packages/matplotlib/axis.py", line 1161, in get_majorticklabels
    ticks = self.get_major_ticks()
  File "/Users/jreback/miniconda/lib/python2.7/site-packages/matplotlib/axis.py", line 1290, in get_major_ticks
    numticks = len(self.get_major_locator()())
  File "/Users/jreback/miniconda/lib/python2.7/site-packages/matplotlib/dates.py", line 1007, in __call__
    return self._locator()
  File "/Users/jreback/miniconda/lib/python2.7/site-packages/matplotlib/dates.py", line 813, in __call__
    return self.tick_values(dmin, dmax)
  File "/Users/jreback/miniconda/lib/python2.7/site-packages/matplotlib/dates.py", line 830, in tick_values
    self.rule.set(dtstart=start, until=stop, count=self.MAXTICKS + 1)
  File "/Users/jreback/miniconda/lib/python2.7/site-packages/matplotlib/dates.py", line 724, in set
    self._rrule = rrule(**self._construct)
  File "/Users/jreback/miniconda/lib/python2.7/site-packages/dateutil/rrule.py", line 470, in __init__
    "raise an error.", DeprecationWarning)
DeprecationWarning: Using both 'count' and 'until' is inconsistent with RFC 2445 and has been deprecated in dateutil. Future versions will raise an error.

Thanks for pointing out.  Not a known issue (to me at least).  I'll see if I can reproduce locally.

@mdboom this is using pretty recently released python-dateutil 2.5.3 FYI (might be new there)

There is a pr fixing this, but I am failing to find it.

https://github.com/matplotlib/matplotlib/issues/6155 / https://github.com/matplotlib/matplotlib/pull/6190

Thanks @tacaswell.  Unfortunately, it doesn't look there's much of a way to workaround that from the outside...

the fix will be it 1.5.2 / 2.0, which ever comes first

thanks @mdboom @tacaswell no worries. just trying to have clean test outputs.


better progress display

Currently when uploading an image, it shows lots of lines which scrolls:
06:42:40 [INFO] 17% uploaded
06:42:40 [INFO] 17% uploaded
06:42:41 [INFO] 17% uploaded
06:42:41 [INFO] 17% uploaded
06:42:41 [INFO] 17% uploaded
06:42:41 [INFO] 17% uploaded
06:42:41 [INFO] 17% uploaded
06:42:41 [INFO] 17% uploaded
06:42:41 [INFO] 17% uploaded
...

This should be improved with ANSI escape sequences, e.g. move cursor one line up so that it is all displayed in one line, as usual for such progress messages. Probably also a good idea to not print it with the logging crate. And would be nice to have a used time and transfer rate (x kB/s) at the end, and maybe during the process, estimated remaining time.

implemented in this PR: https://github.com/vouch-opensource/mcumgr-client/pull/6


Can't find export Loupe when using typescript

Getting error:
The requested module '../../../node_modules/loupe-js/dist/index.js' does not provide an export named 'Loupe'
To reproduce:
Import and use loupe-js in a typescript project
Am I doing something wrong?

Thanks for the report. Could you share more about the structure of your TypeScript project, such as the tsconfig, webpack/esbuild config, and directory structure?
In the meantime, here's an example of a TypeScript project in which I've imported and used Loupe successfully.
https://github.com/nishanths/scrobble/blob/48633a3e190d8311550fe4f2263c9942a885bf96/web/components/songcard/util.tsx#L5


abort on error, but ignore unavailable

Checklist

[x] I'm asking a question
[x] I've looked through the README and FAQ for similar questions
[x] I've searched the bugtracker for similar questions including closed ones

Question
There's two error handling scenarios via arguments, ignore and abort. How is one supposed to ignore the much more common "unavailable videos", while still aborting on actual errors like 429 and others?
-i, --ignore-errors              Continue on download errors, for example to
                                 skip unavailable videos in a playlist
--abort-on-error                 Abort downloading of further videos (in the
                                 playlist or the command line) if an error
                                 occurs

Currently you can't.


Releases are not from the correct repo

Describe the bug
Under "Update Extension", the releases listed come from this repo, instead of this one. This leads to unexpected "New update available in settings" in the parameters
To Reproduce
Steps to reproduce the behavior:

Go to the extension page
Click on ⚙
Under Update Extension

Expected behavior
There should be releases from this repo
Screenshots
Pretty much self explanatory ...
Desktop:

OS: Windows
Version 11
Extension version v<IP_ADDRESS>-beta

the utility never worked and it has been removed in newer versions


Tanujasontakke

The Readme file is currently lengthy and complex, making it challenging for newcomers to comprehend how to contribute effectively to the project.
To enhance accessibility and clarity, I propose relocating the Contributing section to the beginning of the Readme file and streamlining its content where feasible.
I kindly request assistance from anyone willing to dedicate time to address this issue and improve the project's accessibility for all contributors. Thank you!

Hello everyone,
I'm Tanuja Sontakke, master’s student in computer science. I have interest in artificial intelligence, data analytics, and software development.  I joined this class to learn how to contribute to open source projects and gain practical experience in solving real-world problems. My goal is to become proficient by the end of the course and learn how to collaborate with others on interesting open source project.
Thank you,
Tanuja

@caiton1, Thank you for all the assistance provided, can you please let me know more on this issue?


tests: change subnet in lvm_osds container scenario

This commit changes the subnets in container-lvm_osds scenario.
Signed-off-by: Guillaume Abrioux<EMAIL_ADDRESS>

jenkins test centos-container-lvm_osds


Sketchy is not creating screenshots for scrumblr

Hello,
I get scrumblr up and running, and try to make it work also with sketchy.
I installed sketchy and also get it to work with a test capture, like documented in the wiki.
But it seems not to work with scrumblr, I only see that the jobs are created and if I list them with http://localhost:8000/api/v1.0/capture I get a list of them. But all jobs from scrumblr have null values:

"callback": "http://localhost:3000/results/55/update_screenshot",
"capture_status": null,
"created_at": "2015-05-12 10:52:56.470125",
"html_url": null,
"id": 3,
"job_status": "CREATED",
"modified_at": "None",
"retry": null,
"scrape_url": null,
"sketch_url": null,
"url": "https://www.reddit.com/r/netflix/comments/10w39c/top_5_on_netflix_instant/",
"url_response_code": null

Test capture worked:

"capture_status": "LOCAL_CAPTURES_CREATED",
"created_at": "2015-05-12 10:41:31.031672",
"html_url": "http://<IP_ADDRESS>:8000/files/google.com_1.html",
"id": 1,
"job_status": "COMPLETED",
"modified_at": "2015-05-12 10:41:38.840162",
"retry": null,
"scrape_url": "http://<IP_ADDRESS>:8000/files/google.com_1.txt",
"sketch_url": "http://<IP_ADDRESS>:8000/files/google.com_1.png",
"url": "http://google.com",
"url_response_code": 200

Any suggestions?
Thanks!

Can be closed, celery was not running correctly.

Thanks.


Add custom validation pattern to the docs

The pattern is to override component.linkAll().

Call linkAll of the base class to produce the relevant links.
Add custom validation checks.
If needed, compute the validationError and add it to the cache object.
return cache object.

It's damn cool pattern which deserves to be reflected in tutorials.

I don't use the validation in valuelink, instead using validate.js. From a user standpoint I think the built in validation is less feature rich than validate.js and maybe overreaching in scope/scale of this library.
Regarding the convenience function that returns a link to everything in the state: when using valuelink at work I have been enforcing a naming convention that all variables that are link objects end with 'Link' in the name. The convenience function that returns all the links doesn't do so. Thus I don't find it too useful.

Well, quite contrary, I believe that the links validation mechanics is the feature which makes this library truly worthy. :) This is the major reason this lib was developed and being used by ReactMVx, which powers Volicon/Verizon product lineup.
There's the article about the validation with links here.
<EMAIL_ADDRESS>


Emulator Tcp Settings not working in docker

When running Secret Agent in a Docker, the Tcp settings to emulate Windows 7/10 don't take. Need to investigate if this has to do with running in Docker "on a mac", or if this is because the Go configuration is not working in Linux/Docker-slim

@blakebyrnes can you please share your Dockerfile, because i have issues to even run secret-agent via docker?

There's a Dockerfile in the root. Check out this answer: https://github.com/ulixee/secret-agent/issues/401#issuecomment-997960927


Attestation presentation shows in Chat

The attestation credential presentation shows in chat. When viewed, it partially shows, then disappears.
https://github.com/user-attachments/assets/f761cadb-92b1-4022-8d82-41eab7a128aa

@cvarjao Reading this, why does this need design? Is it not simply a bug? We should remove any visibility of the attestation flow.

duplicates #2063


building: extra common scriptes for image building and bump ttrpc-compiler

Extra common building scripts to make it more general for other images.
Bump ttrpc-compiler in creates.io from 0.6.1 to 0.6.2, while ttrpc-compiler(kuasar-io) is still 0.6.1.

Release workflow is green: https://github.com/Burning1020/kuasar/actions/runs/10399930546


[SPARK-19926][PYSPARK] make captured exception from JVM side user friendly

What changes were proposed in this pull request?
The str of CapaturedException is now returned by str(self.desc) rather than repr(self.desc), which is more user-friendly. It also handles unicode under python2 specially.
Why are the changes needed?
This is an improvement, and makes exception more human readable in python side.
Does this PR introduce any user-facing change?
Before this pr,  select 中文字段 throws exception something likes below:
Traceback (most recent call last):
  File "/Users/advancedxy/code_workspace/github/spark/python/pyspark/sql/tests/test_utils.py", line 34, in test_capture_user_friendly_exception
    raise e
AnalysisException: u"cannot resolve '`\u4e2d\u6587\u5b57\u6bb5`' given input columns: []; line 1 pos 7;\n'Project ['\u4e2d\u6587\u5b57\u6bb5]\n+- OneRowRelation\n"

after this pr:
Traceback (most recent call last):
  File "/Users/advancedxy/code_workspace/github/spark/python/pyspark/sql/tests/test_utils.py", line 34, in test_capture_user_friendly_exception
    raise e
AnalysisException: cannot resolve '`中文字段`' given input columns: []; line 1 pos 7;
'Project ['中文字段]
+- OneRowRelation

How was this patch
Add a new test to verify unicode are correctly converted and manual checks for thrown exceptions.
This pr's credits should go to @uncleGen and is based on https://github.com/apache/spark/pull/17267

Ping @HyukjinKwon and @viirya.
I believe this should be ported before https://github.com/apache/spark/pull/18324, let's check this pr first.

Can one of the admins verify this patch?

ok to test

Test build #110903 has started for PR 25814 at commit 3c028e9.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/16021/
Test PASSed.

Test build #110903 has finished for PR 25814 at commit 3c028e9.

This patch fails Python style tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/110903/
Test FAILed.

@advancedxy please fix the style. looks good otherwise.

Test build #110910 has started for PR 25814 at commit 9e4e7e9.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/16027/
Test PASSed.

Test build #110910 has finished for PR 25814 at commit 9e4e7e9.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/110910/
Test PASSed.

Merged to master.

I'm seeing an error after this went in with unicode:
starting flake8 test...
flake8 checks failed:
./python/pyspark/sql/utils.py:31:60: F821 undefined name 'unicode'
if sys.version_info.major < 3 and isinstance(desc, unicode):
^
1     F821 undefined name 'unicode'
Where is unicode supposed to come from?

If it’s python2, unicode is built-in.
Otherwise, this part is never evaluated, thus irrelevant.

hmm, then why am I getting the error? I'm simply running the dev/lint-python script, my default system version is python 3.7.3. it seems to be checking for unicode package still. Its not clear to me which version Jenkins is using. I see it install python 3.5.6 but that is way after the lint script runs
Have you tried this with python3?

Have you tried this with python3?

Yes, I ran tests with python3.7 on my local machine, but not dev/lint-python.
Looks like flake cannot infer that unicode is never used for python3.  The code is correct in the runtime.
Seems we don't run lint-python on the Jenkins? @HyukjinKwon can you help confirming that?
I'd like to address this problem in https://github.com/apache/spark/pull/25847, the fix is simple, just
add the following in the begin:
import py4j
import sys

if sys.version_info.major >= 3:
    unicode = str

Does that sound reasonable to you @HyukjinKwon ? Or I should submit a follow up pr for this problem? Also cc @viirya

I would like to see this fixed quickly because dev/lint-python is run by run-tests.py which if you are running with python 3 fails and thus makes my CI fail.  I have to assume the Apache Spark Jenkins is using python 2 at that point.  If #25847 is going to be committed today I'm ok with it, otherwise I think it should be separate pr

I'm fine either way. Looks #25847 was approved. It might be merged soon.

I have updated a new commit to #25847, hope it would be merged soon.

I will take a look, If @HyukjinKwon is unable to merge it due to time difference.

thanks!

@tgravescs I have a question on #25847, and I think that @advancedxy can't response in quick due to time difference. I am not sure how many people are affected by this, but in order to unblock it, I am going to create a follow up PR to include the fix.


Error when running any pygmentize command | MacOS

Hello there,
I'm facing an issue (See Error message) when I run any pygmentize command on MacOS.
I've installed pygments earlier this day via:
sudo easy_install Pygments

🔴 Error message:
➜  src git:(master) ✗ pygmentize -V
Traceback (most recent call last):
  File "/usr/local/bin/pygmentize", line 11, in <module>
    load_entry_point('Pygments==2.11.2', 'console_scripts', 'pygmentize')()
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/pkg_resources/__init__.py", line 489, in load_entry_point
    return get_distribution(dist).load_entry_point(group, name)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/pkg_resources/__init__.py", line 2843, in load_entry_point
    return ep.load()
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/pkg_resources/__init__.py", line 2434, in load
    return self.resolve()
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/pkg_resources/__init__.py", line 2440, in resolve
    module = __import__(self.module_name, fromlist=['__name__'], level=0)
  File "/Library/Python/2.7/site-packages/Pygments-2.11.2-py2.7.egg/pygments/cmdline.py", line 83
    print("%s not found!" % what, file=sys.stderr)

💻 Environment
MacOS: 11.6.1 (20G224)
Python: 2.7.16

We no longer support Python 2. Please use Python 3. Thanks.

looks like I'm getting the same error, after updating to the latest version (3.10) :/

Alright, with the correct python version it works as expected.. Thanks ;D
In case sb is facing the same issue and needs to update python on their macOS (Big Sur) too,
this tutorial worked for me: https://www.youtube.com/watch?v=0rg6nyanX5Y


can't compile project - cannot convert argument 4 from "PULONG" to "PSIZE_T"

Hi,
I take example code from your description (how inject DLL) but  get 2 errors during compilation-  both on line
NtAllocateVirtualMemory(hProcess, &lpAllocationStart, 0, (PULONG)&szAllocationSize, MEM_COMMIT | MEM_RESERVE, PAGE_READWRITE);
Errors :
1 ) argument of type "PULONG" is incompatible with parameter of type "PSIZE_T"
2 ) cannot convert argument 4 from "PULONG" to "PSIZE_T"
All code and the errors can be seen on the link https://ibb.co/JzrBx4y

Try making allocationSize ULONG type

The prototype for NtVirtualAllocMemory is defined on MSDN.
https://docs.microsoft.com/en-us/windows-hardware/drivers/ddi/ntifs/nf-ntifs-ntallocatevirtualmemory
From the picture, it looks like you're casting from PSIZE_T to PULONG. Remove the cast and should compile fine.


feat: release v5.20.0

Move some of the globalConfig validators to the ucc-gen from UCC UI
Custom feature implementation in UCC UI
Multiple documentation updates

:tada: This PR is included in version 5.20.0-beta.1 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:

:tada: This PR is included in version 5.20.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


batch_read_file_in_stream doesn't work

When I call batch_read_file_in_stream I'm getting this error:
Error occurred in request., ConnectionError: ("bad handshake: SysCallError(-1, \'Unexpected EOF\')",)

It is not SSL related, because when I call batch_read_file that receives an image url instead of a local image, it works.
I'm calling it like this:
with open(R"C:\...\teste.png", "rb") as imageStream:
    recognize_printed_results = computervision_client.batch_read_file_in_stream(imageStream,  raw=True)

It is something related to this line (body_content = self._client.stream_upload(image, callback)), because when I change it to body_content = image.read() it works:
# Construct body
-body_content = self._client.stream_upload(image, callback) # <-- causes error in the `send` call below
+body_content = image.read()

# Construct and send request
request = self._client.post(url, query_parameters, header_parameters, body_content)
response = self._client.send(request, stream=False, **operation_config)

All examples about this API that I found on the internet, they use batch_read_file. I didn't find any using batch_read_file_in_stream.

@lmcarreiro thanks for letting us know. I am tagging the right team to take a look at it

Hi @lmcarreiro
That's a SSL connection error, which is happening way earlier in the process that any kind of streaming reading. So the code you changed shouldn't have any impact at all.
Could you confirm with 100% certainty (by replaying it several times), that in 100% of your failure the stream_upload is used, and in 100% of your success the direct read was used?
Thank you,


[FEATURE] Would like more control over amount of parallelism S3 repo plugin

Is your feature request related to a problem? Please describe.
I'm building a cluster for a SIEM setup. The first 7 days of data will be on our full flash block storage on the SAN which performs fantastic, but it's expensive. We need to archive the data, so between 7 and 185 days we are writing this to an on prem Scality S3 solution with searchable snapshots.
Well..It works like a charm! Some throughput numbers
2 search nodes: 400MB/s
2 search nodes with concurrent segment search: 580MB/s
3 search nodes with concurrent segment search: 800MB/s
4 search nodes with concurrent segment search: 1.2GB/s
I/O response times aren't climbing while putting more load on the Scality appliance, it still has headroom.
In terms of CPU the search nodes are doing about 40% of the maximum possible.
Networkwise I'm not maxing out either the 10gb ethernet connections from the compute nodes (10gb*number of nodes) or the Scality itself (network; 25gb * number of scality nodes, more than enough headroom). Interconnects in the network are 100gb.
I need more search nodes to get more throughput, but this is not always ideal (more memory overhead, network comms, etc). I would prefer a smaller amount of larger search nodes rather than the other way around.
Describe the solution you'd like
More parallelism is probably my friend in this case and a single node in would probably benefit from this. But as far as I can see I can't influence this from the settings, while the AWS S3 lib does expose performance settings (max concurrent requests).
I would like to have more fine grained control to play around andmax out my compute nodes/the Scality (and while doing so making the storage guys smile).
Describe alternatives you've considered
Spin up more search nodes.
Additional context
N/A

Thanks @ict-one-nl for sharing the results. To better understand the setup, lets consider 2 search node case and I have few questions:

2 search nodes with concurrent segment search: 580MB/s

How many indices are in this setup and with what shard configuration. ? How many shards are hosted on these nodes ? What are the size of the shards here ?
Are all the index shards powered by Searchable Snapshots indices ? If yes, are you seeing file cache misses during the search queries ?
These throughput numbers are for which operation ?
How many clients are running the search request and across how many indices ?
Is 40% CPU utilization in this setup as well ? Without concurrent search enabled, what is the CPU utilization do you see ?
Also would be great if you can share some search latency numbers with and without concurrent search in your setup ? If possible, please share the type of queries you are running :)

Around 700 indices: ±300 on hot storage, 400 on S3. Number of shards is a mix, the heavier used indices have 4 primaries, others just 1. 0 replicas for all. Small indices ±10 segment, the bigger ones 20-35.
Good question; where can I see the cache hits/misses?
This is while using Dashboards on the whole data: overall results and then drilling down on particulier fields
Only 1 dashboards client at this time
Didn't collect the cpu-numbers without concurrent segment search. This is kind of a production system so I'm trying to minimise the outages.
If you can give me a few pointers on how to collect this so that it is useful: sure

Good question; where can I see the cache hits/misses?

@ict-one-nl You can use GET /_nodes/stats to fetch the file cache stats.

@ict-one-nl  Thanks for sharing the response. This one seems to be a bigger cluster than 2 node. Would be easier to try on 2 node but lets see.
There are at max (700*4) = 2800 shards spread out on 9 nodes. So roughly 2800//9 = ~310 shards per node.  Considering the query is spanning all the indices, so it may be touching all these shards. And there is single query sent at a time, so to a node at max 5 shards will be hit at a time. Each of the shard requests will be parallelized internally with concurrent search. If with this you still have enough CPU capacity on each node during the query time, you can try increasing the shard requests sent to each node at a time by setting this parameter max_concurrent_shard_requests to a larger value.
Note: When you will have multiple clients running the query concurrently then probably a default of 5 should be good. The threadpools for the search and to perform concurrent search path is shared between requests at shard level. So assuming the CPU cycles are not fully utilized in your setup, seems like it can run more shard level search requests and hence the suggestion. You can try in pre-prod environment first.

The query cache is only a few hundred kilobytes per node it seems, while I haven't changed the settings. But this is a cluster that's primarily doing ingest and very little querying, only when the analysts pull up dashboards or dive into the data. The cluster is hosting ±2300 shards at the time of writing but this will go up over time for the coming months.
I have looked into the max_concurrent_shard_requests setting, I can try that one but I haven't found a way to set it as a default on the cluster or in the dashboards config, only on individual api-calls. Can I do this globally or in Dashboards? I'll try to figure out if it makes a difference. I have cpu-cycles left, shouldn't be a problem.

It should be in Dashboard under Advanced Settings. Will try to share the exact location once I get an endpoint in case you still don't find it. It is not possible to set it globally as it is a request parameter currently.

Thanks! Will test with that option. That's probably enough to resolve the ticket I suppose.


Load attachment previews when message rendered

:eyeglasses: @keybase/react-hackers

:no_entry: Error rendering the commits ff00f423f448...23e806fd34cd on linux. :mag_right: 15 errored

Error in 23e806fd34cd: Attachment_Message-Basic_Uploading-ERROR

Error in 23e806fd34cd: Attachment_Message-Basic_Preview_Video_w_Duration-ERROR

Error in 23e806fd34cd: Attachment_Message-Basic_Preview_Image_w_Duration-ERROR

Error in 23e806fd34cd: Attachment_Message-Basic_Preview_Image_Pending-ERROR

Error in 23e806fd34cd: Attachment_Message-Basic_Preview_Image_Not_Downloaded-ERROR

Error in 23e806fd34cd: Attachment_Message-Basic_Preview_Image_Failed-ERROR

Error in 23e806fd34cd: Attachment_Message-Basic_Preview_Image_Downloading_Preview-ERROR

Error in 23e806fd34cd: Attachment_Message-Basic_Preview_Image_Downloaded-ERROR (view)
Error in 23e806fd34cd: Attachment_Message-Basic_Not_loaded-ERROR (view)
Error in 23e806fd34cd: Attachment_Message-Basic_Generic_File_sent-ERROR (view)
Error in 23e806fd34cd: Attachment_Message-Basic_Generic_File_Uploading-ERROR (view)
Error in 23e806fd34cd: Attachment_Message-Basic_Generic_File_Failed-ERROR (view)
Error in 23e806fd34cd: Attachment_Message-Basic_Generic_File_Downloading-ERROR (view)
Error in 23e806fd34cd: Attachment_Message-Basic_Generic_File_Downloaded-ERROR (view)
Error in 23e806fd34cd: Attachment_Message-Basic_Downloading-ERROR (view)

:no_entry: Error rendering the commits ff00f423f448...3a84d54ffa0a on linux. :mag_right: 15 errored

Error in 3a84d54ffa0a: Attachment_Message-Basic_Uploading-ERROR

Error in 3a84d54ffa0a: Attachment_Message-Basic_Preview_Video_w_Duration-ERROR

Error in 3a84d54ffa0a: Attachment_Message-Basic_Preview_Image_w_Duration-ERROR

Error in 3a84d54ffa0a: Attachment_Message-Basic_Preview_Image_Pending-ERROR

Error in 3a84d54ffa0a: Attachment_Message-Basic_Preview_Image_Not_Downloaded-ERROR

Error in 3a84d54ffa0a: Attachment_Message-Basic_Preview_Image_Failed-ERROR

Error in 3a84d54ffa0a: Attachment_Message-Basic_Preview_Image_Downloading_Preview-ERROR

Error in 3a84d54ffa0a: Attachment_Message-Basic_Preview_Image_Downloaded-ERROR (view)
Error in 3a84d54ffa0a: Attachment_Message-Basic_Not_loaded-ERROR (view)
Error in 3a84d54ffa0a: Attachment_Message-Basic_Generic_File_sent-ERROR (view)
Error in 3a84d54ffa0a: Attachment_Message-Basic_Generic_File_Uploading-ERROR (view)
Error in 3a84d54ffa0a: Attachment_Message-Basic_Generic_File_Failed-ERROR (view)
Error in 3a84d54ffa0a: Attachment_Message-Basic_Generic_File_Downloading-ERROR (view)
Error in 3a84d54ffa0a: Attachment_Message-Basic_Generic_File_Downloaded-ERROR (view)
Error in 3a84d54ffa0a: Attachment_Message-Basic_Downloading-ERROR (view)

[ ] use onChangeVisibleRows for RN ListView
[ ] Investigate handling multiple calls to onLoadAttachment before it finishes


 When you respawn you have to buy the next tier instead of the lowest.

Should be fixed

Seen this bug on the running server just now, wondering if its actually fixed and needs updating or actually needs fixing.


Add create_complex_regression_pipeline to sklearn_model_utils.py

Description
Add create_complex_regression_pipeline to sklearn_model_utils.py
Checklist

[ ] I have added screenshots above for all UI changes.
[ ] I have added e2e tests for all UI changes.
[ ] Documentation was updated if it was needed.

Codecov Report

Merging #2318 (ed008c2) into main (2839a15) will increase coverage by 3.95%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##             main    #2318      +/-   ##
==========================================
+ Coverage   88.42%   92.37%   +3.95%
==========================================
  Files         133      107      -26
  Lines        7584     5391    -2193
==========================================
- Hits         6706     4980    -1726
+ Misses        878      411     -467

Flag
Coverage Δ

unittests
92.37% <100.00%> (+3.95%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Files Changed
Coverage Δ

...st_utils/rai_test_utils/models/sklearn/__init__.py
100.00% <ø> (ø)

...i_test_utils/models/sklearn/sklearn_model_utils.py
74.54% <100.00%> (+3.11%)
:arrow_up:

... and 26 files with indirect coverage changes


improve and/or document development and debugging of tests

To make it easier for a client developer to act on test failures (and for test developers to implement new tests), it should be reasonably easy to see what kind of repository structure a specific test offers to the client:
Possible improvements:

more optional logging?
Ability to store a copy of repository metadata

python-tuf tests have this with --dump argument to some tests (like python3 tests/test_updater_top_level_update.py --dump)
RepositorySimulator already has write() method for this
I wonder if we should just automatically dump the metadata into a directory in /tmp on test failure?

I can have a look at this but I might wait until #35 is there so it may be posisble to automate metadata dump into GH artifacts

this is mostly fixed in #90 -- but it would be cool if the GH action could somehow automatically use this feature. I will do some tests

I've modified #90 so that it always uploads the repository versions.  It would be cool if it only happened for failing tests and each failing test had it's own artifact but that seems far too much work.
I think this is fixed with #90


GSD Request

--- GSD JSON ---
{
  "vendor_name": "Linux",
  "product_name": "Kernel",
  "product_version": "versions from  to before v4.4.296",
  "vulnerability_type": "unspecified",
  "affected_component": "unspecified",
  "attack_vector": "unspecified",
  "impact": "unspecified",
  "credit": "",
  "references": [
    "https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/commit/?id=3e04b9e6aa7d77287e70a400be83060d2b7b2cfe"
  ],
  "extended_references": [
    {
      "type": "commit",
      "value": "3e04b9e6aa7d77287e70a400be83060d2b7b2cfe",
      "note": "fixed"
    }
  ],
  "reporter": "joshbressers",
  "reporter_id": 1692786,
  "notes": "",
  "description": "xen/blkfront: harden blkfront against event channel storms\n\nThis is an automated ID intended to aid in discovery of potential security vulnerabilities. The actual impact and attack plausibility have not yet been proven.\nThis ID is fixed in Linux Kernel version v4.4.296 by commit 3e04b9e6aa7d77287e70a400be83060d2b7b2cfe. For more details please see the references link."
}
--- GSD JSON ---

This issue has been assigned GSD-2021-1002616


Sessions stay valid after validity ends if expiry date for voucher is set

If we generate Vouchers and set an expiry date, the expiry date will be set as session timeout, instead of the validity time.
This is due to the following part in the code
if ($row['expirytime'] > 0 && $row['expirytime'] > time()) {
    $this->lastAuthProperties['session_timeout'] = $row['expirytime'] - time();
    return true;
} elseif (time() - $row['starttime'] < $row['validity']) {
    $this->lastAuthProperties['session_timeout'] = $row['validity'] - (time() - $row['starttime']);
    return true;
}

from src/opnsense/mvc/app/library/OPNsense/Auth/Voucher.php because of the precedence of expiry time over validity.
This is security relevant
To Reproduce
Steps to reproduce the behavior:

Go to Services -> Captive Portal -> Vouchers
Click on Create vouchers
Create Voucher with

Validity: Custom(minutes) 5
Expires in: 3 month
Number of vouchers: 1 (should be irrelevant)
Groupname: whatever

Use the generated voucher, Session won't be invalidated/cleaned up after 5 Minutes, instead it will wait for expiry, so validity will be 3 month

Expected behavior
Session will be invalidated after validity has reached its end, not after expiry of the voucher itself.
[✓] I have read the contributing guide lines at https://github.com/opnsense/core/blob/master/CONTRIBUTING.md
[✓] I have searched the existing issues and I'm convinced that mine is new.

@xx4h thank you for the thorough report and provided PR. While looking at it, I wondered if the correct session_timeout shouldn't the the lowest of these two values.
In most circumstances your fix would very likely be better than the current situation, but expirytime could still be triggered before the validity left on the ticket. What do you think?

@AdSchellevis thank you for the quick response. In my opinion the expiry date is only to ensure the voucher is no longer used after this date. If we use the voucher one minute before expiry we should get a session of the length validity.
But as you mentioned it, i saw another point. As we don‘t ever have a validity of forever we don‘t need to use expiry at all („elseif“ wouldn‘t even ever be used in my PR), so we could remove the „elseif“ completely? What do you think?
Highly appreciate the discussion.

After another „playthrough“ i have to slightly correct my last comment. As we are in the authenticate function, we need to check the expiry too. So my new suggestion would be to combine the current „if“ and „elseif“ conditions into one „if“.
So we ensure

Voucher is not expired
Validity (based on starttime) has not reached its end

I’ll provide a new PR. What do you think?

I think that should do the trick indeed, if you update the PR I'll take a look.

I already updated the commit 36049b47de48337cdcf9c1af66b1ef9a1fb18766

my mistake, totally missed the commit. I think that's almost complete, but session_timeout should probably also be influenced by whichever comes first (validity or expiry).
something like:
$this->lastAuthProperties['session_timeout'] = min(
       $row['validity'] - (time() - $row['starttime']),
       $row['expirytime'] - time()
);

No problem. So you don't agree with me on

In my opinion the expiry date is only to ensure the voucher is no longer used after this date. If we use the voucher one minute before expiry we should get a session of the length validity.

I'm fine with that, just want to get sure, that we discussed it.

I agree there's room for interpretation, although I expect the most logic situation is to stop the session on expirytime as well, which is more or less backwards compatible with the situation we had before too.


No Response

I train a model use my own data with labels in a short time, but when I use the model to test, there was no response, it showed have loaded the test file and model, I wait for a relative long time but nothing happened, even raised any error.

@AwkwardBoy could you share the commands you ran and some example data? That way we can reproduce the bug and figure out what went wrong. Thanks!

Sorry, it seems that I used a relative large test data to the model, and it use a pretty long time than my image. I used a small test data, and it works well. Many thanks

@AwkwardBoy thanks for the update. You can also set -thread to a larger number (default is 10) for bigger datasets. Closing the issue for now.


Please Help Me!!

Modify which code under the folder can customize your name, etc.

_config.yml


Introduce parallel runs

Resolves #128

@johanneshiry Please double check, if I took over your implementations correctly.

Reminder to myself: Don't forget to adapt the documentation!!!

Reminder to myself: Don't forget to adapt the documentation!!!

@ckittl you may consider creating a separate issue for this? Or do you intend to have this documentation in this PR?

@dependabot squash and merge

!test


Fix ci build

does this fixing the CI build on main?

that should fix unit tests for ci-integration


go 1.8.3: function "str_Format_MeasureUnit" not defined

Hey @AndreaGreco, I can see tests failing with go 1.8.3, any ideas how to fix this?
Problem reading parsing template file: template: production_example.tmpl:20: function "str_Format_MeasureUnit" not defined

This evening i will check this bug.
Thank you for reporting
Andrea
2017-07-05 14:13 GMT+02:00 Roman Belyakovsky<EMAIL_ADDRESS>
Hey @AndreaGreco https://github.com/andreagreco, I can see tests
failing with go 1.8.3, any ideas how to fix this?
Problem reading parsing template file: template: production_example.tmpl:20: function "str_Format_MeasureUnit" not defined
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/inCaller/prometheus_bot/issues/26, or mute the thread
https://github.com/notifications/unsubscribe-auth/AEVOwEFPHhI8ZY6PMkDjULRmk4SndotDks5sK33WgaJpZM4OOQDd
.

Today compiled and all works.
I think you could close this


Does not install on Mac OS-X El Capitan

I just tried installing using the package file, as well as the brew cask and getting the same installation issue. There is a corresponding stack overflow discussion without any resolution.
Is this because it's trying to install itself under /usr/bin (which is protected in El Capitan)?  Is it possible to set the prefix of the installation to /usr/local/bin instead? (I am just guessing here).

| → sudo installer -pkg ~/Downloads/bii-macos-64_3_3.pkg -target /
installer: Package name is Biicode
installer: Installing at base path /
installer: The install failed (The Installer encountered an error that caused the installation to fail. Contact the software manufacturer for assistance.)

And using brew:
| → brew install Caskroom/cask/biicode
==> brew cask install Caskroom/cask/biicode
==> Downloading https://s3.amazonaws.com/biibinaries/release/3.3/bii-macos-64_3_3.pkg
######################################################################## 100.0%
==> Running installer for biicode; your password may be necessary.
==> Package installers may write to any location; options such as --appdir are ignored.
Password:
==> installer: Package name is Biicode
==> installer: Installing at base path /
==> installer: The install failed (The Installer encountered an error that caused the installation to fail. Contact the software manufacturer for assistance.)
Error: Command failed to execute!

==> Failed command:
["/usr/bin/sudo", "-E", "--", "/usr/sbin/installer", "-pkg", "#<Pathname:/opt/homebrew-cask/Caskroom/biicode/3.3/bii-macos-64_3_3.pkg>", "-target", "/"]

==> Output of failed command:
installer: Package name is Biicode
installer: Installing at base path /
installer: The install failed (The Installer encountered an error that caused the installation to fail. Contact the software manufacturer for assistance.)

==> Exit status of failed command:
#<Process::Status: pid 33736 exit 1>

I have hit the same thing. I was curious for a package manager for c++ apps so I hope this gets fixed soon.

I just realized that the company behind it shutdown in August, and if you look at the commit history, the project have not had any since May last year.
So to me this looks like a ghostly dead technology.
:(

Check conan.io ;)


Adds SHA1 history feature

This PR allows gulp-changed to work only when the source file changes using SHA1 history. This is useful for things like in-place source formatting.

like in-place source formatting.

What is that? Can you provide a realistic example?

like in-place source formatting.
What is that? Can you provide a realistic use-case example for the suggested feature?

I'm applying formatting to source files when saved to enforce styling rules and avoid linting comments in pull-requests requests.

Why are you even using gulp for that? That should be done in your editor by a plugin.
I don't really see the use-case for this tbh, and it's a bit out of scope for this plugin. Publish a fork or use https://github.com/contra/gulp-cached instead.

To have an editor take care of this I would have to write plugins for every editor that my team uses and then make sure they actually use it, which switches this from tech problem to people problem (and those are much harder to solve).The idea is to be able to run gulp dev and have everything working consistently for everyone regardless of the platform or editor they use.
I published this is a separate module https://github.com/alexgorbatchev/gulp-changed-in-place

Cool. Happy to link to it at the end of the readme if you do a PR.


RemoveSelector removing 2 UUID instead of one

Calling Mods.SubclassCompatibilityFramework.Api.RemoveSelectors with:
{
        "FileType" : "Progression",
        "Function" : "AddSpells",
        "ListUUID" : "0f094e35-9675-464d-8cae-8e58c28de955",
        "TargetUUID" : "ac2a03fd-ac7b-42b6-a1b7-e0de94a77703",
        "modGuid" : "a5799115-ef11-457b-92cd-2c927de09b02"
}

Selectors value for this UUID: AddSpells(0f094e35-9675-464d-8cae-8e58c28de955,,,,AlwaysPrepared);AddSpells(e568eca4-b5e1-4b67-83d6-d831adf05e23,,,,AlwaysPrepared);AddSpells(729670a8-da85-4fd2-9764-4dec636a275b,DruidCircleOfTheSporesSpells,,,AlwaysPrepared)
Expected result: removes AddSpells(0f094e35-9675-464d-8cae-8e58c28de955
Result: removes AddSpells(0f094e35-9675-464d-8cae-8e58c28de955 and AddSpells(e568eca4-b5e1-4b67-83d6-d831adf05e23
So, it removes the next one too, but not the last one.
I have tried to debug RemoveSelector function, but it never enters for loop. Previous condition is false on Queue[Globals.ModuleTypes[type]][target].Selectors ~= nil
Queue[Globals.ModuleTypes[type]][target] value is:
{
        "Selectors_Remove" :
        {
                "AddSpells" :
                [
                        "0f094e35-9675-464d-8cae-8e58c28de955"
                ]
        }
}

I am using the latest version. And I have already used this API with success in the past.

Take your time, your health is much more important. Currently, I'm just adding back what has been removed, so I have a working solution. It is just weird, I don't understand how it can go wrong.


[BUG] can't import performance metrics

sktime 0.6.0
for example:
from sktime.performance_metrics.forecasting import MeanAbsolutePercentageError
gives the following error:
ImportError: cannot import name 'MeanAbsolutePercentageError' from 'sktime.performance_metrics.forecasting' (/opt/anaconda3/lib/python3.8/site-packages/sktime/performance_metrics/forecasting/init.py)

@eyalshafran you can access the performance metrics in sktime.forecasting.all.
But you raise a good point about the performance_metrics not being available for import from the performance_metrics.forecasting sub-module.
I'll talk with @mloning about where we want to make these available in the API.

I think this is related to https://github.com/alan-turing-institute/sktime/issues/865 - please make sure your version align (the new metrics are on main but not in the latest release yet).


Set default autoscroll speed based on tab bpm

It would be nice to set the default speed for autoscroll based on tab bpm (and zoom level if implemented)

Won't fix since autoscroll speed is now preference based


Not all keywords supported

I added a pact-lsp client to support the pact-lsp server in the Pact for Visual Studio Code (vscode) extension (https://github.com/kadena-community/pact-vscode/commit/916d4c00cf12f0504c438c3e8b1ca08887e5a151)
I used a sample lsp extension for vscode and it does work for the functionality show in the screenshots for pact-lsp: completes and hovers for enforce-* , is-charset , read-* , mod, define-* , ..
But some pact keywords appear to be unknown to pact-lsp, some I tested but probably not a complete list: module, defcap, defun, defconst, defschema, deftable, defpact, step, let, let*, property. These are not found for completion and not showing the docs on hover.
My impression is that this is an issue at the lsp server level rather than with the lsp client I added to the pact extension.
This is the debug output when typing (module ) and hovering it:
[Info] Starting server
[Debug] ---> {"jsonrpc":"2.0","id":0,"method":"initialize","params":{"processId":2815395,"clientInfo":{"name":"Visual Studio Code","version":"1.80.0"},"locale":"en","rootPath":"/pact","rootUri":"file://pact","capabilities":{"workspace":{"applyEdit":true,"workspaceEdit":{"documentChanges":true,"resourceOperations":["create","rename","delete"],"failureHandling":"textOnlyTransactional","normalizesLineEndings":true,"changeAnnotationSupport":{"groupsOnLabel":true}},"configuration":true,"didChangeWatchedFiles":{"dynamicRegistration":true,"relativePatternSupport":true},"symbol":{"dynamicRegistration":true,"symbolKind":{"valueSet":[1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26]},"tagSupport":{"valueSet":[1]},"resolveSupport":{"properties":["location.range"]}},"codeLens":{"refreshSupport":true},"executeCommand":{"dynamicRegistration":true},"didChangeConfiguration":{"dynamicRegistration":true},"workspaceFolders":true,"semanticTokens":{"refreshSupport":true},"fileOperations":{"dynamicRegistration":true,"didCreate":true,"didRename":true,"didDelete":true,"willCreate":true,"willRename":true,"willDelete":true},"inlineValue":{"refreshSupport":true},"inlayHint":{"refreshSupport":true},"diagnostics":{"refreshSupport":true}},"textDocument":{"publishDiagnostics":{"relatedInformation":true,"versionSupport":false,"tagSupport":{"valueSet":[1,2]},"codeDescriptionSupport":true,"dataSupport":true},"synchronization":{"dynamicRegistration":true,"willSave":true,"willSaveWaitUntil":true,"didSave":true},"completion":{"dynamicRegistration":true,"contextSupport":true,"completionItem":{"snippetSupport":true,"commitCharactersSupport":true,"documentationFormat":["markdown","plaintext"],"deprecatedSupport":true,"preselectSupport":true,"tagSupport":{"valueSet":[1]},"insertReplaceSupport":true,"resolveSupport":{"properties":["documentation","detail","additionalTextEdits"]},"insertTextModeSupport":{"valueSet":[1,2]},"labelDetailsSupport":true},"insertTextMode":2,"completionItemKind":{"valueSet":[1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25]},"completionList":{"itemDefaults":["commitCharacters","editRange","insertTextFormat","insertTextMode"]}},"hover":{"dynamicRegistration":true,"contentFormat":["markdown","plaintext"]},"signatureHelp":{"dynamicRegistration":true,"signatureInformation":{"documentationFormat":["markdown","plaintext"],"parameterInformation":{"labelOffsetSupport":true},"activeParameterSupport":true},"contextSupport":true},"definition":{"dynamicRegistration":true,"linkSupport":true},"references":{"dynamicRegistration":true},"documentHighlight":{"dynamicRegistration":true},"documentSymbol":{"dynamicRegistration":true,"symbolKind":{"valueSet":[1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26]},"hierarchicalDocumentSymbolSupport":true,"tagSupport":{"valueSet":[1]},"labelSupport":true},"codeAction":{"dynamicRegistration":true,"isPreferredSupport":true,"disabledSupport":true,"dataSupport":true,"resolveSupport":{"properties":["edit"]},"codeActionLiteralSupport":{"codeActionKind":{"valueSet":["","quickfix","refactor","refactor.extract","refactor.inline","refactor.rewrite","source","source.organizeImports"]}},"honorsChangeAnnotations":false},"codeLens":{"dynamicRegistration":true},"formatting":{"dynamicRegistration":true},"rangeFormatting":{"dynamicRegistration":true},"onTypeFormatting":{"dynamicRegistration":true},"rename":{"dynamicRegistration":true,"prepareSupport":true,"prepareSupportDefaultBehavior":1,"honorsChangeAnnotations":true},"documentLink":{"dynamicRegistration":true,"tooltipSupport":true},"typeDefinition":{"dynamicRegistration":true,"linkSupport":true},"implementation":{"dynamicRegistration":true,"linkSupport":true},"colorProvider":{"dynamicRegistration":true},"foldingRange":{"dynamicRegistration":true,"rangeLimit":5000,"lineFoldingOnly":true,"foldingRangeKind":{"valueSet":["comment","imports","region"]},"foldingRange":{"collapsedText":false}},"declaration":{"dynamicRegistration":true,"linkSupport":true},"selectionRange":{"dynamicRegistration":true},"callHierarchy":{"dynamicRegistration":true},"semanticTokens":{"dynamicRegistration":true,"tokenTypes":["namespace","type","class","enum","interface","struct","typeParameter","parameter","variable","property","enumMember","event","function","method","macro","keyword","modifier","comment","string","number","regexp","operator","decorator"],"tokenModifiers":["declaration","definition","readonly","static","deprecated","abstract","async","modification","documentation","defaultLibrary"],"formats":["relative"],"requests":{"range":true,"full":{"delta":true}},"multilineTokenSupport":false,"overlappingTokenSupport":false,"serverCancelSupport":true,"augmentsSyntaxTokens":true},"linkedEditingRange":{"dynamicRegistration":true},"typeHierarchy":{"dynamicRegistration":true},"inlineValue":{"dynamicRegistration":true},"inlayHint":{"dynamicRegistration":true,"resolveSupport":{"properties":["tooltip","textEdits","label.tooltip","label.location","label.command"]}},"diagnostic":{"dynamicRegistration":true,"relatedDocumentSupport":false}},"window":{"showMessage":{"messageActionItem":{"additionalPropertiesSupport":true}},"showDocument":{"support":true},"workDoneProgress":true},"general":{"staleRequestSupport":{"cancel":true,"retryOnContentModified":["textDocument/semanticTokens/full","textDocument/semanticTokens/range","textDocument/semanticTokens/full/delta"]},"regularExpressions":{"engine":"ECMAScript","version":"ES2020"},"markdown":{"parser":"marked","version":"1.1.0"},"positionEncodings":["utf-16"]},"notebookDocument":{"synchronization":{"dynamicRegistration":true,"executionSummarySupport":true}}},"initializationOptions":[{"pact":"pact"}],"trace":"off","workspaceFolders":[{"uri":"file://pact","name":"pact"}]}}
[Debug] <--2-- {"id":0,"jsonrpc":"2.0","result":{"capabilities":{"callHierarchyProvider":false,"codeActionProvider":false,"colorProvider":false,"completionProvider":{"resolveProvider":false},"declarationProvider":false,"definitionProvider":false,"documentFormattingProvider":false,"documentHighlightProvider":false,"documentR[aDnegbeuFgo]r m-a-t-t>i n{g"Pjrsoovnirdpecr""::"f2a.l0s"e,,""mdeotchuomde"n:t"SiynmibtoilaPlriozveidd"e,r""p:afraalmsse",:"{f}o}l
di[nDgeRbaungg]e P-r-o-v>i d{e"rj"s:ofnarlpsce",:""h2o.v0e"r,P"rmoevtihdoedr""::"ttreuxet,D"oicmupmleenmte/ndtiadtOipoennP"r,o"vpiadrearm"s:"f:a{l"stee,x"trDeofceurmeenncte"s:P{r"ouvriid"e:r""f:iflael:s/e/,/"hroemnea/meemPmrioev/iDdoecru"m:efnatlesne/,k"asdeelneacstwiaopn/Rpaancgte/Ptreosvti.dpearc"t:"f,a"llsaen,g"usaegmeaIndt"i:c"Tpoakcetn"s,P"rvoevrisdieorn""::{1",l"etgeexntd""::"{""}t}o}k
en[MDoedbiufgi]e rVsF"S::[ "odpeecnlianrga tNioornm"a,l"idzeefdiUnriit i5o5n7"5,4"8r5e6a6d3o6n4l7y0"4,0"1s9t7a t"ifci"l,e":d/e/p/rheocmaet/eedm"m,i"ea/bDsotcruamcetn"t,e"na/skyandce"n,a"smwoadpi/fpiaccatt/itoens"t,."pdaocctu"m
entation","defaultLibrary"],"tokenTypes":["namespace","type","class","enum","interface","struct","typeParameter","parameter","variable","property","enumMember","event","function","method","macro","keyword","modifier","comment","string","number","regexp","operator"]}},"textDocumentSync":{"change":2,"openClose":true,"save":{"includeText":true},"willSave":false,"willSaveWaitUntil":false},"typeDefinitionProvider":false,"workspace":{},"workspaceSymbolProvider":false}}}
[Debug] <--2-- {"jsonrpc":"2.0","method":"textDocument/publishDiagnostics","params":{"diagnostics":[],"uri":"file://pact/test.pact"}}
[Debug] ---> {"jsonrpc":"2.0","method":"textDocument/didChange","params":{"textDocument":{"uri":"file://pact/test.pact","version":2},"contentChanges":[{"range":{"start":{"line":0,"character":0},"end":{"line":0,"character":0}},"rangeLength":0,"text":"()"}]}}
[Debug] ---> {"jsonrpc":"2.0","method":"textDocument/didChange","params":{"textDocument":{"uri":"file://pact/test.pact","version":3},"contentChanges":[{"range":{"start":{"line":0,"character":1},"end":{"line":0,"character":1}},"rangeLength":0,"text":"m"}]}}
[Debug] ---> {"jsonrpc":"2.0","id":1,"method":"textDocument/completion","params":{"textDocument":{"uri":"file://pact/test.pact"},"position":{"line":0,"character":2},"context":{"triggerKind":1}}}
[Debug] <--2-- {"id":1,"jsonrpc":"2.0","result":{"isIncomplete":false,"items":[{"label":"make-list"},{"label":"map"},{"label":"minutes"},{"label":"mod"}]}}
[Debug] ---> {"jsonrpc":"2.0","method":"textDocument/didChange","params":{"textDocument":{"uri":"file://pact/test.pact","version":4},"contentChanges":[{"range":{"start":{"line":0,"character":2},"end":{"line":0,"character":2}},"rangeLength":0,"text":"o"}]}}
[Debug] ---> {"jsonrpc":"2.0","method":"textDocument/didChange","params":{"textDocument":{"uri":"file://pact/test.pact","version":5},"contentChanges":[{"range":{"start":{"line":0,"character":3},"end":{"line":0,"character":3}},"rangeLength":0,"text":"d"}]}}
[Debug] ---> {"jsonrpc":"2.0","method":"textDocument/didChange","params":{"textDocument":{"uri":"file://pact/test.pact","version":6},"contentChanges":[{"range":{"start":{"line":0,"character":4},"end":{"line":0,"character":4}},"rangeLength":0,"text":"u"}]}}
[Debug] ---> {"jsonrpc":"2.0","id":2,"method":"textDocument/completion","params":{"textDocument":{"uri":"file://pact/test.pact"},"position":{"line":0,"character":5},"context":{"triggerKind":1}}}
[Debug] <--2-- {"id":2,"jsonrpc":"2.0","result":{"isIncomplete":false,"items":[]}}
[Debug] ---> {"jsonrpc":"2.0","method":"textDocument/didChange","params":{"textDocument":{"uri":"file://pact/test.pact","version":7},"contentChanges":[{"range":{"start":{"line":0,"character":5},"end":{"line":0,"character":5}},"rangeLength":0,"text":"l"}]}}
[Debug] ---> {"jsonrpc":"2.0","id":3,"method":"textDocument/completion","params":{"textDocument":{"uri":"file://pact/test.pact"},"position":{"line":0,"character":6},"context":{"triggerKind":1}}}
[Debug] <--2-- {"id":3,"jsonrpc":"2.0","result":{"isIncomplete":false,"items":[]}}
[Debug] ---> {"jsonrpc":"2.0","method":"textDocument/didChange","params":{"textDocument":{"uri":"file://pact/test.pact","version":8},"contentChanges":[{"range":{"start":{"line":0,"character":6},"end":{"line":0,"character":6}},"rangeLength":0,"text":"e"}]}}
[Debug] ---> {"jsonrpc":"2.0","id":4,"method":"textDocument/completion","params":{"textDocument":{"uri":"file://pact/test.pact"},"position":{"line":0,"character":7},"context":{"triggerKind":1}}}
[Debug] <--2-- {"id":4,"jsonrpc":"2.0","result":{"isIncomplete":false,"items":[]}}
[Debug] ---> {"jsonrpc":"2.0","method":"textDocument/didChange","params":{"textDocument":{"uri":"file://pact/test.pact","version":9},"contentChanges":[{"range":{"start":{"line":0,"character":7},"end":{"line":0,"character":7}},"rangeLength":0,"text":" "}]}}
[Debug] ---> {"jsonrpc":"2.0","id":5,"method":"textDocument/hover","params":{"textDocument":{"uri":"file://pact/test.pact"},"position":{"line":0,"character":4}}}
[Debug] <--2-- {"id":5,"jsonrpc":"2.0","result":null}

@trendzetter that is very true. The LSP server uses the pact executable to get a list of natives (and documentation).
The ones you mentioned aren't part of it. In the long-run we are working on a more enhanced LSP server, including jump to definition etc.


botservice 0.4.3 not available with cli version 2.0.53

Tool
Name: [Msbot|Ludown|LUIS|QnAMaker|Chatdown|Dispatch|LuisGen]
Version: tool version
OS: os version
Describe the bug
A clear and concise description of what the bug is.
To Reproduce
Steps to reproduce the behavior:

Install CLI 2.0.53
az extension add --name botservice
Version of botservice installed is 0.4.1 - but running msbot complains that it needs 0.4.3

Expected behavior
0.4.3 should be installed according to the docs.
[bug]

Hi @garypretty, can you try the daily build (4.3.2-123) which can be found on MyGet?
To download it, you'll first need to change your npm registry to point to our MyGet gallery via this command
npm config set registry https://botbuilder.myget.org/F/botbuilder-tools-daily/npm/

Then install msbot via npm i msbot for a local install or npm i -g msbot. To reset your registry back to npmjs.org, you'll need to use the following command
npm config set registry https://registry.npmjs.org/

Closing as this has been addressed with the latest public release of msbot, version 4.3.2. This version of msbot does not use the botservice extension, so you are not required to call az extension add -n botservice.
If you still run into this issue, please @mention me in this issue or open up a new issue.


loading pretrained BasicVSR++

Hi @ckkelvinchan
I want to use BasicVSR++ in EDVR old codes as model (I do not want to use mmediting codes at this step)
I initiated BasicVSR++ model:
from mmedit.models.backbones.sr_backbones.basicvsr_pp import BasicVSRPlusPlus
model = BasicVSRPlusPlus(mid_channels=64, num_blocks= 7, max_residue_magnitude= 10, is_low_res_input= True, spynet_pretrained =".../mmediting/pretrained/spynet_20210409-c6c1bd09.pth", cpu_cache_length= 100)
How can I properly load the pretrained model into it to avoid getting Unexpected key(s) in state_dict: "meta", "state_dict" error?
Thank you for your help in advance.
Nasrin

Maybe you can format the struct of the checkpoint file.

Or only load state_dict from the pre-trained checkpoint file.
By
torch.load('FILE_PATH')['state_dict']

Closing due to inactivity, please reopen if there are any further problems.


Update logic-apps-securing-a-logic-app.md

AAD was incorrectly renamed to Entra ID while the user interface itself still uses the wording AAD. Reverting it back so it matches the end user experience.

@ecfan
Can you review the proposed changes?
When the changes are ready for publication, add a #sign-off comment to signal that the PR is ready for the review team to merge.
#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

@KoenZomers: Thanks for your contribution. UX and docs are being updated asynchronously by various teams. They will eventually be synchronized.
#please-close


How to tail remote log file?

How do I setup ssh to tail a remote log file?

Hi,
There are several ways of configuration.
Please refer to the page 6 of the user manual for SSH:
https://github.com/pschweitz/insidelog/blob/master/UserManual.pdf
Otherwise to tail remote files located on a Windows server I recommend to open a read only shared drive, then to tail them like local files.
Thanks for using in'side log

Is this the right way of ssh string at right place? I tried multiple ways, did not go thru. Can you help me with this....
ssh://@:/

Yes it is like the connection string you provided.
Please make sure the server is running an ssh server (sshd), and accepting login with the user you want to (root is not authorized by default on many distributions).
Finally check on the server side, the log files of the ssh server to identify a potential issue.
Thanks.


Create a comprehensive .gitignore

Is your feature request related to a problem? Please describe.
We want to prevent unwanted files from being pushed to GitHub codebases
Describe the solution you'd like
A comprehensive .gitignore file would prevent contributors from pushing unnecessary files
Additional context
Documentation

[ ] https://git-scm.com/docs/gitignore
[ ] https://docs.github.com/en/get-started/getting-started-with-git/ignoring-files
[ ] https://www.atlassian.com/git/tutorials/saving-changes/gitignore

Expo generates a .gitignore file for js


Adjusted dev.Dockerfile to run make web-build properly

Updated dev image to have a later version of nodejs in order to run make web-build properly

Do we also want to explicitly say which node version we are using as the engine? Something like the following in the package.json @CannonLock
{
    "engines": {
        "node" : 18
    }
}


Added brazilian banks and improvements in pt_BR docs

Added brazilian banks, using febraban list (brazilian banks federation). Improvements in pt_BR functions documentation, to show all available options and expected results.

No news, closing


Update Kokkos to 3.5.00

No objections, of course, but out of curiosity what improvements does the new version bring ?

Changelog can be found from https://github.com/kokkos/kokkos/blob/master/CHANGELOG.md#3500-2021-10-19
Of immediate interest are portable API for creating multiple execution space objects (~ CUDA streams), and Serial backend becoming thread safe (but simply protected with a mutex so not efficient); latter means that kokkos can be run with more than 1 threads, even if the throughput won't scale. They also added optional support for cudaMallocAsync()


chore: fix some comments

Related Github tickets

a list of github issues that are relevant for this PR

Background
fix some comments
Testing completed

[ ] test coverage exists or has been added/updated
[ ] tested in a private testnet

Breaking changes

[ ] I have checked my code for breaking changes
[ ] If there are breaking changes, there is a supporting migration.

Thanks for the kind changes. The bad grammar keeps everyone on their toes!


Grant dart-internal access to gs://fuchsia-artifacts-release

AccessDeniedException: 403<EMAIL_ADDRESS>does not have storage.objects.list access to the Google Cloud Storage bucket. Permission 'storage.objects.list' denied on resource (or it may not exist).

See https://ci.chromium.org/ui/p/dart-internal/builders/flutter/Linux engine_release_builder/774/overview as an example.
While these artifacts don't ship to beta|stable, we do support them in Google's CP process.

There's a tracking bug in b/316178512 to get the ACLs enabled.

Verified in https://ci.chromium.org/ui/p/dart-internal/builders/flutter/Linux Production Engine Drone/29617/overview


actions/cache: Stop caching .cache/pre-commit

Experiment: Will this fix the intermittent test failures?

This just gives us a different intermittent error.

We live well in a cashless society!


#5: Cadence Scenario: Final touches

TEST CASES: Check marks indicate that the test case is coded, not that everything actually works.

[x] Domain management
[ ] Workflow tests:

[x] Basic workflow by type
[x] Workflow calls activity by type
[x] Workflow calls local activity by type
[x] Workflow calls child workflow by type
[x] Basic workflow by name
[x] Workflow calls activity by name
[x] Workflow calls child workflow by name
[x] GetValueAsync()

[x] Fixed values
[x] Mutable values

[x] Parallel child workflows
[x] Workflow cancels child workflow
[x] Workflow cancels activity
[x] GetWorkflowStateAsync()
[x] GetWorkflowResultAsync()
[x] CancelWorkflowAsync()
[x] TerminateWorkflowAsync()
[x] SignalWorkflowAsync()
[x] QueryWorkflowAsync()
[x] Workflow Properties:

[x] Versioning: Version and OriginalVersion
[x] Domain
[x] WorkflowId
[x] RunId
[x] WorkflowTypeName
[x] TaskList

[x] CronSchedule:

[x] HasPreviousResult
[x] GetPreviousResult

[ ] DisconnectContextAsync() - Let's hold off on this until we look at the Java API
[x] UtcNowAsync()
[x] SleepAsync()
[x] SignalChildWorkflowAsync()
[x] CancelChildWorkflow()
[x] RestartAsync()
[x] SleepUntilUtcAsync()
[ ] QueryChildWorkflowAsync() - Do we need to add this?
[ ] TerminateChildWorkflow() - Do we need to add this?
[x] CallWorkflowAsync() - Nice way to execute and wait for an external workflow
[x] AutoRegisterWorkflows() - Registers tagged workflows in assembly
[x] AutoRegisterActivities() - Registers tagged workflows in assembly
[x] Non-default task list
[x] GetVersion()

[ ] Activity

[ ] Activity cancellation (via worker stop)
[ ] Activity cancellation (via parent workflow cancellation or termination)
[x] Activity Info properties:

[x] TaskToken
[x] WorkflowTypeName
[x] WorkflowDomain
[x] WorkflowRun
[x] ActivityId
[x] ActivityTypeName
[x] TaskList
[x] HeartbeatTimeout
[x] ScheduledTimeUtc
[x] StartedTimeUtc
[x] DeadlineTimeUtc
[x] Attempt

[x] SendHeartbeatAsync()
[x] HasLastHeartbeatDetailsAsync()
[x] GetLastHeartbeatDetailsAsync()
[x] CompleteActivityAsync()
[x] SendActivityHeartbeat()

[x] Explicit test using multiple clients

SPECIFICATION IN PROGRESS

[ ] CadenceClient should read lines from the STDOUT/STDERR from the cadence-proxy instances it instantiates, normalize this and log this to the .NET logger.

More operations:

[ ] DescribeWorkflowExecution()
[ ] DescribeTaskList()
[ ] GetWorkflowHistory()
[ ] ListClosedWorkflow()
[ ] ListOpenWorkflow()
[ ] CountWorkflow()
[ ] Activity Sessions

Questions:

[ ] Do we want to support the GetVersion() semantics described here or stick with our Version and OriginalVersion properties?

[x] We're implementing support for MutableSideEffect() but not SideEffect().  I think this makes sense, but we should do a final review to be sure.

[x] GetWorkerStopChannel(): Do we need to do anything special with this channel.
I believe this relates only to activities (not workflows).  The problem this is solving is that unlike workflows, activities will run to completion even after being cancelled or terminated once scheduled and started on a worker.  The idea is that Cadence will close this channel when the activity worker is being stopped as a signal to the activity that it should terminate.  I'll define a new message the cadence-proxy can send the cadence-client when this happens and then I'll cancel a new Activity.CancellationToken property that application activities can monitor.
Here's some more information.

[x] We're currently not supporting sending signals to child workflows due to having no place to track the ChildWorkflowFuture instances.  We' probably going to need to add this.

[ ] Implement cancellation.  I've added the ProxyRequest.IsCancellable property so it will be available for all requests.  This will be passed as true when the client application wishes to cancel an operation in progress.  cadence-proxy should be able to handle this in a general way.  Here's what you'll do:

[x] You'll need a global table that tracks outstanding requests the client has submitted to the proxy.  This will be keyed by request ID and should have a structure that includes a cancellation function.

[ ] For each received request, check the IsCancellable property.  If this is false, then proceed normally, but if this is true then you'll need to:

Create a cancellation function.
Add a record to the new outstanding requests table with the cancellation function.
Use WithCancel() to create a new context using the new cancellation function.
Perform the operation using the new context.
When the operation completes (successfully or not) remove the record from the outstanding requests table.

[ ] The proxy will receive a CancelRequest message when the workflow application wishes to cancel an operation.  Here's how you'll handle this:

Use the CancelRequest.TargetRequestId property to lookup the pending request.  If this is not present, then simply send a CancelReply (with no error).
Otherwise, call the cancellation function in the record, remove the record, and send a CancelReply.

[x] It looks like Cadence can wait on multiple futures, like closing a channel, waiting on a timer, waiting on an activity, etc.  .NET apps can accomplish the same thing using usual Task coordination mechanisms.

I'm going to go ahead and close this because we're refactoring to look like the Java API.  This is now covered by: #580


Setup repository for additional testing

Move all code except for main code into pkg directory.
That should adding additional code (i.e. tests) easier.
Related ticket https://issues.redhat.com/browse/APPSRE-6240

Test by running locally against one of our AWS accounts.


Scaling does not match HNN (original)

As per @rythorpe there should be an upward deflection after the proximal input. See here:
https://github.com/jasmainak/mne-neuron/pull/35#discussion_r282478290

actually I take this back, it looks good to me. What do you say @rythorpe. See here: https://jasmainak.github.io/mne-neuron/auto_examples/plot_simulate_somato.html#sphx-glr-auto-examples-plot-simulate-somato-py

What changed to produce this? The simulated waveform looks good, but the scaling still seems a bit off.

nothing really. If I use the parameters you sent me, we get this. The problem arose when I tried to use the "diff" -- so maybe not all parameters were updated.
okay let me rename the issue to reflect that the scaling is off. Personally I think the right way to fix these things is with tests rather than trying to figure out what is different.
There are no tests in HNN, so it is really hard to attest a "correctness" to it. Of course, you have sanity checks but it would be hard to do software development without more solid testing.

Implementing some formal tests would be good. Let's also keep dialoguing (maybe at a different time and thread) about how to implement "diff" files in a better way.

Hi folks. As I mentioned to @jasmainak today, I found a couple of things causing inconsistent results with HNN:

Refactoring: this fixed the first dipole deviation point:
8f43e18a8ba6a3107acb2ef5195c65aea9cc7039
@jasmainak Mainak, since you know the logic for the refactoring, can you attack this? Alternatively, since this code is technical debt and will be removed by netpyne integration, just ignore 1).
The one fixed in PR #47. Commit: 8dfc00a68d979e91e4dbed019d821471ab069055

*) This change makes me uneasy because I don't understand the logic. The connection seemed to be unique, so I'm not sure why it's "spurious"?
12c2808f3a5ddb5bc68a03a32b9913ae4e4493ad

Thanks for digging into this @blakecaldwell !
regarding 1. let's fix it if you've already put in the effort into it and the code exists (which seems to be the case). I'll add a whats_new.rst page tomorrow so we can start documenting bug fixes with proper credit. A proper netpyne integration will take some time, but this is already useful!

The connection seemed to be unique, so I'm not sure why it's "spurious"?

okay perhaps I need to explain myself a bit here. This commit is part of https://github.com/jasmainak/mne-neuron/pull/22 which was essentially fixing a bug introduced in the refactor of https://github.com/jasmainak/mne-neuron/commit/c76a27b767d8fdec9f4c1acd3197cac1e6f8e2b0. During the refactor I had mistakenly added a connection that should never have been there in the first place

Okay, that explanation helps. I wasn't sure if it was introduced by refactoring or was something that seemed ineffectual, so it was removed.
Can you fix the bug by reverting the commit or fixing the refactoring?

yep! I'm going to look into it :)


REQ：密码密文调用

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
在写sql建表语句中，可以通过引用方式调用密码吗？
希望秘密不是明文的。
Describe the solution you'd like
A clear and concise description of what you want to happen.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

-- creates a mysql cdc table source
CREATE TABLE mysql_binlog (
id INT NOT NULL,
name STRING,
description STRING,
weight DECIMAL(10,3)
) WITH (
'connector' = 'mysql-cdc',
'hostname' = 'localhost',
'port' = '3306',
'username' = 'flinkuser',
'password' = 'flinkpw',
'database-name' = 'inventory',
'table-name' = 'products'
);
-- read snapshot and binlog data from mysql, and do some transformation, and show on the client
SELECT id, UPPER(name), description, weight FROM mysql_binlog;

Could you use English for better communication? feel free to reopen once updated the description.


llama_new_context_with_model: flash_attn is not compatible with attn_soft_cap - forcing off

Device 0: NVIDIA GeForce RTX 4090, compute capability 8.9, VMM: yes
CUDA_VISIBLE_DEVICES=0 ./llama-server --host <IP_ADDRESS> --port 8008 -m /home/kemove/model/gemma-2-27b-it-Q5_K_S.gguf -ngl 99 -t 4 -np 4 -ns 4 -c 512 -fa

cool

How should I address this issue to be able to utilize flash_attn properly?

How is no one addressing this? LMStudio doesn't work for me at all anymore. It's bricked.

Feel free to work on it if you need it. We welcome contributions.


skeleton-esnext and jspm 0.17

The skeleton-esnext references jspm 0.17 and thus after jspm install a migration process is started.
During this process the config.js file is renamed to jspm.config.js with the bundle task and index.html still configured to expect config.js.
Furthermore according to the following warning issued after the migration process the reference to mainin aurelia-app="main" should be aurelia-app="main.js":
* js extensions are required for module imports not inside packages. Eg System.import('./test') will
       need to become System.import('./test.js').

When fixing that, it's missing app.js.. :smile:
This seems to be the case because defaultJSExtensions: true is missing from jspm.config.js after the migration.
Then, bootstrap css cannot be found:
system.src.js:5123 GET<EMAIL_ADDRESS>404 (Not Found)

That file is actually in<EMAIL_ADDRESS>Also, vscode complains about not being able to read aurelia-tools/.eslintrc like it's referenced in the local .eslintrc. Setting this entry to ./node_modules/aurelia-tools/.eslintrc.json fixes that.

An accidental incorrect dependency version slipped in! Sorry! We have made a new release with the correct version number.


Make readers usable outside of package modulereader

Exported readers can't be used outside of package because they require initialization of un-exported state.

Add constructors;
Refactoring of related tests.

Submission Checklist

[ ] Have you installed and run this change against pre-commit? (pre-commit install)
[ ] Are all tests passing? (make tests)
[ ] Have you written unit tests to cover this change?
[ ] Is unit test coverage still above 80%?
[ ] Have you updated all applicable documentation?
[ ] Have you followed the guidelines in our Contributing document?

Could you describe the functionality that this will enable?

It's just a fix for a bug "Exported but useless in deceiving way", it could have been also addressed by un-exporting readers, but I found them useful in (2).
I got burned by this while writing module interface inspector tool outside of this package. One could use GetModuleInfo, but it's

"less explicit" if intention to read local modules of particular kind only;
static with state, so it may have negative side effects.


Bundle: namespaceSelector

This PR adds a namespaceSelector option to the bundle.spec.target API.
The namespace selector currently only contains a MatchLabels map[string]string field.
If the label selector is empty, it matches on all Namespaces (the current behaviour).
Hopefully this is quite self explanatory slightly_smiling_face
A target ConfigMap will now receive an event with a relevant message when the target ConfigMap is not deleted because it is not owned by the trust operator.
/assign @munnerz
fixes https://github.com/cert-manager/trust/issues/1
Docs PR

@SgtCoDFish As discussed on the standup, I think I agree that syncing to all namespaces by default is probably not the way to go, and we should make the namespace selector a required field in future PRs.
/hold cancel

/test pull-cert-manager-trust-verify

/test pull-cert-manager-trust-smoke

As discussed on the standup...

Cool cool; I'll create issues now for that and for the root cert bundle thing we mentioned!

Hello @SgtCoDFish, a new version (0.1.2) of the Helm chart with support on CRD level was released, but the functionality in the application itself was not released. It there a plan to align this, please?

Hello @SgtCoDFish, a new version (0.1.2) of the Helm chart with support on CRD level was released, but the functionality in the application itself was not released. It there a plan to align this, please?

Hi! maybe @JoshVanL can help, I can't I'm afraid

@jaygridley I'll go ahead with a minor release with this feature now :slightly_smiling_face:


CF Pages Build Error: The path is missing the og-image payload.

Details
FIrst of all, thank you for making/maintaining this library :)
Problem
While generating the project locally works fine, building the project in the Cloudflare Pages and Github Action logs out the following error:
ERROR  [nuxt] [request error] [unhandled] [500]  (500 The path ... is missing the og-image payload. (/api/og-image-options?path=...))

While some of my project pages are built using Nuxt Content, I noticed that the above error message happens to all of my pages so this might not be the Nuxt Content issue..
Relevant config/code
app.vue

  // ...
  <SeoKit />
  <NuxtPage />

In all of my page files, added following:
// useHead is a little different for individual pages but it generally is like below:
useHead({
  meta: [
    { name: 'keywords', content: keywords },
  ],
})

// useServerSeoMeta is a little different for individual pages but it generally is like below:
useServerSeoMeta({
  title: () => page.value?.title,
  description: () => page.value?.description,
})

defineOgImageStatic({
  component: 'MyOgImage',
  title: <string literal for different pages>,
  description: '',
  background: '#27272a',
})

In components/islands/MyOgImage.vue:

<template>

          {{ title }}

          {{ description }}

</template>

In nuxt.config.ts:
runtimeConfig: {
    public: {
      siteUrl: '...',
      siteName: '...',
      siteDescription: '...',
      language: 'en',
    },
  },

What I tried

I tried npx playwright install && nuxt generate to see if the issue was caused by playwright but the problem still persisted.
I added the new experimentalRuntimeBrowser: true in my nuxt config, but it wasn't working.

Not sure why it works on local but fails in github action and cf pages...

Version 1.5.0 might work a little bit better with this. One thing to make sure of is that you are server-side rendering your pages

Hi @Zerro97
If you are still interested in this issue, please use  v2.0.0-beta.21, it is working with CloudFlare pages as far as I can tell.


Grabber doesn't recognize the size by one of the sources

Bug description
By the source rule34.paheal.net grabber doesn't recognize the size of the image
Steps to reproduce
Enable the source rule34.paheal.net
Search for a image
Open the image and you will see that grabber doesn't recognize the size
Expected behavior
It will show the size of the image
System information
Windows 10 with the latest nightly version

Indeed, it seems that not only Grabber fails to parse the image size from the page, it also doesn't properly update the detected size when the image is done loading.
Two bugs in one, so I just pushed two fixes 😄
Thanks for the heads-up 👍


hactool: init 1.3.2

Motivation for this change
Adds hactool
Things done

[X] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[X] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[X] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[X] Fits CONTRIBUTING.md.

Commit message is missing an at: hactool: init at 1.3.2

My bad, fixed.

Apologies for the messing around, thought that'd compile.
Anything blocking this from getting merged?


Automated email custom domain setup

Currently, the sender of all automated emails is a random email address (clothingloop7@gmail.com), replace it with the custom domain<EMAIL_ADDRESS>or<EMAIL_ADDRESS>

This is the sample email right?

Fixed the sender email address :)

Fixed the sender email address :)

Looking good! Thank you :)


How are the features created for the intent_sklearn classifier?

Hey,
i asked this now many times on gitter for spacy and rasa, too. But I have no answer yet to this simple question.
As far as I have understood, the only position where the features are created in the code for the spacy featurizers is the following:
def features_for_doc(doc):

    """Feature vector for a single document / sentence."""

    # type: Doc -> np.ndarray

    return doc.vector

So, this doc.vector is the only thing which is used then for intent classification? What ML-Algorithms are used then in spacy to create this array of numbers?

The doc vector is a trained embedding. There are different ways to train them and whcih one works best depends on the properties of the dataset (e.g. how many unique words). Common methods are word2vec, glove, fasttext. The vectors are fed into an SVM.

@tmbo Thank you! I was confused because I thought word vectosr should be continous and between 0 and 1...

@tmbo You said that there are different ways to train the doc vector, what way did rasa nul choose?

it depends which pipeline you use, spacy for example has GloVe vectors.


Result of subquery doesn't hit index on master query field

OrientDB Version, operating system, or hardware.

[x] v2.2.4

Operating System

[ ] Linux
[ ] MacOSX
[x] Windows
[ ] Other Unix
[ ] Other, name?

Expected behavior and actual behavior
Apologies if this is not the place for this question, not sure if this is a bug or not.
I have a ClassA with an NONUNIQUE - SBTREE index on field Id. When I perform the following query:
SELECT @rid.asString() as rid, Id as id, PrimaryName as name FROM ClassA
WHERE Id IN [100, 200, 300, 400]

I get the results back in few milliseconds and I can see that the index is used. No problem at all. However, If I do the following query:
SELECT @rid.asString() as rid, Id as id, PrimaryName as name FROM ClassA
WHERE Id IN (SELECT DISTINCT(in('edge_to_classA').Id) FROM ClassB WHERE (PrimaryName LUCENE 'Hello'))

The result of the subquery is Ids 100, 200, 300, 400, which then applied to the master query returns the same results as expected. However, it doesn't hit the index on the Id field in ClassA. As a result, query1 takes 11ms to run and query2 takes 500ms on a class with 50K vertices. Lucene index is used as expected.
Is there anything missing in order to hit the index? Is it a bug or intended behavior?
Thanks!

Hi @ismaelpernas
It is a known limitation of current SQL executor. We are completely re-writing it, so in v 3.0 it will be supported, but for now I think you have to deal with it.
As a temporary work around, you can use a BATCH script like following:
LET $a = (SELECT DISTINCT(in('edge_to_classA').Id) FROM ClassB WHERE (PrimaryName LUCENE 'Hello'))
SELECT @rid.asString() as rid, Id as id, PrimaryName as name FROM ClassA WHERE Id IN $a

In this case the index will be used
Thanks
Luigi

In 3.0 this is already working.

Hello,
we are using the Document API in OrientDB version 2.2 and facing exactly the same problem as @ismaelpernas.
Switching to Orient 3 (beta) is a no go for us, since we are already using it in production.
Suppose we have a class Company and a class Employee and are interested in all Companies with at least one employee having a name from an arbitrary list. Employees are defined as LINKEDLISTs in our Company schema. Our query would look smth like this:
select from Company where employees in (select from Employee where name in ["John", "Paul"])
Currently we have defined the following two indexes:
Company.employees (index on the employee links (their @rid)) -> dictionary hash index and Employee.name -> notunique index
When executing the above query with explain we see that only the second index Employee.name is used, since we did not define the above indexes as a compound index across the two classes Employee and Company.
The batch approach worked for us, however when applying it we are already hitting a second big limitation. Command scripts seem to only work synchronously,  meaning also that we can only get the results as a list all at once and not one by one in a lazy fashion, which in our case is a NO GO due to the memory overhead.
A naive workaround we tried is as follows:
The approach of defining a custom OCommandAsyncScript did not work unfortunately. When debugging the OStorageRemote class of Orient it seems that no partial results could be read, Here the respective extract from the source code:
 public class OCommandAsyncScript extends OCommandScript implements OCommandRequestAsynch{

            public OCommandAsyncScript(String sql, String cmd) {
                super(sql, cmd);
            }

            @Override
            public boolean isAsynchronous() {
                return true;
            }
        }

        private void containsAtLeastOne(final @Nonnull ODatabaseDocumentTx documentTx,
                                            final @Nonnull Consumer<Company> matchConsumer,
                                            final @Nonnull String queryText
                                           ) throws TimeoutException {

                String cmd = "begin\n";
                cmd += "let a = select from Employee where name " + queryText + "\n";
                cmd += "let b = select from Company where employees in $a\n";
                cmd += "COMMIT\n";
                cmd += "return $b";
                final OCommandHandler resultListener = new OCommandHandler(documentTx, (document -> {
                    final Company companies = document2model(document);
                    matchConsumer.accept(company);
                }));

                OCommandAsyncScript request =  new OCommandAsyncScript("sql", cmd);
                request.setResultListener(resultListener);
                documentTx.command(request).execute();
...
            }

    public class OCommandHandler implements OCommandResultListener {
     private final ODatabaseDocumentTx database;
        private final Consumer<ODocument> matchConsumer;

        public OCommandHandler(
                final @Nonnull ODatabaseDocumentTx database,
                final @Nonnull Consumer<ODocument> matchConsumer
        ) {
            this.database = database;
            this.matchConsumer = matchConsumer;
        }

        @Override
        public boolean result(Object iRecord) {
            if (iRecord != null) {

                final ODocument document = (ODocument) iRecord;

                /*
                 Result handler might be asynchronous, if document is loaded in a lazy mode,
                 database will be queries to fetch various fields. Need to activate it on the current thread.
                 */
                database.activateOnCurrentThread();

                matchConsumer.accept(document);
            }
            return true;
        }
        .......................
    }