https://docs.google.com/document/d/1di9dyUM0Ipr_InE6k-wT6mS3nGTNHxCz/edit?usp=drivesdk&ouid=112256106480073136838&rtpof=true&sd=true&disco=AAAAN7oazlA

Pre-requisites

[ ] Prior to submitting documentation, please apply to join the GitHub Technology Partner Program: partner.github.com/apply. Please feel free to proceed once your application is approved.

What information would you like to add to docs.github.com?

Tasks
Please be sure to complete each of the following:
Third-party product documentation:

[ ] MUST follow our general contributing guidelines for voice and markup format.
[ ] MUST emphasize how the third-party product works with GitHub.
[ ] MUST be written in Markdown format, using one of the templates provided
[ ] MUST include the name and URL of the GitHub technology partner responsible for maintenance of the documentation being contributed. This should be added via the contributor.name and contributor.URL properties in the template's YAML frontmatter.
[ ] MUST be proposed via a pull request to this repo following the GitHub Flow.
[ ] MUST be located in the root of the content folder. Your filename MUST match the GitHub technology partner name, and use the .md file extension.

The Pull Request:

[ ] MUST reference this issue, e.g. via closes #<this issue number>
[ ] MUST pass the automated CI checks
[ ] MUST include links to supporting material demonstrating the functionality being documented (this can be a link to a public GitHub repo, or a video / screencast walkthrough)

Once all tasks are completed, please mention @github/docs-content for next steps.
/cc @github/partner-engineering for :eyes:

https://docs.google.com/document/d/1di9dyUM0Ipr_InE6k-wT6mS3nGTNHxCz/edit?usp=drivesdk&ouid=112256106480073136838&rtpof=true&sd=true&disco=AAAAN7oazlA


[timeline] fix bulk download formatting

there is a display-flex on #main-pane which caused the weird column layout

sure, np!


依存句法分析加载模型出错

Describe the bug
从hanlp.pretrained.dep.CTB7_BIAFFINE_DEP_ZH加载依存分析模型出错
Code to reproduce the issue
import hanlp
hanlp.load(hanlp.pretrained.dep.CTB7_BIAFFINE_DEP_ZH)

Describe the current behavior
从hanlp.pretrained.dep.CTB7_BIAFFINE_DEP_ZH加载依存分析模型出错
Expected behavior
成功加载
System information

OS Platform and Distribution (e.g., Linux Ubuntu 16.04):
Python version: Linux xxx 4.15.0-72-generic #81-Ubuntu SMP Tue Nov 26 12:20:02 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
HanLP version: 2.0.0a39

Other info / logs
Failed to load https://file.hankcs.com/hanlp/dep/biaffine_ctb7_20200109_022431.zip. See stack trace below
Traceback (most recent call last):
  File "/data/humeng/projs/extract_spo/.venv/lib/python3.7/site-packages/hanlp/utils/component_util.py", line 48, in load_from_meta_file
    obj.load(save_dir, **load_kwargs)
  File "/data/humeng/projs/extract_spo/.venv/lib/python3.7/site-packages/hanlp/common/component.py", line 244, in load
    self.build(**merge_dict(self.config, training=False, logger=logger, **kwargs, overwrite=True, inplace=True))
  File "/data/humeng/projs/extract_spo/.venv/lib/python3.7/site-packages/hanlp/common/component.py", line 269, in build
    self.model(sample_inputs)
  File "/data/humeng/projs/extract_spo/.venv/lib/python3.7/site-packages/tensorflow_core/python/keras/engine/base_layer.py", line 822, in __call__
    outputs = self.call(cast_inputs, *args, **kwargs)
  File "/data/humeng/projs/extract_spo/.venv/lib/python3.7/site-packages/hanlp/components/parsers/biaffine/model.py", line 92, in call
    x = self.lstm(embed, mask=mask)
  File "/data/humeng/projs/extract_spo/.venv/lib/python3.7/site-packages/tensorflow_core/python/keras/engine/base_layer.py", line 822, in __call__
    outputs = self.call(cast_inputs, *args, **kwargs)
  File "/data/humeng/projs/extract_spo/.venv/lib/python3.7/site-packages/tensorflow_core/python/keras/engine/sequential.py", line 281, in call
    outputs = layer(inputs, **kwargs)
  File "/data/humeng/projs/extract_spo/.venv/lib/python3.7/site-packages/tensorflow_core/python/keras/layers/wrappers.py", line 543, in __call__
    return super(Bidirectional, self).__call__(inputs, **kwargs)
  File "/data/humeng/projs/extract_spo/.venv/lib/python3.7/site-packages/tensorflow_core/python/keras/engine/base_layer.py", line 822, in __call__
    outputs = self.call(cast_inputs, *args, **kwargs)
  File "/data/humeng/projs/extract_spo/.venv/lib/python3.7/site-packages/tensorflow_core/python/keras/layers/wrappers.py", line 657, in call
    initial_state=forward_state, **kwargs)
  File "/data/humeng/projs/extract_spo/.venv/lib/python3.7/site-packages/tensorflow_core/python/keras/layers/recurrent.py", line 644, in __call__
    return super(RNN, self).__call__(inputs, **kwargs)
  File "/data/humeng/projs/extract_spo/.venv/lib/python3.7/site-packages/tensorflow_core/python/keras/engine/base_layer.py", line 822, in __call__
    outputs = self.call(cast_inputs, *args, **kwargs)
  File "/data/humeng/projs/extract_spo/.venv/lib/python3.7/site-packages/tensorflow_core/python/keras/layers/recurrent_v2.py", line 1144, in call
    **cudnn_lstm_kwargs)
  File "/data/humeng/projs/extract_spo/.venv/lib/python3.7/site-packages/tensorflow_core/python/keras/layers/recurrent_v2.py", line 1362, in cudnn_lstm
    time_major=time_major)
  File "/data/humeng/projs/extract_spo/.venv/lib/python3.7/site-packages/tensorflow_core/python/ops/gen_cudnn_rnn_ops.py", line 1906, in cudnn_rnnv3
    ctx=_ctx)
  File "/data/humeng/projs/extract_spo/.venv/lib/python3.7/site-packages/tensorflow_core/python/ops/gen_cudnn_rnn_ops.py", line 2002, in cudnn_rnnv3_eager_fallback
    attrs=_attrs, ctx=ctx, name=name)
  File "/data/humeng/projs/extract_spo/.venv/lib/python3.7/site-packages/tensorflow_core/python/eager/execute.py", line 67, in quick_execute
    six.raise_from(core._status_to_exception(e.code, message), None)
  File "<string>", line 3, in raise_from
tensorflow.python.framework.errors_impl.UnknownError: Fail to find the dnn implementation. [Op:CudnnRNNV3]
https://file.hankcs.com/hanlp/dep/biaffine_ctb7_20200109_022431.zip was created with hanlp-2.0.0, while you are running 2.0.0-alpha.39. Try to upgrade hanlp with
pip install --upgrade hanlp
If the problem persists, please submit an issue to https://github.com/hankcs/HanLP/issues .

[x] I've completed this form and searched the web for solutions.

似乎不是hanlp的问题，是tf的问题，我将 meta.json 中的hanlp_version改成了当前版本，关于hanlp的报错没了，似乎只是tf的问题.

这样解决了
'''
import tensorflow as tf
gpus = tf.config.experimental.list_physical_devices('GPU')
print(gpus)
for gpu in gpus:
tf.config.experimental.set_memory_growth(gpu, True)
'''

再次遇到这个问题 求详解怎么解决！


How to customize which characters are considered higher in the alphabet than others?

I don't fully understand the collation rules, but all I know is the following blocks would be sorted like this:
variable "grafana_address" {
  type = string
}
variable "grafana_password" {
  type = string
}
variable "grafana-count" {
  type = number
}
variable "grafana-username" {
  type = string
}
variable "grafana" {
  type = bool
}

But I'd like them to be sorted like this:
variable "grafana" {
  type = bool
}
variable "grafana-count" {
  type = number
}
variable "grafana-username" {
  type = string
}
variable "grafana_address" {
  type = string
}
variable "grafana_password" {
  type = string
}

So essentially the _ should be considered less far down the alphabet than the letters, and the - should be considered higher up the alphabet than _. Are these types of customizations possible?

Yes, that is possible through the exteded collatorOptions as described in the Extension Settings (though admittedly not very clearly):

collatorOptions: Collator options for sorting. See https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/Intl/Collator/Collator for more information

Default:{
  "numeric": true,
  "caseFirst": "false",
  "sensitivity": "base"
}

In addition to the default JavaScript Collator options, the following properties can be supplied

locales: A BCP 47 language tag, or an comma separated array of such strings.
customSortOrder: Custom Sort order in the form of a list of characters

This means, in order to sort _ before -, it should be enough to add the following to your settings:
{
    "numeric": true,
    "caseFirst": "false",
    "sensitivity": "base",
    "customSortOrder": "_-"
}

If that doesn't work, let me know :)

@1nVitr0 That still doesn't seem to work. I put those settings into my VS Code, and then uninstalled the extension and reinstalled it.

Thank you. This seems to work brilliantly.
The one thing I did have to add was the alphabet. So my final custom order is this (I also set caseFirst to be upper, but that was my decision outside of this):
"blocksort.collatorOptions": {
  "numeric": true,
  "caseFirst": "upper",
  "sensitivity": "base",
  "customSortOrder": "abcdefghijklmnopqrstuvwxyz\"-_"
},

But all of this does exactly what I want it to. Thank you so much for the guidance and quick fix!
For more info as to why I added the alphabet...
For some reason, the " part isn't behaving how I'd expect.
Here's an example where it's not working:
# Actual
variable "grafana" {
  type = bool
}
variable "grafana_password" {
  type = string
}
variable "name" {
  type = string
}
variable "helm_chart_version" {
  type = string
}

# Expected
variable "grafana" {
  type = bool
}
variable "grafana_password" {
  type = string
}
variable "helm_chart_version" {
  type = string
}
variable "name" {
  type = string
}

And an example where it is working:
variable "grafana" {
  type = bool
}
variable "grafana-count" {
  type = number
}
variable "grafana-username" {
  type = string
}
variable "grafana_address" {
  type = string
}
variable "grafana_password" {
  type = string
}
variable "name" {
  type = string
}

I've narrowed down to something about the character count. Because name and helm are the same amount of characters, it's reading "name" to come before "helm_release", even though h comes before n, simply because it's reading " to come before _. But if I add the alphabet at the beginning, then it properly recognizes that h should come before n.

That makes total sense, thanks for the detailed info! There is already an  inbuilt option for collators to ignore punctuation, I might just extend that to quotes and brackets by default. This is probably a frequent use case for custom sort order.


fix(cli): AGE-392 & AGE-373 Use actual span status & Keep trace upon error

Resolving AGE-392, still requires AGE-410 @bekossy

Please make sure to use black with the right version (can be found in the github action)

Published SDK alpha, now updating staging template
https://github.com/Agenta-AI/agenta-docker-templates/actions/runs/9860994372

See comments in original issue.

What do you mean ?

See comments in original issue.

What do you mean ?

https://linear.app/agenta/issue/AGE-373/tracing-breaks-when-the-code-fails-there-is-no-active-span-to-end#comment-61a8a51c

But I am testing now the other PR first as discussed

@mmabrouk -- this PR is no longer relevant.


This project no longer runs correctly

Describe the bug
When I start this project to demo its capabilities, it does not proxy the rendered markup into storybook.
I have the Django project running and the storybook running.
Environment

Mac Sonoma
Python 3.9.18
Steps to reproduce

(Write your steps here:)

Clone or download code for project
python -m venv --prompt sb .venv
source .venv/bin/activate
pip install -r requirements.txt
npm install
python manage.py runserver 0:8001
npm run start

Expected behavior

I expected to be able to navigate the Storybook and see the components
Actual behavior

I receive this error in Storybook Error occurred while trying to proxy: localhost:6006/pattern-library/api/v1/render-pattern

Hi @ay13, I’ve been through those exact steps and the project still runs the same as ever. Exact steps as yours. Thinking of possible issues, it could be the Node version you’re using? See https://github.com/nodejs/node/issues/40537
Django’s development server only serves on IPv4 I believe, while Node will be resolving localhost to an IPv6 address.
If this is the possible culprit, try on a recent Node version and see what happens? You can also export TEST_ORIGIN=http://<IP_ADDRESS>:8001 to force Node querying the IPv4 address.


Create Vite - Remix - "remix command not found"

Describe the bug

I create a new project with create vite
I choose React -> Remix
I install dependencies with NPM
when i run npm run dev, it shows: remix: command not found

Reproduction

Steps to reproduce
Run npm create vite@latest
Choose React and then Remix.
Try to start with npm run dev
System Info
System:
    OS: macOS 14.6.1
    CPU: (10) arm64 Apple M1 Pro
    Memory: 150.53 MB / 16.00 GB
    Shell: 5.9 - /bin/zsh
  Binaries:
    Node: 22.4.1 - /opt/homebrew/bin/node
    npm: 10.8.1 - /opt/homebrew/bin/npm
    pnpm: 9.2.0 - /opt/homebrew/bin/pnpm
    bun: 1.1.26 - /opt/homebrew/bin/bun
  Browsers:
    Chrome: 128.0.6613.120
    Safari: 17.6

Used Package Manager
npm
Logs
No response
Validations

[X] Follow our Code of Conduct
[X] Read the Contributing Guidelines.
[X] Read the docs.
[X] Check that there isn't already an issue that reports the same bug to avoid creating a duplicate.
[X] Make sure this is a Vite issue and not a framework-specific issue. For example, if it's a Vue SFC related bug, it should likely be reported to vuejs/core instead.
[X] Check that this is a concrete bug. For Q&A open a GitHub Discussion or join our Discord Chat Server.
[X] The provided reproduction is a minimal reproducible example of the bug.

I was not able to reproduce. Maybe there was an error during npm i running inside create-remix. Does it reproduce after clearing npm cache?

I also managed to run the repro steps without any error - with node 20 / npm 10
@robertotcestari , what node/npm version did you use?

Sorry guys, clearing the npm cache solved for me. Super weird! Thanks :)


Add Roxanna to list of frameworks

Thank you!
Side-note: You might consider to rename the repo to all lowercase, since it is also used as the import path

That's a good suggestion. I'll change it. Thanks!


[stable/concourse] Add ability to set annotations on web service.

/ok-to-test

/assign linki
(as per @k8s-ci-robot)

/lgtm


Add reference golang client

Closes #1

No tests? :(

Also, I would prefer it be in a directory named /go instead of /golang

The Client struct and its code should be put in a different non-main package to allow others to import it.

No tests? :(

Yep, more precisely:
No time, no tests
Another race of conditions
The sea of the simulation
Keep your failures in memory
I fail it, especially tonight
(With apologies to Franco Battiato)
Please check again and let me know if you like what you see. (What server should I use for integration testing? I recall some mlab4s already run ndt7, but I'd like to ask mlab-ns for geo options.)

(Oh, I don't have enough permissions to add travis and coveralls, otherwise I'd done it myself.)

It is now enabled on travis, so all you have to do is add a .travis.yml file.

For your integration tests, I would encourage you to:

Only run them when -short is not passed to go test
Run them inside a docker container, and cause them to connect to a real ndt-server instance also running inside that container.
Cause them to connect to a local fake mlab-ns instance that returns localhost at the ndt7 URL either by overriding DNS settings or by making the name of the mlab-ns server a commandline parameter.

If you do these three things, then the integration tests will be the same for every client, regardless of implementation language.

If you add a .travis.yml file in the root of the repo, then I think Travis will start testing it.

Please test the error handling cases too. go test ./... -short -cover=1 should return 100% for the client library, and testing that no lines of main crash looks pretty easy as well (you get 100% coverage when it is trying to run in insecure mode and can't connect).

Here is a cool trick I learned:
If you create a file called client_test.go and use it to expose a new function UpdateDeps, then that new function will only be available to test code.
Then, in client.go you can have:
dialerDial := dialer.Dial

and in client_test.go you would have:
package client

func UpdateDeps(dial func (URL string, header http.Header)(websocketConn, *http.Response, error)) {
  dialerDial = dial
}

And then you can use UpdateDeps to avoid having to do all that dancing around setting up a new dependencies object, an approach which strikes me as kind of heavyweight.
Alternatively, you could create a subdirectory of ndt7 called fakeserver and then call fakeserver.Start() and have your client test against that server. Creating good fakes is the nice thing to do if you are creating a new service.

Superseded by #4

Closes because #4 is really more mature than this PR.


✨[FEATURE] Streamlit-based user interface for the Resume Analyzer

in #380 want to add a deployment with flask and streamlit
🌟 Feature Overview
Add a Streamlit-based user interface for the Resume Analyzer, enabling users to upload resumes and view analysis results in an interactive, web-based format. Integrate Streamlit with Flask to leverage Flask's backend capabilities and ensure easy deployment.
🤔 Why this feature?
This feature would improve user experience by providing a more accessible, interactive interface for uploading and analyzing resumes. By combining Streamlit with Flask, the system can support backend functionalities (e.g., complex processing tasks) while maintaining an intuitive front end, making it easier for non-technical users to engage with the application.
📝 Additional Details
Add any other details or suggestions.
screenshot

@suryanshsk assign me this issue


TD-291: Make some tests parallel

В construct_domain_fixture/0 все еще не обрезан жир.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 89.205%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
4074

Relevant Lines:
4567

💛  - Coveralls


Is it time to upgrade the KG2pre build system to Ubuntu 22.04?

The KG2pre build system was developed for (and, as emphasized about 10 times in the documentation, unapologeticly and explicitly tied to) Ubuntu 18.04. But Ubuntu 18.04, which came out in April 2018, is now almost five years old. Canonical has set the EOL for support for that release to be April 30, 2023, I think (see this page). Is it time to make the jump to Ubuntu 22.04?  It might all "just work", and if so, we'd just need to do a cut-and-paste on the documentation and upgrade the OS version in the build instances. Thoughts?

Also tagging @amykglen for her thoughts.

kg2erica.rtx.ai was created with Ubuntu 22.04. setup-kg2-build.sh failed on first go. Here's a snippet of the log:
Preparing to unpack .../00-libpython3.7-minimal_3.7.17-1+jammy1_amd64.deb ...^M
Unpacking libpython3.7-minimal:amd64 (3.7.17-1+jammy1) ...^M
Selecting previously unselected package python3.7-minimal.^M
Preparing to unpack .../01-python3.7-minimal_3.7.17-1+jammy1_amd64.deb ...^M
Unpacking python3.7-minimal (3.7.17-1+jammy1) ...^M
Selecting previously unselected package libexpat1-dev:amd64.^M
Preparing to unpack .../02-libexpat1-dev_2.4.7-1ubuntu0.2_amd64.deb ...^M
Unpacking libexpat1-dev:amd64 (2.4.7-1ubuntu0.2) ...^M
Selecting previously unselected package libpython3.7-stdlib:amd64.^M
Preparing to unpack .../03-libpython3.7-stdlib_3.7.17-1+jammy1_amd64.deb ...^M
Unpacking libpython3.7-stdlib:amd64 (3.7.17-1+jammy1) ...^M
Selecting previously unselected package libpython3.7:amd64.^M
Preparing to unpack .../04-libpython3.7_3.7.17-1+jammy1_amd64.deb ...^M
Unpacking libpython3.7:amd64 (3.7.17-1+jammy1) ...^M
Selecting previously unselected package libpython3.7-dev:amd64.^M
Preparing to unpack .../05-libpython3.7-dev_3.7.17-1+jammy1_amd64.deb ...^M
Unpacking libpython3.7-dev:amd64 (3.7.17-1+jammy1) ...^M
Selecting previously unselected package python3.7.^M
Preparing to unpack .../06-python3.7_3.7.17-1+jammy1_amd64.deb ...^M
Unpacking python3.7 (3.7.17-1+jammy1) ...^M
Selecting previously unselected package python3.7-dev.^M
Preparing to unpack .../07-python3.7-dev_3.7.17-1+jammy1_amd64.deb ...^M
Unpacking python3.7-dev (3.7.17-1+jammy1) ...^M
Selecting previously unselected package python3.7-lib2to3.^M
Preparing to unpack .../08-python3.7-lib2to3_3.7.17-1+jammy1_all.deb ...^M
Unpacking python3.7-lib2to3 (3.7.17-1+jammy1) ...^M
Selecting previously unselected package python3.7-distutils.^M
Preparing to unpack .../09-python3.7-distutils_3.7.17-1+jammy1_all.deb ...^M
Unpacking python3.7-distutils (3.7.17-1+jammy1) ...^M
Selecting previously unselected package python3.7-venv.^M
Preparing to unpack .../10-python3.7-venv_3.7.17-1+jammy1_amd64.deb ...^M
Unpacking python3.7-venv (3.7.17-1+jammy1) ...^M
Setting up libpython3.7-minimal:amd64 (3.7.17-1+jammy1) ...^M
Setting up libexpat1-dev:amd64 (2.4.7-1ubuntu0.2) ...^M
Setting up python3.7-minimal (3.7.17-1+jammy1) ...^M
Setting up python3.7-lib2to3 (3.7.17-1+jammy1) ...^M
Setting up libpython3.7-stdlib:amd64 (3.7.17-1+jammy1) ...^M
Setting up libpython3.7:amd64 (3.7.17-1+jammy1) ...^M
Setting up libpython3.7-dev:amd64 (3.7.17-1+jammy1) ...^M
Setting up python3.7-distutils (3.7.17-1+jammy1) ...^M
Setting up python3.7 (3.7.17-1+jammy1) ...^M
Setting up python3.7-venv (3.7.17-1+jammy1) ...^M
Setting up python3.7-dev (3.7.17-1+jammy1) ...^M
Processing triggers for man-db (2.10.2-1) ...^M
Processing triggers for mailcap (3.70+nmu1ubuntu1) ...^M
Get:1 http://us-west-2.ec2.archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-distutils all 3.10.6-1~22.04 [139 kB]
Fetched 139 kB in 0s (9465 kB/s)
Unrecognized python3 distutils .deb package filename; this is a bug in setup-python37-with-pip3-in-ubuntu.shinc

3e1cb8f addressed that issue. New error:
Collecting mypy>=0.0
  Downloading mypy-0.902-cp37-cp37m-manylinux2010_x86_64.whl (21.5 MB)
     ━━━━━━━╸                                 4.2/21.5 MB 17.2 MB/s eta 0:00:02
ERROR: Exception:
Traceback (most recent call last):
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_vendor/urllib3/response.py", line 438, in _error_catcher
    yield
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_vendor/urllib3/response.py", line 561, in read
    data = self._fp_read(amt) if not fp_closed else b""
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_vendor/urllib3/response.py", line 527, in _fp_read
    return self._fp.read(amt) if amt is not None else self._fp.read()
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_vendor/cachecontrol/filewrapper.py", line 90, in read
    data = self.__fp.read(amt)
  File "/usr/lib/python3.7/http/client.py", line 465, in read
    n = self.readinto(b)
  File "/usr/lib/python3.7/http/client.py", line 509, in readinto
    n = self.fp.readinto(b)
  File "/usr/lib/python3.7/socket.py", line 589, in readinto
    return self._sock.recv_into(b)
  File "/usr/lib/python3.7/ssl.py", line 1071, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/lib/python3.7/ssl.py", line 929, in read
    return self._sslobj.read(len, buffer)
socket.timeout: The read operation timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_internal/cli/base_command.py", line 160, in exc_logging_wrapper
    status = run_func(*args)
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_internal/cli/req_command.py", line 247, in wrapper
    return func(self, options, args)
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_internal/commands/install.py", line 420, in run
    reqs, check_supported_wheels=not options.target_dir
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_internal/resolution/resolvelib/resolver.py", line 93, in resolve
    collected.requirements, max_rounds=try_to_avoid_resolution_too_deep
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_vendor/resolvelib/resolvers.py", line 481, in resolve
    state = resolution.resolve(requirements, max_rounds=max_rounds)
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_vendor/resolvelib/resolvers.py", line 380, in resolve
    success = self._backtrack()
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_vendor/resolvelib/resolvers.py", line 320, in _backtrack
    success = _patch_criteria()
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_vendor/resolvelib/resolvers.py", line 309, in _patch_criteria
    if not candidates:
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_vendor/resolvelib/structs.py", line 151, in __bool__
    return bool(self._sequence)
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 155, in __bool__
    return any(self)
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 143, in <genexpr>
    return (c for c in iterator if id(c) not in self._incompatible_ids)
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_internal/resolution/resolvelib/found_candidates.py", line 47, in _iter_built
    candidate = func()
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_internal/resolution/resolvelib/factory.py", line 211, in _make_candidate_from_link
    version=version,
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 303, in __init__
    version=version,
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 162, in __init__
    self.dist = self._prepare()
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 231, in _prepare
    dist = self._prepare_distribution()
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_internal/resolution/resolvelib/candidates.py", line 308, in _prepare_distribution
    return preparer.prepare_linked_requirement(self._ireq, parallel_builds=True)
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_internal/operations/prepare.py", line 491, in prepare_linked_requirement
    return self._prepare_linked_requirement(req, parallel_builds)
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_internal/operations/prepare.py", line 542, in _prepare_linked_requirement
    hashes,
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_internal/operations/prepare.py", line 170, in unpack_url
    hashes=hashes,
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_internal/operations/prepare.py", line 107, in get_http_url
    from_path, content_type = download(link, temp_dir.path)
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_internal/network/download.py", line 147, in __call__
    for chunk in chunks:
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_internal/cli/progress_bars.py", line 53, in _rich_progress_bar
    for chunk in iterable:
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_internal/network/utils.py", line 87, in response_chunks
    decode_content=False,
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_vendor/urllib3/response.py", line 622, in stream
    data = self.read(amt=amt, decode_content=decode_content)
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_vendor/urllib3/response.py", line 587, in read
    raise IncompleteRead(self._fp_bytes_read, self.length_remaining)
  File "/usr/lib/python3.7/contextlib.py", line 130, in __exit__
    self.gen.throw(type, value, traceback)
  File "/home/ubuntu/kg2-venv/lib/python3.7/site-packages/pip/_vendor/urllib3/response.py", line 443, in _error_catcher
    raise ReadTimeoutError(self._pool, None, "Read timed out.")
pip._vendor.urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='files.pythonhosted.org', port=443): Read timed out.

[notice] A new release of pip is available: 23.0.1 -> 23.1.2
[notice] To update, run: python3.7 -m pip install --upgrade pip

That error didn't happen this time. New error:
[notice] A new release of pip is available: 23.0.1 -> 23.1.2
[notice] To update, run: python3.7 -m pip install --upgrade pip
+ curl -s -L -f -H 'Accept: application/zip' https://github.com/RTXteam/robot/releases/download/v1.3.0/robot.jar
+ curl -s https://raw.githubusercontent.com/RTXteam/robot/v1.3.0/bin/robot
+ chmod +x /home/ubuntu/kg2-build/robot
+ curl -s -L -f /home/ubuntu/kg2-build https://github.com/RTXteam/owltools/releases/download/v0.3.0/owltools
+ chmod +x /home/ubuntu/kg2-build/owltools
+ RAPTOR_NAME=raptor2-2.0.15
+ curl -s -L -f -o /home/ubuntu/kg2-build/raptor2-2.0.15.tar.gz http://download.librdf.org/source/raptor2-2.0.15.tar.gz
+ rm -r -f /home/ubuntu/kg2-build/raptor2-2.0.15
+ tar xzf /home/ubuntu/kg2-build/raptor2-2.0.15.tar.gz -C /home/ubuntu/kg2-build
+ cd /home/ubuntu/kg2-build/raptor2-2.0.15
+ ./autogen.sh --prefix=/usr/local
autogen.sh: Looking for programs: automake aclocal autoconf autoheader libtoolize gtkdocize
autogen.sh: automake program 'automake' V 011605 (min 011102) in /usr/bin
autogen.sh: aclocal program 'aclocal' V 011605 (min 011102) in /usr/bin
autogen.sh: autoconf program 'autoconf' V 027100 (min 026200) in /usr/bin
autogen.sh: autoheader program 'autoheader' V 027100 (min 026200) in /usr/bin
autogen.sh: libtoolize program 'libtoolize' V 020406 (min 020200) in /usr/bin
autogen.sh: gtkdocize program 'gtkdocize' V 013301 (min 010300) in /usr/bin
autogen.sh: Dependencies satisfied

autogen.sh: Processing directory .
autogen.sh: Running libtoolize --force --copy --automake
autogen.sh: Running gtkdocize --copy
autogen.sh: Running aclocal -Wall -I build
autogen.sh: Running autoheader
autogen.sh: Running automake --gnu --add-missing --force --copy -Wall
configure.ac:70: installing 'build/compile'
configure.ac:32: installing 'build/missing'
examples/Makefile.am: installing 'build/depcomp'
parallel-tests: installing 'build/test-driver'
autogen.sh: Running autoconf -Wall
configure.ac:86: warning: AC_PROG_LEX without either yywrap or noyywrap is obsolete
./lib/autoconf/programs.m4:716: _AC_PROG_LEX is expanded from...
./lib/autoconf/programs.m4:709: AC_PROG_LEX is expanded from...
configure.ac:86: the top level
configure.ac:295: warning: The macro `AC_HEADER_STDC' is obsolete.
configure.ac:295: You should run autoupdate.
./lib/autoconf/headers.m4:704: AC_HEADER_STDC is expanded from...
configure.ac:295: the top level
configure.ac:298: warning: The macro `AC_HEADER_TIME' is obsolete.
configure.ac:298: You should run autoupdate.
./lib/autoconf/headers.m4:743: AC_HEADER_TIME is expanded from...
configure.ac:298: the top level

autogen.sh: Running ./configure --enable-maintainer-mode --enable-gtk-doc --enable-silent-rules --prefix=/usr/local
checking for a BSD-compatible install... /usr/bin/install -c
checking whether build environment is sane... yes
checking for a race-free mkdir -p... /usr/bin/mkdir -p
checking for gawk... gawk
checking whether make sets $(MAKE)... no
checking whether make supports nested variables... no
checking whether to enable maintainer-specific portions of Makefiles... yes
checking build system type... x86_64-pc-linux-gnu
checking host system type... x86_64-pc-linux-gnu
checking whether build environment is sane... yes
checking whether make supports the include directive... no
checking for gcc... gcc
checking whether the C compiler works... yes
checking for C compiler default output file name... a.out
checking for suffix of executables...
checking whether we are cross compiling... no
checking for suffix of object files... o
checking whether the compiler supports GNU C... yes
checking whether gcc accepts -g... yes
checking for gcc option to enable C11 features... none needed
checking whether gcc understands -c and -o together... yes
checking dependency style of gcc... none
checking for ar... ar
checking the archiver (ar) interface... ar
checking for gcc... (cached) gcc
checking whether the compiler supports GNU C... (cached) yes
checking whether gcc accepts -g... (cached) yes
checking for gcc option to enable C11 features... (cached) none needed
checking whether gcc understands -c and -o together... (cached) yes
checking dependency style of gcc... (cached) none
checking whether gcc is clang... checking how to print strings... printf
checking for a sed that does not truncate output... /usr/bin/sed
checking for grep that handles long lines and -e... /usr/bin/grep
checking for egrep... /usr/bin/grep -E
checking for fgrep... /usr/bin/grep -F
checking for ld used by gcc... /usr/bin/ld
checking if the linker (/usr/bin/ld) is GNU ld... yes
checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B
checking the name lister (/usr/bin/nm -B) interface... BSD nm
checking whether ln -s works... yes
checking the maximum length of command line arguments... 1572864
checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop
checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop
checking for /usr/bin/ld option to reload object files... -r
checking for objdump... objdump
checking how to recognize dependent libraries... pass_all
checking for dlltool... no
checking how to associate runtime and link libraries... printf %s\n
checking for archiver @FILE support... @
checking for strip... strip
checking for ranlib... ranlib
checking command to parse /usr/bin/nm -B output from gcc object... ok
checking for sysroot... no
checking for a working dd... /usr/bin/dd
checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1
checking for mt... mt
checking if mt is a manifest tool... no
checking for stdio.h... yes
checking for stdlib.h... yes
checking for string.h... yes
checking for inttypes.h... yes
checking for stdint.h... yes
checking for strings.h... yes
checking for sys/stat.h... yes
checking for sys/types.h... yes
checking for unistd.h... yes
checking for sys/time.h... yes
checking for dlfcn.h... yes
checking for objdir... .libs
checking if gcc supports -fno-rtti -fno-exceptions... no
checking for gcc option to produce PIC... -fPIC -DPIC
checking if gcc PIC flag -fPIC -DPIC works... yes
checking if gcc static flag -static works... yes
checking if gcc supports -c -o file.o... yes
checking if gcc supports -c -o file.o... (cached) yes
checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes
checking whether -lc should be explicitly linked in... no
checking dynamic linker characteristics...   -Wall -Wc++-compat -Wextra -Wunused -Waggregate-return -Wbad-function-cast -Wcast-align -Wdeclaration-after-statement -Wdisabled-optimization -Wdiv-by-zero -Wendif-labels -Werror-implicit-function-declaration -Wfloat-equal -Wformat-security -Wframe-larger-than=4096 -Winit-self -Winline -Wmissing-declarations -Wmissing-format-attribute -Wmissing-noreturn -Wmissing-prototypes -Wnested-externs -Wold-style-definition -Wpacked -Wpointer-arith -Wredundant-decls -Wshadow -Wsign-compare -Wstrict-prototypes -Wswitch-enum -Wundef -Wunreachable-code -Wunsafe-loop-optimizations -Wwrite-strings -Wno-conversion -Wno-format-nonliteral -Wno-missing-field-initializers -Wno-sign-conversion -Wno-system-headers -Wno-unused-parameter -Wswitch-bool -Wlogical-not-parentheses -Wsizeof-array-argument -Wbool-compare -Wc90-c99-compat -Wc99-c11-compat
checking for egrep... (cached) /usr/bin/grep -E
checking for errno.h... yes
checking for fcntl.h... yes
checking for stdlib.h... (cached) yes
checking for stddef.h... yes
checking for unistd.h... (cached) yes
checking for string.h... (cached) yes
checking for limits.h... yes
checking for math.h... yes
checking for getopt.h... yes
checking for sys/stat.h... (cached) yes
checking for sys/param.h... yes
checking for sys/stat.h... (cached) yes
checking for sys/time.h... (cached) yes
checking for setjmp.h... yes
checking for stat... yes
checking for fetch.h... no
checking for an ANSI C-conforming const... yes
checking whether byte ordering is bigendian... no
checking for inline... inline
checking whether __FUNCTION__ is available... yes
checking for gettimeofday... yes
checking for getopt... yes
checking for getopt_long... yes
checking for stricmp... no
checking for strcasecmp... yes
checking for vsnprintf... yes
checking for isascii... yes
checking for setjmp... yes
checking for strtok_r... yes
checking for qsort_r... yes
checking for qsort_s... no
checking for vasprintf... yes
checking whether need to declare optind... no
checking whether vsnprintf has C99 compatible return value... yes
checking for special C compiler options needed for large files... no
checking for _FILE_OFFSET_BITS value needed for large files... no
checking for pkg-config... /usr/bin/pkg-config
checking pkg-config is at least version 0.9.0... yes
checking for xml2-config... xml2-config
checking for xmlCreatePushParserCtxt... yes
checking for libxml via xml2-config... yes - 2.9.13
checking for xslt-config... no
checking for curl-config... no
checking for LIBCURL... no
checking for libcurl via pkg-config... no - not found
checking for ICU... no
checking for xmlCreatePushParserCtxt... (cached) yes
checking libxml library... yes - version 2.9.13
checking for libxml/nanohttp.h... yes
checking for libxml/parser.h... yes
checking for libxml/hash.h... yes
checking for libxml/SAX2.h... yes
checking if libxml xmlEntity has name_length field... no
checking if libxml xmlEntity has etype field... yes
checking if libxml xmlSAXHandler has initialized field... yes
checking if libxml xmlSAXHandler has externalSubset field... yes
checking for xmlSAX2InternalSubset... yes
checking for xmlCtxtUseOptions... yes
checking if libxml has parser option XML_PARSE_NONET... yes
checking for libxml/HTMLparser.h... yes
checking if libxml has parser option HTML_PARSE_NONET... yes
checking for yajl installation... not found. Get it from http://lloyd.github.com/yajl/ and use --with-yajl=DIR if necessary to configure the installation directory.
checking GRDDL parser requirements... no - libxml2 and libxslt are both not available
checking JSON parser requirements... no - libyajl is not available
checking RDF parsers required... all
checking RDF serializers required... all
checking XML names version... 1.0
checking WWW libraries available...  libxml 2.9.13
checking WWW library to use... libxml 2.9.13 via xml2-config
checking NFC library to use... none
checking for libinn.h... no
checking date parsing source... raptor parsedate
checking using memory signing... no
checking whether make supports nested variables... (cached) no
checking for gtk-doc... yes
checking for gtkdoc-check... gtkdoc-check.test
checking for gtkdoc-check... /usr/bin/gtkdoc-check
checking for gtkdoc-rebase... /usr/bin/gtkdoc-rebase
checking for gtkdoc-mkpdf... /usr/bin/gtkdoc-mkpdf
checking whether to build gtk-doc documentation... yes
checking for GTKDOC_DEPS... no
checking that generated files are newer than configure... done
checking that generated files are newer than configure... done
configure: creating ./config.status
config.status: creating Makefile
config.status: creating raptor2.spec
config.status: creating raptor2.rdf
config.status: creating data/Makefile
config.status: creating docs/Makefile
config.status: creating docs/version.xml
config.status: creating examples/Makefile
config.status: creating scripts/Makefile
config.status: creating src/raptor2.h
config.status: creating src/Makefile
config.status: creating tests/Makefile
config.status: creating tests/feeds/Makefile
config.status: creating tests/grddl/Makefile
config.status: creating tests/ntriples/Makefile
config.status: creating tests/ntriples-2013/Makefile
config.status: creating tests/nquads-2013/Makefile
config.status: creating tests/rdfa/Makefile
config.status: creating tests/rdfa11/Makefile
config.status: creating tests/json/Makefile
config.status: creating tests/rdfxml/Makefile
config.status: creating tests/turtle/Makefile
config.status: creating tests/turtle-2013/Makefile
config.status: creating tests/trig/Makefile
config.status: creating utils/Makefile
config.status: creating librdfa/Makefile
config.status: creating raptor2.pc
config.status: creating src/raptor_config.h
config.status: executing depfiles commands
config.status: error: in `/home/ubuntu/kg2-build/raptor2-2.0.15':
config.status: error: Something went wrong bootstrapping makefile fragments
    for automatic dependency tracking.  If GNU make was not used, consider
    re-running the configure script with MAKE="gmake" (or whatever is
    necessary).  You can also try re-running configure with the
    '--disable-dependency-tracking' option to at least be able to build
    the package (albeit without support for automatic dependency tracking).
See `config.log' for more details

That error was solved by installing make. It must no longer come installed. New error: (note it doesn't error out but this doesn't seem good)
+ sudo -u postgres psql -c 'DO $do$ BEGIN IF NOT EXISTS ( SELECT FROM pg_catalog.pg_roles WHERE rolname = '\''ubuntu'\'' ) THEN CREATE ROLE ubuntu LOGIN PASSWORD null; END IF; END $do$;'
could not change directory to "/home/ubuntu/kg2-build/raptor2-2.0.16": Permission denied
DO
+ sudo -u postgres psql -c 'ALTER USER ubuntu WITH password null'
could not change directory to "/home/ubuntu/kg2-build/raptor2-2.0.16": Permission denied
ALTER ROLE

Here are the types of errors in DrugCentral's extract caused by problems with how postgres is installed:
ERROR:  syntax error at or near "LAMIVUDINE"
LINE 1: LAMIVUDINE TRIUMEQ PD VIIV HLTHCARE EQ 60MG BASE;
        ^
ERROR:  syntax error at or near "EQ"
LINE 1: EQ 5MG BASE;
        ^
ERROR:  trailing junk after numeric literal at or near "30M"
LINE 1: 30MG N 215413  2022-03-30 1 RX VIIV HEALTHCARE CO TABLET, FO...
        ^
ERROR:  syntax error at or near "DOLUTEGRAVIR"
LINE 1: DOLUTEGRAVIR SODIUM;
        ^
ERROR:  syntax error at or near "LAMIVUDINE"
LINE 1: LAMIVUDINE TRIUMEQ PD VIIV HLTHCARE EQ 60MG BASE;
        ^
ERROR:  syntax error at or near "EQ"
LINE 1: EQ 5MG BASE;
        ^
ERROR:  trailing junk after numeric literal at or near "30M"
LINE 1: 30MG N 215413  2022-03-30 1 RX VIIV HEALTHCARE CO TABLET, FO...
        ^
ERROR:  syntax error at or near "TADALAFIL"
LINE 1: TADALAFIL ENTADFI VERU 5MG;
        ^
ERROR:  trailing junk after numeric literal at or near "5M"
LINE 1: 5MG N 215423  2021-12-09 1 RX VERU INC CAPSULE ORAL 001
        ^
ERROR:  syntax error at or near "TADALAFIL"
LINE 1: TADALAFIL ENTADFI VERU 5MG;
        ^
ERROR:  trailing junk after numeric literal at or near "5M"
LINE 1: 5MG N 215423  2021-12-09 1 RX VERU INC CAPSULE ORAL 001

and
ERROR:  must be owner of schema public
ERROR:  permission denied for database drugcentral
ERROR:  must be owner of schema public
SET
SET
ERROR:  permission denied for schema public
LINE 1: CREATE TABLE public.act_table_full (
                     ^
ERROR:  relation "public.act_table_full" does not exist
ERROR:  permission denied for schema public
LINE 1: CREATE TABLE public.action_type (
                     ^
ERROR:  relation "public.action_type" does not exist
ERROR:  permission denied for schema public
ERROR:  relation "public.action_type_id_seq" does not exist
ERROR:  permission denied for schema public
LINE 1: CREATE TABLE public.active_ingredient (
                     ^
ERROR:  relation "public.active_ingredient" does not exist
ERROR:  permission denied for schema public
ERROR:  relation "public.active_ingredient_id_seq" does not exist
ERROR:  permission denied for schema public
LINE 1: CREATE TABLE public.approval (
                     ^
ERROR:  relation "public.approval" does not exist
ERROR:  permission denied for schema public
ERROR:  relation "public.approval_id_seq" does not exist
ERROR:  permission denied for schema public
LINE 1: CREATE TABLE public.approval_type (
                     ^
ERROR:  relation "public.approval_type" does not exist
ERROR:  permission denied for schema public
ERROR:  relation "public.approval_type_id_seq" does not exist
ERROR:  permission denied for schema public
LINE 1: CREATE TABLE public.atc (
                     ^
ERROR:  relation "public.atc" does not exist
ERROR:  permission denied for schema public
LINE 1: CREATE TABLE public.atc_ddd (
                     ^
ERROR:  relation "public.atc_ddd" does not exist
ERROR:  permission denied for schema public
ERROR:  relation "public.atc_ddd_id_seq" does not exist
ERROR:  permission denied for schema public
ERROR:  relation "public.atc_id_seq" does not exist

The issue with extract-drugcentral.sh has been resolved. It does not appear the problem was with Ubuntu 22.04.

I am closing this issue because this worked as intended in the KG2.8.4pre build.


Task 585 Preposition

Task 585_preposition_text_generation -> Given two words, you have to generate which preposition connects both.
Please review.

@kushalchawla, wondering if you can help review this PR?

Also, please suggest to me another task I can create from this dataset.
Thanks in advance!!

I am trying to better understand the task.
For this instance,
        {
            "input": "Word1: trader \n Word2: stock",
            "output": [
                "on"
            ]
        },

why is it "on" and not "of"? (i.e., trader of stock).

I am trying to better understand the task.
For this instance,
        {
            "input": "Word1: trader \n Word2: stock",
            "output": [
                "on"
            ]
        },

why is it "on" and not "of"? (i.e., trader of stock).

That's how it's present in the dataset. What do you suggest I do here?

Is there a way to filter out high-quality instances of the task?

Is there a way to filter out high-quality instances of the task?

I fixed that. Please review again.

Is there a way to filter out high-quality instances of the task?

I fixed that. Please review again.

Thanks! Could you briefly describe what kind of filtering did you apply?

Is there a way to filter out high-quality instances of the task?

I fixed that. Please review again.

Thanks! Could you briefly describe what kind of filtering did you apply?

There was multiple files and I only used the one which had better labels.

What do you mean by "better labels"?

What do you mean by "better labels"?

Like those files have more accurate preposition and other files have multiple words repeating not all prepositions were accurate.

What do you mean by "better labels"?

Like those files have more accurate preposition and other files have multiple words repeating not all prepositions were accurate.

I understand it this far! :) But how do you measure/estimate accuracy/quality? Did you use any quality/confidence scores associated or just spot-checking?

What do you mean by "better labels"?

Like those files have more accurate preposition and other files have multiple words repeating not all prepositions were accurate.

I understand it this far! :) But how do you measure/estimate "were accurate"? Did you use any quality/confidence scores in the dataset files or just spot-checking?

No, I just use my own intuition and checked it manually. There were 4 files and I choose the one which was containing more accurate prepositions.


Update 7-mocking-your-kafka-consumer.md

The class names where incomplete in the docs. Updated with the correc ones.

thanks for your PR, but this is not the correct fix here. I pushed an update for this page.


[BUG] Passing axis=None into argpartition causes TypeError

Describe the bug
The documentation states that the argpartition method's axis parameter can be None; this means that the function will partition the array as a flattened array.
Instead, when None is passed, a TypeError will be raised:
TypeError                                 Traceback (most recent call last)
Cell In[7], [line 2](vscode-notebook-cell:?execution_count=7&line=2)
      [1](vscode-notebook-cell:?execution_count=7&line=1) a = mx.ones((3,3))
----> [2](vscode-notebook-cell:?execution_count=7&line=2) mx.argpartition(a, 2, None)

TypeError: argpartition(): incompatible function arguments. The following argument types are supported:
    1. argpartition(a: array, /, kth: int, axis: Union[None, int] = -1, *, stream: Union[None, Stream, Device] = None) -> array

Invoked with types: mlx.core.array, int, NoneType

I believe that the error message also agrees with the documentation and usage, as it says Union[None, int].
To Reproduce
import mlx.core as mx

a = mx.ones((3,3))
mx.argpartition(a, 2, None)

Expected behavior
Either None should not accepted and the documentation updated, or the code fixed.
Desktop (please complete the following information):

OS Version: MacOS 14.4.1
Version: 0.13.0

Additional context
I've tried to look at the relevant binding code's lambda, and it makes sense to me[^1]; it's pretty straightforward how it tries to handle a None reference. I'm at a loss trying to figure out a fix.
[^1]: that being said, I'm not very proficient with binding Python and C++

It's caused by a small typo I think:
"axis"_a = -1, should be "axis"_a.none() = -1, to allow None value.
Let me open a PR and fix it.


Generate nested patterns

This PR adds the Prism.patterns.nested function which creates patterns to match recursively nested structures.
This PR is intended to go together with #1538.
#1444 will profit from this.

I really want to make this a resource (#1539) so that it doesn't add weight to core.

I'm going to close this now because there are better ways to implement methods for generating nested patterns.


Dijkstra Algorithm

I would like to add an implementation of the Dijkstra algorithm.
input: path to a txt file as a command line argument. The txt file will contain the data matrix for  distances between nodes(the [i,j] element will represent distance from i to j).
program asks user for source node.
output: distance and path from source node to every other node in the graph.
Let me know if I can work on this

Hi!! I would like to contribute to this issue if it is still open!!


⚠ Bofrost.be has degraded performance

In 0bf16d5, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 1510 ms

Resolved: Bofrost.be performance has improved in d181c25.


Demo docs have out of date container image names

Jenkins and plugins versions report

https://github.com/jenkinsci/jenkinsfile-runner/tree/main/demo
https://github.com/jenkinsci/jenkinsfile-runner/blob/8fb1b688719218bb95b609caa0700467a6be1d09/demo/pipeline-as-yaml/README.md

What Operating System are you using (both controller, and any agents involved in the problem)?
N/A
Reproduction steps
N/A
Expected Results
N/A
Actual Results
N/A
Anything else?
No response

@pdxjohnny  Seems like this can be closed?

I think so. I will be doing a considerable demo revamp anyway


Update qs 1-5 to v6.2

Updates quickstarts 1-5 to version 6.2

The number of files changed is large, but mostly this is generated code. In most of the quickstarts, we just update the proj files. In the EF quickstart, we also regenerate migrations, and in the AspNet Identity quickstart, we re-run the template using 6.2's template.

Why is it necessary to update the quickstarts for a minor release?


WinAFL can not fuzzy Windows service.

I have simple service and try to run fuzzy function but fuzzy never run. Below is my service code.
#include <Windows.h>
#include <tchar.h>
#define MY_DEBUG_TAG "SampleService"
#include "log.h"
SERVICE_STATUS        g_ServiceStatus = {0};
SERVICE_STATUS_HANDLE g_StatusHandle = NULL;
HANDLE                g_ServiceStopEvent = INVALID_HANDLE_VALUE;
VOID WINAPI ServiceMain (DWORD argc, LPTSTR *argv);
VOID WINAPI ServiceCtrlHandler (DWORD);
DWORD WINAPI ServiceWorkerThread (LPVOID lpParam);
#define SERVICE_NAME  _T("SampleService")
DWORD g_BytesTransferred = 0;
VOID CALLBACK FileIOCompletionRoutine(
__in  DWORD dwErrorCode,
__in  DWORD dwNumberOfBytesTransfered,
__in  LPOVERLAPPED lpOverlapped)
{
g_BytesTransferred = dwNumberOfBytesTransfered;
}
void __declspec(noinline) fuzz(LPCWSTR data) {
int const BUFFERSIZE = 1024;
DWORD  dwBytesRead = 0;
char   ReadBuffer[BUFFERSIZE] = { 0 };
OVERLAPPED ol = { 0 };
debug_print("fuzz open file = %s\n", data);
HANDLE hFile = CreateFile(data,
    GENERIC_READ,
    FILE_SHARE_READ,
    NULL,
    OPEN_EXISTING,
    FILE_ATTRIBUTE_NORMAL | FILE_FLAG_OVERLAPPED,
    NULL);

if (hFile == INVALID_HANDLE_VALUE)
{
    debug_print("fuzz open file error= %s\n", data);
    return;
}

if (FALSE == ReadFileEx(hFile, ReadBuffer, BUFFERSIZE - 1, &ol, FileIOCompletionRoutine))
{
    debug_print("fuzz read fil faile=%08x\n", GetLastError());
    CloseHandle(hFile);
    return;
}

//SleepEx(1000, TRUE);
dwBytesRead = g_BytesTransferred;

if (dwBytesRead > 0 && dwBytesRead <= BUFFERSIZE - 1)
{
    ReadBuffer[dwBytesRead] = '\0'; // NULL character
    debug_print("fuzz read OK=%s\n", ReadBuffer);
}
else if (dwBytesRead == 0)
{
    debug_print("fuzz read no data\n");
}
else
{
    debug_print("\n ** Unexpected value for dwBytesRead ** \n");
}

CloseHandle(hFile);
debug_print("fuzz finished\n");

}
int _tmain (int argc, TCHAR *argv[])
{
debug_print("Main: Entry");
debug_print("argc = %d\n", argc);
for (int i = 0; i < argc; i++)
    debug_print("argv[%d] = %s\n", i, argv[i]);

fuzz(L"D:\\WinAFL\\Test\\input.txt");

SERVICE_TABLE_ENTRY ServiceTable[] =
{
    {SERVICE_NAME, (LPSERVICE_MAIN_FUNCTION) ServiceMain},
    {NULL, NULL}
};

if (StartServiceCtrlDispatcher (ServiceTable) == FALSE)
{
   debug_print("Main: StartServiceCtrlDispatcher returned %d", GetLastError());
   return GetLastError ();
}

debug_print("Main: Exit");
return 0;

}
VOID WINAPI ServiceMain (DWORD argc, LPTSTR *argv)
{
DWORD Status = E_FAIL;
debug_print("ServiceMain: Entry");

HANDLE hDebuggerPresentThread = CreateThread(NULL, 0, DebuggerPresentThread, NULL, 0, NULL);

g_StatusHandle = RegisterServiceCtrlHandler (SERVICE_NAME, ServiceCtrlHandler);

if (g_StatusHandle == NULL)
{
    debug_print("ServiceMain: RegisterServiceCtrlHandler returned error");
    goto EXIT;
}

// Tell the service controller we are starting
ZeroMemory (&g_ServiceStatus, sizeof (g_ServiceStatus));
g_ServiceStatus.dwServiceType = SERVICE_WIN32_OWN_PROCESS;
g_ServiceStatus.dwControlsAccepted = 0;
g_ServiceStatus.dwCurrentState = SERVICE_START_PENDING;
g_ServiceStatus.dwWin32ExitCode = 0;
g_ServiceStatus.dwServiceSpecificExitCode = 0;
g_ServiceStatus.dwCheckPoint = 0;

if (SetServiceStatus (g_StatusHandle, &g_ServiceStatus) == FALSE)
{
    debug_print("SetServiceStatus returned error");
}

/*
 * Perform tasks neccesary to start the service here
 */
debug_print("Performing Service Start Operations");

// Create stop event to wait on later.
g_ServiceStopEvent = CreateEvent (NULL, TRUE, FALSE, NULL);
if (g_ServiceStopEvent == NULL)
{
    debug_print("ServiceMain: CreateEvent(g_ServiceStopEvent) returned error");

    g_ServiceStatus.dwControlsAccepted = 0;
    g_ServiceStatus.dwCurrentState = SERVICE_STOPPED;
    g_ServiceStatus.dwWin32ExitCode = GetLastError();
    g_ServiceStatus.dwCheckPoint = 1;

    if (SetServiceStatus (g_StatusHandle, &g_ServiceStatus) == FALSE)
    {
        debug_print("ServiceMain: SetServiceStatus returned error");
    }
    goto EXIT;
}

// Tell the service controller we are started
g_ServiceStatus.dwControlsAccepted = SERVICE_ACCEPT_STOP;
g_ServiceStatus.dwCurrentState = SERVICE_RUNNING;
g_ServiceStatus.dwWin32ExitCode = 0;
g_ServiceStatus.dwCheckPoint = 0;

if (SetServiceStatus (g_StatusHandle, &g_ServiceStatus) == FALSE)
{
    debug_print("ServiceMain: SetServiceStatus returned error");
}

// Start the thread that will perform the main task of the service
HANDLE hThread = CreateThread (NULL, 0, ServiceWorkerThread, NULL, 0, NULL);

debug_print("ServiceMain: Waiting for Worker Thread to complete");

// Wait until our worker thread exits effectively signaling that the service needs to stop
WaitForSingleObject (hThread, INFINITE);

debug_print("ServiceMain: Worker Thread Stop Event signaled");

/*
 * Perform any cleanup tasks
 */
debug_print("ServiceMain: Performing Cleanup Operations");

CloseHandle (g_ServiceStopEvent);

g_ServiceStatus.dwControlsAccepted = 0;
g_ServiceStatus.dwCurrentState = SERVICE_STOPPED;
g_ServiceStatus.dwWin32ExitCode = 0;
g_ServiceStatus.dwCheckPoint = 3;

if (SetServiceStatus (g_StatusHandle, &g_ServiceStatus) == FALSE)
{
    debug_print("ServiceMain: SetServiceStatus returned error");
}

EXIT:
debug_print("ServiceMain: Exit");

return;

}
VOID WINAPI ServiceCtrlHandler (DWORD CtrlCode)
{
debug_print("ServiceCtrlHandler: Entry");
switch (CtrlCode)
{
 case SERVICE_CONTROL_STOP :

     debug_print("ServiceCtrlHandler: SERVICE_CONTROL_STOP Request");

    if (g_ServiceStatus.dwCurrentState != SERVICE_RUNNING)
       break;

    /*
     * Perform tasks neccesary to stop the service here
     */

    g_ServiceStatus.dwControlsAccepted = 0;
    g_ServiceStatus.dwCurrentState = SERVICE_STOP_PENDING;
    g_ServiceStatus.dwWin32ExitCode = 0;
    g_ServiceStatus.dwCheckPoint = 4;

    if (SetServiceStatus (g_StatusHandle, &g_ServiceStatus) == FALSE)
	{
        debug_print("ServiceCtrlHandler: SetServiceStatus returned error");
	}

    // This will signal the worker thread to start shutting down
    SetEvent (g_ServiceStopEvent);

    break;

 default:
     break;
}

debug_print("ServiceCtrlHandler: Exit");

}
DWORD WINAPI ServiceWorkerThread (LPVOID lpParam)
{
debug_print("ServiceWorkerThread: Entry");
//  Periodically check if the service has been requested to stop
while (WaitForSingleObject(g_ServiceStopEvent, 0) != WAIT_OBJECT_0)
{
    /*
     * Perform main service function here
     */

    //  Simulate some work by sleeping
    Sleep(3000);
}

debug_print("ServiceWorkerThread: Exit");

return ERROR_SUCCESS;

}
It can run fuzzy on command
afl-fuzz.exe -D D:\WinAFL\DynamoRIO-Git\dynamorio\build\bin64\ -i D:\WinAFL\Test\testin -o  D:\WinAFL\Test\testout -t 200000 -- -coverage_module SampleService.exe -target_module SampleService.exe -target_method fuzz -fuzz_iterations 10 -nargs 2 -- SampleService.exe @@
But can not run on command and it will stock "OverlappedConnectNamedPipe", "OverlappedConnectNamedPipe" is my log.
afl-fuzz.exe -D D:\WinAFL\DynamoRIO-Git\dynamorio\build\bin64\ -A SampleService.exe -i D:\WinAFL\Test\testin -o  D:\WinAFL\Test\testout -t 200000 -- -coverage_module SampleService.exe -target_module SampleService.exe -target_method fuzz -fuzz_iterations 10 -nargs 2 -- SampleService.exe @@
WinAFL 1.16b by<EMAIL_ADDRESS>Based on AFL 2.43b by<EMAIL_ADDRESS>[+] You have 4 CPU cores with average utilization of 11%.
[+] Try parallel jobs - see afl_docs\parallel_fuzzing.txt.
[] Checking CPU core loadout...
[+] Found a free CPU core, binding to #0.
[+] Process affinity is set to 1.
[] Setting up output directories...
[+] Output directory exists but deemed OK to reuse.
[] Deleting old session data...
[+] Output dir cleanup successful.
[] Scanning 'D:\WinAFL\Test\testin'...
[+] No auto-generated dictionary tokens to reuse.
[] Creating hard links for all input files...
[] Attempting dry run with 'id_000000'...
[*] OverlappedConnectNamedPipe GetLastError=997
Please help me, There have any wrong let service can not run fuzzy.

For fuzzing Windows services, you most likely want to use "Attach" functionality, see https://github.com/googleprojectzero/winafl#attaching-to-a-running-process

Yes, I am use attach by add option -A, But it seems no function. below is my command.
afl-fuzz.exe -D D:\WinAFL\DynamoRIO-Git\dynamorio\build\bin64\ -A SampleService.exe -i D:\WinAFL\Test\testin -o D:\WinAFL\Test\testout -t 200000 -- -coverage_module SampleService.exe -target_module SampleService.exe -target_method fuzz -fuzz_iterations 10 -nargs 2 -- SampleService.exe @@
fuzz function never run.

i have a question, As I know,In order to get coverage, the process must exit.so how winafl attach model work.Thanks!

The process does not need to exit in order to get coverage. WinAFL collects coverage when the target_method exits, not the process.


Fancyzones bugging start zone of sharex screenshot

Microsoft PowerToys version
0.82.1
Installation method
PowerToys auto-update
Running as admin
Yes
Area(s) with issue?
FancyZones
Steps to reproduce
Enable "Move new windows to last known position" and try to printscreen using shareX
PowerToysReport_2024-07-15-14-51-38.zip

✔ Expected Behavior
Be able to see the whole screen
❌ Actual Behavior
Cropping the screen and setting the 0,0 position to the center of my monitor
Other Software
No response

If i disable the "last known position" feature it works again. It was working normally until 3 day ago.

have you tried adding ShareX.exe to the excluded apps section like folks suggested in https://github.com/microsoft/PowerToys/issues/29193 ?

/needinfo

have you tried adding ShareX.exe to the excluded apps section like folks suggested in #29193 ?

/needinfo

It worked! Sorry, didn't see that, and it seems that is a old problem, but sometimes, even without this config sharex works correctly, maybe sharex should recommend adding it to powertoys.
Thank you!


Using shared queues

Hi,
I am trying to use the shared_queue functionality of the Envoy plugins to
enable communication between an HTTP extension and a Service extension.
Firstly, I don't see the relevant calls exposed in the module exports. I had
to use this additional import to get to it:
import { register_shared_queue, resolve_shared_queue } from "@solo-io/proxy-runtime/runtime";
Is this expected?
Secondly, I could not see how to use these APIs to get the queue ID. In
the end I made the following changes in runtime.ts:
    class QueueResult {
      result: WasmResultValues;
      token: u32;
    }

    export function register_shared_queue(queue_name: string): QueueResult {
      let qid = globalU32Ref;
      let queue_name_buffer = String.UTF8.encode(queue_name);
      let r = imports.proxy_register_shared_queue(changetype<usize>(queue_name_buffer), queue_name_buffer.byteLength, qid.ptr());
      return { result: r, token: qid.data };
    }

    export function resolve_shared_queue(vm_id: string, queue_name: string): QueueResult {
      let qid = globalU32Ref;
      let vm_id_buffer = String.UTF8.encode(vm_id);
      let queue_name_buffer = String.UTF8.encode(queue_name);
      let r = imports.proxy_resolve_shared_queue(changetype<usize>(vm_id_buffer), vm_id_buffer.byteLength,
        changetype<usize>(queue_name_buffer), queue_name_buffer.byteLength, qid.ptr());
      return { result: r, token: qid.data };
    }

Am I missing something?
If not, should I submit this as a pull request?
Thanks,
Frank.

A PR would be appreciated!
thank you!

It would be good for the project to choose a license type under which the code is made available. I need to get company clearance for contributions, without a defined license type this may be difficult.

Hi @FrankTaylorLieder, we've added a license (Apache 2.0) to the repo now! Hope that helps.

Hi @FrankTaylorLieder, we've added a license (Apache 2.0) to the repo now! Hope that helps.

Thanks. I'll progress getting the contribution sorted.

Hi. I've just created a PR from my company github account. Let me know if anything else is needed. Thanks.

fixed by https://github.com/solo-io/proxy-runtime/pull/58
thank you!


Saving does not reorder imports

This does not seem to work for me. I am adding this to my settings.json
"[python]": {
        "editor.codeActionsOnSave": {
            "source.organizeImports": false,
            "source.organizeImports.reorder-python-imports": true
        },
    }

Saving does not reorder imports
Originally posted by @jahamilton12121 in https://github.com/TheButlah/vscode-reorder-python-imports/issues/14#issuecomment-1163392997

I can't reproduce this. Could you please provide an example file and maybe more settings from settings.json?


Published certificate disappeared from dashboard

I'm helping a user with some revisions to their certificate, but they've hit "publish" and its no longer appearing on their dashboard.
The certificate is:
https://certificates.theodi.org/datasets/1709/certificate
I've seen a screenshot and their dashboard now only lists a single draft certificate, the published one is no longer there.
Any help appreciated -- looks like this will be our first Expert certificate once its tweaked so keen to get it published!

Hi @ldodds,
Which user is this the dashboard from, the certificate changed ownership on the 16th Jan to<EMAIL_ADDRESS>and is waiting to be accepted back by the account it was transferred from<EMAIL_ADDRESS>

I approve the starring out of email addresses here, but now my brain is just filling in swear words.

Missed this update sorry @pkqk. I cancelled the transfer and redid it and thats done the trick.


CircleCI migration

it works… Not sure if we are 100% sold on the transfer but here it is either way.

In addition to my review comments, the Circle build appears to be failing. Also, this branch should delete .travis.yml.

@dostrander also, please replace the Travis status badge in the readme with a Circle status badge.


Add Date Imported column to 'view submissions' tab in Curation App

Need to be able to sort publications on the 'view submissions' tab by import date, so curators can see which publications have been curated in the last week, not just created.

@earlEBI  is this feature still needed or do you have a workaround?

@ljwh2 It's okay, I've been using a different workaround, yes.


Remove transform() method?

I'm not sure that this is a good feature. Other builders don't seem to have it. I'm thinking it might be best to remove it until we really really know that we want it?

I personally wasn't gonna use it so okay


there is no contribute guide

There is CONTRIBUTING.md in root directory and link in the file. But the link does not work becourse link is not valid.

Reproduction
see CONTRIBUTING.md and click the contribution guide

Additional Details

What is Expected?
What is actually happening?


Adding Pull Request template

Pull request template added for the github repo which lists out all our
required bits of information for new PRs, as well as requiring linked
issues and a checklist of tasks and a link to the contribution
guidelines.
Addresses #181

/lgtm


Remove curly brackets in switch case

The redundant pair of {} will lead to program logic errors.

The change itself is good and fixed the indentation, but I don't think it fixes any logic error.  Can you explain a little bit more?


First-pass implementation of pachctl login

Also not sure if I'm doing something wrong, but after I pasted the token, pachctl crashed with the following stacktrace:
(1) Please paste this link into a browser:
http://github.com/login/oauth/authorize?client_id=d3481e92b4f09ea74ff8&redirect_uri=https%3A%2F%2Fpachyderm.io%2Flogin-hook%2Fdisplay-token.html
(You will be directed to GitHub and asked to authorize Pachyderm's login app on Github. If you accept, you will be given a token to paste here, which will give you an externally verified account in this Pachyderm cluster)

(2) Please paste the token you receive from GitHub here:
29ff900a6858c35bd66ab9a01da140e9a8bbe4e9
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x18 pc=0xd4032c]

goroutine 1 [running]:
github.com/pachyderm/pachyderm/src/server/auth/cmds.LoginCmd.func1(0x240d560, 0x0, 0x0, 0xc4204101b0, 0xc420149ce0)
        /home/ubuntu/go/src/github.com/pachyderm/pachyderm/src/server/auth/cmds/cmds.go:71 +0x3ac
github.com/pachyderm/pachyderm/src/server/pkg/cmdutil.Run.func1(0xc420482900, 0x240d560, 0x0, 0x0)
        /home/ubuntu/go/src/github.com/pachyderm/pachyderm/src/server/pkg/cmdutil/cobra.go:45 +0x47
github.com/pachyderm/pachyderm/src/server/vendor/github.com/spf13/cobra.(*Command).execute(0xc420482900, 0x240d560, 0x0, 0x0, 0xc420482900, 0x240d560)
        /home/ubuntu/go/src/github.com/pachyderm/pachyderm/src/server/vendor/github.com/spf13/cobra/command.go:572 +0x22b
github.com/pachyderm/pachyderm/src/server/vendor/github.com/spf13/cobra.(*Command).ExecuteC(0xc4201d6000, 0xc42019f750, 0xc42019f6d0, 0xc42019f730)
        /home/ubuntu/go/src/github.com/pachyderm/pachyderm/src/server/vendor/github.com/spf13/cobra/command.go:658 +0x339
github.com/pachyderm/pachyderm/src/server/vendor/github.com/spf13/cobra.(*Command).Execute(0xc4201d6000, 0x0, 0x0)
        /home/ubuntu/go/src/github.com/pachyderm/pachyderm/src/server/vendor/github.com/spf13/cobra/command.go:617 +0x2b
main.main.func1(0x23e6b20, 0xc4200a8d80)
        /home/ubuntu/go/src/github.com/pachyderm/pachyderm/src/server/cmd/pachctl/main.go:21 +0x42
main.main()
        /home/ubuntu/go/src/github.com/pachyderm/pachyderm/src/server/cmd/pachctl/main.go:25 +0xc3


Noob Init Question

Getting this output while trying any yt link.
{'detail': [{'loc': ['query', 'url'], 'msg': 'field required', 'type': 'value_error.missing'}]}
.....
Running docker here, passes nox

Hi @aadityaverma
Let me know if you use the docs UI or a script request.
Could you share a code snippet or a screenshot of the docs endpoint you are using?

Hey thanks for replying so quickly, getting the above error when I run
//
import requests
url = "https://youtube.com/watch?v=XfKQUn9wm7I"
data = {"url": url}
response = requests.post("http://localhost:5001/api/v1/youtube", json=data)
print(response.json())

And when I run
//
curl -X 'POST'
'http://localhost:5001/api/v1/youtube?url=https%3A%2F%2Fyoutube.com%2Fwatch%3Fv%3DXfKQUn9wm7I&num_speakers=2&source_lang=Hindi&timestamps=seconds'
-H 'accept: application/json'
-d ''

This is the error
(tts) aditya@panel:~/wordcab-transcribe$ sudo curl -X 'POST' \

'http://localhost:5001/api/v1/youtube?url=https%3A%2F%2Fyoutube.com%2Fwatch%3Fv%3DXfKQUn9wm7I&num_speakers=2&source_lang=Hindi&timestamps=seconds'
-H 'accept: application/json'
-d ''
[sudo] password for aditya:
Sorry, try again.
[sudo] password for aditya:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/dist-packages/starlette/middleware/errors.py", line 162, in call
await self.app(scope, receive, _send)
File "/usr/local/lib/python3.10/dist-packages/starlette/middleware/exceptions.py", line 79, in call
raise exc
File "/usr/local/lib/python3.10/dist-packages/starlette/middleware/exceptions.py", line 68, in call
await self.app(scope, receive, sender)
File "/usr/local/lib/python3.10/dist-packages/fastapi/middleware/asyncexitstack.py", line 21, in call
raise e
File "/usr/local/lib/python3.10/dist-packages/fastapi/middleware/asyncexitstack.py", line 18, in call
await self.app(scope, receive, send)
File "/usr/local/lib/python3.10/dist-packages/starlette/routing.py", line 718, in call
await route.handle(scope, receive, send)
File "/usr/local/lib/python3.10/dist-packages/starlette/routing.py", line 276, in handle
await self.app(scope, receive, send)
File "/usr/local/lib/python3.10/dist-packages/starlette/routing.py", line 66, in app
response = await func(request)
File "/usr/local/lib/python3.10/dist-packages/fastapi/routing.py", line 237, in app
raw_response = await run_endpoint_function(
File "/usr/local/lib/python3.10/dist-packages/fastapi/routing.py", line 163, in run_endpoint_function
return await dependant.call(**values)
File "/app/wordcab_transcribe/main.py", line 206, in inference_with_youtube
utterances = [
TypeError: 'ValueError' object is not iterable

Conda is python 3.9

Maybe my  selecting "Hindi" or "hi" is causing the above cause the defaults (spk=0) is using the gpu.

File "/app/wordcab_transcribe/main.py", line 206, in inference_with_youtube
utterances = [
TypeError: 'OutOfMemoryError' object is not iterable
I am running a Rtx super 2060, 8gb VRam ~ 5 available on startup and container run

It could come from the lack of VRAM. It uses 5.3GB on my side. Could you free some VRAM and give it a new try?
Also, if you are using Docker, you can do docker logs container-name to access the logs. In this case, docker logs wordcab-transcribe (if you used the commands provided in the README file.

I tried to reproduce your bug with this Python code snippet:
import requests

url = "https://youtube.com/watch?v=XfKQUn9wm7I"
response = requests.post(
    f"http://localhost:5001/api/v1/youtube?url={url}&source_lang=hi")
print(response.json())

I can confirm that you need at least 6GB of VRAM for ASR:

But the problem comes after during diarization because the application is trying to diarize everything at once, which causes CUDA OOM on long videos.
Here is the error I get:
2023-04-11 08:33:23.590 | DEBUG    | wordcab_transcribe.service:runner:121 - Longest wait: 0.1002820310000061
2023-04-11 08:36:45.457 | ERROR    | wordcab_transcribe.service:runner:149 - Error processing batch: CUDA out of memory. Tried to allocate 3.65 GiB (GPU 0; 23.70 GiB total capacity; 15.10 GiB already allocated; 1.03 GiB free; 19.81 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation.  See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF
INFO:     <IP_ADDRESS>:60570 - "POST /api/v1/youtube?url=https://youtube.com/watch?v=XfKQUn9wm7I&source_lang=hi HTTP/1.1" 500 Internal Server Error
ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/uvicorn/protocols/http/h11_impl.py", line 429, in run_asgi
    result = await app(  # type: ignore[func-returns-value]
  File "/usr/local/lib/python3.10/dist-packages/uvicorn/middleware/proxy_headers.py", line 78, in __call__
    return await self.app(scope, receive, send)
  File "/usr/local/lib/python3.10/dist-packages/fastapi/applications.py", line 276, in __call__
    await super().__call__(scope, receive, send)
  File "/usr/local/lib/python3.10/dist-packages/starlette/applications.py", line 122, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/usr/local/lib/python3.10/dist-packages/starlette/middleware/errors.py", line 184, in __call__
    raise exc
  File "/usr/local/lib/python3.10/dist-packages/starlette/middleware/errors.py", line 162, in __call__
    await self.app(scope, receive, _send)
  File "/usr/local/lib/python3.10/dist-packages/starlette/middleware/exceptions.py", line 79, in __call__
    raise exc
  File "/usr/local/lib/python3.10/dist-packages/starlette/middleware/exceptions.py", line 68, in __call__
    await self.app(scope, receive, sender)
  File "/usr/local/lib/python3.10/dist-packages/fastapi/middleware/asyncexitstack.py", line 21, in __call__
    raise e
  File "/usr/local/lib/python3.10/dist-packages/fastapi/middleware/asyncexitstack.py", line 18, in __call__
    await self.app(scope, receive, send)
  File "/usr/local/lib/python3.10/dist-packages/starlette/routing.py", line 718, in __call__
    await route.handle(scope, receive, send)
  File "/usr/local/lib/python3.10/dist-packages/starlette/routing.py", line 276, in handle
    await self.app(scope, receive, send)
  File "/usr/local/lib/python3.10/dist-packages/starlette/routing.py", line 66, in app
    response = await func(request)
  File "/usr/local/lib/python3.10/dist-packages/fastapi/routing.py", line 237, in app
    raw_response = await run_endpoint_function(
  File "/usr/local/lib/python3.10/dist-packages/fastapi/routing.py", line 163, in run_endpoint_function
    return await dependant.call(**values)
  File "/app/wordcab_transcribe/main.py", line 206, in inference_with_youtube
    utterances = [
TypeError: 'OutOfMemoryError' object is not iterable

Thanks for reporting your issue @aadityaverma and for providing explanations and code snippets. I will investigate how to fix this for long videos.

For the record, on the video you are trying to transcribe, diarization takes more than 24GB of VRAM 😯.

@chainyo would it be possible to confirm those extra ~17GB of VRAM are caused by diarization? Seems unlikely with the small speechbrain model and agglomerative clustering.

It seems to be at the end of the faster-whisper process, but I still need to inspect it closely.

And this happens even with a batch size of 1?
As an aside, I was trying a notebook that used a different method of diarization. It split the file into multiple smaller files, then transcribed those, and then the diarization.
I think the speechbrain model and agglomerative clustering is less prone to mistakes, but splitting the file sped up the process by 2x vs what it is right now. It also probably uses less memory.
Should we explore this approach? @chainyo

Closed by #31
P.S.: On long videos, like the one linked above, transcription takes less than 5.3GB and is 30min long. New NVIDIA NeMo diarization takes 5min and 13.5GB of VRAM.


How to model nominal types

I've got a simple nominal type:
export type Id = string & { readonly "": unique symbol };
export interface Hero {
  id: Id;
  name: string;
}

How can I create a schema for Hero? I tried ts-to-zod, but it doesn't seem to be able to handle the case. Is there any way to model this on zod?  (Note: I don't need to use ts-to-zod, I can write the schema manually as long as I know how to do it.)
Thanks.

This comment provides a kind of solution here (updated for your example):
export type Id = Brand<'Id', string>;
export function isValidId(id: string): id is Id {
  //                 Note the type guard ^^^^^^^
  return true; // Or whatever validation makes sense
}
export const IdSchema = z.string().refine(isValidId);

const id: Id = IdSchema.parse('682a8518-a062-4078-9ae0-4b8184e5fe00')

That thread also discusses some branding at some length, too, so might be worth reading through.


🐛 Bug Report: Creating a user throws an error

👟 Reproduction steps
Run:
appwrite users create --verbose \
    --userId john \
    --name John \
    --email<EMAIL_ADDRESS>\
    --password 'Password123'

👍 Expected behavior
The user creates successfully without errors
👎 Actual Behavior
The user is created, but an error occurs:
$ appwrite users create --verbose \
    --userId johm \
    --name John \
    --email<EMAIL_ADDRESS>\
    --password 'Password123'
$id : john
$createdAt : 2023-04-19T19:21:31.060+00:00
$updatedAt : 2023-04-19T19:21:31.060+00:00
name : John
password : $argon2id$v=19$m=65536,t=4,p=3$T3JlY1MuMVJhQ2o1d3k0NA$0uoV2bq2atv1SHW+GnWZaHeg+rOguKGXq5ICTPq0SN0
hash : argon2
TypeError: Cannot read properties of undefined (reading 'name')
    at parse (/Users/steven/.nvm/versions/node/v16.16.0/lib/node_modules/appwrite-cli/lib/parser.js:26:52)
    at usersCreate (/Users/steven/.nvm/versions/node/v16.16.0/lib/node_modules/appwrite-cli/lib/commands/users.js:87:9)
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
✗ Error Cannot read properties of undefined (reading 'name')

using json output works fine:
$ appwrite users create --verbose --json \
    --userId john \
    --name John \
    --email<EMAIL_ADDRESS>\
    --password 'Password123'
{
  "$id": "john",
  "$createdAt": "2023-04-19T19:25:31.168+00:00",
  "$updatedAt": "2023-04-19T19:25:31.168+00:00",
  "name": "John",
  "password": "$argon2id$v=19$m=65536,t=4,p=3$T3AxVFJSTVJuc3p2TjFPZA$o7ux4HCf/SIVHfSmnb4la3hz9Ob/7JVyiiSoeXTU/7A",
  "hash": "argon2",
  "hashOptions": {
    "type": "argon2",
    "memoryCost": 2048,
    "timeCost": 4,
    "threads": 3
  },
  "registration": "2023-04-19T19:25:31.167+00:00",
  "status": true,
  "passwordUpdate": "2023-04-19T19:25:31.167+00:00",
  "email"<EMAIL_ADDRESS>  "phone": "",
  "emailVerification": false,
  "phoneVerification": false,
  "prefs": {}
}
✓ Success

It seems like the parser fails on hashOptions here:
https://github.com/appwrite/sdk-for-cli/blob/b4619977eb95ca6650aa5291eb6a26d6bfa46eda/lib/parser.js#L26
🎲 Appwrite version
Version 1.3.x
💻 Operating system
Linux
🧱 Your Environment
Used CLI version 2.0.2
👀 Have you spent some time to check if this issue has been raised before?

[X] I checked and didn't find similar issue

🏢 Have you read the Code of Conduct?

[X] I have read the Code of Conduct

Hey @stnguyen90 , I would like to work on the issue. Can it be assigned to me?

@imf-ali assigned! Thanks for your interest! 🙏


Otbn timing fixes

This brings across the OTBN timing fixes from Integrated as well as some DV fixes that @rswarbrick did which are at least partially related to the timing changes.
I've run a local regression and I think all of the failures are existing issues.

CI failed due to this commit being awkward: https://github.com/lowRISC/opentitan/pull/20957/commits/cbfebacad51bf29a402a790e08acbb353eaaa13b
It's a merge of commits @rswarbrick authored on the integrated dev branch (which were already partially but not fully present on master hence merging them and rewriting the commit message). I altered the signed-off-by line to me but the commit other remained @rswarbrick. After a discussion I've just switched the signed-off-by line to @rswarbrick which should fix the issue.


Add better executive summary to README

Need to indicate what hydroloom is for and who it is intended to be use by.

f2c4ef10bebe63ea1165dc4078d6097db8ea5a53


Close button on file tabs doesn't seem to work

Bug Report
App Version: 2.0.3 RC4
Platform: Linux
Installation Method: AppImage
Bug Description:
Close button on tabs should close the todo file. Instead, it pops up a context menu -- just like the right click on the tab.
Screenshots:

sleek 2.0.3-rc.5 uses "three dots" button rather than a close button, so I guess this issue can be closed


genericx86-64-ext: add raw and flasher artifacts

Now that balena-yocto-scripts support uploading named artifacts, upload
raw and flasher images for genericx86-64-ext.
Change-type: patch
Signed-off-by: Joseph Kogut<EMAIL_ADDRESS>

@jakogut device repos don't expect a Change-type: but require a Changelog-entry: IIRC

I'm converting this to a draft until the balena-img changes are merged, as deploying these artifacts calls scripts/prepare.ts which creates the deflate compressed partition images. If those aren't created, the other image types still won't be usable.
https://github.com/balena-io/balena-img/pull/340


Using exclude lists breaks detail view ordering

Checklist

[X] The bug is reproducible against the latest release or master.
[X] There are no similar issues or pull requests to fix it yet.

Describe the bug
When getting rid of the exclude columns the set difference is used, which breaks the original ordering
https://github.com/aminalaee/sqladmin/blob/2fb1d26b6ae473f00607424bef58a28182fe0d13/sqladmin/models.py#L914-L915
To fix this I would instead use the following:
exclude_columns = {self.get_model_attr(attr) for attr in exclude}
attrs = [attr for attr in self._attrs if attr not in exclude_columns]

Steps to reproduce the bug
Use non-empty ModelView.column_details_exclude_list
Expected behavior
Model attributes displayed in the order they were defined.are
Actual behavior
Model attributes are displayed in random order.
Debugging material
No response
Environment
Linux / 3.8 / 0.8
Additional context
No response

Thanks for reporting this, I've created a PR based on your fix.


chatnotifications: add incoming private message notification

Resolves #7687

I would like to see the chathistory-resending-notifications problem fixed correctly first instead of hacking more things around it. We already have a couple of places that try to work around it.


Data Protection Content Validation Issue for github.io website

Section link1

Reason:
Link validation Issue: The service corresponding to the link does not match.

Section link1

Reason:
Format validation Issue: Text exceeds page size.

Section link1

Reason:
Format validation Issue: Missing description.

Section link1

Reason:
Format validation Issue: Extra symbols -

Section link1

Reason:
Typing annotation Issue: Please unify the format, update to *args:Any, **kwargs:Any or *args, **kwargs.
@rohit-ganguly, @lmazuel for notification.

Close this issue as we'll put it into a summarzied one.


ledger: more flexible generators

Allow specifying number of source and number of destination accounts. This
simplifies the previous flag --generator:

--generator many-many is now --sources 0 --destinations 0
--generator few-few is now --sources 10 --destinations 10
--generator few-one is now --sources 10 --destinations 1

etc.

This change is

LGTM. Maybe add some examples in the usage. eg:
no-contention: --sources=--destinations=0
mid-contention: --sources=--destinations=10
high-contention: --source=10, --destinations=1

Done, TFTR!


Jersey Client does not post form data correctly by default

I am using dropwizard 1.0.6.
I used Jersey Client to send a post request to a server and it gzips the form data without setting proper headers. As a result, the server uses gzipped form data as plain data. When I do setGzipEnabledForRequests(false) it is working correctly.
Sample code
        WebTarget webTarget = client.target("http://httpbin.org/post");
        MultivaluedMap<String, String> formData = new MultivaluedHashMap<String, String>();
        formData.add("username", "guest");
        String response = webTarget.request().post(Entity.form(formData), String.class);

Thanks for the bug report! What do you mean by "without setting proper headers"? When I run your example I see that the client sends the Content-Encoding header as gzip and the Content-Type header as application/x-www-form-urlencoded, which is correct.
Feb 21, 2017 3:44:20 PM org.glassfish.jersey.logging.LoggingInterceptor log
INFO: 1 * Sending client request on thread main
1 > POST http://httpbin.org/post
1 > Content-Encoding: gzip
1 > Content-Type: application/x-www-form-urlencoded

Feb 21, 2017 3:44:20 PM org.glassfish.jersey.logging.LoggingInterceptor log
INFO: 1 * Client response received on thread main
1 < 200
1 < Access-Control-Allow-Credentials: true
1 < Access-Control-Allow-Origin: *
1 < Connection: keep-alive
1 < Content-Length: 537
1 < Content-Type: application/json
1 < Date: Tue, 21 Feb 2017 14:44:20 GMT
1 < Server: nginx
{
  "args": {},
  "data": "",
  "files": {},
  "form": {
    "\u001f\ufffd\b\u0000\u0000\u0000\u0000\u0000\u0000\u0000 -N-\ufffdK\ufffdM\ufffdM/M-.\u0001\u0000\ufffdJ\ufffdj\u000e\u0000\u0000\u0000": ""
  },
  "headers": {
    "Accept-Encoding": "gzip,deflate",
    "Content-Encoding": "gzip",
    "Content-Length": "34",
    "Content-Type": "application/x-www-form-urlencoded",
    "Host": "httpbin.org",
    "User-Agent": "jersey-test"
  },
  "json": null,
  "origin": "<IP_ADDRESS>",
  "url": "http://httpbin.org/post"
}

I was expecting to see an unzipped version of "form" data in httpbin.org response. Maybe it's the server side which does not honor "gzip" Content-Encoding properly? My web server is not able to handle the zipped form data as httpbin.org.

I am not sure about how https://httpbin.org handles such requests, but I'm quite sure that an HTTP server can decode gzip-encoded requests. Please take a look at JerseyClientIntegrationTest.java. We have tests there for handling compressed content from the client with an embedded com.sun.net.httpserver.

ok, feel free to close this ticket then.


v13.2.0 optimize CellModel

SonarQube analysis reported 1 issue:

 1 info

Watch the comments in this conversation to review them.
Note: the following issues could not be reported as comments because they are located on lines that are not displayed in this pull request:

 Split this 158 characters long line (which is greater than 120 authorized).


'prepare' task for windows

I'm getting ready to create a prepare task for windows, using Chef MSI installer.
It will require a bit of refactoring as unlike darwin/linux, this one is completely different.

I'm all for this. knife-windows can do this for chef server do I suspect we
can do something similar. WinRM should work but I've never gotten it to
work with SSL which is concerning.
On Friday, February 10, 2012, Thibaut Barrre <
<EMAIL_ADDRESS>wrote:

I'm getting ready to create a prepare task for windows, using Chef MSI
installer.
It will require a bit of refactoring as unlike darwin/linux, this one is
completely different.

Reply to this email directly or view it on GitHub:
https://github.com/matschaffer/knife-solo/issues/19

You should be able to turn of gssapi and kerberos with this the (from https://github.com/matschaffer/chef-loves-windows/blob/master/script/new_instance#L56):
winrm quickconfig -q
winrm set winrm/config/winrs @{MaxMemoryPerShellMB="300"}
winrm set winrm/config @{MaxTimeoutms="1800000"}
winrm set winrm/config/service/auth @{Basic="true"}
winrm set winrm/config/service @{AllowUnencrypted="true"}

Looks like I can't assign to you either. I may need to give you push access for that or something. I'll poke around and see what I can figure out.

Sure push access would be nice;
If you do I'll push to features branches then pull request (master is
for you!) for reviews etc.
Envoyé de mon iPhone
Le 11 févr. 2012 à 12:44, Mat Schaffer
<EMAIL_ADDRESS>a écrit :

Looks like I can't assign to you either. I may need to give you push access for that or something. I'll poke around and see what I can figure out.

Reply to this email directly or view it on GitHub:
https://github.com/matschaffer/knife-solo/issues/19#issuecomment-3920214

great! Thanks! Easier for me :)
-- Thibaut
On Sat, Feb 11, 2012 at 12:55 PM, Mat Schaffer <
<EMAIL_ADDRESS>
wrote:

You should be all set. I also assigned your original pull request although
maybe that should be assigned to me to merge it in. I'll do that and we can
do feature branches and PR on this repo from now on.

Reply to this email directly or view it on GitHub:
https://github.com/matschaffer/knife-solo/issues/19#issuecomment-3920265

Hey @thbar can you send me info on how you set up your windows instances? (i.e., which SSH server, where do you get rsync from, etc)
I'll see what I can do about getting prepare working over the next couple days.


Face Mask Detection

Description
(Write your answer here.)
During Covid-19 period wearing mask is crucial one, so I've developed a ML project which can detect multiple faces and show the result. I've even worked on Arduino which turns the camera towards the face and send the signal to the machine to detect the face using OpenCV and displayed the result.

I tried detecting faces using available pretrained models like YOLO, RESNET-50 and many more, after detecting the face I've cropped out the faces and sent it to my model and it will detect whether mask is present or not.
Using Arduino I've implemented 360° rotated camera and the ML model will detect the faces and displays the result.

Checklist

[x] I've read the contribution guidelines.
[x] I've checked the issue list before deciding what to submit.
[x] I've edited the README.md and link to my code.

(Add x in the [] to mark as completed.)
Related Issues or Pull Requests
Closes Issue: #31

@khusheekapoor  worked on it please look into it


Rewrite GoogleTranslator.translate_batch method to require only one API call for the whole list of words (batch)

I noticed that it's possible to take advantage of the fact that Google Translate can handle multiple words at a time to speed up the translate_batch method. In this case, if instead of using BaseTranslator._translate_batch for the GoogleTranslator.translate_batch method, we can instead join the batch list with linebreaks, run a single translate call on the entire string, and then split the translated string again by linebreaks to return the arr list of results. This way, we don't need to loop through multiple API calls via the translate method, rather can get the same set of results with only one API call.
I have tried a number of adhoc test cases by choosing random lists of strings and have found that the result is always identical to what you get when running the current method; however, before formalizing tests for this I wanted to submit it and see whether this idea has already been attempted and whether it was found lacking for some reason that I haven't noticed yet. Basically interested in feedback on the idea.

Thanks for the PR. I think this is a good idea. However, would it work all the time? Wouldn't this make translations dependent on one other, like if its some kind of a sentence together?
I would say, make your implementation as default and add a parameter called "translate_separately" or "use_separate_api_calls"... whatever you wanna name it. This will make sure that we can have both functionalities if needed

Thanks for the feedback, @nidhaloff. As far as I could tell, it seemed like whenever a line break separates words, they don't get interpreted as a complete sentence and are treated separately. But that's just from the trials I've done and I guess Google could technically change that behaviour at some point. Is that what you were getting at though?
As for the parameter, I think that sounds like a good idea as well. Or if you wanted your implementation to remain as the default, then you could instead have a parameter like translate_quickly or whatever (i.e. the opposite of the ones you listed) but would be up to you of course!


Build with 4.10-rc-2 and 4.11 nightly release

To find potential problem in early phase, build with Gradle 4.10-RC2 and 4.11 nightly release.

@spotbugs/everyone please have a review, thank you!


[MB-11454] PO9 - History and Audit Logging POC

Summary
Proof of concept audit logging. The goal of PO9 is to create a history logging system like in Jira to show the progression of move changes.
It will include things such as: who changed it, what it changed to, and when did it change.
This is PoC to prove out that this is feasible to capture using DB triggers and an audit log table using JSON columns
Things to highlight
DB Changes
The audit history table will save the state of the old_data and the changed_data in a json format. This allows us to provide flexibility for the table data and also meet the requirements for Transcom. Read more about it in this confluence page
Here are the column descriptions for the audit_history table

column name
description

id
log id

schema_name
name of the schema

table_name
name of the table (i.e addresses, mto_shipments)

relid

object_id
id of the table entity (i.e addresses id column)

session_userid
id of the user who made the change

event_name
the name of the API call (will be a FKey in actual implementation)

action_tstamp_tx
Transaction start time

action_tstamp_stm
Statement start time

action_tstamp_clk
Trigger start time

transaction_id
Identifier of transaction

client_query
The query executed

action
Insert, update, or delete

old_data
State of the old data before the change

changed_data
The change itself

statement_only
True if audit event is from for each statement, false if not

Data gets inserted into this table via triggers. The trigger will evaluate whether it is a create, update, or delete and then create an audit record accordingly. Also, the update record is only created if there is a diff between the old record and the new one, so no empty changed_data records will be created for update.
The if_modified_func() creates the new audit history record, it has separate if statements for insert update and delete
add_audit_history_table adds the triggers for these tables. We don't have to explicitly assign the triggers to the tables.
It's hilarious: our custom parser in pkg/migrate can't handle the SQL in the migration file. If you paste in the migration manually, everything works
API Handler Changes
The Application Context (AuditableAppContextFromRequest) now saves the session id of the user so that when transactions are made through the API, the DB can know who made the change. In addition, we allow the API to send the type of event is such as updateShipment to tell the DB the context of the change.
The AuditableAppContextFromRequest makes use of
SET LOCAL audit.current_user_id = ? and
SET LOCAL audit.current_event_name = ? to have the session user ID and  event_name available.
For infrasec, we would like them to review these specific changes and evaluate any security risks from adding this functionality to the API
Steps to test and see API moveHistory response

Log into the office
Select a move from the queue and click on the  History  tab. On the History tab and you will  see the JSON out from the moveHistory API call.

Fields to note in the JSON are the changedValues  field and the oldValues fields.  These  keys hold the old values before the update and the new values after the update.

Review Screen mocks

history log usability miro board
figma prototype from usability session

Warnings

:warning:
Please add the JIRA issue key to the PR title (e.g. MB-123)

  Generated by :no_entry_sign: dangerJS against 45d8afc7b4a7baa88f6054f243a169d2938bb8ef

I may be dismissing my own review. As I am seeing this DB issue on every branch and not just this one. I'll do that once I've confirmed I can run things. But folks are welcome to dismiss it if it's a red herring.

Member

@rogeruiz try make db_dev_fresh. That fixed the issue for me.

I may be dismissing my own review. As I am seeing this DB issue on every branch and not just this one. I'll do that once I've confirmed I can run things. But folks are welcome to dismiss it if it's a red herring.

@rogeruiz  thanks for diving into to this. Keep in mind this is also a review to look at how we are bringing in these changes design-wise. We are introducing new tables and new concepts with triggers and stored procedures which I don't think we currently do in the code base.