Infinite field event

Hi I'm using firebase cloud function and I'm trying to create a middleware to upload image to firebase cloud storage with busboy. For now I'm just trying to test the middleware without file. Here is the code :
import { NextFunction, Request, Response } from "express";
import * as busboy from "busboy";

export async function extractPaymentImg(
  req: Request,
  res: Response,
  next: NextFunction
) {
  const bb = busboy({
    headers: req.headers,
    limits: {
      fileSize: 10 * 1024 * 1024,
    },
  });

  // @ts-ignore

  bb.on(
    "file",
    (
      fieldname: any,
      file: any,
      filename: any,
      transferEncoding: any,
      mimeType: any
    ) => {
      file.resume();
    }
  );

  bb.on("field", (key, value) => {
    console.info(key);
    req.body[key] = value;
  });

  bb.on("close", () => {
    next();
  });

  // @ts-ignore
  if (req.rawBody) {
    // @ts-ignore
    bb.end(req.rawBody);
  } else {
    req.pipe(bb);
  }
}

But I'm getting an infinite loop on the field event. It keep getting triggered infinitely. I precise that I have already done some research. Here is the link that I tried to use to fix my problem :
Handling multipart/form-data POST with Express in Cloud Functions
https://github.com/mscdex/busboy/issues/61
https://www.mikesukmanowsky.com/blog/firebase-file-and-image-uploads
I also precise that I use postman for my test

Can you provide the test raw body you're writing to the busboy instance (keeping everything intact, including CRs and LFs) that's causing this?

Can you copy and paste the output of console.log(req.rawBody.toString('base64')) ? I need the entirety of the actual data to try to reproduce the issue on my side.
What version of node and what version of busboy are you encountering this issue with?

I'am using node v16.14.0 and busboy 1.6.0. Here is my req.rawBody in base64 :
 LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLTI1NTMwOTA1NDExMTA1NjcwMjYzNzM3MQ0KQ29udGVudC1EaXNwb3NpdGlvbjogZm9ybS1kYXRhOyBuYW1lPSJ0ZXN0Ig0KDQp0ZXN0DQotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tMjU1MzA5MDU0MTExMDU2NzAyNjM3MzcxLS0NCg==

I cannot reproduce the issue. Here is my reproduction code, using your form data and configuration:
'use strict';

const busboy = require('busboy');

const data = Buffer.from('LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLTI1NTMwOTA1NDExMTA1NjcwMjYzNzM3MQ0KQ29udGVudC1EaXNwb3NpdGlvbjogZm9ybS1kYXRhOyBuYW1lPSJ0ZXN0Ig0KDQp0ZXN0DQotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tMjU1MzA5MDU0MTExMDU2NzAyNjM3MzcxLS0NCg==', 'base64');
const bb = busboy({
  headers: {
    'content-type': 'multipart/form-data; boundary=--------------------------255309054111056702637371'
  },
  limits: {
    fileSize: 10 * 1024 * 1024,
  },
});
bb.on('file', (...args) => {
  console.log('file', args);
});
bb.on('field', (...args) => {
  console.log('field', args);
});
bb.on('close', () => {
  console.log('close');
});
bb.end(data);

and the resulting output:
field [
  'test',
  'test',
  {
    nameTruncated: false,
    valueTruncated: false,
    encoding: '7bit',
    mimeType: 'text/plain'
  }
]
close

Perhaps something is calling your extractPaymentImg function for the same request?

extractPaymentImg is only use in one place for a test router. No other routes use it

I found the error thanks to you. I was going to delete the test router and quit and then I saw that I was calling testRouter  in the testRouter


how to import the third packages

i follow the faq and build the source source code and tag it to a docker。when i use the docker in dify，i can not import the nump
this is the error

it seems there is some permission problems

i follow this setp1 、setp2 to set the config.yaml and zsysnum_linux_amd64.go file
https://github.com/langgenius/dify-sandbox/blob/main/FAQ.md#1-why-does-my-python-code-throw-an-exception-like-xxxso-cannot-open-shared-object-file-no-such-file-or-directory

try to use numpy 1.x version

您好，您的邮件我已经收到，我会尽快处理

i reaplace the numpy version and set some .so in config.yaml but the problem in  picture 2 is still there
2024/08/15 05:25:20 server.go:50: [INFO]initializing python dependencies sandbox...
2024/08/15 05:26:54 env.go:30: [WARN]python lib path /usr/lib/python3.10 is not available
2024/08/15 05:26:54 env.go:30: [WARN]python lib path /usr/lib/python3 is not available
2024/08/15 05:26:54 env.go:30: [WARN]python lib path /run/systemd/resolve/stub-resolv.conf is not available
2024/08/15 05:26:54 env.go:30: [WARN]python lib path /run/resolvconf/resolv.conf is not available
2024/08/15 05:26:54 server.go:55: [INFO]python dependencies sandbox initialized
[GIN-debug] [WARNING] Creating an Engine instance with the Logger and Recovery middlew

it seems your python is not in the /usr/lib/python3.10 or /usr/lib/python3, try to fix that first.

it seems your python is not in the /usr/lib/python3.10 or /usr/lib/python3, try to fix that first.

you are right i modify the config.yaml
but new problems
this is the error in dify web：
Node 代码执行 2 run failed: READ THIS FOR ADVICE ON HOW TO SOLVE THIS ISSUE! Importing the numpy C-extensions failed. This error can happen for many reasons, often due to issues with your setup or how NumPy was installed. We have compiled some common reasons and troubleshooting tips at: https://numpy.org/devdocs/user/troubleshooting-importerror.html Please note and check the following: * The Python version is: Python3.10 from "/usr/local/bin/python3.10" * The NumPy version is: "1.23.5" and make sure that they are the versions you expect. Please carefully study the documentation linked above for further help. Original error was: libpthread.so.0: cannot open shared object file: No such file or directory ne 48, in  File "", line 4, in  File "/usr/local/lib/python3.10/site-packages/numpy/init.py", line 140, in  from . import core File "/usr/local/lib/python3.10/site-packages/numpy/core/init.py", line 49, in  raise ImportError(msg) ImportError: IMPORTANT: PLEASE READ THIS FOR ADVICE ON HOW TO SOLVE THIS ISSUE! Importing the numpy C-extensions failed. This error can happen for many reasons, often due to issues with your setup or how NumPy was installed. We have compiled some common reasons and troubleshooting tips at: https://numpy.org/devdocs/user/troubleshooting-importerror.html Please note and check the following: * The Python version is: Python3.10 from "/usr/local/bin/python3.10" * The NumPy version is: "1.23.5" and make sure that they are the versions you expect. Please carefully study the documentation linked above for further help. Original error was: libpthread.so.0: cannot open shared object file: No such file or directory error: exit status 255
this is the sandbox docker log

2024/08/15 06:23:49 setup.go:29: [INFO]initializing nodejs runner environment...
2024/08/15 06:23:50 setup.go:85: [INFO]nodejs runner environment initialized
2024/08/15 06:23:50 setup.go:31: [INFO]initializing python runner environment...
2024/08/15 06:23:50 setup.go:43: [INFO]python runner environment initialized
2024/08/15 06:23:50 config.go:96: [INFO]network has been enabled
2024/08/15 06:23:50 config.go:112: [INFO]using https proxy: http://ssrf_proxy:3128
2024/08/15 06:23:50 config.go:121: [INFO]using http proxy: http://ssrf_proxy:3128
2024/08/15 06:23:50 server.go:20: [INFO]config init success
2024/08/15 06:23:50 server.go:26: [INFO]runner dependencies init success
2024/08/15 06:23:50 server.go:42: [INFO]installing python dependencies...
2024/08/15 06:23:52 setup.go:114: [INFO]Requirement already satisfied: numpy==1.23.5 in /usr/local/lib/python3.10/site-packages (from -r requirements.txt (line 1)) (1.23.5)
2024/08/15 06:23:52 setup.go:114: [INFO]Requirement already satisfied: pypdf==3.17.4 in /usr/local/lib/python3.10/site-packages (from -r requirements.txt (line 2)) (3.17.4)
2024/08/15 06:23:52 setup.go:114: [INFO]Requirement already satisfied: markdown==3.5.2 in /usr/local/lib/python3.10/site-packages (from -r requirements.txt (line 3)) (3.5.2)
2024/08/15 06:23:53 setup.go:135: [INFO]Python dependency installed: numpy 1.23.5
2024/08/15 06:23:53 setup.go:135: [INFO]Python dependency installed: pypdf 3.17.4
2024/08/15 06:23:53 setup.go:135: [INFO]Python dependency installed: markdown 3.5.2
2024/08/15 06:23:53 server.go:48: [INFO]python dependencies installed
2024/08/15 06:23:53 server.go:50: [INFO]initializing python dependencies sandbox...
2024/08/15 06:25:13 server.go:55: [INFO]python dependencies sandbox initialized
2024/08/15 06:25:13 cocrrent.go:31: [INFO]setting max requests to 50
2024/08/15 06:25:13 cocrrent.go:13: [INFO]setting max workers to 4

follow the FAQ1 add the libpthread.so.0

follow the FAQ1 add the libpthread.so.0

thank you。i find the problem THE FAQ documnet 's   system call in numpy is wrong

the document is to show how to resolve the problem,  but the final result is based on different systems

I want to use sandbox to create charts using pandas and matplotlib but returns errors because packages aren't installed
line 1, in <module>\nModuleNotFoundError: No module named 'matplotlib'
So here's what I tried to do in dify

Create a custom Dockerfile:
Create a new Dockerfile in your /dif/docker directory. Named it  sandbox.dockerfile.
 # sandbox.dockerfile
 FROM langgenius/dify-sandbox:latest

 # Copy the requirements.txt file into the container
 COPY sandbox-requirements.txt /dependencies/python-requirements.txt

 # Install the dependencies
 RUN pip3 install --no-cache-dir -r /dependencies/python-requirements.txt

create docker/sandbox-requirements.txt
matplotlib
pandas

Modify the docker-compose.yaml to use the custom Dockerfile:
Update the sandbox service to build from the custom Dockerfile.
// ... existing code ...
sandbox:
  build:
    context: .
    dockerfile: sandbox.dockerfile
  restart: always
  environment:
    # The DifySandbox configurations
    # Make sure you are changing this key for your deployment with a strong key.
    # You can generate a strong key using `openssl rand -base64 42`.
    API_KEY: ${SANDBOX_API_KEY:-dify-sandbox}
    GIN_MODE: ${SANDBOX_GIN_MODE:-release}
    WORKER_TIMEOUT: ${SANDBOX_WORKER_TIMEOUT:-15}
    ENABLE_NETWORK: ${SANDBOX_ENABLE_NETWORK:-true}
    HTTP_PROXY: ${SANDBOX_HTTP_PROXY:-http://ssrf_proxy:3128}
    HTTPS_PROXY: ${SANDBOX_HTTPS_PROXY:-http://ssrf_proxy:3128}
    SANDBOX_PORT: ${SANDBOX_PORT:-8194}
  volumes:
    - ./volumes/sandbox/dependencies:/dependencies
    - ./requirements.txt:/app/requirements.txt  # Mount the requirements.txt file
  networks:
    - ssrf_proxy_network
// ... existing code ...

Build and run the updated service:
Run the following commands to build and start the updated sandbox service.
docker-compose build sandbox
docker-compose up sandbox

This indeed fixes pandas and matplotlib error but for some reason numpy (a dependency of both pandas and matplotlib) is still not found and throws an error
Traceback (most recent call last):
File \"/var/sandbox/sandbox-python/tmp/a8bb7065_f87e_4c56_a91e_3d3d6aa23509.py\", line 48, in <module>
File \"<string>\", line 1, in <module>
File \"/usr/local/lib/python3.10/site-packages/pandas/__init__.py\", line 19, in <module>
raise ImportError(ImportError: Unable to import required dependencies: numpy: Error importing numpy: you should not try to import numpy from its source directory; please exit the numpy source tree, and relaunch\n your python interpreter from there.

Notice that it read that pandas package is installed locally this time, but it can't find its dependency numpy, though from the logs when building sandbox with custom python-requirements.txt, numpy did get installed
I did add numpy to python-requirements.txt but still the same error showed up
I feel I am so close but don't know what else to do
Thanks in advance

After further trials, I added the following to config.yaml
python_lib_path:
  - /usr/local/lib/python3.10
  - /usr/local/lib/python3.10/site-packages

Now I get this error 🙃
IMPORTANT: PLEASE READ THIS FOR ADVICE ON HOW TO SOLVE THIS ISSUE!

Importing the numpy C-extensions failed. This error can happen for
many reasons, often due to issues with your setup or how NumPy was
installed.

We have compiled some common reasons and troubleshooting tips at:

 https://numpy.org/devdocs/user/troubleshooting-importerror.html

Please note and check the following:

 * The Python version is: Python3.10 from \"/usr/local/bin/python3\"
 * The NumPy version is: \"2.1.0\"

and make sure that they are the versions you expect.
Please carefully study the documentation linked above for further help.

Original error was: libgcc_s.so.1: cannot open shared object file: No such file or directory

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
 File \"/var/sandbox/sandbox-python/tmp/d5600e89_9809_498c_89ac_372be73bcb7e.py\", line 48, in <module>
 File \"<string>\", line 1, in <module>
 File \"/usr/local/lib/python3.10/site-packages/matplortError:

IMPORTANT: PLEASE READ THIS FOR ADVICE ON HOW TO SOLVE THIS ISSUE!

Importing the numpy C-extensions failed. This error can happen for
many reasons, often due to issues with your setup or how NumPy was
installed.

We have compiled some common reasons and troubleshooting tips at:

 https://numpy.org/devdocs/user/troubleshooting-importerror.html

Please note and check the following:

 * The Python version is: Python3.10 from \"/usr/local/bin/python3\"
 * The NumPy version is: \"2.1.0\"

and make sure that they are the versions you expect.
Please carefully study the documentation linked above for further help.

Original error was: libgcc_s.so.1: cannot open shared object file: No such file or directory

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
 File \"/var/sandbox/sandbox-python/tmp/d5600e89_9809_498c_89ac_372be73bcb7e.py\", line 48, in <module>
 File \"<string>\", line 1, in <module>
 File \"/usr/local/lib/python3.10/site-packages/matplotlib/__init__.py\", line 159, in <module>
 from . import _api, _version, cbook, _docstring, rcsetup
 File \"/usr/local/lib/python3.10/site-packages/matplotlib/cbook.py\", line 24, in <module>
 import numpy as np
 File \"/usr/local/lib/python3.10/site-packages/numpy/__init__.py\", line 119, in <module>
 raise ImportError(msg) from e
ImportError: Error importing numpy: you should not try to import numpy from
 its source directory; please exit the numpy source tree, and relaunch
 your python interpreter from there.
error: exit status 255

Realizing that libgcc_s.so.1: cannot open shared object file: No such file or directory requires installing apt-get to linux for numpy, I went on another route of using plotly which doesnt have complicated dependencies. It worked great, but can't write generated image to chart due to file restrictions. Any idea how can I prompt code interpreter to generate an image of the chart and return it to Dify Agent?

After further trials, I added the following to config.yaml
python_lib_path:
  - /usr/local/lib/python3.10
  - /usr/local/lib/python3.10/site-packages

Now I get this error 🙃
IMPORTANT: PLEASE READ THIS FOR ADVICE ON HOW TO SOLVE THIS ISSUE!

Importing the numpy C-extensions failed. This error can happen for
many reasons, often due to issues with your setup or how NumPy was
installed.

We have compiled some common reasons and troubleshooting tips at:

 https://numpy.org/devdocs/user/troubleshooting-importerror.html

Please note and check the following:

 * The Python version is: Python3.10 from \"/usr/local/bin/python3\"
 * The NumPy version is: \"2.1.0\"

and make sure that they are the versions you expect.
Please carefully study the documentation linked above for further help.

Original error was: libgcc_s.so.1: cannot open shared object file: No such file or directory

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
 File \"/var/sandbox/sandbox-python/tmp/d5600e89_9809_498c_89ac_372be73bcb7e.py\", line 48, in <module>
 File \"<string>\", line 1, in <module>
 File \"/usr/local/lib/python3.10/site-packages/matplortError:

IMPORTANT: PLEASE READ THIS FOR ADVICE ON HOW TO SOLVE THIS ISSUE!

Importing the numpy C-extensions failed. This error can happen for
many reasons, often due to issues with your setup or how NumPy was
installed.

We have compiled some common reasons and troubleshooting tips at:

 https://numpy.org/devdocs/user/troubleshooting-importerror.html

Please note and check the following:

 * The Python version is: Python3.10 from \"/usr/local/bin/python3\"
 * The NumPy version is: \"2.1.0\"

and make sure that they are the versions you expect.
Please carefully study the documentation linked above for further help.

Original error was: libgcc_s.so.1: cannot open shared object file: No such file or directory

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
 File \"/var/sandbox/sandbox-python/tmp/d5600e89_9809_498c_89ac_372be73bcb7e.py\", line 48, in <module>
 File \"<string>\", line 1, in <module>
 File \"/usr/local/lib/python3.10/site-packages/matplotlib/__init__.py\", line 159, in <module>
 from . import _api, _version, cbook, _docstring, rcsetup
 File \"/usr/local/lib/python3.10/site-packages/matplotlib/cbook.py\", line 24, in <module>
 import numpy as np
 File \"/usr/local/lib/python3.10/site-packages/numpy/__init__.py\", line 119, in <module>
 raise ImportError(msg) from e
ImportError: Error importing numpy: you should not try to import numpy from
 its source directory; please exit the numpy source tree, and relaunch
 your python interpreter from there.
error: exit status 255

I also have this problem when I use numpy and other libraries that depend on numpy, do you have any solutions for it now?

I also have this problem when I use numpy and other libraries that depend on numpy, do you have any solutions for it now?

Check my previous reply https://github.com/langgenius/dify-sandbox/issues/37#issuecomment-2326520238
AFAIK from the FAQ, running OS level packages using apt-get requires further configuration for syscall that I wasn't free to try out. So I reverted to plotly but I can't generate a chart image and send it back to Dify to render. Requires investigation with plotly and how to send generated chart image back.

I tried to get system call number ....
I run main and below is log of main:
2024/09/07 16:45:40 setup.go:29: [INFO]initializing nodejs runner environment...
2024/09/07 16:45:40 setup.go:85: [INFO]nodejs runner environment initialized
2024/09/07 16:45:40 setup.go:33: [INFO]initializing python runner environment...
2024/09/07 16:45:40 setup.go:50: [INFO]python runner environment initialized
2024/09/07 16:45:40 config.go:96: [INFO]network has been enabled
2024/09/07 16:45:40 server.go:20: [INFO]config init success
2024/09/07 16:45:40 server.go:26: [INFO]runner dependencies init success
[GIN-debug] [WARNING] Creating an Engine instance with the Logger and Recovery middleware already attached.

[GIN-debug] [WARNING] Running in "debug" mode. Switch to "release" mode in production.
 - using env:   export GIN_MODE=release
 - using code:  gin.SetMode(gin.ReleaseMode)

[GIN-debug] GET    /health                   --> github.com/langgenius/dify-sandbox/internal/controller.Setup.func1 (5 handlers)
2024/09/07 16:45:40 cocrrent.go:31: [INFO]setting max requests to 50
2024/09/07 16:45:40 server.go:47: [INFO]installing python dependencies...
2024/09/07 16:45:40 cocrrent.go:13: [INFO]setting max workers to 4
2024/09/07 16:45:40 server.go:53: [INFO]python dependencies installed
2024/09/07 16:45:40 server.go:55: [INFO]initializing python dependencies sandbox...
 We recommend you to set a value.
Please check https://pkg.go.dev/github.com/gin-gonic/gin#readme-don-t-trust-all-proxies for details.
[GIN-debug] Listening and serving HTTP on :8194
2024/09/07 16:46:27 env.go:30: [WARN]python lib path /etc/ssl/certs/ca-certificates.crt is not available
2024/09/07 16:46:27 server.go:60: [INFO]python dependencies sandbox initialized

And I run below command but there is no printed:
go run cmd/test/syscall_dig/main.go
Following syscalls are required:

Please help.

According to the instructions on the FAQ page, add the sandbox-related permissions, repackage, and the matplotlib can run now. However, the output image cannot be used for file transfer, but it can be rendered using base64, which is not bad.

您好，您的邮件我已经收到，我会尽快处理

According to the instructions on the FAQ page, add the sandbox-related permissions, repackage, and the matplotlib can run now. However, the output image cannot be used for file transfer, but it can be rendered using base64, which is not bad.

Which version？please.

您好，您的邮件我已经收到，我会尽快处理

Node [PY] 工作流输出 run failed: atplotlib import _api, _cm, cbook, scale File "/usr/local/lib/python3.10/site-packages/matplotlib/scale.py", line 22, in <module> from matplotlib.ticker import ( File "/usr/local/lib/python3.10/site-packages/matplotlib/ticker.py", line 138, in <module> from matplotlib import transforms as mtransforms File "/usr/local/lib/python3.10/site-packages/matplotlib/transforms.py", line 49, in <module> from matplotlib._path import ( AttributeError: _ARRAY_API not found ar/sandbox/sandbox-python/tmp/de70e915_1cd0_49da_a3c0_449bc9e8fd3b.py", line 48, in <module> File "<string>", line 15, in <module> File "/usr/local/lib/python3.10/site-packages/matplotlib/__init__.py", line 113, in <module> from . import _api, _version, cbook, _docstring, rcsetup File "/usr/local/lib/python3.10/site-packages/matplotlib/rcsetup.py", line 27, in <module> from matplotlib.colors import Colormap, is_color_like File "/usr/local/lib/python3.10/site-packages/matplotlib/colors.py", line 56, in <module> from matplotlib import _api, _cm, cbook, scale File "/usr/local/lib/python3.10/site-packages/matplotlib/scale.py", line 22, in <module> from matplotlib.ticker import ( File "/usr/local/lib/python3.10/site-packages/matplotlib/ticker.py", line 138, in <module> from matplotlib import transforms as mtransforms File "/usr/local/lib/python3.10/site-packages/matplotlib/transforms.py", line 49, in <module> from matplotlib._path import ( AttributeError: _ARRAY_API not found error: exit status 255

i got it


[WIP] ARROW-2805: [Python] Use official way to find TensorFlow module

Still trying this out, but this seems like the way to do it.
Note it will use the slow path in Python 2 but that's ok I think.

Codecov Report

Merging #2224 into master will increase coverage by 2.39%.
The diff coverage is 57.14%.

@@            Coverage Diff             @@
##           master    #2224      +/-   ##
==========================================
+ Coverage   84.12%   86.52%   +2.39%
==========================================
  Files         288      232      -56
  Lines       43855    41124    -2731
==========================================
- Hits        36895    35582    -1313
+ Misses       6933     5542    -1391
+ Partials       27        0      -27

Impacted Files
Coverage Δ

python/pyarrow/compat.py
74.24% <57.14%> (-0.35%)
:arrow_down:

cpp/src/arrow/util/thread-pool-test.cc
98.91% <0%> (-0.55%)
:arrow_down:

go/arrow/math/uint64.go

rust/src/error.rs

go/arrow/memory/memory_sse4_amd64.go

go/arrow/math/uint64_avx2_amd64.go

go/arrow/memory/go_allocator.go

rust/src/memory_pool.rs

rust/src/memory.rs

go/arrow/math/int64_sse4_amd64.go

... and 48 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9d1432e...a874471. Read the comment docs.


feat: add support for HTTP proxy in the configuration.

Various LLM model services may require an HTTP proxy for access. Adding proxy configuration options can avoid the hassle of manually configuring environment variables every time they are used.
If the HTTPProxy field is set in the configuration, create an http.Client with the specified proxy URL and use it in the openai.NewClientWithConfig function.

Awesome, thank you for this!


v9 throws error when deploying

We're deploying our service with the following step:
  - name: Deploy Compute@Edge Package
    uses: fastly/compute-actions/deploy@main
    with:
      service_id: ${{ env.serviceID }}
      comment: 'Deployed via GitHub Actions'

With the release of v9 this morning, it's now throwing the error Error: artifact.create is not a function after deploying. This will prevent the subsequent steps from running, but the service will be deployed.

Getting the same errors

Will there be a release with the fix soon?

It's in-process in #63.


Update wallet.md

Description:
Simple typo fix "Provder.call()" -> "Provider.call()"
Notes for reviewer:

Thank you for the PR 😄 !


Document every tool

Manual lives here. The docs are for MVP but they are still valid. Every tool here must have their own README.md as follows:

tools/

run/

main.go
...
README.md

new/

main.go
...
README.md

...

And we can have a list and short descriptions of all supported tools in the root README.md.

Shouldn't this be at it's own repository?

@DavidHunter Well' I don't know. Probably.
The idea was to simplify user's reading of code by providing a README for every subpackage in the repo. That would also help to keep the docs up-to-date: if you're contributing something, you're making changes not only to code, but also to the appropriate README.
But on the other hand, that would require maintaining two versions of docs: in this repo and web-site. And that looks like overkill.
What do you think? Separate repo?

I looked at other open source projects and they have them in separate repo or its in the website repo.
Mongodb has docs in a separate repo. You can git clone it and build a local html version. I think that is a nice feature.

OK, let's use a separate repo then.

It also depends on what you have planned for Colegion. Will you be building other products other then Goal toolkit?

@DavidHunter Yes I will.

We can have the docs in the projects repositories then just parse the docs in each project for the Colegion website.

I will support any your decision regarding this issue.

@DavidHunter, By the way we can rename the project and/or move it into a separate organization if that helps. E.g. how about goal+? goalplus is available GH username for a new organization.
And as for the domain, unfortunately .toolkit does not exist. But there is .tk (as in toolkit). Though don't know whether we can trust it as it is 1) free, 2) the registrar doesn't have SSL certificate. On the other hand, they have a lot of good options such as getgoal.tk, learngoal.tk, goalplus.tk.
Or we can go with a more traditional but also longer .com domain. goalplus.com, goalproject.com, and goaltoolkit.com are taken, goalplustoolkit.com is free.

@DavidHunter Are you still around and interested? If not I'm going to follow my initial plan.

I am still around. Been busy with some stuff.  I want to support your plans.

@DavidHunter Great.
I'm closing this issue as we have already had some kind of documentation for every of the tools. Now we need to work on the quality of the documentation + probably redesign the web-site (orange color, icon with the Sun, etc. is all a legacy of the previous project name).


testcommit

What this PR does / why we need it:
Which issue(s) this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged):
Fixes #
Special notes for your reviewer:

/hold

/ping

/ping

/ping

/retest

/shrug

/cat

/meow

/woof

/joke

/retest

/retest


Admin: Country disaggregations: UI updates

Issues
This ticket covers a number of UI improvements. Some of these items were mocked up but not implemented during Papaya, and I've added some additional refinements.
Note: The mockup in this ticket depicts disaggregation categories as re-orderable, and this is currently not the case. Because this is not a trivial level of effort, we've pulled that UI aspect into another ticket -- #1872.
Acceptance criteria
Small text and layout tweaks

[x] 1. Rename the "Add another option"  button to "Add a category".

[x] 2. Change placeholder text "New Disaggregation type" to "New disaggregation". (Please note sentence case.)

[x] 3. Change the list title "Labels" to "Categories" -- to be consistent with "Add a category".

[x] 4. Move "Add country disaggregation" button to upper right corner
I noticed that Paul's mockup shows the "Add country disaggregation" in a different location than where it is on Production. I think his mockup placement makes the button more visible, and is more consistent with the upper right placement of "add a thing" buttons globally -- users, programs, organizations, indicators, etc.

Streamline process of adding the first option

[x] 1. When I click "Add country disaggregation",  the first option row appears automatically.
Right now, I have to click two different add buttons to add my first disaggregation option. I'd like to see the flow be more similar to indicator setup; when you select the "Event" target frequency, we automatically display your first event row. We don't make you also click "Add an event" for that first event.

Housekeeping

[ ] ~Unit test/s written wherever applicable~
[ ]  i18n tags included wherever applicable
[ ]  Functionality is accessible to people using screen readers

The small text tweaks should be pretty easy but the Streamlining of first-category disaggregation could push the ticket into Medium territory.

Not automating tests for this one as it is >90% text tweaks.  Verified expected behavior in English/French/Spanish, and will add automated tests with #1872

All elements are in place. Needs some styling tweaks. Here's a better snapshot of the mockup without the bottom cut off, for reference:

[ ] 1. "Selected by default" should be a bit closer to the bottom of the disaggregation field above.

[ ] 2. "Selected by default" should be the smaller font size -- same size used for the form label above.

[ ] 3. Add space in between that check box and "Categories".

[ ] 4. "Categories" should be larger font size (not a header size, just the normal body font size), bold, and dark gray.

[ ] 5. Need roughly half the amount of space between the final category text box and the "Add a category" button.

[ ] 6. Need a lot more vertical space between "Add a category" and "Save changes".

Updated mockup in the main ticket to make it easier to compare before/after, and incorporated the new lock icon requested in the comment above.

Looking much better! Just a few more small tweaks:

"Selected by default" should be a bit closer to the bottom of the disaggregation field above.

It's a little bit TOO close now, so that it feels a bit crowded. See how much space there is between the "Disaggregation" label and the top of the text box? Can we have the same amount of space between the checkbox and the bottom of the text box? (I know it's not an exact science, just trying to put into words the look I'm after.)

Add space in between that check box and "Categories".

Needs a bit more space, like about 50% more distance.

Need roughly half the amount of space between the final category text box and the "Add a category" button.

Vertical distance looks better. Can you make the "Add" icon more aligned with the reorder handles? Closer to how it looks in RF builder:

"Order" label is missing, above reordering drop-downs.

Is it fairly easy to have "Order" exactly flush left with the number dropdowns? Here's how it looks on my screen:

If it's NOT easy, having it centered over the dropdown column would also be fine.

When a "Remove" button next to a disaggregation category is disabled, I think people will need an explanation of why it's not editable or removable. Here's an idea: Instead of a disabled "Remove" button, we follow the pattern used in the RF builder and replace it with a lock icon, like so:

On-click, the icon says, "This category cannot be edited or removed because it was used to disaggregate a result."
To be clear, this is only for categories. The "Delete disaggregation" button should remain as is.
Not seeing this update yet... Happy to put it in a new ticket if you prefer -- just let me  know.

After I fill out a field and move on to the next, it has a green outline around it, instead of returning to the previous gray.

And when I'm being corrected, I'd expect the relevant fields to have a red outline. Instead, it's green.

Right now, the numbers are not all right-aligned, and pink background highlighting extends the entire width of the number field, like this:

In Paul's original design for this, he has the pink highlighting behind the number only -- which really draws attention to the delta -- and the numbers are all right-aligned, like this:

Add space in between that check box and "Categories".

Needs a bit more space, like about 50% more distance.

Need roughly half the amount of space between the final category text box and the "Add a category" button.

Vertical distance looks better. Can you make the "Add" icon more aligned with the reorder handles? Closer to how it looks in RF builder:

"Order" label is missing, above reordering drop-downs.

Is it fairly easy to have "Order" exactly flush left with the number dropdowns? Here's how it looks on my screen:

If it's NOT easy, having it centered over the dropdown column would also be fine.

When a "Remove" button next to a disaggregation category is disabled, I think people will need an explanation of why it's not editable or removable. Here's an idea: Instead of a disabled "Remove" button, we follow the pattern used in the RF builder and replace it with a lock icon, like so:

On-click, the icon says, "This category cannot be edited or removed because it was used to disaggregate a result."
To be clear, this is only for categories. The "Delete disaggregation" button should remain as is.
Not seeing this update yet... Happy to put it in a new ticket if you prefer -- just let me  know.

There are a couple of scenarios where it would be nice if we focused on the first input field so I can just start typing:

I click "Add a new country disaggregation". It'd be nice if the Disaggregation field already had focus so I can start typing.

I click "Add category". It would be nice if the new category field had focus so I can start typing. It looks like the button retains the focus -- stays highlighted, etc.

Everything looks good except for one issue -- https://github.com/mercycorps/TolaActivity/issues/1503#issuecomment-569141703 -- and I created a new ticket for it.
Moving this to Passed!


Fixes on agent suggestion and blinking cursor

AgentSuggestion: fix click on dropdown wihout handle, set dropdown origin to auto
Blinking cursor: works also for list items and nested content

Done and closing this PR


Model view across multiple tables

This issue is more of a question. How do you use a model view that incorporates a join between one or more tables in DBFlow? I see examples for a single table, but none for the aforementioned use case.

Nevermind, I found information on how to do so. I have to use a QueryModel.


Situation Awareness:  Add "Remove Incident" option in popup

Like we have the "Set as incident" option on the bottom of the popup window, we want to add an additional option: "Remove Incident" that becomes available if the incident has already been saved back to the feature service.  Clicking the "Remove Incident" option should then delete that incident feature from the feature service.

I was not thinking about this all the way through when we talked the other day. We are past string freeze and this would require NLS updates.

Widget is back in Beta, we were able to go ahead and make string changes.  This change was implemented as a "Delete" button on the feature popup:


create a service to run blazegraph on corefacility

as required by https://github.com/superphy/backend/issues/159
currently running on screen in /Warehouse/Users/claing/superphy/spfy/docker-blazegraph/2.1.4-inferencing using command java -server -Xmx4g -Dbigdata.propertyFile=/Warehouse/Users/claing/superphy/spfy/docker-blazegraph/2.1.4-inferencing/RWStore.properties -jar blazegraph.jar

I'll likely setup jetty on the corefacility VM to run blazegraph. We are in an odd deployment atm., to get around permission issues required to write on /Warehouse, so hoping this might help with https://github.com/superphy/backend/issues/187

Jetty has been setup using claing as the user to address permission issues. Seems to be working, see https://github.com/superphy/backend/issues/187#issuecomment-346887375 . Closing issue.


Add ingress class name configuration

What this PR does / why we need it:
To allow selecting specific ingress controller when using RawDeployment
Which issue(s) this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged):
Fixes #2048
Type of changes
Please delete options that are not relevant.

[x] New feature (non-breaking change which adds functionality)

Feature/Issue validation/testing:

[x] Run the controller with and without ingress class name in cluster and create inference service

Logs
Ingress generated when ingress class name is set to "istio"

apiVersion: networking.k8s.io/v1
kind: Ingress
metadata:
    queue.sidecar.serving.knative.dev/resourcePercentage: "20"
  creationTimestamp: "2022-02-18T09:48:52Z"
  generation: 1
  name: xgboost-sample-413
  namespace: test
  resourceVersion: "10446008"
  uid: 79862c9c-e97f-4da9-9d58-e39a0b5481b5
spec:
  ingressClassName: istio
  rules:
  - host: xgboost-sample-413-test.example.com
    http:
      paths:
      - backend:
          service:
            name: xgboost-sample-413-predictor-default
            port:
              number: 80
        path: /
        pathType: Prefix
  - host: xgboost-sample-413-predictor-default-test.example.com
    http:
      paths:
      - backend:
          service:
            name: xgboost-sample-413-predictor-default
            port:
              number: 80
        path: /
        pathType: Prefix

Checklist:

[x] Have you added unit/e2e tests that prove your fix is effective or that this feature works?
[x] Has code been commented, particularly in hard-to-understand areas?
[x] Have you made corresponding changes to the documentation?

Release note:

Add `ingressClassName` configuration to allow selecting specific ingress controller for RawDeployment

/ok-to-test

PR for doc update https://github.com/kserve/website/pull/113

The last e2e fails are unrelated to the PR
FAILED predictor/test_multi_model_serving.py::test_mms_sklearn_kserve[v2-gs://seldon-models/sklearn/mms/lr_model]
FAILED predictor/test_xgboost.py::test_xgboost_v2_runtime_kserve - requests.e...

/retest

/retest

@yuzisun Ready to be reviewed again

Thanks @pradithya !
/lgtm
/approve


Add Footer

Add footer for more interactive

I want to contribute to this project as gssoc-ext contributor . please assign this issue to me.
Please mention all the things that i should add in footer along with that please label this issue as gssoc or gssoc-ext.

I want to contribute to this project as gssoc-ext contributor . please assign this issue to me.
Please mention all the things that i should add in footer along with that please label this issue as gssoc or gssoc-ext.

I want to contribute to this project. My experience with HTML, CSS and JavaScript will provide great assistance. Along with that i have knowledge of UI/UX.

I want to contribute to this project as gssoc-ext contributor . please assign this issue to me.
Please mention all the things that i should add in footer along with that please label this issue as gssoc or gssoc-ext.

can you assign this to me I will work on it I will make my best

assign me this issue

can you plzzz assign i will do my best

@shivamy009  he can you please assign this issue to me I will make my best


Rename Util to Helper

Q
A

Branch?
v2.0(master)

Bug fix?
No

New feature?
No

Deprecations?
No

Internal Changed?
Yes

Removed
No

Tests pass?
Yes

Doc pr?
No

This commit modifies Util, renames it to Helper, and modifies access permissions to internal.

Codecov Report

Merging #230 into master will decrease coverage by <.01%.
The diff coverage is 100%.

@@            Coverage Diff             @@
##           master     #230      +/-   ##
==========================================
- Coverage   96.01%   96.01%   -0.01%
==========================================
  Files          31       31
  Lines        2660     2659       -1
==========================================
- Hits         2554     2553       -1
  Misses        106      106

Impacted Files
Coverage Δ

src/CatLib.Core/Support/Helper.cs
100% <ø> (ø)

src/CatLib.Core/CatLib/Application.cs
99.34% <100%> (+0.04%)
:arrow_up:

src/CatLib.Core/Support/Str.cs
99.46% <100%> (ø)
:arrow_up:

src/CatLib.Core/Support/Arr.cs
98.72% <100%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update cb3cb03...f9fce85. Read the comment docs.


Add "branch" option to Env vars

Travis released the env var per branch feature.
https://changelog.travis-ci.com/environment-variables-per-branch-109051
And API v3 supports the option as well.
https://developer.travis-ci.com/resource/env_var#Env var
This PR makes the option available on go-travis.

@shuheiktgw
Please take a look at this, than you.

Thanks for your PR! 👍 I'll review this PR this weekend, so give me a few days!

LGTM 👍
Sorry for my tardy review...


Failed to connect to MSI to create service principle

Describe the bug
I am following a lab in MS Learn https://microsoftlearning.github.io/mslearn-ai-services/Instructions/Exercises/02-ai-services-security.html#secure-key-access-with-azure-key-vault.
The part creating service principle stopped me.
Related command
az ad sp create-for-rbac -n "api://" --role owner --scopes subscriptions//resourceGroups/
Errors
Failed to connect to MSI. Please make sure MSI is configured correctly.
Get Token request returned: <Response [400]>
Issue script & Debug output
cli.knack.cli: Command arguments: ['ad', 'sp', 'create-for-rbac', '-n', 'api://ai-app',
'--role', 'owner', '--scopes', 'subscriptions/c46ffa71-c974-4749-a21a-f9ce60c39b67/resourceGroups/AItest', '--debug']
cli.knack.cli: init debug log:
Enable color in terminal.
cli.knack.cli: Event: Cli.PreExecute []
cli.knack.cli: Event: CommandParser.OnGlobalArgumentsCreate [<function CLILogging.on_global_arguments at 0x7fbce3086160>, <function OutputProducer.on_global_arguments at 0x7fbce2fa0d30>, <function CLIQuery.on_global_arguments at 0x7fbce2f37310>]
cli.knack.cli: Event: CommandInvoker.OnPreCommandTableCreate []
cli.azure.cli.core: Modules found from index for 'ad': ['azure.cli.command_modules.role']
cli.azure.cli.core: Loading command modules:
cli.azure.cli.core: Name                  Load Time    Groups  Commands
cli.azure.cli.core: role                      0.004        17        61
cli.azure.cli.core: Total (1)                 0.004        17        61
cli.azure.cli.core: These extensions are not installed and will be skipped: ['azext_next']
cli.azure.cli.core: Loading extensions:
cli.azure.cli.core: Name                  Load Time    Groups  Commands  Directory
cli.azure.cli.core: ai-examples               0.114         1         1  /usr/lib/python3.9/site-packages/azure-cli-extensions/ai-examples
cli.azure.cli.core: Total (1)                 0.114         1         1
cli.azure.cli.core: Loaded 18 groups, 62 commands.
cli.azure.cli.core: Found a match in the command table.
cli.azure.cli.core: Raw command  : ad sp create-for-rbac
cli.azure.cli.core: Command table: ad sp create
cli.azure.cli.core: remaining    :              for-rbac
cli.knack.cli: Event: CommandInvoker.OnPreCommandTableTruncate [<function AzCliLogging.init_command_file_logging at 0x7fbce23e7820>]
cli.azure.cli.core.azlogging: metadata file logging enabled - writing logs to '/home/sylvia/.azure/commands/2024-08-13.15-48-37.ad_sp_create-for-rbac.6754.log'.
az_command_data_logger: command args: ad sp create-for-rbac -n {} --role {} --scopes {}
--debug
cli.knack.cli: Event: CommandInvoker.OnPreArgumentLoad [<function register_global_subscription_argument..add_subscription_parameter at 0x7fbce238f430>]
cli.knack.cli: Event: CommandInvoker.OnPostArgumentLoad []
cli.knack.cli: Event: CommandInvoker.OnPostCommandTableCreate [<function register_ids_argument..add_ids_arguments at 0x7fbce23b5430>, <function register_cache_arguments..add_cache_arguments at 0x7fbce235b310>]
cli.knack.cli: Event: CommandInvoker.OnCommandTableLoaded []
cli.knack.cli: Event: CommandInvoker.OnPreParseArgs []
cli.knack.cli: Event: CommandInvoker.OnPostParseArgs [<function OutputProducer.handle_output_argument at 0x7fbce2fa0dc0>, <function CLIQuery.handle_query_parameter at 0x7fbce2f373a0>, <function register_ids_argument..parse_ids_arguments at 0x7fbce235b280>]cli.azure.cli.core.util: Retrieving token for resource https://graph.microsoft.com/
urllib3.connectionpool: Starting new HTTP connection (1): localhost:50342
urllib3.connectionpool: http://localhost:50342 "POST /oauth2/token HTTP/1.1" 400 126
msrestazure.azure_active_directory: MSI: Retrieving a token from http://localhost:50342/oauth2/token, with payload {'resource': 'https://graph.microsoft.com/'}
msrestazure.azure_active_directory: MSI: Failed to retrieve a token from 'http://localhost:50342/oauth2/token' with an error of '400 Client Error: Bad Request for url: http://localhost:50342/oauth2/token'. This could be caused by the MSI extension not yet fully provisioned.
cli.azure.cli.core.auth.adal_authentication: throw requests.exceptions.HTTPError when doing MSIAuthentication:
Traceback (most recent call last):
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/auth/adal_authentication.py", line 75, in set_token
super().set_token()
File "/usr/lib64/az/lib/python3.9/site-packages/msrestazure/azure_active_directory.py", line 598, in set_token
self.scheme, _, self.token = get_msi_token(self.resource, self.port, self.msi_conf)
File "/usr/lib64/az/lib/python3.9/site-packages/msrestazure/azure_active_directory.py", line 486, in get_msi_token
result.raise_for_status()
File "/usr/lib64/az/lib/python3.9/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 400 Client Error: Bad Request for url: http://localhost:50342/oauth2/token
cli.azure.cli.core.azclierror: Traceback (most recent call last):
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/auth/adal_authentication.py", line 75, in set_token
super().set_token()
File "/usr/lib64/az/lib/python3.9/site-packages/msrestazure/azure_active_directory.py", line 598, in set_token
self.scheme, _, self.token = get_msi_token(self.resource, self.port, self.msi_conf)
File "/usr/lib64/az/lib/python3.9/site-packages/msrestazure/azure_active_directory.py", line 486, in get_msi_token
result.raise_for_status()
File "/usr/lib64/az/lib/python3.9/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 400 Client Error: Bad Request for url: http://localhost:50342/oauth2/token
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/auth/adal_authentication.py", line 87, in set_token
.format(err.response.status, err.response.reason))
AttributeError: 'Response' object has no attribute 'status'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib64/az/lib/python3.9/site-packages/knack/cli.py", line 233, in invoke
cmd_result = self.invocation.execute(args)
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/init.py",
line 664, in execute
raise ex
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/init.py",
line 731, in _run_jobs_serially
results.append(self._run_job(expanded_arg, cmd_copy))
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/init.py",
line 723, in _run_job
return cmd_copy.exception_handler(ex)
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/command_modules/role/commands.py", line 51, in graph_err_handler
raise ex
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/init.py",
line 701, in _run_job
result = cmd_copy(params)
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/init.py",
line 334, in call
return self.handler(*args, **kwargs)
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/commands/command_operation.py", line 121, in handler
return op(**command_args)
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/command_modules/role/custom.py", line 1174, in create_service_principal_for_rbac
existing_sps = list(graph_client.service_principal_list(filter=query_exp))
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/command_modules/role/_msgrpah/_graph_client.py", line 179, in service_principal_list
result = self._send("GET", "/servicePrincipals" + _filter_to_query(filter))
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/command_modules/role/_msgrpah/_graph_client.py", line 52, in _send
r = send_raw_request(self._cli_ctx, method, url, resource=self._resource, uri_parameters=param,
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/util.py", line 983, in
send_raw_request
token_info, _, _ = profile.get_raw_token(resource)
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/_profile.py", line 401, in get_raw_token
msi_creds = MsiAccountTypes.msi_auth_factory(MsiAccountTypes.system_assigned, identity_id,
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/_profile.py", line 734, in msi_auth_factory
return MSIAuthenticationWrapper(resource=resource)
File "/usr/lib64/az/lib/python3.9/site-packages/msrestazure/azure_active_directory.py", line 592, in init
self.set_token()
File "/usr/lib64/az/lib/python3.9/site-packages/azure/cli/core/auth/adal_authentication.py", line 89, in set_token
raise AzureResponseError('Failed to connect to MSI. Please make sure MSI is configured correctly.\n'
azure.cli.core.azclierror.AzureResponseError: Failed to connect to MSI. Please make sure MSI is configured correctly.
Get Token request returned: <Response [400]>
cli.azure.cli.core.azclierror: Failed to connect to MSI. Please make sure MSI is configured correctly.
Get Token request returned: <Response [400]>
az_command_data_logger: Failed to connect to MSI. Please make sure MSI is configured correctly.
Get Token request returned: <Response [400]>
cli.knack.cli: Event: Cli.PostExecute [<function AzCliLogging.deinit_cmd_metadata_logging at 0x7fbce23e7a60>]
az_command_data_logger: exit code: 1
cli.main: Command ran in 40.375 seconds (init: 0.104, invoke: 40.271)
telemetry.main: Begin splitting cli events and extra events, total events: 1
telemetry.client: Accumulated 0 events. Flush the clients.
telemetry.main: Finish splitting cli events and extra events, cli events: 1
telemetry.save: Save telemetry record of length 4045 in cache
telemetry.main: Begin creating telemetry upload process.
telemetry.process: Creating upload process: "/usr/bin/python3.9 /usr/lib/az/lib/python3.9/site-packages/azure/cli/telemetry/init.py /home/sylvia/.azure"
telemetry.process: Return from creating process
telemetry.main: Finish creating telemetry upload process.
Expected behavior
Output of the code should be something like
{
    "appId": "abcd12345efghi67890jklmn",
    "displayName": "api://ai-app-",
    "password": "1a2b3c4d5e6f7g8h9i0j",
    "tenant": "1234abcd5678fghi90jklm"
}

Environment Summary
{
"azure-cli": "2.62.0",
"azure-cli-core": "2.62.0",
"azure-cli-telemetry": "1.1.0",
"extensions": {
"ai-examples": "0.2.5",
"ml": "2.28.0",
"ssh": "2.0.5"
}
}
Additional context
Previous issues suggested I might use az login. but I had login by browser when opening Azure Cloud Powershell. The following command and return indicated the successful login.
az account show
{
"environmentName": "AzureCloud",
"homeTenantId": "5b973f99-77df-4beb-b27d-aa0c70b8482c",
"id": "c46ffa71-c974-4749-a21a-f9ce60c39b67",
"isDefault": true,
"managedByTenants": [],
"name": "Visual Studio Professional Subscription - Tim",
"state": "Enabled",
"tenantId": "5b973f99-77df-4beb-b27d-aa0c70b8482c",
"user": {
"cloudShellID": true,
"name"<EMAIL_ADDRESS>"type": "user"
}
}
The following command and return not able to let me re-login because company's policy not allow that.
az login
Cloud Shell is automatically authenticated under the initial account signed-in with. Run 'az login' only if you need to use a different account
To sign in, use a web browser to open the page https://microsoft.com/devicelogin and enter the code S76HWXNWM to authenticate.
Additionally, even in the lab in MS Learn, I am not able to login Azure. It direct me to the following page with url "
Login failed"

Thank you for opening this issue, we will look into it.

The requests.exceptions.HTTPError: 400 Client Error: Bad Request for url: http://localhost:50342/oauth2/token error could be related to https://github.com/Azure/azure-cli/issues/11749. I will contact Cloud Shell team internally.
As for the access_denied, @rayluo, are you aware of this failure which doesn't have error_description or error_uri?

Additionally, even in the lab in MS Learn, I am not able to login Azure. It direct me to the following page with url
"Login failed" http://localhost:50120/?error=access_denied&error_subcode=cancel&state=TlfchDPFkwdVXqmA)

As for the access_denied, @rayluo, are you aware of this failure which doesn't have error_description or error_uri?

Not sure. Better have a repro before we can investigate.


Add the ability to access files inside templates

Description of your changes

Similarly as Helm template does through the .Files object, we might need to literally inject vanilla files into a template. For example, rather than including the terraform code into workspaces.tf.upbound.io, we might do:
apiVersion: tf.upbound.io/v1beta1
kind: Workspace
spec:
  forProvider:
    source: Inline
    module: {{ readFile "files/workspace.tf" | quote }}
    # module: {{ readFiles "files/*.tf" "\n" | quote }} # alternatively

and keep files separatedly, easier to maintain.
I have:

[x] Read and followed Crossplane's contribution process.
[x] Added or updated unit tests for my change.

Just to add more clarity on the usecase, the idea is to inject some files "as is". These files are copied in configMaps which are:

created by kustomize

configMapGenerator:
- name: karpenter
  namespace: crossplane-system
  files:
  - terraform/variables.tf
  - terraform/main.tf
  - terraform/data.tf
generatorOptions:
  disableNameSuffixHash: true
  labels:
    part-of: function-go-templating
  annotations:
    k8s-sidecar-target-directory: terraform

read and injected via DeploymentRuntimeConfig this way:

apiVersion: pkg.crossplane.io/v1beta1
kind: DeploymentRuntimeConfig
metadata:
  name: function-go-templating
  # DeploymentRuntimeConfig is not namespaced, but this is required by
  # kustomize to properly inject the generated ConfigMap
  namespace: crossplane-system
spec:
  deploymentTemplate:
    metadata:
      labels:
        kubernetes.io/part-of: crossplane
    spec:
      selector: {}
      template:
        spec:
          containers:
          - name: configmap-mounter
            env:
            # All configmaps labeled `part-of: function-go-templating` will be
            # mounted in `/templates`
            - name: LABEL
              value: part-of
            - name: LABEL_VALUE
              value: function-go-templating
            - name: FOLDER
              value: /templates
            image: kiwigrid/k8s-sidecar:1.25.4
            imagePullPolicy: IfNotPresent
            volumeMounts:
            - mountPath: /templates
              name: templates
          - name: package-runtime
            args:
            - --debug
            volumeMounts:
            - name: templates
              mountPath: /templates
          volumes:
          - name: templates
            emptyDir: {}
  serviceAccountTemplate:
    metadata:
      name: function-go-templating # required by rolebinding
---
kind: Role
apiVersion: rbac.authorization.k8s.io/v1
metadata:
  namespace: crossplane-system
  name: template-replication
rules:
- apiGroups: [""]
  resources: ["configmaps"]
  verbs: ["get", "watch", "list"]
---
kind: RoleBinding
apiVersion: rbac.authorization.k8s.io/v1
metadata:
  name: template-replication
  namespace: crossplane-system
subjects:
- kind: ServiceAccount
  name: function-go-templating
  namespace: crossplane-system
roleRef:
  kind: Role
  name: template-replication
  apiGroup: rbac.authorization.k8s.io


Add pagination back

I removed it because it seemed not to work.  Let’s not play with jPages, let’s produce something better.

I doubt it will be necessary.  No pagination is easier for search.


add dell inspiron-5515

I have been testing this for about a month.

Just mark as ready, when you are ready.


Enable disabling of certain dates

Types of changes

[ ] Bugfix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)

Description

Added a disabledDates props which holds an array of dates to be disabled. These days will be rendered with the disabled props.
Also handles the case when you would select a range that includes one of the disabled dates.
Added an example using this feature to the demo

Related Issue: #213

should be ok now


How disable NotFoundHandler on virtual paths?

Hi @marisks this looks good, so wanted to take NotFoundHandler on a testdrive.
BUT we are using https://github.com/ligershark/WebOptimizer for CSS and Javascript bundling.
We do register weboptimizer like this
services.AddWebOptimizer(pipeline => { pipeline.AddCssBundle("/css/bundle.css", "/**/*.css"); pipeline.AddJavaScriptBundle("/js/bundle.js", "js/**/*.js"); });

Seems when we installed NotFoundHandler this stopped to work, is the NotFoundHandler hijacking the pipeline somehow? When we remove the AddNotFoundHandler the css bundling is working, any idea?

It is just a Razor library with default ASP.NET config. No special treatment was done.
You might try to ignore the NotFoundHandler script and CSS:
/_content/Geta.NotFoundHandler.Admin/css/dashboard.css
/_content/Geta.NotFoundHandler.Admin/js/dashboard.js

We have the same problem with the NotFoundHandler and WebOptimizer.
We have verified that by removing the module bundles work as before.

have you tryed with the latest version of weboptimizer? @haugsten it seems they might have fixed it in weboptimizer ... https://github.com/ligershark/WebOptimizer.Sass/issues/34 (i havent got the time to test)

We are using WebOptimizer.Core and latest version does not fix the problem. But we where able fix the problem by moving the resources outside wwwroot folder and use .UseContentRoot() extension.
                 pipeline.AddCssBundle("/static/css/bundle.css",                     "Static/css/bootstrap.min.css",                     "Static/css/styles.min.css").UseContentRoot();

@marisks In the public static IServiceCollection AddOptimizelyNotFoundHandler you are calling this services.AddCmsUI(); What is the reason for this? This will be done by Optimizely and not handled by the module?

@oyvindwh The code for module initialization was taken from the Optimizely example. Probably early versions needed this call.
Does it cause any issues? I can remove it and push new packages.

I have removed the call to CmsUI and published the packages.

Is this fixed by WebOptimizer already and we can close the issue?

Closing as it is WebOptimizer issue.


Velocity > 1

Hi, i am using your excellent library to send a recieve signals from my APC Mini.
In order to debug and play around with it I have mapped all of my pads to a virtual interface of checkboxes and range sliders, and have it set up to detect the 'noteoff' event when i press any of the pads. I managed to find some basic docs for the mini which show the pad IDs which saved me a bit of time, and also noticed that i can send a signal back to the pad to tell the pad to stay lit once pressed, but in order to do this i need to be able to send a velocity signal > 1 back to it. I got it working by removing the check on line 2652 in your library but just wondered if theres a cleaner way to do it? my code to set the LEDs on the pads is provided below for clarity, and the original graphic i found which steered me in the right direction.

output.playNote(56, 'all', {velocity:0});  // off
output.playNote(56, 'all', {velocity:1});  // green
output.playNote(56, 'all', {velocity:2});  // green_blink
output.playNote(56, 'all', {velocity:3});  // red
output.playNote(56, 'all', {velocity:4});  // red_blink
output.playNote(56, 'all', {velocity:5});  // yellow
output.playNote(56, 'all', {velocity:6});  // yellow_blink

any ideas?
any if anyone is interested i can upload my virtual APC mini interface, preumably it would only require slight modifications to be used with other similar devices.

In MIDI, the velocity is set using an integer between 0 and 127. However, in this library, the velocity is set using a decimal number between 0 and 1 which is usually easier to work with. This means that if you want to send an actual MIDI velocity value of 6 you would need to do the following:
output.playNote(56, 'all', {velocity: 0.047});

This would result in the value 6 being sent because 0.047 × 127 = 6 (once rounding has been applied).
Obviously, in your case, this is a bit silly and counter-intuitive. For that reason, I added an option to both playNote() and stopNote(). With that option, you will be able to send raw velocity values:
output.playNote(56, 'all', {velocity: 6, rawVelocity: true});

To make it consistent, I also added a rawVelocity property to incoming MIDI message.
Those changes are available in release v2.0.0-beta.2 on GitHub and NPM.

i understand. superb!


🎢 Ethers v6

any update here please?

@yivlad hi! any update here please? I really need it with Ethers v6...

Hey @AntonioVentilii
Unfortunately I no longer maintain this project. Not sure if it's maintained at all... So can't really help you.


Column name updated automatically when filtering related column with same column name

Summary of problem
I have a User datatable where I also display the Role name assigned to the user, for ACL I use Laratrust.
key thing to note is user name and role name both are displayed in the table ans we have column filter setup on the same.
The problem is when I filter roles name column all names in my user.name column gets updated to filtered role name.
Code snippet of problem
Following code is from class UsersDataTable extends DataTable {
Note that I use eager loading ->with('roles') on related roles table.

public function query(User $model)
	{
		$columns = [
			'users.id', 'users.name', 'users.email', 'users.verified', 'users.active', 'users.created_at',
			'users.updated_at',
		];
		$scope = $model->newQuery()->with('roles')->select($columns);
		if(!Laratrust::hasRole('superadmin')){
			return $scope->where('current_team_id', Auth::user()->currentTeam->id);
		}
		return $scope;
	}

and to show the roles name column
->editColumn('roles.name', function ($user) {
				return $user->roles->pluck('name')->implode(', ');
			})

System details

Operating System Ubuntu 16.04
PHP Version 1.7
Laravel Version 5.6
Laravel-Datatables Version 8.7

Screenshots

After applying filter see the Name column

I added a filter on my roles.name column as following, and it seems to work now. Is there any better solution than this?
		->filterColumn('roles.name', function ($query, $keyword) {
			$query->whereHas('roles', function ($query) use ($keyword) {
				$query->where('name',$keyword);
			});
		})

I am experiencing the exact same problem. My master table books has a title column. The related table categories also has a column called title. As soon as I click to order the category column, all columns with the same name in the books table get overriden (even id).
I set up a new project with fresh dependencies. The same code works in an older version (Laravel 5.6, Laravel-Datatables 8.9.2).

Update: its fixed if I do this:
return datatables()->eloquent(Book::select([
            'books.*',
        ])->with($with))->toJson();

https://github.com/yajra/laravel-datatables/issues/1231


6.0.0-beta.6 does not install plugins - npm run test fail with "Cannot find module '@angular/cli/plugins/karma'"

Versions
<!--
Output from: `ng --version`.
If nothing, output from: `node --version` and `npm --version`.
  Windows (7/8/10). Linux (incl. distribution). macOS (El Capitan? Sierra?)
-->
Angular CLI: 6.0.0-beta.6
Node: 9.8.0
OS: win32 x64
Angular: 5.2.9
... animations, common, compiler, compiler-cli, core, forms
... http, language-service, platform-browser
... platform-browser-dynamic, router

@angular/cli: 6.0.0-beta.6
@angular-devkit/architect: 0.0.7
@angular-devkit/build-optimizer: 0.4.6
@angular-devkit/build-webpack: 0.0.7
@angular-devkit/core: 0.4.6
@angular-devkit/schematics: 0.4.6
@ngtools/json-schema: 1.2.0
@ngtools/webpack: 6.0.0-beta.6
@schematics/angular: 0.4.6
@schematics/package-update: 0.4.6
typescript: 2.5.3
webpack: 4.1.1

Repro steps

Use Angular-CLI version 6.0.0-beta.6 to create new app and run npm run test

Observed behavior
<!-- Normally this includes a stack trace and some more information. -->
18 03 2018 22:04:52.691:ERROR [config]: Error in config file!
 { Error: Cannot find module '@angular/cli/plugins/karma'
    at Function.Module._resolveFilename (module.js:543:15)
    at Function.Module._load (module.js:470:25)
    at Module.require (module.js:593:17)
    at require (internal/module.js:11:18)
    at module.exports (c:\ngcli6test\abc\karma.conf.js:13:7)
    at Object.parseConfig (c:\ngcli6test\abc\node_modules\karma\lib\config.js:416:5)
    at new Server (c:\ngcli6test\abc\node_modules\karma\lib\server.js:79:20)
    at Observable_1.Observable.obs [as _subscribe] (c:\ngcli6test\abc\node_modules\@angular-devkit\build-webpack\src\karma\packages\angular_devkit\build_webpack\src\karma\index.ts:105:27)
    at Observable._trySubscribe (c:\ngcli6test\abc\node_modules\src\Observable.ts:217:19)
    at Observable.subscribe (c:\ngcli6test\abc\node_modules\src\Observable.ts:202:87)
    at Object.subscribeToResult (c:\ngcli6test\abc\node_modules\src\util\subscribeToResult.ts:34:21)
    at MergeMapSubscriber._innerSub (c:\ngcli6test\abc\node_modules\src\operators\mergeMap.ts:138:14)
    at MergeMapSubscriber._tryNext (c:\ngcli6test\abc\node_modules\src\operators\mergeMap.ts:134:10)
    at MergeMapSubscriber._next (c:\ngcli6test\abc\node_modules\src\operators\mergeMap.ts:118:12)
    at MergeMapSubscriber.Subscriber.next (c:\ngcli6test\abc\node_modules\src\Subscriber.ts:96:12)
    at MapSubscriber._next (c:\ngcli6test\abc\node_modules\src\operators\map.ts:83:22) code: 'MODULE_NOT_FOUND' }

Desired behavior

Mention any other details that might be useful (optional)
Using Angular-CLI 1.7.0 to create application generates plugins folder under @angular\cli - it is missing in Angular-CLI 6.0.0-beta.6

Same here!

Same here too!

Any temporary solution for this?

You need to replace @angular/cli by @angular-devkit/build-webpack in karma.conf.js.
But there are a lot of breaking changes in this beta release: if you want to use the CLI without trouble, you should stay on 1.7.x for now.

beta.3 is good enough!

Yup, but beta.6 introduced architect, and a lot of things changed (command flags have been removed or renamed, config files have changed...).

Just to close the loop here, following @cexbrayat's suggestion, my working karma.conf.js now looks like:
module.exports = function (config) {
  config.set({
    basePath: '',
    frameworks: ['jasmine', '@angular-devkit/build-webpack'],
    plugins: [
      require('karma-jasmine'),
      require('karma-chrome-launcher'),
      require('karma-jasmine-html-reporter'),
      require('karma-coverage-istanbul-reporter'),
      require('@angular-devkit/build-webpack/plugins/karma')
    ],
    client:{
      clearContext: false // leave Jasmine Spec Runner output visible in browser
    },
    coverageIstanbulReporter: {
      reports: [ 'html', 'lcovonly' ],
      fixWebpackSourcePaths: true
    },
    angularCli: {
      environment: 'dev'
    },
    reporters: ['progress', 'kjhtml'],
    port: 9876,
    colors: true,
    logLevel: config.LOG_INFO,
    autoWatch: true,
    browsers: ['Chrome'],
    customLaunchers: {
      ChromeNoSandbox: {
        base: 'Chrome',
        flags: ['--no-sandbox']
      }
    },
    singleRun: false
  });
};

I'm using:

angular 6.0.0-rc.0 (all angular dependencies)
@angular/cli": "6.0.0-beta.6"
added "@angular-devkit/build-webpack": "0.0.7"

@filipesilva can we close the issue or it's still valid after architect?

Please try the latest stable release. If you still hit the same problem file a new issue.


Create initial camera model with forward and inverse projection methods

Resolved with https://github.com/yangjames/Calico/commit/cb26c0ea772e847fda4d0415a3a2f1b9b9594796


Location of templates

Is actually possible to store templates in a different place than settings.json? I feel this not very convenient...

As of now that's the only place to store templates as I felt that was alot more convenient. But I'm open to suggestions, what would you prefer?
Would you like to save the complete directory at the root of the project? Or in some global vscode folder?

Hi, in my opinion, I think that a dedicated folder would be a good choice.


Change osm.org to openstreetmap.org in docs

In the docs the example is:
L.tileLayer('http://{s}.tile.osm.org/{z}/{x}/{y}.png', {
  attribution: '© OpenStreetMap contributors'
}).addTo(map);

osm.org is just for convenience in typing it into your browser.  But his causes a problem when using ssl.  You actually need to use {s}.tile.openstreetmap.org/{z}/{x}/{y}.png.  So why not change it to that in the docs?

Because nobody has done that yet? Feel free to submit a pull request with the changes.

I guess this was fixed by #5130


SAA-1282 missed off original PR. We now also need to raise allocation amend events when we update allocations.

This was missed off the original bug fix PR here

Codecov Report
All modified lines are covered by tests :white_check_mark:

Files
Coverage Δ

...ivitiesmanagementapi/service/AllocationsService.kt
85.91% <100.00%> (+1.78%)
:arrow_up:

... and 1 file with indirect coverage changes
:loudspeaker: Thoughts on this report? Let us know!.


when froge swim

pls add froge swim feature to froget roll sumer update.

@TaromaruYuki feature reqeust

froge swimming in summer 2023, froge roool ths yer


Extend the fetchplan format parameter of the ODocument.toJSON()

Hi,
how discussed in the forum ( http://bit.ly/14dyUHG ), it would useful to have a new value to set in the fetchplan to avoid a field creation in the JSON string.
It would also be useful if this value can be propagated to all the linked documents  traversed by the toJSON() method

Not relevant anymore, in v3.0 fetchplan are deprecated in favor of new SELECT extended projections


Research billingual git repo

One found be @gabrielcossette that might be good enough
https://codeberg.org/?lang=fr-FR

Clients and Suppliers can choose to use source code repo of their choice.
Gitlab will be recommended (multilingual) for teams that don't already have work on Github or others.
Supplier can work on Client's repo or choose other and send link to branch by email.
Supplier could also work locally and send branch or patch by email.


Preview and conversion to HTML fails

The preview of Markdown files (Markdown Preview: Preview in Browser > markdown) and the conversion to HTML (Build with: Markdown) fails
when images are included:
![image text](relative/path/to/image.png)

The error message is as follows:
Traceback (most recent call last):
  File "C:\Program Files\Sublime Text 3\sublime_plugin.py", line 553, in run_
    return self.run()
  File "MarkdownPreview in C:\Users\plath\AppData\Roaming\Sublime Text 3\Installed Packages\Markdown Preview.sublime-package", line 1320, in run
  File "MarkdownPreview in C:\Users\plath\AppData\Roaming\Sublime Text 3\Installed Packages\Markdown Preview.sublime-package", line 768, in run
  File "MarkdownPreview in C:\Users\plath\AppData\Roaming\Sublime Text 3\Installed Packages\Markdown Preview.sublime-package", line 709, in convert_markdown
  File "MarkdownPreview in C:\Users\plath\AppData\Roaming\Sublime Text 3\Installed Packages\Markdown Preview.sublime-package", line 1105, in parser_specific_convert
  File "markdown in C:\Users\plath\AppData\Roaming\Sublime Text 3\Installed Packages\Markdown Preview.sublime-package", line 384, in convert
  File "markdown.treeprocessors in C:\Users\plath\AppData\Roaming\Sublime Text 3\Installed Packages\Markdown Preview.sublime-package", line 295, in run
  File "markdown.treeprocessors in C:\Users\plath\AppData\Roaming\Sublime Text 3\Installed Packages\Markdown Preview.sublime-package", line 106, in __handleInline
  File "markdown.treeprocessors in C:\Users\plath\AppData\Roaming\Sublime Text 3\Installed Packages\Markdown Preview.sublime-package", line 239, in __applyPattern
  File "markdown.inlinepatterns in C:\Users\plath\AppData\Roaming\Sublime Text 3\Installed Packages\Markdown Preview.sublime-package", line 428, in handleMatch
  File "markdown.inlinepatterns in C:\Users\plath\AppData\Roaming\Sublime Text 3\Installed Packages\Markdown Preview.sublime-package", line 245, in unescape
  File "markdown.inlinepatterns in C:\Users\plath\AppData\Roaming\Sublime Text 3\Installed Packages\Markdown Preview.sublime-package", line 244, in get_stash
NameError: global name 'itertext' is not defined

The problem arises for

Windows 7 (didn't test other OSses)
Sublime Text 3 (build 3114)
Markdown Preview (1.4.0)

I'll take a look at your pull.  Looks like I probably missed this.  Thanks!


[website]Add Configuration documentation

Description
Add a new website page about the configuration of compiling the website.
Checklist
Essentials

[x] PR's title starts with a category (e.g. [BUGFIX], [MODEL], [TUTORIAL], [FEATURE], [DOC], etc)
[x] Changes are complete (i.e. I finished coding on this PR)
[x] All changes have test coverage
[x] Code is well-documented

Changes

[ ] Feature1, tests, (and when applicable, API doc)
[ ] Feature2, tests, (and when applicable, API doc)

Comments

If this change is a backward incompatible change, why must this change be made.
Interesting edge cases to note here

cc @dmlc/gluon-nlp-team

Job PR-1179/1 is complete.
Docs are uploaded to http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR-1179/1/index.html

Job PR-1179/2 is complete.
Docs are uploaded to http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR-1179/2/index.html

Job PR-1179/6 is complete.
Docs are uploaded to http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR-1179/6/index.html

Job PR-1179/7 is complete.
Docs are uploaded to http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR-1179/7/index.html

You also need to modify https://github.com/dmlc/gluon-nlp/blob/ef57ca08ee507902a9b2fbb4dbcc4ca110d84cd3/ci/jenkins/Jenkinsfile_py3-master_gpu_doc
You can find that out by searching the repository for md2ipynb.py.

@StrayBird-ATSH can you fix the conflict for docs/community/index.rst?

@StrayBird-ATSH can you fix the conflict for docs/community/index.rst?

Yes. There are several new pull requests #1193 #1192 #1191 that affect this documentation. So I will take some time to give better explanations in this documentation.

Currently with all the existing new pull requests, including the latest #1195 , the python part errors are wiped out.
However, there still needs some more configuration on nbsphinx for preventing it from executing the code blocks in the ipynb files.
After vast search, solutions are available: https://nbsphinx.readthedocs.io/en/latest/never-execute.html
Next I will take some time to figure out how to add something like a new argument to control nbsphinx.
There will be some new pull requests for the corresponding global change.

Job PR-1179/25 is complete.
Docs are uploaded to http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR-1179/25/index.html

Job PR-1179/26 is complete.
Docs are uploaded to http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR-1179/26/index.html

Job PR-1179/27 is complete.
Docs are uploaded to http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR-1179/27/index.html

This pull request is now complete and ready for review and merge.

This pull request is now complete and ready for review and merge.

@leezu Thanks!


chore: Manually update Pandas to version 2.2.0

The updated of pandas to version 2.2.0 exposed issues with our test_whole_table performance manager test.
The Dataframe.compare function that we were using to check equivalency between our pipeline output and the source of truth CSV file was not performing as expected. Use of this function has been replaced with pandas.testing.assert_series_equal which produces a much more strict comparison between dataframe columns.
Also added an additional test for the process_vp_files function, which was used during the debugging process, so might as well add it.
Asana Task: https://app.asana.com/0/1205827492903547/1204354793482788

LGTM. There is the other pandas PR in here that dependabot built that we should close as well.


Do some archetype wrangling

This is contingent on the BASE_ARCHETYPES bug being fixed – #4111

[ ] Wave decks should probably be some distinct subcategories of Blink.
[ ] Devoid cruelty should be its own archetype not lumped into Cruel Control.
[ ] Make mardu life an archetype and put s6 and s7 decks in it
[x] Make a dynavolt tower archetype
[ ] Aggro-Control is a mess of Aggro-Control and (mostly?) Fish decks because I didn't understand the difference between those two things when I started categorizing.

A couple things

I made Devoid control it's own archetype but it's still a sub-archetype of cruel control atm. I thinking with about 8 signets and hedron archives it's feels more like a ramp deck than anything else. Other thoughts?
Not really enough decks (6) atm I feel like to make an archetype with 10 being the normal minimal baseline but could be added in the future if it gets played more.
tower archetype can be crossed off the list, since you took care of it.
Lastly, would this be a good thread for potential archetype renames, etc? Not sure how easy/difficult it is renaming or deleting archetype so may not be necessary to keep track of like this.

Yeah this is a good thread to thrash some things out if we want a less synchronous discussion than #code on Discord.
You're right that "Devoid of Cruelty" doesn't really play like cruel control at all. It did run counterspells to get as far as the Ultimatum so it's also not that different. But it was all about cost reducers, signets and the ultimatum rather than messing around with much in the way of removal and other interaction. It wouldn't be ridiculous to put it under ramp. I'm torn on that one. Maybe the tiebreaker is that people will look under Cruel Control for ultimatum decks and that's what it is more than anything?
Is it Mardu Life that doesn't have enough decks? I still had four as the threshold in my mind when I wrote this list I think but I'm happy to ignore it if it's only at 6 decks. I am down with my own revision of the threshold now PD is bigger and badder than ever :D
Renames are (very) easy in the database but there's no UI for it. I could make one but it should be pretty rare?

Well, we currently have reliving ultimatums over in combo so I don't think it would be too crazy to have cruel ult decks be a bit scattered to some degree and have devoid cruelty in ramp. Overall, it seems like an common issue for certain themes/card-centered decks, (e.g. madness and necro) that span across multiple archetypes. It possibly might be annoying for some but if I wanted to see cruel ult, or other theme decks I usually go to the card's page anyways (though don't really know if this is the normal go to for most) or whatever key card(s) for the general theme and find all the decks for a more general theme there.
Yeah, I was referencing Mardu life. Something in like the 5-10 range is probably  fine for a minimum, I was just mainly going off what you recently said  in #code on discord

Number of decks before we create a new archetype should be about ten I think. It was four when I started but there were a lot less players/decks then

We just have to agree on something for a standard baseline for future sorting and in general.
Yeah, pretty much all the names are good there was just like one or two minor things that could probably be adjusted. One that I can recall atm is to change "Boros Vehicles" to just "Vehicles" as there's now some non-boros vehicle decks. We could make "boros vehicles" a sub-category of "vehicles" in the future if necessary it but I don't think it's needed as a subarchetype at this point in time. Another one is "treefolk" is pretty small atm with 2 decks (with one being the goldfish version) and stick them with "rofellos ramp" or just "ramp."

Sorry I wasn't very clear. By "I am down with my own revision of the threshold" I meant "I think my suggestion of making 10 the threshold is good and we can not bother with a Mardu Life category". In fact, we should probably retire a couple of categories like Mono W Oketra's Monument that only have 4-5 decks.
I forgot about Reliving Ultimatums. That is a pretty good argument for moving Devoid of Cruelty into Ramp. I'm happy if we do that. After thinking about it I agree that it's more important for a deck to sit inside the right macro archetype than it is for key cards to all live in the same part of the tree. Let's do our best to describe the key strategy of the deck and only worry about "siblings" after that.
Go ahead and move the decks out of Treefolk. If you post here the renames and deletions you want I can do them by hand easily until I build some UI :D


Rename default branch (master ➜ main)

Following the example of other popular free software projects, we also rename our default branch to remove terminology stemming from colonialism and slavery.
Closes #204

Thank you Jannis! :1st_place_medal:


[ConversationEntity Memory Prompt Template] - issues with customisation

I’m having a few issues with a prompt template using ConversationChain and ConversationEntity Memory.
Currently I’m using a template as follows:
template = """Assistant is a large language model based on OpenAI's chatGPT…

The user Assistant is speaking to is a human and their first name is {first_name} and their surname is {last_name}.

Entities:
{entities}

Conversation history:
{history}

user: {input}
panda:"""

I’m then dynamically passing in the first_name and last_name variables as follows, whilst passing over the entities, history and input variables so they can be picked up later:
    new_template = template.format(
        first_name=first_name,
        last_name=last_name,
        entities="{entities}",
        history="{history}",
        input="{input}"
    )

I then build my prompt:
    prompt = PromptTemplate(
        input_variables=["entities", "history", "input"],
        template=new_template
    )

And then run as normal. However, when I inspect the final template in PromptLayer I see that the variables have been replaced as follows:
    first_name=“{input}”,
    last_name=first_name,
    entities=last_name,
    history="{entities}",
    input="{history}"

So none of the variables have mapped properly, and have been mapped in order but with ”{input}” being passed first.
Ideally, I’d take all the input_variables out of the PromptTemplate and set everything up manually, but I don’t think ConversationChain with ConversationEntityMemory will let me do that as I think it’s expecting {entities}, {history}, and {input} variables to be passed in the PromptTemplate.
conversation = ConversationChain(
        llm=llm,
        verbose=False,
        prompt=prompt,
        memory=ConversationEntityMemory(llm=OpenAI(openai_api_key=settings.OPENAI_API_KEY))
    )

I managed to debug this - problem on my end, apologies

Hey Sean, may I know how did you solved it?


minor fixes around operations_api.js

Current coverage is 92.53% (diff: 100%)

Merging #55 into master will not change coverage

@@             master        #55   diff @@
==========================================
  Files             7          7
  Lines           924        924
  Methods         127        127
  Messages          0          0
  Branches        200        200
==========================================
  Hits            855        855
  Misses           69         69
  Partials          0          0

Powered by Codecov. Last update b83b8a5...c89e38e

@landrito, please take a look.


6.3 ui 配置用户名密码无效

Please answer these questions before submitting your issue.

Why do you submit this issue?
[ ] Question or discussion
[× ] Bug
[ ] Requirement
[ ] Feature or performance improvement

Question

What do you want to know?

Bug

Which version of SkyWalking, OS and JRE?

Which company or project?

What happen?
If possible, provide a way for reproducing the error. e.g. demo application, component version.

Requirement or improvement

Please describe about your requirements or improvement suggestions.

That is removed in 6.2.0. As far as i know.

English only, and yes, removed.


Add basic functionality for a year picker

What does this PR Fix?

Adds a basic functionality for a user to choose the year
Has two buttons, one for the previous year and one for the next year

Proposed Changes

Add components/YearPicker.vue for this component
Add an ESLint rule to disable no-lonely-if

Additional Info

This does not implement the dropdown menu to select the year manually
The upper limit for the year is 2050
The lower limit for the year is 1900
The UI is pretty much bare-bones so here is a list of things to fix:

Bring the buttons back to the position of the year displayed in the middle
Add subtle rounded corners to the box
Probably change the design of the button as it looks very bootstrap-y
Make the year on the center clickable (a link?) so that we can pass an @click handler to show the dropdown

Screenshots

[x] Have you tested this code?

@floydpink I have made all the changes!

There are a lot of anys used in the component I'll try and figure out their exact typings

@floydpink Made the changes!


Update Vulkan-Headers to 1.3.242

Depends on #719
Closes #698, closes #670
Lots of churn to use the new api attribute, but all worth it in the end. Also notice the shiny new deprecated attribute :tada:

Parts of the PR update to 1.3.241 while the title says 1.3.242. I don't know which is correct but they should be made to agree before this merges.

Don't worry about it. I sometimes forget to update the value in the changelog and Cargo.toml but end up double-checking before merging (and definitely before releasing).
In this particular case there's still lots to do on the generator side to make the new format work. What appear to be simple changes can only be passed through to the vk-parse structs, while we still partly rely on the unmaintained vkxml crate. Desire has always been to migrate to vk-parse (and lately: rewrite the generator altogether) but that has yet to materialize.

Well, I mean I've got a whole new parser that works on the latest XML, but since it's totally separate data types you'd (probably?) have to adjust your output stage a lot to use it.

It seems that everyone is writing a new parser, generator, or minimal Vulkan wrapper library nowadays, but that doesn't help us if it takes significant time to integrate with our generator/rewrite. Feel free to join in on https://github.com/ash-rs/ash/discussions/662 as we try to work out how (and when?) to merge Erupt's generator and approach to Vulkan with Ash.

@Ralith can you check out #719 and this PR? Upstream CI is waiting for us to be compatible with the new vk.xml format again.


scipy.integrate.quad gives wrong result when change an argument a little

In the following integral function, when n2=22144 the integral value is w= 0.4256854383924181. But with matlab, integral value will be<PHONE_NUMBER>0129.305. I checked the value and found matlab is right. When n2=22145,the values in scipy and matlab are  the same.
Reproducing code example:

from math import sqrt, log, exp
import numpy as np
from scipy.integrate import quad

def integrand(x, r1, r2):
    a = r1 + r2
    b = r1 * r2
    R = a * x / 2
    R1 = R ** 2 - a ** 2
    R2 = R ** 2 - (r1 - r2) ** 2
    vdw = -7e-21 * (2 * b / R1 + 2 * b / R2 + log(R1 / R2))
    edl = 7.8e-12 * b / a * log(1 + exp(-328774227 * (R - a)))
    force = vdw + edl
    return exp(force / 4.11447e-21) / x ** 2

n1 = 5010
n2 = 22144
radius1 = 1.05 * 10 ** -8 * n1 ** (1 / 1.8)
radius2 = 1.05 * 10 ** -8 * n2 ** (1 / 1.8)
w = quad(integrand, 2, np.inf, args=(radius1, radius2))
print('w=', w[0])

Scipy/Numpy/Python version information:

1.5.4 1.19.5 sys.version_info(major=3, minor=6, micro=6, releaselevel='final', serial=0)

Are you possibly using vpa or some other high precision library on matlab? You are essentially working with practical zeros for standard double floats.
exp(force / 4.11447e-21) / x ** 2 this is practically divide by zero unless force is pathetically close to zero. Similarly other parts of the problem is ill conditioned too.
Note that standard floating point number precision is ~2e-16. Anything past that point is just noise even though it might work occasionally when the operation is well defined. However in general there is no guarantee for accuracy. You might want to scale your data so that you are operating away from the precision.

I didn't use vpa in matlab. I should revise the results from matlab as follows.
n2 = 22144, w = 1.1772e+13
n2 = 22145, w = 1.1775e+13

In scipy, I got:
n2 = 22144, w = 0.4256854383924181
n2 = 22145, w =<PHONE_NUMBER>5351.027   # 1.1775e +13

It is clear that, when n2=22145, the results from scipy and matlab are close to each other, but not in the case of n2=22144.
In exp(force / 4.11447e-21) / x ** 2, the force is close to zero, because vdw and edl are both small value. In fact, I can calculate the corrent value of exp(force / 4.11447e-21) / x ** 2  and plot its cruve. Also, I can get a very close (correct) integral value with scipy.integrate.trapz.
A BBS user told me that he/she copy the code and obtain (He/She used scipy 1.5.2, but I did not get the same results with scipy 1.5.2 ):
n2=22144, w=<PHONE_NUMBER>9067.406
n2=22145, w=<PHONE_NUMBER>5351.027

If change 4.11447 in  exp(force / 4.11447e-21) / x ** 2 to 4.1145 and 4.1144, I will get (puzzling):
#4.1145
n2=22144, w=<PHONE_NUMBER>0129.305
n2=22145, w=<PHONE_NUMBER>7123.924

#4.1144
n2=22144, w= 0.42568494248362776
n2=22145, w= 0.4256854757392548

Yes as I mentioned you are working in the numerical noise. Matlab can also get confused and it won't be Matlab's fault.

Seems like there is nothing to do here. Closing.


Blits.Launch: Handle empty settings

I was just getting started with Blits and was confused to get errors like "Cannot use 'in' operator to search for 'fontLoader' in undefined" and "Cannot read properties of undefined (reading 'w')". Turns out I hadn't provided any settings object to Blits.Launch().
I suggest either handling an undefined/null settings object, or throwing a more meaningful error if one is provided.

Released in 0.9.9.


failed to perform copy command because if missing recursive

I think there is an error in the
"Copy a file share to another storage account" example. At least I get the error:
failed to perform copy command due to error: failed to initialize enumerator: cannot use directory as source without --recursive or a trailing wildcard (/*)
It might be related to the fact that I have another set of SAS token settings, but I would love to know about that.

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: cd2ee3a6-a4ae-068a-1a7e-9a81877e1a21
Version Independent ID: 57abfa84-1c27-6dcc-f757-bc3c90e6e6b0
Content: Transfer data to or from Azure Files by using AzCopy v10
Content Source: articles/storage/common/storage-use-azcopy-files.md
Service: storage
Sub-service: common
GitHub Login: @normesta
Microsoft Alias: normesta

@matzter
Thanks for your feedback! We will investigate and update as appropriate.

@matzter
Thank you for your feedback!
I'd recommend working closer with our support team via an [Azure support request] (https://docs.microsoft.com/en-us/azure/azure-portal/supportability/how-to-create-azure-support-request). Or you can leverage our Q&A forum by posting your issue there so our community, and MVPs can further assist you in troubleshooting this issue or finding potential workarounds.
[Teams Q&A forum] (https://docs.microsoft.com/en-us/answers/topics/46488/office-teams-windows-itpro.html) for technical questions about the configuration and administration of Microsoft Teams on Windows.
[Microsoft Teams Community forum] (https://answers.microsoft.com/en-us/msteams/forum?sort=LastReplyDate&dir=Desc&tab=All&status=all&mod=&modAge=&advFil=&postedAfter=&postedBefore=&threadType=All&isFilterExpanded=false&page=1)
Thank you for your time and patience throughout this issue.


Custom bulk action not working

Hi when I tried to implement a custom bulk action it's always showing like this: Resource of given id: Question does not have an action with name: moveAll or you are not authorized to use it!, I'm not getting any other errors
code:
moveAll: {
actionType: 'bulk',
component: AdminJs.bundle('../components/actions/move-all'),
handler: (request, response, context) => {
return {
records: [],
}
},
},

Modified handler now it's working.
handler: (request, response, context) => {
const recordsInJSON = records.map(record => record.toJSON(context.currentAdmin))
return {
records: recordsInJSON,
}
            },


About training time cost

@xiaoqian-shen Hi, thanks for your great project!
As mentioned in the paper, "Our model is trained on 64 NVIDIA H100 GPUs."
Could you please share the training time cost? Thank you.

Thanks for asking this. For the 7B version, image training stage takes for 24h and video training stage takes for 28h.

Thanks for the reply!


Cached scoring callbacks

Introduce caching mode (use_caching=True) for scoring callbacks
Move scoring callback tests to a dedicated tests/callbacks/ subfolder

Alternative approach to PR #149.
@dnouri would be great if could weigh in on this as well.

Does this still require inference to be run twice per iteration? Once inside train_step or validation_step, and once within the callbacks?
Can you explain the mechanism that makes sure that two scoring callbacks use the same predictions?
I'm thinking the caching doesn't make the code easier to understand. There's already a considerate amount of indirection in these callbacks. The FIXME comment that I read but didn't understand doesn't make me feel great.

This solution re-uses the y_pred from train_step (or validation_step), effectively doing the same thing as the Metrics callback but in a way that enables the use of sklearn scorers. If caching is enabled, the callback stores references to y_pred (collected on batch end) and during score computation it mocks net.infer to return the collected predictions. Since the predictions are references we can define as many callbacks as we want without increasing the memory footprint.
The FIXME comment is not caused by this PR, the PR's changes just highlight the problem so I thought documenting it would be a good idea.

effectively doing the same thing as the Metrics callback but in a way that enables the use of sklearn scorers

OK, this sounds like an advantage. I assume it means I can use sklearn scorers here, but I can't use them in the other PR?
Even if it's hard for me as the author of my PR to really be objective, I'm still thinking this is more complicated, and the code harder to follow than the alternative.

@dnouri

OK, this sounds like an advantage. I assume it means I can use sklearn scorers here, but I can't use them in the other PR?

Yes, the other PR is focused on metrics and has the disadvantage that it is not clear when to use predict or predict_proba which leads to quirky workarounds and possibly duplicated code (e.g., same code used in predict needs to be re-written for scoring).

Even if it's hard for me as the author of my PR to really be objective, I'm still thinking this is more complicated, and the code harder to follow than the alternative.

I think most of the complexity is added by the option to disable caching to save memory in certain cases which was not an option in the other PR. The remaining code should be approximately the same.

I think most of the complexity is added by the option to disable caching to save memory in certain cases

I also believe that the two are more similar than it appears at first glance.
Although the end result is a little more complex overall, this PR has the advantage that existing code should continue to work, with the added benefit of using caching right away. I also find the existing way of adding scoring callbacks more intuitive, and since there is an explicit parameter to disable caching, it's still transparent for the user that caching happens.

@benjamin-work pls review again


ECS AME

About the PR

Refactors the AME to be fully ECS.
Renames the AME classes to Ame to match with Apc and Pda.
Adds some more doc comments.
Media

[x] I have added screenshots/videos to this PR showcasing its changes ingame, or this PR does not require an ingame showcase

conflicts.

@metalgearsloth
The merge conflict solved itself when I merged master and the test failure appears to be a result of someone serializing an update deadline when saving a map. I'll pr some empty commits, but it should be good to go.

That did not work.

That appears to have uncooked the diff

The controller display no longer updates when "Fuck" and "Critical" states should appear. Take a look if you can easily make a shared system for the controller and shields, move some code from server there and make the client systems inherit that, wont require you to do so tho since this is a cleanup and the old system was like that Also, remember to update the "AME" folder names/namespaces too

About 90% of the behavior is in NodeContainer so until that's in shared there's not much to move. It's more trouble than it's worth right now.