JAX filters

Finish JAX implementation of filters

Can't figure out why the installation is failing here, I didn't change anything from main in that aspect @CosmoMatt

Codecov Report
Patch coverage: 71.42% and project coverage change: -16.81 :warning:

Comparison is base (5fb38af) 94.62% compared to head (9c33a89) 77.81%.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
Additional details and impacted files
@@             Coverage Diff             @@
##             main      #60       +/-   ##
===========================================
- Coverage   94.62%   77.81%   -16.81%
===========================================
  Files           7        9        +2
  Lines         279      550      +271
===========================================
+ Hits          264      428      +164
- Misses         15      122      +107

Impacted Files
Coverage Δ

s2wav/transforms/numpy_scattering.py
18.60% <18.60%> (ø)

s2wav/transforms/jax_scattering.py
20.00% <20.00%> (ø)

s2wav/transforms/jax_wavelets.py
79.41% <79.41%> (ø)

s2wav/filter_factory/kernels.py
90.56% <80.76%> (-9.44%)
:arrow_down:

s2wav/utils/shapes.py
91.30% <80.95%> (-8.70%)
:arrow_down:

s2wav/filter_factory/tiling.py
74.46% <85.71%> (+7.80%)
:arrow_up:

s2wav/filter_factory/filters.py
93.47% <96.29%> (+1.17%)
:arrow_up:

s2wav/transforms/numpy_wavelets.py
97.87% <97.87%> (ø)

s2wav/utils/math_functions.py
100.00% <100.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


API calls in testnet returning blank dataset(s)

Brief Description: API calls in testnet returning blank dataset(s)
Operating System (OS and version): Windows 10
OpenBazaar version: SERVER_VERSION = "0.2.3",PROTOCOL_VERSION = 2
Hardware: Surface Pro 3 @ virtualenv
Reproducible (Always):
Steps to reproduce:

update username and password as in below API call, into ob.cfg
python openbazaard.py start -ta <IP_ADDRESS>
curl --data "username=ktest&password=password123" --dump-header headers.txt http://localhost:18469/api/v1/login
curl --cookie headers.txt http://localhost:18469/api/v1/profile

Observed Behavior:
API response: {}
Expected Behavior:
API response(similar to prod): { "profile": { "social_accounts": {}, "moderation_fee": 0.0, "moderator": false, "nsfw": false, "vendor": false, "guid": "5b0de6ec7df9a1ddd44d675f0a2bd8ee0b96497e", "background_color": 11711154, "secondary_color": 15132390, "location": "UNITED_KINGDOM", "short_description": "", "primary_color": 16777215, "email": "", "website": "", "handle": "", "text_color": 0, "last_modified":<PHONE_NUMBER>, "public_key": "b44675355c4de653f8b69df289f645ff1af0911d3e0ff679875eb72d46154781", "about": "", "name": "kumR", "header_hash": "44f2e2b03e17326e0617bde347849952ff0725c9", "pgp_key": "", "avatar_hash": "5417644628cbb62e872a910e6e5af32fdb08145e" } }
Additional info:
reproduction in prod:
2. python openbazaard.py start -a <IP_ADDRESS>
3. curl --data "username=ktest&password=password123" --dump-header headers.txt http://localhost:18469/api/v1/login
4. curl --cookie headers.txt http://localhost:18469/api/v1/profile

Are you sending a GUID to the call or no? I'm assuming from your text that's a no so that means you must be getting into this path:
else:
            p = Profile(self.db).get()
            if not p.HasField("guid_key"):
                request.write(json.dumps({}))
                request.finish()
            else:
                temp_handle = self.db.profile.get_temp_handle()
                parse_profile(p, None if temp_handle == "" else temp_handle)

First step would be to check in your OB-Mainnet.db to see if you have a guid key in the keys table. If you do then maybe there's something wrong retrieving your Profile from the db.

soz for the late reply ...
No, not sending the GUID: to reiterate, my API call was:
http://localhost:18469/api/v1/profile
I specified 'testnet' in the issue subject and also implied as such in my OB kickoff command:
python openbazaard.py start -ta <IP_ADDRESS>
so am I really looking at  OB-Mainnet.db or  OB-Testnet.db ?
I checked both, and yes both contain guid and bitcoin (privkey and pubkey) in table: keys.
'something wrong retrieving your Profile from the db': any further clues please?
So you don't think OB is simply confused by the existence of two (mainnet and testnet) dbs ?
Reckon I should just get rid of all traces of OB and reinstall? If so, which windows folders would you recommend looking at especially to make sure none of the old install remnants have persisted?


Bug: unable to open database file error when adding spiceai/fed-demo while Spice is running

Describe the bug
Follow the Federated SQL Query quick start but swap steps 6 and 7 to start spice first and then add dependency spicepod (spice add spiceai/fed-demo)
Observe error:

2024-09-09T23:20:14.546109Z  WARN runtime: Unable to attach data connector s3: Unable to create dataset acceleration: Acceleration creation failed: Unable to create table: External error: DbConnectionPoolError: ConnectionPoolError: Rusqlite("unable to open database file: /Users/sg/playground/rel_0_17_4/quickstarts/federation/.spice/data/s3_source_accelerated_sqlite.db")
2024-09-09T23:20:37.368713Z  WARN runtime: Unable to attach data connector s3: Unable to create dataset acceleration: Acceleration creation failed: Unable to create table: External error: DbConnectionPoolError: ConnectionPoolError: Rusqlite("unable to open database file: /Users/sg/playground/rel_0_17_4/quickstarts/federation/.spice/data/s3_source_accelerated_sqlite.db")

I'm also seeing this for the DuckDB acceleration


python.pkgs.python-language-server: init at 0.18.0

Motivation for this change
I use the following snippet for the plugins (put it into environment.systemPackages for example).
(python3.withPackages(ps: [ps.pyls-mypy ps.pyls-isort ]))

and the following snippets in neovim:
let g:LanguageClient_serverCommands = {
     \ 'python': ['pyls']
     \ }

which is provided by the LanguageClient-neovim as shown in my dotfiles: https://github.com/Mic92/dotfiles/blob/master/nixpkgs-config/config.nix#L26
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option build-use-sandbox in nix.conf on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[x] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[x] Fits CONTRIBUTING.md.

@GrahamcOfBorg build python.pkgs.python-language-server

Success on x86_64-linux (full log)
Attempted: python.pkgs.python-language-server
Partial log (click to expand)
test/test_language_server.py               28      0   100%
test/test_uris.py                          17      2    88%
test/test_utils.py                         56      0   100%
test/test_workspace.py                     33      0   100%
-----------------------------------------------------------
TOTAL                                    2051    219    89%
Coverage HTML written to dir htmlcov

===================== 89 passed, 5 skipped in 6.44 seconds =====================
/nix/store/2b0y9mi9l7h4n7x1yykznljsmj47x0m5-python2.7-python-language-server-0.18.0

Success on x86_64-darwin (full log)
Attempted: python.pkgs.python-language-server
Partial log (click to expand)
test/test_language_server.py               28      0   100%
test/test_uris.py                          17      2    88%
test/test_utils.py                         56      0   100%
test/test_workspace.py                     33      0   100%
-----------------------------------------------------------
TOTAL                                    2051    223    89%
Coverage HTML written to dir htmlcov

===================== 89 passed, 5 skipped in 4.75 seconds =====================
/nix/store/fqljfgw54v8zzija2jmw8qv8wsr0rrlc-python2.7-python-language-server-0.18.0

Success on aarch64-linux (full log)
Attempted: python.pkgs.python-language-server
Partial log (click to expand)
test/test_language_server.py               28      0   100%
test/test_uris.py                          17      2    88%
test/test_utils.py                         56      0   100%
test/test_workspace.py                     33      0   100%
-----------------------------------------------------------
TOTAL                                    2051    220    89%
Coverage HTML written to dir htmlcov

==================== 89 passed, 5 skipped in 22.03 seconds =====================
/nix/store/ib68rbiflq5f6xmgw8cm63k1k0b3b7b1-python2.7-python-language-server-0.18.0

Looks good. Closing this then https://github.com/NixOS/nixpkgs/pull/31180

Ah, I did not check, what we got before.

Turns out both packages are empty at the moment.

Fixed.

@GrahamcOfBorg build python.pkgs.python-language-server python3.pkgs.python-language-server
python3.pkgs.pyls-mypy python3.pkgs.pyls-isort

Success on x86_64-darwin (full log)
Attempted: python.pkgs.python-language-server, python3.pkgs.python-language-server
Partial log (click to expand)
test/test_uris.py                          17      2    88%
test/test_utils.py                         56      0   100%
/nix/store/9x01k2w0m29sz605ajdw7vk3g77rs76z-python2.7-python-language-server-0.18.0
/nix/store/d3hmqissvkh4sxxvnm5wms3b9lr3ry2z-python3.6-python-language-server-0.18.0
test/test_workspace.py                     33      0   100%
-----------------------------------------------------------
TOTAL                                    2051    219    89%
Coverage HTML written to dir htmlcov

===================== 89 passed, 5 skipped in 4.80 seconds =====================

Success on aarch64-linux (full log)
Attempted: python.pkgs.python-language-server, python3.pkgs.python-language-server
Partial log (click to expand)
test/test_uris.py                          17      2    88%
test/test_utils.py                         56      0   100%
test/test_workspace.py                     33      0   100%
-----------------------------------------------------------
TOTAL                                    2051    219    89%
Coverage HTML written to dir htmlcov

==================== 89 passed, 5 skipped in 22.57 seconds =====================
/nix/store/w1ibly0xybglnvjz81xifrsxjy8rmnin-python2.7-python-language-server-0.18.0
/nix/store/mygidsqwij3hs3l9jiivvpdgfn36sldn-python3.6-python-language-server-0.18.0

Success on x86_64-linux (full log)
Attempted: python.pkgs.python-language-server, python3.pkgs.python-language-server
Partial log (click to expand)
test/test_uris.py                          17      2    88%
test/test_utils.py                         56      0   100%
test/test_workspace.py                     33      0   100%
-----------------------------------------------------------
TOTAL                                    2051    219    89%
Coverage HTML written to dir htmlcov

===================== 89 passed, 5 skipped in 6.71 seconds =====================
/nix/store/xb3hx7kns3sfnv447m8jilsyygfghcli-python2.7-python-language-server-0.18.0
/nix/store/hk8xkdqj3fcjjzklz9qmbw67slx5ipg9-python3.6-python-language-server-0.18.0

Success on x86_64-linux (full log)
Attempted: mypy
Partial log (click to expand)
strip is /nix/store/j75dgadrff2d1fyc4fczmcgqkid2imdx-binutils-2.30/bin/strip
stripping (with command strip and flags -S) in /nix/store/yml98fqhs57yv4cpqhmzxm29mqapzwym-python3.6-mypy-0.600/lib  /nix/store/yml98fqhs57yv4cpqhmzxm29mqapzwym-python3.6-mypy-0.600/bin
patching script interpreter paths in /nix/store/yml98fqhs57yv4cpqhmzxm29mqapzwym-python3.6-mypy-0.600
/nix/store/yml98fqhs57yv4cpqhmzxm29mqapzwym-python3.6-mypy-0.600/lib/mypy/typeshed/tests/mypy_test.py: interpreter directive changed from "/usr/bin/env python3" to "/nix/store/96wn2gz3mwi71gwcrvpfg39bsymd7gqx-python3-3.6.5/bin/python3"
/nix/store/yml98fqhs57yv4cpqhmzxm29mqapzwym-python3.6-mypy-0.600/lib/mypy/typeshed/tests/mypy_selftest.py: interpreter directive changed from "/usr/bin/env python3" to "/nix/store/96wn2gz3mwi71gwcrvpfg39bsymd7gqx-python3-3.6.5/bin/python3"
/nix/store/yml98fqhs57yv4cpqhmzxm29mqapzwym-python3.6-mypy-0.600/lib/mypy/typeshed/tests/pytype_test.py: interpreter directive changed from "/usr/bin/env python" to "/nix/store/96wn2gz3mwi71gwcrvpfg39bsymd7gqx-python3-3.6.5/bin/python"
checking for references to /build in /nix/store/yml98fqhs57yv4cpqhmzxm29mqapzwym-python3.6-mypy-0.600...
wrapping `/nix/store/yml98fqhs57yv4cpqhmzxm29mqapzwym-python3.6-mypy-0.600/bin/dmypy'...
wrapping `/nix/store/yml98fqhs57yv4cpqhmzxm29mqapzwym-python3.6-mypy-0.600/bin/stubgen'...
wrapping `/nix/store/yml98fqhs57yv4cpqhmzxm29mqapzwym-python3.6-mypy-0.600/bin/mypy'...

Success on x86_64-darwin (full log)
Attempted: mypy
Partial log (click to expand)
post-installation fixup
strip is /nix/store/kdff2gim6417493yha769kh00n63lnrw-cctools-binutils-darwin/bin/strip
stripping (with command strip and flags -S) in /nix/store/icg5a777kh9afsrx1ij3n4cq5bq76zvm-python3.6-mypy-0.600/lib  /nix/store/icg5a777kh9afsrx1ij3n4cq5bq76zvm-python3.6-mypy-0.600/bin
patching script interpreter paths in /nix/store/icg5a777kh9afsrx1ij3n4cq5bq76zvm-python3.6-mypy-0.600
/nix/store/icg5a777kh9afsrx1ij3n4cq5bq76zvm-python3.6-mypy-0.600/lib/mypy/typeshed/tests/mypy_selftest.py: interpreter directive changed from "/usr/bin/env python3" to "/nix/store/sm6n6vgc3gy064nnvc49b5g8a6n2cn8h-python3-3.6.5/bin/python3"
/nix/store/icg5a777kh9afsrx1ij3n4cq5bq76zvm-python3.6-mypy-0.600/lib/mypy/typeshed/tests/mypy_test.py: interpreter directive changed from "/usr/bin/env python3" to "/nix/store/sm6n6vgc3gy064nnvc49b5g8a6n2cn8h-python3-3.6.5/bin/python3"
/nix/store/icg5a777kh9afsrx1ij3n4cq5bq76zvm-python3.6-mypy-0.600/lib/mypy/typeshed/tests/pytype_test.py: interpreter directive changed from "/usr/bin/env python" to "/nix/store/sm6n6vgc3gy064nnvc49b5g8a6n2cn8h-python3-3.6.5/bin/python"
wrapping `/nix/store/icg5a777kh9afsrx1ij3n4cq5bq76zvm-python3.6-mypy-0.600/bin/dmypy'...
wrapping `/nix/store/icg5a777kh9afsrx1ij3n4cq5bq76zvm-python3.6-mypy-0.600/bin/mypy'...
wrapping `/nix/store/icg5a777kh9afsrx1ij3n4cq5bq76zvm-python3.6-mypy-0.600/bin/stubgen'...

Success on aarch64-linux (full log)
Attempted: mypy
Partial log (click to expand)
stripping (with command strip and flags -S) in /nix/store/6qyg340bb2xs8jwb261n88gwivx81kip-python3.6-mypy-0.600/lib  /nix/store/6qyg340bb2xs8jwb261n88gwivx81kip-python3.6-mypy-0.600/bin
patching script interpreter paths in /nix/store/6qyg340bb2xs8jwb261n88gwivx81kip-python3.6-mypy-0.600
/nix/store/6qyg340bb2xs8jwb261n88gwivx81kip-python3.6-mypy-0.600/lib/mypy/typeshed/tests/mypy_selftest.py: interpreter directive changed from "/usr/bin/env python3" to "/nix/store/qdcj04rnk8kb34zjrfzg8gfgl6svfcr8-python3-3.6.5/bin/python3"
/nix/store/6qyg340bb2xs8jwb261n88gwivx81kip-python3.6-mypy-0.600/lib/mypy/typeshed/tests/mypy_test.py: interpreter directive changed from "/usr/bin/env python3" to "/nix/store/qdcj04rnk8kb34zjrfzg8gfgl6svfcr8-python3-3.6.5/bin/python3"
/nix/store/6qyg340bb2xs8jwb261n88gwivx81kip-python3.6-mypy-0.600/lib/mypy/typeshed/tests/pytype_test.py: interpreter directive changed from "/usr/bin/env python" to "/nix/store/qdcj04rnk8kb34zjrfzg8gfgl6svfcr8-python3-3.6.5/bin/python"
checking for references to /build in /nix/store/6qyg340bb2xs8jwb261n88gwivx81kip-python3.6-mypy-0.600...
wrapping `/nix/store/6qyg340bb2xs8jwb261n88gwivx81kip-python3.6-mypy-0.600/bin/stubgen'...
wrapping `/nix/store/6qyg340bb2xs8jwb261n88gwivx81kip-python3.6-mypy-0.600/bin/mypy'...
wrapping `/nix/store/6qyg340bb2xs8jwb261n88gwivx81kip-python3.6-mypy-0.600/bin/dmypy'...
/nix/store/6qyg340bb2xs8jwb261n88gwivx81kip-python3.6-mypy-0.600

Also added in the wiki: https://nixos.wiki/wiki/Vim#Vim_as_a_Python_IDE


Headers are printed as duplicate json keys

Logging request/response headers adds each header as a duplicate "header" key in json output. This is invalid json. It would be better to have the headers as a json array.

Can you make an example please?

Sure. Here is a log output as json with a bunch of headers set (IPs obfuscated):
{
    "time":"2024-02-12T07:53:52.410079233Z",
    "level":"INFO",
    "msg":"",
    "request":{
       "time":"2024-02-12T07:53:52.40991004Z",
       "method":"GET",
       "host":"X.X.X.X",
       "path":"/",
       "query":"",
       "params":{},
       "route":"",
       "ip":"X.X.X.X",
       "referer":"",
       "length":0,
       "header":{
          "X-Amzn-Trace-Id":[
             "Root=1-65c9ce90-6b85b2375fa9aeb27161a2dd"
          ]
       },
       "header":{
          "User-Agent":[
             "Mozilla/4.0 (compatible; MSIE 6.0; Windows CE; IEMobile 7.11) XV6800"
          ]
       },
       "header":{
          "Accept-Charset":[
             "utf-8"
          ]
       },
       "header":{
          "Accept-Encoding":[
             "gzip"
          ]
       },
       "header":{
          "X-Forwarded-For":[
             "<IP_ADDRESS>"
          ]
       },
       "header":{
          "X-Forwarded-Proto":[
             "https"
          ]
       },
       "header":{
          "X-Forwarded-Port":[
             "443"
          ]
       },
       "user-agent":"Mozilla/4.0 (compatible; MSIE 6.0; Windows CE; IEMobile 7.11) XV6800"
    },
    "response":{
       "time":"2024-02-12T07:53:52.410061559Z",
       "latency":151289,
       "status":404,
       "length":0
    }
 }

This is invalid json, the headers are duplicate keys

Oh! I see.
I read your first message too fast and was expecting duplicated "request" or "response" fields.
I just made a fix 👌

Now it looks a lot better! 👍


[Question] Is the server portion of mycelite going to be open-sourced/available?

Will we be able to host our own synchronization server for mycelite? I am just looking into it, not a user yet, but would like to be able to host my own server instead of registering with mycelial if possible.

Hey @psalm842 ! Appreciate the question.
Mycelite is a PoC we released as part of our user testing. We are actually in private beta with customers for our new, e2e OSS platform which includes all the components you need to host your own Mycelial network.
Can you shoot me an email so I can show you the latest and get you beta access? It includes the sync servers, new UI, totally rewritten client, and supports a much wider array of data sources and sinks (not just SQLite!). Would love to hear more about your use case, too!
Drop a note here with the best way to reach ya, hop in our Discord (https://discord.gg/mycelial), or shoot me an email michael [at] mycelial.com, and I'll be happy to give you a tour and get you early access!

Thanks @tbaums I sent you a request from my work email timothy.viola [at] cummins.com through the mycelial early access request site. Feel free to respond as appropriate. I really don't want to take up much of your time as I'm really just looking into it in an exploratory fashion for an internal usage application, but I think the concept is fantastic and I'm curious to try it out.


Update success toast copy from "Data use case saved|deleted" to "Data Use saved|deleted"

Docs Update Description
When editing a System's Data Use, update the toast copy to "Data Use saved|deleted"
See example: https://www.loom.com/share/72e7e0cb1b934c31ad912866575df369

QA'd and moving to done.
I did find a separate bug https://github.com/ethyca/fidesplus/issues/720


Modify Docker Image Action

Update the docker creation GitHub action to also upload the created image to docker.io and then releases will be totally automated as far as container images go.

this is in place since v1.2.3


Emulate Development with lambda runtime interface emulator

Hi Guys,
I'm trying to emulate lambda in a local development environment using lambda runtime interface emulator[1]. When making the invocation to lambda runtime, the adapter attempts to find something on /var/task instead of passing the event request to my HTTP daemon running at the same container.
I tried to create /var/task/ into the container. After that, the adapter tried to find a bootstrap script without success.
I started my daemon and runtime emulator using bash script in the ENTRYPOINT container.
Any idea how I can use lambda runtime to test lambda in a development environment without deployment?
Regards.
[1] - https://github.com/aws/aws-lambda-runtime-interface-emulator

You don’t need the emulator. Just run your http server locally, test and debug using existing tools normally. When you need to delay to lambda, add the adapter to your container as extension. That’s all you need to do.
在 2022年2月23日，上午11:25，João Paulo Lins @.***> 写道：

Hi Guys,
I'm trying to emulate lambda in a local development environment using lambda runtime interface emulator[1]. When making the invocation to lambda runtime, the adapter attempts to find something on /var/task instead of passing the event request to my HTTP daemon running at the same container.
I tried to create /var/task/ into the container. After that, the adapter tried to find a bootstrap script without success.
I started my daemon and runtime emulator using bash script in the ENTRYPOINT container.
Any idea how I can use lambda runtime to test lambda in a development environment without deployment?
Regards.
[1] - https://github.com/aws/aws-lambda-runtime-interface-emulator
—
Reply to this email directly, view it on GitHubhttps://github.com/aws-samples/aws-lambda-adapter/issues/19, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AAADE5T4GK4NG3UYGHCC6XLU4RHQDANCNFSM5PDFK4SQ.
You are receiving this because you are subscribed to this thread.Message ID: @.***>

Hi Harold,
Thank you so much for your response.
I understand that the adapter could work transparently, but for our pipeline, we would have the opportunity to do some tests on the local environment without making Deploy.
Today we use serverlessish, and we want to migrate to lambda-adapter because the code is well sustained and robust.
We want to maintain our pipeline from development to production with local tests through the emulator for simulating some events coming from APIGW or ALB, for example.
Below I'll share my docker file, entry-point file, and one main.go file with a simple http-server to understand how we are working today.
I'll be very grateful if you could suggest or advise how I can use the emulator with lambda-adapter.
Tks.
Dockerfile
FROM golang:1.15 AS build
WORKDIR /teste
COPY . .
RUN CGO_ENABLED=0 go build -ldflags="-s -w" -o main

#FROM public.ecr.aws/c2t6n2x5/serverlessish:2 AS s

COPY --from=public.ecr.aws/awsguru/aws-lambda-adapter:0.2.0 /opt/extensions/lambda-adapter /opt/extensions/lambda-adapter

FROM alpine

RUN apk add --no-cache bash

ADD https://github.com/aws/aws-lambda-runtime-interface-emulator/releases/latest/download/aws-lambda-rie /usr/bin/aws-lambda-rie

RUN chmod 755 /usr/bin/aws-lambda-rie
COPY ./entry.sh /
RUN chmod 755 /entry.sh

COPY --from=build /teste/main /main

ENV PORT=8081

ENTRYPOINT ["/entry.sh"]

entry.sh
#!/bin/sh

# Start the first process
./main &
status=$?
if [ $status -ne 0 ]; then
  echo "Failed to start my server: $status"
  exit $status
fi

if [ -z "${AWS_LAMBDA_RUNTIME_API}" ]; then
  exec /usr/bin/aws-lambda-rie "$@"
else
  exec "$@"
fi

maing.go
package main

import (
	"net/http"
	"net/http/httputil"
)

func main() {
	http.HandleFunc("/", func(w http.ResponseWriter, r *http.Request) {
		dump, _ := httputil.DumpRequest(r, true)
		w.Write(append([]byte("this is what i received on port 8081:\n\n"), dump...))
	})

	http.HandleFunc("/ping", func(w http.ResponseWriter, r *http.Request) {
		w.Write([]byte(`ok`))
	})

	err := http.ListenAndServe(":8081", nil)
	if err != nil {
		panic(err)
	}
}

I see. Let me check how to do this.

Great! Thank you very much! I'll do new test as soon you release adjustments.

Great! Thank you very much! I'll do new test as soon you release adjustments.

It's not a simple update. Rust Runtime 0.5.0 has major breaking changes. I'm working on it. Hopefully to get the new release out soon.

@jpaulolins I just released Adapter v0.3.0. Could you check if the new version solve this issue?

@jpaulolins I will close this issue for now. If you still see issues, please reopen this one.


Update form should support image display / change functionality

Is your feature request related to a problem? Please describe.
Update form should support image display / change functionality.

When image is updated delete previous image saved in storage. [Firebase - only]
DataAdapter - can implement a method called deleteUpload(item?.id, field)


Release Manager Admin Control Panel

Every 3-4 months when an official Boost Release goes live, the release manager (Marshall) runs scripts to upload the archive to jfrog, and update the boost.org website. There are multiple steps involved, which could be incrementally added in Django.  Create a Release Manager Admin UI.

Generate the .zip files from the development snapshots and upload to jfrog as an official release. Currently functional. Accomplished with bash or python scripts. The script can continue to be used for now.
Download the zip archive, unbundle it, and then upload the contents to S3.  I will write a new command line script.
Update the boost website. So far "./manage.py import_versions" and ./manage.py import_library_versions" will update temp-site, if a new boost release exists. That means Marshall should have a way to run those functions and "update the website".

Each of those could (separately) be added as links or buttons in the Django admin panel on a page for the release manager.
Continuing, that admin page should also be able to run all the web maintenance scripts: import_versions, update_libraries, import_library_versions, import_library_version_docs_urls, import_commit_counts.

I have updated the script publish_release.py, and Marshall has merged it.
Now, a new boost archive will extracted and uploaded automatically to S3, and the website can serve those pages as documentation.
In terms of the above tasks 1, 2, 3 :
1 and 2 are in-place and functional as command-line scripts.  It's not urgent for them to be added to the website UI, they can continue to be run as before.
3 is still an open issue.   The release manager should have simple access to update the boost website, displaying the new boost version information.

@sdarwin I think we have what we need in place for this ticket to be closed, right?

I tested "Import New Releases" and that worked. Great! If there are problems later we could open another issue.


Block PR merger on "do not merge" label

Problem
The "do not merge" label doesn't enforce itself.
Description
In https://github.com/Kong/kubernetes-ingress-controller/pull/1522, I did not see the "do not merge label" because I was looking down at the end of the PR to see recent commits and CI status. Those looked good, so following Shane's merge of next into the PR branch, I thought I'd be proactive and merge the PR after CI went green, to avoid it getting out of sync with next again.
The consequences here were pretty minor (some dirty commit history went into next), but it's easy to not scroll back up to the top of a long PR to not see the "do not merge" label. Automation could help avoid similar screwups, with possibly worse consequences, going forward.
Making PRs into drafts works for this, but we don't typically use that, or only use it early in a PR's life. The "do not merge" label works well if the author of a PR wants to mark something that they don't want others to merge on their behalf so they can clean history or whatever. https://github.com/dimagi/required-labels should handle this easily.
Acceptance

[ ] If "do not merge" is present on a PR, Github will not allow you to merge that PR.

Hasn't really come up in practice since, so closing as "maybe revisit this in the future, but not prioritized for now"


loop to change user

foreach (var item in list)
{
var model = new {headimgurl = "", nickname = ""};
item.WxAvatar = model.headimgurl;
item.WxName = model.nickname;
await userManager.UpdateAsync(item);
}
System.InvalidOperationException: Invalid operation. The connection is closed.

OK, guessing here, but you're trying to update a user in asp.net identity?
This will only work when you retrieve an instance of the user from the user manager, update the fields on the user class you got back, then pass that to update. Without doing that there's no way to even lookup your user, this type of anonymous type simply will not work.

We're closing this issue as no response or updates have been provided in a timely manner. If you have more details and are encountering this issue please add a new reply and re-open the issue.


Fix Travis CI

I have gone through these following points

[x] Check latest documentation: https://docs.nativebase.io/
[x] Check for existing open/closed issues for a possible duplicate before creating a new issue: https://github.com/GeekyAnts/NativeBase/issues
[x] Use the latest NativeBase release: https://github.com/GeekyAnts/NativeBase/releases
[x] Check examples from NativeBase KitchenSink https://github.com/GeekyAnts/NativeBase-KitchenSink
[x] For discussion purpose make use of NativeBase Slack: http://slack.nativebase.io/
[x] For queries related to theme, check Theme Variables from Docs and live NativeBase Theme Editor http://nativebase.io/customizer/

Issue Description
TravisCI is failing, no pull request can be merged. It has been a long time, maybe someone could take a look
Failing message:
react-native: command not found
The command "react-native init AwesomeNativeBase" failed and exited with 127 during .

Your build has been stopped.

As seen here for example: https://travis-ci.org/GeekyAnts/NativeBase/jobs/587197188?utm_medium=notification&utm_source=github_status
related to
#2924  #2931 #2934 #2935  #2943 #2946 #2968 #2972 #2973

Fixed with https://github.com/GeekyAnts/NativeBase/pull/2992


Single-item-claim-array when using ClaimValueTypes.Json changing schema

Hi folks,
Please see the previous two issues I filed eventually routing me here by the AspNetCore folks:
IdentityServer/IdentityServer4#3968
https://github.com/dotnet/aspnetcore/issues/18178
When sending over a JWT with an array claim with only one value, the claim in user.profile gets transformed to just a string. When an array with 2 values gets sent over in the JWT claim, user.profile sets it to an array with those 2 values.
This means that the schema changes depending on how many items are in the claim which is less than ideal and forces some special casing.
To Reproduce
Consider this code applied to a React + ASP.NET template with Individual User authentication/authorization. The snippet has IdentityServer send over the JWT claim as an array even if it only has one value in it:
public Task GetProfileDataAsync(ProfileDataRequestContext context)
{
    // Get all the roles associated with this subject
    IEnumerable<Claim> roleClaims = context.Subject.FindAll(JwtClaimTypes.Role);

    // Put those roles into a list so we can serialize them after
    IList<string> roles = new List<string>();
    foreach (Claim roleClaim in roleClaims)
    {
        Debug.Assert(roleClaim.Type == JwtClaimTypes.Role);

        roles.Add(roleClaim.Value);
    }

    // Serialize the roles into JSON
    string rolesJson = JsonSerializer.Serialize(roles);

    // Put the roles JSON into an actual Claim object
    Claim claim = new Claim(JwtClaimTypes.Role, rolesJson, IdentityServerConstants.ClaimValueTypes.Json);

    // Add the claim to the IssuedClaims which will eventually end up in the issued JWT
    context.IssuedClaims.Add(claim);

    return Task.CompletedTask;
}

The JWT that comes out on the other end does have an array with 1 value in it but user.profile transforms it into a string.
If you don't want to actually create a role before testing this, just replace rolesJson above with "[\"role1\"]".
From AuthorizeServices.js checking out user.profile where the claims end up on the client side:

I considered this as a bug because it overrides the explicitly defined preference of IdentityServer.
Further technical details

ASP.NET Core version 3.1

.NET Core SDK (reflecting any global.json):
Version:   3.1.100
Commit:    cd82f021f4
Runtime Environment:
OS Name:     Windows
OS Version:  10.0.18362
OS Platform: Windows
RID:         win10-x64
Base Path:   C:\Program Files\dotnet\sdk\3.1.100\
Host (useful for support):
Version: 3.1.0
Commit:  65f04fb6db
.NET Core SDKs installed:
3.0.100 [C:\Program Files\dotnet\sdk]
3.1.100 [C:\Program Files\dotnet\sdk]
.NET Core runtimes installed:
Microsoft.AspNetCore.All 2.1.13 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.All]
Microsoft.AspNetCore.App 2.1.13 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
Microsoft.AspNetCore.App 3.0.0 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
Microsoft.AspNetCore.App 3.1.0 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
Microsoft.NETCore.App 2.1.13 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
Microsoft.NETCore.App 3.0.0 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
Microsoft.NETCore.App 3.1.0 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
Microsoft.WindowsDesktop.App 3.0.0 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]
Microsoft.WindowsDesktop.App 3.1.0 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]
To install additional .NET Core runtimes or SDKs:
https://aka.ms/dotnet-download

The VSCode 1.41.1

We should check how we handle roundtripping json when an array has a single string.
Check JsonWebToken.AddClaimsFromJToken

@azydevelopment we ran out of time, i moved this to next months release.

Thanks for the update. Would love to get this fixed to remove the need for testing 2 schemas on authed requests

@azydevelopment i am not sure how this is caused by IdentityModel.
If you have additional details, please re-open with additional details.

Facing the same issue here, there's inconsistency when returning list of items (i.e., Roles):

Having no roles at all will not include an empty list
Having one role will include the role as string
Having two or more roles will include list of string

Why can't we just specify the type to be an array?

@a7md0, did you find a workaround for this?

@a7md0, did you find a workaround for this?

@NickDarvey Yes, see this Stackoverflow answer
For reference my code was
claims.AddClaims(userRoles.Select(role => new Claim("roles", role)));

Changed to
claims.AddClaim(new Claim("roles", JsonSerializer.Serialize(userRoles), JsonClaimValueTypes.JsonArray));

，你找到解决方法了吗？

是的，请参阅此 Stackoverflow 答案
作为参考，我的代码是
claims.AddClaims(userRoles.Select(role => new Claim("roles", role)));

更改为
claims.AddClaim(new Claim("roles", JsonSerializer.Serialize(userRoles), JsonClaimValueTypes.JsonArray));

JsonArray is the solution
JSON Array are not the same as JSON String
JsonArray：
JsonClaimValueTypes.JsonArray = ["text":["a1","a2"]]
JSON String:
JsonClaimValueTypes.Json = ["text":"["a1","a2"]"]


Possible to force dark mode?

Hello,
Is it possible to force dark mode as the only theme that can possibly be displayed?  Not a defect by any means, I just don't want my site presented in light mode - ever.
Thanks

Under component folder there is a file Layout.js. I added a line after line 18 as below.

Basically it's uses a local storage variable theme to determine if dark mode enabled or light mode. Initially when you load the website there is no theme variable exist. The variable initiates when you click the change mode button. What i did i initialize the theme variable on website load.


Call failed with status code 403 (Forbidden): PUT

I have managed to connect scheduler app with my Autodesk Counstruction Cloud account. Did all the steps, application runs and i can see documents from ACC Docs. The issue is when i start the conversion of .rvt files to .ifc.

Any idea why im i getting 403 Forbidden when trying to create storage location for the ifc?

i found the part of the code that is giving me this error:
`var sessionId = Guid.NewGuid().ToString();
Log.Information($"File is greater than 20MB. Uploading file in 5MB chunks instead. {sessionId}");
string objectId = "";
//If greater than 20MB, upload in 5mb chunks
for (int i = 0; i < contentLength; i += 5_000_000)
{
string range = $"bytes={i}-{Math.Min(contentLength - 1, i + 5_000_000 - 1)}";
string uploadRange = $"bytes {i}-{Math.Min(contentLength - 1, i + 5_000_000 - 1)}/{contentLength}";
using Stream downloadStream = await downloadUrl
    .WithOAuthBearerToken(token)
    .WithHeader("Range", range)
    .GetStreamAsync(completionOption: HttpCompletionOption.ResponseHeadersRead);

var content = new StreamContent(downloadStream);

var response = await uploadStreamUrl
    .AppendPathSegment("resumable")
    .WithOAuthBearerToken(token)
    .WithHeader("Content-Range", uploadRange)
    .WithHeader("Session-Id", sessionId)
    .PutAsync(content);

if (response.StatusCode == StatusCodes.Status200OK)
{
    var jsonResponse = response.GetStringAsync().Result;
    dynamic data = JsonConvert.DeserializeObject<dynamic>(jsonResponse);

    objectId = data.objectId;
}

}`
its in this method: PassDownloadToStorageLocation(...)
it looks like the .ifc is downloaded to varibable content, but i get 403 when this is called:
var response = await uploadStreamUrl
.AppendPathSegment("resumable")
.WithOAuthBearerToken(token)
.WithHeader("Content-Range", uploadRange)
.WithHeader("Session-Id", sessionId)
.PutAsync(content);

Thanks for reporting. This sample still uses some deprecated API, so it caused the error.
As our new SDK is coming, we have plans to migrate most of our samples to use the new one, but it would take time to complete.
However, we don't want to block you from using this sample, so if you want to fix this issue yourself, please follow this blog post to migrate to the new API:
https://aps.autodesk.com/blog/download-derivative-files-using-new-signedcookies-api-without-setting-cookies-first-header
Our apologies for the inconveinece!

Sorry for the delay. The new and updated repo can be found here: https://github.com/autodesk-platform-services/aps-revit.ifc.scheduler


changes to build-cassandra-bin working with cassandra 3.10

Because who doesn't want the latest Cassandra version?
in particular C* 3.0.10 doesn't support offheap_objects

Can one of the admins verify this patch?

Are you sure this is enough for the framework to support C* 3.10? I am guessing that some of the cassandra.yaml parameters have been changed/added/removed from 3.0.10 to 3.10

It works for me!

Hey guys, any chance of more movement on this? Do you wan/need more tests or anything?

+1

Hi folks, unfortunately we're sticking with 3.0.x for a while longer, as this is what is still recommended as stable by DataStax.  You can see our version policy here.
I'd guess we'll probably move to 3.11 at some point after that has baked, but we don't have any current plans.


Launching experimental debugger with mixed indentations in Python code fails silently

Use a mix of tabs and spaces in Python code
Launch the debugger, and it fails silently (basically nothing happens)

https://github.com/Microsoft/ptvsd/issues/79

Duplicate of #753


Documentation proofreading

Pull Request
Related issue
(No related issue)
What does this PR do?
Proofreads portions of the documentation, attempting to improve its readability.
PR checklist
Please check if your PR fulfills the following requirements:

[x] Does this PR fix an existing issue, or have you listed the changes applied in the PR description (and why they are needed)?
[ ] Have you read the contributing guidelines? (This project seems to be missing a CONTRIBUTING.md)
[x] Have you made sure that the title is accurate and descriptive of the changes?

Thank you so much for contributing to Meilisearch!

@wackbyte Could you please cargo +nightly fmt the project?

Done!


:Disconnect method for Iris:Connect and State:OnChange objects

Should be fixed here: #95e9232

This is probably the better way to do this. A table with nothing except a Disconnect method just for the sake of consistency with RBXScriptConnection instances is overkill now that i think of it.

Yeah, it would be nice, but there are other examples of where returning the disconnect callback is perfectly fine.


UnpicklingError: invalid load key, '\x0a'

I'm trying to validate this model by using colab, and the Unpickling Error occurred like below:
Traceback (most recent call last):
File "coco_validation.py", line 51, in
main()
File "coco_validation.py", line 40, in main
retinanet.load_state_dict(torch.load(parser.model_path, map_location=torch.device('cuda')))
File "/usr/local/lib/python3.6/dist-packages/torch/serialization.py", line 529, in load
return _legacy_load(opened_file, map_location, pickle_module, **pickle_load_args)
File "/usr/local/lib/python3.6/dist-packages/torch/serialization.py", line 692, in _legacy_load
magic_number = pickle_module.load(f, **pickle_load_args)
_pickle.UnpicklingError: invalid load key, '\x0a'.
I've googled a lot to search the answer but the only thing that I've got is that this problem is related to the range of something...
Thank you in advance

@miramira227 I am facing same issue, did you find solution?
Thanks


new feature/ Implement Course Management on Admin Dashboard

Create forms for Course management.
Implement views and templates to handle CRUD functionality on the Database

Write tests to ensure CRUD functionality for courses works as it should.


Rename charts to match chartjs-chart-* naming convention

Chart.BarFunnel.js and Chart.smith.js should probably be renamed to chartjs-chart-barfunnel and chartjs-chart-smith or similar

Could be better to have tickets on both repositories than here :)

Ok. See https://github.com/chartjs/Chart.smith.js/issues/4 and https://github.com/chartjs/Chart.BarFunnel.js/issues/7

Thanks, closing this one!


fix(custom): optionally return category from value(). close #12952

Signed-off-by: LemniscateX<EMAIL_ADDRESS>
Brief Information
This pull request is in the type of:

[x] bug fixing

What does this PR do?
Fix value() method of parameter api in custom renderItem from returning unexpected ordinal index.
Fixed issues
Fix #12952
Details
Before: What was the problem?
RenderItem's data construction will use the ordinal index of dimension x instead of its raw value. Current value() implementation will return this ordinal index.
After: How is it fixed in this PR?
Add detect logic to value() to check if dim is dimension x. If so, return its raw value from ordinalMeta.categories.

@pissang @LemniscateX
I am not sure about the behavior of this API value().
Current behavior:

If the dimension is in type of 'ordinal', and the dimension is used by an 'category' axis, value() returns the ordinal number rather than the original category string.
Else value() returns the original category string.

If we change the behavior like the PR did:
In all cases value() returns the original category string.
The two issues need to be considered.

It is a break change. And in some cases that might not easy to fix that, because users might not know how to get the ordinal number.
As 1 mentioned, users might need to get the ordinal number, which might be used to calculate the coordinate or retrieve something as an index.

So I prefer not to modify the behavior of value().
But since 5.0 there is an extra api ordinalRawValue() provided, but not documented, but used in an test/custom-shape-morphing3.html. The behavior is:

If the original value is 'hahaha' and the dimension type is 'ordinal', rawValue() always returns 'hahaha' whether this dimension is used by a category axis or not.
In other cases, it is the same as value() did.

Is ordinalRawValue() it enough for this issue? Or anything else ideas?

@pissang @LemniscateX
I am not sure about the behavior of this API value().
Current behavior:

If the dimension is in type of 'ordinal', and the dimension is used by an 'category' axis, value() returns the ordinal number rather than the original category string.
Else value() returns the original category string.

If we change the behavior like the PR did:
In all cases value() returns the original category string.
The two issues need to be considered.

It is a break change. And in some cases that might not easy to fix that, because users might not know how to get the ordinal number.
As 1 mentioned, users might need to get the ordinal number, which might be used to calculate the coordinate or retrieve something as an index.

So I prefer not to modify the behavior of value().
But since 5.0 there is an extra api ordinalRawValue() provided, but not documented, but used in an test/custom-shape-morphing3.html. The behavior is:

If the original value is 'hahaha' and the dimension type is 'ordinal', rawValue() always returns 'hahaha' whether this dimension is used by a category axis or not.
In other cases, it is the same as value() did.

Is ordinalRawValue() it enough for this issue? Or anything else ideas?

I agree with you that ordinalRawValue() can meet the demand of getting original value no matter what the data type it is, and as well as to fix the issue.
It just seems that value() is out of users' expectation when it comes to dimension x. I guess a little bit mention in document would be better. XD


Calculating hold/slider note score based on time held down

As a player, I want to get score when I hold down a hold note, so I can feel validated when it's not just the start and end of the hold note.

If you are NOT holding the note, get points based on milliseconds passed. Also if you hold it too early, you get punished too. And also for holding passed the end.
We want some point calculation done while note is being held down. One way is having ticks and calculating ticks of scores when you hold down through it. Another simpler way is just calculating score on every frame - every missed millisecond adds to score.
May require reworking of how hold notes work - currently hold note disappears if you miss it or let go too early

Implementation details: For every time UpdateNote gets called, I will check if you're holding and hovering the note. If true and you're in VisibleBefore or VisibleAfter, the score will increase. If false and you're in During, the score will increase.


refactor: Move from global state to functions

This PR represents a few experiments of features I've used in Cobra and some attempts to reduce duplication of code.

Uses cli.GenericFlag to encapsulate parsing and validation of flag values at parse time. This removes the burden from the individual CLI commands to parse and validate args and options.

Add flag.ID that may be used by any flag that requires an Influx ID. flag.ID parses and validates string value is a valid ID, removing this burden from individual commands and ensuring valid values before the command actions begins.

Adds a Flags() method to the Params structs to directly capture the values when parsing flags.

Moves from global state to local builder functions for the majority of the commands. This allows the commands to bind to flag variables reducing the repeated ctx.String(), ctx.Int(), etc

Leverages the BeforeFunc to create middleware and inject the CLI and API client into commands, saving the repeated boilerplate across all of the instantiated commands. This is extensible, so additional middleware can be appends using the middleware.WithBeforeFns

Thanks for the review, @danxmoran. I've pushed a commit with the feedback suggestions.

Sorry to dirty the commit history, didn't want to rebase/force-push and disrupt your other open PR 😬


Add summarize() methods to the LLMs that are missing them.

Motivation:
From the table here, you can see that some of the LLMs are missing the summarize() method.
Tasks:
Please add the method following the similar flow, same prompt, etc.

Assigning this to you @yorzi per discussion in Slack. Thank you!


Refactor doc test and justfile

Separated doc test into a separated justfile recipe
Refactor the name of the test related to recipe to follow the same pattern of test-*.

@yihuaf , if you're busy with something else, just reply to the above comments, and I can push a commit that makes changes accordingly and merge :+1:

Please go ahead. Thanks!
On Sun, Sep 24, 2023 at 11:20 PM Yashodhan @.***> wrote:

@yihuaf https://github.com/yihuaf , if you're busy with something else,
just reply to the above comments, and I can push a commit that makes
changes accordingly and merge 👍
—
Reply to this email directly, view it on GitHub
https://github.com/containers/youki/pull/2330#issuecomment-1732991817,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AEY66HUOZMAL2LG4SYCO6BLX4EPETANCNFSM6AAAAAA4E2PQ3E
.
You are receiving this because you were mentioned.Message ID:
@.***>

Please go ahead. Thanks!

Sure, no worries!

Codecov Report

Merging #2330 (28586ed) into main (0036180) will increase coverage by 0.02%.
Report is 95 commits behind head on main.
The diff coverage is n/a.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2330      +/-   ##
==========================================
+ Coverage   64.81%   64.83%   +0.02%
==========================================
  Files         129      129
  Lines       15171    15201      +30
==========================================
+ Hits         9833     9856      +23
- Misses       5338     5345       +7


JSON import of new resource not working

If I create a new resource in AdminUI on System A and I fill it in two languages, then I export in JSON, then I try to import on System B, it imports only in English. When importing, it does not even display the columns for the other language. In JSON file it seems to be correct:
{
"id": 1987,
"resourceKey": "/zsolttest",
"modificationDate": "2019-04-30T14:02:14.99Z",
"author": "_ext_zsoltne_adm",
"isModified": true,
"translations": [
{
"id": 16936,
"resourceId": 1987,
"language": "de",
"value": "new"
},
{
"id": 16937,
"resourceId": 1987,
"language": "en",
"value": "resource"
}
]
}
Package DbLocalizationProvider.AdminUI.EPiServer 5.5.1.
I cannot reproduce right now, but when I tried to export 2000 migrated resources on System A and tried to import it on System B, which was completely empty, there was no translations imported, only the resource entries themselves.
In both cases a workaround is to reimport the file and accept the "updates".
I am not sure if it has anything to do with legacy and migrated resources.

hi,
are the same languages enabled in both systems?

hi,
yes, for my test it is german and english. I guess otherwise the update would not work either.

any specific/weird resource key names? or just xpath?

found an issue. this affects only new resources. fixing..

No special name, just xpath, alphabetical with foward slash like in the json.


Create 1624.json

Adding the Saga remote by Tornado has the same codes as 1621 but needs to change the off button only

I added the tornado saga


Fail safe mode

see #205
re-created PR because previous PR's history got wonky.

Thanks.  In the future please squash commits like "fix bad rebase" into the original commit that introduced the issue so that we don't have cruft in the permanent history.
Heads-up -- I deleted the .vscode directory.  I don't want to have platform-specific editor settings in the project -- you should be able to do echo /.vscode >> .git/info/exclude to have git ignore the directory in your worktree only.  Maybe we could have an "editor config" file in here, but I'd prefer not to because our style is 100% PEP-8 and it's weird to carry around cruft just for vscode.  Taken to the logical extreme, we would need to maintain configs for all kinds of editors, across all projects I maintain, which does not scale.  Thanks for understanding, and thanks for fixing up the history through your initial rebase.
The implementation was nice and clean -- merged!  Thanks for adding a test case too -- that'll keep me from breaking it in the future.  Please take a look at b4b4333f40ea4c33a9fbce630842d085363d75aa where I had to fixup a few things for flake8 - - this can be tested locally in the future by running the make check target.

Ah, sorry about the .vscode directory. I didn't intend to include that in my PR. Want me to delete the stale branch?

No worries.  I don't mind having the stale branch around personally, but feel free to remove it if you prefer.  It actually makes it kinda easier to see where the PRs originated IMO:
.


Kyma resource does not get deleted

Description
on the development environment one Kyma CR looks like this:
apiVersion: operator.kyma-project.io/v1beta2
kind: Kyma
metadata:
  annotations:
    compass-runtime-id-for-migration: 8229990c-90fe-4984-85fb-7548fb4045ce
    kyma-kcp-crd-generation: "8"
    kyma-skr-crd-generation: "1"
    moduletemplate-kcp-crd-generation: "472"
    moduletemplate-skr-crd-generation: "1"
    skr-domain: c-6298f2f.dev.kyma.ondemand.com
  creationTimestamp: "2024-03-13T08:06:10Z"
  deletionGracePeriodSeconds: 0
  deletionTimestamp: "2024-03-15T00:00:16Z"
  finalizers:
  - operator.kyma-project.io/Kyma
  generation: 2
  labels:
    kyma-project.io/broker-plan-id: 361c511f-f939-4621-b228-d0fb79a1fe15
    kyma-project.io/broker-plan-name: aws
    kyma-project.io/global-account-id: 461f6292-8085-41c8-af0c-e185f39b5e18
    kyma-project.io/instance-id: 3FE0DB9F-754C-4E07-958E-7067669762C1
    kyma-project.io/platform-region: cf-us10-staging
    kyma-project.io/region: eu-central-1
    kyma-project.io/runtime-id: 8229990c-90fe-4984-85fb-7548fb4045ce
    kyma-project.io/shoot-name: c-6298f2f
    kyma-project.io/subaccount-id: e61d0f49-ef82-4fa5-96e0-7a0fe1ed02c9
    operator.kyma-project.io/beta: "true"
    operator.kyma-project.io/internal: "true"
    operator.kyma-project.io/kyma-name: 8229990c-90fe-4984-85fb-7548fb4045ce
    operator.kyma-project.io/managed-by: lifecycle-manager
    operator.kyma-project.io/skip-reconciliation: "true"
  name: 8229990c-90fe-4984-85fb-7548fb4045ce
  namespace: kcp-system
  resourceVersion: "3592657167"
  uid: 21ee600b-eec7-4d55-b495-8b79c4e3174b
spec:
  channel: fast
  modules:
  - customResourcePolicy: CreateAndDelete
    name: api-gateway
  - customResourcePolicy: CreateAndDelete
    name: istio
  - customResourcePolicy: CreateAndDelete
    name: btp-operator
status:
  activeChannel: fast
  conditions:
  - lastTransitionTime: "2024-03-13T14:11:47Z"
    message: all modules are in ready state
    observedGeneration: 1
    reason: Ready
    status: "True"
    type: Modules
  - lastTransitionTime: "2024-03-13T14:11:47Z"
    message: module templates are synchronized
    observedGeneration: 1
    reason: Ready
    status: "True"
    type: ModuleCatalog
  - lastTransitionTime: "2024-03-13T14:11:47Z"
    message: skrwebhook is synchronized
    observedGeneration: 1
    reason: Ready
    status: "True"
    type: SKRWebhook
  lastOperation:
    lastUpdateTime: "2024-03-13T14:11:47Z"
    operation: kyma is ready
  modules:
  - channel: fast
    fqdn: kyma-project.io/module/nats
    manifest:
      apiVersion: operator.kyma-project.io/v1beta2
      kind: Manifest
      metadata:
        generation: 1
        name: 8229990c-90fe-4984-85fb-7548fb4045ce-nats-2143556813
        namespace: kcp-system
    name: nats
    resource:
      apiVersion: operator.kyma-project.io/v1alpha1
      kind: NATS
      metadata:
        name: eventing-nats
        namespace: kyma-system
    state: Ready
    template:
      apiVersion: operator.kyma-project.io/v1beta2
      kind: ModuleTemplate
      metadata:
        generation: 1
        name: nats-fast
        namespace: kcp-system
    version: 1.1.0
  - channel: fast
    fqdn: kyma-project.io/module/serverless
    manifest:
      apiVersion: operator.kyma-project.io/v1beta2
      kind: Manifest
      metadata:
        generation: 1
        name: 8229990c-90fe-4984-85fb-7548fb4045ce-serverless-2752323641
        namespace: kcp-system
    name: serverless
    resource:
      apiVersion: operator.kyma-project.io/v1alpha1
      kind: Serverless
      metadata:
        name: default
        namespace: kyma-system
    state: Ready
    template:
      apiVersion: operator.kyma-project.io/v1beta2
      kind: ModuleTemplate
      metadata:
        generation: 1
        name: serverless-fast
        namespace: kcp-system
    version: 1.3.1
  - channel: fast
    fqdn: kyma-project.io/module/telemetry
    manifest:
      apiVersion: operator.kyma-project.io/v1beta2
      kind: Manifest
      metadata:
        generation: 1
        name: 8229990c-90fe-4984-85fb-7548fb4045ce-telemetry-812080235
        namespace: kcp-system
    name: telemetry
    resource:
      apiVersion: operator.kyma-project.io/v1alpha1
      kind: Telemetry
      metadata:
        name: default
        namespace: kyma-system
    state: Ready
    template:
      apiVersion: operator.kyma-project.io/v1beta2
      kind: ModuleTemplate
      metadata:
        generation: 1
        name: telemetry-fast
        namespace: kcp-system
    version: 1.10.1
  - channel: fast
    fqdn: kyma-project.io/module/application-connector
    manifest:
      apiVersion: operator.kyma-project.io/v1beta2
      kind: Manifest
      metadata:
        generation: 1
        name: 8229990c-90fe-4984-85fb-7548fb4045ce-application-connector-134
        namespace: kcp-system
    name: application-connector
    resource:
      apiVersion: operator.kyma-project.io/v1alpha1
      kind: ApplicationConnector
      metadata:
        name: applicationconnector-sample
        namespace: kyma-system
    state: Ready
    template:
      apiVersion: operator.kyma-project.io/v1beta2
      kind: ModuleTemplate
      metadata:
        generation: 1
        name: application-connector-fast
        namespace: kcp-system
    version: 1.0.6
  - channel: fast
    fqdn: kyma-project.io/module/istio
    manifest:
      apiVersion: operator.kyma-project.io/v1beta2
      kind: Manifest
      metadata:
        generation: 1
        name: 8229990c-90fe-4984-85fb-7548fb4045ce-istio-4034478325
        namespace: kcp-system
    name: istio
    resource:
      apiVersion: operator.kyma-project.io/v1alpha2
      kind: Istio
      metadata:
        name: default
        namespace: kyma-system
    state: Ready
    template:
      apiVersion: operator.kyma-project.io/v1beta2
      kind: ModuleTemplate
      metadata:
        generation: 1
        name: istio-fast
        namespace: kcp-system
    version: 1.3.2
  - channel: fast
    fqdn: kyma-project.io/module/btp-operator
    manifest:
      apiVersion: operator.kyma-project.io/v1beta2
      kind: Manifest
      metadata:
        generation: 1
        name: 8229990c-90fe-4984-85fb-7548fb4045ce-btp-operator-732144065
        namespace: kcp-system
    name: btp-operator
    resource:
      apiVersion: operator.kyma-project.io/v1alpha1
      kind: BtpOperator
      metadata:
        name: btpoperator
        namespace: kyma-system
    state: Ready
    template:
      apiVersion: operator.kyma-project.io/v1beta2
      kind: ModuleTemplate
      metadata:
        generation: 1
        name: btp-operator-fast
        namespace: kcp-system
    version: 1.1.5
  - channel: fast
    fqdn: kyma-project.io/module/api-gateway
    manifest:
      apiVersion: operator.kyma-project.io/v1beta2
      kind: Manifest
      metadata:
        generation: 1
        name: 8229990c-90fe-4984-85fb-7548fb4045ce-api-gateway-1209152227
        namespace: kcp-system
    name: api-gateway
    resource:
      apiVersion: operator.kyma-project.io/v1alpha1
      kind: APIGateway
      metadata:
        name: default
        namespace: ""
    state: Ready
    template:
      apiVersion: operator.kyma-project.io/v1beta2
      kind: ModuleTemplate
      metadata:
        generation: 1
        name: api-gateway-fast
        namespace: kcp-system
    version: 2.2.1
  - channel: fast
    fqdn: kyma-project.io/module/eventing
    manifest:
      apiVersion: operator.kyma-project.io/v1beta2
      kind: Manifest
      metadata:
        generation: 1
        name: 8229990c-90fe-4984-85fb-7548fb4045ce-eventing-3765891325
        namespace: kcp-system
    name: eventing
    resource:
      apiVersion: operator.kyma-project.io/v1alpha1
      kind: Eventing
      metadata:
        name: eventing
        namespace: kyma-system
    state: Ready
    template:
      apiVersion: operator.kyma-project.io/v1beta2
      kind: ModuleTemplate
      metadata:
        generation: 1
        name: eventing-fast
        namespace: kcp-system
    version: 1.1.0
  state: Ready

as can be seen. The CR has a deletion timestamp and thus should be deleted.
The reconciler logs show:
{"level":"ERROR","date":"2024-03-15T12:12:15.000188058Z","caller":"controller/controller.go:329","msg":"Reconciler error","context":{"controller":"purge","controllerGroup":"operator.kyma-project.io","controllerKind":"Kyma","Kyma":{"name":"8229990c-90fe-4984-85fb-7548fb4045ce","namespace":"kcp-system"},"namespace":"kcp-system","name":"8229990c-90fe-4984-85fb-7548fb4045ce","reconcileID":"51a80dbb-710f-46d3-b9bf-49efd8dc7742","error":"secret with label operator.kyma-project.io/kyma-name=8229990c-90fe-4984-85fb-7548fb4045ce access secret not found"},"stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/internal/controller/controller.go:329\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/internal/controller/controller.go:227"}
{"level":"ERROR","date":"2024-03-15T12:12:25.001452452Z","caller":"controller/controller.go:329","msg":"Reconciler error","context":{"controller":"purge","controllerGroup":"operator.kyma-project.io","controllerKind":"Kyma","Kyma":{"name":"8229990c-90fe-4984-85fb-7548fb4045ce","namespace":"kcp-system"},"namespace":"kcp-system","name":"8229990c-90fe-4984-85fb-7548fb4045ce","reconcileID":"124bca14-a901-4f48-b759-b99303a13f42","error":"secret with label operator.kyma-project.io/kyma-name=8229990c-90fe-4984-85fb-7548fb4045ce access secret not found"},"stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/internal/controller/controller.go:329\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/internal/controller/controller.go:227"}
{"level":"ERROR","date":"2024-03-15T12:12:45.002066301Z","caller":"controller/controller.go:329","msg":"Reconciler error","context":{"controller":"purge","controllerGroup":"operator.kyma-project.io","controllerKind":"Kyma","Kyma":{"name":"8229990c-90fe-4984-85fb-7548fb4045ce","namespace":"kcp-system"},"namespace":"kcp-system","name":"8229990c-90fe-4984-85fb-7548fb4045ce","reconcileID":"37152dff-38e4-42a2-8d1f-bcf72f283530","error":"secret with label operator.kyma-project.io/kyma-name=8229990c-90fe-4984-85fb-7548fb4045ce access secret not found"},"stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/internal/controller/controller.go:329\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/internal/controller/controller.go:227"}
{"level":"ERROR","date":"2024-03-15T12:12:50.002818489Z","caller":"controller/controller.go:329","msg":"Reconciler error","context":{"controller":"purge","controllerGroup":"operator.kyma-project.io","controllerKind":"Kyma","Kyma":{"name":"8229990c-90fe-4984-85fb-7548fb4045ce","namespace":"kcp-system"},"namespace":"kcp-system","name":"8229990c-90fe-4984-85fb-7548fb4045ce","reconcileID":"251d7d6d-445d-48ec-a402-7745e9d106ed","error":"secret with label operator.kyma-project.io/kyma-name=8229990c-90fe-4984-85fb-7548fb4045ce access secret not found"},"stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/internal/controller/controller.go:329\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/internal/controller/controller.go:266\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.17.2/pkg/internal/controller/controller.go:227"}

Steps to reproduce
no idea
Environment Type
Managed
Environment Info
Kubernetes Version: x.y.z
Docker Version: x.y.z
Kyma CLI Version: x.y.z
If used - k3d/k3s/minikube versions
Attachments
No response

This may be related to: https://github.tools.sap/kyma/backlog/issues/5219
What we can see however is that the KymaCR does not include the purge finalizer anymore. Metrics also show that a purge has been performed at 01:00 which may be related to this Kyma. It would at least correlate with the behavior we observed from the other ticket (roughly one hour after triggering the deletion, KEB forcefully de-provisions the SKR shoot).

In the other issue de-provisioning the shoot also led to successfully deleting the KymaCR. In this case however, this doesn't seem to be true (SKR shoot and secret are gone, but KymaCR is still there with operator.kyma-project.io/Kyma finalizer). This needs to be investigated.
CC @ruanxin

This may be related to an issue on prod.
What we can see however is that the KymaCR does not include the purge finalizer anymore. Metrics also show that a purge has been performed at 01:00 which may be related to this Kyma. It would at least correlate with the behavior we observed from the other ticket (roughly one hour after triggering the deletion, KEB forcefully de-provisions the SKR shoot).

In the other issue de-provisioning the shoot also led to successfully deleting the KymaCR. In this case however, this doesn't seem to be true (SKR shoot and secret are gone, but KymaCR is still there with operator.kyma-project.io/Kyma finalizer). This needs to be investigated.
CC @ruanxin

This kyma marked with label operator.kyma-project.io/skip-reconciliation: "true", kyma controller is not taking this into reconciliation.
I can't say this is a bug or rather expected behaviour, it brings value for troubleshooting purposes, that if some kymas marked for skip reconciliation, we keep it even the remote shoot cluster is gone. @janmedrek, we can discussion how to deal with this situation.

Well, in my opinion, it would be expected behaviour to not touch Kyma CRs that are marked with the skip label at all.
Skip label is only added manually in the KCP by a person who has access to the environment. And this should be the one responsible for removing that label.
I would keep the behaviour as it is and clearly state in our KCP good practices that if someone adds that label they should also make sure it is gone.


dlsym finds the wrong symbol from another handle

It seems that if a extern "C" function does not hide its visibility, it may be used to resolve the symbol in later usages of dlsym with a distinct handle even though dlopen uses RTLD_LOCAL. This would imply the symbol is re-exported just through linking a dependency, though this still remains unclear.
Situation: mod A depends on mod B and both are late mods. If mod A does not have late_load, it will use mod B's late_load and cause a double call. This should instead be null
Discord discussion https://discord.com/channels/994470435100033074/1011387411021975564/1201031750604824587

Should be resolved with this https://github.com/sc2ad/scotland2/pull/12

Resolved in #12


[enhencement] add cobra manpage generation command for siac

I will create a pr for this one.

Implemented in #1753


unify json production as much as possible

@doutriaux1 @lee1043   CD can provide example in one of a number of existing branches (e.g, https://github.com/PCMDI/pcmdi_metrics/blob/334_monsoon_wang/src/python/devel/monsoon_wang/scripts/monsoon-wang_driver.py) and JL and PG can propagate across other branches

@doutriaux1 @lee1043  PG using monsoon-wang as a test case using JSON class... we will need to improve and apply this in all other analysis codes

@gleckler1 I think we can close this one now. Correct?

@doutriaux1 Yes, but to advance the solution we need to have the PMPparser as part of the PMP master on github so that we can efficiently advance the common/default arguments (https://github.com/PCMDI/pcmdi_metrics/wiki/PMPParser)

@zshaheen I think we can merge this in today, correct? @zshaheen isn't the Parser already in?

@doutriaux1 yes, the parser is in, but not under a main release on conda. So you have to download a nightly to use it.

@zshaheen @doutriaux1  We need the parser in the PMP github master.   Can you do a pull request for just the parser, NOT the rest of the CDP?

But it is in master. See here: https://github.com/PCMDI/pcmdi_metrics/blob/master/src/python/pcmdi/pmp_parser.py
I think you want it where a user doesn't need to install CDP, is that correct?

@zshaheen I think @gleckler1 didn't realize he could already use it in his branch

@zshaheen can you point @gleckler1 to your wiki page on how to use this for his driver

@zshaheen @doutriaux1 OK, I think I'm getting it.  Its in master, but only in the nightly conda build (not the v1.1 release).   Do I have the process (below) right for making changes?
From a nigthly conda env, I go to ~/git/pcmdi_metrics, create a branch to modify the default CDP parameters in (~git/pcmdi_metrics/src/python/pcmdi/pmp_parser.py), push it, make a pull request, and once that gets accepted/merged into master the next day the changes will be available in the nightly conda build of the PMP.
Is that right??

it should be, assuming @zshaheen to get the automatic nighlty build is in as well.

@gleckler1 Here's the page on how to use the parser, which I think you already have: https://github.com/PCMDI/pcmdi_metrics/wiki/PMPParser
This is how the driver will work, once we accept the pull request (after modifications to account for the changes after late November): https://github.com/PCMDI/pcmdi_metrics/wiki/PMP-using-CDP-Guide
@gleckler1 yes, your statement is correct.
@doutriaux1 I guess I'll try to get the nightly builds working today.

@doutriaux1 @zshaheen  Thanks...  using the parser rnow (e.g., https://github.com/PCMDI/pcmdi_metrics/blob/334_monsoon_wang/src/python/devel/monsoon_wang/scripts/mpi_compute.py)...  finessing and augmenting the default options will be how we work towards unifying different metrics.

@doutriaux1 @gleckler1 Nightly uploads are now working. It'll only upload the pull requests when they get accepted into master, not before.


LOG_CHANNEL error

Deploy un keyeb
Starting Bot....✨
Traceback (most recent call last):
File "/workspace/bot.py", line 5, in
from config import Config
File "/workspace/config.py", line 27, in
class Config(object):
File "/workspace/config.py", line 42, in Config
LOG_CHANNEL = int(os.environ.get("LOG_CHANNEL"))

add LOG_CHANNEL id in your variable


Fix kuzu integration .execute() calls, which require a dict not a list of tuples

Description
Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.
Fixes https://github.com/run-llama/llama_index/issues/9244
New Package? N/A
Did I fill in the tool.llamahub section in the pyproject.toml and provide a detailed README.md for my new integration or package?

[ ] Yes
[ ] No

Version Bump?
Did I bump the version in the pyproject.toml file of the package I am updating? (Except for the llama-index-core package)

[ ] Yes
[x ] No

Type of Change
Please delete options that are not relevant.

[ x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

How Has This Been Tested?
Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration

[x] Ran the Kuzu example, it was broken before my changes and now it runs fine both on Mac and Windows.
[ ] Added new unit/integration tests
[ ] Added new notebook (that tests end-to-end)
[ ] I stared at the code and made sure it makes sense

Suggested Checklist:

[ ] I have performed a self-review of my own code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] I have added Google Colab support for the newly added notebooks.
[ ] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] New and existing unit tests pass locally with my changes
[ ] I ran make format; make lint to appease the lint gods

Thanks @ZmeiGorynych, can you also please update the version (patch) number in pyproject.toml?

@ZmeiGorynych looks like lint/fmt checks are failing can you please run:
make lint and make format


Support Bitbucket API 1.0 in committime exporter

On premise instances of bitbucket (Bitbucket Server) do not support API 2.0, as it is only available for Bitbucket Cloud. Can we get a committime exporter collector for Bitbucket Server?

First of all thank you for your quick response to this issue. I have tested your PR and I found a little problem, but I'm not sure if it's on my side. Let me detail what I did:
As the network traffic from the organization's OpenShift cluster to GitHub is restricted, I could not mount this PR as documented in https://pelorus.readthedocs.io/en/latest/Configuration/
exporters:
  instances:
  - app_name: committime-github
    exporter_type: comittime
    source_url: https://github.com/konveyor/pelorus.git
    source_ref: refs/pull/680/head
    env_from_secrets:
    - github-credentials
    env_from_configmaps:
    - pelorus-config
    - committime-config

What I did instead is create a configmap with the new collector_bitbucket.py and mounted it as a volume in /opt/app-root/lib64/python3.9/site-packages/committime/collector_bitbucket.py. This produced the following error: ModuleNotFoundError: No module named 'pelorus.timeutil'.
I found the file on the repo so I deleted the import and pasted the methods directly in collector_bitbucket.py (definitely not a good fix but it's the first thing that came to my mind) . After this, I started to read debug logs retrieving commit information, so I assume it works.
Therefore I can confirm the code works, but I can't verify that the module pelorus.timeutil can be imported.

Glad to hear it's working! We'll see if we can get it merged and cut a quick release.

@xacobecm the latest release, 2.0.1, should fix things. Please let us know if it works for you (in released form)!


validators should allow for processing false as an option (For exampl…

…e if I need isArray: false or similar things)

This cannot be done as sending false as the options should skip the validations according to the docs. Is there any reason why you can't use an empty object?


Update microsoft-graph-migration.md: include az ad app update

az ad app create and az ad app update share the same parameters, so we should include az ad app update in the breaking change doc as well.
Close #3171

Docs Build status updates of commit 3640ab0:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs-ref-conceptual/microsoft-graph-migration.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel


I can't install Teams Toolkit plugin into VScode

Type: Bug
The commnd line shows some error message when software startup,
2023-06-01 14:29:28.029 [error] end of central directory record signature not found: CorruptZip: end of central directory record signature not found
at pt.download (c:\Users\kz06\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\code\node\sharedProcess\sharedProcessMain.js:88:141)
at process.processTicksAndRejections (node:internal/process/task_queues:96:5)
at async x.y (c:\Users\kz06\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\code\node\sharedProcess\sharedProcessMain.js:88:20937)
at async x.h (c:\Users\kz06\AppData\Local\Programs\Microsoft VS Code\resources\app\out\vs\code\node\sharedProcess\sharedProcessMain.js:88:19006)
and I can't install Teams Toolkit plugin into VScode
VS Code version: Code 1.78.2 (b3e4e68a0bc097f0ae7907b217c1119af9e03435, 2023-05-10T14:39:26.248Z)
OS version: Windows_NT x64 10.0.19045
Modes:
Sandboxed: Yes

System Info

Item
Value

CPUs
Intel(R) Core(TM) i7-10700 CPU @ 2.90GHz (16 x 2904)

GPU Status
2d_canvas: enabledcanvas_oop_rasterization: disabled_offdirect_rendering_display_compositor: disabled_off_okgpu_compositing: enabledmultiple_raster_threads: enabled_onopengl: enabled_onrasterization: enabledraw_draw: disabled_off_okvideo_decode: enabledvideo_encode: enabledvulkan: disabled_offwebgl: enabledwebgl2: enabledwebgpu: enabled

Load (avg)
undefined

Memory (System)
15.72GB (2.46GB free)

Process Argv
--crash-reporter-id 8edf40db-4ed3-493b-9e50-d992d85ae4d4

Screen Reader
no

VM
0%

Extensions (18)

Extension
Author (truncated)
Version

vscode-eslint
dba
2.4.0

python-environment-manager
don
1.0.4

python-extension-pack
don
1.7.0

gitlens
eam
13.6.0

go
gol
0.38.0

vsc-python-indent
Kev
1.18.0

dotenv
mik
1.0.1

isort
ms-
2022.8.0

python
ms-
2023.4.1

vscode-pylance
ms-
2023.5.50

vetur
oct
0.37.3

material-icon-theme
PKi
4.28.0

LiveServer
rit
5.7.9

intellicode-api-usage-examples
Vis
0.2.7

vscodeintellicode
Vis
1.2.30

volar
Vue
1.2.0

jinja
who
0.0.8

markdown-all-in-one
yzh
3.5.1

(1 theme extensions excluded)

A/B Experiments
vsliv368cf:30146710
vsreu685:30147344
python383:30185418
vspor879:30202332
vspor708:30202333
vspor363:30204092
vslsvsres303:30308271
vserr242:30382549
pythontb:30283811
vsjup518:30340749
pythonptprofiler:30281270
vshan820:30294714
vstes263:30335439
vscoreces:30445986
vscod805cf:30301675
binariesv615:30325510
bridge0708:30335490
bridge0723:30353136
cmake_vspar411:30581797
vsaa593cf:30376535
pythonvs932:30410667
cppdebug:30492333
vsclangdc:30486549
c4g48928:30535728
dsvsc012:30540252
pynewext54:30695312
azure-dev_surveyone:30548225
vsccc:30610678
2e4cg342:30602488
pyind779:30671433
89544117:30613380
pythonsymbol12:30671437
a9j8j154:30646983
showlangstatbar:30737416
vsctsb:30748421
pythonms35:30701012
pythonfmttext:30731395
pythoncmv:30739700
fixshowwlkth:30730052
showsbindicator:30730056
pythongtdpathcf:30739705

Does the same happen if you download the VSIX directly from Marketplace and then drag/drop the file into Extensions view?

Does the same happen if you download the VSIX directly from Marketplace and then drag/drop the file into Extensions view?

hi @gjsjohnmurray ,
Yes, it outputs the same error message: 'end of central directory record signature not found'
And I just tried to install it via the command line, it installed successfully.

I have no idea about this situation.

This one? /duplicate of https://github.com/microsoft/vscode/issues/182196
It (v5.0.0) just installed for me without problems. Maybe it's getting corrupted somewhere on your connection, or a bad copy has been cached.

Thanks for creating this issue! We figured it's covering the same as another one we already have. Thus, we closed this one as a duplicate. You can search for similar existing issues. See also our issue reporting guidelines.
Happy Coding!

@gjsjohnmurray
Yes, Teams Toolkit extension.
I have also tried it on my other PC and Mac, and it works well as you.
But in this PC, the problem occurs.

Sorry, my previous comment originally and incorrectly had a command in it that caused the bot to close this issue.
Do you have an antivirus on the PC with the problem? Maybe it's interfering with the file.

Yep, I'm using the company PC, It installed a McAfee.
Could it have affected the installation process?

I don't know. But I do know that McAfee AV has been causing a lot of grief with the latest VS Code. See https://github.com/microsoft/vscode/issues/178962

Okay, thanks.
I would ask for some help from our IT admin to get advice and some test on it.


Caching issue the pwcalculation is clean before phonon_frequencies finished

The pressure workchain (or other) will clean remote folder when the workchain in verifying charge density cutoff (coincidently when the wavefunction cutoff test give the same recommended cutoff) is all finished, but this may happened before phonon frequencies and bands workchain are done, and cause the caching to fail.

This is fine, it only happened in some cases and I want the rho cutoff verification don't have caching (It can have, but not save too much if the recommended wavefunction cutoffs are different for properties.) I'd sacrifice this cost to save inodes space.

This can be mitigate by put bands/phonon_frequencies workflows before cohesive/pressure/delta.


Unable to finetune Mistral-7B with DeepSpeed Zero3

Please check that this issue hasn't been reported before.

[X] I searched previous Bug Reports didn't find any similar reports.

Expected Behavior
I'm currently testing if I can fit the sequence_len so at the very least it should give an OOM. I have tried changing the sample_packing to false but it just returns a different error.
My setup is not ideal since I'm using Pytorch with CUDA 11.7 and BitsAndBytes with CUDA 12.2 (the version of my GPUs driver).

WARNING:torch.distributed.elastic.multiprocessing.api:Sending process 175956 closing signal SIGTERM
WARNING:torch.distributed.elastic.multiprocessing.api:Sending process 175957 closing signal SIGTERM
WARNING:torch.distributed.elastic.multiprocessing.api:Sending process 175958 closing signal SIGTERM
wandb: WARNING No program path found, not creating job artifact. See https://docs.wandb.ai/guides/launch/create-job
ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: -6) local_rank: 3 (pid: 175959) of binary: /.../.venv/bin/python
Traceback (most recent call last):
  File "/..../.venv/bin/accelerate", line 8, in <module>
    sys.exit(main())
  File "/.../.venv/lib/python3.10/site-packages/accelerate/commands/accelerate_cli.py", line 47, in main
    args.func(args)
  File "/.../.venv/lib/python3.10/site-packages/accelerate/commands/launch.py", line 1008, in launch_command
    deepspeed_launcher(args)
  File "/.../.venv/lib/python3.10/site-packages/accelerate/commands/launch.py", line 724, in deepspeed_launcher
    distrib_run.run(args)
  File "/.../.venv/lib/python3.10/site-packages/torch/distributed/run.py", line 785, in run
    elastic_launch(
  File "/.../.venv/lib/python3.10/site-packages/torch/distributed/launcher/api.py", line 134, in __call__
    return launch_agent(self._config, self._entrypoint, list(args))
  File "/.../.venv/lib/python3.10/site-packages/torch/distributed/launcher/api.py", line 250, in launch_agent
    raise ChildFailedError(
torch.distributed.elastic.multiprocessing.errors.ChildFailedError

sample_packing=false
Traceback (most recent call last):
  File "/opt/miniconda3/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/opt/miniconda3/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/.../axolotl/src/axolotl/cli/train.py", line 42, in <module>
    fire.Fire(do_cli)
  File "/.../.venv/lib/python3.10/site-packages/fire/core.py", line 141, in Fire
    component_trace = _Fire(component, args, parsed_flag_args, context, name)
  File "/.../.venv/lib/python3.10/site-packages/fire/core.py", line 475, in _Fire
    component, remaining_args = _CallAndUpdateTrace(
  File "/.../.venv/lib/python3.10/site-packages/fire/core.py", line 691, in _CallAndUpdateTrace
    component = fn(*varargs, **kwargs)
  File "/.../axolotl/src/axolotl/cli/train.py", line 38, in do_cli
    train(cfg=parsed_cfg, cli_args=parsed_cli_args, dataset_meta=dataset_meta)
  File "/.../axolotl/src/axolotl/train.py", line 142, in train
    trainer.train(resume_from_checkpoint=resume_from_checkpoint)
  File "/.../.venv/lib/python3.10/site-packages/transformers/trainer.py", line 1543, in train
    return inner_training_loop(
  File "/.../.venv/lib/python3.10/site-packages/transformers/trainer.py", line 1860, in _inner_training_loop
    tr_loss_step = self.training_step(model, inputs)
  File "/.../.venv/lib/python3.10/site-packages/transformers/trainer.py", line 2746, in training_step
    self.accelerator.backward(loss)
  File "/.../.venv/lib/python3.10/site-packages/accelerate/accelerator.py", line 1958, in backward
    self.deepspeed_engine_wrapped.backward(loss, **kwargs)
  File "/.../.venv/lib/python3.10/site-packages/accelerate/utils/deepspeed.py", line 167, in backward
    self.engine.backward(loss, **kwargs)
  File "/.../.venv/lib/python3.10/site-packages/deepspeed/utils/nvtx.py", line 15, in wrapped_fn
    ret_val = func(*args, **kwargs)
  File "/.../.venv/lib/python3.10/site-packages/deepspeed/runtime/engine.py", line 1955, in backward
    self.optimizer.backward(loss, retain_graph=retain_graph)
  File "/.../.venv/lib/python3.10/site-packages/deepspeed/utils/nvtx.py", line 15, in wrapped_fn
    ret_val = func(*args, **kwargs)
  File "/.../.venv/lib/python3.10/site-packages/deepspeed/runtime/zero/stage3.py", line 2135, in backward
    self.loss_scaler.backward(loss.float(), retain_graph=retain_graph)
  File "/.../.venv/lib/python3.10/site-packages/deepspeed/runtime/fp16/loss_scaler.py", line 63, in backward
    scaled_loss.backward(retain_graph=retain_graph)
  File "/.../.venv/lib/python3.10/site-packages/torch/_tensor.py", line 487, in backward
    torch.autograd.backward(
  File "/.../.venv/lib/python3.10/site-packages/torch/autograd/__init__.py", line 200, in backward
    Variable._execution_engine.run_backward(  # Calls into the C++ engine to run the backward pass
RuntimeError: The size of tensor a (0) must match the size of tensor b (14336) at non-singleton dimension 1

Steps to reproduce
I have created a accelerate config file:
compute_environment: LOCAL_MACHINE
debug: false
deepspeed_config:
  deepspeed_config_file: deepspeed/zero3_bf16.json
  zero3_init_flag: true
distributed_type: DEEPSPEED
downcast_bf16: 'no'
machine_rank: 0
main_training_function: main
num_machines: 1
num_processes: 4
rdzv_backend: static
same_network: true
tpu_env: []
tpu_use_cluster: false
tpu_use_sudo: false
use_cpu: false

And I'm running the following command:
accelerate launch --config_file accelerate_config/multi_gpu_config.yaml -m axolotl.cli.train mistral-7b-instruct-v0.2-mullti-gpu.yaml

### Config yaml

```yaml
base_model: mistralai/Mistral-7B-Instruct-v0.2
model_type: MistralForCausalLM
model_config:
  sliding_window: 4096
tokenizer_type: LlamaTokenizer
is_mistral_derived_model: true

load_in_8bit: false
load_in_4bit: false
strict: false

datasets:
  - path: dataset.parquet
    type: alpaca
dataset_prepared_path:
val_set_size: 0.05
output_dir: out

sequence_len: 1024
sample_packing: false
pad_to_sequence_len: true
eval_sample_packing: false

wandb_project:
wandb_entity:
wandb_watch:
wandb_name:
wandb_log_model:

gradient_accumulation_steps: 4
micro_batch_size: 1
num_epochs: 3
optimizer: adamw_bnb_8bit
lr_scheduler: cosine
learning_rate: 0.000005

train_on_inputs: false
group_by_length: false
bf16: true
fp16: false
tf32: false

gradient_checkpointing: true
early_stopping_patience:
resume_from_checkpoint:
local_rank:
logging_steps: 1
xformers_attention:
flash_attention: true

warmup_steps: 10
evals_per_epoch: 4
eval_table_size:
eval_table_max_new_tokens: 128
saves_per_epoch: 0.5
debug:
deepspeed: deepspeed/zero3_bf16.json
weight_decay: 0.0
fsdp:
fsdp_config:
special_tokens:
  bos_token: "<s>"
  eos_token: "</s>"
  unk_token: "<unk>"

Possible solution
No response
Which Operating Systems are you using?

[X] Linux
[ ] macOS
[ ] Windows

Python Version
3.10
axolotl branch-commit
main/d69ba2b0b76fad112acecd5a1fbb339e6244ff7b
Acknowledgements

[X] My issue title is concise, descriptive, and in title casing.
[X] I have searched the existing issues to make sure this bug has not been reported yet.
[X] I am using the latest version of axolotl.
[X] I have provided enough information for the maintainers to reproduce and diagnose the issue.

Update: Increasing the micro_batch_size to 8 seems to do the trick, however, I'm now wondering if it should be possible to use smaller batch sizes?

I have same issue when i'm using sample_packing: false, micro_batch_size: 1.

This looks like a dupe of https://github.com/OpenAccess-AI-Collective/axolotl/issues/1092

what GPU are you using?

I'm using 4x A100 80GB

Upon testing with current release of axolotl, the error no longer persists. Closing this issue.


Number and Pin Input Fields doesn't Restrict Full-Width Characters in using Japanese Input Method

🐛 Bug report

The Number Input and Pin Input fields are intended to only accept numeric or alphabetic input.
However, when using input methods for languages like Japanese, multi-byte character input is not restricted and is accepted.
💥 Steps to reproduce

Test on the Zag.js Documentation Website:
https://zagjs.com/components/react/pin-input

Switch to "Japanese input mode."
Press the "a" key, which inputs “あ” and moves to the next input field.
Press the "1" key, which inputs “１” (FULLWIDTH DIGIT ONE) and moves to the next input field.
Press the "p" key, which inputs “ｐ” (FULLWIDTH P) and moves to the next input field.

💻 Link to reproduction

Test on the Zag.js Documentation Website:
https://zagjs.com/components/react/pin-input
🧐 Expected behavior

I expect the input fields to reject characters in the same way they do when entering alphabetic characters in a numeric field or numeric characters in an alphabetic field.
🧭 Possible Solution

🌍 System information

Software
Version(s)

Zag Version
0.5.0

Browser
Chrome 124.0.6367.208, Safari 17.4.1 (arm64)

Operating System
macOS Sonoma 14.4.1

📝 Additional information

I am not familiar with Zag.js, so I'm not sure if this information is useful.
Typically, when using Japanese input mode with an Input Method in three steps:

Type in the Latin alphabet to input Hiragana.
Select conversion candidates.
Confirm the conversion.

However, in Zag.js, the character is immediately confirmed upon key press, skipping the conversion step, and the input moves to the next field.
At the same time, pressing an alphabetic key in a numeric field or a numeric key in an alphabetic field results in accepting full-width characters.
It would be preferable to check the input character once the conversion candidates are finalized and then decide whether to accept the input.
You can determine if a conversion is in progress using the KeyboardEvent.isComposing property.
https://developer.mozilla.org/en-US/docs/Web/API/KeyboardEvent/isComposing

I take it back because I was mistaken.


New release please

Hey, I'm the developer of CovenantSQL which imports "xtaci/smux". Users of CovenantSQL need the latest feature of your master. But dep keeps pulling out the latest tag.

the latest release is v1.1.1


Review wireframes WRT UX basics

We talked to Professor Fund about this, Please see diagram and will talk about this tonight.

@ffund , We re designed our buttons as follows, we have a start/end day button. We also have play/ pause  button we discussed for the pomodoro and budget modes, but for the task mode we also need a way to signal task completed and thought we could use this button as well instead of creating another separate button for the task completed. Is this too confusing? Also we moved all of our settings editing buttons away further away from the more used buttons.

Here's the updated wireframe: Flexible Pomodoro Tree Wireframe V2.pdf

Final wireframe: Flexible Pomodoro Tree Wireframe - Final.pdf
We will be using five buttons:

Settings (to select the mode and change mode-specific settings)
Up (to count up / scroll up)
Down (to count down / scroll down)
Play-Pause-Check (to pause or resume and also to mark tasks as done for Task mode)
Start/End of the Day (keeps LED on at End of the Day, press again to reset)


[SPARK-15980] [SQL] Support Stata-like tabulation of values in a single column, optionally with weights

What changes were proposed in this pull request?
See JIRA ticket: https://issues.apache.org/jira/browse/SPARK-15890
How was this patch tested?
Test is included.
I suspect that the changes in the /dev/pr-deps directory should not have been committed, but I would think that the .gitignore file would have prevented this.

Can one of the admins verify this patch?

I think it will be nicer if it follows https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark

Hello, I read the rules at the link before creating the Jira ticket and pull request, and I think I am in compliance. Can you please tell me which point at that link I have not complied with? Thanks.

@shafiquejamal
The PR title should be of the form [SPARK-xxxx] [COMPONENT] Title, where SPARK-xxxx is the relevant JIRA number, COMPONENT is one of the PR categories shown at https://spark-prs.appspot.com/ and Title may be the JIRA's title or a more specific title describing the PR itself.

Ok, I'll close this an open a new PR with the title done correctly. Thanks.

Hello, just wanted to know what else I should do in order for this PR to be accepted. Thanks.

This PR looks like it has some problems. It adds some deps files that are unrelated. Generally you'd want to argue that this functionality is important enough to justify the burden of maintaining it as an API. I'm not (yet) sure it is.


changed type from 'f' to 'float64' fitEDD.py/impport hdf5plugin module in func_....

Good!
We could maybe add it in fitEDD also. I discovered that module 2days ago.


integration JR and CBnet with newest version of whobpyt

Plan is for this to be closed and re-opened as multiple PR's. Should be new branches off of your forked dev for different features. Eg:

JR Performance Updates
New CBNet Implementation
Further split if applicable (Par class updates, Model_Fitting class updates, other simplification updates)

Each of these pull requests should succeed at running all eg00X examples (without deleting any of them). This helps keep the API consistent/working across the package, but does not guarantee it - so should still be checked further if there is a API change in a PR.
Some features seem to be deleted that might make sense to keep as optional, particularly in par class and model fitting class.
Debugging commits can be cleaned up using git rebase.

Some good things with simplifying the code. In particular, relating to #107 and #108.
Is going to be a new PR focused on JR performance. In particular, improving performance with the custom_costs_JR objective function with priors. Using 1/var (or std) for the priors seemed to help.
For now, plan is to keep the options in the Par class to allow for having no priors, priors that are not fit, and priors that are fit. Might be re-discussed in the future, regarding possible alternative like setting priors with a small effect and different learning rate. May want to test various combinations first.
Might be good to discuss in more detail which things are to be simplified / what changes to the API.
May want to have cleaned up the PR into organized commits. Need to get all examples running before accepting the PR. Also, should keep the type check quality control in function arguments.


404 extension store error

The app has probably been removed from the web store.

Yes, we took it down after teacher complaints and attention from tiktok, that's why we removed the links from README. You aren't missing anything though, it doesn't work anymore.


fix : Getting started in Mac to reflect Android version

Updating Setting up the development environment in MacOS documentation to reflect Android version bump.
React Native is increasing the minimum ANDROID_SDK requirement from Android SDK Platform 31 to Android SDK Platform 33 for 0.72 onwards. Updating our MacOS documentation to reflect the same for corresponding Android version.
#3605

Can we backport it to 0.71 docs also?

Wasn't this change only applicable for the 0.72 ?

Can we backport it to 0.71 docs also?

Wasn't this change only applicable for the 0.72 ?

Nope that's applicable for both as we bumped to SDK 33 in .71

https://github.com/facebook/react-native-website/pull/3616 ✅


Determine Number of Unique Combinations

Hi and thanks for this awesome tool.
I just want to know how I can determine how NFTs I can generate that are unique based on the number of accessories I have.

Multiply all the factors.
3 heads3 eyes3 legs Will give you 27 variations.
Sent from Yahoo Mail for iPhone
On Saturday, February 12, 2022, 05:17, Chelsea are Champions @.***> wrote:
Hi and thanks for this awesome tool.
I just want to know how I can determine how NFTs I can generate that are unique based on the number of accessories I have.
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you are subscribed to this thread.Message ID: @.***>

Thanks


Fix pause_mode may not be converted correctly in .tscn files.

Fixes: https://github.com/godotengine/godot/issues/74845
A pause_mode of 2 was not converted correctly.
In Godot 3, the pause_mode of 2 equals the PAUSE_MODE_PROCESS value.
In Godot 4, the pause_mode PAUSE_MODE_PROCESS was renamed to PROCESS_MODE_ALWAYS and equals the number 3.
The fix is therefore to convert the pause_mode = 2 to pause_mode = 3 (PAUSE_MODE_PROCESS -> PROCESS_MODE_ALWAYS) in .tscn files.

Thanks!


tweaks

:arrow_up<EMAIL_ADDRESS>Fix tests

Thanks! Can you take a look at the failing tests?

Yes, looking into them as we speak :).

@arthurvr fixed

Thank you @SamVerschueren :)

No problem :). Thanks for accepting!