Clearing data used for trace when minimizing existing Docker image

When minimizing the existing Docker image using neurodocker/reprounzip, is there a way to clear the input and output data used/created when generating the trace? By default these are part of the minimized image. Or does it require to clean the config.yml from repro-config before runing reprounzip?
Thanks!

hi @NPann - you have a few options here.

modify the config.yml file inside the container and re-pack the traced files into the rpz file. as the neurodocker script works now, all the traced commands are run, and then the traced files are immediately packed into the rpz. you can enter the docker container, edit the config.yml file, and then repack with /tmp/reprozip-miniconda/bin/reprozip pack -d /tmp/neurodocker-reprozip-trace OUTFILE.
the .rpz file is a tar file (not compressed), which contains a compressed tarball of data and some metadata. you can extract the .rpz file and the data tarball, remove the files you don't want, then work backwards to recreate the .rpz file.
you can modify the dockerfile or docker image that is created by reprozunzip docker and then build the image using the --squash option. this will squash every layer into one, so you can't take advantage of docker's caching features.

i realize these options aren't necessarily trivial, so please let me know if you need help. i think option 2 would be best to try first.

Thanks! I will give a shot to option #2 which seems pretty easy to implement.

Finally got a chance to try this and #2 worked like a charm. Thanks!


clarify use of "bomlink" in schema

I am still uncertain which elements allow the use of bomlink.
From use cases it appears to be possible in externalReferences[].url, vulnerabilities[].affects[].ref.
Any where else?
I'd suggest enhancing the schema to make it visible where a bomlink is allowed and where it is not.
This helps tool builders, parsers, and most importantly clarifies this from schema, not only some additional pamphlets/texts.

Related to #179

vulnerabilities[].affects[].ref is just a string, not a URI, but external references are entirely possible (and recommended)

the thing is, we introduced an extra type alias "refType" for strings, to make it clear that some strings are not alike.

refType Identifier-DataType for interlinked elements.

in dependencies these the attribute ref are of "refType", in components the bom-ref is of "refType". the dependencies[].ref there is expected to have a counterpart in components[].bom-ref
no bomlink allowed.
the vulnerabilities[].affects[].ref is of "refType", and - AFAIK - allowed to reference a components[].bom-ref, or be a bomlink - which should have a certain format.
So, vulnerabilities[].affects[].ref value can have a counterpart in the current CDX document, nor in another CDX document if it is in the format of a bomlink. This is not clear from the schema,
i propose to introduce a new type "bomlink", a string -alias with a constraint: it must match the pattern
urn:cdx:[0-9a-f]{8}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{4}-[0-9a-f]{12}/[1-9][0-9*]#.+.

"urn:cdx:" is hard
pattern from serialnumber-uuid-part
"/" is hard
pattern for integer
"#" is hard
any non-empty string

This new type "bomlink" should be added wherever a "bomlink" is allowed/expected, so that digesting software authors are aware from reading the schema, that this special string at certain structures can have more meaning.
Otherwise, we would end up with lots of text describing specialties.
T

@stevespringett wrote here: https://github.com/CycloneDX/specification/issues/229#issuecomment-1562170044

First, thanks for the feedback. Much appreciated. Every URL in CycloneDX can either be a URL or a BOM-Link. So you could have something like

Possibly caused #136


[Feature][frame] transformationRules has set default value.

Search before asking

[X] I had searched in the issues and found no similar feature requirement.

Description
Should the backend remove these default handling？

Use case
No response
Related issues
No response
Are you willing to submit a PR?

[ ] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

No, I think backend should keep them as most of them are common case

However, it is quite confusing for users, they would get an unexpected result when they set the options to empty.

I added this to v0.15 and we should discuss this matter.
@Startrekzky @yumengwang03

@warren830 I'm not against providing reasonable default values to users. But I think the key issue here is that the current frontend presentation would lead users to believe those values are just placeholders, instead of default values, thus resulting in the mismatch of the frontend and backend behavior.
If we keep the frontend unchanged, I will vote for removing those default values in the backend as well.


Add more italian data

Hi,
I submit my changes concerning the support for the Italian language of some modules.
Regards.
Stefano

Sorry I fix this.

But why you closed it?

Hi re-submit a new pull-request after fix the file gender_pl.rb
Il giorno sab 7 ago 2021 alle ore 14:47 Vsevolod Voloshyn <
@.***> ha scritto:

But why you closed it?
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/ffaker/ffaker/pull/499#issuecomment-894650559, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAEMYT4YT4SNZNEZWXKRD43T3UTORANCNFSM5BVUPHWQ
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&utm_campaign=notification-email
.

I also added tests of: address_it, gender_it, identification_it,
job_it, lorem_it
and fix test_units.rb
Il giorno sab 7 ago 2021 alle ore 14:47 Vsevolod Voloshyn
@.***> ha scritto:

But why you closed it?
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub, or unsubscribe.
Triage notifications on the go with GitHub Mobile for iOS or Android.

New PR: #501


findByPrefix needs to sort results then limit

The findByPrefix call[1] does not return the concept kidney when using:
http://matrix.neuinfo.org:9000/scigraph/vocabulary/autocomplete/kidney?limit=20&searchSynonyms=true
Based on discussion at the architecture meeting it seemed that the issue was that the results needed to be sorted first and then limited since when the limit is set to 100 the concept is returned.
[1] http://matrix.neuinfo.org:9000/scigraph/docs/#!/vocabulary/findByPrefix

How do you want these to be sorted - just alphabetically?

Sorting alphabetically seems fine. Is that how the autocomplete service currently works from Ontoquest?


Fix 4:2:0 assumption in IEF block context selection

Fixes #2299.
Also added doc comments for the block context accessors.

Coverage decreased (-0.02%) to 82.338% when pulling df992bf1967dada1e0fbc57ad2e7c289945055f3 on rzumer:fix-ief-422-444 into 3686d408f6c1a05bdb4c2e0dbfbeeccf3cae345b on xiph:master.


Bug 1101778 - Change footer link hover to a lighter color

Hey @Gioyik! It looks like travis-ci failure was a false alarm. I manually triggered the test and build passed.

This looks good. Thanks @Gioyik. If tests complete, @johngian can you merge?

Coverage increased (+0.1%) to 92.88% when pulling f9bd818d2509cc795b8d46a797a414c1978f59c0 on Gioyik:patch-1 into 3b834fb9c38fd86dded1b87950815c271bde4adf on mozilla:master.

I suggest instead of changing sandstone less, to override the functionality in ``main.less`.

Coverage increased (+0.21%) to 92.99% when pulling 602767a26f920345d3e537ed8233e09da0031419 on Gioyik:patch-1 into 3b834fb9c38fd86dded1b87950815c271bde4adf on mozilla:master.

Coverage remained the same at 92.99% when pulling defbe975bd6a2a17470bb2ac3f4fa795cf7e5811 on Gioyik:patch-1 into 53ed6a341196e09468b9aaf59504f2e12461167b on mozilla:master.

Coverage remained the same at 92.99% when pulling defbe975bd6a2a17470bb2ac3f4fa795cf7e5811 on Gioyik:patch-1 into 53ed6a341196e09468b9aaf59504f2e12461167b on mozilla:master.

I made the changes, could you review it? I squashed some commits :)

Coverage remained the same at 92.99% when pulling defbe975bd6a2a17470bb2ac3f4fa795cf7e5811 on Gioyik:patch-1 into 53ed6a341196e09468b9aaf59504f2e12461167b on mozilla:master.

I see 2 commits. Can you squash them to one?

Done!

Coverage remained the same at 92.99% when pulling 202ad678dabad83fc55af978ea2cc4356090571b on Gioyik:patch-1 into 53ed6a341196e09468b9aaf59504f2e12461167b on mozilla:master.

Hey @Gioyik!
Thank you for the contribution, I am merging this PR here #1158 after a minor change in the commit message.
:rocket:


add notebook

A simple notebook showing how to use the package dynamic_characterization:

as standalone (e.g. imported from other software)
using brightway biosphere flows

@muelleram looks good, I just changed the way you get the bio flows to use bd.get_node - so if you think this is alright we can merge this

Perfect!


feat: add the missing important "infrastructure contracts" on Kakarot

Feature Request
Describe the Feature Request
There is a new RIP for rollups which is to simplify adding a list of important contracts that are factories, e.g. arachnid and createX.

There are 4 contracts in the RIP, so I think we could add the missing two: https://github.com/ethereum/RIPs/pull/30/files#diff-8fb76c4cfd3e4dc31a49e0ecb56ea00561f0f2af4b4d4353c52b62e95fc6a8bbR39
Describe Preferred Solution

whitelist the pre eip-155 txs that deployed the contracts
add all these contracts in our deployments scripts

Note cc @greged93 is arachnid and createX part of the deploy kakarot scripts?

@Eikix yes arachnid and createX are part of the deploy scripts

Closing this issue in favor of https://github.com/kkrt-labs/kakarot/issues/1457


fix: continue on error on unit test on python 3.9 job

@mbruzda-splunk would appreciate a test run to see how it works.

@artemrys https://github.com/splunk/splunk-add-on-for-microsoft-office-365/actions/runs/6260573009/job/16998888425?pr=638
Here is the same change but for python 3.11

@mkolasinski-splunk can you please take a look?


Add PS2 compiler ee-gcc29-991111b/r4

This is the compiler for Sly Cooper on PS2.

Might need to rerun the checks since my PR on the compilers repo was merged.

@TheOnlyZac this failed https://github.com/decompme/decomp.me/actions/runs/9727725876/job/27109038662?pr=1289
Are you sure you named the output file correctly? I saw in the PR, the archive name doesn't match the compiler ID. it doesn't include the b4 part.. https://github.com/decompme/compilers/pull/15/files#diff-8377b3e3740a3fcd9f682e5fb55425f2fdbece1791854b9e5013e7f1a5e60e7eR224 not sure if that's the issue, but just saw it

Haven't had a chance to look at this but I will soon.

Gonna close this PR as it's gone stale. Feel free to re-open once you have the compiler working.


au Hikarie fiber 10G with Edgerouter Infinity

Hello!
I'm aware that this utility isn't made for the situation that I am in, but perhaps it can help me get close to working.
I have 10G KDDI Fiber in Japan, which comes with an "aterm-bl1000hw" router. I have replaced it with an Edgerouter Infinity (usg-xg-8).

Clone MAC from "aterm" to "eth1" (WAN)
When I plug in "eth1" (WAN) to the ONU I get DHCP address
Everything works...

... for about 24 hours. Then it drops, I have to plug in their router for a few seconds, repeat.
I have been told it uses EAPOL, which led me here.
I now have their aterm plugged into "eth0".
It refuses to DHCP; in that I'm probably supposed have some magic key in there;

 dhcp tcpdump

06:54:05.349948 IP (tos 0x10, ttl 128, id 0, offset 0, flags [none], proto UDP (17), length 328)
    <IP_ADDRESS>.67 > <IP_ADDRESS>.68: BOOTP/DHCP, Reply, length 300, xid 0x8bd070a6, Flags [none]
	  Your-IP <IP_ADDRESS>
	  Client-Ethernet-Address ma:ca:dd:re:ss:ss
	  Vendor-rfc1048 Extensions
	    Magic Cookie 0x63825363
	    DHCP-Message Option 53, length 1: Offer
	    Server-ID Option 54, length 4: <IP_ADDRESS>
	    Lease-Time Option 51, length 4: 3600
	    Subnet-Mask Option 1, length 4: <IP_ADDRESS>
	    Default-Gateway Option 3, length 4: <IP_ADDRESS>
	    Domain-Name-Server Option 6, length 4: <IP_ADDRESS>
06:54:05.350351 IP (tos 0xa0, ttl 32, id 39920, offset 0, flags [DF], proto UDP (17), length 576)
    <IP_ADDRESS>.68 > <IP_ADDRESS>.67: BOOTP/DHCP, Request from 6c:e4:da:43:48:31, length 548, xid 0x4ad070a6, Flags [none]
	  Client-IP <IP_ADDRESS>
	  Client-Ethernet-Address ma:ca:dd:re:ss:ss
	  Vendor-rfc1048 Extensions
	    Magic Cookie 0x63825363
	    DHCP-Message Option 53, length 1: Release
	    Client-ID Option 61, length 7: ether 6c:e4:da:43:48:31
	    Server-ID Option 54, length 4: <IP_ADDRESS>
	    MSG Option 56, length 48: "I'm no longer need the IP address (<IP_ADDRESS>)"

Inside the DHCP packet it has the string: `kddi-hgw1.13` which perhaps has a respond phrase?

But I left eap_proxy.py running while desperate googling was going on, and suddenly this showed up:
ubnt@ubnt:~$ sudo ./eap_proxy.py eth1 eth0 --ping-gateway
[2020-06-30 06:34:12,322]: starting proxy_loop
[2020-06-30 07:03:50,860]: eth0: ma:ca:dd:re:ss:ss > 01:80:c2:00:00:03, EAPOL start (1) v1, len 0 > eth1
[2020-06-30 07:03:50,889]: eth1: 74:3a:65:2a:63:75 > ma:ca:dd:re:ss:ss, EAP packet (0) v1, len 5, Request (1) id 89, len 5 [1] > eth0
[2020-06-30 07:03:50,890]: eth0: ma:ca:dd:re:ss:ss > 01:80:c2:00:00:03, EAP packet (0) v1, len 17, Response (2) id 89, len 17 [13] > eth1
[2020-06-30 07:03:50,915]: eth1: 74:3a:65:2a:63:75 > ma:ca:dd:re:ss:ss, EAP packet (0) v1, len 28, Request (1) id 90, len 28 [24] > eth0
[2020-06-30 07:03:50,915]: eth0: ma:ca:dd:re:ss:ss > 01:80:c2:00:00:03, EAP packet (0) v1, len 22, Response (2) id 90, len 22 [18] > eth1
[2020-06-30 07:03:50,984]: eth1: 74:3a:65:2a:63:75 > ma:ca:dd:re:ss:ss, EAP packet (0) v1, len 4, Success (3) id 91, len 4 [0] > eth0

Which fills me with some hope, especially since it is communicating to/fro a few times, ending with "success". Does
their "aterm" router perhaps not need to DHCP for the EAP proxy to do it's work?
I will have to wait 22 hours to find out...

Looks like it's working, I would check your IP6 settings and/or jumbo frames. It may just be bottleneck causing crash.

it's stopped twice, and both times no matter what troubleshooting I did, only started working once I pugged in their router for a bit. But I'm hoping it will not stop tomorrow as eap_proxy is running.

I have passed the daily hangup without issues, and I believe that was the last piece of the puzzle.
Thanks for much for your excellent utility.

I am also using the same au Hikari ISP as lundman and have the same problem.
I installed eap_proxy on ER-X but it doesn't work.
The FW of ER-X is 1.10.11.
I now have their HGW(Equivalent of RG) connected to 'eth1' and their ONU (Equivalent of AT&T ONT) to 'eth0'.
Clone MAC from 'HGW' to "eth0" (ONU)
au Hikari, slightly different from AT&T, does not use VLAN tags.
Therefore, I don't think it is necessary to create a VLAN.
Bypassing HGW only requires a MAC address and 802.1X authentication.
Add DUID-LL if IPv6 is also needed.
Also, the HGW rejects DHCP, but since EAPOL is Layer 2 and does not require an IP address, there should be no problem.
Are there any other settings other than what is written here?
Please tell me the solution.

show config interfaces
interfaces {
    ethernet eth0 {
        address dhcp
        description ONU
        duplex auto
        firewall {
            in {
                ipv6-name WANv6_IN
                name WAN_IN
            }
            local {
                ipv6-name WANv6_LOCAL
                name WAN_LOCAL
            }
        }
        mac a4:12:42:00:00:00
        speed auto
    }
    ethernet eth1 {
        description HGW
        duplex auto
        speed auto
    }
    ethernet eth2 {
        description VoIP
        duplex auto
        speed auto
    }
    ethernet eth3 {
        description LAN
        duplex auto
        speed auto
    }
    ethernet eth4 {
        description Local
        duplex auto
        poe {
            output off
        }
        speed auto
    }
    loopback lo {
    }
    switch switch0 {
        address <IP_ADDRESS>/24
        description Local
        mtu 1500
        switch-port {
            interface eth1 {
            }
            interface eth2 {
            }
            interface eth3 {
            }
            interface eth4 {
            }
            vlan-aware disable
        }
    }
}
service {
    dhcp-server {
        disabled false
        hostfile-update disable
        shared-network-name LAN {
            authoritative enable
            subnet <IP_ADDRESS>/24 {
                default-router <IP_ADDRESS>
                dns-server <IP_ADDRESS>
                dns-server <IP_ADDRESS>
                lease 86400
                start <IP_ADDRESS> {
                    stop <IP_ADDRESS>
                }
            }
        }
        static-arp disable
        use-dnsmasq disable
    }
    dns {
        forwarding {
            cache-size 150
            listen-on switch0
        }
    }
    gui {
        http-port 80
        https-port 443
        older-ciphers enable
    }
    nat {
        rule 5010 {
            description "masquerade for WAN"
            outbound-interface eth0
            type masquerade
        }
    }
}

This is the execution log of eap_proxy.py.
No response from HGW.
admin@EdgeRouter-X-5-Port:~$ sudo ./config/screpts/eap_proxy.py eth0 eth1 --ping-gateway
[2023-07-11 21:38:54,012]: starting proxy_loop
[2023-07-12 17:17:50,937]: eth0: 08:00:70:00:00:00 > a4:12:42:00:00:00, EAP packet (0) v1, len 5, Request (1) id 81, len 5 [1] > eth1
[2023-07-12 17:18:21,709]: eth0: 08:00:70:00:00:00 > a4:12:42:00:00:00, EAP packet (0) v1, len 5, Request (1) id 81, len 5 [1] > eth1
[2023-07-12 17:18:51,789]: eth0: 08:00:70:00:00:00 > a4:12:42:00:00:00, EAP packet (0) v1, len 5, Request (1) id 81, len 5 [1] > eth1
[2023-07-12 17:19:21,878]: eth0: 08:00:70:00:00:00 > a4:12:42:00:00:00, EAP packet (0) v1, len 4, Failure (4) id 82, len 4 [0] > eth1
[2023-07-12 17:20:21,988]: eth0: 08:00:70:00:00:00 > a4:12:42:00:00:00, EAP packet (0) v1, len 5, Request (1) id 83, len 5 [1] > eth1
[2023-07-12 17:20:53,708]: eth0: 08:00:70:00:00:00 > a4:12:42:00:00:00, EAP packet (0) v1, len 5, Request (1) id 83, len 5 [1] > eth1
[2023-07-12 17:21:23,778]: eth0: 08:00:70:00:00:00 > a4:12:42:00:00:00, EAP packet (0) v1, len 5, Request (1) id 83, len 5 [1] > eth1
[2023-07-12 17:21:54,713]: eth0: 08:00:70:00:00:00 > a4:12:42:00:00:00, EAP packet (0) v1, len 4, Failure (4) id 84, len 4 [0] > eth1
[2023-07-12 17:22:54,782]: eth0: 08:00:70:00:00:00 > a4:12:42:00:00:00, EAP packet (0) v1, len 5, Request (1) id 85, len 5 [1] > eth1
[2023-07-12 17:23:24,843]: eth0: 08:00:70:00:00:00 > a4:12:42:00:00:00, EAP packet (0) v1, len 5, Request (1) id 85, len 5 [1] > eth1
[2023-07-12 17:23:54,952]: eth0: 08:00:70:00:00:00 > a4:12:42:00:00:00, EAP packet (0) v1, len 5, Request (1) id 85, len 5 [1] > eth1
[2023-07-12 17:24:25,795]: eth0: 08:00:70:00:00:00 > a4:12:42:00:00:00, EAP packet (0) v1, len 4, Failure (4) id 86, len 4 [0] > eth1

However, when I check the packet capture, it seems that EAPOL is being sent from HGW.
Ethernet II, Src: NECPlatf_ab:cd:ef (a4:12:42:00:00:00), Dst: Nearest-non-TPMR-bridge (01:80:c2:00:00:03)
    Destination: Nearest-non-TPMR-bridge (01:80:c2:00:00:03)
    Source: NECPlatf_ab:cd:ef (a4:12:42:00:00:00)
    Type: 802.1X Authentication (0x888e)
    Padding:<PHONE_NUMBER>00000000000000000000000000000000000000000000000000000000000000…
802.1X Authentication
    Version: 802.1X-2001 (1)
    Type: Start (1)
    Length: 0

It was caused by my switch port including eth1.
switch switch0 {
        address <IP_ADDRESS>/24
        description Local
        mtu 1500
        switch-port {
            interface eth1 {
            }
            interface eth2 {
            }
            interface eth3 {
            }
            interface eth4 {
            }
            vlan-aware disable
        }
    }

Removing eth1 from the switch port worked fine.
[2023-07-12 22:30:51,891]: eth0: 08:00:70:00:00:00 > a4:12:42:00:00:00, EAP packet (0) v1, len 5, Request (1) id 93, len 5 [1] > eth1
[2023-07-12 22:30:51,894]: eth1: a4:12:42:00:00:00 > 01:80:c2:00:00:03, EAP packet (0) v1, len 17, Response (2) id 93, len 17 [13] > eth0
[2023-07-12 22:30:51,915]: eth0: 08:00:70:00:00:00 > a4:12:42:00:00:00, EAP packet (0) v1, len 22, Request (1) id 94, len 22 [18] > eth1
[2023-07-12 22:30:51,918]: eth1: a4:12:42:00:00:00 > 01:80:c2:00:00:03, EAP packet (0) v1, len 34, Response (2) id 94, len 34 [30] > eth0
[2023-07-12 22:30:51,955]: eth0: 08:00:70:00:00:00 > a4:12:42:00:00:00, EAP packet (0) v1, len 4, Success (3) id 94, len 4 [0] > eth1


 All CLA requirements met.

 All CLA requirements met.
Originally posted by @microsoft-cla[bot] in https://github.com/microsoft/vscode/issues/149021#issuecomment-1120394059

#13061

[ ] ****
[ ] Pull request


add option to skip image create if the image already exists

this adds a switch param to New-BcImage which allows to suppress image creation if the image already exists. The use case is that I am managing container hosts and just want to send them the command "New-BcImage ...". If the image doesn't exist, it is created. If it already exists, it returns.
I don't know why but GitHub identifies a ton of changes in the New-NavImage.ps1 file. I even tried editing in the browser to avoid any automatic format or change, but it still has way more than I actually changed. I'll mark the actual changes with comments

Not sure why, but there are a ton of changes when reviewing this - it is hard to see what actually changed and what not???

yes, as I wrote I ended up changing it directly in the browser as I thought that maybe VS Code was doing some formatting even if I used "save without formatting", but Github still shows lots of changes. Maybe it's because of this?

Oh yes, this seems to be the case. If you go to the "changed files" view, select the gear icon and enable "hide whitespace changes", then you see only the actual changes

Will have a look.
New-BcContainer already does this in a slightly different way. Maybe I should move that to New-BcImage and let New-BcContainer call over with the parameter.

I have just checked in a new New-BcContainer and a new New-BcImage which introduces this parameter.
It will force the rebuild if the image doesn't exist or if it was build on an old generic version or for a different OS version.
All checks from New-BcContainer has moved to New-BcImage.

Thanks a lot, that is even better! Do you already have an idea when you plan to release the next bccontainerhelper version?

If all tests passes it will auto-release as a preview version in ~2 hours.


Support v2 of Pager Duty REST API

This commit updates the Connection class to support only v2+ of
the Pager Duty REST API. Updates have been made following the migration
document https://v2.developer.pagerduty.com/docs/migrating-to-api-v2.
Notable v2 updates include:

Required 'Accept' request header which includes version number
Base URL has changed, so account_domain is no longer needed
Rate limiting error handling
requester_id (user id) is no longer sent as a query parameter to
identify the requesting user. Instead, set the From header to the
request user's email address in the headers hash as needed.

In addition to these v2 updates, method signatures have been changed, which
was the main motivation for no longer supporting v1. Prior to
this update, the query parameters were sent through the request body,
which worked for v1 but not for v2.
One of the changes made to v2 was to
restructure the way lists are sent as query parameters. Instead of
having test.com/some_uri?status=status1,status2,status3, we now need to
support
test.com/some_url?statuses[]=status1&statuses[]=status2&statuses[]=status3. Faraday supports encoding query parameters this way, but when sent through the body, arrays are encoded as JSON and so they do not align with what the API requires. Additionally, now that requester_id is added as a header value, it makes sense to separate the request body, headers, and query parameters.
Additionally, we no longer default to any version of the API. The API
version should be sent when initializing PagerDuty::Connection.

Looks good, I'd merge it but I don't have write access to this repository.


Bug: Create Community

Description
Creating community doesn't clearly show what is necessary or pull relevant information
Steps to Reproduce
Steps to reproduce the behavior:

Go to 'Subreddits'
Click on 'Create New Community'
Populate fields
Click on 'Create Subreddit'

Expected behavior
User ID should populate from logged in user, or prompt user to log in if not logged in.
Name should error out if community already exists.
Snackbar notifications to inform the user of actions. (Failed, Sucess, etc)

fixed: Snackbar notifications to inform the user of actions. (Failed, Sucess, etc)


New merge back request to update to the newest version of the SDK

We should resolve this to make all of the things that have been updated on the SDK

This should be everything, it is working


For primary config, just use stack_name/service_name

@alena1108 @ibuildthecloud Can you take a quick look.  This removes that nasty "io.rancher.service.primary.launch.config" part from the ${service_name} macro for the primary config.  secondary config will still have it.  This also allows for backwards compatibility prior to adding the launchConfig name to the service name (for the anti-affinity blocker bug).

LGTM

Regarding the TF, I'm still looking at it but wasn't able to replicate it locally.  Plus, it doesn't look related to my changes.

I don't get warm fuzzies about that TF, but I'll merge


Minor syntax highlighting fix in README.md

Add missing js to code-block for syntax highlighting.

Thanks!


Setting bounds to selector is not restricting movement to the selector.

Here I have:
`<ReactDraggable
bounds='.notesCanvas'
nodeRef={nodeRef}

`

but I am able to drag notes completely around the viewport with it being restricted to the viewport's edges.  This is not what I want, I am trying to restrict it to inside the selector as above.

is this .noteCanvas element a parent element of your ReactDraggable?


Allow numbers in storage prefix on ONTAP

Volumes created with a prefix starting with a number created before
commit c262e4ca7966700dfc48276c86a26ee7c82c71c9 no longer work on newer
versions of trident, as the prefix matcher doesn't accept them.
Accepting prefixes starting with a number is OK as the prefix is not
actually the first part of the volume name.

This is most likely only true for the ontap-nas-economy or ontap-san-economy driver. Can you confirm that you are using one of these drivers?

This is most likely only true for the ontap-nas-economy or ontap-san-economy driver. Can you confirm that you are using one of these drivers?

We're using the ontap-nas-economy driver. Would it be acceptable to have a separate check or a parameter allowing numbers for those? I see the required info is available in both ValidateNASDriver and ValidateSANDriver.

We're using the ontap-nas-economy driver. Would it be acceptable to have a separate check or a parameter allowing numbers for those? I see the required info is available in both ValidateNASDriver and ValidateSANDriver.

@sorcix,
We're going to see if we can restrict allowing numbers in the prefix to the ontap-*-economy drivers to fix this issue for you.

@sorcix,
We're going to see if we can restrict allowing numbers in the prefix to the ontap-*-economy drivers to fix this issue for you.

Hi @sorcix,
Thanks for the submission but a new function was needed to address this issue for the ontap-*-economy drivers. We were unable to use your PR this time.

Hi @sorcix,
Thanks for the submission but a new function was needed to address this issue for the ontap-*-economy drivers. We were unable to use your PR this time.


Change profile by left/right clicking status bar sftp text

Is this a similar or duplicate feature request?

[x] No.

Is your feature request related to a problem? Please describe.
I am using multiple profiles for various sftp sites. To change them we have to use the command palette.
Describe the solution you'd like
It would be helpful (and intuitive) to change the profile by left/right clicking the sftp text in the status bar.

Describe alternatives you've considered
The command palette can be used but it is not nearly as quick as using an status bar menu option.
Does this project help you?

[x] Yes. SFTP IS AWESOME!

You can set a keybinding for Change Profile command.


docs: correct calling setuptools commands

Summary of changes

Closes
Pull Request Checklist

[ ] Changes have tests
[ ] News fragment added in changelog.d/.
(See documentation for details)

Thank you very much @jnoortheen


[JS] DotPrompt.generate does not maintain input string encoding

Describe the bug
formatPrompt.generate({
            input : {
                data: "Some \"string\" with special characters"
            },
            output : {schema: outputSchema}
        })

Replaces inner quotes with ascii encoding - instead of maintaining the correct encoding.
Some \"string\" with special characters
is converted into:
Some "string" with special characters
To Reproduce

Use a simple prompt that has one input param as string
Provide a string that contains special characters ( like ", or ` )
Run the prompt
See that the input is send with ascii encoding to the AI - Model

Expected behavior
The expected behaviour is that .generate would maintain the original encoding
Runtime (please complete the following information):

OS: MacOS
Version [14.2.1]

Node version
v22.1.0
Additional context
Example Prompt
---
model: openai/gpt-4o
config:
  temperature: 0.1
input:
  schema:
    story: string
---
Summarize the following story:

{{story}}

Example Input :
{
    "story": "This is my \"Story\" about some stuff from other`s!"
}

Actual output send to the AI:
This is my "Story" about some stuff from other`s!
Expected:
This is my "Story" about some stuff from others!`

Dotprompt uses Handlebars which HTML escapes variables by default. You should be able to send unescaped values using triple stache syntax:
{{{story}}}

See: https://handlebarsjs.com/guide/expressions.html#html-escaping
We should probably add this to the docs.


Added SpaceDuck theme 🚀🦆

Hi, I've been using your status bar for a while now and also made a custom theme based on SpaceDuck. I thought of adding it to the main repo (if I can), otherwise I would keep getting merge conflicts when updating simple-bar. 😛
This is how it looks normally with some widgets:

I personally use it like this though:

And this is how the settings menu looks (green border is for mouse hover):

Anyway, thanks for making this widget 👍

Hi! I always merge themes on demand, I'm glad people want to contribute by adding more colors to simple-bar. Thank you for your work! :)


Embassy support

This PR contains a WIP support for embassy.
Currently, the implementation is working and I can run CoAP server on nRF52840 target, but it breaks tokio. Changes done:

where possible replaced std imports with core/alloc imports
added tokio and embassy features
made observable resource support an optional feature - currently, observable resources are not supported on embassy and must be disabled
RNG is passed as argument instead of rand::thread_rng()
removal of future spawning - embassy requires that all spawned futures must be 'static which caused major problems
EDIT: TaskPool used for spawning futures requires self: &'static Self, futures must be 'static, not &'static. So taskpool would have to be declared as static and passed to CoAP server, to declare static variable we must known concrete type of the future to be spawned with TaskPool, static POOL: TaskPool<impl Future> won't work. AFAIK it's not possible to use async move {} - futures need to be created by implementing Future trait.

Thanks so much for doing this work, it's a lot for me to unpack as I've not done much embedded rust before but getting into it now.  Would you prefer to wait until after Tokio is repaired?  If not, I can try to figure out what it would take to fix when I get some free time soon

Thanks for interest. This work as done as part of CoAP server implementation for the Fobnail project and currently I am focusing on other stuff but I plan to resume work on this PR soon.

Ack'd, I may take a look shortly for my own goals and see if I can generalize it to still work with Tokio.  There are some good insights into https://github.com/ryankurte/rust-coap-client for how this kind of generalization can work.

I'm adding this support myself now as well as supporting no_std in order to use this code on my esp32.  See: https://github.com/jasta/coap-server-rs/tree/main/coap-server-embassy


Create LICENSE.txt

This needs Ian's approval

Thanks @jasonblais, discussed with @coreyhulen and our thinking now is Apache v2: https://github.com/mattermost/mattermost-webapp/pull/6
This is a pretty important decision and I'll queue an item for Platform to discuss

Thanks, replaced by #6


The Perth point on the map now links to the Perth hub page

The page looks great.
The signup link doesn't work.
There's a MailChimp mailing list for the conference in general, but not for each hub. I think<EMAIL_ADDRESS>is being provisioned.
There is an email announcement going out this week announcing the hubs, how do you feel about the announcement highlighting this site as an example of the grass-roots nature of the conference hubs?

Re the sign up link - We're working on a Google Form for a 'Hold the date' campaign that this'll link to.
We've got<EMAIL_ADDRESS>up and running now and are pushing folks there for now.
I'm happy for our page to get highlighted. Ping @johnwbryant. In that case, I'll just push a PR to make that 'Sign up' button point at our email address until the form is ready.

That's great!
Good going. I'll put a link into the email blast.

Sounds great! I will have to get in there and take my name off the
conference content section :P
We should be able to get a first pass of the sign up form done in the next
couple of days too. Will update the page when that's good to go.
On Sun, 13 Sep 2020 at 15:33, Keith Moss<EMAIL_ADDRESS>wrote:

Re the sign up link - We're working on a Google Form for a 'Hold the date'
campaign that this'll link to.
We've got<EMAIL_ADDRESS>up and running now and are pushing
folks there for now.
I'm happy for our page to get highlighted. Ping @johnwbryant
https://github.com/johnwbryant. In that case, I'll just push a PR to
make that 'Sign up' button point at our email address until the form is
ready.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/foss4g-oceania/foss4g-sotm-oceania-2020/pull/25#issuecomment-691627454,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAIMWOCAY6JBN3FHWY5NTPLSFRYUFANCNFSM4RKOOMJQ
.

Looking great team...cheers!
On Sun, 13 Sep 2020 at 17:38, John Bryant<EMAIL_ADDRESS>wrote:

Sounds great! I will have to get in there and take my name off the
conference content section :P
We should be able to get a first pass of the sign up form done in the next
couple of days too. Will update the page when that's good to go.
On Sun, 13 Sep 2020 at 15:33, Keith Moss<EMAIL_ADDRESS>wrote:

Re the sign up link - We're working on a Google Form for a 'Hold the
date'
campaign that this'll link to.
We've got<EMAIL_ADDRESS>up and running now and are
pushing
folks there for now.
I'm happy for our page to get highlighted. Ping @johnwbryant
https://github.com/johnwbryant. In that case, I'll just push a PR to
make that 'Sign up' button point at our email address until the form is
ready.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<
https://github.com/foss4g-oceania/foss4g-sotm-oceania-2020/pull/25#issuecomment-691627454
,
or unsubscribe
<
https://github.com/notifications/unsubscribe-auth/AAIMWOCAY6JBN3FHWY5NTPLSFRYUFANCNFSM4RKOOMJQ
.

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/foss4g-oceania/foss4g-sotm-oceania-2020/pull/25#issuecomment-691628216,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AANMZ4SX2FFLCCTJE23ICHDSFRZI3ANCNFSM4RKOOMJQ
.


Could not resolve com.facebook.android:facebook-android-sdk:16.+

🐛 Bug Report

What went wrong:
Could not determine the dependencies of task ':app:lintVitalReportRelease'.

Could not resolve all task dependencies for configuration ':app:releaseRuntimeClasspath'.
Could not resolve com.facebook.android:facebook-android-sdk:16.+.
Required by:
project :app > project :react-native-fbsdk-next
Failed to list versions for com.facebook.android:facebook-android-sdk.
Unable to load Maven meta-data from https://jcenter.bintray.com/com/facebook/android/facebook-android-sdk/maven-metadata.xml.
Could not HEAD 'https://jcenter.bintray.com/com/facebook/android/facebook-android-sdk/maven-metadata.xml'.
Read timed out

PRs happily accepted


Typo "patch*****"→"patch*"

https://docs.microsoft.com/en-us/sql/sql-server/sql-server-2012-release-notes?view=sql-server-2016
https://github.com/MicrosoftDocs/sql-docs/blob/live/docs/sql-server/sql-server-2012-release-notes.md
#PingMSFTDocs

@hyoshioka0128 : Thanks for your contribution! The author(s) have been notified to review your proposed change.

Docs Build status updates of commit cad69c3:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/sql-server/sql-server-2012-release-notes.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

@MikeRayMSFT
Can you review this PR?
IMPORTANT: When this content is ready to merge, you must add #sign-off in a comment or the approval may get overlooked.
#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

Invalid command: '#label'. Only Microsoft employees can use this command.

@hyoshioka0128 Thank you for your contribution. If you accept the suggested edits, we'll get this merged in the next few days.

@hyoshioka0128 : Thanks for your contribution! The author(s) have been notified to review your proposed change.

@rwestMSFT - Thanks!

Docs Build status updates of commit 4c4fcb3:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/sql-server/sql-server-2012-release-notes.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel

We found inconsistencies elsewhere in the article, so I created an internal PR that corrected those. Thank you for your feedback and for helping improve content, even if it is ten years old.

Docs Build status updates of commit 4c4fcb3:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/sql-server/sql-server-2012-release-notes.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel


Handle Java SE 11 requirements in Jakarta API

The Jakarta EE 10 Specification changes the required minimum Java Version from 8 to 11.
2.4.1. Container Requirements

This specification requires that containers support execution in a Java™ runtime environment,
as defined by the Java Platform, Standard Edition specification, v11 or later (Java SE 11 or later)

The PR #611 Upgrade of org.osgi.service.servlet to support Jakarta Servlet API 6.x is first PR with this issue.
We should discuss the implications of this like, how to do a CI build with different base Versions per Chapter.

Issues:
Doclets might not run untder java 8
https://github.com/osgi/osgi/tree/main/osgi.specs/src/org/osgi/tools/xmldoclet


Add show 'Download CSV' button condiction

General
Show "Download CSV" button only when data fetch from server
Type

ℹ  What types of changes does your code introduce?

👉 Put an x in the boxes that apply

[x] Fix #16
[ ] Feature

Describe the changes here (summarized)

Done .  @itsalb3rt


🐛 BUG: Moving global style tag into different tags automatically

Describe the Bug
When I have a style tag in my code, the auto-formatter decides to move it to a completely different place in the code, inside other tags. It only happens when using the <ViewTransitions /> I have in the head
https://github.com/withastro/language-tools/assets/84212701/e8758099-7ae7-4ce3-b912-78e41a3484c2
Steps to Reproduce

npm init astro using standard layout, strictest TS
Go into Layout.astro
Add <ViewTransitions /> in head
Try saving

Duplicate of https://github.com/withastro/prettier-plugin-astro/issues/316


BC16 - Compile App failed: Cannot bind argument to parameter 'AlcOutput' because it is null.

Our pipelines failes during the compilation with the following error:
Compiling...
alc.exe /project:C:\agent-W1\_work\2\s\<Repo>\app /packagecachepath:C:\agent-W1\_work\2\s\<Repo>\.alPackages /out:C:\agent-W1\_work\2\a\app\<AppFile> /assemblyprobingpaths:"C:\Program Files (x86)\Microsoft Dynamics NAV\160\RoleTailored Client","C:\Program Files\Microsoft Dynamics NAV\160\Service","C:\Program Files (x86)\Open XML SDK\V2.5\lib","c:\windows\assembly","C:\Test Assemblies\Mock Assemblies"
##[error]Compile-AppInBCContainer : Cannot bind argument to parameter 'AlcOutput' because it is null.
At C:\agent-W1\_work\2\s\Pipeline\Build-App\Compile-App.ps1:42 char:5
+     Compile-AppInBCContainer -containerName $containerName -credentia ...

+     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

    + CategoryInfo          : InvalidData: (:) [Compile-AppInNavContainer], ParameterBindingValidationException

    + FullyQualifiedErrorId : ParameterArgumentValidationErrorNullNotAllowed,Compile-AppInNavContainer
##[error]PowerShell exited with code '1'.

Compile command:
Compile-AppInBCContainer -containerName $containerName -credential $adminCredentials -appProjectFolder $appProjectFolder -appSymbolsFolder $buildSymbolsFolder -appOutputFolder (Join-Path $buildArtifactFolder $_) -UpdateSymbols:$updateSymbols -AzureDevOps:$true -CopyAppToSymbolsFolder
The version is version: 16.0.11240.11946-de (pulled by "mcr.microsoft.com/businesscentral/sandbox:de").
Next insider minor ("bcinsider.azurecr.io/bcsandbox:de" - v15.5.41963.0-de) works.
Next insider major ("bcinsider.azurecr.io/bcsandbox-master:de" - v16.0.11240.12052-de) does not work.
The way we create our container:
$additionalParameters = @("--volume ""$($sharedFolder):$($sharedFolder)""")
New-BCContainer -accept_eula `
    -containerName $containerName `
    -auth NAVUserPassword `
    -Credential $adminCredentials `
    -imageName $bcImage `
    -additionalParameters $additionalParameters `
    -licenseFile $licensefile `
    -shortcuts $shortcuts `
    -includeTestToolkit:$testToolKit `
    -doNotUseRuntimePackages `
    -assignPremiumPlan `
    -bakFile $backupFile `
    -accept_outdated `
    -enableTaskScheduler:$false `
    -alwaysPull `
    -updateHosts `
    -useTraefik `
    -PublicDnsName $env:DNSNAME `
    -Restart always

Do you need any other information?
Using navconainerhelper <IP_ADDRESS>

Did you find a solution to this problem?
I cannot repro this.

Looking further - the only place this can happen is if the output from the compiler is blank - then Convert-ALCOutputToAzureDevOps will give this message.
I will make the function more resilient towards an empty result.

Shipped in <IP_ADDRESS>

Just wanted to let you know that it worked and fixed the issue.

Thanks Andreas


Introduce UI Testing for AboutThisApp.kt

Kind (Required)
Choose the suitable template if exists.

Improvement

Overview (Required)

Write test cases for About Screen AboutThisApp.kt

Steps

Create a androidTest package inside conference-app-2021/uicomponent-compose/other/src
Create a same sub-packages conference-app-2021/uicomponent-compose/other/src/androidTest/java/io/github/droidkaigi/feeder/about/AboutThisAppTest.kt
List out all the edge cases to test
Write all the test cases
All test should pass

Links

Reference - https://developer.android.com/jetpack/compose/testing

Thank you!!

If you do this you can reference this test. https://github.com/DroidKaigi/conference-app-2021/blob/main/uicomponent-compose/feed/src/androidTest/java/io/github/droidkaigi/feeder/feed/FeedItemTest.kt

I was waiting if any contributor shows up, else I am happy to work on this at weekend.


Missing Oracle datatype XMLTYPE in provider manifest

Description
The title has it all.
See similar issue https://github.com/zzzprojects/EntityFramework-Effort/issues/104
Maybe it would be a good idea to provide a way of injecting those rarly used types. Unfortunatly I am not able to change the model to avoid the issue.
Exception
System.InvalidOperationException
HResult=0x80131509
Message=The store type 'XMLTYPE' could not be found in the Effort provider manifest
Source=EntityFramework
StackTrace:
at System.Data.Entity.Utilities.DbProviderManifestExtensions.GetStoreTypeFromName(DbProviderManifest providerManifest, String name)
at System.Data.Entity.ModelConfiguration.Configuration.Properties.Primitive.PrimitivePropertyConfiguration.ConfigureColumn(EdmProperty column, EntityType table, DbProviderManifest providerManifest)
at System.Data.Entity.ModelConfiguration.Configuration.Properties.Primitive.PrimitivePropertyConfiguration.Configure(EdmProperty column, EntityType table, DbProviderManifest providerManifest, Boolean allowOverride, Boolean fillFromExistingConfiguration)
at System.Data.Entity.ModelConfiguration.Configuration.Properties.Primitive.PrimitivePropertyConfiguration.<>c__DisplayClass4.b__3(Tuple2 pm)    at System.Data.Entity.Utilities.IEnumerableExtensions.Each[T](IEnumerable1 ts, Action1 action)    at System.Data.Entity.ModelConfiguration.Configuration.Properties.Primitive.PrimitivePropertyConfiguration.Configure(IEnumerable1 propertyMappings, DbProviderManifest providerManifest, Boolean allowOverride, Boolean fillFromExistingConfiguration)
at System.Data.Entity.ModelConfiguration.Configuration.Types.StructuralTypeConfiguration.ConfigurePropertyMappings(IList1 propertyMappings, DbProviderManifest providerManifest, Boolean allowOverride)    at System.Data.Entity.ModelConfiguration.Configuration.Types.EntityTypeConfiguration.ConfigurePropertyMappings(DbDatabaseMapping databaseMapping, EntityType entityType, DbProviderManifest providerManifest, Boolean allowOverride)    at System.Data.Entity.ModelConfiguration.Configuration.Types.EntityTypeConfiguration.Configure(EntityType entityType, DbDatabaseMapping databaseMapping, DbProviderManifest providerManifest)    at System.Data.Entity.ModelConfiguration.Configuration.ModelConfiguration.ConfigureEntityTypes(DbDatabaseMapping databaseMapping, ICollection1 entitySets, DbProviderManifest providerManifest)
at System.Data.Entity.ModelConfiguration.Configuration.ModelConfiguration.Configure(DbDatabaseMapping databaseMapping, DbProviderManifest providerManifest)
at System.Data.Entity.DbModelBuilder.Build(DbProviderManifest providerManifest, DbProviderInfo providerInfo)
at System.Data.Entity.DbModelBuilder.Build(DbConnection providerConnection)
at System.Data.Entity.Internal.LazyInternalContext.CreateModel(LazyInternalContext internalContext)
at System.Data.Entity.Internal.RetryLazy2.GetValue(TInput input)    at System.Data.Entity.Internal.LazyInternalContext.InitializeContext()    at System.Data.Entity.Internal.InternalContext.Initialize()    at System.Data.Entity.Internal.InternalContext.GetEntitySetAndBaseTypeForType(Type entityType)    at System.Data.Entity.Internal.Linq.InternalSet1.Initialize()
at System.Data.Entity.Internal.Linq.InternalSet1.GetEnumerator()    at System.Data.Entity.Infrastructure.DbQuery1.System.Collections.Generic.IEnumerable.GetEnumerator()
at System.Collections.Generic.List1..ctor(IEnumerable1 collection)
at System.Linq.Enumerable.ToList[TSource](IEnumerable`1 source)
at SampleIssue.Program.Main(String[] args) in c:\temp\SampleIssue\SampleIssue\Program.cs:line 19
Project
I attached a sample projet, just restore nuget packages to have it build.
SampleIssue.zip
Further technical details

EF version: 6.2
EF Effort version: 2.1
Database Provider: Oracle 19.3

Hello @ymris ,
Thank you for reporting. We will look at it.
I'm not sure if we will succeed to support this one as we already tried in the past to make some customization for Oracle and that doesn't always work, but we will certainly try.
Best Regards,
Jonathan

Performance Libraries
context.BulkInsert(list, options => options.BatchSize = 1000);
Entity Framework Extensions • Entity Framework Classic • Bulk Operations •  Dapper Plus
Runtime Evaluation
Eval.Execute("x + y", new {x = 1, y = 2}); // return 3
C# Eval Function • SQL Eval Function

A simple way to ignore this datatype would actually be enough for my case. As I have seen in other threads this could come in handy every now and then, until a proper solution is in place.

Sorry for the very late reply @ymris ,
We totally forgot to merge your pull.
The v2.1.1 has been released with it.
We also added a new option EntityFrameworkEffortManager.CustomManifestPath which allow you to specify your own manifest file.
Let me know if everything work on your side.


Axis dimensions titles

Hi, thanks for this great package.
Would be good if you could add axis titles options (i.e: "power" on y and "date" on x axis)

Hi, your welcome 🙏 ,
would you explain little more?

I've seen that actually you can put titles on axis but only for particular axis values.
Would be useful to have axis to show dimensions (like power or time, or the generic X and Y).
Them would appear on extreme top of axis (for Y) and extreme right (for X).

Aha, let's call it right and top titles, (currently we just have left and bottom),
is it correct?

4 day past and you didn't answer yet,
I will close it tomarrow night if there is no respond.

It sounds like, he want to add a descriptive title to the x and y axis. Like: "Y-Axis" on y axis and "X-Axis" on x axis.
I've added such information using text widgets...

Aha I think we don't need to implement it in the library, because we can combine logs of widgets together.


Allow polygons with holes to be specified.

This will render polygons with holes, but doesn't yet support editing them.
Some scalability tests are needed.

I'll note that in HistomicsUI where this can be displayed, we already correctly handle computing area and perimeter for polygons with holes.


[wip] argo daemon improvements

testing out alternatives for argo daemon containers due to their shortcomings with resource management.
best alternative so far seems to be a service&statefulset approach, but this has major caveats

security concerns with allowing an argo serviceaccount to create services in the namespace
so far no robust cleanup method for deleting the services associated with a workflow, as exit handlers do not run when terminating a workflow.

closing as the service approach doesn't seem like a viable solution due to risk of dangling resources


examples/search/search_certs.py errors with 403

Describe the bug
If you execute search_certs.py you get the following error;
censys.common.exceptions.CensysUnauthorizedException: 403 (Forbidden): Your user does not have permission to define specific fields.
And as the 403 suggests if you strip out the fields the example works;
from censys.search import CensysCerts

c = CensysCerts()

# Single page of search results
query = c.search(
    "parsed.subject.country: AU",
    sort=["parsed.issuer.organization", "parsed.subject.postal_code"],
)
hits = query()
print(hits)

# Multiple pages of search results
query = c.search(
    "parsed.subject.country: AU",
    sort=["parsed.issuer.organization", "parsed.subject.postal_code"],
    pages=2,
    per_page=5,
)
for hits in query:
    for hit in hits:
        print(hit)

# View all results
query = c.search(
    "parsed.subject.country: AU",
    sort=["parsed.issuer.organization", "parsed.subject.postal_code"],
    pages=2,
    per_page=5,
)
print(query.view_all())

Hi @cloudjunky
At the moment only our paid accounts support defining fields. Please reach out to our sales team if you are interested in upgrading your account<EMAIL_ADDRESS>For more information you can read this support article.


Remove sends of bare strings for public methods.

@Fryguy saw one of these during your demonstration of the api.
@imtayadeway I can't tell if these methods are covered by tests. It looks like there might be some dynamic method calling based on resource.  I can try adding tests if they're not covered.

@jrafanie this looks great! Let me get back to you about test coverage. I think it's OK but I will verify

[x] results
[x] accounts
[x] software
[x] features
[x] rates

Should all have coverage, at least indirectly

👍  on this PR.

@Fryguy darga?

Thanks @chessbyte, yes, darga makes sense since we have test coverage and there's a chance this PR would cause git conflicts for other backports.


Update cache every run. Add /compiled and /logs. Make key sensitive to matrix.

Alternative to https://github.com/julia-actions/cache/pull/45
Closes https://github.com/julia-actions/cache/issues/11
Fixes https://github.com/julia-actions/cache/issues/46
This keeps the depot in one cache file for the given key, which  is sensitive to ~julia version, OS and arch (for the usual matrix var names, and there's a note if not).~ all matrix vars and the runner.OS.
It also re-saves the cache every run, removing the previous cache that was used.
By including /logs it also enables automatic Pkg.gc() to keep the depot size down, given that the depot will be restored>used>saved>restored>used>saved.. sequentially through the runs.
Regarding the split strategy in #45 , while there are some elements of the depot that are cross-OS compatible (/packages, /registries), for precompilation to remain hot, and for automatic Pkg.gc() to work properly, I think the depot should be cached in lock-step as a whole.
To implement this, because neither Github or actions/cache expose a way to update a cache file at a key, we have to run our own deletion just before the actions/cache save post step. So for a given key, there will only ever be one cache retained. This reduces the chance of the automatic eviction github does evicting a useful cache over an less useful one.
Demo
You can see it in action here https://github.com/JuliaIO/PNGFiles.jl/pull/72
Tests have been disabled, so it's just installation and loading.
First commit was with no cache files in the repo.
Second empty commit benefitted from the caching.
On linux 1.11 goes from 2 minutes to 40s
Cache sizes are all around 30 MB.
And there will only ever be the same number as the permutations of the matrix, so 15 in that repo, which is a common number.
I will note that it seems there's been a sizeable regression in precompile duration in master recently. Needs investigating.
How to release
It'd be nice to get this widely adopted, so I'm intrigued about releasing this as a minor change.
There's no breakage to the API, except for changes to defaults.

isn't the most recent cache deleted?

No, the cache deletion step happens just before the cache/save step.
The way post jobs are queued is a little confusing.

Ideally we'd only save if there were changes in the depot, but in practice that will be true every run because of the usage logs being updated. And usage logs allow us to do auto Pkg.gc
It kind of puts the decision on how to manage the depot in Julia's hands, which I think makes sense.

Reminder to myself. We might want to add an input to turn off cache deletion.

If you're able to review @SaschaMann let me know, otherwise I'll merge and release this as v1.4.0 tomorrow. (or let me know if you want more time)

I've done some tidying. @rikhuijzer would you mind taking one last look before I merge? This is in the context of it being a non-breaking release

Ok. I've found a better way than guessing matrix var names.. now this collates all matrix vars in the order they are entered automatically into a string.
So
      matrix:
        julia-version: ['1', '^1.10.0-rc1', 'nightly']
        os: [ubuntu-latest, windows-latest, macOS-latest]
        arch: [x64, x86]

becomes, for instance 1-ubuntu-latest-x64
And I included runner.OS just in case it's not part of the matrix.
So a full default key looks like julia-cache-1-ubuntu-latest-x64-Linux-6961372938-1
You can see the latest in action here
https://github.com/JuliaIO/PNGFiles.jl/actions/runs/6961372938/attempts/1?pr=72
and the re-run with a hot cache (although some of the nightlies updated)
https://github.com/JuliaIO/PNGFiles.jl/actions/runs/6961372938/attempts/2?pr=72

For future reference, here are the numbers from the two runs:

Test Description
First Run
Second Run

test (nightly, macOS-latest)
2m 56s
3m 38s

test (nightly, ubuntu-latest)
2m 1s
38s

test (nightly, ubuntu-latest, ...)
2m 0s
1m 54s

test (nightly, windows-latest, ...)
3m 5s
1m 36s

test (nightly, windows-latest, ...)
3m 4s
1m 29s

test (^1.10.0-rc1, macOS-latest, ...)
1m 59s
2m 0s

test (^1.10.0-rc1, ubuntu-latest, ...)
1m 38s
1m 36s

test (^1.10.0-rc1, ubuntu-latest, ...)
1m 35s
1m 28s

test (^1.10.0-rc1, windows-latest, ...)
2m 39s
1m 19s

test (^1.10.0-rc1, windows-latest, ...)
2m 35s
1m 8s

test (1, macOS-latest, ...)
3m 22s
1m 20s

test (1, ubuntu-latest, ...)
1m 35s
37s

test (1, ubuntu-latest, ...)
1m 32s
40s

test (1, windows-latest, ...)
2m 39s
1m 2s

test (1, windows-latest, ...)
2m 51s
1m 21s

(Credits to ChatGPT. I just threw in two screenshots asked for a table. I manually verified all the numbers. They are correct.)

Nice speedup  🚀

Note that some of the nightly versions changed between runs, so had to do re-precompilation.. That will be an issue until 1.11 is released.
But yeah, it's surprisingly effective on 1.9, but unfortunately that gain is lost in 1.10.0-rc1 because of more stdlibs outside of the sysimage.
I'm going to look into whether we can fix that regression by moving away from mtime sensitivity when it comes to stdlibs. I.e. reviving https://github.com/JuliaLang/julia/pull/50919

Ok. Should be good to go now. Final run check (ignore that these are opposite order.. I deleted the caches after attempt #2)

: cold cache :
: hot cache :

https://github.com/JuliaIO/PNGFiles.jl/actions/runs/6961978935/attempts/3?pr=72
https://github.com/JuliaIO/PNGFiles.jl/actions/runs/6961978935/attempts/2?pr=72

Note: I noticed that the two nightly macOS runs are on the same julia commit.. so I think there might be an issue preventing macOS from avoiding re-precompilation. That can be investigated independently.

I think we may want to also include the job name in the key automatically?

Also from testing this with a self hosted runner. We can't assume jq is installed

Also, if there's no matrix
jq: error (at <stdin>:1): string ("") has no keys

Also from testing this with a self hosted runner. We can't assume jq is installed

I'm not too worried about that. Requiring jq as a dependency seems fine, it's an extremely common tool and it's available on all hosted runners anyway.

Note to self. Hitting this on a private repo during the post step, which doesn't currently make sense to me..
Setting working directory to /home/runner/work/Foo.jl/Foo.jl
failed to run git: fatal: not a git repository (or any of the parent directories): .git

ERROR: LoadError: failed process: Process(`gh cache list --limit 100`, ProcessExited(1)) [1]

I'm noticing some things testing this with a larger less standard package setup, so I'm investigating.

Ok, some tweaks:

Added include-matrix input bool to allow the user to disable automatically including the matrix. While including the matrix is a good default for standard julia package CI, a use case I have for it is where a single runner runner runs, then a matrix of many different permutations, and I want the matrix to use the cache from the first runner. So in that case ignoring the matrix is beneficial
Pass the run repo explicitly to the gh cache calls as it cannot be assumed that the working directory is the repo of the run
Using an underscore after the restore key helps to indicate the end of the part that restore keys should match. Otherwise too many caches were deleted
Explicitly run Pkg.gc before save to help keep the cache size down
List the depot tree size after restore, for info

ugh.. turns out you can just ${{ join(matrix.*, '-') }} to get all matrix values joined with -.
So that avoids the need for jq 🎉
I'll go ahead and merge, and release tomorrow as 1.4.0 unless I hear otherwise.


Adding Register

Codecov Report

Merging #47 into master will increase coverage by 1.13%.
The diff coverage is 96.93%.

@@             Coverage Diff              @@
##             master      #47      +/-   ##
============================================
+ Coverage     59.83%   60.97%   +1.13%
- Complexity     1346     1389      +43
============================================
  Files           151      157       +6
  Lines          3259     3354      +95
============================================
+ Hits           1950     2045      +95
  Misses         1309     1309

Impacted Files
Coverage Δ
Complexity Δ

.../Api/Transformer/Register/CraftsmanTransformer.php
100% <100%> (ø)
2 <2> (?)

src/Api/Transformer/Foyer/CraftsmanTransformer.php
100% <100%> (ø)
3 <1> (+1)
:arrow_up:

src/Api/Transformer/Register/MapTransformer.php
100% <100%> (ø)
3 <3> (?)

src/Repository/IssueRepository.php
80.95% <100%> (+0.46%)
13 <0> (ø)
:arrow_down:

src/Api/Transformer/Foyer/IssueTransformer.php
100% <100%> (ø)
5 <3> (+1)
:arrow_up:

src/Api/Entity/Register/Map.php
100% <100%> (ø)
2 <2> (?)

src/Api/Entity/Register/Issue.php
100% <100%> (ø)
22 <22> (?)

src/Api/Transformer/Register/IssueTransformer.php
100% <100%> (ø)
4 <4> (?)

src/Controller/Api/RegisterController.php
88.46% <88.46%> (ø)
8 <8> (?)

... and 7 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update de70f6b...d159e41. Read the comment docs.


Separate db_access policy into separate db_app_access and db_migrator_access policies

Currently the app service can technically access the migrator user in the database if it ignores/overrides the DB_USER environment variable, since the IAM role/policy on the task execution role provides access to both db users. It would be tighter security to separate those into separate policies.
This ticket would be to:

Separate the current db_access policy into two separate policies db_app_access and db_migrator_access. This will require separating the access_policy_name database configuration in env-config as well into app_access_policy_name and migrator_access_policy_name.
In the app service layer we'll want to reference the "app_access_policy_name" to pass into the service, since that's the one the service will want to attach to the service. We will also want to do something similar to pass in the migrator_access_policy_arn into the service layer so that it the module can create a migrator role the same way it created a role for the service.
The last part is to make the database migrations work. We need to update the run-database-migrations.sh script to not only override the environment variables for the task, but to also override the taskRoleArn to use the migrator role instead of the service role (see https://docs.aws.amazon.com/cli/latest/reference/ecs/run-task.html). This last part may require some changes to the code design to make it work.

Going to split this into a multi stage deployment:

Additive (both, app and migrator resources). No change in roles used
Change over app role
App references app role only
Change over migrator role
Migration references new role
Delete old roles
Delete old policies

Going to split this into a multi stage deployment:
1. Additive (both, app and migrator resources). No change in roles used

   * Change over app role

2. App references app-only role

   * Delete old role

3. Change over migrator role

   * Migration references new role
   * Remove migrator permissions from app role
   * Delete old policy

Step 3 will be split into 2 steps. We are only changing 1 layer per PR.


Idea for PageWriter Model method

I've been thinking more about PageWriter's Model method again. To make it more usable, would a parameter of Action delegates passed in to customise the model's write behaviour be a good idea? So in the case of a checkbox for a boolean model property you could call the Action you want used to update checkboxes on the view. If no Action delegate exists then it works as it does now i.e. assume it is a textbox.
Would this work and also is there any benefit in this? Or is it too complicated?

Are you thinking that the delegate would take an IWebElement or just the property name and type or...?

Semi structured idea so I'm not sure what would work best to be honest. Still learning.
I want to be able to default to the following code from PageWriter as it is now...
_componentFactory.HtmlControlFor<CheckBox>(propertyExpression)
.ReplaceInputValueWith(stringValue);

But override this if I have a Boolean for example with something like the following call...
if(stringValue == "true"){
_componentFactory.HtmlControlFor<CheckBox>(propertyExpression)
                .Checked();
}else {...}

So there would need to be a parameter to pass in the propertyExpression? And one would need to remember to specify the propertyTypeHandling for Boolean.ToString() so GetStringValue returns the right value?
Is there a potential problem with a group of checkboxes though? How do we ensure the right box is ticked based on value? Is this where a IWebElement parameter would come in useful? And is there anything that does this already?


[WIP] Add Merge Patch option for ApplicationSet sync

Adds "MergePatch" sync option for ApplicationSets when upserting generated sets.
Closes #186

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Closing this as essentially what needs to happen is the generated template is stored (in an annotation) on the generated app, and updated app is compared to the previously generated app and a patch is generated, and then the patch is applied to the live resource. Basically a three-way merge.

Is this feature available in any releases, I cannot find it.


MAIN B-19507 limit customer access via validation code (MERGE AFTER MAIN B-19506)

INTEGRATION PR
Agility ticket
Summary
This PR will need to be merged after the B-19506 branch https://github.com/transcom/mymove/pull/12488#pullrequestreview-1997774962

In the near future, we will be getting some validation code(s) from DPS that a customer will need to input when beginning their move. This is to keep users from creating fake moves and only really allow authenticated and appropriate users to use MilMove.
In order to make this happen, we need the user to input that validation code before doing anything else. So the logic implemented in this BL item will require the user to put that code in if they haven't set their profile up (AKA have an empty profile) and the feature flag is turned on.
This PR does the following:

creates a migration file that creates a table called application_parameters where the validation_code will be stored
creates internal endpoint, POST /validation-code
updates the getWorkflowRoutes to
refactors the ConusOrNot.jsx component to be an updated functional component
created ValidationCode.jsx component to handle the form and API call
added & updated all relevant tests, cleaned up some code
my main man @TevinAdams added some playwright test adjustments when the flag is true

How to test
Couple of setup things you need to do first:

make db_dev_migrate (this will create the application_parameters table
You'll need to fill in a row with a value in validation_code and id, updated_at and created_at will auto populate
In your .envrc, set export FEATURE_FLAG_VALIDATION_CODE_REQUIRED=true
Now fire up your client and server

For the happiest path

Access MM as a customer
Login as a brand new customer
You should now see the validation code screen
Input the code you slapped in the application_parameters table
It should now let you progress through the profile set up

For the saddest path

Access MM as a customer
Login as a brand new customer
You should now see the validation code screen
Input anything other than the code you put in the database
You should see an error screen and not be able to progress
You can have as many attempts as you want when inputting the code (this was a requirement from Kipp)

Screenshots

Mobile

Mobile

Warnings

:warning:

Files located in legacy directories (src/shared or src/scenes) have
been edited. Are you sure you don’t want to also relocate them to the new file structure?
View the frontend file org ADR for more information

  Generated by :no_entry_sign: dangerJS against 474c468c95e0b127455d6f174f6b33292bfc444b

For some reason I didn't have to update the spectral count in the integrationTesting branch, but I apparently have to update it here.

@danieljordan-caci conflicts from merging 19506 in

Should be real quick and easy

Should be real quick and easy

Yup should be good now


Read published files direct from filesystem if possible

This addresses a performance issue when building the solr search index with a large number of published events. The event metadata files and catalogs (e.g. dublincore.xml, segments.xml, slidetext.xml) are loaded into the workspace from http requests which is relatively slow, especially if Opencast is configured with https.
With a large number of events (60K+), this change reduced indexing time from > 6 hours to just over 1 hour on a test system.
This uses a similar implementation to the technique used to read asset manager files directly, though the location of DistributionPathUtils in asset-manager-utils is probably questionable and I'm open to suggestions there.

@smarquard This is ready to go aside from that rename as far as I'm concerned.

I'm not sure I will be able to return to this any time soon given local #COVID19 priorities. If anyone else would like to push changes and get this ready to merge please go ahead.

I've asked @marwyg to quickly finish this so that we can hopefully include this in 8.3

Closing this in favour of #1483, which completes the work.


Fix number_of_jobs parsing

Replaced jobs with the correct variable (number_of_jobs) when parsing the user's selection of job count from the GUIDE.

Good catch; this wasn't caught before because apparently all my personal testing devices are single-threaded CPU's lol so the early return prevented reaching that line (pretty sure the GitHub action runners have same problem too)


Bug: Unexpected highlight

As the image showing below, non-foldable blocks are also highlighted, remove this may be better.

This problem is now perfectly resolved on feature/general-improvement


Determine if folio data import is concerned with the format of filenames

One vendor includes parens in file names, currently there is a script to remove the parens as they caused an issue somewhere in the symphony pipeline.
Determine if the folio data import has the same issue or if we can avoid file renaming.

@justinlittman - I've been trying to follow the code, with partial success, and I'm wondering if the following is correct:

we do the actual READ of the files in our vendor load airflow plugin ... that is, we send the contents of the marc files as a payload in the POST request
this means that parens in the filenames are m00t, UNLESS they would affect the processing in our vendor_load plugin

multipart files?
reading them from within the context of the flask vendor-load plugin?

what is your take?

Are you trying to test file upload by user or FTP download from vendor?

@justinlittman when vendor data is processed in prod now, with scripts and Symphony, Symphony barfs on parens.  Is that a m00t point for what we're doing?

from Darsi:

On Justin's advice, I uploaded a file to airflow, using the Gobi full-bib approach (see https://sul-libsys-airflow-dev.stanford.edu/vendors/interface/18, from 2023-05-25) and it seems to have loaded (see https://folio-test.stanford.edu/data-import/job-summary/73e10f15-a790-46bb-9b7f-f74b5156f3ee)

From https://docs.google.com/spreadsheets/d/1Z4mPTEZuw_YIqN2PCWy4BXbOzzi8zFAXqGwQBD0-It8, vendor CIBTC has parens in names:

EUS91000_(20230207)_37.mrc
EUS91005_(20230210)_212.mrc

doing ftp from sul-libsys-airflow-dev:
libsys@sul-libsys-airflow-dev:~$ ftp -p <IP_ADDRESS> 21
Connected to <IP_ADDRESS>.
220 Microsoft FTP Service
Name (<IP_ADDRESS>:libsys): stanford
331 Password required for stanford.
Password: # see google sheet
230 User stanford logged in.
Remote system type is Windows_NT.
ftp> passive
Passive mode off.
ftp> passive
Passive mode on.
ftp> get EUS91006_(2020.12.28)_1.mrc
local: EUS91006_(2020.12.28)_1.mrc remote: EUS91006_(2020.12.28)_1.mrc
227 Entering Passive Mode (124,207,37,180,5,82).
125 Data connection already open; Transfer starting.
226 Transfer complete.
1921 bytes received in 0.00 secs (2.5445 MB/s)
ftp> exit
221

libsys@sul-libsys-airflow-dev:~$ ls -l
total 108
drwxr-xr-x 3 libsys libsys  4096 Sep 19  2022  airflow
drwxr-xr-x 2 libsys libsys 77824 Apr  4 09:00  data
-rw-r--r-- 1 libsys libsys  1921 May 25 13:13 'EUS91006_(2020.12.28)_1.mrc'
drwxr-xr-x 3 libsys libsys  4096 Nov  2  2022  fixes
drwxr-xr-x 5 libsys libsys  4096 May 25 11:08  libsys-airflow
drwxr-xr-x 2 libsys libsys  4096 Apr 19  2022  mapping_files
drwxr-xr-x 6 libsys libsys  4096 Mar 15 08:09  virtual-env

on the remote:  EUS91006_(2020.12.28)_1.mrc (no quotes)
on our machine:  'EUS91006_(2020.12.28)_1.mrc' (single quotes)
I will now attempt to do this within python (but I expect it shells out to the os anyway)

Notes on what I tried to do in python:
libsys@sul-libsys-airflow-dev:~$ python3
>>> from airflow.providers.ftp.hooks.ftp import FTPHook
>>> hook = FTPHook(ftp_conn_id="<IP_ADDRESS>")
>>> hook
<airflow.providers.ftp.hooks.ftp.FTPHook object at 0x7ff94907dca0>
>>> filename = "EUS91006_(2020.12.28)_1.mrc"
>>> hook.retrieve_file(filename, ".")
--- Logging error ---
Traceback (most recent call last):
  File "/home/libsys/.local/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context
    self.dialect.do_execute(
  File "/home/libsys/.local/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute
    cursor.execute(statement, parameters)
sqlite3.OperationalError: no such table: connection

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/libsys/.local/lib/python3.8/site-packages/airflow/models/connection.py", line 400, in get_connection_from_secrets
    conn = secrets_backend.get_connection(conn_id=conn_id)
  File "/home/libsys/.local/lib/python3.8/site-packages/airflow/utils/session.py", line 70, in wrapper
    return func(*args, session=session, **kwargs)
  File "/home/libsys/.local/lib/python3.8/site-packages/airflow/secrets/metastore.py", line 36, in get_connection
    conn = session.query(Connection).filter(Connection.conn_id == conn_id).first()
  File "/home/libsys/.local/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 3429, in first
    ret = list(self[0:1])
  File "/home/libsys/.local/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 3203, in __getitem__
    return list(res)
  File "/home/libsys/.local/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 3535, in __iter__
    return self._execute_and_instances(context)
  File "/home/libsys/.local/lib/python3.8/site-packages/sqlalchemy/orm/query.py", line 3560, in _execute_and_instances
    result = conn.execute(querycontext.statement, self._params)
  File "/home/libsys/.local/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1011, in execute
    return meth(self, multiparams, params)
  File "/home/libsys/.local/lib/python3.8/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection
    return connection._execute_clauseelement(self, multiparams, params)
  File "/home/libsys/.local/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement
    ret = self._execute_context(
  File "/home/libsys/.local/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context
    self._handle_dbapi_exception(
  File "/home/libsys/.local/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception
    util.raise_(
  File "/home/libsys/.local/lib/python3.8/site-packages/sqlalchemy/util/compat.py", line 182, in raise_
    raise exception
  File "/home/libsys/.local/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context
    self.dialect.do_execute(
  File "/home/libsys/.local/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 608, in do_execute
    cursor.execute(statement, parameters)
sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) no such table: connection
[SQL: SELECT connection.password AS connection_password, connection.extra AS connection_extra, connection.id AS connection_id, connection.conn_id AS connection_conn_id, connection.conn_type AS connection_conn_type, connection.description AS connection_description, connection.host AS connection_host, connection.schema AS connection_schema, connection.login AS connection_login, connection.port AS connection_port, connection.is_encrypted AS connection_is_encrypted, connection.is_extra_encrypted AS connection_is_extra_encrypted
FROM connection
WHERE connection.conn_id = ?
 LIMIT ? OFFSET ?]
[parameters: ('<IP_ADDRESS>', 1, 0)]
(Background on this error at: http://sqlalche.me/e/13/e3q8)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.8/logging/__init__.py", line 1085, in emit
    msg = self.format(record)
  File "/usr/lib/python3.8/logging/__init__.py", line 929, in format
    return fmt.format(record)
  File "/home/libsys/.local/lib/python3.8/site-packages/airflow/utils/log/colored_log.py", line 95, in format
    record = self._color_record_traceback(record)
  File "/home/libsys/.local/lib/python3.8/site-packages/airflow/utils/log/colored_log.py", line 86, in _color_record_traceback
    self.color(self.log_colors, record.levelname) + record.exc_text + escape_codes['reset']
AttributeError: 'CustomTTYColoredFormatter' object has no attribute 'color'
Call stack:
  File "<stdin>", line 1, in <module>
  File "/home/libsys/.local/lib/python3.8/site-packages/airflow/providers/ftp/hooks/ftp.py", line 166, in retrieve_file
    conn = self.get_conn()
  File "/home/libsys/.local/lib/python3.8/site-packages/airflow/providers/ftp/hooks/ftp.py", line 60, in get_conn
    params = self.get_connection(self.ftp_conn_id)
  File "/home/libsys/.local/lib/python3.8/site-packages/airflow/hooks/base.py", line 68, in get_connection
    conn = Connection.get_connection_from_secrets(conn_id)
  File "/home/libsys/.local/lib/python3.8/site-packages/airflow/models/connection.py", line 404, in get_connection_from_secrets
    log.exception(
Message: 'Unable to retrieve connection from secrets backend (%s). Checking subsequent secrets backend.'
Arguments: ('\x1b[1mMetastoreBackend\x1b[22m',)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/libsys/.local/lib/python3.8/site-packages/airflow/providers/ftp/hooks/ftp.py", line 166, in retrieve_file
    conn = self.get_conn()
  File "/home/libsys/.local/lib/python3.8/site-packages/airflow/providers/ftp/hooks/ftp.py", line 60, in get_conn
    params = self.get_connection(self.ftp_conn_id)
  File "/home/libsys/.local/lib/python3.8/site-packages/airflow/hooks/base.py", line 68, in get_connection
    conn = Connection.get_connection_from_secrets(conn_id)
  File "/home/libsys/.local/lib/python3.8/site-packages/airflow/models/connection.py", line 410, in get_connection_from_secrets
    raise AirflowNotFoundException(f"The conn_id `{conn_id}` isn't defined")
airflow.exceptions.AirflowNotFoundException: The conn_id `<IP_ADDRESS>` isn't defined

the surrounding quotes seem to a be problem;  I uploaded a file named 'filename(hasparens).mrc' (with quotes) and it never appeared on https://folio-test.stanford.edu/data-import?direction=descending&sort=completedDate.  (I uploaded a diff file afterwards and it did appear.)

Closing this as airflow does not seem to create these problematic characters.


Move scene change detection into ContextInner

It will need access to these fields for lookahead scene detection

Coverage decreased (-0.08%) to 80.95% when pulling 03f34ecf5ea36f9b4356ef9031916dcb9dee0059 on shssoichiro:scenechange-update into 5079a62a69ec62578452ead6b9d5e5022b37996e on xiph:master.

Why move it here, again? Also I'm not sure if we always have the last frame in frame_q to fetch it from there.

This is related to #1441 / #794. When we use lookahead for scene change detection, it will need access to the whole lookahead queue instead of just the current and last frame. This also avoids having the scenechange detector keep an extra reference to the last frame, when we can look that up from the frame queue. Originally I hoped to change the ScenechangeDetector struct to hold a reference to the frame_q, but that wouldn't be possible without unsafe code or a major refactor.
I considered that the detect_scene_change function could just be a standalone function in the scenechange module, but it seemed unnecessary to keep that module for one small function.
Maybe it just makes more sense to close this until the full new scenechange algorithm is implemented. I wanted to keep the refactor separate from changing the algorithm, but maybe that doesn't make sense here.

#1443 just landed, which by nature of constructing fi's in lookahead also effectively moved scenecut detection to lookahead. So maybe this refactor isn't necessary?

I think some change still needs to be made here, because SceneChangeDetector still doesn't have access to all the frames. However, after looking through the AOM code more, this PR might also not do what we need without more refactoring. I'll hold off on this change for now until we can be more certain what the lookahead-based scenecut detection looks like.


api login error

i want to check that username and password is exist by login i am calling following api(api/session as per web api login). i am using guzzle to call api from my server i am able to get user details by calling api/users with the guzzle.
API_PATH contains server path. and i am passing email and password.
$client = new GuzzleHttp\Client();
$res = $client->post(API_PATH.'session',array('email'=>$email,'password'=>$password));

i am getting following error
"details":"The @FormParam is utilized when the content type of the request entity is not application

Looks like request is incorrect. You should compare your request with what default web UI sends.

thanx i got it.

is there any list of api's available which i can use.
i want to insert record into user_group table i cant see any api for that in swagger.json documentation.
i have to do it manually or any api available.

You can POST /permissions/groups to set a user to a group. It's in the swagger specs.

@sunhoww  thanx...


Preparations for v0.9.0rc1 release (v0.9.0 pre-release)

OK, let's try to release a new version. As described in #361, it will be v0.9.0, but this is a pre-release to test that the updated release process works as expected.
Draft of the release notes:
This is a release candidate for v0.9.0.

Corrections and improvements to the lin-BASEX method implementation, as well as
improvements and extensions of the analytical Abel-transform tools.

Here is a full list of changes in v0.8.5:
* Correct behavior of relative basis_dir in basex under Python 2 (PR #336).
* Improvements in tools.analytical.SampleImage class: more consistent and
  intuitive interface, accurate Abel transform for existing images, additional
  sample images with exact Abel transform (PR #339, #352).
* Analytical Abel transform of axially symmetric piecewise polynomials in
  spherical coordinates (PR #339).
* Offline HTML and PDF documentation is now available at Read the Docs and can
  be built locally (PR #343, #348, #349).
* **Important** changes in the **lin-BASEX** implementation (PR #357):

  - It was erroneously producing even-sized images with offset origin. Now the
    output is odd-sized and properly centered.
  - Output images for radial_step > 1 were scaled down by the same factor. Now
    they have the save size as the input.
  - The sign of Beta for odd Legendre orders is reversed to be consistent with
    PyAbel conventions (zero angle is upwards, towards smaller row indices).

* Transform() with method='linbasex' now always stores the radial, Beta and
  projection attributes, so there is no need to pass return_Beta=True
  in transform_options (PR #357).

Looks good to me!

Something very strange happens with Travis CI: for Python 3.10, instead of installing SciPy from a wheel package, like it did before:
211 Collecting scipy
212  Downloading scipy-1.9.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (33.7 MB)

and currently does for Python 3.9:
237 Collecting scipy
238   Downloading scipy-1.9.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (33.8 MB)

and for Python 3.11:
212 Collecting scipy
213  Downloading scipy-1.9.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (33.4 MB)

now it tries to build from source:
200 Collecting scipy
201  Downloading scipy-1.9.3.tar.gz (42.1 MB)

and fails.  :–/ I've tried to restart the job, but got the same result.
Any ideas why this happens or where to ask/report? Or maybe just wait a couple of days and try again?

Uhg, Travis being weird again. No, I have no idea why it's doing this. Waiting a day might be advisable...

The same problem today. Internet searches still give no relevant results. So I've decided to ask at the Travis CI Community Forums, maybe somebody would help... Otherwise, maybe we should just disable this build until the problem resolves?
By the way, Dan, how many minutes we have at Travis and  AppVeyor?

Awesome! Thanks for asking Travis about the issue.
In the meantime, I'm happy to exclude Python 3.10 from the Travis tests for now and open a new issue to remind us to reinstate it.
On AppVeyor, I believe that we have (and have always had) unlimited build time. The issue is just that they only have one concurrent build, so it's a bit slow.
I tried to see how many credits we had left on Travis, but I couldn't figure it out. As far as I can tell, I no longer administer PyAbel on Travis, lol. I think that their support for Open Source has been going downhill. At some point in the near future, we may want to rethink which CI services we're using.

As far as I can tell, I no longer administer PyAbel on Travis, lol.

This is really strange. :–)
So, as I understand, the plan is to make this pre-release now, then try to switch from Travis to GitHub Actions, make another pre-release to test how that works, and then finally release v0.9.0?
If so, could you please approve this PR? Because otherwise GitHub thinks that I'm merging my own PRs without any reviews...

Approved!
I think that we should go ahead and release v0.9.0 and worry about the Travis issues later.


[BEAM-12832] Add Go SDK xlang info to programming guide.

Adds a Go SDK section to "Using cross-language transforms", following the structure of the existing SDKs. Also adds a section to "Creating cross-language transforms" mentioning that the feature is not yet available.

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

[x] Choose reviewer(s) and mention them in a comment (R: @username).
[x] Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
[ ] Update CHANGES.md with noteworthy changes.
[x] If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

GitHub Actions Tests Status (on master branch)

See CI.md for more information about GitHub Actions CI.

R: @lostluck @chamikaramj
Also two questions:

Is there any way to see this in HTML form so I can see if the code snippets are displaying right?
Are there any owners of the programming guide that I should ask to review this?

LGTM. Thanks.


[KYUUBI #3890] [Improvement] Prefer binPack style for importSelectors in scalafmt styling

Why are the changes needed?

to close #3890 .
Change importSelectors = singleLine to importSelectors = binPack in .scalafmt.conf.
How was this patch tested?

[ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

[ ] Add screenshots for manual tests if appropriate

[x] Run test locally before make a pull request

Codecov Report

Merging #3891 (d75a075) into master (00c27a4) will decrease coverage by 0.00%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##             master    #3891      +/-   ##
============================================
- Coverage     51.79%   51.78%   -0.01%
  Complexity       13       13
============================================
  Files           506      506
  Lines         28955    28955
  Branches       3987     3987
============================================
- Hits          14996    14995       -1
- Misses        12538    12539       +1
  Partials       1421     1421

Impacted Files
Coverage Δ

...g/apache/kyuubi/sql/KyuubiEnsureRequirements.scala
0.00% <ø> (ø)

...pache/kyuubi/sql/KyuubiQueryStagePreparation.scala
0.00% <ø> (ø)

...g/apache/kyuubi/sql/KyuubiSparkSQLAstBuilder.scala
0.00% <ø> (ø)

...ache/kyuubi/sql/RepartitionBeforeWritingBase.scala
0.00% <ø> (ø)

...che/kyuubi/sql/watchdog/MaxPartitionStrategy.scala
0.00% <ø> (ø)

...ubi/sql/zorder/InsertZorderBeforeWritingBase.scala
0.00% <ø> (ø)

...rg/apache/kyuubi/sql/zorder/ZorderBytesUtils.scala
0.00% <ø> (ø)

...che/spark/sql/PruneFileSourcePartitionHelper.scala
0.00% <ø> (ø)

...uthz/ranger/RuleApplyRowFilterAndDataMasking.scala
91.66% <ø> (ø)

...k/authz/ranger/RuleReplaceShowObjectCommands.scala
62.90% <ø> (ø)

... and 43 more

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more

emmm, but it looks ugly for scala code. sorry for the -1

Let me try to explain this PR in some more reasons,

singleLine style for imports does force the line of long imports to break maxColumn rule, which is not self-explicable and brings worse readability in practical use
long imports are unavoidable in some cases, or using import any._ with wildcard will cause cyclic dependencies (e.g. v2commands.scala as the example the issue mentioned)
binPack style won't impact the multi-imports which is not over-sized
binPack sytle is the original capability from scalafmt, and wont introduced extra mannual workload for auto linting and reformat using IDE or tools.

What do you think. @pan3793 @yaooqinn
Which is more important self-explicable rules and readability in single screen VS single line for minimum line breaks?

singleLine style for imports does force the line of long imports to break maxColumn rule, which is not self-explicable and brings worse readability in practical use

For the scala code style setting, it allows to ignore the import part.

  <check level="error" class="org.scalastyle.file.FileLineLengthChecker" enabled="true">
    <parameters>
      <parameter name="maxLineLength"><![CDATA[100]]></parameter>
      <parameter name="tabSize"><![CDATA[2]]></parameter>
      <parameter name="ignoreImports">true</parameter>
    </parameters>
  </check>

import is not code, so it is reasonable to limit the import length.
for a corner case, if my code package depth is big, how do you prevent it to exceed the maxLineLength?

2.long imports are unavoidable in some cases, or using import any._ with wildcard will cause cyclic dependencies (e.g. v2commands.scala as the example the issue mentioned)

I wonder that you can split the multiple imports into two lines manually?
FYI:
Before:
import org.apache.kyuubi.plugin.spark.authz.v2Commands.CommandType.{CommandType, HasChildAsIdentifier, HasQueryAsLogicalPlan, HasTableAsIdentifier, HasTableAsIdentifierOption, HasTableNameAsIdentifier}

After:
import org.apache.kyuubi.plugin.spark.authz.v2Commands.CommandType.{CommandType, HasChildAsIdentifier, HasQueryAsLogicalPlan}
import org.apache.kyuubi.plugin.spark.authz.v2Commands.CommandType.{HasTableAsIdentifier, HasTableAsIdentifierOption, HasTableNameAsIdentifier}

binPack style won't impact the multi-imports which is not over-sized
It looks not good for this case, at least, I think we should not limit the import length with the same size of code.

I prefer to keep it as-is.

OK, closing this PR. Based on the discussion, the advantage achieved by binpack style for important is not significant and not part of consensu.
Thanks for the reviews.


[SB] SB tests pipeline fix

/azp run python - servicebus -tests

API change check
API changes are not detected in this pull request.

/azp run python - servicebus - tests


Subclass with the same name as the base class.

System Details

Web Framework version: netcoreapp3.0
Swashbuckle.AspNetCore version: 5.0.0-rc5

The endpoint receives a ViewModel.
This ViewModel has a property where it is the same name as the base class.
I am attaching two images to make it easier to understand. One is when it works and another not.

See https://github.com/domaindrivendev/Swashbuckle.AspNetCore#customize-schema-ids

See https://github.com/domaindrivendev/Swashbuckle.AspNetCore#customize-schema-ids


How to run Rails on IC - Documentation

Since we don't want to have platform specific defaults in IC, we should put this information in Platform specific documentation.

Maybe we can change this topic to a "How to run Rails on IC" issue and list all the steps we need to document for that?

:+1: Good suggestion :-) Done!

Suggestions (these are all my current things that are undocumented or the UI is not telling me how to do things when hosting a basic web app)

Add SECRET_KEY_BASE
How to link + set up the Database connection
How to configure the web runner (puma or else) via Procfile

Addition:

Use > 1GB of memory as default

Addition:

How to migrate on deploy (ie with the rake hook)

Addition:

Tweak Puma settings (our own Puma is a very large config for a simple server)

More specific to my previous comment:

Make sure people use the correct number of threads/workers for Puma config. For instance, on a single-core system ($10 Digital Ocean Droplet) you must only configure 1 thread because it has one core.

Turns out, SECRET_KEY_BASE is not required, I believe the Heroku buildpack sets this value for us.

@michiels Would it make sense to also port the documentation you wrote on the website to the internal docs of IC?

@jvanbaarsen Definetely! Do you think it would be good to just use the same markdown from the site for in-app documentation and sync it some way?

@michiels Hm, We can see if the markdown works correctly. For me it is important that the documentation in IC itself is leading. So we have to create it here, and then sync (parts) to the website.
Do you have suggestions for how to do this?

@jvanbaarsen Let me port the documentation to this repo, then I'll write a script in the Jekyll site to keep it in sync

@michiels Perfect! I assigned you to this issue.

:+1: