vmware, ui: update portgroup on network offering change

Description
Adds option for specifying MAC Learning property for network offering (useful for VMware Distributed Virtual Portgroup). Added global config - network.mac.learning for the default value.
Enhanced update network form in the UI.
On network offering change for an isolated network

VMware portgroup should be updated accordingly.
VMs on the network should be placed on the correct VMware portgroup based on the network rate, https://docs.cloudstack.apache.org/en/latest/adminguide/service_offerings.html#network-throttling.

Types of changes

[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] New feature (non-breaking change which adds functionality)
[x] Bug fix (non-breaking change which fixes an issue)
[x] Enhancement (improves an existing feature and functionality)
[ ] Cleanup (Code refactoring and cleanup, that may add test cases)

Feature/Enhancement Scale or Bug Severity
Feature/Enhancement Scale

[ ] Major
[ ] Minor

Bug Severity

[ ] BLOCKER
[ ] Critical
[x] Major
[ ] Minor
[ ] Trivial

Screenshots (if appropriate):

How Has This Been Tested?

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian. SL-JID 658

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian.  I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian. SL-JID 737

@blueorangutan test centos7 vmware-67u3

@shwstppr a Trillian-Jenkins test job (centos7 mgmt + vmware-67u3) has been kicked to run smoke tests

@blueorangutan test centos7 vmware-65u2

@shwstppr a Trillian-Jenkins test job (centos7 mgmt + vmware-65u2) has been kicked to run smoke tests

Trillian test result (tid-1462)
Environment: vmware-65u2 (x2), Advanced Networking with Mgmt server 7
Total time taken: 38431 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5181-t1462-vmware-65u2.zip
Smoke tests completed. 89 look OK, 0 have error(s)
Only failed tests results shown below:

Test
Result
Time (s)
Test File

@blueorangutan test matrix

@DaanHoogland a Trillian-Jenkins matrix job (centos7 mgmt + xs71, centos7 mgmt + vmware65, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@shwstppr a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian.  Not seen in manual run
manualtest.txt
Will re-run thru BO

@blueorangutan package

@shwstppr a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian. SL-JID 759

@blueorangutan package

@shwstppr a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian. SL-JID 762

@blueorangutan package

@shwstppr a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian. SL-JID 763

@blueorangutan package

@shwstppr a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian. SL-JID 764

@blueorangutan test matrix

@shwstppr a Trillian-Jenkins matrix job (centos7 mgmt + xs71, centos7 mgmt + vmware65, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@blueorangutan package

@shwstppr a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_multiplication_x: el7 :heavy_multiplication_x: el8 :heavy_multiplication_x: debian. SL-JID 769

@blueorangutan package

@shwstppr a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_multiplication_x: el7 :heavy_multiplication_x: el8 :heavy_multiplication_x: debian. SL-JID 770

@blueorangutan package

@shwstppr a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_multiplication_x: el8 :heavy_check_mark: debian. SL-JID 771

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian.  I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian. SL-JID 841

@blueorangutan package

@shwstppr a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_multiplication_x: el7 :heavy_multiplication_x: el8 :heavy_multiplication_x: debian :heavy_multiplication_x: suse15. SL-JID 1167

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 1169

@blueorangutan package

@shwstppr a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 1172

@blueorangutan package

@shwstppr a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan package

@shwstppr a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 1191

@blueorangutan test matrix

@shwstppr a Trillian-Jenkins matrix job (centos7 mgmt + xs71, centos7 mgmt + vmware65, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

Trillian Build Failed (tid-2006)

Trillian test result (tid-2007)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 33707 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5181-t2007-kvm-centos7.zip
Smoke tests completed. 89 look OK, 0 have errors
Only failed tests results shown below:

Test
Result
Time (s)
Test File

LGTM, did a few tests and the features seem to work well. :+1:

@shwstppr @NuxRo please advise when the PR is ready for review

@blueorangutan package

@shwstppr a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan package

@shwstppr a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan packjage

@blueorangutan package

@shwstppr a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_multiplication_x: el7 :heavy_multiplication_x: el8 :heavy_multiplication_x: debian :heavy_check_mark: suse15. SL-JID 1296

@blueorangutan package

@sureshanaparti a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 1299

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 1300

@blueorangutan package

@shwstppr a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan package

@shwstppr a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 1305

@blueorangutan test centos7 vmware-67u3

@sureshanaparti a Trillian-Jenkins test job (centos7 mgmt + vmware-67u3) has been kicked to run smoke tests

@blueorangutan test centos7 vmware-65u2

@shwstppr a Trillian-Jenkins test job (centos7 mgmt + vmware-65u2) has been kicked to run smoke tests

Trillian test result (tid-2113)
Environment: vmware-65u2 (x2), Advanced Networking with Mgmt server 7
Total time taken: 38482 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5181-t2113-vmware-65u2.zip
Smoke tests completed. 85 look OK, 4 have errors
Only failed tests results shown below:

Test
Result
Time (s)
Test File

test_DeployVmAntiAffinityGroup_in_project
Error
119.64
test_affinity_groups_projects.py

test_DeployVmAntiAffinityGroup
Error
47.65
test_affinity_groups.py

test_03_deploy_and_scale_kubernetes_cluster
Failure
32.97
test_kubernetes_clusters.py

test_07_deploy_kubernetes_ha_cluster
Failure
0.05
test_kubernetes_clusters.py

test_08_deploy_and_upgrade_kubernetes_ha_cluster
Failure
0.04
test_kubernetes_clusters.py

test_09_delete_kubernetes_ha_cluster
Failure
0.04
test_kubernetes_clusters.py

test_02_list_snapshots_with_removed_data_store
Error
54.81
test_snapshots.py

Trillian test result (tid-2112)
Environment: vmware-67u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 40934 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5181-t2112-vmware-67u3.zip
Smoke tests completed. 89 look OK, 0 have errors
Only failed tests results shown below:

Test
Result
Time (s)
Test File

@blueorangutan test centos7 vmware-65u2

@shwstppr a Trillian-Jenkins test job (centos7 mgmt + vmware-65u2) has been kicked to run smoke tests

Trillian test result (tid-2118)
Environment: vmware-65u2 (x2), Advanced Networking with Mgmt server 7
Total time taken: 36792 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5181-t2118-vmware-65u2.zip
Smoke tests completed. 89 look OK, 0 have errors
Only failed tests results shown below:

Test
Result
Time (s)
Test File

this work is split into PRs mentioning this above (#5470 and #5471) as the bits of work are divisable and might not both go in.


drop BINARY for case sensitivity, rely only on collation + charset

Here is the explanation for the bug being seen in a deployed service:
per https://stackoverflow.com/a/56283818/3068233

Using the binary operator is inadvisable because it compares the actual bytes of the encoded strings. If you compare the actual bytes of two strings encoded using the different character sets two strings that should be considered the same they may not be equal. For example if you have a column that uses the latin1 character set, and your server/session character set is utf8mb4, then when you compare the column with a string containing an accent such as 'café' it will not match rows containing that same string! This is because in latin1 é is encoded as the byte 0xE9 but in utf8 it is two bytes: 0xC3A9.

So, any time the connection has a different collation than the table BINARY will fail!
So, the only non-flaky way to enforce case sensitivity is by defining the column as case sensitive.

postgres is case sensitive by default, this is now a no-op


$(...).datetimepicker.setLocale is not a function

Hi~
I just copyed "jquery.datetimepicker.css" and "jquery.datetimepicker.full.min.js" to my WebStorm project. It goes well when I use "$('.reminder').datetimepicker" to initialize the datetimepicker widget with default settings. But, when I use "$('.reminder').datetimepicker.setLocale('zh');" to change the language from English to Chinese, the chrom browser show a exception as "Uncaught TypeError: $(...).datetimepicker.setLocale is not a function".
So, that's why? Could u help me? Did I miss anything when using datetimepicker plug-in? Are only one javascript file and one css file not enough?
Thanks a lot for sharing you project~

Job done. Use jQuery.datetimepicker.setLocale('zh') instead when changing default language.


enable workflow at organization level

#52

Thanks for the quick turnaround here @rohankh532! Looks good overall, will take another look next week. Please include documentation for the tool in this PR (things like how to use the tool, required scopes for the PAT etc.). Could add to README.md so that it's visible to users.

Without tests, it is hard to maintain things. For example that is the reason we are porting the shell script to go #87
We shouldn't merge these changes without tests and high code coverage.
That is one of the reasons I am blocking this change.

@naveensrinivasan do you have any suggestions on how to unit test this? Since the code is mostly API calls to GH, it's difficult to write unit tests for it.

Without tests, it is hard to maintain things. For example that is the reason we are porting the shell script to go #87
We shouldn't merge these changes without tests and high code coverage.
That is one of the reasons I am blocking this change.

@naveensrinivasan do you have any suggestions on how to unit test this? Since the code is mostly API calls to GH, it's difficult to write unit tests for it.

I agree unit tests could be hard for this. But we should be able to add e2e tests for this similar to https://github.com/ossf/scorecard/tree/main/e2e . This ensures that we haven't broken the functionality especially when there are lots of folks going to use this as a feature

Without tests, it is hard to maintain things. For example that is the reason we are porting the shell script to go #87
We shouldn't merge these changes without tests and high code coverage.
That is one of the reasons I am blocking this change.

@naveensrinivasan do you have any suggestions on how to unit test this? Since the code is mostly API calls to GH, it's difficult to write unit tests for it.

I agree unit tests could be hard for this. But we should be able to add e2e tests for this similar to https://github.com/ossf/scorecard/tree/main/e2e . This ensures that we haven't broken the functionality especially when there are lots of folks going to use this as a feature

Makes sense. Since that is a big chunk of work in itself, can we tackle that as part of a separate PR? Note that, this PR is just a v0 version of the tool, something to get the framework in place. It will get refined more as we go before we actually recommend this to users.

It could be a separate PR. But the issue is that no one takes the responsibility and it falls off the radar till things go wrong. That is the reason we should insist on tests for PRs.
Also writing tests make the code more manageable into functions instead of a giant main func.
Thoughts?

Thinking about this more - it won't be that easy writing e2e tests also for this. Every e2e test will end up creating a bunch of new PRs and unlike Scorecards, we won't have data that is being returned to verify against. I do genuinely think writing tests for this is far more complicated than what we want to take on in this initial PR. If you still have concerns, let's discuss this in the upcoming Scorecard sync.

Without tests, it is hard to maintain things. For example that is the reason we are porting the shell script to go #87
We shouldn't merge these changes without tests and high code coverage.
That is one of the reasons I am blocking this change.

@naveensrinivasan do you have any suggestions on how to unit test this? Since the code is mostly API calls to GH, it's difficult to write unit tests for it.

I agree unit tests could be hard for this. But we should be able to add e2e tests for this similar to https://github.com/ossf/scorecard/tree/main/e2e . This ensures that we haven't broken the functionality especially when there are lots of folks going to use this as a feature

Makes sense. Since that is a big chunk of work in itself, can we tackle that as part of a separate PR? Note that, this PR is just a v0 version of the tool, something to get the framework in place. It will get refined more as we go before we actually recommend this to users.

It could be a separate PR. But the issue is that no one takes the responsibility and it falls off the radar till things go wrong. That is the reason we should insist on tests for PRs.
Also writing tests make the code more manageable into functions instead of a giant main func.
Thoughts?

I looked into writing tests and there seems to be a good example here, but it still requires a live Github account to make the changes on. Another option used here is just writing endpoints to mimic github api calls, which works well for GET requests, but I'm not sure how that would work for POSTs where we want persistence after modifications. So overall testing this seems pretty difficult, but if there was a live test Github account then it would be much easier.

Without tests, it is hard to maintain things. For example that is the reason we are porting the shell script to go #87
We shouldn't merge these changes without tests and high code coverage.
That is one of the reasons I am blocking this change.

@naveensrinivasan do you have any suggestions on how to unit test this? Since the code is mostly API calls to GH, it's difficult to write unit tests for it.

I agree unit tests could be hard for this. But we should be able to add e2e tests for this similar to https://github.com/ossf/scorecard/tree/main/e2e . This ensures that we haven't broken the functionality especially when there are lots of folks going to use this as a feature

Makes sense. Since that is a big chunk of work in itself, can we tackle that as part of a separate PR? Note that, this PR is just a v0 version of the tool, something to get the framework in place. It will get refined more as we go before we actually recommend this to users.

It could be a separate PR. But the issue is that no one takes the responsibility and it falls off the radar till things go wrong. That is the reason we should insist on tests for PRs.
Also writing tests make the code more manageable into functions instead of a giant main func.
Thoughts?

I looked into writing tests and there seems to be a good example here, but it still requires a live Github account to make the changes on. Another option used here is just writing endpoints to mimic github api calls, which works well for GET requests, but I'm not sure how that would work for POSTs where we want persistence after modifications. So overall testing this seems pretty difficult, but if there was a live test Github account then it would be much easier.

I understand! Thanks for trying and appreciate it!

Ready for review. Issues to propagate to the next PR:

Automatically generate the default branch and randomize the schedule (link)
Add e2e integration tests
Run script as a docker image and allow users run and provide a PAT via CLI so the SCORECARD_READ_TOKEN secret can be automatically created at an org level (link)

@laurentsimon Is this good to be merged?


Updates API usage for Spaceship's new API

Spaceship's api changed Tunes::Tester::External.create

@hjanuschka I cherry-picked some of your commits, thank you! If you're cool with that, can you confirm with @googlebot?

Talked with @taquitos on Slack about merging this as is and revisiting the group selection. This would only be an issue for apps that are added to TestFlight after the changes last week.

@taquitos @googlebot  i am fine with cherry-picked commits.


switch to https://schema.org/version/latest/schema.rdf

Please make sure that you've checked the following before submitting your pull request. Thanks!

[x] Check that you pass the basic style checks and unit tests by running mvn clean install

@mr-c thanks!
is there a doc/issue/explanation for this change and will it apply to all CWL going forward?
when I get back to my desk, I'll need to cherry-pick this into dockstore branch to get access to build secrets

@denis-yuen They broke their website and we don't know when it'll be fixed https://github.com/schemaorg/schemaorg/issues/2593
Also, rdflib 5.0.0 no longer supports rdfa encoding.
We are working on fixes on the cwltool side to soften the dependency on schema providers like schema.org without having to use --skip-schemas: https://github.com/common-workflow-language/cwltool/issues/1300

re-created with access to build secrets at above link


#352 Resolved

Fixes Issue #352
Changes proposed
A Scroll Down button enables a user to scroll to the bottom of the page in one go. It works in the opposite way of Scroll Up button.
I have added a Scroll Down button in files: index.html, about.html, contact.html, services.html, icons.html, gallery.html and typography.html.
I have also styled it exactly like Scroll Up button using CSS properties.
Also, I used JavaScript to give it functionalities that enable a user to reach to the bottom of the page.
Screenshots

https://github.com/Anupkjha2601/food-recipes-website/assets/121788863/d399c653-15c2-4fde-b1de-1d7ce40a5d37

@Anupkjha2601 Please have a look into it.

@MahajanPreksha this pull request has some conflict , Can you please make a new pull request of this .


Allow input of rate to generate costs when producing CSV

As of now, the CSV generated only calculates the SU hours. As a user of the script, I want to provide the SU rate via a command-line parameter so that the CSV generated can automatically calculate the cost.

This works, or if you prefer you could also have a csv that houses the types and rates that you pull from. Whichever is easier.


Update DG for Appointment feature

Appointment feature documentation
Appointment use cases and user stories
Appointment manual testing

Closes #303, #302

LGTM


Cost card hero numbers should be smaller

The AWS and Azure overview have cards that show cost. The hero numbers in these cards should be the same size font.
When we updated the cost card, on the top of all overview pages, that inadvertently affected the style reused by the AWS and Azure overview cards that also show cost.
https://issues.redhat.com/browse/COST-605
Before

After

Thanks, Boaz! Merging now for QA to test


run: add region tag

for documentation

Hey @gottskalk, would you like to move forward with this PR?
cc @grayside


chore: wire up google analytics

Pull Request Test Coverage Report for Build 148498114

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 0.0%

Totals

Change from base Build 139339807:
0.0%

Covered Lines:
0

Relevant Lines:
0

💛  - Coveralls


[POST]  and  don't change

Hello, when I try to login into a site in the post i put
username=<USER>&password=<PASS>&g-recaptcha-response=<RECAPTCHA>
But the variables USER and PASS do not change
Post Data: sponsor=undefined&username=<USER>&password=<PASS>&g-recaptcha-response=03AOLTBLSRH...
i selected creditentials in the debugger.
Thanks :)

Solution found :
First of all open your OB folder, and then open the Settings folder.
In the settings folder you will find a file named "Environment.ini", if don't have one, open OB and go check again.
Open the file with a text editor, the first 5 lines you will see is, lets call it, a dictionary definition for variables in the Default combo configuration.
The fifth line is where we can see one of these variables, change the DATA into USER,PASS
Save it and open OB, it should now detect the   Variables when are used with the "Default" combo config.


Remove Banner in Git

The banner was removed on the servers.
The rm of the masthead needs to be removed in git otherwise we will see it next time we deploy

This fix has been put into production


Upgrade to latest sodar-core

Is your feature request related to a problem? Please describe.
We should upgrade to the latest and greatest sodar-core.
Describe the solution you'd like
Upgrade and make sure that everything works.
Describe alternatives you've considered
N/A
Additional context
N/A

I'm also trying to upgrade a number of dependency. This issue here upstream with aldjemy/SQLAlchemy appears to be a hard nut to crack:

https://github.com/aldjemy/aldjemy/issues/190

Some more things that I found out so far:

One could think of creating a context manager within which one perform the aldjemy queries. This context manager could set the json (de)serializer for the SQLAlchemy engine (which appears to push it through to the psycopg driver) when entering, then run the block within the context, and finally unset it again. However, this causes "interesting" behaviour for the new multithreaded development server in corner cases.
Using a second connection to the same database works except ... Django tests really don't like multiple database connections pointing to the same database. I found some old tickets in the Django issue tracker and they looked like anything attempts to fix it were abandoned.


Middleware

Be able to add middleware that can intercept any handlers before passing it on to its next handler
See http://expressjs.com/en/guide/writing-middleware.html for example

Definitely essential feature. I would propose that it should allow a default middleware stack and a customizable per route middleware stack override. This is one thing I always found frustrating about express. I would often write my own middleware that selectively applied others depending on the route.

I like your thoughts, I've currently got it set up similar to how express is working on the feature/middleware branch. Any proposals on how you think the interface should look for overriding the default stack on a particular route?

What about just something like this
app.defaultMiddlewares = [SomeMiddleWare(), SomeOtherMiddleWare(config)]

let alternateMiddleware = [AltMiddleWare()]

// Uses default
app.get("/") { request, response in
    response.send(text: "Hello World!")
}

// Uses alternate
app.get("/", alternateMiddleware) { request, response in
    response.send(text: "Hello World!")
}

I like it, I'll create another issue to add this in to the current model


TCP data Packet loss (IDFGH-6335)

Development Kit: ESP32-WROOM-32D (ESP32_DEVKITC_V4)
Kit version v4
Kit version N/A
Module or chip used: ESP32-WROOM-32D
IDF version ESP-IDF v4.4
Build System: CMake
Operating System: [Windows]
(Windows only) environment type: ESP Command Prompt
Using an IDE?: No
Power Supply: USB
Problem Description
I am using ESP Dev kit for testing wifi. i have used wifi and tcp examples and modified it a little to make it work for my project. I am missing about 20 out of 100 packets. i have attached wireshark and packetsender log. I have also attached sdkconfig file used for this project.
// If possible, attach a picture of your setup/wiring here.
Code to reproduce this issue
I am only sharing the tcp part of the code as other part is sensitive. My device connects to a wifi and then calls this function to send tcp data. for debug or testing purpose i am sending it in a loop.
static void tcp_client_task()
{
    char rx_buffer[128];
    char addr_str[128];
    int addr_family;
    int ip_protocol;
	char tcpPayload[1024]="HELLO, THIS IS A TEST MESSEGE";
	//printf("tcp payload\n%s",tcpPayload);
        struct sockaddr_in dest_addr;
        dest_addr.sin_addr.s_addr = inet_addr(serverip);
	    ESP_LOGI(TAG, "this is serverip  %u", dest_addr.sin_addr.s_addr);
        dest_addr.sin_family = AF_INET;
        dest_addr.sin_port = htons(serverPort);
        addr_family = AF_INET;
        ip_protocol = IPPROTO_IP;
        inet_ntoa_r(dest_addr.sin_addr, addr_str, sizeof(addr_str) - 1);

        int sock =  socket(addr_family, SOCK_STREAM, ip_protocol);
        if (sock < 0) {
            ESP_LOGE(TAG, "Unable to create socket: errno %d", errno);
            //break;
        }
        //ESP_LOGI(TAG, "Socket created, connecting to %s:%d", serverIP, serverPort);

        int err = connect(sock, (struct sockaddr *)&dest_addr, sizeof(dest_addr));
        if (err != 0) {
            ESP_LOGE(TAG, "Socket unable to connect: errno %d", errno);
            //break;
        }
        ESP_LOGI(TAG, "Successfully connected");
            int XY = send(sock, tcpPayload, strlen(tcpPayload), 0);
            if (XY < 0) {
                ESP_LOGE(TAG, "Error occurred during sending: errno %d", errno);
            }

        if (sock != -1) {
            ESP_LOGE(TAG, "Shutting down socket and restarting...");
            shutdown(sock, 0);
            close(sock);
        }
[missed packets packetsender.log](https://github.com/espressif/esp-idf/files/7638132/missed.packets.packetsender.log)
![sinppet2wireshark](https://user-images.githubusercontent.com/81243896/144340128-6af09a77-2f98-48ed-8810-51e6d7cbb9aa.png)
![snippet1wireshark](https://user-images.githubusercontent.com/81243896/144340135-7073dd4c-ba87-4b3e-aea2-d81d71449711.png)
![snippet3wireshark](https://user-images.githubusercontent.com/81243896/144340137-5cd08862-fad2-46ee-b5a1-7a348906aeb8.png)
![snippet4wireshark](https://user-images.githubusercontent.com/81243896/144340140-f5397fcc-769e-4e27-8ef2-2e3b002bc87f.png)
[sdkconfig.txt](https://github.com/espressif/esp-idf/files/7638170/sdkconfig.txt)
}

Wifi is turned off when tcp packet is sent and turned on back again after a 1 second delay and again a packet is sent.

Wifi is turned off when tcp packet is sent

Maybe the packet does not always finish transmission before you turn off WiFi?

yeah, actually just finished further testing and found out that i was shutting down wifi straight after sending the packet. i think even though it is a blocking tcp transmission if you send the tcp packet and straight away shutdown wifi, sometimes it doesnt send packet. i am assuming data packet might still be getting processed on hardware level. Even if it fails to send the data packet, is not a issue because it can be handled but esp-32 doesnt give you a transmission error.

hi @omairakash
The mechanism of TCP sending data is as follows：
1 TCP has a corresponding sending window. When the application layer transmits data to LwIP, it will first fill in the sending window. Every time TCP successfully sends a data, it will receive an ACK. If an ACK is not received, the corresponding sending window will not move
2  When WiFi is disconnected, the data that has not been sent will be placed in the send window.
The solution to your problem is as follows：
1 When the WiFi is disconnected, a disconnect event will be received. In the event, close the socket.

Adding a delay of 50 ms for shutting down  WiFi after closing the TCP socket, fixed my problem. So, i guess if you are using TCP sockets and want to turn off WiFi immediately after sending, you have to wait for suitable time. That way data packets are not lost because wifi had shutdown before sending. & as suggested by @xueyunfei998,  it would be good practice. to close the socket after WiFi disconnect event.

Thanks for reporting and sharing the updates, feel free to reopen.


Factor out etcdWatcher and rename methods in StorageInterface

Ref #10475
Follow-up from #11666

Nit then lgtm

@derekwaynecarr - since you already reviewed it - can you please apply LGTM label?

@wojtek-t - done

@derekwaynecarr - great - thanks!


[WIP] NIMBUS-280: UI Date refactor

Description
THIS IS A WIP
Fixes #585
Overview of Changes
N/A
Type of Change

[ ] New feature
[X] Bug fix
[ ] Refactor/Technical Debt
[ ] Documentation Update
[ ] Test case change
[ ] This change requires a documentation update
[ ] Other

Test Details
N/A
Additional Notes
N/A

You did it @lopezton-anthem!
Thank you for signing the Anthem Opensource Software CLA.

The changes introduced at the time of this comment ensure the browser is serializing the javascript date to the UTC ISO formatted date/time string in form: "YYYY-MM-DDThh:mm:ss:xxxZ" for Date, LocalDate, and LocalDateTime.
There is still something wrong when handling LocalDate updates from the UI. I'm not sure if the issue is due to a logic error when deserializing to LocalDate on the server or if I'm sending the data from the UI incorrectly.


planning sometimes fails when using RRT* for parking

Checklist

[X] I've read the contribution guidelines.
[X] I've searched other issues and no duplicate issues were found.
[X] I'm convinced that this is not my fault but a bug.

Description
planning fails when driving in parking lots with rrtstar algorithm in the freespace_planner.
The solved trajectory by the freespace_planner is visualized as in the picture below, but the output from the motion_velocity_smoother is not visualized.

Attach the terminal output for further information.

Expected behavior
arrive at a goal with rrtstar algorithm in parking scenario.
Actual behavior
planning fails and it won't arrive at a goal
Steps to reproduce

change the default param in freespace_planner from astar to rrtstar
set a goal to in the parking lot and run in the parking scenario

Versions
No response
Possible causes
No response
Additional context
No response

no one is assigned now

I test the "rrtstar" in the parking.The  path display planning is successful, but the trajectory of motion_velocity_smoother display wrong is in the process of control. Simulation of the video as follows:

https://user-images.githubusercontent.com/102840938/201040744-436d0277-f2e3-4782-9256-b000b19c9f85.mp4


I made a compatible "Random" of the C# in TypeCrsipt

Hi Yuu,
I wonder if we can generate an identical result with MarkovJunior C#.
So I translated the C# (or dotnet) random function into TypeScript.
After a week stabilizing, I got the perfect result.
That was a good news, right? I think so.
THe bad news is, I did it in very old commit of your MarkovJuniorWeb: while it has no webassembly at all.
So here I send you only file that declare the random function.
(if you want to try, here is my working branch)
Okay, here is the file: https://github.com/x2nie/MarkovJuniorWeb/blob/x2nie-nowasm2/src/random.ts

Oh, I forgot to mention.. How I am sure that it will generates an identical result?
answer: by allow user to manually input the seed.
So, let say we give the MarkovJuniorC# : <model name="BasicKey" seed="1234567" />
then we input that same seed into the MarkovJunioWeb.
That is just that is that.

Feel free to just PR this, I can't care less about naming conventions 😂

Yeah, I made a PR: #7

Yeah, I just made that !
#7


Conda installation?

I run a computational biology lab, and I'd love to recommend difftastic to my lab members, but the installation process isn't as straightforward as I'd like.
For instance, running https://github.com/Wilfred/difftastic/releases/download/0.51.1/difft-x86_64-unknown-linux-gnu.tar.gz gives the error:
$ ./difft
./difft: /lib64/libstdc++.so.6: version `CXXABI_1.3.9' not found (required by ./difft)
./difft: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.21' not found (required by ./difft)
./difft: /lib64/libc.so.6: version `GLIBC_2.28' not found (required by ./difft)
./difft: /lib64/libc.so.6: version `GLIBC_2.18' not found (required by ./difft)
./difft: /lib64/libc.so.6: version `GLIBC_2.25' not found (required by ./difft)
./difft: /lib64/libc.so.6: version `GLIBC_2.29' not found (required by ./difft)

Would it be straightforward to package up difftastic as a conda-installable package? I'd easily recommend it then, it seems marvellous!

I'm not a Conda user I'm afraid, so it's not something I'm interested in doing myself.
That specific error typically means that you're on an older Linux version with a version of glibc that's too old. The musl build should work once #563 is fixed though.

I'm on a compute cluster with glibc 2.17 from 2012 and no musl, so I guess I'd have to use the cargo install --locked difftastic route.

Please reconsider providing a package for difftastic on conda-forge.


Update translations for 4.1.4

Hello translators! Spyder version 4.1.4 is soon to be released and we'd like to ask for your help to update your respective translations.
We plan to do this release on Tuesday, so it'd be great if you could help us with that by July 7th 10:00 pm UTC at most. It's ok if you cannot make it on time, we can release your updates on a future version.
French
@afvincent
@jnsebgosselin
Japanese
@sohnishi
Portuguese (Brazilian)
@sehnem
@manipuladordedados
Russian
@burrbull
@Qlogin
Spanish
@ccordoba12
@juanis2112
Simplified Chinese
@suokunlong
@kingmo888
@nnnewb
@gepcel
German
@alexschw
@be-we
@bnavigator
Best and thanks again!

Will do.


Don't do assistive MathML when the output renderer is PlainSource.  #1497

Don't do assistive MathML when the output renderer is PlainSource.  Resolves issue #1497.

LGTM.


Use built-in overload of UseSerilog to configure the logger

Small optimization of the uber-sample.

Clean!


Error when trying to evaluate a new dataset: CUDNN_STATUS_BAD_PARAM

Hi, thanks for releasing this code.
I want to evaluate SoundNet with another dataset.
I have created text files for training and testing that contain a column for the full path to the WAV files and another column for their class. All the audio files are the same length.
I have modified the eval_dcase.lua script to read these text files and expect the duration of the files.
When I run it, I get the following error:
/home/jdieza15/torch/install/bin/luajit: /home/jdieza15/torch/install/share/lua/5.1/nn/Container.lua:67:
In 25 module of nn.Sequential:
In 1 module of nn.ConcatTable:
/home/jdieza15/torch/install/share/lua/5.1/cudnn/init.lua:162: Error in CuDNN: CUDNN_STATUS_BAD_PARAM (cudnnGetConvolutionNdForwardOutputDim)
stack traceback:
	[C]: in function 'error'
	/home/jdieza15/torch/install/share/lua/5.1/cudnn/init.lua:162: in function 'errcheck'
	...torch/install/share/lua/5.1/cudnn/SpatialConvolution.lua:140: in function 'createIODescriptors'
	...torch/install/share/lua/5.1/cudnn/SpatialConvolution.lua:188: in function <...torch/install/share/lua/5.1/cudnn/SpatialConvolution.lua:186>
	[C]: in function 'xpcall'
	/home/jdieza15/torch/install/share/lua/5.1/nn/Container.lua:63: in function 'rethrowErrors'
	.../jdieza15/torch/install/share/lua/5.1/nn/ConcatTable.lua:11: in function <.../jdieza15/torch/install/share/lua/5.1/nn/ConcatTable.lua:9>
	[C]: in function 'xpcall'
	/home/jdieza15/torch/install/share/lua/5.1/nn/Container.lua:63: in function 'rethrowErrors'
	...e/jdieza15/torch/install/share/lua/5.1/nn/Sequential.lua:44: in function 'forward'
	eval_urbansound8k.lua:64: in function 'read_dataset'
	eval_urbansound8k.lua:115: in main chunk
	[C]: in function 'dofile'
	...za15/torch/install/lib/luarocks/rocks/trepl/scm-1/bin/th:150: in main chunk
	[C]: at 0x00405d50

WARNING: If you see a stack trace below, it doesn't point to the place where this error occurred. Please use only the one above.
stack traceback:
	[C]: in function 'error'
	/home/jdieza15/torch/install/share/lua/5.1/nn/Container.lua:67: in function 'rethrowErrors'
	...e/jdieza15/torch/install/share/lua/5.1/nn/Sequential.lua:44: in function 'forward'
	eval_urbansound8k.lua:64: in function 'read_dataset'
	eval_urbansound8k.lua:115: in main chunk
	[C]: in function 'dofile'
	...za15/torch/install/lib/luarocks/rocks/trepl/scm-1/bin/th:150: in main chunk
	[C]: at 0x00405d50

This is the code in line 64:
net:forward(snd:view(1,1,-1,1):cuda())
I never used lua before, so I do not know how to interpret this error. Is it related to my installation of CuDNN or I am doing something wrong when running the code?
Thanks

How long is the waveform you are using as input? I think it might be too small, and this error is complaining that the dimensionality of the hidden units are too small at this point in the network (likely becoming 0).

The waveforms are 4 seconds long

As a quick work around, try repeating it a few times. I think the SoundNet model we release requires at least a 5 second input.

Okay, I will do that. Thank you very much!
Do you think it would make a difference if, instead of repeating the audio, I center it around zeros to a certain duration?

I have repeated the audio files up to 10 seconds, but now I get the error Contiguous.lua:4: attempt to index local 'input' (a nil value).
See the full stack trace:
/home/jdieza15/torch/install/bin/luajit: /home/jdieza15/torch/install/share/lua/5.1/nn/Container.lua:67:
In 28 module of nn.Sequential:
In 3 module of nn.ParallelTable:
In 1 module of nn.Sequential:
...e/jdieza15/torch/install/share/lua/5.1/nn/Contiguous.lua:4: attempt to index local 'input' (a nil value)
stack traceback:
        ...e/jdieza15/torch/install/share/lua/5.1/nn/Contiguous.lua:4: in function <...e/jdieza15/torch/install/share/lua/5.1/nn/Contiguous.lua:3>
        [C]: in function 'xpcall'
        /home/jdieza15/torch/install/share/lua/5.1/nn/Container.lua:63: in function 'rethrowErrors'
        ...e/jdieza15/torch/install/share/lua/5.1/nn/Sequential.lua:44: in function <...e/jdieza15/torch/install/share/lua/5.1/nn/Sequential.lua:41>
        [C]: in function 'xpcall'
        /home/jdieza15/torch/install/share/lua/5.1/nn/Container.lua:63: in function 'rethrowErrors'
        ...dieza15/torch/install/share/lua/5.1/nn/ParallelTable.lua:12: in function <...dieza15/torch/install/share/lua/5.1/nn/ParallelTable.lua:10>
        [C]: in function 'xpcall'
        /home/jdieza15/torch/install/share/lua/5.1/nn/Container.lua:63: in function 'rethrowErrors'
        ...e/jdieza15/torch/install/share/lua/5.1/nn/Sequential.lua:44: in function 'forward'
        eval_urbansound8k.lua:64: in function 'read_dataset'
        eval_urbansound8k.lua:115: in main chunk
        [C]: in function 'dofile'
        ...za15/torch/install/lib/luarocks/rocks/trepl/scm-1/bin/th:150: in main chunk
        [C]: at 0x00405d50

WARNING: If you see a stack trace below, it doesn't point to the place where this error occurred. Please use only the one above.
stack traceback:
        [C]: in function 'error'
        /home/jdieza15/torch/install/share/lua/5.1/nn/Container.lua:67: in function 'rethrowErrors'
        ...e/jdieza15/torch/install/share/lua/5.1/nn/Sequential.lua:44: in function 'forward'
        eval_urbansound8k.lua:64: in function 'read_dataset'
        eval_urbansound8k.lua:115: in main chunk
        [C]: in function 'dofile'
        ...za15/torch/install/lib/luarocks/rocks/trepl/scm-1/bin/th:150: in main chunk
        [C]: at 0x00405d50

Any help is very appreciated

Is the problem solved yet? I'm having the same issues here. Many thanks!

Hi.. I am also having the same problem. Any update?


try removing the new xms and xms flags to see if that helps kubernetes-model build

see https://github.com/fabric8io/kubernetes-model/pull/232

[merge]


Use display: none to hide search when not searching

Purpose
As far as I know, display: none is the proper way to completely remove an element, which is what we want to do here with the search. It doesn't leave space for the element unlike visibility: hidden. Currently, there are visibility: hidden, transform: scale(0), and z-index: -99. I guess all of these are for compatibility so I didn't remove them.

What is the problem that you are attempting to solve?
Please include screenshots showing before/after to help reviewers.

There are no visual differences. It's just that display: none seems to be the more correct way to completely hide an element.

Closing as this PR is not solving any issue on the roadmap and I recall some of the JS libraries rely on these styles. We have much higher priorities on the roadmap that users would appreciate contributions for: https://github.com/wowchemy/wowchemy-hugo-modules/issues?q=is%3Aissue+is%3Aopen+label%3Aenhancement


Update sites.yml

Scan: https://radar.cloudflare.com/scan/dbc9aec3-ba2e-4bfb-afae-1c88280e906c/summary

This PR is:

[X] Adding a new domain
[ ] Updating existing domain size
[ ] Changing domain name
[ ] Removing existing domain from list
[ ] Website code changes (512kb.club site)
[ ] Other not listed

[X] I used the uncompressed size of the site
[X] I have included a link to the Cloudflare report
[X] This site is not an ultra minimal site
[X] The following information is filled identical to the data file

I confirm that I have read the FAQ section, particularly the two red items around minimal pages and inappropriate content and I attest that this site is neither of these things.

[X] Check to confirm

- domain:
  url:
  size:
  last_checked:

Cloudflare Report: https://radar.cloudflare.com/scan/dbc9aec3-ba2e-4bfb-afae-1c88280e906c/summary

Cool idea. Thanks!


Browser Agent Errors for Passing Strings Instead of Objects in NREUM

This customer had a deploy that changes their NREUM.loader_config and NREUM.info into strings, which caused the Browser agent to not load or report data properly. We expect these values to be passed as objects, but it took weeks to figure out that they had been wrapped with quotes.
If the Browser agent could throw an error when these values are not passed as an object, troubleshooting this issue would be a lot quicker.

Feature Request for messaging in console when the agent fails. Consider adding this in the diagnostic version of the agent.


UnicodeDecodeError: 'utf-8' codec can't decode bytes in position 0-1: invalid continuation byte

Hi! I am trying to train a TTS model for Persian language. I followed the instructions you posted on the main page (README). However I get this error and I can't fix it. In my opinion, these errors are related to the encoding format of the json files that are created in the "pytorch_dump_folder_path" folder.
I tried to convert all of them to utf-8 encoding format, but because some of them contain ascii characters, they remained in the same ascii encoding format. In my research, I kept coming across this sentence that said:

Since ASCII is a subset of UTF-8, these files don't require conversion because they are already compatible with UTF-8.
These ascii encoded json files are: config.json, tokenizer_config.json, preprocessor_config.json, added_tokens.json

Of course, I'm not sure if the errors I'm getting are necessarily related to this issue or not, but anyway, I'd be happy if you could help.
Traceback (most recent call last):
  File "/home/user1/.pyenv/versions/3.10.0/lib/python3.10/site-packages/transformers/configuration_utils.py", line 719, in _get_config_dict
    config_dict = cls._dict_from_json_file(resolved_config_file)
  File "/home/user1/.pyenv/versions/3.10.0/lib/python3.10/site-packages/transformers/configuration_utils.py", line 817, in _dict_from_json_file
    text = reader.read()
  File "/home/user1/.pyenv/versions/3.10.0/lib/python3.10/codecs.py", line 322, in decode
    (result, consumed) = self._buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'utf-8' codec can't decode bytes in position 0-1: invalid continuation byte

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/user1/finetune-hf-vits/run_vits_finetuning.py", line 1491, in <module>
    main()
  File "/home/user1/finetune-hf-vits/run_vits_finetuning.py", line 635, in main
    config = VitsConfig.from_pretrained(
  File "/home/user1/.pyenv/versions/3.10.0/lib/python3.10/site-packages/transformers/configuration_utils.py", line 605, in from_pretrained
    config_dict, kwargs = cls.get_config_dict(pretrained_model_name_or_path, **kwargs)
  File "/home/user1/.pyenv/versions/3.10.0/lib/python3.10/site-packages/transformers/configuration_utils.py", line 634, in get_config_dict
    config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
  File "/home/user1/.pyenv/versions/3.10.0/lib/python3.10/site-packages/transformers/configuration_utils.py", line 722, in _get_config_dict
    raise EnvironmentError(
OSError: It looks like the config file at '/home/user1/finetune-hf-vits/torch_files/model.safetensors' is not a valid JSON file.
Traceback (most recent call last):
  File "/home/user1/.pyenv/versions/3.10.0/lib/python3.10/site-packages/transformers/configuration_utils.py", line 719, in _get_config_dict
    config_dict = cls._dict_from_json_file(resolved_config_file)
  File "/home/user1/.pyenv/versions/3.10.0/lib/python3.10/site-packages/transformers/configuration_utils.py", line 817, in _dict_from_json_file
    text = reader.read()
  File "/home/user1/.pyenv/versions/3.10.0/lib/python3.10/codecs.py", line 322, in decode
    (result, consumed) = self._buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'utf-8' codec can't decode bytes in position 0-1: invalid continuation byte

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/user1/finetune-hf-vits/run_vits_finetuning.py", line 1491, in <module>
    main()
  File "/home/user1/finetune-hf-vits/run_vits_finetuning.py", line 635, in main
    config = VitsConfig.from_pretrained(
  File "/home/user1/.pyenv/versions/3.10.0/lib/python3.10/site-packages/transformers/configuration_utils.py", line 605, in from_pretrained
    config_dict, kwargs = cls.get_config_dict(pretrained_model_name_or_path, **kwargs)
  File "/home/user1/.pyenv/versions/3.10.0/lib/python3.10/site-packages/transformers/configuration_utils.py", line 634, in get_config_dict
    config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
  File "/home/user1/.pyenv/versions/3.10.0/lib/python3.10/site-packages/transformers/configuration_utils.py", line 722, in _get_config_dict
    raise EnvironmentError(
OSError: It looks like the config file at '/home/user1/finetune-hf-vits/torch_files/model.safetensors' is not a valid JSON file.```

Hey @VafaKnm, could you send me the script/config you're using ?
From what I understand, your torch_files doesn't have a config.json. What steps did you follow here?

Here is the steps i followed:

Clone the repository and install requirements
Build the monotonic alignment search function
since I use Ubuntu 22.04:

# Install dependencies
sudo apt-get install festival espeak-ng mbrola
# Install phonemizer
pip install phonemizer

clone and install uroman:

git clone https://github.com/isi-nlp/uroman.git
cd uroman
export UROMAN=$(pwd)

since there is no training checkpoint available for my language (Persian):

cd <path-to-finetune-hf-vits-repo>
python convert_original_discriminator_checkpoint.py --language_code fas --pytorch_dump_folder_path finetune-hf-vits/torch_files

run the code for training:

accelerate launch run_vits_finetuning.py /finetune-hf-vits/persian_tts_train_conf.json

this is the "persian_tts_train_conf.json" parameters:
{
    "project_name": "mms_persion_finetuning",
    "push_to_hub": false,
    "report_to": ["tensorboard"],
    "overwrite_output_dir": true,
    "output_dir": "/home/user1/finetune-hf-vits/output_models",

    "dataset_name": "/home/user1/finetune-hf-vits/TTS_data/new_data_version/farshad_tts_ds",
    "dataset_config_name": "male",
    "audio_column_name": "audio",
    "text_column_name":"text",
    "train_split_name": "/home/user1/finetune-hf-vits/TTS_data/new_data_version/farshad_tts_train_ds",
    "eval_split_name": "/home/user1/finetune-hf-vits/TTS_data/new_data_version/farshad_tts_val_ds",
    "speaker_id_column_name": "speaker_id",
    "override_speaker_embeddings": true,
    "filter_on_speaker_id": 1,

    "full_generation_sample_text": "سلام این یک جمله به زبان فارسی است",

    "max_duration_in_seconds": 40.709,
    "min_duration_in_seconds": 0.019,
    "max_tokens_length": 879,

    "model_name_or_path": "/home/user1/finetune-hf-vits/torch_files/model.safetensors",

    "preprocessing_num_workers": 2,

    "do_train": true,
    "num_train_epochs": 200,
    "gradient_accumulation_steps": 1,
    "gradient_checkpointing": false,
    "per_device_train_batch_size": 16,
    "learning_rate": 2e-5,
    "adam_beta1": 0.8,
    "adam_beta2": 0.99,
    "warmup_ratio": 0.01,
    "group_by_length": false,

    "do_eval": true,
    "eval_steps": 50,
    "per_device_eval_batch_size": 16,
    "max_eval_samples": 25,
    "do_step_schedule_per_epoch": true,

    "weight_disc": 3,
    "weight_fmaps": 1,
    "weight_gen": 1,
    "weight_kl": 1.5,
    "weight_duration": 1,
    "weight_mel": 35,

    "fp16": true,
    "seed": 456
}

json files inside the pytorch_dump_folder_path folder that were created:

added_tokens.json

{
  "<unk>": 44
}

config.json

{
  "activation_dropout": 0.1,
  "architectures": [
    "VitsModelForPreTraining"
  ],
  "attention_dropout": 0.1,
  "depth_separable_channels": 2,
  "depth_separable_num_layers": 3,
  "discriminator_kernel_size": 5,
  "discriminator_period_channels": [
    1,
    32,
    128,
    512,
    1024
  ],
  "discriminator_periods": [
    2,
    3,
    5,
    7,
    11
  ],
  "discriminator_scale_channels": [
    1,
    16,
    64,
    256,
    1024
  ],
  "discriminator_stride": 3,
  "duration_predictor_dropout": 0.5,
  "duration_predictor_filter_channels": 256,
  "duration_predictor_flow_bins": 10,
  "duration_predictor_kernel_size": 3,
  "duration_predictor_num_flows": 4,
  "duration_predictor_tail_bound": 5.0,
  "ffn_dim": 768,
  "ffn_kernel_size": 3,
  "flow_size": 192,
  "hidden_act": "relu",
  "hidden_dropout": 0.1,
  "hidden_size": 192,
  "hop_length": 256,
  "initializer_range": 0.02,
  "layer_norm_eps": 1e-05,
  "layerdrop": 0.1,
  "leaky_relu_slope": 0.1,
  "model_type": "vits",
  "noise_scale": 0.667,
  "noise_scale_duration": 0.8,
  "num_attention_heads": 2,
  "num_hidden_layers": 6,
  "num_speakers": 1,
  "posterior_encoder_num_wavenet_layers": 16,
  "prior_encoder_num_flows": 4,
  "prior_encoder_num_wavenet_layers": 4,
  "resblock_dilation_sizes": [
    [
      1,
      3,
      5
    ],
    [
      1,
      3,
      5
    ],
    [
      1,
      3,
      5
    ]
  ],
  "resblock_kernel_sizes": [
    3,
    7,
    11
  ],
  "sampling_rate": 16000,
  "segment_size": 8192,
  "speaker_embedding_size": 0,
  "speaking_rate": 1.0,
  "spectrogram_bins": 513,
  "torch_dtype": "float32",
  "transformers_version": "4.37.2",
  "upsample_initial_channel": 512,
  "upsample_kernel_sizes": [
    16,
    16,
    4,
    4
  ],
  "upsample_rates": [
    8,
    8,
    2,
    2
  ],
  "use_bias": true,
  "use_stochastic_duration_prediction": true,
  "vocab_size": 44,
  "wavenet_dilation_rate": 1,
  "wavenet_dropout": 0.0,
  "wavenet_kernel_size": 5,
  "window_size": 4
}

preprocessor_config.json

{
  "feature_extractor_type": "VitsFeatureExtractor",
  "feature_size": 80,
  "hop_length": 256,
  "max_wav_value": 32768.0,
  "n_fft": 1024,
  "padding_side": "right",
  "padding_value": 0.0,
  "return_attention_mask": false,
  "sampling_rate": 16000
}

special_tokens_map.json

{
  "pad_token": "Ù„",
  "unk_token": "<unk>"
}

tokenizer_config.json

{
  "add_blank": true,
  "added_tokens_decoder": {
    "0": {
      "content": "\u0644",
      "lstrip": false,
      "normalized": false,
      "rstrip": false,
      "single_word": false,
      "special": true
    },
    "44": {
      "content": "<unk>",
      "lstrip": false,
      "normalized": false,
      "rstrip": false,
      "single_word": false,
      "special": true
    }
  },
  "clean_up_tokenization_spaces": true,
  "is_uroman": true,
  "language": "fas",
  "model_max_length":<PHONE_NUMBER>000000019884624838656,
  "normalize": true,
  "pad_token": "\u0644",
  "phonemize": false,
  "tokenizer_class": "VitsTokenizer",
  "unk_token": "<unk>",
  "verbose": false
}

vocab.json

{
  " ": 30,
  "'": 40,
  "-": 35,
  "_": 6,
  "ء": 14,
  "آ": 34,
  "أ": 3,
  "ؤ": 36,
  "ئ": 4,
  "ا": 41,
  "ب": 26,
  "ت": 25,
  "ث": 20,
  "ج": 8,
  "ح": 18,
  "خ": 32,
  "د": 28,
  "ذ": 5,
  "ر": 9,
  "ز": 43,
  "س": 39,
  "ش": 31,
  "ص": 16,
  "ض": 42,
  "ط": 19,
  "ظ": 24,
  "ع": 2,
  "غ": 29,
  "ف": 11,
  "ق": 17,
  "ك": 7,
  "ل": 0,
  "م": 23,
  "ن": 22,
  "ه": 10,
  "و": 27,
  "ي": 13,
  "ٔ": 21,
  "پ": 1,
  "چ": 37,
  "ژ": 38,
  "ک": 33,
  "گ": 12,
  "ی": 15
}

Among these json files, added_tokens.json, config.json and preprocessor_config.json files are in ascii format while rest of them are in utf-8 format.

Update
The error raised because of wrong setting of "model_name_or_path" parameter in the "persian_tts_train_conf.json" file. the value of "model_name_or_path" must be a repo name or its path. for my language, Persian (Farsi), it is "facebook/mms-tts-fas".
So, I create model folder which contains model itself and relevant json files in the "pytorch_dump_folder_path" using repo name with this command:
python convert_original_discriminator_checkpoint.py --language_code fas --pytorch_dump_folder_path ./facebook/mms-tts-fas

also, i add "uroman_path" to "persian_tts_train_conf.json" and set "is_uroman" parameter of "tokenizer_config.json" file to True according to my language.


Add "alphabet" argument to toString()

Coverage remained the same at 94.217% when pulling 2077aeaa440d871be5118359295d9d519125d091 on pashinin:master into 790436fb2498a5225a4b32db39e7dbf879cd4072 on peterolson:master.

Looks good to me, thanks!


Create a new wiki and improve documentation

Could we adopt the same model as CAS does? and move docs to source control directly?

Yes, of course! What you did for CAS is my model here ;-) I'm currently moving the Github wiki into the Gihub pages: https://github.com/pac4j/pac4j/tree/gh-pages/wiki with Jekyll generation, then I'll add automatic Jekyll build and finally move the docs in the pac4j project with copy to the Github pages during the build.

Very cool. If I can help, let me know plz.

Writing a great documentation is a tremendous work and I realize the current documentation is way too light for all the capabilities pac4j offers. It's going to be easier when the documentation will be directly available in the pac4j project.

The essential has been done, various improvements will follow when opportunities arise.


Proposal: Add custom or optional tag to transcript format

I was looking to the JSON transcript format here mentioned.
{
  "version": "1.0.0",
  "segments": [
    {
      "speaker": "Darth Vader",
      "startTime": 0.5,
      "endTime": 0.75,
      "body": "I"
    },
    {
      "speaker": "Darth Vader",
      "startTime": 1,
      "endTime": 1.25,
      "body": "am"
    },
    {
      "speaker": "Darth Vader",
      "startTime": 1.5,
      "endTime": 2.0,
      "body": "your"
    },
    {
      "speaker": "Darth Vader",
      "startTime": 2.25,
      "endTime": 2.50,
      "body": "father."
    },
    {
      "speaker": "Luke",
      "startTime": 2.75,
      "endTime": 3.0,
      "body": "Nooooo"
    }
  ]
}

Is it possible to add custom/optional fields at the same level of version? Or maybe is there a sort of other/notes field where we can add miscellaneous information?

Any update on that?

@theDanielJLewis The idea is to save a field to figure out where the transcript is coming from.
So the name could be source or similar and the value should be a string.

You can probably add whatever additional fields you want. But what do you want that information to do, and how will it benefit anyone, especially the audience?

Hi, Paul. There is a proposal to add the quality/generator of transcript - whether it's entirely automated or if it has gone through some form of human editorial review - at #421
(I complicated it by also adding opt-out requests. I should split the proposal into two.)
This benefits the listener by making it clear when a transcript is the product of automation, or whether it can be 100% relied on after going through a human being. I would expect this to be visible in the UX in some way. Is this what you would be wanting to do? (In my mind, this information should be in the signpost to the transcript - ie the link in the RSS - rather than in the transcript itself; you can't add that kind of metadata into SRT/VTT files as I understand it.)
I'm not sure of the use-case to explain whether the transcript came from WhisperAI/Rev/Descript though: very open to it, but let us know.


Add api tests for deleting link password

Test scenarios to add

only Admin and Space Admin can remove the password in read-only public link https://github.com/owncloud/ocis/pull/7540
all users can remove their password if set the permission 0 (invite people) https://github.com/owncloud/ocis/pull/7894

Related Bugs

https://github.com/owncloud/ocis/issues/7821

Related PRs for the test coverage has been merged. So closing this issue.


/glade/scratch

Describe the bug
The /glade/scratch partition is not available and at least one of the notebooks points there.
To Reproduce
cupid-run config.yml
Expected behavior
The following message:
PermissionError: [Errno 13] Permission denied: '/glade/scratch'
ploomber.exceptions.TaskBuildError: Error when executing task 'ocean_surface'. Partially executed notebook available at /glade/u/home/dbailey/CUPiD/examples/coupled_model/computed_notebooks/quick-run/ocean_surface.ipynb
ploomber.exceptions.TaskBuildError: Error building task "ocean_surface"
===================================================== Summary (1 task) =====================================================
NotebookRunner: ocean_surface -> File('computed_notebook...cean_surface.ipynb')
===================================================== DAG build failed =====================================================
Additional context
There are a number of paths hard coded to /glade/scratch in mom-tools.

I think the issue is that mom6-tools uses ncar-jobqueue, and the default configuration for that package points to /glade/scratch/. Do you have a ~/.config/dask/ncar-jobqueue.yaml file on glade? If so, there's probably a block like
casper-dav:
  pbs:
    #    project: XXXXXXXX
    name: dask-worker-casper-dav
    cores: 1 # Total number of cores per job
    memory: '10GB' # Total amount of memory per job
    processes: 1 # Number of Python processes per job
    interface: ext
    walltime: '01:00:00'
    resource-spec: select=1:ncpus=1:mem=25GB
    queue: casper
    log-directory: '/glade/derecho/scratch/${USER}/dask/casper-dav/logs'
    local-directory: '/glade/derecho/scratch/${USER}/dask/casper-dav/local-dir'
    job-extra: []
    env-extra: []
    death-timeout: 60

Where I've already updated log-directory and local-directory to use /glade/derecho/scratch but your version may specify /glade/scratch instead. Another place to look is ~/.dask/jobqueue.yaml, where the block is
jobqueue:
  pbs:
    cores: 1
    interface: ext
    job-extra: []
    local-directory: /glade/derecho/scratch/mlevy
    log-directory: /glade/derecho/scratch/mlevy
    memory: 10GiB
    name: dask-worker
    processes: 1
    queue: regular
    resource-spec: select=1:ncpus=1:mem=10GB
    walltime: 01:00:00

and again, I've updated log-directory and local-directory.

Got it. Should I just wipe out that whole directory? When did it get created?

(while you're at it, make sure interface is ext instead of ib0)

There is no setting for derecho in these files and there is still a hobart setting. How does it get created? We should wipe this directory out and make sure everyone gets a fresh version.

I'm not sure how it gets created, hence my reluctance to remove it :) I noticed the lack of derecho settings, but CUPiD runs fine on derecho so I don't think it's an issue. Instead of outright deleting it, can you rename it and see if it's recreated (or if CUPiD runs without it)?

Interesting. I deleted the ~/.config/dask directory and it got recreated when I reran the cupid-run. Or more accurately, I also wiped out the computed notebooks and then it recreated this. The ncar-jobqueue.yml file is out of date. This must be coming from a CISL file somewhere.


'charmap' codec can't encode character... error when using .write_report()

Expected Behavior
Assessment report is written to html file using utf-8 encoding for export into Credo AI Governance Tool.
Actual Behavior
When I initially ran my report, after the report was shown in the jupyter notebook, I gott a 'charmap' codec can't encode character '\ue6c6' in position 237531: character maps to  error (image attached).
From my research and spot checking of the code I found that while Python 3.7+ default encoding is 'utf-8' most legacy windows systems default encoding is  cp1252 and this is inherited by python as the default encoding and used when the open function is run (https://stackoverflow.com/questions/42070668/python-3-default-encoding-cp1252) in the report.py file.
I was able to fix this by changing my default encoder but in the interest of making the code environment agnostic, another option is to pass encoding = 'utf-8' when the open function is run similar to this:- open(<file_loc>,'w',encoding = 'utf8')
Steps to Reproduce the Problem

Run through the quickstart assessment in

local Jupyter notebook

using Python 3.7.13

on a windows machine.

Observe output

Specifications

Version: 0.1.2
Platform: Local Jupyter Notebook, Windows Machine, Python 3.7.13

Update: when my notebook reloads it requires that I run:
import _locale
_locale._getdefaultlocale = (lambda *args: ['en_US', 'utf8'])``

which could be prohibitive in a deployment environment

@jcdyer3 , reporting functionality is being significantly changed in the next upload which will make this issue irrelevant. Stay tuned


HIVE-25240: Query Text based MaterializedView rewrite of subqueries

What changes were proposed in this pull request?

Generate expanded query text of subqueries and use it to lookup materializations.
If materialization exists replace the subquery Calcite plan with materialized view scan.

Why are the changes needed?
Improve query text based materialized view query rewrite.
Does this PR introduce any user-facing change?
Yes. Explain and Explain cbo output can change.
How was this patch tested?
mvn test -Dtest.output.overwrite -DskipSparkTests -Dtest=TestMiniLlapLocalCliDriver -Dqfile=materialized_view_rewrite_by_text_8.q,materialized_view_rewrite_by_text_7.q,materialized_view_rewrite_by_text_6.q -pl itests/qtest -Pitests

@jcamachor
Did the changes you requested.


Do not assume that window exists in WASM

Some JS environments have fetch but their global scope isn't named window, e.g. web workers. With this patch, reqwest will use whatever is named fetch in the global scope.
This (at least partially) addresses #910, as the global.Window = Object part is no longer required.

Thanks!


pre_resolve_composes: add multilib support

Add support for parsing multilib_arches and multilib_method and passing
them to ODCS.
Add a simple unit test case to confirm the requests have the appropriate
fields.
Signed-off-by: Mark Langsdorf<EMAIL_ADDRESS>

Updated release notes draft:

Ability to request ODCS composes with multilib


usb: stm32: Introduce transfer method

Transfer is an important concept of USB specification.
During a transfer, several packets can be transmitted.
Today the usb API only provides ep_read and ep_write
functions but the transfer concept is missing.
This is typically ok for basic drivers which don't have
to take care of how data is transfered/splitted.
However there are some drivers like CDC EEM, in which
transfer concept is important for packet management.
Moreover, current ep-write and ep_read method have a
different implementation in usb_dc_dw and usb_dc_stm32
device drivers. For example usb_dc_dw supports only
1-data-packet transfers due to its implementation.
This can increase latency and reduce performance.
I think this is something we need to fix/improve by
implementing better transfer management.
This patch introduces usb_dc_ ep_transfer method which
can be used to configure IN/OUT transfers. This allows
to configure and request different transfer sizes and
should prevent usage of the current stm32 temporary
buffer.
This method has asynchronous and synchronous mode.
Synchronous mode waits for transfer completion before
returning. Asynchronouse mode (irq safe) configures
the transfer and returns immediately, the provided
callback will be then called on transfer completion.
This also update ep_write and ep_read stm32 implementation
to use this new method but keep their behavior unchanged
for legacy reasons.
Note that for now this method is local to stm32 device
driver, however the goal would be to expose this function
as a new USB device driver API method so that class
drivers use it. This will request same implementation in
the usb_dc_dw_driver.
Signed-off-by: Loic Poulain<EMAIL_ADDRESS>

@ydamigos, @jfischer-phytec-iot, @finikorg could you please have a look. In a next step, I would like to implement the same for usb_dc_dw and then make the usb_dc_transfer part of the API and so available for class drivers. Having such function makes sense to me and should simplify some drivers, but let me thoughts...

Not support read_wait/continue but I can definitely take the patch in this PR and rebase.

@galak, could you please check this PR

@galak could we move forward and merge this PR ?

@loicpoulain Where is the transfer concept? It seems to be tailored to the STM HAL Driver. I do not see how it can be exposed to the API. BTW, everything initiated by the host is running in the ISR context.

@jfischer-phytec-iot, Yes in case of STM32, the 'transfer' is mostly handled at HAL level (manage tx/rx buffer, fill the fifo when empty...), the driver here mainly manages transfer state, concurrency and completion. We can see this as a (very)simplified version of USB URB (on Linux).


ContentDialog improvements

Several much needed improvements for ContentDialog:

Initialization logic has been refactored to ensure ContentDialog initalizes in the correct order. Previously, SetupDialog, which is responsible for setting up all the buttons based on the properties was called AFTER the dialog said is was ready and raised the opened event. This was leading to the issue where the buttons were still invisible and initial focus was not being applied. Now, everything is run in the correct order and when the Opened event fires, you can be sure the entire dialog is ready to go.

As a result, initial focus is now correctly applied (this is done automatically). You can still override that and focus whatever you want by handling the Opened event.
It is not required to post to the dispatcher to get focus to work correctly
Also, just as a reminder, if no focusable content is found in the ContentDialog (can happen with all disabled buttons or no buttons, combined with no focusable content), focus will NOT move into the dialog and will remain on whatever the previous focus is. This is by design and is how the FocusManager works (we can't focus any control that isn't focusable)

Fixed an issue where if the dialog was launched via a Button invoked with the enter key with a DefaultButton set, the dialog would immediately close. This is hack fixed as I think this is an underlying issue in Avalonia where if focus changes in between key events, the KeyUp is routed to the new focused control rather than the old.
Some adjustments to the ShowAsync method

Added ShowAsync(TopLevel) overload. This should be used in cases where no ApplicationLifetime is present (like in my unit tests), as ContentDialog won't know where to launch.
As a result, ShowAsync(Window) remains for now but will be removed in 2.1 as this is breaking change

Some minor cleanup of some code
Added unit tests for ContentDialog, which includes tests for the above bugs to ensure they don't regress in the future.

fixes #419

This is hack fixed as I think this is an underlying issue in Avalonia where if focus changes in between key events, the KeyUp is routed to the new focused control rather than the old.

If we have no issue to track this upstream, consider to open an issue upstream for this.

When DefaultButton is None, the Enter key should do nothing

@timunie There's a related issue already filed several months ago here
@workgroupengineering Not entirely true. The reason the enter key is closing the dialog is because focus is set to one of the buttons (as its the only focusable content in the dialog), so the enter key is passed to the button which invokes it - the dialog itself isn't doing anything. This is correct behavior - the focused control takes priority, then the dialog steps in after that, if needed. When default button is None, the enter key should be ignored for unhandled Key events that come from within the dialog's content (like if you had a TextBox there)


Add task retries for DDD pipelines

For testing the pipeline was run 10 times on a Fyre cluster, passing all 10:

I also did 2 tests against ROKS using the Jenkins job. First run:

The 1 failure was during the prereq validation due to a test problem with concurrently using/updating the oc command line tool.
Second run:

The 1 failure was while changing the CS admin password, something new to investigate later! :
log-1171)[2022-04-05T01:15:04.167Z]     INFO: Waiting for the platform-auth-idp-credentials secret to appear
[2022-04-05T01:15:04.167Z]     NAME                            TYPE     DATA   AGE
[2022-04-05T01:15:04.167Z]     platform-auth-idp-credentials   Opaque   2      30m
[2022-04-05T01:15:04.167Z]     INFO: Found the secret platform-auth-idp-credentials in the namespace 'ibm-common-services'
[2022-04-05T01:15:04.167Z]     INFO: Waiting for Common Services console route
[2022-04-05T01:15:04.167Z]     INFO: CP_USERNAME: admin
[2022-04-05T01:15:04.167Z]     INFO: CP_CONSOLE: cp-console.auto-1-click-fcd-3-ec111ed5d7db435e1c5eeeb4400d693f-0000.eu-gb.containers.appdomain.cloud
[2022-04-05T01:15:04.167Z]     INFO: Downloading cloudctl
[2022-04-05T01:15:04.167Z]     INFO: Doing the cloudctl login
[2022-04-05T01:15:04.167Z]     INFO: cloudctl login succeeded
[2022-04-05T01:15:04.167Z]     INFO: Updating the admin password
[2022-04-05T01:15:04.167Z]      [ERROR] Failed to update the common services admin username/password

I have seen the CS password issue happen few time as well


Application freezes on end layout. Seemingly accessing larger than allowed index

Hi there, I'm enjoying creating something with this library using the odin bindings. I have an application where I keep changing the text element and after around 40 changes(its inconsistent) the application freezes up and gets stuck in line 2471 of after calling clay.EndLayout()
I have the state of the local variables here as I recompiled the library with debug symbols. I cannot seem to get any warnings or better errors so let me know the best way to do that if it would help. I am on windows but compiling the library on ubuntu.
Here is the state

Theres nothing particularly interesting about my layout except the text changes on a button press.
createLayout :: proc(lerpValue: f32) -> clay.ClayArray(clay.RenderCommand) {
clay.BeginLayout()
if clay.Container(
clay.ID("LandingPage1Desktop"),
clay.Layout({sizing = {width = clay.SizingGrow({}), height = clay.SizingFit({min = cast(f32)windowHeight - 70})}, childAlignment = {y = .CENTER}, padding = {x = 50}}),
) {
rad:: 50.0
// if mainText == nil {
//     log.error("wtf")
//     mainText = generate_text(200)
// }
if clay.Rectangle(
clay.ID("yo"),
clay.Layout(
clay.LayoutConfig{
childAlignment = {.CENTER,.CENTER},
childGap = 15,
layoutDirection = .TOP_TO_BOTTOM,
sizing = clay.Sizing{clay.SizingGrow({}),clay.SizingGrow({}) },
padding = {16,16}
}
),
clay.RectangleConfig(clay.RectangleElementConfig{
color = {104,150,205,255},
cornerRadius = {rad,rad,rad,rad}
})
){
clay.Text(
clay.ID("the-main-text"),
mainText,
&mainTextConfig)
}
}
EDIT: I should mention the text is random so thats probably why its inconsistent, Also its with line wrap, here is the config
mainTextConfig := clay.TextElementConfig {
fontId    = FONT_ID_BODY_24,
fontSize  = 24,
textColor = clay.Color{255,255,255,255},
wrapMode = .Words,
}

@SushilRagoonath Hello, sorry you're having trouble. I have a suspicion about what this could be, will investigate today and let you know what I find!

I've merged a change that I think should fix this issue in https://github.com/nicbarker/clay/pull/44, please try out main and let me know if it works for you 🙂

Cool, it works now, ran it for a few minutes and it worked fine. Thanks


python311Packages.parsel: 1.9.0 -> 1.9.1

Automatic update generated by nixpkgs-update tools. This update was made based on information from passthru.updateScript.
meta.description for python311Packages.parsel is: Python library to extract data from HTML and XML using XPath and CSS selectors
meta.homepage for python311Packages.parsel is: https://github.com/scrapy/parsel
Updates performed

Ran passthru.UpdateScript

To inspect upstream changes
Impact
Checks done

built on NixOS
The tests defined in passthru.tests, if any, passed
found 1.9.1 with grep in /nix/store/c1pfizvysdg3n1w74kjf8afrh7d6d8qz-python3.11-parsel-1.9.1
found 1.9.1 in filename of file in /nix/store/c1pfizvysdg3n1w74kjf8afrh7d6d8qz-python3.11-parsel-1.9.1

Rebuild report (if merged into master) (click to expand)

91 total rebuild path(s)

91 package rebuild(s)

First fifty rebuilds by attrpath
archivebox
aws-sam-cli
csvs-to-sqlite
gruut
home-assistant-cli
home-assistant-component-tests.gdacs
home-assistant-component-tests.geo_rss_events
home-assistant-component-tests.ign_sismologia
home-assistant-component-tests.qld_bushfire
home-assistant-component-tests.renault
home-assistant-component-tests.unifiprotect
hydrus
invoice2data
khoj
komikku
krr
lacus
marge-bot
pacu
paperless-ngx
parsedmarc
python311Packages.aio-georss-client
python311Packages.aio-georss-gdacs
python311Packages.asf-search
python311Packages.dateparser
python311Packages.dsnap
python311Packages.flask-common
python311Packages.georss-client
python311Packages.georss-generic-client
python311Packages.georss-ign-sismologia-client
python311Packages.georss-ingv-centro-nazionale-terremoti-client
python311Packages.georss-nrcan-earthquakes-client
python311Packages.georss-qld-bushfire-alert-client
python311Packages.georss-tfs-incidents-client
python311Packages.georss-wa-dfes-client
python311Packages.gruut
python311Packages.htmldate
python311Packages.itemloaders
python311Packages.lacuscore
python311Packages.maya
python311Packages.parsedmarc
python311Packages.parsel
python311Packages.playwrightcapture
python311Packages.prometheus-api-client
python311Packages.prometrix
python311Packages.python-binance
python311Packages.pyunifiprotect
python311Packages.renault-api
python311Packages.scrapy
python311Packages.scrapy-deltafetch

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/c1pfizvysdg3n1w74kjf8afrh7d6d8qz-python3.11-parsel-1.9.1 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A python311Packages.parsel https://github.com/r-ryantm/nixpkgs/archive/c75810800fe29be5f03df61b3d6a7524948f79a0.tar.gz

Or:
nix build github:r-ryantm/nixpkgs/c75810800fe29be5f03df61b3d6a7524948f79a0#python311Packages.parsel

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/c1pfizvysdg3n1w74kjf8afrh7d6d8qz-python3.11-parsel-1.9.1
ls -la /nix/store/c1pfizvysdg3n1w74kjf8afrh7d6d8qz-python3.11-parsel-1.9.1/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review --extra-nixpkgs-config '{ allowInsecurePredicate = x: true; }' run on x86_64-linux 1

2 packages marked as broken and skipped:

khoj
khoj.dist

14 packages failed to build:

marge-bot
marge-bot.dist
pacu
pacu.dist
parsedmarc (python311Packages.parsedmarc)
parsedmarc.dist (python311Packages.parsedmarc.dist)
python311Packages.dsnap
python311Packages.dsnap.dist
python312Packages.dsnap
python312Packages.dsnap.dist
python312Packages.scrapy-deltafetch
python312Packages.scrapy-deltafetch.dist
tts
tts.dist

154 packages built:

archivebox
archivebox.dist
aws-sam-cli
aws-sam-cli.dist
csvs-to-sqlite
csvs-to-sqlite.dist
gruut (python311Packages.gruut)
gruut.dist (python311Packages.gruut.dist)
home-assistant-cli
home-assistant-cli.dist
home-assistant-component-tests.gdacs
home-assistant-component-tests.geo_rss_events
home-assistant-component-tests.ign_sismologia
home-assistant-component-tests.qld_bushfire
home-assistant-component-tests.renault
home-assistant-component-tests.unifiprotect
hydrus
hydrus.doc
invoice2data
invoice2data.dist
komikku
krr
krr.dist
lacus
lacus.dist
paperless-ngx
python311Packages.aio-georss-client
python311Packages.aio-georss-client.dist
python311Packages.aio-georss-gdacs
python311Packages.aio-georss-gdacs.dist
python311Packages.asf-search
python311Packages.asf-search.dist
python311Packages.dateparser
python311Packages.dateparser.dist
python311Packages.flask-common
python311Packages.flask-common.dist
python311Packages.georss-client
python311Packages.georss-client.dist
python311Packages.georss-generic-client
python311Packages.georss-generic-client.dist
python311Packages.georss-ign-sismologia-client
python311Packages.georss-ign-sismologia-client.dist
python311Packages.georss-ingv-centro-nazionale-terremoti-client
python311Packages.georss-ingv-centro-nazionale-terremoti-client.dist
python311Packages.georss-nrcan-earthquakes-client
python311Packages.georss-nrcan-earthquakes-client.dist
python311Packages.georss-qld-bushfire-alert-client
python311Packages.georss-qld-bushfire-alert-client.dist
python311Packages.georss-tfs-incidents-client
python311Packages.georss-tfs-incidents-client.dist
python311Packages.georss-wa-dfes-client
python311Packages.georss-wa-dfes-client.dist
python311Packages.htmldate
python311Packages.htmldate.dist
python311Packages.itemloaders
python311Packages.itemloaders.dist
python311Packages.lacuscore
python311Packages.lacuscore.dist
python311Packages.maya
python311Packages.maya.dist
python311Packages.parsel
python311Packages.parsel.dist
python311Packages.playwrightcapture
python311Packages.playwrightcapture.dist
python311Packages.prometheus-api-client
python311Packages.prometheus-api-client.dist
python311Packages.prometrix
python311Packages.prometrix.dist
python311Packages.python-binance
python311Packages.python-binance.dist
python311Packages.pyunifiprotect
python311Packages.pyunifiprotect.dist
python311Packages.renault-api
python311Packages.renault-api.dist
python311Packages.scrapy
python311Packages.scrapy-deltafetch
python311Packages.scrapy-deltafetch.dist
python311Packages.scrapy-fake-useragent
python311Packages.scrapy-fake-useragent.dist
python311Packages.scrapy-splash
python311Packages.scrapy-splash.dist
python311Packages.scrapy.dist
python311Packages.secure
python311Packages.secure.dist
python311Packages.trafilatura
python311Packages.trafilatura.dist
python311Packages.wktutils
python311Packages.wktutils.dist
python312Packages.aio-georss-client
python312Packages.aio-georss-client.dist
python312Packages.aio-georss-gdacs
python312Packages.aio-georss-gdacs.dist
python312Packages.asf-search
python312Packages.asf-search.dist
python312Packages.dateparser
python312Packages.dateparser.dist
python312Packages.flask-common
python312Packages.flask-common.dist
python312Packages.georss-client
python312Packages.georss-client.dist
python312Packages.georss-generic-client
python312Packages.georss-generic-client.dist
python312Packages.georss-ign-sismologia-client
python312Packages.georss-ign-sismologia-client.dist
python312Packages.georss-ingv-centro-nazionale-terremoti-client
python312Packages.georss-ingv-centro-nazionale-terremoti-client.dist
python312Packages.georss-nrcan-earthquakes-client
python312Packages.georss-nrcan-earthquakes-client.dist
python312Packages.georss-qld-bushfire-alert-client
python312Packages.georss-qld-bushfire-alert-client.dist
python312Packages.georss-tfs-incidents-client
python312Packages.georss-tfs-incidents-client.dist
python312Packages.georss-wa-dfes-client
python312Packages.georss-wa-dfes-client.dist
python312Packages.gruut
python312Packages.gruut.dist
python312Packages.htmldate
python312Packages.htmldate.dist
python312Packages.itemloaders
python312Packages.itemloaders.dist
python312Packages.lacuscore
python312Packages.lacuscore.dist
python312Packages.maya
python312Packages.maya.dist
python312Packages.parsel
python312Packages.parsel.dist
python312Packages.playwrightcapture
python312Packages.playwrightcapture.dist
python312Packages.prometheus-api-client
python312Packages.prometheus-api-client.dist
python312Packages.prometrix
python312Packages.prometrix.dist
python312Packages.python-binance
python312Packages.python-binance.dist
python312Packages.pyunifiprotect
python312Packages.pyunifiprotect.dist
python312Packages.renault-api
python312Packages.renault-api.dist
python312Packages.scrapy
python312Packages.scrapy-fake-useragent
python312Packages.scrapy-fake-useragent.dist
python312Packages.scrapy-splash
python312Packages.scrapy-splash.dist
python312Packages.scrapy.dist
python312Packages.secure
python312Packages.secure.dist
python312Packages.trafilatura
python312Packages.trafilatura.dist
python312Packages.wktutils
python312Packages.wktutils.dist
unifi-protect-backup
unifi-protect-backup.dist
webmacs
webmacs.dist

Maintainer pings
cc @fabaff for testing.

Already on master.


Temporary fix for the starts_with? issue, where swagger patterns have already been converted to Regexp.

Is it possible to create a spec that demonstrates the error?

@Fryguy yeah I'm trying to get some reproduction steps...no luck so far

@agrare, @Fryguy :
I have a 100% way to reproduce. Actually I understand the error and I also happen to have a sort-of fix.
The problem is that a (Hash) structure is being updated from multiple threads in parallel, values are passed by reference. State mutation. Well Ruby allows you to do these things. Anyone willing to pay me to rewrite the API in Elixir? ;-)
Here's my fix: https://github.com/ManageIQ/topological_inventory-api/pull/171
However I am very unsure whether the logic of the lib/open_api should be done this way. I'd rather be more careful and do less state mutation in multi-threaded app.

To create a reproducer one needs to have the API running in a multi-threaded environment and fire 2 parallel requests that will cause the OpenAPI definitions to be parsed.
Good luck trying to do that in a unit test :-D
Well actually if you do that somehow, please, let me know, I'd love to learn some new dirty tricks ;-)

To elaborate a bit more on what I mean by "I'd rather be more careful":
I think that the algorithm in lib/open_api should be changed in such a way that instead of having one hash that is being changed in place, there would be two. One for input only (unprocessed parts of the schema) and the other one for the output (processed parts of the schema). The output values would be written once completely calculated, no intermediate values.
It that way even w/o locking and even if multiple threads would be parsing the same part of the schema, the result would be correct.


Add support for Omniture campaign tracking to Snowplow ETL

Assigning to Yali - write the spec in this ticket then re-assign to Alex for scheduling.

Migrated to https://github.com/snowplow/enrich/issues/236


Add interface for filtering Java classes out of KIE project builds.

This PR is required for LiveSpark, where we require the ability to prevent client-side classes with GWT dependencies from being compiled.

Related PRs:
https://github.com/droolsjbpm/drools/pull/786
https://github.com/droolsjbpm/kie-wb-common/pull/359

+1 to merge
@mariofusco could you please check this too?

Being a nosey bugger, I looked at Predicate (I doth my hat to @mariofusco and his Java 8 knowledge).. looks like you can chain composite "filters" with and or or: https://docs.oracle.com/javase/8/docs/api/java/util/function/Predicate.html

@manstis Yes, that's what I meant ( @mbarkley sorry for not having clarified this ). Also consider that if you have a Collection of Predicates:
Collection<Predicate<String>> ps = ...
you can reduce it into a single Predicate as simply as:
Predicate<String> p = ps.stream().reduce( s -> true, Predicate::and );
@manstis Out of curiosity what "doth my hat" means? I don't know that English word and I cannot find it.

@mariofusco OK, I spelt it wrong: http://www.phrases.org.uk/meanings/doff-your-hat.html

@manstis I see, thanks :) Actually I had to learn all the new Java 8 API when I wrote my Java 8 book :P

@mariofusco I've moved the new buildAll(Predicate<String>) method to the InternalKieBuilder as you've suggested. Thanks for the feedback.


feat: frequency, min_new_tokens, presence, and repetition penalties

Thank you for your contribution, we really appreciate it. The following instructions will help improve your pull request and make it easier to receive feedback. If there are any items you don't understand, don't worry. Just submit the pull request and ask the maintainers for help.
Motivation
Penalties are defined in SamplingParams, and the tensors being created during batch execution, but not yet implemented.
Also we can cut-down some milliseconds in ITL, and some VRAM usage, by not creating those unnecessary tensors.
Modification

Implemented following penalties, similarly to they are in vllm:

frequency_penalty
min_new_tokens
presence_penalty
repetition_penalty

Introduces following new sampling_parameters, and added them to OpenAI protocol in same name as appeared on vllm for compatibility:

stop_token_ids: similar to stop, but token IDs instead of str. This could be useful when used with min_new_tokens.
repetition_penalty
min_new_tokens

Each penalizers are fully batch-compatible (filter, merge supported).
Penalizers will do nothing (not even create a tensor) if they are not required.
Performance implcations on using penalizer sampling_parameters are documented.
Add ability for sglang.bench_serving to accept additional --request-body to specify sampling_params if desired.

Benchmark
Benchmarks were ran on single NVIDIA H100 SXM5
Baeline calculated on dc9d06d886151707f97d0b78095df9de262fd3c9:
$ python3 -m sglang.bench_serving --backend sglang --port 8413 --dataset-name random --num-prompts 3000 --random-input 256 --random-output 512

============ Serving Benchmark Result ============
Backend:                                 sglang
Traffic request rate:                    inf
Successful requests:                     3000
Benchmark duration (s):                  67.50
Total input tokens:                      378633
Total generated tokens:                  775651
Total generated tokens (retokenized):    774862
Request throughput (req/s):              44.44
Input token throughput (tok/s):          5609.11
Output token throughput (tok/s):         11490.58
----------------End-to-End Latency----------------
Mean E2E Latency (ms):                   42141.26
Median E2E Latency (ms):                 45393.52
---------------Time to First Token----------------
Mean TTFT (ms):                          20705.28
Median TTFT (ms):                        14893.99
P99 TTFT (ms):                           49444.93
-----Time per Output Token (excl. 1st token)------
Mean TPOT (ms):                          94.00
Median TPOT (ms):                        91.96
P99 TPOT (ms):                           232.66
---------------Inter-token Latency----------------
Mean ITL (ms):                           181.11
Median ITL (ms):                         62.46
P99 ITL (ms):                            441.66
==================================================

Calculated on this PR's branch (without any penalizers):
$ python3 -m sglang.bench_serving --backend sglang --port 8413 --dataset-name random --num-prompts 3000 --random-input 256 --random-output 512

============ Serving Benchmark Result ============
Backend:                                 sglang
Traffic request rate:                    inf
Successful requests:                     3000
Benchmark duration (s):                  66.11
Total input tokens:                      378633
Total generated tokens:                  775651
Total generated tokens (retokenized):    775118
Request throughput (req/s):              45.38
Input token throughput (tok/s):          5727.04
Output token throughput (tok/s):         11732.16
----------------End-to-End Latency----------------
Mean E2E Latency (ms):                   40881.94
Median E2E Latency (ms):                 43967.10
---------------Time to First Token----------------
Mean TTFT (ms):                          19884.75
Median TTFT (ms):                        14226.56
P99 TTFT (ms):                           47738.97
-----Time per Output Token (excl. 1st token)------
Mean TPOT (ms):                          91.96
Median TPOT (ms):                        90.11
P99 TPOT (ms):                           308.54
---------------Inter-token Latency----------------
Mean ITL (ms):                           174.54
Median ITL (ms):                         58.56
P99 ITL (ms):                            440.18
==================================================

Additional benchmarks can be found in the updated sampling_params.md
Notes to Reviewers
This is my very first time writing Python code, and thus working with PyTorch (my industry backgrounds are primarily Golang, Rust, Java, Nodejs, ...). So please feel to add any comments if something looks off or inefficient.
Checklist

[x] 1. Ensure pre-commit pre-commit run --all-files or other linting tools are used to fix potential lint issues.
[x] 2. Confirm that modifications are covered by complete unit tests. If not, please add more unit tests for correctness.
[x] 3. Modify documentation as needed, such as docstrings or example tutorials.

@vhain Nice work!

@vhain ready to merge?
@zhyncs can you take another look and approve this?

In the future, we plan to wrap all the logits processing and sampling into the Cuda graph as well.
Are these penalizers cuda-graph compatible?

In the future, we plan to wrap all the logits processing and sampling into the Cuda graph as well. Are these penalizers cuda-graph compatible?

@vhain

@Ying1123 @zhyncs I'm pretty new to this ground (started playing with LLM ~ month ago, started using sglang ~ 2 weeks ago, and this is my first ever Python/PyTorch code written). I don't think this penalizers are implemented based on CUDA grapu, but I will take a look on other CUDA graph implementations in sglang to figure it out. Hopefully I can pull up another PR to make it use CUDA graphs...

@Ying1123 @zhyncs Although I might need some extra time on what and how the CUDA graph works, all those penalizers are purely written in PyTorch (with device="cuda"). So it should be fairly simple to migrate..?

Yes, do not worry about it for now. We will refactor and start moving the sampling within the CUDA graph. We will let you know later and ask for your help if needed.

We found that presence_penalty has a great influence on the speed of decode.
When set presence_penalty = 0.5 qwen-72b-gptq-int4 (got 17.82 token/s on 4 * A100)，3.x slower than set presence_penalty=0.0 (got 60 token/s on 4*A100).

@hnyls2002 Is this related to how the cuda graph is triggered?

@Xu-Chen Recently we did some modifications to how the cuda graph is enabled. In the 0.3.0, if you set penalty or regex, cuda graph will be disabled. This is a bug and we will fix it soon.

@vhain @Xu-Chen  I believe the performance slowdown problem will be fixed in #1392.
With llama3.1-8b on 1 A100, the decoding speed is 77 tokens per sec the same as without presence penalty, but on main the speed is 71 tokens per sec.
On 4 x A100, the decoding speed is 129 tokens per sec, while without presence penalty the speed is 134 tokens per sec, but on main the speed is 58 tokens per sec.

@vhain @Xu-Chen @merrymercy
The penalties consume calculation in two phases:

Cumulate output tokens or input tokens.
Apply the penalties to the logits results.

The second phase was fully overlapped by https://github.com/sgl-project/sglang/blob/184e4446529bd2518361e62fe2cd93a713c78438/python/sglang/srt/model_executor/model_runner.py#L568 (this calculation can be executed parallel with model forward)
Also, the first phase can be overlapped, I have made some tries, but it failed.
https://github.com/sgl-project/sglang/commit/dc1672596f9c6451573c99a8534695c9f9f72d87
https://github.com/sgl-project/sglang/commit/f46a050dc54717c1fc461fde571f4c7eda930079
What I thought was to make the cumulate a lazy operation, only being done when batch size changes or before applying. This can save more time and make the inference with penalties as fast as in normal cases. If you are interested in this, you are welcome to contribute to this optimization.


prevent locks during full refresh in incremental materialization (fix…

…es #2426)
resolves #2426
Description
Prevent locks during full refresh in incremental materialization. The code change involves changing the order of operations to reflect the order of operations in a table materialization.
Checklist

[x] I have signed the CLA
[x] I have run this code in development and it appears to resolve the stated issue
[x] This PR includes tests, or tests are not required/relevant for this PR
[ ] I have updated the CHANGELOG.md and added information about my change to the "dbt next" section.

@jtcohen6 Thank you for the suggestions! I have made the requested changes. Is this line of code (line 26) still required?
{% do to_drop.append(backup_relation) %}

If yes, should we add something to also drop tmp_relation?


My collection references non-existing role

I have:
"roles": [
  "admin, user"
],

And in videos:
"roles_allowed_to_read": [
  "user"
],

Still I get
Collection "videos" references non-existing role "user". Please add this role to application.roles array.

kitchen version: 0.9.57, osx: 10.11.4
Suggestions ?

You are missing quotes in roles: ["admin", "user"] instead ["admin, user"]

Thanks. That did it. The reason it happened is because i used comma separated list in GUI in-stead of line-shift separated. It would perhaps be more intuitive if both methods worked (or the help pop-up explained it)

I agree. Old gui is not intuitive at all... working on a brand new one.


KeyPath cannot be Global Variable, Needs to be added to Profile

Once PS session is off, the variable will not be available.
You need to add the KeyPath endpoiint is PS profile:
> notepad $PROFILE.AllUsersAllHosts
$KeyPath = "<PATH>"

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 24a6c4e2-702f-2b17-3e2d-c86f33b13beb
Version Independent ID: 1e7811d8-668a-db98-34ca-eaf4d7ee8c1f
Content: Dynamic scale Windows Virtual Desktop session hosts - Azure
Content Source: articles/virtual-desktop/set-up-scaling-script.md
Service: virtual-desktop
GitHub Login: @Heidilohr
Microsoft Alias: helohr

Thanks for the feedback! I have assigned the issue to the content author to investigate further and update the document as appropriate.

Closing the loop on this - $KeyPath doesn't appear in the article itself, and I can't find it in the .ps1 files either, so I'm assuming this has been sorted already.  If this is still an issue and is with the .ps1 files, please open an issue in this repo: https://github.com/Azure/RDS-Templates.
#please-close