[SPARK-15253] [SQL] Support old table schema config key "spark.sql.sources.schema"

What changes were proposed in this pull request?
Originally, we used spark.sql.sources.schema to store the schema of a data source table.
After SPARK-6024, we removed this flag. Although we are not using spark.sql.sources.schema any more, we need to still support it, so that the new spark version is compatible with old meta store.
How was this patch tested?
Existing unit test.

Test build #58463 has started for PR 13073 at commit 306e892.

@clockfly, seems JIRA number mentioned in the title is wrong, I think it should be SPARK-15253.

Test build #58463 has finished for PR 13073 at commit 306e892.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/58463/
Test PASSed.

Merged build finished. Test PASSed.

@devaraj-kavali Thanks, fixed

Test build #58545 has started for PR 13073 at commit f82f7c6.

Test build #58545 has finished for PR 13073 at commit f82f7c6.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/58545/
Test PASSed.

Merged build finished. Test PASSed.

LGTM , merging to master and 2.0!


Add LazyCollection class

Issue #18

@sirn do you want to have a look? will merge it tomorrow 🎉

as I talked to @sirn personally. I will merge this then improve about caching later.

as I talked to @sirn personally. I will merge this then improve about caching later.

🤔


integration tests: run with native/vfs by default.

Signed-off-by: Andrea Luzzardi<EMAIL_ADDRESS>

Using vfs the tests don't slow down by much and the environment is more reproducible on every host.
STORAGE_DRIVER=aufs bats test/integration/constraints.bats  3.75s user 1.17s system 13% cpu 37.104 total
STORAGE_DRIVER=vfs bats test/integration/constraints.bats  4.05s user 1.39s system 13% cpu 40.089 total

Also, it's not supported to run the aufs driver on top of the aufs driver:
https://github.com/docker/docker/blob/master/daemon/graphdriver/aufs/aufs.go#L48
Meaning that we cannot chain aufs docker-in-docker's.
@jfrazelle @vieux @abronan Any better option than vfs to run docker in docker?

image affinity seems to fail with this PR and on an unrelated note, docker cp is stuck on both master and this PR

With #703 and #702 it actually works, I believe.

Tests blocking at cp for me, will test with the other PRs ;-)

Like @vieux, tests are failing on affinity after merging changes in #703

Try:
DRIVER=vfs DOCKER_IMAGE=dockerswarm/dind DOCKER_VERSION=1.6.0 bats [...]

@aluzzardi Indeed, it passes now :+1:

@aluzzardi Wait still having random errors on affinity if I re-run the tests..
On [[ "${output}" == *'"Name": "node-0"'* ]]

I had the tests passing the first time and now it fails systematically on image affinity.


Set an option for automatic column width

@mentax
Thanks for your program.
Could be possible to modify the source to add an option for autozize column width in Excel .xlsx output file?
Thanks.

You can use template option.
All styles added to column will be copied for all rows.

@DeyV
Is it work also if template is a table?


Bugfix of Multiscale Calculation

Overview
This pull request contains some improvements and bugfixes of the 1-3D multiscale calculation. Besides, It also appends a few optional input parameters. Since the backward compatibility remains in this code, the input file of the multiscale calculation in the previous version is still available in the modified code.
Changes

Enable the arbitrarily shaped structure of the macro points.
Enable 3D mode of the multiscale calculation in SALMON.
(Previously these two points are implemented only in the ARTED)
Automatic detection of NKSplit and NXYSplit parameter.
(Currently, these parameters remain as the optional items for the compatibility of the old input file. We have a plan to remove these variables in the future updates)
Shift 1/2 Delta t in the numerical integration of the energy absorption. It is not significant to results, but in principle, it is better for the energy conservation.
Change the log format in the STDOUT of the multiscale calculation. The new format is easier for users to grasp how the computation proceeds.
Additionally, insert the OpenMP directives to speed up the data assignments.
Fix any other minor problems...

Testing
Comparison between original results and modified code

As shown in the following figure, the new code successfully reproduces the previous ones:

Example of the output (for peer reviewers)

The input file uploaded as below:
https://gist.github.com/uemoto1/e90ce9f3c015c086c6b377b83bc5c213
( The pseudopotential Si_rps.dat is also required for execution)

You can get the results at iter=1000 in STDOUT

 -----------------------------------------------
 Multiscale iter =  1000/  1000
 Microscopic system:
    Excitation energy:     Eex =  6.533425E-003    Diff =  2.233543E-003 [au]
 Macroscopic system:
      Absorbed energy:    Eabs =  6.531510E-003    Diff =  2.233342E-003 [au]
         Field energy:    Eemf =  2.749756E+000    Diff = -2.429957E-003 [au]
      Total EM energy:    Etot =  2.756287E+000    Diff = -1.966158E-004 [au]
 Position of wavepacket:
     Central position:     <r> = -2.035E+004,  0.000E+000,  0.000E+000, [au]
    Spatial spreading:     rms =  8.669E+003,  0.000E+000,  0.000E+000, [au]
 Total time =   33.6190788745880
 -----------------------------------------------

I have tested this code in the Oakforest PACS environment. Please someone check in FX machine?
Thank you for your consideration.

I found a problem of the export of Ac_m file in some condition. I will fix a bug later.

Currently I send the bugfix. Now The code is working correctly.
(I suspects this bug seems to be happend in the resolving conflicts by mistake...)

@uemoto1 san, thank you for your implementation. Unfortunately, I do not have an access to FX machine. So, I would like to ask someone to test this patch.
I have one suggestion about absorbed energy. In the present implementation, the absorbed energy is computed by Ohm's law. However, based on my experience, the divergence of Poynting vector would be more numerically accurate (please have a look at PRB 92, 205413 (2015) for multi-scale simulations. So, please consider to employ Poynting vector if you suffer from the numerical accuracy.

@shunsuke-sato san, Thank you for comments. I think it is possible to add the Poynting vector routine. However, I guess the coding and the check of precision will be a time consuming. I will schedule it for the next implementation.
(P.S. Since I got some comments for the preparation of the next release version, I have to modify this PR. After modification, I will ask the check and merge. Sorry for inconvenience...)

@shunsuke-sato san, Thank you for checking. I will send the bugfix later.

Thank you for many fruitful comments! Now, I have fixed related problems and reduced warning messages.

@uemoto1 san, thank you for fixing the problem. However, it seems that this patch does not reproduce the original results. For example, if examples/bulk_Si/input_ms_Si.inp is used, Ac_M000000.out of the original code and Si_Ac_m_000001.out of this patch are not identical.
Furthermore, all the files of Si_Ac_m_00000*.out are identical although they should give the data for different macro points.
So, could you check the output of this patch?

At least, in my environment, the code generates the appropriate output data; I can't reproduce the bug report.
However, during checking the source codes (the related section of  Ac_M outputs), I found one subroutine accesses to an array element which placed on out of the allocated range. I guess this buffer-overflow problem will probably induce the similar problem you reported by contaminating the stored data. I immediately send a bugfix. In my test, it also works correctly as below:

(In this time, I increased NX_m=24 to clarify the errors in the propagation induced by growing up its thickness.)
I think this behavior strongly depends on the system size, processors number,  compilers, and any other environments. I require you to check the modified code and reproduction of the original outputs.
Thank you for your corporation.

@uemoto1 san, still this patch does not reproduce the original results, at least, in my environment. In the attached figure, the red line shows the original result, and the blue-dotted line shows the result of this patch. You can see the file information from the legends of the figure.
Do you get the identical lines for the vector potential in time?

Thank you @shunsuke-sato for reporting. I have recalculated by using "example/bulk_si" inputs, and the attached is the result of the calculation.

The blue line is the original results and orange point are the modified code. For this comparison, I use the version 176863c59f5ec498741985361772c68bc0121db1 as old version.

@shunsuke-sato san, During testing in some of different computation conditions, I found an appearance of significant error will be seen when the number of MPI are gradually increased (much larger than number of the macropoints). At that time, the behavior of the differences are resemble to the attached above.

I have experimentally fixed the bug as above.

@uemoto1 san, thank you for the confirmation.
In my calculations, I used 8 MPI processes for 4 macroscopic points. And, this is the only possible choice for the original code with examples/bulk_Si/input_ms_Si.inp.

Thanks for checking @shunsuke-sato san. I grasp the bugfix proposed above is also works successfully for the MPI number of nproc = 8.

The modification is provide the header comment lines of the output files which helps for users to indicate the meaning of the columns and its unit. It change the description of term Ac_x to A_x/c in the comment line for convenience. For example ...
# Time[au] A_x/c(0)[au] A_y/c(0)[au] A_z/c(0)[au] A_x/c(L)[au] A_y/c(L)[au] A_z/c(L)[au]

@uemoto1 san, thank you for fixing the problem. Then, I could restart the review and the tests. But, I could not have the time until Friday because of visitors. So, could you wait until Friday? I'm a bit afraid that the first release is urgent. But, I do not know the exact plan.
Also, as I wrote above, I do not have access to FX machines. So, could you ask someone else for the tests on FX machines?

I'll try the calculation on the FX machine this afternoon, so could you wait for a while? I'll give a comment after the calculation.

I found two problems.

The build on the k-computer did not succeed. The build passes If line 660 in src/ARTED/control/control_ms.f90 is modified from

!$omp parallel do default(shared) collapse(3) &
!$ & private(iix_m, iiy_m, iiz_m, rrx, rry, rrz, eem) &
!$ & reduction(+: sx1, sy1, sz1, sx2, sy2, sz2, sem)

to

!$omp parallel do default(shared) collapse(3) &
!$omp private(iix_m, iiy_m, iiz_m, rrx, rry, rrz, eem) &
!$omp reduction(+: sx1, sy1, sz1, sx2, sy2, sz2, sem)

@uemoto1 san, could you modify this part?

Even if the problem gave above is solved, the result seems to be strange. I attach the calculated result at iter=4000.

Is it possible for you to fix?

Thank you @mn2007 san. Your report is very helpful!

I will fix the directives of the OpenMP.

I think the difference is originating to the new output file uses the different column arrangement (and unit system) from the old ones. Due to this reason, I think the direct comparison between old output and new output is a bit difficult.

Currently, I have the series of output files tested in the KNL machine, which is consistent to the older results. Later, I will upload one file of KNL output. Can you compare with the K-computer's result to the KNL result?

Thank you for your proposal and sorry for skipping over the description for the output, @uemoto1 san. It will take a time to understand new format, so uploading the KNL result would be very helpful for me. I'll wait until you upload.

Sorry for late, @mn2007  san. I fixed the OpenMP directives at this commitment.
The attached is the example of the input file as below:
https://www.dropbox.com/s/emb8ozlvh4n5rdx/input_ms_Si_check1d.txt?dl=0
(Please prepare Si_rps.dat file on the same directory of input file)
The following is the example of output file at iter = 4000 step (obtained in KNL):
https://www.dropbox.com/s/fsbx7pkdqvgx8i9/ms_Si_check1d_Ac_004000.out?dl=0
The critical quantities in this file is

Column 1: Horizontal Axis
Column 16: Energy of Electronic System
Column 17: Energy of Absorption

The 16-th and 17-the elements are calculated from the most of other physical quantities in the multiscale calculation. Therefore, we can use those couple of values as the representation of the convergence.

Thank you for updating, @uemoto1 san. But it seems that problems are not solved yet.

The part where build does not pass is what I commented. But updated parts are not there. Therefore please let me explain in other words. Because !$ is used instead of !$omp on lines 661 and 662 in src/ARTED/control/control_ms.f90, the build doesn't pass. Could you modify this part?

Calculated values on the k-computer are a little bit different from the ones on OFP though I used the uploaded input file. Is this differece acceptable or not?

Sorry @mn2007 san, I have misunderstood your point. I retried to fix the OpenMP directives.
Besides the small difference between OFP and K is I think nearly acceptable...

Thank you for fixing the problem about the OpenMP directive, @uemoto1 san. Since @uemoto1 san insisted that the difference is acceptable, I merge this PR.

Thank you @mn2007 san for quick checking...
Generally, the edge point the error induced by the numerical differentiation will be more easy to see than any other point, due to the discontibuity of the current density. Therefore,in  this case, I guess the such kind of the errors grows up by the difference of the processer and paralization method,
(Besides, I want to grasp the actual numerical precision. Can I have the output files  of ms_Si_check1d_Ac_M_0000??.out in the K computer...)

Followings are files obtained on the K computer. Could you tell me if you can not download the files?
https://www.dropbox.com/s/zu9mwivdjr83geg/Si_Ac_M_000001.out?dl=0
https://www.dropbox.com/s/dwv1zd8a863your/Si_Ac_M_000002.out?dl=0
https://www.dropbox.com/s/66a4rrgds91njdd/Si_Ac_M_000003.out?dl=0
https://www.dropbox.com/s/8kvkzqf7eqky3h6/Si_Ac_M_000004.out?dl=0

Thank you @mn2007 san, I can download your data. They are enough for my analysis!

Could you wait your analysis? I uploaded wrong output files. Sorry for that.

Okay!, Please tell me when you finished the replacement of these files.

Sorry for making you confused. I uploaded correct ones. Could you check for these files?
https://www.dropbox.com/s/2gjix3ywrbhnd8n/ms_Si_check1d_Ac_M_000001.out?dl=0
https://www.dropbox.com/s/vkj6suce4p4op94/ms_Si_check1d_Ac_M_000002.out?dl=0
https://www.dropbox.com/s/ah1skcti720iqwn/ms_Si_check1d_Ac_M_000003.out?dl=0
https://www.dropbox.com/s/i583ddszxx5e0ex/ms_Si_check1d_Ac_M_000004.out?dl=0
https://www.dropbox.com/s/oeqodokxuffxs7i/ms_Si_check1d_Ac_M_000021.out?dl=0
https://www.dropbox.com/s/bx8rww6ihxfir7l/ms_Si_check1d_Ac_M_000022.out?dl=0
https://www.dropbox.com/s/p2ymyu4w635nrl2/ms_Si_check1d_Ac_M_000023.out?dl=0
https://www.dropbox.com/s/1vmwz00hamz1v05/ms_Si_check1d_Ac_M_000024.out?dl=0

Thank you for your reply despite being so busy!


Added Scholastica (BD)

School URL:
https://scholasticabd.com/index.php
Proof of presence of IT related course:
https://scholasticabd.com/academics/alevel.php#:~:text=Business%2C Biology%2C Accounting%2C-,Computer Science,-%2C Mathematics%2C Law%2C Psychology
Proof of recognition of domain by institution:
Internet Use Policy.pdf

[x] Students
[ ] Academic/Teaching Staff
[ ] Other/Support Staff
[ ] Alumni

Education Levels

[ ] Post-graduate research
[ ] Graduate School
[ ] College (University) or Undergraduate School or equivalent
[x] Community College or equivalent
[x] High School or equivalent
[x] Elementary School or equivalent

@TheMayhem6328 lib/domains/online/scholastica: this request has an incorrect file path format, please ensure that you are familiar with     this repository rules located at the bottom of this page and change     your request accordingly. If you don't know how to change request, close it and open a new one.     If you are not able to make the pull request according the instructions, please send us an email to<EMAIL_ADDRESS>Please mention this request URL in the message.

I'm sorry - I forgot to add the extension to the file. Added a new commit with fixed layout

@TheMayhem6328 Pull request merged. Thank you.


Virtualization

I noticed that you are looking on adding virtualization. I'm also interested in adding this to my project.
react-window might be another good option for a virtualization library. It was made by the developer of react-virtualized but it has a much simpler and refined API
https://react-window.now.sh/#/examples/grid/variable-size

Absolutely! Would love to work in virtualization for tables that have pagination={false}. If you would like to take up a POC and see how it turns out I would love to take a look

Can you guys guess when you are able to implement it?

Bump. Material-UI Tables has an example for adding virtualization in its docs.
https://material-ui.com/components/tables/#virtualized-table

Do we have an example for mui-datatables?

how to implement virtualization? infinite-scrolling - increases the number of objects, but it is necessary to constantly update the number of displayed objects

how to implement virtualization? infinite-scrolling - increases the number of objects, but it is necessary to constantly update the number of displayed objects

Is the feature of virtualization planned to be implemented in the near future?

Hi any updates on this?

Bump

I finally gave up and made my own board with MaterialUI and react-virtuoso.
Virtuoso even has an example to implement MUI arrays and list and is very easy to set up compared to react-window. It also supports horizontal scroll and can be responsive

Here is an exemple with Virtuso, MUI and table filter
https://codesandbox.io/s/virtuoso-mui-filter-f5xtfr


Issue re-installing Alexander, not able to locate files

Hey, I'm looking to reinstall after a recent file wipe I had to do, but unfortunately whenever I try to install, I get this error message. I'm not sure what is causing it, as the file location is correct for the game.
I'm wondering if this is a case of something missing after my reinstall of the base game or something along those lines, cause my game is working perfectly fine right now.
Thanks for the help.

I'm currently having the same issue after my files were wiped and my FFXIV is freshly installed in the correct location as well, have you found a fix?


feat(driver,windows): add win32 event support

This PR adds Win32 event support for IOCP driver. Win32 event is kind of foundamental syncronize object. It could be, e.g., an event handle, an input console handle, a pipe handle, or a mutex handle.
Win32 event could not be polled by IOCP, but IOCP could be waited as a usual event on Windows 10+. MsgWaitForMultipleObjectsEx is used here to wait them all, and reserves possibility for APC routines and window messages. If there are more than 62 events to be waited, the remain events will be waited in seperate threads.
In this PR, stdio is also refactored to use the new feature. To make the code simpler, the console code page is forced to UTF8.
This PR is a prediction of the planned compio-process. We need the feature to wait for the process handle.

@George-Miao may feels hard to review code for Windows. @bdbai would you like to take a look?

Impl changed to use thread pool API instead. According to Raymond Chen, it handles more than 64 events in a single thread.


Improve sig formatting

This PR

shows sig(:final) for final sigs in LSP
shows multi-line sigs in LSP when the arg count goes above a cutoff (close #1516)

Motivation
To improve LSP.
Test plan
See included automated tests.
Note that the big sig types work well in hover:

But not so well in the outline:

from convo with jvlik: add a nested class/module.

@azdavis Actually, before we merge this -- can we make it conform to Stripe's stylistic conventions?
sig do
  params(
    foo: Bar,
  )
  .returns(Something)
end

(notice the . placement)


Update all tests to set the environment variables that they require

Currently, some tests explicitly specify the environment variables that will be needed and some tests assume that these variables are already set. Even if a target is added to the Makefile to set the required variables, we'd still have the case where someone is trying to run a test from the IDE or just using pytest and then the required variables would not be set.
We should likely update the tests so that they read the environment variables to be used from a file or something like that.

We should also add assertions to the tests to make sure the required variables are set.

I'm working on this since I think it is useful for what I need to do next. Or at least they might be somewhat related.
I'm taking the approach that the user needs to set the variables before running the tests, and doing a coarse grained check that the main environment variables are set.
This is based on the .env file I have locally to run the tests
export POD_CONTAINER=docker
# export POD_CONTAINER=podman

# Env vars to configure Stomp
export STOMP_USER=artemis
export STOMP_PASSWORD=artemis
# Env vars to configure the Neo4j db. Currently, these values are hardcoded in the tests
export NEO4J_USERNAME=neo4j
export NEO4J_PASSWORD=neo4jpassword
export NEO4J_DATABASE=neo4j
# Env vars to configure the PgVector db. Currently, these values are hardcoded in the tests
export POSTGRES_USER=postgres
export POSTGRES_PASSWORD=postgres
export POSTGRES_DB=postgres
# Env vars for the model serving
export MODEL_PATH=/Users/kabir/sourcecontrol/python/models
export MODEL_NAME=Phi-3-mini-4k-instruct-q4.gguf
# Groq
export GROQ_API_KEY=XXXXXXXXXXXXXX

We could go more fine-grained, and only require the exact variables for each test, but I think that will be very fiddly and time consuming to get right


get authentication for someone else

Hi,
is there some way how to get authentication for some user?
Let's imagine the workflow application:

User ABC creates some tasks in client application, which can run at any time (in 1 day or maybe in 10 days, or maybe in 1 month)
task is stored in repository and as metadata there is also stored user's ID (ID-ABC-123)
task is going to be executed, but it needs to be executed under user ABC because it uses another services which need to know about user context.

Authorization token could expire in meantime and storing the credentials is risky.
For this there is an option to create some "privileged" client and send some header (X-USER-ID) with user's id to the auth server. Auth server should validate the client and also user. If everything is ok, then try to change authentication. The client should use for this userInfoUri and get re-authenticated user.
Is in uaa implemented something similar?
Thanks

@bilak The refresh token serves as an offline token and is meant to be used on the users behalf to get more access tokens in an offline fashion after the original access token has expired.
Please refer to the refresh token flow here :  http://docs.cloudfoundry.org/api/uaa/#refresh-token


Change access modifier of wrap method in LockableTaskScheduler

I'm developing a multi-tenancy application that connects to different database servers. When configuring the lock provider our Datasource already supports multi-tenancy
@Bean
public LockProvider scheduledJobLockProvider(final DataSource dataSource) {
return new JdbcTemplateLockProvider(JdbcTemplateLockProvider.Configuration
		.builder()
                // The datasource is multi-tenant
		.withJdbcTemplate(new JdbcTemplate(dataSource))
		.withTableName("scheduled_tasks")
		.usingDbTime()
		.build());
}

but in order to work, we need to set the tenant in each Runnable of TaskScheduler using ThreadTenantContext.set("TENANT_1") before actual lock.
As I see the only way to achieve this is to wrap LockableRunnable by extending LockableTaskScheduler
Describe the solution you'd like
Please change the access modifier of wrap method in LockableTaskScheduler from private to protected.
Describe alternatives you've considered
Create my own implementation of TaskScheduler similar to LockableTaskScheduler

Hi, thanks for feedback. Isn't it possible to do the same by wrapping the LockProvider and set the thread local there?


⚠ Jurnal has degraded performance

In 2a5a6c3, Jurnal (https://jurnal.unmer.ac.id) experienced degraded performance:

HTTP code: 200
Response time: 10439 ms

Resolved: Jurnal performance has improved in 2b6d938.


What is "Direct Routing service numbers" ?

Under step 6's Note: "
Note
Direct Routing service numbers assigned to resource accounts for auto attendant and call queues are supported for Microsoft Teams users and agents only.
"
What is "Direct Routing service numbers" ? As I understand, the service numbers is working with the Calling Plan also, then I suggest to remove the "Direct Routing" , and chang to "Service numbers assigned to resource accounts for auto attendant and call queues are supported for Microsoft Teams users and agents only."

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: e0703860-c3db-c723-317f-7fab164c006d
Version Independent ID: c6384e2b-ac37-265d-8c33-f004eca97673
Content: Configure a resource account in Skype for Business Server 2019 - Skype for Business Hybrid
Content Source: Skype/SfbHybrid/hybrid/configure-onprem-ra.md
Product: skype-for-business-itpro
GitHub Login: @CarolynRowe
Microsoft Alias: crowe

@tangx007 Thank you for submitting feedback and contributing to the docs. We are currently investigating this.

Hi @tangx007, thank you for your feedback.
It's recommended that you first understand what is Direct Routing. Under the same step you can find the following sentence:
"You can assign a Direct Routing Hybrid number to your resource account. For details, see Plan Direct Routing."

Hi @dariomws , thank you for the clarify. I agree with you that I should understand the Direct Routing.
And you give me the information is for Direct Routing Hybrid number. But for this case, I am mension that is Under step 6's Note Direct Routing service numbers, as I understand, the service numbers is working with the Calling Plan only.
I dont know if you get point or not ? Looking forward to your update.

I suggest to remove the "Direct Routing" , and chang to "Service numbers assigned to resource accounts for auto attendant and call queues are supported for Microsoft Teams users and agents only."
Because it makes me a confuse which DID type I should use for the Teams User?

@tangx007, this issue is very similar or even the same as https://github.com/MicrosoftDocs/OfficeDocs-SkypeForBusiness/issues/4384.
This article is related to SfB Hybrid:
"Skype for Business Server 2019 hybrid implementations only use Cloud services provided by Phone System for unified messaging and do not integrate with Exchange Online. In Skype for Business Server 2019 you are now able to use the Cloud call queues and auto attendants described in Here's what you get with Phone System in Office 365.
To use an Phone System auto attendant or call queue with Skype for Business Server 2019, you will need to create resource accounts that act as application endpoints and can be assigned phone numbers, then use the online Teams admin center to configure the call queue or auto attendant. This resource account can be homed online (see Manage resource accounts in Microsoft Teams to create resource accounts homed online) or on premises as described in this article. Typically you will have multiple Phone System auto attendant or call queue nodes, each of which is mapped to a resource accounts, which can be homed online or in Skype for Business Server 2019."
For more information: https://docs.microsoft.com/skypeforbusiness/hybrid/plan-cloud-auto-attendant. I think the diagram there is self-explanatory.
Anyway, I'm reviewing the document again to see if we can improve it.

Hi @tangx007 we thank you for submitting feedback! This issue has been solved as well. However, for additional questions I think the best way forward is if you open a service ticket in your tenant so this can get resolved ASAP. Based on the outcome let me know if it is something that can be called out in the docs.
Please follow this link to contact support for business products:https://docs.microsoft.com/office365/admin/contact-support-for-business-products
Please keep us posted here on the resolution so we can feed whatever information you discover into the content.


Runtime error with any example that uses event_loop on unix port

I'm trying to get the examples working on a raspberry pi through the unix port, but keep running into this error whenever an example uses the event_loop function.
Traceback (most recent call last):
  File "example3.py", line 37, in <module>
  File "display_driver.py", line 2, in <module>
  File "display_driver_utils.py", line 35, in __init__
  File "display_driver_utils.py", line 163, in init_gui
  File "display_driver_utils.py", line 42, in init_gui_SDL
  File "lv_utils.py", line 95, in __init__
  File "lv_timer.py", line 142, in init
  File "lv_timer.py", line 103, in timer_create
RuntimeError: timer_create_ error: -1 (errno = 22)

Hi @jath03 !
Please specify: on which version of lv_micropython it happens, how you built it, what display driver you are using, etc.
Also provide information about the rpi board you are using, Linux version etc.
The error you are seeing means that timer_create function returned the error EINVAL.
According to the docs this means:

Clock ID, sigev_notify, sigev_signo, or sigev_notify_thread_id is invalid.

In the code we call timer_create like this:
https://github.com/lvgl/lv_binding_micropython/blob/341134744b2a919d8a9e7773bba1bdec0fa21b44/driver/linux/lv_timer.py#L98-L101
So:

clockid = CLOCK_MONOTONIC
sigev_notify = SIGEV_SIGNAL
sigev_signo = SIGRTMIN + sig_id

Looks like Linux on your side has some issue with one of these arguments.

lv_microython: commit 6ebf96a9032170a957dd07c83350480c08b79c78
built using the instructions in the README on the pi itself
SDL driver
Raspberry pi  3b
Linux 5.15.32-v7+

This is probably related to https://github.com/lvgl/lv_binding_micropython/issues/273, fixed in https://github.com/lvgl/lv_binding_micropython/pull/274.
Please reopen if it doesn't fix it.


Allow PR merge-only bots in dim-bots

Closes #2517

Thanks @fregante for the simplified selector
Test

aws-cdk:

commits authored by humans but merged by mergify shouldn't be dimmed
as is the case now, commits authored by dependabot should be dimmed

Excellent, it works! Thanks for the quick PR


[FLINK-21140][python] Extract zip file dependencies before adding to PYTHONPATH

What is the purpose of the change
Not all zip files are importable in Python and so we should expand zip file dependencies and add the root directory to PYTHONPATH. This pull request extracts zip file dependencies before adding to PYTHONPATH.
Brief change log

Update PythonEnvUtils to fix the client side
Update ProcessPythonEnvironmentManager to fix the server side

Verifying this change
This change added tests and can be verified as follows:

Updated PythonEnvUtilsTest and ProcessPythonEnvironmentManagerTest

Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): (no)
The public API, i.e., is any changed class annotated with @Public(Evolving): (no)
The serializers: (no)
The runtime per-record code paths (performance sensitive): (no)
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn/Mesos, ZooKeeper: (no)
The S3 file system connector: (no)

Documentation

Does this pull request introduce a new feature? (no)
If yes, how is the feature documented? (not applicable)

@WeiZhong94 Thanks a lot for the review. Updated the PR~

@WeiZhong94 Thanks a lot for the review. Updated the PR~


Replace XAML tokens

@Thraka You forgot to squash and merge?

Yep. I warned him about the PRs not being squashed offline. Thanks @NextTurn!


Disable linter on .text-hide to prevent error

Was causing our npm scripts to fail.

This is already done in v4-dev. I don't see why you need this.

Doh! Thanks, I thought I had merged v4-dev into my branch.


Failed to install @plone/volto, try again

Installation fails with:
marek@MONO ~/dev/kobra> create-volto-app my2-volto-app
/home/marek/.nvm/versions/node/v12.13.0/lib/node_modules/@plone/create-volto-app/volto-starter-kit

Creating my2-volto-app...

> Success! Created files for "my2-volto-app" Volto app

  Installing npm modules:
    @plone/volto

> Error! Failed to install @plone/volto, try again.
undefined

marek@MONO ~/dev/kobra> yarn -v
1.19.1
marek@MONO ~/dev/kobra> node -v
v12.13.0
marek@MONO ~/dev/kobra> npm -v
6.12.0

Node 12 has as far as I know only been added recently in the latest volto 4 alpha's.
You could try to install create-volto-app with Node 10, or install the alpha version, which will scaffold a volto 4 alpha app

I upgraded the app according to https://docs.voltocms.com/upgrade-guide/
that worked. The section in the README could be fixed, as the prerequisites (https://github.com/plone/volto#prerequisites) don't match the install section (https://github.com/plone/volto#create-volto-app)
btw. what is the way to install a fresh volto 4.0.0 app without using create-volto-app?


Future of alphaMode

In Blender's legacy EEVEE renderer, a material has a "Blend Mode" property that controls the interpretation of the alpha value produced from the node graph. For example, the nodes could calculate Alpha=0.5, but if the Blend Mode was "Opaque", the alpha value would be ignored and it would be rendered opaque. Both the importer and exporter have up to this point leaned on this feature to represent glTF's alphaMode+alphaCutoff properties.
However, this has only ever worked in EEVEE. In Cycles, alpha always has the normal interpretation as semi-transparency/coverage. If you want a surface to be opaque, the node graph should calculate Alpha=1, and not rely on an "after the fact" reinterpretation of the alpha value.
With Blender 4.1's introduction of the EEVEE-Next renderer with no Blend Mode, intended to eventually replace current (legacy) EEVEE, this addon should probably start thinking about moving to encoding alphaMode entirely in the node graph.
That would mean

alphaMode
Blender Implementation

OPAQUE
1.0→Alpha Socket

MASK
glTF alpha→[Math node: X >= alphaCutoff]→Alpha socket

BLEND
glTF alpha→Alpha socket

Import

OPAQUE and BLEND should already be correct.
For MASK, the base color code would learn how to insert a Greater-Than node in front of the Alpha socket (same as it worked in 2.79).
It can continue setting the Eevee Blend Mode for now.

Export

The alphaMode+alphaCutoff would need to be gathered from the Alpha socket. Constant 1 = OPAQUE, Greater-Than node = MASK, otherwise = BLEND.
Backwards compatibility considerations with current Blend Mode based setups?

Thoughts?

Note: EEVEE-next is postponed to 4.2

@julienduroure Did you decide if this idea sounds good to you?

Okay, the next problem is how to implement MASK mode. Spec says

5.19.10. material.alphaCutoff
Specifies the cutoff threshold when in MASK alpha mode. If the alpha value is greater than or equal to this value then it is rendered as fully opaque, otherwise, it is rendered as fully transparent. A value greater than 1.0 will render the entire material as fully transparent.

ie.
alpha = alpha >= cutoff ? 1.0 : 0.0;

The problem is Blender does not have a Greater-Than-Or-Equal node, only a Greater-Than node. So how to implement?
Ideas

When cutoff=0.5, round(alpha). Rounds 0.5 up to 1.0, so it's correct. Best by far, but only works for cutoff=0.5.
alpha > cutoff. ie. we simply do not guarantee correctness at the cutoff value. Simple, not correct.
1 - (alpha < cutoff). Correct, but requires two nodes, annoying to create.
alpha > cutoff - epsilon. Complicated, difficult to know whether it will actually be correct.
round(alpha * (0.5/cutoff)). ie. scale so cutoff=0.5, then round. The scaling would be absorbed into the alpha factor. Algebraically correct and superset of 1, but kind of complicated and irreversibly mixes the alpha factor and cutoff together.

What do you think? Can you think of another way to do it?

Hello! I'd like to suggest that during the import process, the Render Method could be set to "Blended" for materials utilizing alphaMode="BLEND" since it replaces Blend Mode: Alpha Blend

Material blend modes have been replaced by Material Render methods. Dithered render method replaces Hashed blend mode. Blended replaces Alpha blended. Alpha clipped should be solved in the shader.

Source

This is what is already planned.
See here :
https://github.com/KhronosGroup/glTF-Blender-IO/blob/49b79c301d21d6f12044016f10a34544d0f389f7/addons/io_scene_gltf2/blender/imp/gltf2_blender_material.py#L74

EEVEE next is now default since yesterday.
I am out of office this week, PR will be merged next week

Merged.
Thanks!

@julienduroure

This is what is already planned.

Sorry for bothering you but I'd like to know if this is still planned.
Currently, the function set_eevee_blend_method sets mat.blend_method to "BLEND", which only affects EEVEE Legacy. For EEVEE Next mat.surface_render_method should be set to "BLENDED" to match that. By default it's equal to "DITHERED", which matches the "HASHED" blend method in EEVEE Legacy.
Also, I think in cases where a material uses the "BLENDED" render method alphaMode can be always set to BLEND on export (even if the alpha channel is unused) since this mode might also disable depth testing and affect the rendering order.

Also, I think in cases where a material uses the "BLENDED" render method alphaMode can be always set to BLEND on export (even if the alpha channel is unused)

I disagree. Blender modes DITHERED and BLENDED are two approximations to the same ideal OIT result, also implied by glTF's BLEND. Essentially they let you trade noise for order-independence. These do no correspond to anything in glTF, because glTF leaves the choice of OIT method entirely up to the implementation. Therefore surface_render_method should be completely ignored by the exporter.
For importing, OPAQUE and MASK should use DITHERED, since DITHERED is guaranteed correct and noiseless when we know alpha is always 0 or 1. For BLEND, either DITHERED or BLENDED is correct, because, again, the choice is entirely up to us as the glTF consumer.

since this mode might also disable depth testing and affect the rendering order.

This is not implied by glTF's BLEND mode. These are concepts that exist only in certain rendering implementations, and again, BLEND specifies only the ideal result, not any particular rendering method.
Don't make the mistake of thinking BLEND corresponds to Blender BLENDED or to naive glEnable(GL_BLEND) just because of the names. It's perfectly possible for a glTF viewer to use alpha hashing for it's BLEND approximation for example.

Here's what the spec says about BLEND

BLEND - The rendered output is combined with the background using the “over” operator as described in [Porter and Duff's "Compositing digital images" paper].

Implementation Note for Real-Time Rasterizers
Real-time rasterizers typically use depth buffers and mesh sorting to support alpha modes. The following describe the expected behavior for these types of renderers. [...]
BLEND - Support for this mode varies. There is no perfect and fast solution that works for all cases. Client implementations should try to achieve the correct blending output for as many situations as possible. Whether depth value is written or whether to sort is up to the implementation. For example, implementations may discard pixels that have zero or close to zero alpha value to avoid sorting issues.

The glTF spec says:

BLEND - The rendered output is combined with the background using the “over” operator as described in Compositing digital images.

This implies some order and, as far as I know, that is not how the HASHED method works. It's rather a hack that gives an illusion of transparency that works by randomly replacing some fragments without combining them.

The previous color will be overwritten by the surface color, but only if the alpha value is above a random clip threshold.

Use noise to dither the binary visibility

The BLENDED method would fit better in this case since it uses forward rendering for translucent meshes and combines fragments.
Also, the spec doesn't necessarily imply that OIT techniques should be used. Instead, it's up to each implementation to decide how it handles the ordering issue. It even acknowledges that

Real-time rasterizers typically use depth buffers and mesh sorting to support alpha modes.

Maybe, that's why the render_method should not be ignored.

Both HASHED and BLENDED are approximations to the ideal OIT result. Neither is strictly closer to BLEND than the other, that's why they both exist.

Both HASHED and BLENDED are approximations to the ideal OIT result.

HASHED is an  approximation to the ideal OIT result but BLENDED is not order independent. I looked at the source code of EEVEE Next and it seems like it still sorts translucent objects based on their world location.
https://github.com/blender/blender/blob/d1782f13c81004646f7cd6050c9a6d8c5dfcde7b/source/blender/draw/engines/eevee_next/eevee_pipeline.cc#L383
https://github.com/blender/blender/blob/d1782f13c81004646f7cd6050c9a6d8c5dfcde7b/source/blender/draw/intern/draw_pass.hh#L476
https://docs.blender.org/manual/en/4.2/render/eevee/materials/settings.html#sorting-problem

When writing to the color buffer using transparent blend modes, the order in which the color blending happens is important as it can change the final output color. As of now EEVEE does not support per-fragment (pixel) sorting or per-triangle sorting. Only per-object sorting is available and is automatically done on all transparent surfaces based on object origin.

Neither is strictly a better fit to BLEND than the other, that's why they both exist.

They have their own use cases but why wouldn't BLENDED be a better fit if the way it works seems to be closer to what the glTF spec describes as blending (combining colors using "over" operator)?

BLENDED is not order independent. I looked at the source code of EEVEE Next and it seems like it still sorts translucent objects based on their world location.

Yes. If BLENDED were completely order-independent it would be exact and not an approximation.
The trade-off is DITHERED is robust and order-independent but is noisy, while BLENDED is exact when you can ensure there are no sorting issues, but can be catastrophically wrong when you can't.

They have their own use cases but why wouldn't BLENDED be a better fit if the way it works seems to be closer to what the glTF spec describes as blending (combining colors using "over" operator)?

Because it isn't closer. DITHERED is also an approximation to the "over" operator!
For an obvious example, consider the case where every fragment in the whole frame has alpha either 0 or 1. Then DITHERED is exactly correct, whereas BLENDED may still have arbitrarily large sorting issues.

Anyway, there doesn't seem to be any point to it in the first place. If there's a Round or >= node, we have to use MASK mode regardless of BLENDED/DITHERED, since that's the only way to get that effect in glTF. And if the Alpha is 1, there's no point to using BLEND instead of OPAQUE in the first place. In all other cases we use BLEND regardless of DITHERED/BLENDED anyway.

BLENDED and DITHERED are both approximations to the correct result. However, only DITHERED is an approximation to the "over" operator, BLENDED does combine fragments.

BLENDED is exact when you can ensure there are no sorting issues, but can be catastrophically wrong when you can't.

DITHERED can also be wrong. For instance, in this case two planes occupy the same space.
When the render method is BLENDED the second plane is correctly rendered on top of the first one.

if the Alpha is 1, there's no point to using BLEND instead of OPAQUE

Reordering and disabling depth could be that reason.

In all other cases we already use BLEND

It currently works for EEVEE Legacy. glTF materials that use alphaMode=BLEND end up using two different render methods in different Blender rendering engines.

As I've already said, BLEND does not mean "render in a second pass and disable depth".

I realize that but as glTF spec says that's how it's usually handled by real time render engines (which glTF was initially intended for) so this probably should be taken into consideration

It literally says nothing about if the depth test should pass on equality.

I don't really have a problem with importing BLEND as BLENDED btw. And the cloud example will export as BLEND regardless of surface_render_method.

It literally says nothing about if the depth test should pass on equality.

Right, but it seems like different rendering engines are able to correctly handle this case especially if one of the planes uses alphaMode=BLEND

I don't really have a problem with importing BLEND as BLENDED btw

Thanks. I appreciate that since this would otherwise could be somewhat problematic. I apologize if this conversation took longer than expected

Current status:

There is a PR for Blender that will redirect blend_method to surface_render_method in the Python API. This means glTF OPAQUE and MASK will import as Blender DITHERED and BLEND will import as BLENDED, no code changes needed on the glTF side. (Of course, it will still be good to migrate to the new API after that PR is merged.)
There is an issue for automatically updating old .blend files that used Alpha Clip to use a Greater-Than node. For backwards compatibility reasons, the glTF exporter will need to recognize a > node and export it as MASK.
The glTF importer/exporter needs to make sure the node setup it recognizes is compatible with USD import/export, since USD has the same feature (called opacityThreshold there). Post about this on the forums

Also this issue should probably be reopened to track progress on this for the 4.2 release.

There is a PR for Blender that will redirect blend_method to surface_render_method in the Python API. This means glTF OPAQUE and MASK will import as Blender DITHERED and BLEND will import as BLENDED, no code changes needed on the glTF side. (Of course, it will still be good to migrate to the new API after that PR is merged.)

I will notify when this PR will be merged. In case I miss it, feel free to ping me

There is an issue for automatically updating old .blend files that used Alpha Clip to use a Greater-Than node. For backwards compatibility reasons, the glTF exporter will need to recognize a > node and export it as MASK.

As you implement the initial work on this, do you plan to propose a PR for this enhancement?

The glTF importer/exporter needs to make sure the node setup it recognizes is compatible with USD import/export, since USD has the same feature (called opacityThreshold there). Post about this on the forums

I have in my TODO list to have a talk with USD devs to detail some area where we should be more aligned / discuss

For backwards compatibility reasons, the glTF exporter will need to recognize a > node and export it as MASK.

diff --git a/addons/io_scene_gltf2/blender/exp/material/gltf2_blender_search_node_tree.py b/addons/io_scene_gltf2/blender/exp/material/gltf2_blender_search_node_tree.py
index b33fa544..2960ca58 100644
--- a/addons/io_scene_gltf2/blender/exp/material/gltf2_blender_search_node_tree.py
+++ b/addons/io_scene_gltf2/blender/exp/material/gltf2_blender_search_node_tree.py
@@ -512,10 +512,6 @@ def gather_alpha_info(alpha_nav):
 #
 # If detected, alpha_nav is advanced to point to the new Alpha socket
 # and the alphaCutoff value is returned. Otherwise, returns None.
-#
-# Nodes will look like:
-#  Alpha -> [Math:Round] -> Alpha Socket
-#  Alpha -> [Math:X < cutoff] -> [Math:1 - X] -> Alpha Socket
 def detect_alpha_clip(alpha_nav):
     nav = alpha_nav.peek_back()
     if not nav.moved:
@@ -529,7 +525,7 @@ def detect_alpha_clip(alpha_nav):

     # Detect 1 - (X < cutoff)
     # (There is no >= node)
-    elif nav.node.type == 'MATH' and nav.node.operation == 'SUBTRACT':
+    if nav.node.type == 'MATH' and nav.node.operation == 'SUBTRACT':
         if nav.get_constant(0)[0] == 1.0:
             nav2 = nav.peek_back(1)
             if nav2.moved and nav2.node.type == 'MATH':
@@ -546,6 +542,21 @@ def detect_alpha_clip(alpha_nav):
                     alpha_nav.assign(nav2)
                     return in0

+    # Detect (X > cutoff)
+    # Wrong when X = cutoff, but backwards compatible with legacy
+    # Alpha Clip setup
+    if nav.node.type == 'MATH':
+        in0 = nav.get_constant(0)[0]
+        in1 = nav.get_constant(1)[0]
+        if nav.node.operation == 'GREATER_THAN' and in1 is not None:
+            nav.select_input_socket(0)
+            alpha_nav.assign(nav)
+            return in1
+        elif nav.node.operation == 'LESS_THAN' and in0 is not None:
+            nav.select_input_socket(1)
+            alpha_nav.assign(nav)
+            return in0
+
     return None

Merged. Closing

The blend_method code can be replaced.

Ah, yes, Legacy EEVEE is gone now.
Can you confirm everything is ok in #2264 ?

Looks fine.


Only the abstract photo style is working

i was only able to use the asbtract photo style every other style give me this error
Downloading my little pony weights (This may take a while)... Download complete Traceback (most recent call last):   File "c:/Users/JF/Desktop/music/music.py", line 10, in <module>     L.hallucinate(file_name = 'hills_pony.mp4')   File "C:\Users\JF\AppData\Local\Programs\Python\Python37\lib\site-packages\lucidsonicdreams\main.py", line 636, in hallucinate     self.stylegan_init()   File "C:\Users\JF\AppData\Local\Programs\Python\Python37\lib\site-packages\lucidsonicdreams\main.py", line 126, in stylegan_init     self.Gs = pickle.load(f)[2]   File "C:\Users\JF\AppData\Local\Programs\Python\Python37\lib\site-packages\dnnlib\tflib\network.py", line 279, in __setstate__     assert state["version"] in [2, 3] AssertionError

Having same issue

Even manually downloading the weights gave me a compile error

Same, I'm debugging it right now but I can't seem to find the root of the error

Similar error I'm getting with anime faces:
Preparing style...
Downloading anime faces weights (This may take a while)...
Download complete
---------------------------------------------------------------------------
UnpicklingError                           Traceback (most recent call last)
<ipython-input-4-447c2cb44ba3> in <module>()
      9               resolution = 360,
     10               start = 30,
---> 11               duration = 45)
     12
     13 files.download("chemical_love.mp4")

1 frames
/usr/local/lib/python3.7/dist-packages/lucidsonicdreams/main.py in hallucinate(self, file_name, output_audio, fps, resolution, start, duration, save_frames, batch_size, speed_fpm, pulse_percussive, pulse_harmonic, pulse_react, motion_percussive, motion_harmonic, motion_react, motion_randomness, truncation, classes, dominant_classes_first, class_pitch_react, class_smooth_seconds, class_complexity, class_shuffle_seconds, class_shuffle_strength, contrast_strength, contrast_percussive, flash_strength, flash_percussive, custom_effects)
    634
    635       if not callable(self.style):
--> 636         self.stylegan_init()
    637
    638       self.style_exists = True

/usr/local/lib/python3.7/dist-packages/lucidsonicdreams/main.py in stylegan_init(self)
    124     # Load weights
    125     with open(weights_file, 'rb') as f:
--> 126       self.Gs = pickle.load(f)[2]
    127
    128     # Auto assign num_possible_classes attribute

UnpicklingError: invalid load key, '\xfd'.

i was only able to use the asbtract photo style every other style give me this error
Downloading my little pony weights (This may take a while)... Download complete Traceback (most recent call last): File "c:/Users/JF/Desktop/music/music.py", line 10, in <module> L.hallucinate(file_name = 'hills_pony.mp4') File "C:\Users\JF\AppData\Local\Programs\Python\Python37\lib\site-packages\lucidsonicdreams\main.py", line 636, in hallucinate self.stylegan_init() File "C:\Users\JF\AppData\Local\Programs\Python\Python37\lib\site-packages\lucidsonicdreams\main.py", line 126, in stylegan_init self.Gs = pickle.load(f)[2] File "C:\Users\JF\AppData\Local\Programs\Python\Python37\lib\site-packages\dnnlib\tflib\network.py", line 279, in __setstate__ assert state["version"] in [2, 3] AssertionError

I think your issue comes from here: https://github.com/mikaelalafriz/lucid-sonic-dreams/issues/3#issuecomment-799151100
Lucid Sonic Dreams uses the stylegan2 repo that is downloaded from main.py, and the dnnlib folder is different from the one you used for your comment above, thus making the error.

Concerning the use of other styles, I think the main issue comes from the OS you use.
Stylegan2 is supported for tensorflow 1.15 on Linux, but not on Windows: https://github.com/NVlabs/stylegan2#requirements
Lucid Sonic Dreams uses tensorflow 1.15.
The wikiart style works well on Linux for me.
But on Windows, I've got an error with Setting up TensorFlow plugin "fused_bias_act.cu" and it seems to be linked with the C++ headers mentioned in my previous link.

The error is related to the pickle protocol version in your Python installation. I had version 5 and, since the assertion in line 279 of dnnlib/tflib/network.py checks for versions 2, 3 and 4, I simply added 5 in there and I was able to use custom style weights.
Hope this helps!

no sure what i ma suppose to add when i go to the line 279 in network.py i see this function
     @property     def own_vars(self):         """Variables defined by this network (local_name => var), excluding sub-networks."""         return copy.copy(self._get_own_vars())

@uhapppy I think you might be looking at the wrong file. in your original reply:

i was only able to use the asbtract photo style every other style give me this error
Downloading my little pony weights (This may take a while)... Download complete Traceback (most recent call last): File "c:/Users/JF/Desktop/music/music.py", line 10, in <module> L.hallucinate(file_name = 'hills_pony.mp4') File "C:\Users\JF\AppData\Local\Programs\Python\Python37\lib\site-packages\lucidsonicdreams\main.py", line 636, in hallucinate self.stylegan_init() File "C:\Users\JF\AppData\Local\Programs\Python\Python37\lib\site-packages\lucidsonicdreams\main.py", line 126, in stylegan_init self.Gs = pickle.load(f)[2] File "C:\Users\JF\AppData\Local\Programs\Python\Python37\lib\site-packages\dnnlib\tflib\network.py", line 279, in __setstate__ assert state["version"] in [2, 3] AssertionError

the error message indicates line 279 in the network.py file (File "C:\Users\JF\AppData\Local\Programs\Python\Python37\lib\site-packages\dnnlib\tflib\network.py", line 279, in __setstate__ assert state["version"] in [2, 3] AssertionError). You need to change that line to assert state["version"] in [2, 3, 4, 5] (depending on your pickle protocol version, I added both 4 and 5 here since your version of network.py seems to only have 2 and 3.

actually i check and the original function is
`    def setstate(self, state: dict) -> None:
"""Pickle import."""
    # Execute custom import handlers.
    for handler in _import_handlers:
        state = handler(state)

    # Get basic fields.
    assert state["version"] in [2, 3, 4, 5]
    name = state["name"]
    static_kwargs = state["static_kwargs"]
    build_module_src = state["build_module_src"]
    build_func_name = state["build_func_name"]`

@uhapppy okay, so if the error is still AssertionError, it means that your state['version'] value is not in array [2, 3, 4, 5]. You can insert print(state["version"]) right before the assertion to see which version you have and then insert that value to the array in the next line. this way, you are guaranteed to get rid of the AssertionError, which is the original error in this issue. In my case, it did not break anything and I was able to use custom weights.

@dogadikbayir i dont know why but i put the print statement right before the assertion an run the file that i use to generate music video wich was the file that was giving the error but i still get the same error and noprint output i tried other print statement to see if it was just the state thing that was bug but still nothing

@uhapppy can you please share the error message you are getting right now?

Hmm that didnt fix for me either Im geting this error
Traceback (most recent call last):
File "lucid.py", line 18, in
flash_strength = 0.7)
File "C:\Python37\lib\site-packages\lucidsonicdreams\main.py", line 680, in hallucinate
self.generate_frames()
File "C:\Python37\lib\site-packages\lucidsonicdreams\main.py", line 525, in generate_frames
np.tile(class_batch, (batch_size, 1)))
File "C:\Python37\lib\site-packages\dnnlib\tflib\network.py", line 604, in run
out_gpu = net_gpu.get_output_for(*in_gpu, return_as_list=True, **dynamic_kwargs)
File "C:\Python37\lib\site-packages\dnnlib\tflib\network.py", line 350, in get_output_for
self._get_vars()  # ensure that all variables have been created
File "C:\Python37\lib\site-packages\dnnlib\tflib\network.py", line 297, in _get_vars
self._vars = OrderedDict(self._get_own_vars())
File "C:\Python37\lib\site-packages\dnnlib\tflib\network.py", line 286, in _get_own_vars
self._init_graph()
File "C:\Python37\lib\site-packages\dnnlib\tflib\network.py", line 126, in _init_graph
assert self._input_templates is None
AssertionError

@dogadikbayir i manage to figure it out i add version 5 to the assert state(seem like the network.py that i open file was not the right one  ) but i get still get an error and now it is
 File "c:/Users/JF/Desktop/music/music.py", line 10, in <module>     L.hallucinate(file_name = 'hours2.mp4')   File "C:\Users\JF\AppData\Local\Programs\Python\Python37\lib\site-packages\lucidsonicdreams\main.py", line 636, in hallucinate     self.stylegan_init()   File "C:\Users\JF\AppData\Local\Programs\Python\Python37\lib\site-packages\lucidsonicdreams\main.py", line 126, in stylegan_init     self.Gs = pickle.load(f)[2]   File "C:\Users\JF\AppData\Local\Programs\Python\Python37\lib\site-packages\dnnlib\tflib\network.py", line 291, in __setstate__     exec(self._build_module_src, module.__dict__) # pylint: disable=exec-used   File "<string>", line 13, in <module> ModuleNotFoundError: No module named 'dnnlib.tflib.ops'

@masterofshapes I could not find the assert self._input_templates is None line in my version of network.py, so I think we are using different versions of dnnlib. I used the dnnlib in this repository. You could try to clone the stylegan2-ada repo in the link into C:\Python37\lib\site-packages/lucidsonicdreams/stylegan2 and you could replace C:\Python37\lib\site-packages\dnnlib with the dnnlib folder inside the cloned repo.
@uhapppy I think your problem could also be related to the dnnlib version you are using, you could try the same procedure I've described above.
If this does not work out for you guys, I think it could be a Windows related bug, I am using Linux.
Hope this helps!

@dogadikbayir i did everything you said it get me farter this time the code work until it reach the hallucinating part now i get this error
Traceback (most recent call last):   File "c:/Users/JF/Desktop/music/music.py", line 10, in <module>     L.hallucinate(file_name = 'hours2.mp4')   File "C:\Users\JF\AppData\Local\Programs\Python\Python37\lib\site-packages\lucidsonicdreams\main.py", line 680, in hallucinate     self.generate_frames()   File "C:\Users\JF\AppData\Local\Programs\Python\Python37\lib\site-packages\lucidsonicdreams\main.py", line 525, in generate_frames     np.tile(class_batch, (batch_size, 1)))   File "C:\Users\JF\AppData\Local\Programs\Python\Python37\lib\site-packages\dnnlib\tflib\network.py", line 604, in run     out_gpu = net_gpu.get_output_for(*in_gpu, return_as_list=True, **dynamic_kwargs)   File "C:\Users\JF\AppData\Local\Programs\Python\Python37\lib\site-packages\dnnlib\tflib\network.py", line 350, in get_output_for     self._get_vars()  # ensure that all variables have been created   File "C:\Users\JF\AppData\Local\Programs\Python\Python37\lib\site-packages\dnnlib\tflib\network.py", line 297, in _get_vars     self._vars = OrderedDict(self._get_own_vars())   File "C:\Users\JF\AppData\Local\Programs\Python\Python37\lib\site-packages\dnnlib\tflib\network.py", line 286, in _get_own_vars     self._init_graph()   File "C:\Users\JF\AppData\Local\Programs\Python\Python37\lib\site-packages\dnnlib\tflib\network.py", line 126, in _init_graph     assert self._input_templates is None

@masterofshapes @uhapppy my bad, I found the assertion, for self._input_templates in my version too. in this case, I need to reproduce the problem on my own machine to help you guys out further. however, the new error is also an AssertionError and it is caused because the self._input_templates property of the class is not None at the time of the assertion. In my case it is None so I am not getting the error. you could trace the value of  self._input_templates to find the place where it is being set to a value other than None.

@dogadikbayir good tanks you very much for your time  let us know if you find something

FYI I had the same AssertionError which happened because I had stylegan2-ada folder in the same location where I installed lucid sonic dreams.
I run pip uninstall lucidsonicdreams
Created a new folder
Run pip install lucidsonicdreams
and it worked with custom models.


odo delete is not deleting user created storage

/kind bug

What versions of software are you using?
Operating System:
Output of odo version:
How did you run odo exactly?
odo component has following storage.
$ odo describe
Component Name: nodejs-mytest1-mhaz
Type: nodejs
Source: file://./
Environment Variables:
 · DEBUG_PORT=5858
Storage:
 · nodejs-mytest1-mhaz-csgq of size 1Gi mounted to /tmp1

When odo delete command is run, it gives message of deleting storage but it is not actually deleting it.
$ odo delete
This component has following storages which will be deleted with the component
Storage nodejs-mytest1-mhaz-csgq of size 1Gi
? Are you sure you want to delete nodejs-mytest1-mhaz from app? Yes
 ✓  Deleting component nodejs-mytest1-mhaz [213ms]
 ✓  Component nodejs-mytest1-mhaz from application app has been deleted

$ oc get pvc nodejs-mytest1-mhaz-csgq-app-pvc
NAME                               STATUS   VOLUME   CAPACITY   ACCESS MODES   STORAGECLASS   AGE
nodejs-mytest1-mhaz-csgq-app-pvc   Bound    pv0013   100Gi      RWO,ROX,RWX                   3m35s

Actual behavior
What should be the behavior of odo when odo delete command is run.  It should delete user created pvc along with or not?
I think Ideally user created persistent volume to have persisted data. so deleting along with component deletion is not right.
option1:  Delete user created storage with odo delete

This needs to be fixed as currently we are only showing message, not actually deleting the pvc.

option2: Do not Delete user created storage with odo delete

The message in odo delete needs to be updated.
behavior of odo push after odo delete? as it will give error storage already exist . Proceed for component creation and show storage exist error as message?

$ odo push
Validation
 ✓  Checking component [25ms]

Configuration changes
 ✗  Failed to create component with name nodejs-mytest1-mhaz. Please use `odo config view` to view settings used to create component. Error: unable to create PVC: unable to create PVC: persistentvolumeclaims "nodejs-mytest1-mhaz-csgq-app-pvc" already exists

Expected behavior
Any logs, error output, etc?

From the Integration tests[1] it is evident that we want to delete user pvc with odo delete
[1 ]https://github.com/openshift/odo/blob/master/tests/integration/component.go#L834.
The above tests is also missed to catch that pvc is not deleted
cc @girishramnani  as discussed on slack we should go with option2, I am not sure how to proceed for odo push after that.

as discussed with @kadel we need to delete user created pvc with odo delete , as it was an input from odo users and to keep it simple..lets currently delete pvc with odo delete.

You can add owner reference to the pvc and that should get deleted if dc is deleted

You can add owner reference to the pvc and that should get deleted if dc is deleted

It's already there in PVC since we merged #2125.

You can add owner reference to the pvc and that should get deleted if dc is deleted

It's already there in PVC since we merged #2125. Unless there's a bug in the code added via that PR.
No ownerReference being passed here :)
https://github.com/openshift/odo/blob/master/pkg/occlient/volumes.go#L16

Umm, are you looking at the right place? I see two calls to CreatePVC function in occlient.go file and they both have ownerReference.

https://github.com/openshift/odo/blob/e170ddee351452f1b208d66364c62900a6571d0c/pkg/occlient/occlient.go#L1199

https://github.com/openshift/odo/blob/e170ddee351452f1b208d66364c62900a6571d0c/pkg/occlient/occlient.go#L1576

While odo push storage is created from here, and it is not passing ownerRef
https://github.com/openshift/odo/blob/2faf28420a64a238f1661560a01335c401cc32b6/pkg/storage/storage.go#L48

I recently raised a PR which was supposed to update owner references for storage https://github.com/openshift/odo/pull/2533. The problem is in the function updateStorageOwnerReference where I updated the owner references to the outdated PVC instead of the latest one. I will send a fix asap.
/assign

@mik-dass Thanks!!


is there a package on pypi?

Hello @fy0, there isn't a package on PyPI. Currently this repository is just a simple explainer on how to create a usable python module for Windows.

ok, thx for reply


moment.duration(): full support for Weeks expression

Hi,
this is more of a question:
Example:
moment.duration('P1Y2M3W') throws currently uncaught exception: "P1Y2M3W" is an invalid ISO 8601 duration.
However, the nW expression for weeks seems to be an equal property of ISO 8601 durations

http://en.wikipedia.org/wiki/ISO_8601#Durations

This might be not fixable, because the core  moment.duration() method doesn't support a week property. Is this why you supply already PnW as a kind of special case?
Hope this makes sense,
jb

Actually, I think I mis-read the wikipedia

Durations are represented by the format P[n]Y[n]M[n]DT[n]H[n]M[n]S or P[n]W

Apologies, I missed the OR in the statement.
Still, https://github.com/nezasa/iso8601-js-period accepts and parses durations like P1Y2M3W. Do you consider this behaviour as non-conformant?

I actually think that the fix is non conformant of the specification and that if you use weeks representation of durations you either use the first format OR the last one, not a mix of both.
If we mix them, then we need to pass along some sort of setting to tell whatever framework is handling this for us in what format we want to receive back. Say you created a duration with moment.duration(a bunch of milliseconds that matches exactly a week) there is no way for us to tell if we should show P1W or P7D. Also, what happens if we have a duration of slightly more than a week, 8 days, and request the week format. Should it give us a float or should we just get the rounded part? I see no mention of this in the spec.

Thank you, this makes sense.


User primary inputmask alias

Since jquery.inputmask was renamed to just inputmask, this change is necessary in order to keep dependencies more stable. There's an alias to old name but it failed recently.

Q
A

Is bugfix?
no

New feature?
no

Breaks BC?
no

Tests pass?
?

Fixed issues
-

Changelog added. I don't think this change makes any difference to end user so see no need to mention it in UPGRADE.

I don't think this change makes any difference to end user so see no need to mention it in UPGRADE.

If someone relies on the path of installed packages it will break, so we should mention it. AssetManager may be configured manually.

Indeed. Done.


Page is Missing the 'Next Sections' Box

https://developers.google.com/web/fundamentals/principles/orientation-works-best
The whole site should be checked.

Not all sections or areas have this.


chore: update Copyrights to Google LLC

AngularJS is in LTS mode
We are no longer accepting changes that are not critical bug fixes into this project.
See https://blog.angular.io/stable-angularjs-and-long-term-support-7e077635ee9c for more detail.

Does this PR fix a regression since 1.7.0, a security flaw, or a problem caused by a new browser version?
No
What is the current behavior?
The Copyrights currently use the old name, Google, Inc. You can see here that the new name is Google LLC and that Google, Inc. is the former name.
What is the new behavior?
Use Google LLC as the name. This is consistent with the angular/angular LICENSE.
Does this PR introduce a breaking change?
No
Please check if the PR fulfills these requirements

[x] The commit message follows our guidelines
[ ] Fix/Feature: Docs have been added/updated
[ ] Fix/Feature: Tests have been added; existing tests pass

Other information:

These are just changes to comments. The Saucelabs unit test failures on Windows appear to be flakes.

Review feedback addressed. Thank you.

Rebased to give CI another chance to pass the unit tests...

Thx, @Splaktar! Can you please replace #27880 with  angular/angular#27880 in the commit message?

Doh, sorry about that, done.

CI has successfully run for this change as part of #17079.


Upgrade to Ember 3

@acorncom I'm not sure why the build is showing as failed. If you click into the travis builds, it actually shows all tests as succeeding and then the build exits.

@elwayman02 Hmm, weird. I'm sadly not a maintainer on this repo, @michalsnik do you have any thoughts?

Hey @elwayman02 and @acorncom :)
Thanks for working on this! It looks like The command "yarn lint:js" exited with 1.

@michalsnik should be good to go now! Thanks for the review :)

Awesome, looking forward to this!

Yay, waiting for this as well :)

@michalsnik do you have any remaining concerns I should address before you can merge this PR?

v1.0.0 released. Enjoy and sorry for the delay guys :)


Make it installable with pip.

I took the liberty to change the setup.py so it is now possible to install with pip without manual interventions.
So it can now be installed like so:
pip install git+https://github.com/someburner/pyBlufi.git

Also change the README to now also letting users know.

Thank you. I will review and merge this soon. There are some fixes for linux I was going to put in since it had been a while since I tested with bluez.
Also @tacozMacleo would you be able to test changes on occasion if I tag you? And if so what OS do you use with this primarily?

That should be a possibility. But it is with a finish product, so it can only be what that product are able to. =)

That should be a possibility. But it is with a finish product, so it can only be what that product are able to. =)

Of course. It's just to make sure my changes don't break things for people. I have noticed issues on linux vs mac, and also differences between linux / bluez versions.
Are you using MacOS or Linux? And if Linux, what bluez version?

Yes I do use Linux and bluez 5.69-1.fc38 on my desktop...

okay can you try with this branch:
https://github.com/someburner/pyBlufi/tree/dev-linux-fixes
And see if it breaks things for you? On my arch install with bluez 5.73 things the original code does not work.

may need to pip install colorlog since I added that for debugging.

with blueZ 5.72-1.fc38 it fails at client.py:219
on another pc with blueZ 5.69-1.fc38, it is bleak that fails, in connection. But it can find it.

Thanks. May have to put some kind of bluez version detection in there. I'll let you know once I get that.


How to style the preview with css?

Hi! I am finding this plugin more and more useful! Thanks!
Is there a way to style the previews with css? Joplin has custom css table option. This would probably work. But is there a class list for styling or something?

Use the develop tools to inspect the elements. There are many entries on the CSS topic in the Joplin forum.
Example of one element:

Thanks. Will do that.


Convert the StableVec class to use virtual addressing

Problem
When doing a 32-bit build of Agave, pointers are of course 32 bits. The StableVec class is used to store vectors within the interpreter's 64-bit address space, but uses a Rust pointer to point to its data (and usize for both cap and len fields).
Summary of Changes
This PR updates the StableVec to use u64s for virtual addresses and sizes, rather than the compilers pointer and usize type, which are 32 bits in a 32-bit build, even though they contain 64-bit virtual addresses.
This could lead to an issue if this class were used to copy vectors between physical and virtual space (e.g. a StableVec that actually points to data in physical memory but tries to have a capacity that doesn't fit in 32 bits), but at worst that would only be an issue for 32-bit builds, not the usual 64-bit ones, and that also does not appear to be something that actually happens. StableVec is used to store vectors in situations where the exact memory layout cannot change, i.e. inside the vm space, not as an kind of enhanced version of Rust's usual Vector class.
Fixes #

@alessandrod @Lichtso 32-bit build fixes (PR 2 of 2, so far)


File permissions do not persist

Currently, whenever a file is added to the registry, filename.txt.gpg will be created and saved with 644 permissions. When it's decrypted, same story, 644. I'd like to be able to have whatever the permissions were at time of encryption persist through the process, so if I have something set to 600, it gets decrypted to 600.

Would it be sufficient to set the perms on the decrypted file to match the perms on the .gpg file?
The decrypt function could:
chmod --reference filename.txt.gpg filename.txt
We could probably do something similar when registering the file.
Reference:
http://unix.stackexchange.com/questions/20645/clone-ownership-and-permissions-from-another-file

yup, that'd work great!

That would be so great and would remove the bad permissions with SSH/SCP warning us that the private key is unprotected when the permissions are 644 when decrypted instead of 600.

That should do it.  Re-open this ticket if it doesn't work.

Sadly this breaks on MacOS.  I'm working on a patch.

Fixed in aee22fc

Awesome! :tada:

This is not working on homebrew blackbox version 1.20181219 (macOS 10.14.4, GPG 2.1) for a file that has 400 permissions. When decrypting, it stores the file as 644


Tools folder extension

The tool "aio-analyzer.py" is currently available within a repository only:
RobotFramework_AIO\test\aio-analyzer\aio-analyzer.py
but is not part of any installation. To make the tool available for users also I suggest to let the
build process copy the tool to
%RobotToolsPath%\aio-analyzer\aio-analyzer.py

solved and merged with #37


fix(CX-2968): Do Not Hide StatusBar on Median Sale Price Chart Screen

Description

This PR hides the status bar on the Median Sale Price Chart screen instead of hiding it when career highlight is selected.

This PR resolves CX-2968
https://user-images.githubusercontent.com/18648835/194526218-4744be2d-e16c-4e20-839d-4c29472fcdc9.mov
QA Testing

Acceptance Criteria

Setup Instructions

PR Checklist

[x] I tested my changes on iOS / Android.
[x] I added screenshots or videos to illustrate my changes.
[ ] I added Tests and Stories for my changes.
[ ] I added an app state migration.
[ ] I hid my changes behind a feature flag.
[ ] I have prefixed changes that need to be tested during a release QA with [NEEDS EXTERNAL QA] on the changelog.

To the reviewers 👀

[ ] I would like at least one of the reviewers to run this PR on the simulator or device.

Changelog updates
Changelog updates

Cross-platform user-facing changes

Do Not Hide StatusBar on Median Sale Price Chart Screen - kizito

iOS user-facing changes

Android user-facing changes

Dev changes

Need help with something? Have a look at our docs, or get in touch with us.

@lordkiz would you mind adding a video showing the new behaviour?

@lordkiz would you mind adding a video showing the new behaviour?

Sure 👍

i don't feel like this is good UX, I find the first screen jump very weird. can you run it with Dascha

i don't feel like this is good UX, I find the first screen jump very weird. can you run it with Dascha

Yes @MounirDhahri . The backdrop from the bottomsheet cannot overlay over the statusbar and that is the reason for hiding the StatusBar on this screen and that would inevitably cause a jump initially. It seems better than having multiple jumps whenever the bottomsheet shows up and whenever it closes.
Maybe what we can do differently is:

Keep the StatusBar
Remove the backdrop from BottomSheet
Add our own overlay on the screen when the BottomSheet shows up which should then draw behind the StatusBar
I will try it this way.

Nice, thanks for making the changes. Something seems to off for me though on iOS
https://user-images.githubusercontent.com/11945712/194528321-d51a66d2-cdde-45c9-a291-9b827ef1217a.mov

Nice, thanks for making the changes. Something seems to be off for me though on iOS

Your simulator is still referencing an updated status bar.
You should kill it and reopen.

I did that already few times, let me try it out again

Same result on a fresh build from xcode after cleaning all data as well as a new session on packager with cache resetted. The good thing, is that now I know for a fact that the issue reported in the other ticket where the career highlights show up, is very accurate since the method is being called on screen load. Fixing it here will fix it for the other screen as well
https://user-images.githubusercontent.com/11945712/194531969-1047eeec-2f9b-43f7-a5b3-31ce1c52226a.mov

Same result on a fresh build from xcode after cleaning all data as well as a new session on packager with cache resetted. The good thing, is that now I know for a fact that the issue reported in the other ticket where the career highlights show up, is very accurate since the method is being called on screen load. Fixing it here will fix it for the other screen as well

Hmmmm. Not happening on my simulator. It seems that it just sets the status bar style to light-content on your simulator. Weird, since nothing in this PR should trigger that.

I can check it out further later. I can see it being triggered though the same way the career highlights are showing up on Artist change. It will be fun to investigate, I will check it out

@MounirDhahri Can't reproduce it. Can you try running this branch on a different simulator - a simulator you had not used to run a branch that had StatusBar related changes.

Might be something with my setup then. Let's merge this and I will test it on my iPhone then


Add lightning-privacy-splice-panel review to bitcoin-review-podcast

This PR adds lightning-privacy-splice-panel transcript review to the bitcoin-review-podcast directory.

Hey @YeamlaksiraKebede, are you planning to address my comments?

Hey @YeamlaksiraKebede , it’s been some time since I last reviewed your submission, and there haven't been any updates since then. Do you have plans to work on the feedback provided?


I can't update nvm-windows

What happened?
I had version 1.1.7 installed so I tried to update to 1.1.12

I have uninstalled version 1.1.7, I tried to access it through the console but it didn't find the nvm and the folder was also deleted, which I considered the uninstall process to be successful
Downloaded and installed the last version from https://github.com/coreybutler/nvm-windows/releases/download/1.1.12/nvm-setup.exe
After the installation process, I opened the console and the version is still 1.1.7

nvm version
1.1.7

It doesn't have any new features from 1.1.12
What did you expect to happen?
Update to 1.1.12
Version
1.1.7
Which version of Windows?
Windows 10 (Default)
Which locale?
English (Default)
Which shell are you running NVM4W in?
PowerShell
User Permissions?
Administrative Privileges, Elevated
Is Developer Mode enabled?
No (Default)
Relevant log/console output
No response
Debug Output
No Logs

Anything else?
No response

It sounds like something didn't get uninstalled. Check your PATH to see if there is a duplicate entry. Also check the values of NVM_HOME and NVM_SYMLINK. If you're still seeing v1.1.7, it's being picked up from the NVM_HOME path.


Drive Duration Multiplier with analysis and governance support

eta: 2022-12-22
Ecosystem team posted a new discussion about continued macroeconomic and cryptoeconomic challenges.
CEL listening to community feedback & analyzing potential enhancements.

nv18 tentative timeline from core devs call:

(source:  https://docs.google.com/presentation/d/1O4dFR-pgQdGw4suqGNiupl9PPN0PB2bHaQGbyq_Z-uw/edit#slide=id.g1a856e54b4d_0_27)

CEL is still monitoring feedback in the discussion [Revisiting a Sector Duration Multiplier](https://www.notion.so/6e92d6e9f9a94d85bd6da3d94a2fe750)

@vkalghatgi drafted new SDM FIP language this week proposing 5-year max duration with a slope-1 multiplier applicable to new sectors only.
A tradeoff analysis matrix from core devs on nv18 inclusion seems to indicate that FIP0047 PoRep bug fix and any new SDM may bump out to nv19 to pave the way for a smoother FVM rollout in nv18


change-commit-linter

Automated changes by create-pull-request GitHub action

Auto-closing pull request


chore(dropdown): change labels to use slots

:tada: This PR is included in version 0.15.0 :tada:
The release is available on:

GitHub release
npm package (@latest dist-tag)

Your semantic-release bot :package::rocket:


metrics-ganglia is changing the mod of file /var/run/cassandra which failed command service cassandra status

Hi,
I am using using metrics-ganglia on my cassandra server, after config done, while it works and cassandra runs okay also. but when I run command:
{code}service cassandra status{code},
it prints:

could not access pidfile for Cassandra

And I debugged in found the mod changed of file /var/run/cassandra

The Metric GangliaReporter doesn't interact with the filesystem at all, so it can't be responsible for that issue.


Mgmt packages with azure-core

This is WIP, do NOT merge this PR.

Closing, this https://github.com/Azure/azure-sdk-for-python/pull/10021 instead now


feat: auto expand lineage

Overview

added auto expansion widget
change table node ui
code refactor

Checklist

[ ] I have run this code and it appears to resolve the stated issue
[ ] README.md updated and added information about my change

@AdiGajbhiye can you record a video explaining the changes so it will be easy to review?


'file_size' KeyError at /api/datasets/

There seems to be an error with the datasets 'file_size' Key, both in develop and master branches. It triggers when uploading a bundle competition.
2024-06-09 09:58:59 django-1          | Internal Server Error: /api/datasets/
2024-06-09 09:58:59 django-1          | Traceback (most recent call last):
2024-06-09 09:58:59 django-1          |   File "/usr/local/lib/python3.8/site-packages/django/core/handlers/exception.py", line 34, in inner
2024-06-09 09:53:40 rabbit-1          | 2024-06-09 06:53:40.272506+00:00 [info] <0.254.0> Running boot step rabbit_exchange_type_headers defined by app rabbit
2024-06-09 09:53:40 rabbit-1          | 2024-06-09 06:53:40.272605+00:00 [info] <0.254.0> Running boot step rabbit_exchange_type_topic defined by app rabbit
2024-06-09 09:53:40 rabbit-1          | 2024-06-09 06:53:40.272658+00:00 [info] <0.254.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit
2024-06-09 09:58:59 django-1          |     response = get_response(request)
2024-06-09 09:53:40 rabbit-1          | 2024-06-09 06:53:40.272684+00:00 [info] <0.254.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit
2024-06-09 09:58:59 django-1          |   File "/usr/local/lib/python3.8/site-packages/django/core/handlers/base.py", line 115, in _get_response
2024-06-09 09:58:59 django-1          |     response = self.process_exception_by_middleware(e, request)
2024-06-09 09:58:59 django-1          |   File "/usr/local/lib/python3.8/site-packages/django/core/handlers/base.py", line 113, in _get_response
2024-06-09 09:58:59 django-1          |     response = wrapped_callback(request, *callback_args, **callback_kwargs)
2024-06-09 09:53:40 rabbit-1          | 2024-06-09 06:53:40.272700+00:00 [info] <0.254.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit
2024-06-09 09:58:59 django-1          |   File "/usr/local/lib/python3.8/site-packages/django/views/decorators/csrf.py", line 54, in wrapped_view
2024-06-09 09:58:59 django-1          |     return view_func(*args, **kwargs)
2024-06-09 09:53:40 rabbit-1          | 2024-06-09 06:53:40.272771+00:00 [info] <0.254.0> Running boot step rabbit_priority_queue defined by app rabbit
2024-06-09 09:53:40 rabbit-1          | 2024-06-09 06:53:40.272803+00:00 [info] <0.254.0> Priority queues enabled, real BQ is rabbit_variable_queue
2024-06-09 09:53:40 rabbit-1          | 2024-06-09 06:53:40.272844+00:00 [info] <0.254.0> Running boot step rabbit_queue_location_client_local defined by app rabbit
2024-06-09 09:53:40 rabbit-1          | 2024-06-09 06:53:40.272875+00:00 [info] <0.254.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit
2024-06-09 09:53:40 rabbit-1          | 2024-06-09 06:53:40.272891+00:00 [info] <0.254.0> Running boot step rabbit_queue_location_random defined by app rabbit
2024-06-09 09:53:40 rabbit-1          | 2024-06-09 06:53:40.272906+00:00 [info] <0.254.0> Running boot step kernel_ready defined by app rabbit
2024-06-09 09:58:59 django-1          |   File "/usr/local/lib/python3.8/site-packages/rest_framework/viewsets.py", line 116, in view
2024-06-09 09:58:59 django-1          |     return self.dispatch(request, *args, **kwargs)
2024-06-09 09:53:40 rabbit-1          | 2024-06-09 06:53:40.272913+00:00 [info] <0.254.0> Running boot step rabbit_sysmon_minder defined by app rabbit
2024-06-09 09:58:59 django-1          |   File "/usr/local/lib/python3.8/site-packages/rest_framework/views.py", line 495, in dispatch
2024-06-09 09:58:59 django-1          |     response = self.handle_exception(exc)
2024-06-09 09:53:40 rabbit-1          | 2024-06-09 06:53:40.272968+00:00 [info] <0.254.0> Running boot step rabbit_epmd_monitor defined by app rabbit
2024-06-09 09:58:59 django-1          |   File "/usr/local/lib/python3.8/site-packages/rest_framework/views.py", line 455, in handle_exception
2024-06-09 09:58:59 django-1          |     self.raise_uncaught_exception(exc)
2024-06-09 09:58:59 django-1          |   File "/usr/local/lib/python3.8/site-packages/rest_framework/views.py", line 492, in dispatch
2024-06-09 09:58:59 django-1          |     response = handler(request, *args, **kwargs)
2024-06-09 09:58:59 django-1          |   File "/app/src/apps/api/views/datasets.py", line 85, in create
2024-06-09 09:58:59 django-1          |     file_size = float(request.data['file_size'])

Maybe related to:

#1468

Another concerning info that is leaked is the whitelist_emails

Indeed:

#1366

I cannot reproduce the issue you have mentioned about file_size. Here is what I did:

Using latest develop branch
Run docker-compose up -d
Run docker-compose exec django ./manage.py migrate
Run docker-compose exec django ./manage.py collectstatic --noinput
Access codabench using localhost
create a new user using Signup
Activate this user using the activation link from django container
Login
Go to Benchmarks -> Management, upload this bundle: iris_competition_bundle.zip

I see no error in django container
@liviust if you can reproduce the issue, please share the steps here.

Todos:

[ ] Fix competition printing in console
[ ] Fix file_size error


Alerts are recalculated several times per page load

I noticed in testing #217 and #219 that alerts are being recalculated at least 4 times for every page load, just to construct the header bar. Base.html calls alert_count 3 times and alert_nav_items once (templates defined here). Those call get_alert which for better or worse recalculates what alerts should be displayed from scratch every time.
Something like this in navigation_tags.py would fix it, but I feel like there ought to be a better way. At least for the 3 alert_count calls, there ought to be a way to just save it to a variable in base.html the first time and reference that.
import weakref
alerts_cache = weakref.WeakKeyDictionary()
def get_alerts_from_cache(context):
    request = context['request']
    user = context['request'].user
    if request in alerts_cache:
        return alerts_cache[request]
    alerts_cache[request]=get_alerts(user)
    return alerts_cache[request]

@register.inclusion_tag('alert_nav_items.html',takes_context=True)
def alert_nav_items(context):
    alerts = get_alerts_from_cache(context)
    return {'alerts': alerts[:12]}

@register.simple_tag(takes_context=True)
def alert_count(context):
    count = len(get_alerts_from_cache(context))
    return count if count > 0 else ''

@YSaxon - thanks for this, and I agree.  The better way is to have an alerts model and store them in the DB as they happen.  This will also allow users to silence the alerts if desired.

@grendel513 I think fixing this should be a swag issue. Would you mind doing the writeup? Here is an example of what I have been doing outline the work required https://github.com/OWASP/django-DefectDojo/issues/146

@devGregA - I agree, I'll get it documented today or tomorrow.

Fixed by https://github.com/OWASP/django-DefectDojo/pull/318

Hi @devGregA @grendel513,
I think that this issue is still pending.
We are using DefectDojo and we have some performance problems. In consequence, I've been reviewing where is the problem and I have been be able to see that the application do a lot of alert/count request, even where no user is using the application (only with the interface opened) . I could prove this intercepting the requests/responses with a proxy.
I think that could be necessary improve this section.
In case that you think that our performance problems is not related to this, please let me know.
Best regards,


How to do Stacked LSTM with attention using this framework ?

hello,
I have run your code successful.
I have also include stacked  LSTM in your code :
def model_attention_applied_before_lstm():
    inputs = Input(shape=(TIME_STEPS, INPUT_DIM,))
    attention_mul = attention_3d_block(inputs)
    lstm_units = 32
    attention_mul = LSTM(lstm_units, return_sequences=True)(attention_mul)
    attention_mul = LSTM(lstm_units, return_sequences=False)(attention_mul)
    output = Dense(1, activation='sigmoid')(attention_mul)
    model = Model(input=[inputs], output=output)
    return model

But maybe this is not the correct way to apply staked LSTM with attention right ?
My ultimate goal is to include attention into this code (classification of multivariate time series ) :

class LSTMNet:
    @staticmethod
    def build(timeSteps,variables,classes):
        inputNet = Input(shape=(timeSteps,variables))
       lstm=Bidirectional(GRU(100,recurrent_dropout=0.4,dropout=0.4,return_sequences=True),merge_mode='concat')(inputNet)
       lstm=Bidirectional(GRU(50,recurrent_dropout=0.4,dropout=0.4,return_sequences=True),merge_mode='concat')(lstm)
        lstm=Bidirectional(GRU(20,recurrent_dropout=0.4,dropout=0.4,return_sequences=False),merge_mode='concat')(lstm)
        # a softmax classifier
        classificationLayer=Dense(classes,activation='softmax')(lstm)
        model=Model(inputNet,classificationLayer)
        return model

Thanks in advance for any possible info

Ok It was simple :

lstm=Bidirectional(LSTM(100,recurrent_dropout=0.4,dropout=0.4,return_sequences=True),merge_mode='concat')(inputNet) #worse using stateful=True
        #lstm=SeqSelfAttention(attention_activation='sigmoid')(lstm)
        lstm=attention_3d_block(lstm,timeSteps)
        lstm=Bidirectional(LSTM(50,recurrent_dropout=0.4,dropout=0.4,return_sequences=True),merge_mode='concat')(lstm) #worse using stateful=True
        lstm=attention_3d_block(lstm,timeSteps)
        lstm=Bidirectional(LSTM(20,recurrent_dropout=0.4,dropout=0.4,return_sequences=False),merge_mode='concat')(lstm) #worse using stateful=True

by the way, I try to use attention with conv1D to specify the "neighbors lenght" contribute to the importance of the step in question (using the size of the kernel) , the results improved:
def attention_3d_block(inputs,timesteps):
    input_dim = int(inputs.shape[2])
    time_steps=timesteps
    a_probs = Conv1D(input_dim,3,strides=1,padding='same',activation='softmax')(inputs)
    output_attention_mul= Multiply()([inputs, a_probs]) #name='attention_mul'
    return output_attention_mul

this way you also do not need to permute - it will build attention vector for time steps and not for variables without permuting...

@rjpg thanks! The attention block got updated. So maybe this is deprecated now.


other.invoke (false); compile error

the library vstgui doesn't compile on fedora 40-41.
error:
clap-saw-demo-editor.cpp
21 |                 other.invoke (false);
issue:
https://github.com/steinbergmedia/vstgui/issues/324
fix:
clap-saw-demo/libs/vstgui/vstgui/lib/finally.h
line 21:
other.invoke = false;
i also had to install quite a few dependencies manually.
all the X11, xcb, xkb, cairo, pangocairo and sqlite.
not familiar with cmake though.

Ahh we probably have to upgrade the submodule to get the latest yeah.
As to the other dependencies, yes, cmake doesn't install them. There's a variety of approaches to this but the one we've taken in this particular project is list them in the workflow for ubuntu where we do CI builds and let folks figure them out on other linux-originated systems. If you'd like to share how you made it build on fedora from a package perspective either in the README or the doc I would happily merge that.
Let me try a PR with latest vstgui.

OK if #46 passes CI I'll merge it and this will sweep the above change. When I do this issue will close.
Thanks!


fix: update reverseProxyUrl in demo, raise awareness of duti.tech compromise

According to @acheong08

For anyone who hasn't upgraded revChatGPT, please do so immediately. My domain name, http://duti.tech, has expired and been taken over by an unknown entity.
There could be security issues if you do not upgrade such as token logging.
3:27 AM · Mar 31, 2023

source: https://twitter.com/GodlyIgnorance/status/1641703845767290880?cxt=HHwWgIDRleO8wMgtAAAA
I've provided the new public proxy used in ChatGPT-Proxy-V4 that is confirmed working for the browser client

Thanks, I had updated this in my example settings but forgot about the demo.


Adding BlockStoreCacheTip property and more debug logs

Attempting to fix the delay in X nodes that can happen sometimes on IBD

@dangershony this change looks good, just please fix the 3 unit tests ;)


allow passing in query without pathname

Next's <Link> allows us to pass in query without having to specify the pathname, assuming that we are changing query parameters on the same URL that the user is currently on. This PR updates the types to allow doing that with nextjs-routes.

Thanks @sachinraja! I wasn't aware of this capability.
Do the router methods (eg router.push) also support this behavior?

😆 Looks like we had the same thought

I'm going to look into writing some type tests so we don't regress and then I'll publish 0.0.14 tonight.

Thanks for being so responsive!


Adding app names table for the filter.

This PR adds a new table in the database to store unique application names that will be used in the filter.

Found a bug that was not adding new app names to the filter after the user clicked on search for the second time. It was updating only once.