Efficiency of a large-scale point cloud prediction

Hi, Thomas!
Thank you for your very complete source codes.
Although I am a layman about 3D semantic segmentation, I tried your source codes and successfully applied KPConv to different datasets, such as S3DIS.
Different from the 2D deep learning prediction process, I found that the workstation had to consume a lot of time to predict one frame of the point cloud, e.g., Area 5.ply.
For example, the prediction of one point cloud may take 2 hours. It is not like a batch prediction process for 2D images, say, around per second for each. In this case, if I want to predict an urban-scale scene, the 3D prediction process may be a high-cost and time-consuming work.
So is the multi-epoch prediction process a common characteristic for the 3D scene prediction? Or do I have any misunderstanding on your test_models.py?
How can I improve the prediction efficiency so that I can produce multiple frames of segmented point cloud more quickly?
I would appreciate it if you could give me some guidance. Thanks
Best regards,
Eric.

Hi Eric,
You can view the process of predicting Area4 as equivalent to segmenting an image that would have 1000000 x 1000000 pixels. As you can understand, that would take quite some time for an image too.
The basic strategy would be a tiling process, where you split this big image (or point cloud in our case) into smaller tiles and predict each tile. Such a tiling strategy has been used for point cloud segmentation and would be faster than my method, but less accurate because of the border effect (at the border between two tiles, if an object is split in half, the prediction might not be as good).
My strategy consists of predicting small parts (spheres) of the point cloud too, but chosen with some overlap, and repeating that multiple times to get a vote for the best predictions. This is why it is longer.
You can try two easy things to speed up the process without changing my code too much:

Stop the testing when the minimum potential value of 0.1 is reached (meaning every point in the cloud has at least be seen once).
Here, you can change the if statement to: if new_min > 0.1:
https://github.com/HuguesTHOMAS/KPConv-PyTorch/blob/e600c1667d085aeb5cf89d8dbe5a97aad4270d88/utils/tester.py#L302-L311
And here just make this if statement always true with if int(np.ceil(new_min)) % 1 == 0: :
https://github.com/HuguesTHOMAS/KPConv-PyTorch/blob/e600c1667d085aeb5cf89d8dbe5a97aad4270d88/utils/tester.py#L354-L355

Use larger subsampling size and the corresponding input sphere radius (keep the same ratio so that the network still use a similar amount of memory on GPU):
https://github.com/HuguesTHOMAS/KPConv-PyTorch/blob/e600c1667d085aeb5cf89d8dbe5a97aad4270d88/train_S3DIS.py#L123-L127
You can try different values, but the higher you get the fewer details the network will have to make predictions and thus you will lose in performance, especially on smaller objects.

Many thanks for your quick reply.
Yeah, I have tried to set new_min =0.1 as a turning point to output the segmented point cloud. All the parts were predicted but there still existed some obvious errors. The prediction seemed not that good, Maybe the model lacked enough review to improve the prediction. As you said, downscaling the point cloud could also increase efficiency.
I will test the sensitivity for different experimental settings.
Thanks.


Create CONTRIBUTING.md file

Add CONTRIBUTING.md file
Format markdown files to break long lines and improve wording

For future reference, this PR was prompted by this discussion in #133.

No remarks on contributing/governance/changelog.
In Usage, consider linefeeds at 58, 87, 185, 311;
and in Readme at 10-11, 19-20 and more (looks like you skipped it entirely).

Great suggestions for USAGE.md. I've applied them all. Same in the README. I hadn't really looked into lines that might need re-wrapping; I only handled lines that were already relatively long. I have now tried to locate other instances where re-wrapping might make sense.
As for lines 10-11 in the README, I'm not sure what wrapping would work better in your view (without breaking the sentence's clauses apart). I've moved the second sentence to its own line, but I can't think of a better way to wrap the first sentence. If anything, I could make it longer, by moving the "is v0.15.0," to the first line. Is this what you had in mind?

And that's a wrap! :+1:


fix(Search): simplify propTypes on SearchResult

Fixes #2135.

Codecov Report

Merging #2138 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #2138   +/-   ##
=======================================
  Coverage   99.76%   99.76%
=======================================
  Files         150      150
  Lines        2597     2597
=======================================
  Hits         2591     2591
  Misses          6        6

Impacted Files
Coverage Δ

src/modules/Search/SearchResult.js
100% <ø> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 49ee127...4914154. Read the comment docs.

Released in<EMAIL_ADDRESS>


Remove version: Jackett.Jackett version 0.21.1396

404 - release deleted
Microsoft Reviewers: Open in CodeFlow

URL: https://github.com/Jackett/Jackett/releases/download/v0.21.1396/Jackett.Installer.Windows.exe
Response Error: The remote server returned an error: (404) Not Found.
(Automated message - build 918)


"Post Upgrade - Change application version" leaves tenant in state OperationalDataUpgradePending and I cannot install new apps

If I want to install new app after running optional Post Upgrade section, then I get error:
Install-NAVApp : Cannot install apps due to the state of the tenant: OperationalDataUpgradePending.
At line:8 char:5

Install-NAVApp -Name $AppInfo.Name -ServerInstance $servInst

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

CategoryInfo          : InvalidOperation: (:) [Install-NAVApp], InvalidOperationException
FullyQualifiedErrorId : MicrosoftDynamicsNavServer$BC160/default,Microsoft.Dynamics.Nav.Apps.Management.Cmdlets.InstallNavApp

Please add instructions how to avoid or resolve this issue.
Maybe instead of this:
Start-NAVDataUpgrade -ServerInstance <server instance name> -Tenant <tenant ID>
we should run that:
Start-NavDataUpgrade-ServerInstance <server instance name> -Tenant <tenant ID> -FunctionExecutionMode Serial
At least that resolved this issue for me.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 282df301-79a2-3747-9718-f09f0b0d73ae
Version Independent ID: b9d4f12b-05e3-fa0c-5d74-4c7372d520f7
Content: Install an update - Business Central
Content Source: dev-itpro/upgrade/upgrading-cumulative-update-v16.md
Service: dynamics365-business-central
GitHub Login: @jswymer
Microsoft Alias: jswymer

Hello, you're correct. The Start-NAVDataUpgrade should be run with -FunctionExecutionMode Serial. The article has been fixed and an update will be published soon. Thanks for the feedback!

Hello,
i ran the DataUpgrade with -FunctionExecutionMode Serial.
Get-NavDataUpgrade shows: Completed, 100%.
"Install-NAVApp -Name  -ServerInstance " still brings up "Cannot install apps due to the state of the tenant: OperationalDataUpgradeInProgress."
How can i bring this to a completed state?

Hi @IMRGroup,
You have to be patient after Start-NAVDataUpgrade.
You can run:
Get-NAVTenant -ServerInstance $servInst -Tenant default -ForceRefresh
And if State = OperationalDataUpgradeInProgress, then WAIT until it becomes Operational
To fix Your case run again:
Start-NavDataUpgrade -ServerInstance $servInst -Tenant default -FunctionExecutionMode Serial

Hi,
At what point did you run "Start-NavDataUpgrade -FunctionExecutionMode Serial"? Just curious because it doesn't appear as a step in the article. For example, was it used in connection with changing the application version or for something else? This information might help identify possible improvements to the doc. Thanks!

@erolkunman - thanks, i guess being patient is the only way. Even thoug State was "Operational", i had to wait another 5min.
@jswymer For me its step 10 in this article: https://docs.microsoft.com/en-us/dynamics365/business-central/dev-itpro/upgrade/upgrade-to-microsoft-base-app-v17
The complete command is "Start-NavDataUpgrade -ServerInstance $servInst -Tenant default -FunctionExecutionMode Serial" like @erolkunman stated...

Hi, thanks for the info.
We've add information to the article, and the relevant articles for other versions. The update will be published soon. Thanks for the feedback.

Hi, i got into this state during customer upgrade, now its stuck in this state for like 48 hours.. any ideas?

Hi, i got into this state during customer upgrade, now its stuck in this state for like 48 hours.. any ideas?

If status from command:
#Get-NAVTenant -ServerInstance $servInst -tenant default -ForceRefresh
is Tenant OperationalDataUpgradePending or OperationalSyncPending
then I would run this powershell:
#Start-NavDataUpgrade -ServerInstance $servInst -Tenant default -FunctionExecutionMode Serial

You have to be patient after Start-NAVDataUpgrade.
You can run: Get-NAVTenant -ServerInstance $servInst -Tenant default -ForceRefresh
And if State = OperationalDataUpgradeInProgress, then WAIT until it becomes Operational
To fix Your case run again: Start-NavDataUpgrade -ServerInstance $servInst -Tenant default -FunctionExecutionMode Serial

Yeah, this worked, i have missed this soultion in replies. Thnak you anyway :)


numpy.linalg.LinAlgError: SVD did not converge

Thx for the current repo.
I want to use TensorNetwork package to simulate time evolution of transverse ising model with itebd algorithm.
but it seems svd throws out error like this,  can anyone give answers or any hints?

does the split_node_full_svd used in apply_two_site_gate() has parameter like max_iter or something else?
are there demo code snippets for using tn.InfiniteMPS or tn.FiniteMPS with tebd algorithm?

thanks~
$ python evolution.py
1727.9739590611944
6.306919862739928e-15
0.014427307657060863
7.142939906200455e-15
0.0015813901699260678
7.156663235322543e-15
../anaconda3/envs/tf2/lib/python3.7/site-packages/tensornetwork/backends/numpy/numpy_backend.py:90: RuntimeWarning: invalid value encountered in sqrt
  return np.sqrt(tensor)

Intel MKL ERROR: Parameter 4 was incorrect on entry to DLASCL.

Intel MKL ERROR: Parameter 4 was incorrect on entry to DLASCL.
Traceback (most recent call last):
  File "evolution.py", line 83, in <module>
    itebd_ising(N=10)
  File "evolution.py", line 76, in itebd_ising
    imps_state.canonicalize()
  File "../anaconda3/envs/tf2/lib/python3.7/site-packages/tensornetwork/matrixproductstates/infinite_mps.py", line 276, in canonicalize
    relative=True)
  File "..anaconda3/envs/tf2/lib/python3.7/site-packages/tensornetwork/backends/numpy/numpy_backend.py", line 627, in svd
    relative=relative)
  File "../anaconda3/envs/tf2/lib/python3.7/site-packages/tensornetwork/backends/numpy/decompositions.py", line 36, in svd
    u, s, vh = np.linalg.svd(tensor, full_matrices=False)
  File "<__array_function__ internals>", line 6, in svd
  File "../anaconda3/envs/tf2/lib/python3.7/site-packages/numpy/linalg/linalg.py", line 1636, in svd
    u, s, vh = gufunc(a, signature=signature, extobj=extobj)
  File "../anaconda3/envs/tf2/lib/python3.7/site-packages/numpy/linalg/linalg.py", line 106, in _raise_linalgerror_svd_nonconvergence
    raise LinAlgError("SVD did not converge")
numpy.linalg.LinAlgError: SVD did not converge

code script shown below,

import tensornetwork as tn
import numpy as np
import tensorflow as tf
# tn.set_default_backend('numpy')

def itebd_ising(N=1000):
    J=1.0;
    g=0.5;
    chi=50
    d=2;
    delta=0.05;
    # N=3000;

    # two-site Hamiltonian
    H = np.array([[J, -g/2, -g/2,0],
                [-g/2, -J,0,-g/2],
                [-g/2.,0,-J,-g/2.],
                [0,-g/2.,-g/2.,J]])
    w,v=np.linalg.eig(H)
    U=np.reshape(np.dot(np.dot(v,np.diag(np.exp(-delta*w))),np.transpose(v)),(2,2,2,2))

    imps_state=tn.InfiniteMPS.random(d=[2,2], D=[chi,chi,chi], dtype=np.complex128)
    print(imps_state.check_canonical())
    imps_state.canonicalize()
    print(imps_state.check_canonical())
    truncation=[]
    for step in range(N):
        if step%2==0:
            truncation_err = imps_state.apply_two_site_gate(U, site1=0, site2=1,max_singular_values=chi)
        else:
            truncation_err = imps_state.apply_two_site_gate(np.transpose(U,(1,0,3,2)), site1=0, site2=1,max_singular_values=chi)
        truncation.append(np.linalg.norm(truncation_err))
        imps_state.canonicalize()
        print(np.linalg.norm(truncation_err))
        print(imps_state.check_canonical())
        # pdb.set_trace()
    print("-"*20)
    print(sum(truncation))
if __name__ == "__main__":
    itebd_ising(N=10)

I think there is a NaN or an Inf somewhere in imps_state
On Fri, Jan 8, 2021, 21:22 Papageno2<EMAIL_ADDRESS>wrote:

Thx for the current repo.
I want to use TensorNetwork package to simulate time evolution of
transverse ising model with itebd algorithm.
but it seems svd throws out error like this, can anyone give answers or
any hints?

does the split_node_full_svd used in apply_two_site_gate() has
parameter like max_iter or something else?
are there demo code snippets for using tn.InfiniteMPS or tn.FiniteMPS
with tebd algorithm?

thanks~
$ python evolution.py
1727.9739590611944
6.306919862739928e-15
0.014427307657060863
7.142939906200455e-15
0.0015813901699260678
7.156663235322543e-15
../anaconda3/envs/tf2/lib/python3.7/site-packages/tensornetwork/backends/numpy/numpy_backend.py:90: RuntimeWarning: invalid value encountered in sqrt
return np.sqrt(tensor)
Intel MKL ERROR: Parameter 4 was incorrect on entry to DLASCL.
Intel MKL ERROR: Parameter 4 was incorrect on entry to DLASCL.
Traceback (most recent call last):
File "evolution.py", line 83, in
itebd_ising(N=10)
File "evolution.py", line 76, in itebd_ising
imps_state.canonicalize()
File "../anaconda3/envs/tf2/lib/python3.7/site-packages/tensornetwork/matrixproductstates/infinite_mps.py", line 276, in canonicalize
relative=True)
File "..anaconda3/envs/tf2/lib/python3.7/site-packages/tensornetwork/backends/numpy/numpy_backend.py", line 627, in svd
relative=relative)
File "../anaconda3/envs/tf2/lib/python3.7/site-packages/tensornetwork/backends/numpy/decompositions.py", line 36, in svd
u, s, vh = np.linalg.svd(tensor, full_matrices=False)
File "<array_function internals>", line 6, in svd
File "../anaconda3/envs/tf2/lib/python3.7/site-packages/numpy/linalg/linalg.py", line 1636, in svd
u, s, vh = gufunc(a, signature=signature, extobj=extobj)
File "../anaconda3/envs/tf2/lib/python3.7/site-packages/numpy/linalg/linalg.py", line 106, in _raise_linalgerror_svd_nonconvergence
raise LinAlgError("SVD did not converge")
numpy.linalg.LinAlgError: SVD did not converge
code script shown below,
import tensornetwork as tn import numpy as np import tensorflow as tf# tn.set_default_backend('numpy')
def itebd_ising(N=1000):
J=1.0;
g=0.5;
chi=50
d=2;
delta=0.05;
# N=3000;
# two-site Hamiltonian
H = np.array([[J, -g/2, -g/2,0],
            [-g/2, -J,0,-g/2],
            [-g/2.,0,-J,-g/2.],
            [0,-g/2.,-g/2.,J]])
w,v=np.linalg.eig(H)
U=np.reshape(np.dot(np.dot(v,np.diag(np.exp(-delta*w))),np.transpose(v)),(2,2,2,2))

imps_state=tn.InfiniteMPS.random(d=[2,2], D=[chi,chi,chi], dtype=np.complex128)
print(imps_state.check_canonical())
imps_state.canonicalize()
print(imps_state.check_canonical())
truncation=[]
for step in range(N):
    if step%2==0:
        truncation_err = imps_state.apply_two_site_gate(U, site1=0, site2=1,max_singular_values=chi)
    else:
        truncation_err = imps_state.apply_two_site_gate(np.transpose(U,(1,0,3,2)), site1=0, site2=1,max_singular_values=chi)
    truncation.append(np.linalg.norm(truncation_err))
    imps_state.canonicalize()
    print(np.linalg.norm(truncation_err))
    print(imps_state.check_canonical())
    # pdb.set_trace()
print("-"*20)
print(sum(truncation))if __name__ == "__main__":
itebd_ising(N=10)

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/google/TensorNetwork/issues/896, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAINHBQXJVYLKQHUVZZ5XTTSY64V5ANCNFSM4V3GZTMA
.

I think there is a NaN or an Inf somewhere in imps_state
On Fri, Jan 8, 2021, 21:22 Papageno2<EMAIL_ADDRESS>wrote:

Thx for the current repo.
I want to use TensorNetwork package to simulate time evolution of
transverse ising model with itebd algorithm.
but it seems svd throws out error like this, can anyone give answers or
any hints?

does the split_node_full_svd used in apply_two_site_gate() has
parameter like max_iter or something else?
are there demo code snippets for using tn.InfiniteMPS or tn.FiniteMPS
with tebd algorithm?

thanks~
$ python evolution.py
1727.9739590611944
6.306919862739928e-15
0.014427307657060863
7.142939906200455e-15
0.0015813901699260678
7.156663235322543e-15
../anaconda3/envs/tf2/lib/python3.7/site-packages/tensornetwork/backends/numpy/numpy_backend.py:90: RuntimeWarning: invalid value encountered in sqrt
return np.sqrt(tensor)
Intel MKL ERROR: Parameter 4 was incorrect on entry to DLASCL.
Intel MKL ERROR: Parameter 4 was incorrect on entry to DLASCL.
Traceback (most recent call last):
File "evolution.py", line 83, in
itebd_ising(N=10)
File "evolution.py", line 76, in itebd_ising
imps_state.canonicalize()
File "../anaconda3/envs/tf2/lib/python3.7/site-packages/tensornetwork/matrixproductstates/infinite_mps.py", line 276, in canonicalize
relative=True)
File "..anaconda3/envs/tf2/lib/python3.7/site-packages/tensornetwork/backends/numpy/numpy_backend.py", line 627, in svd
relative=relative)
File "../anaconda3/envs/tf2/lib/python3.7/site-packages/tensornetwork/backends/numpy/decompositions.py", line 36, in svd
u, s, vh = np.linalg.svd(tensor, full_matrices=False)
File "<array_function internals>", line 6, in svd
File "../anaconda3/envs/tf2/lib/python3.7/site-packages/numpy/linalg/linalg.py", line 1636, in svd
u, s, vh = gufunc(a, signature=signature, extobj=extobj)
File "../anaconda3/envs/tf2/lib/python3.7/site-packages/numpy/linalg/linalg.py", line 106, in _raise_linalgerror_svd_nonconvergence
raise LinAlgError("SVD did not converge")
numpy.linalg.LinAlgError: SVD did not converge
code script shown below,
import tensornetwork as tn import numpy as np import tensorflow as tf# tn.set_default_backend('numpy')
def itebd_ising(N=1000):
J=1.0;
g=0.5;
chi=50
d=2;
delta=0.05;
# N=3000;
# two-site Hamiltonian
H = np.array([[J, -g/2, -g/2,0],
            [-g/2, -J,0,-g/2],
            [-g/2.,0,-J,-g/2.],
            [0,-g/2.,-g/2.,J]])
w,v=np.linalg.eig(H)
U=np.reshape(np.dot(np.dot(v,np.diag(np.exp(-delta*w))),np.transpose(v)),(2,2,2,2))

imps_state=tn.InfiniteMPS.random(d=[2,2], D=[chi,chi,chi], dtype=np.complex128)
print(imps_state.check_canonical())
imps_state.canonicalize()
print(imps_state.check_canonical())
truncation=[]
for step in range(N):
    if step%2==0:
        truncation_err = imps_state.apply_two_site_gate(U, site1=0, site2=1,max_singular_values=chi)
    else:
        truncation_err = imps_state.apply_two_site_gate(np.transpose(U,(1,0,3,2)), site1=0, site2=1,max_singular_values=chi)
    truncation.append(np.linalg.norm(truncation_err))
    imps_state.canonicalize()
    print(np.linalg.norm(truncation_err))
    print(imps_state.check_canonical())
    # pdb.set_trace()
print("-"*20)
print(sum(truncation))if __name__ == "__main__":
itebd_ising(N=10)

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/google/TensorNetwork/issues/896, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAINHBQXJVYLKQHUVZZ5XTTSY64V5ANCNFSM4V3GZTMA
.

thanks for issue @Papageno2. I submitted a fix for the error. I'm not sure if the iTEBD actually converges to the right state (some quick tests indicate it always converges to a product state), so there could still be a bug somewhere. Let me know if there are any more issues

thanks for issue @Papageno2. I submitted a fix for the error. I'm not sure if the iTEBD actually converges to the right state (some quick tests indicate it always converges to a product state), so there could still be a bug somewhere. Let me know if there are any more issues

I think there is a NaN or an Inf somewhere in imps_state

I think so, but I don't know how to check it out and why it occurs.

I think there is a NaN or an Inf somewhere in imps_state

I think so, but I don't know how to check it out and why it occurs.

it was a precision issue

it was a precision issue

it was a precision issue

Hi @mganahl,
Sorry for the long absence again, but I believe this is related to the issue #888 I had raised too some time ago.
Has there been a resolution to this? Thanks again, Martin!

it was a precision issue

Hi @mganahl,
Sorry for the long absence again, but I believe this is related to the issue #888 I had raised too some time ago.
Has there been a resolution to this? Thanks again, Martin!

I submitted a fix, hopefully we'll pull it in today!

I submitted a fix, hopefully we'll pull it in today!

Can you please elaborate on what the issue was?
Thanks!

Can you please elaborate on what the issue was?
Thanks!

a precision problem. Canonicalize takes the sqrt of eigenvalues of left and right reduced density matrices. EVs of the rdm's grew small (order of precision), and due to finite precision arithmetic actually negative. np.sqrt of a negative float gives nan, producing the issue.

a precision problem. Canonicalize takes the sqrt of eigenvalues of left and right reduced density matrices. EVs of the rdm's grew small (order of precision), and due to finite precision arithmetic actually negative. np.sqrt of a negative float gives nan, producing the issue.

@sr33dhar I can't really tell though if this will solve your problem. Best you try it and let us know

@sr33dhar I can't really tell though if this will solve your problem. Best you try it and let us know

Hey @mganahl,
For smaller instances, this had fixed the problem,
but when I am now trying out simulations of 20 qubit MPS states, the same SVD issue arises.
I am trying to create a parametrised state with two parameters.
When applying no ways to limit the bond-dimension, I am getting SVD errors while using the apply_two_site_gate() function
This error arises only when the bond-dimension is high. It almost always breaks when the maximum bond-dimension of 1024 (for 20 qubits) is used.
But repeating the same calculation with the same input parameters a few times seems to be resolving the issue.
So the entire process looks a bit random.
I believe this attached file should reproduce the issue. (Attaching the .py code as a .txt file)
Can you please help me out here?
Test_code.txt
Thanks again, Martin!
Much appreciated

Hi @sr33dhar I looked at the code, and there is indeed something going on in numpy. The issue I believe arises because the singular values of the matrices you are creating are highly degenerate. I think that if you were to enforce a canonical form on the MPS, this would fix your problem, but I haven't tried it. Instead, I submitted a PR (similar to your PR, which is still open (sorry!)) that defaults to using QR instead of SVD if no truncation is performed. This fixes the issue. Hopefully we'll have it merged soon.

Apart from the above, I noticed that the code you sent uses inconsistent dtypes, i.e. you are setting some dtypes to complex64, but others are float64 or complex128. In order to avoid any suprises there just set all types of all arrays to be the same

Thanks, @mganahl! :)
The code snippet I've provided is only part of what I'm trying to do, and for the method, I'm developing:
1.) I have to reduce the bond-dimension and make sure that all bond-dimensions do not cross a set threshold D_max
2.) After truncation, my states have to remain non-normalised.
So given these, are you suggesting that using the tn.FiniteMPS.canonicalize(normalize: bool = False) after each apply_two_site_gate() operation? I tried this just now, and it looks to be not working.
Another thing I tried doing is increasing the precision of everything to complex128 hoping that higher precision will resolve this, but that too is poorly implemented and didn't work.
And no worries about the previous QR suggestion. I'm sorry I did not follow up on that too! x|

Also, @mganahl, in a more complete version of the code, I am also doing implicit truncations to the MPS state using a self-defined truncate_mps() function that takes an MPS state and returns a truncated state with all bond-dimensions <= a set limit, D_max.
I am doing this through SVD operations too and have never observed the "SVD did not converge" error there.
Not really sure if this is a coincidence though.
Attaching that code too here as a .txt file.
Test_code2.txt
P.S. I started using python only for this project, and so if there are any suggestions to make the code better/faster, please do state them.
Thanks again, Martin :)

Also, @mganahl, in a more complete version of the code, I am also doing implicit truncations to the MPS state using a self-defined truncate_mps() function that takes an MPS state and returns a truncated state with all bond-dimensions <= a set limit, D_max.
Attaching that code too here as a .txt file.
Test_code2.txt
The same error with SVD appears even for bond-dimensions = 64.
This is again for a 20-qubit instance where the maximum bond-dim = 1024.
P.S. I started using python only for this project, and so if there are any suggestions to make the code better/faster, please do state them.
Thanks again, Martin :)

Hi @sr33dhar, had a very quick look at your code. The truncation there will in many cases lead to non-optimal truncations, something that you definitely want to avoid. I submitted a PR that adds truncation to the MPS class via the position function. You can use that for truncating your MPS

Hey @mganahl, are these changes accessible by just re-installing the latest version? Sorry, I'm still very new to Git.

it's not released yet. You can clone the PR to your local machine and install it there

Hey @mganahl,
Thanks again for your prompt response!
1.) Previously, for me, the SVD error was very random and running the same code with the same parameter values sometimes solved the issue. This is why in the code attached above [Test_code_III.txt], I was initialising the parameters with a random number each time.
2.) But now, the error looks to be more deterministic. From the few times, I ran this code, it seemed like most errors occurred when the parameter corresponding to two-qubit gates was an element of [1.4, 1.6] radians. Not sure if this is the only interval though.
3.) In the code attached below, 10 sets of parameters where I got an SVD error are hard-coded into the Error_list array.
Test_code_IV.txt
4.) Sometimes, reducing the decimal precision seems to solve the issue.
Thanks again, Martin! :)
Cheers,
Rishi

2.) The error does not look to be so deterministic anymore.
Re-running the same code resulted in no error for the first 5 parameter sets. Not really sure why though.

Hi @sr33dhar, I had a look at it. This is indeed a bug, but with the numpy package. The problem is caused by the matrix you are trying to sv decompose. The matrix essentially is highly singular, i.e. it has very many singular values at or very close to machine epsilon. lapack (the underlying fortran library that numpy is using) apparently has some trouble if the singular value spectrum has this kind of property. There are some ad-hoc workarounds that can fix this issue in some cases (e.g. doing a QR prior to the svd).
From an MPS perspective, your code seems to be using a much too large bond dimension. I think you should try to add matrix truncation based on a truncation threshold, rather than an absolute bond dimension. This will 1) improve efficiency (at least during early runs) and 2) will likely fix the svd issue you are seeing.

Hi all!
I believe my recent PR #962 might be of help here. With the fallback to the _gesvd LAPACK routine all examples in the Test_code_IV.txt  worked reliably,  at least for me. I've run them all 5 times now. Is that also true for you, @sr33dhar?


Replace Custom Logger content with link to .NET docs

Fixes #20751.
I also removed the sample as it's no longer referenced.
cc @Rick-Anderson

@serpent5  thanks!


Temporarily add deps for minkindr_python

Adding build dependencies for minkindr_python, at least until https://github.com/ethz-asl/minkindr/issues/69 is resolved.

Test FAILed.

Test PASSed.


Use 24 hour format for hours

Checklist

[x] Manual verification
[ ] Unit test coverage
[ ] E2E test coverage
[x] Needs manual QA?

Summary
Issue addressed:
The timestamps returned from the runtime were not being displayed properly.
https://rilldata.slack.com/archives/CTZ8XBQ85/p1686876647920379
Details:
We were using a 12 hour clock while formatting the timestamps. This PR switches it to a 24 hour clock.
D3 Locale format types
Steps to Verify

Create a model
SELECT cast('2022-01-01 00:00:00' as timestamp) as ts, cast('2022-01-01' as timestamptz) tsz
The resulted rows should display 2022-01-01 00:00:00

Hey, given earlier confusion about time zones, I think you should consider including the time zone in the string (for UTC, it will just be one extra letter, Z). For example by using ISO 8601 format instead (%Y-%m-%dT%H:%M:%S.%LZ). Including the time zone in the string is the only way to eliminate any confusion about what time is being shown.


Making component fully controlled (props-driven)

Hello, thank you for this library.
I have stumbled upon a problem, where I need to dynamically toggle Sortable disability through props change. However, Sortable does not respond to change of options of any kind. This is caused due to these lines:
delete props.options;
delete props.onChange;

Is there any particular reason for that?
I was able to achieve my goals by removing above lines and with this:
componentDidUpdate(prevProps, prevState) {
        if (prevProps.options.disabled !== this.props.options.disabled) {
            this.sortable.option('disabled', this.props.options.disabled);
        }
}

It also can be expanded to make component respond for any option change (since RubaXa's API allows that)
I think this component should follow React idioms, and be open to be controlled from outside using props, and it's a responsibility of this component for doing so. I can prepare PR for this change, if it's welcome

@Tauka
It's a good idea for making the component fully controlled and updating sortable options in componentDidUpdate. I'm considering making a breaking change in a major release by removing the uncontrolled code. You can also prepare a PR for reference. Thank you.

@cheton I don't see the delete ... lines of code in the current source. Did you manage to fix this? If so please close, otherwise we can look into it.

I'm closing this issue because this looks to be solved.


Added exception handling in grad_total_variation

Exception handling added when size of input tensor is (0, 3) it happened when I set --bound >= 4.
In that case, "RuntimeError: CUDA error: invalid configuration argument" is raised.

fixed.

Thanks for your contribution!


Fix #130: Use Maven overlay for banana instead of git submodule

Fix #130:  Use Maven overlay for banana instead of git submodule
Remove banana folder
Is this related to an already existing issue on sparkler?
#130
Will it close an existing issue?
Closes #130
How was this patch tested?
Tested it by cloning the my branch in a new directory and running ./bin/dockler.sh script and then navigating to the /banana dashboard page. It worked and loaded the dashboard correctly.
Note this did not require me to use the git submodules.

This is brilliant @sujen1412 !
I didnt know that this is even possible.
I tested it, everything works smoothly.
Thanks


Heatmap doesnt show score if there are no SLOs/SLOs defined

If we have a quality gate without an SLO then Keptn marks that evaluation as "pass" with a score of 0!
The problem is that this is not visualized well. The heatmap currently looks like something is missing - see here

It would be better to show the SCORE row as we actually do have a score even though it is 0

In this special case it would also be great to put more emphasize on the text that explains that there is no SLO defined. Right now the text is gray and doesnt stick out. I suggest we highlight it somehow

I think this would be really useful but I would go further than this as this is similar to an issue i raised in 0.2
If i have specified a test but have not provided the SLO then surely the build should fail. To me it should be promote only with explicit pass where as we seem to currently only stop the promotion on an explicit fail. If i forget to supply the SLOs or something causes them to become unavailable then I would not want builds to still be promoted.

I will close this issue, as it has been addressed:


Extend Product Data call

I have the problem that I would like to extend the Product Detail Page with the EAN number and other fields. However, I can't manage to expand the product call to get these fields delivered from Shopware.
The most important thing for me would be to know how I can explicitly extend the product object to get more data delivered from Shopware
How can I extend or customize calls in vue Storefront?

Hi @LakeWeb-tech, sorry for a veeery late response 😂 here are the details how extend/modify the request's payload in general:
https://shopware-pwa-docs.vuestorefront.io/landing/cookbook/#_9-overwrite-api-defaults
for product data call I would try with "useCms" as a root property in api defaults. Let us know if it helps :)


yii migration create mysql table length not working

What steps will reproduce the problem?
use yii migration create mysql table
···
'id' => $this->integer(length),
···
length not working
What is the expected result?
What do you get instead?
Additional info

Q
A

Yii version
2.0.37

PHP version
7.2.33

Operating system
macos10.15

DB version
mysql 8.0.21

What is length in this case?

@bizley
When does the issue occur?
class m200904_015218_init_operation_log_table extends Migration
{
/**
* {@inheritdoc}
*/
public function safeUp()
{
$tableOptions = null;
if ($this->db->driverName === 'mysql') {
$tableOptions = 'CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci ENGINE=InnoDB';
}
    $this->createTable('{{%test}}', [
        'id' => $this->integer(10),
    ], $tableOptions);
}

What do you see?
mysql fields length display as 0
What was the expected result?
mysql fields length display as 10

@bizley The problem is caused by mysql8.0.21

I see you are still waiting for reply here (don't close the issue then next time).
MySQL's integer column length was merely there to affect the way the column is being displayed, nothing else - column size was the same no matter what you have put there. In MySQL 8.0.19 this feature has been deprecated. See this SO answer.


feat(router) add header regex matching method

Summary
Add header regex matching method for routing decision. Based on this issue created before
https://github.com/Kong/kong/issues/5666
Full changelog
For avoiding behavior changes, only header with 1 value and prefixed with ~* is checked against re_find
Unit test added as
  -- 15. headers (regex)
  {
    service = service,
    route = {
      headersRegex = true,
      headers = {
        user_agent = {
          "~*windows|linux|os\\s+x\\s*[\\d\\._]+|solaris|bsd",
        },
      },
    },
  },

Issues resolved
Fix https://github.com/Kong/kong/issues/5666

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Great!

@vanhtuan0409  Whether this modification supports header-based regular expressions, whether it has been tested on Kubernetes and VM, and if not, whether we have considered using plugins to handle header-based regular expressions？

Some questions:
What if previously configured values have "~" in the value?
What if someone wants to do header matching based on the literal string "~"?
And then finally, the Route entity has "regex_priority", historically used for distinguishing path regex matches and having a priority amongst them. Users could get confused now (renaming the property is not an option since it is a breaking change).
But, do header matches have a similar problem (as paths) where the regex_priority field could be helpful?

What if previously configured values have "*" in the value?
Those will still work. This only gets activated when there's only one rule, and the rule starts with ~*

This begs the question: what if someone has exactly that setup: someone who has a route which matches headers that exactly contain a single value that begins with ~*, like ~*potato.
My answer to that is: we would break things for that particular person. So this change is technically backwards-breaking.
At the same time I think the odds of really impacting someone because of this are really astronomical. Matching by non-host header is already uncommon. The combination of unusual prefix + only one header really doesn't worry me.

And then finally, the Route entity has "regex_priority", historically used for distinguishing path regex matches and having a priority amongst them. Users could get confused now (renaming the property is not an option since it is a breaking change).
But, do header matches have a similar problem (as paths) where the regex_priority field could be helpful?

The place where it would he helpful would be if someone needs to prioritize one header regex over a different header regex in a different route. I think that can be added later as an extra feature, if someone requests it. Perhaps in 3.0 we will come up with something better than regex_priority.

My answer to that is: we would break things for that particular person. So this change is technically backwards-breaking.

At the same time I think the odds of really impacting someone because of this are really astronomical. Matching by non-host header is already uncommon. The combination of unusual prefix + only one header really doesn't worry me.

I get that practically this is okay today but I'll always be hesitant of introducing a change that limits the capability of the product.

The place where it would he helpful would be if someone needs to prioritize one header regex over a different header regex in a different route.

That may result in a breaking change unless we say something along the lines "in case of multiple routes with regex header values, the precedence order is undefined".

limits the capability of the product.

I understand the concern and I thank you for reviewing this. I think as it is this PR is good enough to merge.

That may result in a breaking change unless we say something along the lines "in case of multiple routes with regex header values, the precedence order is undefined".

That is a good point. I will make sure to include that in the docs.
We have run several performance tests for this branch and confirmed the changes had no significant performance impact, so I am merging it.


MUMUP-2509, 2513, 2514, 2515, Add theme for UW-Oskhosh, UW  La Crosse…

…, UW Green Bay, UW-Parkside

Coverage remained the same at 34.738% when pulling 2d58fabb07c0fe3cccf9852540b26f849caf9477 on jiayinjx:add_Theme1 into dc5af3b90dcd85961ef06d7f0ba6e13019d78771 on UW-Madison-DoIT:master.

:+1:

Cleaned up in https://github.com/UW-Madison-DoIT/uw-frame/pull/223 . Strong work @jiayinjx


Discord expired invite link

There is a Discord expired invite link in the README.md file
#celo-governance channel](https://discord.gg/rgwgCsYs)
Please create an active link or remove the link.
Thanks

Fixed thanks for the heads up :)


roon-server: 100800753 -> 100800790

Motivation for this change
Update roon-server to current build 790
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[x] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[x] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

Please squash your commits and use the standard commit message format:
roon-server: 100800753 -> 100800790
Thanks for the pkg bump!

@lovesegfault done and thanks for adding this in the first place.


Recommend moving file evaluation table out from under "Incremental Migration" section.

The article provides a verbose table of file conflict behavior AFTER the first migration task has completed, placing the table under the incremental migration section.
Based off my testing, all migration tasks will use the file conflict evaluation table, even on the first run. The way the article is written implies that the file evaluation table only applies to copies after the first migration task has been completed, and this does not appear to be the case.
I recommend creating a new section for file conflicts and moving the table to that section to clarify the scope.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: e06d8f2b-828c-aafe-41cc-30be91fbdf41
Version Independent ID: 1ed236b8-ab64-6f0e-1cab-901743d575dc
Content: Step 3: Copy to migrations for file share migration - Migrate to Microsoft 365
Content Source: migration/mm-fileshare-copy-to-migrations.md
Service: sharepoint-online
GitHub Login: @JoanneHendrickson
Microsoft Alias: jhendr

Thanks for your feedback @Poent


Help-link in Settings leads to incorrect page

In the Settings, there is a link, "What do all these %x codes mean?"
This leads to a Github document page with an anchor g-date-time-format.
Unfortunately, it looks like the intended link no longer exists, as there is no such anchor or documentation on the target page. I have tried to find out where it should lead, but I have failed!
I believe that some of the % codes are the same as described in the Linux command date, but not all. E.g., %;cf, %;@ and others.
Please would you update the link?

I can’t update the link. The GTK project has deleted this part of their documentation. It contained a lot of Glib specific time formats. So, … hm. The Internet Archive doesn’t have it either.

Oh, well. Thanks for trying, though.
Maybe leave a link to date, but with a note that it's not exhaustive?

The correct link is https://docs.gtk.org/glib/method.DateTime.format.html

The correct link is https://docs.gtk.org/glib/method.DateTime.format.html

Thank you! I have made a note of this.
@da2x — Would you be able to update the link to this one?

Thanks, I’ll update the link.


add information about which locale is blank in validate_presence_of on localize field ( on master branch )

Same PR than #1747 but in master branch

Sweet - thanks!


Gophish Webhook Signature Verification Fails

I tried to integrate gophish-notifier with my 0.12.1 gophish.
Configuration
# Host to listen on. If GoPhish is running on the same host, you can set this to <IP_ADDRESS>
listen_host: <IP_ADDRESS>
# Port to listen on
listen_port: 9999
# Webhook path. The full address will be http://<host>:<ip><webhook_path>. Ex: http://<IP_ADDRESS>:9999/webhook
webhook_path: /webhook
# Secret for GoPhish authentication
secret: secretpassword123
# Log level. Log levels are panic, fatal, error, warning, info, debug, trace.
log_level: debug
# (Optional) Base URL of GoPhish instance so that Slack notifications can link to campaign
base_url: https://<IP_ADDRESS>:3333
# Enables sending profiles. Options are `slack` and `email`. Make sure to configure the required parameters for each profile
profiles:
  - slack

# Slack Profile
slack:
  # Webhook address. Typically starts with https://hooks.slack.com/services/...
  webhook: 'https://hooks.slack.com/services/XXXXXXXXXXXXXXXXXXXXXXXX'
  # Username displayed in Slack
  username: Gophish
  # Channel to post in
  bot_channel: '#phish'
  # Bot profile picture
  emoji: ':blowfish:'
  # (Optional) Disable email, username, and credentials from being sent to Slack
  disable_credentials: true

# Email Profile
# Email to send from
email:
  sender<EMAIL_ADDRESS>  # Password of sender email. Uses plain SMTP authentication
  sender_password: password123
  # Recipient of notifications
  recipient<EMAIL_ADDRESS>  # Email host to send to
  host: smtp.gmail.com
  # Email host address
  host_addr: smtp.gmail.com:587

# You can also supply an email template for each notification
email_submitted_credentials_template: |
  Someone submitted credentials!
  Email ID - {{ .ID }}
  Email Address - {{ .Email }}
  IP Address - {{ .Address }}
  User Agent - {{ .UserAgent }}
  Username - {{ .Username }}
  Password - {{ .Password }}

I got the following doing "Ping" in gophish. Same issue also occurs with actual cred submissions.
~/gophish-notifier$ ./gophish-notifier
INFO[0000] Using config file: /home/er4z0r/gophish-notifier/config.yml
INFO[0000] Using Slack sending profile. Will send messages to #phish
INFO[0000] Server listening on <IP_ADDRESS>:9999/webhook
DEBU[0019] {"success":true}
ERRO[0019] invalid signature

Below is a tcpdump -A
11:17:26.500793 IP localhost.42824 > localhost.9999: Flags [P.], seq 1:258, ack 1, win 512, options [nop,nop,TS val<PHONE_NUMBER> ecr<PHONE_NUMBER>], length 257
E..5?k@.@..U.........H'.../.Z........).....
........POST /webhook HTTP/1.1
Host: <IP_ADDRESS>:9999
User-Agent: Go-http-client/1.1
Content-Length: 16
Content-Type: application/json
X-Signature: sha256=a3d9e29720841a77d50b27f64c0fdae99d0fdbd9ea2f944c6e0a75b8bab53170
Accept-Encoding: gzip

{"success":true}
11:17:26.500816 IP localhost.9999 > localhost.42824: Flags [.], ack 258, win 510, options [nop,nop,TS val<PHONE_NUMBER> ecr<PHONE_NUMBER>], length 0
E..4K3@.@...........'..HZ.....0......(.....
........
11:17:26.501019 IP localhost.9999 > localhost.42824: Flags [P.], seq 1:178, ack 258, win 512, options [nop,nop,TS val<PHONE_NUMBER> ecr<PHONE_NUMBER>], length 177
E...K4<EMAIL_ADDRESS>........HTTP/1.1 400 Bad Request
Content-Type: text/plain; charset=utf-8
X-Content-Type-Options: nosniff
Date: Tue, 09 Apr 2024 11:17:26 GMT
Content-Length: 18

invalid signature

Okay after a little digging around the code I found that this one is at least partially on me:
Turns out when trying to remove IOCs from the upstream gophish version I was a bit too eager and removed the term Gophish from the signature header making it X-Signaturewhere X-Gophish-Signature is expected.
The only weird thing to me now is, why the code that should have detected the missing of X-Gophish-Signature did not log accordingly.

This issue would have been easier to catch if the correct error was propagated here: https://github.com/t94j0/gophish-notifier/blob/master/main.go#L49


[Question] Is there any way to preconfigure Rancher ?

What kind of request is this (question/bug/enhancement/feature request):
Question
Steps to reproduce (least amount of steps as possible):
apiVersion: v1
kind: Namespace
metadata:
  name: cattle-system
---
apiVersion: v1
kind: ServiceAccount
metadata:
  name: rancher
  namespace: cattle-system
---
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRole
metadata:
  # "namespace" omitted since ClusterRoles are not namespaced
  name: rancher
rules:
- apiGroups: ["*"]
  resources: ["*"]
  verbs: ["*"]
---
apiVersion: rbac.authorization.k8s.io/v1
# This role binding allows "jane" to read pods in the "default" namespace.
kind: ClusterRoleBinding
metadata:
  name: rancher
subjects:
- kind: ServiceAccount
  name: rancher
  namespace: cattle-system
  apiGroup: ""
roleRef:
  kind: ClusterRole #this must be Role or ClusterRole
  name: rancher
  apiGroup: ""
---
apiVersion: apps/v1
kind: Deployment
metadata:
  name: rancher
  namespace: cattle-system
spec:
  replicas: 1
  selector:
    matchLabels:
      app: rancher
  template:
    metadata:
      labels:
        app: rancher
    spec:
      serviceAccountName: rancher
      containers:
      - name: name
        image: rancher/rancher:v2.5.5
        args:
          - "--features"
          - "fleet=false"   # tried comma seperated like `fleet=false,dashboard=false` But it's not working. Single feature disable is working.
        resources:
          requests:
            cpu: 100m
            memory: 200Mi
        ports:
        - containerPort: 443
---
apiVersion: v1
kind: Service
metadata:
  name: rancher
  namespace: cattle-system
spec:
  type: LoadBalancer
  ports:
  - port: 8443
    targetPort: 443
  selector:
    app: rancher

Result:
This will install rancher with lots of feature.
Other details that may be helpful:
Environment information

Rancher version (rancher/rancher/rancher/server image tag or shown bottom left in the UI): 2.5.5
Cluster creation: k3d cluster create rancher --k3s-server-arg --no-deploy --k3s-server-arg traefik --network rancher

Question
Is there any way to preconfigure

admin password
Cluster url
project - namespace organization ( for example create a project called dev and add namespaces dev in that)
Something like a config.yaml or a set of env vars ?
I tried CATTLE_FEATURES=fleet=false,dashboard=false. Seems like it's not working. Other params I couldn't find any docs.

Most common configurable options are described on https://rancher.com/docs/rancher/v2.x/en/installation/install-rancher-on-k8s/chart-options/. If you dont wan't to use Helm, you can check the chart to see what the Helm option translates to in the Deployment here https://github.com/rancher/rancher/tree/master/chart.
There are other automation examples in the quickstart repository here https://github.com/rancher/quickstart
Automating project/namespaces can either be done through the same automation or the Rancher CLI https://github.com/rancher/cli/

Most common configurable options are described on https://rancher.com/docs/rancher/v2.x/en/installation/install-rancher-on-k8s/chart-options/. If you dont wan't to use Helm, you can check the chart to see what the Helm option translates to in the Deployment here https://github.com/rancher/rancher/tree/master/chart.
There are other automation examples in the quickstart repository here https://github.com/rancher/quickstart
Automating project/namespaces can either be done through the same automation or the Rancher CLI https://github.com/rancher/cli/

Hi @superseb,
Thanks for all the above references. I've gone through the documents you shared. But nowhere it talks about disabling a feature. I saw CATTLE_FEATURES=<feat1>=true,<feat2>=true
But that's not working. And is there any doc on all the features which I can pick and choose? If I want to use rancher to manage the current cluster, I don't need a dashboard, fleet so on and so forth. If you can shed some light on this, it'll be great.

Hi @superseb,
Thanks for all the above references. I've gone through the documents you shared. But nowhere it talks about disabling a feature. I saw CATTLE_FEATURES=<feat1>=true,<feat2>=true
But that's not working. And is there any doc on all the features which I can pick and choose? If I want to use rancher to manage the current cluster, I don't need a dashboard, fleet so on and so forth. If you can shed some light on this, it'll be great.

I had the same problem today. I was reading https://rancher.com/docs/rancher/v2.5/en/installation/resources/feature-flags/ and trying to disable fleet and istio-virtual-service-ui in rancher v2.5.8 by setting CATTLE_FEATURES to "istio-virtual-service-ui=false,fleet=false" but this only disables istio-virtual-service-ui. If I try it with "fleet=false,istio-virtual-service-ui=false", then only fleet is disabled. Somehow comma-seperated values don't work. How could we disable multiple features via helm chart?


Fix css styles

Looks like a RTD theme update broke our custom.css style overrides.

@shirhatti Can you take a look?

It was ReadTheDocs bug that was resolved almost immediately. Closing out this issues


Errors when moving from 4.0.4 to 4.1.1

I haven't had a chance to investigate deeper, but I'm seeing a few errors thrown when I attempted to move to version 4.1.1:
TypeError: blurImg is null
onloadBlurUp . ls.blur-up.js:58
TypeError: ele is null
hasClass . lazysizes.js:44
addClass . lazysizes.js:48
onloadBlurUp . ls.blur-up.js:55
run . lazysizes.js:127

@seantimm
Do you have site or a testcase, where I can reproduce it? (The normal demo page works: https://jsfiddle.net/trixta/v0oq0412/embedded/result/ as expected.)
You can also mail me.

@seantimm
Do you have more information? Maybe I can already reproduce your issue, if I have your HTML?

Should be able to message you a site shortly...

@seantimm
any news?

I shot an email your way!  😄

@seantimm
I got your message, but the link is redirected to a 404 page. Could you please check?

@aFarkas Access is unfortunately scoped to primarily US-based requests.  If you're accessing from outside the US, you'll need access to a US-based proxy of some sort.  The link is walled off due to GDPR, and it might be difficult for me to open access.

give me just the html


[DOCS] Add a license

Your project is very nice. It would be nice if you put a license on it. If you don't know why you need a license and what license to choose, you can refer to this website.

don't know why you need a license and what license to choose, you can refer to this

Hey, I'd do just that. Thanks :)

Added License

Awesome!


Personalize cost function

Description
I have been looking for some method to change loss function, and I have not found anything...
I don't know if it's a feature request, but anyway:
How can I change the loss function to be, for instance, the MSE with respect to the mean of the distribution?

Hi @edarca,
for which model do you want to change the loss function? For the non-probabilistic ones, it is straightforward, you can just implement what you want. For parametric probabilistic methods, it is a bit trickier.
One way to arrive at MSE is to take the GaussianOutput and fix sigma like we do in this test: https://github.com/awslabs/gluon-ts/blob/master/test/distribution/test_mx_distribution_inference.py#L609. This basically arrives at MSE/L2 loss.


Unable to control brightness/temp on SNL530

I have a SNL530 that I have successfully connected via HTTP on Raspberry Pi. The on/off command works, but brightness and temp do not. This is using CCT mode.
There are no functionality issues when connecting the light with the official Neewer phone app. I'm guessing the protocol for these lights is slightly different?

Hi @PrezP!  One question, and one "try this" - is the SNL530 a bi-color (only CCT mode is available) light, or RGB (full-spectrum color) light?  If it's a bi-color light, then they do use a different protocol - but - try this first - make sure you have the light selected, click on the "Light Preferences" tab, then "This light can only use CCT mode", and then "Save Preferences" - you should be able to control those commands with that setting turned on.

Ahh, I just noticed the Raspberry Pi comment too - if you don't have access to the GUI, you can create the preferences file for that light like this:

If there isn't one yet, create a light_prefs folder in the same folder as NeewerLite-Python
Create a text file in that new folder with a name that's the same as the MAC address of the light, but with no ":"s
(for example, if the light's MAC address is 11:22:33:44:55:66 then make a file called<PHONE_NUMBER>66)
In that new text file, add this line, and save it:
|False|True
And then re-launch NeewerLite-Python

Thanks @taburineagle, I followed your instructions and this works! SNL530 is indeed a bi-color light with a temperature range of 3200K-5600K.
One thing I noticed is that the commands I was sending had &on or &off in them, this blocks the brightness and temperature parameter from being updated. Everything works as intended when this parameter is excluded.
I tested again to see if it could work without the preference file and without the on/off parameter included, but it did not. So the preference file is required.

Ah, excellent!  I'm glad to hear that it worked.  The reason why I asked if it was a bi-color light is that I do have logic in the main program that turns that feature on automatically for lights that are only bi-color lights, so now I can add the SNL530 to that list of lights.  I'm wondering if SNL is Neewer's code for bi-color lights - I might need to just add the "SNL" phrase as a trigger to turn that feature on.
I do have it so that &on and &off  at the moment override any other parameters from passing through, but I'll take a look at more properly implementing both those commands and a separate parameter at the same time down the line too.

My light appears as NEEWER-SNL530 in the interface. Looking at their website, the last page of the Neewer app manual has a table of lights, features and compatibility, though it's in a not-so-friendly image format.

Ahh!!!  Thanks for that, that's actually extremely helpful, I wasn't aware of that list!  So apparently all of the lights in the SRP, ZRP, SNL families, as well as the GL1 and NL140 are bi-color only lights.  Interesting... it also lists which lights have group control and which ones don't, which is also helpful.  I'm not sure what "NEEWER INFINITY" is, but a lot of those ones listed above are Bluetooth controllable as well.

Hi @PrezP - I'm going to close this issue as it's been a while, and 0.12 should address this issue (as it now loads the correct settings for the SNL530 on launch) - if you have any other issues, please let me know!


Add proxy support for request_session

It's a TODO in the code, right now you won't be able to use proxies if you want to use the new request_session parameter in service management apis.

This is supposed to work now.


control-service: Release 1.2.16

Testing done: https://gitlab.com/vmware-analytics/versatile-data-kit/-/pipelines/382795980
Signed-off-by: gageorgiev<EMAIL_ADDRESS>

Please do NOT merge until th CI of the commit being released has passed SUCCESFULLY:
https://gitlab.com/vmware-analytics/versatile-data-kit/-/commit/1f57f0eda203b6bc0cd4caddaeacad1bdfe32719

Please do NOT merge until the CI of the commit being released has passed SUCCESFULLY:
https://gitlab.com/vmware-analytics/versatile-data-kit/-/commit/1f57f0eda203b6bc0cd4caddaeacad1bdfe32719

It did pass so there's no issue. But it may not have.
We will automate releases so this all happens automatically in the future.


Build fails on Mint 17

While trying to build on Mint 17 using GHC 7.8.3, the build fails with exactly the same error shown here: http://hackage.haskell.org/package/helm-0.7.1/reports/1
The error seems to come from glib <IP_ADDRESS>. glib <IP_ADDRESS> builds successfully on my system, so it might be a good idea to upgrade to the newer version.

---
Want to back this issue? **[Post a bounty on it!](https://www.bountysource.com/issues/8589091-build-fails-on-mint-17?utm_campaign=plugin&utm_content=tracker%2F290443&utm_medium=issues&utm_source=github)** We accept bounties via [Bountysource](https://www.bountysource.com/?utm_campaign=plugin&utm_content=tracker%2F290443&utm_medium=issues&utm_source=github).

We can't easily change the version of glib that cairo/pango depend on. Maybe this is an issue with your gtk2hs build tool? What is your output for gtk2hsC2hs --version?

Output is as follows:
C->Haskell Compiler, version 0.13.12 (gtk2hs branch) "Bin IO", 27 May 2012

I also have a similar problem on OSX building using the guide on the helm web site.

What is the correct version of gtk2hs package from cabal?
Will installing via a stackage snapshot alleviate this issue?
Any workarounds would be welcome.
Xubuntu 14.04 LTS
libgtk2.0-common                               2.24.23-0ubuntu1.2
C->Haskell Compiler, version 0.13.12 (gtk2hs branch) "Bin IO", 27 May 2012
SDL 2.0.3 from this PPA

I'm also having this issue on debian sid, same failed build log.

Have you tried building using stack? Last I was looking to compile I only managed via stack so I would recommend that.

Still getting the same issues with stack build, Cairo & Glib failing to build from what looks like a type error (log).

Still getting the same issue, glib/cairo failing to build (log)

Closing this due to the rework. If it's still happening, please reopen a new issue.


Fix #4775: Escape user code before incorporating in a regex

...as part of monarch $Sn rule processing.
There is a proposal to support such sanitization as part of the language, but it's not implemented yet.   There are also libraries providing this service (eg lodash ), not sure what is the policy on adding dependencies to vscode.
This suggestion is just an added manual escaping, seems good enough.

Uploading linguist-lildude-linear-regex-redos.zip…


Debugging doesn't start without any error messages when trying to debug C code using WSL

Issue Type: Bug
Hi!
I'm trying to debug C code using VS Code in combination with WSL (Ubuntu-20.04) and a gdb debugger but despite having double checked my launch.json file, the process aborts after the debug toolbar appears for approximately half a second without any error messages. The weird part is that I didn't have any problems debugging in the past but a few days ago it suddenly stopped working.
WSL is working properly in the command prompt as well as in the VS Code terminal, so I guess WSL isn't causing the problem. Executing the C file in the command prompt using WSL is working fine as well, which is why I think VS Code is causing the issue.
Things I tried so far:

un and reinstalling my extensions as well as VS Code
switching to VS Code Insiders
editing my settings.json file to {"terminal.integrated.shell.windows": "C:\Windows\System32\bash.exe"}
obvious, but perhaps worth mentioning: rebooting my PC
debugging manually using "gdb filename" in the VS Code terminal which is working properly

If you need any additional information just let me know.
VS Code version: Code 1.65.2 (c722ca6c7eed3d7987c0d5c3df5c45f6b15e77d1, 2022-03-10T14:33:55.248Z)
OS version: Windows_NT x64 10.0.19042
Restricted Mode: No
Remote OS version: Linux x64 <IP_ADDRESS>-microsoft-standard-WSL2

System Info

Item
Value

CPUs
Intel(R) Core(TM) i7-10610U CPU @ 1.80GHz (8 x 2304)

GPU Status
2d_canvas: enabledgpu_compositing: enabledmultiple_raster_threads: enabled_onoop_rasterization: enabledopengl: enabled_onrasterization: enabledskia_renderer: enabled_onvideo_decode: enabledvulkan: disabled_offwebgl: enabledwebgl2: enabled

Load (avg)
undefined

Memory (System)
31.78GB (20.96GB free)

Process Argv
--crash-reporter-id a6dfd0b5-b9fd-4439-a20c-90c82835b0fb

Screen Reader
no

VM
0%

Item
Value

Remote
WSL: Ubuntu-20.04

OS
Linux x64 <IP_ADDRESS>-microsoft-standard-WSL2

CPUs
Intel(R) Core(TM) i7-10610U CPU @ 1.80GHz (8 x 2304)

Memory (System)
24.88GB (24.31GB free)

VM
0%

Extensions (2)

Extension
Author (truncated)
Version

remote-wsl
ms-
0.64.2

cpptools
ms-
1.9.7

A/B Experiments
vsliv368:30146709
vsreu685:30147344
python383cf:30185419
vspor879:30202332
vspor708:30202333
vspor363:30204092
pythonvspyl392:30443607
pythontb:30283811
pythonvspyt551:30345470
pythonptprofiler:30281270
vsdfh931cf:30280410
vshan820:30294714
vstes263cf:30335440
pythondataviewer:30285071
vscod805:30301674
pythonvspyt200:30340761
binariesv615:30325510
bridge0708:30335490
bridge0723:30353136
vsaa593cf:30376535
vsc1dst:30438360
pythonvs932:30410667
wslgetstarted:30449410
vsclayoutctrt:30451275
dsvsc009:30452663
pythonvsnew555:30457759
vscscmwlcmt:30438805
vscgsvid1:30447480
cppdebugcf:30451567
pynewfile477cf:30450039

For me, this happens between two native Linux machines. It used to work and then just stopped. There's no error message, the debugger process simply isn't started (or terminates immediately) on the remote matchine.

/extCpp


Deprecate solid.web.list in README

As per conversation

right, solid.web.list has been deprecated for just solid.web.get (looks like I forgot to update the example in the readme)

Regarding listing a solid container
https://github.com/solid/solid-client#listing-a-solid-container

Fixed in latest commit. Thanks!

seeAlso https://github.com/solid/solid-client/issues/85


Remove authors who do not have any songs

There are 11 authors who do not have any songs. These authors should be removed.

Additionally removed the authors "unknown" and "Traditional" after setting the author as "Author Unknown".


Build and distribute pyosmium wheel

Do you think it makes sense to build and distribute a Python Wheel for PyOsmium? At the moment users need to install build-essentials, all libosmium native deps, and boost-python-dev.
Would it make sense to build a wheel and ship it, so that users can simply
pip install osmium

and don't have to worry about dependency management?
(FYI: this is food for thought, not urgent or blocking - I noticed this while bundling a pyosmium program with Docker and was a bit surprised how much I have to pull in to get pyosmium to compile)
Here are some notes with refs to get started:

https://github.com/scanse/sweep-sdk/issues/54
https://github.com/scanse/sweep-sdk/pull/51

and it's a bit tricky with native deps as usual :)

This would absolutely make sense but I don't currently have the resources to build and test this sufficiently. Leaving this issue open anyway, just in case somebody wants to pick it up.

I'm giving this a look. After some preliminary testing it looks like manylinux / PEP513 is a way to go. Just simple move from one Ubuntu release to the other breaks standard wheel because of difference in version of boost library.
The only drawback of using manylinux is that this is very conservative environment with gcc 4.8, boost 1.41 which are quite old.
I still haven't tested how standard wheels behave on Windows and macOS, but looking at this ticket  I fear that it might be not that easy with Windows.
As for testing - I plan to use Travis /AppVeyor to build a wheel, and then run test suite in separate virtualenv, after, if possible, deinstallation of system-wide build packages (boost, boost-python etc.).

PyOsmium uses libosmium which doesn't work with boost 1.41 and I am not sure it all works with GCC 4.8.

Sorry, boost 1.48. At least it didn't complain during compilation, though I have problems during linking phase. Gcc 4.8 is used by travis builds so I assume, that’s what it works. Question is, how long we want to stick to it.
OTOH I could just run auditwheel on Ubuntu trusty/xenial and see on how many platforms it will work

I can test it on Mac provided the instructions.

@wiktorn I'd suggest taking a look at https://github.com/matthew-brett/multibuild, I've used these tools to build OS X + manylinux wheels for a couple of packages w/ minimal effort.
You might also take a look at the ray project which builds manylinux wheels that use boost.

@bnaul Thank's a lot, that could help a lot.
Just as I got manylinux wheels up & running on Debian / Ubuntu / Centos / Arch.

Looks like I've got it working on Linux & macOS with Travis.
On Linux I build manylinux binaries using Boost 1.67 compiled from source (as CentOS 5 has outdated Boost). Using Docker build is tested on:

Distribution
Python 2
Python 3

Debian (stretch / latest)
2.7
3.5

Ubuntu (bionic / latest)
2.7
3.6

Centos (centos7 / latest)
2.7
3.4

ArchLinux (latest)
2.7
3.6

It should be fairly easy to add additional distributions to test. Though they are only x64.
On macOS builds use Boost  provided by HomeBrew but I'm afraid that wheel will be pinned to specific Boost version and will fail to load if there is no specific version of Boost available on system. I'm not sure, if it's an improvement.
@lonvia Travis CI doesn't store any build artifacts. I tried uploads to AWS S3 and as a GitHub release. Both has some drawbacks - AWS needs an account there, GitHub releases are created per job, so for one build - you get 6 releases. You can always use your own build infrastructure. Which way you plan to go with this?
Next I plan to check Windows builds.
Should I test any other distributions? Anything else that should be done?

Waiting for @lonvia to finish replacing boost-python with pybind11 and then this will be far easier to build and distribute

@wiktorn What is the status on this?  Given the rather large changes with pybind11 and the binary wheels, I'd like to roll out an exceptional pre-release, so that we can get a bit more feedback before the next full release. Also would help to test the whole workflow of wheel creation.

Do binary wheels of other python packages work on Alpine Linux?

As far as I've checked - no (officially). They may work if you install glibc on Alpine Linux and set your installation as manylinux compatibile (see pypa/pip#3969). So I guess it's not a showstopper.
I guess that for Alpine it would be the best to provide apk binary package.

The latest 2.15.0 release now ships with binary wheels. Many thanks to @wiktorn for pushing this forward.


I found in Forge 1.19.2 that if there are multiple armor mods in the game that depend on geckolib, the armor animation will not be triggered

I found in Forge 1.19.2 that if there are multiple armor mods in the game that depend on geckolib, the armor animation will not be triggered

multiple armour mods? 多个盔甲模组？

If two mods that depend on Geckolib both contain armor with Geckolib animations, the armor's animations will not play.

multiple armour mods? 多个盔甲模组？

I am a player from China, and my English vocabulary might not be very good. Please excuse me for that.

How do you know this isn't just a bug with those mods?

How do you know this isn't just a bug with those mods?你怎么知道这不仅仅是那些模组的错误？

Because I have tried many different ways to put them together, but their commonality is that they are all made by mcreator.

That seems like an mcreator problem, not a Geckolib problem

That seems like an mcreator problem, not a Geckolib problem

I understand now, thank you very much for taking the time to answer my question.


cannot convert from 'NumSharp.NDArray' to 'System.Array'

im trying to bring a custom AI model into C# I prepared the input the same way in python and it runs properly im able to prepare my input data the way i need it with num sharp but cant convert it into a System.Array that the model requires the fallowing is all that was required to make it run in python if any one could show me how to do that it would be a great help
int[]input = {57, 45, 46, 56, 11, 46};
var ip = np.asarray((0)).reshape((1));
ip.reshape((1, input.Length));

You can use npArray.Data<int>().ToArray() to convert from NDArray to int[].


Update to latest changes in purescript-generics

https://github.com/purescript/purescript-generics/pull/21

https://github.com/zudov/purescript-strongcheck-generics/commit/e5e7f7409c229e53ec80e3db31c5792d74cac1fc


fixing queryString (python 2 and 3) and cookies value for latest mitm

Regarding har_extractor

queryString for param id=aflon was coming as

"queryString": [
            {
              "name": "i",
              "value": "d"
            }
          ],

(due to missing iteritems()  / items() .. i guess this was never working even in python 2)

Cookies were coming as

"request": {
          "cookies": [
            {
              "name": "__cfduid",
              "value": "d"
            },
            {
              "name": "user",
              "value": "m"
            }
          ],

values have only one letter due to v[0] .. probably because it earlier used to an array?
This fixes those two issues. Rest of the fields look good in python 3 unless someone finds a problem.

There are issues with some other fields too. Will create a new pull request if I ever come around to fix those too.  (line 31 in harparser.py has iteritems() )
Will close this pull request. Anyone is welcome to proceed with the fixes.


Use encrypted auth token for images

Details
Uses an encrypted auth token instead of a plain one in URLs to fetch images.
Fixed Issues
Fixes https://github.com/Expensify/Expensify/issues/166503
Tests / QA Steps

Upload an image in a chat.
Verify that you can view the thumbnail image in the chat.
Tap on the image, and verify that you can view the full-size preview in the attachment modal.
Make sure you are not logged into E.com.
Upload a .zip file to chat.
Click on the attachment link for the .zip file, verify that it is downloaded without logging into E.com.
Log out then back in, then repeat steps 2, 3, & 6
Open the developer console, go to Application, search for the session key, and erase the key-value pair for encryptedAuthToken. Then refresh the page and repeat steps 2, 3, & 6.

Tested On

[x] Web
[ ] Mobile Web
[ ] Desktop
[ ] iOS
[ ] Android

Screenshots
Web

Mobile Web

Desktop

iOS

Android

HOLD on https://github.com/Expensify/Web-Expensify/pull/31211

Added an Onyx migration so users don't have to sign out and back in for images to work.

Oops, I introduced a bug with the migration.

In case it is different problem than you have. The branch should probably not work yet as mentioned above, but for me it keeps hanging on blank page after uploading an image. The thumbnail was loading for a long time so I refreshed the page and I get a blank blue page and the only way to make it work is to Clear site data in the inspector.

for me it keeps hanging on blank page after uploading an image

Good call out @mountiny, thanks for testing! This helped me identify a bug in the migration, which is now fixed. For posterity, the two issues here were:

(Web-E) The encryptedAuthToken needed to be url-encoded before being sent across the network.
I was missing a resolve() in the migration so the promise was hanging.

Updated!

As the HOLD PR https://github.com/Expensify/Web-Expensify/pull/31211 is merged, shall I merge it or do I need to wait for the Title label to be updated?

@mountiny Good question – general rule-of-thumb is don't merge a PR with HOLD in the title. In this case we need to wait for that Web-E PR to be deployed to production.

Perfect! Thanks for clarifying!

:hand: This PR was not deployed to staging yet because QA is ongoing. It will be automatically deployed to staging after the next production release.

🚀 Deployed to staging in version: 1.0.73-4🚀

platform
result

🤖 android 🤖
success ✅

🖥 desktop 🖥
success ✅

🍎 iOS 🍎
success ✅

🕸 web 🕸
success ✅

🚀 Deployed to production in version: 1.0.74-0🚀

platform
result

🤖 android 🤖
success ✅

🖥 desktop 🖥
success ✅

🍎 iOS 🍎
success ✅

🕸 web 🕸
success ✅


Assimulo solvers

When I try to install assimulo withing conda environment I get the following error on the Python 3.6.8
Could not find cannot import name 'radau5'
Could not find cannot import name 'dopri5'
Could not find cannot import name 'rodas'
Could not find cannot import name 'odassl'
Could not find ODEPACK functions.
Could not find RADAR5
Could not find GLIMDA.
The assimulo is used for pyFMI simulations but unsucesfully. Why the solvers are not working

conda list ?

Installed here is the conda list:
assimulo                  3.0             py36h1fff9c8_1004    conda-forge

windows ?

Yes installed within anaconda

it's a duplicate of #19, closing


Version 1.0.1 fails coverage reporting

I'm getting the following error with the coverage reporting.
/path/to/099_coverage_spec.rb:1:in `block in <top (required)>': uninitialized constant RSpec::Puppet::Coverage (NameError)
Any idea's ?

Closing this issue as its been solved in the meantime.


Documentation

Hi, I have a Miele@Home-Account. But where can I find the Client-ID? And what's the client secret? Is it the password?
Unfortunately no hint in documentation.
And the link to Miele@home in the documentation is not totally correct: you first have to select a country, otherwise you don't find a possibility to get an account.
And wants about the "Authorization grant server port."? Also no hint in the documentation...

Hi Stefan,
go to this website (it is the second link for gettimg a devolper account) https://www.miele.com/developer/.
Click on get involved and fill the two fields and register the app.
The name of your application is not really important.
Then you should get the needed credentials for the plugin.
I hope this helped.
Peter

Worked, thank you!