@netlify/plugin-nextjs fails with "Cannot find module"

Describe the bug
Next.js app build is failing with this error:
8:30:27 AM: ────────────────────────────────────────────────────────────────
8:30:27 AM:   Plugin "@netlify/plugin-nextjs" failed
8:30:27 AM: ────────────────────────────────────────────────────────────────
8:30:27 AM:
8:30:27 AM:   Error message
8:30:27 AM:   Error: Error loading your next.config.js.
8:30:27 AM:   Cannot find module '@next/bundle-analyzer'
8:30:27 AM:   Require stack:
8:30:27 AM:   - /opt/build/repo/frontend/next.config.js
8:30:27 AM:   - /opt/build/repo/frontend/node_modules/next/dist/next-server/server/config.js
8:30:27 AM:   -<EMAIL_ADDRESS>8:30:27 AM:   -<EMAIL_ADDRESS>8:30:27 AM:   -<EMAIL_ADDRESS>8:30:27 AM:   -<EMAIL_ADDRESS>8:30:27 AM:   -<EMAIL_ADDRESS>
next.config.js
const hostname = new URL(process.env.WORDPRESS_URL).hostname;
const withBundleAnalyzer = require('@next/bundle-analyzer')({
  enabled: process.env.ANALYZE === 'true',
});

module.exports = withBundleAnalyzer({
  target: 'serverless',
  webpack: config => {
    config.module.rules.push({
      test: /\.svg$/,
      use: ['@svgr/webpack', 'url-loader'],
    });
    return config;
  },
  images: {
    domains: [hostname],
  },
});

netlify.toml
[build]
  base = "frontend/"
  command = "yarn build"
  publish = ".next"

[[plugins]]
  package = "@netlify/plugin-nextjs"

Versions

<EMAIL_ADDRESS><EMAIL_ADDRESS>

The last successful build happened 5/26 with these versions:

<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>
The first failed build happened 6/1 with these versions:

<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>
I tried to deploy the last successful build from 5/26 today and it failed with the same error with these versions:

<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>
I think the only thing that changed between the last successful deploy and when I tried to redeploy it are the @netlify/build and @netlify/plugin-nextjs versions.

@clareoneill hey claire! thanks for the detailed issue!! it seems like the only diff between the 5/26 successful build and 6/1 failed build is the netlify/build version, so i pinged some engineers internally. while we did only release 3.4.0 today, i can't rule out it being somewhat part of the issue. would it be possible to spin up a repo that reproduces the cannot find module error for us? that would be super helpful, though we do v much appreciate all the details already included!! 🙏

Figured it out! NODE_ENV was set to production so the devDependencies weren't being installed during the build 🤦🏻 Thanks for pointing me in the right direction.


Add alpha development screenshot.

Add screenshot and update readme to show it.
Update readme with github workflow actions badge.

https://help.github.com/en/actions/configuring-and-managing-workflows/configuring-a-workflow#adding-a-workflow-status-badge-to-your-repository


change 0% to 0 on flex["1"] in default config

Some css parsers fail when 0 has units.
Can we just change this so less people run into this issue?
https://github.com/styled-components/css-to-react-native/issues/114

Unfortunately this is necessary to workaround a bug in IE11 where all flex basis values need a unit:
https://github.com/philipwalton/flexbugs/blob/master/README.md#flexbug-4
Where is this an issue for you?

Ok, thanks, I'll close it.
Seeing some parsing issues from the default css in css-to-react-native: https://github.com/styled-components/css-to-react-native/issues


some issues

Hello,
I installed in my pc using snakemake and git, but when I try to run the test I get the following error:
it is possible to have a step by step of how to run the tutorial in snakemake?
Using temporary directory: tests/tmp/cabana/LLPRIMER_22943487/
Using output directory: tests/output_pecto/
Building DAG of jobs...
MissingInputException in rule clusters_blastx_nontarget_format in line 77 of /home/cabana/Documents/INS/coregenomeprimers/CoreGenomePrimers/./bin/cgp/nontarget/cds/Snakefile:
Missing input files for rule clusters_blastx_nontarget_format:
output: tests/output_pecto/cgp/nontarget/cds_blastx.tsv
affected files:
None
Thanks

You need to update the paths to the database files in the config: https://github.com/leylabmpi/CoreGenomePrimers/blob/master/config.yaml

The databases have been uploaded to http://ftp.tue.mpg.de/ebio/projects/CoreGenomePrimers/
Feel free to re-open the issue if you experience any problems with the databases.

Thank you for the help!!!
Now the pipeline is running!!! Now I have the next error:
Activating conda environment: .snakemake/conda/4399104154e1404dd5821e6396e5680d_
[Thu Sep 22 15:00:18 2022]
Error in rule primers_design:
jobid: 96
output: tests/tmp/cabana/LLPRIMER_22943487/primers_raw/cds/10/primers_degen.fna, tests/tmp/cabana/LLPRIMER_22943487/primers_raw/cds/10/primers_expand.fna, tests/tmp/cabana/LLPRIMER_22943487/primers_raw/cds/10/primers.tsv
log: tests/output_pecto/logs/cgp/primers/design/cds/10.log (check log file(s) for error message)
conda-env: /home/cabana/Documents/INS/coregenomeprimers/CoreGenomePrimers/.snakemake/conda/5c4280d88a5bb1e9f08bb8027c1720fe_
shell:
    export PATH=$CONDA_PREFIX/bin:$PATH
    PREFIX=`echo "tests/tmp/cabana/LLPRIMER_22943487/primers_raw/cds/10/primers.tsv" | perl -pe 's/\.tsv$//'`
    bin/scripts/primer_design.py --consensus-threshold 0.34 --num-raw-primers 1000 --num-final-primers 10 --opt-size 20 --min-size 18 --max-size 26 --opt-prod-size 150 --min-prod-size 100 --max-prod-size 250 --opt-tm 62 --min-tm 54 --max-tm 70 --max-tm-diff 2.5 --oligo-DNA 50 --salt-monovalent 50 --salt-divalent 1.5 --dNTPs 0.2 --opt-gc 50 --min-gc 25 --max-gc 75 --max-degeneracy 128 --max-degeneracy-3prime 6 --window-3prime 5 --make-oligo 0 --int-opt-size 20 --int-opt-tm 60           --prefix $PREFIX tests/tmp/cabana/LLPRIMER_22943487/clusters_core/cds/cluster_10.afa 2> tests/output_pecto/logs/cgp/primers/design/cds/10.log 1>&2

    (one of the commands exited with non-zero exit code; note that snakemake uses bash strict mode!)

And the 10.log is:
2022-09-22 15:00:15,985 - Designing primers...
2022-09-22 15:00:18,546 -   No. of raw degen primer sets: 1000
2022-09-22 15:00:18,546 - Calculating degenerate primers...
Traceback (most recent call last):
File "bin/scripts/primer_design.py", line 756, in
main(args)
File "bin/scripts/primer_design.py", line 733, in main
internal_oligo=args.make_oligo)
File "bin/scripts/primer_design.py", line 465, in calc_degen
window=window_3prime)
File "bin/scripts/primer_design.py", line 355, in expand_degen
degen = reduce((lambda x, y: x * y), [len(x) for x in seq])
NameError: name 'reduce' is not defined
Please, I need your help!!

The error was due to a version issue with python. It should now be fixed. To be clear, if you run into a new problem, please open up a new issue. "some issues" isn't really a specific title for your problem(s).
Note: running the BLAST vs nt/nr will require a lot of memory (and time) by default. I hope that you have sufficient computational resources.

Thank you for your help!!!


Regarding POC

MARUTI - At the POC, 7205.8 there is [34/34]. What does that denote? - posted by<EMAIL_ADDRESS>

CAn someone explain?


[Neue] Post avi, PostMeta cleanup

This PR shrinks the size of avatars in all post components to 42 from 52 (matches new ProfileCard). It also refactors PostMeta in situ to use our new text handling, and introduces WebOnlyInlineLinkText as a replacement for TextLinkOnWebOnly.
Closes #5346 and closes #5322

Thanks @surfdude29 will have a look!

I just tried the preview branch and tested with Japanese and Korean, thanks for fixing the timestamp text wrapping! :)


HV-943 Clarifying note on traversable resolvers in reference guide

HV-5-MASTER #655 SUCCESS
This pull request looks good

Merged thanks.


server: check service offering (storage) tags when reallocate a ROOT disk

Description
This PR fixes #4406  (probably)
In some cases, the disk offering of ROOT disk is not same as service offering of VM.
for example
(1) create a vm but not start it, then scale vm to another service offering
(2) reinstall vm, then scale vm to another service offering
These two issues are fixed by this PR.
The issue might exist in some other scenarios, so it would be better to always update ROOT disk offering tags to the tags of vm service offering in DeploymentPlanningManagerImpl.java.

Types of changes

[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] New feature (non-breaking change which adds functionality)
[x] Bug fix (non-breaking change which fixes an issue)
[ ] Enhancement (improves an existing feature and functionality)
[ ] Cleanup (Code refactoring and cleanup, that may add test cases)

Feature/Enhancement Scale or Bug Severity
Feature/Enhancement Scale

[ ] Major
[ ] Minor

Bug Severity

[ ] BLOCKER
[ ] Critical
[x] Major
[ ] Minor
[ ] Trivial

Screenshots (if appropriate):
How Has This Been Tested?

@blueorangutan package

@davidjumani a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian. SL-JID 1386

@blueorangutan package

@DaanHoogland a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian. SL-JID 1417

@blueorangutan test

@weizhouapache a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

Trillian test result (tid-2228)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 30502 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5501-t2228-kvm-centos7.zip
Smoke tests completed. 87 look OK, 0 have errors
Only failed tests results shown below:

Test
Result
Time (s)
Test File

@weizhouapache can you re-target to 'main' please.

@blueorangutan package

@blueorangutan package

@weizhouapache a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 1475

@blueorangutan test

@sureshanaparti a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

Trillian test result (tid-2278)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 36153 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5501-t2278-kvm-centos7.zip
Smoke tests completed. 86 look OK, 4 have errors
Only failed tests results shown below:

Test
Result
Time (s)
Test File

test_01_add_primary_storage_disabled_host
Error
0.62
test_primary_storage.py

test_01_primary_storage_nfs
Error
0.12
test_primary_storage.py

ContextSuite context=TestStorageTags>:setup
Error
0.22
test_primary_storage.py

test_01_secure_vm_migration
Error
155.45
test_vm_life_cycle.py

test_02_unsecure_vm_migration
Error
272.30
test_vm_life_cycle.py

test_03_secured_to_nonsecured_vm_migration
Error
149.10
test_vm_life_cycle.py

test_08_migrate_vm
Error
43.89
test_vm_life_cycle.py

test_02_list_snapshots_with_removed_data_store
Error
9.56
test_snapshots.py

test_02_list_snapshots_with_removed_data_store
Error
9.57
test_snapshots.py

test_hostha_enable_ha_when_host_in_maintenance
Error
303.77
test_hostha_kvm.py

test_hostha_kvm_host_recovering
Error
8.16
test_hostha_kvm.py

@blueorangutan test

@sureshanaparti a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

Trillian test result (tid-2283)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 40643 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5501-t2283-kvm-centos7.zip
Smoke tests completed. 88 look OK, 2 have errors
Only failed tests results shown below:

Test
Result
Time (s)
Test File

ContextSuite context=TestKubernetesCluster>:teardown
Error
84.12
test_kubernetes_clusters.py

test_disable_oobm_ha_state_ineligible
Error
1512.68
test_hostha_kvm.py

@blueorangutan test

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

Trillian test result (tid-2300)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 33338 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5501-t2300-kvm-centos7.zip
Smoke tests completed. 90 look OK, 0 have errors
Only failed tests results shown below:

Test
Result
Time (s)
Test File

Trillian test result (tid-2302)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 33829 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5501-t2302-kvm-centos7.zip
Smoke tests completed. 90 look OK, 0 have errors
Only failed tests results shown below:

Test
Result
Time (s)
Test File


30 swagger ui

@yspanchal please look into this, something doesn't seem right. 600+ files have been changed.

@sidharthshah fixed. PR was raised against master branch. i changed it to develop.


Simplified if return

Simplify if control structures that return the boolean result of their condition.

See earlier comments. In future, please don't open loads of PRs without consulting the authors. This helps make sure both of us aren't wasting our time. If you want to propose new CS styles, open a single PR with the proposed config changes.


Regression on positions of constants

With the new constant evaluator, we don't serialize the source positions of constants. This causes some missing positions in stack traces when a constant is involved in a runtime error. For instance, the test language_2/vm/bool_check_stack_traces_test/01 fails because a null condition in an if statement comes from a const variable.
A full fix will require a change to the Kernel binary format to include the position into ConstantExpression nodes, plus support for reading this position from the node in all backends.
A simpler solution that will handle common cases (including the mentioned test) would be to convert primitive constants back into literals in places that do not require a constant (such as referencing a const variable).

Proposed fix: https://dart-review.googlesource.com/c/sdk/+/98677.


References not showing correctly

VSCode Version: Code 1.7.1 (02611b40b24c9df2726ad8b33f5ef5f67ac30b44, 2016-11-03T13:46:00.226Z)
OS Version: Darwin x64 15.6.0
Extensions:

Extension
Author
Version

unity-tools
Tobiah
0.1.9

unity-debug
Unity
1.1.0

unity-snippets
YclepticStudios
0.1.2

csharp
ms-vscode
1.5.1

mono-debug
ms-vscode
0.11.0

omnisharp
ms-vscode
0.3.3

colonize
vmsynkov
1.0.1

Steps to Reproduce:

Just installed c# 1.5.1 and seeing this

Duplicate of #15389

Closing as duplicate. Please use the insiders build until the next VS Code update


Support for UITextField

Added support for UITextField & Updated documentation.
Please refer #62

great job! Thanks


Revert "Delete manifests/a/AList/AList/3.15.0 directory"

Reverts microsoft/winget-pkgs#189430
Microsoft Reviewers: Open in CodeFlow

URL: https://github.com/alist-org/alist/releases/download/v3.15.0/alist-windows-386.zip
Status Code: 200
(Automated message - build 897)

Commenting to remove Needs-Author-Feedback label.

URL: https://github.com/alist-org/alist/releases/download/v3.15.0/alist-windows-386.zip
Status Code: 200
(Automated message - build 897)

URL: https://github.com/alist-org/alist/releases/download/v3.15.0/alist-windows-386.zip
Status Code: 200
(Automated message - build 897)

[Policy] Needs-Manual-Merge


feat(printer): mk printers more easily configurable

Hi !
Following this issue I opened https://github.com/scalameta/munit/issues/637 and closed right after once I realised I should havve looked around a bit more, I tried my hand at using custom pretty printers to clarify some of my diffs.
Using the answer to this question https://github.com/scalameta/munit/issues/480 I got pretty much what a I needed ( comparing scodecs ByteVectors ) but I found the experience a bit confusing and felt some boilerplate could be avoided.
Which leads me to this PR :)
Changes :

add orElse combinator for Printer for composability
add utility constructor for easier instantiation : user will only pass whatever is actually meaningful to them in most cases, ie. the custom logic to turn their test values into differenciable strings
update Assertion to allow users to pass their custom Printer without also overriding munitPrint

Comment taken into account. I also restricted some tests to scala 2.13 like in munit.PrintersSuite and fixed the Printer implem to compile under 2.12

Looks like the tests are passing! Let's see if anyone more familiar with the codebase has time to look at it.

Comments taken into account in the latest commits. Also added section covering the why and how of custom printers in https://scalameta.org/munit/docs/tests.html right under custom timeouts. Please tell me if its clear enough and / or if you would prefer it elsewhere :)

scalafmt and scalafix ran without apparent issue
But I've got some errors from doc/docusaurusCreateSite which seem unrelated to this PR

Any idea why ?

scalafmt and scalafix ran without apparent issue
But I've got some errors from doc/docusaurusCreateSite which seem unrelated to this PR
Any idea why ?

That might be an existing issue, I don't think your change could have influenced anything

Any plans to release this change soon ?


SampleRNN performance

On a Tesla K80, how much time does an epoch take? For the samples listed on soundcloud, how many epochs is it? What hardware is used?

For music dataset with a K80 it took us ~20 epochs in three days. You will get so-so samples much sooner. As long as the rest of the machine is decent enough (which I assume that's the case as you have a K80 installed) the rest should be fine.

@soroushmehr thanks much for the quick reply :) Is this on two or three tier?

It's for both, give or take a few.

@soroushmehr i'm getting very different performance (much slower) for the music dataset. if you have a moment i would appreciate any advice.
i'm running a k80 on google compute engine. 8 CPUs, 30 GB of RAM. the image is on a 10GB disk and i have a 250GB SSD attached for storage. here's an excerpt from the training:
Wall clock time spent before training started: 0.11h
Training!
0 500 1000
Validation! Done!

>>> Best validation cost of 1.7006663084 reached. Testing! Done!
>>> test cost:1.70596313477     total time:390.858022928
epoch:0 total iters:1460        wall clock time:1.82h
>>> Lowest valid cost:1.7006663084       Corresponding test cost:1.70596313477
        train cost:1.8725       total time:1.50h        per iter:3.699s
        valid cost:1.7007       total time:0.11h
        test  cost:1.7060       total time:0.11h
Saving params! Done!
Train info saved! And plotted!
Sampling! 20 samples of 5 seconds length generated in 1773.51222897 seconds. Done!
Validation Done!
Back to Training...
1500 2000 2500
Validation! Done!

>>> Best validation cost of 1.6106518507 reached. Testing!  Done!
Train info saved! And plotted!
Sampling! 20 samples of 5 seconds length generated in 1770.73614192 seconds. Done!
Validation Done!
Back to Training...
3000 3500 4000
Validation! Done!

>>> Best validation cost of 1.54390776157 reached. Testing!  Done!
Train info saved! And plotted!
Sampling! 20 samples of 5 seconds length generated in 1747.0210681 seconds. Done!
Validation Done!
Back to Training...
4500 5000 5500
Validation!  Done!
Train info saved! And plotted!
Sampling! 20 samples of 5 seconds length generated in 1747.70665789 seconds. Done!
Validation Done!
Back to Training...
6000 6500 7000 [Another epoch]
Validation! Done!

>>> Best validation cost of 1.50889408588 reached. Testing! Done!
>>> test cost:1.50275349617     total time:389.24376297
epoch:1 total iters:7251        wall clock time:10.49h
>>> Lowest valid cost:1.50889408588      Corresponding test cost:1.50275349617
        train cost:1.4716       total time:7.44h        per iter:3.695s
        valid cost:1.5089       total time:0.11h
        test  cost:1.5028       total time:0.11h
Saving params! Done!
Train info saved! And plotted!
Sampling! 20 samples of 5 seconds length generated in 1744.28628492 seconds. Done!
Validation Done!
Back to Training...

Validation! Done!

>>> Best validation cost of 1.4724830389 reached. Testing!  Done!
Train info saved! And plotted!
Sampling! 20 samples of 5 seconds length generated in 1741.3295691 seconds. Done!
Validation Done!
Back to Training...
7500 8000 8500
Validation! Done!

>>> Best validation cost of 1.42520678043 reached. Testing! Done!
>>> test cost:1.4195625782      total time:390.478302002
epoch:1 total iters:8770        wall clock time:13.45h
>>> Lowest valid cost:1.42520678043      Corresponding test cost:1.4195625782
        train cost:1.3996       total time:9.00h        per iter:3.695s
        valid cost:1.4252       total time:0.11h
        test  cost:1.4196       total time:0.11h
Saving params! Done!
Train info saved! And plotted!
Sampling! 20 samples of 5 seconds length generated in 1760.72217083 seconds. Done!
Validation Done!
Back to Training...
9000 9500

It looks like it's generally working:

if i run watch -n0.1 nvidia-smi i can see it fluttering between ~900MB of memory usage and ~3200MB (out of 12GB total).
running htop i can see python is using one core at 100%:
  PID USER      PRI  NI  VIRT   RES   SHR S CPU% MEM%   TIME+  Command
 1614 kyle       20   0 55.3G 2117M  186M R 99.5  7.0 15h04:02 python ...

the memory use clearly isn't a bottleneck (7%) but it seems like the CPU use is very high. i thought training was usually a GPU constrained process?

K80 Driver Version: 375.26
CUDA 8.0.61_375.26
cuDNN v5.1
lasagne 0.2.dev1
python 2.7.6
latest numpy and theano installed with conda

the main differences are the python version, and possibly the numpy version.. but if it's generally working, i would expect a big problem from these.

It looks like you did not specify THEANO_FLAGS=mode=FAST_RUN,device=gpu0,floatX=float32 to tell theano to use GPU.
That may be causing the model to run on cpu and hence the slowdown.
Is it the case?

hi @kundan2510 i copied the command from the readme, which includes THEANO_FLAGS=mode=FAST_RUN,device=gpu0,floatX=float32. also, would i see 3GB of GPU memory being used by python in nvidia-smi if theano was not using the GPU? is there another way to know that theano is not using the GPU?
i didn't paste the beginning of the output, but i remember it mentioning that the GPU was being used.
i did find one mistake, however, which is that i am using CUDA but not cuDNN. is this speed more like CPU-only speed, CUDA-only speed, or is it possible that everything is correct and there is another bottleneck like between the RAM and GPU, or due to this being run in a VM?

This seems like CPU-only speed to me. We are anyway not using any cuDNN functions, hence, I would not expect any speedup-drop due to absence of cuDNN.
Following command should let you see if you are able to use GPU or not:
THEANO_FLAGS=mode=FAST_RUN,device=gpu0,floatX=float32 python -c "import theano"
If it uses GPU, it will show that you are using GPU k80. Also, when you run the code, the first line printed should be "Using gpu device 0: Tesla K80 ...." which is missing in the output you copied in one of the previous comment.

set this up again on a local machine with a gtx 980, similar results:
$ THEANO_FLAGS=mode=FAST_RUN,device=gpu0,floatX=float32 python -c "import theano"
WARNING (theano.sandbox.cuda): The cuda backend is deprecated and will be removed in the next release (v0.10).  Please switch to the gpuarray backend. You can get more information about how to switch at this URL:
 https://github.com/Theano/Theano/wiki/Converting-to-the-new-gpu-back-end%28gpuarray%29

Using gpu device 0: GeForce GTX 980 (CNMeM is disabled, cuDNN 5110)

and here's the beginning of the command running:
Experiment started at: 2017-03-26 19:41
WARNING (theano.sandbox.cuda): The cuda backend is deprecated and will be removed in the next release (v0.10).  Please switch to the gpuarray backend. You can get more information about how to switch at this URL:
 https://github.com/Theano/Theano/wiki/Converting-to-the-new-gpu-back-end%28gpuarray%29

Using gpu device 0: GeForce GTX 980 (CNMeM is disabled, cuDNN 5110)
Created experiment tag for these args:
models-three_tier-three_tier.py-expBEST_3TIER-seq_len512-big_frame_size8-frame_size2-emb_size256-skip_connF-dim1024-n_rnn1-rnn_typeGRU-q_levels256-q_typelinear-batch_size128-weight_normT-learn_h0T-which_setMUSIC-lr0.001
Python:
	sys.version_info	sys.version_info(major=2, minor=7, micro=12, releaselevel='final', serial=0)
Numpy:
	.__version__	1.12.0
Theano:
	.__version__	0.9.0.dev-b3d19ce8e8d7cdf87c3f84599be81647803aa1f6

All passed args:
['models/three_tier/three_tier.py', '--exp', 'BEST_3TIER', '--seq_len', '512', '--big_frame_size', '8', '--frame_size', '2', '--emb_size', '256', '--skip_conn', 'False', '--dim', '1024', '--n_rnn', '1', '--rnn_type', 'GRU', '--q_levels', '256', '--q_type', 'linear', '--batch_size', '128', '--weight_norm', 'True', '--learn_h0', 'True', '--which_set', 'MUSIC']

...

it looks like it's using the GPU but still taking longer than the 20 epochs in 72 hours.
i'll run this for a while and check the timing.

Here is a result for some user who trained 9 epochs in 20hrs on gtx1080. https://github.com/soroushmehr/sampleRNN_ICLR2017/issues/9 You may want to try the same config.

thanks @kundan2510. i tried the same config as #9 on the gtx 980, and it ran out of memory (Error allocating<PHONE_NUMBER> bytes of device memory (out of memory). Driver report 464125952 bytes free and<PHONE_NUMBER> bytes total). then i tried it on the K80 and it doesn't run out of memory, but still seems to go just as slowly as before.
here are my complete version numbers:
K80 (Google Compute Engine):

NVIDIA-SMI 375.26, Driver Version: 375.26
Cuda compilation tools, release 8.0, V8.0.61
cuDNN 5110
Python 2.7.13
numpy 1.12.1
scipy 0.19.1
theano 0.9.0.dev-b3d19ce8e8d7cdf87c3f84599be81647803aa1f6
lasagne 0.2dev1

GTX 980

NVIDIA-SMI 375.39, Driver Version: 375.39
Cuda compilation tools, release 8.0, V8.0.61
cuDNN 5110
Python 2.7.12
numpy 1.12.0
scipy 0.18.1
theano 0.9.0.dev-c697eeab84e5b8a74908da654b66ec9eca4f1291
lasagne 0.2dev1

since you said that cuDNN is not being used, then i suspect 5110 vs 5105 should not make a difference. i also suspect that Python 2.7.13 vs 2.7.12 shouldn't make a difference. this leaves the possibilities of:

theano
CUDA/nvcc

maybe the thing that i'm missing is that theano 0.9 should only be used for the wavenet re-implementation, but not for the samplernn models? i will try to downgrade theano and test.

You can have a look at th_conf.txt under that specific experiment. All the flags passed to Theano will be there. Look for suspicious flags in http://deeplearning.net/software/theano/tutorial/using_gpu.html and http://deeplearning.net/software/theano/library/config.html.
Other option would be to profile it (e.g. with profile=True,profile_memory=True) to see where is the bottleneck. This might give us more insight into what's happening during compilation and run.
Have you tried clearing the cache before launching the experiment? Whenever you change the Theano version, compiler, etc. or in general once in awhile, it is a good practice to clear it.

i'm put the entire directory online (temporarily). here's a link to th_conf.txt
i generally clear the theano cache often. in this case, i installed all the software fresh on the google compute instance, so there was no need to clear the cache in terms of version changes (though clearing out old experiments that might have hung was still relevant).
i looked through the flags and didn't see anything suspicious. i suspect that 2.5s vs 1.7s per iteration is just due to the hardware differences...?

I didn't see anything abnormal. Although I don't have much experience with Google compute instance, maybe we are left to assume, as you said, there is a difference due to hardware and/or config.


Change grunt to gulp

Well, I don't have much expertise in gulp, that would be a nice thing :)

What are the motivations for the switch ?

Hey @mauriciosoares & @GrosSacASac, since it is a pure JS lib, maybe need to consider Rollup or something like that which fits better for a library development/automation for different apporaches (commonjs, umd, esm, etc.).

Hi @hwclass We will use rollup as bundler for sure. Grunt and Gulp are not bundlers, they are tasks runners, so we can use rollup inside grunt if you see what I mean. Task runner can define task like linting, testing etc. Nowadays the most popular task runner is webpack, which also contains a bundler (webpack bundler). Webpack is made for apps, not libraries so there is no benefit of using it.
I asked a few friends, and it turns out grunt and gulp are almost the same, grunt is very similar to npm scripts, and gulp uses an asset pipelining paradigm.

There were actually no specific motivation for changing from grunt to gulp 😅, I don't think that's necessary at all, and I like the idea of using rollup instead of any task runner, and use npm scripts to run the commands, to make it more lightweight.


config.yaml valid yaml

registry:
  # Note this is project *ID*, not just project
  #
  # `<prefix>` can be any string and will be appended to image names
  # e.g., `dev` and `prod`.
  prefix:  gcr.io/<google-project-id>/<prefix>

hub:
  # This is the DNS that you've configured. E.g. `beta.mybinder.org`
  # Note that there is `http://` here
  url: http://<dns-entry-for-jupyterhub>

ingress:
  enabled: true
    # But no `http://` here
    host: <dns-entry-for-binder>

jupyterhub:
  ingress:
    enabled: true
    # But no `http://` here
    host: <dns-entry-for-jupyterhub>

the comment and host of the ingress block need to be moved back to be valid yaml
Chris edit:
The problem here is that the yaml we told people to put into their config files was invalid - there was an extra tab where there shouldn't be. This should be fixed once #113 is merged

Closed by #113


ADD: extract_env python script

Thought it would be much better to do a python script actually taking directly a spack spec as argument extracting the SPACK_RUN_ENV dictionary and creating the env.txt directly so this PR changes that.
To test just:
./extract_env.py spack_spec

launch jenkins --test=root -v cosmo@master%pgi

launch jenkins --test=root -v cosmo@master%pgi

works on tsa, can be merged.

launch jenkins --test=root -v cosmo@master%pgi

launch jenkins cosmo@master%pgi


#267 - Add Serilog to C7Engine

And replace all Console logs in that project with it.
Used what I thought was the appropriate level.  We can shift them as time goes; I expect we'll generally be demoting logs from info to debug (or verbose) as more is added.
Also set the default minimum level to "info".  We should be selectively enabling debug for certain areas, which I plan to test next.
Opening this PR even though it's only the Engine part of propagating Serilog, since the sooner we get it to more modules the fewer Console logs we will have to convert.  I might have more modules added soon, but if not at least it'll be in one.

Regarding your newest commit, I think that would be covered by #259. @TinaFemea I know you haven't used Serilog, but generally the approach would be to create your logging sinks (outputs) to log everything and then configure your filters at runtime to capture what you want, right?

Yep!  Log everything, then filter out what you don't want.

Yeah, for that last commit I had a feeling there was a better way to do it; the way I found felt a bit clumsy.  Ironically I don't think I've ever actually set up namespace-based log filtering before.  At work we usually had something like Splunk to filter the logs (and if not, we just had lots of logs to wade through), and with projects like my editor I've just tweaked things manually when needed.
I also hadn't seen #259 yet.  Glad we have a card for it.  Going to go ahead and merge this one, and probably swing back around to that later if someone else hasn't first.  This was kind of a side quest from my other tasks, which will benefit from it, so I want to wrap them up next.


Angular breaks the ability to select all hidden columns

Description

As reported at https://forum.handsontable.com/t/show-hide-copy-inconsistent/1565
It's an Angular only bug. It does not occur for the vanilla version.

I am using PRO 1.14.2 with Angular4.
I am loading data for grid on init, and hide/show cols based on condition.
Say, table has a,b,c,d as columns. Once initialized with data, I am updating through settings to hide c,d based on user selection. It is hiding the columns. But when I copy the grid through Ctrl+C, only a,b are copied.
If I hide just column c, then on copy it is copying all the columns (including hidden).
Looks like if hidden columns are at the end, they are not copied.If they are in between they are copied.
Please clarify on this.
This fiddle I tired with end columns, it is working, but not in Angular Wrapper http://jsfiddle.net/6y8f4xrL/

Steps to reproduce

Hide any column on the beginning or at the end of the table
Click CTRL/CMD + A to select all columns
Use any other editor - can be Excel/Calc as well to paste the values

Your environment

Wrapper version: 1.0.0-beta3
Browser Name and version: Chrome 62
Operating System: Windows 10

I think we can close this issue. Feel free to reopen this one if you find similar problems in the most recent version.

Updated the version to
"@handsontable-pro/angular": "^1.0.0-beta4",
"handsontable-pro": "^1.15.1",
issue still remains...

Hi @sumavr,
as I mentioned before, this behaviour is exactly as we expect. There is no issue in my opinion. Especially in the wrapper.
If you think, that selection all cells and hiding columns/rows should work in a different way, you can create new issue here.
I would like to notice that is the same behaviour like in Google Sheets.


⚠ Jerry Savelle Ministries International Australia has degraded performance

In f1aa397, Jerry Savelle Ministries International Australia (https://jsmiaustralia.org) experienced degraded performance:

HTTP code: 200
Response time: 5403 ms

Resolved: Jerry Savelle Ministries International Australia performance has improved in 8146b4a after 12 minutes.


Cloudscraper fix

Use cloudscraper to download content and also use book metadata to get download urls.

Thanks for your contribution! Cloudscraper is a large, heavy dependency. Do you have any evidence for what causes the 403 from #122 or a reason to believe it's resolved by a feature of cloudscraper?  Can you tell me more about how this change works?

Thank you for the PR. To add a datapoint here, it did not solve the requests.exceptions.HTTPError: 403 Client Error: Forbidden for url: https://authorize.kobo.com/ww/en/signin/signin error during user add from PR #122 for me.


HTMLBars not respecting Ember.String.htmlSafe()

If I bind to the variable message in a template:
//template.hbs
{{message}}

//component.js
message: "line one
line two"

message will be escaped and the
 tag will not cause a line break. However, if the variable is a SafeString, it is still escaped:
//component.js
message: Ember.String.htmlSafe("line one
line two")

Could you please provide a demo/reproduction?

 I was trying to compose multiple htmlSafe strings and pass that as message. If I compose the string then call htmlSafe it works.
Thanks.


Filter archived keys on NewkeyImput so we will not get "archived folders"

#992

I understand the case (although there's no semantics of archived folders), does this fix allow user to recreate an archive key? (cause this case can be more unpredictable)

/cf-test

/cf-test


User self management page

Dependant on #9
A page that allows a user to:

Submit documents to apply for starving hacker
Pause membership

With some kind of 'reason' field.
With some kind of controls so that we dont get people paying for a month, using a week, pausing for two months, using for a week, etc.

Resume membership
Stop membership

With some kind of exit survey

This will be implemented with the new stripe billing feature so is now redundant.

This will be implemented with the new stripe billing feature so is now redundant.

can the ticket remain open until these features are implemented?

can the ticket remain open until these features are implemented?

The stripe ticket (#9) has been updated to include all of the relevant stipe billing features, including these.

The stripe ticket (#9) has been updated to include all of the relevant stipe billing features, including these.


Release on F-Droid

I can see F-Droid release APK's right there, in your source code  on GitHub and GitLab (I believe they should be posted in "Releases" section, but ok), but the app is not actually on F-Droid. Why don't you submit it, if you already make F-Droid builds?

Released on F-Droid https://f-droid.org/packages/org.futo.circles/


Remove unused functions from 5.6 backdeploy

Removing

swift_task_localValueGetImpl
swift_task_localValuePopImpl
swift_task_localsCopyToImpl
swift_task_reportIllegalTaskLocalBindingWithinWithTaskGroupImpl

These static functions are not used or exported from the 5.6 backdeploy library.
rdar://101351064

@swift-ci please test


Recover from seed

Now that we generate a different seed every time the user starts the Configure Signing Device flow, also give the user an option to provide a seed in case they are recovering from a blown up signer.

@tomastiminskas let me know if you can wedge this into the list (iOS first would be ideal even though this is in the kotlin repo)

@pitoi I can try to get this done on iOS tomorrow. So user will enter the seed? And process will continue from there?
With seed you mean the 12/24 random words? or the seed that is later generated from the mnemonic words?

It's the 12/24 random words they should enter and then it will proceed/restore from there


Update README.md

Added my personal blog to the examples of README

Nicely done! It's amazing how a change in font can make the site feel so unique.


An error occurs when running the code

Hi, there
When I try to run your codes on the Semantic-KITTI dataset, I met an error as follows
Reusing positional embeddings.
Traceback (most recent call last):
  File "main.py", line 334, in <module>
    exp = Experiment(settings)
  File "main.py", line 80, in __init__
    self.model = self._initModel()
  File "main.py", line 91, in _initModel
    model = build_rangevit_model(
  File "main.py", line 32, in build_rangevit_model
    model = models.RangeViT(
  File "/data/rangevit/models/rangevit.py", line 347, in __init__
    resized_pos_emb = resize_pos_embed(pretrained_state_dict['encoder.pos_embed'],
KeyError: 'encoder.pos_embed'

Could you tell me how to solve this problem?

Hi!
Thank you for your question. Which pre-trained weights are you loading in  the model? If you are training from from scratch, you can set the variable reuse_pos_emb: false in the config file.

Hi! Thank you for your question. Which pre-trained weights are you loading in the model? If you are training from scratch, you can set the variable reuse_pos_emb: false in the config file.

Hi
I load the pre-trained model model_skitti_train_cs_init_h128.pth, downloaded according to your provided link.
Init a recoder at  poisoned_models/log_exp_kitti
Loading pretrained parameters from pretrained_models/model_skitti_train_cs_init_h128.pth
Loading pretrained parameters from pretrained_models/model_skitti_train_cs_init_h128.pth
Loading pretrained parameters from pretrained_models/model_skitti_train_cs_init_h128.pth
Loading pretrained parameters from pretrained_models/model_skitti_train_cs_init_h128.pth
dict_keys(['model', 'epoch'])

Hi @ideasplus. Can you share the command that you are using for running the code?

Hi @ideasplus. Can you share the command that you are running for using the code?

Sure, I use the following command:
python -m torch.distributed.launch --nproc_per_node=4 --master_port=63545 --use_env main.py 'config_kitti.yaml' ./semantic-kitti/sequences/  --save_path trained_models/  --pretrained_model pretrained_models/model_skitti_train_cs_init_h128.pth

Hello, I have encountered the same problem as you, have you solved it

Hi, there
When I try to run your codes on the Semantic-KITTI dataset, I met an error as follows
Reusing positional embeddings.
Traceback (most recent call last):
  File "main.py", line 334, in <module>
    exp = Experiment(settings)
  File "main.py", line 80, in __init__
    self.model = self._initModel()
  File "main.py", line 91, in _initModel
    model = build_rangevit_model(
  File "main.py", line 32, in build_rangevit_model
    model = models.RangeViT(
  File "/data/rangevit/models/rangevit.py", line 347, in __init__
    resized_pos_emb = resize_pos_embed(pretrained_state_dict['encoder.pos_embed'],
KeyError: 'encoder.pos_embed'

Could you tell me how to solve this problem?

reuse_pos_emb
I have encountered the same error KeyError: 'encoder.pos_embed' after setting the variable reuse_pos_emb: false

Hi! Thank you for your question. Which pre-trained weights are you loading in the model? If you are training from scratch, you can set the variable reuse_pos_emb: false in the config file.

I have encountered the same error KeyError: 'encoder.pos_embed' after setting the variable reuse_pos_emb: false

Hi @gidariss
I am trying to run evaluation of the pre-trained RangeViT model on nuScenes dataset. However, it seems the pre-trained RangeVit model doesn't provide key named "epoch" in it, which is needed in _loadCheckpoint. I suppose I can set it to an arbitrary number, right?

@gidariss please update the link of pretrained image backbone so this issue can be solved (The Cityscapes pre-trained ViT encoder weights can be downloaded from here


Attribute relation check

Schwifty will now error on server start if you have a collision between model attributes and relations.  Objection doesn't handle this well, and it's hard to do there, so handle it here instead.

@wswoodruff @mattboutet what do you think about making all the model checks configurable on/off with a plugin option?  I can imagine us adding other checks in the future for "correctness" that could break "working" deployments, and it seems like we should be able to toggle this gate off.

What's the case where this will break the build?

I consider this a semi-breaking change because servers that used to start might now fail to start (if it's using a poorly-configured model, by schwifty's standards).  If we put it behind a flag then we can offer the functionality without making a breaking change.

So there must be a situation where a model prop and relation will not break then. I thought any time this happened, Objection just crapped its pants?

  I think we should let people do it wrong (but be able to opt-in to the check) rather than breaking their deployments on a minor version upgrade.

P.S. anyone out there interested in adding documentation for this?

I can probly add documentation tomorrow


ERROR     [main] A JuicePass Proxy task failed: ValueError: reuse_port not supported by socket module (run on Windows)

I run juicepassproxy on Windows. it will error by message,
ERROR     [main] A JuicePass Proxy task failed: ValueError: reuse_port not supported by socket module
cause of  reuse_port not compatible with Windows.
I just fix problem by edit line 83 of juicebox_mitm.py to from "reuse_port=True" to "reuse_port=False". It work correctly.

Awesome find. My setup just did the same thing when I tried setting it up:
2024-10-04 22:22:23  ERROR     [__main__] A JuicePass Proxy task failed: ValueError: reuse_port not supported by socket module
Traceback (most recent call last):
  File "C:\Users\micro\Desktop\juicepassproxy-juicebox_commands\juicepassproxy.py", line 565, in main
    await asyncio.gather(
  File "C:\Users\micro\Desktop\juicepassproxy-juicebox_commands\juicebox_mitm.py", line 59, in start
    await self._connect()
  File "C:\Users\micro\Desktop\juicepassproxy-juicebox_commands\juicebox_mitm.py", line 87, in _connect
    self._dgram = await asyncio_dgram.bind(
                  ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\micro\AppData\Local\Programs\Python\Python312\Lib\site-packages\asyncio_dgram\aio.py", line 244, in bind
    transport, protocol = await loop.create_datagram_endpoint(
                          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\micro\AppData\Local\Programs\Python\Python312\Lib\asyncio\base_events.py", line 1399, in create_datagram_endpoint
    _set_reuseport(sock)
  File "C:\Users\micro\AppData\Local\Programs\Python\Python312\Lib\asyncio\base_events.py", line 92, in _set_reuseport
    raise ValueError('reuse_port not supported by socket module')
ValueError: reuse_port not supported by socket module

Possibly an issue of little consequence since the target system is Linux (within Home Assistant), but for debug testing on a separate machine, this could be fixed to make life easier.

Now. I change more to support Windows and can run as long service.

edit line 78 and 83 of juicebox_mitm.py to from "reuse_port=True" to "reuse_port=False".
change line 26 of const.py from  MAX_JPP_LOOP = 10 to MAX_JPP_LOOP = 999999 to protect proxy about when XWaybox temporary offline

FWIW, whenever I pull the latest commit, the first/only thing I have to change is "reuse_port=False" in two lines. There's a tradeoff in making that second (unrelated) change - it's likely meant as a safeguard against the software becoming unstable, but it does indeed have the effect of "crashing" if the box is ever offline (which mine is, unplugged 99% of the time because I'm a giant nerd always powering it off weird batteries and cords - I usually charge at work, ha).

@FalconFour please check the last commit which has a option to select on command line or configuration file

best will be if someone can detect the environment to select correct default on windows


fix(core-browser): move react to peerDependencies

Types

[ ] 🎉 New Features
[ ] 🐛 Bug Fixes
[ ] 📚 Documentation Changes
[ ] 💄 Code Style Changes
[ ] 💄 Style Changes
[x] 🪚 Refactors
[ ] 🚀 Performance Improvements
[ ] 🏗 Build System
[ ] ⏱ Tests
[ ] 🧹 Chores
[ ] Other Changes

Background or solution
@opensumi/ide-core-browser depends on<EMAIL_ADDRESS>which should be put in peerDependencies to avoid creating extra unnecessary<EMAIL_ADDRESS>environment.
Changelog
fix(core-browser): move react to peerDependencies.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

/publish

请再重新提交一下 lock 文件

请再重新提交一下 lock 文件

提交了，麻烦再触发下 CI。

/publish

@gemwuu @hacke2 这个有相关结论吗？移动 react 依赖到 DevDeps 的原因是啥？

@gemwuu @hacke2 这个有相关结论吗？移动 react 依赖到 DevDeps 的原因是啥？

是移到 peerDependencies 中。组件强依赖 react 框架，更加合理的做法是声明 peerDependencies，否则会污染依赖树上的 react 版本。


Match versions for historical drafts

(Note: this is a purely cosmetic feature request and not something that's probably worth prioritizing over more functional issues. I just thought I'd file it for tracking)
I do my best to make my CubeCobra card versions match the versions on MTGO, but it looks like the ability to view previous drafts (which is incredibly cool btw) just shows the default versions of those cards rather than the versions that match my cube. It would be cool if the specific card versions were recorded along with the draft info.

The complete card descriptions are recorded in the logs and should reflect the exact versions used during the draft.
I did a quick test and it seems to work as expected; Can you give me the exact steps that led you to find this discrepancy?

At least when submitting the log to magicprotools the cards are shown as their newest version on that site.

At least when submitting the log to magicprotools the cards are shown as their newest version on that site.

This one is expected, the export function only uses card names. I don't even know if the MTGO log format, or magicprotools, supports a way to specify a print (set and/or collector number).


Convert Audio to Video (with Poster) and Convert Audio for HLS

Hello
I could not find the answers to my questions so I am asking them here and I hope someone can help me.

How can I convert an audio file (wav, mp3, etc.) to a video file (mp4) using this package (with an image as a poster)?

// something like this command
ffmpeg -loop 1 -i image.jpg -i audio.wav -c:v libx264 -tune stillimage -c:a aac -b:a 192k -pix_fmt yuv420p -shortest out.mp4

How can I convert an audio file (wav, mp3, etc.) to HLS using this package?

I did this correctly for the video file and I had no problem but I did not see a sample for the audio file.
Is it possible to stream an audio file and convert it to HLS (making ts and m3u8 files)? I mean, do I need to create HLS files to stream audio files on players like Video.js? Does streaming an audio file make sense?
Do we need to convert the audio file to a video file first and then build the HLS, or can we build the HLS directly?

With this package, can a watermark be placed on a photo? Or wrote a text on it (drawtext command)?

How to add album art (jpg) to audio file (mp3) using this package?

// something like this command
ffmpeg -i in.mp3 -i test.png -map 0:0 -map 1:0 -c copy -id3v2_version 3 -metadata:s:v title="Album cover" -metadata:s:v comment="Cover (front)" out.mp3

If you provide a sample code of this package for the above three questions, I would be grateful.
Thank You

  ```

$path = [
'ffmpeg.binaries' => '/usr/local/Cellar/ffmpeg/5.1.2/bin/ffmpeg',
'ffprobe.binaries' => '/usr/local/Cellar/ffmpeg/5.1.2/bin/ffprobe',
];
$ffmpeg = FFMpeg::create($path);
// 获取音频长度
$cover_path = public_path().'storage/cover.jpg';
$mp3_path   = public_path().'storage/121.終生老友-张诗莉-朱彦安.mp3';
$mp4_path   = public_path().'storage/121.終生老友-张诗莉-朱彦安.mp4';
$srt_path   = public_path().'storage/121.終生老友-张诗莉-朱彦安.srt';
$advancedMedia = $ffmpeg->openAdvanced([]);
$advancedMedia->setInitialParameters(['-loop', '1', '-i', $cover_path, '-i', $mp3_path,
'-c:v', 'libx264',
'-c:a', 'copy',
'-vf', 'subtitles='.$srt_path,
'-shortest', $mp4_path]);
$advancedMedia->save();
to use setInitialParameters  or setAdditionalParameters method, u only can use `openAdvanced` then add your parameters.
the cost is can not listen the process  on x264 format


Add option to disable gizmo rendering for specific cameras

Added the DisableGizmos marker component that, when added, prevents a camera from rendering gizmos.

couldn't render layers be used?

couldn't render layers be used?

This was originally my plan but render layers are not extracted to the render world so using that would require additional bookkeeping.

render layers are not extracted to the render world so using that would require additional bookkeeping.

Would this similar to what is done in https://github.com/bevyengine/bevy/pull/8332 for UI?

Would this similar to what is done in #8332 for UI?

Yeah, would you prefer I grab the RenderLayers extraction code from that PR and go with that?

Yeah, would you prefer I grab the RenderLayers extraction code from that PR and go with that?

Yes. @james7132 seemed to not be a fan to add those to the render app, but if ECS/render experts are OK with that it would have my preference

My preference is also for reusing the RenderLayers mechanism here. No strong opinions on exactly how that should be done though.

@james7132 probably didn't like paying the cost of extracting RenderLayers for every ui node, but we only need them per camera/view here.

We definitely want more granular settings. I'll open some issues for future improvements to bevy_gizmos soon.

@devil-ira can you update the PR description to reflect the new changes?

Oops, didn't mean to commit the split_screen changes.


prevent Unknown provider error when minified

Should be quickly merged !
Lost 2 hours of development due to this bug.

@GuillaumeCisco Use my fork. I've PR'd my changes but I don't see them ever being merged, I have registered a separate bower package as well (wb-angular-slugify).

Thanks @williamboman, I used @gustavopaes small modification that work correctly. I'll take a look to your repo in the week.

Thanks, fixed by a0f0991


Extend pivot operator support

Extends the parser with support for:

Multiple aggregate function calls
Aliased aggregation function calls
Aliased pivot values - also allowing arbitrary expressions as values

https://cloud.google.com/bigquery/docs/reference/standard-sql/query-syntax#pivot_operator

Pull Request Test Coverage Report for Build<PHONE_NUMBER>
Details

69 of 75 (92.0%)  changed or added relevant lines in 3 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.01%) to 89.253%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

src/parser/mod.rs
20
21
95.24%

tests/sqlparser_common.rs
41
46
89.13%

Totals

Change from base Build<PHONE_NUMBER>:
0.01%

Covered Lines:
23502

Relevant Lines:
26332

💛  - Coveralls

looks good to me! cc @alamb

🤔  github says this PR has conflicts that must be resolved

Resolved conflicts
thanks for the reviews @alamb @jmhain!

Thanks again


[On Hold] Use fork of buildx to fix file finalizer

- What I did
Replaced os.File for an interface in containerd/console (https://github.com/ulyssessouza/console/commit/f652dc3e99a9f4aa760deb9b4b28edb7c4e5001a) so that can be used by docker/buildx (https://github.com/ulyssessouza/buildx/commit/5941345e21ebda43723a475380135fe3741d6b3c) and docker/app
- How I did it
Fork and override of the repos in Gopkg.toml
- How to verify it
Check that the broken output fix still working by repeating a docker app build exhaustively.
- Description for the changelog
Use a file interface from containerd/console to pass to buildx's printer
- A picture of a cute animal (not mandatory)

/cc @tonistiigi @tiborvass

@ulyssessouza is this the only change in the fork? https://github.com/ulyssessouza/buildx/commit/5941345e21ebda43723a475380135fe3741d6b3c

@thaJeztah In buildx, yes. But there is another fork. The containerd/console with https://github.com/ulyssessouza/console/commit/f652dc3e99a9f4aa760deb9b4b28edb7c4e5001a
I'll propose a PR on each repo.
I also think this PR could be merged after the merges (if the case) in the upstream repos to avoid the override to my repo.
The intent of this PR is first to validate the approach.

Thanks for clarifying; yes we should avoid forks if possible

I like the approach of offering a "consumer" counterpart for a PR to upstream project, which helps better unterstand the needs and if fix is actually relevant.
Maybe we should agree on a label/PR prefix/comment for such scenario.
Typically PR description could explicitely claim "This demonstrate containerd#123" DO NOT MERGE

@silvin-lubecki After reviewing, that looks like it's a side-effect of the bumps on buildx and containerd.


General python support

In awaiting the conclusion from #141, I tried to show how a general version-agnostic approach could look. In practice, you only need to add the line from __future__ import print_function to all python files and they will in 99% of the times work for both versions. At least when considering small algorithms such as this project here and not huge complex interconnected libraries that have lots of dependencies.

I think the consensus is that we don't want to have a compromise on versions. Getting rid of py2 and py3 and use py is great, but I don't think we want to include from __future__ import print_function  at all. People who want to use python 3 code using python 2 should add that themselves.

As a quick note the py label should be defined in the book.json file in the root directory. this will make sure that all py labels will have the correct tag at the top of the screen ("Python" instead of "Python 2" or "Python 3"). I can do this and submit a PR to your branch @VikingScientist , or you can change
                                {
                                        "lang": "py2",
                                        "name": "Python 2"
                                },
                                {
                                        "lang": "py3",
                                        "name": "Python 3"
                                },

to
                                {
                                        "lang": "py",
                                        "name": "Python"
                                },

and then just check to make sure the language is correct and syntax highlighting is right by running gitbook serve.

@leios is there a place we could mention explicitly our stance on python version?

@jiegillet I think I we already did in #141. Maybe we should make language-specific style guides and mention it in here?

No I mean in the book. The topic is bound to come up. It should be stated somewhere, maybe?

Yeah, that's what I meant too. We should add some style guidelines to the How to Contribute section and for python, we just say that we are sticking to python 3 for this.
I am not sure where else to put it, but @julianschacher was mentioning he wanted to create a How to Contribute guide... So that would be a good place too.
Maybe we should move this to a separate issue?

No #141 is the right place to discuss that. This is slightly wrong though, so let's get back to code reviewing, sorry @VikingScientist

Hehe. This is fine. I initiated the discussion, and if it is discussed here or in #141 really doesn't bother me. I agree with @leios though: we should put the "python 3 only"-stance somewhere (i.e. in the How to contribute section) so that it is available for new contributers. The issue tracker will fade; in fact auto-close after this PR is merged, so it's not a good long-term documentation.
There's a few upcoming commits more where I make the requested changes to book.json as well as fixing the last python-code in the FFT. After this, all version-specific code is gone, so I'll remove py2 and py3 from book.json.

Coolz. Ping me when you feel it's ready for a merge.

Oh yeah, if this PR removes all version specific stuff from the whole book, it should be fine to remove py2 and py3. I just thought there were more python implementations hiding somewhere.

I did grep for any mention of py2 or py3, but can't find any trace of it anymore.
I like fixup commits such as<PHONE_NUMBER>210f6f3ebe69c6d8a38407f4902c31 as it makes the reviewers life easier, but I want these to be squashed with it's referencing commit before being merged into trunk. So if I get a thumbs up on this so far then I'll run git rebase -i HEAD~6 --autosquash and then it's ready to be merged.

We always squash and merge PRs (through the GH interface) anyway. There's no need to manually squash. But thanks for the consideration!

Rebased to resolve some merge conflicts. Ready to be looked at @jiegillet

Great!, so once this is merged, we can have a look at the python 3 implementations #146 #144 #138 , all of which should have modifications in their markdown files.
I am mentioning this now so we remember on those later.


Correctly Command in README.md

In the first time, I use create-react-app the instruction tell me to use yarn command. I saw the command README.md still use npm command. I already change it to yarn command.

Thanks for the suggestion! It should only suggest Yarn if you already use Yarn—is that the case?
Since Yarn is still very new I think it makes more sense to use npm in the docs.
What do you think?

@gaearon Should we add something like "npm start  or yarn start". I think it make more sense if someone who came across from another dev environment and already have yarn.
SOMEONE: Yeah I already create my first react profile by create-react-app. create-app tell me to use yarn start. But README tell me to use npm start !?!?!

@gaearon ping

I tweaked this to still suggest npm by default (most users don't know about Yarn) but mention yarn aliases. Thanks!


DO NOT MERGE! Fast Forward stable to ea388cda2ea28d2eb037b1a931aa2ac77406697d.

This PR will be merged automatically once checks are successful.

This change is

Jenkins job mixer/postsubmit passed


Install Failed

Version of protoc (protoc --version)
libprotoc 2.6.1
Version of ProtocolBuffers.framework
n/a
I am on the latest code with the master branch.
.proto file to reproduce
n/a
Description
protoc --swift_out does not exist. I run ./scripts/build.sh and then protoc --help and don't see the option listed. The end of the build output looks like this
+ make install
Making install in plugin/compiler
 ../.././install-sh -c -d '/usr/local/bin'
  /bin/sh ../../libtool   --mode=install /usr/bin/install -c protoc-gen-swift '/usr/local/bin'
libtool: install: /usr/bin/install -c protoc-gen-swift /usr/local/bin/protoc-gen-swift
make[2]: Nothing to be done for `install-data-am'.
make[2]: Nothing to be done for `install-exec-am'.
make[2]: Nothing to be done for `install-data-am'.

perhaps it's not installing or building correctly? I can provide more information, just wasn't sure what was relevant or needed.

Installation was successful.

Yes, you should include this or install from cocoapods or etc.


Log-button

I can't find any instructions for how to configure the "Log" button in the workouts. What QuickAdd macro should be set up for this to work?

Never mind. Think i figured it out.. Changed "Log" with "Add exercise". That did the trick.
Out of curiosity though: How are you using "type" and "sub-type"? I have seen that they affect the heatmap, but I can't figure the meaning behind. Care to share?


Web - Unable to dismiss Switch to Expensify Classic RHP via ESC key after refreshing the page

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Version Number: 9.0.22-0
Reproducible in staging?: Y
Reproducible in production?: Y
If this was caught during regression testing, add the test name, ID and link from TestRail: N/A
Email or phone of affected tester (no customers<EMAIL_ADDRESS>Issue reported by: Applause - Internal Team
Action Performed:

Go to staging.new.expensify.com
Go to Account settings
Click Switch to Expensify Classic
Dismiss the RHP via ESC key
Note that the RHP can be dismissed via ESC key
Refresh the page
Click Switch to Expensify Classic
Press ESC key

Expected Result:
Switch to Expensify Classic RHP can be dismissed via ESC key after refreshing the page
Actual Result:
Switch to Expensify Classic RHP cannot be dismissed via ESC key after refreshing the page
Workaround:
Unknown
Platforms:

Which of our officially supported platforms is this issue occurring on?

[ ] Android: Native
[ ] Android: mWeb Chrome
[ ] iOS: Native
[ ] iOS: mWeb Safari
[x] MacOS: Chrome / Safari
[x] MacOS: Desktop

Screenshots/Videos
Add any screenshot/video evidence

https://github.com/user-attachments/assets/62f146f5-a6e8-4cb5-bb7a-1d4ea849e6ff
View all open jobs on GitHub

@strepanier03  FYI I haven't added the External label as I wasn't 100% sure about this issue. Please take a look and add the label if you agree it's a bug and can be handled by external contributors

Same issue as https://github.com/Expensify/App/issues/46915

Closing in favor of #46915 which is two weeks old.


Support ingressNamespace for HTTP01 Challenges on ClusterIssuers

When using the ingressName field on HTTP01 solver spec, cert-manager will perform an edit-in-place of that ingress to point to the solver pod to complete the challenge. The issue is that, this ingress resource must exist in the same namespace as the CertificateRequest and as such may cause confusion, or may just not be acceptable in some environments.
We should add another field ingressNamespace that can be used to denote which namespace the target ingress resource exists in to be updated. There are a couple requirements that we should validate:

The Issuer using the ingressNamespace field must be a ClusterIssuer, to ensure we don't provide privilege escalation across namespaces.
The ingressName must also be present.
The namespace will be defaulted to the CertificateRequest namespace should it not be present.

We should add this field to both v1alpha2 and v1alpha3.
/assign
/cc @munnerz
/kind feature

If a user specifies 'ingressClass' and 'ingressNamespace' (but not
ingressName), what should we do?
On Thu, 6 Feb 2020 at 11:41, Josh Van Leeuwen<EMAIL_ADDRESS>wrote:

When using the ingressName field on HTTP01 solver spec, cert-manager will
perform an edit-in-place of that ingress to point to the solver pod to
complete the challenge. The issue is that, this ingress resource must exist
in the same namespace as the CertificateRequest and as such may cause
confusion, or may just not be acceptable in some environments.
We should add another field ingressNamespace that can be used to denote
which namespace the target ingress resource exists in to be updated. There
are a couple requirements that we should validate:

The Issuer using the ingressNamespace field must be a
ClusterIssuer, to ensure we don't provide privilege escalation across
namespaces.
The ingressName must also be present.
The namespace will be defaulted to the CertificateRequest namespace
should it not be present.

We should add this field to both v1alpha2 and v1alpha3.
/assign
/cc @munnerz https://github.com/munnerz
/kind feature
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/jetstack/cert-manager/issues/2579?email_source=notifications&email_token=AABRWPZB32LRH25V56ZSKP3RBPZPJA5CNFSM4KQ3MQPKYY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4ILPRGIA,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AABRWPZAJPTUSXW5X5KJYM3RBPZPJANCNFSM4KQ3MQPA
.

This will be caught by the namespace !& name validation:
So you get the following behavior:
Just ingressClass - fine
ingressClass + namespace - Must specify name if namespace is defined
ingressClass + name - same error as currently
ingressClass + name + namespace - same error as above
namespace - Must specify name if namespace is defined
name + namespace - fine

We've put this on hold for now as-per https://github.com/jetstack/cert-manager/pull/2582#issuecomment-583377547
This will require a fairly significant re-architecture to handle object ownership between namespaces, or to change the solving components to be owned by the ClusterIssuer resource instead of the CertificateRequest/Order/Challenge.


Feature Request: ConfigurationBinder.Bind() to bind properties with public getter and private setter

Issue Title
To support what similar to ApplicationSettingsBase in .NET Framework, which could read app.config and deserialize to properties with public getter and private setter, so the settings singleton could not be modified by other app codes.
General
I could implement this through some verbose codes already.
	public sealed class SmtpSection
	{
		private static readonly Lazy<SmtpSection> lazy = new Lazy<SmtpSection>(
			() =>
				{
					var obj = new SmtpSection();
					return obj;
				}
		);

		public static SmtpSection Instance { get { return lazy.Value; } }

		SmtpSection()
		{
			var config = new ConfigurationBuilder().AddJsonFile("appSettings.json").Build();
			var smtpSection = config.GetSection("mailSettings").GetSection("smtp");
			From = smtpSection["from"];
			Host = smtpSection["host"];
			UserName = smtpSection["userName"];
			Password = smtpSection["password"];
			Port = smtpSection.GetValue<int>("port");
			EnableSsl = smtpSection.GetValue<bool>("enableSsl");
		}

		public string Host { get; private set; }
		public int Port { get; private set; }
		public string UserName { get; private set; }
		public string Password { get; private set; }
		public string From { get; private set; }
		public bool EnableSsl { get; private set; }

	}

against appSettings.json:
{
  "mailSettings": {
    "smtp": {
      "host": "smtp.office365.com",
      "port": 587,
      "userName"<EMAIL_ADDRESS>      "password": "Upassword",
      "from"<EMAIL_ADDRESS>      "enableSsl": true
    }
  }
}

This is working however, verbose.
I could also use bind().
	public sealed class SmtpSection
	{
		private SmtpSection()
		{
		}

		public static SmtpSection Instance { get { return Nested.instance; } }

		private class Nested
		{
			static Nested()
			{
			}

			static SmtpSection Create()
			{
				var obj = new SmtpSection();
				var config = new ConfigurationBuilder().AddJsonFile("appSettings.json").Build();
				config.GetSection("mailSettings").Bind("smtp", obj);
				return obj;
			}

			internal static readonly SmtpSection instance = Create();
		}

		public string Host { get; set; }
		public int Port { get; set; }
		public string UserName { get; set; }
		public string Password { get; set; }
		public string From { get; set; }
		public bool EnableSsl { get; set; }

	}

However, the setters of those public properties have to be public, otherwise, bind() could not set the property and yield no exception.
Presumably the bind() function uses reflection to walk through the properties of the object, and should be able to by-pass the private setter and assign value to the property, as ApplicationConfigurationBase in .NET Framework does.

This issue was moved to aspnet/Extensions#2632


Appstudio update test-component-pac-errl

Pipelines as Code configuration proposal

Pipelines as Code CI/test-component-pac-errl-on-pull-request has successfully validated your commit.


Check for a prediction in the subway critical user journey

I'd still rather test the Red Line, but it's better than nothing!

I think there is an issue with the rendering that it doesn't even load the schedule pane.


Anonymise IP addresses sent to Google Analytics

https://developers.google.com/analytics/devguides/collection/analyticsjs/advanced#anonymizeip
As per https://github.com/alphagov/static/pull/544

:+1:


Handle MIDI timing in case of lag

Currently, start/end times are determined from a timer separate from the MIDI clock; it uses performance.now() so it records the time the event was received, or rather handled. This is the only straightforward way to do it, because I don't think the Web MIDI API gives you timestamps!
But what happens is if the page lags, the notes build up and all appear to start/end once the lag is over. (and are recorded as such.)
This is not good!
Investigate:

Is it possible to access WebMIDI from a WebWorker?
Is there any better timer to use, like the clock signals in MIDI? Can we access that and use it to correct for lag?

In https://github.com/1j01/midi-recorder/commit/71ad9073c9c94c3000997768220afe08d2422e9d, I made it use timestamps from the MIDI events, when available, which may fix this.

I think it's okay now.


Added a notebook comparing median filter to normalized median filter.

I added validation.local_norm_median_val() function to OpenPIV. Here, I create a notebook to show how that function compares to the function validation.local_median_val(). The notebook is called compare_median_filters.ipynb and is placed in the notebooks folder. The data for this notebook is stored in the newly created folder test21.

Hello, @alexlib, I am wondering if you can review this pull request, please. If you accept this pull request, I will submit another one with the notebook that compares circular and linear correlation methods. That will be the last pull request for now.


Aliyun API Error: RequestId:  Status Code: -1 Code:

DSM 6.1-15047        Use the updated version
2017/08/15 14:22:27 Aliyun API Error: RequestId:  Status Code: -1 Code: AliyunGoClientFailure Message: json: cannot unmarshal string into Go struct field RecordType.TTL of type int32

Have U update the docker?

The Docker version is 1.11.2-0329, and is the latest version in the synology suite.

Update the Docker of chenhw2/aliyun-ddns-cli
docker pull chenhw2/aliyun-ddns-cli

same issue,Status: Image is up to date for chenhw2/aliyun-ddns-cli:latest

How often this error comes up?
In My DSM, it only comes up 5 times in the last 24 hour, which i think it doesn't master.

If IP and domain resolution are correct, the domain name and IP are displayed in the log. An error occurs whenever the domain name and IP parse do not correspond to each other. And the error is to parse the error once.

I meet the same issue now. I will try to fix this.
Problem comes from https://github.com/denverdino/aliyungo/issues/148

try https://github.com/chenhw2/aliyun-ddns-cli/commit/0eaac3b1512aa482b7dfdf4860db412fd76b184b and the latest docker

Download the latest version of chenhw2/aliyun-ddns-cli1, parsing normal. Prepare for long runs to see stability. Thank you

It seems ok now，thank you


Avoid unused/missing warnings if querying array/object from translations

We have found useful to extract the entire array of wording to language file and then render them using v-for. But right now in such cases vue-i18n-extract reports about unused keys in language files and missed keys in files with source code. This PR enables support of it.

Had a deep dive into this, I like the use of usedByVueItem to simplify the whole diffing process.
Thanks 👍


Uncaught (in promise) CompileError: WebAssembly.instantiate(): expected magic word 00 61 73 6d, found 3c 21 44 4f @+0 await (async)		 (anonymous)	@	mngpost:24

Describe the bug
Note does not happen consistently.
Leptos Dependencies
console_error_panic_hook = "0.1.7"
leptos = { version = "0.5.4", features = ["csr", "nightly"] }
leptos_meta = { version = "0.5.4", features = ["csr", "nightly"] }
leptos_router = { version = "0.5.4", features = ["csr", "nightly"] }
regex = "1.10.2"
serde = { version = "1.0.195", features = ["derive"] }
serde_json = "1.0.111"
To Reproduce
Steps to reproduce the behavior:

Start the app as trunk serve --open
On browser type url <IP_ADDRESS>:8080/admin/mail and enter
Then click on link /admin/mngpost
Now type <IP_ADDRESS>:8080 and enter
Now click on browser's go back button

Expected behavior
Should go back to root url but fails to load with the error given
Additional context
This project is public and can be found here https://github.com/jsoneaday/rust-blog

The fact that this is an intermittent and fairly hard to reproduce error, and that it is a WASM parsing error, makes me think the source of it lies somewhere outside this library. I wonder, for example, whether there's a chance that it's a caching issue: i.e., if it happens when you are working in a loop of changing and recompiling the app, and if there's a point where the JS and WASM are out of sync, or something.
Alternatively, whether a cargo clean and rebuild fixes it.
But I think there's something going on that is not related to Leptos per se.

cargo clean sounds reasonable. I'll try that


[rt.openssl.org #4576] X25519, ECPKParameters_print

Migrated from rt.openssl.org#4576 (status was 'open')
Requestors:

<EMAIL_ADDRESS>
From<EMAIL_ADDRESS>on 2016-06-16 17:25:45:
Hi,

It is not possible to print parameters of the elliptic curve X25519 from
the command line:

  openssl ecparam -name X25519 -noout -text -param_enc explicit

Nothing is printed.

openssl version: OpenSSL 1.1.0-pre6-dev  xx XXX xxxx
built from git source: commit b84e12266f85156f58804ff94ea110890f13b52d

First explanation: ECPKParameters_print cannot call "get parameter"
functions because there are not defined in the method list of X25519.

The curve coefficient used in the curve25519 methods is not useful
because it uses a strange representation.

The solution is not simple because curve25519 is a Montgomery curve:
  B.y^2 = x^3 + A.x^2 + x mod p
With
  A=486662       (decimal)
  B=1            (decimal)
  p=(2^255)-19   (decimal)

If the function ECPKParameters_print prints this information as others
prime curves, it will be *confused* because in the others prime curves
A and B are coefficients of a short Weierstrass curve:
  y^2 = x^3 + A.x + B
That is different than a Montgomery curve.

It exists a short Weierstrass curve isomorphic with curve25519. I thinks
protocols use coordinates of point on the Montgomery curve so it will be
also *confused* to print the isomorphic short Weierstrass curve
parameters.

Before found a proper method to print A and B, it should be easy to
print p, order, co-factor and generator coordinates:

p =
  2^255 - 19   (decimal)

Order (of the generator) =
  2^252 +<PHONE_NUMBER>7372353535851937790883648493   (decimal)

Cofactor =
  8   (decimal)

<https://cr.yp.to/ecdh/curve25519-20060209.pdf>

Simon.

From<EMAIL_ADDRESS>on 2016-06-16 17:35:36:
I don't think this will get fixed for 1.1

This is no longer an issue because X25519 is now treated as a separate algorithm and cannot be used as a curve for the EC library. As such ecparam, ECPKParameters_print etc aren't applicable.


Seconds considered as days

Starting with version 0.9.3, things like 1.day are being converted to 86400, and when Rails receives and integer, it's considered as days.
1.9.3-p484 :002 > DateTime.now - 86400
 => Sat, 04 Jul 1778 12:02:51 -0600
1.9.3-p484 :003 > DateTime.now - 86400.day
 => Sat, 04 Jul 1778 12:02:59 -0600
1.9.3-p484 :004 > DateTime.now - 86400.seconds
 => Thu, 22 Jan 2015 12:03:02 -0600

Whenever's numeric time/date extensions are not the same as those in Rails so their behavior may differ slightly. Is this causing an issue with your usage of Whenever?

Yes, I had to downgrade to version 0.9.2 because models were created with the wrong date (1778)

Can you paste a sample from your schedule.rb file?

every 1.day, :at => '5:00 am' do
  runner 'method(DateTime.now - 1.day, true)'
end

as I wrote before, 1.day turns into 86400 seconds, and then it's considered as 86400 days.

Thanks. #520 is related. A fix might be for Whenever to skip parsing numeric time extensions inside of quotes or perhaps only parse them after the every statement. I'll think on it.

Thanks :smile:

I'm closing this because it's more precisely defined in #520. Please follow that issue for a resolution.


No extended releases for Linux arm64?

Am I misreading the releases page or is there not a Hugo extended version for arm64 Linux?

No, you are correct. The extended version requires a build setup for C/C++ for the target platform; we're currently cross-building everything from one Docker container, and I haven't been successful in setting up both ARM64 and AMD64 in the same container. I'll admit I haven't tried too hard, and we might be able to improve this by splitting the build somehow ... That said, we have other isues trackingthis, so close this ad a duplicate.

See #8257

@chris-short "extended" builds are available as:

Hugo snap (see https://snapcraft.io/hugo)
Debian/Ubuntu packages: https://packages.debian.org/sid/hugo and https://packages.ubuntu.com/kinetic/hugo

and maybe more for other Linux distributions, though I haven't checked.  See if any of these would suite your needs?  :-)

I'll check those images.


IIDOptimizer crashes when run on an ARM64 device

Describe the bug
IIDOptimizer crashes when a CsWinRT referencing project is built on an ARM64 device.
To Reproduce

Install .NET 6 ARM64 SDK on an ARM64 device, e.g. Surface Pro X
Create a classlib project
Add CsWinRT reference
Add .winmd reference
Setup CsWinRTIncludes and CsWinRTWindowsMetadata
Build the project

Expected behavior
Project compiles without warnings.
Actual behavior
Project compiles but the following warning/error is displayed:
  Failed to load the dll from [C:\Program Files\dotnet\host\fxr\6.0.1\hostfxr.dll], HRESULT: 0x800700C1
  The library hostfxr.dll was found, but loading it from C:\Program Files\dotnet\host\fxr\6.0.1\hostfxr.dll failed
    - Installing .NET prerequisites might help resolve this problem.
       https://go.microsoft.com/fwlink/?linkid=798306

Windows Event Viewer shows that a crash occurs in packages\microsoft.windows.cswinrt\1.4.1\build\tools\IIDOptimizer\IIDOptimizer.exe.
Version Info
CsWinRT: 1.4.1
.NET SDK: 6.0.101
Windows SDK: Microsoft.Windows.SDK.CPP NuGet package, version 10.0.22000.196
OS: Windows 11 ARM64
Additional context
This is likely because IIDOptimizer.exe is x64 itself and tries to load ARM64 hostfxr.dll. It should probably redistribute a private version of hostfxr.dll instead.

Testing with the latest 6.0.6 showed the issue still repros.  Looks like we will need to rebuild with that version to get the fix as the apphost exe comes from .NET.

IIDOptimizer now is built using .NET 6 in CsWinRT 2.0 which should address this.


Orgs - Edit an organization: "default_repository_permission" is an enum

endpoint scope: Orgs
endpoint name: Edit an organization
route: PATCH /orgs/:org
documentation URL: https://developer.github.com/v3/orgs/#edit-an-organization

Current specification
https://github.com/octokit/routes/blob/a509e1a89672025ec580405648b9c5666e3e7b06/routes/orgs/edit-an-organization.json#L61-L67
I expected

 "default_repository_permission" parameter should have "enum" options
{
  "name": "Edit an organization",
  "enabledForApps": false,
  "method": "PATCH",
  "path": "/orgs/:org",
  "params": [
    {
      "name": "org",
      "type": "string",
      "required": true,
      "description": ""
    },
    {
      "name": "billing_email",
      "type": "string",
      "description": "Billing email address. This address is not publicized.",
      "required": false
    },
    {
      "name": "company",
      "type": "string",
      "description": "The company name.",
      "required": false
    },
    {
      "name": "email",
      "type": "string",
      "description": "The publicly visible email address.",
      "required": false
    },
    {
      "name": "location",
      "type": "string",
      "description": "The location.",
      "required": false
    },
    {
      "name": "name",
      "type": "string",
      "description": "The shorthand name of the company.",
      "required": false
    },
    {
      "name": "description",
      "type": "string",
      "description": "The description of the company.",
      "required": false
    },
    {
      "name": "has_organization_projects",
      "type": "boolean",
      "description": "Toggles whether organization projects are enabled for the organization.",
      "required": false
    },
    {
      "name": "has_repository_projects",
      "type": "boolean",
      "description": "Toggles whether repository projects are enabled for repositories that belong to the organization.",
      "required": false
    },
    {
      "name": "default_repository_permission",
      "type": "string",
      "description": "Default permission level members have for organization repositories:  \n\\* `read` \\- can pull, but not push to or administer this repository.  \n\\* `write` \\- can pull and push, but not administer this repository.  \n\\* `admin` \\- can pull, push, and administer this repository.  \n\\* `none` \\- no permissions granted by default.",
      "default": "read",
      "required": false,
      "enum": [
        "read",
        "write",
        "admin",
        "none"
      ]
    },
    {
      "name": "members_can_create_repositories",
      "type": "boolean",
      "description": "Toggles ability of non-admin organization members to create repositories  \n\\* `true` \\- all organization members can create repositories.  \n\\* `false` \\- only admin members can create repositories.",
      "default": true,
      "required": false
    }
  ],
  "description": "",
  "documentationUrl": "https://developer.github.com/v3/orgs/#edit-an-organization"
}

If you’d like to work on it, just comment below and follow instructions in CONTRIBUTING.md

fixed via #105


[SSL: WRONG_VERSION_NUMBER] errors with Indian video site

Checklist

[X] I'm reporting a bug unrelated to a specific site
[X] I've verified that I'm running yt-dlp version 2022.07.18 (update instructions) or later (specify commit)
[X] I've checked that all provided URLs are playable in a browser with the same IP and same login details
[X] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[X] I've searched the bugtracker for similar issues including closed ones. DO NOT post duplicates
[X] I've read the guidelines for opening an issue

Provide a description that is worded well enough to be understood
When downloading videos from a specific site hosted in India, I've started getting "[SSL: WRONG_VERSION_NUMBER]" errors.
The website is region restricted so can only be access from an IP address within India (a different error shows up very quickly if you're not on an Indian IP address).
There were no issues using yt-dlp.exe with this site until mid-May. I've been busy and just came back to try and download again today, and now am hitting this error. I've also had to switch VPN providers due to the previous provider halting India access, but the video and URL load fine within the browser, albeit a little slow.
I'm getting the errors right now even when just trying to get a list of available formats. It's weird. Occasionally a different error shows up, and once I did get the list of formats to display. I also got a lower-resolution version of the video to start downloading once as well. That makes me wonder if this is really an SSL version error or something else. The downloads (or download attempts) are also painfully slow, but I'm putting that down to the VPN.
Provide verbose output that clearly demonstrates the problem

[X] Run your yt-dlp command with -vU flag added (yt-dlp -vU <your command line>)
[X] Copy the WHOLE output (starting with [debug] Command-line config) and insert it below

Complete Verbose Output
[debug] Command-line config: ['--no-check-certificate', '-vU', '-F', '--socket-timeout', '300', '--write-sub', 'https://www.hotstar.com/in/tv/mahabharat/435/shakuni-stabs-abhimanyu/1000012005']
[debug] Encodings: locale cp932, fs utf-8, pref cp932, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version 2022.07.18 [135f05e] (win32_exe)
[debug] Python 3.8.10 (CPython 64bit) - Windows-10-10.0.19043-SP0
[debug] Checking exe version: ffmpeg -bsfs
[debug] Checking exe version: ffprobe -bsfs
[debug] Checking exe version: avprobe -bsfs
[debug] exe versions: ffmpeg git-2019-12-26-b0d0d7e
[debug] Optional libraries: Cryptodome-3.15.0, brotli-1.0.9, certifi-2022.06.15, mutagen-1.45.1, sqlite3-2.6.0, websockets-10.3
[debug] Proxy map: {}
[debug] Fetching release info: https://api.github.com/repos/yt-dlp/yt-dlp/releases/latest
Latest version: 2022.07.18, Current version: 2022.07.18
yt-dlp is up to date (2022.07.18)
[debug] [hotstar] Extracting URL: https://www.hotstar.com/in/tv/mahabharat/435/shakuni-stabs-abhimanyu/1000012005
[hotstar]<PHONE_NUMBER>: Downloading JSON metadata
[hotstar]<PHONE_NUMBER>: Downloading webpage
[hotstar]<PHONE_NUMBER>: Downloading token
[hotstar]<PHONE_NUMBER>: Downloading JSON metadata
ERROR: [hotstar]<PHONE_NUMBER>: Unable to download JSON metadata: <urlopen error [SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:1131)> (caused by URLError(SSLError(1, '[SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:1131)')))
  File "yt_dlp\extractor\common.py", line 644, in extract
  File "yt_dlp\extractor\hotstar.py", line 176, in _real_extract
  File "yt_dlp\extractor\hotstar.py", line 74, in _call_api_v2
  File "yt_dlp\extractor\hotstar.py", line 48, in _call_api_impl
  File "yt_dlp\extractor\common.py", line 1004, in download_content
  File "yt_dlp\extractor\common.py", line 968, in download_handle
  File "yt_dlp\extractor\common.py", line 838, in _download_webpage_handle
  File "yt_dlp\extractor\common.py", line 795, in _request_webpage

  File "urllib\request.py", line 1354, in do_open
  File "http\client.py", line 1252, in request
  File "http\client.py", line 1298, in _send_request
  File "http\client.py", line 1247, in endheaders
  File "http\client.py", line 1007, in _send_output
  File "http\client.py", line 947, in send
  File "http\client.py", line 1421, in connect
  File "ssl.py", line 500, in wrap_socket
  File "ssl.py", line 1040, in _create
  File "ssl.py", line 1309, in do_handshake
ssl.SSLError: [SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:1131)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "yt_dlp\extractor\common.py", line 777, in _request_webpage
  File "yt_dlp\YoutubeDL.py", line 3639, in urlopen
  File "urllib\request.py", line 525, in open
  File "urllib\request.py", line 542, in _open
  File "urllib\request.py", line 502, in _call_chain
  File "yt_dlp\utils.py", line 1455, in https_open
  File "urllib\request.py", line 1357, in do_open
urllib.error.URLError: <urlopen error [SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:1131)>

That shouldn't be happening, given you passed --no-check-certificate. How strange

iirc this error happens when you try to use SSL/HTTPS on HTTP site.
Maybe something is intercepting your connection to point you to some HTTP webpage instead of the real site?

Maybe something is intercepting your connection to point you to some HTTP site instead of the real site?
That or maybe there is an issue with the url or server being used for the json metadata download.

These are possible. I didn't have this issue before. It's possible that in the last couple of months the site has changed its configuration (although not so likely tbh, it doesn't look like they've revamped it at all). The VPN is more likely to be the issue, and I did manage to get one file to download in the end last night -- although only by writing a batch file wrapper for yt-dlp.exe that retries the download persistently whenever it errors out until it finally succeeds. Once the file had actually started downloading, that download failed every 10-15 minutes or so but resumed after a couple of retries, without yt-dlp.exe exiting. I'm having real trouble downloading the subtitle file to go with it, too - I could only get the video to download by giving up on the subtitle file, and when I try to download that separately it keeps failing with HTTP 403... I had no issues downloading the subtitle files at all a couple of months ago.
I'm trying to get set up with a different VPN in the hope that this is an intermittent VPN capacity problem and that a different one will work better. In the meantime, though, it seems odd that yt-dlp.exe is throwing the SSL error when that doesn't seem to be what the problem is, and also when --no-check-certificate is specified. Or will it still run into SSL issues because (whether or not it checks the certificate) it still has to negotiate an HTTPS connection? (I did try sending the url just as HTTP instead of HTTPS but it didn't make any difference.)
Also, given that one download did work in the end (with many, many retries), is there actually an SSL problem at all? If the message is a red herring it really makes troubleshooting downloads harder than ideal. If this was an issue with server configuration you'd think it would never succeed.

I'm trying to get set up with a different VPN

If you were using a VPN in the original report, it is most likely the VPN's fault
❯ yt-dlp -s https://www.hotstar.com/in/tv/mahabharat/435/shakuni-stabs-abhimanyu/1000012005
[hotstar]<PHONE_NUMBER>: Downloading JSON metadata
[hotstar]<PHONE_NUMBER>: Downloading webpage
[hotstar]<PHONE_NUMBER>: Downloading token
[hotstar]<PHONE_NUMBER>: Downloading JSON metadata
[hotstar]<PHONE_NUMBER>: Downloading m3u8 information
[hotstar]<PHONE_NUMBER>: Downloading MPD manifest
[hotstar]<PHONE_NUMBER>: Downloading MPD manifest
[hotstar]<PHONE_NUMBER>: Downloading MPD manifest
[hotstar]<PHONE_NUMBER>: Downloading m3u8 information
[hotstar]<PHONE_NUMBER>: Downloading MPD manifest
[hotstar]<PHONE_NUMBER>: Downloading m3u8 information
[hotstar]<PHONE_NUMBER>: Downloading m3u8 information
[hotstar]<PHONE_NUMBER>: Downloading MPD manifest
[hotstar]<PHONE_NUMBER>: Downloading m3u8 information
[hotstar]<PHONE_NUMBER>: Downloading m3u8 information
[hotstar]<PHONE_NUMBER>: Downloading m3u8 information
[info]<PHONE_NUMBER>: Downloading 1 format(s): sdr-dash-video-avc1-7+sdr-dash-audio-und-mp4a-2-1

Why did you add the "incomplete" tag to this report? I stated from the start that I was using a VPN (and why). It's also not clear why yt-dlp.exe is reporting that it has failed due to an SSL problem when that isn't the case.
Just closing this or marking it as "not a problem" or falsely marking that the person who reported it didn't do so correctly is unhelpful.

The VPN is creating the SSL issue. The incomplete label can be removed if you can reproduce the issue without any VPN

The incomplete label can be removed if you can reproduce the issue without any VPN

If I use a different VPN and the problem goes away, the problem was the VPN. If I use a different VPN and the problem still exists, the problem isn't the VPN.

ok, does it go away?

ok, does it go away?

I don't know yet. I've been battling with another VPN provider since yesterday over payment issues to get an account set up.

Or will it still run into SSL issues because (whether or not it checks the certificate) it still has to negotiate an HTTPS connection? (I did try sending the url just as HTTP instead of HTTPS but it didn't make any difference.)

It can, depending on the server and VPN configuration

I don't know yet. I've been battling with another VPN provider since yesterday over payment issues to get an account set up. But I will report here either way.

So until you report back, the issue is incomplete. That doesn't mean you didn't open the issue correctly, just that more info is needed from your side

That doesn't mean you didn't open the issue correctly, just that more info is needed from your side

Ok, fair enough. In the meantime, if it is an SSL issue caused by the VPN, why wouldn't it fail with that error every time? A genuine SSL issue wouldn't be intermittent, surely? A timeout issue, yes... but in that case shouldn't the error be reported as a timeout?

The error message is being produced by OpenSSL. I can't say for sure that it is the correct message, but   the error is definitely happening during the SSL handshake.
As for the intermittent nature of the error; badly configured VPNs/proxies can give all kinds of weird and intermittent errors. I can't possibly try and diagnose what the issue in the network actually is
On a sidenote, can you try --legacy-server-connect? The error message doesn't match with the errors it is supposed to handle, but might as well try just in case

Thank you for keeping this open.
I've now been able to try this out with a different VPN service and you're right, it was the VPN. The new service works very smoothly and downloads the whole file in about five minutes, without any errors. I will be cancelling the other one!

On a sidenote, can you try --legacy-server-connect? The error message doesn't match with the errors it is supposed to handle, but might as well try just in case

Out of curiosity I did try this even after seeing that the other VPN worked, to see if using this option would have solved the problem, but it didn't. I tried  --force-ipv4  too, as I'd seen that suggested elsewhere, but it also didn't help.
This does seem to have been nothing to do with yt-dlp, though, and everything to do with the VPN. Apologies for the false alarm, and I hope some of the details noted here might help anyone else who runs across the same kind of issue in the future figure out where the problem really lies. Thank you for the information and assistance!


[Feature Request] Support enable/disable inheritence for Security permissions

Is your feature request related to a problem? Please describe.
Currently, we can't turn on/off inheritance for a set of permissions for a given user/group and security token.

The inheritPermissions flag is associated with a token or a resource rather than a group or identity.
So, when you change inheritPermssions flag for a token, it will be reflected for every group or users already added or are going to be added in future.
These requires commands related to update/delete/list Access control lists.
Currently all our commands are associated with modifying an entry(ACE) in ACL and not the ACL itself.
We are not planning to add the commands related to ACL as of now, since the listing of ACL is currently broken due to lack of pagination feature in the Security APIs [and the access control list is usually very long due to the reason that its an extensive list of tokens for all users/groups associated with that resource]
We shall revisit this feature once the pagination is added to the corresponding security APIs.
Till then, only way to update inheritance-flag for your token is to do http POST request on the token
POST  https://dev.azure.com/ORG_NAME/_apis/accesscontrollists/<security-namespace-id>?api-version=5.1-preview.1
{
                "value":[
                                                                {
                                                                                "inheritPermissions": false,
                                                                                "token": <SECURITY_TOKEN>
                                                                }
                             ]
}