Another Error Scenario

I seem to have encountered an error scenario not covered by your guide.
I had successfully configured an access package to allow external users both AAD and non-AAD to request my access package from the myaccess portal. Then after a few days, it seems something happened and external identies who haven't made their way into the tenant yet stopped being able to request access. When they click 'Request' on any Access Package in the Available list, an error pops up (hidden behind a broken/empty panel)
Error: An error occurred while processing this request..
Any advice on resolving this would be much appreciated.  Thank you.

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 86dcc449-d02e-b6da-8cf3-e3bd4ed59665
Version Independent ID: 8cb0a6f4-4ed2-18e0-5948-fb49986023d5
Content: Troubleshoot entitlement management - Microsoft Entra
Content Source: articles/active-directory/governance/entitlement-management-troubleshoot.md
Service: active-directory
Sub-service: compliance
GitHub Login: @OWinfreyATL
Microsoft Alias: owinfrey

Update, it seems to not be all external users, but those that I've added and since removed from the tenant (they are even fully deleted). But reusing users that I've deleted from the tenant had been working fine previously.

@fei0x
Thanks for your feedback! We will investigate and update as appropriate.

Hi @fei0x
Glad to know you have self-resolved the issue. If there are further questions regarding this topic, please do let us know and we will gladly continue the discussion.

Hi @SaibabaBalapur-MSFT
Why do you assume my issue has been resolved?
I have external users who I imagine should be able to requests for access packages and are getting an error toast on screen.
I'm not sure if any particular settings are causing this issue, but for me it's quite simple to reproduce.

Create an access package available to external users.
Have a new external user request the package (one that was not in the tenant before)
Remove the user from then tenant
Have the user come back and request the access package again, and you will see the error: "Error: An error occurred while processing this request.."

Up until 2 days ago I was not seeing this issue when following those steps. But now I am unable to complete those steps.
I need assistance to understand what may have changed in my tenant to cause this. Thank you.

@fei0x
Since this issue isn't directly related to improving our docs, and to gain a better understanding of your issue, I'd recommend working closer with our support team via an [Azure support request] (https://docs.microsoft.com/en-us/azure/azure-portal/supportability/how-to-create-azure-support-request). Or you can leverage our Q&A forum by posting your issue there so our community, and MVPs can further assist you in troubleshooting this issue or finding potential workarounds.
[Teams Q&A forum] (https://docs.microsoft.com/en-us/answers/topics/46488/office-teams-windows-itpro.html) for technical questions about the configuration and administration of Microsoft Teams on Windows.
[Microsoft Teams Community forum] (https://answers.microsoft.com/en-us/msteams/forum?sort=LastReplyDate&dir=Desc&tab=All&status=all&mod=&modAge=&advFil=&postedAfter=&postedBefore=&threadType=All&isFilterExpanded=false&page=1


(in progress) Fix duplication on shutdown fixes #23

Summary
Decaton allows process duplication by design.
However, it's expected duplication not to occur in ordinary processing situation. ordinary situation here means:

All consumer and brokers works properly
All tasks is completed within CONFIG_GROUP_REBALANCE_TIMEOUT_MS on partition revocation

Currently, process can be duplicated even in ordinary situation above due to 3 issues.
This PR fixes them.
Issue 1: ProcessPipeline returns immediately without doing process after terminated

This causes duplication by following sequence:

(tasks are denoted by [offset: key])
Say partition contains [1:a], [2:b], [3:b], [4:a], and partition concurrency is set to 2 (threadX,Y).
And key a will be routed to threadX, key b will be routed to threadY.

threadX's queue will be like this: [1:a], [4:a]
threadY's queue will be like this: [2:b], [3:b]
OOOCC will be like this: [1(n), 2(n), 3(n), 4(n)] hw=0

(n) means not completed. (c) means completed.

threadX completes [1:a] and [4:a]
threadY completes only [2:b]
OOOCC will be like this: [1(c), 2(c), 3(n), 4(c)] hw=2
Initiate shutdown
ProcessorPipeline returns without completing [3:b], hence [4:a] will be processed again after rebalance

Solution
Revert to process all queued tasks.
Issue 2: Kafka 2.4 has changed to call onPartitionsRevoked on shutdown
Kafka clients changed the behavior to call onPartitionRevoked on KafkaConsumer#close. (https://github.com/apache/kafka/pull/6884)
This can cause duplication as below:
Say OOOCC is like this [1(c), 2(c), 3(n), 4(c)] hw=2.

initiate shutdown
All processors are destroyed (https://github.com/line/decaton/blob/85a426ee8754349f82b6442cc9cab95226acb051/processor/src/main/java/com/linecorp/decaton/processor/runtime/ProcessorSubscription.java#L254)
consumer#close (https://github.com/line/decaton/blob/85a426ee8754349f82b6442cc9cab95226acb051/processor/src/main/java/com/linecorp/decaton/processor/runtime/ProcessorSubscription.java#L255)
revocation handler waits all pending tasks to complete, but since all processors are destroyed, 3(n) will not be completed by anyone (https://github.com/line/decaton/blob/85a426ee8754349f82b6442cc9cab95226acb051/processor/src/main/java/com/linecorp/decaton/processor/runtime/ProcessorSubscription.java#L180)
exceeds CONFIG_GROUP_REBALANCE_TIMEOUT_MS, 4(c) will be processed again after rebalance

Solution
onPartitionRevoked immediately returns if ProcessorSubscription already terminated.
Issue 3: ProcessorSubscription doesn't wait pending tasks on shutdown
Solution
wait all pending tasks on shutdown

As described above, to achieve "duplication not to occur in ordinary processing situation", it's required to wait all pending tasks.
But it brings another risk that, the possibility of ungraceful shutdown increase.
Say there are some pending tasks on ProcessorUnit's queue.
Waiting them all makes shutdown duration longer certainly.
We often set a timeout for shutdown to rollout new application soon, and once shutdown time exceeds timeout, often we have no choice other than killing the app ungracefully.
It can cause unpredictable result which possibly affects service.
In conclusion, I close this PR for now.
But this PR includes another useful changes which adds integration test to check core functionality.
I'll create an another PR for it.


Add more values to built-in template_file_variables

Overview/Summary
Update module to provide additional built-in values for the template file variables,
This PR fixes/adds/changes/removes

Fixes #255
Contributes towards a fix for #207
Adds the following key/value pairs to the built-in template_file_variables for use with templatefile() function when loading templates from the lib folders:

Source module
Variable name
Example value
Description

connectivity
ddos_protection_plan_resource_id
/subscriptions/00000000-0000-0000-0000-000000000000/resourceGroups/myorg-ddos/providers/Microsoft.Network/ddosProtectionPlans/myorg-ddos-westus
Resource ID for the DDoS protection plan created by the module.

connectivity
private_dns_zone_prefix
/subscriptions/00000000-0000-0000-0000-000000000000/resourceGroups/myorg-dns/providers/Microsoft.Network/privateDnsZones/
Resource ID suffix used for all azurerm_private_dns_zone resources created by the module under the scope of connectivity resources.

connectivity
connectivity_location
westus
Location set for the connectivity resources.

connectivity
virtual_network_resource_id_by_location
{ westus = "/subscriptions/00000000-0000-0000-0000-000000000000/resourceGroups/myorg-connectivity-westus/providers/Microsoft.Network/virtualNetworks/myorg-hub-northeurope" }
Map of Resource IDs by location for virtual network resources created by the module.

connectivity
vpn_gateway_resource_id_by_location
{ westus = "/subscriptions/00000000-0000-0000-0000-000000000000/resourceGroups/myorg-connectivity-westus/providers/Microsoft.Network/virtualNetworkGateways/myorg-vpngw-northeurope" }
Map of Resource IDs by location for VPN gateway resources created by the module.

connectivity
firewall_resource_id_by_location
{ westus = "/subscriptions/00000000-0000-0000-0000-000000000000/resourceGroups/myorg-connectivity-westus/providers/Microsoft.Network/azureFirewalls/myorg-fw-northeurope" }
Map of Resource IDs by location for Azure Firewall resources created by the module.

management
log_analytics_workspace_resource_id
/subscriptions/00000000-0000-0000-0000-000000000000/resourceGroups/myorg-mgmt/providers/Microsoft.OperationalInsights/workspaces/myorg-la
Resource ID for the Log Analytics workspace created by the module.

management
log_analytics_workspace_name
myorg-la
Name for the Log Analytics workspace created by the module.

management
log_analytics_workspace_location
northeurope
Location for the Log Analytics workspace created by the module.

management
automation_account_resource_id
/subscriptions/00000000-0000-0000-0000-000000000000/resourceGroups/myorg-mgmt/providers/Microsoft.Automation/automationAccounts/myorg-automation
Resource ID for the Automation Account created by the module.

management
automation_account_name
myorg-automation
Name for the Automation Account created by the module.

management
automation_account_location
northeurope
Location for the Automation Account created by the module.

management
management_location
northeurope
Location set for the management resources.

management
management_resource_group_name
myorg-mgmt
Name of the Resource Group deployed by the module for management resources.

management
data_retention
30
Retention period (in days) used when configuring the Log Analytics workstation and associated policies.

Breaking Changes
none
Testing Evidence
Temporary output was used to validate that values were correctly added to the internal template_file_variables object:

As part of this Pull Request I have

[x] Checked for duplicate Pull Requests
[x] Associated it with relevant issues, for tracking and closure.
[x] Ensured my code/branch is up-to-date with the latest changes in the main branch
[x] Performed testing and provided evidence.
[x] Updated relevant and associated documentation.
[x] Updated the "What's New?" wiki page (located in the Enterprise-Scale repo in the directory: /docs/wiki/whats-new.md)

/azp run unit

/azp run unit

/azp run e2e

/azp run unit

/azp run e2e

/azp run unit


Problems with Juno installation in atom linked to HttpParser

I've been trying to install juno within atom, and met persistent problems with HttpParser. I tried the fixes suggested on the juno discussion page and was advised here. Here are my error scripts (I am using Julia v0.4.5, Atom v1.7.4 and OSX 10.11.3):
`julia> Pkg.build("Atom")
INFO: Building HttpParser
INFO: Changing Directory to /Users/davidzentlermunro/.julia/v0.4/HttpParser
INFO: Changing Directory to /Users/davidzentlermunro/.julia/v0.4/HttpParser
INFO: Changing Directory to /Users/davidzentlermunro/.julia/v0.4/HttpParser/deps/src
INFO: Attempting to Create directory /Users/davidzentlermunro/.julia/v0.4/HttpParser/deps/usr/lib
INFO: Directory /Users/davidzentlermunro/.julia/v0.4/HttpParser/deps/usr/lib already created
INFO: Changing Directory to /Users/davidzentlermunro/.julia/v0.4/HttpParser/deps/src
xcrun: error: invalid active developer path (/Library/Developer/CommandLineTools), missing xcrun at: /Library/Developer/CommandLineTools/usr/bin/xcrun
=============================[ ERROR: HttpParser ]==============================
LoadError: failed process: Process(setenv(make -j8 -C http-parser library,Union{ASCIIString,UTF8String}["XPC_FLAGS=0x0","PATH=/Applications/Julia-0.4.5.app/Contents/Resources/julia/bin:/Applications/Julia-0.4.5.app/Contents/Resources/julia/libexec/git-core:/Applications/Julia-0.4.5.app/Contents/Resources/julia/bin:/Applications/Julia-0.4.5.app/Contents/Resources/julia/libexec/git-core:/Users/davidzentlermunro/anaconda/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin:/usr/local/git/bin:/Library/TeX/texbin","PWD=/Users/davidzentlermunro","NODE_PATH=/Applications/Atom.app/Contents/Resources/app.asar/exports","XPC_SERVICE_NAME=0","TERM_PROGRAM=Apple_Terminal","GIT_EXEC_PATH=/Applications/Julia-0.4.5.app/Contents/Resources/julia/libexec/git-core","SHELL=/bin/bash","__CF_USER_TEXT_ENCODING=0x1F5:0:0","NODE_ENV=production","TMPDIR=/var/folders/8q/sjb3qrjd71bc669szqbty7gm0000gn/T/","TK_LIBRARY=/System/Library/Frameworks/Tk.framework/Versions/8.5/Resources/Scripts","GOOGLE_API_KEY=AIzaSyAQfxPJiounkhOjODEO5ZieffeBv6yft2Q","FONTCONFIG_PATH=/Applications/Julia-0.4.5.app/Contents/Resources/julia/etc/fonts","LANG=en_GB.UTF-8","SHLVL=3","LOGNAME=davidzentlermunro","TERM_SESSION_ID=36326E4A-E59F-42C2-AFB5-4C8179537108","SSH_AUTH_SOCK=/private/tmp/com.apple.launchd.zTWbDVHuJ1/Listeners","ATOM_HOME=/Users/davidzentlermunro/.atom","_=/Applications/Julia-0.4.5.app/Contents/Resources/julia/bin/julia","GIT_TEMPLATE_DIR=/Applications/Julia-0.4.5.app/Contents/Resources/julia/share/git-core","Apple_PubSub_Socket_Render=/private/tmp/com.apple.launchd.E72VpqG5VI/Render","USER=davidzentlermunro","TERM=xterm-256color","HOME=/Users/davidzentlermunro","TERM_PROGRAM_VERSION=361.1","OPENBLAS_MAIN_FREE=1"]), ProcessExited(1)) [1]
while loading /Users/davidzentlermunro/.julia/v0.4/HttpParser/deps/build.jl, in expression starting on line 42
================================================================================
INFO: Building Homebrew
HEAD is now at 7cbd735 Remove formulae/aliases/travis.yml. (#50676)
HEAD is now at c377b50 Merge pull request #92 from staticfloat/staging
INFO: Building MbedTLS
INFO: Building Nettle
================================[ BUILD ERRORS ]================================
WARNING: HttpParser had build errors.

packages with build errors remain installed in /Users/davidzentlermunro/.julia/v0.4
build the package(s) and all dependencies with Pkg.build("HttpParser")
build a single package by running its deps/build.jl script

================================================================================`

xcrun: error: invalid active developer path (/Library/Developer/CommandLineTools), missing xcrun at: /Library/Developer/CommandLineTools/usr/bin/xcrun

Only just noticed that line -- maybe try something like this if it's even relevant to your OS version (sorry, I know next to nothing about OSX).

You need to install dev tools (gcc, make,  etc.) to build binary dependencies.

worked a treat, thanks. I followed these instructions in case helpful for anyone:
http://railsapps.github.io/xcode-command-line-tools.html

I have same issue and david's method also works well for me.


Consistent failures always with exit-code=256

Operating system
PRETTY_NAME="CentOS Linux 7 (Core)"
3.10.0-514.6.1.el7.x86_64
conda version: 4.5.12
Package name
unknown
Conda environment
# packages in environment at /home/bio/miniconda2/envs/denovo_asm:
#
# Name                    Version                   Build  Channel
asn1crypto                0.24.0                py27_1003    conda-forge
avro-python2              1.8.2                      py_1    bioconda
bcftools                  1.9                  h47928c2_1    bioconda
bedtools                  2.27.1               he860b03_3    bioconda
blas                      1.0                         mkl
blasr                     5.3.2                h82bacf8_5    bioconda
blasr_libcpp              5.3.1                h82bacf8_4    bioconda
bwa                       0.7.17               h84994c4_4    bioconda
bzip2                     1.0.6             h14c3975_1002    conda-forge
ca-certificates           2018.11.29           ha4d7672_0    conda-forge
certifi                   2018.11.29            py27_1000    conda-forge
cffi                      1.11.5          py27h9745a5d_1001    conda-forge
chardet                   3.0.4                 py27_1003    conda-forge
cryptography              2.5              py27hb7f436b_0    conda-forge
curl                      7.64.0               h646f8bb_0    conda-forge
cython                    0.29.4           py27hf484d3e_0    conda-forge
decorator                 4.3.2                      py_0    conda-forge
enum34                    1.1.6                 py27_1001    conda-forge
future                    0.17.1                py27_1000    conda-forge
genomicconsensus          2.3.2                    py27_3    bioconda
h5py                      2.8.0           py27hfb8609e_1004    conda-forge
hdf5                      1.10.3            hba1933b_1001    conda-forge
htslib                    1.9                  h47928c2_5    bioconda
idna                      2.8                   py27_1000    conda-forge
intel-openmp              2019.1                      144
ipaddress                 1.0.22                     py_1    conda-forge
iso8601                   0.1.12                     py_1    conda-forge
krb5                      1.16.3            hc83ff2d_1000    conda-forge
libcurl                   7.64.0               h01ee5af_0    conda-forge
libdeflate                1.0                  h14c3975_1    bioconda
libedit                   3.1.20170329      hf8c457e_1001    conda-forge
libffi                    3.2.1             hf484d3e_1005    conda-forge
libgcc-ng                 7.3.0                hdf63c60_0    conda-forge
libgfortran-ng            7.2.0                hdf63c60_3    conda-forge
libssh2                   1.8.0             h1ad7b7a_1003    conda-forge
libstdcxx-ng              7.3.0                hdf63c60_0    conda-forge
linecache2                1.0.0                      py_1    conda-forge
minimap2                  2.15                 h84994c4_1    bioconda
mkl                       2019.1                      144
mkl_fft                   1.0.10           py27h14c3975_1    conda-forge
mkl_random                1.0.2            py27h637b7d7_2    conda-forge
mummer4                   4.0.0beta2      pl526hfc679d8_3    bioconda
ncurses                   6.1               hf484d3e_1002    conda-forge
networkx                  2.2                        py_1    conda-forge
nim-falcon                0.0.0                         0    bioconda
numpy                     1.15.4           py27h7e9f1db_0
numpy-base                1.15.4           py27hde5b4d6_0
openssl                   1.0.2p            h14c3975_1002    conda-forge
pb-assembly               0.0.4                    py27_3    bioconda
pb-dazzler                0.0.0                h470a237_0    bioconda
pb-falcon                 0.2.5            py27hc0aa232_3    bioconda
pbalign                   0.3.2                    py27_0    bioconda
pbbam                     0.19.0               h6678c95_1    bioconda
pbcommand                 1.1.1                    py27_2    bioconda
pbcopper                  0.4.2                h02d93b8_0    bioconda
pbcore                    1.6.5                    py27_0    bioconda
pbmm2                     0.12.0               ha87ae23_0    bioconda
perl                      5.26.2            h14c3975_1001    conda-forge
pip                       19.0.1                   py27_0    conda-forge
pycparser                 2.19                       py_0    conda-forge
pyopenssl                 19.0.0                   py27_0    conda-forge
pysam                     0.15.2           py27h1671916_1    bioconda
pysocks                   1.6.8                 py27_1002    conda-forge
python                    2.7.15            h938d71a_1006    conda-forge
python-consensuscore      1.1.1            py27h02d93b8_2    bioconda
python-consensuscore2     3.1.0                    py27_2    bioconda
python-edlib              1.2.3.post1      py27h470a237_0    bioconda
python-intervaltree       3.0.2                      py_0    bioconda
python-msgpack            0.5.6            py27h470a237_0    bioconda
python-sortedcontainers   2.1.0                      py_0    bioconda
pytz                      2018.9                     py_0    conda-forge
readline                  7.0               hf8c457e_1001    conda-forge
requests                  2.21.0                py27_1000    conda-forge
samtools                  1.9                  h57cc563_6    bioconda
setuptools                40.7.3                   py27_0    conda-forge
six                       1.12.0                py27_1000    conda-forge
sqlite                    3.26.0            h67949de_1000    conda-forge
tk                        8.6.9             h84994c4_1000    conda-forge
traceback2                1.4.0                    py27_0    conda-forge
unittest2                 1.1.0                      py_0    conda-forge
urllib3                   1.24.1                py27_1000    conda-forge
wheel                     0.32.3                   py27_0    conda-forge
xz                        5.2.4             h14c3975_1001    conda-forge
zlib                      1.2.11            h14c3975_1004    conda-forge

Describe the bug
When trying to run assembly, inconsistent errors, initially appear to be issues with the heartbeat files. Some files complete successfully. Others fail fairly quickly during tan-split step. Total data set is 15 cells, but as part of troubleshooting, I have been breaking the set into smaller subsets of 2, 3, 4, 5 cells to test if it is system resource related. I have also tried use bam2fastx instead of SMRT Link to generate the input fasta, single cells, all cells, and nothing has worked.
Error message
[INFO]recently_satisfied:
set([Node(0-rawreads/build)])
[INFO]Num satisfied in this iteration: 1
[INFO]Num still unsatisfied: 1
[INFO]About to submit: Node(0-rawreads/tan-split)
[INFO] starting job Job(jobid='P7a76247ac20297', cmd='/bin/bash run.sh', rundir='/mnt/grid/Luce_5856/0-rawreads/tan-split', options={'pwatcher_type': 'fs_based', 'use_tmpdir': False, 'MB': 4000, 'job_type': 'local', 'submit': 'bash -C ${CMD} >| ${STDOUT_FILE} 2>| ${STDERR_FILE}', 'NPROC': 1, 'njobs': '8'}) w/ job_type=LOCAL
[INFO]dir: '/mnt/grid/Luce_5856/mypwatcher/jobs/P7a76247ac20297'
CALL:
 '/bin/bash /mnt/grid/Luce_5856/mypwatcher/wrappers/run-P7a76247ac20297.bash 1>|stdout 2>|stderr & '
[INFO]pid=21649 pgid=21649 sub-pid=22190
[INFO]Submitted backgroundjob=MetaJobLocal(MetaJob(job=Job(jobid='P7a76247ac20297', cmd='/bin/bash run.sh', rundir='/mnt/grid/Luce_5856/0-rawreads/tan-split', options={'pwatcher_type': 'fs_based', 'use_tmpdir': False, 'MB': 4000, 'job_type': 'local', 'submit': 'bash -C ${CMD} >| ${STDOUT_FILE} 2>| ${STDERR_FILE}', 'NPROC': 1, 'njobs': '8'}), lang_exe='/bin/bash'))
[ERROR]Task Node(0-rawreads/tan-split) failed with exit-code=256
[ERROR]Some tasks are recently_done but not satisfied: set([Node(0-rawreads/tan-split)])
[ERROR]ready: set([])
        submitted: set([])
[ERROR]Failed to kill job for heartbeat 'heartbeat-P8404878de35533' (which might mean it was already gone): IOError(2, 'No such file or directory')
Traceback (most recent call last):
  File "/home/bio/miniconda2/envs/denovo_asm/lib/python2.7/site-packages/pwatcher/fs_based.py", line 612, in delete_heartbeat
    bjob.kill(state, heartbeat)
  File "/home/bio/miniconda2/envs/denovo_asm/lib/python2.7/site-packages/pwatcher/fs_based.py", line 274, in kill
    with open(heartbeat_fn) as ifs:
IOError: [Errno 2] No such file or directory: '/mnt/grid/Luce_5856/mypwatcher/heartbeats/heartbeat-P8404878de35533'
[ERROR]Failed to kill job for heartbeat 'heartbeat-P7a76247ac20297' (which might mean it was already gone): IOError(2, 'No such file or directory')
Traceback (most recent call last):
  File "/home/bio/miniconda2/envs/denovo_asm/lib/python2.7/site-packages/pwatcher/fs_based.py", line 612, in delete_heartbeat
    bjob.kill(state, heartbeat)
  File "/home/bio/miniconda2/envs/denovo_asm/lib/python2.7/site-packages/pwatcher/fs_based.py", line 274, in kill
    with open(heartbeat_fn) as ifs:
IOError: [Errno 2] No such file or directory: '/mnt/grid/Luce_5856/mypwatcher/heartbeats/heartbeat-P7a76247ac20297'
Traceback (most recent call last):
  File "/home/bio/miniconda2/envs/denovo_asm/bin/fc_run", line 11, in <module>
    load_entry_point('falcon-kit==1.2.5', 'console_scripts', 'fc_run')()
  File "/home/bio/miniconda2/envs/denovo_asm/lib/python2.7/site-packages/falcon_kit/mains/run1.py", line 726, in main
    main1(argv[0], args.config, args.logger)
  File "/home/bio/miniconda2/envs/denovo_asm/lib/python2.7/site-packages/falcon_kit/mains/run1.py", line 76, in main1
    input_fofn_fn=input_fofn_fn,
  File "/home/bio/miniconda2/envs/denovo_asm/lib/python2.7/site-packages/falcon_kit/mains/run1.py", line 242, in run
    dist=Dist(NPROC=4, MB=4000, job_dict=config['job.step.da']),
  File "/home/bio/miniconda2/envs/denovo_asm/lib/python2.7/site-packages/falcon_kit/pype.py", line 106, in gen_parallel_tasks
    wf.refreshTargets()
  File "/home/bio/miniconda2/envs/denovo_asm/lib/python2.7/site-packages/pypeflow/simple_pwatcher_bridge.py", line 278, in refreshTargets
    self._refreshTargets(updateFreq, exitOnFailure)
  File "/home/bio/miniconda2/envs/denovo_asm/lib/python2.7/site-packages/pypeflow/simple_pwatcher_bridge.py", line 362, in _refreshTargets
    raise Exception(msg)
Exception: Some tasks are recently_done but not satisfied: set([Node(0-rawreads/tan-split)])

To Reproduce
I get similar behavior when running the F1_bull test set. That set crashes at 0-rawreads/build with a similar error:
[ERROR]Task Node(0-rawreads/build) failed with exit-code=256
[ERROR]Some tasks are recently_done but not satisfied: set([Node(0-rawreads/build)])
[ERROR]ready: set([])
        submitted: set([])
[ERROR]Failed to kill job for heartbeat 'heartbeat-P186ecc91d79e2f' (which might mean it was already gone): IOError(2, 'No such file or directory')

The 200k test set assembles correctly.
Expected behavior
I expect the system to be able to perform the preads correctly for a subset of 2 cells, which worked with another subset earlier.

If there is an error in a task, you need to find the task-specific stderr (somewhere under 0-rawreads/build e.g.). I'm not sure about that.
On the "heartbeat" problem, fs_based (filesystem-based process-watcher) is very difficult to support on disparate systems. Try
pwatcher_type = blocking
job_type = string
submit = ...

See https://github.com/PacificBiosciences/pypeFLOW/wiki/configuration


HSTS Support

I think it could be really good to improve the ssl security to force the HSTS header from haproxy which normally will be the place to do ssl offloading.
We can add this as an extra.

Curious is that many times I have only achieved an A+ in ssllabs test after enabling HSTS and in your config this is not an option.

Agree 100% that HSTS is a good thing. Forcing HSTS will break some sites so better to make HSTS a configurable option.
There's are good arguments either way for defaulting to off vs on. So long as HSTS is configurable and visible either default is fine.

@lcacciagioni Same story as #48, if you want to submit a PR :)


Implement JSONLDataset level partitioning

High Level Change
We augment where partitioning of the data happens to be earlier in the process saving a lot of compute when it comes to running tokenization. This should allow us to scale WPS past the ceiling (~3.5M) we were seeing earlier.
How Did We Implement?
We utilize the virtual sub-sharding implemented for JSONLDataset instead as a partitioning function (this means we cannot do sub-sharding, but no one is really using this anyway, assertions have been added). We had to adapt some of the load_dataset function signatures but overall this is a very easy change.
What We Do Now
The current way we generate documents is the following. Each GPU does the following:

Enumerate all documents
Tokenize all documents
Block by sequence length
Each GPU selects the block that corresponds to it’s ID.

Pros:

Blocks are completely randomized on all GPU’s
Fully reproducible. Can restart a run and follow the same exact selection process.

Cons:

Every GPU has to tokenize EVERY sample, which might be the cause the lack of GPU saturation.

In the current change, each GPU does the following:

Enumerate all documents
Select documents that correspond to it’s ID
Tokenize current GPU documents
Block by sequence length
Each GPU simply enumerates blocks

Pros:

Fully reproducible. Can restart a run and follow the same exact selection process. But ONLY when world size stays the same throughout training.
Tokenization only occurs on the documents you actually use on the current GPU

Cons:

Are there any?

Questions
Q. What happens if one GPU runs out of documents before others?
A. Same thing that happens in the previous code when one GPU is out of blocks, we stop training on current shard. The amount of data we'll be leaving behind is miniscule.
Q. Well if we're leaving data behind is this not problematic for consistent validation?
A. Yes for validation we don't really care about WPS so we're okay using the old implementation that will use all of the data (except maybe for the last batch).

To run test: pytest cpu_tests/test_streaming_language_modeling_task.py -s -k test_load_partitioned_dataset


WARN: Error dialing target site

Hi there,
version: 3.3.0
I've been trying to set up a phishing awareness training for a bunch of our employees, it all goes well, but for some unknown reason I can't make proxy to work with our MFA solution, once I'm being redirected to MFA page after SAML login, I'm getting
[170] WARN: Error dialing target site: tls: either ServerName or InsecureSkipVerify must be specified in the tls.Config
in evilginx console. Evilginx then sends HTTP/1.1 POST request instead of HTTP/2 and MFA drops session.
I've tried to use the following construction in vendor/github.com/go-resty/resty/v2/client.go
func (c *Client) SetTLSClientConfig(config *tls.Config) *Client {
        transport, err := c.Transport ()
        if err != nil {
                c.log.Errorf("%v", err)
                return c
        }
        config.InsecureSkipVerify = true
        transport.TLSClientConfig = config
        return c
}

But still no luck :(
Any help would be greatly appreciated. Thanks in advance.

**Hi 👽 ! If you are interested in ⚙Advanced Phishing⚙ and the ✨Evilginx3✨ tool then I offer you Google Gmail and Custom Phishlets with a ✅Free Tutorial✅ which arrives if the 📈Telegram reaches 50 Subscribers📈
⏳ GOOGLE GMAIL PHISHLET 2024 WITH PROOF ⏳
->
⛔https://www.youtube.com/watch?v=nA47UknIE6A⛔
🔓 Ask your questions and a free tutorial from 50 subs on telegram !!!
->
📩https://t.me/Noremorse1011📩**

Same problem :(


fix: github secret action that saves coverage percentage fails

A clear and concise description of what the bug is. If not obvious, please add some context about where/how the problem occurs.
Steps to reproduce the behavior:

Go to '...'
Click on '....'
Scroll down to '....'
See error

A clear and concise description of what you expected to happen, and what actually happened.
Adding screenshots are usually very helpful :)

@HansKristianVikOlsen did the PR fix the issue? Can this Issue be closed?

No, not yet. The step is commented out for now


python3Packages.localzone: Downgrade dnspython dependency

The current localezone release is not compatible with dnspython 2.x that
was introduced in nixpkgs with commit a7b5b18ab92f4f4b303d3d3526b91a28f627c68c
Motivation for this change
Fix broken build
ZHF: #97479
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[x] Determined the impact on package closure size (by running nix path-info -S before and after)
[x] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

@mweinelt I adopted your recommended changes. Is this what you meant?

Yes, I feel this makes this change alot cleaner and better maintainable.

LGTM. What is broken, was broken before as well. Lexicon has alot of tests fail with regard to localzone though.
Result of nixpkgs-review pr 99496 1

2 packages failed to build:

ape
lexicon

2 packages built:

python37Packages.localzone
python38Packages.localzone

So revert?

Yes

https://github.com/NixOS/nixpkgs/pull/99567

I already made an issue upstream https://github.com/ags-slc/localzone/issues/1


Re-add workflow to update the "docs/latest" folder

[!CAUTION]
Testing still needs to be done on the contents of this PR since I don't know for sure if it's actually needed. (I'd ran into an issue for one workflow, but other workflows seem to work fine.)
If this PR is, in fact, needed, we shouldn't merge it until we update the workflow that builds Jekyll; otherwise, the workflow for Jekyll will be built twice. Instead, the workflow for building Jekyll should run after this workflow is completed or if this workflow doesn't need to run.

Description
This PR re-adds a workflow to update the docs/latest folder.
Related issues and/or PRs

https://github.com/scalar-labs/docs-scalardl/pull/90

Changes made

Re-added a workflow to update the docs/latest folder with the latest version of docs.

Checklist

The following is a best-effort checklist. If any items in this checklist are not applicable to this PR or are dependent on other, unmerged PRs, please still mark the checkboxes after you have read and understood each item.

[x] I have updated the side navigation (_data/navigation.yml) as necessary.
[x] I have commented my code, particularly in hard-to-understand areas.
[x] I have updated the documentation to reflect the changes.
[x] Any remaining open issues linked to this PR are documented and up-to-date (Jira, GitHub, etc.).
[x] My changes generate no new warnings.
[x] Any dependent changes in other PRs have been merged and published.

Additional notes (optional)
N/A

Closing this PR since the workflows in our internal docs repository works as expected.


Make conflig.yml optional

We probably need to make this optional (assuming we don't need it in all cases) or create in on install (is that something we can do)?
I'll have a bash at step 1.

Ah - thanks. This is indeed in #20


Adjustments of AMI members

Removed Zuppetti and Pasandi, added Sortino in purchase and Elobaid as seniors

Removed Pasandi from other sub-groups!


[BUG] typo in  picamera2/examples/tensorflow /remove_background.py

Describe the bug
Example code points to a tflite model that doesn't exist.
File: remove_background.py
Line 3 currently reads:
# Usage: ./remove_background.py --model deeplapv3.tflite --background thing.png

Should be changed to:
# Usage: ./remove_background.py --model deeplabv3.tflite --background thing.png

Additional context
Reported on the forum here: picamera2/examples/tensorflow /remove_background.py - Raspberry Pi Forums

Thanks, I've pushed that change to our "next" branch, so it will appear in due course...!


[as2_python_api] Add topic namespace with argument in mission interpreter

Basic Info

Info
Please fill out this column

Issue(s) this addresses
-

ROS2 version tested on
Humble

Aerial platform tested on
Gazebo

Description of contribution in a few bullet points

Add a parameter to set if using global topics or add the namespace to the topic

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (8566da1) 0.00% compared to head (87159a3) 0.00%.

:exclamation: Current head 87159a3 differs from pull request most recent head df10d52. Consider uploading reports for the commit df10d52 to get more accurate results

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@          Coverage Diff          @@
##            main    #408   +/-   ##
=====================================
  Coverage   0.00%   0.00%
=====================================
  Files        101     101
  Lines       5612    5612
=====================================
  Misses      5612    5612

Flag
Coverage Δ

unittests
0.00% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


How to add shapes?

Does it support to add shapes such as rectangles, arrows or triangles etc?

Currently, custom views are not supported.

It would be great if it gets custom view support

@burhanrashid52 Great Library...!! #kudos
would be thankful if custom views are been added


Snippets not updating correctly, should check GitHub for changes

🔍 Is there already an issue for your problem?

[X] I have checked older issues, open and closed

ℹ Environment / Computer Info
- Spotify version: <IP_ADDRESS>6.geb595a67
- Spicetify version: 2.18.1

📝 Description
It would be great if snippets could be updated to correctly update once a change as been made on GitHub.
I was told (by @theRealPadster) that it checks the local marketplace files, however no matter what I seem to do I can never seem to get my snippet to show in the marketplace, I've tried deleting files multiple times, but I must be missing something.
For reference, it is my Rounded Images snippet which doesn't appear.
📸 Screenshots

Snippets are stored locally and on releases.
This was deliberately made, commits on the current development version will be snipped on the next release


Add batching for sending AWS Security Hub findings

New feature motivation
When customers with a large volume of resources run prowler to report on their resources and import the results into Security Hub they are running into API throttling rate limits which is impacting the ability for customers to get all their Prowler findings into Security Hub in a timely manner.  The main cause of this is that findings are sent to Security Hub one by one instead of batches.   The BatchImportFindings API for Security Hub allows up to 100 findings to be batched together in a single request.
The feature ask is that the integration with AWS Security Hub be updated so that findings are collected and sent to Security Hub in batches.  Batch sizes of 100 are the max that can be sent but even an non-optimal batching strategy could help in significantly reducing the number of calls that are made to BatchImportFindings.
Here is the API limits that are published for Security Hub: https://docs.aws.amazon.com/securityhub/1.0/APIReference/Welcome.html
Solution Proposed
From what I can tell the sending of findings to Security Hub is initiated here: https://github.com/prowler-cloud/prowler/blob/bc11537350e1e919eff4a02d4d3fcd3e109c6d11/prowler/lib/outputs/outputs.py#L116.
What I believe would need to happen is that some logic would need to be added before the send_to_security_hub call is made where findings are collected into a batch and then when a batch limit is reached, or there are no more findings to report on, the current batch of findings is sent to Security Hub.
Describe alternatives you've considered
No other alternatives considered.
Additional context
No response

Thanks for reporting it @scottbward, I'll take a look this week. Thanks!

Hi @scottbward, the above PR improves the behaviour of the Security Hub integration sending the findings in batches up to 100.
Thanks for using Prowler 🚀


how to  use  acme  plugin

it  always  error,  and  some  menu  such as  kong  can't  be  open

I think traefik better for me

I think traefik better for me


Function definition missing - GetUtcStartOfWeekInTimeZone

Where did you get the code?

[ x] Followed the tutorial from Microsoft Graph tutorials

Describe the bug
A function definition is missing
To Reproduce
Steps to reproduce the behavior:

Follow the tutorial till here https://docs.microsoft.com/en-us/graph/tutorials/xamarin?tutorial-step=4
In this steps CalendarPage-xaml and .cs file has been explained
You have refer to a function GetUtcStartOfWeekInTimeZone in the .cs file
But this method is not defined in the tutorial hence a build error will occur

Expected behavior
There should not be a build error
Desktop (please complete the following information):

OS: Windows Andriod emulator

Dependency versions

Authentication library (MSAL, etc.) version:
Graph library (Graph SDK, REST library, etc.) version:

Additional context
to solve the problem I used below function definition but for this the line var startOfWeek = GetUtcStartOfWeekInTimeZone(DateTime.Today, App.UserTimeZone); needs to be changed to var startOfWeek = GetUtcStartOfWeekInTimeZone(DateTime.Today, App.UserTimeZone.ToString()); in CalendarPage.xaml.cs file
private static DateTime GetUtcStartOfWeekInTimeZone(DateTime today, string timeZoneId)
{
// Time zone returned by Graph could be Windows or IANA style
// .NET Core's FindSystemTimeZoneById needs IANA on Linux/MacOS,
// and needs Windows style on Windows.
// TimeZoneConverter can handle this for us
TimeZoneInfo userTimeZone = TZConvert.GetTimeZoneInfo(timeZoneId);
        // Assumes Sunday as first day of week
        int diff = System.DayOfWeek.Sunday - today.DayOfWeek;

        // create date as unspecified kind
        var unspecifiedStart = DateTime.SpecifyKind(today.AddDays(diff), DateTimeKind.Unspecified);

        // convert to UTC
        return TimeZoneInfo.ConvertTimeToUtc(unspecifiedStart, userTimeZone);
    }

Thank you for reporting, you're right this was omitted from the instructions. I'll get it fixed.

Thank you for reporting, you're right this was omitted from the instructions. I'll get it fixed.

The missing function is here: https://github.com/microsoftgraph/msgraph-training-xamarin/blob/6b9dcc03f48cf7eeb4bfcb1fe6e9f65d9ea064f8/demo/GraphTutorial/GraphTutorial/CalendarPage.xaml.cs#L63-L73

The missing function is here: https://github.com/microsoftgraph/msgraph-training-xamarin/blob/6b9dcc03f48cf7eeb4bfcb1fe6e9f65d9ea064f8/demo/GraphTutorial/GraphTutorial/CalendarPage.xaml.cs#L63-L73


how to set HTML5 attributes to input?

Hi,
I am trying to set the Step attribute of the HTML5 number input in the x-editable form. I am able to set the input type but no luck in setting the step property. Can anyone help me with this? The sample code is given below:
$('#budget').editable({
            inputclass: 'input-sm',
            shown: function(e, editable){
                $('.editable-input').find('input[type="number"]').attr('step','1000');
            },
            validate: function(value) {
                if($.trim(value) == '')
                {
                    return 'This field is required';
                }
            }
        });

Why don't you give an example, maybe in Fiddle?

Unfortunately due to this project being supported by volunteers we cannot provide user support at this time. Please try a site like Stack Overflow:  http://stackoverflow.com/questions/tagged/x-editable
Thank you.


Update pytest

At the moment, pytest does not work out-of-the-box in the root directory (nor in the test directory). These changes make pytest work out-of-the-box.

Ah, you're right. I contaminated the directory. I'll update this. The error that I was getting from this was:
git clone https://github.com/climate-machine/SCAMPy
Cloning into 'SCAMPy'...
remote: Enumerating objects: 15, done.
remote: Counting objects: 100% (15/15), done.
remote: Compressing objects: 100% (11/11), done.
remote: Total 2828 (delta 5), reused 8 (delta 4), pack-reused 2813
Receiving objects: 100% (2828/2828), 5.11 MiB | 4.41 MiB/s, done.
Resolving deltas: 100% (2050/2050), done.

\SCAMPyTest>cd SCAMPy\

\SCAMPyTest\SCAMPy>pytest.exe
================================================= test session starts =================================================
platform win32 -- Python 3.6.5, pytest-4.4.0, py-1.8.0, pluggy-0.9.0
hypothesis profile 'default' -> database=DirectoryBasedExampleDatabase('C:\\Users\\kawcz\\Dropbox\\Caltech\\work\\dev\\SCAMPyTest\\SCAMPy\\.hypothesis\\examples')
rootdir: \SCAMPyTest\SCAMPy
plugins: hypothesis-4.18.3
collected 0 items / 7 errors

======================================================= ERRORS ========================================================
___________________________________ ERROR collecting tests/plots/test_plot_Bomex.py ___________________________________
ImportError while importing test module '\SCAMPyTest\SCAMPy\tests\plots\test_plot_Bomex.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
tests\plots\test_plot_Bomex.py:16: in <module>
    import common as cmn
E   ModuleNotFoundError: No module named 'common'
________________________________ ERROR collecting tests/plots/test_plot_DYCOMS_RF01.py ________________________________
ImportError while importing test module '\SCAMPyTest\SCAMPy\tests\plots\test_plot_DYCOMS_RF01.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
tests\plots\test_plot_DYCOMS_RF01.py:16: in <module>
    import common as cmn
E   ModuleNotFoundError: No module named 'common'
_________________________________ ERROR collecting tests/plots/test_plot_GATE_III.py __________________________________
ImportError while importing test module '\SCAMPyTest\SCAMPy\tests\plots\test_plot_GATE_III.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
tests\plots\test_plot_GATE_III.py:17: in <module>
    import common as cmn
E   ModuleNotFoundError: No module named 'common'
...
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Interrupted: 7 errors during collection !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
=============================================== 7 error in 0.46 seconds ===============================================

OK. I coded it to work as it was described in readme. Does it work for you if you do it this way?

I think it may have. Part of what I was trying to do was allow running the script from any sub-directory of SCAMPy, and adding an option for compiling (I hard-coded the compile since I was more interested in refactoring than running)

@charleskawczynski  can I close this one?

@charleskawczynski can I close this one?

Yeah, this has gotten a quite stale it looks.


Not compatible with PyTorch v1.2 any more

There is underline private API changes of the latest version of PyTorch.
That introduces the following error.
lib/python3.6/site-packages/nonechucks/__init__.py in <module>
      1 from .dataset import SafeDataset
      2 from .sampler import SafeSampler
----> 3 from .dataloader import SafeDataLoader
      4
      5 __all__ = ['SafeDataset', 'SafeSampler', 'SafeDataLoader']

lib/python3.6/site-packages/nonechucks/dataloader.py in <module>
     42
     43
---> 44 class _SafeDataLoaderIter(data.dataloader._DataLoaderIter):
     45
     46     def __init__(self, loader):

AttributeError: module 'torch.utils.data.dataloader' has no attribute '_DataLoaderIter'

Hi @iyah4888, thanks for raising the issue. This has been fixed in the latest release.

Has the problem been solved?


Issue connecting to new German data center

This library assumes the endpoint you are connecting to has the suffix .servicebus.windows.net. IoT Hub endpoints in the new German data center have a suffix .azure-devices.de making it impossible to connect using this library.

@dominicbetts The connection string builder in eventhubs-client does support taking different suffix:
Could you try that: https://github.com/hdinsight/eventhubs-client/blob/81762f9361c79eea82fdd7083eea73c8942676f9/src/main/java/com/microsoft/eventhubs/client/ConnectionStringBuilder.java
 public ConnectionStringBuilder(String policyName, String policyKey,
      String namespace, String serviceFqdnSuffix) {
    connectionString = "amqps://" + policyName + ":" + encodeString(policyKey)
        + "@" + namespace + "." + serviceFqdnSuffix;
  }

Also - I would recommend looking at the official azure-event-hubs for long term support directly by the event-hubs team.


CFFL

CFFL

Linter check found the following problems:
The following problems have been found:
ERROR: /tmp/abs_efy3bc1oja/clone/recipe/meta.yaml:20: missing_wheel: For pypi packages, wheel should be present in the host section
ERROR: /tmp/abs_efy3bc1oja/clone/recipe/meta.yaml:30: missing_pip_check: For pypi packages, pip check should be present in the test commands
WARNING: /tmp/abs_efy3bc1oja/clone/recipe/meta.yaml:39: missing_description: The recipe is missing a description
Errors were found


Fix small typo

s/commends/command/g

I don't think the CI failure is related to my change.

Thanks! re-running lint

Looks like the rubocop check fails if there's no ruby in the PR. How odd. I'm approving this, I"ll merge in a bit, but I wanna see if I can fix this first.

Oh. Looks like GITHUB_SECRET somehow fails on PRs from external contributors...


(cpp) Template parameters trigger class header rule

Describe the issue
When using the template <class T> syntax in C++, the class keyword misleads the parser into thinking it’s found a class header, and goes into class title mode, if there’s some { shortly afterwards. The relevant rule is
https://github.com/highlightjs/highlight.js/blob/5b87cc4d106059bee1c30f123e5a4053e0af9de4/src/languages/c-like.js#L227
Which language seems to have the issue?
cpp
Are you using highlight or highlightAuto?
highlight. When using highlightAuto, the code snippet is mis-categorised as angelscript and parsed differently still.
Sample Code to Reproduce
template <class T> // comment
auto foo(T x) { … }

highlight.js marks this up as
<keyword>template</keyword> <<class><keyword>class</keyword> <title>T</title>> // <title>comment</title>
<title>auto</title> <title>foo</title>(<title>T</title> <title>x</title>) {</class> … }

Expected behavior
When replacing class with typename (which is 100% equivalent in this context), it’s marked up (more) correctly:
<keyword>template</keyword> <<keyword>typename</keyword> T> <comment>// comment</comment>
<function><keyword>auto</keyword> <title>foo</title><params>(T x)</params> </function>{ … }

Additional context

Present in master. Some earlier version used highlighted this correctly (presumably before support for class headers was added). Fundamentally the issue is that template parameter declarations aren’t handled at all by the lexer (by contrast, template argument lists do have rudimentary handling; i.e. usage rather than declaration).
A fix would probably require a separate mode for template parameter declarations, which is a hairy topic. In fact, correctly disambiguating the meaning of >> (can be right-shift operator or a terminating nested template argument list) is context-sensitive, and undecidable for the lexer (!) because its meaning can depend on the type of names it is applied to: a<b<c>>d can either be parsed as a variable declaration of d where the type has a nested template argument (list if a is a type), or as an expression involving less-than comparison and bit shifts, if a is a variable: https://godbolt.org/z/rM18oc

Related: https://github.com/highlightjs/highlight.js/issues/2102

These issues are probably going to stay open (or eventually auto-close as "impossible") until a C++ experts attemps to solve them - I simply don't understand the language well enough (see the related issue).  I'm not sure they can be solved.
template <class T>

Would a template <.*> style rule that had it's own scope potentially solve this?  I worry not because there could probably be nested <> and we're not a parser so we can't figure it out.
What if the class rule bailed when it hit a >... but I'm imagining there are probably cases where one uses <> inside of a class definition header, no?

the code snippet is mis-categorised as angelscript and parsed differently still.

Detection is best-effort and often wrong (particular for small snippets).

I’m happy to take a stab at this once I find some time but I agree with you that this probably can’t be solved entirely. In fact, I suspect that we may have to give up something else: would you be open to a PR that increases overall reliability of C++ rendering at the cost of no longer recognising class/function declarations, and thus won’t highlight them as titles (nor the parameter lists)? That would make things drastically easier, since the language definition no longer needs to try to infer this context, and reverts to being a glorified tokeniser.
Personally I’d classify title/params highlighting as “nice to have”, and stuff like correctly recognising comments and keywords as essential. The current version of the C++ highlighter (almost certainly unintentionally!) seems to prioritise them the other way round.

would you be open to a PR that increases overall reliability of C++ rendering at the cost of no longer recognising class/function declarations, and thus won’t highlight them as titles (nor the parameter lists)

I don't think so - and definitely not before ruling out ALL other choices.  That does not sound like a great path forward to me.  If someone just wants colored keywords there are other highlighting options available that are much simpler.  We try to go further than that - and we successfully highlight TONS of valid C++ code, just you've found one case we don't work so well.

Right now it seems your original issue would be fixed by simply adding a special rule for:
template <class [identifier]>

If that would not resolve the issue, please expand your issue to provide additional examples.


Possibility to use goblint conf file (issue #2)

Running the plugin now assumes goblint is added to the PATH.
When there is a goblint conf file with the name "goblint.json" present in the project root directory, the plugin uses it to run the command. If the conf file is not present, the default command is still:
goblint --enable dbg.debug --set result json-messages -o <pathToJsonResult> <fileToAnalyze>

Is there a better way than just throwing an exception to let the extension user know if they don't have goblint in their PATH? Same with the goblint.json not being in a correct format etc. Right now, it is very easy to break the extension, and as a user, it is pretty tricky to find out why the extension does not work when there is something wrong.
https://github.com/goblint/GobPie/blob/941896f5e0584134762c2ed37eda2d36cc2c291c/src/main/java/GoblintAnalysis.java#L119-L124

When there is a goblint conf file with the name "goblint.json" present in the project root directory, the plugin uses it to run the command. If the conf file is not present, the default command is still:
goblint --enable dbg.debug --set result json-messages -o <pathToJsonResult> <fileToAnalyze>

If goblint.json isn't present, then the plugin shouldn't do anything with C files. It's quite annoying to have it automatically run on every C file you ever open with VSCode. For example, even developing Goblint itself and looking at its regression tests, the plugin tries to run and show warnings, but the default configuration is incorrect for those. Or to look at a repository like sv-benchmarks which has tens of thousands of C programs.

Is there a better way than just throwing an exception to let the extension user know if they don't have goblint in their PATH? Same with the goblint.json not being in a correct format etc. Right now, it is very easy to break the extension, and as a user, it is pretty tricky to find out why the extension does not work when there is something wrong.

Does Magpie not provide any way to show custom alerts to the user? Like the ones that say something like "Goblint started/finished analyzing file".

Is there a better way than just throwing an exception to let the extension user know if they don't have goblint in their PATH? Same with the goblint.json not being in a correct format etc. Right now, it is very easy to break the extension, and as a user, it is pretty tricky to find out why the extension does not work when there is something wrong.

Does Magpie not provide any way to show custom alerts to the user? Like the ones that say something like "Goblint started/finished analyzing file".

That was a good idea. Added the notifications that notify the user when there is an error with running the goblint command with the last commit.


[cPP CHANGE] Version inconsistency

On behalf of CCCS
cPP lists different versions on the Title page and Section 1.1 (version 0.58 vs. 0.59). cPP and SD versions do not match (0.59 vs. 0.39).

We will increment all documents to version 1.0 following the conclusion of comment periods and update the revision history notes to the initial release. We are leaving this issue open as a reminder to double-check before final publication.

Corrected all version information across all documents for final release


Look for backups' databases, even if deleted.

Part of a series of changes that enables the restoration from backup of deleted databases.

Codecov Report

Merging #268 into master will not change coverage.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##           master     #268   +/-   ##
=======================================
  Coverage   96.15%   96.15%
=======================================
  Files          83       83
  Lines        3851     3851
=======================================
  Hits         3703     3703
  Misses        148      148

Impacted Files
Coverage Δ

spec/aptible/cli/subcommands/backup_spec.rb
100.00% <ø> (ø)

lib/aptible/cli/subcommands/backup.rb
100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update edb403d...8918050. Read the comment docs.


Update membrane example to latest

For now this is in draft status, I'll push additional work to this branch to run CI in the coming days.

https://github.com/meta-flutter/meta-flutter/pull/184


Sectioning template showing previous sectioning templates sections

If there are multiple sectioning templates in a workflow and the user clicks on different sectioning templates in sequence, then after clicking on the first one, all the other sectioning templates will show the first templates sections and not their own. If the user clicks on a process different from sectioning inbetween then it will properly update.

This issue was occurring because controller had setup variables in the constructor. The constructor is only called when a new instance of the component is created. When clicking on the same type of component template, angularjs doesn't need to create a new instance of the component. Thus all state variables refer to the original sectioning process (that is state that was set up in the constructor).
I updated this to dynamically compute these state items rather than to statically set them in the constructor.


"as must" --> as much

For Testing the Advanced Sample Extension:
In "You are required to include a Visual Studio Code test package with your extension. Ensure that you include as must code coverage as you can."  the "must" should be replaced by "much" I think.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 885cbacd-b3e7-1730-812c-9148ebfc90e9
Version Independent ID: eb11ce7e-1efb-106c-5d79-19c206860da0
Content: Technical Validation Checklist - Business Central
Content Source: dev-itpro/developer/devenv-checklist-submission.md
Service: dynamics365-business-central
GitHub Login: @SusanneWindfeldPedersen
Microsoft Alias: rweigel

Thanks for catching this - it will be fixed with the next push to live. Thanks.


New comparison and logical operators

There are more filters available now, as well as AND/OR/NOT logical operators. Would really appreciate it if you implemented them.
https://docs.nocodb.com/developer-resources/rest-apis/#comparison-operators
https://docs.nocodb.com/developer-resources/rest-apis/#logical-operators

Hello @MitPitt!
Sorry for the late reply!
Seems good. I will take a look at them.
I add this enhancement to a new 0.2 milestone.

I've started to work on adding more comparison operators in v2.0. I will make a back port without breaking changes to 0.2 when finished. In v2.0 I'm going to introduce a breaking change renaming In filter to like.
I've published an alpha for the moment so anyone can test it.
https://pypi.org/project/nocodb/2.0.0a1/

Hello @MitPitt I released a new 2.0.0 version adding new operators :)


Automate executing WebAssembly tests

There's currently a WebAssembly test in tests/src/Simple/HelloWasm, but it only tests generating WebAssembly without attempting to execute it. We should have a way to run WebAssembly tests (including telling pass and fail apart). It probably shouldn't depend on running browsers since that would be annoying during development and hard to diagnose in CI. Perhaps it's possible to run via node.js or some other command line tooling?

It looks like a combination of node.js version 8.7.0 and a simple JS script to load the WebAssembly should work. The gist at https://gist.github.com/kanaka/3c9caf38bc4da2ecec38f41ba24b77df has code JS code for running wasm in the runwasm,js file. We could use that to bootstrap running the tests.

I've asked CI owners and it sounds like we can require a dependency like Chrome or Node.js on the CI machines as long as we don't have to update it too often. It's worth keeping in mind that while we can only generate WebAssembly on Windows right now, we'd eventually like to do it on Linux and Mac, so a cross-platform solution would be nice.
CC @hippiehunter

@hippiehunter found that we can run the copy of node.js (v4.1.1) included in Emscripten on Emscripten's output. I had to add -s "BINARYEN_METHOD='native-wasm,interpret-binary'" to the Emscripten command line, which runs a WASM interpreter. If node 8.7.0 works without the interpreter, that might be a bit better, but we'd have to figure out how to deploy it to developer and CI machines.

Node 8.7.0 doesn't require the interpreter option for emscripten linking. I don't know if it's worth the extra hassle though.

Emrun seems to work pretty well with Chrome (it kinda works with Edge and Firefox, but Edge prompts to close the tab and Firefox doesn't close). To use it, add --emrun to the emcc command line and then run emrun --browser chrome path\to\output.html. That launches Chrome, runs the test, prints the output to stdout, exits the tab it opens, and emrun exits with the right return code. We might want to consider hooking that up to our test infrastructure as long as folks don't mind having Chrome.
It looks like we can automate installing Chrome with https://gist.github.com/kurokikaze/350fe1713591641b3b42


The extensions/v1beta1 and networking.k8s.io/v1beta1 API versions of Ingress is no longer served as of v1.22

Hey @blake, it is me again :D
See more in https://kubernetes.io/docs/reference/using-api/deprecation-guide/#ingress-v122,
since it is used internally, it needs to be updated.

Closed by #4. :-)

Closed by #4. :-)


Adding Progress bar Component

Currently , we are working on the design of the components , you all guys have to make that designed components , so that the app does not have a random design  for each component .


Remove windows options in 2.2.3 and 2.1.10 branch

Old windows feature in 2.1 and 2.2 is deprecated. Please try new Windows feature in 2.3.0 preview/alpha.

I can confirm removal of the Windows Support option for custom cluster in v2.2.3-rc7. This looks good in the UI. Notice "Flannel" network provider has the Windows Support removed from the name which is good.
There is no current 2.1.10 so I cannot test there. FWIW I reviewed the code changes and it looks good.


Support line ending of wcl.sh file - MacOS

Quick fix, on mac/unix system run the following command to fix the .sh file:
sed -i -e 's/\r$//' wcl.sh

Hi Mate, what line ending pattern does Mac require?


gabor filter and PCA whitening in ndimage

Is your feature request related to a problem? Please describe.
Describe the solution you'd like
Add nd Gabor filters and PCA whitening to the current processing functions in ndimage. The gabor filter would allow for more image processing of higher dimensional images, since most implementations are restricted to 2 dimensions.
Describe alternatives you've considered
Additional context (e.g. screenshots)

Hi @ryanlu41 thanks for this idea. Seems like we missed replying to this, sorry about that. My main question is what's different in the implementation of the PR you just submitted compared to what's in scikit-image (code, doc)? It seems very similar, and while a Gabor filter makes sense to add to the available ndimage filters, it would be good to have a reason to add this here instead of telling users to simply use it from scikit-image.

And the same question for PCA whitening - I haven't checked other libraries, what's out there already? E.g. we don't have PCA, scikit-learn does.

No worries! Re: first question, the scikit-image PR only works for 2D images, while the implementation that we made can be used for any number of dimensions.
For the second question, I think scikit-learn and Keras have PCA whitening, but after I made the issue, I also felt that it didn't really fit (sorry, I should have updated this issue). I did not include it in my PR

No worries! Re: first question, the scikit-image PR only works for 2D images, while the implementation that we made can be used for any number of dimensions.

Oh yes, seeing that now. That seems to be in need of generalizing in scikit-image - @jni I thought everything was n-D already? Any opinion on this issue and linked PR?

@jni I thought everything was n-D already?

Since I appointed myself Guardian of the Dimensions :crossed_swords: :ice_cube:  at scikit-image 6 years ago, I've tried to make sure (almost) all PRs are nD or at least 3D. But there is plenty of code from before that time that is 2D-only. =)
We also have a stalled PR at scikit-image/scikit-image#2739 with nD Gabor filters, but this code looks much simpler. If SciPy doesn't want them we do! =) I must admit I know very little about Gabor filters and even less about nD Gabor filters, so I can't quickly comment about the correctness of it.

If SciPy doesn't want them we do! =)

Not not wanting but your servant humbly thinks that this is more suited to scikit-image your dimensionness.

Sounds good! I've done some previous work with converting 3D stuff in scikit-image, I'd be happy to move this PR over there.

That sounds like the right outcome to me as well, so I'll close this.
Thanks for working on this @ryanlu41!


control sequence output: beginning of line

the scala sbt build tool uses the C-a (or [A) control sequence a lot to go to the beginning of the line. Unfortunately, drone doesn't seem to support this and it ends up printing things like

[info] Resolving org.scala-sbt#sbt;0.13.8 ...

[info] Resolving org.scala-sbt#main;0.13.8 ...

[info] Resolving org.scala-sbt#actions;0.13.8 ...

[info] Resolving org.scala-sbt#classpath;0.13.8 ...

[info] Resolving org.scala-lang#scala-compiler;2.10.4 ...

tracking under issue #939


Reduce number of curl calls to the AUR

This adds a cache for DownloadJson (via a new SetJson function).
This will fetch the JSON for each set of arguments only once.

While there were 4 curl calls without this for pacaur -S aur/foo, it is
now reduced to 1.

This feature sounds sexy on paper, but in practice this isn't true. In fact, this patch only saves a single json call even for complex dependency tree like plasma-git-meta (22 calls on my machine, 21 with your patch).
The call that is redundant is the first located in DepsSolver(). It is then duplicated right away in the first FindDepsAur() loop. Instead of implementing a cache feature, I probably better rework these function to remove that duplicate call.

I got 4 calls for pacaur -S aur/vim-youcompleteme-git IIRC.

True, it actually depends on the number of not yet installed AUR dependencies of the packages. For new packages with AUR dependencies, this won't do much, but this will slightly speed up updating.
I'll have a look at the duplicate call first, as that one always happens in any case.

A better way than caching would be to remove duplicates before querying the AUR, e.g with grep -Fxvf. I've managed to reduce curl calls for plasma-git-meta from 20+ to 7 that way, see aurchain

I doubt I could do that without implementing topological sorting too.

Implementing topological sorting would certainly require the use of a local binary repository, as split packages handling sucks - and it's not an option (see #408) unless the whole stuff gets rewritten. But I wonder if there is an easy way to store individual call results in arrays, and merging them instead of sending duplicate packages in the next json calls...

A first quickly but seemingly working topological sorting implementation is available in the tsortsolver branch. Expect quite a few bugs with split packages, but the overall calls are decreased significantly in complex cases (from 21 to 7 for plasma-git-meta for example).

Adjusted and pushed in 602ce1ca074a2b31dbe8fa2c14158a35d4e7d34b.
Found a typo error in CheckAur() (GetJson instead of SetJson), and I could not find the reason you used a deps_json variable for the ConflickCheck() code, instead of calling the global json variable. Do you remember by any chance?

Thanks!
No, I cannot remember: maybe because it was parsed already / optimized in the flow?!

All right. Doesn't seem necessary with the current code, so it's been removed.

Nice!  Thanks for merging and maintaining pacaur!


Ignore ERR_ABORTED/-3 page failures, as this is expected when a page …

…load is overridden by user command (back, reload, etc.). r=vporof

Coverage decreased (-0.02%) to 42.483% when pulling a168ea16f6f380cbc7887bb54472c41088a1a44a on jsantell:ignore-aborted-page-failure into d41cd1faee6a0e617185dec776b1e5aae7e17b05 on mozilla:master.


[Question] VRAM for distillation

I'm trying do distillation of the my sdxl model with A6000 (48GB).
But, I cannot do distillation with 1024x1024 because of OOM.
How much VRAM do we need for distillation?
Thanks in advance.

A100 80G is not working too.


Various small improvements to service construction.

Among other things, this PR:

Splits up sc_service::build into build_offchain_workers, build_network and spawn_tasks.
Adds in a sc_service::PartialComponents type that can either be used to construct a full service or for the chain ops subcommands.
Simplifies the BasicPool::{new_light, new_full} apis.

Looks great all in all, just needs some cosmetic changes and it's ready for merge :+1:

rebase needed.


[FLINK-24755][doc]Add guidance to solve the package sun.misc does not exist

What is the purpose of the change
Add guidance to solve the package sun.misc does not exist

@flinkbot run azure

@flinkbot run azure

@flinkbot run azure


feat!: tabler ui kit instead of bootstrap

[ ] I have reviewed my code in "Files changed" tab.
[ ] I have re-read the issue and this PR fully resolves it.

Dropdown menus review:

incorrect color for text in default option #040A11 (should be #182433)

incorrect color for text in disabled option #040A11 0.5 opacity (should be #182433 0.5 opacity)
incorrect background color for hovered option #DCE1E7 (should be #6C7A91 0.08 opacity)
incorrect background color #066FD1 (should be #066FD1 0.04 opacity) and text color #FFFFFF (should be #066FD1)
incorrect top&bottom paddings for option 6px (should be 8px)
incorrect top&bottom paddings for dropdown menu container (selectize-dropdown-content class) 5px (should be 4px)
incorrect border color for dropdown menu container #DCE1E7 (should be #042045 0.1 opacity)
incorrect avatar size for recruiter select (position and candidate) 32x32px (should be 20x20px)


ScrollView and nested tabs swiping don't work properly in TabNavigator

Current Behavior
This is the structure of my application:

Drawer: DrawerNavigator

Wrapper: StackNavigator

Main: TabNavigator (initialRouteName in Wrapper)

Home: Screen (First tab and initialRouteName in Main)
Redeem: TabNavigator (Second tab)

Store: Screen (First nested tab)
Transactions: Screen (Second nested tab)

Invite: Screen (Last tab)

Profile: Screen (Accessible from drawer)
Contact: Screen (Accessible from drawer)

I'm using a ScrollView in Home screen. But this happens:

Content of Home screen doesn't hide on other tabs.
And when I change initialRouteName to Redeem this happens:

Previous problem is fixed but it makes another problem in nested tabs swiping
And finally when I change initialRouteName to Invite everything are fixed:

Expected Behavior

When initial route has ScrollView, the contents of ScrollView shouldn't be remain on other tabs
Nested tabs swiping should work properly, when their parent tab is initial route

Your Environment

software
version

react-navigation
1.0.0-beta.11

react-native
0.44.0

node
v7.8.0

npm or yarn
yarn v0.24.5

After 4 days finally I fixed this bug in my application. I changed TabNavigator route config to:
{
  ...
  initialRouteName: 'Home',
  order: ['Invite', 'Redeem', 'Home'],
}

instead of
{
  ...
  initialRouteName: 'Home',
  order: ['Home', 'Redeem', 'Invite'],
}

+1

Closing since OP @2rajpx fixed it himself.


transform serde enums

Consider the following example:
export type TransactionStatus = SerdeEnum<{
  /** Transaction is part of the future queue. */
  future: void
  /** Transaction is part of the ready queue. */
  ready: void
  /** The transaction has been broadcast to the given peers. */
  broadcast: string[]
  /** Transaction has been included in block with given hash. */
  inBlock: Hash
  /** The block this transaction was included in has been retracted. */
  retracted: Hash
  /**
   * Maximum number of finality watchers has been reached,
   * old watchers are being removed.
   */
  finalityTimeout: Hash
  /** Transaction has been finalized by a finality-gadget, e.g GRANDPA */
  finalized: Hash
  /**
   * Transaction has been replaced in the pool, by another transaction
   * that provides the same tags. (e.g. same (sender, nonce)).
   */
  usurped: Hash
  /** Transaction has been dropped from the pool because of the limit. */
  dropped: void
  /** Transaction is no longer valid in the current state. */
  invalid: void
}>

To discriminate between members of the resulting union, one must do a typeof "string" check...
declare const status: TransactionStatus

if (typeof status === "string") {
  //
} else {
  status.finalized // now accessing props is valid
}

This is inconvenient when attempting to check which member is a match.
Ideally, one could simply...
if (status.finalized) {
  // ...
}

Meanwhile, would-be string values could also be available as props (with a value of true).
if (status.ready) {
  // ...
}

Perhaps this would eliminate the need for such a transformation:
function narrowSerde<T, K extends Extract<T, string> | (T extends object ? keyof T : never)>(
  value: T,
  type: K,
): value is Extract<T, K | Record<K, unknown>> {
  return (value === (type as any) || (typeof value === "object" && value !== null && type in value))
}

declare const foo: "a" | "b" | { c: number } | { d: string }

if (narrowSerde(foo, "a")) {
  foo // "a"
} else {
  foo // "b" | { c: number } | { d: string }
  if (narrowSerde(foo, "c")) {
    foo // { c: number }
  } else {
    foo // "b" | { d: string }
  }
}

Awesome. I like the idea of us exposing this convenience util (perhaps we should also expose other utils of similar vein, ie. throwIfError).

Not going to be applicable upon metadata v15 –– we'll be able to interact with these methods via state_call (no serde in the mix).


Question deflection

Version: 1.79.0-insider (Universal)
Commit: 667d4629dee90744edd5054f13bc2452c8c14490
Date: 2023-05-29T05:24:34.999Z (1 day ago)
Electron: 22.5.3
Chromium: 108.0.5359.215
Node.js: 16.17.1
V8: <IP_ADDRESS>-electron.0
OS: Darwin arm64 22.4.0

Issue: When I ask Copilot to generate unit tests for selected code, it doesn't answer the question, and instead gives me a suggestion for a new question.
Steps to Reproduce:

Create Angular@14 project with Jest@28
Select code snippet
Ask GitHub Copilot "Generate unit tests for the selected code"

Code is smudged to protect the security codebase I'm working on, but it shows that code is selected, and the response from GitHub Copilot being a redirect-prompt of: "How can I install Jest in my project?"

That blue piece is a actually a follow up question (basically a question that Copilot thinks you might want to ask next). It looks like copilot chat didn't respond at all. Is there anything in the GitHub Copilot Chat output channel?

Is that something different from what's shown in the image? If so, how can I access it?

This is likely fixed. Can you confirm if you're still seeing the issue?


When Encoding json, it replaces : with =

Originally reported on Google Code with ID 244
Make content application/json.
Use this JSON in Payload:
{ "id":"1111","name": "777", "model": "777", "properties": {}, "statuses": {},"events":
{}, "actions": {}, "description": "Test tank 777"}

Press encode. It encodes it replacing "id": with "id"=

%7B+%22id%22=%221111%22%2C%22name%22%3A+%22777%22%2C+%22model%22%3A+%22777%22%2C+%22properties%22%3A+%7B%7D%2C+%22statuses%22%3A+%7B%7D%2C%22events%22%3A+%7B%7D%2C+%22actions%22%3A+%7B%7D%2C+%22description%22%3A+%22Test+tank+777%22%7D

Reported by luislobo on 2014-04-05 01:02:34

You are putting a JSON string into a regular form fields. Use "Raw" instead.


System.Net.WebException: Error: NameResolutionFailure

Xamarin.Auth Issue
Version

[ ] nuget version = 1.5.0
[ ] component version =
[ ] sample

Steps to reproduce

Can't reproduce (it's coming from our crash analytics), one off bug but might lead you to potentially fixing the issue.

Android: 5.1.1
Android Build: LMY48B.J500GXXU1AOL1
Manufacturer: samsung
Model: SM-J500G
Thread: Thread-2666-2666
CrashReporter Key: A6142E57-3598-E073-FC61-BF4DDEFDCB44BD56B087
Start Date: Mon Jun 05 23:56:02 GMT+08:00 2017
Date: Tue Jun 06 00:04:28 GMT+08:00 2017
Format: Xamarin
Xamarin caused by: android.runtime.JavaProxyThrowable: System.AggregateException: A Task's exception(s) were not observed either by Waiting on the Task or accessing its Exception property. As a result, the unobserved exception was rethrown by the finalizer thread. ---> System.AggregateException: One or more errors occurred. ---> System.Net.WebException: Error: NameResolutionFailure
at System.Net.HttpWebRequest.EndGetResponse (System.IAsyncResult asyncResult) [0x00058] in :0
at System.Threading.Tasks.TaskFactory1[TResult].FromAsyncCoreLogic (System.IAsyncResult iar, System.Func2[T,TResult] endFunction, System.Action1[T] endAction, System.Threading.Tasks.Task1[TResult] promise, System.Boolean requiresSynchronization) [0x0000f] in :0
--- End of inner exception stack trace ---
at System.Threading.Tasks.Task.ThrowIfExceptional (System.Boolean includeTaskCanceledExceptions) [0x00011] in :0
at System.Threading.Tasks.Task1[TResult].GetResultCore (System.Boolean waitCompletionNotification) [0x0002b] in <a83cd6d69e484f55bdb92ebf1dda2881>:0    at System.Threading.Tasks.Task1[TResult].get_Result () [0x0000f] in :0
at Xamarin.Auth.OAuth1Authenticator.m__0 (System.Threading.Tasks.Task1[TResult] respTask) [0x00000] in <bae572ba45754aac977da65c58a52c3b>:0    at System.Threading.Tasks.ContinuationResultTaskFromResultTask2[TAntecedentResult,TResult].InnerInvoke () [0x00024] in :0
at System.Threading.Tasks.Task.Execute () [0x00010] in :0
--- End of inner exception stack trace ---
---> (Inner Exception #0) System.AggregateException: One or more errors occurred. ---> System.Net.WebException: Error: NameResolutionFailure
at System.Net.HttpWebRequest.EndGetResponse (System.IAsyncResult asyncResult) [0x00058] in :0
at System.Threading.Tasks.TaskFactory1[TResult].FromAsyncCoreLogic (System.IAsyncResult iar, System.Func2[T,TResult] endFunction, System.Action1[T] endAction, System.Threading.Tasks.Task1[TResult] promise, System.Boolean requiresSynchronization) [0x0000f] in :0
--- End of inner exception stack trace ---
at System.Threading.Tasks.Task.ThrowIfExceptional (System.Boolean includeTaskCanceledExceptions) [0x00011] in :0
at System.Threading.Tasks.Task1[TResult].GetResultCore (System.Boolean waitCompletionNotification) [0x0002b] in <a83cd6d69e484f55bdb92ebf1dda2881>:0    at System.Threading.Tasks.Task1[TResult].get_Result () [0x0000f] in :0
at Xamarin.Auth.OAuth1Authenticator.m__0 (System.Threading.Tasks.Task1[TResult] respTask) [0x00000] in <bae572ba45754aac977da65c58a52c3b>:0    at System.Threading.Tasks.ContinuationResultTaskFromResultTask2[TAntecedentResult,TResult].InnerInvoke () [0x00024] in :0
at System.Threading.Tasks.Task.Execute () [0x00010] in :0
---> (Inner Exception #0) System.Net.WebException: Error: NameResolutionFailure
at System.Net.HttpWebRequest.EndGetResponse (System.IAsyncResult asyncResult) [0x00058] in :0
at System.Threading.Tasks.TaskFactory1[TResult].FromAsyncCoreLogic (System.IAsyncResult iar, System.Func2[T,TResult] endFunction, System.Action1[T] endAction, System.Threading.Tasks.Task1[TResult] promise, System.Boolean requiresSynchronization) [0x0000f] in :0 <---
<---

Platform:

[] .NET version =
[] mono version = <IP_ADDRESS>

Expected behaviour
The app should not crash if "resolution failure" happens.

This is now design problem.
OK. I might put it in Xamarin.Auth, but how do you want me to inform user that they have DNS problems (possible network problems).
Everything in Xamarin.Auth starts (and finishes) from ctor. I would put ctor in try/catch and then decide to log or show to user.
But thanks for investigating and reporting

@moljac shouldn't this trigger error event? I can put the try catch to my app but just wondering what the best approach is here.

Xamarin.Auth does not handle networking issues/interruptions during OAuth flow.
Due to lack of info and difficulty of reproducing triaging it as "Low Priority"


Race Condition -> RuntimeError: cuda runtime error (77) : an illegal memory access was encountered at /maskrcnn-benchmark/maskrcnn_benchmark/csrc/cuda/nms.cu:103

🐛 Bug
When my maskrcnn's parameters requires_grad is False, I get an error in the inference stage due to nms. This didn't happen in last month's version of this repo.
To Reproduce
I run the following command for a CityScapes batch.
for p in mrcnn.parameters():
     p.requires_grad = False

mrcnn.eval()
predictions = mrcnn(image_list)

Error that I get,
    result = self.forward(*input, **kwargs)
  File "/mnt/home/issam/Research_Ground/domain_adaptation/models/base_models/adv_mrcnn.py", line 242, in forward
    x, result, detector_losses = self.roi_heads(features, proposals, targets)
  File "/miniconda/envs/py36/lib/python3.6/site-packages/torch/nn/modules/module.py", line 489, in __call__
    result = self.forward(*input, **kwargs)
  File "/mnt/home/issam/Research_Ground/domain_adaptation/models/maskrcnn/heads.py", line 26, in forward
    x, detections, loss_box = self.box(features, proposals, targets)
  File "/miniconda/envs/py36/lib/python3.6/site-packages/torch/nn/modules/module.py", line 489, in __call__
    result = self.forward(*input, **kwargs)
  File "/maskrcnn-benchmark/maskrcnn_benchmark/modeling/roi_heads/box_head/box_head.py", line 52, in forward
    result = self.post_processor((class_logits, box_regression), proposals)
  File "/miniconda/envs/py36/lib/python3.6/site-packages/torch/nn/modules/module.py", line 489, in __call__
    result = self.forward(*input, **kwargs)
  File "/maskrcnn-benchmark/maskrcnn_benchmark/modeling/roi_heads/box_head/inference.py", line 82, in forward
    boxlist = self.filter_results(boxlist, num_classes)
  File "/maskrcnn-benchmark/maskrcnn_benchmark/modeling/roi_heads/box_head/inference.py", line 126, in filter_results
    boxlist_for_class, self.nms
  File "/maskrcnn-benchmark/maskrcnn_benchmark/structures/boxlist_ops.py", line 27, in boxlist_nms
    keep = _box_nms(boxes, score, nms_thresh)
RuntimeError: cuda runtime error (77) : an illegal memory access was encountered at /maskrcnn-benchmark/maskrcnn_benchmark/csrc/cuda/nms.cu:103
Uncaught exception. Entering post mortem debugging
Running 'cont' or 'step' will restart the program
> /maskrcnn-benchmark/maskrcnn_benchmark/structures/boxlist_ops.py(27)boxlist_nms()
     26     score = boxlist.get_field(score_field)
---> 27     keep = _box_nms(boxes, score, nms_thresh)
     28     if max_proposals > 0:

Environment
Numpy: 1.15.4
CUDA: 9.0.176
Pytroch: 1.0.1.post2
CUDNN: 7402

I believe it is a race condition@fmassa, I can print torch.zeros(5).cuda(0)
before calling the line,
concat_boxes = torch.cat([a.bbox for a in boxes], dim=0)

in  maskrcnn_benchmark/modeling/roi_heads/box_head/inference.py
but after that line calling  torch.zeros(5).cuda(0)  (without waiting), causes the issue RuntimeError: CUDA error: an illegal memory access was encountered
Note that boxes is in GPU 1.

I think that the error is not in nms, but might happen before. Can you run your inference code with CUDA_LAUNCH_BLOCKING=1 python tools/test_net.py --etc and see where the error is raised?

You are right, I am still not sure where the bug came from :(, so I just reverted back to my older code base went to a different docker and things are working as expected. And it was happening very arbitrarily (I can't reproduce it anymore).
This started also after using nn.DistributedDataParallel but I am not sure if it contributed to it.
I can close this issue until it happens again.

@IssamLaradji maybe you had a bugged PyTorch version?
There was a version of PyTorch nightly that had a bug, but it has been fixed since then

@fmassa I found the reason why this happened. It was because I had  a pytorch dataset that also calls __get_item__ of another dataset and that caused illegal memory access issues with the dataloader.

I think the illegal memory access was in the other dataset then?

Hi, I met the same issue. I found that nms.cu initialize its threads on GPU-0 by default, and will raise such illegal memory access error when boxes is on other GPUs. Any idea to fix this ?

In my case, the issue was that I was using python multithreading to run two threads, one for training and one for validation. I fixed this by using multiprocessing instead of multithreading.
Are you running multiple threads?

In my case, the issue was that I was using python multithreading to run two threads, one for training and one for validation. I fixed this by using multiprocessing instead of multithreading.
Are you running multiple threads?

No. Actually, I tried to compile only nms.cu, no more code included, and found this issue.

Hi, I met the same issue. I found that nms.cu initialize its threads on GPU-0 by default, and will raise such illegal memory access error when input tensor boxes is on other GPUs. Any idea to fix this ?

Yes, If I tried to assign the model to a specific GPU, e.g., cuda:1, the error occurs

I am encountering a similar problem. I am using multiple GPUs with multiprocessing.
  File "/opt/conda/lib/python3.7/site-packages/maskrcnn_benchmark-0.1-py3.7-linux-x86_64.egg/maskrcnn_benchmark/modeling/rpn/inference.py", line 135, in forward
    sampled_boxes.append(self.forward_for_single_feature_map(a, o, b))
  File "/opt/conda/lib/python3.7/site-packages/maskrcnn_benchmark-0.1-py3.7-linux-x86_64.egg/maskrcnn_benchmark/modeling/rpn/inference.py", line 115, in forward_for_single_feature_map
    score_field="objectness",
  File "/opt/conda/lib/python3.7/site-packages/maskrcnn_benchmark-0.1-py3.7-linux-x86_64.egg/maskrcnn_benchmark/structures/boxlist_ops.py", line 27, in boxlist_nms
    keep = _box_nms(boxes, score, nms_thresh)
RuntimeError: cuda runtime error (700) : an illegal memory access was encountered at /src/vqa-maskrcnn-benchmark/maskrcnn_benchmark/csrc/cuda/nms.cu:103

Why be in a hurry to close? Anyway.. This issue keeps happening. Running a MaskRCNN benchmark, what is worse is when CUDA_LAUNCH_BLOCKING=1 turned on, the issue goes away.
Bad old days of C and its memory problems!

I am encountering a similar problem. I am using multiple GPUs with multiprocessing.
  File "/opt/conda/lib/python3.7/site-packages/maskrcnn_benchmark-0.1-py3.7-linux-x86_64.egg/maskrcnn_benchmark/modeling/rpn/inference.py", line 135, in forward
    sampled_boxes.append(self.forward_for_single_feature_map(a, o, b))
  File "/opt/conda/lib/python3.7/site-packages/maskrcnn_benchmark-0.1-py3.7-linux-x86_64.egg/maskrcnn_benchmark/modeling/rpn/inference.py", line 115, in forward_for_single_feature_map
    score_field="objectness",
  File "/opt/conda/lib/python3.7/site-packages/maskrcnn_benchmark-0.1-py3.7-linux-x86_64.egg/maskrcnn_benchmark/structures/boxlist_ops.py", line 27, in boxlist_nms
    keep = _box_nms(boxes, score, nms_thresh)
RuntimeError: cuda runtime error (700) : an illegal memory access was encountered at /src/vqa-maskrcnn-benchmark/maskrcnn_benchmark/csrc/cuda/nms.cu:103

have you resolved this issue? I'm using single GPU, but the same problem.

Hi, I met the same issue. I found that nms.cu initialize its threads on GPU-0 by default, and will raise such illegal memory access error when input tensor boxes is on other GPUs. Any idea to fix this ?

I specified the device "cuda:0", and it works.


[Issue] Expandable attribute doesn't work for list of scriptable objects

Defining a serializable a list of scriptable objects with the Expandable attribute gives you continuous errors:
NullReferenceException: Object reference not set to an instance of an object
NaughtyAttributes.Editor.PropertyUtility.GetPropertyType (UnityEditor.SerializedProperty property) (at Assets/Packages/ThirdParty/NaughtyAttributes/Scripts/Editor/Utility/PropertyUtility.cs:182)
NaughtyAttributes.Editor.ExpandablePropertyDrawer.OnGUI_Internal (UnityEngine.Rect rect, UnityEditor.SerializedProperty property, UnityEngine.GUIContent label) (at Assets/Packages/ThirdParty/NaughtyAttributes/Scripts/Editor/PropertyDrawers/ExpandablePropertyDrawer.cs:70)
NaughtyAttributes.Editor.PropertyDrawerBase.OnGUI (UnityEngine.Rect rect, UnityEditor.SerializedProperty property, UnityEngine.GUIContent label) (at Assets/Packages/ThirdParty/NaughtyAttributes/Scripts/Editor/PropertyDrawers/PropertyDrawerBase.cs:30)
UnityEditor.PropertyDrawer.OnGUISafe (UnityEngine.Rect position, UnityEditor.SerializedProperty property, UnityEngine.GUIContent label) (at <9540aba417024bb296674f70fa788b73>:0)
UnityEditor.PropertyHandler.OnGUI (UnityEngine.Rect position, UnityEditor.SerializedProperty property, UnityEngine.GUIContent label, System.Boolean includeChildren, UnityEngine.Rect visibleArea) (at <9540aba417024bb296674f70fa788b73>:0)
UnityEditor.PropertyHandler.OnGUI (UnityEngine.Rect position, UnityEditor.SerializedProperty property, UnityEngine.GUIContent label, System.Boolean includeChildren) (at <9540aba417024bb296674f70fa788b73>:0)
UnityEditorInternal.ReorderableList+Defaults.DrawElement (UnityEngine.Rect rect, UnityEditor.SerializedProperty element, System.Object listItem, System.Boolean selected, System.Boolean focused, System.Boolean draggable, System.Boolean editable) (at <9540aba417024bb296674f70fa788b73>:0)
UnityEditorInternal.ReorderableList.DoListElements (UnityEngine.Rect listRect, UnityEngine.Rect visibleRect) (at <9540aba417024bb296674f70fa788b73>:0)
UnityEditorInternal.ReorderableList.DoList (UnityEngine.Rect rect, UnityEngine.Rect visibleRect) (at <9540aba417024bb296674f70fa788b73>:0)
UnityEditorInternal.ReorderableListWrapper.Draw (UnityEngine.GUIContent label, UnityEngine.Rect r, UnityEngine.Rect visibleArea, System.Boolean includeChildren) (at <9540aba417024bb296674f70fa788b73>:0)
UnityEditor.PropertyHandler.OnGUI (UnityEngine.Rect position, UnityEditor.SerializedProperty property, UnityEngine.GUIContent label, System.Boolean includeChildren, UnityEngine.Rect visibleArea) (at <9540aba417024bb296674f70fa788b73>:0)
UnityEditor.PropertyHandler.OnGUI (UnityEngine.Rect position, UnityEditor.SerializedProperty property, UnityEngine.GUIContent label, System.Boolean includeChildren) (at <9540aba417024bb296674f70fa788b73>:0)
UnityEditor.PropertyHandler.OnGUILayout (UnityEditor.SerializedProperty property, UnityEngine.GUIContent label, System.Boolean includeChildren, UnityEngine.GUILayoutOption[] options) (at <9540aba417024bb296674f70fa788b73>:0)
UnityEditor.EditorGUILayout.PropertyField (UnityEditor.SerializedProperty property, UnityEngine.GUIContent label, System.Boolean includeChildren, UnityEngine.GUILayoutOption[] options) (at <9540aba417024bb296674f70fa788b73>:0)
NaughtyAttributes.Editor.NaughtyEditorGUI.DrawPropertyField_Layout (UnityEngine.Rect rect, UnityEditor.SerializedProperty property, UnityEngine.GUIContent label, System.Boolean includeChildren) (at Assets/Packages/ThirdParty/NaughtyAttributes/Scripts/Editor/Utility/NaughtyEditorGUI.cs:37)
NaughtyAttributes.Editor.NaughtyEditorGUI.PropertyField_Implementation (UnityEngine.Rect rect, UnityEditor.SerializedProperty property, System.Boolean includeChildren, NaughtyAttributes.Editor.NaughtyEditorGUI+PropertyFieldFunction propertyFieldFunction) (at Assets/Packages/ThirdParty/NaughtyAttributes/Scripts/Editor/Utility/NaughtyEditorGUI.cs:89)
NaughtyAttributes.Editor.NaughtyEditorGUI.PropertyField_Layout (UnityEditor.SerializedProperty property, System.Boolean includeChildren) (at Assets/Packages/ThirdParty/NaughtyAttributes/Scripts/Editor/Utility/NaughtyEditorGUI.cs:27)
NaughtyAttributes.Editor.NaughtyInspector.DrawSerializedProperties () (at Assets/Packages/ThirdParty/NaughtyAttributes/Scripts/Editor/NaughtyInspector.cs:87)
NaughtyAttributes.Editor.NaughtyInspector.OnInspectorGUI () (at Assets/Packages/ThirdParty/NaughtyAttributes/Scripts/Editor/NaughtyInspector.cs:47)
UnityEditor.UIElements.InspectorElement+<>c__DisplayClass59_0.<CreateIMGUIInspectorFromEditor>b__0 () (at <ab574a2f598240d68c66d280c533b9d3>:0)
UnityEngine.GUIUtility:ProcessEvent(Int32, IntPtr, Boolean&)

I had the same issues.
This is solution:


Extremely inconsistent click-drag behaviour

I was testing the modal window example, and found that clicking and dragging was extremely inconsistent in a very strange way.
Example
I have actually had similar behavior to this while attempting to work on a general graphics canvas widget for my project Lipuma. At the time I thought it was due to a misunderstanding of mine but now it seems that it might be deeper than that.
In terms of platform I have currently tested this using i3 as my window manager on X11. It's late as I'm writing this, and I will double check this with KDE Plasma tomorrow morning.

I just confirmed that the same behavior occurs under cinnamon and KDE Plasma.

I have identified the problem: The debug output used to print out all of the move events was causing handling the event to take so long that the event loop was failing to keep up.
This doesn't explain the jitter I've been dealing with in Lipuma, but before this incident I had assumed it was my code anyways.
Closing as user error.

I think maybe we should change the example... it's demonstrating how to set the child position programmatically, but this definitely isn't the right way to have a moveable child window.


paint-order not applied to <use>

use-paint-order.svg
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 240 240">
  <defs>
    <g id="a-circle">
      <circle r="80" />
    </g>
  </defs>

  <circle cx="90" cy="90" r="80" fill="green"
      stroke="blue" stroke-width="10" paint-order="stroke fill" />

  <use href="#a-circle" x="150" y="150" fill="orange"
      stroke="blue" stroke-width="10" paint-order="stroke fill" />

</svg>

Actual
Expected

I'm not sure behaviour of other implementations actually is correct here. Per the spec https://svgwg.org/svg2-draft/painting.html#PaintOrder the paint-order property is only allowed on the following elements

shapes:

circle
ellipse
line
path
polygon
poly line
rect

text content elements

text
textPath
span

It is inherited though that should only apply to text content elements as out of the above elements only text actually is a container type (in the sense that is can have visible children).

Looks similar to the fill attribute.  It is said it applies to just shapes and text content elements but then it is inherited and one could specify fill="..." on the root <svg> or <g> element – that one is handled by JSVG.

I think "applies to" and which element could specify the attribute are two different parts.  The <use> element is specified to have presentation attributes that include paint-order.  "Style Scoping and Inheritance" further specify how these apply to referenced elements.

Ah it has been to long since I worked on inherited properties. This makes a lot of sense.

Should be fixed in current snapshot

Tested with current 1.5.1-SNAPSHOT – works as expected now.

Now available in 1.6.0