Refunded order gets wrong state.

Expected behavior
When an order is refunded the order gets the state "paid" I checked the configuration but I would expect that it should go to another option like this:

Actual behavior
Order gets state paid:

This happend to iDeal orders, don't know if this happens with order payment methods.
Steps to reproduce the behavior
Create an iDeal order. Pay this order and refund it.
Environment

PrestaShop version: <IP_ADDRESS>
Mollie module version: 4.1.1
PHP version: 7.2.34

Hi @jacob-v-dam !
Thanks a lot for your input to the Mollie community.
Just wanted to double check have you noticed this behavior only on 4.1.1 version? or previous versions too?
Looking forward to hearing from you

This also happend in version 4.1.0 therefor i updated to version 4.1.1 to see if the problem still existed, unfortunately it did.

Hello @jacob-v-dam thank you for your insights,
We have tested on our testing environments, we couldn't find any code problems, seems that Mollie has a little bit changed the Refund functionality in the Mollie.com dashboard.
If you could check your Mollie account, you could see that now you can cancel the Refund action, and the Refund status itself is pending. The module is mirroring the same statuses at this functionality as the Mollie dashboard does.

However, if you still experiencing the problem, that could be not related to this Mollie update, could check and write us here?
Or could we check your webshop by logging in and debugging there?
Best Regards.
<EMAIL_ADDRESS>

We have the same problem, it seems that the Mollie backend triggers a statusupdate to the status "Paid".
Can you please look in to this?

@thezimba Hey, are you still encountering the issue? If so, would you be able to create a separate issue for it? Or write us at -<EMAIL_ADDRESS>for further investigation!
--
Best regards,
Invertus Support team

I'm still encountering this issue. As soon as the refund is requested the state goes back to 'Betaling aanvaard', which is paid.
If you change your order to a different state and request a refund the error occurs, it goes back to 'Betaling aanvaard'.

Hello @jacob-v-dam, thank you for your message!
We've tested this on an https secure connection, and it seems that the refund is done appropriately (adding screenshots)

Maybe you could screenshot the webhook transactions on the right side of the dashboard? The errors can be seen here:

If we could see the errors, it would be easier to identify the issue!
Looking forward to your reply!
Best regards,
Invertus Support team

There are no errors in the refunded order. I create the refund from the mollie table, could this be the problem? And most of the time it as an iDeal payment.

@jacob-v-dam Could you maybe clarify if you're testing this on a localhost? And after doing the refund, does the status not change correctly even after 10-15 minutes after making the refund?
Looking forward to your reply!
Best regards,
Invertus Support team

Hello @jacob-v-dam, how are you?
 Or does it still persists? If yes, would you be able to clarify the needed information from my last message for further investigation?
Kindly looking forward to your reply!
Best regards,
Invertus Support team

I made a refund and happend again. Again it was a iDeal payment.
The refund was made possible with the table on the order detail page.

@jacob-v-dam And you're testing this on a local host? Or the page is live on a hosting server?
Looking forward to your reply!
Best regards,
Invertus Support team

This is a live server. Probably you could fix the log reporting and then it would show up in the presta log

@jacob-v-dam Could you maybe send us your Front office/ Back office + FTP + clear steps how to replicate the issue to -<EMAIL_ADDRESS>for further investigation? As at the moment it's difficult to determine what exactly is wrong, since we couldn't replicate it from our end.
Best regards,
Invertus Support team

Hey @jacob-v-dam I've double checked this issue further, and came to the conclusion, that this is not really an issue, as I've got a full clarification, that the official time that the status should change is within 2 hours, so please let me know if the status doesn't change even after 2 hours, if it does, then it's normal, if it doesn't change even after 2 hours mark, then it's an issue.
Looking forward to your reply!
Best regards,
Invertus Support team

I'll try to provide FTP credentials this week.
But I think I have found something else:
Order complete
When someone returns an order and it gets refunded everything goes well. The order is marked as shipped in Mollie and it doesn't get the paid state.
Order cancelled
When an order is cancelled but it isn't delivered it gets the paid state when it is refunded. In my case an order gets a different state for order handling. So the paid state is not set anymore this allows the module to set the paid state again and send an e-mail.

I'll try to provide FTP credentials this week.
But I think I have found something else:
Order complete
When someone returns an order and it gets refunded everything goes well. The order is marked as shipped in Mollie and it doesn't get the paid state.
Order cancelled
When an order is cancelled but it isn't delivered it gets the paid state when it is refunded. In my case an order gets a different state for order handling. So the paid state is not set anymore this allows the module to set the paid state again and send an e-mail.

Thank you for that, would be best to provide back office/ front office login details as well, as we couldn't reproduce the issue from our end + clear steps how to encounter it, so we could rapidly check how to solve it, if the issue can actually be reproduced.
Be sure to send the login details at -<EMAIL_ADDRESS>Best regards,
Invertus Support team

Thank you for that, would be best to provide back office/ front office login details as well, as we couldn't reproduce the issue from our end + clear steps how to encounter it, so we could rapidly check how to solve it, if the issue can actually be reproduced.
Be sure to send the login details at -<EMAIL_ADDRESS>Best regards,
Invertus Support team

Is it possible to remove the 2 hour check?

Is it possible to remove the 2 hour check?

Hello @basemedia, thank you for your message! But unfortunately the 2 hour mark is default, and intended Mollie behaviour, therefore it can't be changed, sorry for the inconveniences.
Let me know if you have any further questions!
Best regards,
Invertus Support team

Hello @basemedia, thank you for your message! But unfortunately the 2 hour mark is default, and intended Mollie behaviour, therefore it can't be changed, sorry for the inconveniences.
Let me know if you have any further questions!
Best regards,
Invertus Support team

That's no problem. I understand. Is it possible to disable the Webhook call? I am using module 3.5.5.
Let me know.

That's no problem. I understand. Is it possible to disable the Webhook call? I am using module 3.5.5.
Let me know.

@basemedia Yeah, it's possible but, the functionality of returning the statuses won't work, when the webhook call is disabled. I would highly suggest firstly doing this on a test environment, only then actually proceeding with disabling it, but most likely it could break the module.
Let me know if you have any other questions, we are here to help!
Best regards,
Invertus Support team

@basemedia Yeah, it's possible but, the functionality of returning the statuses won't work, when the webhook call is disabled. I would highly suggest firstly doing this on a test environment, only then actually proceeding with disabling it, but most likely it could break the module.
Let me know if you have any other questions, we are here to help!
Best regards,
Invertus Support team

Ok. Please inform how I can disable the call.

Ok. Please inform how I can disable the call.

Hello,
To disable the webhook you can comment the whole file in order to disable it, the webhook can be found - controllers/front/webhook.php, or in the function "initContent" you can perform die('ok'); and that should disable it.
Best regards,
Invertus Support team

Hello,
To disable the webhook you can comment the whole file in order to disable it, the webhook can be found - controllers/front/webhook.php, or in the function "initContent" you can perform die('ok'); and that should disable it.
Best regards,
Invertus Support team

Hello @jacob-v-dam does your issue still persists? Would you be able to provide the credentials for further checking?
Also, 4.2.0 version was just released, you can download it here - https://github.com/mollie/PrestaShop/releases/tag/4.2.0
Any feedback regarding the new version is greatly appreciated!
Looking forward to your reply!
Best regards,
Invertus Support team

Hello @jacob-v-dam does your issue still persists? Would you be able to provide the credentials for further checking?
Also, 4.2.0 version was just released, you can download it here - https://github.com/mollie/PrestaShop/releases/tag/4.2.0
Any feedback regarding the new version is greatly appreciated!
Looking forward to your reply!
Best regards,
Invertus Support team


Support Angular 8

Please update to Angular 8.

Yes please!!!

See #46

Upgraded to Angular version 8.


Authentication

+] Authentication renewed!
Server resent the older message<PHONE_NUMBER>621292033, ignoring
[+] Authentication renewed!
[proxychains] Strict chain  ...  <IP_ADDRESS>:9050  ...  <IP_ADDRESS>:443  ...  OK
[proxychains] Strict chain  ...  <IP_ADDRESS>:9050  ...  <IP_ADDRESS>:443  ...  OK
[+] Authentication renewed!
[proxychains] Strict chain  ...  <IP_ADDRESS>:9050  ...  <IP_ADDRESS>:443  ...  OK
[+] Authentication renewed!
[+] Authentication renewed!
[proxychains] Strict chain  ...  <IP_ADDRESS>:9050  ...  <IP_ADDRESS>:443 [+] Authentication renewed!
[+] Authentication renewed!

a7947c3847fb95f89424b338ee3ce0b007391c02


mangawt extension not working

Source information
MangaWT
Source language
Turkish / Türkçe
Steps to reproduce

Expected behavior
Extension works
Actual behavior
Extension does not works
Mihon/Tachiyomi version
0.17.7015 Beta
Android version
Android 13
Other details
Even though I open webview it doesn't work
Acknowledgements

[X] I have searched the existing issues and this is a new ticket, NOT a duplicate or related to another open or closed issue.
[X] I have written a short but informative title.
[X] I have updated the app to version 0.15.3.
[X] I have updated all installed extensions.
[X] I have tried the troubleshooting guide.
[X] If this is an issue with the app itself, I should be opening an issue in the app repository.
[X] I will fill out all of the requested information in this form.

Add a :+1: reaction to issues you find important.

Domain changed to .com


Keybase unable to start after configuring proxy_ca_certs

Hello,
I was unable to relaunch my keybase app after I tried to configure the proxy_ca_certs to enable the traffic monitoring on my burp.
I tried to reinstall and delete all resource/file with a keybase label on it by after installing im still having the error
ERROR Failed to configure API access: In config file /Users/local/Downloads/cacert.cer: Bad CA Cert file; failed to parse
When I try to set a different proxy_ca_certs im having this error
keybase config set proxy_ca_certs "/Users/local/Downloads/burp.pem"

We found a Keybase service (keybase.service) but it's not running.
You might try starting it: keybase launchd start keybase.service

▶ ERROR There were multiple errors: dial unix /Users/mikkz/Library/Group Containers/keybase/Library/Caches/Keybase/keybased.sock: connect: no such file or directory; dial unix /Users/local/Library/Caches/Keybase/keybased.sock: connect: no such file or directory

How can I start the keybase with a fresh install and cert?
keybase version
Client:  5.5.0-20200526170801+139bb348af
I'm using mac os high seirra 10.13.6
Thanks!

Fixed it by editing the /Library/Application Support/Keybase/config.json


vagrant_ip has conflict with MikroTik router

Issue Type

Question

Summary
Is there any reason why for variable vagrant_ip the ip <IP_ADDRESS> is used by default? I bought yesterday MikroTik router which binds 192.168.88.* to it's own purposes. So this cause the problem with starting vagrant:
The specified host network collides with a non-hostonly network!
This will cause your specified IP to be inaccessible. Please change
the IP or name of your host only network so that it no longer matches that of
a bridged or non-hostonly network.

I just want you to know it.

@Niklan there's a PR open which could fix this -- https://github.com/geerlingguy/drupal-vm/pull/1559

I have no idea why I originally chose 88.88, other than a general liking for the number 8... so it kind of just stuck.
Note that until anything is changed in Drupal VM's default IP, changing the IP address is easy with vagrant_ip or vagrant_public_ip; or you can use auto networking if you have that plugin by setting <IP_ADDRESS>, or even dhcp if you check out how it's done in #1559 .

@geerlingguy yes, this is not problem at all. I just changed the IP on <IP_ADDRESS> (was binded to previous asus router, so now it's free to use in my network) and all works fine.
I just wrote it for your information, maybe it will be helpful in the future, so issue now can be closed. Maybe some of IP in 192.168.* is safe to use on all routers and can be set by default? I don't know. I also used before D-Link, it also bind 192.168.1.* as asus router.

I typically change it to <IP_ADDRESS>-105, but supporting dhcp and hostsupdater would be very nice to have.

if #1559 gets merged dhcp will work if you set vagrant_ip: dhcp as long as you have vagrant-hostmanager installed. I don't think vagrant-hostsupdater will ever support it considering the issue has been open since 2015 :/


Remove at_least_one=False from Artifact SCO

Codecov Report

Merging #290 into stix2.1 will decrease coverage by 0.03%.
The diff coverage is 100%.

@@             Coverage Diff             @@
##           stix2.1     #290      +/-   ##
===========================================
- Coverage    98.09%   98.06%   -0.04%
===========================================
  Files          123      123
  Lines        13409    13409
===========================================
- Hits         13154    13149       -5
- Misses         255      260       +5

Impacted Files
Coverage Δ

stix2/v21/observables.py
96.96% <100%> (ø)
:arrow_up:

stix2/canonicalization/Canonicalize.py
60.24% <0%> (-1.21%)
:arrow_down:

stix2/base.py
98.07% <0%> (-0.77%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e1a88a4...f241ed5. Read the comment docs.


GET with body

[x] Feature Request. Start by telling us what problem you’re trying to solve.

I'd like to use okhttp to send GET requests with a body. So far as I can tell this is permitted by the spec but the server "SHOULD" ignore it. I'd like to you okhttp with a server that does not.

This breaks too many other assumptions like how caching works. You'll need to fix your server, fork OkHttp, or use another client.

Thanks for responding so quickly. We'll use another client.

Could someone suggest a client that does allow this? So far all clients seems to assume GET does not allow for a body.

@mmcminn You can configure the Apache Http Async Client to send bodies with GET requests. It's not the default behavior, but you can see a simple example here.


TECS and L1 switch to matrix math library

ECL side - https://github.com/PX4/ecl/pull/409

Rebased with ECL updated to master.

Merging this to unblock ECL development. It checks out in SITL and the vast majority was 1-1 conversion from old mathlib vector/matrix -> matrix lib.


Remove support for extensions in pre-v3 X.509 certificates

Context
X.509 is the standard for certificates used, among other things, in TLS. The original standard (v1) was published by the ITU in 1988, followed by v2 in 1993 and v3 in 1997. The IETF defines a "Internet X.509 Public Key Infrastructure" profile of X.509, based on v3 since its inception in 2002 (RFC 3280). The CA/Browser forum defines baseline requirements for use on the web, also based on v3 since their inception in 2011.
Version 3 of X.509 introduced the possibility for certificates to include optional extensions. This possibility was not present in earlier versions of the specification, however some software did generate pre-v3 certificates that did include extensions. Such certificates are not and never were compliant, so by default Mbed TLS rejects them.
However, in order to support users faced with such certificates (generated by 3rd parties) a compile-time option MBEDTLS_X509_ALLOW_EXTENSIONS_NON_V3 was introduced in 2013, that would cause such certificates to be accepted if they are otherwise compliant and valid.
Proposal
Remove the option MBEDTLS_X509_ALLOW_EXTENSIONS_NON_V3  in Mbed TLS 3.0 and just always reject non-compliant certificates that declare a version lower than 3 but include extensions.
Rationale

This is 2021 and hopefully all certificates that were generated recently enough to not be expired yet are v3, so we shouldn't need to care about pre-v3 certs, let alone non-compliant pre-v3 certificates.
Every additional compile-time option brings some complexity that negatively impacts maintainability and testing. This is only OK if this cost is justified by the service the option provides to users, but that doesn't seem to be the case here.

Work to do for 3.0

Remove MBEDTLS_X509_ALLOW_EXTENSIONS_NON_V3 and let the code behave as if it were always disabled.
Remove tests that depend on this option; for tests that depend on its negation, remove the dependency declaration.
As a result, git grep MBEDTLS_X509_ALLOW_EXTENSIONS_NON_V3 should find no occurrence (except in the ChangeLog) and the CI should still pass.

Mailing-list discussion
https://lists.trustedfirmware.org/pipermail/mbed-tls/2021-April/000340.html

There has been no objection on the list, so I'm marking this as approved.


btrbk: 0.22.2 -> 0.24.0

Motivation for this change
Upgrades btrbk to the latest upstream version.
This new version requires config migrations due to incompatible changes.
Does a package need to handle this somehow?
Things done

[ ] Tested using sandboxing
(nix.useSandbox on NixOS,
or option build-use-sandbox in nix.conf
on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] Linux

[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[x] Fits CONTRIBUTING.md.

Thanks for the heads-up! I've got some personal backup services that depend on it, but I'm fine with modifying them. Grepping for btrbk doesn't yield any services depending on it.

@the-kenny right, I also didn't find any service, so I created my own.
It is kind of opinionated at the moment, but I could be persuaded to improve on it an send a pull request.

I added openssh to the path in order to get the ssh integration working.
Since the change seems trivial, I squashed the commit ontop of the version bump.

Merged as a1d9d7efc0


mqtl modfication

See the added 3 notebooks, the module added:
Create BMIQ.ipynb
phenotype_formmating.ipynb: bed_filter_na, per_chr_softImpute_1
covariate_formmating.ipynb:  compute_residual_per_chr

Thanks @yuqimiao it actually looks in good shape although some details needs rework.
@hsun3163 am not going to merge this PR. I'll leave the decision to you. You can either take a look at them later this week to incorporate into our protocol and send PR at that point, or actually merge this PR yourself but make immediate patches to bring it to our standards via another PR

@hsun3163 the details I'm refering to also include some loose commands in @yuqimiao 's notebook contributed to the brain-xqtl-analysis repo.

The change was adopted in the new PR


Add S3 access key format for prior version of KFServing

What this PR does / why we need it:
Kubeflow manifests repository's master branch is configured with KFServing version 0.3. And current kfserving s3 sample document is working with KFServing version 0.4 but not with before version 0.3. So, I would like to supply additional configuration information with this PR.
Which issue(s) this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged):
Fixes #None
Special notes for your reviewer:

Please confirm that if this PR changes any image versions, then that's the sole change this PR makes.
None

Release note:

@Minkyu-Choi thanks for the update!
/ok-to-test

/lgtm
/approve


Replacing youtube-dl in third-party applications

Checklist

[X] I'm asking a question and not reporting a bug/feature request
[X] I've looked through the README
[X] I've read the guidelines for opening an issue
[X] I've searched the bugtracker for similar questions including closed ones

Question
Is it possible to make it work instead of youtube-dl in third party applications like radio ++ (this is an applet on cinnamon).
She wants youtube-dl but can't download

Most apps should just work fine if you just rename the binary to youtube-dl. Some may need you to set --compat-options youtube-dl in the config if they depend on youtube-dl behavior that's different in yt-dlp.

Большинство приложений должно работать нормально, если вы просто переименуете двоичный файл в youtube-dl. Некоторым может потребоваться установить --compat-options youtube-dlв конфигурации, если они зависят от поведения youtube-dl, которое отличается от yt-dlp.

How to do it, how to rename
Or how to change the configuration

You don't know how to rename a file on a computer? Seriously?
For the configuration: https://github.com/yt-dlp/yt-dlp#configuration

If possible, you should just ask the app's devs to support yt-dlp (and other forks). But assuming that is not possible, create a symlink for youtube-dl to yt-dlp
sudo ln -s /usr/local/bin/yt-dlp /usr/local/bin/youtube-dl

@pukkandan I have asked.
Can't find the config file

The simply create the file

@pukkandan I do not know where to create

Probably ~/.config/yt-dlp/config. Read https://github.com/yt-dlp/yt-dlp#configuration

If possible, you should just ask the app's devs to support yt-dlp (and other forks). But assuming that is not possible, create a symlink for youtube-dl to yt-dlp
sudo ln -s /usr/local/bin/yt-dlp /usr/local/bin/youtube-dl

Okay, that seems to work, but how do I get back if I want to?

get what back?

получить что обратно?

For example, if this does not work, and I want to return the opening of files in youtube-dl

delete /usr/local/bin/youtube-dl and install youtube-dl again

@pukkandan I tried but writes like this
"noob @ debian: ~ $ sudo ln -s / usr / local / bin / yt-dlp / usr / local / bin / youtube-dl
[sudo] password for noob:
ln: could not create symlink '/ usr / local / bin / youtube-dl': File exists
noob @ debian: ~ $"

We're not computer teacher. Read error message carefully.

@nao20010128nao Did I ask you? Pass by, if you don't know, noob!


PHP: fix examples ClientStub constructor

Fixes #5519

The only test failure is a Python test, is it ok to merge?

Python test failure unrelated and win C failure unrelated as well (this is only touching PHP code). Merging this because it seems to be very low risk PR and we currently have a big merge queue after the fixit.


Finalize initial compatibility

This patch ensures all methods found in reflection and published in the documentation are present and implemented.
The following methods have no corresponding functionality in the ZendHQ version, and have been implemented to (a) log a warning, and (b) return a sane default value:

getStatistics(): This could potentially be implemented, as we can gather most of the information from the queues, but there is no documentation of what the actual structure returned is.
getStatisticsByTimespan(): see previous.
getConfig(): ZendHQ does not support querying for the configuration
reloadConfig(): see previous.
getDependentJobs(): ZendHQ does not support dependent jobs at this time.
getApplications(): ZendHQ does not have a concept of an application; the assumption is that you will have a ZendHQ node per application.
getSchedulingRules(), getSchedulingRule(), deleteSchedulingRule(), updateSchedulingRule(), suspendSchedulingRule(), and resumeSchedulingRule(): ZendHQ keeps schedules per-job, instead of as separate entities. As such, these methods have no meaning under ZendHQ JQ.

Other operations are also not supported, and log warnings while continuing normally:

The node_name option when creating a job is not supported in ZendHQ.
The predecessor option when creating a job is not supported in ZendHQ.
When retrieving jobs via getJobsList(), any of the date-time queries (scheduled_before, scheduled_after, executed_before, executed_after) will raise a warning if the date-time provided cannot be used to successfully create a DateTimeImmutable instance.

Additionally, there were a number of methods found via Reflection that were not in the documentation, and the assumption made was that these were from previous versions and considered deprecated; as such, I chose not to implement them:

abortJob()
createQueue()
deleteQueue()
getCurrentJobStatus()
getStatisticsByQueues()
resumeQueues()
retroAnalyzeStats()
runNowSchedulingRule()
public static function setCurrentJobProgress()
suspendQueues()

These can be added if we find customers using them.
Also with this patch, I did the following:

Set the minimum PHP version to 7.2 (minimum that Zend currently supports via ZendHQ JQ)
Replaced php-cs-fixer with the Laminas CS (superset of phpcs)
Bumped the PHPUnit version
Changed the autoloading to use file-based conditional autoloading instead of a class map. This approach is considered better in terms of CS (less indentation than with conditional classes).

Thanks a lot @weierophinney !


Updated test without diactoros to work also in separate process

Before, when the test run in whole test case some classes were already loaded

Thanks, @webimpress.


Resource path that precedes with / results in Missing identifier

Description:

Then the resource path precedes with a /, it results in Missing identifier diagnostic error. This causes confusion in the Choreo resource form as we can't identify the issue. The error diagnostic should ne more meaningful to identify the exact error.

Describe your problem(s)
import ballerina/http;

service / on new http:Listener(8080) {
    resource function get /hello(string name) returns json|error? {
        return error("");
    }
}

Describe your solution(s)
Related Issues (optional):

Suggested Labels (optional):

Suggested Assignees (optional):

Fixed in #34370 for SL-RC1


Update virtual-networks-create-vnetpeering-scenario-crosssub-include.md

Fix typo.

Hi @alexandair, I'm your friendly neighborhood Azure Pull Request Bot (You can call me AZPRBOT). Thanks for your contribution!
You've already signed the contribution license agreement. Thanks!
We will now validate the agreement and then real humans will evaluate your PR.
TTYL, AZPRBOT;

@alexandair : Thanks for your contribution to the Azure documentation! The author, @azdocprs, has been notified to review your proposed change.

@NarayanAnnamalai Hi Narayan Please review the proposed change. Thanks.

@NarayanAnnamalai Hi Narayan Please review the proposed change. Thanks.

@alexandair : Thanks for the edit. #sign-off

Only the author of the article can use the sign off comment to add the ready-to-merge label.


Understand diffrax.diffeqsolve

Hi,
Thanks for the nice package. I have a question regarding the implementation of diffrax.diffeqsolve. Specifically, I want to know a bit more details about the ODE solver, especially on what are the key factors driving diffeqsolve to be faster. In a nutshell, can you list several bulletpoints on the code implementation optimizations that have been done to accelerate ODE solving in diffrax?

In my experience one of the biggest factor in a jax package's speedup is simply that it used jax (not to diminish any of the other optimizations Patrick has implemented using jax). When I write numba code, then convert it to jax, jax if often just faster by default. For implementation considerations, I recommend section 5 of: https://arxiv.org/abs/2202.02435

There's been a lot of JAX-specific tricks that have gone into this: for example knowing when the compiler will want to make a copy of a buffer, and avoiding those cases. Or knowing that vmap-of-cond becomes jnp.where, and likewise knowing to avoid that.
I think one interesting trick here is the way we make sure to be vmap-friendly. That is, if we do vmap(diffeqsolve), we'd like the result to be fast. The key trick here is that we don't do a loop-over-output-times (integrating in between), and instead do a loop-over-steps (outputting times as we go along). This avoids having a double-while loop, with the inner loop sitting and waiting at every output time until every batch element is done.
Another trick that comes to mind is the use of Stumm-Walther-Wang-Moin checkpointing, to make autodiff fast: https://github.com/patrick-kidger/equinox/blob/main/equinox/internal/_loop/checkpointed.py
There's probably a bunch of other things too, but this is what comes to mind!


Shared Forwarding and Gateway-Group sporadic connection lost

Dear all,
Describe the bug
I think there is a bug in shared forwarding combined with gateway-group. When both is used I have sporadic connection losses to the WAN side.
To Reproduce

create 2 WAN-gateways
add both to a gateway-group (same Tier)
modify firewall-rule to use gateway group instead of default gateway

After that - you will have sporadic connection losses to internet. It can be repaired either switching of shared forwarding or using default-gateway instead of gateway group.
Both ways are not good, because I want loadbalancing as well as traffic shaper which needs shared forwarding turned on.
See: https://forum.opnsense.org/index.php?topic=23456.0 and https://forum.opnsense.org/index.php?topic=23460.30
More users see the same problem.
Expected behavior
No internet connection losses.
Environment
ESXi virtualized
OPNsense 21.1.7_1-amd64
FreeBSD 12.1-RELEASE-p18-HBSD
OpenSSL 1.1.1k 25 Mar 2021
Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz (2 cores)

Dear,
as I am affected as well and debugging my setup since the last 5 days (after OPNsense upgrade) please let me add some more information to raise the priority as I think loosing the MultiWAN and load balancing capability of OPNsense is a major issue.
My setup:
The OPNsense is installed on a hardware platform using a Celeron CPU and Intel nic's. This Hardware is made for firewalls (I don't have all the specs in mind yet but if necessary I can provide them as well).
For troubleshooting I also Installed the OPNsense on a 2nd device but with the same issue (read more below).
I have 2 Internet Gateways from 2 different ISPs both terminating each on an AVM Fritzbox (a widely used xDSL modem and router).
The OPNsense is behind those both AVM VDSL router via 2 separate VLAN's.
Between the OPNsense and each of the gateway router is a small transfer network with static assigned IPs.
The transmission OPNsense -> Gatwayrouter is IP routing no NAT on this lag.
The NAT will happen later on the gateway VDSL router towards Internet.
In the configuration I have both Gateways in a same Tier group and route the traffic via a floating firewall rule.
To ensure the session consistence I enabled in the advances firewall settings under MultiWAN the function to lock sessions with a custom time of 300 seconds.
This Setup was working fine over the last few years and after the update to the Version OPNsense 21.1.8_1-amd64 I experience sporadic Internet outages from all internal networks.
I can ICMP ping endpoints behind the gateways while the bug were triggered but everything else on every client does not work. It seems like OPNsense somehow messed completely up with the sessions and gateway allocation.
After a restart of the whole firewall it works for a few minutes - hours (no pattern recognized yet).
Steps taken for troubleshooting.
I reinstalled the firewall on the same hardware while importing my configuration.
Reinstalled the firewall on a spare hardware device while importing the configuration.
Steps I will do later for troubleshooting.
Since it's an productive firewall I need to be carefully and document every step but as I could not find a solution with multiwan enabled I will do next a full downgrade on the spare firewall. Once I can confirm the last working version I will also update you here.
Workaround:
Disable the load balancing by changing the floating firewall rule to use only one gateway.
Downgrade OPNsense
Additional details for troubleshooting:
Current version: OPNsense 21.1.8_1-amd64
Last known Version: OPNsense 20.xx (subversion not clear as I made several updates at once)
Replicating the bug: having 2 Internet gateways in a same tier group and defined in a floating rule.
Thank you very much for your support. I hope this bug report is detailed enough to raise the priority.
Please let me know If I you need any further details

Same issue here, it's also mentioned many times in the OPNsense forum, e.g. here
https://forum.opnsense.org/index.php?topic=17116.0
https://forum.opnsense.org/index.php?topic=7860.0
https://forum.opnsense.org/index.php?topic=19977.0
https://forum.opnsense.org/index.php?topic=6993.0
https://forum.opnsense.org/index.php?topic=23456.0
Workaround: Either disable shared forwarding, and loosing traffic shaping and captivate portal or disabling sticky connections.

FWIW, people say it's broken quickly but fail to add such helpful information as to what IP protocol family is involved or give some packet-based (pcaps) indication on the issue.

Hello,
I find the reaction both here and in the forum very unfortunate. Several topics have been opened and no real error analysis has been attempted in any of them. I have asked specifically what information I can still contribute to the diagnosis - but there is simply no more response from the developers. I find this more than a pity.
Yes, I didn't pay money for support - but if this is probably a bug, everyone involved should be interested in solving the problem - and yes, my time is not free either. But I'm happy to use it for bug analysis in the spirit of community - I just need to know what to contribute.
Very good example is Rapterron, he has contributed quite a bit - but unfortunately in my infrastructure I can't downgrade / upgrade / set up new machines at will. But since no one told me pertinently what info they still need, I couldn't help until now.
But I have described exactly how the bug can be traced, I have 2 firewalls that show similar behavior and also found other forum participants who have similar problems. To stand now sweeping and say it will probably be due to the users, I find to shame. Even if it should be sometimes, these members also need help. But in this case I think it is a bug - according to Rapterron's exemplary search probably after 19.7.
Dear OpnSense team - if without any major change the problem occurs all at once after upgrading from 19.7 to a higher version I ask the question here. Is it probably due to the software or the user???
See https://github.com/opnsense/core/issues/5094

By the way - simple IPv4 TCP/UDP and ICMP
In one of the forum posts you find a lot of screenshots so please do not claim there is not enough information.

Maybe the reason is most of the devs do the dev at home where two lines are quite untypical, thats why also devs need more Info like packet captures.
I try to reproduce next week on a VPS (cause also me dont have 2 lines to test)

A solid bug report is always welcome, but like I also mentioned in the other thread (https://github.com/opnsense/core/issues/5094#issuecomment-885461358), if there's a difference  between versions it's imperative to know what the last working version was (not being a version from 2 years ago).
Next question is what did "it" do, what do you expect "it" to do and what should the feature do according to the documentation, and don't forget, which features are being used in combination (in case the shaper and captive portal aren't used, you can safely disable shared forwarding by the way as these are the reason the option exists).
The conditions under which an issue appears are also quite crucial to know, @fichtner doesn't point for no reason to which kind of traffic is being affected. IPv4 and IPv6 for example are different implementations inside the kernel.
When connectivity drops for whatever reason, also check the logs, did a line drop for example or are there kernel messages from the driver (driver/hardware related for example).
I just tried to setup a gateway group with (and without) sticky connections, on my end it works without issues (with IPv4, but since quite some people use this combination, I didn't really expect issues to be honest).
If we state https://github.com/opnsense/core/issues/5094 and this issue are the same, we probably beter close one of them by the way.

Dear OpnSense team - if without any major change the problem occurs all at once after upgrading from 19.7 to a higher version I ask the question here. Is it probably due to the software or the user???

Reading the text above, I hope you understand it's not that simple to point to "the software" as well, there are quite some moving parts there.... for us it's impossible to track everybody's problems considering more than 80% of the issues are related to how people use our software and the equipment surrounding it (not necessarily issues with the software). The quality and contents of issues really matter to gain priority (yes, we also accept pull requests to discuss improvements).
Our community time is limited, we use quite a lot of it to improve OPNsense.....  going on goose chases doesn't help. Not saying that you don't have an issue, but it would really help if there's a reproducible set of steps someone else can replicate which always leads to the same result (from scratch with the minimum set of components). Most projects request that by the way, I don't think we're that unique.

From my point of view you can merge this issue with issue #5094 (I don't know, why Raptorron replied here and also opened a new one). But he did very good analyzes (I didn't know that it worked before because my second line is quite new so with the former versions I also had only one WAN - line).
My biggest problem is - I tried to ask and help in the community forum (and you should agree, that it is probably a problem with the software and there are more than only one person out there with this phenomenon) but suddenly there are no replies and no reactions from dev-team. A good software team should also make an effort to investigate (community) errors.
It is also possible to logon via teamviewer in my installation and do a phone-call to get the necessary informations (german native language) if there is an really interest and when a good error culture is lived.
OT:
I recently had a similar problem with a backup software. Standard is free - larger editions are chargeable.
There was a sporadic problem restoring some virtual machines (this was apparently due to something specific in my backup infrastructure). After 2 emails and a short demonstration in my environment (counterpart was from Australia) and collecting debug-logs from the developers, the bug was found and fixed within 10 days (it was a specific problem with some SATA hard disks).
Mind you, at the moment I'm using the free edition there - but here the developers were very eager. And in my case it is quite so that I use and use things privately. If they prove themselves, they will possibly be used both at my job and in our club and then the paid editions are usually used - so a win-win for both sides. However, products are also excluded in this way - I am certainly not alone with this approach.

It is also possible to logon via teamviewer in my installation and do a phone-call to get the necessary informations (german native language) if there is really an interest and when a good error culture is lived.

I understand your point of view, but  in reality networking is complicated and most of the  issues really lie out of our scope. Quite some issues look alike, but have different causes. If there's an apparent and reproducible bug, we tend to dig into those as soon as we find the time for it, but in reality there's a lot of assumptions in tickets.
It's always annoying when you open a thread in a forum and nobody reacts, but the community as whole need to step-up more in that area I guess. You can't always point to the people building the product.
Some time ago I read a book on the subject by Nadia Eghbal named "Working in Public: The Making and Maintenance of Open Source Software", if you're interested in how (most) open source projects work, it's definitely an advisable read.
If you're really interested in tracking your issue down, my advise would be to try to gather some people on the forum (you can ask people on GitHub to join there too) and discuss an action plan how to make your problem reproducible. If that seems to be difficult, try to figure out what binds the issues you expect to be the same (type of hardware, type of traffic, functionality used, etc etc). In some cases the way things are configured are just different than intended, in which case they can stop working at some point in time as well.
I'll close this issue so https://github.com/opnsense/core/issues/5094 can stay open.


Flickering/missing Textures in Witcher 3

Software information
Witcher 3, highest settings excluding NV Hairworks
System information

GPU: NVIDIA GTX 1050 Ti 4GB
Driver: x11-drivers/nvidia-drivers-396.24-r1
Wine version: app-emulation/wine-vanilla-3.10 (some cherry picks from wine-staging)
DXVK version: dxvk-0.54 (binary distribution)

Log files

Not created yet

Before submitting log files I'd like to know if something is maybe just broken with my installation because I couldn't find any other report of this quite severe visual problem. Witcher 3 renders correctly with vanilla wine tho performance is bad compared to DXVK. I made a short video clip to demonstrate the problem:
https://youtu.be/2y5IqHKgVnk
Is this a known problem of a wrong installation? In contrast, Skyrim SE works great with DXVK, it doesn't with vanilla wine.
If you need logs, let me know. Logging is completely turned off here because I see performance issues with default wine logging turned on, so I'd need to adjust my setup first.

It is old driver problem, for Witcher you need 396.24.02 (vulkan beta).

It is the latest beta driver as downloadable from NVIDIA. It looks more like the flickering issue early wine vanilla versions had with Witcher 3. According to NVIDIA download archives, this version is already beyond the Vulkan beta driver and is the recommended latest driver.
Is it possible that NVIDIA download version names do not include sub-version? Because I downloaded my version of 396.24 on Apr, 26nd. But the download archives say "released on May, 2nd".
I just compared the installed driver and a freshly downloaded, identical:
kakra@jupiter ~ $ ls -al {/usr/portage/distfiles,/home/kakra/downloads}/NVIDIA-Linux-x86_64-396.24.run
-rw-r--r-- 1 kakra   kakra   86545234 20. Jun 08:36 /home/kakra/downloads/NVIDIA-Linux-x86_64-396.24.run
-rw-rw-r-- 1 portage portage 86545234 26. Apr 18:20 /usr/portage/distfiles/NVIDIA-Linux-x86_64-396.24.run
kakra@jupiter ~ $ md5sum {/usr/portage/distfiles,/home/kakra/downloads}/NVIDIA-Linux-x86_64-396.24.run
7b5c4735a5b7ad3a9d166ca85cc88e17  /usr/portage/distfiles/NVIDIA-Linux-x86_64-396.24.run
7b5c4735a5b7ad3a9d166ca85cc88e17  /home/kakra/downloads/NVIDIA-Linux-x86_64-396.24.run

https://developer.nvidia.com/linux-3962402 - download
https://developer.nvidia.com/vulkan-driver - info

Oh wow, why is this on a completely separate page? I'll try later today. Thanks for the link.

I'm on 396.24.02 and there is no problem like that.
Graphics:  Card-1: Intel Device 591b bus-ID: 00:02.0 chip-ID: 8086:591b            Card-2: NVIDIA Device 1c8d bus-ID: 01:00.0 chip-ID: 10de:1c8d            Display Server: X.Org 1.19.5 driver: nvidia            Resolution<EMAIL_ADDRESS>          GLX Renderer: GeForce GTX 1050/PCIe/SSE2            GLX Version: 4.6.0 NVIDIA 396.24.02 Direct Rendering: Yes

With your version of the drivers + DXVK you need this. In the future you won't need it.

On lutris, right click on your game
System options
Environment variables
Add __GL_NextGenCompiler with the value 1

@MartinPL true, it's fixed with 396.24.02 + DXVK 0.44 but with the latest build from master you'll get the next error:
err:   Required Vulkan extension VK_EXT_vertex_attribute_divisor not supported
err:   Required Vulkan extension VK_KHR_maintenance2 not supported
err:   DxvkAdapter: Failed to create device
err:   D3D11CoreCreateDevice: Failed to create DXGI device

@Zeioth Is that advice for me or OP?
Because i can run Witcher 3 and Gta 5 with DXVK 0.54 and it doesn't need that workaround.
Only problem is Skyrim SE which game boots but can't get past loading screen either with new game option or using a previous save.

@Zeioth current master requires the winevulkan updates from Wine 3.10.
Similarly, using the old Nvidia shader compiler is probably not going to work because I removed the workarounds for it. I'm kind of hoping that they get a new stable driver out of the door soon which contains the necessary Vulkan fixes, until then it's either using 396.24.02 or sticking to DXVK v0.54.

doitsujin as usual, you are right, thank you.

"Although Skyrim SE is not working for me. Even with Lutris DXVK."
Like Fallout4 you need a custom fix for skyrimse otherwise you will get a black screen on launch, there may be ini workarounds like disabling intro videos but I couldn't get them to work.
If your using AMD gpu then you could use glorious eggroll wine edition (arch build). I spin my own collection of patches however, arch is life!

@jarrard
I installed it on a complete new prefix also , like i did with Gta 5 and Witcher 3.
By intro video , you mean animations at loading screens? That is where game hangs , animations keep playing but when i look at the at the HDD led on my laptop ; there is zero activity. It should load files but looks like something is blocking it.
Drive is EXT4 btw. I'm on Nvidia Gpu with 396.24.02 driver , using Nvidia Prime.

To jump in back for Skyrim SE: It's properly working here. But you're going to need two DLL overrides to native: Set xaudio2_7 and dsound to "native,builtin". Also, I experienced such problems when using custom Xbox controller wrappers/remappers. Don't use them. Wine has great support for it since SDL was integrated into winebus.sys. Set the games to use builtin for all xinput DLL variants.
There's a chance that one of my cherry-picks makes a difference for Skyrim SE:
https://github.com/kakra/wine/tree/patches-3.10/wined3d
(there are a few other branches, consider it as it is: these are no scientific cherry-picks)

Okay, this is fixed now thanks to @Zeioth, putting the export into my PoL startup script fixed the issue. There seem only very very minor rendering issues left which can be seen as black triangles. Here's an example but I also saw them around Ard Skellige along the mountain sides in the distance:
https://youtu.be/F1e-0MDSYg8
I think this can be closed when all parts come together: Updated NVIDIA drivers and updated DXVK. I expect I can remove the export again by then.
Thanks to all for figuring this out so fast.

@kakra Despite adding xaudio2_7 and dsound i still can't past that screen. Background music started to play though.
Either something is very wrong with my system or your cherry picks are doing a trick on there.
BTW , game also has same issue on plain Wine Staging to. 3.10 and 3.9 was the tested ones.
Glad that your Witcher problem solved btw.

@Leopard1907 I'm using vanilla wine with only my patch series applied. You can checkout the different branches (versioned against vanilla wine, one for each category) and create a single patch from it with "git format-patch --stdout wine-3.xx" against the wine base version. Then either apply them to your source tree (but then you could also merge and rebase), or put those patches into your distribution package manager and let it rebuild wine from sources. That's how I do it in Gentoo and why I've chosen that workflow.

Sounds like this can be closed.


Does not function with Django 3.0

I am using the latest version on PyPi (0.2.2) with Django 3.0.9 and Python 3.8.5.
In the latest Django the 'url' function is replaced by 'path', so my urls.py looks as follows,
urlpatterns = [
    path('admin/', admin.site.urls),
    path('plate/', include('django_spaghetti.urls')),
]

When I go to plate/ on my webserver, I get the following error,
Internal Server Error: /plate/
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/django/core/handlers/exception.py", line 34, in inner
    response = get_response(request)
  File "/usr/local/lib/python3.8/site-packages/django/core/handlers/base.py", line 115, in _get_response
    response = self.process_exception_by_middleware(e, request)
  File "/usr/local/lib/python3.8/site-packages/django/core/handlers/base.py", line 113, in _get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/usr/local/lib/python3.8/site-packages/django/views/generic/base.py", line 71, in view
    return self.dispatch(request, *args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/django/views/generic/base.py", line 97, in dispatch
    return handler(request, *args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/django_spaghetti/views.py", line 40, in get
    return self.plate()
  File "/usr/local/lib/python3.8/site-packages/django_spaghetti/views.py", line 85, in plate
    if f.rel is not None:
AttributeError: 'AutoField' object has no attribute 'rel'
[06/Aug/2020 22:35:31] "GET /plate/ HTTP/1.1" 500 81752

Is this a configuration issue, or a bug? Does this package get updated on PyPi when there are updates? I am using this with Docker, so being able to access via pip is great.
Thanks!

Thanks for reporting this @matthew-nm I'll have a look this weekend.

@matthew-nm
Hope you have figured out the solution. I had encounter the same problem and I managed it by pip installing directly from the master branch of this github:
pip install https://github.com/LegoStormtroopr/django-spaghetti-and-meatballs/archive/master.zip

Version 0.3.0 is now on PyPI 🤯

Thanks everyone for prodding me about this


Calibrate tax rates for IDN

For this, we'll need to update

[x] Consumption tax rates, tau_c
[x] Corporate income tax rate, cit_rate
[x] Personal income taxes(including pension contributions) (assume linear tax functions if we can't find taxes by income group)

[x]  Effective tax rates, etr_params
[x] Marginal tax rates on capital and labor income, mtrx_params and mtry_params

Resolved with PR #12.  But only linear taxes are imposed on households.  Data that would allow for estimating progressive tax functions would add a lot of value.


avoid GDAL from ubuntugis, remove sen2cor binary after installation

We tried to reduce the size of the docker image. It is not necessary to install Python and GDAL from UbuntuGIS since both is included in the standalone installer of Sen2Cor. Additionally we remove the installer after installation. The resulting image size is 720MB.

Hi hjeakel,
Thank you  for you continuous contributions to this repo.

Its me who has to thank you.


This should fix issue #28 (day of year code giving inconsistent values)

Fixed by using day-of-year package to get the day.
Issue #28

This looks great, thanks for pointing that out.

  Glad it helped


Homebrew no longer works on Mac OS Jobs

Describe the bug
I have the build job
name: CI (Coq, MacOS)

on:
  push:
  pull_request:
  schedule:
    - cron: '0 0 1 * *'

jobs:
  build:

    runs-on: macos-latest

    env:
      NJOBS: "2"
      COQ_VERSION: "master"

    # initial steps copied from https://github.com/coq/coq/blob/cfc41cb79e2364f19d97e7e5c94262132972b0b2/azure-pipelines.yml#L41-L110
    steps:
    - name: Install system dependencies
      run: |
        set -e
        brew update
        (cd $(brew --repository)/Library/Taps/homebrew/homebrew-core/ && git fetch --shallow-since=${HBCORE_DATE} && git checkout ${HBCORE_REF})
        brew install gnu-time opam pkg-config gtksourceview3 adwaita-icon-theme
        pip3 install macpack
      env:
        HOMEBREW_NO_AUTO_UPDATE: "1"
        HBCORE_DATE: "2019-09-03"
        HBCORE_REF: "44ee64cf4b9f2d2bf000758d356db0c77425e42e"

I get the error
==> Installing adwaita-icon-theme
==> Pouring adwaita-icon-theme-3.32.0.mojave.bottle.tar.gz
🍺  /usr/local/Cellar/adwaita-icon-theme/3.32.0: 5,827 files, 22.6MB
Error<EMAIL_ADDRESS>is not a valid keg

See https://github.com/mit-plv/fiat-crypto/runs/846886316
Area for Triage: Apple
Question, Bug, or Feature?:
Bug
Virtual environments affected

[x] macOS 10.15

Expected behavior
It was working fine before without errors, but it started failing within the past couple of days.
Actual behavior
https://github.com/mit-plv/fiat-crypto/runs/846886316

Hi @JasonGross !
I've checked previous build from columns-base-conversion branch and it use the same image version - 20200625.2, as failed one, but step Install system dependencies execute successfully, which mean they both were executed on the same image, with the same set of software.
Is there possibility that there is issue with some internal dependencies in your project?

Agree with @vmapetr , that is definitely not the image issue.
Minimal steps to reproduce:
It will fail:
brew update
(cd $(brew --repository)/Library/Taps/homebrew/homebrew-core/ && git fetch --shallow-since=2019-09-03 && git checkout 44ee64cf4b9f2d2bf000758d356db0c77425e42e)
brew install adwaita-icon-theme

It will pass:
brew update
brew install adwaita-icon-theme

Since you point to the old version of formula, probably some dependencies of adwaita-icon-theme are not valid anymore. I believe it is better to ask on forum related to this formula

Closing the issue since it is not related to image.
Please let me know if you have any objections


Overlay Background color on map - make the map unclickable

Summary
i am trying to set a dark background color on the map as overlay
the problem is when doing so - the hole map becomes unclickable.
i need to implement a logic that by default the map is without the dark background, and if the user click on one of the markers/polygons that on the map - a dark overlay will be set on the map, except the selected marker/polygon.
i also tried to play with the zindex property, and to set the OverlayComponent at the top of the map, or at the bootom, or  after the markers or before - not helped me, the map was still unclickable
any ideas ?
Reproducible sample code
import {
  View,
} from "react-native";
import MapView from "react-native-maps";

const Map = () => {
  const {markers, polygons} = useMapStore()

  const OverlayComponent = () => (
    <View
      style={{
        position: 'absolute',
        top:0,
        right: 0,
       height: '100%',
        width: '100%',
        opacity: 0.5,
        zIndex: 1,
        backgroundColor: 'rgba(0,0,0,0.8)',
      }}
    >
    </View>
  );

  return (

<MapView
      region={region}
      style={{
zIndex: 1,
flex:1
}}
<MapMarkers markers={markers} />
<MapPolygons polygons={polygons} />

 <OverlayComponent />
)

}

Steps to reproduce
create a simple map with markers or polygons on it, and set a View element with background color an a position absolute property
Expected result
the expected result will be to set a background color overlay on the map, and still be able to click on item on the map
Actual result
the map not respond when click on it
React Native Maps Version
0.30.1
What platforms are you seeing the problem on?
Android, iOS (Google Maps)
React Native Version
0.66.4
What version of Expo are you using?
Not using Expo
Device(s)
iphone, android
Additional information
No response

Happens to me too, would like to see a solution


Layer Mask within Layer Group affects scaling on export

Working on a project for iOS, the developer let me know that one of my images wasn't half of the @2x image. After some tinkering I found an offending layer mask within the layer set (even if the layer and layer mask are not visible), when this layer mask is deleted the image exported and scaled correctly. Another workaround is creating a mask on the parent layer set that I'm exporting and then it will export/scale correctly.
The two layers sets I'm comparing create identically sized @2x assets but different sized 50% scaled assets.
I can send the PSD for someone to examine the potential issue, thanks!

@chadrolfs  Im not seeing this in the current build. I can send you the test file if that works best

Yep, I'm not seeing this either and the related/similar issue (40) has been closed.  Closing this as well as resolved


copyEnv hack is problematic and bleeds other information to the arrays

Release v1.1 have fixed the compatibity with MathJax 2.7.1 but in a very hacky way.
A better solution is to use David's suggestion.

Closing as the repo is mostly abanoned. Head over https://github.com/OmarIthawi/arabic-mathjax for the maintained fork of this extension.


Frappé Gantt only supports usage of a string CSS selector, HTML DOM element or SVG DOM element for the 'element' parameter

I create an element by the instructions of the repo:
<svg id="gantt"></svg>

But get the error: Frappé Gantt only supports usage of a string CSS selector, HTML DOM element or SVG DOM element for the 'element' parameter.
How can I fix it?

How did you fix this I am having the same error?

@henryhu712 how did you fix this issue?

You should use gantt grawing function inside the DOMContentLoaded eventlistener. It works for me.
`


Fix RefreshToken endpoint exception

"IDX10223: Lifetime validation failed. The token is expired."

https://stackoverflow.com/questions/47711983/jwtsecuritytoken-returning-wrong-expiration-time


Health Drain

Describe your problem here.
How do I make the health drain snowly like in the Bob's Onslaught heres the code what do I do?
function onCreate()
	--Iterate over all notes
	for i = 0, getProperty('unspawnNotes.length')-1 do
		--Check if the note is an Instakill Note
		if getPropertyFromGroup('unspawnNotes', i, 'noteType') == 'Drain Note' then
			setPropertyFromGroup('unspawnNotes', i, 'texture', 'NOTEDrain'); --Change texture
			setPropertyFromGroup('unspawnNotes', i, 'noteSplashTexture', 'DrainNOTESplash')
			if getPropertyFromGroup('unspawnNotes', i, 'mustPress') then --Doesn't let Dad/Opponent notes get ignored
				setPropertyFromGroup('unspawnNotes', i, 'ignoreNote', true); --Miss has no penalties
			end
		end
	end
	--debugPrint('Script started!')
end

-- Function called when you hit a note (after note hit calculations)
-- id: The note member id, you can get whatever variable you want from this note, example: "getPropertyFromGroup('notes', id, 'strumTime')"
-- noteData: 0 = Left, 1 = Down, 2 = Up, 3 = Right
-- noteType: The note type string/tag
-- isSustainNote: If it's a hold note, can be either true or false

function goodNoteHit(id, noteData, noteType, isSustainNote)
    dodgeAnimations = {'dodgeLEFT', 'dodgeDOWN', 'dodgeUP', 'dodgeRIGHT'}
    if noteType == 'Drain Note' then
        characterPlayAnim('boyfriend', 'pre-attack', true);
        setProperty('boyfriend.specialAnim', true);

        local animToPlay = 'pre-attack';
        if noteData == 0 then
            animToPlay = 'Slash';
        elseif noteData == 1 then
            animToPlay = 'Slash';
        elseif noteData == 2 then
            animToPlay = 'Slash';
        elseif noteData == 3 then
            animToPlay = 'Slash';
        end
        characterPlayAnim('dad', 'Slash', true);
        setProperty('dad.specialAnim', true);
    end

        if noteType == 'Drain Note' then
            setProperty('health', 0.01);
        end
    end

What do I add?
Are you modding a build from source or with Lua?
Lua
What is your build target?
Windows x64
Did you edit anything in this build? If so, mention or summarize your changes.
I made sprites and i have used some scripts

use a timer that is really short and loops many times

how do I do that exactly?

use a timer that is really short and loops many times

How do I use timers and loops? I'm a noob at coding so can you give me a code to use (You can add it to my code if you need to, to make sure it works)

How do I use timers and loops? I'm a noob at coding so can you give me a code to use (You can add it to my code if you need to, to make sure it works)

I don't know lua very well, I do source code mostly but I can see if the wiki can tell me how

let me know if this works: https://pastebin.com/kXiMS6ML
play around with the healthDrain variable if you think it drains too little/too much


Improve SMTP error given with TLS mismatch

Describe the bug
I just ran into this via office365.  If you use the docs example of SmtpTransport::relay("smtp.office365.com") it fails.  What you need is SmtpTransport::starttls_relay instead.  The error you get from attempting to use relay instead, however, is extremely generic and doesn't suggest anything even close to TLS:
error = lettre::transport::smtp::Error {
    kind: Client,
    source: Error(
        None,
    ),
}

The recently closed #632 would also benefit from this I believe!
To Reproduce
SmtpTransport::relay("smtp.office365.com")
Expected behavior
A more useful error.  Something like
error = lettre::transport::smtp::Error {
    kind: Client,
    source: Error(
        TLS,
    ),
}

Environment (please complete the following information):

0.10.0-rc.3
OpenSUSE Tumbleweed

It seems like the r2d2 connection pool is messing up the error source, because compiling without it instead gives Connection error: Network is unreachable (os error 101), which would be the best we can do here.
SmtpTransport::relay uses a different port from SmtpTransport::starttls_relay, so it's not possible for us to know that trying on a different port would have worked unless we actually tried.


"textDocument/formatting" is not supported for typst_lsp

According to the README, typst_lsp has
https://github.com/nvarner/typst-lsp/blob/0d5b9330a1d515fa47456e755f751ea4056282b8/README.md?plain=1#L10
however, according to my editor, "textDocument/formatting" is not suppoted for typst_lsp. Is the formatting support implemented as something different from "textDocument/formatting"? If so, I think this should be fixed.

(I have experimentalFormatterMode set to string 'on' in my lspconfig. Not sure if that's how it works.)

Have same isue in neovim


CRUD functions by default?

Moor rocks, but I'm missing something, or this is a feature request. It seems like one should get vanilla CRUD functions, maybe along with a .watch() Stream for all tables by default. ActiveRecord has a nice idiom where you can call these (among others) on any instance of any model:
.where()                     (read)
.new({optional params map})  (instantiate)
.create({params map})        (instantiate and save)
.update({params map}
.destroy()

It seems like Moor could (simply?) have something similar where the functions are created as part of the build? Is the current intent that one types each of those functions for each table in database.dart? Instead of a params map, one could pass in a FoosCompanion to get the benefits of that class, but ideally, one would just pass in legal parameters.

We can't really have those methods on the generated model, because from there it's not obvious which database to use for the actual query.
We could add a generateCRUD parameter to @UseMoor and @UseDao that would generate these methods on the database or dao. It could be something like
class MyDatabase extends _$MyDatabase {
  // These methods would be created automatically:
  Selectable<Data1> readTable1([Expression<bool> Function(Table1) predicate]);
  Future<int> newTable1(/*Parameters copied from Table1Companion.insert*/);
  Future<void> updateTable1(Data1 row);
  Future<void> deleteTable1(Data1 row);
}

Is that what you're looking for?

Yes, I think this would be a great addition to the API! I would throw in a watchTable1() too for good measure. Then, the hand-written functions that we define in database.dart can focus on needs that we have beyond basic CRUD.

If you have a "primary" table per dao, you could use something like:
abstract class CrudDao<T extends Table, D extends DataClass,
    DB extends GeneratedDatabase> extends DatabaseAccessor<DB> {
  CrudDao(DB attachedDatabase) : super(attachedDatabase);

  TableInfo<T, D> get primaryTable;

  Selectable<D> selectAll() => select(primaryTable);

  Future<List<D>> listAll() => selectAll().get();
  Stream<List<D>> watchAll() => selectAll().watch();

  Future<int> insertNew(Insertable<D> row) {
    return into(primaryTable).insert(row);
  }

  Future<void> replace(Insertable<D> row) {
    return update(primaryTable).replace(row);
  }
}

Then you could write your daos like this:
@UseDao(tables: [Items])
class ItemsDao extends CrudDao<Items, Item, MyDatabase> {
  class ItemsDao(MyDatabase db): super(db);

  TableInfo<Items, Item> get primaryTable => items;
}

This will give them most of the methods your interested in. I'm considering adding that class to moor (instead of having an option to generate additional methods). It's a bit more cumbersome to use that generated methods and only works if there's a single primary table per dao, but it's much easier to implement and maintain.

I'm probably interpreting something wrong. I declared the CrudDao class verbatim as above, then tested it with one of my tables as follows. This is just as above, but I think that where you have class ItemsDao..., class might be a typo.
@UseDao(tables: [AssessmentTypes])
class AssessmentTypesDao
    extends CrudDao<AssessmentTypes, AssessmentType, MtDatabase> {
  AssessmentTypesDao(MtDatabase db) : super(db);

  TableInfo<AssessmentTypes, AssessmentType> get primaryTable =>
      assessmentTypes;
}

The database builds successfully, but I'm not seeing any sign of the generated methods for the DAO:
// **************************************************************************
// DaoGenerator
// **************************************************************************

mixin _$AssessmentTypesDaoMixin on DatabaseAccessor<MtDatabase> {
  $AssessmentTypesTable get assessmentTypes => attachedDatabase.assessmentTypes;
}

Where am I going wrong? If I get this working, it will save a whole lot of boilerplate!

Right, but AssessmentTypesDao should inherit the right methods from CrudDao? E.g. you could use yourDatabase.assessmentTypesDao.listAll() and get a Future<List<AssessmentType>>.
I forgot to add the mixin though:
@UseDao(tables: [AssessmentTypes])
class AssessmentTypesDao
    extends CrudDao<AssessmentTypes, AssessmentType, MtDatabase>
    with _$AssessmentTypesDaoMixin {

Right of course, it has those methods by instantiating the abstract class. Thank you.

All of my tables use an auto-incrementing id primary key.  Can I access that column in the abstract class even though the getter isn't defined for Table? I would need that for the "R" in CRUD, I think.
(btw, I would just test that, but I'm in the middle of overhauling the whole data model for this app. If only Dart had a REPL :))

Can I access that column in the abstract class even though the getter isn't defined for Table?

You can use primaryTable.columnsByName['id'] as Expression<int>.

Sorry, hopefully almost done here. Under the gun so asking: how do I use that, specifically within the abstract class? Tried defining a getter, substituting it for t.id,...

Sure! You can use it like this:
  Future<D> find(int id) {
    final idColumn = primaryTable.columnsByName['id'] as Expression<int>;
    return (select(primaryTable)..where((_) => idColumn.equals(id))).getSingle();
  }

It works! Thanks so much for considering this feature and getting this test implementation going! If you do decide to fold it into the package, the final win would be to obviate this small boilerplate that is currently needed to get a CRUD DAO for a given model. My knowledge isn't deep enough to know if that's do-able or not.
@UseDao(tables: [ValueTypes])
class ValueTypesDao extends CrudDao<ValueTypes, ValueType, MtDatabase>
    with _$ValueTypesDaoMixin {
  ValueTypesDao(MtDatabase db) : super(db);
  TableInfo<ValueTypes, ValueType> get primaryTable => valueTypes;
}

@UseDao(tables: [QuestionInterfaces])
class QuestionInterfacesDao
    extends CrudDao<QuestionInterfaces, QuestionInterface, MtDatabase>
    with _$QuestionInterfacesDaoMixin {
  QuestionInterfacesDao(MtDatabase db) : super(db);
  TableInfo<QuestionInterfaces, QuestionInterface> get primaryTable =>
      questionInterfaces;
}

@UseDao(tables: [Measurements])
class MeasurementsDao extends CrudDao<Measurements, Measurement, MtDatabase>
    with _$MeasurementsDaoMixin {
  MeasurementsDao(MtDatabase db) : super(db);
  TableInfo<Measurements, Measurement> get primaryTable => measurements;
}

Manager API added this


cpplint:   build/include_what_you_use

Hmm, this adds a lot of unnecessary lines. What do you think about this one? I'm 50/50 on it.

I didn't think it made much sense at first. But halfway through, I think it's worth it. We don't have to guess where the relevant header files are, "Do not rely on transitive inclusions" is a good style (https://google.github.io/styleguide/cppguide.html#Include_What_You_Use)
I've also added some comments to make include a little clearer:
#include <algorithm>  // for sort
#include <utility>  // for pair<>

Sounds good, but let's skip the comments. There's nothing enforcing the comments stay up to date.

In addition, after adding this filter, we can safely delete many unused includes


Remove old feature toggles

PR Description
Removing old hidden options, which don't need feature toggling since they are part of the official spec and have been tested for a long time.

--Xfork-choice-proposer-boost-enabled
--Xfork-choice-equivocating-indices-enabled

Fixed Issue(s)
fixes #5965
Documentation

[X] I thought about documentation and added the doc-change-required label to this PR if updates are required.

Changelog

[X] I thought about adding a changelog entry, and added one if I deemed necessary.

Was Looking Good To Me but I'd like to take another look tomorrow morning before approving


Show cursor shape in SUI

Summary of the Pull Request
Show the cursor shape next to the text for it
TODO: Not too happy with the empty box icon being a different size, gotta fix that

References
#8764

PR Checklist

[ ] Closes #xxx
[x] CLA signed. If not, go over here and sign the CLA
[ ] Tests added/passed
[ ] Documentation updated. If checked, please file a pull request on our docs repo and link it here: #xxx
[ ] Schema updated.
[x] I work here

Validation Steps Performed

If you implement the console preview display, this too could display the chosen cursor shape, colour, and blink rate (whatever settings you include for the cursor)

If you implement the console preview display, this too could display the chosen cursor shape, colour, and blink rate (whatever settings you include for the cursor)

If you implement the console preview display, this too could display the chosen cursor shape, colour, and blink rate (whatever settings you include for the cursor)

Yup! Unfortunately, I don't think we have enough time to add the terminal preview for v1.6. But it's a very exciting feature for v1.7 😀

If you implement the console preview display, this too could display the chosen cursor shape, colour, and blink rate (whatever settings you include for the cursor)

Yup! Unfortunately, I don't think we have enough time to add the terminal preview for v1.6. But it's a very exciting feature for v1.7 😀

I'm kinda shocked that these blocks are different widths. I would've figured they're the same width, one narrow character.
Oh maybe if you make the font for just the run with the cursor a monospaced font, they'd be narrow?

I'm kinda shocked that these blocks are different widths. I would've figured they're the same width, one narrow character.
Oh maybe if you make the font for just the run with the cursor a monospaced font, they'd be narrow?

That would require there to be multiple Runs eh

That would require there to be multiple Runs eh

@msftbot merge this in 12 hours

@msftbot merge this in 12 hours


Compilation fails

README says that I can use verilator 4.102 and higher:
I'm using verilator 4.210  and getting following:
make -f $RV_ROOT/tools/Makefile verilator-build
%Error: Unknown warning specified: -Wno-IMPLICITSTATIC... Suggested alternative: '-Wno-IMPLICIT'
make: *** [verilator-build] Error 1

Hi. Your version is supported indeed but requires a different commandline flag(s). I updated the Makefile to detect version automatically and use correct flags in each case. Please take a look: https://github.com/chipsalliance/Cores-VeeR-EL2/pull/135

How do verilator version earlier than 5.000 work with latest UVM TB additions to this data base?

UVM-based tests currently use Verilator from a branch which hasn't been merged upstream yet. See https://github.com/antmicro/Cores-VeeR-EL2/blob/mkurc/gh-133/.github/workflows/build-verilator.yml#L16-L18


Patch release/2.4.2

arrow functions for endpoints instead of class methods

:tada: This PR is included in version 2.4.1 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


🐛 Fix broken dependency

What do these changes do?

Ensure we use an older version of Papermill for running our notebooks. Once the newest version of papermill has been fixed we should relax the dependency.
I files a bugreport on Papermill's github site.

Related issue/s

How to test

For internal developers

Makes sense.
Should we maybe link here the papermill issue?

Makes sense. Should we maybe link here the papermill issue?

Yep, good point: https://github.com/nteract/papermill/issues/735


Translator seemingly becomes unequippable after picking up/putting down too many objects

Game Version: Latest (Steam Build ID 7584343)
OWML Version: 2.2.0
NomaiVR Version: 2.4.2
VR hardware: Samsung Odyssey+ (Windows Mixed Reality)
I was on the Quantum Moon during my first playthrough, spending longer than I think the devs might've intended picking up/putting down picture tiles, when I suddenly became completely unable to pick up my translator with either hand. Both other tools were still equippable at the time. Meditating until the next loop seemed to fix the bug, from then on I was able to use my translator in the same location without issues.
Here's a video of it happening, including (I think) the relevant steps that led up to it and its resolution. The bug itself occurs after 7 minutes in: https://www.youtube.com/watch?v=RZNNT1s_ex8

This is quite an elusive bug that we are having trouble reproducing but we know it's there under certain circumstances.
In the video I also see that prompts for WMR controllers have the wrong icons, do you mind enabling "Debug mode" under the mod settings and sending us a log of a playthrough with it enabled so we can at least start by fixing those? 😃

Log attached; I wasn't sure how much of a playthrough was necessary, but I did a little over a single-loop session where I engaged with nearly all of the player verbs I could think of, going through the 6DOF tutorial and cleaning up log info around Brittle Hollow. I'm a big fan of this project, so let me know if you need anything else.
OWML.Log.06-12-2021-04.35.27.txt


Manually flush trigger

Current the flush will only be scheduled when memory threshold reached. It's a completely internal operation. This ticket request an external public interface to force flush a table or a region.
The requested API is helpful when

Testing behaviors related to flush
Scheduling a table (close in one instance and open in another one)

I dig around, found this function:
https://github.com/GreptimeTeam/greptimedb/blob/57979c9d3dba13beef5d63b4dc73fa1b3281e7e6/src/storage/src/flush.rs#L37
Should we add a new  FlushStrategy like EventBasedStrategy which holding a channel receiver be good?
And this strategy also can be composed with SizeBasedStragety.

Glad you are interested!

found this function

Yes, in the write process we will check should_flush every time before writing. This is an async way to implement (if no write request then the flush event won't be executed neither). And I'm also wondering to exposing an active (sync) interface on RegionWriter to perform flush without depends on write request. Both active and passive manners are useful.
But consider the maybe use-case of the passive way, looks like FlushSwitch is able to cover the unit-test scenario. If we have EventBasedStrategy in the non-test path, a problem is where to put the tx of this strategy? So in my perspective we should implement the active way first.

Done in #1184


Create unit test for PastebinURLAnalyzer

The current implementation of the PastebinURLAnalyzer did not get any unit tests yet. This should change now.
To resolve this task you need to create a new unit test file in the tests directory named pastebinurlanalyzer_test.py.
In this file implement at least 5 positive and 5 negative tests. The more the better!
Make sure to test tricky combinations. Unit tests should really be testing code to its limits.
PS: It's okay when tests make the build fail because the code is faulty! (It's not okay if tests fail for no valid reason)

I can take this up

There is no start.py? Was wondering how to run the project

You would need to copy the example.py from the examples directory. But that will only work when you got a pastebin pro account.
Better to run the unit tests independently with python -m unittest discover -s . -v -p "*_test.py"

Just to be clear is www.pastebin.com/something or pastebin.com/something considered a valid pastebin url?

Since there were no unit tests yet it is possible that the current implementation is broken or faulty.
Only pastebin.com/something with http and https prefixed is a valid url.
It is okay when tests fail because of coding errors in pastepwn. That's what tests are for right? :blush:

Fixed in 88abf882aecb1e5c1a92ea4d9b868d02d37de687


Running 'brew --config' reports "no git repository"

I've run: cd "$(brew --repo)" && git fetch && git reset --hard origin/master && brew update, and:

[x] Ran brew update
[x] Ran brew doctor

But I when I run brew --config I get
HOMEBREW_VERSION: >1.0.0 (no git repository)
...

HOMEBREW_VERSION: >1.0.0 (no git repository)
ORIGIN: https://github.com/Homebrew/brew.git
HEAD: 889c400be4ba7803b7dcf402b00279a21ae80c97
Last commit: 51 minutes ago
Core tap ORIGIN: https://github.com/Homebrew/homebrew-core
Core tap HEAD: 7b6f42699b965a9f44d35de97e97ce2464799e25
Core tap last commit: 2 hours ago
HOMEBREW_PREFIX: /usr/local
HOMEBREW_REPOSITORY: /usr/local/Homebrew
HOMEBREW_CELLAR: /usr/local/Cellar
HOMEBREW_BOTTLE_DOMAIN: https://homebrew.bintray.com
CPU: quad-core 64-bit haswell
Homebrew Ruby: 2.0.0-p648
Clang: 8.0 build 800
Git: 2.10.0 => /usr/local/bin/git
Perl: /usr/bin/perl
Python: /usr/local/bin/python => /usr/local/Cellar/python/2.7.12/Frameworks/Python.framework/Versions/2.7/bin/python2.7
Ruby: /usr/local/bin/ruby => /usr/local/Cellar/ruby/2.3.1/bin/ruby
Java: 1.8.0_102
macOS: 10.12-x86_64
Xcode: 8.0
CLT: N/A
X11: 2.7.9 => /opt/X11

This is a known issue and will be fixed soon. Your Homebrew installation is fine.

Fixed by #1090 actually.

Fixed by https://github.com/Homebrew/brew/commit/5af52410abbc2a93fbaf57fc7d8637ed5eaa469f. brew update.


Weird Gap in Cover images

Bug Description
After copying the screenshot settings I am getting weird gaps in the Cover Images
To Reproduce
No response
Extensions log
extensions.log
Screenshots

The reason is that the covers of those games don't match the aspect ratio you have configured in Settings -> Grid View. You need to download different ones or change the stretch mode here to Uniform to Fill but I don't recommend that.


corrected parsing for real invoices and added another test

 Logiciel de facturation

@michelraymond looks good, thanks !


full width homepage

Content goes full width, and also fetches 1.5 times the number of results on large screens.

Can't wait for this... <3


Moving SRAM docs from gf180mcu-pdk

Fixes #https://github.com/google/gf180mcu-pdk/issues/11

Moved all documentations in docs directory.

Made symbolic link for it in gf180mcu-pdk

[x] Built locally with no errors

I have reworked this pull request slightly. I move the specs to a specs directory under each cell. See the commit at https://github.com/google/globalfoundries-pdk-ip-gf180mcu_fd_ip_sram/commit/894afa53abe42b2cad8ce9460dc7b4c0ec43fc44

@mohanad0mohamed - I have updated this pull request for you.

Thanks @mithro. I was going to do the same but I didn't know that I can put directories inside each cell.
I thought this shouldn't happen so I made them in docs directory.

I have moved code_of_conduct.rst and contributing.rst outside docs not to produce warnings. Also edited README.rst to change 180um to 180nm.

I have moved code_of_conduct.rst and contributing.rst outside docs not to produce warnings. Also edited README.rst to change 180um to 180nm.

Two comments;

Please keep pull requests to a single item.
We should fix the warnings from these docs, not remove the docs all together.

@mohanad0mohamed - I have removed the non-moving SRAM docs changes from this pull request.


Unnecessary offset request in segment commit flow causes instability and ingestion lag

I believe this issue originates here, https://github.com/apache/pinot/blob/a5b3483a838839e606b251f2bb6e0d0b22f75a93/pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/realtime/PinotLLCRealtimeSegmentManager.java#L533. When committing segments, the controller also sets up the new segments. It requests the new partition group metadata to see if there's any new partitions that need to be consumed from.
This eventually calls computePartitionGroupMetadata which also fetches the offsets for all partitions. In our case, we have thousands of of partitions, and sometimes this call just fails because kafka times out or returns an error. In our case, we see ~10-20 minutes of ingestion lag until the segment commit is retried.
The code itself doesn't even need the offsets, it just needs the partition count and the partition group ids. But it would be great if someone could double check me there.
Initially I can think of 2 backwards compatible solutions:

use the existing fetchPartitionCount to get the partition count. add a new method to StreamMetadataProvider to fetch just the partitionIds. It can default to using computePartitionGroupMetadata, and we can override it in our own class
add a new computePartitionGroupMetadata function that takes a withOffsets boolean to determine the behavior.

I'm leaning towards the former since it's a more explicit solution.

cc @Jackie-Jiang

This may be contributing to the slow force commit behaviour we noticed and end up filing tickets for.  We did note the calls to get offset info, but didnt end up looking further among the other things we tried to look into (table level locking in the commit protocol)

Good catch! I believe we should be able to refactor the code and only read the partition count.
Curious on how you find this hotspot? Do you see this method showing up in the profile?

Curious on how you find this hotspot? Do you see this method showing up in the profile?

Didn't need a profile. This times out after 25 seconds for us and causes ingestion to pause. I traced it back from the stack trace

@Jackie-Jiang, I've confirmed that every force commit causes an offset request from Pinot->Kafka. For a table with hundreds of consuming segments, this caused hundreds of offset requests.
Another potential issue I see is this table experienced ~2 minutes of ingestion lag between requesting the force commit and the force commit completing. I haven't looked at the code yet, but should we do these commits in batches? Meaning, should we only tell a segment to commit once a previous one has completed to avoid lag while waiting for other work to complete?

Another potential issue I see is this table experienced ~2 minutes of ingestion lag between requesting the force commit and the force commit completing. I haven't looked at the code yet, but should we do these commits in batches? Meaning, should we only tell a segment to commit once a previous one has completed to avoid lag while waiting for other work to complete?

After requesting the force commit, server needs to seal the current consuming segment and commit it, which can explain the ~2 minutes lag.

Is sealing expected to take that long?
On Fri, Oct 20, 2023, 5:21 p.m. Xiaotian (Jackie) Jiang <
@.***> wrote:

Another potential issue I see is this table experienced ~2 minutes of
ingestion lag between requesting the force commit and the force commit
completing. I haven't looked at the code yet, but should we do these
commits in batches? Meaning, should we only tell a segment to commit once a
previous one has completed to avoid lag while waiting for other work to
complete?
After requesting the force commit, server needs to seal the current
consuming segment and commit it, which can explain the ~2 minutes lag.
—
Reply to this email directly, view it on GitHub
https://github.com/apache/pinot/issues/11812#issuecomment-1773410261,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ACOCX4ABVQCRGZ3EYD2LZRTYALTNPAVCNFSM6AAAAAA6CNGIGSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTONZTGQYTAMRWGE
.
You are receiving this because you commented.Message ID:
@.***>

@priyen It depends. You may check the time spent during regular segment commit

Another potential issue I see is this table experienced ~2 minutes of ingestion lag between requesting the force commit and the force commit completing

This consumption lag is table wide after force-commit is issued. https://github.com/apache/pinot/issues/11950 proposes to stagger committing different partitions over longer period of time so that you can control how you want to experience the consumption lag: all at once (current behavior) or spread over longer period of time.


Unexpected URL matching when quotes are involved

{"url":"http://www.blah.com/","hello":"world"}

URL text match is http://www.blah.com/","hello":"world but the href is http://www.blah.com/ (as it should be).
(tested here: http://markdown-it.github.io/linkify-it/)

If you add space after , it will work properly. I don't think it worth to care much about any machine-generated strings. This package is for links in human-readable texts.

Look what happens after your sample is formatted to more human-friendly form:
http://markdown-it.github.io/linkify-it/#t1={ "url"%3A"http%3A%2F%2Fwww.blah.com%2F"%2C "hello"%3A"world" }
What do you think? I tend to close.

@puzrin generally you're right on JSON; I still think it's a bug, with (uncommon) strings like
http://www.blah.com/"abc"

If " cannot be a part of a link, it should stop matching.
The href doesn't match what's highlighted because it's being closed by a quote and the rest becomes an attribute which is unsafe. So that should probably be escaped.
http://www.blah.com/"abc"

Human readable strings are the correct target, until someone tries to inject XSS 🤔

" CAN be a part of link sometime: http://foo.com/blah_blah_"doublequoted". That's true for some wiki links and so on. See examples in demo.

http://markdown-it.github.io/linkify-it/#t1=http%3A%2F%2Fwww.blah.com%2F"onmouseover%3Dalert(1)%2F%2F"

That's a serious XSS 😢

Looks like escaping problem in markdown, not in this package. Thanks for report.

Ahh... wrong alarm. Everything is fine with markdown: demo
This example works ONLY in linkify-it demo, because nobody cares there about security - demo was done quick and dirty to visualize how linkify-it works. That does not affect package security anyhow.
So, let's return to first post - i thing there are no easy way to understand ton formatted JSON. " can happen in wiki links. I think issue can be closed as "artificial".

any thought? I tend to close as "not a bug"

As long as it's not a parsing problem and quotes are allowed in URLs, it's indeed not a bug because the string I posted couldn't be parsed otherwise.


Add description

ELICIT is a novel knowledge organization system that integrates concepts of causality, factual knowledge and meta-reasoning into a model-driven knowledge graph representation to provide situational awareness--especially of causal factors and relationships between them--to planners faced with complex operational environments.
ELICIT can create structured knowledge out of (and across) both structured sources (e.g. tables, spreadsheets, databases) and unstructured text sources (e.g. newswire, discussion forums, military reports). The ELICIT knowledge graph contains entities (person, organizations, etc.) and events (attacks, mergers, policy agreements, etc.) as well as links between them, all automatically derived from the input source data.
The ELICIT knowledge graph further contains causal factors and causal links between those factors. ELICIT discovers these in both structured and unstructured data, both from individual sources (e.g. the attack led to further protests) as well as across sources (e.g. by detecting a quantitative relationships between a time series of attacks extracted from many documents and a time series of protests extracted from a database). In the larger scope of the DARPA Causal Exploration program, these causal factors and links serve as input to causal models that help planners explore the possible impact of their actions on their operational environments.


#2428 - Camunda retry intervals (Timers)

Updated the time events necessary values to PT12H

assessment-gateway.bpmn: "verify-application-exceptions-retry-timer"
assessment-gateway.bpmn: "program-info-request-timer"
assessment-gateway.bpmn: "verify-assessment-calculation-timer"
income-verification.bpmn: "cra-income-verified-timer"
supporting-user-information-request.bpmn: "supporting-user-info-received-timer"

Nice work @lewischen-aot 👍One minor comment