Permission denied [Errno 13] when using source_distribution_plugin

Hi,
I'm getting the following error:
[DEBUG] Executing subtask of 'build_source_distribution' from 'pybuilder.plugins.source_distribution_plugin'
[INFO]  Building source distribution in /mnt/c/Projects/integrationfilemanagement/lambdas/authenticator/target/dist/ifm_authenticator-1.0.dev0-src
Traceback (most recent call last):
  File "/home/jenkins/.local/lib/python3.10/site-packages/pybuilder/cli.py", line 506, in main
    summary = reactor.build(
  File "/home/jenkins/.local/lib/python3.10/site-packages/pybuilder/reactor.py", line 234, in build
    execution_summary = self.build_execution_plan(tasks, execution_plan)
  File "/home/jenkins/.local/lib/python3.10/site-packages/pybuilder/reactor.py", line 271, in build_execution_plan
    task_execution_summaries = self.execution_manager.execute_execution_plan(
  File "/home/jenkins/.local/lib/python3.10/site-packages/pybuilder/execution.py", line 393, in execute_execution_plan
    summaries.append(self.execute_task(task, **kwargs))
  File "/home/jenkins/.local/lib/python3.10/site-packages/pybuilder/execution.py", line 340, in execute_task
    task.execute(self.logger, kwargs, _executable=_executable)
  File "/home/jenkins/.local/lib/python3.10/site-packages/pybuilder/execution.py", line 179, in execute
    executable.execute(argument_dict)
  File "/home/jenkins/.local/lib/python3.10/site-packages/pybuilder/execution.py", line 95, in execute
    self.callable(*arguments)
  File "/home/jenkins/.local/lib/python3.10/site-packages/pybuilder/plugins/source_distribution_plugin.py", line 48, in build_source_distribution
    shutil.copytree(project.basedir,
  File "/usr/local/lib/python3.10/shutil.py", line 559, in copytree
    return _copytree(entries=entries, src=src, dst=dst, symlinks=symlinks,
  File "/usr/local/lib/python3.10/shutil.py", line 513, in _copytree
    raise Error(errors)
shutil.Error: [('/mnt/c/Projects/integrationfilemanagement/lambdas/authenticator', '/mnt/c/Projects/integrationfilemanagement/lambdas/authenticator/target/dist/ifm_authenticator-1.0.dev0-src', "[Errno 13] Permission denied: '/mnt/c/Projects/integrationfilemanagement/lambdas/authenticator/target/dist/ifm_authenticator-1.0.dev0-src'")]
------------------------------------------------------------
BUILD FAILED - Error: [('/mnt/c/Projects/integrationfilemanagement/lambdas/authenticator', '/mnt/c/Projects/integrationfilemanagement/lambdas/authenticator/target/dist/ifm_authenticator-1.0.dev0-src', "[Errno 13] Permission denied: '/mnt/c/Projects/integrationfilemanagement/lambdas/authenticator/target/dist/ifm_authenticator-1.0.dev0-src'")] (shutil.py:513)
------------------------------------------------------------

What might be a problem?
I'm running everything in WSL against a folder which is mounted to it from the host Windows system.

Even it fails on this command the files i'm expecting to be copied do get copied and the target folder does get created.

i'm not sure what's happening here because clean works fine and can totally delete those folders.

Could be symlinks? Could be setting permissions? Not sure either, but it doesn't look like a PyB problem, more like WSL quirks.

I actually checked permissions on the parent folder.
There were 'write' missing and I added them.
What would be to check about symlinks?

i ran WSL as an admin.
it worked.
i will close the issue 4 now.
but maybe u can still comment about symlinks...
is there a way to disable following them? tho i don't have them in my project folder...

Could also be copying file attributes and failing to set those. I don't know the permissioning model of WLS with respect to Windows mounts so I was just spitballing here about all the possible failures.

Okay. Let's say 'running as admin' is a solution for WSL-based builds.


Use of AppLogo from network

Hello !
Is it possible to use an -AppLogo from the network ?
For example:
\np1\Users\Public\image-notif.gif
It doesn't seems to work ... how can I do that ?
Thanks

Just had a look, and can reproduce this issue... will dive in and see if I can make this work on the next release.

It looks like the same sort of problem as with URIs to online images where the documentation says it works... but it doesn't.
I plan to put a work around in as before to copy the image from the network path to the local temp directory.

This will be out in v0.7.0... soon(tm)


fix hostname filter

hostname filter was broken if a scheme was not present.
uses a  modified version of the regex found at
http://www.ietf.org/rfc/rfc3986.txt appendix B
fixes #415
@grobie @juliusv

ignore


geofence-geojson: Grammar improvements. Increased Acrolinx score from 82 to 100.

Per prior arrangement, if this PR needs approval, or if the commits need to be pulled into the private repo -- and while @eriklindeman is OOF April 10-17 -- only @FarazGIS should be notified. Thanks.

@FarazGIS
IMPORTANT: When the changes are ready for publication, add a #sign-off comment to signal that the PR is ready for the review team to merge.
#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

@sign-off


Some false positives I found

face-recognition        1.3.0
face-recognition-models 0.3.0
Python version: 3.8.5
Operating System: Mac Os

Description
I thought about sharing some funny false positives I found. I have some more, not sure if they are of any use.
It's using the CNN model and just 0 sampling.
https://imgur.com/a/cFLcbjf
What I Did
            model="cnn"
            upsample=0

Any idea what is driving those false positive @danielo515 I am having lots of false id's

To be honest no.
Those are just some few examples out of some thousand pics, so I didn't checked it further.


Change all optional unit to [unit]

As suggested before, we should change every signal one.
Signed-off-by: Qiang Huang<EMAIL_ADDRESS>

Nice! LGTM (docs and code)

LGTM


BusActivityMonitor hardened and simplified

Hi,
I use the BusActivityMonitor to ensure that all events are processed after my integrationtest finished, so I'm able to safely reset my database after each integrationtest without events that are still being processed.
The current implementation of the BusActivityMonitor is not that friendly to use in my case => I need to use a long inactivitytimeout and I also get issues, if I call the AwaitBusInactivity function twice. (semaphore is only released once, so the second call waits forever)
I builded a workaround for myself, but I think it could help other people too, so I integrated my workaround directly into the busactivitymonitor.
With these changes you are now able to use a very short inactivity timeout (I currently using 20ms) and you are also able to call the monitor as often as you like without any issues.
As a side note: I'm not that happy with the way I integrated my changes to the monitor, but I didn't want to break the Class api surface for people who use the classes directly in there own code.
If I'm allowed to "break" the class api surface of the "TestFramework Implemations" namespace by removing the empty constructor from the BusActivityMonitor, I would rename the old BusActivityMonitor to InternalBusActivityMonitor and then implement a new BusActivityMonitor that just wraps the InternalMonitor and get's the BusInactive Predicate as second parameter?

I'm not sure what's all entailed here, but this is no longer uses in favor of the test harness activity monitor. It all starts with the ContainerTestHarness.

I wasn't able to find a way other than the BusActivityMonitor to await pending events and I was under the impression that the ContainerTestHarness is more for normal "Unittests" and not for integration testing (most likely I googled then for the wrong terms😅).
I will recheck and then abandon the pr when I'm able to switch to the ContainerTestHarness, thanks for your fast answer @phatboyg. 👍

That's one of the key benefits of the new test harness, it can be used with any transport for any type of test. For instance:
https://github.com/MassTransit/MassTransit/blob/c3b0c9f38c1487f954ef284e5300587a49eb7437/tests/MassTransit.QuartzIntegration.Tests/Container_Specs.cs#L44

@phatboyg Just to make sure I don't miss anything: The test harness also does not a simple: "Wait until all pending events are being consumed" function even if there was a long inactivity period between publish calls, right?
(Cause I don't care, if there was 0, 1 or 3 events published, my tests are just asserting the outcome)
Again thank you a lot for your help 😊

The inactivity timeout should be set longer than the expected period of nothing being consumed. For instance, if you schedule a message for 5 seconds, and are expecting that message to be delivered/consumed as part of your test, your inactivity timeout should be > 5 seconds.


[IMPROVEMENT] Upgrade CSI sidecar components version

Is your improvement request related to a feature? Please describe (👍 if you like this request)
The current versions of the CSI sidecar components are vulnerable to CVEs. We should upgrade to more recent versions that have the fixes for those CVE issues.
Fixes:

CVE-2022-41723
CVE-2023-3978

Describe the solution you'd like

[ ] Create the following CSI sidecar component images from upstream:

CSI attacher: v4.4.0
CSI node driver registrar: v2.9.0
CSI provisioned: v3.6.0
CSI resizer: v1.9.0
~CSI snapshotter~

The CSI snapshotter is already at the most recent container image release from upstream (v6.2.1).

Livenessprobe: v2.11.0

[ ] Upgrade images in the deployment:

YAML
Chart

Describe alternatives you've considered
None
Additional context
https://github.com/longhorn/security/issues/16

cc @innobead

@yangchiu I am not sure if we are also able to upgrade the CSI snapshotter to versions above v6.2.1 as I cannot find them in upstream images: https://console.cloud.google.com/gcr/images/k8s-artifacts-prod/ASIA/sig-storage/csi-snapshotter

@yangchiu I am not sure if we are also able to upgrade the CSI snapshotter to versions above v6.2.1 as I cannot find them in upstream provided images: https://console.cloud.google.com/gcr/images/k8s-artifacts-prod/ASIA/sig-storage/csi-snapshotter

@c3y1huang Yes, just mirrored v6.3.0 image. It should be the latest.
I get confused by the gcr registry, but the following link contains the latest images: https://console.cloud.google.com/gcr/images/k8s-staging-sig-storage/global/csi-snapshotter

@c3y1huang Yes, just mirrored v6.3.0 image. It should be the latest.
I get confused by the gcr registry, but the following link contains the latest images: https://console.cloud.google.com/gcr/images/k8s-staging-sig-storage/global/csi-snapshotter

From https://github.com/kubernetes-csi/csi-release-tools/blob/master/SIDECAR_RELEASE_PROCESS.md#release-process

Promote images from k8s-staging-sig-storage to registry.k8s.io/sig-storage. From the k8s image repo, run ./generate.sh > images.yaml, and send a PR with the updated images. Once merged, the image promoter will copy the images from staging to prod.

Seems for some reason the csi-snapshotter version hasn't been promoted to prod yet.
@innobead , should we wait for the prod image or use the staging image that @yangchiu mirrored?

@innobead , should we wait for the prod image or use the staging image that @yangchiu mirrored?

Never mind, I am able to docker pull registry.k8s.io/sig-storage/csi-snapshotter:v6.3.0, so I assume it's already in prod.

Verified on master-head 20231124

longhorn master-head https://github.com/longhorn/longhorn/commit/57bf3edb1faa955ab077187a518d7be99ff38792

Result Passed

We did not observe the mentioned issues (CVE-2022-41723 and CVE-2023-3978) in the CSI sidecar components.
Observation of CVEs (CVE-2022-41723 and CVE-2023-3978) in longhorn-engine & longhorn-instance-manager
Ref : master-head https://ci.longhorn.io/job/private/job/image-security-scan/1230/testReport/

CVE-2022-41723:

longhorn-instance-manager-master-head.CVE-2022-41723.golang.org/x/net-v0.0.0-20191021144547-ec77196f6094 [HIGH]
longhorn-engine-master-head.CVE-2022-41723.golang.org/x/net-v0.0.0-20190522155817-f3200d17e092 [HIGH]

CVE-2023-3978:

longhorn-instance-manager-master-head.CVE-2023-3978.golang.org/x/net-v0.0.0-20191021144547-ec77196f6094 [MEDIUM]
longhorn-engine-master-head.CVE-2023-3978.golang.org/x/net-v0.0.0-20190522155817-f3200d17e092 [MEDIUM]


Adds support for reference tags to Stockholm reader and writer

Fixes #1348 as decided in #1347

@Kleptobismol there's a merge conflict, probably the changelog

@jairideout, had some problems with my branches, but it's all fixed, ready for a final pass.

Sweet, thanks @Kleptobismol!


Handle errors when traversing the node_modules dir

The navy-plugin-nodejs beforeLaunch hook doesn't add a listener for errors when traversing the file system. This has had the indirect effect of making the plugin assume that every navy develop command is being performed on a Node.js project.
Instead i've caught the event and just emitted a message in the error console. The develop command can continue and any errors from a missing node_modules directory will just surface from node directly.
Thoughts?
cc @madjam002 @jeanpaulgorman @ozamarripa

I guess the linter hasn't run before push?

Ok looks good

Looks good 👍


factorio: experimental 0.16.51 -> 0.17.1

Motivation for this change
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Assured whether relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

0.17.2 is out now

we might as well merge this and do 0.17.1 -> 0.17.2 in another PR

0.17.2 is in #56488


sendbird2.init() is not a function.

I am following (http://blog.sendbird.com/tutorial-build-a-messaging-app-using-react-native/) for a school project and cannot get past setting up the login. I have changed all the requires to the new import syntax for react-native. The error I am getting is ... "sendbird.init is not a function" ... From what I am reading, it is a bug and I need to revert back to an older state of react-native and sendbird.
Let me know if there is a known solution to this. Thank you.

Hi Michael,
Sorry.
The guide was built on SDK v2.
Could you try v3 sample ?
Thanks.


Strip failed: BFD: /home/ec2-user/sklearn_build/lib64/python2.7/site-packages/numpy/.libs/stV4bcuq: Not enough room for program headers, try linking with -N

I tried running the script on an Amazon Linux instance but the strip part failed with a "Not enough room for program headers, try linking with -N" error.
BFD: /home/ec2-user/sklearn_build/lib64/python2.7/site-packages/numpy/.libs/stV4bcuq: Not enough room for program headers, try linking with -N
strip:/home/ec2-user/sklearn_build/lib64/python2.7/site-packages/numpy/.libs/stV4bcuq[.note.gnu.build-id]: Bad value

Do you have an idea how to fix this problem?
Thanks

I encountered this as well. At first I thought it was a instance size issue (not enough room) but even on a t2.medium I get the same errors.

@lemaxm @mmoutenot Check this link for the issue - https://github.com/numpy/numpy/issues/7570. I've made a PR on this.

I think this is fixed (at least for docker running) - can you confirm @lemaxm?


support for binary data

Another thing I would like to see is the support for binary data. My first take was to use base64 encoding, but doing it all isn't very efficient and it's not easy to debug.
I guess only when a chunk contains binary data, base64 or some other encoding should be used.

Wait, I missed it's already handled. Nice.


Are you still there??

@vladfaust Your handling of this repository has been pretty infuriating. You haven't made any commits to this repo nor responded to any issues for at least 13 months, despite 4 open issues from the community since 2018, and 4 open Pull Requests since 2019, including one from me. Is it really too much to ask for you to glance at this repo and merge a PR to remove some compiler warnings? You've actually built a pretty handy Wakatime integration here, what with the Unity Package Manager support and removal of Python as a dependency. But good lord, the constant Console warnings from this package when reimporting assets in Unity, mixed with the bugs reported by others, mixed with your laughable project maintenance, has completely soured my taste for this tool, and I have uninstalled it from all of my Unity projects. For a maintainer of multiple other high-starred repos, and for someone with a link to their Patreon account in the README, I would have expected better.

I hope now you installed it to all of your Unity projects back!


Unable to setup the docs on local

While setting up the documentation site on my local using hugo I am getting an error.
hugo server --buildDrafts --disableFastRender -F -s site
Start building sites …
hugo v0.92.2+extended linux/amd64 BuildDate=2022-02-23T16:47:50Z VendorInfo=ubuntu:0.92.2-1
ERROR 2022/10/10 20:42:11 failed to load data: failed to load data: unmarshal failed: unexpected end of JSON input
ERROR 2022/10/10 20:42:11 failed to load data: failed to load data: unmarshal failed: unexpected end of JSON input
ERROR 2022/10/10 20:42:11 failed to load data: failed to load data: unmarshal failed: unexpected end of JSON input
Error: Error building site: failed to load data: failed to load data: unmarshal failed: unexpected end of JSON input

I've been using Hugo v0.101.0+extended and have had no issue. Perhaps try with a newer release?

Tried with v0.101. and v0.104 Still facing same issue

Hmm, this might be due to the JSON files extracted from code that get displayed in the docs. Try running make dist first to pull in the JSON data.

@Harshil-Jani Did you have any luck running make dist?

@Harshil-Jani Did you have any luck running make dist?

Naah ! :(

Could you reply with the output of running make dist? I'd like to confirm what the issue is.

I extremly apologies for a really late reply, for some reasons the notification got skipped from my end and I almost forgot about it.
I figured it out now that the actual issue was with my go installation. And hugo was working as expected. Thankyou @neflyte for the follow up. I really appreciate that. Now, I can run docs on my local after fixing my go installation.


[WIP]*: use unix socket in test

#221

Etcd cluster will not initialize successfully with unix socket in go1.5. I am digging into this problem.

Seem that we meet block in CI test, we can pass a timeout to go test like go test -timeout 5m, so if the test blocks longer than 5m, panic, so we can see wether case causes this.

LGTM

LGTM


Modify type of variable in OPENSSL_cpuid_setup function

I suggest modify type of variable "e" from char * to const char *.
Because return value of getenv() should not change through a pointer.

@komainu8 do you agree that this is a trivial change?  If so, please put "CLA: trivial" in the commit message

It's already marked as trivial

Question is why just armcap.c? This pattern is present in all *cap.c modules. For reference, originally e declaration simply matched standard getenv() declaration. Of course, it's no harm assigning it to const char *, but original rationale was to match getenv...

@dot-asm
I don't have special reason to modify just armcap.c. I found this improvements by chance.
This improvements is a very small part and not a big deal, though I hope I can contribute OpenSSL even a little.
I understood original rationale, however I think type of e is const char* is safer than type of e is char*.
Because If type of e is char *, it can carelessly change enviroment in process through a e.

Because If type of e is char *, it can carelessly change enviroment in process through a e.

I don't follow "it" what? Is armcap.c careless? No. The only thing that can happen is that compiler is buggy and generates bad binary code. But in such case no const qualifier would stand in the way...

I'm so sorry. My explaine was not good.
For sure, this code is not happen carelessly change environment in process through a e at the time of execution.
What I mean is that programmer might carelessly change environment in process through a e at the time of modify this code.
So, by changing type of e to const char *, I wanted to make it difficult to change environment in process by programmer.

Your explanation was fine.  We just don’t agree that it’s necessary for this code.

Argh.    I guess it's more useful/explanatory than not.


test(storybook): test headers by placing cursor - #14

Signed-off-by: Sanket Shevkar<EMAIL_ADDRESS>

Changes

Had some issues with my fork and local repository. So I am creating a new PR after creating a new fork. Added tests for all 6 headers.

Related Issues

Issue #14
Pull Request #311

Author Checklist

[ ] Ensure you provide a DCO sign-off for your commits using the --signoff option of git commit.
[ ] Vital features and changes captured in unit and/or integration tests
[ ] Commits messages follow AP format
[ ] Extend the documentation, if necessary
[ ] Merging to master from fork:branchname
[ ] Manual accessibility test performed

[ ] Keyboard-only access, including forms
[ ] Contrast at least WCAG Level A
[ ] Appropriate labels, alt text, and instructions

@Michael-Grover @irmerk  I've updated the changes you suggested in #311. I am closing #311. Sorry for the inconvenience.

Looks like a few of the tests are failing in the CI. Can you please take a look?

Individually tested, all tests are working fine, but when all are run together they sometimes are not able load and find the components needed for testing. I'll find a way to optimise this.


⚠ Melody Beta has degraded performance

In 9b27ca0, Melody Beta (https://canary.melody.api.triza.dev) experienced degraded performance:

HTTP code: 200
Response time: 1914 ms

Resolved: Melody Beta performance has improved in aaa18a6.


Question about the DDL tab on Table Properties Pages

How is that DDL retrieved from the DBMS?  Is there a JDBC API that is used to retrieve DDL from the DBMS, or is generated from system tables, or is it specific to the DBMS module?

Thanks for the explanation.  That is what I thought.
I have two main DBMS that I use: Oracle and Postgres based (Greenplum and Redshift).  So in the Postgres example, you do some queries against pg_tables and some other system catalog tables, and use that to "stitch" together the DDL you show?

Yes. It is correct. DBeaver read info from pg_attributes, pg_types etc.

Because we implemented it just recently: https://github.com/dbeaver/dbeaver/issues/15905
You can check it in the last DBeaver version (but be careful with this case https://github.com/dbeaver/dbeaver/issues/17865)

@LonwoLonwo can you point me to the code that does this?

Hello @michaelcollinsedgov
Starting here https://github.com/dbeaver/dbeaver/blob/devel/plugins/org.jkiss.dbeaver.ext.postgresql/src/org/jkiss/dbeaver/ext/postgresql/edit/PostgreTableManagerBase.java#L132
If we are talking about partitions.

Do you have any other questions @michaelcollinsedgov ?
Or I can lose this ticket?


Intergration with a Router (example)

Could you show an example of how to use react-flight with react-router-dom for example? It would be awesome if you added it to the examples folder, for everyone else to see.

Sure, is there anything especially tricky that you would like me to tackle there?
Also - is there a canonical example I can use as a starting point (like create-react-app) that would be most understandable?


LDAP Invalid username/password

I used npm install passport-ldapauth and believe the following config is correct...at least while looking at the documention on passport-ldapauth.
ldap:
    enabled: true
    url: 'ldap://{serverIP}:389'
    bindDn: 'CN={proxy_username},DC={domain},DC=org'
    bindCredentials: '{proxy_password}'
    searchBase: 'DC={domain},DC=org'
    searchFilter: '(uid={{username}})'
    searchAttributes:  ['displayName', 'mail']

I appear to be getting an Invalid username/password error, was hoping there was something obvious missing...Are there any gotchas when dealing with LDAP or does the config seem correct?
I have tried many options

Username
DOMAIN\Username
<EMAIL_ADDRESS>
Also, was able to use dsquery to get the bindDN piece...but still getting invalid user/pass for known good user/pass
dsquery user dc={domain},dc=org -samid {username}-s {serverIP}
Also temporarily changed passport-ldapauth to return back the actual error instead of the friendly handled error and received this
80090308: LdapErr: DSID-0C0903A8, comment: AcceptSecurityContext error, data 52e, v1db1
I guess the 52e represents 'Invalid Credentials'...but the credentials are definitely correct?
So far no luck =/

Alright, managed to get it working after hating life for a few hours....here is an updated config example that hopefully helps others.
ldap:
    enabled: true
    url: 'ldap://<IP_ADDRESS>:389'
    // FULL DN!!!! Dont strip anything out from the dsquery
    bindDn: 'CN=<user>,OU=<organizationalUnit>,DC=<domain 1>,DC=<domain 2>,DC=org'
    bindCredentials: '<password>'
    searchBase: 'DC=<domain 1>,DC=<domain 2>,DC=org'
    searchFilter: 'sAMAccountName={{username}}'
    searchAttributes:  ['displayName', 'mail']


Use global with_ methods to circumvent need for serialization

It's easy enough to add with_ methods to allow a direct handle to mutations, etc instead of serializing/deserializing them.

btw, have you considered signal based reactivity? works great in floem/lapce (native framework; initially based on leptos_reactive)


HTML lang attribute to auto-setLocale

Why to manually enforce the default locale:
Example:
<script type="text/javascript"> Lang.setLocale('{{App::getLocale()}}'); </script>
While everyone has the locale defined as an html attribute: lang?
Example:
<html lang="el">
It would be great to automatically check the lang attribute of the html tag to preset the default locale.

I suppose it's related: https://github.com/rmariuzzo/Laravel-JS-Localization/issues/60

Correct


 There seems to be no other method to get user's attention without require their interaction.
Status bar has "Show notifications" button, which shows previous messages from showInformationMessage, which suggests these messages could get hidden, however the API doesn't provide any means to hide these messages.
It would be useful to be able either provide a timeout for showInformationMessage or at least dismiss own messages.

I'm not sure if it's a bug or a feature, but if showInformationMessage called quickly 4 times with the same text it will dismiss the message. This could be used as a hack to dismiss own messages, but it feels like abuse.

This feature request is now a candidate for our backlog. The community has 60 days to upvote the issue. If it receives 20 upvotes we will move it to our backlog. If not, we will close it. To learn more about how we handle feature requests, please see our documentation.
Happy Coding!

This feature request has not yet received the 20 community upvotes it takes to make to our backlog. 10 days to go. To learn more about how we handle feature requests, please see our documentation.
Happy Coding!

:slightly_frowning_face: In the last 60 days, this feature request has received less than 20 community upvotes and we closed it. Still a big Thank You to you for taking the time to create this issue! To learn more about how we handle feature requests, please see our documentation.
Happy Coding!


API FB (via WebScraping) & tests

Have you tried executing the methods in the file API_FB.py class Manipulation_FB?

Have you tried executing the methods in the file API_FB.py class Manipulation_FB? Yes and it worked
have you tried calling the main function in test_API_FB.py? Yes and it worked
Have you executed the tests in tests.py? didn't succeed this one yet... still checking it
btw, can I get an explanation about your last comment regarding the tests:
"That list of outputs is very temporary as jobs change all the time.
For testing purposes, it might make sense to copy their HTML page statically so you can mock the tests."
thanks!

I'm beginning to understand what you did here.
Basically, while your functions are defined within a class, you're really not using class constructs.
My suggestion would be:
from bs4 import BeautifulSoup
import requests

class Manipulation_FB:
    def __init__(self):
        self.soup = None
        self.request = None

    def extract_jobs_url(self):
        fb_url = "https://www.facebook.com"
        jobs_links = []
        list_jobs_links = []
        jobs_list = self.soup.find("div", {"class": "_8tk7"})
        jobs = jobs_list.find_all("a", {"class": "_8sef"})
        links = [link['href'] for link in jobs]
        jobs_links = links
        for link in jobs_links:
            list_jobs_links.append(fb_url+link)
            # Need to push to a db
        print(list_jobs_links)
        return list_jobs_links

    def extract_jobs_title(self):
        jobs_titles = []
        list_jobs_titles = []
        jobs_list = self.soup.find("div", {"class": "_8tk7"})
        jobs = jobs_list.find_all("div", {"class": "_8sel"})
        jobs_titles = jobs
        for title in jobs_titles:
            list_jobs_titles.append(title.get_text())
            # Need to push to a db
        print(list_jobs_titles)
        return list_jobs_titles

    def create_soup(self):
        print(self.request.status_code)
        soup = BeautifulSoup(self.request.content, 'html.parser')
        # print(soup.prettify())
        self.soup = soup

    def create_req():
        # Load our first page
        # Need to pull from db
        search_url = "https://www.facebook.com/careers/jobs/?q="
        prefrences = "DevOps"
        r = requests.get(search_url+prefrences)
        self.request =  r

To use this class you would then do:
manipulation = Manipulation_FB()
manipulation.create_req()
manipulation.create_soup()
manipulation.extract_jobs_url()
manipulation.extract_jobs_title()


Update cbor-gen

Ref: https://github.com/whyrusleeping/cbor-gen/pull/92

Note cbor_gen.go was both codegen'd and also edited, so we have a combination of native cbor-gen and the edits that we had to do here to make it work properly .. I do wonder if we shouldn't upstream some of this, specifically that cbor-gen still wants to do cbor big ints but we always use bytes for them.

Marking as draft until issues raised in https://github.com/filecoin-project/go-state-types/pull/242 are resolved

Updated for master now that https://github.com/whyrusleeping/cbor-gen/pull/94 is merged; but this is also now low priority as we no longer have breakage and the diff is relatively meaningless


feature: allow private bookmarks

I think it would be great if users could add private (encrypted) bookmarks instead of only public ones. I have no idea what the best UX would be for this but I imagine an "easy" solution would be to just naively set the behaviour of bookmarks in the settings where the user gets to choose that bookmark list items are added either as public or private.

Well you don't need to decrypt everything when the app opens, what about decrypting it when the list is loaded? Idk, maybe that's a bad solution too?


Desktop: Sway 1.9 - Browser window not rendered correctly and hard to interact with

Describe the bug
The browser window is rendered in a buggy way and interacting with it is difficult (left-clicks) to almost impossible (right-clicks).
To Reproduce
Steps to reproduce the behavior:

Install Fusion using the script
Run the app
Observe how the browser window is wonky

Expected behavior
A normal browser window that can be interacted with.
Screenshots

Desktop (please complete the following information):

Fusion version 2.0.19983
NVIDIA GeForce GTX 1650 Mobile
Nixos Unstable
Sway 1.9
OpenGL-Mode (both Directx 9 and 11 don't work as they render a black screen where the model should be)
Wine 9.0
Winetricks 20240105

Additional context
I'm using a dual monitor setup. When I do manage to land a right-click the context-menu sometimes shows up on the other monitor from where the screen is.
Also, when I click in the browser window I get the following messages in the log:
107c:err:x11drv:X11DRV_GetCurrentDisplaySettings Failed to get L"\\\\.\\DISPLAY2" current display settings.
107c:err:x11drv:X11DRV_GetCurrentDisplaySettings Failed to get L"\\\\.\\DISPLAY2" current display settings.
107c:err:x11drv:X11DRV_GetCurrentDisplaySettings Failed to get L"\\\\.\\DISPLAY2" current display settings.

I too am getting this issue. However it's the canvas that has the Fusion 360 logo stuck in the background.

im also getting this issue, the logo/black screen gets stuck on the background, running the default script on nobara 39
just when i thought i finally got things working this happens :(

also i dont know if this helps or not, but if i select "enter fullscreen" then deselect it, for a brief moment, the properly rendered window flashes, before returning to black, as pictured in the above persons reply

I'm in the same boat. Installed it like 5 minutes ago to test again after few months. Ryzen 7700X, 7900XT, nobara 39, kernel 6.8.12, plasma 6.0.4

Everything seems to work but the model view is just black. All the menus, buttons and even shortcuts seem to work just fine. Any tips on helping debug this?

For me, worked changing driverOptionId value from VirtualDeviceDx9 to VirtualDeviceGLCore in the file .autodesk_fusion/wineprefixes/default/drive_c/users/ivan/AppData/Roaming/Autodesk/Neutron/Platform/Options/NMachineSpecificOptions.xml
I have a NVidia card on my laptop as secondary card

For me, worked changing driverOptionId value from VirtualDeviceDx9 to VirtualDeviceGLCore in the file .autodesk_fusion/wineprefixes/default/drive_c/users/ivan/AppData/Roaming/Autodesk/Neutron/Platform/Options/NMachineSpecificOptions.xml
I have a NVidia card on my laptop as secondary card

Thanks for sharing, unfortunately this does not work for me. I'm on a laptop with AMD Radeon integrated GPU.


[Bug] [UI] Dependencies in workflow instances show failures，version 3.1.2

Search before asking

[X] I had searched in the issues and found no similar issues.

What happened
This dependency is configured in my workflow definition and it is displayed normally.

But when I run the workflow, the dependency display fails in the workflow instance, as shown in the screenshot below.

What you expected to happen
I want to see the correct dependencies also in the workflow instance
How to reproduce
none
Anything else
none
Version
3.1.x
Are you willing to submit PR?

[ ] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

I'll check out this issue.

此问题已自动标记为陈旧，因为它已经 30 天没有最近的活动。如果没有进一步的活动，它将在接下来的 7 天内关闭。

this question is import, please repaire it.


FIX: Underspecified regex sets BIDSLayout to ignore data with sesions

This PR removes one ignore pattern that resulted in ignoring all data when sessions are defined.
To preempt regressions, a simple test is added, using data structures from @dmd (see #921 (comment)).
I will be adding more test structures from https://github.com/nipreps/mriqc/issues/921 and other reported problems.
Resolves https://github.com/nipreps/mriqc/issues/1086.

The new tests are passing on circle:
mriqc/tests/test_config.py::test_bids_indexing_manifest[gh921-dmd-20220428-0] PASSED
mriqc/tests/test_config.py::test_bids_indexing_manifest[gh921-dmd-20230319-0] PASSED
mriqc/tests/test_config.py::test_bids_indexing_manifest[gh1086-ds004134] PASSED


5 species don't have rasterized realized ranges

Cause of problem: rasterize function documentation says it only includes cells where polygon crosses centre
Ranges with no raster:

Anolis cooki GBIF
Craugastor fleischmanni IUCN
Halozetes belgicae GBIF
Sphaerodactylus roosevelti IUCN
Xantusia riversiana IUCN

*likely also alters very patchy ranges

Solved thanks to Adam and his shp2rast() function!


Support newline between autodoc identifer and YAML options

The current syntax of ...
::: my_package.my_module.MyClass
    handler: python
    options:
      members:
        - method_a
        - method_b
      show_root_heading: false
      show_source: false

... does not play well with markdown formatters.
Consider changing the syntax. Here's some ideas.
A markdown list, in conjunction with a flag variable
::: my_package.my_module.MyClass has_options=true

    - handler: python
    - options
      - members
        - method_a
        - method_b
      - show_root_heading: false
      - show_source: false

A markdown list, with an indicator flag
::: my_package.my_module.MyClass

    - #!mkdocstrings
    - handler: python
    - options
      - members
        - method_a
        - method_b
      - show_root_heading: false
      - show_source: false

Hello, thanks for the suggestion. We will probably not change the syntax any time soon. Have you tried:
::: my_package.my_module.MyClass

    handler: python
    options:
      members:
        - method_a
        - method_b
      show_root_heading: false
      show_source: false

?
That would make the YAML options equivalent to a code block, which would then not be re-formatted by tools, and would fallback gracefully when displaying in GitHub or else. If it does not work, I'm OK for us to bring support.

That seems to work for preventing markdown formatters from breaking the syntax.
However, mkdocstrings no longer parses it as a settings string.

I see, thank you for trying. Let's make it work then.

This will be released in the next version :slightly_smiling_face:


pushover.failure sends notification, but doesn't alert message severity level

I'd expect it to come through to pushover with a different severity level to distinguish it from other, less important, messages

So it turns out this is a quirk with the way that Apprise works with Pushover. Debugging Mailrise shows that the .failure notification type is being submitted to the Apprise API correctly, which is supposed to give you a red Mailrise icon for that notification—except that Apprise's Pushover plugin does not do anything useful with the notify_type passed to it. This actually makes sense, because Pushover notifications cannot set their own icons; icons are defined on a per-app basis on the Pushover dashboard.
You're probably looking for Pushover's "priority" option, which you add to the query string of the service URL. You have a choice of low, moderate, high, or emergency:
configs:
  pushover:
    urls:
      - pover://pover://{user_key}@{token}?priority=low
  pushover_urgent:
    urls:
      - pover://pover://{user_key}@{token}?priority=emergency

This is a pretty nasty gotcha, but I don't think it's practical for Mailrise try to do anything about it. Every single plugin may or may not make use of the notify_type passed into it; there's no way to know for sure. With a case like this, you could make an automatic map from Apprise's notify_type to Pushover's priority, but this would need to be done on a plugin-by-plugin basis.


[tensor] design DistSpec and DistSpecManager for ColoTensor

design DistSpec and DistSpecManager for ColoTensor
update current ops, besides loss
skip test_model.py

All tests passed.


Add ability to specify partitioner

Many writers won't care what partition their data goes to, they just
want it done randomly. Since we're using signed numbers here, we can use
negative numbers to indicate to use some special partitioning logic.

Could also implement this in a way similar to the Middleware approach, where you provide a partitioning function. I am not sure how useful that would be, though.
Other partitioners needed are "hash by key" and "round robin" maybe?

I need to think about it. I see your point and that's something I never thought about, but I understand need for it.
Using producer wrapper, there will be no need for introducing special value handling, but such wrapper would change interface and that's bad - no other wrapper would work afterwards.
Using negative numbers would not change the interface but I'm a bit afraid it might cause confusion. It seems better though than middleware approach.
Why not provide a function that can return partition number instead? This can be called directly as argument to produce method:

p.Produce("my-topic", p.RandPart(), myMessage)
p.Produce("my-topic", p.HashPart(myMessage), myMessage)

Also please remember that producing is atomic - if you pick destination (topic and partition) you must write to it all given messages at once.

Updated.
Here at Dropbox we're basically using two partitioning strategies right now: random (per atomic block of messages) and hashed by some calculation. I think the (updated) pull request here will be flexible enough for what we need to do, since we can pass in a function that does whatever.

What you're proposing now is change that breaks API. I don't think I can accept this - to much of our code would stop working. Providing wrapper would be in this case better because it's more flexible and does not break existing API.

What do you think about this interface? https://github.com/husio/kafka/commit/d88d9a619e65c60ed7d87a8d339b61b84e4277c2

I think that's another fine way of doing it. I don't care too much what it looks like, as long as the functionality exists. Whatever you want.

I have implemented 3 distributing producers that wrap standard producer and return different interface. I think this keeps code simple and allows future extensions.
https://github.com/optiopay/kafka/pull/11


Added check for empty response

Added check for empty response as in the section above (lines 273-281)

Hello,
You already opened a pull request and was closed due to inactivity and lack of response #94. Also please make sure the build passes. Please reopen a pull request when you're sure you can give all the necessary information asked before and the build passes.


Missing files?

I am going through chapter 5 of the book. There are some errors in product.component.html that I wanted to fix by comparing to the source code.
    <div class="btn-group" role="group"                  jhiSort [(predicate)]="predicate" [(ascending)]="reverse"                  [callback]="transition.bind(this)">
Errors are:

Unresolved variable or type "reverse"
Unresolved variable or type "transition"

The problem is when I navigate to https://github.com/PacktPublishing/Full-Stack-Development-with-JHipster/tree/master/Chapter05/online-store/src/main/webapp/app there is only "vendor.ts" file?

Hi @Celebes
I've updated the repo, now there are all the files in the repository.


[hotfix][e2e][influxdb] Fix testcase startup connect container throw EOF

Purpose of this pull request

Check list

[x] Code changed are covered with tests, or it does not need tests for reason:
[ ] If any new Jar binary package adding in your PR, please add License Notice according
New License Guide
[ ] If necessary, please update the documentation to describe the new feature. https://github.com/apache/incubator-seatunnel/tree/dev/docs


fix: escape pipe in api enpoint table

turns out you have to escape pipes, used inside gfm markdown, even if they occur inside code blocks.
https://github.github.com/gfm/#example-200
who knew. seems like an unplesantness that could have been avoided.
The current HTML conversion matches the github interpretation...

This PR should fix it.

woah thanks


2DD 5.25 360k ibm-pc format

Hello!  Sorry for my English... I'm Korean.
First of all, Thank you so much!
So many Korean people whose hobbies are collecting retro IBM-PC are glad to meet your project!
(I'm vice manager of online-community for "DOS/win3.1")
Your core theme of the project is Shugart, but IBM-PC format doesn't seem to be out of your interest... T.T
I know 5.25 shugart pin-out is different from that of 5.25 IBM.
So that?? 2DD 5.25 360KB  ibm-pc formatted diskette does not working using greaseweazle. It means reading and writing does not operate well...
Error Message shown as bellow,
"Greaseweazle v0.11 [F1], Host Tools v0.11
Reading Track 0.0...Command Failed: Seek: Track 0 not found"
360KB 2DD formatted diskettes don't work with both 5.25 2HD and 2D drives.
(But 2HD 5.25 1.2MB IBM-PC formatted diskettes do work well with 5.25 1.2MB 2HD floppy drive.)
So I have question for you, weather 360KB 2D IBM-PC format is not your intetest yet or I did something wrong...
If 5.25 2D 360KB IBM-PC format works good with greaseweazle, So many Korean people will be very grateful to you.

Hi brainy78,
Try this https://kr.element14.com/bourns/4114r-1-102lf/resistor-network-isolated-7-resistor/dp/9355634


16 add 10 russian and english topics

Added 10 new topics. Please, review and run every topic on your PC several times.

Idea for enhancement - I will add it as an issue if you find it interesting. I think it would be good to add also level of the words to the topic. Because when you learn you should choose the proper complexity

Idea for enhancement - I will add it as an issue if you find it interesting. I think it would be good to add also level of the words to the topic. Because when you learn you should choose the proper complexity


Fixed bug & updated UI

looks good! we will still need to figure out button size when you mouse over, they seem to go off the panel. not critical though


[5.4] Apply policies on subtypes of the configured class

This gives the Gate the ability to find the first Policy for a given class / object, where this object is either the configured class, extends from it or implements the configured interface.
Example usage
interface Foo {}
class Bar implements Foo {}
class Baz extends Bar {}

// Previous behavior
Gate::policy(SomePolicy::class, Bar::class);
Gate::check('update', new Bar); // This works, as the policy is bound to Bar::class
Gate::check('update', new Baz); // But not this one!

// Now I can...
Gate::check('update', Baz::class); // as it IS a Bar.

Gate::policy(SomePolicy::class, Foo::class);
Gate::check('update', Bar::class); // It IS a Foo
Gate::check('update', Baz::class); // It IS also a Foo

Backwards compatibility breaks:

The public method getPolicyFor($class) used to throw InvalidArgumentException when no policy was found. Now it returns either a Policy or null. This was not being used anywhere else inside the framework, and the Gate would never reach the exception itself, as the argument was always validated beforehand.
The protected method firstArgumentCorrespondsToPolicy($arguments) is gone, as it duplicated most of the work done in getPolicyFor($class). Now the Gate will attempt to get the Policy, and if null is returned, will continue trying as before.
The protected method resolvePolicyCallback(...) now receives the Policy instead of fetching it.

Pointing at 5.4 because of all this BC breaks. Let me know if you want me to try other approaches to this, or if it's something you don't plan to support.
Cheers!

Yes yes yes! 👍
Some more context: this is neat when you're working with, let's say Doctrine entities which have Proxies generated for them which are used in the app. Atm. Gate won't find the policy for the proxy class because it isn't an actual instance of the entity but rather an extended class.
Really hope this gets merged 😄

Please send a PR to the master branch of documentation with notes for the 5.4 upgrade guide.

Thanks for merging this! :)


smb backslash issue

Clicking on a smb with \ in it causes the expression to match, but not treated as a backslash during the search.
example:
click on \spoolss causes expression smb.fn=="\spoolss" which will then match just "spoolss" without the backslash

@awick Just removing backslashes won't work because of values like "\tmp\foo". However searching for "\tmp\foo" works. Should we escape all backslashes in all searches (not just smb.x)?

This is an example of a query that doesn't work and should: https://demo.arkime.com/sessions?expression=smb.share %3D%3D "\\<IP_ADDRESS>\ADMIN%24"&date=-1

Hi, is this open? I see @31453  is assigned to it? @

bumping this with additional context:
The filter from right-clicking an SPI field: smb.fn == "shieldbase.lan\Policies\{3AED11CF-0291-4915-AA85-E95C65F7EA88}\gpt.ini" does not return sessions
However, escaping the backslashes with smb.fn == "shieldbase.lan\\Policies\\{3AED11CF-0291-4915-AA85-E95C65F7EA88}\\gpt.ini" matches sessions as expected


Fix vcpkg_fixup_cmake_targets to work correctly on MinGW

Handle executable suffix correctly on all targets.

Please update the akali's version info to test the changes. See documentation.

@JackBoosY, sorry I am not very sure what you mean. Could you please clarify? Do you want me to raise akali's port version (from 1.41 to say 1.41-1) and commit this change to my branch? Why is this necessary and why exactly akali's port? Sorry for asking, I am just curious to know... for the next time I submit some similar changes? :)

@koprok We need to bump the version of the port that uses vcpkg_fixup_cmake_targets to test whether the PR modification is correct.

Should we follow the latest convention using Version:  and Port-Version:  pair?

Should we follow the latest convention using Version:  and Port-Version:  pair?

@linquize, I cannot find anything about such convention in Vcpkg documentation and I also don't see any port using it.

libarchive is using the new Version: and Port-Version: pair

libarchive is using the new Version: and Port-Version: pair

Ahh sorry, you are right @linquize ! I was looking at my mingw-vcpkg-fixup-cmake-targets branch instead of upstream master. Should I use Port-Version instead of Version, @JackBoosY, what do you think ?

Opencc regression is note related with this PR.
We need to wait for fix it first.

Opencc regression is note related with this PR.
We need to wait for fix it first.

Fixed in #12246

/azp run

Waiting for merge #12458.

/azp run


Support masking sensitive fields

Fields such as password should be maskable.

Closed via https://github.com/mongoid/mongoid-shell/pull/14.


Misleading Readme

Because of its KISS (keep it simple stupid) infrastructure, it works in all OSes without any platform-spesific dependency. People who wants to use no-git shouldn't check if a spesific OS compatible with no-git or not.
Installation
No installation required, it is shipped with all OSes by default.
You can start using it anytime with any project on any OS.

This also means no issues.


node.asbpath is nil while traversing project source tree

To replicate, run premake5 cmake in the http://github.com/TheChernoCommunity/GameProject-1 project.
Produces this following output:
Running action 'cmake'...
Generated CMakeLists.txt...
Generated build/cmake/glad.cmake...
Generated build/cmake/glfw.cmake...
Error: /home/angus/.premake/cmake_project.lua:37: bad argument #2 to 'getrelative' (string expected, got nil)

Using premake5 v5.0.0alpha16, in case that turns out to matter.

This turned out to be because a git submodule was not cloned, as I quickly discovered as I was moving to another build toolchain. Apologies for the noise.


feature/pulsar: provide token && http request

https://github.com/dapr/components-contrib/pull/1427

@1046102779 - Given that you updating the docs, it would be really good to add a link to the Pulsar docs that people can reference.  For example after this sentence
"To setup Pulsar pubsub create a component of type pubsub.pulsar. See [this guide]({{< ref "howto-publish-subscribe.md#step-1-setup-the-pubsub-component" >}}) on how to create and apply a pubsub configuration. "
Add "For more information on Apache Pulsar read https://pulsar.apache.org/docs/en/concepts-overview/"

@1046102779 - Can you DCO sign this PR also, after the updates?


update modules in generated package

new versions of the tooling (e.g., new vars syntax handled by preprocessor)

Sorry about the mess :)


Failing to find static files.

Im having an issue with static files and generating the pdf.
It seems directly related to this issue https://github.com/wkhtmltopdf/wkhtmltopdf/issues/2051.
Flask's method of serving static files means that wkhtmltopdf is trying to get them from a location that doesnt exist.
Terminal output:
Loading pages (1/6)
Warning: Failed to load file:///static/css/style.css (ignore)
Warning: Failed to load file:///static/css/media-queries.css (ignore)
Warning: Failed to load file:///static/img/logo_trans.png (ignore)
Warning: Failed to load file:///static/img/em3_trans.png (ignore)
Warning: Failed to load file:///static/js/vendors/scripts.js (ignore)
Warning: SSL error ignored
Warning: Failed to load file://www.google-analytics.com/ga.js (ignore)
Counting pages (2/6)
Resolving links (4/6)
Loading headers and footers (5/6)
Printing pages (6/6)
Done
Exit with code 1 due to network error: ContentNotFoundError

Theres a "simple" work around that I could use by reproducing the whole page in a new template with absolute links but this works if you only have one page and doubles the workload.
Im wondering is there a way to set a config variable that would reference the absolute location of the static dir?

There is not currently a config variable, but a PR with this feature is welcomed. You can also pass in context to the templates (see https://github.com/chris-griffin/flask-wkhtmltopdf/blob/master/flask_wkhtmltopdf.py#L108) so you could optionally pass in the base path of the static directory as a variable and handle that in your template. So instead of writing entirely new templates, you can modify your existing ones to use absolute paths when you pass in a particular variable that contains an absolute path.

Right so this is what i ended up doing.
Creating a global helper in my app factory:
app.jinja_env.globals['static'] = helpers.static_file
This was a function that dependent on the context used the regular flask url_for or built the url itself:
def static_file(filename, pdf=False, root=None):
    if(pdf):
        return "".join([root, "static/", filename])
    else:
        return url_for('static', filename = filename)

I then called this in my templates like this:
<script src="{{ static('js/reportFunctions.js', pdf=pdf, root=root) }}"></script>
Unfortunately the server froze when I tried building my pdfs and I have a short timeframe so Im going to have to pursue a different course of action.
Im leaving this here as a possible help to anyone.

So Im back and Ive been looking into this further.
So wkhtmltopdf is trying to load the js and css files as local files
file:///static/css/style.css
When it does this and cant find them because they are not at this address it ignores them and produces a pdf without styling or javascript but with the content.
When I added my above helper it seemed to try to get the files but then it just hung/hanged the server, similar to whats described here - https://github.com/wkhtmltopdf/wkhtmltopdf/issues/2254.

Hi,
Can we run wkhtmltopdf without internet?


added Java folder in counting sort and added readme in it

Added the java folder in the counting sort and added a readme.md file in it.

@shanky199912 : It would be great if you can add the description along with the issue number.
Feel free to use our contribution guidelines (https://github.com/fnplus/interview-techdev-guide/blob/master/CONTRIBUTING.md) for reference

As the issue has been already resolved by some other contributor so I am closing this PR.


Migrate from setuptools to Poetry

As a further improvement, during the upgrade to version 2.0 you could consider migrating from setuptools to Poetry for dependency management.
Related to #224

Hi @fox91, many thanks for the suggestion! What would be the purpose of this migration? What the advantages? Would you be able to put together a PR? This could also be just a proof of concept to explain what you have in mind and how you would do it.


Remove dependencing on CryptoSwift

Use swift-crypto vended by swift-SRP instead

Depends on https://github.com/adam-fowler/swift-srp/pull/14
Also - I need to change version requirement on Swift-SRP dependency


Reduce test flakiness

This is an attempt to reduce the test flakiness. I noticed that setUp calls are not executed on the same FakeAsync zone than the tests, which means that they are more likely to leak into other tests and flushing mikro-tasks in the tests doesn't actually flush the ones scheduled in setUp. Maybe this is enough to fix the flakiness in the tests. It definitely helped to reveal two instances where we forgot to dispose a timer or animation controller.
I also removed as many runAsync calls as possible, will look at the remaining ones in the future. As a general rule of thumb, we don't really want the tests to do any async work, (network requests or file accesses should be mocked, or even worse, waiting for a timeout), so we should never use runAsync.

Given the fact that 100 cycles of the tests passed (see CI run for 25134ad22afd6931bdc609885fe5636f1d7818ef) I'd say we can be pretty confident that this fixes the flakiness. 😁


Use Python 3.10 base image

Purpose
This PR updates the dev container to use a Python 3.10 base image, instead of the universal bullseye. It subsequently removes the Python feature, since it's slow. The feature was also using "os-provided" as the Python version, which is problematic on machines that have bad Python installs (like mine!). It's a more consistent environment to use the Docker's Python.
(Related issue: #343)
A similar change was made in the Python azd templates a while back:
https://github.com/Azure-Samples/todo-python-mongo-terraform/blob/main/.devcontainer/Dockerfile
Does this introduce a breaking change?

[ ] Yes
[X] No

Pull Request Type
What kind of change does this Pull Request introduce?

[ ] Bugfix
[ ] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Documentation content changes
[ ] Other... Please describe:

How to Test

Open in Dev Container on Mac, run azd up
Open in GitHub Codespaces, run azd up.

This doesn't work for me:
[12350653 ms] Start: Run: docker inspect --type image mcr.microsoft.com/devcontainers/python:3.10
[12353447 ms] Error fetching image details: No manifest found for mcr.microsoft.com/devcontainers/python:3.10.
[12353447 ms] Start: Run: docker pull mcr.microsoft.com/devcontainers/python:3.10
Error response from daemon: Get "https://mcr.microsoft.com/v2/": net/http: TLS handshake timeout
[12374441 ms] []
[12374441 ms] Error: No such image: mcr.microsoft.com/devcontainers/python:3.10

@tonybaloney I wonder if that was an intermittent error? It's listed at that exact URL on:
https://mcr.microsoft.com/en-us/product/devcontainers/python/about
I also just started a Codespace from this branch and it succeeded:
#9 [internal] load metadata for mcr.microsoft.com/devcontainers/python:3.10
2023-06-30 15:59:26.867Z: #9 DONE 0.8s
2023-06-30 15:59:27.112Z:
#10 [context dev_containers_feature_content_source] load from client
#10 transferring dev_containers_feature_content_source: 72.97kB done
2023-06-30 15:59:27.230Z: #10 DONE 0.2s

I do sometimes have intermittent errors with the mcr.microsoft.com images, though not recently.

This worked for me.


The production of the low resolution prediction results

Hello, I'm extremely grateful for your work. I'd like to clarify if the low-resolution prediction results, such as the one from Fuxi method named "2020-64x32_equiangular_conservative.zarr/", are obtained directly through training and prediction on a low-resolution dataset, or if they are downsampled from the original high-resolution prediction results. If they are obtained by downsampling, could you please elaborate on the specific method used for the downsampling process? Thank you very much.

Hi,
the lower resolution results were regridded using: https://github.com/google-research/weatherbench2/blob/main/scripts/regrid.py
with conservative regridding.

Thank you ^_^

Hello, when i use the https://github.com/google-research/weatherbench2/blob/main/scripts/regrid.py, i encounter with the following error, do you know how to solve this bug? Does this error is induced by the incorrect path? Looking forward your suggestions. Very very thanks.
I0801 10:38:46.446722<PHONE_NUMBER>26848 stager.py:761] Executing command: ['/home/lisl/.conda/envs/py39gdal/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmpkdxo0tlz/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp39', '--platform', 'manylinux2014_x86_64']
I0801 10:38:47.240728<PHONE_NUMBER>26848 stager.py:786] Executing command: ['/home/lisl/.conda/envs/py39gdal/bin/python', '-m', 'build', '--sdist', '--outdir', '/tmp/tmpzsqqg563', '/home/lisl/weatherbench2_main/scripts']
/home/lisl/.conda/envs/py39gdal/bin/python: No module named build
I0801 10:38:47.282829<PHONE_NUMBER>26848 stager.py:796] Executing command: ['/home/lisl/.conda/envs/py39gdal/bin/python', 'setup.py', 'sdist', '--dist-dir', '/tmp/tmpzsqqg563']
I0801 10:38:47.477443<PHONE_NUMBER>26848 dataflow_runner.py:395] Pipeline has additional dependencies to be installed in SDK worker container, consider using the SDK container image pre-building workflow to avoid repetitive installations. Learn more on https://cloud.google.com/dataflow/docs/guides/using-custom-containers#prebuild
I0801 10:38:47.481861<PHONE_NUMBER>26848 environments.py:314] Using provided Python SDK container image: gcr.io/cloud-dataflow/v1beta3/beam_python3.9_sdk:2.53.0
I0801 10:38:47.482055<PHONE_NUMBER>26848 environments.py:321] Python SDK container image set to "gcr.io/cloud-dataflow/v1beta3/beam_python3.9_sdk:2.53.0" for Docker environment
I0801 10:38:48.289190<PHONE_NUMBER>26848 translations.py:712] ==================== <function pack_combiners at 0x7fc27af97310> ====================
I0801 10:38:48.289617<PHONE_NUMBER>26848 translations.py:712] ==================== <function sort_stages at 0x7fc27af97af0> ====================
I0801 10:38:48.294850<PHONE_NUMBER>26848 auth.py:134] Setting socket default timeout to 60 seconds.
I0801 10:38:48.294947<PHONE_NUMBER>26848 auth.py:136] socket default timeout is 60.0 seconds.
W0801 10:38:51.300006<PHONE_NUMBER>26848 _metadata.py:139] Compute Engine Metadata server unavailable on attempt 1 of 3. Reason: timed out
W0801 10:38:51.375129<PHONE_NUMBER>26848 _metadata.py:139] Compute Engine Metadata server unavailable on attempt 2 of 3. Reason: [Errno 113] No route to host
W0801 10:38:54.379387<PHONE_NUMBER>26848 _metadata.py:139] Compute Engine Metadata server unavailable on attempt 3 of 3. Reason: timed out
W0801 10:38:54.379814<PHONE_NUMBER>26848 _default.py:338] Authentication failed using Compute Engine authentication due to unavailable metadata server.
W0801 10:38:54.381045<PHONE_NUMBER>26848 retry.py:290] Retry with exponential backoff: waiting for 1.6381955742278063 seconds before retrying _get_credentials_with_retrys because we caught exception: google.auth.exceptions.DefaultCredentialsError: Your default credentials were not found. To set up Application Default Credentials, see https://cloud.google.com/docs/authentication/external/set-up-adc for more information.
Traceback for above exception (most recent call last):
File "/home/lisl/.conda/envs/py39gdal/lib/python3.9/site-packages/apache_beam/utils/retry.py", line 275, in wrapper
return fun(*args, **kwargs)
File "/home/lisl/.conda/envs/py39gdal/lib/python3.9/site-packages/apache_beam/internal/gcp/auth.py", line 175, in _get_credentials_with_retrys
credentials, _ = google.auth.default(
File "/home/lisl/.conda/envs/py39gdal/lib/python3.9/site-packages/google/auth/_default.py", line 691, in default
raise exceptions.DefaultCredentialsError(_CLOUD_SDK_MISSING_CREDENTIALS)
W0801 10:38:59.027251<PHONE_NUMBER>26848 _metadata.py:139] Compute Engine Metadata server unavailable on attempt 1 of 3. Reason: timed out
W0801 10:38:59.087109<PHONE_NUMBER>26848 _metadata.py:139] Compute Engine Metadata server unavailable on attempt 2 of 3. Reason: [Errno 113] No route to host
W0801 10:39:02.090723<PHONE_NUMBER>26848 _metadata.py:139] Compute Engine Metadata server unavailable on attempt 3 of 3. Reason: timed out
W0801 10:39:02.091118<PHONE_NUMBER>26848 _default.py:338] Authentication failed using Compute Engine authentication due to unavailable metadata server.
W0801 10:39:02.091533<PHONE_NUMBER>26848 retry.py:290] Retry with exponential backoff: waiting for 3.814032520849619 seconds before retrying _get_credentials_with_retrys because we caught exception: google.auth.exceptions.DefaultCredentialsError: Your default credentials were not found. To set up Application Default Credentials, see https://cloud.google.com/docs/authentication/external/set-up-adc for more information.
Traceback for above exception (most recent call last):
File "/home/lisl/.conda/envs/py39gdal/lib/python3.9/site-packages/apache_beam/utils/retry.py", line 275, in wrapper
return fun(*args, **kwargs)
File "/home/lisl/.conda/envs/py39gdal/lib/python3.9/site-packages/apache_beam/internal/gcp/auth.py", line 175, in _get_credentials_with_retrys
credentials, _ = google.auth.default(
File "/home/lisl/.conda/envs/py39gdal/lib/python3.9/site-packages/google/auth/_default.py", line 691, in default
raise exceptions.DefaultCredentialsError(_CLOUD_SDK_MISSING_CREDENTIALS)
W0801 10:39:08.915890<PHONE_NUMBER>26848 _metadata.py:139] Compute Engine Metadata server unavailable on attempt 1 of 3. Reason: timed out
W0801 10:39:08.975111<PHONE_NUMBER>26848 _metadata.py:139] Compute Engine Metadata server unavailable on attempt 2 of 3. Reason: [Errno 113] No route to host
W0801 10:39:11.978773<PHONE_NUMBER>26848 _metadata.py:139] Compute Engine Metadata server unavailable on attempt 3 of 3. Reason: timed out
W0801 10:39:11.979199<PHONE_NUMBER>26848 _default.py:338] Authentication failed using Compute Engine authentication due to unavailable metadata server.
W0801 10:39:11.979631<PHONE_NUMBER>26848 retry.py:290] Retry with exponential backoff: waiting for 4.959881430377898 seconds before retrying _get_credentials_with_retrys because we caught exception: google.auth.exceptions.DefaultCredentialsError: Your default credentials were not found. To set up Application Default Credentials, see https://cloud.google.com/docs/authentication/external/set-up-adc for more information.
Traceback for above exception (most recent call last):
File "/home/lisl/.conda/envs/py39gdal/lib/python3.9/site-packages/apache_beam/utils/retry.py", line 275, in wrapper
return fun(*args, **kwargs)
File "/home/lisl/.conda/envs/py39gdal/lib/python3.9/site-packages/apache_beam/internal/gcp/auth.py", line 175, in _get_credentials_with_retrys
credentials, _ = google.auth.default(
File "/home/lisl/.conda/envs/py39gdal/lib/python3.9/site-packages/google/auth/_default.py", line 691, in default
raise exceptions.DefaultCredentialsError(_CLOUD_SDK_MISSING_CREDENTIALS)
W0801 10:39:19.950947<PHONE_NUMBER>26848 _metadata.py:139] Compute Engine Metadata server unavailable on attempt 1 of 3. Reason: timed out
W0801 10:39:20.015117<PHONE_NUMBER>26848 _metadata.py:139] Compute Engine Metadata server unavailable on attempt 2 of 3. Reason: [Errno 113] No route to host
W0801 10:39:23.018795<PHONE_NUMBER>26848 _metadata.py:139] Compute Engine Metadata server unavailable on attempt 3 of 3. Reason: timed out
W0801 10:39:23.019207<PHONE_NUMBER>26848 _default.py:338] Authentication failed using Compute Engine authentication due to unavailable metadata server.
W0801 10:39:23.019629<PHONE_NUMBER>26848 retry.py:290] Retry with exponential backoff: waiting for 11.64508406264211 seconds before retrying _get_credentials_with_retrys because we caught exception: google.auth.exceptions.DefaultCredentialsError: Your default credentials were not found. To set up Application Default Credentials, see https://cloud.google.com/docs/authentication/external/set-up-adc for more information.
Traceback for above exception (most recent call last):
File "/home/lisl/.conda/envs/py39gdal/lib/python3.9/site-packages/apache_beam/utils/retry.py", line 275, in wrapper
return fun(*args, **kwargs)
File "/home/lisl/.conda/envs/py39gdal/lib/python3.9/site-packages/apache_beam/internal/gcp/auth.py", line 175, in _get_credentials_with_retrys
credentials, _ = google.auth.default(
File "/home/lisl/.conda/envs/py39gdal/lib/python3.9/site-packages/google/auth/_default.py", line 691, in default
raise exceptions.DefaultCredentialsError(_CLOUD_SDK_MISSING_CREDENTIALS)
W0801 10:39:37.682912<PHONE_NUMBER>26848 _metadata.py:139] Compute Engine Metadata server unavailable on attempt 1 of 3. Reason: timed out
W0801 10:39:37.743090<PHONE_NUMBER>26848 _metadata.py:139] Compute Engine Metadata server unavailable on attempt 2 of 3. Reason: [Errno 113] No route to host
W0801 10:39:40.746725<PHONE_NUMBER>26848 _metadata.py:139] Compute Engine Metadata server unavailable on attempt 3 of 3. Reason: timed out
W0801 10:39:40.747148<PHONE_NUMBER>26848 _default.py:338] Authentication failed using Compute Engine authentication due to unavailable metadata server.
W0801 10:39:40.747362<PHONE_NUMBER>26848 auth.py:165] Unable to find default credentials to use: Your default credentials were not found. To set up Application Default Credentials, see https://cloud.google.com/docs/authentication/external/set-up-adc for more information.
Connecting anonymously. This is expected if no credentials are needed to access GCP resources.
Traceback (most recent call last):
File "/home/lisl/weatherbench2_main/model2023/datasets/regrid.py", line 166, in
app.run(main)
File "/home/lisl/.conda/envs/py39gdal/lib/python3.9/site-packages/absl/app.py", line 308, in run
_run_main(main, args)
File "/home/lisl/.conda/envs/py39gdal/lib/python3.9/site-packages/absl/app.py", line 254, in _run_main
sys.exit(main(argv))
File "/home/lisl/weatherbench2_main/model2023/datasets/regrid.py", line 145, in main
_ = (
File "/home/lisl/.conda/envs/py39gdal/lib/python3.9/site-packages/apache_beam/pipeline.py", line 612, in exit
self.result = self.run()
File "/home/lisl/.conda/envs/py39gdal/lib/python3.9/site-packages/apache_beam/pipeline.py", line 559, in run
return Pipeline.from_runner_api(
File "/home/lisl/.conda/envs/py39gdal/lib/python3.9/site-packages/apache_beam/pipeline.py", line 586, in run
return self.runner.run_pipeline(self, self._options)
File "/home/lisl/.conda/envs/py39gdal/lib/python3.9/site-packages/apache_beam/runners/dataflow/dataflow_runner.py", line 477, in run_pipeline
self.dataflow_client = apiclient.DataflowApplicationClient(
File "/home/lisl/.conda/envs/py39gdal/lib/python3.9/site-packages/apache_beam/runners/dataflow/internal/apiclient.py", line 502, in init
storage_credentials = credentials.get_google_auth_credentials()
AttributeError: 'NoneType' object has no attribute 'get_google_auth_credentials'


store "exact_part" with document

When the storage level is set to "document" the exact_part was not stored, but only if the storage level is "fingerprint".
However, it is a usecase to use the document together with the exact_part for evaluation of search hits.

Codecov Report

Merging #31 (4b56426) into main (e18d504) will not change coverage.
The diff coverage is 100.00%.

Impacted Files
Coverage Δ

narrow_down/data_types.py
100.00% <ø> (ø)

narrow_down/scylladb.py
97.97% <100.00%> (ø)


Refactored project into a Python package

Refactored project into a Python package
Refactored the code to comply with PEP formatting rules.
Cleaned up the code so all imports are explicit, instead of implicit.
Added /.github/workflows/python-publish.yml to enable PyPi package publishing for this project.
Set the package version to 0.0.1.

Closing this branch in favor or #2, which fixes an issue raised by GitHub not immediately knowing what to do with day_scraper.py


[VOTE] Ending Python 2.x support in next release (0.83)

Given that Python 2 will reach its end of life at the end of this year, we should drop Python 2 support. That is, contributors would no longer be required to write Python code that's compatible with Python 2.7. Also, Python distributions of XGBoost on PyPI will be Python 3 exclusive.
Indicate your support by replying "+1" to this thread. I want to get 4-5 votes from the committers to proceed with this decision. (Others, feel free to voice support with +1 reply as well, although only committers will have binding votes.)
@dmlc/xgboost-committer

Definitely +1

+1.
We need to upgrade Python on test farm then.

+1

+1

+1

+1

+1

With 7 votes from committers, it is decided that the upcoming release (0.83) will support Python 3 exclusively. I filed #4381 to migrate pylint to Python 3, and #4380 will use Python 3 exclusively for all CI tests. Thanks!

Given the major status of this project and the major importance of this project to the scientific Python community, you should consider adding your name and logo to Python3Statement.org of projects planning to drop support for Python 2 on or before Jan 1 2020, to maximize public visibility of your support timeline in a central location, and help send the message that remaining Python 2 users should start transitioning now to minimize the pain later. To add XGBoost, you can just submit a simple PR to the Python3Statement repo with your name and logo—a SVG or transparent PNG of this would be ideal:

Or, if you like, I can create a PR for you there and @hcho3 can sign off, if you want. Thanks!

@CAM-Gerlach Yes, we'd love to put our logo there. Can you go ahead and create a PR on our behalf? I'll sign it off.

@hcho3 Sure; I'll go ahead and tag you there. Thanks!

@hcho3 Particularly since it is ending Python 2 support before 2020, it would be really nice to have the project in the timeline. What date should I put for the beginning of Python 3 support (or has it always supported Python 3 since the first release in 2014)? I couldn't find any info on this in the obvious places (Trove classifiers, .travis.yml/appveyor.yml, release notes, readme, etc).
Also, is there an approx release date for 0.90 (it doesn't have to be exact, just the likely date of release assuming Spark 2.4.3 drops on as planned on or about May 5 (which it looks it will) and implementing the remaining items for #4389 go according to plan; due to the long time span of the charge, a difference of up to a couple weeks from the actual won't really be visible.

@CAM-Gerlach XGBoost has been tested with Python 3.x for a long while. At PyPI, we have been distributing "universal" wheels of XGBoost that are both Python 2 and 3 compatible. See https://pypi.org/project/xgboost/#files.
Only change with 0.90 release is that we will no longer make guarantee about supporting Python 2. We hope to make 0.90 by middle of May, assuming we can address the items in the Roadmap.

XGBoost has been tested with Python 3.x for a long while.

Okay, so about what rough timeframe should I put down for that, then?

At least since Nov 2015, based on this commit: https://github.com/dmlc/xgboost/commit/25c4fbd0cb5cbb8ad06533f5a6d147559d424563. This commit adds a compatibility layer to support Python 2 and 3.


Please add a License.md file

This component is AWESOME! However, it would be really helpful if the license was clearly stated.

There is license
https://github.com/andrewcourtice/vuetiful/blob/master/license.txt


Update Connector version to 0.5.1

Problem description
In preparation of the connector release, update connector version to 0.5.1 from the r0.5 branch in support of Pravega release 0.5.1 ( https://github.com/pravega/pravega/releases/tag/v0.5.1)
Update Pravega version from gradle.properties to 0.5.1
Update Connector version from gradle.properties to 0.5.1
Update Pravega sub-module commit ID to 35797c05455a5d05c8af5782557e8f986d47c2df
Problem location
Build scripts
Suggestions for an improvement

Pravega 0.5.1 is released, we should cut a new version of the connector too.


Questions regarding context length

Hello all,
After reading the documentation I'm still a bit confused regarding the context_length parameter, and I couldn't find much online.
As far as I understand the context_length defines the number of time steps to look back to predict the next prediction_length time steps.
Let's say I have a time series spanning 3 weeks (freq = D), I use the first 2 weeks for training the 3rd for testing (last 7 days).

If I set prediction_length = context_length = 7, does that mean the model will only "see" values from the 2nd week and ignore  the 1st, even though the training set spans 2 weeks?

If that's the case does that mean context_length should be equal to time_series_length - prediction_length, so that it sees data from the complete date-range (training-set-start-date to training-set-end-date)?

Hello all,
After reading the documentation I'm still a bit confused regarding the context_length parameter, and I couldn't find much online.
As far as I understand the context_length defines the number of time steps to look back to predict the next prediction_length time steps.
Let's say I have a time series spanning 3 weeks (freq = D), I use the first 2 weeks for training the 3rd for testing (last 7 days).
* If I set prediction_length = context_length = 7, does that mean the model will only "see" values from the 2nd week and ignore  the 1st, even though the training set spans 2 weeks?

As far as I understand the code as well as the tutorials, during training, sequences of length equal to context_length  +prediction_length are sampled from the training dataset, the first observations (context_length) are used as input for the network and the predictions. In your case this would mean, that the first 7 days are used as input for the estimator and the output of the estimator, c and the next 7 days to calculate the training loss.

* If that's the case does that mean context_length should be equal to time_series_length - prediction_length, so that it sees data from the complete date-range (training-set-start-date to training-set-end-date)?

The optimal case would be that you have enough observations that you can

Hello all,
After reading the documentation I'm still a bit confused regarding the context_length parameter, and I couldn't find much online.
As far as I understand the context_length defines the number of time steps to look back to predict the next prediction_length time steps.
Let's say I have a time series spanning 3 weeks (freq = D), I use the first 2 weeks for training the 3rd for testing (last 7 days).
* If I set prediction_length = context_length = 7, does that mean the model will only "see" values from the 2nd week and ignore  the 1st, even though the training set spans 2 weeks?

As far as I understand the code as well as the tutorials, during training, sequences of length equal to context_length + prediction_length are sampled from the training dataset. The first set of observations is used as input for the estimator and the second set to calculate the loss.
In your case the first week is used as input for the estimator (or "seen" in your terms) and the second week to calculate the training loss.

* If that's the case does that mean context_length should be equal to time_series_length - prediction_length, so that it sees data from the complete date-range (training-set-start-date to training-set-end-date)?

The optimal case would be that you have a training set that allows sampling of multiple sequences of length equal to context_length+prediciton_length.
F.e. if you have 28 days of observations (4 weeks), context_length=14 days and prediction length=7 days. During training multiple sequences of length=21 are sampled, the first two weeks are used as input and the last week to calculate the training loss.

@kaijennissen I think I might have misunderstood when you said:

The optimal case would be that you have a training set that allows sampling of multiple sequences of length equal to context_length+prediciton_length.

F.e. if I have 84 days (12 weeks), and prediction_length = 7, then context_length = 14 is still optimal?
Since the training set still allows sampling of multiple sequences of length 21 (in this case 4 non over-lapping sequences of length 21)
And does that mean that in the same example (84 days) using context length = 35, (giving us ctx_len + pred_len = 42) is also optimal? Again it the training set allows sampling for multiple sequences of length 42 (in this case 2 non over-lapping sequences of length 21)
So I'm still confused, does this mean there is no optimal value but several?

@mariosantosprivate
What I mean is that with a longer history, it is possible to sample different subsequences of the time series and not only one (which was the case in your initial example).
It is hard to say what the optimal value for context_length is since this heavily depends on the characterstics of yout time series (i.e. seasonality) F.e. with daily data you have a weekly seasonality but also a yearly (and sometimes a monthly).

@kaijennissen Ah, now I understand, thank you!


Lambda package doesn't compile after AWS SDK C++ update

What platform/OS are you using?
Docker FROM ubuntu:18.04
Which version of the SDK?
The problem appears with v1.7.212
What compiler are you using? what version?
g++
What are your CMake arguments?
I'm following the instructions for creating a lambda package using AWS SDK C++ and S3 from:
https://aws.amazon.com/blogs/compute/introducing-the-c-lambda-runtime/
Can you provide a TRACE level log? (sanitize any sensitive information)
With v1.7.212, I get:
[100%] Linking CXX executable XXX
/usr/bin/ld: cannot find -laws-c-event-stream
/usr/bin/ld: cannot find -laws-checksums
/usr/bin/ld: cannot find -laws-c-common
collect2: error: ld returned 1 exit status
make[2]: *** [XXX] Error 1
CMakeFiles/XXX.dir/build.make:140: recipe for target 'XXX' failed

Before, it worked perfectly.

What do you mean 'before'?
Also we are working on fixing a similar problem. If you use target_link_library with AWSSDK_LINK_LIBRARIES variable in your cmake scripts,try modify this variable to aws-cpp-sdk-[service name], [service name] is 'lambda' or 's3', etc.

More information here. https://github.com/awslabs/aws-lambda-cpp/issues/64

We have fixed this issues in commit https://github.com/aws/aws-sdk-cpp/commit/0e3c5d7351caa50edf36a5c987e5ea723024e568
Please update SDK to latest to try again. Reopen if you still have this issue.


[AutoPR hdinsight/data-plane] [HDInsight] - Add FINISHING to application state

Created to sync https://github.com/Azure/azure-rest-api-specs/pull/4906

This PR has been merged into https://github.com/Azure/azure-sdk-for-go/pull/3707


Enable local driver for log rotation

Closes #231. For this PR, I verified that on the QA server...

docker-compose logs service outputs logs
sudo docker ps -qa | sudo xargs docker inspect --format='{{.LogPath}}' | sudo xargs ls -hl shows a reduction in log size
docker inspect <container> shows max-file as a config

As detailed at https://docs.docker.com/config/containers/logging/local/#options, this defaults to a 20M file for each log and 5 maximum files (each compressed).
In a 3 month period, we expect 15MB for service and 640MB for nginx for a very active server, so the defaults for 100MB for service (because it's less stuff in docker-compose) and 600MB for nginx seem like good conservative defaults. We can dial the latter down if necessary.
This risk of this PR is that we are possibly throwing away old logs and someone might find that objectionable.

@issa-tseng, per your suggestion, I looked into what version we would need...
Support for the local driver was added to docker-compose in v1.28.3 (https://github.com/docker/compose/pull/8082).
We recommend this DigitalOcean droplet which runs docker-compose v1.27.0,  so we should add docs for v1.3 that people need to upgrade their docker-compose.
Instructions are at https://docs.docker.com/compose/install/.
sudo curl -L "https://github.com/docker/compose/releases/download/1.29.2/docker-compose-$(uname -s)-$(uname -m)" -o /usr/local/bin/docker-compose
sudo chmod +x /usr/local/bin/docker-compose

We use v1.29.2 on ODK Cloud and it works great.


"Environment variables loaded from .env" is misleading

Bug description
I followed the "Running migrations on different environments" guide and executed this statement in my terminal:
dotenv -e .env.test -- npx prisma migrate dev

It was giving me the following output:

Environment variables loaded from .env
Prisma schema loaded from prisma\schema.prisma
Datasource "db": PostgreSQL database "tests", schema "public" at "localhost:5433"

I was very surprised because I do have a .env and .env.test file in my project and thought that Pisma is not pickung up my .env.test file because it's reporting that it loaded variables from ".env". In fact it used my .env.test file.
How to reproduce

Create a .env file with DATABASE_URL="postgresql://postgres:postgres@localhost:5432/root_db?schema=public"
Create a .env.test file with DATABASE_URL="postgresql://prisma:prisma@localhost:5433/test_db?schema=public"
Run dotenv -e .env.test -- npx prisma migrate dev

Expected behavior
To avoid this confusion I suggest to change the phrasing of the console output. Preferably it should show the correct file name (e.g. loaded from .env.test) or not mention the file name at all (e.g. loaded environment variables).
Prisma information
schema.prisma
generator client {
  provider = "prisma-client-js"
}

datasource db {
  provider = "postgresql"
  url      = env("DATABASE_URL")
}

model enum_role {
    type        String @id
    description String
}

Environment & setup

OS: Windows 10
Database: PostgreSQL
Node.js version: 16.10.0

Prisma Version
prisma                  : 3.4.0
@prisma/client          : 3.4.0
Current platform        : windows
Query Engine (Node-API) : libquery-engine 1c9fdaa9e2319b814822d6dbfd0a69e1fcc13a85 (at<EMAIL_ADDRESS>Migration Engine        : migration-engine-cli 1c9fdaa9e2319b814822d6dbfd0a69e1fcc13a85 (at<EMAIL_ADDRESS>Introspection Engine    : introspection-core 1c9fdaa9e2319b814822d6dbfd0a69e1fcc13a85 (at<EMAIL_ADDRESS>Format Binary           : prisma-fmt 1c9fdaa9e2319b814822d6dbfd0a69e1fcc13a85 (at<EMAIL_ADDRESS>Default Engines Hash    : 1c9fdaa9e2319b814822d6dbfd0a69e1fcc13a85
Studio                  : 0.438.0

I think what technically is happening there that Prisma does read from .env, but that dotenv -e .env.test already filled the env vars and so the Prisma part skips the already existing env vars instead of overwriting them.

To avoid this confusion I suggest to change the phrasing of the console output. Preferably it should show the correct file name (e.g. loaded from .env.test) or not mention the file name at all (e.g. loaded environment variables).

This is unfortunately not possible, as Prisma itself das not read .env.test but the dotenv CLI does that and populates the environment variables.
Does that make sense?
Still I totally see how this can be confusing.

ping @bennycode

Hi @janpio, your explanation makes sense to me. I think the best that can be done here is placing a note in the docs. And how about rephrasing "Environment variables loaded from .env" to just "Environment variables loaded"?

The correct wording would probably be Read .env file and put contained environment variables into environment - because at this step we really only do that, and then the reading of the actual environment variables per the env() in the schema file definition happens later. But that is super complicated to explain unfortunately. Or do you think maybe .env found, loaded file content into environment variables (if not present yet) would indeed be more correct and less misleading?

It's super misleading, I lost two hours trying to figure out why my env variables from .env file were loaded during my tests whereas I followed the instructions to load a .env.test file.
Actually dotenv and prisma aren't smart at all: if you have the same variable in the two files and used dotenv -e .env.test ok when prisma is initiated it won't override the variable. HOWEVER, it will load variables from the .env file which aren't in the .env.test file. This is super wrong, this is not explained in the docs, and this is a very bad pattern.
.env file shouldn't be automatically magically loaded by prisma.

Any news on this?

The problem is the advice to use dotenv-cli while prisma insists on loading .env. This is very confusing and error prone. Why doesn't prisma use an environment variable to load the desired .env file?
For example: ENV_PATH="./.env.dev" prisma migrate dev.

Just got bitten by this. I wouldn't expect prisma to expand .env onto process.env at all. That's what dotenv is for.

@janpio is there any reason prisma is integrating dotenv functionality? A teammate lost 1-2 hours again because of this issue. Prisma is implicitly loading an .env file in our app, causing an unexpected behavior.

 Totally unexpected behavior.

What would be an acceptable fix? I figure that Prisma should (1) not
overload process.env (2) by default, use a different *.prisma.env file (3)
accept a CLI PRISMA_ENV override that is the path to the desired prima env
file.
I can open a PR, but as it is a breaking change, feel that it would be
rejected even though it is the safe behavior.
 Totally unexpected behavior.
—
Reply to this email directly, view it on GitHub
https://github.com/prisma/prisma/issues/10104#issuecomment-1829521404,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AACESLNJTVZV2X5MOFIUGM3YGW3QJAVCNFSM5HLGAJHKU5DIOJSWCZC7NNSXTN2JONZXKZKDN5WW2ZLOOQ5TCOBSHE2TEMJUGA2A
.
You are receiving this because you commented.Message ID:
@.***>

i am using render.com for postgresql but when i want to migrate to db i get this:
Environment variables loaded from .env
Prisma schema loaded from prisma/schema.prisma
Datasource "db": PostgreSQL database "test_database_lenk", schema "public" at "dpg-cm59nkq1hbls73ahtp70-a.oregon-postgres.render.com"
Error: P1001: Can't reach database server at dpg-cm59nkq1hbls73ahtp70-a.oregon-postgres.render.com:5432
Please make sure your database server is running at dpg-cm59nkq1hbls73ahtp70-a.oregon-postgres.render.com:5432.
can anyone tell me  what is the problem?

ping @bennycode

How to resolve this


Netlist synthesis data

HI ,
According https://github.com/chipsalliance/caliptra-rtl/blob/main/docs/CaliptraIntegrationSpecification.md
The Netlist synthesis data table Total Area 337088.

Can you clarify if this number is related to mm^2 or actually in Gate Count(Nand2)?
Please specify for what Process the the numbers are related? to TSMC 5nm or 40nm ?
(both numbers mentioned if searching the word 'TSMC' - confusing information)

Thanks

The area is expressed in units of square microns.

So μm2.

The reference to TSMC 5nm in the spec should be removed, that was referencing the initial DC experiments done with 5 nm process files. The partner that collected the actual synthesis data is not releasing which process node they are working with.
Quote from the Integration Spec:
"The target foundry technology node is an industry standard, moderately advanced technology node as of 2023 September."


Error while Adding DAPR via Azure component in Azure Container Apps Environment.

Please provide us with the following information:

This issue is a: (mark with an x)

[ ] bug report -> please search issues before submitting
[ ] documentation issue or request
[ ] regression (a behavior that used to work and stopped in a new release)

Issue description
I am trying to add a DAPR Component via Azure Component option and it fails with Deny Assignments which are there on the managed resource group that gets created when we host Azure Functions in Azure Container Apps.
Steps to reproduce

.. Create a Azure Function in Azure Container App
.. Add DAPR component to the container App Environment via the Azure Component Option and try to add a Config store

Expected behavior [It should add the DAPR component]
Actual behavior [Errors out with Deny Assignments]
Screenshots
If applicable, add screenshots to help explain your problem.
Additional context
Error
Error: Operation is not succeeded: Failed. {"code":"UnauthorizedResourceAccess","message":"Execution failed. The client '' with object id 'a3a44cb2-fcb0-47ec-bd42-edd8a815da06' has permission to perform action 'Microsoft.App/containerApps/write' on scope '/subscriptions/9d23e376-3fdf-46a7/resourceGroups/usascamsdevace01_FunctionApps_d3e11262-39ea-43ee-bb96-e44160074aea/providers/Microsoft.App/containerApps/ams-blob'; however, the access is denied because of the deny assignment with name 'd3e11262-39ea-43ee-bb96-e44160074aea' and Id 'd3e1126239ea43eebb96e44160074aea' at scope '/subscriptions/9d23e376-3fdf-46a7/resourceGroups/usascamsdevace01_FunctionApps_d3e11262-39ea-43ee-bb96-e44160074aea'.\nStatus: 403 (Forbidden)\nErrorCode: DenyAssignmentAuthorizationFailed\n\nContent:\n{"error":{"code":"DenyAssignmentAuthorizationFailed","message":"The client '' with object id 'a3a44cb2-fcb0-47ec-bd42-edd8a815da06' has permission to perform action 'Microsoft.App/containerApps/write' on scope '/subscriptions/9d23e376-3fdf-46a7/resourceGroups/usascamsdevace01_FunctionApps_d3e11262-39ea-43ee-bb96-e44160074aea/providers/Microsoft.App/containerApps/ams-blob'; however, the access is denied because of the deny assignment with name 'd3e11262-39ea-43ee-bb96-e44160074aea' and Id 'd3e1126239ea43eebb96e44160074aea' at scope '/subscriptions/9d23e376-3fdf-46a7/resourceGroups/usascamsdevace01_FunctionApps_d3e11262-39ea-43ee-bb96-e44160074aea'."}}\n\nHeaders:\nCache-Control: no-cache\nPragma: no-cache\nx-ms-failure-cause: REDACTED\nx-ms-request-id: dae830b3-501d-4bd9-9d17-d829d44549d0\nx-ms-correlation-request-id: REDACTED\nx-ms-routing-request-id: REDACTED\nStrict-Transport-Security: REDACTED\nX-Content-Type-Options: REDACTED\nX-Cache: REDACTED\nX-MSEdge-Ref: REDACTED\nDate: Wed, 02 Oct 2024 15:21:26 GMT\nContent-Length: 712\nContent-Type: application/json; charset=utf-8\nExpires: -1\n"

Hi @VenkataRKC , user is not expected to update from MRG as deny assignment for updates is being enforced. However the portal experience for Azure Functions on ACA is not yet enabled . Adding Dapr components will work via ARM/Bicep/azd deployments

For more details on MRG refer to this doc link - https://learn.microsoft.com/en-us/azure/azure-functions/functions-container-apps-hosting#managed-resource-groups

Ok thank you @raorugan , will try adding the component via Bicep. Any ETA on when this will be enabled from portal ?.

It is fixed in portal now

@BlackRider97 thanks for the response/followup. Btw the Documentation does not show the Azure Component as preview . But where as when i login to the Portal i see that the Azure Component is in preview mode. Is it in Preview or Generally Available ?.
As per documentation .
https://learn.microsoft.com/en-us/azure/container-apps/dapr-component-connection#create-a-dapr-component

As per portal
It shows as preview in the parenthesis.


PackageId:CPython39.Exe.x64;PackageAction:Install;ReturnCode:5;

This issue has been moved from a ticket on Developer Community.

Describe your issue here
===DO NOT EDIT BELOW THIS LINE===
PackageId:CPython39.Exe.x64; PackageAction:Install; ReturnCode:5;

Original Comments
Feedback Bot on 4/19/2023, 01:38 AM:
(private comment, text removed)

Original Solutions
(no solutions)

It seems the problem occurs when the CPython installer fails. This could be due to network timeouts, corporate firewall policy, VPN configuration, anti-virus, or other problems. See if a retry helps, and if not, see if you can download the Python runtime directly from https://python.org/ and install it manually.
If that doesn't solve your issue, we could use more detailed logs to see what's really going on. Can you please collect more logs by running http://aka.ms/vscollect.exe and uploading %temp%\vslogs.zip and reopen the ticket if it persists? Thank you!😊


Create conda env in cluster

#1396  👈
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @carolineechen and the rest of your teammates on  Graphite


fix: cleaner solution to handle slice type for extra-args param

Based on feedback from https://github.com/kubernetes-sigs/hydrophone/pull/140 , adding a cleaner solution to handle Slice of String type for "extra-args".

/retest

/test all

cc @rjsadow @rakshitgondwal

@reetasingh We can remove the test for checking the skip value as we are not really modifying anything inside the ValidateArgs() wrt skip. We are just printing its value.

@reetasingh We can remove the test for checking the skip value as we are not really modifying anything inside the ValidateArgs() wrt skip. We are just printing its value.

done


Variable resolving does not work correctly if expression starts from $

The variable expanding mechanism used to preprocess projects and property sheets does not work correctly if the string to be expanded starts from the "$" symbol
e.g.
$(AAA);$(BBB)
"$(AAA);$(BBB);CCC"
gets expanded (assuming $(AAA) expanding to AAA and $(BBB) to BB) to
"AAA BBB AAA;BBB;CCC"
This leads to ignoring the first include path and failing compilation.
Adding something other in front fixes the issue -> "DDD;$(AAA);$(BBB);CCC" expands correctly to "DDD;AAA;BBB;CCC"
The issue can be observed while building with clang-build.ps1 while printing "($data).InnerText" in the "Function Get-ProjectAdditionalIncludes".
Moreover, strings are being executed during evaluation.
Running clang-build.ps1 on a project that contains:
msg * surprise $(OutDir)$(CombinedTargetFileName).lib
Shows a surprise message. Quite funny :-), but also really dangerous

We've looked further into this; indeed the problem was occurring only on systems using PowerShell 3.0. Having isolated the issue, we were able to push a fix for it. It will be included in the next Clang Power Tools release (4.9).
Thank you for your feedback.
Regards,
Gabriel.