Parse templates error in Jinja2Loader

I'm using flask-assets and it's command line facilities, but the Jinja2Loader fails for some reason, this is the code that fails at load_bundles:
        loader = Jinja2Loader(env, template_dirs, [app.jinja_env],
                              jinja_ext=jinja_extension)
        return loader.load_bundles()

This is the exception:
Traceback (most recent call last):
  File "run.py", line 9, in <module>
    from xyz.console import manager, term
  File "xyz/console/__init__.py", line 16, in <module>
    app, webapp = xyz.run()
  File "xyz/boot.py", line 121, in run
    m.run(['--parse-templates', 'build'])
  File "/home/manuel/.virtualenvs/webapp/lib/python2.7/site-packages/flask_assets.py", line 422, in run
    return impl.main(args)
  File "/home/manuel/.virtualenvs/webapp/lib/python2.7/site-packages/webassets/script.py", line 557, in main
    return self.run_with_argv(argv)
  File "/home/manuel/.virtualenvs/webapp/lib/python2.7/site-packages/webassets/script.py", line 549, in run_with_argv
    return self.run_with_ns(ns)
  File "/home/manuel/.virtualenvs/webapp/lib/python2.7/site-packages/webassets/script.py", line 531, in run_with_ns
    env = self._setup_assets_env(ns, log)
  File "/home/manuel/.virtualenvs/webapp/lib/python2.7/site-packages/flask_assets.py", line 364, in _setup_assets_env
    env.add(*[b for b in self.load_from_templates(env, ns.jinja_extension)
  File "xyz/lib/assets.py", line 26, in load_from_templates
    return Jinja2Loader(env, template_dirs, [jinja2_env], jinja_ext=jinja_extension).\
  File "/home/manuel/.virtualenvs/webapp/lib/python2.7/site-packages/webassets/ext/jinja2.py", line 218, in load_bundles
    bundles.extend(self.with_file(filename, self._parse) or [])
  File "/home/manuel/.virtualenvs/webapp/lib/python2.7/site-packages/webassets/loaders.py", line 301, in with_file
    return then_run(filename, contents)
  File "/home/manuel/.virtualenvs/webapp/lib/python2.7/site-packages/webassets/ext/jinja2.py", line 246, in _parse
    _recurse_node(node)
  File "/home/manuel/.virtualenvs/webapp/lib/python2.7/site-packages/webassets/ext/jinja2.py", line 244, in _recurse_node
    _recurse_node(node)
  File "/home/manuel/.virtualenvs/webapp/lib/python2.7/site-packages/webassets/ext/jinja2.py", line 237, in _recurse_node
    *AssetsExtension.resolve_contents(files.as_const(), self.asset_env),
  File "/home/manuel/.virtualenvs/webapp/lib/python2.7/site-packages/jinja2/nodes.py", line 490, in as_const
    return [x.as_const(eval_ctx) for x in self.items]
  File "/home/manuel/.virtualenvs/webapp/lib/python2.7/site-packages/jinja2/nodes.py", line 561, in as_const
    obj = self.node.as_const(eval_ctx)
  File "/home/manuel/.virtualenvs/webapp/lib/python2.7/site-packages/jinja2/nodes.py", line 604, in as_const
    obj = self.node.as_const(eval_ctx)
  File "/home/manuel/.virtualenvs/webapp/lib/python2.7/site-packages/jinja2/nodes.py", line 365, in as_const
    raise Impossible()
jinja2.nodes.Impossible

I'm going to try debug this but i'm not sure why as_const gets called on a Expr node with abstract=False.. anyone seen this already?

Ok, looks like assets arguments in templates MUST be hardcoded strings, for instance, this will fail:
{% set bundlename = 'bundle_js_theme_flipzord' %}
{% assets bundlename %}
<script rel="script" type="text/javascript" src="{{ ASSET_URL }}"></script>
{%- endassets %}

..but this will work fine:
{% assets 'bundle_js_theme_flipzord' %}
<script rel="script" type="text/javascript" src="{{ ASSET_URL }}"></script>
{%- endassets %}

I would say this is the expected behaviour. The loader tries to find the assets tag and reads the name, but it doesn't actually execute the template.
Possible there could be a way around this (executing the template while replacing the tag with a "capture' utility), the question is if it's worth it.


fix(autoware_pointcloud_preprocessor): fix unusedFunction

Description
This is a fix based on cppcheck unusedFunction warnings.
sensing/autoware_pointcloud_preprocessor/src/downsample_filter/robin_hood.h:344:0: style: The function 'rotr' is never used. [unusedFunction]
T rotr(T x, unsigned k)
^

sensing/autoware_pointcloud_preprocessor/src/downsample_filter/robin_hood.h:1935:0: style: The function 'emplace_hint' is never used. [unusedFunction]
  iterator emplace_hint(const const_iterator & position, Args &&... args)
^

sensing/autoware_pointcloud_preprocessor/src/downsample_filter/robin_hood.h:2180:0: style: The function 'rehash' is never used. [unusedFunction]
  void rehash(size_t c)
^

sensing/autoware_pointcloud_preprocessor/src/downsample_filter/robin_hood.h:2196:0: style: The function 'compact' is never used. [unusedFunction]
  void compact()
^

sensing/autoware_pointcloud_preprocessor/src/downsample_filter/robin_hood.h:2234:0: style: The function 'max_load_factor' is never used. [unusedFunction]
  float max_load_factor() const noexcept
^

sensing/autoware_pointcloud_preprocessor/src/downsample_filter/robin_hood.h:2241:0: style: The function 'load_factor' is never used. [unusedFunction]
  float load_factor() const noexcept
^

Related links
Parent Issue:

Link

How was this PR tested?
Notes for reviewers
None.
Interface changes
None.

Effects on system behavior
None.

@yukkysaito could you take a look at this pr?


Fixed Resize issue in description of activities [continuation from 1366]

@llaske
Fixed the resize issue, will close #1366 , since it had lot of issues ( created fresh PR ), was one of my firsrt PRs, thanks for your guidance on the issue at that time
Could you please review it here

Not sure to understand why you've done 2 PR.

Not sure to understand why you've done 2 PR.

Actually the time, I raised the first PR, I was new so used master branch, so now these activities are not present in that fork, that is what is raising conflicts, there, so
It was easier if you merge this and close that one

So please close the one you want.

@llaske, closed the previous one

Nice. Thanks @Vishalk91-4


Team selection

Description
As a teammate working in several teams, I want to select the team I am working in today in order to make my declaration in the good team
Additional informations
Teams will be affected by captains
Team list will be provided once the teammate is connected

ticked already in the work #249,  this one is a duplicate


[core] Merge options in experimentalStyled

BREAKING CHANGE
The options inside the experimentalStyled are now merged under one object.
-experimentalStyled(Button, { shouldForwardProp: (prop) => prop !== 'something' }, { skipSx: true })(...);
+experimentalStyled(Button, { shouldForwardProp: (prop) => prop !== 'something', skipSx: true })(...);

Going to merge to avoid updating on each commit. @siriwatknp please update the remaining PRs for migrating components considering this change.
Thanks for the quick review @eps1lon 🙏


Updating Functions

Updating functions from Y→N.

The app has issues with merging, it has been fixed on a42bccb.


Category does not exist

Hi!
I'm currently doing your tutorial, I'm on Day 7 (you need to add your missing comma on your tutorial right before $page on CategoryController.php on function show() ).
I have currently an issue, when I go to the main page ("/") it says that none of the methods like activeJobs() exists and have a public access in class App\Entity\Category.
Do you have a fix for this ?  Thank you!

Closing the issue, I've found the fix!

@liloo2040 what was the problem? Do you have any suggestions to improve the guide, somebody not to have the same problem?

@liloo2040  confess to us!

I had issues, I found them and fixed them.


docs(guide/Running in Production): Typo fix

What kind of change does this PR introduce? (Bug fix, feature, docs update, ...)
Docs updates.
What is the current behavior? (You can also link to an open issue here)
Text reads 'using any 3rd part library'.
What is the new behavior (if this is a feature change)?
Text will read 'using any 3rd party library'.
Does this PR introduce a breaking change?
No.
Please check if the PR fulfills these requirements

[ ] The commit message follows our guidelines: https://github.com/angular/angular.js/blob/master/CONTRIBUTING.md#commit-message-format
[ ] Tests for the changes have been added (for bug fixes / features)
[ ] Docs have been added / updated (for bug fixes / features)

Other information:
Updates text 'using any 3rd part library' to 'using any 3rd party library'.

I signed it!


UAA is not requesting openid scope from external oidc identity provider

What version of UAA are you running?
74.15.0
What output do you see from curl <YOUR_UAA>/info -H'Accept: application/json'
{
  "app": {
    "version": "74.15.0"
  },
  "showLoginLinks": true,
  "links": {
    "uaa": "https://uaa.*******.com",
    "login": "https://login.*******.com"
  },
  "zone_name": "uaa",
  "entityID": "uaa.*******.com",
  "commit_id": "1c19ffc",
  "idpDefinitions": {
  },
  "prompts": {
    "username": [
      "text",
      "Username"
    ],
    "password": [
      "password",
      "Password"
    ],
    "passcode": [
      "password",
      "Temporary Authentication Code ( Get one at https://login.xxxxxx.com/passcode )"
    ]
  },
  "timestamp": "2020-02-27T20:24:00+0000"
}

How are you deploying the UAA?
I am deploying the UAA

using cf-deployment

What did you do?
Configured an external IDP [Keycloak] via bosh.
Registerd IDP output:
uaac curl -k /identity-providers?rawConfig=true
{
  "type": "oidc1.0",
  "config": {
    "emailDomain": [
      "<REDACTED>"
    ],
    "additionalConfiguration": null,
    "providerDescription": null,
    "externalGroupsWhitelist": [
    ],
    "attributeMappings": {
      "given_name": "given_name",
      "family_name": "family_name",
      "email": "email",
      "user_name": "username"
    },
    "addShadowUserOnLogin": true,
    "storeCustomAttributes": true,
    "authUrl": null,
    "tokenUrl": null,
    "tokenKeyUrl": null,
    "tokenKey": "-----BEGIN PUBLIC KEY-----<REDACTED>-----END PUBLIC KEY-----\n",
    "linkText": "Log in with OIDC Identity Provider",
    "showLinkText": true,
    "clientAuthInBody": true,
    "skipSslValidation": false,
    "relyingPartyId": "<REDACTED>",
    ""relyingPartySecret": "<REDACTED>",
    "scopes": [
      "openid",
      "profile",
      "email"
    ],
    "issuer": null,
    "responseType": "code",
    "userInfoUrl": null,
    "discoveryUrl": "https://<redacted>/auth/realms/<realm>/.well-known/openid-configuration",
    "passwordGrantEnabled": true,
    "setForwardHeader": true,
    "prompts": [
      {
        "name": "username",
        "type": "text",
        "text": "OIDC Username"
      },
      {
        "name": "password",
        "type": "password",
        "text": "OIDC Password"
      },
      {
        "name": "passcode",
        "type": "password",
        "text": "Authenticator App One Time Passcode if using --origin oidc"
      }
    ]
  },
  "id": "<REDACTED>",
  "originKey": "oidc",
  "name": "UAA Oauth Identity Provider[oidc]",
  "version": 52,
  "created":<PHONE_NUMBER>000,
  "last_modified":<PHONE_NUMBER>000,
  "active": true,
  "identityZoneId": "uaa"
},
....

Login via web browser https://login.******.com, get redirected to IDP, enter username/password, get redirected back to CF Login, shadow  user gets created in UAA under origin oidc as expect.  All good! (This flow uses authorization_code)
Try this flow via cf login -u<EMAIL_ADDRESS>--origin oidc does not return an id_token.  (This flow use direct_grant/grant_type=password)
Authenticating...
REQUEST: [2020-04-21T16:15:06-07:00]
POST /oauth/token?login_hint=%7B%22origin%22%3A%22oidc%22%7D HTTP/1.1
Host: login.******.com
Accept: application/json
Authorization: [PRIVATE DATA HIDDEN]
Connection: close
Content-Type: application/x-www-form-urlencoded
User-Agent: cf/6.51.0+2acd15650.2020-04-07 (go1.13.8; amd64 linux)
[PRIVATE DATA HIDDEN]

RESPONSE: [2020-04-21T16:15:07-07:00]
HTTP/1.1 401 Unauthorized
Cache-Control: no-store
Content-Length: 111
Content-Type: application/json
Date: Tue, 21 Apr 2020 23:15:07 GMT
Pragma: no-cache
Strict-Transport-Security: max-age=31536000 ; includeSubDomains
Www-Authenticate: Basic realm="UAA/client", error="unauthorized", error_description="Could not obtain id_token from external OpenID Connect provider."
X-Content-Type-Options: nosniff
X-Frame-Options: DENY
X-Vcap-Request-Id: 68db6b65-4cc2-4533-7241-d2ea438cc992
X-Xss-Protection: 1; mode=block
{
  "error": "unauthorized",
  "error_description": "Could not obtain id_token from external OpenID Connect provider."
}

Could not obtain id_token from external OpenID Connect provider.

What did you expect to see? What goal are you trying to achieve with the UAA?
Expected to get back an id_token and be authenticated.
Debugging the incoming request on the IDP I expect to see scope=openid included in the form POST
POST /auth/realms/<realm>/protocol/openid-connect/token HTTP/1.1
X-Forwarded-For: <cf login client ip>, <uaa source ip>
X-Forwarded-Proto: https
X-Forwarded-Port: 443
Host: <idp host>
Content-Length: 104
Accept: application/json
Content-Type: application/x-www-form-urlencoded;charset=UTF-8
Authorization: Basic <base64 client id/secret>
User-Agent: Apache-HttpClient/4.5.11 (Java/11.0.6)
Accept-Encoding: gzip,deflate

grant_type=password&scope=openid&response_type=id_token&username=<user email>&password=<password>  (<---added scope param as expected)

What did you see instead?
I see the cf login request making it to the configured IDP, but the scope parameter is missing which is needed to get back back an id_token.  An access_token and refresh_token are returned however.
Please include UAA logs if available.
==> data/sys/log/uaa/uaa.log <==
[2020-04-21 23:35:17.000] uaa - 16 [https-jsse-nio-8443-exec-3] ....  INFO --- Audit: ClientAuthenticationSuccess ('Client authentication success'): principal=cf, origin=[remoteAddress=<X.X.X.X>, clientId=cf], identityZoneId=[uaa]

==> data/sys/log/uaa/uaa.log <==
[2020-04-21 23:35:17.176] uaa - 16 [https-jsse-nio-8443-exec-3] ....  INFO --- Audit: IdentityProviderAuthenticationFailure ('<REDACTED>'): principal=null, origin=[remoteAddress=<X.X.X.X>, clientId=cf], identityZoneId=[uaa], authenticationType=[oidc1.0]

I can reproduce whether or not I get an id_token back from my idp by directly query my IDP  with or without the scope=openid.  Include the scope=openid, I get access_token, refresh_token, id_token. Without scope param, I don't get a id_token in the response.
Poking around the code I'm wondering if simply adding the scopes param here would make sense.
https://github.com/cloudfoundry/uaa/blob/v74.15.0/server/src/main/java/org/cloudfoundry/identity/uaa/authentication/manager/PasswordGrantAuthenticationManager.java#L157

To narrow down the issue a bit more, I've reproduced this on a local instances of uaa.
curl \
-u cf: \
-H 'Accept: application/json' \
-H 'Content-Type: application/x-www-form-urlencoded' \
-X POST 'http://localhost:8080/uaa/oauth/token?login_hint=%7B%22origin%22%3A%22<IDP>%22%7D' \
-d 'grant_type=password&password=<PASSWORD>&username=<USERNAME>'

{"error":"unauthorized","error_description":"Could not obtain id_token from external OpenID Connect provider."}

 I can't say for sure, I think this may be by design.  The password grant should only be used in special trusted situations. Generally the authorization_code flow is more appropriate for authentication.
I believe you can make the cf cli use the authorization_code grant by supplying the --sso flag to cf login

@shamus Thanks for the reply.   The cf login --sso prompts for a uaa minted passcode, which, to obtain would take me to uaa login page using a browser flow.  From there I can authenticate with my IDP and get the passcode.   So yes, this would use authorization_code and works, but it does not provide a direct cli path to login. I'd expect the UAA to be trusted for the IDP defined in the UAA config and other login methods pass in credentials to UAA.
I'd think any scopes defined in the IDP UAA config, would get passed along in the request during authentication:
https://github.com/cloudfoundry/uaa/blob/v74.17.0/uaa/src/main/resources/uaa.yml#L345
That being said, if I'm misunderstanding something, do you have any recent documentation and examples of login flows that would make this more clear.  I'm trying to have parity with my current UAA/LDAP login flow, but rather than direct to uaa/ldap, use an identity provider that can support various mfa options (otp, yubikey, etc). (ultimately backed by the same ldap user store).

Sorry for the delay in response. Could you provide some clarification around what you mean by "a direct cli path to login."? What's the use case?

Closing due to lack of activity.

@shamus Likewise sorry for the delayed response.  By "direct cli path to login", like I mentioned would be
cf login -u<EMAIL_ADDRESS>--origin <oidc idp>
My use case is to simply to login to CloudFoundry using the cf-cli with an oidc IDP configured for authentication.


add support for ARTICLE command

Support for ARTICLE command.
https://tools.ietf.org/html/rfc3977#section-6.2.1
Plus updated tests

Coverage increased (+0.4%) to 82.105% when pulling 3975a5dc3816749d91d6a5c76264565ab7fd1bc6 on mattpage:master into e01a8afdb2c2946d32c18e3b6592b1ab2482ef81 on robinvdvleuten:master.

@mattpage I merge it in for now. The whole library could get some cleaning, so maybe I'll put some effort in it for the upcoming weeks to make it more future-proof with some async / promise sugar.

@robinvdvleuten thanks! I agree about the cleanup. I promisified it with a wrapper in my client, so a newer version that supported promises directly would be great.


Feature Request: Support opening plugin folder in Finder

Is your feature request related to a problem? Please describe.
Currently there are a few options with the op command, e.g. opening the plugin configuration pane. Is it possible to open the plugin folder in Finder?
Describe the solution you'd like
Support opening the plugin folder in Finder.

easy enough, will be implemented in the next release. 👍

ok, not super simple actually, because all the "space" for the modifier keys is already used up 😅
Therefore, will probably will the part of the release after the next. However, you can use oplugin to open the plugin folder in general in the meantime.

Implemented in release 2.1 via the new Settings Search. :)

Thanks for the update!
I tried to use o, but it gave me the following errors from the debug console:
[13:25:26.212] Shimmering Obsidian[Script Filter] Queuing argument '(null)'
[13:25:26.533] Shimmering Obsidian[Script Filter] Script with argv '(null)' finished
[13:25:26.534] ERROR: Shimmering Obsidian[Script Filter] Code 1: /Users/xx/Library/Application Support/Alfred/Alfred.alfredpreferences/workflows/user.workflow.D29ABBD5-F375-4C89-B556-DF4C2B2E5309/scripts/setting-search.js: execution error: Error: SyntaxError: JSON Parse error: Unexpected EOF (-2700)

Then it directed me to Search Google for 'o,'.

Have you updated to the newest version of the Advanced URI Plugin (which is needed for this)?
Also what exactly led to the error – trying to open a plugin's local folder or using the o, search in general?

I am using version 1.14.0 of the Advanced URI plugin. It should be the latest version.
Whenever I type o,, I see the error.

Are you developing a plugin of your own or are you using beta plugins (= not downloaded via the community store)?

Yes, I am using beta plugins in a vault that Shimmering Obsidian is configured for. One is the Calendar plugin:
https://github.com/liamcain/obsidian-calendar-plugin/releases/tag/2.0.0-beta.2
Another one is not publicly available.
I have some other beta plugin in other vaults that Shimmering Obsidian are not configured for.

I have some other beta plugin in other vaults that Shimmering Obsidian are not configured for.

Okay, found the issue, it's beta plugins where the developer hasn't released a file called manifest.json yet which is causing the trouble. Those files contain metadata for plugins that the settings search utilizes.
It should be fixed in hotfix-release 2.1.1.
(Only minor issue that the plugin's name cannot be properly displayed – the dev of the beta plugin where this is the case needs to add a manifest.json for it to work.)

It seems that one cannot open the setting page of such a beta plugin? E.g. the calendar plugin I posted above.

yep, that's a restriction cause the beta plugin doesn't have all the necessary information needed for that yet.

Okay then. Thanks for the clarification.


Support the ability to create the same ECR Repository in multiple regions

What problem are you facing?
Currently it is not possible to manage ECR repositories in multiple regions with the same name from a single k8s cluster.
I feel it is a very common configuration for teams operating in multiple aws regions to have ECR replication enabled so that images pushed to one region get replicated to other regions.
Because the name of the ECR repo is tied to the name of the k8s object I cant create the same repo in multiple regions.
How could Crossplane help solve your problem?
I'm thinking the best path forward would be to add a new property to the forProvider object called something like awsName.
This would allow you to have 2 objects with different names and regions, but the same awsName resulting in the same repository being created in multiple regions.
for example:
apiVersion: ecr.aws.crossplane.io/v1beta1
kind: Repository
metadata:
  name: repo1-us-east-2
spec:
  forProvider:
    awsName: repo1
    region: us-east-2
---
apiVersion: ecr.aws.crossplane.io/v1beta1
kind: Repository
metadata:
  name: repo1-us-west-2
spec:
  forProvider:
    awsName: repo1
    region: us-west-2

You can do this using a Composition by patching the desired name into the crossplane.io/external-name label on the managed resource to specify the name used in AWS.  The Repository objects would have unique names generated by the Composition, but the MRs can use the names you want in AWS.

See the note following this section - https://docs.crossplane.io/latest/concepts/compositions/#template-a-managed-resource

Thank @bobh66 I didnt know we could already external-name annotation for this, very helpful for these kinds of regional resources.
I was already wrapping these repos in a helm chart so it made more sense to include the overwrite of the annotation in the helm chart rather than using compositions and or functions.
For the curious heres a snippet:
{{- $root := . -}}
{{- range $region := .Values.regions -}}
{{- range $repo := $root.Values.repositories }}
apiVersion: ecr.aws.crossplane.io/v1beta1
kind: Repository
metadata:
  name: {{ $repo.name }}-{{ $region }}
  annotations:
    crossplane.io/external-name: {{ $repo.name }}
spec:
  deletionPolicy: {{ $root.Values.deletionPolicy }}
  forProvider:
    region: {{ $region }}
  providerConfigRef:
    name: aws-provider-config
---
{{- end }}
{{- end }}


feat: Enable proxy: ChargeOver

Testing
GET
URL:
POST
URL:
Invalid requests
Pagination
###page1
###page2
Successful console operation (operation & events)
Failed console operation (operation & events)

I wasn’t asked to input my workspace anywhere(value is ampersand-staging). an issue with mail monkey

closing for now since it's blocked


First draft of Add Event Form

I would appreciate @Caleb-Cohen @intelagense and anyone else's thoughts on the form.
I will be changing the input for Recurring Dates and adding the Success pg tomorrow.

@InstincDev great work! Do we need to keep the .EJS files or can we remove them from this PR?

Thanks. The EJS can be deleted or I will in the morning.  I forgot about them once I got everything working.


about deleting comments

the comments cannot be deleted by DELETE botton and when user send comments there lacks a clearing to prevent user from sending repeated contents.

the comments cannot be deleted by DELETE botton

In Progress

when user send comments there lacks a clearing to prevent user from sending repeated contents.

will fix in #190


[channels,location] implement client stub channel

to fix issues with RDP files that request the location channel provide a stub channel.
@pnowack do you know by chance if there is a simple library we can use or will this have to be a per platform imlementation to actually get the location?

@pnowack do you know by chance if there is a simple library we can use

There is geoclue for this. It is actually horrible for the server side, because it is a system service and thus having per (remote-) user session location is currently impossible with that. But for the client side, it should be okay-ish for now.

@pnowack will keep that for a second pull request as geoclue is linux only?
with this pr we should have the channel up and running, the client just needs to hook up the LocationStart and LocationStop routines and send LocationSend in  between.


Give handleAddition and handleDelete default props

When readOnly is true, both handleAddtion and handleDelete are unused. Provide a noop function as a default prop and remove the requirement for them to be provided.
Fixes #303

@jpbufe3 since you made these props optional can you also remove them from tests as its passed as noop which is now taken care in the component itslef


Deploy imagebuilding feature on the NASA VEDA Hub

To make progress towards https://github.com/NASA-IMPACT/veda-jupyterhub/issues/58, we should deploy the imagebuilding feature on the NASA VEDA hub.
Definition of done

[x] NASA VEDA JupyterHub has imagebuilding feature deployed

Resources

Our documentation on enabling this: https://infrastructure.2i2c.org/howto/features/imagebuilding/
PR partially enabling this https://github.com/2i2c-org/infrastructure/pull/4988

Deployed


[Identity] Support multiple versions of the DefaultAzureCredential

The DefaultAzureCredential should allow users to specify what version of the credential chain they want to pick. This can be done by passing a version property through the constructor.

We haven't made agreements here, and this isn't part of the blocking issues for the September release, so I'm thinking on moving this out of this release.
cc: @jonathandturner @ramya-rao-a

Closing issue.  Will reevaluate based on customer feedback for all languages


Fix 0 frames being read during SVO read

At the moment, with the current ZED SDK, nbFrames is always zero when when reading from an SVO file, as zed.open() has not yet been called.
This code moves the nbFrames calculation to after zed.open() has been called, fixing the problem ansd allowing zed-save-depth to work on SVO files with the latest SDK.

Thanks for your contribution!


Ct unstable

:tada: This PR is included in version 1.3.1 :tada:
Your semantic-release bot :package::rocket:


Add site-wide app to display enabled features

Is your feature request related to a problem? Please describe.
It's sometimes hard to track down which features are enabled in a VarFish site and which are not.
Describe the solution you'd like
Add a simple site-wide app to display the features. Alternatively, adjust the database info app to display this.
Describe alternatives you've considered
N/A
Additional context
N/A

This would be best implemented through an additional feature in sodar-core. Postponing.


make File._file_size big enough (for files larger than ~2Gb)

Merge this after merging #1021.

@skirsdeda could you rebase on current develop and update the migration? Thanks!

@yakky done.

Thanks @skirsdeda


Fix mime-type detection for HTTP server

As the title, all information is in the comment.
Closes #18347

https://github.com/go-gitea/gitea/issues/18347

// detectWellKnownMimeType will return the mime-type for a well-known file ext name
// The purpose of this function is to bypass the unstable behavior of Golang's mime.TypeByExtension
// mime.TypeByExtension would use OS's mime-type config to overwrite the well-known types (see its document).
// If the user's OS has incorrect mime-type config, it would make Gitea can not respond a correct Content-Type to browsers.
// For example, if Gitea returns `text/plain` for a `.js` file, the browser couldn't run the JS due to security reasons.
// detectWellKnownMimeType makes the Content-Type for well-known files stable.

if we should be using an external package for this.

IMO, this feature is very trivial, not worthy to introduce a new mime package. And usually we do not need to update the mime types frequently.


Cannot install on Windows

I am running Win10 with the anaconda dist of python 3.6 and have the MS build tools and compiler installed.  I pip install the pdftotext package.  Installation begins and then terminates with this message:
pdftotext.cpp(3): fatal error C1083: Cannot open include file: 'poppler/cpp/poppler-document.h': No such file or directory

Any ideas?

You would need to get poppler and its development files installed on Windows. I don't use Windows, so I am not much help, sorry.
If you figure something out, I will gladly add it to the README here!

Thanks.  I am researching this but have not found any good guidance.  I will report back my findings.

Any updates on this problem? I happen to have this same thing.

No, I didn’t. My solution ended up being in a completely different direction, using different packages.  This may be worth a mention in the README file for future Windows (10) users.

All hope is not lost on the windows version.   There is a command line utility with the same name and you can use the subprocess package to execute pdftotext
PDFtotext windows download instruction, credit @s2t2

Go to https://www.xpdfreader.com/download.html and click "Download the Xpdf tools"
Uncompress/extract the zip file, and move the folder to a location like the Desktop or the Programs directory.
Inside the unzipped folder, copy the file bin64/pdftotext.exe into your project repository

3. Inside the unzipped folder, copy the file bin64/pdftotext.exe into your project repository

You mean that it can be used from windows command prompt but not python?

Inside the unzipped folder, copy the file bin64/pdftotext.exe into your project repository

You mean that it can be used from windows command prompt but not python?

just copy files bin64/*.exe to your PYTHON PATH directory

Any chance of prebuilt binaries being offered? Is it something that could be integrated into the CI setup?

I "ugly" installed pdftotext successfully on windows three times over the past two days, as the subprocess method is a non-starter for me. I have a writeup on SO
https://stackoverflow.com/questions/45912641/unable-to-install-pdftotext-on-python-3-6-missing-poppler/58139729#58139729
as well as on my blog, which has screenshots
https://coder.haus/2019/09/27/installing-pdftotext-through-pip-on-windows-10/
Please try this, let me know if it works. I'm hoping to take time to do it properly and potentially generate a PR.
My solution requires Anaconda (for conda install).  First, install Microsoft VC++ build tools, download poppler for windows as well as conda install poppler, and copy some of the poppler files to different locations in the Anaconda directory structure.  Again, I have done this a total of 3 times and know it can be done better, but this will get you up and running.

I needed to apply this diff, then it worked for me:
diff --git a/setup.py b/setup.py
index 4c0e861..8a7337a 100644
--- a/setup.py
+++ b/setup.py
@@ -29,8 +29,8 @@ elif platform.system() in ["Windows"]:
         print("ERROR: CONDA_PREFIX is not found.")
         print("       Install Anaconda or fix missing CONDA_PREFIX and try again.")
         sys.exit(1)
-    anaconda_poppler_include_dir = path.join(conda_dir, "Library\include")
-    anaconda_poppler_library_dir = path.join(conda_dir, "Library\lib")
+    anaconda_poppler_include_dir = path.join(conda_dir, r"Library\include")
+    anaconda_poppler_library_dir = path.join(conda_dir, r"Library\lib")
     include_dirs = [anaconda_poppler_include_dir]
     library_dirs = [anaconda_poppler_library_dir]
 else:

@zacps I don't understand what your diff changes. Does it just change the strings into raw strings, or am I missing something? There are no escape characters, so aren't both versions equal?
$ python
>>> r"Library\include" == "Library\include"
True

\i is an invalid escape sequence, but now that I think about it I'm not sure why it changed anything.

Thank you so much @woodsjs for your blog post!
Just a quick update I would add:
When running pip install it's looking at the files inside my python3.6 libs folder and not the conda libs folder, so for me it worked when I copied the poppler-cpp.lib file into the AppData/Local/Programs/Python/Python36/libs folder.

Thanks for this, Katia! I've updated the post to point to the possibility of the file living in the Python/Python{PythonVersion}/libs directory.

@woodsjs I finally set up appveyor and pushed a release including your changes from #47: https://pypi.org/project/pdftotext/2.1.3/ . I hope it's nicer for Windows/conda users now. Thanks again!

@jalan It looks like you have yet to upload the Windows binaries to pypi so Windows users can get them!

@GadgetSteve ?
I didn't say I was planning to upload any Windows binaries

I have had the hardest time installing pdftotext on my windows 10. Found @woodsjs page very useful as those were the exact errors I got. Finally I got it successfully installed but my PyCharm is not recognizing and giving :
ImportError: DLL load failed while importing pdftotext: The specified module could not be found.
I see inside site-packages that pip install doesn't download the jar file, maybe that is the problem. Please please someone help me out. Spent 2 days on this thing.

@palakjadwani this is the problem with there not being a binary download for the pdtotext package - you can find some workarounds at http://faculty.washington.edu/jwilker/559/2018/pdftotext.pdf but they are less than ideal.

@palakjadwani If you can see the package using the anaconda prompt (you can, correct?), this more than likely has NOTHING to do with the install of pdftotext. This is most likely because your pycharm install is not using the interpreter, conda, that you installed pdftotext under.
See Jetbrains documentation on changing your interpreter https://www.jetbrains.com/help/pycharm/configuring-python-interpreter.html?_ga=2.75189201.2125986240.1606050657-56391306.1606050657#interpreter  You would add your existing anaconda environment.
I've tested this, as I do not use PyCharm, and was able to add my anaconda environment and get access to pdftotext.  I would also suggest shutting pycharm down and restarting to make the new interpreter active.

I have the wheel file of the pdftotext for cp38 version 3.8.5 64 bit.
Just go to power shell and do
cd [Location of the file]
pip install ./[Wheel file [name]
Or
py -3.8 -m pip install ./[Wheel file name]
I am also attaching poppler files so you can extract these files in python destination folder.
pdftotext.zip

I have the wheel file of the pdftotext for cp38 version 3.8.5 64 bit.
Just go to power shell and do
cd [Location of the file]
pip install ./[Wheel file [name]
Or
py -3.8 -m pip install ./[Wheel file name]
I am also attaching poppler files so you can extract these files in python destination folder.
pdftotext.zip

I have the wheel file of the pdftotext for cp38 version 3.8.5 64 bit.
Just go to power shell and do
cd [Location of the file]
pip install ./[Wheel file [name]
Or
py -3.8 -m pip install ./[Wheel file name]
I am also attaching poppler files so you can extract these files in python destination folder.
pdftotext.zip

If any one have the wheel of pdftotext of version cp39 64 bit kindly share it.

I have the wheel file of the pdftotext for cp38 version 3.8.5 64 bit.
Just go to power shell and do
cd [Location of the file]
pip install ./[Wheel file [name]
Or
py -3.8 -m pip install ./[Wheel file name]
I am also attaching poppler files so you can extract these files in python destination folder.
pdftotext.zip

If any one have the wheel of pdftotext of version cp39 64 bit kindly share it.

Now I have the latest wheel file. version 39 64 Bit
pdftotext.zip

Now I have the latest wheel file. version 39 64 Bit
pdftotext.zip

hey! trying to install this i get the following error with 3.9:
(venv) (dir)>python -m pip install ./pdftotext-2.1.5-cp39-cp39-win_amd64.whl
Processing (dir)\pdftotext-2.1.5-cp39-cp39-win_amd64.whl
Installing collected packages: pdftotext
Successfully installed pdftotext-2.1.5

(venv) (dir)>python (script).py
Traceback (most recent call last):
  File "(dir)\(script).py", line 11, in <module>
    import pdftotext
ImportError: DLL load failed while importing pdftotext: The specified module could not be found.

(venv) (dir)>pip freeze
(misc modules)
pdftotext @ file:///C:/Users/tct/dev/konya.balazs/vub-pdf2xlsx-gui/pdftotext-2.1.5-cp39-cp39-win_amd64.whl
(misc modules)

Have you come across this already? Do you have any idea how to remedy the situation?
Thank you very much beforehand.

hey! trying to install this i get the following error with 3.9:
(venv) (dir)>python -m pip install ./pdftotext-2.1.5-cp39-cp39-win_amd64.whl
Processing (dir)\pdftotext-2.1.5-cp39-cp39-win_amd64.whl
Installing collected packages: pdftotext
Successfully installed pdftotext-2.1.5

(venv) (dir)>python (script).py
Traceback (most recent call last):
  File "(dir)\(script).py", line 11, in <module>
    import pdftotext
ImportError: DLL load failed while importing pdftotext: The specified module could not be found.

(venv) (dir)>pip freeze
(misc modules)
pdftotext @ file:///C:/Users/tct/dev/konya.balazs/vub-pdf2xlsx-gui/pdftotext-2.1.5-cp39-cp39-win_amd64.whl
(misc modules)

Have you come across this already? Do you have any idea how to remedy the situation?
Thank you very much beforehand.

Hey!
I have come across the following while trying to install it:
(venv) (dir)>python -m pip install ./pdftotext-2.1.5-cp39-cp39-win_amd64.whl
Processing (dir)\pdftotext-2.1.5-cp39-cp39-win_amd64.whl
Installing collected packages: pdftotext
Successfully installed pdftotext-2.1.5

(venv) (dir)>python (script).py
Traceback (most recent call last):
  File "(dir)\(script).py", line 11, in <module>
    import pdftotext
ImportError: DLL load failed while importing pdftotext: The specified module could not be found.

(venv) (dir)>pip freeze
(misc modules)
pdftotext @ file:///(drive):/(dir)/pdftotext-2.1.5-cp39-cp39-win_amd64.whl
(misc modules)

Do you have any idea what could be causing this?
Any help would be greatly appreciated.

Hey!
I have come across the following while trying to install it:
(venv) (dir)>python -m pip install ./pdftotext-2.1.5-cp39-cp39-win_amd64.whl
Processing (dir)\pdftotext-2.1.5-cp39-cp39-win_amd64.whl
Installing collected packages: pdftotext
Successfully installed pdftotext-2.1.5

(venv) (dir)>python (script).py
Traceback (most recent call last):
  File "(dir)\(script).py", line 11, in <module>
    import pdftotext
ImportError: DLL load failed while importing pdftotext: The specified module could not be found.

(venv) (dir)>pip freeze
(misc modules)
pdftotext @ file:///(drive):/(dir)/pdftotext-2.1.5-cp39-cp39-win_amd64.whl
(misc modules)

Do you have any idea what could be causing this?
Any help would be greatly appreciated.

There is possibly the error in the environment.
Try to run it in anaconda Or install it in anaconda prompt.
If the problem persists then you can use PyPDF2 as the pdf extractor.
Else There could be issues in the installation of poppler.
I am also finding the solution.
You can also refer to the Coder Haus blog on this.
If you find the solution then please let me know.
On Mon, 18 Jan 2021 at 16:32, polyspastos<EMAIL_ADDRESS>wrote:

Hey!
I have come across the following while trying to install it:
(venv) (dir)>python -m pip install ./pdftotext-2.1.5-cp39-cp39-win_amd64.whl
Processing (dir)\pdftotext-2.1.5-cp39-cp39-win_amd64.whl
Installing collected packages: pdftotext
Successfully installed pdftotext-2.1.5
(venv) (dir)>python (script).py
Traceback (most recent call last):
File "(dir)(script).py", line 11, in
import pdftotext
ImportError: DLL load failed while importing pdftotext: The specified module could not be found.
(venv) (dir)>pip freeze
(misc modules)
pdftotext @ file:///(drive):/(dir)/pdftotext-2.1.5-cp39-cp39-win_amd64.whl
(misc modules)
Do you have any idea what could be causing this?
Any help would be greatly appreciated.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/jalan/pdftotext/issues/16#issuecomment-762172363, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/ASLD7K2H27CNGAE63DBLUNTS2QILHANCNFSM4EV2LW6A
.

There is possibly the error in the environment.
Try to run it in anaconda Or install it in anaconda prompt.
If the problem persists then you can use PyPDF2 as the pdf extractor.
Else There could be issues in the installation of poppler.
I am also finding the solution.
You can also refer to the Coder Haus blog on this.
If you find the solution then please let me know.
On Mon, 18 Jan 2021 at 16:32, polyspastos<EMAIL_ADDRESS>wrote:

Hey!
I have come across the following while trying to install it:
(venv) (dir)>python -m pip install ./pdftotext-2.1.5-cp39-cp39-win_amd64.whl
Processing (dir)\pdftotext-2.1.5-cp39-cp39-win_amd64.whl
Installing collected packages: pdftotext
Successfully installed pdftotext-2.1.5
(venv) (dir)>python (script).py
Traceback (most recent call last):
File "(dir)(script).py", line 11, in
import pdftotext
ImportError: DLL load failed while importing pdftotext: The specified module could not be found.
(venv) (dir)>pip freeze
(misc modules)
pdftotext @ file:///(drive):/(dir)/pdftotext-2.1.5-cp39-cp39-win_amd64.whl
(misc modules)
Do you have any idea what could be causing this?
Any help would be greatly appreciated.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/jalan/pdftotext/issues/16#issuecomment-762172363, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/ASLD7K2H27CNGAE63DBLUNTS2QILHANCNFSM4EV2LW6A
.

I suspect that you need to have the poppler bin directory on your path for it to work. This is probably why the pdftotext.zip that had the wheel in also had poppler-0.68.0_x86 (1).7z in it. You will need to use 7-zip to extract this and add the_location_that_you_extract_to\bin to your path.
Hope that helps.
From: GodMakesMe<EMAIL_ADDRESS>Sent: 18 January 2021 12:26
To: jalan/pdftotext<EMAIL_ADDRESS>Cc: Steve (Gadget) Barnes<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [jalan/pdftotext] Cannot install on Windows (#16)
There is possibly the error in the environment.
Try to run it in anaconda Or install it in anaconda prompt.
If the problem persists then you can use PyPDF2 as the pdf extractor.
Else There could be issues in the installation of poppler.
I am also finding the solution.
You can also refer to the Coder Haus blog on this.
If you find the solution then please let me know.
On Mon, 18 Jan 2021 at 16:32, polyspastos <notifications<EMAIL_ADDRESS>wrote:

Hey!
I have come across the following while trying to install it:
(venv) (dir)>python -m pip install ./pdftotext-2.1.5-cp39-cp39-win_amd64.whl
Processing (dir)\pdftotext-2.1.5-cp39-cp39-win_amd64.whl
Installing collected packages: pdftotext
Successfully installed pdftotext-2.1.5
(venv) (dir)>python (script).py
Traceback (most recent call last):
File "(dir)(script).py", line 11, in
import pdftotext
ImportError: DLL load failed while importing pdftotext: The specified module could not be found.
(venv) (dir)>pip freeze
(misc modules)
pdftotext @ file:///(drive):/(dir)/pdftotext-2.1.5-cp39-cp39-win_amd64.whl
(misc modules)
Do you have any idea what could be causing this?
Any help would be greatly appreciated.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/jalan/pdftotext/issues/16#issuecomment-762172363, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/ASLD7K2H27CNGAE63DBLUNTS2QILHANCNFSM4EV2LW6A
.

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/jalan/pdftotext/issues/16#issuecomment-762218036, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ABKVUWROKGAJJDZRJS5TIIDS2QSEZANCNFSM4EV2LW6A.

I suspect that you need to have the poppler bin directory on your path for it to work. This is probably why the pdftotext.zip that had the wheel in also had poppler-0.68.0_x86 (1).7z in it. You will need to use 7-zip to extract this and add the_location_that_you_extract_to\bin to your path.
Hope that helps.
From: GodMakesMe<EMAIL_ADDRESS>Sent: 18 January 2021 12:26
To: jalan/pdftotext<EMAIL_ADDRESS>Cc: Steve (Gadget) Barnes<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [jalan/pdftotext] Cannot install on Windows (#16)
There is possibly the error in the environment.
Try to run it in anaconda Or install it in anaconda prompt.
If the problem persists then you can use PyPDF2 as the pdf extractor.
Else There could be issues in the installation of poppler.
I am also finding the solution.
You can also refer to the Coder Haus blog on this.
If you find the solution then please let me know.
On Mon, 18 Jan 2021 at 16:32, polyspastos <notifications<EMAIL_ADDRESS>wrote:

Hey!
I have come across the following while trying to install it:
(venv) (dir)>python -m pip install ./pdftotext-2.1.5-cp39-cp39-win_amd64.whl
Processing (dir)\pdftotext-2.1.5-cp39-cp39-win_amd64.whl
Installing collected packages: pdftotext
Successfully installed pdftotext-2.1.5
(venv) (dir)>python (script).py
Traceback (most recent call last):
File "(dir)(script).py", line 11, in
import pdftotext
ImportError: DLL load failed while importing pdftotext: The specified module could not be found.
(venv) (dir)>pip freeze
(misc modules)
pdftotext @ file:///(drive):/(dir)/pdftotext-2.1.5-cp39-cp39-win_amd64.whl
(misc modules)
Do you have any idea what could be causing this?
Any help would be greatly appreciated.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/jalan/pdftotext/issues/16#issuecomment-762172363, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/ASLD7K2H27CNGAE63DBLUNTS2QILHANCNFSM4EV2LW6A
.

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/jalan/pdftotext/issues/16#issuecomment-762218036, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ABKVUWROKGAJJDZRJS5TIIDS2QSEZANCNFSM4EV2LW6A.

You can try latest version of poppler and extract the files according to the folders destination
And Then try installing pdftotext
If you are using anaconda then you can run
conda install -c conda-forge poppler

You can try latest version of poppler and extract the files according to the folders destination
And Then try installing pdftotext
If you are using anaconda then you can run
conda install -c conda-forge poppler

I've had some trouble getting pdftotext working on Windows.
But i managed with the following steps:
download poppler: https://anaconda.org/conda-forge/poppler/21.03.0/download/win-64/poppler-21.03.0-h9ff6ed8_0.tar.bz2
copy the contents from ..\poppler-21.03.0-h9ff6ed8_0\Library\lib\ to ..<Python-install-folder>\libs
copy the contents from ..\poppler-21.03.0-h9ff6ed8_0\Library\include\poppler to ..<Python-install-folder>\include\poppler
copy the DLLs from ..\poppler-21.03.0-h9ff6ed8_0\Library\include\bin*.dll to ..<Python-install-folder>\Lib\site-packages\
Copy the DLLs to c:\Python3\Lib\site-packages
charset.dll
freetype.dll
iconv.dll
libcrypto-1_1-x64.dll
libcurl.dll
liblzma.dll
libpng16.dll
libssh2.dll
openjp2.dll
tiff.dll
zlib.dll
zstd.dll
Now you can install pdftotext with:
pip install pdftotext-2.1.6-cp39-cp39-win_amd64.whl
Files are in attachment
PDFtoTEXT_Win10_x64.zip


Served file can get classified as modified if in app cache when put in background

Creating this issue as something to have on record.
To provide some context:
This application makes use of the 'watcher' package.
Now, this 'watcher' can have some unusual behaviour under Linux. If itself is at fault, I don't know. As you may know, Android utilises the Linux kernel. Android also has its own twists to it, among other things.
Now, the issue. It appears that if the file selection is specifically stored under the application's cache and the application gets put into the background (i.e. multitasking) and maybe switching between apps doing whatever, the 'modify' event can fire off in the background for that file actively being served.
I haven't dug too deep into what actually gets modified, if it even gets modified at all, but I see no reason for the file to get supposedly modified in any way in this case.
This was noticed with two devices now (Pixel 6 [stock], OnePlus 6T [custom ROM]), both on the December 2023 releases of Android 14. The issue was noticed during the development of v2.3.0, but it was very unclear as to what was going on and it looked like it only happened very few times.
The next release, v2.3.1, will exclude this check for files copied into application cache. This means that modifications would only be checked when it comes to files in internal shared storage (through Direct Access Mode).
So, if you had experienced the issue.. whoopsie. Try giving v2.3.1 a shot, once that is out.

i sure love android :)))))

Released v2.3.1. Resolves the issue.


Issue #SB-8497 feat: UI development for English font change on entire portal i.e. Noto Sans

@lakhanmandloi Please review PR.

@harishgilimi Please merge this PR as all changes are related with css and it is approved by @lakhanmandloi

This PR contains the change in Font Family for the portal. Here are some screens where the change can be seen.
1. Workspace -> All Uploads
Before Font Change

After Font Change

2. Workspace
Before Font Change

After Font Change

**3. Courses-> Course -> Course TOC
Before Font Change

After Font Change


doc: fix caretaker PR search

The PR search link still has the old label "PR action: merge", but this has been updated to "action: merge".

@googlebot ping!


Update metrics and property keys

Update metrics and property keys on alluxio docs

Codecov Report

Merging #14392 (e907364) into master (50500ce) will decrease coverage by 12.68%.
The diff coverage is 100.00%.

:exclamation: Current head e907364 differs from pull request most recent head 06e198e. Consider uploading reports for the commit 06e198e to get more accurate results

@@              Coverage Diff              @@
##             master   #14392       +/-   ##
=============================================
- Coverage     29.65%   16.97%   -12.69%
+ Complexity     6209     2709     -3500
=============================================
  Files          1495     1495
  Lines         87476    87476
  Branches      10424    10424
=============================================
- Hits          25939    14846    -11093
- Misses        59382    71393    +12011
+ Partials       2155     1237      -918

Impacted Files
Coverage Δ

...common/src/main/java/alluxio/conf/PropertyKey.java
98.05% <100.00%> (-1.40%)
:arrow_down:

...mon/src/main/java/alluxio/shell/CommandReturn.java
0.00% <0.00%> (-100.00%)
:arrow_down:

...mon/src/main/java/alluxio/util/ExceptionUtils.java
0.00% <0.00%> (-100.00%)
:arrow_down:

...n/src/main/java/alluxio/wire/AlluxioProxyInfo.java
0.00% <0.00%> (-100.00%)
:arrow_down:

.../src/main/java/alluxio/wire/AlluxioMasterInfo.java
0.00% <0.00%> (-100.00%)
:arrow_down:

...src/main/java/alluxio/job/meta/JobIdGenerator.java
0.00% <0.00%> (-100.00%)
:arrow_down:

...n/src/main/java/alluxio/stress/BaseParameters.java
0.00% <0.00%> (-100.00%)
:arrow_down:

...main/java/alluxio/underfs/options/ListOptions.java
0.00% <0.00%> (-100.00%)
:arrow_down:

...main/java/alluxio/worker/block/io/BlockReader.java
0.00% <0.00%> (-100.00%)
:arrow_down:

...main/java/alluxio/worker/block/io/BlockWriter.java
0.00% <0.00%> (-100.00%)
:arrow_down:

... and 419 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 47b025c...06e198e. Read the comment docs.

@Xenorith PTAL, we can merge the master side first

alluxio-bot, merge this please


Question about inference

I have a question about inference code.
In tasks/task_utils.py, function 'decode_object_seq_to_bbox',
there is no function that acts as 'end-of-sequence'.

I think PADDING_TOKEN (which denoted as 0 in vocab.py) is the token that indicates end-of-seq,
but in the inference time, the code does not use the token.
Am I right?

yes padding token is also the ending token. with sequence augmentation, we won't use ending token, rather predict to maximum length, and use likelihood to score each instance/prediction.

Hi Ting,
Thanks for the great research work and the code. In the paper, you mentioned the prediction of a maximum length at inference. I didn't find it in the code. Could you please point me to where it is implemented?

Please see
https://github.com/google-research/pix2seq/blob/83089ca98e077dd0a6864c2a68583b474df7a2d4/models/ar_model.py#L171
On Tue, Dec 6, 2022 at 1:44 PM Yujie Qian @.***> wrote:

Hi Ting,
Thanks for the great research work and the code. In the paper, you
mentioned the prediction of a maximum length at inference. I didn't find it
in the code. Could you please point me to where it is implemented?
—
Reply to this email directly, view it on GitHub
https://github.com/google-research/pix2seq/issues/14#issuecomment-1340050838,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAKERUP44U75EJPHWFLYWADWL6XVPANCNFSM523VBW6Q
.
You are receiving this because you commented.Message ID:
@.***>

Thanks for the prompt reply! I misunderstood your paper: I thought you were predicting an actual length of the generated sequence, but actually it is "predict to a maximum length".
Did you do any filtering based on the likelihood scores for the evaluation? Otherwise, the model is predicting the same number of objects for all images?

We rank the prediction using the likelihood score during evaluation (AP
takes a ranked list to compute)
On Wed, Dec 7, 2022 at 2:07 PM Yujie Qian @.***> wrote:

Thanks for the prompt reply! I misunderstood your paper: I thought you
were predicting an actual length of the generated sequence, but actually it
is "predict to a maximum length".
Did you do any filtering based on the likelihood scores for the
evaluation? Otherwise, the model is predicting the same number of objects
for all images?
—
Reply to this email directly, view it on GitHub
https://github.com/google-research/pix2seq/issues/14#issuecomment-1341655616,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAKERUKCWP7VKSBP4ID3VG3WMEDCZANCNFSM523VBW6Q
.
You are receiving this because you commented.Message ID:
@.***>


Not an issue!

Just wanted to ask about how logging in is meant to work after you have their info on here as your discord username must be old!

sorry for missing this! Repo needs some updates, were you able to figure it out?


added parser interface

This is a generic parser interface that would be used by all libraries that operation as krm functions

I was thinking something like this would be in the nephio/api repo

this is part of the library and we created a lib under krm-functions as the code is more close to the functions versus the api.
In the api repo we have added the getters, but the this is something to consume a library in a fn. So we believe this is a better fit in the function library.
So we beleive something like this make sense:
nephio/krm-functions/lib where a set of helpers libraries reside.

/assign @johnbelamaric

Can you rebase?

/lgtm
/approve


Include an option to anonymize post quotes aswell.

It would be nice if there is an automatic function to anonymize quotes in posts of deleted users.
I'm currently doing this via a db query, like:
UPDATE mybb_posts SET `message` = REPLACE(`message`, "quote='oldusername'", "quote='newusername'") WHERE `message` LIKE "%quote='oldusername'%";

+1 - this is needed!

There are additional considerations to take into account: for instance, usernames should also be updated on username change.


User full_name in DB returns null if no middle name in DB

If a user does not have middle name in the database, the full_name attribute returns null.

Disregard commit 6e6daf3. I referenced the incorrect issue in that commit.

This was merged into master quite some time ago. Closing.


Update makefile (see: #3)

Pull Request Test Coverage Report for Build 643462707

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 63.158%

Totals

Change from base Build 634422641:
0.0%

Covered Lines:
12

Relevant Lines:
19

💛  - Coveralls


build: attempt to port to Windows

https://github.com/apple/swift-package-manager/pull/2041/commits/a4411fb603a5b2aaf32019b1303cd5d00dfe1d7f#diff-296aa080a049a48a75c47e0a2926fde0L120
sysconf don't work for Windows, maybe use multiprocessing.cpu_count instead?

@swift-ci please smoke test

@swift-ci please smoke test

@swift-ci please smoke test

@swift-ci please smoke test

@swift-ci please smoke test

@swift-ci please smoke test

@swift-ci please test

@swift-ci please smoke test

@swift-ci please smoke test

14:53:31 --- bootstrap: note: building self-hosted 'swift-build': env SWIFT_EXEC=/Users/buildnode/jenkins/workspace/swift-package-manager-PR-osx-smoke-test/buildbot_incremental/swiftpm-macosx-x86_64/x86_64-apple-macosx10.10/release/swiftc SWIFTPM_BUILD_DIR=/Users/buildnode/jenkins/workspace/swift-package-manager-PR-osx-smoke-test/buildbot_incremental/swiftpm-macosx-x86_64 SWIFTPM_BOOTSTRAP=1 SDKROOT=/Applications/Xcode-beta.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk /Users/buildnode/jenkins/workspace/swift-package-manager-PR-osx-smoke-test/buildbot_incremental/swiftpm-macosx-x86_64/x86_64-apple-macosx10.10/release/swift-build-stage1 --disable-sandbox -Xlinker -rpath -Xlinker @executable_path/../lib/swift/macosx -v -Xswiftc -Xcc -Xswiftc -DSPM_BUILD_IDENT=bcab5f6a -Xswiftc -I/Users/buildnode/jenkins/workspace/swift-package-manager-PR-osx-smoke-test/buildbot_incremental/llbuild-macosx-x86_64/products/llbuildSwift -Xswiftc -I/Users/buildnode/jenkins/workspace/swift-package-manager-PR-osx-smoke-test/llbuild/products/libllbuild/include -Xlinker -rpath -Xlinker @executable_path/../lib/swift/pm/llbuild -L/Users/buildnode/jenkins/workspace/swift-package-manager-PR-osx-smoke-test/buildbot_incremental/llbuild-macosx-x86_64/lib -Xlinker -rpath -Xlinker /Users/buildnode/jenkins/workspace/swift-package-manager-PR-osx-smoke-test/buildbot_incremental/llbuild-macosx-x86_64/lib -Xswiftc -enable-testing --configuration release --build-tests
14:53:31 error: unknown option -L/Users/buildnode/jenkins/workspace/swift-package-manager-PR-osx-smoke-test/buildbot_incremental/llbuild-macosx-x86_64/lib; use --help to list available options
swiftc requires -L to have a space between the flag and its argument (unlike clang)

Looks good in general but you should break up the changes (deployment target, rpath, etc)

@aciidb0mb3r - I'm not sure if it really makes sense to break this up into smaller pieces since it doesn't really remain usable.

The proposed changes might not be very useful unless we get all of them but I think it's really important to land things in a safe manner. Some of the stuff (like rpath) are really sensitive and we don't have coverage for all the use cases with swift-ci. There are some internal workflows that depends on the bootstrap doing the right thing and we won't find out about them until it's already broken. I wish we had enough test coverage for bootstrap script but that is not the case right now.

@swift-ci please smoke test

@swift-ci please smoke test

@swift-ci please smoke test

@swift-ci please smoke test

CMake provides a much nicer way to bootstrap; the remaining issues are in t-s-c or at runtime where we could just switch to Foundation.


fix(dnn/arm_common): support more monotonous case in arm typecvt for …

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Major data corruption issue with PR #956 and connection pooling

We have identified a major bug that appears to have been introduced in PR #956. When using connection pooling under high concurrency, cancelled SqlCommand objects may return the connection to the pool with data still in flight. In the reproduction example below, which occurs in 4.0.0-preview2 but is not reproducible prior to the PR in 4.0.0-preview1, we spawn 100 threads that are opening connections, executing a simple SQL statement that passes in a parameter set to a unique GUID and gets it echoed back through a second parameter, and closes the connection, with a low cancellation timeout so that some will fail and some will succeed. We are finding that the parameter values from a previous connection are being returned in a new, unrelated command object. This suggests that the changes made in PR #956 are no longer fully resetting the connection and in-flight data may come into a new command using a connection retrieved from the pool. This could have significant data corruption implications where output parameters from an unrelated command are returned.
Reproduction Code:
    private static void Exec()
    {
      var cancellationToken = new System.Threading.CancellationTokenSource(50);
      var connection = new Microsoft.Data.SqlClient.SqlConnection("Data Source=your-data-source;Integrated Security=SSPI;Trust Server Certificate=true;Max Pool Size=256;Min Pool Size=0;");
      var expectedGuid = System.Guid.NewGuid();
      var cm = new Microsoft.Data.SqlClient.SqlCommand();
      cm.Connection = connection;
      cm.CommandType = System.Data.CommandType.Text;
      cm.CommandText = "select @id2 = @id;";
      cm.Parameters.Add(new Microsoft.Data.SqlClient.SqlParameter("@id", System.Data.SqlDbType.UniqueIdentifier) { Value = expectedGuid });
      cm.Parameters.Add(new Microsoft.Data.SqlClient.SqlParameter("@id2", System.Data.SqlDbType.UniqueIdentifier) { Direction = System.Data.ParameterDirection.Output });
      cm.CommandTimeout = 2;
      try
      {
        connection.Open();
        var task = cm.ExecuteNonQueryAsync(cancellationToken.Token);
        task.Wait();
      }
      catch (System.Exception)
      {
        //ignore cancellations
      }
      finally
      {
        connection.Close();
      }
      if<EMAIL_ADDRESS>== null) return;
      else if<EMAIL_ADDRESS>!= expectedGuid) throw new System.InvalidOperationException(string.Format("OH NO: Expected {0}, Got {1}", expectedGuid, ((System.Guid)cm.Parameters["@id2"].Value).ToString()));
    }

    public static void Main(string[] args)
    {
      var threads = new System.Collections.Generic.List<System.Threading.Thread>();
      for (int i = 0; i < 100; i++)
      {
        var t = new System.Threading.Thread(() => { for (int j = 0; j < 1000; j++) Exec(); });
        t.Start();
        threads.Add(t);
      }
      for (int i = 0; i < threads.Count; i++) threads[i].Join();
      System.Console.WriteLine("END");
      System.Console.ReadKey();
    }

Just a few seconds into execution, you'll see it throw the InvalidOperationException with something like:
System.InvalidOperationException: 'OH NO: Expected f90b93e5-e651-4543-a663-562998fca20d, Got 50f1c311-9e34-4573-9637-e3e3f0a4737b'
The output parameter is clearing being populated with data from another past iteration of the connection.

@agclark27 thanks for bringing this up. We will look into it shortly.
CC: @Wraith2

If I set timeout before setting parameters, there is no issue. 🤔

also with previous versions I tested with preview1 and 3.0.1 and it worked fine.

Sure. And I agree that it's likely to be  #956 but we should really bisect by just removing that one PR and retesting so make sure of that because there are other changes between 3 and 4.

The repro doesn't look like it's doing anything illegal. It's likely to be an issue similar to the ones we've seen in the past where a connection is returned to to pool without being completely closed. Whatever the cause I think reverting that one PR is probably the best place to start.


Need AWS C++ libraries for RaspberryPi 3-B Linux (Raspbian) on ARM Processor

I was attempting to write a C++ appliance for AWS on a little Linux box (a Raspberry Pi !!)  I have found references to Windows 32bit and 64bit libraries... but I cannot seem to find references to non-64bit Linux distros.... Is it possible to port these to a 1.2 GHz 64-bit quad-core ARM Cortex-A53 which is running a 32bit Raspbian OS??? If you want to ask questions about what I need, please feel free to contact me...  Thanks!

Are you asking if you can build from source for your target? The answer is yes. It's just standard cmake to specify the target.
Sent from my iPhone

On Oct 8, 2016, at 4:12 PM, scotthbradley<EMAIL_ADDRESS>wrote:
I was attempting to write a C++ appliance for AWS on a little 32bit ARM
processor Linux box (a Raspberry Pi !!) I have found references to Windows
32bit and 64bit libraries... but I cannot seem to find references to non-64bit
Linux distros.... Is it possible to port these to a 1.2 GHz 64-bit quad-core ARM
Cortex-A53 which is running a 32bit Raspbian OS??? If you want to ask questions
about what I need, please feel free to contact me... Thanks!
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.

I was under the assumption that you provided binary libraries for each OS...
Seeing that you provide DLLs for 32bit Windows and 64bit Windows each is
what brought me to that conclusion.  Are you saying that I can build AWS
for my box?  if so, what I am attempting to do, is replace a Java program
which already runs on the box with something FASTER!!!
It seems that we are using the following AWS (again) libraries for Java
import com.amazonaws.AmazonClientException;
import com.amazonaws.AmazonServiceException;
import com.amazonaws.auth.BasicAWSCredentials;
import com.amazonaws.regions.Region;
import com.amazonaws.regions.Regions;
import com.amazonaws.services.kinesis.AmazonKinesisClient;
import com.amazonaws.services.kinesis.model.CreateStreamRequest;
import com.amazonaws.services.kinesis.model.DescribeStreamRequest;
import com.amazonaws.services.kinesis.model.DescribeStreamResult;
import com.amazonaws.services.kinesis.model.PutRecordRequest;
import com.amazonaws.services.kinesis.model.PutRecordResult;
import com.amazonaws.services.kinesis.model.PutRecordsRequest;
import com.amazonaws.services.kinesis.model.PutRecordsRequestEntry;
import com.amazonaws.services.kinesis.model.PutRecordsResult;
import com.amazonaws.services.kinesis.model.PutRecordsResultEntry;
import com.amazonaws.services.kinesis.model.ResourceNotFoundException;
import com.amazonaws.services.kinesis.model.StreamDescription;
Does any of that make sense?  Can I build from source what I need in C++
from those libraries above???
Thanks,
Scott.

Ok, so.. some developers attempted to build the AWS libraries on the RaspberryPi 3 before without success... Unfortunately, looking at the README.MD in the source directory, it states clearly that the builds may fail if built on a system with less than 4GB of ram.  The RaspberryPi has only 1GB of ram, so ... does that mean I will have problems building many parts of the system with that small amount of ram???  Also, there is no way to increase the ram on a RaspberryPi for any reason (I've checked that out already...)  What do you suggest???

Cross compilation. Also ec2 on GCC is likely the only sdk you would have trouble with. If you use clang it will be fine. Also use the BUILD_ONLY cmake arg to build only the services you need.
Sent from my iPhone

On Oct 8, 2016, at 6:07 PM, scotthbradley<EMAIL_ADDRESS>wrote:
Ok, so.. some developers attempted to build the AWS libraries on the RaspberryPi 3 before without success... Unfortunately, looking at the README.MD in the source directory, it states clearly that the builds may fail if built on a system with less than 4GB of ram. The RaspberryPi has only 1GB of ram, so ... does that mean I will have problems building many parts of the system with that small amount of ram??? Also, there is no way to increase the ram on a RaspberryPi for any reason (I've checked that out already...) What do you suggest???
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub, or mute the thread.

were you able to resolve this?

hey, thanks for thinking of me.
i have not resolved this yet because I was interrupted from the project to
work on several other things. I plan to get back to it at some point, but
not quite yet.

Hello, were you able to build your own binary on Raspberry PI? We have successfully built it on our own, but we haven't had a plan to supply downloadable binary officially yet.

Closing since no further response from user.


Enable installation of certs via URL or cookbook_file

Description
This change enables users to install a trusted cert that is provided either via URL or cookbook_file in a wrapper cookbook.
Justification
We already have the certs in a standard format.  It's not a very good user experience (and introduces surfaces for opaque failure) to require users to take the standard cert format and convert it to a JSON encoded string...  To use this we were basically taking the output of this command:
ruby -rjson -e 'puts File.read(ARGV.shift).to_json' my_cert.crt

Then copy/pasting the result into an attribute.
On more than one occasion obscure failures were caused due to a copy/paste error.
Being able to just use the file directly by copying it into the cookbook or downloading it from a known safe URL would eliminate the potential for human error in copy/pasting.
Issues Resolved
N/A, well, this one :) (#16 )
Check List

[x] All tests pass. See https://github.com/chef-cookbooks/community_cookbook_documentation/blob/master/TESTING.MD
[x] New functionality includes testing.
[x] New functionality has been documented in the README if applicable
[x] All commits have been signed for the Developer Certificate of Origin. See https://github.com/chef-cookbooks/community_cookbook_documentation/blob/master/CONTRIBUTING.MD

Oh nice. I literally just started a branch to add this before we add this resource to Chef. I have a few tweaks, but this is a great start.


Fix website linking to v1.0.0-beta.0 as a fallback

Etcher version: Etcher-??
Operating system and architecture: Windows 10 64bits
Do you see any meaningful error information on DevTools? Nop

When you have more then 4 drives the list grows inside the application and you can only select another disk by tabbing

After tab (to select disk under those)

Usb pen not present at the time

Downloaded portable version and it looks different, so it may just be that the normal installer has packed with an older version?

First download also downloaded that weird win32 version (that i installed and was causing this issue), new version downloaded.

On the gitter channel @eSkiSo also identified that there's a link to https://resin-production-downloads.s3.amazonaws.com/etcher/1.0.0-beta.0/Etcher-win32-x86.exe which is presumably wrong... screenshot
ping @craig-mulligan
(and this is presumably also the cause of #789 )

Ah, interesting; so presumably, the Etcher site is using that version as a fallback if it can't contact the server to get an updated list. Can that be changed so that it defaults to the GitHub releases page or some other complete list (so the user chooses manually)? That's what I have done with JS-based release pages like this in the past.

That does not look like beta17. It seems exceedingly weird @jviotti, if
that's what we're shipping, we have an emergency!
--
Alexandros Marinos
Founder & CEO, Resin.io
+1<PHONE_NUMBER>
@alexandrosm
On Fri, Dec 2, 2016 at 11:24 PM, Eskiso<EMAIL_ADDRESS>wrote:

Downloaded portable version and it looks different, so it may just be that
the normal installer has packed with an older version?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/resin-io/etcher/issues/929#issuecomment-264589676,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABLUCHAaR8Os3QapIeyF3TTAt67hmlH1ks5rEKibgaJpZM4LDFpo
.

We don't want to make gh releases as those are very hard / impossible to
get analytics out of
--
Alexandros Marinos
Founder & CEO, Resin.io
+1<PHONE_NUMBER>
@alexandrosm
On Sat, Dec 3, 2016 at 2:24 AM, Wasabi Fan<EMAIL_ADDRESS>wrote:

Ah, interesting; so presumably, the Etcher site is using that version as a
fallback if it can't contact the server to get an updated list. Can that be
changed so that it defaults to the GitHub releases page or some other
complete list (so the user chooses manually)? That's what I have done with
JS-based release pages like this in the past.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/resin-io/etcher/issues/929#issuecomment-264609320,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABLUCO8HumpwbwP3TkYjjeHQw7WGBIu8ks5rENLCgaJpZM4LDFpo
.

We don't want to make gh releases as those are very hard / impossible to
get analytics out of

I'm not sure what you mean. GitHub provides download counts for individual files in every release.
Either way, it doesn't really matter what page you link to; what I'm thinking is that you should set the fallback URL to be a list of releases instead of that old one directly.

agreed, don't want to fall back to the oldest one. in fact, @jviotti what's
stopping us from simply re-publishing the website upon a new release? that
would save us this weird indirection/fallback situation
--
Alexandros Marinos
Founder & CEO, Resin.io
+1<PHONE_NUMBER>
@alexandrosm
On Sat, Dec 3, 2016 at 5:20 AM, Wasabi Fan<EMAIL_ADDRESS>wrote:

We don't want to make gh releases as those are very hard / impossible to
get analytics out of
I'm not sure what you mean. GitHub provides download counts for individual
files in every release.
Either way, it doesn't really matter what page you link to; what I'm
thinking is that you should set the fallback URL to be a list of releases
instead of that old one directly.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/resin-io/etcher/issues/929#issuecomment-264617834,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABLUCA5k44xB2T7PeK2R8SFMIoLyc5Sqks5rEPw4gaJpZM4LDFpo
.

what's stopping us from simply re-publishing the website upon a new release?

I guess that'd simply be another step to add to https://github.com/resin-io/etcher/blob/master/docs/PUBLISHING.md

That does not look like beta17. It seems exceedingly weird @jviotti, if
that's what we're shipping, we have an emergency!

It seems to be an issue on the website, which is pointing to a very old release instead of to the latest one for certain user agents.

in fact, @jviotti what's
stopping us from simply re-publishing the website upon a new release? that
would save us this weird indirection/fallback situation

We've discussed this with @craig-mulligan on the summit (having a static set of links updated on each release rather than "clever" logic to find the latest one automatically), and I think this is how the re-designed site works already, but we're not deploying it anywhere yet, though I'm not sure why. @craig-mulligan?
As a quick solution, lets solve this problem on the user-agent/latest version detection logic and lets focus on getting the new site up and running.

but we're not deploying it anywhere yet, though I'm not sure why.

I haven't had any time since the summit, and we have the new lander ideas to include, hopefully decemeber will be quiet and we can upgrade everything.

As a quick solution, lets solve this problem on the user-agent/latest version detection logic and lets focus on getting the new site up and running.

Sure I'll knock up a PR quickly @jviotti

@jviotti I added a downloads section: https://etcher.io/#downloads and updated the fallback.

Nice. I guess that has the unfortunate side-effect of highlighting just how "big" the Etcher downloads are though ;-)   (maybe it's worth adding a small note that this is because Etcher is built on top of Electron, and not because Etcher is "bloatware"?)
@jviotti & @dlech Should the .deb file be included in that list too? Or maybe the https://github.com/resin-io/etcher/blob/master/README.md#installers section of the GH Readme should also be included on the etcher.io website somehow?

Has the "slogan" on the website now 'reverted' back to Burn images to SD cards & USB drives, safe & easy.? I'm fairly sure that @jviotti updated it to Flash OS images to SD cards & USB drives, safely and easily. as part of https://github.com/resin-io/etcher/issues/797#issuecomment-257968786
(Or maybe I'm just mis-remembering?)

Should the .deb file be included in that list too? Or maybe the https://github.com/resin-io/etcher/blob/master/README.md#installers section of the GH Readme should also be included on the etcher.io website somehow?

I don't think the debian file needs to be in the Downloads section. But I do think that there should be an "Other installation methods" section that lists supported package managers. I guess for now, this is just the debian package, but it could be expanded to include a Chocolaty package for Windows, brew on Mac, rpm on other Linux distros, etc.

@craig-mulligan

@jviotti I added a downloads section: https://etcher.io/#downloads and updated the fallback.

Can you point us to the commit/PR? What is the fallback now? Can we close this issue?

I don't think the debian file needs to be in the Downloads section. But I do think that there should be an "Other installation methods" section that lists supported package managers. I guess for now, this is just the debian package, but it could be expanded to include a Chocolaty package for Windows, brew on Mac, rpm on other Linux distros, etc.

Lets include this in the re-designed website, in order to avoid work in a landing page that will be replaced in the near future.

@craig-mulligan re: https://github.com/resin-io/etcher-homepage/commit/43034e794be88adfbdeafbaf117ba1e4b423ba47
Unless we get the re-designed website up and running very soon, we'll have to manually update the fallback the next time we release. What about simply making the button scroll the website to the "downloads" section, and completely get rid of the concept of a "fallback"?

@jviotti -- is it that bad to update the landing page on every release?
--
Alexandros Marinos
Founder & CEO, Resin.io
+1<PHONE_NUMBER>
@alexandrosm
On Mon, Dec 5, 2016 at 3:28 AM, Juan Cruz Viotti<EMAIL_ADDRESS>wrote:

@craig-mulligan https://github.com/craig-mulligan re:
resin-io/etcher-homepage@43034e7
https://github.com/resin-io/etcher-homepage/commit/43034e794be88adfbdeafbaf117ba1e4b423ba47
Unless we get the re-designed website up and running very soon, we'll have
to manually update the fallback the next time we release. What about simply
making the button scroll the website to the "downloads" section, and
completely get rid of the concept of a "fallback"?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/resin-io/etcher/issues/929#issuecomment-264760347,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABLUCEUjoK3uTmYB_sQWM1L2_AzKWtgBks5rE4TugaJpZM4LDFpo
.

OTOH if we do end up updating the landing page on every release (presumably via some semi-automated step of the publishing process), then I guess we could just 'hardcode' all the relevant URLs in the page anyway, and then there wouldn't be any need for a "fallback URL" at all.

The thing is that as it is now, the latest version is dynamically calculated, but we still have to remember to update the fallback. When we have the new landing page, it will be integrated into the main Etcher repository, which means it will be able to get the latest version from package.json automatically, so we won't have to manually update every time.
Until then, it sounds simple to point to the downloads table and avoid having to maintain even the fallback. I agree its not a big deal, but sounds like an easy win to me.

Closing since this issue was already resolved.


add Strato dyndns provider

this adds the german provider "strato.de" to the list of dyndns services

[x] Redmine Issue: https://redmine.pfsense.org/issues/11978
[ ] Ready for review

"Last Tested: 29 Mai 2021" should be "Last Tested: 29 May 2021"

"Last Tested: 29 Mai 2021" should be "Last Tested: 29 May 2021"

corrected! thank you!

@dneuhaeuser please rebase your fork and make sure the change respect recently change that sorted all entries alphabetically

conflicts are resolved

Manually merged it after squash all commits and cleanup some extra space added.  Thanks


iwasm return Illegal instruction when executing a webassembly code

Prepare the following simple rust code:
fn main() {
    println!("Hello, world!");
}

Compile it to webassembly:
$ rustup target add wasm32-wasi
$ rustc hello.rs --target wasm32-wasi

Then use iwasm to execute it:
$ ./iwasm --version
iwasm 1.2.2
$ ./iwasm hello.wasm
Illegal instruction

Any suggestion for this? Thanks very much.

I build iwasm following the readme.txt

@lyuxiaosu Which platform do you run iwasm? Could you try adding cmake -DWAMR_DISABLE_WRITE_GS_BASE=1 when building iwasm?

@lyuxiaosu Which platform do you run iwasm? Could you try adding cmake -DWAMR_DISABLE_WRITE_GS_BASE=1 when building iwasm?

Hi wenyongh, thanks for the reply. Sorry I didn't clarify the platform. I built iwasm on x86_64, Ubuntu 20.04.
I also tried the option you gave:
cmake .. -DWAMR_BUILD_JIT=1 -DWAMR_BUILD_FAST_JIT=1 -DWAMR_DISABLE_WRITE_GS_BASE=1 -B build
but it still showed the same error. Thanks.

Hi, I tested it in my Ubuntu 20.04 x86_64: build hello.rs, build iwasm with cmake .. -DWAMR_BUILD_JIT=1 -DWAMR_BUILD_FAST_JIT=1, it runs OK.
Could you upload your wasm file?

I attached the wasm file, this file can be executed successfully with other wasm runtime, so it should be correct. The kernel version is 5.4.0-139-generic , ubuntu 20.04 x86_64.
hello.zip

I forgot to mention that I git clone the project and build iwasm. The git log shows:
commit 0ac5f206b81eea94e7c42b2358783c8cb79d56db (HEAD -> main, origin/main, origin/HEAD)
Author: Wenyong Huang<EMAIL_ADDRESS>Date:   Fri Jun 16 11:48:12 2023 +0800

    Enable windows x86-32 AOT relocations (#2285)

    Implement relocation types IMAGE_REL_I386_DIR32 and IMAGE_REL_I386_REL32,
    fix failure to find AOT function symbol, and implement symbol __aulldiv.

I am not sure if it is the particular version caused the problem.

I git pull the latest code and rebuild everything and it still showed the same error:
xxx@node0:~/wasm-micro-runtime/product-mini/platforms/linux/build$ make clean
xxx@node0:~/wasm-micro-runtime/product-mini/platforms/linux/build$ cmake .. -DWAMR_BUILD_JIT=1 -DWAMR_BUILD_FAST_JIT=1
-- Fetching asmjit ..
 -DWAMR_BUILD_JIT=1 -DWAMR_BUILD_FAST_JIT=1, and run the hello.wasm, it works. Could you try using gdb to run, and when failed, use command like disp /10i $pc to see which instruction causes the core dump? And could you check whether interpreter mode works?


Separate matplotlib specific codes and plot core in main codes

This PR propose to separate matplotlib specific codes and plot core in Koalas:

databricks.koalas.plot.core: other plot backends, the entry point of plotting, shared codes, etc.
databricks.koalas.plot.matplotlib:  matplotlib specific codes

Codecov Report

Merging #1936 (39308d0) into master (79720a7) will decrease coverage by 2.76%.
The diff coverage is 88.39%.

@@            Coverage Diff             @@
##           master    #1936      +/-   ##
==========================================
- Coverage   94.16%   91.40%   -2.77%
==========================================
  Files          41       43       +2
  Lines       10055     9979      -76
==========================================
- Hits         9468     9121     -347
- Misses        587      858     +271

Impacted Files
Coverage Δ

databricks/koalas/plot/matplotlib.py
91.76% <85.71%> (ø)

databricks/koalas/plot/core.py
88.48% <88.48%> (ø)

databricks/koalas/plot/__init__.py
100.00% <100.00%> (ø)

databricks/koalas/usage_logging/__init__.py
25.66% <0.00%> (-66.65%)
:arrow_down:

databricks/koalas/usage_logging/usage_logger.py
47.82% <0.00%> (-52.18%)
:arrow_down:

databricks/koalas/__init__.py
68.75% <0.00%> (-21.88%)
:arrow_down:

databricks/conftest.py
89.83% <0.00%> (-10.17%)
:arrow_down:

databricks/koalas/spark/functions.py
88.88% <0.00%> (-7.41%)
:arrow_down:

databricks/koalas/accessors.py
86.43% <0.00%> (-7.04%)
:arrow_down:

databricks/koalas/namespace.py
78.17% <0.00%> (-6.07%)
:arrow_down:

... and 18 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 79720a7...39308d0. Read the comment docs.

Btw, we should update setup.py as well?


Search use ignore file does not work

VSCode Version: 1.52.1
OS Version: Ubuntu SMP Tue Jan 5 21:23:50 UTC 2 x86_64 x86_64 x86_64 GNU/Linux

Steps to Reproduce:

go to Search Preference, uncheck Search:Use ignore Files
search include ignored files
go to check Search:Use ignore Files
search still include ignored files

Does this issue occur when all extensions are disabled?: Yes/No
Yes

The highlighted message is telling you that you have deselected the indicated toggle button. Click that button and all should be well.

The highlighted message is telling you that you have deselected the indicated toggle button. Click that button and all should be well.

Wow, I've been living with this for years.
Clicking on the cog really works!
Thank you

Wow, I've been living with this for years.
Clicking on the cog really works!
Thank you

Glad you found a solution, thanks @gjsjohnmurray.
@korakotlee it's very common for people to miss this button. Do you have any ideas for how to make it more obvious? Did you notice the underlined message?

Glad you found a solution, thanks @gjsjohnmurray.
@korakotlee it's very common for people to miss this button. Do you have any ideas for how to make it more obvious? Did you notice the underlined message?

maybe a little help icon that when click show a tooltip

"exclude settings and ignore files are disabled - enable"

maybe a little help icon that when click show a tooltip

"exclude settings and ignore files are disabled - enable"


Problems with LDAP group replication

Hello,
I have a problem with group replication from ActiveDirectory. An ActiveDirectory user can log in, but the AD groups are not replicated correctly.
If I set AUTH_LDAP_MIRROR_GROUPS = True and log in with an AD user, I see in the database that the Django tables auth_group, auth_group_permissions and auth_user_groups are written correctly. However, the AD groups are missing from the DefectDojo tables dojo_dojo_group and dojo_dojo_group_member. I can't see these AD groups in the DefectDojo web user interface either.
If I set AUTH_LDAP_MIRROR_GROUPS = False and create the groups manually via the DefectDojo web user interface, the AD user is not assigned to these groups when logging in.
Here is my LDAP configuration:
import ldap from django_auth_ldap.config import LDAPSearch, LDAPGroupQuery, NestedActiveDirectoryGroupType

AUTHENTICATION_BACKENDS = (
    "django_auth_ldap.backend.LDAPBackend",
    "django.contrib.auth.backends.ModelBackend",
)

AUTH_LDAP_SERVER_URI = "ldaps://ldap.example.com"
AUTH_LDAP_CONNECTION_OPTIONS = {
 ldap.OPT_REFERRALS: 0,
 ldap.OPT_X_TLS_REQUIRE_CERT: ldap.OPT_X_TLS_NEVER
}
AUTH_LDAP_GLOBAL_OPTIONS = AUTH_LDAP_CONNECTION_OPTIONS

AUTH_LDAP_BIND_DN =<EMAIL_ADDRESS>AUTH_LDAP_BIND_PASSWORD = "password"
AUTH_LDAP_USER_SEARCH = LDAPSearch(
    "ou=users,dc=example,dc=com", ldap.SCOPE_SUBTREE, "(sAMAccountName=%(user)s)"
)

AUTH_LDAP_USER_ATTR_MAP = {
    "username": "sAMAccountName",
    "first_name": "givenName",
    "last_name": "sn",
    "email": "mail",
}

AUTH_LDAP_GROUP_SEARCH = LDAPSearch(
    "ou=django,ou=groups,dc=example,dc=com",
    ldap.SCOPE_SUBTREE,
    "(objectClass=group)",
)
AUTH_LDAP_GROUP_TYPE = NestedActiveDirectoryGroupType(name_attr="cn")

AUTH_LDAP_USER_FLAGS_BY_GROUP = {
    "is_active": "cn=active,ou=django,ou=groups,dc=example,dc=com",
    "is_staff": "cn=staff,ou=django,ou=groups,dc=example,dc=com",
    "is_superuser": "cn=superuser,ou=django,ou=groups,dc=example,dc=com",
}

AUTH_LDAP_ALWAYS_UPDATE_USER = True
AUTH_LDAP_FIND_GROUP_PERMS = True
AUTH_LDAP_MIRROR_GROUPS = True
AUTH_LDAP_CACHE_GROUPS = True
AUTH_LDAP_CACHE_TIMEOUT = 3600

Expected behavior
AD users should also have their AD group membership in DefectDojo.
Deployment method (select with an X)

[X] Docker Compose
[ ] Kubernetes
[ ] GoDojo

Environment information

Operating System: Debian Base Image
DefectDojo version: 2.24.4

Did you solve this problem? I face a similar problem. Groups are not populated to database and not visible in the UI.

Hello @martigr , it's been a while now. As far as I remember, I created a custom LDAP authentication backend in which the DefectDojo group assignments were set.

I had a closer look into the database. The LDAP groups are populated to the table auth_group. But they are not populated to the table dojo_dojo_group. This is the table used to show the group in the UI and used for permissions…

Hello @martigr , it's been a while now. As far as I remember, I created a custom LDAP authentication backend in which the DefectDojo group assignments were set.

Hi, @reichertan can you share the LDAP backend you have implemented? We are dealing with the same situation.

Hi @xzavrel, I used https://github.com/django-auth-ldap/django-auth-ldap/blob/master/django_auth_ldap/backend.py as a template. The _LDAPUser class there has a _get_or_create_user method, there you could add code to assign users to or remove users from Dojo groups.
Sorry, I'm not allowed to paste my exact code.


Add javadoc to describe IntrospectionUtils.isInstance

@ChristopherSchultz Should I merge it or are you just testing things out?
Not sure why you opened a PR rather than push it directly given that this is not a change that requires much review.

Just exercising everything to make sure it works how I expect it to work.
For example, Eclipse crapped its pants when I tried to import my fork of tomcat-master. It seems like the GitHub 2FA basically makes Eclipse stop working. I'm sure it has something to do with cached credentials in one of the dozen or so keychains that are in play, here.

Is your remote configured for https:// (rather than git://)?.  Run git remote -v to view the remote URLs.  I was trying at first to use the git:// scheme and it didn't work.


[BUG 🪲] Typo on CursorCaptuerSettings?

Describe the bug 🐛
Should this be CursorCaptureSettings?

Yea, I don't know how did I miss this XD, thanks.


net: sending UDP datagrams back and forth fails with "sendmsg: operation not permitted"

What version of Go are you using (go version)?

$ go version
go1.21.0 linux/arm64

Does this issue reproduce with the latest release?

I created two UDP sockets, and send UDP datagrams from one to the other, and vice versa:
func newUDPConn(t *testing.T) *net.UDPConn {
	addr, err := net.ResolveUDPAddr("udp", "localhost:0")
	if err != nil {
		t.Fatal(err)
	}
	conn, err := net.ListenUDP("udp", addr)
	if err != nil {
		t.Fatal(err)
	}
	t.Cleanup(func() { conn.Close() })
	return conn
}

func TestUDPSending(t *testing.T) {
	c1 := newUDPConn(t)
	c2 := newUDPConn(t)

	const num = 1000
	done := make(chan struct{}, 2)
	var failed1, failed2 bool
	go func() {
		defer func() { done <- struct{}{} }()
		for i := 0; i < num; i++ {
			_, _, err := c1.WriteMsgUDP(make([]byte, 1000), nil, c2.LocalAddr().(*net.UDPAddr))
			if err != nil {
				failed1 = true
				t.Logf("c1 send failed %d: %v\n", i, err)
			}
			time.Sleep(200 * time.Microsecond)
		}
	}()

	go func() {
		defer func() { done <- struct{}{} }()
		for i := 0; i < num; i++ {
			_, _, err := c2.WriteMsgUDP(make([]byte, 1000), nil, c1.LocalAddr().(*net.UDPAddr))
			if err != nil {
				failed2 = true
				t.Logf("c2 send failed %d: %v\n", i, err)
			}
			time.Sleep(200 * time.Microsecond)
		}
	}()

	<-done
	<-done

	if failed1 || failed2 {
		t.Fail()
	}
}

What did you expect to see?
I expected UDP datagrams to be sent on both sockets.
What did you see instead?
More often than not, this test fails on Linux:
c1 send failed 0: write udp <IP_ADDRESS>:47716-><IP_ADDRESS>:34183: sendmsg: operation not permitted

It's either the first or the second connection that fails, but if there's a failure, it's always only the first call that fails. All subsequent calls complete successfully.
On macOS, this code doesn't produce any errors.

I tried using the TestUDPSending you provided in both the wsl and github code spaces, but it couldn't reproduce the failure.

I am able to reproduce (on Linux), but it is very hit-or-miss. Strangely, it only seems to happen on the host - I cannot reproduce in a Docker container.
From looking around, it seems like this may be a Linux "feature" where sendmsg sometimes returns EPERM if the firewall buffer is full, or something like that. It's not very clear though.

I've run the snippet 100 times on a Linux machine and on MacOS but couldn't reproduce. Interestingly, on Linux a test run takes ~1.2s, and on MacOS ~0.35s.
Linux: Ubuntu 22.04.1 LTS (GNU/Linux 5.15.0-56-generic x86_64)
MacOS: Ventura 13.5.2.

Snippet to run the test 100 times
package main

import (
	"net"
	"testing"
	"time"
)

func newUDPConn(t *testing.T) *net.UDPConn {
	addr, err := net.ResolveUDPAddr("udp", "localhost:0")
	if err != nil {
		t.Fatal(err)
	}
	conn, err := net.ListenUDP("udp", addr)
	if err != nil {
		t.Fatal(err)
	}
	t.Cleanup(func() { conn.Close() })
	return conn
}

func TestUDPSending(t *testing.T) {
	c1 := newUDPConn(t)
	c2 := newUDPConn(t)
	for j := 0; j < 100; j++ {
		t.Run("", func(t *testing.T) {
			const num = 1000
			done := make(chan struct{}, 2)
			var failed1, failed2 bool
			go func() {
				defer func() { done <- struct{}{} }()
				for i := 0; i < num; i++ {
					_, _, err := c1.WriteMsgUDP(make([]byte, 1000), nil, c2.LocalAddr().(*net.UDPAddr))
					if err != nil {
						failed1 = true
						t.Logf("c1 send failed %d: %v\n", i, err)
					}
					time.Sleep(200 * time.Microsecond)
				}
			}()

			go func() {
				defer func() { done <- struct{}{} }()
				for i := 0; i < num; i++ {
					_, _, err := c2.WriteMsgUDP(make([]byte, 1000), nil, c1.LocalAddr().(*net.UDPAddr))
					if err != nil {
						failed2 = true
						t.Logf("c2 send failed %d: %v\n", i, err)
					}
					time.Sleep(200 * time.Microsecond)
				}
			}()

			<-done
			<-done

			if failed1 || failed2 {
				t.Fail()
			}
		})
	}
}

</details

@dennis-tra You need to make new udp conns on each run. The error concerns the initial packets exchanged on the connection.
package main

import (
	"net"
	"testing"
	"time"
)

func newUDPConn(t *testing.T) *net.UDPConn {
	addr, err := net.ResolveUDPAddr("udp", "localhost:0")
	if err != nil {
		t.Fatal(err)
	}
	conn, err := net.ListenUDP("udp", addr)
	if err != nil {
		t.Fatal(err)
	}
	t.Cleanup(func() { conn.Close() })
	return conn
}

func TestUDPSending(t *testing.T) {

	for j := 0; j < 100; j++ {
		t.Run("", func(t *testing.T) {
            c1 := newUDPConn(t)
	        c2 := newUDPConn(t)
			const num = 1000
			done := make(chan struct{}, 2)
			var failed1, failed2 bool
			go func() {
				defer func() { done <- struct{}{} }()
				for i := 0; i < num; i++ {
					_, _, err := c1.WriteMsgUDP(make([]byte, 1000), nil, c2.LocalAddr().(*net.UDPAddr))
					if err != nil {
						failed1 = true
						t.Logf("c1 send failed %d: %v\n", i, err)
					}
					time.Sleep(200 * time.Microsecond)
				}
			}()

			go func() {
				defer func() { done <- struct{}{} }()
				for i := 0; i < num; i++ {
					_, _, err := c2.WriteMsgUDP(make([]byte, 1000), nil, c1.LocalAddr().(*net.UDPAddr))
					if err != nil {
						failed2 = true
						t.Logf("c2 send failed %d: %v\n", i, err)
					}
					time.Sleep(200 * time.Microsecond)
				}
			}()

			<-done
			<-done

			if failed1 || failed2 {
				t.Fail()
			}
		})
	}
}

Use the following code
package main

import (
	"net"
	"testing"
	"time"
)

func newUDPConn(t *testing.T) *net.UDPConn {
	addr, err := net.ResolveUDPAddr("udp", "localhost:0")
	if err != nil {
		t.Fatal(err)
	}
	conn, err := net.ListenUDP("udp", addr)
	if err != nil {
		t.Fatal(err)
	}
	t.Cleanup(func() { conn.Close() })
	return conn
}

func TestUDPSending(t *testing.T) {

	for j := 0; j < 100; j++ {
		t.Run("", func(t *testing.T) {
			t.Parallel()
			c1 := newUDPConn(t)
			c2 := newUDPConn(t)
			const num = 1000
			done := make(chan struct{}, 2)
			var failed1, failed2 bool
			go func() {
				defer func() { done <- struct{}{} }()
				for i := 0; i < num; i++ {
					_, _, err := c1.WriteMsgUDP(make([]byte, 1000), nil, c2.LocalAddr().(*net.UDPAddr))
					if err != nil {
						failed1 = true
						t.Logf("c1 send failed %d: %v\n", i, err)
					}
					time.Sleep(200 * time.Microsecond)
				}
			}()

			go func() {
				defer func() { done <- struct{}{} }()
				for i := 0; i < num; i++ {
					_, _, err := c2.WriteMsgUDP(make([]byte, 1000), nil, c1.LocalAddr().(*net.UDPAddr))
					if err != nil {
						failed2 = true
						t.Logf("c2 send failed %d: %v\n", i, err)
					}
					time.Sleep(200 * time.Microsecond)
				}
			}()

			<-done
			<-done

			if failed1 || failed2 {
				t.Fail()
			}
		})
	}
}

Failed to reproduce in wsl1

Thanks for correcting, and sorry for the noise. However, even with both of your corrected versions, I cannot reproduce it on my Linux machine.

cc @neild @ianlancetaylor

Strangely, EPERM is not defined as one of the error values from sendmsg, so no matter what the kernel isn't even abiding by its own documentation.

POSIX does not seem to allow EPERM from sendmsg either:
https://pubs.opengroup.org/onlinepubs/9699919799/functions/sendmsg.html
It seems like if the firewall buffer is full it ought to return ENOBUFS instead. 🤷♂
At any rate, this looks like maybe a Linux kernel bug rather than a Go bug, and (especially given that it is UDP) it's not clear to me that Go should necessarily work around that bug itself.

FYI, I've seen this “sendmsg: operation not permitted” happen with Syncthing due to UDPFLOOD protection, configured automatically by DirectAdmin (iptables -vL UDPFLOOD showing "limit: avg 100/sec burst 500" and "limit: avg 30/min burst 5").

@ArtemGr, that still sounds consistent with a this being a Linux kernel bug. (Perhaps enabling UDPFLOOD limits causes the kernel to return an error that is not consistent with its documentation?)


Add more 'Stu Lowe' cards

Add more of Stu Lowe's coding cards...RPG game series.

Stu had to move the cards to remove the backgrounds. Can you check that our snapshot are updated?

Changed out all the links and images to the latest stuff.