Multicast route configuration and support for join/leave transport node

This pr creates multicast route client with multicast socket, which handles IGMPMSG_NOCACHE messages:

If the message has VIF equals to gateway interface's VIF, which means it is outbound multicast traffic from pods to external interfaces. The client configures the multicast route from Antrea gateway to external interfaces.
If the message has VIF different from gateway interface's VIF, which means it is inbound multicast traffic. The client configures the multicast route from the external interface to the Antrea gateway.

Also the multicast client delete the multicast routes and configure the interfaces to join/leave multicast groups for the following circumstances:

If all the multicast receivers inside the pods leaves the multicast group A, it deletes inbound multicast route from external interfaces to gateway for the group A and ensures all the external interfaces leave the multicast group A.
If at least one receiver inside the pod joins the multicast group A, it configures all the external interfaces join the multicast group A.

According to the offline tests, an iptables rule to enforce the multicast traffic to the iptables masqurade chain is neede for the multiple outbound interfaces case, but I didn't find the related the logics in your PR. Do you forget it or I have missed something? If I missed that, please help figure it out.

@ceclinux : I could not see your commit any more. Could you check?

@ceclinux : I could not see your commit any more. Could you check?

Sorry for the inconvenience.  Now you can see my commit.

According to the offline tests, an iptables rule to enforce the multicast traffic to the iptables masqurade chain is needesd for the multiple outbound interfaces case, but I didn't find the related the logics in your PR. Do you forget it or I have missed something? If I missed that, please help figure it out.

Updated. Thanks for pointing this out.

/test-all

/test-windows-all
/test-ipv6-only-all
/test-ipv6-all

The PR touches 271 files, please revert unrelated changes.

The PR touches 271 files, please revert unrelated changes.

updated. Reset all the unrelated files.

/test-e2e
/skip-windows-all
/skip-windows-proxyall-e2e
/skip-ipv6-all

title: s/Mulitcast/Multicast
insert an empty between title and body

Reminder: There is a typo for this branch name. Rename it will cause close of this pr. May need to find a way to fix it before merging. @ceclinux

title: s/Mulitcast/Multicast

insert an empty between title and body

updated

/test-e2e
/test-conformance
/test-networkpolicy

/test-e2e
/test-conformance
/test-networkpolicy

/test-networkpolicy

/test-windows-e2e
/test-windows-conformance
/test-windows-networkpolicy

/test-windows-e2e
/test-windows-conformance
/test-windows-networkpolicy

Appreciate for detailed review @tnqn @wenyingd @jianjuns 👍


Flaky Test: v3discovery.TestCheckCluster

pull-etcd-unit-test Test: go.etcd.io/etcd/server/v3/etcdserver/api/v3discovery.TestCheckCluster/2_retries_for_getClusterSize
Test failed 1.4% (2/139) of the time
failure logs are:

commit
started
log

d28b489ab
2024-04-18 15:04:03 +0000 UTC
https://prow.k8s.io/view/gs/kubernetes-jenkins/logs/pull-etcd-unit-test/1780975546570641408

ebaf40ca8
2024-04-18 14:44:51 +0000 UTC
https://prow.k8s.io/view/gs/kubernetes-jenkins/logs/pull-etcd-unit-test/1780970720042422272

Please follow the instructions in the contributing guide to reproduce the issue.

pull-etcd-unit-test Test: go.etcd.io/etcd/server/v3/etcdserver/api/v3discovery.TestCheckCluster/no_retries
Test failed 1.4% (2/139) of the time
failure logs are:

commit
started
log

d28b489ab
2024-04-18 15:04:03 +0000 UTC
https://prow.k8s.io/view/gs/kubernetes-jenkins/logs/pull-etcd-unit-test/1780975546570641408

ebaf40ca8
2024-04-18 14:44:51 +0000 UTC
https://prow.k8s.io/view/gs/kubernetes-jenkins/logs/pull-etcd-unit-test/1780970720042422272

Please follow the instructions in the contributing guide to reproduce the issue.


Update README.md

Added new project:
multiformat - alpha
Summary
Added reference new project
Before Merge

[ ] Allow at least 24 hours for community input
[ ] If this is a new protocol, has the change been applied to https://github.com/multiformats/multicodec as well? If so, please link the multicodec PR.

The above two bullets are not needed since I only added a reference to a new implementation. No new/changed protocol proposed.

Agreed, its better to have one language block with multiple sub-items.
Fixed this, please have another look whenever it suits you.


Added a dev server run script

Watches for changes to files in src, transpiles using babel into lib triggering nodemon to restart the server process.

You could also add in the package.json under scripts: { "dev": "./bin/dev" }

Cool! @maysale01 Could you also add some info in CONTRIBUTING.md about how to use this? In the meantime I can still merge.


Custom Entities shown under folder "unknown" and custom entity not writeable

I added today my first custom entities and reading via ems-esp and iobroker works fine, but the folder in ioBroker is named "unknown". Is this the correct behaviour...?
A custom entity in that folder "unknown" is correctly set to be writeable in ems-esp and can also be written in ems-esp, but can not be written from ioBroker?!
B Which version of the ems-esp adapter are you using?
4.7.0

which ems-esp firmware version are you using?

Version 3.7.0 dev.30

Ulf Hirsekorn

Von: Thomas @.>
Gesendet: Samstag, August 17, 2024 10:24 AM
An: tp1de/ioBroker.ems-esp @.>
Cc: UlfHRO @.>; Author @.>
Betreff: Re: [tp1de/ioBroker.ems-esp] Custom Entities shown under folder "unknown" and custom entity not writeable (Issue #102)
which ems-esp firmware version are you using?
—
Reply to this email directly, view it on GitHubhttps://github.com/tp1de/ioBroker.ems-esp/issues/102#issuecomment-2294792086, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BCGDZ735KCA6YJHYMOTVDODZR4CDDAVCNFSM6AAAAABMUV4E4KVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEOJUG44TEMBYGY.
You are receiving this because you authored the thread.Message ID: @.***>

I found the mistake but I am just thinking how to correct. Up to yet custom elements where read and by device_id the right device was allocated. So custom elements for thermostat where under thermostat or heatingCircuits. Since devices where renamed the allocation was not working anymore ... so undefined.
Shall I keep this or shall custom elements be under custom?
What do you think?

I think I will use custom object structure for custom elements ....

👍
—————————
Ulf Hirsekorn
—————————

Von: Thomas @.>
Gesendet: Samstag, August 17, 2024 10:53 AM
An: tp1de/ioBroker.ems-esp @.>
Cc: UlfHRO @.>; Author @.>
Betreff: Re: [tp1de/ioBroker.ems-esp] Custom Entities shown under folder "unknown" and custom entity not writeable (Issue #102)
I think I will use custom object structure for custom elements ....
—
Reply to this email directly, view it on GitHubhttps://github.com/tp1de/ioBroker.ems-esp/issues/102#issuecomment-2294798654, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BCGDZ72ZUQLF47NO2CKJ5M3ZR4FP7AVCNFSM6AAAAABMUV4E4KVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEOJUG44TQNRVGQ.
You are receiving this because you authored the thread.Message ID: @.***>

Does ot mean I can Not write to custom entities...? Or is it just now a bug...?
Thanks....
—————————
Ulf Hirsekorn
—————————

Von: Thomas @.>
Gesendet: Samstag, August 17, 2024 10:49 AM
An: tp1de/ioBroker.ems-esp @.>
Cc: UlfHRO @.>; Author @.>
Betreff: Re: [tp1de/ioBroker.ems-esp] Custom Entities shown under folder "unknown" and custom entity not writeable (Issue #102)
I found the mistake but I am just thinking how to correct. Up to yet custom elements where read and by device_id the right device was allocated. So custom elements for thermostat where under thermostat or heatingCircuits. Since devices where renamed the allocation was not working anymore ... so undefined.
Shall I keep this or shall custom elements be under custom?
What do you think?
—
Reply to this email directly, view it on GitHubhttps://github.com/tp1de/ioBroker.ems-esp/issues/102#issuecomment-2294797763, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BCGDZ72Q4KJD4KZRIYH4N7LZR4FBFAVCNFSM6AAAAABMUV4E4KVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEOJUG44TONZWGM.
You are receiving this because you authored the thread.Message ID: @.***>

Does ot mean I can Not write to custom entities...? Or is it just now a bug...? Thanks....

another bug

Ok... Thanks for looking into this and for your time and effort...!
—————————
Ulf Hirsekorn
—————————

Von: Thomas @.>
Gesendet: Samstag, August 17, 2024 11:40 AM
An: tp1de/ioBroker.ems-esp @.>
Cc: UlfHRO @.>; Author @.>
Betreff: Re: [tp1de/ioBroker.ems-esp] Custom Entities shown under folder "unknown" and custom entity not writeable (Issue #102)
Does ot mean I can Not write to custom entities...? Or is it just now a bug...? Thanks....
another bug
—
Reply to this email directly, view it on GitHubhttps://github.com/tp1de/ioBroker.ems-esp/issues/102#issuecomment-2294809365, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BCGDZ7ZYWKFVR572EYMW3D3ZR4LCTAVCNFSM6AAAAABMUV4E4KVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEOJUHAYDSMZWGU.
You are receiving this because you authored the thread.Message ID: @.***>

I haven't used custom elements in ioBroker for a long time anymore ... since I moved to Home Assistant.
Writing was never enabled - just reading. It should work now with version 4.7.2.
Please test and report.

Hi Thomas,
Tested with 4.7.2. and I can confirm both is now correct:

Custom entities in folder "custom"
Custom entity is writable

Thanks a lot and "case closed"!
I hope you will maintain this adapter even you changed to HA!?!
Best regards,
p.s. unfortunately I have to open another ticket for DHW control commands... Sorry...

Ulf Hirsekorn

Von: Thomas @.>
Gesendet: Samstag, August 17, 2024 12:19 PM
An: tp1de/ioBroker.ems-esp @.>
Cc: UlfHRO @.>; Author @.>
Betreff: Re: [tp1de/ioBroker.ems-esp] Custom Entities shown under folder "unknown" and custom entity not writeable (Issue #102)
I haven't used custom elements in ioBroker for a long time anymore ... since I moved to Home Assistant.
Writing was never enabled - just reading. It should work now with version 4.7.2.
Please test and report.
—
Reply to this email directly, view it on GitHubhttps://github.com/tp1de/ioBroker.ems-esp/issues/102#issuecomment-2294818293, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BCGDZ74PHINGLCLQ2PP3W33ZR4PRFAVCNFSM6AAAAABMUV4E4KVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEOJUHAYTQMRZGM.
You are receiving this because you authored the thread.Message ID: @.***>


Problem with README links

Links in README are pointing to internal Gitlab pages.

To be updated as stated in GitLab issue #1119, please open further issues there :)


Bug: db.get_batches method in ledger rpc

### How to reproduce the bug
I encountered the following bug while testing the ledger RPC module. In the theo/test_rpc branch, in the test_rpc.rs file, the fourth test case:
let data = r#"{"jsonrpc":"2.0","method":"ledger_getBatches","params":[[2], "Standard"],"id":1}"#
            .as_bytes();
let expected = r#"{"jsonrpc":"2.0","error":{"code":-32000,"message":"io error: unexpected end of file"},"id":1}"#;
query_test_helper(data, expected);

Highlights that the ledger_getBatches method returns an error message while being inputed the right parameters.
Origin of the bug
In ledger-db/rpc.rs  in the populate_batch_response function we perform the following conversion:
batch.try_into?()

For each query mode, this conversion raises the error: (io error: unexpected end of file).
Explanation
It seems that this bug is due to the fact that the StoredBatch and the BatchResponse structures don't have the same format (the BatchResponse has a tx_range field that StoredBatch doesn't have), hence the conversion is not straightforward.

This looks like it's an error in the deserialization of the custom receipt - nothing else in try_into should be able to raise an io error. This likely indicates that the data being stored in the database is missing (part of) the custom StoredBatch field.
Is it possible that we're trying to read a different type than we're writing?

Yes, I just figured it out and indeed I wasn't providing the right generic parameters to get_ledger_rpc, I am going to close the issue


Trailing whitespace

Codacy detected an issue:
Message: Trailing whitespace
Occurred on:

Commit:  74422ce03601b774f905220e64d3fe98e3185de9
File:    wsocket.py
LineNum: 4
Code:    WSocket is a Simple WSGI Websocket Server, Framework, Middleware And

Currently on:

Commit:  9bf919181dc6868a72b426a6b29f1b821b7c21b3
File:    wsocket.py
LineNum: 4

Stale issue message

Stale issue message


Autocomplete path

First of all, thanks a lot for sharing this, the plugin looks awesome and I think it has a bright future ahead.
Now, I have a question. I'm quite used to hit tab to autocomplete the path of my search location. My typical flow is: :Ag "Search query" some<tab>where/in/my/pro<tab>ject/<CR>.
With vim-grepper, I have to type the whole path: gs -> "Search query" somewhere/in/my/project<CR>, because hitting <tab> changes the search program. How could I get the path to autocomplete?
Thanks and keep up the great work! :+1:

Thanks! I'm glad if other people find my plugins useful, too.
Now we dive into the ugly corners of Vim. ;] File completion for a command works different from file completion of a function like input(), like in this case.
For ag.vim's case it's easy enough. You can simply test this:
:command! -nargs=* -complete=file Edit edit <q-args>`

Afterwards you can use tab completion anywhere after :Edit  and it will just work. For input() you have to write an own completion function and even then, the completion functions always replaces the whole line. That works, but it has the disadvantage that, if it shows the possible completions, you'll also see all leading context that possible doesn't even belong to the path.
Anyway, it's better than no file completion at all, I guess. I'll keep my eyes open for better solutions, though.

Wow, works great! I also really like the new mappings. Great work, man! :) :+1:

Thanks!

@metalelf0 By the way, this will probably be useful for you: #6.


fix: use external health check for edge runtime

What kind of change does this PR introduce?
follow up #1061
What is the current behavior?
container health check is logging too much error
What is the new behavior?
switch to external http health check from host
Additional context
Add any other context or screenshots.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

12 of 12 (100.0%)  changed or added relevant lines in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.03%) to 61.045%

Totals

Change from base Build<PHONE_NUMBER>:
0.03%

Covered Lines:
4380

Relevant Lines:
7175

💛  - Coveralls


Android builds failed

after npm install and react-native link, tried to install my android app but i got this error:
reactnative 0.34
Unknown source file : UNEXPECTED TOP-LEVEL EXCEPTION:
Unknown source file : com.android.dex.DexException: Multiple dex files define Landroid/support/v7/appcompat/R$anim;
Unknown source file : 	at com.android.dx.merge.DexMerger.readSortableTypes(DexMerger.java:596)
Unknown source file : 	at com.android.dx.merge.DexMerger.getSortedTypes(DexMerger.java:554)
Unknown source file : 	at com.android.dx.merge.DexMerger.mergeClassDefs(DexMerger.java:535)
Unknown source file : 	at com.android.dx.merge.DexMerger.mergeDexes(DexMerger.java:171)
Unknown source file : 	at com.android.dx.merge.DexMerger.merge(DexMerger.java:189)
Unknown source file : 	at com.android.dx.command.dexer.Main.mergeLibraryDexBuffers(Main.java:502)
Unknown source file : 	at com.android.dx.command.dexer.Main.runMonoDex(Main.java:334)
Unknown source file : 	at com.android.dx.command.dexer.Main.run(Main.java:277)
Unknown source file : 	at com.android.dx.command.dexer.Main.main(Main.java:245)
Unknown source file : 	at com.android.dx.command.Main.main(Main.java:106)

:app:dexDebug FAILED

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':app:dexDebug'.
> com.android.ide.common.process.ProcessException: org.gradle.process.internal.ExecException: Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 2

Fixed with: cd android && ./gradlew clean


What does the TenantCreator role do (permissions wise)

I have been looking on google, microsoft docs and in the portal, but this role does not exist??
https://docs.microsoft.com/en-us/azure/active-directory/users-groups-roles/directory-assign-admin-roles
I can see that after the Enterprise Application is created that adding a user to it automatically gives that user the TenantCreator role. But it's not a role that exists in documentation or in the dropdown box when creating an Enterprise Application manually. So how am I supposed to read about it?
What permissions does a user get when being assigned this role??
Is it equal to Global Administrator, or is it scoped to specific actions?
Does the user get permissions to create enterprise applications at random and delete applications and service principals??
What kind of permissions does the TenantCreator entail? Because the name of the role suggests permissions on the level of a Global Administrator.
Some user being assigned this role could potentially have security issues.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: eab4b2c4-29d9-d759-066f-f7cf633260ca
Version Independent ID: 05c8b237-2c9e-6453-9cbf-9c7a3b7f8b07
Content: Create a tenant in Windows Virtual Desktop Preview - Azure
Content Source: articles/virtual-desktop/tenant-setup-azure-active-directory.md
Service: virtual-desktop
GitHub Login: @Heidilohr
Microsoft Alias: helohr

Thanks for the feedback! We are currently investigating and will update you shortly.

@MMollyy thanks for raising this issue. I took a look at our documentation and I too don't find anything related to TenantCreator. I can speculate what that entails but am not finding anything official.
This might just apply to Windows Virtual Desktop.
I am going to assign this issue to the Content Author to review and see if we can add some documentation around this role and the permissions it entails.
CC @ChristianMontoya

@MicahMcKittrick-MSFT @MMollyy : Understood that it is not widely documented. This role is only used for the New-RdsTenant operation, described in this article. If the user has not been assigned this role, the operation will fail. We do not use this Application Role anywhere else in the system.

Thanks @ChristianMontoya
If you like, I can close this issue if we don't want to add any additional info to the doc at this time.

@MicahMcKittrick-MSFT : If we continue to receive confusion on this, we can update. For now, I'd rather leave as is and work on other articles/feedback.
#please-close


Nullable Enums do not display as dropdown

I am attempting to generate swagger from an AspNetCore controller. Given the following code, I would expect two dropdowns to be available. If the user submits without making a selection the first should default to value1 while the second should be null
[HttpGet]
public IActionResult Get([FromQuery]DemoRequest request)
{
    // handle request
}

public class DemoRequest
{
    public DemoEnum DemoSelection { get; set; }
    public DemoEnum? DemoSelectionNullable { get; set; }
}

public enum DemoEnum
{
    value1,
    value2
}

What is actually rendered is one dropdown, and a textbox with no indication that it is an enum

This seems to be a Swagger UI problem and should be reported in this project together with a sample spec.

should be reported in this project

Did you mean reported in that project? Or is this project correct?
Assuming this project is correct, I've created a sample project to reproduce the issue and the generated json schema:

https://github.com/chrisheil/EnumGenExample
https://github.com/chrisheil/EnumGenExample/blob/master/swagger.json

Report here:
https://github.com/swagger-api/swagger-ui
And add a reference back to this issue.

Thanks

Btw is it correct with ReDoc?

Here is a link to ReDoc's demo site with the generated swagger spec
It looks like it defines it as a nullable int, but recognizes possible values an Enum with "oneOf" for the two int values.
So it does seem to be a difference in how SwaggerUI generates the controls based on that

I experimented with the raw spec that was generated, and discovered a way to get this to work in SwaggerUI. This correctly submits the expected request to the DemoController in the provided project
Original
{
  "name": "DemoSelectionNullable",
  "in": "query",
  "schema": {
    "nullable": true,
    "oneOf": [
      {
        "$ref": "#/components/schemas/DemoEnum"
      }
    ]
  },
  "x-position": 2
}

Updated
{
  "name": "DemoSelectionNullable",
  "in": "query",
  "schema": {
    "allOf": [
      {
        "nullable": true,
      },
      {
        "$ref": "#/components/schemas/DemoEnum"
      }
    ]
  },
  "x-position": 2
}

Additionally, the response provided on the SwaggerUI post suggested defining the nullable enum as a new component with the addition of a null options. In my example project it worked as well.
components:
  schemas:
    NullableDemoEnum:
      type: integer
      nullable: true
      enum:
        - 0
        - 1
        - null

The OpenAPI spec is just crap..
The problem with having nullable in the referenced schema is that it always nullable but nullable should be part of the property and not the schema.
In your sample (inline) we lose the name of the enum (needed for client generation).

It sounds like OpenAPI 3.1 will (hopefully) address this issue, though I have no idea when that will be released. Until then, I was looking into Document or Operation Processors earlier but I can't tell if I can take direct control over the swagger generation or not.
For now I will just create a duplicate Enum with an extra "Null" value by default, and then just null it out when mapping to the original Enum.


Add Cartographer as a package to TCE

Add Cartographer as a package to TCE
Feature Request
Problem
A path to production is a way of codifying an application’s value stream map as it makes its way from a developer’s workstation to a production environment.
Although Kubernetes has a rich ecosystem of APIs and tools to do the work, managing the communication paths between these resources can still be a big pain.
Cartographer
What is Cartographer?
Cartographer allows users to configure Kubernetes resources into re-usable supply chains that can be used to define all of the stages that an Application Workload must go through to get to an environment. We call these stages the path to production.
Cartographer separates controls between a user responsible for defining a Supply Chain (known as an App Operator) and a user responsible for creating the application (the Developer). These roles are not necessarily mutually exclusive, but provide the ability to create a separation concerns which means developers can focus on writing code, and platforms teams can focus on smoothing and securing their path to production.
How does Cartographer work?
Cartographer allows users to define all of the steps that an application must go through to create an image and Kubernetes configuration. Users achieve this with the Supply Chain abstraction.
The supply chain consists of resources that are specified via Templates. Each template acts as a wrapper for existing Kubernetes resources and allows them to be used with Cartographer. Cartographer supply chain templates include:
Source Template
Image Template
Config Template
Generic Template

Unlike many other existing Kubernetes native workflow tools, Cartographer does not “run” any of the objects themselves. Instead, it monitors the execution of each resource and templates the following resource in the supply chain after a given resource has completed execution and updated its status.
Feature Ask
The ask is to make Cartographer available as a Tanzu package as part of Tanzu Community Edition.

Hi @jwntrs,
Please review our package maintainer documentation.
If you're good with the above, let us know and we're happy to then approve this proposal and can accept a PR whenever your package is ready.
If you (or your team) cannot do what's described in those docs, let us know so we can figure out a plan.
Thank you!

Hi @joshrosso , I'll be the one pushing a PR to include the Cartographer package - just went through the documentation and everything sounds good!
We have created a package-for-cartographer repository under vmware-tanzu (should be made public soon - repository created but still private, just waiting for approval), but the repository is currently publishing the artifacts to ghcr.io as I don't yet have credentials to projects.registry.vmware.com (I'll reach out directly to figure that one out).
Thank you!

@seemiller can give you access to the registry @cirocosta.

@seemiller @cirocosta do you have the appropriate permissions now?

I added @cirocosta to the TCE Harbor project 4 days ago, he should be able to push packages.

Yes, thank you @seemiller !
@joshrosso , #3262 ready for review 👍


Change array_agg to return null on no input rather than empty list

Which issue does this PR close?
As @findepi pointed out in https://github.com/apache/datafusion/issues/11274#issuecomment-2211364784 that most of the aggregate function does not return non-null result if no row qualified. I double check the result in Postgres and Duckdb and find out they does not return empty list for array_agg. I think we can follow the behaviour as they did.
I also hope this can make dealing with nullability simpler

Check the nullability of each (aggregate) function
Make sure nullable is helpful for logical optimizer.

Closes #.
Rationale for this change

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

The result of array agg is changed

Thanks @alamb @findepi


[l10n] Improve az-AZ locale

[x] I have followed (at least) the PR section of the contributing guide.

@rommelmamedov Thanks, you rock 🎸 :)


Provide tissue-class-specific TSNR

At this moment the reports provide averaged TSNR over the entire brain. Because GM, WM and CSF have very different levels of TSNR, a lot of information is lost in the process of averaging. It would be much more informative if TSNR was provided for each tissue class separately.

For reference I'll note this here -> http://neurostatscyrilpernet.blogspot.com/2017/01/fmri-noise.html

Opened https://github.com/nipy/nipype/issues/1878 for this.


Does not show up in settings

I installed the latest version of uYouPlus and the setting to activate it does not show up in Video Overlay.
uYou 3.0.4 (most recent commit as of today)
YouTube version 19.42.1

Open the issue on uYouPlus repo, not here.


Utf 8 db

Going to use these tests to avoid a similar slip in the future.
I will add the patch on top.

Picking it up in #1757.


Call heap_caps_enable_nonos_stack_heaps() earlier

Just before starting the scheduler, since starting the scheduler involves allocating significant amount of memory for tasks.
It should be safe to do, since no other allocations take place and ROM functions are not being used.

@projectgus this one is for you

I share the concern @igrr has.
We are aware of this general problem (especially if there's a lot of statically allocated RAM). The solution, we think, is going to be moving the startup stack somewhere else in memory so that we can reduce the amount of memory reserved for startup stacks. I have a non-working patch for this somewhere if you want to see it, but I haven't got around to finishing it yet (you'd be welcome to start from there and get something going, though.)

yeah, good point @igrr. @projectgus - show me the patch, maybe i can finish it. this prevents us from updating the IDF.

Here you go:
https://gist.github.com/projectgus/29e9f3b3d344bfc4d4a0371cc314683c#file-0001-wip-allow-first-128kb-of-dram-to-be-allocated-static-patch
This is a fairly old patch and a WIP (predates new heap management code I think), so it probably doesn't apply cleanly to the github master. There are a bunch of things missing, but it may give you something to work from...

(I should be clear, I don't remember if this patch even works for the part which is implemented here...)

@projectgus PTAL
this is mostly based on your change, but i went one step further and actually allocate temp stacks on the heap - hey, why not? :)

[Nov 10 14:47:34.195] I (408) cpu_start: Pro cpu up.
[Nov 10 14:47:34.195] I (409) heap_init: Initializing. RAM available for dynamic allocation:
[Nov 10 14:47:34.217] I (413) heap_init: At 3FFAE6E0 len 00001920 (6 KiB): DRAM
[Nov 10 14:47:34.218] I (419) heap_init: At 3FFB3D50 len 0002C2B0 (176 KiB): DRAM
[Nov 10 14:47:34.218] I (426) heap_init: At 3FFE0440 len 00003BC0 (14 KiB): D/IRAM
[Nov 10 14:47:34.239] I (432) heap_init: At 3FFE4350 len 0001BCB0 (111 KiB): D/IRAM
[Nov 10 14:47:34.239] I (438) heap_init: At 40089758 len 000168A8 (90 KiB): IRAM
[Nov 10 14:47:34.240] I (445) cpu_start: Starting app cpu, entry point is 0x400806a4
[Nov 10 14:47:34.240] I (0) cpu_start: APP cpu start user code, stack at 0x3ffae7b4
[Nov 10 14:47:34.252] I (458) cpu_start: PRO cpu start user code, stack at 0x3ffaefb8
[Nov 10 14:47:34.270] I (142) cpu_start: Starting scheduler on PRO CPU.
[Nov 10 14:47:34.270] I (0) cpu_start: Starting scheduler on APP CPU.
[Nov 10 14:47:34.270] I (145) cpu_start: Entering app_main

I left some minor comments but generally this looks good to me, much simpler than what I was playing with.
I'm travelling at the moment so I won't get a chance to run the code and test it until next week, sorry.

ok, all comments addressed.

Thanks @rojer.
I've had a closer look at this now, and I also remembered the full details of the use case I had. This PR doesn't quite meet the use case I had in mind. I think this use case is a bit different to the use case you have, can you please explain your use case? I'm guessing it's heap allocation during static constructors, or something like that?
The use case that I was looking at is removing the ~192KB limit on statically allocated DRAM (.bss+.data). At the moment CPU0 (call_start_cpu0) starts with its stack around 0x3FFE3C40 and CPU1 (call_start_cpu1) is around 0x3FFE7D90.
Relocated the stack at the end of call_start_cpuX doesn't quite fix this, because there's already stack used by call_start_cpuX and this can overwrite data/bass. Relocating the stack at the beginning of call_start_cpu0 isn't quite enough, because the software bootloader uses stack as well.
So the solution I had in mind was something like:

Bootloader should relocate its stack before loading the .data section (or should put its stack in the .bss section).
call_stack_cpu1 should relocate its stack when CPU1 is first started, before any stack frames are written at the default stack address.

Moving the switch_stack assembler code you've written into a place that it can be linked into both the bootloader and the user app looks like it will make it fairly simple to achieve this goal.
I'm not necessarily asking you to do this work. If this PR currently solves the use cases that you have then I'm happy to merge this now and I'll get back to the 192KB static DRAM limit later on. But I figured I'd explain what I'm thinking, as well.

well, the case was that with a bit more static data scheduler wouldn't start because it couldn't allocate stack for tasks. but certainly nowhere near 192K of it.
now it actually turns out that this was mostly caused by the bug i had with c++ exception init, which ate 20K of heap, so strictly speaking, this change is no longer needed.
so, if you think it's useful in its current form, let's get it in and i'll let you take it from here to do the bootloader part.

Hi @rojer ,
Just wanted to let you know I've been looking at removing the 192KB static limit this week, using this PR as a basis. Still working on ith, though.

ack. i'll close this then. there's no real urgency, with c++ exception init fixed i don't actually need this, at the moment.


[5.4] Implicit route model binding not working with gates

Laravel version: 5.4.23

PHP version: 7.1.4

Database driver: pgsql

Models location: app/Models

Models namespace: Api\Models

I defined a gate named view as below in AuthServiceProvider.php:
Gate::define('view', function (User $user, User $requestedUser) {
        return $user->id == $requestedUser->id;
    });

If I use this gate in my routes file api.php as below:
Route::group(['middleware' => ['auth:api', 'can:view,user']], function () {
    Route::get('users/{user}', 'UserController@show');
});

FYI UserController@show:
public function show(Request $request, $user)
{
    return response()->json($user, 200);
}

Then I get this error:

FatalThrowableError in AuthServiceProvider.php line 38:
Type error: Argument 2 passed to Api\Providers\AuthServiceProvider::Api\Providers{closure}() must be an instance of Api\Models\User, string given, called in /path-to-project/vendor/laravel/framework/src/Illuminate/Auth/Access/Gate.php on line 274

The line 38 matches the line where the view gate is defined.
And I don't get any errors if I explicitly bind the {user} parameter to the User model:
Route::model('user', \Api\Models\User::class);

So I am pretty sure there is an implicit route model binding problem.
But everything works fine if I retrieve the user as below (closure):
Route::group(['middleware' => ['auth:api', 'can:view,user']], function () {
    Route::get('/users/{user}', function (\Api\Models\User $user) {
        return $user;
    });
});

I cannot understand why the implicit route model binding does not work when calling a method instead of using a closure. Am I doing something wrong or is it a bug?

That makes sense, as far as laravel knows {user} stores a string so it passes it to the gate, you need to explicitly tell laravel that this URL segment should be converted to a model.

It is not that simple :

https://laravel.com/docs/5.4/routing#implicit-binding
https://laravel.com/docs/5.4/authorization#via-middleware

You have to typehint the user on your controller method.


Removing under construction Buttons

The actual scenarios list has some items that are under construction. The feedback from @amedina  was to hide those links until they are ready.
Those links can be commented on for now.

fixed on pull request #11


No hand models after loading first_person_controller_vr.tscn

I followed wiki, but there are errors on console:
ERROR: Cannot open file 'res://.import/left_hand.glb-77ac71087f4863f9f653fbf9e0d7f139.scn'.    at: (core/io/resource_format_binary.cpp:984) ERROR: Cannot open file 'res://.import/right_hand.glb-3c383114f6b2b559f4827c32305c15a4.scn'.    at: (core/io/resource_format_binary.cpp:984)
When I use "Instance Child Scene" to load first_person_controller_vr.tscn there are no hands. Only ARVR controllers.
I use Godot 3.4 and plugin version 1.1.0

You have to add the left_hand_mesh.tscn and right_hand_mesh.tscn like this:

The controller nodes have no visual representation by themselves.

Indeed, the hand meshes are not added by default to the controller scene, not everyone wants to use them.

Closing the issue as the question was answered. @Looki2000 Feel free to reopen if needed.


feat(frontend): Expose all included and executed receipts in particular block

Partially resolves: #851
This PR is a part of disscussion of another PR

@luixo This feature is a valuable addition to the Block Details page, which helps nearcore chain team to be informed about the pieces that were included and executed in a given block. It does not need to be beautiful, so I believe it is ready to be merged (unless there are concerns about the implementation)


cant build lumen on linux using the latest nightly nor nightly-2020-05-13

I am trying to build lumen and keep getting errors, I made the following podman script to setup the env.
Build command completed, waiting for exit..
thread 'main' panicked at 'command did not execute successfully: "rustup" "run" "nightly" "cargo" "rustc" "-p" "lumen" "--message-format=json" "--color=never" "--" "-Clink-args=-Wl,-rpath,$ORIGIN/../lib" "-C" "opt-level=0"
expected success, got: exit code: 1', ioEggEFGJh.rs:290:9
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
[cargo-make] ERROR - Unable to execute rust code.
[cargo-make] WARN - Build Failed.
The command '/bin/sh -c cd /root/lumen && LLVM_PREFIX=$XDG_DATA_HOME/llvm/lumen cargo make' returned a non-zero code: 1

I get a similar error with nightly and nightly-2020-05-13, which is caused by a compile error
error[E0599]: no method named `reserve_in_place` found for struct `RawVec<T>` in the current scope
   --> liblumen_arena/src/arena.rs:183:39
    |
183 |                 if last_chunk.storage.reserve_in_place(currently_used_cap, n) {
    |                                       ^^^^^^^^^^^^^^^^ method not found in `RawVec<T>`

error[E0599]: no method named `reserve_in_place` found for struct `RawVec<u8>` in the current scope
   --> liblumen_arena/src/arena.rs:322:22
    |
322 |                     .reserve_in_place(used_bytes, needed_bytes)
    |                      ^^^^^^^^^^^^^^^^ method not found in `RawVec<u8>`

error: aborting due to 2 previous errors

For more information about this error, try `rustc --explain E0599`.

I get a similar error with nightly and nightly-2020-05-13, which is caused by a compile error
error[E0599]: no method named `reserve_in_place` found for struct `RawVec<T>` in the current scope
   --> liblumen_arena/src/arena.rs:183:39
    |
183 |                 if last_chunk.storage.reserve_in_place(currently_used_cap, n) {
    |                                       ^^^^^^^^^^^^^^^^ method not found in `RawVec<T>`

error[E0599]: no method named `reserve_in_place` found for struct `RawVec<u8>` in the current scope
   --> liblumen_arena/src/arena.rs:322:22
    |
322 |                     .reserve_in_place(used_bytes, needed_bytes)
    |                      ^^^^^^^^^^^^^^^^ method not found in `RawVec<u8>`

error: aborting due to 2 previous errors

For more information about this error, try `rustc --explain E0599`.

@vans163 Try this patch:
--- a/Makefile.toml
+++ b/Makefile.toml
@@ -72,7 +72,7 @@ CARGO_MAKE_RUST_SCRIPT_PROVIDER = "cargo-script"
 CARGO_MAKE_USE_WORKSPACE_PROFILE = true
 CARGO_MAKE_CARGO_BUILD_TEST_FLAGS = "--no-fail-fast"
 CARGO_TARGET_DIR = { value = "${CARGO_MAKE_WORKSPACE_WORKING_DIRECTORY}/target", condition = { env_not_set = ["CARGO_TARGET_DIR"] } }
-CARGO_MAKE_TOOLCHAIN_DEFAULT = { source = "${CARGO_MAKE_CI}", default_value = "nightly", mapping = { "true" = "nightly-2020-05-13", "false" = "nightly" } }
+CARGO_MAKE_TOOLCHAIN_DEFAULT = { source = "${CARGO_MAKE_CI}", default_value = "nightly-2020-05-13", mapping = { "true" = "nightly-2020-05-13", "false" = "nightly-2020-05-13" } }
 CARGO_MAKE_TOOLCHAIN = { value = "${CARGO_MAKE_TOOLCHAIN_DEFAULT}", condition = { env_not_set = ["CARGO_MAKE_TOOLCHAIN"] } }
 BACKTRACE_DEFAULT = { source = "${CARGO_MAKE_CI}", mapping = { "true" = "1", "false" = "0" } }
 RUST_BACKTRACE = { value = "${BACKTRACE_DEFAULT}", condition = { env_not_set = ["RUST_BACKTRACE"] } }

@danielzfranklin I get the same outside of docker.
Try applying the patch above and running:
docker run -v $PWD:/code --rm -it kronicdeth/lumen-development@sha256:71d03d818e85085995170b6211ec9ad17231bfee5716bda0552e14a7d1979b1b /bin/bash
cd /code
cargo make lumen

After that, to build spawn-chain example for wasm:
cargo make spawn-chain-web

Sorry for getting back late on this but nightly has since changed. Could you please retry? I'll close for now but let us know if this still isn't working and we can reopen to address


build: Update Vulkan-Headers and VUL to 1.3.291

CI CrashDiagnosticLayer build queued with queue ID 226570.

CI CrashDiagnosticLayer build # 219 passed.


[AutoPR compute/resource-manager] Compute v2019_03_01 Python

Created to sync https://github.com/Azure/azure-rest-api-specs/pull/5628

(message created by the CI based on PR content)

This PR has been merged into https://github.com/Azure/azure-sdk-for-python/pull/4724


Airplane Accident Severity

Machine Learning Model to find Severity of Airplane Accidents.

@sd2001 , as per the new rules of Hacktoberfest 2020, could you please label this pull request as "hacktoberfest-accepted", if merged? Thank you.

Yeah, so I have the hacktoberfest mentioned in the repo topic. So its mentioned to do either of them.
No problem as per your request, I'll label it as hacktoberfest-accepted.Thank you.Happy Hacking.

Yeah, so I have the hacktoberfest mentioned in the repo topic. So its mentioned to do either of them.
No problem as per your request, I'll label it as hacktoberfest-accepted.Thank you.Happy Hacking.

Thank you so much!


ctrl+r history results should be unique by command

I normally have used ctrl+r and hit it a few times to get the right command pre-fzf, which worked fine, and now with fzf, I can use my arrow keys to scroll the results, but I have many more to scroll than before. I don't see any value in presenting numerous duplicate results here, and zsh's default ctrl+r behavior doesn't do this.

@junegunn could you please provide an example on how to enable this option in fish? It doesn't have setopt

I want my history file to contain the duplicates, because I want to see my history. But I don't want them showing up in multiple entries when I search them through fzf. Can't we do that?

It's not simple as it sounds so it's not supported. If you know some shell scripting, you should be able to implement your own version of the binding.


How to get language inside nextjs getInitialProps method

Hi .
Is there any chance I can get current language inside nextjs getInitialProps method so I can do some SSR calls based on language.
Thanks .

You can check page props for initialLanguage.

Let me know if you have any other questions.

You can check page props for initialLanguage.

Can you be more specific? I keep getting undefined.
I tried this, but it's not working.
class MyApp extends App {
  static async getInitialProps({ Component, ctx }) {
    let pageProps = {};

    if (Component.getInitialProps) {
      pageProps = await Component.getInitialProps(ctx);
    }

    console.log({initLang: pageProps.initialLanguage})

    return { pageProps, namespacesRequired: ["common"] };
  }

Maybe you meant req.i18n.language. Still I don't get how to make this info available to nested components in an smart way.

Still I don't get how to make this info available to nested components in an smart way.

The current language is passed as a prop called lng via the withNamespaces HOC. If you need the current language in your _document component, you'll need to take one of the above approaches.

The current language is passed as a prop called lng via the withNamespaces HOC.

Ok. Totally missed it.
Thanks.

you'll need to take one of the above approaches.

@isaachinman Sorry, What are the above approaches, can't see them!

Use of lng in _document is well documented. Feel free to have a look around or post on StackOverflow.

@isaachinman Thank you for the prompt response,
Why lngFromReq function returns the fallback array of languages? it is not logical for me!
I need to filter out all languages except the current language but I can't do it because lngFromReq returns the fallback array, not the current language from request!!


Feat: expose complete stateStore as a slot prop

Expose state store as a solution to debouncing search updates with the updateState method
Closes #37

@huntabyte On it 👌


Incorrect forward to OLS4 from https://www.ebi.ac.uk/ols/index

Most search engines use https://www.ebi.ac.uk/ols/index which forwards to
https://www.ebi.ac.uk/ols4/index, a page which cannot be found.
Please forward https://www.ebi.ac.uk/ols/index to https://www.ebi.ac.uk/ols4/

This should be resolved now.


Opamp-go Module has security vulnarabilities related to the koanf library being used

Hi @everyone,
Am using the opamp-go module latest version in my project for the dynamic configuration of the otel collector platform.
have enabled the security scan of debricked and fortify scan for all the dependencies being used here and found few of the vulnarabilities related to the koanf package being used , below is the list
CWE-20 CWE-20 Improper Input Validation: CVE-2014-9653	github.com/knadh/koanf/providers/file:1.1.0
CWE-787 CWE-787 Out-of-bounds Write: CVE-2019-18218	github.com/knadh/koanf/providers/file:1.1.0
CWE-770 CWE-770 Allocation of Resources Without Limits or Throttling: CVE-2023-6337	github.com/hashicorp/vault/sdk:0.1.13
CWE-532 CWE-532 Insertion of Sensitive Information into Log File: CVE-2020-13223	github.com/hashicorp/vault/sdk:0.1.13
CWE-863 CWE-863 Incorrect Authorization: CVE-2023-24999	github.com/hashicorp/vault/sdk:0.1.13
CWE-532 CWE-532 Insertion of Sensitive Information into Log File: CVE-2018-19786	github.com/hashicorp/vault/sdk:0.1.13
CWE-613 CWE-613 Insufficient Session Expiration: CVE-2021-32923	github.com/hashicorp/vault/api:1.0.4
CWE-770 CWE-770 Allocation of Resources Without Limits or Throttling: CVE-2023-6337	github.com/hashicorp/vault/api:1.0.4
CWE-732 CWE-732 Incorrect Permission Assignment for Critical Resource: CVE-2023-5077	github.com/hashicorp/vault/api:1.0.4
CWE-295 CWE-295 Improper Certificate Validation: CVE-2021-27400	github.com/hashicorp/vault/api:1.0.4
CWE-404 CWE-404 Improper Resource Shutdown or Release: CVE-2020-7220	github.com/hashicorp/vault/api:1.0.4
CWE-532 CWE-532 Insertion of Sensitive Information into Log File: CVE-2020-13223	github.com/hashicorp/vault/api:1.0.4
CWE-863 CWE-863 Incorrect Authorization: CVE-2023-24999	github.com/hashicorp/vault/api:1.0.4
CWE-287 CWE-287 Improper Authentication: CVE-2020-16251	github.com/hashicorp/vault/api:1.0.4
CWE-345 CWE-345 Insufficient Verification of Data Authenticity CWE-290 Authentication Bypass by Spoofing: CVE-2020-16250	github.com/hashicorp/vault/api:1.0.4
CWE-532 Insecure Deployment: Unpatched Application: CVE-2018-19786<EMAIL_ADDRESS>CWE-327 Insecure Deployment: Unpatched Application: CVE-2022-27191<EMAIL_ADDRESS>CWE-347 Insecure Deployment: Unpatched Application: CVE-2020-9283<EMAIL_ADDRESS>CWE-476 Insecure Deployment: Unpatched Application: CVE-2020-29652<EMAIL_ADDRESS>CWE Not Specified Insecure Deployment: Unpatched Application: CVE-2022-30636<EMAIL_ADDRESS>CWE Not Specified Insecure Deployment: Unpatched Application: CVE-2021-43565<EMAIL_ADDRESS>CWE-295 Insecure Deployment: Unpatched Application: CVE-2020-7919<EMAIL_ADDRESS>i could see that the latest version of opamp is also using the same versions of the libraries.
Can anyone help me out how to mitigate these issues, because i read that all the security scans are taken care as part of the otel repositeries?

None of these dependencies are used in the client/server packages provided. Did you mean the project is using them in the examples?

Hi @srikanthccv ,
Yeah it is from the examples from the opamp-go.
anyway we have resolved it by upgrading to the Nonvulnarable and latest version available\\\

Closing this because the library itself doesn't have any vuln dependencies. The mentioned package is part of the example and will create a separate issue to address the dips.


SQL IN (...) operator

I found no way to write parameters for such query:
SELECT * FROM mytable WHERE rowid IN (1,2,3);
Test 1:
const t1 = db.prepare('SELECT * FROM mytable WHERE rowid IN (?)');
t1.all(1,2,3);
=> RangeError: Too many parameter values were provided
t1.all([1,2,3]);
=> RangeError: Too many parameter values were provided
t1.all(new Set([1,2,3]));
=> TypeError: SQLite3 can only bind numbers, strings, Buffers, and null
Test 2:
const t2 = db.prepare('SELECT * FROM mytable WHERE rowid IN (@args)');
t2.all({args: [1,2,3]});
=> TypeError: SQLite3 can only bind numbers, strings, Buffers, and null
t2.all({args: new Set([1,2,3])});
=> TypeError: SQLite3 can only bind numbers, strings, Buffers, and null

This is a limitation of Sqlite3, not better-sqlite3. You have to construct the SQL string manually for each array.
function selectByIds(ids) {
  const params = '?,'.repeat(ids.length).slice(0, -1);
  const stmt = db.prepare(`SELECT * FROM mytable WHERE rowid IN (${params})`);
  return stmt.all(ids);
}
const results = selectByIds([1, 2, 3]);

If you want to reuse the prepared statements to improve performance, you can cache them by their parameter count:
const cache = new Map;
function selectByIds(ids) {
  let stmt = cache.get(ids.length);
  if (stmt === undefined) {
    const params = '?,'.repeat(ids.length).slice(0, -1);
    stmt = db.prepare(`SELECT * FROM mytable WHERE rowid IN (${params})`);
    cache.set(ids.length, stmt);
  }
  return stmt.all(ids);
}
const results1 = selectByIds([1, 2, 3]); // stmt is created and cached
const results2 = selectByIds([4, 5, 6]); // stmt is reused from cache

Depending on the use case, the caching approach could result in an unacceptably large cache.

@JoshuaWise maybe you want to add this to the docs too?


*: prepare release

This PR includes commits that prepare the first docker2aci release:

Clean the API by reducing the exposed functions and using config structs instead of individual parameters.
Decouple an library error message from the docker2aci CLI
Change the names of the Convert functions
Exit with status 2 when the arguments are invalid
Add version flag
Update build instructions

The version stuff can be reworked in some followup PR. LFAD.


Programmatically Change Pages

I have the following option menu:
    st.session_state.navigation = option_menu(
        "Trust Builder",
        navigation_options,
        icons=icons,
        menu_icon="list",
        default_index=navigation_options.index(st.session_state.navigation),
        key="selected_option"
    )

I'd like to programmatically change the option selection, e.g. via a button, in some cases. This has always run into errors.
Is there a way to do this?

I'm not sure I understand exactly what you are trying to do and what is not working. Can you please elaborate?

I'm not sure I understand exactly what you are trying to do and what is not working. Can you please elaborate?

Normally, you have to click on the option to change the selection. This is fine, works as a nav bar should. I'd also like to change the option programmatically, e.g. via a button:
if st.button("Go to My Documents"):
   st.session_state.navigation = "My Documents"
   st.rerun()

However, this doesn't work. You can do this with other types of navigation but not option_menu.

bump


Be able to remove the path and locations from the error object in HotChocolate V14.

Product
Hot Chocolate
Is your feature request related to a problem?
Hi team,
I've encountered an issue after upgrading from Hot Chocolate v13 to v14. In the project, I use an ErrorHandlingFilter (implementing IErrorFilter) to customize error responses. Previously, I could remove the path and extensions properties from the error object using methods like error.WithMessage(ex.Message).WithCode(ErrorCodes.BadUserInput).RemovePath().RemoveLocations(). This worked as expected in v13.
However, after upgrading to v14, these RemovePath() and RemoveLocations() calls no longer have any effect. The path and extensions properties are always present in the final error object.
After investigating, I found a change in MiddlewareContext.Global.cs file in v14
https://github.com/ChilliCream/graphql-platform/blob/410d8977b4a3b68250e7a6aed930df66de527670/src/HotChocolate/Core/src/Execution/Processing/MiddlewareContext.Global.cs#L129
This line seems to be re-adding the path and locations to the error, overriding the removals.
My questions are:
Is this behavior intentional in v14?
Is there a recommended way to remove path and locations from error objects in v14 if we still need it?
The solution you'd like
Be able to remove the path and locations from the error object in HotChocolate V14.

The GraphQL spec demands that field errors have a path and location. We now will always add a path to an error that is happening in a field execution context.

If an error can be associated to a particular field in the GraphQL result, it must contain an entry with the key path that details the path of the response field which experienced the error. This allows clients to identify whether a null result is intentional or caused by a runtime error.

https://spec.graphql.org/draft/#sel-HAPHRPHEByBB0Bp6Z

If an error can be associated to a particular field in the GraphQL result, it must contain an entry with the key path that details the path of the response field which experienced the error. This allows clients to identify whether a null result is intentional or caused by a runtime error.

https://spec.graphql.org/draft/#sel-HAPHRPHEByBB0Bp6Z

Thanks for the response and link. It's good to know that path and location are now mandatory requirements.   @michaelstaib


Fix documentation for Indexed

Correct the guide documentation for Indexed. Sequences obviously don't have indexes.
Checklist

[X] I've added at least one test that validates that my change is working, if appropriate (N/A)
[X] I've followed the code style of the rest of the project (N/A)
[X] I've read the Contribution Guidelines
[X] I've updated the documentation if necessary

Thanks!


Add oonidata package + reprocessing from jsonl

This is related to making it easier for third parties to consume OONI data (see: https://github.com/ooni/backend/issues/514).
As part of this PR I have also done a bit of refactoring to the s3feeder with the following goals:

Make the code in there more re-usable by tools such as oonidata
Add support for fetching data from the jsonl buckets instead of the cans and minicans

Currently the jsonl fetchers are not wired up to the fastpath, but it should just be a matter of changing the functions that call stream_cans to stream_jsonl as the API is fully compatible.
We should probably first discuss with @FedericoCeratto when and how exactly this should be done.
In doing the switch from reprocessing from cans to jsonl, I think we should consider the following:

The new jsonl bucket format (the one that starts with the jsonl/ prefix), is very good if a user is interested in accessing just measurements for a given set of test_names and countries, yet it doesn't work very well if you want to process ALL data for a given time range. This may or may not be an issue for our data processing pipeline, I think that when we are to reprocess data, we probably also want to do it on a per test_name basis and we care to reprocess it from the beginning of time to date.
The average size of each individual jsonl is significantly smaller than a can. This means that batch retrieval might be slower.

Regarding the oonidata tool it currently supports the sync command, with command line options that are taken directly from the netanalysis.ooni.data.sync_measurements tool of @fortuna.
I would actually like to change the CLI API a bit, so it should not be considered stable ATM.
The main changes I would like to do are:

Support passing a list of country codes or omitting the country code entirely for retrieving all data for a given time range
Support passing a list of test_names and not defaulting to web_connectivity

Other minor things I am considering as well are:

Small cosmetic changes to the CLI args (ex. replace _ with - and align the naming conventions with those used elsewhere in the pipeline)

The reason why I am opening this PR is that I would like to start getting feedback on early on, so that this can inform future iterations.

TODO:

[ ] Benchmark using ThreadPool
[ ] Set MAX_POOL_SIZE to a factor of os.cpu_count()

Sharing here some of the results from the benchmark of ThreadPool vs ProcessPool.
These tests were run on a 32 core server with 1 Gbit link, using the default configuration of ThreadPool and ProcessPool (it defaults to using os.cpu_count()).
By running:
time oonidata sync --since 2022-01-01 --until 2022-01-05 --country-codes RU --test-names webconnectivity --output-dir output

This command in particular will download 8.5GB worth of data.
With ProcessPool:
real    1m24.508s
user    0m45.710s
sys     0m18.767s
---
real    1m23.868s
user    0m46.850s
sys     0m20.405s
---
real    1m23.433s
user    0m46.757s
sys     0m20.322s

With ThreadPool:
real    1m24.009s
user    0m58.021s
sys     0m28.024s
---
real    1m24.002s
user    0m57.935s
sys     0m27.903s
---
real    1m24.141s
user    0m58.933s
sys     0m29.225s

By running on a test type that has smaller files on a larger time range:
time oonidata sync --since 2022-01-01 --until 2022-03-01 --country-codes RU --test-names whatsapp --output-dir output

This range of data had an overall size of 526M.
with ThreadPool:
real    0m30.137s
user    4m18.437s
sys     0m4.370s
---
real    0m29.380s
user    4m16.164s
sys     0m4.374s

with ProcessPool:
real    0m28.351s
user    4m15.623s
sys     0m4.514s
---
real    0m28.075s
user    4m17.353s
sys     0m4.277s

Based on these stats, it seems like there is very little difference between the two, with just an extremely marginal improvement when using ProcessPool.


Pylint complaining abstract-class-instantiated because of type hint stunt for init

Environment
How do you use Sentry?
Sentry SaaS (sentry.io) or self-hosted/on-premise (which version?)
Saas
Which SDK and version?
python-sdk v1.0.0 in Python 3.9
Steps to Reproduce
In my code, I call
sentry_sdk.init(dsn=os.getenv('SENTRY_DSN')

I use pylint that just released a version 2.7.4 to statically check my code for lint errors
Expected Result
No lint error found (that was the case three weeks ago)
Actual Result
I get this pylint error
E0110: Abstract class 'init' with abstract methods instantiated (abstract-class-instantiated)

I believe this is due to the stunt to have nicer autocompletion that is now detected by pylint.

FWIW, I've just started seeing this with an update from Python 3.8 to 3.9.

isn't the fix straightforward?
if MYPY:
    class _MyContextManager(ContextManager[Any]):
        def __exit__(self, exc_type, exc_value, traceback):
            pass

    class init(ClientConstructor, _MyContextManager):  # noqa: N801
        pass

Up. @belm0's fix seems to be sorting out the problem

@sl0thentr0py @belm0 @ava7
I am running into the same issue. Python 3.6.15, sentry-sdk==0.20.3
I have a module level functions where i am calling
sentry_logging = LoggingIntegration(
            level=logging.INFO,
            event_level=logging.ERROR
        )

sentry_sdk.init(
            dsn=dsn,
            attach_stacktrace=True,
            integrations=[sentry_logging]
        )

and pylint is complaining with
 E0110: Abstract class 'init' with abstract methods instantiated (abstract-class-instantiated)
we are using<EMAIL_ADDRESS>for linting in our CI
any idea how to proceed?

xref to #1415


Resolved: Unnecessary check for quoteId in _serverDeleteItem method (#3415)

Related issues

#3415
closes#
#3415
https://github.com/DivanteLtd/vue-storefront/issues/3415
Short description and why it's useful

Removed if condition from the _serverDeleteItem method on core/modules/cart/store/action.ts  file.
Screenshots of visual changes before/after (if there are any)

Which environment this relates to
Check your case. In case of any doubts please read about Release Cycle

[x] RC version (https://next.storefrontcloud.io) - this is a stabilisation fix for Release Candidate of Vue Storefront. I've created branch from release branch and want to merge it back to release

Upgrade Notes and Changelog

[x] No upgrade steps required (100% backward compatibility and no breaking changes)

IMPORTANT NOTICE - Remember to update CHANGELOG.md with description of your change
Contribution and currently important rules acceptance

[x] I read and followed contribution rules
[x] I read the TypeScript Action Plan and adjusted my PR according to it
[x] I read about Vue Storefront Modules and I am aware that every new feature should be a module

Thanks! Please just update the changelog

Thanks for the review @pkarw,  done!


Decoder using JSGF Grammar?

I guess the official Kaldi project is the right place for this question, but I dare to ask anyway :)
Has anyone tried to use a JSGF Grammar with Kaldi yet?

I have interest in this as well.

https://github.com/gooofy/kaldi-adapt-lm/blob/master/kaldiadaptlm/templates/kaldi-run-adaptation.sh


Publish on packagist

Please, publish gearmanui on packagist, this would ease a lot its installation using composer create-project

I'll look into it. Thanks for the suggestion.

The new version of GearmanUI is available on packagist. I'm still figuring out how to handle certain dependencies though ...

Like what ?


[Tracking/Action] some descriptive title

Description
Add the Spanish language to the Env Sustainability website and the Glossary
Input
Just the current content of the website
Outcome
Website translated into Spanish
To-Do
Translate the current pages

I am going to work on the About folder

I will be part of the translation team from Cloud Native Guatemala.

I will be helping with the translation. I'm from Cloud Native Guatemala

I´m gonna be part of the translation team from Cloud Native Guatemala.

Hello, I'll also be part of the translation team. I'm a member of Cloud Native Guatemala.

We already assigned the 23 documents to translate into our team. This will be ready by February 13th @leonardpahlke

Wow, this is amazing! I love all the engagement and efficiency from the community on this - thank you for the time and effort💚

We are done with @shlopezm4 and I, just waiting for the others translations to send the PR.

My part was merged.

My part was merged.

I'm from the Cloud Native Guatemala Community and I'm happy to help with translations!

Working on the PR right now @leonardpahlke I think that is related to the other issue pending about the workflow for preview the website into Spanish

This our current PR https://github.com/cncf/tag-env-sustainability/pull/340 @leonardpahlke

Thanks for all your work translating the website in spanish! 🙌


Allow different path for vs code.

What's the rationale for this change?

I think vs code runs the tests not from the crate dir but from the workspace.

Is this the only occurrence of this? Also could it be maybe fixed by having a symlink to the test_data folder? Or is it dirty?

feels like a hack tbh

Seems to be this issue: https://github.com/rust-lang/rust-analyzer/issues/4705


label_image does not work with quantized MobilenetV1 .tflite

Hi,
I used retrain.py to retrain quantized mobilenet v1 from https://tfhub.dev/google/imagenet/mobilenet_v1_050_128/quantops/classification/1.
Then I converted the graph to tflite as following:
toco \
--input_format=TENSORFLOW_GRAPHDEF \
--input_file=/home/khoi/mobilenet_slim/exp2_1_1/graph.pb \
--output_format=TFLITE \
--output_file=/home/khoi/mobilenet_slim/exp2_1_1/exp2.tflite \
--inference_type=QUANTIZED_UINT8 \
--input_shape=1,128,128,3 \
--input_array=Placeholder \
--output_array=final_result \
--input_data_type=FLOAT

When I run the label_image,

bazel run --config=opt //tensorfl/lite/examples/label_image:label_image -- \
--tflite_model=/home/khoi/mobilenet_slim/exp2_1_1/exp2.tflite \
--image=/home/khoi/mobilenet_slim/exp2_1_1/3.bmp \
--labels=/home/khoi/mobilenet_slim/exp2_1_1/labels.txt

the process stop at resolved reporter without any error.
Does anyone know what the problem can be?

Hi jonoki, thanks for the report. We're looking into it, not clear yet which component is even at fault...

How to run quantized mobilenet v1 inference model?

@jonkoi: This reproduces for me (and --config=dbg plus gdb shed some light). The issue appears to be a boundary condition in TFLite's handling of quantization scales. I'll see if I can work around that in the quantops modules itself...

Please try again with https://tfhub.dev/google/imagenet/mobilenet_v1_050_128/quantops/classification/3
For me, that fixed the problem. Please reopen (with repro details) if it persists for you. Thank you for your patience.

Hi, arnoegw. I'm curious about what did you do to build the V3? Did you do something in module_fn()?
By the way, are the module_fn() in ModuleSpec you guys used to generate TensorFlow hub modules open-sourced? Actually I'm also interested in them and I hope to learn these implementations.
Thank you very much.

Hi, @arnoegw . I'm curious about what did you do to build the V3? Did you do something in module_fn()?
By the way, are the module_fn() in ModuleSpec you guys used to generate TensorFlow hub modules open-sourced? Actually I'm also interested in them and I hope to learn these implementations.
Thank you very much.

Hi @XMK233, the module_fn for google/imagenet/mobilenet_v1... is just a thin wrapper around the TF-Slim implementation (and likewise for any of our image models that mention TF-Slim in the documentation). Unfortunately, it is not open-sourced at this time.
That wrapper contains a scaling from the canonical input range [0,1] of pixel values to the one expected internally by slim, which is [-1,+1]. Before commit https://github.com/tensorflow/tensorflow/commit/01ebab40444bc20202336a36012aedc02210661e, toco did not work when using the precise range [-1,+1] for quantization, so I worked around that and made it [-1,+1.001].

Thanks. ;-)


Update Get-SpoofMailReport.md

@chrisda

Docs Build status updates of commit 8d27d95:
:clock10: Full build: the average full build time is 17 min(s) 40 sec(s), this is based on the last 1000 build(s) for this repository.

Docs Build status updates of commit 8d27d95:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

exchange/exchange-ps/exchange/Get-SpoofMailReport.md
:white_check_mark:Succeeded
View (exchange-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit eb75510:
:clock10: Full build: the average full build time is 17 min(s) 35 sec(s), this is based on the last 1000 build(s) for this repository.

Docs Build status updates of commit eb75510:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

exchange/exchange-ps/exchange/Get-SpoofMailReport.md
:white_check_mark:Succeeded
View (exchange-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel


Automate Process for Packaging Extension for Each Platform

As we support more platforms, we should probably automate creating a release. Notably, creating the zip files for each platform that contains what it needs.

Already completed, closing.


Use with foreman and remote debugger

Hi,
I am looking to use this library to integrate with our local dev environment using foreman.   I read in another issue #287 that we could use debug gem as a remote debugger, but unsure if I am doing it the right way.
My procfile
web: rdbg -O -- bundle exec rails s
worker: bundle exec sidekiq -C config/sidekiq.yml
webpacker: WEBPACKER_DEV_SERVER_HOST=<IP_ADDRESS> ./bin/webpack-dev-server

But I get the following error:
web-1            | 19:23:04 web.1       | /usr/local/bin/ruby: No such file or directory -- bundle (LoadError)

Not released yet. You can try it on master branch.

This gem is awesome. Working through the Rails 7 upgrade and loving debug so far. +1 for the debugger alias ❤
I got remote debugging with Foreman / Procfile up and running pretty smooth (for what I wanted) and thought I'd share. I didn't change the web: declaration in my procfile; I prefer to keep my procfile clean (even though it's a .dev, still) — I instead just add require 'debug/open_nonstop' to the top of my development.rb config file (with a note about why it's there for my fellow devs) then run the application with Foreman as normal. At that point I can use the VS Code adapter to attach to the process at any time and have a live debugging connection or, more typically, after dropping in a debugger and forcing the breakpoint, attach to the process to work through that debugging point.
Works excellently! Probably the best IDE-driven debugging process I've ever had in Ruby 😆 Thank you team!!

@acetinick sorry for absent.
I'm not sure why Gmefile.lock specifies 1.2.4. Do you have an idea? (I'm not an expert about bundler ecosystem).

@jon-sully
I have recently been trying to get the require 'debug/open_nonstop' working in my rails application (using foreman as well). However when I add the line to the top of my development.rb my application loads as if it is never loaded. For comparison, if I add that same line to the top of my bin/rails file then it will start up and my console says:
DEBUGGER: Debugger can attach via UNIX domain socket (/tmp/ruby-debug-sock-0/ruby-debug-ruby-debug-10)

Does this still work for you or have you had to make any updates to get your debugger to work?

This gem is awesome. Working through the Rails 7 upgrade and loving debug so far. +1 for the debugger alias ❤
I got remote debugging with Foreman / Procfile up and running pretty smooth (for what I wanted) and thought I'd share. I didn't change the web: declaration in my procfile; I prefer to keep my procfile clean (even though it's a .dev, still) — I instead just add require 'debug/open_nonstop' to the top of my development.rb config file (with a note about why it's there for my fellow devs) then run the application with Foreman as normal. At that point I can use the VS Code adapter to attach to the process at any time and have a live debugging connection or, more typically, after dropping in a debugger and forcing the breakpoint, attach to the process to work through that debugging point.
Works excellently! Probably the best IDE-driven debugging process I've ever had in Ruby 😆 Thank you team!!
EDIT: I may in the future switch from having the require 'debug/open_nonstop' in development.rb to just making my Procfile.dev's web command be rdbg -O -n -c bundle exec puma since the development.rb require approach can make certain commands finicky. Time will tell. Both work great 🙂

@jon-sully can you explain how you can attach to the process of a debugger, maybe also without using VC 😬
Thanks

Ah, yeah that's uh.. relevant! 😆 "Here's how to fire up the debugger" without "here's how you connect" feels a little half-baked. Sorry!
You can connect to the running ruby (web) process once it's fired up (as long as you wrap it in Rdbg via my prior comment) either via VS Code with a launch.json config like:
{
  "version": "0.2.0",
  "configurations": [
    {
      "type": "rdbg",
      "name": "Attach with rdbg",
      "request": "attach"
    }
  ]
}

Provided you have the Ruby VS Code extension installed (https://marketplace.visualstudio.com/items?itemName=rebornix.Ruby)
Or you can connect directly to the process via command line by just running:
$> rdbg -A

Which is the short hand for "attach".
Attaching to a running process should work whether that process is currently paused at a break point or running normally.

@jon-sully I have recently been trying to get the require 'debug/open_nonstop' working in my rails application (using foreman as well). However when I add the line to the top of my development.rb my application loads as if it is never loaded...
Does this still work for you or have you had to make any updates to get your debugger to work?

@elalemanyo I can't recall exactly why I switched to using the CLI invocation instead of the ruby package — I think I was getting a bit of strange behavior too, but I have been using this for most of the year with my Procfile.dev set as:
# NOTE: Opens up the remote debugging back-door port so that when a breakpoint
# is hit in the server process (running under Foreman), a remote debugging
# utility (https://marketplace.visualstudio.com/items?itemName=KoichiSasada.vscode-rdbg
# for VSCode) (`rdbg -A` in a terminal) can attach and control/continue/etc. Neato!
web: rdbg -O -n -c bundle exec puma

log: tail -f -n 0 log/development.log
js: yarn build --watch
css: yarn build:css --watch

And boot the application using Rails 7's canonical bin/dev.

@jon-sully Normally I was starting my web service using this: web: bin/rails server -p $PORT -b $BIND , so now following your instructions I am using web: rdbg -O -n -c bin/rails server -p $PORT -b $BIND but I am getting this error:

any idea? Thanks

Try this: rdbg -O -n -c -- bin/rails server -p $PORT -b $BIND

@st0012 thanks for your suggestion, now I get a new error 🙂

Not sure if now is because of my setup... I keep trying 💪

Add bundle exec before both rdbg and bin/rails should help.

I too am on the "always bundle exec before ruby executables" train 😛 as with the common / idiomatic be prefix shortcut.

@st0012 thanks again but getting new error 😬

Try this :)
bundle exec rdbg -O -n -c -- bundle exec rails s -p $PORT -b $BIND

Can you upgrade debug to the latest version? It looks like a bug I fixed in 1.6.*.

@st0012 now works! To connect to debugger I can run rdbg -A in a terminal, right? Trying this but having some issues... running all my setup inside docker so I am running docker exec -it <mycontainer> rdbg -A but I am getting this error:

I'm not a docker / container user myself but does docker exec -it run that command inside the same container, or just spin up a new small container to run the following command? If it's the latter then I'd imagine you'll have to figure out how to expose the right socket / port info so that a different container can connect to your server container. This is all outlined pretty well in the docks for "Remote Debugging" on the README.
I'll probably leave my thoughts at that for containerized running though — just want to stay true to the topic of this particular issue we're commenting on (which is just how to use Ruby Debug as a remote client for when running Rails Server under Foreman). Cheers! 👍

@st0012 docker exec command runs a new command in a running container, so that should be ok. But you're right that this is off topic, sorry about that. Thanks for all the help.

@elalemanyo I just stumbled on this issue. I think the problem you are having is the parser doesn't recognize that the -p and -b are for the bin/rails command and not rdbg.  Just put the -c command in quotes and it is works for me:
web: rdbg -O -n -c "bin/rails server -p $PORT -b $BIND"

Thanks everybody for the help here.
None of these solutions worked for me, including @spovich 's most recent. What worked for me was cutting the web: line with rails server entirely out of my Procfile.dev and just running the server in another window with rails s the old way. So my foreman is only running dartsass, solid_queue, actioncable and whatever other processes, and the window running rails s works as expected with debug.
Setting up a port for debug and starting rdbg in another window, even if it weren't so buggy, is certainly not easier — and frankly seems a little convoluted. If foreman and debug are both core Rails now, it seems like a debug session is something that should work out of the box (I realize this is the wrong repo to say that!). It should really require no time or research to set up, and it should be well documented. right?


Push artifacts to Maven Central

Context
Authenticating with GitHub Packages might be too much for developer that is "just passing by".
We need to reduce friction, so that more people can quickly try this out and express their opinion.
Acceptance criteria

Existing release scripts support pushing to Maven Central

All existing packages (with bumped versions) are present in Maven Central repository

Documentation is updated

"Supported providers" table
"Getting started" guide

GitHub Packages pane is not displayed on pulumi-kotlin repo page

Details

docs

https://maven.apache.org/repository/guide-central-repository-upload.html

"hardest" part – domain ownership verification (https://central.sonatype.org/publish/requirements/coordinates/)

The task was officially completed with this PR: https://github.com/VirtuslabRnD/pulumi-kotlin/pull/214


issue with travis.ci

Hi Randy,
I saw the travis build wasn't responding correctly, is there anything I can help with?
ERROR: InvocationError: '/home/travis/build/andymaheshw/AdobeAnalytics/.tox/check/bin/flake8 src tests setup.py'
___________________________________ summary ____________________________________
ERROR:   check: commands failed

Changed the tox file to fix it... Let me know if that works, check out the pull request.

#18 still fails on the PEP8 syntax check. See my comments on your pull request, it might be worth just turning off the syntax checker until we've got a package worth releasing.

Merged #18 to keep moving


Issue with direct link to HTTPS images

Images served over HTTPS are not displaying properly

Hi David, do you have any workaround for images with HTTPS please?
I tried leaving out the "s" from an "https" URL in the attached PBIX, but it didn't work.
PBIX_ImageTimeline_Issue1.zip

I'm having the same problem. Images over HTTPS are not showing up.

I'm having the same problem. Images over HTTPS are not showing up.


Write a blog post about our overall cloud cost control strategy

As we start working on providing better cost control to our communities, we want to lay out a overarching narrative of how we are going to be doing that, in line with our principles and strengths. It has two audiences:

External budget owners, who need to understand how to model cloud costs for their communities
2i2c team members, as we try to make choices in our product building process.

This overarching narrative in this blog post would help keep us aligned, and help get us out of unnecessary rabbitholes.

I started a draft in https://hackmd.io/AqZxyS8oSyGCpWfyX3_pfA?both

@yuvipanda I've reviewed your first draft 💪

@yuvipanda just checking in case you need more help from me.

Hey! How can we get this one over the line? I think we agreed in our last sync to put a deadline on this so... I am choosing Aug 16 before you fly out! ✈

@jnywong let's put this back on the backlog, and I'll pick this back up after I'm back from my time off.

Sounds good!

@yuvipanda or @jnywong does this card belong on the P&S wall? I'd also be ok with moving it under the broader marketing work

@yuvipanda what would you like to do with this one? I think we could repurpose the content to serve comms for the AWS rollout? https://github.com/2i2c-org/infrastructure/issues/4879?

https://github.com/2i2c-org/infrastructure/issues/4879 is now closed,  but I am working on getting this blog post as a sister companion piece.

Can this be closed now that the post is out?

@Gman0909 The blog post for this is not published: https://github.com/2i2c-org/2i2c-org.github.io/pull/331
I think you are maybe confusing this with https://github.com/2i2c-org/infrastructure/issues/4879?

But I agree that this is a loose end that we need to either tie up or cut loose! :)

I was referring to #4879, yes, and my question was whether this is still relevant. In either case I think we should split this off into its own action and not let this hold up the closing of the parent initiative.


Version 1.3 unstable?

Since the latest update the plugin always crashes for me as soon as i leave a map, with this message:
"Plugin has become unstable, so it has been stopped" and the log saying "Unrolling dangling script UI stack: Main.as line 912".

ahhh shit.. thats not good, I'll try to find out whats going on in the next few days

Thanks for letting me know i'll make an update on openplanet for it soon


$CurrentContainer cannot be initialized when -only-exposed is used

If using docker-gen and nginx separately instead of nginx-proxy, the official template does not work when -only-exposed (or -only-published) is used.
After debugging, I found out that the root cause is $CurrentContainer is not initialized properly. This is expected because the docker-gen container does not expose any ports. So
{{ $CurrentContainer := where $ "ID" .Docker.CurrentContainerID | first }}

cannot find the docker-gen container inside $ (the list of all containers)
A possible solution is to explicitly expose .CurrentContainer as a top-level argument to the template.

Sorry, I'm not sure.
Is that supposed to be fixed by #2191, or #2191 only  fixes #2189 ?


Add TextEncoder polyfill to the SDK

Describe the issue:
One of the dependencies of this SDK uses the TextEncoder API. Since this is not supported in React Native, this polyfill has to be manually installed. It will be better for the developers if the polyfill can be packaged by the SDK itself.

@thivi
Hi, this looks like it's  an old issue, is it still relevant after all the refactoring that has occurred since then?

Hi @jay-jlm,
This is no more relevant as this code segment has been moved out of the SDK by https://github.com/asgardeo/asgardeo-auth-js-sdk/pull/167


remove released_at instances on ui

Remove released_at from ui

We also need to remove this data from the database via a migration to remove the column (along with any associations or requirements tied to the release date if there are any)

Okay, will look into this


Use modeName

#74  👈
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @ksharma-xyz and the rest of your teammates on  Graphite


FR: Ability to use goaccess over https

It seems goaccess (--real-time-html) can't be used currently over https (WebSocket connection to 'wss://localhost:7890/' failed: Error in connection establishment: net::ERR_CONNECTION_REFUSED).   As almost all production systems use https (unconditional redirect) by default then maybe a way could be devised to provide https support for goaccess?
BR,
G.

GoAccess does provide wss support. Did you configure goaccess with --with-openssl? How are you running goaccess?

Hi, I installed latest from goaccess.io to the server I wanted to monitor and ran goaccess -f /var/log/apache2/public_access.log -o /var/www/goa/index.html --real-time-html --ssl-cert=/etc/letsencrypt/live/mydomain.com/cert.pem --ssl-key=/etc/letsencrypt/live/mydomain.com/privkey.pem or goaccess -f /var/log/apache2/public_access.log -o /var/www/goa/index.html --real-time-html --ws-url=localhost. I got the page up but it doesn't update. I have Apache rewrite so everything switches to https immediately. Googling the problem took me to http://stackoverflow.com/questions/38710438/ which claims that Goaccess doesn't work over https. If it works I would really like to know how to do it.

Please try using wss:// as part of your --ws-url and make sure you pass the right host (the server that's running goaccess and probably not the machine containing the browser to open the report, i.e., localhost), e.g.,:
goaccess /var/log/apache2/public_access.log -o /var/www/goa/index.html --real-time-html --ssl-cert=/etc/letsencrypt/live/mydomain.com/cert.pem --ssl-key=/etc/letsencrypt/live/mydomain.com/privkey.pem --ws-url=wss://your_server_host:7890

Do I understand correctly that every client that views Goaccess page from myserver.com needs to be able to access myserver.com:7890 also, so besides 443 I have to open port 7890 for everyone (who needs to access Goaccess page) in my firewall?  Ie client opens browser to myserver.com:443/goa and that page tries to actually connect to myserver.com:7890 to pull live data? Isn't that insecure to have 7890 open for the world or make iptables rules for everyone who needs to view Goaccess page?

It is correct that every client that wants to see your goaccess report needs to establish a connection to the WebSocket server running on myserver.com through whatever port you choose to use (defaults to 7890). So yes, you need to set a rule in your firewall (iptables) to open that port.
The HTML document (report) is served using your webserver through port 443, but the WebSocket Secure connection (wss) will be served on port 7890.
I believe it's possible to do the TLS layer through a reverse proxy to circumvent goaccess wss connection, haven't tried this myself though.

Were you able to run the report over https & wss?

I'm trying to run G on another server now and 'tail -f' over ssh on the server I want to monitor (ssh<EMAIL_ADDRESS>'cat /var/log/apache2/public_access.log' | goaccess -a -). Is that possible?

Certainly doable, preferably you are using your ssh keys to access the remote server. e.g.,
ssh -t user@host 'tail -f /var/log/apache2/access.log' | goaccess --log-format=VCOMBINED

Closing this. Feel free to comment or reopen it if needed.

Not sure if it's working or not. I ssh to my server and run: nohup sh -c "ssh -t<EMAIL_ADDRESS>tail -F /var/log/apache2/public_access.log | goaccess" & (I use -t -t since sometimes nohup.out complains about not allocating pseudo-terminal; -F since I have logrotate on that other server) but it doesn't look like goaccess would stay active. When I kill the process and re-run goaccess the homepage gets sometimes (often I kill the old ssh-tail-goaccess process, start a new one and nothing appears - no data and status is "UNDEFINED — UNDEFINED") refreshed  with new data but after that no new data seems to appear. What I might be doing wrong?

I wouldn't recommend running goaccess on your local machine if you plan to keep it in the background i.e., &, you are better off mounting the logs on your local machine using something like sshfs and then parsing it with goaccess or even better having a centralize log server, e.g., rsyslog.
It sounds like the issue you are having is keeping the connection opened or even establishing one to the remote server. GoAccess simply reads whatever is in the pipe. I'd try checking if you are actually getting data by removing the pipe and goaccess from  the command line and keeping only tail.

Just running the ssh and tailing works. But piping it to goaccess doesn't seem to work, netcating to server 7890 connects (gives just black). Can't use sshfs because I can't restart server at the moment (after installing sshfs+fuse). That remote server is already forwarding rsyslog to this server, including apache log, but goaccess can't parse the log file (token doesn't match...) since it's not pure apache log but a mixed log (all that goes to syslog on that remote server). Don't know how I can parse out the apache log entries from the composite log and write it to a separate file for goaccess to use.

I'd start with the basics of running goaccess against a sample log in your local machine and make sure you can access from the outside world with live stats. If that works and if you still want to run it on a different machine then you should be able to tail the log and pipe the output to goaccess.  You can try using a single dash to let goaccess know it should read from the pipe.
As I said before, if tail is constantly streaming data, then goaccess should just take that data and process it. I'm running a few instances where data is being piped for months and haven't had any bumps. Check if data is not being buffered from the remote server.
You can certainly try parsing the syslog with goaccess, but it's likely you will get a bunch of invalid requests (not related to apache). e.g.,
Apr 25 19:00:29 servername apache: test.domain.com:80 <IP_ADDRESS> - - [25/Apr/2017:19:00:29 +0500] "GET /file.xz HTTP/1.1" 200 406 "-" "Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Firefox/52.0" 400

and run it as
goaccess syslog --log-format='%^:%^:%^: %v:%^ %h %^[%d:%t %^] "%r" %s %b "%R" "%u" %D' --date-format=%d/%b/%Y --time-format=%T --num-tests=0

Thanks for all your help. For some reason I can't get it to work.  It might have something to do with the servers I'm working with. As I've run out of time currently I'll leave it at that. But as soon I have time I'll try again and might start asking silly questions again here... :P

No worries. Feel free to reopen it anytime.


Fixed possible invalid values for height, weight and age.

Removed unnecessary useEffect hooks and directly dispatched actions within the onChange handlers of input fields.

Fixes issues #2 , #3 , #4


Tests automation question

Hi, love this project. I am developping a Play 2.3.7 Application and I am having some trouble automating tests.
I want to test some operations to the DB (insert,selectbyId,selectAll...etc) and if possible in a way that works with Travis.
My problem is that i receive this error:
ERROR com.websudos.phantom - unconfigured column family devices
I ve checked it on localhost, and i see that everytime an instert or query is executed on the test.  The thing is when i execute the test, it creates the keyspace "phantom" but it doesnt create the table "devices", so if i dont have it created by default ,it will throw an exception an show that message
On your tests i ve seen a method called insertSchema() that is executed before every test, but i am neither able to find its implementation in your examples nor able to import it from the sourcecode.
override def beforeAll(){
    super.beforeAll()
    Devices.insertSchema()
  }

The thing is i dont either know how your embedded Cassandra DB works, because after all those tests end, neither the keyspace nor the table (in this case i have created the table myself on the CQL Shell before excuting them) are being dropped, so if for example i execute a getEntireTable, i will receive a different number of items everytime, because all those rows are not being deleted by default.
I say this because i was under the impression that  on each execution of the TestSuite, the keyspce, tables, rows...etc would be created and after finishing...removed
In case you are wondering it, this is my class header code, the rest are just querys on scalaTest:
class DevicesSpec  extends PhantomCassandraTestSuite{

  //No need to specify the keyspace, its "phantom" by default
  implicit val s: PatienceConfiguration.Timeout = timeout(10 seconds)
  implicit val executor = scala.concurrent.ExecutionContext.Implicits.global

  override def beforeAll(){
    super.beforeAll()
    //Devices.create.future()
   //insertSchema()?
  }

Thank you for your time, and i hope you can help me with this
Fernando

Hi @fernandoj92,
The insert schema method does a very simple thing:
Await.ready(Table.create.future(), 3.seconds).
You generally need 2 sets of methods:

object DatabaseService {
  def init(): Future[List[ResultSet]] = {
    val create = Future.sequence(List(
      Table1.create.future(),
      Table2.create.future()
    ))

    Await.ready(create, 5.seconds)
  }

   def cleanup(): Future[List[ResultSet]] = {
    val truncate = Future.sequence(List(
      Table1.truncate.future(),
      Table2.truncate.future()
    ))
    Await.ready(truncate, 5.seconds)
  }
}

Then you define your own specification, you generally don't use the default one directly.

trait CustomSpec extends CassandraFlatSpec {

   override def beforeAll(): Unit = {
     super.beforeAll()
     DatabaseService.init()
   }

   override def afterAll(): Unit = {
     super.afterAll()
     DatabaseService.cleanup()
   }
}

And then you use this global spec to define the rest of your tests:

class MySpec extends CustomSpec {

  "The db service" should "insert a user into the db" in {
    ...
   }

}

Hope this helps.

Thank you very much for your consideration. This helped me a lot :)


Fix custom_user

I have :
fixed the migration files
fixed the order of the migration files
fixed the customuser
created the currect way of using the User from django
removed few functions that is not needed
removed few tests that is not needed because django User have created a tests for them already
changed few tests
fixed the migration tests
wrote a better way of testing and the order of saving that happend because of they change of the customuser
and few more.

@thetaxas2468 you are mentioning here too many things for just 1 issue.
Some of the descriptions are not clear. For example, "fixed the migration files" - what are we fixing here?
Please divide your work in a way that makes it easy for us to review and test it.
Also, that way if you need to revert some of your changes, it won't affect everything else you've worked on.

i couldnt because all of the things that changed depend one on another


Elixir implementation of encoder

Github repo: https://github.com/perzanko/blurhash-elixir
Documentation on hexdocs: https://hexdocs.pm/blurhash
Ref: https://github.com/woltapp/blurhash/issues/44

cc: @DagAgren

@DagAgren
I would also love to see this merged. :)

Thanks for the contribution! 🍬


discord-user-bots does not support embeds

I tried to use both Discord.MessageEmbed and Discord.RichEmbed, but I cant get it to work. are embeds supported?
Heres my code:
if (message.content = "help") {
    const embed = new Discord.MessageEmbed;
    embed.setTitle('HelperBot - Help')
    embed.setDescription('This bot is a discord bot that is in a user account. Try me out!')
    message.channel.send(embed)
  }

I'm honestly not sure why you would want to use a Discord embed in a user bot, but no embeds are not supported. However the code shown above does seem like Discord.js code, and not code from this library. As discord-user-bots does not send messages using a message.channel.send() function.

I'm honestly not sure why you would want to use a Discord embed in a user bot, but no embeds are not supported.
Well it worked for me though...


Improve boss battle recommendations

Move logic onto server
Implement coverage and type recommendations
Change icon to info icon
Improve copy for stat recommendations

Potential for personalised team recommendations?

I think the compare feature is enough for this


Fix cert rewrite on VM reboot

This change fixes the issue descibed in:
Docker certificate will be overwritten after rebooting #4
install.sh now creates certificates instead of enable.sh.  This change
also removes the install_only option which doesn't appear to have been
used by anything.
Because docker is now started by default on install with the official
Docker script, docker is now restarted at the end of installation to
pick up all configuration changes which occur after the Docker install
script is run.
Since restarting of docker occurs in both install.sh and enable.sh it
has been factored out into the shared library.

Obsolete after rewrite.


Ensure 'mch-imageRepository' is added when defined

Signed-off-by: Zachary Kayyali<EMAIL_ADDRESS>
Description of the change: Ensures Annotation override is defined in MCH spec during downstream installations.
Motivation for the change:

/hold

/unhold


[SPARK-32920][CORE][SHUFFLE][FOLLOW-UP] Fix to run push-based shuffle tests in DAGSchedulerSuite in ad-hoc manner

What changes were proposed in this pull request?
Currently when the push-based shuffle tests are run in an ad-hoc manner through IDE, spark.testing is not set to true therefore Utils#isPushBasedShuffleEnabled returns false disabling push-based shuffle eventually causing the tests to fail. This doesn't happen when it is run on command line using maven as spark.testing is set to true.
Changes made - set spark.testing to true in initPushBasedShuffleConfs

Why are the changes needed?
Fix to run DAGSchedulerSuite tests in ad-hoc manner

Does this PR introduce any user-facing change?
No

How was this patch tested?
In my local IDE

cc @otterc @mridulm

Can one of the admins verify this patch?

Thanks for the fix @venkata91. I tested the change as well and it works. Looks good to me.

cc @Ngone51 too

+CC @gengliangwang, merged to branch-3.2 as well.

Merged to master and branch-3.2
Thanks for fixing this @venkata91 !


Debugger is not working

Getting error when running app in debug mode.
When hitting play on debugger, debugger options appear for split second and exception occurs.
error while processing request '{_request}' (exception: {_exception})

OS: Mac

This issue was moved to Microsoft/vscode-mono-debug#1


try fix CI builds

updated Changelog.md with missing PRs.
Adding sphinx-issues-4.1.0 to the environment.yaml


os_stub/openssllib: Support more architectures

I have dropped the arc and arm. I suspect they would work, but I can't test it

For better or worse libspdm uses the UEFI profile of OpenSSL, which helps it fit into more limited systems.


Is total_step fixed?

Hi,
Sorry again but could I double check on the setting of total_step? I saw it is hard-coded in the example script but I believe this number should be the same as the total number of entries in the train_sample_weight.json  if batch_size is set to 1 right? I've changed it accordingly in my own case. I guess the user is also expected to change total_step case by case right ?
Thanks in advance.

No. The dataset is randomly sampled instead of shuffled, so the total step is independent with dataset size.

I see. Thanks for your explanation.