Can't pickle Transaction objects

  File "train.py", line 132, in main
    train_dataset = chainermn.scatter_dataset(train_dataset, comm)
  File "/home/aixile/anaconda3/lib/python3.6/site-packages/chainermn/datasets/scatter_dataset.py", line 91, in scatter_dataset
    comm.send(subds, dest=i)
  File "MPI/Comm.pyx", line 1175, in mpi4py.MPI.Comm.send (src/mpi4py.MPI.c:106424)
  File "MPI/msgpickle.pxi", line 210, in mpi4py.MPI.PyMPI_send (src/mpi4py.MPI.c:42085)
  File "MPI/msgpickle.pxi", line 112, in mpi4py.MPI.Pickle.dump (src/mpi4py.MPI.c:40704)
TypeError: can't pickle Transaction objects
^C^Z[warn] Epoll ADD(4) on fd 28 failed.  Old events were 0; read change was 0 (none); write change was 1 (add): Bad file descriptor

This happens when my dataset loader tries to load images from a lmdb file.
class lsun_bedroom_train(datasets_base):
    def __init__(self, path, img_size=256):
        self.all_keys = self.read_image_key_file_json(path + '/key_bedroom.json')
        self.db = lmdb.open(path+"/bedroom_train_lmdb", readonly=True).begin(write=False)
        super(lsun_bedroom_train, self).__init__(flip=1, resize_to=img_size, crop_to=0)

    def __len__(self):
        return len(self.all_keys)

    def get_example(self, i):
        id = self.all_keys[i]
        img = None
        val = self.db.get(id.encode())
        img = cv2.imdecode(np.fromstring(val, dtype=np.uint8), 1)
        img = self.do_augmentation(img)
        img = self.preprocess_image(img)
        return img

hi @Aixile ,
Yes, as you pointed out by yourself, the error happens because self.db is not picklable.
Since ChainerMN needs to send the dataset over a network, the data must be serializable.
Although I'm not familiar with lmdb, I guess one way to avoid this problem is to delay the initialization of lmdb objet, which is now done in __init__.
class lsun_bedroom_train(datasets_base):
    def _init_db(self):
        self.db = lmdb.open(path+"/bedroom_train_lmdb", readonly=True).begin(write=False)

    def __init__(self, path, img_size=256):
        self.all_keys = self.read_image_key_file_json(path + '/key_bedroom.json')
        self.db = None
        super(lsun_bedroom_train, self).__init__(flip=1, resize_to=img_size, crop_to=0)

    def __len__(self):
        return len(self.all_keys)

    def get_example(self, i):
        if self.db is None:
            self._init_db()
        id = self.all_keys[i]
        img = None
        val = self.db.get(id.encode())
        img = cv2.imdecode(np.fromstring(val, dtype=np.uint8), 1)
        img = self.do_augmentation(img)
        img = self.preprocess_image(img)
        return img

I didn't test it but hope it helps :)

This strategy solves my problem. Thanks!


Apply PEP8 suggestions via autopep8

@mk-fg -- I was designing a config system and came up with a design identical to yours. Found this repo when I was searching for AttrDict implementations for YAML.
If you don't mind, I'd like to help with the maintenance of this repository -- documentation, test cases, PEP8 fixes, etc to begin with. I'd rather work with your code than maintain a separate fork.
This is a pull request to make the code mostly PEP8 compliant (via autopep8 and a few manual edits.) Will send some test cases and doc updates over the next few days.

Sorry, but I don't like and don't want to follow PEP8.
As should be obvious from the code here, I kinda have my own weird and crappy style, and I've tried adopting PEP8 in the past, but all it led to is me abandoning the codebase, as it's too hard and inconvenient to work with (e.g. pulseaudio-mixer-cli projects, and some others) or refactoring back to my style (e.g. python-onedrive).
I guess many people might be fine with it though, likely the majority, so I think refactoring you did and stuff such as tests that you're planning to do is awesome and The Right Thing for a module useful for everybody, it's just that I'd rather maintain my own fork - way easier for me that way.
Furthermore, people asked for things like Python 2.6 and 3.x here a lot (iirc, check closed issues), which I'm also just "meh" about, and if you'll also be willing to implement these, I think it'll be fantastic.

So going forward, I think maintaining a separate pep8 and "best practices" fork is still the best option.
As I can't vouch for any fork (no offense), I'd rather not transfer PyPI project to fork that I don't know much about, as that can be unfair to any (probably super-rare) users of the project, especially if there are any significant changes planned there.
But given that the name of this project is kinda terrible anyway (as with most of my projects, blame lack of imagination), I think you can just come up with the better one and register that on PyPI instead, and I propose to link it at the top of the README with "FOR NEW PROJECTS USE THAT ONE INSTEAD" kind of message.
You can also send message to github support and they'll make your fork not to be considered such (i.e. no "forked from ..." at the top), which I think might be a good idea with a separate pypi project - to avoid confusion for new users as to which "fork" to pick, and some other upsides github-ui-wise.
Does that make any sense?

That's fine @mk-fg. In that case, I'll just create a new repo derived from this, credit it, and maintain it independently.
Thanks for building this in the first place!

Thanks!
Let me know if there's something I can do to help there.
I've added a todo for adding links to the readme here, should find and link all similar modules (iirc there was at least one from beets author) when I'll get to it, including proper version of this one.

Added the Links section now (including sanand0/orderedattrdict), wonder if maybe you might find something more suitable for your use-case there as well - plenty of yaml-reading attr-access layered whatever-updating modules around, generally way better-maintained than this one ;)

Oh, right, forgot the link: https://github.com/mk-fg/layered-yaml-attrdict-config#links

Thanks @mk-fg -- that list definitely helps.


Waypoint: Make Object Properties Private - Instruction Clarity

I have addressed a number of questions regarding this Waypoint over that past week. While I don't believe the wording of the instructions is to blame for all the confusion, perhaps some clarity could be added at the end to help users understand what needs to be done while also reinforcing the terminology.  Additions in bold, deleted text struck through.

Properties Private
Objects have their own attributes, called properties, and their own functions, called methods.
In the previous challenge, we used the this keyword to reference public properties and public methods of the current object.
We can also create private properties and private methods, which aren't accessible from outside the object.
To do this, just declare properties or functions within the constructor without the this keyword.
Let's create an object with two functions. One attached as a property and one not.
See if you can keep myBike.speed and myBike.addUnit private, while making myBike.getSpeed publicly accessible.
See if you can modify the Bike constructor so that both the speed property and the addUnit method are private, while also making the getSpeed method publicly accessible for all objects created from the Bike constructor.  We'll check your work by testing the myBike object we've created from the Bike constructor at the bottom of the code.

Hi @MattYamamoto, we already have an issue for this at https://github.com/FreeCodeCamp/FreeCodeCamp/issues/4177.
Can you please post your suggestions on the other issue? This will ensure that they will get consideration when someone is working on fixing the issue.
Thanks!

after countless attemps i got this to pass:
 var gear = 0;

  this.setGear = function() {
    gear += 4;
  };

  this.getGear = function() {
    return gear;
  };

can someone please explain why / what happened??

hmmmm... yeah I don't think I would be able to come up with that... at least now with the "+= 4;" sigh

The isntructions are a bit vague. Here is my solution, knock yourself out :)
`var Car = function() {
// this is a private variable
var speed = 10;
// these are public methods
this.accelerate = function(change) {
speed += change;
};
this.decelerate = function() {
speed -= 5;
};
this.getSpeed = function() {
return speed;
};
};
var Bike = function() {
// Private var
var gear;
// accessible from outside
this.getGear = function(){
return gear;
};
this.setGear = function(set){
gear = set;
};
};
var myCar = new Car();
var myBike = new Bike();`

The instructions for this exercise were very confusing. I got everything that you got, @saifalizafar except for the gear = set. I was trying to do something similar to get getGear to be equal to setGear, but no go. Will try this now.

I come from a language where if you are initializing a variable it has to be to something, the entire notion of being able to accomplish "var gear;" and it automatically be set to undefined was foreign to me. Initially I did:
`var Bike = function() {
// Only change code below this line.
var gear = undefined;
this.getGear = function() {
return gear;
};
this.setGear = function(newGear) {
gear = newGear;
};
};`
Despite the FCC editor alerting me to the fact that I didnt have to set gear to undefined.
I later refactored my code to get "var gear" to clear the alert raised by the editor. Again, to me it hasnt really been mentioned that you can successfully initialize a var without setting to anything....coming from Ruby such a concept doesnt even exist I dont think. This is what lead to my confusions at least.

Anyone who has ever ridden a bike knows that you don't "set" a gear; you can only change gears relative to the gear that you're in. The below isn't accepted by FCC as a "correct" answer, but it makes more sense in the context of shifting gears on a bike.
`var Bike = function(gearInitial) {
var gear = gearInitial;
this.setGear = function(shiftGear) {
	gear += shiftGear;
};

this.getGear = function() {
	return gear;
};

};`
So let's say I start in 3rd gear, shift up one gear, then shift down two gears. I'd then be in 2nd gear...
`var myBike = new Bike(3);
myBike.setGear(1);
myBike.setGear(-2);`

Thanks @friendofdog for the clarification. I will revisit.

Hi...this is my solution...
var Bike = function() {
// Only change code below this line.
var gear;
this.setGear = function(y) {
gear = y;
};
this.getGear = function() {
return gear;
};
};

@Galiante Please don't post solutions in here!

Sorry @theflametrooper , I'll delete my post :smile:

Hi friends,
I stumbled upon some videos that helped me tremendously when I was stuck on this challenge. He breaks down the concepts revolving around this exercise: Constructor functions, closures, getters, setters, etc. Have fun!  and....
Keep on hacking!
Javascript Closures Part 1
Javascript Closures Part 2

@jrogodel Feel free to post these videos on our Subreddit!

@jrogodel ... thanks for the links, but they are the SAME... here are the correct URLs:
Video 1 =  https://www.youtube.com/watch?v=DZEblYanz3c
Video 2 = https://www.youtube.com/watch?v=6ltWzDKweUQ

setGear() is just supposed to set the gear. You don't need to add new gear to the new values from set gear. all you need is x = y and not x+=y.

The code given above the challenge is rather confusing. I've never ridden a bike but I thought its just like (setting gear += set), as friendofdog mentioned. and if you var gear = 0 and then setGear(4) it will return four. "I made it! What the heck..."

Finally :)
var Bike = function() {
// Only change code below this line.
var gear;
this.setGear = function(change) {
gear = change;
};
this.getGear = function() {
return gear;
};
};

Hey.
Maybe this can clarify (I found this ultra confusing at first).
The hint is in the test credentials:
myBike.getGear() should return 3 after calling myBike.setGear(3)

So you create your object:

var Bike = function() {
};

add your private variable:
var Bike = function() {
var gear;
};

Now you need a function that will get the number passed to it from myBike.setGear(3)

var Bike = function() {
var gear;
this.setGear= function(passedVar){
gear = passedVar;
};
};

Finally you need to return the current gear (which is our private variable)

var Bike = function() {
var gear;
this.setGear= function(passedVar){
gear = passedVar;
};
this.getGear= function(){
return gear;
};
};

i did this and it works
var gear = 0;
this.setGear = function(shift) {
gear = shift;
};
this.getGear = function() {
return gear;
};
};

// --- Spoiler --- //
::Solution ahead::
var Bike = function() {
var gear = 0;
this.setGear = function(change) {
gear = change;
};
this.getGear = function() {
return gear;
};
};
So basically, setGear needs to set the value of the gear which is PRIVATE.
Hence we use setGear to set the value and getGear to simply return gear.

@x19kutz
Please do not post your solution on here. You could help people at FreeCodeCamp Chat Room or Forum. GitHub Issues are for reporting bugs on the website only.
Happy Coding!

@texas2010 Thank you for the update, wasn't aware of it! That was my first comment.

@x19kutz, no problem.  all good.

Thank you @jrogodel those videos did help

I just finished this. Here is what i got. I hope it helps.
var Bike = function() {
// Only change code below this line.
var gear = 0;
this.setGear = function(i) {
gear = i;
};
this.getGear = function () {
return gear;
};
};
Whatever we put inside the parameters of setGear() becomes the value of gear, which getGear returns and holds that value as well.

@Taylorbostick32  Please Don't post solution Here !


Can't find dependency although existing in yaml-file.

On Ubuntu 16.04 I tried to install yapf via rosdep but rosdep can't find the package although it exists in python.yaml (line 5754). Although it works if I change the order of the yaml files in /etc/ros/rosdep/sources.list.d/20-default.list.
Please note that yapf also exits in base.yaml, but not for Ubuntu Xenial. I guess the search-algorithm for the package stops too early.

The rules are explicitly evaluated in order and go based on the first match to allow custom overrides of the values on system administrators or users.
It looks like #22073 was added without consolidating with #15567
These should be consolidated to leverage the pip values for older platforms and binary packages where available. @tylernewnoise Could you open a PR to deduplicate the entries? I'd recommend explicitly listing the older platforms with pip entries, and anywhere they're availabe from binary packages with the wildcard notation to allow the rule to match expected future distributions including the binary packages again.

Hi and a happy new year.
Thx for pointing it out - I'll make the PR asap.


[cppcms] build failure

Host Environment

OS: linux/debian x64
Compiler: gcc 8.3

To Reproduce
Steps to reproduce the behavior:
`root@unique-gig-2:/home/vcpkg-2020.01# vcpkg install cppcms
-bash: vcpkg: command not found
root@unique-gig-2:/home/vcpkg-2020.01# ./vcpkg install cppcms
The following packages will be built and installed:
cppcms[core]:x64-linux
Starting package 1/1: cppcms:x64-linux
Building package cppcms[core]:x64-linux...
-- Note: cppcms only supports dynamic library linkage. Building dynamic library.
-- Using cached /home/vcpkg-2020.01/downloads/artyom-beilis-cppcms-b72b19915794d1af63c9a9e9bea58e20a4ad93d4.tar.gz
-- Extracting source /home/vcpkg-2020.01/downloads/artyom-beilis-cppcms-b72b19915794d1af63c9a9e9bea58e20a4ad93d4.tar.gz
-- Using source at /home/vcpkg-2020.01/buildtrees/cppcms/src/20a4ad93d4-26c9d29282
-- Configuring x64-linux-dbg
-- Configuring x64-linux-rel
-- Building x64-linux-dbg
-- Building x64-linux-rel
CMake Error at ports/cppcms/portfile.cmake:25 (file):
file must be called with at least two arguments.
Call Stack (most recent call first):
scripts/ports.cmake:94 (include)
Error: Building package cppcms:x64-linux failed with: BUILD_FAILED
Please ensure you're using the latest portfiles with .\vcpkg update, then
submit an issue at https://github.com/Microsoft/vcpkg/issues including:
Package: cppcms:x64-linux
Vcpkg version: 2020.01.17-unknownhash
`
Failure logs
-Cut and past the appropriate build messages from the console output.
-Please attach any additional failure logs mentioned in the console output.
Additional context
Add any other context about the problem here, such as what you have already tried to resolve the issue.

@how0723, thanks for reporting this issue.
It seems that cppcms doesn't support on linux in vcpkg, It looks it's a source issue in upstream.
I will add a failure message to cppcms in vcpkg.


[Do-not-merge] Upgrade to Cosmos-SDK v0.50.

🚧 WIP - early version
See #1438
⚠ All broken currently ! 🤯
Failing tests are deactivated. Go mod is setup my local workspace.
I am waiting for a soution in ibc-go that fixes the: failed consensus state verification for client (07-tendermint-0): chained membership proof failed to verify membership of value:
See upgrade doc in the SDK
I have started with just the go.mod dependencies and some related changes to imports.
This blocked now on the ibc-go release that includes the capability module and fixed imports for sdk v0.50.

Notional is helping the team with a PR but still core integration of the testing framework does not work for me.
Either there are some issues with CometBFT or the way how I would use it for the extended ibc-go testing framework. See my issue

This is also blocked on on some modules in the SDK that are not released. See go.mod replacement statements for details
Some notes on the work
New modules

circuit

Moved to cosmossdk.io path

store
x/nft
x/evidence
x/feegrant
x/upgrade

Others
"github.com/cosmos/cosmos-sdk/snapshots -> "cosmossdk.io/store/snapshots
"github.com/cosmos/cosmos-sdk/client/grpc/tmservice -> "github.com/cosmos/cosmos-sdk/client/grpc/cmtservice
"github.com/cosmos/cosmos-sdk/x/capability -> "github.com/cosmos/ibc-go/v7/modules/capability
Removed: legacy proposals for x/upgrade

[x] deprecate MakeEncodingConfig
[x] wasm keeper: accept runtime.NewKVStoreService for keys[wasm.StoreKey],
[x] handle storeservice.Get/Set errors
[ ] remove non requires sdk modules from begin/ endblocker
[ ] replace sdk.Context with stdlib context in keeper
[x] use [(cosmos_proto.scalar) = "cosmos.AddressString"] for addresses in proto
[x] set cosmos.msg.v1.service proto annotation
[x] upgrade ante-handler
[x] use new collections framework for params

@alpe might be able to make a pr to fix now.

@alpe sounds good to me.
FYI:

I am not sure if rebase is best, typically I fail with that.

If you are sure that it is best, would you mind showing me how you do it, when you do it?  Because if it is best, I'm knowledge deficient there.

Closing this in favour of https://github.com/CosmWasm/wasmd/pull/1528


[Security] Allocation of Resources Without Limits or Throttling

⚠ Security Report
Description

Introduced through the Maven dependency in pom.xml file:
<EMAIL_ADDRESS>› org.json:json@20230618
Description
Affected versions of this package are vulnerable to Allocation of Resources Without Limits or Throttling. An attacker can cause indefinite amounts of memory to be used by inputting a string of modest size. This can lead to a Denial of Service.
Additional context

More information on the Snyk Report
Version 20231013 isn't vulnerable

fixed in #70


add Ghost chart

Ghost needs to know the external host of the application at deploy-time so it can configure the application URLs correctly. I've been battling with different ways to solve this issue, and I've opted for a similar approach to @gtaylor's approach to requiring EULA in Minecraft. Essentially, if you don't provide the release with an external host, it will skip the deployment and tell you how to obtain the external IP from the service created and upgrade the deployment.
I feel this is a good approach because it makes it clear that the deployment is incomplete, and forces users to configure the correct host before using the application in a broken state.
That said, I'm open to hearing other ideas on solving this problem. One other idea I had, and implemented in a separate workspace, was to use a post-install hook to launch a pod that uses the Kubernetes API to automatically configure the correct host. The issue with this is that it relies on automatic load balancer provisioning, is not obvious to the user, and is difficult to maintain.
cc @viglesiasce @migmartri @sameersbn @michelleN @lachie83

Thanks for the contribution @prydonius Will review!


cleanup(test): remove python regression tests

What type of PR is this?
/kind cleanup
Any specific area of the project related to this PR?
/area tests
/area CI
What this PR does / why we need it:
Following up the contribution of the testing repository (https://github.com/falcosecurity/evolution/issues/246), this PR deprecates and removes the python-based regression testing suite, no more used. Now that they have no purpose anymore, the following have been removed:

CircleCI jobs
builder, tester, and local docker images files
Github Action workflow that used to bump the builder and tester images

Which issue(s) this PR fixes:
Special notes for your reviewer:
Does this PR introduce a user-facing change?:
NONE

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: jasondellaluce
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS [jasondellaluce]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

LGTM label has been added.  Git tree hash: d96072f43169861338757cf4829c14140235c6e2

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: FedeDP, jasondellaluce
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS [FedeDP,jasondellaluce]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: FedeDP, incertum, jasondellaluce
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS [FedeDP,incertum,jasondellaluce]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

/close

@jasondellaluce: Closed this PR.

In response to this:

/close

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

/reopen

@jasondellaluce: Reopened this PR.

In response to this:

/reopen

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: FedeDP, incertum, jasondellaluce, LucaGuerra
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS [FedeDP,LucaGuerra,incertum,jasondellaluce]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

/close

@jasondellaluce: Closed this PR.

In response to this:

/close

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

/reopen

@jasondellaluce: Reopened this PR.

In response to this:

/reopen

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.


Receiving error when trying to choose Action

I receive an error message (attached) when on "Choose Action" in creating a new Mass Action record , I also do not show any available processes in the "Action" drop down menu.

I do have invocable processes setup and active for the object I'm attempting to create a Mass Action for.
The named credential has not changed for our org. I am the user reperesented by the named credential and I do have access to the list view I'm trying to schedule a mass action for.
I have not had any issues like this over the past 4 months I've been using this app. I'm not really sure where to start troubleshooting, could I get some help please?

Here's the excerpt from the error message in the picture above:

[Cannot read property 'length' of null]
highlightOptionWithText()@https://primerosystems.lightning.force.com/components/lightning/combobox.js:2:12206
Object.a.runActionOnBufferedTypedCharacters()@https://primerosystems.lightning.force.com/components/lightning-utils.js:2:1181
i()@https://primerosystems.lightning.force.com/components/lightning/combobox.js:2:2963
requestAnimationFrame()@https://primerosystems.lightning.force.com/components/lightning/combobox.js:2:3916

On the chance I am able to choose an Action, when I proceed to "Field Mappings" I do not have the option to map:

@ksaner92 @jnauman Which version of the app do you all have installed in your orgs? The current version is 1.5 as of this writing. And you probably do want to update your Named Credential URLs to v42.0.
@ksaner92 so this was working fine for you for 4 months and then one day it stopped working? Any idea what changed in your org that might be related?
Things to double-check are that the Named Credential URL includes your My Domain as displayed when in Classic and not what you see in the address bar when in Lightning Experience.
For example, your Named Credential URL should be like https://primerosystems.my.salesforce.com/services/data/v42.0 with a scopes full and refresh_token and the Callout Option "Generate Authorization Header" checked.
If still get errors, although it's annoying to do, you may want to try re-creating your Connected App, Auth. Provider, and Named Credential from scratch.

Hi @DouglasCAyers I currently have version 1.5 of the Mass Action Scheduler app installed. I have tried updating my Named Credential URL to v42.0 however that did not change the inability to choose an Action.
And yes, this has been working for me with no hiccups up until 3/29. As annoying as it is when troubleshooting, nothing has changed with my setup or any related objects, list views, process builders.
I do have 2 Named Credentials setup, with the following URLs https://primerosystems.com.my.salesforce.com/services/data/v41.0 and
https://primerosystems.com.my.salesforce.com/services/data/v42.0
Neither are working. I have tried completely uninstalling the app, re-installing, and re-created the Connected App, Auth. Provider, and Named Credentials from scratch 3 times with no success.

I appreciate your help!

Hrmm, that is strange. By chance are you in a sandbox? If yes, then the Named Credential URL will need to be changed to fit the sandbox domain.

On Apr 9, 2018, at 7:56 AM, ksaner92<EMAIL_ADDRESS>wrote:
Hi @DouglasCAyers I currently have version 1.5 of the Mass Action Scheduler app installed. I have tried updating my Named Credential URL to v42.0 however that did not change the inability to choose an Action.
And yes, this has been working for me with no hiccups up until 3/29. As annoying as it is when troubleshooting, nothing has changed with my setup or any related objects, list views, process builders.
I do have 2 Named Credentials setup, with the following URLs https://primerosystems.com.my.salesforce.com/services/data/v41.0 and
https://primerosystems.com.my.salesforce.com/services/data/v42.0
Neither are working. I have tried completely uninstalling the app, re-installing, and re-created the Connected App, Auth. Provider, and Named Credentials from scratch 3 times with no success.
I appreciate your help!
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

@DouglasCAyers I thought it was pretty strange too :| This is in production. My mass actions in sandbox are still working totally fine.

@DouglasCAyers I went through and re-setup the named credential and everything seems to be working great now! Thanks!

Good to hear @jnauman

I'm running into this exact same problem. I am in a sandbox and have made a named credentials with my sandboxes' domain as url. Is there a known cause and/or solution to this problem?
When I visit the url .my.salesforce.com/services/data/v42.0 I get
<Errors> <Error> <errorCode>INVALID_SESSION_ID</errorCode> <message>Session expired or invalid</message> </Error> </Errors>
Is this related?

Hi @jvlaar, you won't be able to go to the URL in your browser address bar because the REST API requires an Authorization header with your oauth access token in it. If you are able to create the Named Credential record successfully and get the Authenticated Status field to say Authenticated as<EMAIL_ADDRESS>and the Named Credential URL is for the same domain as the org you're on, then the only thing I can think of is to make sure the oauth scopes are correct. You need at least refresh_token scope, and if you're having issues, probably want to also have full scope selected too.
Please share screen shots of your Connected App, Auth. Provider, and Named Credential if you don't mind.
Thanks

@ksaner92 @jvlaar Do your Connected App and Named Credential both specify the exact same scopes of full and refresh_token? Make sure both match exactly and see if that has a difference.

Another thing to consider per related issue #7 is check if your production orgs are using Two-Factor Authentication or require High Assurance Session. If yes, then you might try to setup your Named Credential to use an integration user that does not require that.
According to another user:

We also experienced this issue in our Production environment, while the same setup worked fine in our Sandbox. The difference for us was our System Administrator Profile in Production had Session Security Level set to High Assurance and only our corporate Single Sign-On or Two-Factor Authentication were considered High Assurance sessions. The issue was resolved by changing our Named Credentials settings to using a Profile that did not require High Assurance sessions.

I am also unable to select a Process at the Choose Action step - I just recreated my Connected App, Auth Provider and Named Credential this morning, and I do have a couple of active invocable processes on the object I'm targeting, but no options appear in the picklist. I'm on version 1.5 of the app, am authenticating with a Sys Admin user, and we don't have 2FA enabled. I'm in a sandbox, and I've verified that the Named Credential URL is using the sandbox domain. I'm not sure what else to check in terms of troubleshooting. Any guidance would be appreciated! Thanks!

FYI, for the next version of the app I have a new setup page that will automatically create and configure the Connected App, Auth. Provider, and Named Credential for you. I hope this eliminates most of the confusion and trouble with getting Mass Action Scheduler setup for folks.
At the moment, some unrelated apex test classes are failing which prevent me from creating the next package version. I'm waiting on this known issue to be fixed. It's currently in progress of being rolled out. Once NA59 gets fixed then I should be able to proceed with providing the next package version.

Here's a video sneak peek of the new auth page. For now, need to download it as .mp4, but I'll post it to YouTube for easier viewing once I release the next version of the app.

Salesforce is playing a bit of whack-a-mole. The known issue got resolved which fixed my first problem, but in doing so a new problem got introduced and so other previously passing tests are now failing. I'm still working with Salesforce Support on getting all issues fixed so I push out new package updates. Thanks for your patience.


Error creating new Container App

Repro Steps

Right clicked on my new CA env I just created and selected 'Create Container App...'
Name - 'first-app'
Cont Reg - ACR - 'mikemortACR'
Repository - 'orderproc'
Tag = '3.0'
HTTP endpoint - 'Enable'
Traffic - 'External'
Port - '80'

Received the following error...
Error: The following field(s) are either invalid or missing. Invalid value: "orderproc-3.0": Invalid Name: Per RFC 1123 name must consist of lower case alphanumeric characters or '-', and must start and end with an alphanumeric character (e.g. 'my-name',  or '123-abc', regex used for validation is 'a-z0-9?'): template.containers.
I tried a few other attempts, the pattern I see is it fails if the tag I select is something like 3.0 or 2.2. If I select a tag without a period in it, it works.

Likely because the . creates an invalid hostname.
Also need to verify other name requirements. For instance, there's a limit of 2–20 characters enforced in VS Code but longer names are allowed.


Unable to install it

/ct import SkyblockAuctionFlipper
After run this command it say
Unable to import module SkyblockAutionFlipper
maybe because there is no available "requestV2" package

Go to the chattriggers website and install requestV2, you may need to install settingsmanager and PromiseV2 as well.


feat(dropdown): add boundary config option

Adds a new config option to specify the Popper.js preventOverflow.boundariesElement, which will allow a non navbar dropdown to "overflow" its scrollParent (when the dropdown is inside an element with style overflow: scroll, or similar), without the need to re-parent (#24257) the .dropdown-menu (maintaining document tab order).
It also, when boundary is not 'scrollParent', adds position: static; to the .dropdown (parent), which allows the actual overflow "escape" to happen.
The boundary config option accepts either a string ('scrollParent', 'viewport' or 'window'), or a reference to an HTMLElement. The default value is 'scrollParent' (the Popper.js default value). A reference to an HTMLElement can only be passed via JavaScript options and not via the data API data-boundary="..".
Using position: static only (as suggested by @FezVrasta https://github.com/twbs/bootstrap/issues/24251#issuecomment-341413786) doesn't always completely address the issue unless Popper's modifiers.preventOverflow.boundariesElement is set to something other than 'scrollParent' (specifically for taller dropdowns in short scroll containers)
Popovers and tooltips have a similar issue (when inside an element with overflow: scroll). for which I have created a separate PR #24979 (which doesn't need the position: static "fix")
/cc @Johann-S @patrickhlauke @FezVrasta
Edit: Link to demo codepen: https://codepen.io/tmorehouse/pen/GyKYZe?editors=1010
Fixes #24251

Before hte "fix":

With the fix and option boundary set to 'viewport:

This PR would negate the need for PR #24257 (re-parenting on dropdown open)

If class .dropdown always had position: static, then line 167 of this PR could be removed (https://github.com/twbs/bootstrap/pull/24976/files#diff-bfe9dc603f82b0c51ba7430c1fe4c558R167), although I am not sure if that would break anything else layout-wise.

Your code looks good to me :+1: but it's seems your fork is a bit outadated maybe can you add a rebase ? And maybe a Codepen where we can try your PR would be nice please

Shouldn't we have a test for this?

Yep a Unit test would be rad :+1:

I'll see if I can get a codepen set up for this.
For tests, not sure if will be easy to test this visually, but can definitely test to check for the .position-static class being applied when boundary is not 'scrollParent'

@Johann-S @XhmikosR here is a codepen which demonstrates the default behavior and how it works with the new option: https://codepen.io/tmorehouse/pen/GyKYZe?editors=1010

@XhmikosR I've added in a basic unit test for checking for the presence (and absence) of the position-static class, based on the boundary setting.

When I view your pen with 360px width device, I see the text is still being cut off, but I guess that is normal, right? Because in normal resolution I see the impact of your patch.

LGTM :+1:

@XhmikosR do you know if they are a way to clean his git history ? Because they are unrelated commits :thinking:

Just squash them together

Either you do it manually and push to his fork, or I think everything will be squashed into one commit when you hit squash and merge.

@Johann-S: so, LGTY?

Yep it looks good to me if squash fix everything but I'm not able to merge his PR :

You didn't try to squash the changes; you were trying to rebase hence the error.

But I wasn't able to change to squash :worried: anyway thank you :+1:

Squash is good with maple syrup, butter and pepper ;-)


sorbet rbi hidden-definitions doesn't read from rbi files

Input
In the rbi file, sorbet-rails defines a custom Elem property in "ActiveRecord::Base" like this:
# -- In sorbet-rails/rbi/activerecord.rbi --
class ActiveRecord::Base
  extend ActiveRecord::Querying::Typed
  extend T::Generic
  Elem = type_template(fixed: ActiveRecord::Base)
end

We set Elem to be fixed in every individual ActiveRecord::Base subclass
# -- In sorbet/rails-rbi/users_role.rbi --

class UsersRole < ApplicationRecord
  extend T::Sig
  extend T::Generic
  extend Site::ModelRelationShared
  extend Site::ClassMethods
  include Site::InstanceMethods
  Elem = type_template(fixed: UsersRole)
end

It works with srb tc. However, when someone wants to run srb rbi definitions. It would raise error like this
/tmp/d20190701-14198-dis6ws/reflection.rbi:1347596: Type `Elem` declared by parent `T.class_of(ApplicationRecord)` must be re-declared in `T.class_of(UsersRole)` https://srb.help/5014
     1347596 |class UsersRole < ApplicationRecord
                    ^^^^^^^^^
    /home/dev/sorbet-rails/rbi/activerecord.rbi:149: `Elem` declared in parent here
     149 |  Elem = type_template(fixed: ApplicationRecord)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

It somehow takes into account the rbi from the gem, but not the rbi from the generated model rbi.
Expected behavior
I think it should include information from both and not treat those as issues.

Relevant discussions:
https://sorbet-ruby.slack.com/archives/CJL5B3CEN/p1562023020092300
#1158

Looks like I might be able to remove the T::Generic from ActiveRecord::Base itself.

@manhhung741 I can't reproduce this in sorbet.run:
https://sorbet.run/#%23 typed%3A true

%23 -- In sorbet-rails%2Frbi%2Factiverecord.rbi --
class ActiveRecord%3A%3ABase
  extend T%3A%3AGeneric
  Elem %3D type_template(fixed%3A ActiveRecord%3A%3ABase)
end

%23 -- In sorbet%2Frails-rbi%2Fusers_role.rbi --

class UsersRole < ActiveRecord%3A%3ABase
  extend T%3A%3AGeneric
  Elem %3D type_template(fixed%3A UsersRole)
end
Is it possible for you to make a reproducer there? Or alternatively to make a zip file with the minimal files (Gemfile, RBI file, Ruby file) that I could reproduce it locally?

This breaks the subclass of ActiveRecord etc, because they need to override the definition of Elem. We do that by autogenerating the class with Elem defined. It works with srb tc but doesn't work with srb init or srb rbi hidden-definitions

I'll try to set up some tests in the sample apps we have in sorbet-rails and send to you later.

I have a repo for you
https://github.com/manhhung741/rails_app5_2
If you run srb tc, there is no problem. If you run srb rbi hidden-definitions, it will fail. In the log file you should see the errors I described.

There is also a problem with srb init doesn't work when sorbet-rails is included in the Gemfile.
I don't know if there is any work-around for that case.
People would either have to:

Only include sorbet-rails after they have run srb init
Or
Run sorbet-rails generation code before srb init

Going to close this in favor of Tapioca
https://sorbet.org/blog/2022/07/27/srb-tapioca


upgrade @prettier/plugin-ruby to 1.6.1

Summary
Upgrade @prettier/plugin-ruby to latest version 1.6.1. Current 0.8.0 is too old and not working properly.

Close stale pr.


how to airdrop before mint ?

Hi, i see a lot of people that sent nft airdrop to influencers before mint starting, also i see airdrops in contest.
So, how can i do this before the time set in the candy machine.
Regards

when u say redeploy, you say update_candy_machine ?


install pdm on windows 10

(Invoke-WebRequest -Uri https://raw.githubusercontent.com/pdm-project/pdm/main/install-pdm.py -UseBasicParsing).Content | python3 -

Installing PDM (2.4.9): Creating virtual environment
Actual environment location may have moved due to redirects, links or junctions.
  Requested location: "C:\Users\david\AppData\Roaming\pdm\venv\Scripts\python.exe"
  Actual location:    "C:\Users\david\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Roaming\pdm\venv\Scripts\python.exe"
Installing PDM (2.4.9): Installing PDM and dependencies
An error occurred when executing ['C:\\Users\\david\\AppData\\Roaming\\pdm\\venv\\Scripts\\python.exe', '-m', 'ensurepip']:
No pyvenv.cfg file

An error occurred when executing ['C:\\Users\\david\\AppData\\Roaming\\pdm\\venv\\Scripts\\python.exe', '-m', 'pip', 'install', '-IU', 'pip']:
No pyvenv.cfg file

pdm lose competition to poetry


Port Amazon/CentOS 6 fixes to master

Ports #290 and #305 to master.
Can I get a review please @jnewbigin?

LGTM

Thanks @jnewbigin


[Client] Update ScannerBuilder with all the newly added arguments like file format and result compression codec

Being addressed in #217


[FEATURE] justfile usage - cog bump --auto should return error code if there are no relevant commits

Hi!
I want to use cog within a justfile to automate my release procedure. I want to set the version within Cargo.toml to the output of cog. Afterwards, I want to continue with the release.
Basically I have come up with something like this:
## `justfile` - `just` command runner

# nushell
set shell := ["nu", "-c"]

bump:
     # call cog bump before using it as input for cargo bump
     # fails and returns if there untracked changes
     # does not fail if there are no relevant commits, but does also not just return the current version but a string
     cog bump --auto -d
     cargo bump (cog bump --auto -d | str trim)
     # Call cargo check to force updating `Cargo.lock`
     cargo check
     # Commit changes to `Cargo.toml` and `Cargo.lock` and actually bump..

At the moment cargo bump fails with: Invalid semver version, expected version or major, minor, patch: ParseError("Error parsing major identifier")
Would it be possible to add a flag to fail if there are no commits
e.g.
cog bump --auto -d --strict
As a general question. Does someone use just with cog and how?
Greetings and thank you,
Christian

Hello @Krensi,
You might wanna use the post_bump_hooks feature to achieve what you want to do. The idea would be to move your "bump logic" directly within Cocogitto.
From what I understand, It would look like something like this in your cog.toml:
post_bump_hooks = [
    "cargo bump {{version}}",
    "cargo check"
]

Then in your Justfile :
## `justfile` - `just` command runner

# nushell
set shell := ["nu", "-c"]

bump:
     cog bump --auto

But to answer your question, the old behavior of Cocogitto was to actually return an error code if no bump commits were found, but it was changed in https://github.com/cocogitto/cocogitto/issues/270 since the cog bump command could be used in automated environments like CI/CD, and developers could only make non-bump commits like chore, ci etc...
Making the cog bump --auto return an error code in such cases could make the CI/CD return error codes when there is actually nothing wrong.

Hello @ABWassim  thanks for your feedback!
I tried using pre_bump_hooks as stated in the documentation. This is my cog.toml file. Unfortunately this does not work on my windows machine.

from_latest_tag = false
ignore_merge_commits = true
generate_mono_repository_global_tag = true
branch_whitelist = []
skip_untracked = false
post_bump_hooks = []
pre_bump_hooks = [
    "cargo build --release",
    "echo 'bumping from {{latest}} to {{version}}'",
    "cargo bump {{version}}",
]
post_package_bump_hooks = []
tag_prefix = "v"

[git_hooks]

[commit_types]

[changelog]
path = "CHANGELOG.md"
authors = []

[bump_profiles]

[packages]

I have the current version of cog.
--
Regarding the bahavior of bump. I see that this might be disrupting for CI, that is why I would suggest an extra flag.
Greetings,
Christian

Hello @Krensi,
Looks like cargo build --release failed for some reason. What kind of terminal are you using on your Windows machine ? Commands are run using sh -c which won't work on Powershell for example. https://github.com/cocogitto/cocogitto/pull/304 is an attempt to support more shells in the future.
And indeed I meant pre_bump_hooks instead of post_bump_hooks in your situation, my mistake.


fix/refactor: add missing imports and reorganize some alls

Pull Request Type

[ ] Feature addition
[x] Bugfix
[ ] Documentation update
[x] Code refactor
[ ] Tests improvement
[ ] CI/CD pipeline enhancement
[ ] Other: [Replace with a description]

Description
I've recently developed a tool that goes in and makes sure that each __init__.py matches up with the __all__s in files/folders in the same directory as it. For example, if there was a statement like from .channel import GuildText, the program will go in and make sure the __all__ of channel is ("GuildText",), and fixes the import if the __all__ doesn't match up. It also detects if the __init__ isn't importing a file with a __all__ in it and adds it to the import.
This tool is far from ready, but I've gotten it to a state where I could run a run on the interactions.py library. Wouldn't you know it, we are missing some imports, so I made this PR to add them back in. This PR also fixes some other issues I was running into involving the codebase, like GuildMedia not being properly exposed in channel.py.
As a (hopefully good) consequence of this program, __all__ for __init__.pys that have been affected have been put in alphabetical order.
Changes

Add GuildMedia to __all__ in channel.py for models.
Export CronTrigger.
Export LocalisedField and LocalizedField.
Export ClientObject and DiscordObject. You may argue against it, but I'd argue that there's no good reason to not export them, and they can have their uses.
Oh right, this program also picked up deserialize_app_cmds, interestingly enough.
Do an alphabetical sort for all __all__s that have been adjusted.

Related Issues

Test Scenarios

Python Compatibility

[x] I've ensured my code works on Python 3.10.x
[ ] I've ensured my code works on Python 3.11.x

Checklist

[x] I've run the pre-commit code linter over all edited files
[x] I've tested my changes on supported Python versions
[ ] I've added tests for my code, if applicable
[ ] I've updated / added  documentation, where applicable

Your code sounds cool, but out of interest how are you validating for objects that should not be exposed to the top level API of a library? Its not always desirable to expose everything under the root namespace.
Or is this just a expose-everything situation?

Your code sounds cool, but out of interest how are you validating for objects that should not be exposed to the top level API of a library? Its not always desirable to expose everything under the root namespace.
Or is this just a expose-everything situation?

Sorry, couldn't look at the code I made for a while 😅. Anyways, the code goes in and exposes everything in a file's __all__, so it's not the most robust thing in the world. Hence why the PR here was limited to only running in places I deemed "safe", and even then, in retrospect, it may have been too zealous.
I'm not sure if there's a way of making some objects not exposed to the top level without adding it to some ignore option or the like to the script.

For transparency's sake, since it's been some months and this PR would have to be recreated if we want to continue with it, here's the script that generated everything: https://gist.github.com/AstreaTSS/9032753c1ae1b8ece431a87d31ca166f


try this https://www.youtube.com/watch?v=9PFmxIdvKEA

https://www.youtube.com/watch?v=9PFmxIdvKEA
gives an error:
python youtube-dl.exe --list-formats "https://www.youtube.com/watch?v=9PFmxIdvKEA"
[youtube] Setting language
[youtube] Confirming age
[youtube] 9PFmxIdvKEA: Downloading webpage
[youtube] 9PFmxIdvKEA: Downloading video info webpage
[youtube] 9PFmxIdvKEA: Extracting video information
[youtube] 9PFmxIdvKEA: Encrypted signatures detected.
[youtube] 9PFmxIdvKEA: Downloading js player vflT9SJ6t
ERROR: Signature extraction failed: Traceback (most recent call last):
File "youtube_dl\extractor\youtube.pyo", line 530, in _decrypt_signature
File "youtube_dl\extractor\youtube.pyo", line 444, in _extract_signature_funct
ion
File "youtube_dl\extractor\youtube.pyo", line 505, in _parse_sig_js
File "youtube_dl\extractor\common.pyo", line 399, in _search_regex
RegexNotFoundError: Unable to extract Initial JS player signature function name;
please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl
with the --verbose flag and include its complete output. Make sure you are using
the latest version; type  youtube-dl -U  to update.
; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl
with the --verbose flag and include its complete output. Make sure you are usin
g the latest version; type  youtube-dl -U  to update.
I'm using the last version:
youtube-dl is up-to-date (2015.03.09)
Thank you

Works fine for me, are you 100% sure you are using the last version? [youtube] Setting language and other message shouldn't appear.
Anyways, post the full output of youtube-dl --verbose "https://www.youtube.com/watch?v=9PFmxIdvKEA"

Sorry,
I've updated but maybe I was still using the old version.
Now I've complely removed the old folder and retried and it works.
Thank you for your fast answer.
On 09/03/2015 18:21, Jaime Marquínez Ferrándiz wrote:

|youtube-dl --verbose "https://www.youtube.com/watch?v=9PFmxIdvKEA"|


Two way bindings is applicable in ng2-datepicker?

Did you manage to implement two way binding? Have you got an example?

Its on the demo page.


Netcoreapp3.1

update HelloWorld, Gravity, BackgroundColor, and AdaptiveWorld to netcoreapp3.1

hi @jackfoxy
i'm not sure if it is a good idea to have multiple paket.dependencies in multiple folders for one solution? aardvark.docs was i think paket-free for easier access to dotnet community. isn't it better to have all vanilla netcore or all paket with one single paket.dependencies?
any thoughts? @luithefirst @krauthaufen

Hi @haraldsteinlechner
I agree.
I modeled the updates after the Sky and SSAO folders, which were already 3.1, so I thought that might be the new preference of the project maintainers.
Personally I also like miscellaneous files like .gitignore, yml's, readme's to be accessible in solution folders. What do you think?
I can make all or any of these updates to the PR. Let me know.

i kind of forgot that for example SSAO was using paket - for good reasons as i remember. however i think when opening the solution everything should work - with this setup at least i get stuff tons of errors unless paket restore is invoked for several folders. i think especially aardvark.docs should be approachable. i would opt for vanilla dotnet for everything. if hardly possible, paket.dependencies in root. what to others think? already mentioned people and @aszabo314 @hyazinthh

Hey, I think the standard dotnet way of handling transitive depenencies is just not manageable...
Maybe we should just use paket and put some build instructions im the readme? I think most people are used to these things anyway...
The other option would be to specifiy a ton of dependencies in every project since afaik there is no dotnet-way of handling transitive depenencies in a reasonable way. (I'd be happy if someone proves me wrong)

One paket dependencies file.
SierpinskiTetrahedron, ModelLoader still netcoreapp2.0
All projects build, with many warnings for SierpinskiTetrahedron.
SierpinskiTetrahedron and ModelLoader do not run.
In another branch ModelLoader can build in netcoreapp3.1, but fails on a different runtime error.
SierpinskiTetrahedron almost builds in netcoreapp3.1, but I do not know how to make the FSharp.Data.Adaptive update build this line in Program.fs
let t = Mod.map2 (fun (t0 : DateTime) (t : DateTime) -> (t - t0).TotalSeconds) t0 Mod.time

Cool, I'll take a look at that tomorrow, we removed Mod.time for several reasons, but since it's most likely used for some animation here, We could replace it with IRenderControl.Time...
When no rendercontrol is available, there are several other "hacks" I can think of...

It looks like installing VS 16.6 installed sdk 3.1.300 and uninstalled 3.1.202.
The builds for Sky.fsproj and SSAO.fsproj now hang with  3.1.300 and never finish.
I will have to fix this.

actually i got distracted while appending your PR in order to merge. when you touch it - could you please move the paket stuff and the solution top level - this way people find it more easily?
the build problem comes from adaptify i suspect which was broken at some point. could you check if updgrading adaptify.msbuild to newest version fixes your problem?

I was also finding it annoying the solution was not at top level.
It is very probably adaptify. I'm getting warnings on adaptify, and adding a global.json pointing to 3.1.202 did not fix the problem. On my machine that has not been updated to VS 16.6 this still builds.
I updated to the latest Adaptify.MSBuild, 0.0.46 and still same situation. It hangs during the build on my updated machine, but not on the machine on the older version of Visual Studio. Although the warning messages about adaptify have gone away doing a dotnet build in powershell. I still get the warning "falling back to local adaptify" in VS.
Could this be significant?
Adaptify warning 3005: Referenced assembly 'C:\Users\jackf\.nuget\packages\aardvark.base.typeproviders\4.5.15\lib\netstandard2.0\Aardvark.Base.TypeProviders.dll' has assembly level attribute 'Microsoft.FSharp.Core.CompilerServices.TypeProviderAssemblyAttribute' but no public type provider classes were found

Solution and paket files moved to top level.
Still does not build in Appveyor because .gitignore specifically excludes Paket.Restore.targets.
Do you want to keep it this way?

people often used to commit a paket bootstrapper.exe and run this as
prebuild step (.paket/paket.exe restore). we did this for most other
aardvark repos. this could solve the ci troubles. i will look into your
adaptify issue tomorrow. then let us merge! thank you very much.
aardvark.docs is important :)
Jack Fox<EMAIL_ADDRESS>schrieb am Mo., 25. Mai 2020, 23:04:

Solution and paket files moved to top level.
Still does not build in Appveyor because .gitignore specifically excludes
Paket.Restore.targets.
Do you want to keep it this way?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/aardvark-platform/aardvark.docs/pull/27#issuecomment-633715741,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAD5KAMTGQ5BR5M2UAAK3X3RTLMNBANCNFSM4NAEJMCA
.

hi @jackfoxy,
the adaptify problem should be fixed here https://github.com/krauthaufen/Adaptify/commit/81e9ba3ff34b62c6d101f210b9719ec22f08919a and in the package https://www.nuget.org/packages/Adaptify.MSBuild/
could you check this one out?

Updated to 0.0.48 Adaptify.MSBuild.
Everything builds.
All netcoreapp3.1 projects run.
netcoreapp2.0 projects possibly have problems in project file. Fail at runtime.
>  dotnet ModelLoader.dll
Error:
  An assembly specified in the application dependencies manifest (ModelLoader.deps.json) was not found:
    package: 'Aardvark.Application.Slim.GL', version: '4.12.0'
    path: 'lib/netstandard2.0/Aardvark.Application.Slim.GL.dll'

>  dotnet SierpinskiTetrahedron.dll
Error:
  An assembly specified in the application dependencies manifest (SierpinskiTetrahedron.deps.json) was not found:
    package: 'Aardvark.Application.Slim.GL', version: '4.12.0'
    path: 'lib/netstandard2.0/Aardvark.Application.Slim.GL.dll'

i'm sorry for the late merge - i fixed the model loader problem in master. actually at the same time @luithefirst added an awesome sky demo. I'm not happy with the currently mixed paket and non-paket thing. maybe when moving everyting to v5 we can fix this one as well...


fix: reduce apiHost steps when using genx in prompt mode - FUI-2207

Review Guidance
📓   Related JIRA
FUI-2207
🤔   What does this PR do?

Attempt on fixing "blank apiHost" after setting it in genx steps (non-prompt mode)

🚀   Where should the reviewer start?
See the api.js changes related to the apiHost question + how the value is set/used here.
📑   How should this be tested?
First:
rm -rf blankappseedtest && npx -y @genesislcap/genx@latest init blankappseedtest --ref bw/api-host-fix

Then:

set a custom API_HOST
finish all the steps
search for the value you used as API_HOST in the app, should be correctly set/ready to use

Repeat the above but without the --ref for this branch:

Do the same, but on main/prerelease branch, "API_HOST" will remain the default... only works if setting in the actual genx command with --apiHost param.

✅   Checklist

[x] I have tested my changes.
[ ] I have added tests for my changes.
[ ] I have updated the project documentation to reflect my changes.

What are the steps to reproduce the api host issue?
> npx -y @genesislcap/genx@latest init myapp
ℹ Downloading NPM seed @genesislcap/blank-app-seed (dist tag latest, subdir: N/A) to /Users/artur.cistov/code/myapp directory...                               15:57:20
✔ Seed downloaded in 4181ms                                                                                15:57:24

You can override the default Genesis server URL used during local developent.
? Set API Host Yes
? API Host (with WebSocket prefix and suffix if any) ws://foo
Optionally, you can enable the SSO function, which will redirect to identity provider before starting the application (given we only have one identity provider).
? Init SSO connection before loading application No
? Project Description

? Group Id global.genesis
? Application Version 1.0.0-SNAPSHOT
? Enable deploy plugin? No
? Generate empty CSV for entities? (config in JSON format) []
? Framework Web Components
? UI configuration in JSON format {}
? Pages config in JSON format [{"name":"home"}]
✔ Project successfully created in 150123ms.                                                                                15:59:50

ℹ (experimental) Opening shell in  myapp...                                                                                15:59:50
> cat client/package.json| grep foo
    "API_HOST": "ws://foo",

riiight..
? Set API Host Yes
? API Host (with WebSocket prefix and suffix if any) ws://foo

I guess this was just me being "dumb" when using the prompts BUT... still think that we should just have ONE step for API_HOST (change proposed here)
Why do we have 2 steps to "fill or not fill API_HOST" when all the other prompts are "one-time" (if you specify that means the YES + the custom value or use the default)
@cistov

@cistov do you think it's worth continuing with this one?

@cistov do you think it's worth continuing with this one?

@MrBrunoWolff I've finally got a chance to test it. All looking good. Just some minor comments.

@cistov this should be good to go now
I'll add a PR on docs repo too and link to this


Extend geocoding report results

Overview
The OAR team needs to see the geocoding times for the entire quarter.
Extends results to include all items in the past four months, and not
just the 1000 most recent items.
Connects #1423
Demo

Notes
This PR needs to be tested on Staging, because there are concerns that with the four-month window the request might time out. It does appear to be working as expected, and within reasonable timeframes, on Staging.
Testing Instructions

Open https://staging.openapparel.org/admin/reports/recent_monthly_geocoding_time_with_queue
Open https://staging.openapparel.org/admin/reports/recent_monthly_geocoding_time_without_queue
Open https://staging.openapparel.org/admin/reports/recent_weekly_geocoding_time_with_queue
Open https://staging.openapparel.org/admin/reports/recent_weekly_geocoding_time_without_queue

Checklist

[ ] fixup! commits have been squashed
[ ] CI passes after rebase
[ ] CHANGELOG.md updated with summary of features or fixes, following Keep a Changelog guidelines

Looking at this now.


Add a GH pages swagger docs

Also, API specifications for metadata-server might be helpful: https://input-output-hk.github.io/offchain-metadata-tools/api/latest/

Please re-open if this doesn't meet your needs @swagendorp. Thanks!


QuickStart failing when creating a the resource 'SplunkSHCMember3'

Hello QS Team,
The EC2 resource 'SplunkSHCMember3' fails creation which eventually causes the entire stack to fail on creation. On reviewing system logs for the instance SplunkSHCMember3 it looks like last command in user-data execution, which I'm guessing is responsible to setting captaincy for the search head returns a 'non-zero' exit code.
Specific command:
sudo -u $SPLUNK_USER $SPLUNK_BIN bootstrap shcluster-captain -servers_list "https://<IP_ADDRESS>:8089,https://<IP_ADDRESS>:8089,https://$LOCALIP:8089" -auth admin:<password>
This causes cfn-signal to send a failure signal to the CloudFormation stack. Can you please replicate this issue and suggest if there something I can do to fix it ?

Would you be able to try manually running that command on SHCMember3 and letting us know if it works as expected?

Hello @billbartlett @deepakr6
I have the same issue.

@deepakr6 @nihe This is fixed now.


Unknown license in releases

What is your question?
I noticed that both the .rpm and .deb packages available in Releases have unknown license in their specifications. I want to know if that's intended or a mistake.
What is the context?
Releases

This issue seems easily resolved by adding "license": "MIT" into packages/insomnia-app/package.json but a think it should be all of the packages.
Anyway, I can make a PR to resolve this issue

@bfsgr PR would be welcomed!


Integrate Code Exporter

NPM package: https://www.npmjs.com/package/graphiql-code-exporter
Source code: https://github.com/OneGraph/graphiql-code-exporter
Example usage: https://github.com/OneGraph/graphiql-code-exporter-example
Running example: https://onegraph.github.io/graphiql-code-exporter-example
The motivation and thought process behind it: https://www.onegraph.com/blog/2019/05/03_Filling_in_the_GraphQL_Pipeline_Ready_to_use_code_generation.html
Video tour showing the ways it can be used: https://youtu.be/1JPf83wZWEU

I would like to give this one a try. Can someone point me in the right direction? Thanks :)

What should be the configurable options for this?


HOTFIX: Keep the same border size when overing

Just a small improvement in the showcase. I don't know if that was intended, but when hovering the result items, the border seemed to change in size and therefore "displacing" elements.
If that's intended, ignore this :)
Great library btw!

Hello @gomezhyuuga,
The displacement effect was not done intentionally at the beginning, but it turned out to be emphasizing the selection even more along with the highlight so I decided to keep it. Thank you thought for taking the time to look into it and change it I really appreciate it.
Thank you so much I'm glad you like it, hope it's coming in handy for you! :)
Have a good day!


Merge client & external client mode code. Add ICMP support and many other fixes.

Much simpler code base with similar functionality. Removed HTTP/HTTPS for now, support will be added later in a proper manner.

👍


OPENCODE-78 - Updated Readme and License

PR approved but please only merge once the ticket with the request has been approved


Tox and extras config (for py3 testing)

This PR doesn't really add any value, but it will make it much easier to test against multiple versions of python in the (near) future.
However, it includes a slightly dirty hack to setup.py to allow gunpowder to be installed using pip (which makes it much easier for downstream packages and is necessary for a clean editable install, as setup.py develop is not recommended, I think). The reasons for this are documented here: https://github.com/funkey/augment/issues/1
Up to you if you want to go down this route; otherwise I'll use this branch for my own testing and then try to strip it out before making a PR for py3.

Sounds good to me. Thanks a lot!


Incorporate CoEpi/CovidWatch Security model doc

https://docs.google.com/document/d/1wPiFnH86DZzDZL2y84GO18GzBoSuYBV2A8WK5bI0tH0/edit#

I'll copy-paste the current version of the doc into the protocol. Then we can use this repo as the single source of truth.


Audit and re-organise the sbt project structure

IMO the current module structure is quite confusing and too granular. We have a lot of nanomodules with only one or two files, and a lot of inter-module dependencies. This makes the codebase difficult to navigate and the build really slow.
It's also not clear why certain classes are in certain modules. Files could be moved to more appropriate modules, or modules could be renamed to better reflect their contents.
A few examples of foibles I've found recently:

The mu-rpc-fs2 and mu-rpc-monix modules contain only a health-check service implementation. Is this example code, or library code that we expect users to make use of? Not really sure what it's for. The actual fs2/Monix integration code is all in other modules: mu-rpc-fs2-internal and mu-rpc-monix-internal.
Those modules have a dependency on the mu-rpc-health-check-unary module, just for the sake of reusing 4 lines of code. I would rather copy the code and remove the dependency.
The ChannelFor class is in the mu-common module. I would expect to see that class in the mu-rpc-channel module.
We have a lot of inter-module test->test dependencies, with test classes in one module extending a "base" class in another module or importing test data from another module. This is extremely hard to navigate, and the excessive re-use of test models makes it difficult to touch them without breaking a lot of code. Again, I'd be happy to copy-paste the code to the module where it's needed, and sever the inter-module dependency.
There are a few cases where multiple modules contribute classes to the same Scala package. So just looking at a class's package does not tell you where the source file is.

Thanks, @cb372.
I agree with this. The reorganization is needed to keep the project codebase as simple as possible. The only requirement I see here before reducing the number of modules is that we need to preserve the number of transitive dependencies that mu-scala would be injecting in projects using it. As a dummy example, if my project is using Monix for streaming, I wouldn't like to have fs2 dependencies because of the mu-scala dependency. The same applies to netty or okhttp.

Agreed 👍

Here is a summary of the current module structure. Arrows are compile-time dependencies. For simplicity, test dependencies are not shown. (Click to enlarge.)

Here is my proposal for re-organisation:

Summary of changes:

Combine the mu-common, mu-rpc-internal-core and mu-rpc-channel modules into a single module called mu-rpc-service. These modules are tightly coupled, either through dependency relationships or via references in macro-generated code, so we may as well combine them into one.

This module will be the only dependency you need in order to compile a @service-annotated service definition trait (with only unary endpoints). Right now you need to depend on mu-rpc-channel to compile a service definition, which I think is pretty confusing.

Combine the mu-health-check-unary, mu-rpc-fs2 and mu-rpc-monix modules into a single module called mu-health-check. This will contain both FS2 and Monix implementations, but it will declare dependencies with optional scope, so users only need to add a dependency on the streaming library they need. The grey arrows in the diagram indicate optional scope.

Rename mu-rpc-internal-{fs2,monix} to mu-rpc-{fs2,monix}. This will not affect users, as we already tell them to depend on mu-rpc-{fs2,monix}, not mu-rpc-internal-{fs2,monix}.

Rename mu-rpc-{netty,netty-ssl,okhttp} to mu-rpc-client-{netty,netty-ssl,okhttp} to make it clearer that they are client modules. This is purely a cosmetic change, and may be unnecessarily disruptive (e.g. scala-steward won't know that the module name has changed), so I'm open to discussion about this one.

Move all tests to a single tests module (see #877). This will depend on pretty much every other module (dependency arrows are omitted from the diagram).

Remove unnecessary dependencies (e.g. mu-rpc-http does not need to depend on mu-rpc-server)

Looks good to me. Very much cleaner and clearer 💯


Bump ethereum-types

Coverage remained the same at 87.556% when pulling 9a52cd134ac50577f3452727cf8dffa6c55996bb on td-ethereumtypesbump into 0aaa603042c69731965794a91ebb90c986b415e3 on master.


 Or am I just dumb?

 My brain's mistake.

Can I support wtfismyip without donating?
I've a server at home if it's helpful.
I don't see that I can help by contributing code because the site has what it needs.. Can I do something anyway?

Contributing code would be great. If you are good with golang (or want to learn it) I've been meaning to implement https://github.com/wtfismyip/wtfismyip/issues/23 for months now


Problem with Doctrine ORM / ODM differences in proxy class naming

Bug Report

Q
A

BC Break
no

Version
2.3.2

Summary
After upgrading from ODM v1.x, I noticed there is a difference in naming of proxy classes between Doctrine ORM and ODM. This wasn't the case in the 1.x. It causes some unexpected behaviors when trying to store objects loaded from ORM to the ODM source.
Current behavior
Currently when I load an object via ORM, its lazy-loaded relations are instances of proxy classes, e.g. Proxies\__CG__\App\Entity\User\Profile. It uses the __CG__ as the namespace's part - it's defined in Doctrine\Persistence\Proxy::MARKER.
On the other hand ODM expects the marker to be __PM__, as per ProxyManager\Inflector\ClassNameInflectorInterface::PROXY_MARKER. Because of that ODM fails when trying to find a mappings for such objects.
How to reproduce
Let's have two simple classes and assume their ORM and ODM mappings are correct:
class User
{
    private int $id;
    private Profile $profile;

    public function getProfile(): Profile
    {
        return $this->profile;
    }
}

class Profile
{
    // ...
}

When we properly load User instance from a DB and call $profile = $user->getProfile(), the $profile is going to be an instance of something like Proxies\__CG__\App\Entity\User\Profile.
If we then try to store that to MongoDB via ODM, it's going to fail with an error message similar to below.
Example:
$entityManager = \Doctrine\ORM\EntityManager::create(...);
$documentManager = \Doctrine\ODM\MongoDB\DocumentManager::create(...);

$profile = new Profile(...);
$documentManager->persist($profile);  // <<-- OK

$user = $this->entityManager->getRepository(User::class)->find(1);
$profile = $user->getProfile();

$documentManager->persist($profile);  // <<-- ERROR

Error message:
Doctrine\Persistence\Mapping\MappingException : The class 'Proxies\__CG__\App\Entity\User\Profile' was not found in the chain configured namespaces App\Entity

The problem is caused by differences between these two places:

Doctrine\Persistence\Proxy::MARKER = '__CG__' (used by ORM)
ProxyManager\Inflector\ClassNameInflectorInterface::PROXY_MARKER = '__PM__' (used by ODM)

Expected behavior
I would expect that both ORM and ODM use the same proxy marker, like it was in version 1.x of ODM. In that version ODM was using the Doctrine\Common\Util\ClassUtils::getRealClass() method, which was used by ORM as well.

Sadly we can't fix this. With ODM 2.0 we decided to use https://github.com/Ocramius/ProxyManager instead of Doctrine's Proxy mechanism as what Marco wrote is way more powerful than our old solution. IIRC ORM also had plans to switch over to the new proxy mechanism which I guess would somehow fix your issue. But I don't know any details if and when ORM will do such a leap.
Offhand I'm not negating such approach worked but I do see a lot of things that could go wrong when passing uninitialized Proxies from other projects :D I'd advise to revisit this anyway.

It's not about using uninitialized objects. Even if ORM initializes it, it's still going to be an instance of a proxy class.

My comment was about using your approach in ODM 1.x :)

@malarzm I've done some more debugging and there's one thing which interested me. Maybe you would be able to explain the logic.
Let's take the same example as above - an instance of class Proxies\__CG__\App\Entity\User\Profile extends App\Entity\User\Profile.
For an instance of the above class:

ODM calls Doctrine\Persistence\Mapping\AbstractClassMetadataFactory::getMetadataFor() with Proxies\__CG__\App\Entity\User\Profile as the parameter.
This method calls loadMetadata() from the same class with the same param
This one gets all the ancestors of the given class ($this->getParentClasses($name)) and tries to load their mappings in a loop (in the example it successfully loads mapping for App\Entity\User\Profile)
Even if it is able to load mappings for all the ancestors, but fails at the proxy class, the whole method throws an exception

I'm wondering whether the idea behind that was to return parent's mapping in case of missing one for the given class. But I cannot tell that by just reading the code.
I'm not trying to complain about anything. I just thought I could help somehow with this piece of code.

To my knowledge, no. The idea is that we need parent's mapping to inherit everything that was defined there, take a look at ODM's ClassMetadataFactory: https://github.com/doctrine/mongodb-odm/blob/2.3.x/lib/Doctrine/ODM/MongoDB/Mapping/ClassMetadataFactory.php#L127.
To solve your issue you could try one of the following:

ODM provides an event for missing metadata (https://github.com/doctrine/mongodb-odm/blob/2.3.x/lib/Doctrine/ODM/MongoDB/Mapping/ClassMetadataFactory.php#L86). You could subscribe to it, check by yourself if you're dealing with ORM's Proxy, and fetch mapping for the real class if that's the case
Decorate class resolver that is used by ODM so it can detect ORM's Proxy. Downside is that it's not designed to be an extension point from DocumentManager's perspective (https://github.com/doctrine/mongodb-odm/blob/2.3.x/lib/Doctrine/ODM/MongoDB/DocumentManager.php#L205) but you should be kinda-safe.

@malarzm yeah, I've already solved my issue by implementing the subscriber you mentioned in (1). And later I started wondering why ODM tries to load parent's class mappings. Looks like I didn't realize ODM does that to support Mapped Superclasses feature.
Thank you again for the next part of clarifications!


How do I send messages quickly without getting memory access exceptions

Hi, as per the title.  Using the simple code below:
using (var producerConnection = new Producer<Null, string>(config.ProducerConfig, null, new StringSerializer(Encoding.UTF8)))
            {
                while (true)
                {
                    Console.WriteLine("Enter the number of messages to publish...");
                    if (int.TryParse(Console.ReadLine(), out int num))
                    {
                        for (var i = 0; i < num; i++)
                        {
                            producerConnection.ProduceAsync("my-topic", null, $"Message #{i}");
                        }
                        producerConnection.Flush();
                    }
                }
            }
        }

This works great for small numbers but if I try say 50,000 messages I get the following error

System.AccessViolationException: 'Attempted to read or write protected memory. This is often an indication that other memory is corrupt.'

If I add a .Wait() to the end of my ProduceAsync() call this kills the performance. I also tried flushing after every N messages but that seemed to give me the worst of both worlds.
Thanks for the help.

Are you referencing the 0.9.2-preview package on nuget? unfortunately there is a bug in that version which would cause this behavior. this is fixed in master (which to my knowledge is now stable, though we haven't finished testing yet).

I will push a new version to nuget shortly.

there is now a 0.9.4-preview2 package on nuget.org. If this does not resolve the problem, please reply and i'll try to reproduce.

Fantastic updating has fixed it, cheers for the quick help!

@mhowlett hey sorry for posting in a closed issue but I am having the same problem and figured it would be better to put my comment in this thread (if you'd prefer I could make a new issue).
I am currently working on replacing RdKafka with Confluent Kafka, and if I don't do something to throttle the producer messages I will get the same System.AccessViolationException as detailed in this thread. I am working with the most recent version of Confluent Kafka and librdkafka.
At the moment I am working on using the features of the package to handle retries and fiddling with some settings in order to get it to work, it's possible something I am doing is causing this, so here are the settings I currently have on my Producers.
Topic configs
request.required.acks = -1
message.timeout.ms = 5000
Global configs
bootstrap.servers = settings.BrokerPath
max.in.flight.requests.per.connection = 1
message.max.bytes = 500000000
retries = 10000000
Here's the full stack trace of the error I see in the Event Log.
Application: ServiceWrapper.exe
Framework Version: v4.0.30319
Description: The process was terminated due to an unhandled exception.
Exception Info: System.AccessViolationException
   at Confluent.Kafka.Impl.LibRdKafka+NativeMethods.rd_kafka_message_timestamp(IntPtr, IntPtr ByRef)
   at Confluent.Kafka.Impl.LibRdKafka.message_timestamp(IntPtr, IntPtr ByRef)
   at Confluent.Kafka.Producer.DeliveryReportCallbackImpl(IntPtr, IntPtr, IntPtr)
   at Confluent.Kafka.Impl.LibRdKafka+NativeMethods.rd_kafka_poll(IntPtr, IntPtr)
   at Confluent.Kafka.Impl.LibRdKafka.poll(IntPtr, IntPtr)
   at Confluent.Kafka.Producer+<>c__DisplayClass9_0.<StartPollTask>b__0()
   at System.Threading.Tasks.Task.InnerInvoke()
   at System.Threading.Tasks.Task.Execute()
   at System.Threading.Tasks.Task.ExecutionContextCallback(System.Object)
   at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object, Boolean)
   at System.Threading.ExecutionContext.Run(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object, Boolean)
   at System.Threading.Tasks.Task.ExecuteWithThreadLocal(System.Threading.Tasks.Task ByRef)
   at System.Threading.Tasks.Task.ExecuteEntry(Boolean)
   at System.Threading.Tasks.ThreadPoolTaskScheduler.LongRunningThreadWork(System.Object)
   at System.Threading.ThreadHelper.ThreadStart_Context(System.Object)
   at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object, Boolean)
   at System.Threading.ExecutionContext.Run(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object, Boolean)
   at System.Threading.ExecutionContext.Run(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
   at System.Threading.ThreadHelper.ThreadStart(System.Object)

Any help or insight you could provide would be greatly appreciated, thanks!

Labelling this as bug if only because we should not ever be throwingAccessViolationExceptions.
are you setting api.version.request? what broker version are you using?
If you post minimal complete example demonstrating the problem, that is the quickest way for us to investigate.

It looks like you are trying to get the timestamp for a produced message (on the producer).
Message timestamps are not currently supported in the delivery report callbacks.

@mhowlett No I am not, I just read what that does, should I be setting that to 0.9.4?
As far as I can tell I'm not doing anything special. I'm using F# so I hope this makes sense to you (the logging stuff is an internal thing)
let deliveryReport = producer.ProduceAsync(topic, null, message)

let contWith (task:Task<Message>) =
  match task.Result.Error.Code with
  | ErrorCode.NoError -> LogToCore logger LogLevel.Info (sprintf "Produced message to topic %s successfully" topic) None []
  | error             -> LogToCore logger LogLevel.Warn "Producing Attempt failed." None [("Error Code", error.ToString())]

deliveryReport.ContinueWith(Action<Task<Message>> contWith) |> ignore

@edenhill interesting, I am not explicitly trying to get the timestamp anywhere, could this be happening as a side effect of something else?

yeah, the timestamp is marshaled from librdkafka regardless of whether it is used. I think @edenhill noticed the error message is related to timestamps and recalled that delivery report timestamps are broken in the current released nuget package (they are fixed in master now). My first instinct of what to try are things related to versioning. try setting api.version.request to true. also what broker version are you using?

Also try calling Library.VersionString to verify the version of librdkafka being found. If it's not 0.9.4, that's the problem. We've seen the wrong version being found in some scenarios where people have installed librdkafka other ways.

We're using 3.1.1, Library.Version string prints 0.9.4 at runtime.
After setting api.version.request everything seems to be working! Sorry if I missed that in the docs, is there anything else you'd like me to try out?

Weird, I don't really see how api.version.request could cause a crash in the delivery report handler.

Hi there,
I am not sure if this is the same issue, but it is memory related too.
When exetuing this little program, memory usage for this process jumps to ~20GB (my system has 16GB ram)
Sometimes it even makes my os (Win10) unstable, screen goes dark, other program crash etc.
using System;
using System.Collections.Generic;
using System.Linq;
using System.Threading.Tasks;
using Confluent.Kafka;
using Newtonsoft.Json;

namespace KafkaProducerTest
{
    class Program
    {
        private const int N = 100_000;

        static void Main(string[] args)
        {
            Console.WriteLine($"lib version: {Library.VersionString}");
            Console.WriteLine("Press <Enter> to start...");
            Console.ReadLine();

            var topic = "test";
            var cfg = new Dictionary<string, object>{
                {"bootstrap.servers", "kafka:9092"},
                {"queue.buffering.max.ms", 100},
                {"client.id" , "test-client"},
                {"message.max.bytes" , 10240},
                {"batch.num.messages", 1000},
                {"request.required.acks", (int)AcksEnum.WaitForAckFromLeader},
                {"api.version.request", true}
            };

            Console.WriteLine(JsonConvert.SerializeObject(cfg, Formatting.Indented));

            using (var producer = new Producer(cfg))
            {
                var payload = new byte[8192];
                Task.WhenAll(Enumerable.Range(0, N).Select(x => producer.ProduceAsync(topic, null, payload))).Wait();
            }
        }
    }
}

Strangely enough, increasing message.max.bytes to 102400 makes it work fine.

@wojciechrak
While testing, I spotted a bug on librdkafka, see here:
https://github.com/edenhill/librdkafka/issues/1363
Note that when I test your code on my computer (either local or remote zookeeper/kafka), I have no issue (6GB used)
Couple of things here:

batch are limited by message.max.bytes, so your limit here is one. Can you try setting batch.num.messages to 1 to see if you have some improvements (for tracking of the librdkafka issue mentioned at start)
You should use the ProduceAsync which takes an IDeliveryHandler, not the one which return a task
When you use the tasked produceAsync, it will create a completion task on every call - so one for the 100_000 objects you send, which will also contain a copy of the data. The task one should be used when you actually await for one (or say a small number) ack(s) of specific messages. In your example, you would rather do this

using System;
using System.Collections.Generic;
using Confluent.Kafka;
using Newtonsoft.Json;
using System.Threading;

namespace KafkaProducerTest
{
    class Program
    {
        private const int N = 100_000;

        static void Main(string[] args)
        {
            Console.WriteLine($"lib version: {Library.VersionString}");
            Console.WriteLine("Press <Enter> to start...");
            Console.ReadLine();

            var topic = "test";
            var cfg = new Dictionary<string, object>{
                {"bootstrap.servers", "kafka:9092"},
                {"queue.buffering.max.ms", 100},
                {"client.id" , "test-client"},
                {"message.max.bytes" , 10240},
                {"batch.num.messages", 1000},
                {"request.required.acks", 0},
                {"api.version.request", true},
            };

            Console.WriteLine(JsonConvert.SerializeObject(cfg, Formatting.Indented));

            using (var producer = new Producer(cfg))
            {
                var dh = new DeliveryHandler(N);
                var payload = new byte[8192];
                for (int i = 0; i < N; i++)
                {
                    producer.ProduceAsync(topic, null, payload, dh);
                }
                dh.AutoEvent.WaitOne();
            }
            Console.WriteLine("Press <Enter> to quit...");
            Console.ReadLine();
        }
    }

    public class DeliveryHandler : IDeliveryHandler
    {
        public int NumberOfMessages { get; private set; }
        public AutoResetEvent AutoEvent { get; private set; }

        public DeliveryHandler(int numberOfMessages)
        {
            NumberOfMessages = numberOfMessages;
            AutoEvent = new AutoResetEvent(false);
        }

        public bool MarshalData { get { return false; } }

        public void HandleDeliveryReport(Message deliveryReport)
        {
            if (--NumberOfMessages == 0)
            {
                AutoEvent.Set();
            }
            if(deliveryReport.Error.HasError)
            {
                //handle error here, message was not acked, details in deliveryReport.Error
            }
        }
    }
}

You will see an impact on both RAM used and GarbageCollection.

for note, queue.buffering.max.kbytes is by default 4_000_000, meaning you can queue up to 4GB of data (+ all override of confluent.Kafka like copy of data for tasked ProduceAsync). You can lower this if you are limited on RAM, and ProduceAsync will block until there is some space. You can also instruct ProduceAsync to throw if queue is full via one of its overload (blockIfQUeueFull)

I'm closing this since the relevant implementation has changed considerably since this issue was filed (including considerable effort to avoid access violation exceptions). Please open a new issue if this problem is encountered in a 1.0 pre-release version or higher.


Web Interface: Code Sharing for DataSource and FeatureSet pages

Right now the two pages have a lot of duplicate code, lets see if we can 'code share'  some of the duplicate code.

Okay, so the DataSource and FeatureSet pages are now in sync, they are using shared web_components but there a lot of code, callbacks, layout, etc that's duplicated. We'll have to circle back to this.


tests: fix curve25519 unittests

Following https://github.com/trezor/trezor-crypto/commit/0abc61f6722580ee779614ef5b31d17a29e4d841.

Thanks!


⚠ Carbubu has degraded performance

In d65a6dc, Carbubu (https://carbubu.fr) experienced degraded performance:

HTTP code: 200
Response time: 4390 ms

Resolved: Carbubu performance has improved in 15b4d8b after 6 minutes.


Fix: Route from BindRequest not passed on

If there is a Route in the Bind Request then put it into the map instead of AppGUID again.

I signed it

Pretty sure this resource is part of route services, which Service Catalog doesn't currently support, or ever plan to. That doesn't necessarily that we should be sticking it in the app guide, but something to think about.

Good catch, thanks @fabstu
/lgtm

/approved

/approve

Pretty sure this resource is part of route services, which Service Catalog doesn't currently support, or ever plan to. That doesn't necessarily that we should be sticking it in the app guide, but something to think about.

Sorry @jberkhahn, I missed your message. I can't see why the library shouldn't follow the spec, given that it supports all the rest of the fields required for the flow. Is it interfering in any way with the Service Catalog, or am I missing something?
/assign @jberkhahn

Ok, but let it be on your head.
/approve

/retest


Add RSS to blog

not critical, jeff is testing RSS implementations elsewhere first

(need to replace static site system with lume)

@taramk Try putting https://treehouse.sh/blog/feed.rss into MailChimp's feed thing. The site is running a different static site generator, but nothing changes with how to do local dev. The "Latest Posts" sidebar on the blog is generated dynamically now. We can also now easily create a proper index page for the blog.
The docs changed a little. First, syntax highlighting changed. If there were customizations, they'll probably need to be updated. I think we also had a black background, but we'd have to find a compatible theme for it. One thing that changed is we used to keep the source code blocks in a scrollable element. Now it pushes the page wide. I tried to apply the old fix and it didn't work, so maybe you can take a look.
The left nav menu is now half generated. The way the TOC plugin works is it only generates for the current page, so I have it showing under the right section when the page is open. The top level page nav is still done by hand, but that can be changed to be generated in another pass. It also changed all the headers to links, so I styled them back to headers, but they are still functionally links (you can click them). Not my ideal, but should be fine.


bug: Color is off in foot terminal

Did you check docs and existing issues?

[X] I have read all the tokyonight.nvim docs
[X] I have searched the existing issues of tokyonight.nvim
[X] I have searched the existing issues of plugins related to this issue

Neovim version (nvim -v)
None
Operating system/version
NixOS Unstable
Describe the bug
When running the command npm create svelte@latest my-app, I see different colors in the Alacritty terminal emulator and in the foot one. Both have the official TokyoNight color scheme from this repo installed.
Steps To Reproduce

Install the foot terminal and hook it up with TokyoNight
Install npm
Run npm create svelte@latest my-app in the foot terminal
What should be gray, is blue

Expected Behavior
The text should be gray, like in other terminals with TokyoNight (e.g., Alacritty).
Repro
No response

This screenshot represents the bug and shows the Alacritty terminal on top and the foot terminal at the bottom.

it's a different terminal, so colors will never be 100% the same


The results about 11-1 on cityscapes

And we also train the model of 1-1 (21 tasks) on cityscapes.
We get the mIoU = 34.60.

And I attach the results file.

A problem in your configuration may be that you have a larger amount of GPUs than me (4 vs 2) and a lower batch size (6 vs 12). (1) the optimal learning rate may not be the same, and (2) the batch norm statistics may be poorer for you because we don't sync the statistics across GPUs.
I'm rerunning on my side those two experiments and will come back to you when I have results. But my config will be with batch_size=12 and nb_gpus=2.

Hi, we apply the standard-setting described as you, batchsize=12, gpus=2.
The results are: mIoU = 34.66, 58.86, described as above.

My logs were for 1-1:
INFO:rank0:
Total samples: 695.000000
Overall Acc: 0.921154
Mean Acc: 0.526491
FreqW Acc: 0.860704
Mean IoU: 0.452352
Class IoU:
	class 0: 0.96692383
	class 1: 0.60595274
	class 2: 0.8396912
	class 3: 0.25620675
	class 4: 0.15220715
	class 5: 0.06744852
	class 6: 0.0029509393
	class 7: 0.32076913
	class 8: 0.8602092
	class 9: 0.4685076
	class 10: 0.8987206
	class 11: 0.57019883
	class 12: 0.14706148
	class 13: 0.8104589
	class 14: 0.22377394
	class 15: 0.418797
	class 16: 0.5558119
	class 17: 0.014650934
	class 18: 0.41433895
Class Acc:
	class 0: 0.9843136
	class 1: 0.7646799
	class 2: 0.9475544
	class 3: 0.32678273
	class 4: 0.16397442
	class 5: 0.07432122
	class 6: 0.002961872
	class 7: 0.39156127
	class 8: 0.9406667
	class 9: 0.55477184
	class 10: 0.95123327
	class 11: 0.72136724
	class 12: 0.1578011
	class 13: 0.92616725
	class 14: 0.23514673
	class 15: 0.64418685
	class 16: 0.59930676
	class 17: 0.014668353
	class 18: 0.6018618

INFO:rank0: Closing the Logger.
Last Step: 20
Final Mean IoU 45.24
Average Mean IoU 39.93
Mean IoU first 45.24
Mean IoU last 0.0

and for 11-1 (incorrectly called 10-1 in the code):
Total samples: 695.000000
Overall Acc: 0.940431
Mean Acc: 0.706060
FreqW Acc: 0.892914
Mean IoU: 0.620541
Class IoU:
	class 0: 0.9772094
	class 1: 0.70418805
	class 2: 0.87226355
	class 3: 0.43371245
	class 4: 0.48649183
	class 5: 0.1728502
	class 6: 0.32025278
	class 7: 0.4916692
	class 8: 0.8817237
	class 9: 0.5381132
	class 10: 0.9231286
	class 11: 0.66175914
	class 12: 0.44145837
	class 13: 0.8645326
	class 14: 0.59335023
	class 15: 0.69356126
	class 16: 0.7649851
	class 17: 0.39857766
	class 18: 0.5704467
Class Acc:
	class 0: 0.9894886
	class 1: 0.82313305
	class 2: 0.9535187
	class 3: 0.55524725
	class 4: 0.5560459
	class 5: 0.1998001
	class 6: 0.3846253
	class 7: 0.5757105
	class 8: 0.94679874
	class 9: 0.6382271
	class 10: 0.96305674
	class 11: 0.77320135
	class 12: 0.5875096
	class 13: 0.9436415
	class 14: 0.66980577
	class 15: 0.7844055
	class 16: 0.84219396
	class 17: 0.5033585
	class 18: 0.7253713

INFO:rank0: Closing the Logger.
Last Step: 10
Final Mean IoU 62.05
Average Mean IoU 62.37
Mean IoU first 62.05
Mean IoU last 0.0

Nevertheless, I'm re-running once again my code. I'll keep you updated when I have results.

Yeah, hope for your reply.

Hi, @arthurdouillard
Is there any progress now?

I have trouble reproducing my results for Cityscapes-domain. I'm not sure why since I have logs (see my previous message) showing my reported performances.
I have updated the scripts for Cityscapes Domain with better results, sligthly above MiB and much higher than ILT, but still a bit lower than paper results.
For 11-1:
Final Mean IoU 60.48
Average Mean IoU 59.33
Mean IoU first 60.48
Mean IoU last 0.0
cityscapes_domain_11-1_PLOP_backbone-0.0001-logits-0.0001 On GPUs 0,1
Run in 17781s

For 1-1:
Final Mean IoU 43.15
Average Mean IoU 34.59
Mean IoU first 43.15
Mean IoU last 0.0
cityscapes_domain_1-1_PLOP_backbone-0.0001-logits-0.001 On GPUs 0,1
Run in 17534s

If I find a fix I'll update the code base.

Hi, @arthurdouillard ,
Could you please re-open this issue? If we have some questions, we can ask for your help in this page.

Hey, I prefer to have atomic issues. For more questions please open a new issue. Thanks!


Add ability to provide CLC snippets in Packet.

Currently in AWS, the user can pass CLC snippets for both controller and worker pool nodes. However the same functionality is not available in Packet.

Done in #355.