Backdoors, GitHub Package Manager, cleanup.

This PR has a bunch of updates:

Add new backdoor detection rules (based on recent attacks seen).
Add preliminary support for Golang, fix GitHub processors (removed libgit2 dependency) (#172).
Minor improvements (version sorting, test coverage, nullability)
Remove self-contained csproj attribute (was preventing building in Visual Studio, debugging, etc.)

@daalcant Could you take a look at the .csproj files (with me setting <SelfContained>false</SelfContained>) to see if we need to adjust the build scripts? This was needed to get the solution to build in Visual Studio.

@daalcant Could you take a look at the .csproj files (with me setting <SelfContained>false</SelfContained>) to see if we need to adjust the build scripts? This was needed to get the solution to build in Visual Studio.

I'll need to update the build strategy. I think if we build each project individually then do a self-contained build of the solution it will achieve what we're looking for. After I test locally I'll update this PR.

I added some changes to prepare for updating the pipeline build order. I expect builds to fail until I commit the next set of changes; just checking to make sure that tests run as expected.

Running into more issues here. Looks like there has been a recent breaking change to the way self-contained project references are validated in .NET 5. Going to fiddle with the configurations and the ValidateExecutableReferencesMatchSelfContained property.
https://docs.microsoft.com/en-us/dotnet/core/compatibility/sdk/5.0/referencing-executable-generates-error

@scovetta Builds seem to be working again (for now). Unfortunately I'm pretty sure our setup is unsupported and could break in the future. The .NET docs suggest we shouldn't expect to bundle our executables in a single folder the way we have been, which is why we keep running into problems. I'm open to discuss later but I suppose this is fine for the short term.
I performed some basic testing of the framework dependent netcore app and the self-contained Windows and Linux apps. All of the executables run, and I was able to successfully demo oss-download against pkg:cargo/rand on each platform as a spot check. Feel free to merge if this is good enough.

Thanks @daalcant! Merging now.


Syntax error on raspbian os

OS: Raspbian os
Device: Rasberry pi 3b+
PY version: Python 3.9.2
When i starting the script i will get this error:
 File "/home/Fess/notcoin-clicker/NotCoin-Clicker/clicker.py", line 297     match current_buff['taskId']:           ^ SyntaxError: invalid syntax

Try install python 3.10 >

If you can't install Python version 3.10 or higher, you need to change the way the get_free_buffs_data function is written in the clicker class instead of using match case, we should use if.

Thank for your review, after 5 hours of installing, i finally done it by installing 3.10 version of python)


Angular " OrderBy: '' " (empty string) no longer sorting by index

In previous versions of Angular (1.2) when you passed an empty string to the OrderBy in an ng-repeat it would order by the index of each item in the array.
Now (1.3.15 & 1.4.0) it orders very differently. This plunk shows 1.2, 1.3.15, and 1.4.0 and how the order by functions differently in each case.
It should order by index if OrderBy isn't specified.

This is going to be fixed in 1.4.2 with https://github.com/angular/angular.js/commit/48e1f5605edd32a63318fd78f5165c7d1f1a20f9
It broke in 1.3.0-rc.5 in https://github.com/angular/angular.js/commit/607f016a0ba705ce40df0164360fb96a9d7f5912

Any chance this could be fixed in 1.3.x as well?

Fix landed as 48e1f5605edd32a63318fd78f5165c7d1f1a20f9


ImageDataGenerator numpy TypeError

I'm trying to use ImageDataGenerator to preprocess the MNIST dataset. It's unsuccessful with the error message being:

Traceback (most recent call last):
File "/home/cm5ky/Dropbox/College/4_Fourth_Year/deep learning/MNIST/assess_performance/test.py", line 14, in
generator.fit(all_x_train)
File "/home/cm5ky/anaconda3/lib/python3.5/site-packages/keras/preprocessing/image.py", line 294, in fit
X -= self.mean
TypeError: Cannot cast ufunc subtract output from dtype('float64') to dtype('uint8') with casting rule 'same_kind'

Changing line 294 in image.py glow X -=  self.mean to X = X - self.mean resolved my issue. My numpy version is 1.10.4.
The error can be reproduced with:
from keras.datasets import mnist
from keras.preprocessing.image import ImageDataGenerator
(all_x_train, all_y_train), ignore = mnist.load_data()
generator = ImageDataGenerator()
generator.fit(all_x_train)

I got the same error.
_# this will do preprocessing and realtime data augmentation
datagen = ImageDataGenerator(
featurewise_center=True,  # set input mean to 0 over the dataset
samplewise_center=False,  # set each sample mean to 0
featurewise_std_normalization=True,  # divide inputs by std of the dataset
samplewise_std_normalization=True,  # divide each input by its std
zca_whitening=False,  # apply ZCA whitening
rotation_range=0,  # randomly rotate images in the range (degrees, 0 to 180)
width_shift_range=0.1,  # randomly shift images horizontally (fraction of total width)
height_shift_range=0.1,  # randomly shift images vertically (fraction of total height)
horizontal_flip=True,  # randomly flip images
vertical_flip=False)  # randomly flip images
datagen.fit(X_train)_
I got the error as follows :
File "/usr/local/lib/python2.7/dist-packages/Keras-1.0.2-py2.7.egg/keras/preprocessing/image.py", line 428, in fit
X -= self.mean
TypeError: Cannot cast ufunc subtract output from dtype('float64') to dtype('uint8') with casting rule 'same_kind'

@jnphilipp  : Could you please check this issue when featurewise_std_normalization=True,
I got similar error as follows.
    datagen.fit(X_train)
  File "/usr/local/lib/python2.7/dist-packages/Keras-1.0.2-py2.7.egg/keras/preprocessing/image.py", line 432, in fit
    X /= (self.std + 1e-7)
TypeError: ufunc 'divide' output (typecode 'd') could not be coerced to provided output parameter (typecode 'B') according to the casting rule ''same_kind''
n

I got the same error.
TypeError: ufunc 'subtract' output (typecode 'O') could not be coerced to provided output parameter (typecode 'f') according to the casting rule ''same_kind''

This error happens when using ImageDataGenerator that requires fitting on the data before being able to generate examples (for example when you have featurewise_center=True).
So the solution is to call the fit method on the generator before starting training.

@lopuhin Thank you. This makes it hard to use together with flow_from_directory

@burgalon yes, I totally agree with that. I ended up using flow_from_directory on an ImageDataGenerator without featurewise_center to load images (or a sample of images if there are too many) from a directory, and then fit another ImageDataGenerator on that data. There is also an issue with a plan for improvement: https://github.com/fchollet/keras/issues/3338#issuecomment-237252884

on a somewhat similar note, I'm wondering how is it possible to connect Tensorflow pipeline into a Keras Model() -
http://stackoverflow.com/questions/40767222/add-tf-image-decode-jpeg-to-keras-created-graph


Architecture

This might be a bit more verse for this page, but one piece of architecture perhaps might be worth a mention is that ML.NET as a framework is extensible and for DNN scenarios we have made TensorFlow ,ONNX operable within the same API set and concepts (e.g. estimators, transformers etc.)

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: edace175-268c-7428-dad5-95cd974422c3
Version Independent ID: 707aed84-b636-088a-bf57-1cc5e4f69631
Content: How does ML.NET work? - ML.NET
Content Source: docs/machine-learning/how-does-mldotnet-work.md
Product: dotnet-ml
GitHub Login: @natke
Microsoft Alias: nakersha

Good idea @asthana86

Hi , i want to use ML.Net in project and it uses data which i can not send over internet , i am aware ML.Net is offline processing the model and predicting results , but i can not find it on the web page mentioned , it is very useful for enterprise , can some one from Microsoft docs update the document or comment here that it is offline process it will really help.

Resolved by #15714


Tests failing for @aws-sdk/client-sqs >=3.316

What version of OpenTelemetry are you using?
Current revision on main
What version of Node are you using?
Node 16, 18
What did you do?
npm run test-all-versions in @opentelemetry/instrumentation-aws-sdk
What did you expect to see?
Tests pass.
What did you see instead?
Tests fail for @aws-sdk/client-sqs >=3.316
Additional context
Run for Node 16: https://github.com/open-telemetry/opentelemetry-js-contrib/actions/runs/4787435108/jobs/8512667684
Run for Node 18: https://github.com/open-telemetry/opentelemetry-js-contrib/actions/runs/4787435108/jobs/8512667928

cc @carolabadeer

Thanks for raising this @pichlermarc! I will take a look

labeling p4 as this does not affect users

@carolabadeer any update?

Currently working with the AWS SDK for JS team to identify possible issues in the changes between @aws-sdk/client-sqs v3.315 and v3.316 that could be causing this test failure. Will post updates here on any findings and progress

While waiting I also looked into the behavior in the unit tests and found that there are two spans being used (not sure if they are meant to be the same) - a test span and a callback span.
The callback span is the one whose attributes are being checked in the unit test that is failing. In that span, the test is checking for a SemanticAttributes.MESSAGING_OPERATION attribute but cannot find one. This span seems to be wrapping an S3 CreateBucket call. These are it's attributes:
{
  'aws.operation': 'createBucket',
  'aws.signature.version': 's3',
  'aws.service.api': 'S3',
  'aws.service.identifier': 's3',
  'aws.service.name': 'Amazon S3',
  'rpc.system': 'aws-api',
  'rpc.method': 'CreateBucket',
  'rpc.service': 'S3',
  'aws.region': 'us-east-1',
  'aws.request.id': '0000000000000',
  'http.status_code': 200
}

Since this is an S3 call, there shouldn't be a messaging.operation atttribute, which is the correct behavior.
The test span, on the other hand, is the one wrapping the SQS ReceiveMessage call. That span contains the correct messaging.operation attribute:
{
  'rpc.system': 'aws-api',
  'rpc.method': 'ReceiveMessage',
  'rpc.service': 'SQS',
  'messaging.system': 'aws.sqs',
  'messaging.destination_kind': 'queue',
  'messaging.destination': 'otel-demo-aws-sdk',
  'messaging.url': 'https://sqs.us-east-1.amazonaws.com/731241200085/otel-demo-aws-sdk',
  'messaging.operation': 'receive',
  'aws.region': 'us-east-1',
  'http.status_code': 200
}

These are my findings so far, but I am still curious about 2 questions:

Why is the callback span only being used in this messaging.operation attribute test and not in any other place? I was able to solve this issue and get the test to pass by using

          // where span.attributes represents the attributes of the test span shown above
          expect(span.attributes[SemanticAttributes.MESSAGING_OPERATION]).toMatch(
            MessagingOperationValues.RECEIVE
          );

instead of
          expect(attributes[SemanticAttributes.MESSAGING_OPERATION]).toMatch(
            MessagingOperationValues.RECEIVE
          );

Still unsure about how/why this issue did not present itself earlier. The implementations for adding the MESSAGING_OPERATION attribute and the unit tests have not had any recent changes, and I am not yet sure about the correlation between the @aws-sdk/client-sqs version bump and this test failure.

This span seems to be wrapping an S3 CreateBucket call. These are it's attributes:

why are we seeing S3 CreateBucket span in this test?

Why is the callback span only being used in this messaging.operation attribute test and not in any other place? I was able to solve this issue and get the test to pass by using

So what this part actually asserts is that the callback itself is being invoked with the receive span set as the active span for the callback invocation. The issue is that any operations triggered inside the callback, like calling deleteMessage or executing db queries - those will create new spans and the parent for them will be the span we get back from context.active() const receiveCallbackSpan = trace.getSpan(context.active());. If the context is ever not propagated to the callback correctly, the attributes for the active span would contain noop or some other span which is not the receive span, thus future child spans will be scoped improperly.
I hope it is clear, and feel free to refactor the test so it better communicate it's intent. We can maybe create a new span in the callback and assert child-parent relationships, or we can just compare the active span id in the callback with the test span? I hope I don't miss anything there.

2. Still unsure about how/why this issue did not present itself earlier. The implementations for adding the MESSAGING_OPERATION attribute and the unit tests have not had any recent changes, and I am not yet sure about the correlation between the @aws-sdk/client-sqs version bump and this test failure.

To me the immediate suspect is this S3 create bucket which seems unrelated. I would add a breakpoint and trace the stack to follow it's roots.
Feel free to ping me in slack to research together.

I opened #1711 to disable this test temporarily.
Otherwise, it's very hard to see if other test-all-versions scripts are failing.
If the PR merges, we'll need to remove the skip() once the problem is resovled.

I have been looking at this a little bit. I don't have a fix yet, however.
Also, see https://github.com/open-telemetry/opentelemetry-js-contrib/pull/1838#issuecomment-1834359339 about a different test failure with more recent versions of @aws-sdk/client-sqs.
-- required packages ["<EMAIL_ADDRESS>-- installing ["<EMAIL_ADDRESS>-- running test "npm run test" with @aws-sdk/client-sqs (env: {})
...
  3 failing

  1) instrumentation-aws-sdk-v3
       custom service behavior
         SQS
           sqs send add messaging attributes:
     SyntaxError: Unexpected token < in JSON at position 0
  Deserialization error: to see the raw response, inspect the hidden field {error}.$response on this object.
      at JSON.parse (<anonymous>)
      at /home/runner/work/opentelemetry-js-contrib/opentelemetry-js-contrib/node_modules/@aws-sdk/client-sqs/dist-cjs/protocols/Aws_json1_0.js:1980:21
      at processTicksAndRejections (internal/process/task_queues.js:95:5)

That failure, I believe, is because a recent-ish version of client-sqs changed the internal protocol used with the SQS service to one that expects JSON payload responses. A write-up of a similar failure against Elastic's APM agent tests here: https://github.com/elastic/apm-agent-nodejs/issues/3324#issuecomment-1536622759

I believe I understand the issue with the v3.316.0 failure now, but I'm not sure how easily it can be fixed. I'll try to explain, and then I have a question about whether we even want to support this. (/cc @blumamir)
the feature that is broken
The aws-sdk instrumentation has special handling for SQS ReceiveMessage described here: https://github.com/open-telemetry/opentelemetry-js-contrib/blob/main/plugins/node/opentelemetry-instrumentation-aws-sdk/doc/sqs.md#receivemessage
One of the items from that doc:

Sets the inter process context correctly, so that additional spans created through the process will be linked to parent spans correctly.
This behavior is partially implemented, see discussion below.

What this means is that the instrumentation attempts to make it so:
sqsClient.receiveMessage(params).then(res => {
  // ...the current span context in here is the ReceiveMessage span.
});

The way that is done currently is by shimming the .then on some of the promises in the code path:

using bindPromise: https://github.com/open-telemetry/opentelemetry-js-contrib/blob/fb807835e9317891e6f18715e708e9993b8797d8/plugins/node/opentelemetry-instrumentation-aws-sdk/src/aws-sdk.ts#L579-L581
bindPromise implementation: https://github.com/open-telemetry/opentelemetry-js-contrib/blob/fb807835e9317891e6f18715e708e9993b8797d8/plugins/node/opentelemetry-instrumentation-aws-sdk/src/utils.ts#L72-L95

the reason for breakage
This broke in<EMAIL_ADDRESS>when the SQS class methods became async functions. Effectively the SQS class changed from (heavily simplified from https://github.com/aws/aws-sdk-js-v3/pull/4639):
class SQS extends SQSClient {
  receiveMessage(args, optionsOrCb, cb) {
    const command = new ReceiveMessageCommand_1.ReceiveMessageCommand(args);
    return this.send(command, optionsOrCb);
  }

to this:
class SQS extends SQSClient {
  async receiveMessage(args, optionsOrCb, cb) {
    const command = new ReceiveMessageCommand_1.ReceiveMessageCommand(args);
    return this.send(command, optionsOrCb);
  }

The current bindPromise usage is not wrapping the return value of SQS.receiveMessage, but instead some internal promises in aws-sdk@3 "middleware stack". The additional promise from this now-async receiveMessage breaks that context binding.
possible fix
A possible fix might be (I haven't tried this) to explicitly wrap that sqsClient.receiveMessage() method, then shim the .then on its returned promise.  ReceiveMessage is the only method with this special handling, so there would not be a need to wrap every API method on the SQS class.
However, IIUC, there will always be possible context loss around some async/await usage patterns. This is mentioned in the "sqs.md" doc:

If async/await is used, context can be lost when returning data from async functions

Also, tests for this for aws-sdk v2 are skipped (and have always been, I believe):
https://github.com/open-telemetry/opentelemetry-js-contrib/blob/fb807835e9317891e6f18715e708e9993b8797d8/plugins/node/opentelemetry-instrumentation-aws-sdk/test/sqs.test.ts#L136-L162
Discussion: do we want to support this?
There are two special handling things being done by SQS ReceiveMessage instrumentation:

attempting to propagate the span context to the message processing code (what this issue is about); and
attempting to create "processing" spans for the handling of each message in a batch.

The latter is attempted by monkey-patching the forEach, map, and filter methods on the returned response.Messages array. So this code produces a "processing" span for each message:
sqs.receiveMessage(...).then(res => {
  res.Messages.forEach(msg => {
    console.log('one message is', msg);
  });
});

I say "attempted" because the instrumentation is necessarily limited. This does not produce processing spans:
sqs.receiveMessage(...).then(res => {
  for (let msg of res.Messages) {
    console.log('one message is', msg);
  };
});

There is already a (very old) discussion issue for this: https://github.com/open-telemetry/opentelemetry-js-contrib/issues/707
The current last comment mentions a bad user outcome when (2) works, but (1) fails:

I am using forEach and inside it, using a setTimeout. Its causing the spans to be nested with one root span having 10000+ spans for receiving messages.

I understand the desire to try to implement the OTel message spec guidelines to create processing spans automatically. However, I think the limited ability to do so in JavaScript results in surprising behaviour such that we might want to consider not doing this limited special handling at all. This would be a breaking change.
Actually, just looking at the OTel Messaging spec (https://opentelemetry.io/docs/specs/semconv/messaging/messaging-spans/) now, has guidance for "processing" spans been dropped? Compare https://opentelemetry.io/docs/specs/semconv/messaging/messaging-spans/#batch-receiving to the older v1.20.0 equivalent: https://github.com/open-telemetry/opentelemetry-specification/blob/v1.20.0/specification/trace/semantic_conventions/messaging.md#batch-processing
The current spec doesn't mention "processing" spans anymore.

I opened #1711 to disable this test temporarily.

The "fix" or removal of the feature (see previous comment) isn't going to be a quick thing. I think in the interim we should disable this particular test. I believe we can skip just this test block:
it('sqs receive add messaging attributes and context',

this would be slight change to #1711.  @pichlermarc Would you object to a change pushed to your #1711 to disable just the smaller part of aws-sdk-v3.test.ts that is failing?

@pichlermarc Would you object to a change pushed to your #1711 to disable just the smaller part of aws-sdk-v3.test.ts that is failing?

I don't have permissions to push to your branch, so I created https://github.com/open-telemetry/opentelemetry-js-contrib/pull/1847 as an alternative.

@pichlermarc Would you object to a change pushed to your #1711 to disable just the smaller part of aws-sdk-v3.test.ts that is failing?

I don't have permissions to push to your branch, so I created #1847 as an alternative.

Ah, yes that's not possible with organization forks. :/
Looks like I was too late here - I'll close my old PR - splitting it and only skipping the part that's failing is better :slightly_smiling_face:


Bad progressive decode of transcoded jpeg.

Describe the bug
Progressive decode of a lossless transcode of chroma subsampled jpeg does not render correctly.
LQIP is gray, MQIP's chroma is at its original subsampled size.
To Reproduce
Progressively load attached files:
4:2:0

4:2:2

(renamed to .jpg to upload to github)
Expected behavior
Image used here is a transcode of 4:4:4 jpeg

Screenshots
4:2:0 at 50/384 kb

4:2:2 at 50/381 kb

Environment
Patched Firefox on libjxl commit 702cd54420513b754edb60e33b9a4438f7e9ca00

I can also see this using the resampling option in djxl
Using this image as a source with these options: djxl.exe .\flower_foveon.png.im_q85_420.jxl -s 8 .\flower_foveon.png.im_q85_420.jxl.png results in this output.


feat(cyphergraph-exporter): import from playground

Also make some adaptations

Welcome to Codecov :tada:
Once you merge this PR into your default branch, you're all set! Codecov will compare coverage reports and display results in all future pull requests.
Thanks for integrating Codecov - We've got you covered :open_umbrella:


Fix - JSON parsing of Consent Requests/Responses

Original issue in tiki-sdk-ios:
In the example app, the TikiSdkConsent shows the same value for `path` and `uses` in the destination. I

Acceptance criteria:
1 -  The HTTP method is in `uses` and the URL without schema in `path`.

Updated issue added in https://github.com/tiki/tiki-sdk-flutter/issues/150#issuecomment-1422597698
When decoding JSON to TikiSdkDestination in the ReqConsent* classes, the paths are been used in place of the uses.
A similar issue was fixed before in https://github.com/tiki/tiki-sdk-flutter/issues/102#issuecomment-1360199148.
Acceptance criteria:
1 - All Req/Rsp Consent classes correctly parse JSON
2 - add tests to integration_test/tiki_sdk_flutter_platform_test.dart with specific paths and uses for methods modifyConsent, getConsent and applyConsent.

We have to change the decoding:
From this : List? uses = map["destination"]?["paths"];
to this: List? uses = map["destination"]?["uses"];
in all the files where the decoding of paths is assigned to uses

We have to change the decoding:
From this : List? uses = map["destination"]?["paths"]; to this: List? uses = map["destination"]?["uses"];
in all the files where the decoding of paths is assigned to uses. Is this what we have to do?

yes, that's the fix.
To test the different types of uses and paths, you could copy the getConsent and applyConsent tests for the following scenarios:
1 - getConsent: use TikiSdkDestination(["path/to/test"], uses: ["use case to test"]) instead of TikiSdkDestination.all() in modifyConsent method and check if the return of getConsent gives the same path and use case.
2 - applyConsent: use TikiSdkDestination(["path/to/test"], uses: ["use case to test"]) instead of TikiSdkDestination.all() in modifyConsentmethod and use applyConsent to check if it matches.

@ricardobrg What kind of values should I be taking for uses list in TikiSdkDestination?

@Harshit933

What kind of values should I be taking for uses list in TikiSdkDestination?
You can create them locally in the tests. Doesn't need to be a field in the class. But if you rather do that, it's ok too. You choose.
Also I have corrected all the paths and uses conflicts which were there in the req and res classes should I make the PR?
Sure! Please do the PR when you are done. If you still want to work on the code you can create the PR as a draft and I will review when you are done. Please, add me as a reviewer in the PR. Thanks!

Created the PR. Please review it and let me know which things are needed to be changed


Topic promises section enhancement

[ ] Promises should be replaced with supports which not includes the fund from the initial fund when topic created.
[ ] There should be a icon on which when we hover it shows a tooltip: "Additional fund promises besides the original promise from OP"
[ ] The funder should be shown on the support record.

Figma link

Preview

Figma link

If there is no supporter, show placeholder

Preview


1.11 is not posting image urls from slack

Describe the bug
When I paste an image or upload a file on the slack side, only the "comment" shows up on the discord side, and if there's no comment -- there's no message at all
To Reproduce
Steps to reproduce the behavior:

Configure discord or IRC
Configure slack with a token
Post an image on the slack side without a comment

... nothing happens on slack.
Expected behavior
We used to get slack image URLs (with a space missing) that had to be clicked and you needed a login, but at least we'd know someone had posted an image and could tell them to use imgur instead.
Config Example
[general]
RemoteNickFormat="{NICK} ({LABEL})"
EditSuffix=" (edited)"
IconURL="https://robohash.org/{NICK}.png?set=set4"
ReplaceMessages=[ ["@everyone","~everyone"], ["@here","~here"] ]

[discord]
    [discord.powershell]
    Label="discord"
    Token="..."
    Server="PowerShell"

[slack]
    [slack.powershell]
    Label="ps"
    Token="xoxb-..."
[irc]
    [irc.freenode]
    Label="irc"
    Server="irc.freenode.net:7000"
    UseTLS=true
    Nick="bifrost"
    UseSASL=true
    NickServNick="bifrost"
    NickServPassword="..."
    ColorNicks=true
    RemoteNickFormat="({PROTOCOL}) <{NOPINGNICK}> "
    EditDisable=true

[[gateway]]
name="bridge"
enable=true

    [[gateway.inout]]
    account="slack.powershell"
    channel="bridge"

    [[gateway.inout]]
    account="irc.freenode"
    channel="#PowerShell"

    [[gateway.inout]]
    account="discord.powershell"
    channel="bridge"
        [gateway.inout.options]
        webhookurl="https://discordapp.com/api/webhooks/...."

Thanks for your hard work!


When using domxss attack payload, the plug-in is not recognized

Hi, kind regards, when using domxss attack payload, the plugin does not recognize

Hi @laowang1026 !
That's not a DOM XSS issue:

https://owasp.org/www-community/attacks/DOM_Based_XSS

But you can solve this, you can change "Match Type" to Simple String, because your payload it's not a regex.
Thanks! :)


chore: remove the pod group

for now, we didnt need the pod group, we can use resourcebinding to managet hte tasks, and implement the worklaod interface, we can supports more resource like deployment

It's better to add ut: )


Cannot initialize a variable of type 'PTExampleTextFrame *' (aka '_PTExampleTextFrame *') with an rvalue of type 'void *'

Example for iOS works ok, but when I'm trying to use libs in my own project (swift version with objective-c++ .mm classes bridges) I get next error:
Cannot initialize a variable of type 'PTExampleTextFrame *' (aka '_PTExampleTextFrame *') with an rvalue of type 'void *'
in this function (Peertalk Example) PTExampleProtocol.h
also this header file for Mac target/project, so does why iOS target/project reference to it?
static dispatch_data_t PTExampleTextDispatchDataWithString(NSString *message) {
  // Use a custom struct
  const char *utf8text = [message cStringUsingEncoding:NSUTF8StringEncoding];
  size_t length = strlen(utf8text);
  //CFAllocatorAllocate(nil, 1 + length, 0);
  PTExampleTextFrame *textFrame = CFAllocatorAllocate(nil, sizeof(PTExampleTextFrame) + length, 0);
  memcpy(textFrame->utf8text, utf8text, length); // Copy bytes to utf8text array
  textFrame->length = htonl(length); // Convert integer to network byte order

  // Wrap the textFrame in a dispatch data object
  return dispatch_data_create((const void*)textFrame, sizeof(PTExampleTextFrame)+length, nil, ^{
    CFAllocatorDeallocate(nil, textFrame);
  });

CFAllocatorAllocate returns a value of type void, which can't be assigned to PTExampleTextFrame as its a struct (thats exactly what the error says)
As a quick'n'dirty solution just cast the returned value of the CFAllocatorAllocate as type (struct _PTExampleTextFrame)
So replace this:
PTExampleTextFrame *textFrame = CFAllocatorAllocate(nil, sizeof(PTExampleTextFrame) + length, 0);
  memcpy(textFrame->utf8text, utf8text, length);

with
PTExampleTextFrame *textFrame = (struct _PTExampleTextFrame*) CFAllocatorAllocate(NULL, sizeof(PTExampleTextFrame) + length, 0);


Microsoft Teams - re-authenticaton required after re-opening the app

Describe the bug
When re-opening the app, re-authentication is required against Microsoft Teams.
To Reproduce
Steps to reproduce the behavior:

Go to a Microsoft Teams workspace and sign in
Close Franz
Open Franz
Go back to the same Microsoft Teams workspace

Expected behavior
The session against Microsoft Teams should still be active
Actual behavior
Prompted for credentials
Desktop (please complete the following information):

OS: Windows 10 (1903)
Version: 5.1.0

Additional info
I have 3 Teams services added, one using a Microsoft account and two using Azure AD accounts. The issue seems to occur only for the two which uses Azure AD accounts.

It's also the same issue with Outlook

For me the issue only started after I changed my password for both services. In the past it was necessary to re-add the service after a password change, but this time that didn't work either.


[Map] DM-DiningRoom

Hash: 1a17743147f2f6bcb21a6670c77d2ffd5d2af935
Current name: DM-DiningRoom
The author of this map, according to the readme, is Madness
Real name = Noah Obringer
Description = A model of my Dining Room

Actually the author's name in the LevelInfo is Noah (Madness) Obringer
No idea where the author name, title and description under Map Information have come from - the title in the LevelInfo is Dining Room.
So no mention of Coret or Alan Willard anywhere in the LevelInfo or readme - something has obviously gone wrong when parsing this map?


I cannot find where is defined in the whole code.
I know @josevalim this is not a bug and should not be, but I also think that I cannot ask this question on stakeoverflow:)
Forgive me:)

email_changed? is defined by the ActiveModel::Dirty API, and the method is defined dynamically when there is an email column in your model.

Thank you...Honestly I googled it, but didn't come out nothing about dirty:(
On Fri, Jan 16, 2015 at 8:14 PM, Lucas Mazza<EMAIL_ADDRESS>wrote:

Closed #3426 https://github.com/plataformatec/devise/issues/3426.
—
Reply to this email directly or view it on GitHub
https://github.com/plataformatec/devise/issues/3426#event-220435600.


VEGA-2309 Fix error on search page when person has no cases #minor

Checklist

[X] I have updated the end-to-end tests to work with my changes
[ ] I have added styling for Dark Mode
[ ] I have checked that my UI changes meet accessibility standards

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (a168c81) 76.37% compared to head (95301d0) 76.37%.

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #476   +/-   ##
=======================================
  Coverage   76.37%   76.37%
=======================================
  Files         104      104
  Lines        3331     3331
=======================================
  Hits         2544     2544
  Misses        483      483
  Partials      304      304

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Fix nullptr dereference on QUIC connection

[approve ci clang-analyzer]

Fixed h3 from crashing, but it looks like there is an issue with clang-analyzer


Remove Export Services for Geneva Release

Remove export-client and export-distro code (edgex-go) and related (developer-scripts, blackbox-testing).

Reopened; https://github.com/edgexfoundry/edgex-docs/issues/59 must still be completed.

Hey, I was just troubleshooting the mysterical disappearence of the export service mentioned in the docs

https://docs.edgexfoundry.org/1.2/walk-through/Ch-WalkthroughExporting/

Does that mean that edgex currently has no means of exporting data to external services?

Hey, I was just troubleshooting the mysterical disappearence of the export service mentioned in the docs

https://docs.edgexfoundry.org/1.2/walk-through/Ch-WalkthroughExporting/

Does that mean that edgex currently has no means of exporting data to external services?

I'm no longer directly involved with EdgeX.  You may be able to resolve this question by contacting @jpwhitemn.

@michaelkargl - export services have been deprecated with the Geneva release.  We are slowly updating the docs.  The new replacement is application services (with the app functions SDK to help you build new ones or use the app-service-configurable if you can get by with just configuration).  You can find these links to start to learn more
https://docs.edgexfoundry.org/1.2/getting-started/quick-start/#exporting-data
https://docs.edgexfoundry.org/1.2/microservices/application/ApplicationServices/
https://docs.edgexfoundry.org/1.2/microservices/application/AppServiceConfigurable/
https://docs.edgexfoundry.org/1.2/examples/AppServiceExamples/
https://docs.edgexfoundry.org/1.2/getting-started/ApplicationFunctionsSDK/


How to implement custom authentication using only Mobile Number, AWS Cognito

Hi,
I would like to implement user login using just mobile number (password less).
Could you please advice how I could achieve this.
I am specifically looking for sample code for iOS swift or at least guidance on this.
Signin/Signup flow

User submits his mobile number
User will receive pass code
Upon entering the passcode, the user shall be signed in

I am basically looking for an iOS swift equivalent of the Mobile Number SignIn Javascript code shown
in this AWS re:Invent event (Relevant screen shots are below)
Client side Javascript code for Mobile Number SignIn.

I am having the same issue as well,
@victorleungtw the link you've posted is expired, can you please give the example code to login from mobile number..?

FYI user.getSession is giving an error with code=20 message="invalid pass or username"

Hi @victorleungtw,
I am facing the same issue while sign in with mobile number using custom challenge.
Can you please provide any sample regarding this?

@aditikarandikar @moosabaloch   Please checkout the updated link here: https://medium.com/@victorleungtw/aws-cognito-user-pools-with-mobile-sdk-for-ios-using-custom-challenge-df2c3b163d3d

Hello @pravishanth, sorry for the delay. Do you still need help with the issue?


Restart TS server command not available in PR diffs

It seems you have to be on a TS file, but it would be nice to be able to restart the TS server independent of any file or lack of file that you're on.

The restriction was added intentionally, I hit this rarely and it not being there for json a lot personally.

I guess my concern is that independent of what file I'm on I may have red tabs or errors throughout my codebase because the TS Language Server needs to be restarted, so hunting down a random ts file to restart the server seems odd in that scenario.

Duplicate of #201734


Extension should use one of the pre-existing categories

Otherwise they won't be listed in code.quarkus.io

Thanks @gastaldi - so this needs a new release to be avaliable on quarkus catalog?

@zhfeng yes, changing an extension's metadata manually is not yet integrated (it's introduced in https://github.com/quarkusio/registry.quarkus.io/pull/92/)

OK, I will take care of a new release later.


Support for negative prompts

Does AudioSep have the potential to support negative prompts?

What does the negative prompts mean? :)

For example:
Prompt: "voice and whistle, no wind or rumble"
From this:
Positive prompt: "voice and whistle"
Negative prompt: "no wind or rumble"
I have found the model has a hard time understanding sounds sometimes, so I was wondering if you could add a negative prompt to further guide it toward what you wanted to separate.


Safetensor file extension recognition

Hi, I was wondering if the programme can read files with .safetensors extensions rn it's saying when I try to load a model.safetensors file that it needs it in another format

If the model you want to use has safetensors weights on its huggingface space, it will by default use the safetensors weights if the model is loaded in a conventional way as done here. You can see https://huggingface.co/docs/diffusers/using-diffusers/using_safetensors for more details.


deactivate widget when navigating to another screen

When new route navigation is opened, such as new screen, the webview_win_floating floating widget is still staying on top of everything. I'm looking for a way to deactivate it when widget goes off screen and restore it back when you go back to the screen with the floating webview widget.

As I mentioned in README, the webview always show on top of all other widgets. This is limitation of this package.
To hide the webview, you can try to make the layout (i.e. left / top / width/ height ) of WebViewWidgetbe out of screen, such as make width / height = 0 , position out of screen , or replace WebViewWidget with Container().
// hide webview
await Navigator.push();  // wait until new screen popped
// show webview

I wonder if that boilerplate code could be avoided with WebView widget handling something like reassemble() callback.
There is a similar/related issue. When you make a hot reload while running windows app under debugger while floating webview is shown. The web view is not being disposed and still shown after the hot reload, even that navigation and entire widget tree is completely reset.

I wonder if that boilerplate code could be avoided with WebView widget handling something like reassemble() callback.

I don't understand about this. Could you please explain with more details ?
About disposing all old webviews when hot-reload,
I fix it and push new version 2.2.5
Please try again with new version.


adding a StrictBooleanConverter

You may not want this, but this is the converter that I ended up using.  (See #76 )
Matches true, false, t, f or any variant capitalization of those.

I'm glad this met your needs, but I don't think it belongs in the library. When in doubt, leave it out.

No problem. Thanks for the library.


generate ci subcommand

This can be cut from the milestone but I think it would be Killer if you could do something like:
cargo dist init github-ci

And it just creates .github/ci/cargo-dist.yml or whatever.
However this raises questions about the Scope of cargo-dist's functionality and what the action would cover:

What would the action react to? (presumably: pushing a tag with vBlah ala)
Would it create a github release? (https://github.com/taiki-e/create-gh-release-action)
Would it push packages to a github release (or elsewhere?) (https://github.com/taiki-e/upload-rust-binary-action)

Or is this stuff more in scope for "the axo cli"?
One possible reason to want cargo-dist to be in the loop for ci declaration is for #19.

You can either do cargo dist init --ci=github at first setup or cargo dist generate-ci github to do it later


Built-in RS232 on P7 not working on iot-gate-imx8

The RS232 port on the back of the iot-gate-imx8 is not working in loopback mode.

Fixed in 2.98.33


RUM-1517 create Stub Core module

What does this PR do?
Because AndroidStudio doesn't deal well with testFixtures source sets, the Stubbed SDKCore (and linked classes) were moved to an independent module which allows code completion and make the IDE happy.

Codecov Report

Merging #1740 (46d11d7) into develop (7845f86) will decrease coverage by 0.00%.
Report is 6 commits behind head on develop.
The diff coverage is n/a.

Additional details and impacted files
@@             Coverage Diff             @@
##           develop    #1740      +/-   ##
===========================================
- Coverage    83.36%   83.35%   -0.00%
===========================================
  Files          465      465
  Lines        16182    16179       -3
  Branches      2412     2411       -1
===========================================
- Hits         13489    13486       -3
+ Misses        2033     2027       -6
- Partials       660      666       +6

see 21 files with indirect coverage changes


pathfinding to emulate relastic walking

Intended use is to exploit everything the vanilla (and maybe popular implementations like Bukkit, Spigot) protocol allows.

This would actually make sense in a far future. But then again, everything on this list should be considered as well.

Just want to add this link to the NCP permission docs.

Physics are done in SpockBot. Moving to Tasks milestone.


Crashing on Fabric 0.14.24 (GDLauncher)

[11:58:21] [main/INFO]: Loading Minecraft 1.20.1 with Fabric Loader 0.14.24
[11:58:21] [main/INFO]: Loading 6 mods:
- fabricloader 0.14.24
- java 17
- minecraft 1.20.1
- mod-loading-screen 1.0.4
|-- com_formdev_flatlaf 3.0
-- net_lenni0451_reflect 1.0.2
[11:58:21] [main/INFO]: SpongePowered MIXIN Subsystem Version=0.8.5 Source=file:/C:/Users/petec/AppData/Roaming/gdlauncher_next/datastore/libraries/net/fabricmc/sponge-mixin/0.12.5+mixin.0.8.5/sponge-mixin-0.12.5+mixin.0.8.5.jar Service=Knot/Fabric Env=CLIENT

Please send your entire log.

latest.log

Without Fabric API
latest.log
With Fabric API
latest.log

So it just exits?

yes

And it has worked fine in the past

Can you use the latest build from GitHub Actions, then send me the .cache folder from inside your .minecraft?

fabric.zip

That is not what I asked you to send

It's probably bad file naming on my part, but the zip file contains the .cache and the logs folder, nothing more

My bad, my device was interpreting .cache as hidden, so I couldn't see it. There is a new build available that will log even more debug info. Can you download that version and send me the .cache folder after using it?

cache.zip
this is using the latest commit under Actions (Log exceptions to file)

Can you try with the latest build and send a screenshot of the error?

It still didn't give an error with the latest build, it just didn't start like before.
However i tried downloading the stadard minecraft launcher and making a fabric instancce in that, and it worked with no issue
Then after looking i around in GDLauncher settings i found and tried changing a setting which seemed to fix the issue
Setting the startup method to "Symlink" instead of "Default" fixed the issue

Does this issue happen with 0.14.24 specifically, or does it happen on older Fabric versions with the latest version of Mod Loading Screen?

it also happen on 0.14.23 and i just tried with 0.14.13 as a random pick and it has the same behavior as the other versions
This is with "Startup Method" is set to "Default", so i think it's a GDLauncher compatibility thing, as it works fine when i set it to "Symlink"


add to MRU history only after releasing ctrl (native)

If I want to e.g. go to 5th tab by using native's ctrl-tab so that it doesn't invoke the tab-list (which is distracting to me), it's not possible if reorder option is on, since the tab is added to MRU history after first ctrl-tab, thus reordering it immediately afterwards.
The behavior then is

infinitely cycling between the two (if Atom MRU is disabled)
MRU cycling (if Atom MRU enabled) -- which again isn't what I want.

In other words, what I want is to be able to use Atom native ctrl-tab to linearly move to nth-tab, without invoking the tab-switcher's tab-list.
End goal being using the native tab-bar as a tab-list when switching, instead of using the tab-switcher's -- best of both worlds IMO.

If you find the tab-list distracting, then I'm not sure you actually want tab-switcher.
Would it be enough to just hook into the command that runs when you release ctrl to move the tab to the left?
atom.commands.add 'atom-workspace',
  'pane:move-active-item-to-top-of-stack': ->
    pane = atom.workspace.getActivePane()
    item = pane.getActiveItem()
    pane.moveItem(item, 0)


Error to register through REST API

I have error when making registration through POST request to /api/v1/auth/registration/ which says NoReverseMatch at /api/v1/auth/registration/. 'users' is not a registered namespace.
In my urls.py:
url(r'^api/v1/auth/', include('rest_auth.urls')),
url(r'^api/v1/auth/registration/', include('rest_auth.registration.urls')),

In my settings:
# APP CONFIGURATION
# ------------------------------------------------------------------------------
DJANGO_APPS = (
    # Default Django apps:
    'django.contrib.auth',
    'django.contrib.contenttypes',
    'django.contrib.sessions',
    'django.contrib.sites',
    'django.contrib.messages',
    'django.contrib.staticfiles',

    # Useful template tags:
    # 'django.contrib.humanize',

    # Admin
    'django.contrib.admin',
)
THIRD_PARTY_APPS = (
    'crispy_forms',  # Form layouts
    'allauth',  # registration
    'allauth.account',  # registration
    'allauth.socialaccount',  # registration
    'allauth.socialaccount.providers.facebook',
    'allauth.socialaccount.providers.linkedin_oauth2',
    'rest_framework',
    'rest_framework.authtoken',
    'rest_auth',
    'rest_auth.registration',
)

# Apps specific for this project go here.
LOCAL_APPS = (
    # custom users app
    'myapp.users.apps.UsersConfig',
    # Your stuff: custom apps go here
)

# See: https://docs.djangoproject.com/en/dev/ref/settings/#installed-apps
INSTALLED_APPS = DJANGO_APPS + THIRD_PARTY_APPS + LOCAL_APPS

Sorry, it was my error. I forgot to provide namespace for User urls like: url(r'^users/', include('myapp.users.urls', namespace='users')),. After I received another error which occurred because my routing for user details was done by username, therefore I commented line # ACCOUNT_USER_MODEL_USERNAME_FIELD = None.


Major refactor of attribute handling, test and diagnostic improvements

In doing this refactoring, I also:

Fixed a bug causing nested items to be generated when they should not have been.
Fixed a small oversight in the Strings package revealed by the fix above.
Added a test case for handling "overload style" renames, while investigating the previous item.
Added a better diagnostic for the problem mentioned in this comment.

Added a better diagnostic for the problem mentioned in this comment.

For the record, I managed to reproduce the issue you were having (I think) with this test code:
#[export_fn(return_raw)]
pub fn test_fn(input: Point) -> bool /* wrong return type */ {
    input.x > input.y
}

fn main() {
    let n = Point {
        x: 0.0,
        y: 10.0,
    };
    if test_fn(n) {
        println!("yes");
    } else {
        println!("no");
    }
}

After adding a diagnostic test and fixing the issue as best I could, this is now the output on stable Rust:
error[E0308]: mismatched types
  --> $DIR/export_fn_raw_return.rs:10:8
   |
9  | #[export_fn(return_raw)]
   | ------------------------ expected `std::result::Result<rhai::any::Dynamic, std::boxed::Box<rhai::result::EvalAltResult>>` because of return type
10 | pub fn test_fn(input: Point) -> bool {
   |        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ expected enum `std::result::Result`, found `bool`
   |
   = note: expected enum `std::result::Result<rhai::any::Dynamic, std::boxed::Box<rhai::result::EvalAltResult>>`
              found type `bool`

error[E0308]: mismatched types
  --> $DIR/export_fn_raw_return.rs:10:33
   |
9  | #[export_fn(return_raw)]
   | ------------------------ expected `std::result::Result<rhai::any::Dynamic, std::boxed::Box<rhai::result::EvalAltResult>>` because of return type
10 | pub fn test_fn(input: Point) -> bool {
   |                                 ^^^^ expected enum `std::result::Result`, found `bool`
   |
   = note: expected enum `std::result::Result<rhai::any::Dynamic, std::boxed::Box<rhai::result::EvalAltResult>>`
              found type `bool`

It's a bit wordy, but hopefully should be clear.

After adding a diagnostic test and fixing the issue as best I could, this is now the output on stable Rust:

I think another case would be returning inconsistent types from two if branches:
if input.x > input.y {
    Ok(true.into())
} else {
    Ok(input.x.into())
}

OK, I tested the error diagnostics.
#[export_fn] successfully puts out an error for return_raw which does not return Result.
#[export_fn] functions have good error diagnostics.
#[export_module] functions do not highlight return_raw errors, not do they highlight interior errors.
Therefore, it seems like we're still missing error position info for modules.

Therefore, it seems like we're still missing error position info for modules.

Hmm. That is a bit of a surprise, but then again, I didn't write a separate test for it.
I will fix this.


problems with validation for jetbrains gateway module folder

The error message is:
Error: Invalid value for variable
on main.tf line 248, in module "jetbrains_gateway":
  248:   folder         = "/home/coder/${local.folder_name}"
    ├────────────────
    │ var.folder is "/home/coder/foo/"
The folder must be a full path and must not start with a ~.
This was checked by the validation rule at .terraform/modules/jetbrains_gateway/main.tf:29,3-13.

The hcl is
locals {
    base_name = try(element(split("/", data.coder_parameter.git_repo.value), length(split("/", data.coder_parameter.git_repo.value)) - 1), "project/")
    #folder_name = try(local.base_name, "project/")
    folder_name = "foo/"

}
}
module "jetbrains_gateway" {
  source         = "registry.coder.com/modules/jetbrains-gateway/coder"
  version        = "1.0.13"
  agent_id       = coder_agent.main.id
  agent_name     =  "main"
  folder         = "/home/coder/${local.folder_name}"
  jetbrains_ides = ["PS", "GO", "IU", "PY", "WS"]
  default        = "PS"
}

i guessed there is a problem with the evaluation of folder_name and so i tried to set on the foldername directly.
BR
Sebastian

@Forestsoft-de the current regex at
https://github.com/coder/modules/blob/dcd605c52efedbb09ac718968e2eeb11f8a1d80a/jetbrains-gateway/main.tf#L30
Does not accept a trailing /. That's why it's failing for you. We should allow accepting / as the last character for the folder

I am running into the same issue when it comes cases where you only no the folder name of the project (like after doing the initial git clone) and you want to open it in Jetbrians later one.


Feature/fill both auction sides

Now bots will ensure sell liquidity in both auction sides

Pull Request Test Coverage Report for Build 948

7 of 7 (100.0%)  changed or added relevant lines in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.05%) to 49.925%

Totals

Change from base Build 945:
0.05%

Covered Lines:
1633

Relevant Lines:
3060

💛  - Coveralls


Optimizer now simplifies multiplication, division, module arg is a literal Decimal zero or one

…
Which issue does this PR close?
Closes #3643.
Rationale for this change
To improve expression simplification efficiency.
What changes are included in this PR?
Are there any user-facing changes?
No user-facing changes are expected.

Looks great to me -- thank you @drrtuy
@liukun4515 can you please confirm this is ok with you as well?

Thanks @alamb  I will take a look this issue and pr  tomorrow.

I took the liberty of resolving the conflict in 47a13f5

I took the liberty of resolving the conflict in 47a13f5

Much appreciated.

I plan to merge this PR when CI passes (we are a bit backed up now)

Thanks again @drrtuy and @isidentical  and @liukun4515 for the discussion and review


about Chinese translation

vis-network is a great library.
so I made a Chinese translation (first version), although there are some translation errors, but help me put it into awesome-visjs or other, let us improve it together:
this is the link
github link 。
I will continue to update it, thank you!

Hi @aimeiyijia,
I don't understand a word but otherwise it looks great. I see your using Vuepress, I would actually like to have all the docs in Vuepress. Would you have the time to help with that? We could then have all the docs in the same style here which would be great. I think it would also make maintaining it much easier. Otherwise we can just link your docs from here.
Thanks for your work either way.

I meant that I don't understand a word in Chinese, otherwise I understand.

@Thomaash  Can you put the Chinese document in a place where others can find it？

Sure, I'll put a link into the official docs. What flag should I use?

Whatever you want


Update repository URL

Active development is returning to the Conveyal organization repo (see #276). As such, we need to update the repo URL in order for automated releases to work correctly.

Codecov Report

Merging #278 into dev will not change coverage.
The diff coverage is n/a.

@@          Coverage Diff          @@
##             dev    #278   +/-   ##
=====================================
  Coverage   5.23%   5.23%
=====================================
  Files        324     324
  Lines      15405   15405
  Branches    4649    4649
=====================================
  Hits         806     806
  Misses     12449   12449
  Partials    2150    2150

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 772ca83...273c17b. Read the comment docs.

:tada: This PR is included in version 4.1.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Long processing time

The transformation process of a large dataset can take up a looong time (ANDB dataset >2 hours).
This issue is extracted from Issue #108 opened by @MiconSchorsij

Surprisingly, COW is pretty darn fast when it comes to handling large datasets. But large datasets, containing a large number of transformations, will just take a lot of processing time. Especially on user-computers. We recommend running COW on a server to speed up this process.

Question: how can I use CoW on a server? I would like to try that.

Not sure how you useful this is, but the shopping list would be:

buy a server or get some server space (e.g. via amazon);
install python3 if not already
get going with cow! see this new quick tutorial


Typescript

➕ New abbr
Criteria

Not an acronym (e.g. RAM, CPU, SQL) or a conventions (e.g. i, j, k).
Lowercase
Singular and neutral form.
Max 1 🟢 abbr

Typescript • 🟢 ts

Pros

In the list, there's Javascript • js

Cons

[x] I can handle the following pr related to this issue to add the new abbr.

It's really the de facto abbreviation for TypeScript so I'm ok with that.

Added in #50


Revert "Update breadcrumbs to new styling (#131) (#379)"

This reverts commit 70c12b02551ff0505efd64fb754e8b390e92c980.
Description
This PR is ready to go in case we need to revert breadcrumbs for 1.2. If we can get a fix for #771 in for 1.2, this PR will be closed. If not, we'll merge this PR and schedule breadcrumbs for next release.
Check List

[ ] New functionality includes testing.
[ ] New functionality has been documented.
[x] All tests pass

[x] yarn lint
[x] yarn test-unit

[x] Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Fixed in #778


Crandall - Improve efficiency of biosample_complete.sh when retrieving identical lineages more than once

Within a single run, we should be able to avoid duplicate requests to retrieve the same lineage.

https://github.com/FDA-ARGOS/data.argosdb/blob/main/lib/get_linage.py

I was thinking of modifying this so that in the data_files we maintained the lineage of all of the sequences we have in the DB.  So with each release we can push an updated list if we need to.

please provide an update @kerchner

Closing this issue.  It is no longer needed because this script now merges lineage values from the ngsQC_HIVE metadata file (see #322).

@HadleyKing Is there, separately, still a value in maintaining a list of all lineages in data_files?  If so, that could be a new Issue.


Fix #107 : em and strong containing html link with _ inside

As mentioned in https://github.com/erusev/parsedown/issues/588#issuecomment-377221179, we can't really fix the core issue properly in a reasonable way. We could fix this one case, but it starts to become a bit of a slippery slope towards putting awareness about all inline elements and how they start and end into just this one element so that it knows how to skip over them (as mentioned in https://github.com/erusev/parsedown/issues/107#issuecomment-377276537).
Personally I think that in this instance, if we're not going to be compliant with the spec then it is better to be predictably non-compliant than to have a selection of special cases that work because we thought of them.
I hope you understand. Thank you nonetheless for taking the time to diagnose and write a patch here :)


Override header background color only when not set

Thanks for your contribution. It seems well 👍 ✅

This closes https://github.com/enisn/UraniumUI/issues/816


Support incremental annotation processing.

Addresses issue: #1225
With #1045, the support for incremental annotation processing is complete.
It would be really nice to see 9.0.0 released with this soon ;)
(let me know if I can help)

@stephanenicolas Are you sure, that ButterKnife can be considered "isolating"? It appears to analyze the autogenerated R classes under some circumstances (such as when used in library project), so at very least it should be "aggregating".
To make matters worse, it is currently using javac-internal APIs (JCTree) to locate R classes in packages, which makes it's compatibility with incremental processing somewhat questionable.

If it only looks at the R class because its constants are referenced by the annotated files, then that's fine, because as soon as R changes, the annotated class will be recompiled.
If a processor looked up R "out of the blue", with no connection to an annotated element (e.g. to decide whether to generated some class at all), then that would be a different story.
That being said, I haven't read the code deeply, I'm just using my user-facing understanding of BK.

The first commit looks good to me. I tested it locally and it seems to work well. Hopefully this will be the first incremental AP!

@stephanenicolas And did you test the speed improvements when butter knife supports incremental compile. My build currently takes several minutes, so I'm looking for this like salvation.

As Alexander pointed out, using com.sun.source.util.Trees or any other compiler-specific APIs may not work with incremental annotation processing. You may want to add some end-to-end tests that actually do some incremental builds using Gradle. You can use the Tooling API to invoke Gradle from your tests.

I made a few improvements to the processor in #1244 . They should help on top of the incremental ap logic. It may make the incremental logic even better as butterknife no longer looks at all fields in R2 classes

I see that in the ButterKnife repository is quite a lot of open pull requests.
Some of them more than year old.
I worry a little bit.

@stephanenicolas What is the status of this pull request?

I am not the one to ask.. :)
2018-04-18 4:13 GMT-07:00 Tomáš Procházka<EMAIL_ADDRESS>
@stephanenicolas https://github.com/stephanenicolas What is the status
of this pull request?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/JakeWharton/butterknife/pull/1230#issuecomment-382351563,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABv33b2mfMF17idpIsg0jPW6xy5SS1B3ks5tpx_VgaJpZM4S5yxk
.

Open
On Wed, Apr 18, 2018, 8:40 AM Stéphane Nicolas<EMAIL_ADDRESS>wrote:

I am not the one to ask.. :)
2018-04-18 4:13 GMT-07:00 Tomáš Procházka<EMAIL_ADDRESS>
@stephanenicolas https://github.com/stephanenicolas What is the status
of this pull request?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<
https://github.com/JakeWharton/butterknife/pull/1230#issuecomment-382351563
,
or mute the thread
<
https://github.com/notifications/unsubscribe-auth/ABv33b2mfMF17idpIsg0jPW6xy5SS1B3ks5tpx_VgaJpZM4S5yxk
.

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/JakeWharton/butterknife/pull/1230#issuecomment-382372395,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAEEEbLp3wb3irt2JnSIhXh1pWEq9s2sks5tpzRGgaJpZM4S5yxk
.

But there is merge conflict, which can fix only the author of the pull request.

I would really like to get some feedback, the PR has been open for a while
and I don't wanna rebase it every time master changes.
I am very open to do it, I just wanna make sure the PR has chances to get
accepted.
2018-04-19 4:06 GMT-07:00 Tomáš Procházka<EMAIL_ADDRESS>
But there is merge conflict, which can fix only the author of the pull
request.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/JakeWharton/butterknife/pull/1230#issuecomment-382695963,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABv33SLqEGyvoRSSHbdUsrvim0eHcHoKks5tqG_OgaJpZM4S5yxk
.

Gradle 4.7 is already out. I think that now this is the most important thing for every library using annotation processing. Recompilation whole project on every small change takes 35s for me and I think that I'm not working on the biggest project.

Android-State is now first Android lib with incremental compilation support!
I tested it together with version of butterknife from @stephanenicolas and it looks that it works.
But I tested it just on the small project. I need to test it on something bigger now.

So it looks that Google team added support for incremental compilation to annotation processors included in build plugin itself. https://androidstudio.googleblog.com/2018/09/android-studio-33-canary-11-available.html Any chance that this pull request will be merged and at least snapshot build will be available?

Hi

Hey guys, what's the state of this? Would love to see butterknife opt into incremental compilation sooner than later :)

Try butterknife-reflect. It's 100% faster than incremental annotation
processing for your IDE builds.
On Thu, Oct 18, 2018 at 2:39 PM Tony Robalik<EMAIL_ADDRESS>wrote:

Hey guys, what's the state of this? Would love to see butterknife opt into
incremental compilation sooner than later :)
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/JakeWharton/butterknife/pull/1230#issuecomment-431117032,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAEEEbAiz2RlJOGWIjIJiGFpemwjED_mks5umMrUgaJpZM4S5yxk
.

That's fine by me. I'm just advocating on behalf of all the people still using Butterknife AP.
If using butterknife-reflect is the preferred solution, maybe it's worth updating the readme to suggest that? There's nothing in the top-level readme to encourage users to switch to that instead.

Here's a reason why NOT to use butterknife-reflect: #1391
Test what you fly...

PRs for missing functionality are welcome.
On Mon, Nov 5, 2018, 3:14 PM Damjan Cvetko<EMAIL_ADDRESS>wrote:

Here's a reason why NOT to use butterknife-reflect: #1391
https://github.com/JakeWharton/butterknife/issues/1391
Test what you fly...
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/JakeWharton/butterknife/pull/1230#issuecomment-436071620,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAEEEddYaLhPZY3tjKmxHw0YfBnET5gwks5usMZzgaJpZM4S5yxk
.

PRs for missing functionality are welcome.

This is PR with missing functionality :-(

I was referring to the reflect runtime
On Fri, Nov 16, 2018, 5:53 PM Tomáš Procházka<EMAIL_ADDRESS>wrote:

PRs for missing functionality are welcome.
This is PR with missing functionality :-(
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/JakeWharton/butterknife/pull/1230#issuecomment-439553669,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAEEEX6LlfZZ8TQgA-XjFnIS8LPxZLCdks5uv0HugaJpZM4S5yxk
.

@JakeWharton and/or other contributors. Can we have a transparent, open and in-depth discussion on this PR ? It looks like there are some reasons on the maintainers side not to merge it and this PR has received some support from the community. Can we talk about it, and maybe figure out an even better solution ?

If there is concern about the safety of this, butterknife could always follow dagger's lead and make it an opt-in feature.

I just enabled the issues on https://github.com/stephanenicolas/butterknife. Also, I was able to repro in the sample of TP 2 (which is also becoming incremental..). Feel free to create the issue in the fork's repo.


SHS-NG M9: Stage page speed up.

There are two main changes to speed up rendering of the tasks list
when rendering the stage page.
The first one makes the code only load the tasks being shown in the
current page of the tasks table, and information related to only
those tasks. One side-effect of this change is that the graph that
shows task-related events now only shows events for the tasks in
the current page, instead of the previously hardcoded limit of "events
for the first 1000 tasks".
To make sorting efficient when using a disk store, the task wrapper
was extended to include many new indices, one for each of the sortable
columns in the UI. The indexed fields are declared in ways that make
them as cheap as possible for the KVStore code to process them, avoiding
things such as "Option.map" since those showed up to be way more
expensive than simple if..else blocks in a profiler.
The second changes the way metrics are calculated for stages. Instead
of looking at all the tasks every time quantiles for the stage-level
metrics are desired, keep an online view of the aggregated metrics
while the events are being processed, and save that aggregated view
to the store once the stage finishes. This is done using the t-digest
library (https://github.com/tdunning/t-digest) which provides accurate
enough approximations of arbitrary quantiles. The calculated quantiles
change slightly when using this library, so the expectation files in
the SHS unit tests had to be updated.
Because the latter is a little more expensive that I'd like, updating
the aggregated metrics and saving them to the store is done asynchronously,
to avoid blocking the listener bus.
With the above changes, a lot of code in the UI layer could be simplified.

is this branch stable enough now?

I just run the UnitTesst, and found some test failed:

stage task summary w shuffle write
stage task summary w shuffle read
stage task list w/ sortBy
stage task list w/ sortBy short names
job progress bars / cells reflect skipped stages

@djvulee there's a couple of things I need to fix in this last patch... if you just reset the branch to the previous commit things should be more stable.

Unit tests should be fixed in this patch too, now.

Ok, Thanks!   I found the current branch can not deal with the failed page well enough, it will produce the following error:

java.lang.IndexOutOfBoundsException: Page 1 is out of range. Please select a page number between 1 and 0.
at org.apache.spark.ui.PagedDataSource.pageData(PagedTable.scala:56)
at org.apache.spark.ui.PagedTable$class.table(PagedTable.scala:108)
at org.apache.spark.ui.jobs.TaskPagedTable.table(StagePage.scala:702)
at org.apache.spark.ui.jobs.StagePage.liftedTree1$1(StagePage.scala:295)
at org.apache.spark.ui.jobs.StagePage.render(StagePage.scala:284)
at org.apache.spark.ui.WebUI$$anonfun$2.apply(WebUI.scala:82)
at org.apache.spark.ui.WebUI$$anonfun$2.apply(WebUI.scala:82)
at org.apache.spark.ui.JettyUtils$$anon$3.doGet(JettyUtils.scala:88)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:687)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
at org.spark_project.jetty.servlet.ServletHolder.handle(ServletHolder.java:845)
at org.spark_project.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1689)
at org.apache.spark.deploy.history.ApplicationCacheCheckFilter.doFilter(ApplicationCache.scala:437)
at org.spark_project.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1676)
at org.spark_project.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:581)
at org.spark_project.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
at org.spark_project.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)
at org.spark_project.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
at org.spark_project.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.spark_project.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)
at org.spark_project.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
at org.spark_project.jetty.server.Server.handle(Server.java:524)
at org.spark_project.jetty.server.HttpChannel.handle(HttpChannel.java:319)
at org.spark_project.jetty.server.HttpConnection.onFillable(HttpConnection.java:253)
at org.spark_project.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
at org.spark_project.jetty.io.FillInterest.fillable(FillInterest.java:95)
at org.spark_project.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
at org.spark_project.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
at org.spark_project.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.spark_project.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
at org.spark_project.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.spark_project.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:745)

Another issue is that the SQL tab page will lead to nullPointerException(M8 branch)

@djvulee do you have some code that can reproduce the failed stage you're having trouble with? I can't see any issues in my local build. The SQL tab and individual executions also render fine for me.

@vanzin I do not have the code, I just click some log history, and find this issue.
I will look through the code in the following days.

If there's any code or even event logs you can share that would help a lot. The logs and code I've been testing with all seem pretty happy.

Ok, I will share the log if possible.

Hi, Marcelo. Thanks for your work on improving SHS. I have compiled locally and started instance pointing to our own spark job history data and it is now working fine. But I found two issues that will still slow down the SHS.

The home page showing up time is trying to gathering all the applications in the application list in FsHistoryProvider. If we have more than 40K apps in HDFS folder, the rendering of the home page will be pretty slow as it needs to build the result for 40K apps which is unnecessary.
The rest API call to get stages/jobs/env information can get the result from DB which is pretty fast. But when user tries to click on the appID on the history home page, HistoryServer will still try to  get the data from ApplicationCache, if not in cache, FsHistoryProvider has to replay the whole log file. But sometimes the logs will be really large, and it will cost long time to replay the whole log. Is it possible that we can construct the info from what we already have in DB?
I would like to contribute to add these two parts of the codes if it is doable and also not in your recent plan, as I didn't find it in your original design doc as mentioned in the upstream ticket.
Thanks.

Hi @zhouyejoe ,

If we have more than 40K apps in HDFS folder, the rendering of the home page will be pretty slow

Yes, that is true. That is independent of where the listing is stored though. Right now pagination is done client-side, and to fix this it should be done server-side. I don't think there's a bug tracking this feature, so feel free to file one.

try to get the data from ApplicationCache, if not in cache, FsHistoryProvider has to replay the whole log file

Yes. The data in the listing DB does not contain all of the data to build the application's UI, so if the UI has never been loaded, the whole event log needs to be parsed.
I filed SPARK-20656 to make this better in the future; basically, with data stored on disk, we could speculatively parse logs (e.g. keep parsing logs of in-progress applications as they're written to, so that when the application finishes the SHS is pretty much up to date). But I'm only planning to look at that after the initial work is in.


FastAPI gets stuck when using run_in_threadpool

First Check

[X] I added a very descriptive title to this issue.
[X] I used the GitHub search to find a similar issue and didn't find it.
[X] I searched the FastAPI documentation, with the integrated search.
[X] I already searched in Google "How to X in FastAPI" and didn't find any information.
[X] I already read and followed all the tutorial in the docs and didn't find an answer.
[X] I already checked if it is not related to FastAPI but to Pydantic.
[X] I already checked if it is not related to FastAPI but to Swagger UI.
[X] I already checked if it is not related to FastAPI but to ReDoc.

Commit to Help

[X] I commit to help with one of those options 👆

Example Code
def data_fetch(query):
    # I take a few seconds to respond
    return

@app.get('/my_home')
async def fetch(somedata: ReqData):
    await run_in_threadpool(data_fetch, somedata.q1)
    await run_in_threadpool(data_fetch, somedata.q2)
    return True

Description
I have implemented all my routes using async. And have followed all guidelines from the FastAPI documentation.
Every route has multiple DB calls, which does not have async support, so they are normal function like this
def data_fetch(query):
    # I take a few seconds to respond
    return

To avoid blocking my event loop I use fastapi.concurrancy.run_in_threadpool
Now the issue is, when a large number of requests come, my new requests are getting blocked. Even if I close the browser tab (cancel request), the entire app gets stuck till the older requests get processed.
What am I doing wrong here?
I use uvicorn as my ASGI server. I run in a kubernetes cluster with 2 replica.
Few suspects: Am I spawning too many threads? Is it some bug within uvicron? Not really sure!
Operating System
Linux
Operating System Details
No response
FastAPI Version
0.73
Python Version
3.9
Additional Context
No response

Perhaps this comment would be helpful to you https://github.com/tiangolo/fastapi/issues/603#issuecomment-540834120

Perhaps this comment would be helpful to you #603 (comment)

I saw that, added the work around by setting max_workers on start-up. I need to check how it performs under load. Meanwhile, does this also resolve the issue?

Can I see a minimal reproducible example on which it gets stuck?

@Kludex sorry for the late reply. Here's a reproducible request.
import httpx
import pandas as pd
import pymongo
from fastapi import FastAPI
from fastapi.concurrency import run_in_threadpool

app = FastAPI()

async def get_data() -> dict:
    async with httpx.AsyncClient() as client:
        r = await client.get('https://www.example.com/')
        # big json ~20mb, sometimes can take 10-20 seconds for response
        return r.json()

def get_meta_data(doc_id: int) -> dict:
    client = pymongo.MongoClient("mongodb://localhost:27017")
    db = client["test"]
    collection = db["docs"]
    return collection.find_one({"doc_id": doc_id}) # sometimes takes ~4-5 seconds for response

@app.get("/get_data")
async def get_data(doc_id: int):
    data = get_data()
    df = pd.DataFrame.from_records(data)

    # some df operations using pandas and numpy mostly

    meta = await run_in_threadpool(get_meta_data, doc_id)
    df.rename(columns=meta.get("columns"))
    return df.to_dict(orient='records')

how async and python work -> https://github.com/tiangolo/fastapi/issues/4265#issuecomment-990945629


Gray image result after training UNet+Tensorflow backend

Hello! I use the "UNet" network for semantic segmentation. The network "UNet" was used in the competition "kaggle ultra nerve". An example of implementing this neural network architecture is here:
https://github.com/jocicmarko/ultrasound-nerve-segmentation
For training, I prepared the data from Toronto's dataset:
https://www.cs.toronto.edu/~vmnih/data/"
I pre-cut the image of the original size 1500 * 1500 into smaller pictures with the size 96 * 96 and converted them into the format "* npy".
As a result of learning the neural network on my data, after the 1st, 5th, 20th era, I run a test on the test images. I get a completely gray picture, instead of a binary mask.
What could be the reason for this prediction? If I use the data used by the author of the above code, I get binary masks. Does anyone have any idea what might be the reason?
pred:

img:

label:

@Maxfashko Did you figure it out ? I'm getting the same problem, while training the model on my DataSet

Hi Maxfashko , I am facing similar problem.
I am trying to use encoder-decoder network for segmentation.
After validation loss converges I tried my model but I am also getting gray Image as a output.
Please help If you have solved this problem.

@AniketGurav You need more learning epochs

@Maxfashko yup increasing the #epochs worked!


MF-269 - Replace UUID with BIGSERIAL as primary key

This pull request resolves #269.
Summary:

dropped CoAP (incompatible API, poor library support, no tests)
replaced UUID with BIGSERIAL (uint64) as things and channels primary key
propagated these changes through protobuf schemas

Codecov Report

Merging #291 into master will decrease coverage by 0.05%.
The diff coverage is n/a.

@@            Coverage Diff            @@
##           master    #291      +/-   ##
=========================================
- Coverage   90.36%   90.3%   -0.06%
=========================================
  Files          10      10
  Lines         166     165       -1
=========================================
- Hits          150     149       -1
  Misses         13      13
  Partials        3       3

Impacted Files
Coverage Δ

users/postgres/init.go
83.33% <ø> (-0.67%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update bbf2d55...c48b3d1. Read the comment docs.


xfsprogs: 6.4.0 -> 6.6.0

Description of changes
Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[x] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Will merge this in a few days, if nobody objects.

Result of nixpkgs-review pr 260867 run on x86_64-linux 1

26 packages marked as broken and skipped:

gnomeExtensions.easyScreenCast
libvmi
mailnagWithPlugins
mailnagWithPlugins.dist
python312Packages.jupyter-repo2docker
python312Packages.jupyter-repo2docker.dist
qemu_xen
qemu_xen.debug
qemu_xen.ga
qemu_xen_4_15
qemu_xen_4_15.debug
qemu_xen_4_15.ga
qubes-core-vchan-xen
rabbitvcs
rabbitvcs.cli
rabbitvcs.dist
redpanda-server
xen
xen-slim
xenPackages.xen-slim
xenPackages.xen-vanilla
xenPackages.xen_4_15-slim
xenPackages.xen_4_15-vanilla
xen_4_15
xen_4_15-slim
xmonad_log_applet

2 packages blacklisted:

nixos-install-tools
tests.nixos-functions.nixos-test

200 packages failed to build:

CuboCore.coreaction
CuboCore.corearchiver
CuboCore.corefm
CuboCore.coregarage
CuboCore.corehunt
CuboCore.coreimage
CuboCore.coreinfo
CuboCore.corekeyboard
CuboCore.corepad
CuboCore.corepaint
CuboCore.corepdf
CuboCore.corepins
CuboCore.corerenamer
CuboCore.coreshot
CuboCore.corestats
CuboCore.corestuff
CuboCore.coreterminal
CuboCore.coretime
CuboCore.coretoppings
CuboCore.coreuniverse
CuboCore.libcsys
adapta-gtk-theme
airlift
airlift.dist
almanah
apptainer
apptainer-overriden-nixos
ayatana-indicator-datetime
bubblemail
bubblemail.dist
budgie.budgie-control-center
budgie.budgie-control-center.debug
calls
calls.devdoc
cantata
ceph (ceph-dev)
ceph-client
ceph-csi
ceph.dev (ceph-dev.dev)
ceph.doc (ceph-dev.doc)
libceph (ceph.lib ,libceph.dev ,libceph.doc ,libceph.lib ,libceph.man)
ceph.man (ceph-dev.man)
charliecloud
chatty
cinnamon.cinnamon-common
cinnamon.cinnamon-control-center
cinnamon.cinnamon-gsettings-overrides
cinnamon.cinnamon-screensaver
cinnamon.nemo
cinnamon.nemo-fileroller
cinnamon.nemo-python
cinnamon.nemo-with-extensions
cinnamon.nemo.dev
clementine
deepin.dde-device-formatter
deepin.dde-file-manager
deepin.dde-gsettings-schemas
deepin.deepin-album
deepin.deepin-compressor
deepin.deepin-music
deepin.udisks2-qt5
deepin.util-dfm
docker (docker_24)
docker-gc
docker-sbom
docker_20_10
docker_20_10.man
endeavour
enlightenment.enlightenment
eos-installer
evolution
evolution-data-server (gnome.evolution-data-server)
evolution-data-server-gtk4
evolution-data-server-gtk4.dev
evolution-data-server.dev (gnome.evolution-data-server.dev)
evolution-ews
evolutionWithPlugins
exaile
fn-cli
folks
folks.dev
folks.devdoc
gfbgraph
gfbgraph.dev
gfbgraph.devdoc
glusterfs
gnome-browser-connector
gnome-multi-writer
gnome-online-accounts
gnome-online-accounts.debug
gnome-online-accounts.dev
gnome-online-accounts.devdoc
gnome-online-accounts.man
gnome-photos
gnome-photos.installedTests
gnome-recipes
gnome.cheese
gnome.cheese.devdoc
gnome.cheese.man
gnome.geary
gnome.gnome-applets
gnome.gnome-calendar
gnome.gnome-contacts
gnome.gnome-control-center
gnome.gnome-control-center.debug
gnome.gnome-disk-utility
gnome.gnome-flashback
gnome.gnome-initial-setup
gnome.gnome-music
gnome.gnome-notes
gnome.gnome-online-miners
gnome.gnome-panel
gnome.gnome-panel-with-modules
gnome.gnome-panel.dev
gnome.gnome-panel.man
gnome.gnome-session
gnome.gnome-session.debug
gnome.gnome-session.sessions
gnome.gnome-shell
gnome.gnome-shell.debug
gnome.gnome-shell.devdoc
gnome.gnome-terminal
gnome.gnome-tweaks
gnome.gvfs
gnome.gvfs.debug
gnome.nixos-gsettings-overrides
gnome.totem
gnomeExtensions.gsconnect
gnomeExtensions.gsconnect.installedTests
grilo-plugins
gvfs
gvfs.debug
libgdata
libgdata.dev
libgdata.installedTests
libsForQt5.partitionmanager (plasma5Packages.partitionmanager)
libxfs (libxfs.bin ,libxfs.dev ,libxfs.doc ,xfsprogs.dev)
libzapojit
libzapojit.dev
lomiri.mediascanner2
lomiri.mediascanner2.dev
mate.mate-utils
mediawriter
mojave-gtk-theme
monitor
nfs-ganesha
ns-usbloader
nvidia-docker
pantheon.elementary-calendar
pantheon.elementary-greeter
pantheon.elementary-mail
pantheon.elementary-session-settings
pantheon.elementary-tasks
pantheon.switchboard-plug-about
pantheon.switchboard-plug-onlineaccounts
pantheon.switchboard-with-plugs
pantheon.wingpanel-applications-menu
pantheon.wingpanel-indicator-datetime
pantheon.wingpanel-with-indicators
phosh
phosh-mobile-settings
pipework
planify
psensor
python311Packages.jupyter-repo2docker
python311Packages.jupyter-repo2docker.dist
qemu_full
qemu_full.debug
qemu_full.ga
rapid-photo-downloader
rapid-photo-downloader.dist
sambaFull (samba4Full)
sambaFull.dev (samba4Full.dev)
sambaFull.man (samba4Full.man)
singularity
singularity-overriden-nixos
spaceFM
stratisd
stratisd.initrd
udiskie
udiskie.dist
udisks (udisks2)
udisks.dev (udisks2.dev)
udisks.devdoc (udisks2.devdoc)
udisks.man (udisks2.man)
udocker
udocker.dist
usbimager
usermount
valent
ventoy-full
vifm-full
vimix-gtk-themes
whitesur-gtk-theme
wipefreespace
xfsdump
xfsprogs
xfsprogs.bin
xfsprogs.doc
xfstests

@mfrw why does xfsprogs fail to build for you? seemed just fine on my machine and ofborg also doesn't complain?

@mfrw why does xfsprogs fail to build for you? seemed just fine on my machine and ofborg also doesn't complain?

Let me take another stab at it. I am guessing there was some disk-space issue with my machine. It could be that.
Let me take a look.

@mfrw why does xfsprogs fail to build for you? seemed just fine on my machine and ofborg also doesn't complain?

Let me take another stab at it. I am guessing there was some disk-space issue with my machine. It could be that. Let me take a look.

The tests failed again on my machine. Unsure why though :(

Strange. Can you paste your logs somewhere?

Strange. Can you paste your logs somewhere?

Ohh sorry; I just did nix-collect-garbage.
Will maybe try again tomorrow :)

Will merge this in a few days, if nobody objects.


Request: Add FromBytes::read_from_prefix_split and read_from_suffix_split

It would be handy to have a FromBytes::read_from_(prefix/suffix)_split that returns a tuple of the T and the unused portion of the byte slice. Ref::new_from_prefix isn't quite the same in case the byte slice is unaligned, but we don't want to derive Unaligned on the type.

Something like this (playground)?
fn read_from_prefix_split<T>(bytes: &[u8]) -> Option<(T, &[u8])>
where
    T: Sized + FromBytes,
{
    Ref::<_, Unalign<T>>::new_unaligned_from_prefix(bytes)
        .map(|(r, s)| (r.read().into_inner(), s))
}

Yeah that looks about right. I mean there's a number of ways to do it, you can just call FromBytes::read_from_prefix and then index into your byte buffer by sizeof, but having it provided and able to be used in a small oneliner would be nice.

In our code, we often parse structures with fixed headers and then some dynamic portion, from a potentially unaligned buffer. To support this, it has been nice to have both options readily available (both preserving the suffix bytes and not), without having to reach for Ref.
Ref is powerful, but it's certainly more tedious to use. And it's arguably more dangerous (from a correctness perspective, not a safety one): since reading from an unaligned buffer requires even more typing than reading from/aliasing an aligned one, developers get lazy and just assume their buffer is aligned. And in their testing, it is. Then something subtle changes in the code, possibly far away from the call site, and runtime checks start failing.
Or developers write something like let foo = Foo::read_from_prefix(buf)? followed by let buf = &buf[..size_of::<Foo>()], which is error prone from the type name duplication. (I guess size_of_val(&foo) would also fix this, but it's still tedious to write.)
To solve this, we have a private crate that provides these kind of extra methods for use with zerocopy, but we'd love to just standardize on a single crate. Since these methods aren't already in zerocopy, I'm curious if we're "holding it wrong"--maybe there's a better way to do this kind of parsing? Do most users have aligned buffers? Or have unaligned struct definitions?

@jstarks Is that private crate open source? It'd be great to see what else you're needing to work around so that we can support your use cases!


feat: adds configuration aliases

#29 - adds configuration aliases

Coverage decreased (-0.3%) to 99.675% when pulling 1096d6da6485c2a9a8e27e22016737f503e45796 on config-aliases into 107f1834eb656168873f271505dea3c968022dd3 on master.

Coverage remained the same at 100.0% when pulling 5cbdcccedc34a82e18dcb3e2b60a37d0b7c15aac on config-aliases into 107f1834eb656168873f271505dea3c968022dd3 on master.


Version 0.1.543: Error "missing 1 required positional argument: 'skill_number'"

With the new modul version 0.1.543 my Meross Switch mss710 can't switched on or off anymore.
I have two meross devices running in my meross app. A Smart Essential Oil Defuser (mod150) and a Meross Switch mss710. After deleting and reinstall the meross-integration now there are no meross-devices listed.
Logfile-Entries:
2023-01-07 13:18:32,654 - INFO     - fhempy.lib.fhem_pythonbinding: Start update...
2023-01-07 13:18:32,656 - INFO     - fhempy.lib.pkg_installer: Attempting install of fhempy
2023-01-07 13:18:39,517 - INFO     - fhempy.lib.pkg_installer: Successfully installed fhempy update!
2023-01-07 13:18:39,534 - INFO     - fhempy.lib.fhem_pythonbinding: Restart initiated...
2023-01-07 13:18:39,537 - INFO     - fhempy.lib.fhem_pythonbinding: All modules successfully undefined!
2023-01-07 13:18:39,539 - INFO     - websockets.server: server closing
2023-01-07 13:18:49,557 - INFO     - websockets.server: connection closed
2023-01-07 13:18:49,558 - INFO     - websockets.server: server closed
2023-01-07 13:18:49,559 - INFO     - fhempy.lib.fhem_pythonbinding: Exit 1
2023-01-07 13:18:50,895 - INFO     - fhempy.lib.fhem_pythonbinding: Starting fhempy 0.1.543...
2023-01-07 13:18:50,903 - INFO     - fhempy.lib.fhem_pythonbinding: Waiting for FHEM connection
2023-01-07 13:18:50,938 - INFO     - websockets.server: server listening on <IP_ADDRESS>:15733
2023-01-07 13:18:59,762 - INFO     - websockets.server: connection open
2023-01-07 13:18:59,768 - INFO     - fhempy.lib.fhem_pythonbinding: Incoming FHEM connection: <IP_ADDRESS>
2023-01-07 13:19:00,974 - ERROR    - meross_integration: Exception raised by task: <Task finished coro=<FhemModule._run_coro() done, defined at /opt/fhem/.local/lib/python3.7/site-packages/fhempy/lib/generic.py:194> exception=TypeError("init() missing 1 required positional argument: 'skill_number'") created at /usr/lib/python3.7/asyncio/tasks.py:325>
Traceback (most recent call last):
File "/opt/fhem/.local/lib/python3.7/site-packages/fhempy/lib/generic.py", line 202, in _handle_task_result
task.result()
File "/opt/fhem/.local/lib/python3.7/site-packages/fhempy/lib/generic.py", line 196, in _run_coro
await coro
File "/opt/fhem/.local/lib/python3.7/site-packages/fhempy/lib/meross/meross_setup.py", line 37, in run_setup
await manager.async_device_discovery()
File "/opt/fhem/.local/lib/python3.7/site-packages/meross_iot/manager.py", line 331, in async_device_discovery
http_devices = await self._http_client.async_list_devices()
File "/opt/fhem/.local/lib/python3.7/site-packages/meross_iot/http_api.py", line 417, in async_list_devices
return [HttpDeviceInfo.from_dict(x) for x in result]
File "/opt/fhem/.local/lib/python3.7/site-packages/meross_iot/http_api.py", line 417, in
return [HttpDeviceInfo.from_dict(x) for x in result]
File "/opt/fhem/.local/lib/python3.7/site-packages/meross_iot/model/shared.py", line 27, in from_dict
obj = cls(**new_dict)
TypeError: init() missing 1 required positional argument: 'skill_number'

Thanks for reporting!
Meross did a breaking change on their APIs:
https://github.com/albertogeniola/MerossIot#-breaking-changes-from-meross-api-
I updated the library to the latest version. The fix is available in version 0.1.544 or higher.

Great. Many thanks for the quick update and your work on the system. Everything works fine now.


Upgrade notice to users with older versions

There are users who have outdated versions of the CLI, we must find a suitable way to notify them to update the package!

I will look to it tonight

Can I use another package to help us with this task or you prefer a native solution?

not perfect, but acceptable

Up to you, if you want @gtrabanco


Update configure-services-and-applications.md

Fixing a minor spelling mistake

@JohanFreelancer9 - kindly do the copy editor review for this PR. Thanks

@tiburd Please merge this PR. Thanks


Cherry pick copyright text change into stable3.13

Cherry pick (kinda) the copyright text change to stable3.13 for Lego.
I say kinda because dialogs have changed in master and I've had to somewhat reimplement it in this stable branch. Not a big change tho

No need to cherry pick this into master (for obvious reasons)


Updated fish shell completions

Just brought the completions for fish shell up to date.

Thanks, @exploide! 🐟🐚 🎉

I was jst installing those in the Fedora package and was wondering: Will this work for https command?

I was just installing those in the Fedora package

Hey @hroncok thanks for addressing my bugzilla issue. :) Just left positive karma on bodhi for the F34 update.
As of now, I was not even aware that there is an https command (that is the same as http).

Will this work for https command?

Not directly. We would need an additional completion file https.fish that just contains complete -c https -w http. This means that completions for https are wrapping those of http.
How should be proceed? Will you create that file as part of the build step? Or we can ask @jakubroztocil if we can add that additional file to the repository.

Having that wrapper here would make more sense to me, that way, others can use it as well.
Is something similar working for Bash?


Support Compose Multiplatform

I would like to use this library in a multi-platform project. As the library does not seem to have any dependency on Android it should be as easy as restructuring and changing the config. I'm happy to contribute the restructuring part. Publishing may require some changes, which will need to be taken care of.
And thanks for this amazing project :)

Hi Shreyash,
thanks for your interest in JsonTree! I saw that you already opened a PR for the multiplatform changes.
I also thought about converting it to a multiplatform library, so this is great. I will try to review your PR in the next couple days and then look into the publishing changes.
Thanks again!


Auto corrected by following Format Ruby Code

Auto corrected by following Format Ruby Code
Click here to configure it on awesomecode.io

Coverage remained the same at 96.927% when pulling 541a41e964d95cf3718150b23c6cf6916ddb3b48 on awesomecode-format-ruby-code-48821 into 1decb2417d0e73db45b9e8348a2c2aff962ee914 on master.

Coverage remained the same at 96.927% when pulling 541a41e964d95cf3718150b23c6cf6916ddb3b48 on awesomecode-format-ruby-code-48821 into 1decb2417d0e73db45b9e8348a2c2aff962ee914 on master.


Ruby String from bytes

Now I'm just trying to decide whether encode should be mut self -> Self or self -> Self.  Either way I won't be returning the mutable self.

I think I'll go with self -> Self.  I prefer immutability and that is the same behavior the method String#encode follows.


MR #887 left undesired logs.

Noticed that there are some logs that wer eprobably left accidentally:
https://github.com/CirclonGroup/angular-tree-component/commit/f639c98fbd9faea1a950765ef8ad2c4bab507a6c

@liesahead Thanks for that! Removed it and added log calls to the no-console linting so it does not happen again.


[Feature] configure an alias on snapshots

Is there an existing feature request for this?

[X] I have searched the existing issues

Describe the Feature
With standard models, we have the ability to configure an alias which makes the resulting database table name different from the model name.
This makes it easier to manage large projects, as all our models are prefixed with the schema name, bug generates a tables without the schema name.
Right now it is not doable for Snapshot. The table generated by snapshots always has the same name as the model.
Describe alternatives you've considered
Overriding the Snapshot macro, or build snapshots ourselves.
Keeping the snapshot without aliases is not an option for us since it generates model naming collisions.
Example my_system_1.users_history and my_system_2.users_history are both referenced using ref('users_history').
Who will this benefit?
Everyone using Snapshot on large dbt projects.
Are you interested in contributing this feature?
No response
Anything else?
No response

@jvenezia Thanks for opening!
Snapshots do support the alias config, just like other resource types (models/seeds/tests/etc). Give this a try:
{% snapshot my_snapshot %}

{{
    config(
      target_schema='my_schema',
      unique_key='id',
      strategy='timestamp',
      updated_at='updated_at',
      alias='a_different_name'
    )
}}

select 1 as id, current_timestamp as updated_at

{% endsnapshot %}

For me, that looks like:
10:29:25  1 of 1 START snapshot my_schema.a_different_name..................................... [RUN]
10:29:36  1 of 1 OK snapshotted my_schema.a_different_name..................................... [SELECT in 10.85s]

And generates SQL like:
  create  table
    "database"."my_schema"."a_different_name"
...

I agree this is confusing because:

The docs on alias are very sparse right now: https://docs.getdbt.com/reference/resource-configs/alias (one issue for improving them: https://github.com/dbt-labs/docs.getdbt.com/issues/890)
The docs on "Snapshot configurations" do not include alias as an option: https://docs.getdbt.com/reference/snapshot-configs
Snapshots use slightly different nomenclature for their other two namespace components, target_database (instead of database) and target_schema (instead of schema). This is to indicate that they behave differently across environments than other resource types. When it comes to alias, though, it's the same behavior as always.

I do think the resolution here is updates to docs.getdbt.com, rather than a change to dbt-core code. As such, I'm going to close this issue.

Thank you very much! Indeed it probably just needs to be more explicit in the docs :)