Uncaught ReferenceError: getSettingValue is not defined

I'm getting Uncaught ReferenceError: getSettingValue is not defined in the Chrome DevTools when trying to load/search something on https://docs.rs/tokio-uring/latest/tokio_uring/?search=spawn
I think this used to work. Also, if you switch to version 0.3.0 you'll see it applies styles correctly and you can search, so only the 0.4.0 build seems broken for this crate.

https://docs.rs/-/rustdoc.static/storage-20221104-1.67.0-nightly-09508489e.js is 404, seems to be the same issue as https://github.com/rust-lang/docs.rs/issues/2005, I've queued a rebuild.

That specific crate page works for me now, thanks!


When using the liberty plugin request.getServletContext().getRealPath(File.separator) always return null

I start my system using the libertyDev command
Everything is working fine
However, when I call code that has this: request.getServletContext().getRealPath(File.separator) it always returns null
Is there a setting that will allow this to return a real path?
In my server.xml I have set this:
<applicationManager autoExpand="true" />

@paulbarr This seems like a question for Open Liberty itself? I presume you get the same behavior when not using our plugin. Correct me if I am wrong.

This looks to be an OpenLiberty issue related to loose config. I'll close this out


add client test

Closes #200

Codecov Report

Merging #201 (5a5596f) into main (79ba5ac) will increase coverage by 0.29%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##             main     #201      +/-   ##
==========================================
+ Coverage   94.39%   94.68%   +0.29%
==========================================
  Files          49       49
  Lines        2068     2068
==========================================
+ Hits         1952     1958       +6
+ Misses         81       75       -6
  Partials       35       35

Impacted Files
Coverage Δ

client.go
86.09% <0.00%> (+3.20%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 79ba5ac...5a5596f. Read the comment docs.


feat: highlight Astro code blocks in MDX

Changes
This adds support for syntax highlighting astro tagged code blocks inside MDX files.
This is MDX

```astro
---
const frontmatter = 'This is Astro frontmatter'
---

<div>This is an Astro template</div>
```

Testing
With the MDX extension installed, open the Astro language tools repo and create an Astro code block inside an MDX file.
Docs
I don’t know what documentation would be needed for this.

I know we do it that way in Markdown, but I don't know why we redefine the frontmatter and stuff. Couldn't we just apply source.astro to code blocks with the astro language?

Without it the frontmatter content isn’t highlighted. I don’t understand why.
I did simplify it a bit now.


(android) Show recently rejected payments in Home

This PR adds a message that summarises recently rejected payments (due to the user's fee policy).
On Android we already show a system notification when such events occurred, but these notifications are easy to miss, (system gives them low priority, or system notifications are disabled). The user is confused about why the payment seemingly never arrived - so we need to display a message.
This message only counts offchain payments rejected less than 3 hours ago. Clicking on that message redirects to the notifications list.
@robbiehanson this is similar to what was done in https://github.com/ACINQ/phoenix/pull/423 although I preferred not to show the full details of 1 single rejection (it takes a lot of place). It's more discreet that way, and the user can still get the details by clicking on the message.
1 payment rejected with 2 important messages
We display two messages, one about the rejected payment, and the other like before, displaying the important with highest priority. Clicking on any of these messages redirects to the notifications list screen.

3 payments rejected with no important messages

We display two messages, one about the rejected payment, and the other like before, displaying the important with highest priority.

This is a great improvement! I will copy this on iOS.

This message only counts offchain payments rejected less than 3 hours ago.

Maybe the time duration should be longer. If I miss a payment while sleeping, it would be nice to still see it on the Home screen.

1 payment rejected recently

Mild suggestion: "1 incoming payment rejected recently" (possibly more clear, but not convinced this is an improvement)


[web] Default bootstrapping logic should not wait for load event

The default code that we insert in index.html when bootstrapping a flutter app is as follows:
    window.addEventListener('load', function (ev) {
      // Download main.dart.js
      _flutter.loader.loadEntrypoint({
        onEntrypointLoaded: function (engineInitializer) {
          engineInitializer.initializeEngine().then(function (appRunner) {
            appRunner.runApp();
          });
        }
      });
    });

This, however, is not good because it means that actually initializing the engine is blocked on all asynchronous scripts and resources on the page. As an example, I loaded the skwasm Material 3 demo here: https://flutterweb-wasm--skwasm-1s3iqgbs.web.app/
Taking a perf profile I saw the following waterfall:

As can be seen from the trace, the highlighted "Google Tag Manager" request (which is just analytics that could otherwise be completely asynchronous) is blocking the window load event, and engine initialization doesn't start until that is completely resolved. I went ahead and did a devtools local override of the code in index.html to listen to the DOMContentLoaded event instead, and the waterfall is much healthier:

I think instead of waiting on DOMContentLoaded, the only thing we actually care about here specifically is that the flutter.js script is loaded, so I think we should just explicitly wait on that event rather than tying it to a browser load event.

Agree with the proposal.
I have a loading indicator with an <img> and with default flutter template (load event) it does not start fetching the engine until the image is loaded.
Docs clearly say that DOMContentLoaded will not fire until all defer scripts are loaded and evaluated : https://developer.mozilla.org/en-US/docs/Web/HTML/Element/script#defer.
So, I changed to DOMContentLoaded and now it does not wait for image to load.
Also, using fetchpriority="high" should ensure that flutter.js is requested first if there are other external scripts: https://developer.mozilla.org/en-US/docs/Web/HTML/Element/script#fetchpriority

Hi, may we request to elevate the priority of this issue back to P1. It's crucial for web deployments because the deferred import functionality appears to be ineffective as long as we encounter this initial loading problem.
In our case, we have a huge main.dar.js file, which is 2MB when gzipped. To mitigate this, we've created a separate bootstrap dart file for deferred loading. Our expectation was for these files to load in parallel. However, they are loading sequentially. While this does split the size, another issue arises from the loading of certain parts being blocked by other requests.

FWIW, you don't actually have to wait for the 'load' event on the document before running flutter.js stuff or loading the app, that's just the default behavior when doing flutter create. That's specifically what this issue tracks, that we're essentially recommending a workflow that is slower than necessary. You can, if you want, write your own bootstrapping script that just waits on the flutter.js script or the DOMContentLoaded event instead.
I'd like to avoid making this a P1 for specific reasons relating to the web engine team's triage process, but rest assured that some changes are coming down the pipe very soon that should improve things in several ways, including (1) generally faster and more parallelized waterfall on startup, (2) simpler startup invocation in general, and (3) better default behavior on flutter create. They will probably obviate most of the issues here. I'll report back on this issue when these improvements land.


DBZ-6153 Refactor Streams deployment content to fix errors

DBZ-6153
This change fixes errors in the connector YAML file that's included in the downstream documentation for using Streams to deploy connectors. Earlier, I did a band-aid fix on the published 2022.Q4/DBZ 1.9.7 version of the  downstream docs, but this change fixes the errors for the 2.x stream.
Due to differences among the connectors, the YAML example requires small tweaks depending on the context. The differences are not complex, but because of a shortcoming in the docs toolchain, when fetching content from upstream, ifeval conditionals are not supported. So to get the required results, I had to refactor the docs. It's a bit of a hack, but it mirrors the structure currently in place for creating the YAML to deploy Kafka Connect.
Tested in a local downstream build.
The change applies only to the downstream version of the docs. There are no effects on the upstream content.

@jpechane Is it ok to merge this? The content is downstream-only and is already released as a one-time fix in the product doc. The purpose of this change is to correct the source files so that the update is persistent. As noted, I've tested the change in a downstream build and can confirm that everything plays nicely with the docs toolchain.

@roldanbob Done and backported. Thanks


feat(others): add jellyfin-cover-art-generator

https://github.com/Tetrax-10/jellyfin-cover-art-generator

Hey where can I add this?
https://github.com/Tetrax-10/jellyfin-better-styles
I dont know will you consider this as a theme. As it only change the movie/tv page's look and enhances the card animation and interactivity.
is there a theme snippet category?

Hello! Yes, I think the themes section is the correct place to add jellyfin-better-styles to. Please open a new PR for this and attach 2-4 pictures.


[Windows] GetSystemMetrics returns the same value with GetSystemMetricsForDpi

According to Microsoft's documentation, GetSystemMetrics is not DPI aware and thus it should return a totally different value with GetSystemMetricsForDpi. However their return values are exactly the same currently. And it's leading us to a very bad situation: the system metric value returned by our own function getSystemMetric is now double scaled.
https://docs.microsoft.com/en-us/windows/win32/api/winuser/nf-winuser-getsystemmetrics
https://docs.microsoft.com/en-us/windows/win32/api/winuser/nf-winuser-getsystemmetricsfordpi

New finding: GetSystemMetrics will return the DPI unaware value if it's called from a console program.

Another new finding: it's still DPI aware on Win7 and Win8.1, but the returned value is a little smaller on Win7.


Run all tests

Hi,
Is there an option to run all the tests, even if some tests in-between fails without aborting ?
-Thanks

it will run them all, the exception is failures in before() / after() etc, the hooks cause mocha to bail because subsequent tests will (should) fail

I don't have an before/after steps. I have the tests at the moment as flat ones after i migrated from expresso.
My issue is, the moment should-assert fails - the process aborts. I would like testcase execution to continue to test all the tests and report at the end in a consolidated manner - what failed and succeed.
I guess this is not possible ? due to the behavior of assert right ?

like I said it should run them all, can you reproduce it with some code posted here? I'll take a look

example:

 ./bin/mocha --reporter list test

  0) foo should bar
  ✓ foo should baz: 0ms

  ✖ 1 of 2 tests failed:

  0) foo should bar:
     Error: oh no
      at Test.fn (/Users/tj/Projects/mocha/test.js:4:11)
      at Test.run (/Users/tj/Projects/mocha/lib/runnable.js:153:32)
      at Runner.runTest (/Users/tj/Projects/mocha/lib/runner.js:271:10)
      at /Users/tj/Projects/mocha/lib/runner.js:312:12
      at next (/Users/tj/Projects/mocha/lib/runner.js:199:14)
      at /Users/tj/Projects/mocha/lib/runner.js:208:7
      at next (/Users/tj/Projects/mocha/lib/runner.js:157:23)
      at Array.0 (/Users/tj/Projects/mocha/lib/runner.js:176:5)
      at EventEmitter._tickCallback (node.js:192:40)

Try this out :
var should = require('should');
describe('tests: ', function() {
it('test 1', function (done)  {
    setTimeout(function() {
        true.should.be.false;
        done();
    }, 2000);
});

it('test 2', function(done)  {
    true.should.be.false;
    setTimeout(function() {
        true.should.be.false;
        done();
    }, 2000);

});

});
You will see, the first one fails and the second test never gets executed.

hmm for this similar one (just changed assertions)

require('should')

describe('tests: ', function(){
  it('test 1', function (done){
    setTimeout(function() {
      'one'.should.be.equal(1);
      done();
    }, 2000);
  });

  it('test 2', function(done){
    'two'.should.be.equal(2);
    setTimeout(function() {
      'three'.should.be.equal(3);
      done();
    }, 2000);
  });
});

I get:

  ...

  ✖ 3 of 2 tests failed:

  0) tests:  test 1:
     AssertionError: expected 'one' to equal 1
      at Object.equal (/Users/tj/Projects/mocha/node_modules/should/lib/should.js:306:10)
      at Object._onTimeout (/Users/tj/Projects/mocha/test.js:7:23)
      at Timer.ontimeout (timers.js:84:39)

  1) tests:  test 1:
     AssertionError: expected 'one' to equal 1
      at Object.equal (/Users/tj/Projects/mocha/node_modules/should/lib/should.js:306:10)
      at Object._onTimeout (/Users/tj/Projects/mocha/test.js:7:23)
      at Timer.ontimeout (timers.js:84:39)

  2) tests:  test 2:
     AssertionError: expected 'two' to equal 2
      at Object.equal (/Users/tj/Projects/mocha/node_modules/should/lib/should.js:306:10)
      at Test.fn (/Users/tj/Projects/mocha/test.js:13:21)
      at Test.run (/Users/tj/Projects/mocha/lib/runnable.js:140:15)
      at Runner.runTest (/Users/tj/Projects/mocha/lib/runner.js:271:10)
      at /Users/tj/Projects/mocha/lib/runner.js:312:12
      at next (/Users/tj/Projects/mocha/lib/runner.js:199:14)
      at /Users/tj/Projects/mocha/lib/runner.js:208:7
      at next (/Users/tj/Projects/mocha/lib/runner.js:157:23)
      at Array.0 (/Users/tj/Projects/mocha/lib/runner.js:176:5)
      at EventEmitter._tickCallback (node.js:192:40)

they both do run, but that first thing reporting twice is definitely a bug

Really,
I got only one run, that's the first one and not the second one.
.
✖ 1 of 2 tests failed:

tests:  test 1:
AssertionError: expected true to be false
at Object.false (/Users/ls/ecl-ws/project1/node_modules/should/lib/should.js:276:10)
at Object._onTimeout (/Users/ls/project1/ecl-ws/Avalon/test.test.js:7:27)
at Timer.ontimeout (timers.js:84:39)


Release/3.2.0

Kotlin 2.0
Gradle 8.8
Bouncy Castle 1.78.1
Kotest 5.9.1
Coroutines 1.8.1
Serialization 1.7.1-SNAPSHOT

Fixes

Move curve from CryptoAlgorithm to JwsAlgorithm
Don't read curve information into the X.509 tea leaves where none exists

CryptoSignatures in X.509 are now indefinite length

Rename CryptoAlgorithm to X509SignatureAlgorithm to better describe what it is

Yeah, the API needs to be revised, because of EC signatures now being handled correctly (i.e. without guessing).


Use PSR-4 standard for unit tests

Q
A

Branch?
2.0

Bug fix?
no

New feature?
no

BC breaks?
no

Deprecations?
no

Tests pass?
no

License
MIT

Following #414, I added namespaces to unit tests and changed the directory structure to PSR-4 convention. I also removed the now useless custom autoloader which is not in use anymore. Please note that ideally I would like to remove the tests/bootstrap.php file and just use the autoloader.php file provided from Composer, but actually this is not possible because of the session_start() line. When and if we will ever refactor the Client implementation to use PSR-7, we can use the ServerRequestInterface class and so we will not have to manage the session ourselves

Code style?

If you're referring to why the build fails, I'm working on it, I don't understand why it says that line endings are wrong when on my setup they are correct (LF)

Maybe these lines contain space on the end?

Fixcp waits for correct case in namespaces. It requires it for PSR0

The folder called "tests" not "Tests"

I got it working. As we're now using PSR-4 everywhere, there is no point in using the PSR-0 rules set in PHPCS. So, I updated the rules and applied the linting to all files

@ste93cry @nokitakaze fyi both of you have commit bit on this branch so as long as a PR passes tests and its approved by reviewers you can merge


Fix missing clsx dep in components

On 0.2.21:
> require('@quri/squiggle-components')
Uncaught Error: Cannot find module 'clsx'

This is my fault, I used clsx in components/ and haven't added it to its package.json, but it was installed already through website/.
But I think it also reveals an issue with our github workflows? Build system should've caught this. (I haven't looked at ci.yml code carefully yet)

Yea, this is weird. Happy to merge this now though.


Fix Pod with Namespace

Can one of the admins verify this patch?

Split of the pullrequest #105

ok to test

LGTM, will merge when the CI passes. Thanks for the patch @cedbossneo!

Looks like Jenkins is failing

+ godep go test -a -v '--vmodule=*=1' --timeout=30m --namespace=default --kube_versions=0.10.0 github.com/GoogleCloudPlatform/heapster/integration/...
=== RUN TestHeapsterInfluxDBWorks
I0217 15:02:11.331626   25980 framework.go:248] Disabled cluster monitoring
I0217 15:02:11.332002   25980 framework.go:251] Setting up new kubernetes cluster version: 0.10.0
I0217 15:02:11.332060   25980 framework.go:142] Bringing down any existing kube cluster
I0217 15:08:20.974312   25980 framework.go:270] Successfully setup new kubernetes cluster version 0.10.0
I0217 15:08:24.448101   25980 framework.go:192] Kubernetes master IP is <IP_ADDRESS>
I0217 15:08:24.620576   25980 framework.go:369] Cannot find Replication Controller "monitoring-heapster-controller". Skipping deletion - replicationController "monitoring-heapster-controller" not found
I0217 15:08:24.625657   25980 framework.go:369] Cannot find Replication Controller "monitoring-influx-grafana-controller". Skipping deletion - replicationController "monitoring-influx-grafana-controller" not found
I0217 15:08:24.630485   25980 framework.go:354] cannot find service "monitoring-influxdb" - service "monitoring-influxdb" not found
I0217 15:08:24.774790   25980 kube_test.go:166] waiting for pods to be running
I0217 15:09:09.901397   25980 kube_test.go:84] 501: All the given peers are not reachable (Tried to connect to each peer twice and failed) [0]
--- FAIL: TestHeapsterInfluxDBWorks (418.57 seconds)
	assertions.go:154:

	Location:	kube_test.go:205

	Error:		No error is expected but got 501: All the given peers are not reachable (Tried to connect to each peer twice and failed) [0]

FAIL
exit status 1
FAIL	github.com/GoogleCloudPlatform/heapster/integration	418.578s

LGTM. Jenkins failure looks like etcd issue. I have restarted the build. Will merge once the build passes.

Sadly I think it is more subtle than that from my restart of the build before. But maybe it likes you more so we'll see :)

A subsequent run of CI passed. But jenkins failed to update github - http://<IP_ADDRESS>/job/heapster-e2e-gce/398/
Merging this PR.

Oh wow Jenkins fine, work for @vishh and not for me. I don't know what to think of this betrayal Jenkins.


Disable a failing unit test

Related to issue #916.
When I run Microsoft.Build.UnitTests.Evaluation.Expander_Tests.Medley (from
Microsoft.Build.Engine.UnitTests.dll) by itself, the test passes. When I run all
tests in the assembly, however, it fails with this message:

FAILURE: Expected '$([Microsoft.VisualBasic.FileIO.FileSystem]::CurrentDirectory)'
to not parse or not be evaluated but it evaluated to
'E:\Projects\msbuild\bin\x86\Windows_NT\Debug'
Expected: True
Actual:   False
Stack Trace:
src\XMakeBuildEngine\UnitTests\Evaluation\Expander_Tests.cs(3141,0): at
Microsoft.Build.UnitTests.Evaluation.Expander_Tests.Medley()

Specifically, the test seems to fail if I also run the
PropertyStaticFunctionAllEnabled method in the same class first. That's the only
other test in the assembly that refers to the
Microsoft.VisualBasic.FileIO.FileSystem type.

LGTM


Unrecoverable consumers in consumer group when session is timeout

Describe the bug
Consumers on the same consumer group stop processing message when their session is timeout & never recover.
Note: When the consumer group contains a single consumer. the behavior is ok & as expected.
How To Reproduce
Topic definition: name=test-topic, partitions=3, replication-factor=1.
kafka = new kafkajs.Kafka({
  brokers: <IP_ADDRESS>:9092
});

const consumerConfiguration = {
  groupId: 'group-id'
  // sessionTimeout is default. 30 seconds
 // heartbeatInterval is default. 3 seconds
};

// Consumer Side - needs to be execute on three different process (3 consumers)
kafkaConsumer = kafka.consumer(consumerConfiguration);
await kafkaConsumer.connect();

await kafkaConsumer.subscribe({ topic: 'test-topic' });
await kafkaConsumer.run({
  autoCommit: true,
  partitionsConsumedConcurrently: 1,
  eachMessage: async({ topic, partition, message }) => {
  	await wait(1000 * 60); // 60 seconds
  }
});

// Producer Side
const producer = kafka.producer()

await producer.connect()
await producer.send({
  topic: 'group-id',
  messages: [
    { value: 'testing message' },
  ],
})

async function wait(ms) {
  console.log(`waiting for ${ms} milliseconds..`);
  return new Promise((resolve) => { setTimeout(() => { resolve() }, ms);
  });
}

Expected behavior
Each consumer from the consumer group is expected to retry the message again & again
Observed behavior
the consumers stop to process any messages. consumer log (same log for each one of the consumers):
waiting for 60000 milliseconds..
{"level":"ERROR","timestamp":"2022-01-30T09:50:55.792Z","logger":"kafkajs","message":"[Connection] Response Heartbeat(key: 12, version: 2)","broker":"<IP_ADDRESS>:9092","clientId":"kafkajs","error":"The coordinator is not aware of this member","correlationId":19,"size":10}
{"level":"ERROR","timestamp":"2022-01-30T09:50:55.792Z","logger":"kafkajs","message":"[Runner] The coordinator is not aware of this member, re-joining the group","groupId":"task-handler-ts","memberId":"kafkajs-bbe11c7d-2eb4-441e-a32c-bff7841143a5","error":"The coordinator is not aware of this member","retryCount":0,"retryTime":268}
{"level":"INFO","timestamp":"2022-01-30T09:50:55.799Z","logger":"kafkajs","message":"[ConsumerGroup] Consumer has joined the group","groupId":"task-handler-ts","memberId":"kafkajs-e9557704-58b1-4e9e-b8d7-aa226f4f6fb8","leaderId":"kafkajs-e9557704-58b1-4e9e-b8d7-aa226f4f6fb8","isLeader":true,"memberAssignment":{"ts-3":[0,1,2]},"groupProtocol":"RoundRobinAssigner","duration":7}
{"level":"ERROR","timestamp":"2022-01-30T09:51:00.807Z","logger":"kafkajs","message":"[Connection] Response Heartbeat(key: 12, version: 2)","broker":"<IP_ADDRESS>:9092","clientId":"kafkajs","error":"The group is rebalancing, so a rejoin is needed","correlationId":28,"size":10}
{"level":"ERROR","timestamp":"2022-01-30T09:51:00.807Z","logger":"kafkajs","message":"[Runner] The group is rebalancing, re-joining","groupId":"task-handler-ts","memberId":"kafkajs-e9557704-58b1-4e9e-b8d7-aa226f4f6fb8","error":"The group is rebalancing, so a rejoin is needed","retryCount":0,"retryTime":241}
{"level":"INFO","timestamp":"2022-01-30T09:51:00.812Z","logger":"kafkajs","message":"[ConsumerGroup] Consumer has joined the group","groupId":"task-handler-ts","memberId":"kafkajs-e9557704-58b1-4e9e-b8d7-aa226f4f6fb8","leaderId":"kafkajs-e9557704-58b1-4e9e-b8d7-aa226f4f6fb8","isLeader":true,"memberAssignment":{"ts-3":[1]},"groupProtocol":"RoundRobinAssigner","duration":5}

After this, the consumer just hang.
Environment:

OS: [e.g. Mac OS 11.5.2]
KafkaJS version [e.g. 1.15.0]
Kafka version [e.g. 2.2.0]
NodeJS version [e.g. 14.5.0]

Additional context
Observed on production with 15 partition topic as well

Same here


delete nvm environment variables

NVM_IOJS_ORG_MIRROR and NVM_NODEJS_ORG_MIRROR environment variables can mess
up headers, delete them to make sure node-gyp uses correct url when downloading headers to ~/.node-gyp
Closes https://github.com/mafintosh/prebuild/issues/84

cc @hintjens

Neat, thanks.

LGTM


gapi.client library 404 when hitting Google API

We are having issues within our webapp when we try to hit a particular Google API.  We can provide more details in email or private communication.  We have validated that using oauth, we are able to get a response from the API using the Google Oauth Playground (https://developers.google.com/oauthplayground/) as well as Postman. This means that we have validated that the API works in production. Additionally, we are able to make a successful request to the API from our GAE app using a .post method to the URL. However when this code is actually written in a function using the gapi.client libraries, we are getting a 404. It appears that the gapi client does not know how to hit the URL.
I have read all documentation on this method including this oauth example: https://developers.google.com/api-client-library/javascript/samples/samples and we validated that our code works with public versions of APIs.

Could you provide more details on what is the method you are calling, and how are you using the gapi.client?

Have you get 'TypeError gapi.client is undefined'? If so, you should replace

with
<script src="https://apis.googe.com/js/client:plusone.js" type="text/javascript>


Backport #22233, #22400, and #22402 to 1.28

This PR backports the following PRs:

Add Health Check and Proto Reflection to basic C++ example server.
Building C++ example with grpc++ instead of grpc++_unsecure
Adding an error to properly report credential missing CreateXdsChannel.

Failures:

https://github.com/grpc/grpc/issues/18430
Node confirmed not be an issue after checking with @murgatroid99


Email: Show total count in email

In email total count is not displayed.

Fixed in this https://github.com/adiralashiva8/testng-metrics/commit/3288b5af9e429828df433c54ecfceed90cef1001 commit


Take into account pipx version of shortnames.conf

Installed in the ~/.local/pipx/venvs/ramalama location

There's a possibility we could get ramalama to re-exec itself early in a venv also... But this works for now...

LGTM


baldor: 0.1.2-0 in 'indigo/distribution.yaml'

Increasing version of package(s) in repository baldor to 0.1.2-0:

upstream repository: https://github.com/crigroup/baldor.git
release repository: https://github.com/crigroup/baldor-release.git
distro file: indigo/distribution.yaml
bloom version: 0.6.1
previous version for package: 0.1.1-0

baldor
* Add function to estimate the transformation between two axes (#3)
* Contributors: fsuarez6

Is it intentional to remove the doc section?

Yes. The Code API generated for indigo doesn't get generated properly. The package is the same for indigo and kinetic, so, people interested in looking into the API can check the one generated for kinetic.

Ok, it is your call. If you prefer to remove the indigo doc job over investigating why it fails that is fine with me.


Field does not return serialized values via getSerializedFieldValues()

When calling the Element's getSerializedFieldValues() method on an element that has a Colour Swatches field in the field layout, the return is not serialized — it's the model.
In the following example, I have an element with a field handle colorTheme.
When I call:
$element->getSerializedFieldValues();

I get:
[
	// other fields, which are all serialized as expected...
	'colorTheme' => percipiolondon\colourswatches\models\ColourSwatches {...}
]

That method calls each field's serializeValues() method here in Craft source.
I do see in this plugin's source that the Colour Swatches field has its own serializeValues() implementation, so I'm not quite sure what is happening.

Craft v4.11.5
Colour Swatches v4.5.2

Thank you for the issue, we will look into it!


Beta release: 0.2.1_beta

Before to publish the new release, I would like to be sure that I didn't broke a couple of feature.
1- I completely changed the way how the grabber read the frames from the buffer. Both the grabber (h264grabber) and the rtsp server (rRTSPServer) are new.
2 - After several issues about the wrong watermark time, I moved the export of the TZ environment variable.
Anyone want to try the new version?
And check if:
1 - The rtsp stream is ok.
2 - The date/time is ok in the app, the date/time is ok in the web gui, the videos are playable in the app, the events page shows the proper date/times. Remember to set the timezone of your region both in the app and in the web gui.
https://github.com/roleoroleo/yi-hack-Allwinner-v2/releases/tag/0.2.1_beta

I'm attempting to test this beta version on y28ga, but having issues with it rebooting contantly, and the normal fix to disable the audio didn't work, then I disabled everything else except ssh and web and it still continues to reboot.  I'm going to run the remove hack and then try to re-apply and see if that corrects it,
Will keep you updated.

I tested it before tu publish and it seems working fine with my y21ga.
If the problem persists, try the new unbrick procedure:
https://github.com/roleoroleo/yi-hack-Allwinner-v2/tree/master/unbrick

well damn.. I just revived this camera from what i thought was bricked a few days ago using that unbrick process, and now I've managed to brick it again, but this time that unbrick process isn't working :(  Going to unplug it for a bit and try again after lunch.. lol maybe being powered off for a bit will change something lol fingerscrossed

Which model suffix?

y28ga  The unbrick worked the first time around, this time nothing happens.

Hi rolee.
Thanks for this release.
Just installed r35gb_0.2.0.tgz on my Dome Guard.
So far:

Cam timezone, video recording and video playback in the app are ok
Snapshot in web UI is also fine but still two timecodes are shown

Time and date at /index.html are ok
Events page semms to be ok

The test ran about 30 minutes so far, I`ll leave the cam online and will have an eye on it.

Ok, finally got a chance to test out the beta on my Dome Guard Cam r35gb.  Already had the hack applied so just updated by deleting everything off the sd card and extracting the new hack.  Made my custom changes to the conf files and booted up.  1 Reboot later and it was up and running smoothly.
Results:

Snapshot has the correct time EST but there are 2 timestamps one on the bottom right and one on the top left
if i change the url to say no to the watermark the timestamp in the top left remains
RSTP stream works smoothly, proper time in the upper left hand corner
date time stamps are correct everywhere EXCEPT for the folder structure name is incorrect
I can however scroll through the timeline in the app and watch recorded events in the app!

Than you for yuor feedback.
A couple of notes:

Snapshot in web UI is also fine but still two timecodes are shown

Yes, I can't remove the watermark added by yi (upper left).

For me its confusing that v2.2.1_beta is named v2.2.0.

Yes, my mistake.

date time stamps are correct everywhere EXCEPT for the folder structure name is incorrect

The directory structure created by the yi processes is UTC and if I try to change it, dates and times are not consistent.

I'll join here because I'm experiencing the issue of playback from SD card of previous events recorded by my y21ga.
I made the following settings about timezone:

in the camera: "CET-1CEST,M3.5.0,M10.5.0/3"
in the app: "UTC" (as of page recommendation)
Is that wrong?

When I try to playback, I'll see often the Kami Cloud request. If/when I can start watch a video I can't seek back where I want: the app go to live preview or to a wrong time in the past.

@outofsight  You want to set both the Camera and the Hack to your timezone.  UTC is what the application uses in the background.

@outofsight You want to set both the Camera and the Hack to your timezone. UTC is what the application uses in the background.

Thanks, I made UTC setting in the app because I read this on the Hack Settings page:

Timezone | Timezone. Get your timezone string from this page and copy here. If you want to use this feature, please set time to "UTC +0 Coordinated universal time" in the app.

I will fix this problem in the next release.

I will fix this problem in the next release.

What fix are you going to apply?  I thought this was working already?

There are 2 changes related to the date/time available in the next release.

I moved the TZ settings so only hack programs read it.
I changed mqttv4 because motion_files messages was wrong.

The beta version tested in this thread contain only the 1st change.

In the last release should I put the correct TZ both in Yi app and in Hack?

Yes.


[Toast] z-index

For what version of Nuxt UI are you asking this question?
v3-alpha
Description
I have labelled it as a question, it could be a bug, but I will let you decide.
It seems like the Toast component has not a high enough z-index to be above everything. (Should it?)
I took notice when using the Drawer but I guess (not tested) it applies i.e. to the Slideover as well. The Toast Message has appeared under the Drawer so the user cannot see it. Imo the toast should be above everything.
Both Drawer and Toast have a z-index of 100 if I saw that correctly. I tried to change the z-index inside the Toastproperties but that doesn't seem to have an effect.
I worked around and just put the Toast in another corner so the user can see it but still is unable to interact with it because the Drawer will close if he clicks outside.
But maybe there is another way to deal with this?

This also seems to happen with an open <UModal>


chore(weave): add pandas a legacy query engine requirement

Description

Fixes WB-NNNNN
Fixes #NNNN

What does the PR do? Include a concise description of the PR contents.
Testing
How was this PR tested?

#2972  👈
master

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @bcsherma and the rest of your teammates on  Graphite


Some problems about the Paper.

Hello, author, I recently saw this paper of yours and I have questions about some of them:

Data set construction: I am curious about the manual replacement of 250 examples for MS-COCO. Are the segment_descriptions here all come up by myself? And then there's layout mask, how is this layout png constructed?
Regarding the improvement of self-attention and cross-attention layers in the generation of diagrams, I have read a lot of papers recently, and I feel that the improvement point is relatively small, are there any other areas for improvement?

Hi, @6Roy,
Regarding the first question, we just segmented the original texts rather than coming up with all the object-wise labels from scratch. It is also the case for layout images, since MS-COCO dataset offers instance-wise layout labels.
For the second question, I first want you to consider the difficulty of evaluating generative models especially when the target is so specific as ours. As you mentioned, our method shows small improvements on some metrics but we would like to emphasize that the strongest contribution is coming from improving the fidelity to layout conditions of existing t2i model even without requiring fine tuning process.


cuSolverRF: sparse refactorization

Description
[from CUDA docs]
The cuSolverRF library was designed to accelerate solution of sets of linear systems by fast re-factorization when given new coefficients in the same sparsity pattern.
Additional Information
No response

Thanks for raising a feature request @ma-sadeghi! Could you share the context / use-case of this request? e.g., do you want to use it in cupyx.scipy.sparse or just want a thin wrapper for the API?

Sure! Let's say we want to solve a PDE with a nonlinear source term (let's say heat equation with a nonlinear source term):
div(u) = f(u)

Typically, this problem can be solved by linearizing the source term and then we'll have a linear system of equations:
Au = b

The above system of equations needs to be iterated (solve for u, re-evalute the linearized f using the new u, update A, and b, and re-solve the system) where at each iteration, both A and b slightly change, but the sparsity pattern doesn't (since that depends on the spatial discretization, which we assume to not change). According to the CUDA docs, this refactorization thing is supposed to be able to re-solve the system much quicker than actually solving it for the first time (that involves factorization).
Regarding what I wanted, I haven't used the CUDA C API, so I don't even know how it's supposed to work, I just came across the docs page and thought it's perfect for the situation I just described. If you think we need more info before proceeding, I can read up the docs page more carefully and see how it's used.


Using the latest commit will panic

Describe the bug
panic after running for a few seconds
To Reproduce
Package with latest commit
OS: Centos7.6
Go Version: go1.16.5

Thanks for your report. Can you share a config file with which to reproduce this issue?


Text width changes when not in typewriter mode

This module is my favorite typewriter module, but I refrain to use it because of the following problem.
When the window is relatively narrow (or on an iPhone), we can see that the margins change and become quite large when typewriter mode becomes deactivated.
It would be useful that the margins do not change between both modes (and are not too big, like when not using this plugin): otherwise lines are really short and harder to read, on an iPhone.

This should be fixed in the latest release, 1.0.0-rc.4. You're welcome to try it. Please reach out to me, if the problem persists.

Perfect, thanks a lot!! I switched back to using this plugin!


Issue with lines when its " enclosed

I am having issue when csv line having double quote. see below-
Id,User,Lead,Assigned to,Reports to,First name,Last name,Access,Title,Department,Source,Email,Alt email,Phone,Mobile,Fax,Blog,Linkedin,Facebook,Twitter,Born on,Do not call,Deleted at,Created at,Updated at,Background info,Skype,Subscribed users,Cf geschlecht,Cf akademischer grad,Cf kontext,Cf unternehmensbereich,Tags;
“3,8,78,,,AMit v,Public,HR-Staff Development,"""",other,abcr@svg.com,"""",3232323,"""","""",www.kkk.com,"""","""","""",,false,,2011-04-12 12:55:30 +0200,2013-12-03 16:37:02 +0100,,"""",#Set:3232323,female,"""",,HR,""""";
Any help will be appreciated much.

Quick questions before :

Is the double at the beginning of the line a mistake ?
For empty field my understanding is that you can either have nothing or four double quotes?

closing this as no comment has been provided ...


Undef small and near if defined

Not only happens on MSVC but also on MinGW (and probably all windows builds)

@mat007 have a look please. Should be low impact if I didn't mistype ;)

Coverage remained the same at 97.394% when pulling c71fe6c9128e0051385a78002d18d485d676b559 on Flamefire:mingw into 1b5d8c84ef02b6cc9f787ec3ffefae7d75f2e7ff on mat007:master.

Thanks!


Fixing multi-submission

Fixes #6788
@sebastienros
Just because i still have some drawbacks with your last multi-submission checking, here, a proposed solution which seems to work. So, based on the last implementation but:

Without using e.preventDefault() at the end. This to submit the form.
And without adding to the buttons the disabled property. Otherwise the button value e.g submit.Publish is not used and e.g you will not see Your Page has been saved.

Note: as before, this only acts on forms with the no-multisubmit class.
Best.

Fixed #6788

Good to go!

I must have left the last preventDefault while testing, but why remove the disabled button?

Checked locally and disabling the buttons prevents the data from being submitted, and the route binding is wrong then as it relies on that (save vs publish).


start-env job uses build.devcloud.yml

I believe this should be using docker-compose.yml (or docker-compose.devcloud.yml).
https://github.com/phase2/generator-outrigger-drupal/blob/master/generators/jenkins/templates/jobs-optional/start-env/config.xml

Correct. stop-env just called teardown which is correct.


Make gc-profiler optional

Bump required version to 1.4.1.

Build on Node v12 was fixed in this version.
It's only used when gc option is requested, so if the user doesn't have build env don't fail to install memory-usage.

ping

ping?

Is this project dead?


Initial work on cli

Adds apistar validate <schema_file> and apistar docs <schema_file>

Needs refinement, but I'd rather get it pulled in now.


Filter spammy sockjs.tornado errors more specifically

See #6959 . This issue is for the follow-up to make a more narrowly-targeted fix, like the one discussed there.

Mooted by the removal of the websockets code in ea6934c26d226055f0d1fac6737e4b235f0d7783.


Return Windows XP support

Is possible give back the Windows XP support which was stopped by Google from Chrome 50?
It was really unfortunate for many who still use Windows XP (including me)

This will not be a trivial change. The Chrome developers are using Windows API features and libraries that don't work on XP, so all of those will have to change. Also, some technologies used for sandboxing aren't available on XP. You may even need to tweak some compiler settings to make this work too.
If someone wants to do this, go ahead. I don't have to knowledge to do it even if I wanted to.
I'm closing this for now since I don't consider this a feature that many users here will use, much less want to implement. If someone has the knowledge and is willing to take this up, please respond.

I understand, really thank you very much for your reply.


Irregular length episodes within seasons

just wondering how hummingbird handles these, for example the episode of kekkai sensen that just aired was 45 minutes and the rest of the season was a standard 24 minutes per episode, just wondering it those extra minutes are recorded or not?

We don't handle it on a per-episode basis. So in this case it would be recorded as 24m.

Often what what uses the average episode length

just seems kind of inaccurate, maybe you could have something like "12 episodes 24 min each + 45 min episode".

Ideally we would be able to set per episode lengths, but right now that's not viable. Down the road it's possible

I actually added this capability in V3


High CPU utilisation on idle

I notice that, while doing nothing (no I/O events) and no client connected,  pigpiod daemon jumps from time to time up to 15% CPU on Raspberry PI 2, and very often stays between 5.7% - 7.6%.
The usage seems too high, do you know how can be reduced?
Thanks,
Dan

I see 10% most of the time on a gen 1 Pi.  I've been told that the daemon is constantly polling the status of all the gpio lines.  That said I wonder if there's a way to have an option to only poll if some request to read the gpio has been performed?

Exactly, this will be a very good optimisation.
On Oct 24, 2015 23:40, "John P Masseria"<EMAIL_ADDRESS>wrote:

I see 10% most of the time on a gen 1 Pi. I've been told that the daemon
is constantly polling the status of all the gpio lines. That said I wonder
if there's a way to have an option to only poll if some request to read the
gpio has been performed?
—
Reply to this email directly or view it on GitHub
https://github.com/joan2937/pigpio/issues/29#issuecomment-150849337.

I'm not very familiar with Broadcom BCM2835 chip low level programming but I assumed pigpio uses interrupts and will not need to perform pooling, isn't that the case?
https://blog.mayflower.de/2073-Using-GPIO-on-Raspberry-Pi.html

pigpio is continually sampling GPIO 0-31 at 200 thousand times a second by default.
You simply can not capture the data captured by pigpio by using any other method (known to me).
Using interrupts would fail on a number of counts, 1) the GPIO edges would not be accurately timestamped, 2) short (circa 100 µs or less) GPIO edges in succession would be lost, 3) the CPU would be spending 100% of its time handling interrupts.
The only area where interrupts score is in better average latency, 50 µs versus 500 µs for the batched sample approach of pigpio.
The sampling itself is done at 0 CPU cost.  The CPU time is spent going through the samples and collating GPIO changes.
At the default 5 µs sampling rate 7.5% CPU is a good average.  Remember that the Pi2 has four CPUs so pigpio is using about 2% of the available power.

Thanks for clarifications.
Is there a way to reduce the number of GPIO sampling loops per second, less than 200.000? My app will not need this level of sensitivity, I only look for button presses.

You could start the daemon with 10 µs sampling (sudo pigpiod -s 10).  It'll make a difference but not a great deal.
If all you want to do with the GPIO is detect button presses you would be better off with one of the other GPIO libraries which don't have pigpio's sampling overhead.

Thanks, I will try.
I really like pgpiod because it does not need root access right for the
client app, seems to be the only one, compared with other libraries out
there, so I'll stick with it :-)

I tried with parameter -s 10 and CPU usage dropped to 2.9 - 3.9% on my PI 2.
pigpiod is still very sensitive to button state changes so I think my app will work well enough with an even lower sensitivity, thus decreasing CPU usage even more.
Any chance to add more sensitivity levels above 10µs?

I'll think about adding a 20 µs sampling rate.  It will not be a priority though and I'll only add it if it causes pretty much no disruption to the existing code.

understood, thanks.
On Oct 28, 2015 13:32, "joan2937"<EMAIL_ADDRESS>wrote:

I'll think about adding a 20 µs sampling rate. It will not be a priority
though and I'll only add it if it causes pretty much no disruption to the
existing code.
—
Reply to this email directly or view it on GitHub
https://github.com/joan2937/pigpio/issues/29#issuecomment-151809589.

Is it possible to set the sampling rate to something close to 0 if you only write pins but don't read any pin?

@paviro You could probably find a more appropriate module, e.g. perhaps servoblaster, if all you are interested in is PWM.

I shall not be adding a lower sampling rate.  If the sampling overhead is too much for the application then pigpio probably isn't the right library to use.

You could try the -m option to the pigpio daemon as that will disable alert sampling.   If you are not using the daemon you could use the gpioCfgInterfaces() option and or in PI_DISABLE_ALERT.

Thanks for the tipp. Which version has the -m switch? pigpio V64 doesn't seem to have it.


📝 Add Docs for features added as part of v2 and marketing materials

🎯 Aim
The aim is to extend current wiki docs and readme with features added as part of v2. Additionally add marketing materials (shorts, movies and images) for those features.
✅ Things ToDo:

[x] wiki and readme: CI/CD pipeline
[ ] short: CI/CD pipeline
[x] movie: CI/CD pipeline
[x] wiki and readme: grant API permissions
[ ] short: grant API permissions
[ ] movie: grant API permissions
[x] wiki and readme: rename project
[ ] short: rename project
[x] movie: rename project
[x] wiki and readme: site collections support
[ ] short: site collections support
[x] movie: site collections support
[x] wiki and readme: Code snippets

Record the movies after rebranding so after 2.1 release


Allow max_length 0 in dict_generic

Closes #3

Test generation of empty dict
Generate dict with min size 0
Update birdie dict shrink test

Thanks for the pull request.  If you could address the couple of comments, then I will accept it.

I ran gleam format to address the failure on CI.
I'll be happy to address any comments, however, I don't currently see any on GitHub.

I'll be happy to address any comments, however, I don't currently see any on GitHub.

Sorry about that, I forgot to submit them.

Thank you! I've updated the PR.

The CI checks are failing, but it is due to the formatting.  This workflow had been on an older version of Gleam and so had slightly different formatting, and I figured that you may have been using the latest Gleam.  I have updated the repository and workflow to use the formatting from Gleam version 1.2.1.  After re-running the workflow, I see the formatting checks are still failing.  So, if you can address that, everything else looks fine.

Thanks again for this!!


Getting error when running

using python3:
File "/Users/m3kwong/PythonCode/LLM/pdfGPT-main/app.py", line 2, in
import fitz
File "/Users/m3kwong/PythonCode/LLM/pdfGPT-main/new/lib/python3.10/site-packages/fitz/init.py", line 1, in
from frontend import *
File "/Users/m3kwong/PythonCode/LLM/pdfGPT-main/new/lib/python3.10/site-packages/frontend/init.py", line 1, in
from .events import *
File "/Users/m3kwong/PythonCode/LLM/pdfGPT-main/new/lib/python3.10/site-packages/frontend/events/init.py", line 1, in
from .clipboard import *
File "/Users/m3kwong/PythonCode/LLM/pdfGPT-main/new/lib/python3.10/site-packages/frontend/events/clipboard.py", line 2, in
from ..dom import Event
File "/Users/m3kwong/PythonCode/LLM/pdfGPT-main/new/lib/python3.10/site-packages/frontend/dom.py", line 439, in
from . import dispatcher
File "/Users/m3kwong/PythonCode/LLM/pdfGPT-main/new/lib/python3.10/site-packages/frontend/dispatcher.py", line 15, in
from . import config, server
File "/Users/m3kwong/PythonCode/LLM/pdfGPT-main/new/lib/python3.10/site-packages/frontend/server.py", line 24, in
app.mount(config.STATIC_ROUTE, StaticFiles(directory=config.STATIC_DIRECTORY), name=config.STATIC_NAME)
File "/Users/m3kwong/PythonCode/LLM/pdfGPT-main/new/lib/python3.10/site-packages/starlette/staticfiles.py", line 57, in init
raise RuntimeError(f"Directory '{directory}' does not exist")
RuntimeError: Directory 'static/' does not exist

try pip install fitz

I was getting the same error (when deploying to HuggingFace), I was able to resolve this by not adding fitz or frontend in the requirements.txt.

same error.
P.s i already installed fitz and frontend

same error
howo to solve it ?


How to include the encoder + decoder in a simple c program

Hello, I am trying to use lyra in a simple c program (hello world) which is built with cmake. As you can see in the screenshot, I can build lyra with bazel (run cmake .. && make && ./main.o from the build dir) but now I am stuck on how I can actually include lyra in the main.c file and how I can link the encoder_main and decoder_main binaies to my main.o file. Can someone help me out? Thanks!

First, is there a strong reason to use cmake? Cause it should be easier to build and include it in bazel, just cause Lyra uses bazel.
Second, I am not sure what you are trying to do, but you most likely want to include lyra_encoder and lyra_decoder, since that is the actual codec API. You can see an example on how to include them in encoder_main_lib and decoder_main_lib, since those are just example file demos. You can also directly include these last ones, if you are dealing with files. An example on how to do that can be seen in encoder_main and decoder_main. But these last ones aren't meant to be be included, since they are just binaries, not libraries.

Sorry for my vague description - yes, basically, I want to use lyra to encode an audio stream. This stream will be sampled by a nrf5340 chip and therefore I also need cmake because the nrf toolchain or Zephyr in general, rely on cmake.
Nevertheless, the problem with my setup is that:
1.) I need to make VSCode aware that I use lyra (screenshot - right side)
2.) somehow link the encoder_main and/or decoder_main to my main.o inside cmake.
Basically this is where I am really stuck now.

That makes a lot of sense, thank you for clarifying.
1.) While I'm no cmake expert, it seems like your linker isn't finding the lyra_encoder header, so you probably need to add the lyra directory explicitly.
2.) You probably don't want to link encoder_main or decoder_main, since they are binaries, but lyra_encoder and lyra_decoder instead.

Aaah thank  you very much! Yes this makes sense. I'll look into it and find a way on how I can add the lyra directory to cmake but without compiling it when I exec make.
Nevertheless, one last question: since I need to somehow have a .so (to my understanding), is there a way in bazel that I can also create a lyra_encoder.so inside the lyra bin dir?

Absolutely! You can build Lyra .so libraries using bazel:
bazel build -c opt :encoder_main
bazel build -c opt :decoder_main

You can also add --config=android_arm64 flag to build for Android ARM64 devices.

Aah perfect, thank you very much!


RimAtomics Long Range attacks desync game on host

While playing w/ a friend, we raided a bandit outpost and I tried to support via Punishers, yea they broke it. Hard. The host is fine, but the world will not load for me anymore Log Here. We have rolled back and everything is still not ok. Any ideas?

Unloading and reloading mod list did the trick

Now the host is having problems with trade ships and crafting, still looking into it


Open user data folder developer command doesn't work on Mac

The command workbench.action.openUserDataFolder seems to only open the finder and not the actual folder.

It seems to work for me on Mac. Any errors do you see? Or do you have special user data folder configured?


install in local failure

[root@localhost ~]# sealer run kubernetes:v1.19.9 --masters <IP_ADDRESS> --nodes <IP_ADDRESS>
2021-08-24 08:27:52 [WARN] [current_cluster.go:51] current cluster not found, new kube build config failed: stat /root/.kube/config: no such file or directory, will create a new cluster
2021-08-24 08:27:52 [INFO] [default_image.go:55] image kubernetes:v1.19.9 already exists

2021-08-24 08:28:51 [EROR] [run.go:55] mount rootfs failed check for node ssh service time out: wait for [<IP_ADDRESS>] ssh ready timeout

<IP_ADDRESS> is the localhost IP.

Make sure the current machine can login using SSH or use password.
sealer run -h

@ysicing Long time no see.


[SUPPORT] HoodieDeltaStreamer not inferring schema from JsonDFSSource

Tips before filing an issue

Have you gone through our FAQs?

Join the mailing list to engage in conversations and get faster support at<EMAIL_ADDRESS>

If you have triaged this as a bug, then file an issue directly.

Describe the problem you faced
I have been successful in using HoodieDeltaStreamer on AWS Glue ETL when using the source class ParquetDFSSource. However, when dealing with JsonDFSSource, I am forced to specify a schema provider class.
2022-06-07 17:39:22,292 ERROR [main] glue.ProcessLauncher (Logging.scala:logError(94)): Exception in User Class
org.apache.hudi.exception.HoodieException: Please provide a valid schema provider class!
	at org.apache.hudi.utilities.sources.InputBatch.getSchemaProvider(InputBatch.java:55)
	at org.apache.hudi.utilities.deltastreamer.SourceFormatAdapter.fetchNewDataInAvroFormat(SourceFormatAdapter.java:64)
	at org.apache.hudi.utilities.deltastreamer.DeltaSync.readFromSource(DeltaSync.java:425)
	at org.apache.hudi.utilities.deltastreamer.DeltaSync.syncOnce(DeltaSync.java:290)
	at org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer.lambda$sync$2(HoodieDeltaStreamer.java:193)
	at org.apache.hudi.common.util.Option.ifPresent(Option.java:96)
	at org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer.sync(HoodieDeltaStreamer.java:191)
	at GlueApp$.main(logistics_hoodiedeltastreamer:49)
	at GlueApp.main(logistics_hoodiedeltastreamer)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.amazonaws.services.glue.SparkProcessLauncherPlugin.invoke(ProcessLauncher.scala:48)
	at com.amazonaws.services.glue.SparkProcessLauncherPlugin.invoke$(ProcessLauncher.scala:48)
	at com.amazonaws.services.glue.ProcessLauncher$$anon$1.invoke(ProcessLauncher.scala:78)
	at com.amazonaws.services.glue.ProcessLauncher.launch(ProcessLauncher.scala:143)
	at com.amazonaws.services.glue.ProcessLauncher$.main(ProcessLauncher.scala:30)
	at com.amazonaws.services.glue.ProcessLauncher.main(ProcessLauncher.scala)

So I opted to use the FilebasedSchemaProvider class, however my job fails with:
2022-06-07 18:09:01,368 ERROR [main] glue.ProcessLauncher (Logging.scala:logError(94)): Exception in User Class
java.io.IOException: Could not load schema provider class org.apache.hudi.utilities.schema.FilebasedSchemaProvider
	at org.apache.hudi.utilities.UtilHelpers.createSchemaProvider(UtilHelpers.java:129)
	at org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer$DeltaSyncService.<init>(HoodieDeltaStreamer.java:612)
	at org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer.<init>(HoodieDeltaStreamer.java:142)
	at org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer.<init>(HoodieDeltaStreamer.java:114)
	at GlueApp$.main(logistics_hoodiedeltastreamer:50)
	at GlueApp.main(logistics_hoodiedeltastreamer)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.amazonaws.services.glue.SparkProcessLauncherPlugin.invoke(ProcessLauncher.scala:48)
	at com.amazonaws.services.glue.SparkProcessLauncherPlugin.invoke$(ProcessLauncher.scala:48)
	at com.amazonaws.services.glue.ProcessLauncher$$anon$1.invoke(ProcessLauncher.scala:78)
	at com.amazonaws.services.glue.ProcessLauncher.launch(ProcessLauncher.scala:143)
	at com.amazonaws.services.glue.ProcessLauncher$.main(ProcessLauncher.scala:30)
	at com.amazonaws.services.glue.ProcessLauncher.main(ProcessLauncher.scala)
Caused by: org.apache.hudi.exception.HoodieException: Unable to instantiate class org.apache.hudi.utilities.schema.FilebasedSchemaProvider
	at org.apache.hudi.common.util.ReflectionUtils.loadClass(ReflectionUtils.java:91)
	at org.apache.hudi.common.util.ReflectionUtils.loadClass(ReflectionUtils.java:100)
	at org.apache.hudi.utilities.UtilHelpers.createSchemaProvider(UtilHelpers.java:127)
	... 15 more
Caused by: java.lang.reflect.InvocationTargetException
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
	at org.apache.hudi.common.util.ReflectionUtils.loadClass(ReflectionUtils.java:89)
	... 17 more
Caused by: org.apache.avro.SchemaParseException: Illegal character in: ...
	at org.apache.avro.Schema.validateName(Schema.java:1151)
	at org.apache.avro.Schema.access$200(Schema.java:81)
	at org.apache.avro.Schema$Name.<init>(Schema.java:489)
	at org.apache.avro.Schema$Names.get(Schema.java:1111)
	at org.apache.avro.Schema.parse(Schema.java:1263)
	at org.apache.avro.Schema$Parser.parse(Schema.java:1032)
	at org.apache.avro.Schema$Parser.parse(Schema.java:1004)
	at org.apache.hudi.utilities.schema.FilebasedSchemaProvider.<init>(FilebasedSchemaProvider.java:59)
	... 22 more

I am a bit lost, because when I use the RowBasedSchemaProvider class, the job fails with a different error than this:
2022-06-07 16:53:45,919 ERROR [main] glue.ProcessLauncher (Logging.scala:logError(94)): Exception in User Class
org.apache.hudi.spark.org.apache.spark.sql.avro.IncompatibleSchemaException: Unexpected type null.
	at org.apache.hudi.spark.org.apache.spark.sql.avro.SchemaConverters$.toAvroType(SchemaConverters.scala:199)
	at org.apache.hudi.AvroConversionUtils$.convertStructTypeToAvroSchema(AvroConversionUtils.scala:63)
	at org.apache.hudi.AvroConversionUtils.convertStructTypeToAvroSchema(AvroConversionUtils.scala)
	at org.apache.hudi.utilities.schema.RowBasedSchemaProvider.getSourceSchema(RowBasedSchemaProvider.java:47)
	at org.apache.hudi.utilities.schema.SchemaProviderWithPostProcessor.getSourceSchema(SchemaProviderWithPostProcessor.java:42)
	at org.apache.hudi.utilities.deltastreamer.DeltaSync.registerAvroSchemas(DeltaSync.java:800)
	at org.apache.hudi.utilities.deltastreamer.DeltaSync.<init>(DeltaSync.java:227)
	at org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer$DeltaSyncService.<init>(HoodieDeltaStreamer.java:614)
	at org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer.<init>(HoodieDeltaStreamer.java:142)
	at org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer.<init>(HoodieDeltaStreamer.java:114)
	at GlueApp$.main(logistics_hoodiedeltastreamer:48)
	at GlueApp.main(logistics_hoodiedeltastreamer)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.amazonaws.services.glue.SparkProcessLauncherPlugin.invoke(ProcessLauncher.scala:48)
	at com.amazonaws.services.glue.SparkProcessLauncherPlugin.invoke$(ProcessLauncher.scala:48)
	at com.amazonaws.services.glue.ProcessLauncher$$anon$1.invoke(ProcessLauncher.scala:78)
	at com.amazonaws.services.glue.ProcessLauncher.launch(ProcessLauncher.scala:143)
	at com.amazonaws.services.glue.ProcessLauncher$.main(ProcessLauncher.scala:30)
	at com.amazonaws.services.glue.ProcessLauncher.main(ProcessLauncher.scala)

To Reproduce
Steps to reproduce the behavior:

Build hudi package and upload to S3
Create AWS Glue Job and set --extra-jars as per the documentation
Write a wrapper in Scala to call the HoodieDeltaStreamer constructor and pass the necessary arguments

Expected behavior
Initially I expected HoodieDeltaStreamer to work with schemaProviderClassName=null and to infer the schema based on the source data. I understand that the schema is explicitly defined in parquet files, hence the ParquetDFSSource source class working without the schemaProvider.
After that, I expected the FilebasedSchemaProvider to work as it should. Not sure if I am missing anything in my set up. I did define the hoodie.deltastreamer.schemaprovider.source.schema.file and hoodie.deltastreamer.schemaprovider.target.schema.file in my properties file.
Environment Description

Hudi version : 10.0.1

Spark version : 3.1.1

Hive version : N/A

Hadoop version : N/A

Storage (HDFS/S3/GCS..) : S3

Running on Docker? (yes/no) : no

Additional context
I don't have a load of experience with Java/Scala. If the answer is to set the right classPath, how should I go about that in AWS Glue and also why does it work for RowBasedSchemaProvider?
Stacktrace
See above

Just noticed the following line in the stack trace:
Caused by: org.apache.avro.SchemaParseException: Illegal character in: ...
Looking into this right now. Seems like I did not handle the nested schema properly.

yes, some issue w/ the schema that you have passed in.

Yep, schema was the issue. Got it working now!

@nsivabalan I am curious though: why can HoodieDeltaStreamer not infer the schema from JsonDFSSource?
From the HoodieDeltaStreamer documentation:

By default, Spark will infer the schema of the source and use that inferred schema when writing to a table. If you need to explicitly define the schema you can use one of the following Schema Providers below.

yes, internally, hudi uses sparkContext.textFile(pathStr) to read json files and hence we need the schema for now. ifyou are  interested, we can file a jira for adding a new source where we read it as spark.json and so it automatically infers schema.


feat(Category/Theory/Monoidal): monoids in a symmetric category form a symmetric category

Thanks!
bors merge


Remove 30 character check

In the final 2.0 spec, the hashes type and the dictionary type in cyber observables are the only places that says the keys SHOULD be no longer than 30 characters. We need to remove this check from everywhere else (e.g. custom property names).

This is an issue with the spec, not the validator. See https://github.com/oasis-tcs/cti-stix2/issues/88.


Load entities in chunk data

Load the entities saved in the ChunkLevel NBT compound. See Entity Format for reference.
Similar to #72. Implementing each entity (including broadcasting to the player) will be on a per-entity basis, similar to the Item and Player entities, and not in the scope of this ticket.

One issue here is that the SystemData for whatever system is responsible for loading entities will be huge, since it will need access to practically every component storage. We might want to consider using specs::LazyUpdate to initialize entities so as to keep the code cleaner.


Delete .github/ISSUE_TEMPLATE directory

You had some trouble to use templates for filling issues with #2711 & #2712, you decided to delete it. Fair.


Fix typo in README.md

'bootsrap' to 'bootstrap'

Thanks!

:tada: This PR is included in version 8.0.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Feature idea: List all files included in search

Would be kinda nice to output the full list of files to a tree so I can easily see if there's a mistake in my include/ignore patterns. Could make a temp file and pipe find . -type f -name $ignorePatterns ! -path  $excludePatterns or whatever into it. Extension is pretty amazing, basically perfect, as is though.

Hi,
Apologies for late reply. The feature you requested has been implemented in version 2.0.0. Since this version you can find dedicated output with logs related to any triggered action and scanned directories structure. Hope it helps you somehow.
Regards,
Kamil


Expose properties

I'm not sure if TRAPI has this yet, but we want to expose the node properties that node types have in our meta_knowledge_graph endpoints.  This will help with https://github.com/ranking-agent/strider/issues/287

In this PR , node properties are computed for every node and the union of attribute sets of leaf nodes are presented in the meta kg graph.
Meta Kg node object has schema attributes property , the computed attributes are presented in this list.
This implementation drops id and name attributes from the final schema attributes list as those are core attributes.


python312Packages.libpwquality: fix build

ZHF: #352882
Follow up from: #346286

format to match the new standards in nixpkgs
pull in patches to move from distutils which doesn't work in 3.12+ to setuptools

setuptools configuration works for 3.11, might need to double check for the other python versions we support

I tried to drop the prefix patch all-together and just move the files from wherever they end up to $py/lib/... but I didn't manage to in the end
before:
S result-py
└── D lib
    └── D python3.11
        └── D site-packages
            ├── F pwquality-1.4.5-py3.11.egg-info
            └── F pwquality.cpython-311-x86_64-linux-gnu.so

after:
S result-py
└── D lib
    └── D python3.11
        └── D site-packages
            ├── D pwquality-1.4.5-py3.11.egg-info
            │   ├── F dependency_links.txt
            │   ├── F PKG-INFO
            │   ├── F SOURCES.txt
            │   └── F top_level.txt
            └── F pwquality.cpython-311-x86_64-linux-gnu.so

I expect this to be non breaking for egg-info but I'm not a python person
Things done

Built on platform(s)

[X] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.11 Release Notes (or backporting 23.11 and 24.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[X] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/prs-ready-for-review/3032/4856

That's about ~25000 rebuilds! Probably need to do some conditional patches for now, or retarget staging?

I guess if I throw the patch on just the python module rather than normal libpwquality that might cut the dependents.
Is there a good script to check the nixpgkgs tree for dependents?

Ok. There's actually very few mentions of libpwquality but one is systemd which is probably where things start.
I'm not really spotting any usages of the python module so I think the python only patching would do

@wegank @RossComputerGuy
This PR is back down to 1-10 packages and since we're waiting on some other PRs to release what are your thoughts on merge and backport?
If you'd prefer we could merge this and draft the backport for after the release is officially cut?


Hotfix: Fix MessengerApiException while fetching User profile with queryUserProfile method

This hotfix coorects the get User Profile bug.
While requesting User Profile we catch

MessengerApiException: (messenger4j#12) is_payment_enabled field is deprecated for versions v3.1 and higher

MessengerApiException: (messenger4j#12) last_ad_referral field is deprecated for versions v3.1 and higher

As a hotfix we can just remove is_payment_enabled and last_ad_referral  from the requested parameters in FB_GRAPH_API_URL_USER

Aymen, thanks for your PR. I already merged another PR addressing the same issue. If you want you can rebase your changes onto the current develop branch of messenger4j and squash your commits. As far as I remember there should be at least a difference in the UserProfileTest so that I can merge your PR too. Would like to reward your efforts. Thanks.


#1638 fixed bechmark, added test, use shutdownNow

GitHub issue resolved: #1638
Briefly describe the changes proposed in this PR:

fixes benchmark
add test and shutdown thread pool correctly
also changed a method from public to package private, it should not have been public to begin with!

@rdf4j-bot run tests


Guaranteed: POP3 connection failed

https://github.com/Webklex/php-imap/blob/e1296d18a01027b9d99728a2b3dee4e8b5b4d299/src/Connection/Protocols/LegacyProtocol.php#L82
According to documentation, /readonly: request read-only mailbox open (IMAP only; ignored on NNTP, and an error with SMTP and POP3).
It is required to update to make sure POP3 works.

Hi @xianzhe18 ,
many thanks for your report. I'm merging this issue with #402 .
Best regards,

This issue still exist also in alpha
Unknown: Can't get status of mailbox {pop3.***.nl:995/pop3/novalidate-cert/ssl}INBOX: invalid remote specification (errflg=2)
When changing the code like @ennnnny provided it works.


Material issues fix

:tada: This PR is included in version 1.10.1 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Session Feedback

Thanks for taking a couple of minutes to give feedback, which will help me improve for next time. Before doing anything else, hit the green button "Submit new issue" right now to save this issue content, rather than try to complete the feedback in this raw form. Then go through the questions and mark a single checkbox for each, to represent your answer. Finally, in the empty comment box below this one, please describe what you liked and what you didn't like.
How experienced were you with web development in general before this session?

[ ] Didn't know what HTML is
[X ] Heard about HTML/CSS/JavaScript, but never developed a web app
[ ] Used HTML/CSS/JavaScript before, but never developed a complete web app on my own
[ ] Developed one or more (smaller) web app(s) on my own
[ ] I am a very experienced web developer

How experienced were you with UI5 before this session?

[ ] Didn't know what UI5 was
[ X] Heard about UI5, but never developed a UI5 app
[ ] Used UI5 before, but never developed a complete UI5 app on my own
[ ] Developed one or more (smaller) UI5 app(s) on my own
[ ] I am Peter Muessig, or at least very experienced

How do you feel about UI5 now (after this session)?

[ ] Don't know what UI5 is
[ ] Know what UI5 is, but don't know how develop a UI5 app
[ X] Know how to use parts of it, but don't know how to built a complete application on my own
[ ] Know how to built a complete application on my own
[ ] I am Peter Muessig, or at least very experienced

Did this session meet your expectations?

[ ] Not really
[ ] Somewhat
[ ] Mostly
[ X] Fully

Was the time allotted to each exercise enough for you to work through them?

[ ] Not really
[ ] Somewhat
[ ] Mostly
[X ] Fully

What did you think of the extra information (collapsable sections 💬) and explanations provided?

[ ] Too much information
[ ] Didn't really read it, didn't really bother me though
[X ] Found it helpful as context and background

How did you find the way we all moved at the same pace through the exercises?

[ ] Would have preferred to go through them on my own at my own speed
[ ] Didn't mind, no strong feelings either way
[ X] Found it useful to keep pace and discuss the exercise questions, and reflect

Which development environment(s) did you use?

[ X] SAP Business Application Studio
[ ] Code editor on my local machine
[ ] Devcontainer

If you have time, please add a comment below to write free-form what you liked and what you disliked about the session. Thank you!

Hi @josimmmm, thank you for the feedback and attending the CodeJam. Looking forward to next time! Best, Nico


Add package rtree

Well, first All checks have passed was reported, and now there is This branch has conflicts that must be resolved
At least it seems not to work:
$ nimble refresh
Downloading Official package list
    Success Package list downloaded.
stefan@nuc ~ $ nimble search rtree
      Error No package found.
stefan@nuc ~ $ date
Thu 17 Oct 2019 04:00:24 AM CEST

I already clicked on Resolve conflicts but that seems not to work.


Typing error on setting component in defaultProps for 'MuiFormHelperText' when creating custom theme

Happens in TypeScript, totally fine in JavaScript.

[ x ] The issue is present in the latest release.
[ x ] I have searched the issues of this repository and believe that this is not a duplicate.

Current Behavior 😯
import { createTheme } from '@material-ui/core/styles';
const myTheme = createTheme({
  components: {
    MuiFormHelperText: {
        defaultProps: {
          component: 'div' // <-- typing error: 'component' does not exist in type 'Partial<FormHelperTextProps<"p", {}>>'.ts(2322)
        }
      }
  }
});

Expected Behavior 🤔
component should be defined in type definition

Steps to Reproduce 🕹

Steps:
See above
Context 🔦

Your Environment 🌎
TypeScript v4.3.5
@material-ui/core v5.0.0-beta.4

`npx @material-ui/envinfo`
  Don't forget to mention which browser you used.
  Output from `npx @material-ui/envinfo` goes here.

Duplicate of https://github.com/mui-org/material-ui/issues/27593


Change build.js.dev.ts to generate "sourceRoot" property instead of leaving it empty (enable debugging inside IDEA/Webstorm))

IMPORTANT: This repository's issues are reserved for feature requests and bug reports. Do not submit support requests here.
Steps to reproduce and a minimal demo of the problem

checkout current repo with IDEA or Webstorm

What steps should we try in your demo to see the problem?

create a javascript debug configuration with the Remote URL pointing to typescript sources:

npm run start
run the debug configuration and set a breakpoint on a typescript file
try to trigger the breakpoint by interacting with the browser

Current behavior
Since "sourceRoot" property is empty (from source maps files), IDEA/Webstorm cannot trigger breakpoints set in typescript files.
Expected/desired behavior
task: "build.dev" should fill in the "sourceRoot" property accordingly
Other information
Also check this issue from jetbrains having a proposal for the transpilation process:
https://youtrack.jetbrains.com/issue/WEB-22451
I have tried this proporsal myself but typescript is complaing that "path" cannot be resolved. Since I'm very new to gulp, I uncertain if this mean "APP_DEST" should be of Path or something similar.
If there is an easier way to debug angular-seed inside IDEA/Webstorm, I would like to know. I've tried following configurations without success:

javascript debug
nodejs run/debug
npm run/debug

And yes I know that chrome can handle this, but for me it's not a clean process, to change the environment (chrome dev tools) for debugging.
I've also created an issue at jetbrains for more clarification: https://youtrack.jetbrains.com/issue/IDEA-159932

@geekrumper thanks for reporting this issue. I'll see if I can take care of it today.

Having external sourcemaps is quite painful for istanbul and karma...You can enable/disable it for your project; take a look here.

Adding back in the commented out code did not generate the correct sourceRoot in the source map file.  The number of "../" in the sourceRoot was doubled + plus one.
Using an example to demonstrate what I am trying to explain: dist/dev/app/about/about.component.js.map "sourceRoot":"../../../../../src/client" (with the solution that is referenced by this thread.)
The result should be:
dist/dev/app/about/about.component.js.map "sourceRoot":"../../../src/client"
I believe the plus one is because relative wants to work with directories rather than files.  So instead of using file.path, using file.dirname could address that shortcoming.  More importantly the plugin that builds the sourcemap already is putting in the "../" for each directory deep from the root, which is why the "../" are being double in the actual sourceRoot setting in the map file.
If the about objects were nested under another directory, such as screens/about the number of extra "../" double for each layer deeper.
I have modify the logic and now get the correct sourceRoot.
 // Use for debugging with Webstorm/IntelliJ   // https://github.com/mgechev/angular2-seed/issues/1220     .pipe(plugins.sourcemaps.write('.', {       includeContent: false,       sourceRoot: (file: any) =>       relative(Config.APP_DEST, Config.PROJECT_ROOT) + '/' + Config.APP_SRC     }))
Through trial and error we realized that we needed ../../ to be added to the source map root and then let the plugin generate the "../" for how nested the js/ts file is.  I believe this is because the resulting files are stored into /dist/dev.  If someone has more knowledge here and a better explanation of why we needed the ../../ prefix I would be very interested to learn.
@mgechev can you try out this setting for building sourcemaps and see if it is still painful for istanbul and karma.
Thanks,
Tom

@TomJahncke That worked for me also.
Thanks.


adds weka_compatibility.sh script that makes a cluster compatible with weka

This has been extensively tested and its usage is described in eng-docs (once the pr is done. It essentially switches enroot and slurm_tmp to use /data.

#195


Create new citation, with existing one already in the DB

I have a lot of citations exported from previous project without a page numbers. When I create a new citation, would it be possible to check first if the citation without page number already exists in the DB  (same object, same source), and if it exists, just add the page to the existing citation.
If citation already exists for the same object but with different page number, I would preffer to get an error message, or a warning that a citation with different page already exists in the DB.

I think it's pretty dangerous to do it by default, i.e. change an existing record if you don't know its there?  Generalized citations vs. page specific citations, if imported from multiple sources, likely need to more specific reconciliation?

We can raise a warning/did you mean I think.  Curators are providing citations to specific pages uniquely however, so it needs to be allowed.

Existing citation without page number is already in the database. What is the danger if you add the page number to it, for me it is more danger to keep two citations, one of which is more specific than the other.  What information you can gain or loose from an existing citation which does not have pages?
In both cases a warning with an option to update the page, leave existing page number, or create a second citation would be a reasonable solution in both cases.

What information you can gain or loose from an existing citation which does not have pages?

I'm not arguing to keep both, I'm arguing against auto-updates which obscure that one type of citation was already in the database.

Three option solution will be perfect for me:

update an existing citation
keep an existing citation
add a second citation

@jlpereira Perhaps we need to auto-filter citations once source is selected so that user can more easily see and edit existing, this might be the middle-ground work around rather than customizing dialogs to work around?

most of those problems are happening in distribution and host plant for me. So finding an existing citation for modification is not an easy task. The same geographic are may have multiple citations. And now new citations are just silently created if the page number does not match. Alternative solution, of cause is to remove the page number from the uniqueness constrain. But this may also be not desirable in all cases.

You didn't mention that this wasn't the general Citation action off the
radial annotator!  That bit is important.
On Mon, Feb 15, 2021 at 4:55 PM Dmitry Dmitriev<EMAIL_ADDRESS>wrote:

most of those problems are happening in distribution and host plant for
me. So finding an existing citation for modification is not an easy task.
The same geographic are may have multiple citations. And now new citations
are just silently created if the page number does not match. Alternative
solution, of cause is to remove the page number from the uniqueness
constrain. But this may also be not desirable in all cases.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/SpeciesFileGroup/taxonworks/issues/2038#issuecomment-779482874,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAAFQSETKGMVWKJDNUKPUU3S7GQ6PANCNFSM4XVCZCZA
.

I was thinking about general citation action. Yes, it is true, I mostly experienced difficulty updating distribution records, just because I have more incomplete citations related to distribution. But had similar issue with many other classes: TaxonName, TaxonNameRelationships, biological associations. And yes, it is mostly by using the OTU radial, just because it is my preffered way of editing. But I also experience the same issue by using New Asserted distribution task. So, I would say it is generic.


Use dependabot for bumping markdownlint-cli

Why
Fixes #1179
Use dependabot for bumping markdownlint-cli to avoid manual work as well as decrease the possibility to miss an update.
What

Create Dockerfile for markdownlint-cli and use it in build pipeline
Configure dependabot to bump Dockerfiles inside /build directory.

Testing
See here that it works as expected: https://github.com/pellared/splunk-otel-go/pull/889

Codecov Report

Merging #1181 (fba020e) into main (fd24aee) will increase coverage by 3.34%.
The diff coverage is 0.00%.

:exclamation: Current head fba020e differs from pull request most recent head dc3b2d7. Consider uploading reports for the commit dc3b2d7 to get more accurate results

@@            Coverage Diff             @@
##             main    #1181      +/-   ##
==========================================
+ Coverage   74.99%   78.33%   +3.34%
==========================================
  Files          55       55
  Lines        2719     2723       +4
==========================================
+ Hits         2039     2133      +94
+ Misses        628      540      -88
+ Partials       52       50       -2

Flag
Coverage Δ

Linux
78.33% <0.00%> (?)

Windows
?

macOS
74.51% <0.00%> (-0.11%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

build/pipeline.go
2.71% <0.00%> (-0.05%)
:arrow_down:

...n/github.com/lib/pq/splunkpq/internal/connector.go
51.75% <0.00%> (-3.52%)
:arrow_down:

instrumentation/database/sql/splunksql/config.go
83.19% <0.00%> (+2.52%)
:arrow_up:

.../gopkg.in/olivere/elastic/splunkelastic/elastic.go
100.00% <0.00%> (+5.08%)
:arrow_up:

...c/confluent-kafka-go/kafka/splunkkafka/consumer.go
88.70% <0.00%> (+12.90%)
:arrow_up:

...hub.com/gomodule/redigo/splunkredigo/redis/dial.go
100.00% <0.00%> (+13.11%)
:arrow_up:

...c/confluent-kafka-go/kafka/splunkkafka/producer.go
87.00% <0.00%> (+19.00%)
:arrow_up:

...n/gopkg.in/olivere/elastic/splunkelastic/option.go
100.00% <0.00%> (+33.33%)
:arrow_up:

...hub.com/gomodule/redigo/splunkredigo/redis/conn.go
100.00% <0.00%> (+35.84%)
:arrow_up:

....com/gomodule/redigo/splunkredigo/option/option.go
100.00% <0.00%> (+50.00%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update fd24aee...dc3b2d7. Read the comment docs.


[feature request] Plotting additional info collected by monitor using results_plotter

The current results_plotter only plots episode rewards. Although TensorBoardCallback can track additional variables, it would be nice to be able to select which metric(e.g. info1 in the code below) to plot from the csv file created by the monitor.
Additionally, the csv file created by the monitor (in case of vectorized environments) has a messy index column as shown below:
import random

import gym
import numpy as np
from stable_baselines.common.vec_env import SubprocVecEnv
from stable_baselines.common.cmd_util import make_vec_env
from stable_baselines.bench import load_results

class CustomEnv(gym.Env):
    def __init__(self):
        super(CustomEnv, self).__init__()
        self.observation_space = gym.spaces.Box(low=0.0, high=1.0, shape=(3,))
        self.action_space = gym.spaces.Discrete(3)

    def reset(self):
        obs = self._get_obs()
        return obs

    def step(self, action):
        obs = self._get_obs()
        reward = np.random.randn()
        done = random.choice([True, False])
        info = {'info0': np.random.randn(), 'info1': np.random.randn()}
        return obs, reward, done, info

    def _get_obs(self):
        return np.random.random((3,))

if __name__ == "__main__":
    n_envs = 4
    env = make_vec_env(CustomEnv,
                       n_envs,
                       monitor_dir='./log/',
                       vec_env_cls=SubprocVecEnv,
                       vec_env_kwargs={"start_method": 'fork'})
    obs = env.reset()

    for i in range(100):
        action = [env.action_space.sample() for _ in range(n_envs)]
        obs, reward, done, info = env.step(action)

    env.close()

    df = load_results('./log')
    print(df.head())

Output:
   index         r  l         t
0      0  0.266806  1  0.014221
1      1 -0.191954  1  0.014738
2      0  0.074852  2  0.014752
3      1 -1.529633  1  0.015202
4      0  2.770444  4  0.015610

It looks like these index values are from the individual csv files in the log folder, but there seems to be no use of this when they are combined into one dataframe.
Other minor concern is to pass the info_keywords in make_vec_env method (as monitor_kwargs maybe?). It would make things easier so that we don't have to rewrite make_env function by ourselves.

results_plotter: I am not sure how in-depth we want to modify these, they seem like older pieces of code. I think utility functions for reading monitor files would be a better fit (e.g. load_monitor(path_to_monitor) -> dict(column_name: list of values)).
Passing info_keywords: Good suggestion! It sounds simple enough we could add it to both here and stable-baselines3. @araffin comments? This should be just passing few parameters env creation functions.
As for the monitor files with vec-envs: I am not quite sure what is the issue. Indeed they get mixed up like that, and you can not separate which env created which lines. However if you wish to track e.g. average episodic reward, this should not be a problem if all the environments are the same (just independent instances of same env). An alternative I have used is to create a new monitor file per environment with unique id, which then can be interleaved later.

As for the monitor files with vec-envs: I am not quite sure what is the issue.

If we want to work with the dataframe returned by load_results, it might create confusion. (df.index will mean the pandas RangeIndex object but df['index'] will mean the messy column named 'index'). I believe my suggestion is to drop this column named 'index' when it is returned by load_results.

I think utility functions for reading monitor files would be a better fit

yes, we already have that https://stable-baselines3.readthedocs.io/en/master/common/monitor.html#stable_baselines3.common.monitor.load_results

has a messy index column as shown below:

What did you expect? As environment are run in parallel, there is one monitor file per environment (see make_vec_env code) that is merged into one when calling load_results. The time is used to sort them.

I believe my suggestion is to drop this column named 'index' when it is returned by load_results

Please do a PR for that ;)

It would make things easier so that we don't have to rewrite make_env function by ourselves.

Actually, you can use the zoo to define a monitor wrapper that will record what you want. But yes, it only few lines to redefine it.

The current results_plotter only plots episode rewards. Although TensorBoardCallback can track additional variables, it would be nice to be able to select which metric(e.g. info1 in the code below) to plot from the csv file created by the monitor.

Regarding this, my point was to plot variables other than episodic reward. Here in the code, instead of y_var = timesteps.r.values, if we could have something like y_var = timesteps[ylabel].values, where ylabel can be passed into the function, it would make the code more generalized.
Sorry I couldn't explain it clearly earlier.
As @Miffyli has suggested, if the code is too old to modify, that is also understandable.

Please do a PR for that ;)

Sure!

Actually, you can use the zoo to define a monitor wrapper that will record what you want. But yes, it only few lines to redefine it.

Okay, I understand.


Color selection for controlled-phase gate when drawing a circuit with matplotlib

What is the expected behavior?
It seems that currently one can not select the color of cp (controlled phase) gates when drawing a circuit using matplotlib, and it would be useful to have that capability.
It appears that this can be achieved in one line by adding to qcstyle.py the following
           'cp': (other_color, black_font),
after line 118, that is, by adding the cp gate to the self.dispcol dictionary of the class DefaultStyle.  I suppose for consistency this should also be added to the other style classes as well (BWStyle and IQXStyle).
Thanks very much for considering this improvement!

As of terra 0.16.0 you should be able to do this with something like:
qc.draw(output='mpl', style={'displaycolor': {'cp': ('#FA74A6', '#000000')}}

This was highlighted in the release notes: https://qiskit.org/documentation/release_notes.html#release-notes-0-16-0-new-features (it's the 3rd bullet point in that section). Additionally in the upcoming 0.17.0 terra release you can now create custom style sheet json files and use them interchangeably with the default, bw, and iqx styles.

Thanks very much for the reply!  What I mean is, I think that the cp gate was left off the list appearing in qcstyle.py, so its color cannot be changed successfully.  For instance, when I run the following, the color of the h gate changes, but not the cp:
from qiskit import QuantumCircuit
import matplotlib.pyplot as plt

qc = QuantumCircuit(2)
qc.cp(1.0,0,1)
qc.h(1)

qc.draw(output='mpl', style={'displaycolor': {'cp': ('#FA74A6', '#000000'),'h': ('#FA74A6', '#000000')}})
plt.show()

qc.draw(output='mpl', style={'displaycolor': {'cp': ('#A27486', '#000000'),'h': ('#A27486', '#000000')}})
plt.show()

I believe I am using the most up-to-date version of terra, 0.16.4.


Disable dropping URLs

Is it possible to disable the "fetch" feature? In my app I don't want user to send remote url. I tried with {server: {fetch: null}} and {server: {fetch:""}} but it still accepts url dragged and dropped.

In version 4.4.0 the beforeDropFile hook has been added, you can use it to validate dropped items.
https://pqina.nl/filepond/docs/patterns/api/filepond-instance/


List FMI 3.0 support in FMI 3.0 tools page

It would be nice to update https://fmi-standard.org/tools/ to reflect the capability to import FMI 3.0 FMUs. Thanks!

opened PR


Added CagedMobs to supported mods list

You also need to add your page to the docs.json file
https://github.com/CraftTweaker/CraftTweaker-Documentation/blob/1.16/docs.json

This is my first time using Pull requests, I hope I did everything alright


[CircleGraph] Change selection line style

This will change graph selection color to blue, from red, and
a little thicker as to follow default Windows selection color.
ONE-vscode-DCO-1.0-Signed-off-by: SaeHie Park<EMAIL_ADDRESS>

for #822, from draft #851


chore(schema,common): Refactoring getters & setters

Information

Type
Breaking change

Chore
No

:tada: This PR is included in version 6.5.0 :tada:
The release is available on:

v6.5.0
GitHub release

Your semantic-release bot :package::rocket:


[BUG] text selection shows extra rectangles on ench line left and right when fakeMica is enabled

Describe the bug
"frosted-glass-theme.fakeMica.enabled": false ↓

"frosted-glass-theme.fakeMica.enabled": true ↓

Additionally, disable frosted-glass-theme and set "editor.background": "#ffffffdd" ↓

There are similar rectangles, but the color is lighter.
Version (please complete the following information):

OS: Windows 11 23H2 22631
VSCode version: 1.92.2
Extension version: 0.8.1

Awesome! Thank you


Build and safeguard remaining routes

Title: Build and safeguard remaining routes
User Stories

As a logged-in user, I want to be able to create new posts and comments and upvote other posts

Authenticated users are now able to perform the required CRUD operations.


Can you please add some document for Spring Kafka using Confluent Avro Deserialization?

I need to integrate Spring Kafka with Confluent Schema registry using Avro. However I can't find any document on Spring Kafka website.
Can anyone help me on the following issues I got?
https://stackoverflow.com/questions/56936582/spring-kafka-with-confluent-kafka-avro-deserializer

GitHub issues are not for asking questions. Furthermore you don't have to post in multiple places, we monitor Stack Overflow and will answer as time permits.
Posting in multiple places wastes your time and ours.


NoExtraConsecutiveBlankLinesFixer crashes on bad whitespace characters

$ php -v
7.1.11
$ php-cs-fixer -V
2.8.0
The command you use to run the fixer (and the configuration file you are using if any).
NoExtraConsecutiveBlankLinesFixer
A minimal sample of valid PHP code that is not fixed correctly (if applicable).
https://github.com/ByTIC/Common/blob/8e7382a9e9f24e9e3d77abea3e8d03a0c6229e47/src/Payments/Gateways/Providers/Euplatesc/Gateway.php
Was hard to edit the file because editors and git settings kept fixing the characters. The original file demonstrates the issue just fine though.
 InvalidArgumentException · Cannot set empty content for id-based Token.

Happens as a result of calling $this->tokens[$index] = new Token([T_WHITESPACE, $content]);.

thanks for reporting,
this fails on 2.7 as well


Change limiter type to function.

The type of the limiters may be changed from Limiter to Callable[[Dict[str, Any]], Optional[str]] as the Limiter objects also conform to this type. The rationale is that many users may be more comfortable writing functions than classes.

Users might be much more familiar with functions rather than class-based approach.

Even better solution would be for limiters to return Iterable[str]. This way the scheduler would be able to skip to the next runner if one is not available.


Method to indicate thar request has body

Is it possible to add method hasBody(), which will return true if request has body, in order to understand that we need to read it using onData.

Can check request.getHeader('content-length')

Data can be chunked, without known content length.

hasBody is a good addition

if (req.getHeader('content-length') || req.getHeader('transfer-encoding') == 'chunked') {
  console.log('hasBody');
}

yes, this will work
please, close, this issue, if you don;t want to add such method to the uws.

The client can send 0 bytes
!!+req.getHeader('content-length')

@uasan assuming you are responding to my function, yes '0' string needs to be properly accounted for, fixed it ;)

// Several values can be listed, separated by a comma
Transfer-Encoding: gzip, chunked

req.getHeader('transfer-encoding')?.includes('chunked')

req.getHeader('transfer-encoding')?.toLowerCase().includes('chunked')

Usually you want to differentiate between standard request uploads with a 'content-length' and potentially unlimited stream of data with 'transfer-encoding: chunked', a simple hasBody would not help with that, encourages bad practice I think, maybe some people need it for something ?
const contentLength = Number(req.getHeader('content-length'));

const transferEncoding = req.getHeader('transfer-encoding');

if (contentLength) {

   const body = await getBody(res);

} else if (transferEncoding?.includes('chunked')) {

   await processStream(res);

} else {

   console.log('no body');

}

res.end('done');

Fot me hasBody is enough. I already user methos, which is limit download size.

bodyType() could return 0 for false, 1 for fix length, 2 for stream. The parser already knows all of this

bodyType() could return 0 for false, 1 for fix length, 2 for stream. The parser already knows all of this

With a fixed body length, it is very useful to know it in advance, then it will be better like this:
req.getBodyLength(): 0 | number | Infinity

Agree, knowing the fixed length can help decide buffer size

Will you add this method to the uws or lets close this issue?