Add Pixmap constructor from bytes for GWT

Hey everyone, I need real help here, how can this PR look better? @lyze237 @MrStahlfelge @tommyettinger @mgsx-dev
This is how I manage to load Pixmap from bytes, I tried hard to load them sync but didn't work. I added a "loaded" attribute to pixmap (both GWT and non-GWT) it can be ignored on non-GWT but maybe could be useful for async load operations.
Thank you @lyze237 for the gist.

Just to check, this is not for something that's already done by Pixmap.downloadFromUrl()?

@MrStahlfelge I don't think they are the same. This logic loads image from bytes, it is not the same as downloading from a server, they can be generated locally (client-side). I am not sure if internally they work the same way.

@MrStahlfelge @tommyettinger thank you for the comments. Indeed the Pixmap.downloadFromUrl() has a lot of similarities I believe they could be unified.
I will be working on the comments later today.

@MrStahlfelge you are right, the previous method is the same as Pixmap.downloadFromUrl() it wasn't working before because I had to call ctx.drawImage() otherwise it doesn't work. Now they are calling the same logic.

Thank you so much @tommyettinger! Looking forward to have this merged.

I have to say I don't understand the sync vs. async loading part... In the code before 3ef4ca1, it didn't look like any behavior changed to make the existing constructors no longer sync -- what did I miss? Is this just the byte[] constructor affected?

@tommyettinger the main concern @mgsx-dev has is that the Pixmap should be created sync. This is how it's done in all backends but for GWT is really hard to do this sync. So devs should expect the same behavior in all backends but the code will not work on GWT.

If it's possible to load a Pixmap synchronously on GWT, then we should probably do that, but if it isn't possible for some constructor, how is it better to just omit it entirely? Isn't having a missing constructor a behavior difference too, since code that constructs a Pixmap from a byte[] will work on most platforms but fail to compile on GWT? I know people have struggled with the undocumented behavior difference in getPixels() on GWT (where it returns a Buffer instead of a ByteBuffer and backs the Buffer with an IntBuffer), but I fail to see how this PR worsens the behavior of GWT if the code that used the byte[] constructor wouldn't even compile before. At least we have a chance to document the newly-present GWT constructor in core, saying that it is sync or async on all platforms but X.

The problem with this new "loaded" state is that all code that use Pixmap should check if it's loaded or not before using it. Even width and height need the data to be loaded, so it somehow breaks overall Pixmap API imho.
Maybe a cleaner solution would be to have a static method with a listener. It would ensure that you never get a half constructed Pixmap. Something like void load(byte[], int, int, Listener<Pixmap>) would work for all backends with the same API / same behavior and won't break anything. What do you think?

@mgsx-dev I was just thinking that something like that would probably make more sense.

I agree with @mgsx-dev this would be a major API break. We do not want async constructors. The suggested static method with a callback is the better option.


Drop 'main' from conditional as it's unrelated to Rails versions

We probably meant 'master', but we don't run against Rails edge.

JRuby jobs failed, it's unrelated and we had them failing previously, fixing in https://github.com/rspec/rspec-rails/pull/2397


Changing the input value does not update _lastValue

It seems that the .change handler for pm is only called for user initiated changes (setContent doesn't cause it be triggered). This means that the wrapper never sets a _lastValue if a new value is passed into it (until the user changes something).
Flow which causes this:
Start with value1
Modify to value2 (via keyboard)
Set value={value1}
Set value={value2}
value2 never gets repopulated because _lastValue is still set to value2, so setContent is never called.
I 'fixed it' locally by adding the follow after setContent:
this._lastValue = this.pm.getContent(this.props.options.docFormat);

Thanks!

:+1:  Thanks - this was giving me a headache earlier today :)


How to reload indicator in carousel?

Hi,
I have a carousel like this that displays 12 elements:

{{component.title}}

Except that the indicator doesn't change if I display 2, 3 or 4 elements when I resize the browser.

@NatsuOnFire when implementing this exact case in vanilla MaterializeCSS does it work as expected?

@NatsuOnFire have you had a chance to check if this is a MaterializeCSS problem or Angular binding issue? Thanks.


Constraints on containment predicates

The predicates that relate a statistical area to the ones that it contains of the next finest rank do not have global constraints on their domain and range (though there are local Restrictions on the classes). I understand that global constraints are somewhat out of favour, but in this case they are appropriate - these are very specific properties that are intended to only relate between specific levels. e.g. it should be
:isStatisticalAreaLevel2Of
  rdf:type owl:ObjectProperty ;
  rdfs:domain :StatisticalAreaLevel2 ;
  rdfs:range :StatisticalAreaLevel1 ;
  rdfs:subPropertyOf :contains ;
.

Alternatively, they might all be replaced by a more general relationship
:isStatisticalAreaContaining
  rdf:type owl:ObjectProperty ;
  rdfs:domain :Feature ;
  rdfs:range :Feature ;
  rdfs:subPropertyOf :contains ;
.

then use local restrictions to constrain the class that is the object of the relationship., e.g.
:StatisticalAreaLevel1
  rdf:type owl:Class ;
  rdfs:subClassOf :Feature ;
  rdfs:subClassOf [
      rdf:type owl:Restriction ;
      owl:allValuesFrom :MeshBlock ;
      owl:onProperty :isStatisticalAreaContaining ;
    ] ;
.

The current design is the worst of both worlds.

Actually they might be better formulated in the other direction, in which case geosparql:sfWithin might be enough:
:MeshBlock
  rdf:type owl:Class ;
  rdfs:subClassOf :Feature ;
  rdfs:subClassOf [
      rdf:type owl:Restriction ;
      owl:onClass :StatisticalAreaLevel1 ;
      owl:onProperty geo:sfWithin ;
      owl:qualifiedCardinality "1"^^xsd:nonNegativeInteger ;
    ] ;
.
:StatisticalAreaLevel1
  rdf:type owl:Class ;
  rdfs:subClassOf :Feature ;
  rdfs:subClassOf [
      rdf:type owl:Restriction ;
      owl:onClass :StatisticalAreaLevel2 ;
      owl:onProperty geo:sfWithin ;
      owl:qualifiedCardinality "1"^^xsd:nonNegativeInteger ;
    ] ;
.

etc. i.e. no need for asgs predicates at all (though maybe we would want asgs:within rdfs:subPropertyOf geo:sfWithin . locally).

Note that use of a geo:sfXXX property also entails that both subject and object are individuals of rdf:type geo:SpatialObject, which is consistent with the various ASGS types to be (transitively) rdfs:subClassOf geo:Feature. So I propose also to add
asgs:Feature rdfs:subClassOf geo:Feature .


[Open source] Exchangis1.0 create a data source, and when the entered name already exists, there is an exception, prompting optimization.

Create a data source, the entered name already exists, and an exception will be reported. The error prompt for optimization is "A data source with the same name already exists"
创建数据源，输入的名称已存在会报异常，优化该错误提示为《已存在同名数据源》

https://github.com/WeBankFinTech/Exchangis/pull/282，这个pr解决了


[AutoDiff] add cross-file registration flag to .swiftinterface

Fixes TF-1101 and https://github.com/tensorflow/swift/issues/359.

@swift-ci please test tensorflow

@dan-zheng https://dev.azure.com/compnerd/swift-build/_build/results?buildId=24025&view=results should do a build of the macOS toolchain

@dan-zheng https://dev.azure.com/compnerd/swift-build/_build/results?buildId=24025&view=results should do a build of the macOS toolchain

Is there a way that I can trigger that on this branch?
I already have one in progress on our mac desktop right now but the builds there seem quite flaky so it would be nice to trigger one there too in case the desktop fails. And it looks easier to build things there than in the desktop in the future.

I already have one in progress on our mac desktop right now but the builds there seem quite flaky

Indeed, the build on the desktop just failed with some error message that looks unrelated to this PR:
--- Building swiftpm ---
+ /Users/swiftninjas/s4tf/swiftpm/Utilities/new-bootstrap build --release --swiftc-path /Users/swiftninjas/s4tf/swift/swift-nightly-install/Library/Developer/Toolchains/swift-tensorflow-DEVELOPMENT-2020-01-10-a.xctoolchain/usr/bin/swiftc --clang-path /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/clang --cmake-path /usr/local/bin/cmake --ninja-path /Users/swiftninjas/s4tf/build/buildbot_osx/ninja-build/ninja --build-dir /Users/swiftninjas/s4tf/build/buildbot_osx/swiftpm-macosx-x86_64 --llbuild-build-dir /Users/swiftninjas/s4tf/build/buildbot_osx/llbuild-macosx-x86_64
--- bootstrap: note: Building SwiftPM (with CMake)
[0/1][  0%][0.000s] Re-running CMake...
CMake Error at CMakeLists.txt:13 (project):
  The CMAKE_Swift_COMPILER:

    /Users/swiftninjas/s4tf/swift/swift-nightly-install/Library/Developer/Toolchains/swift-tensorflow-DEVELOPMENT-2019-12-22-a.xctoolchain/usr/bin/swiftc

  is not a full path to an existing compiler tool.

  Tell CMake where to find the compiler by setting either the environment
  variable "SWIFTC" or the CMake cache entry CMAKE_Swift_COMPILER to the full
  path to the compiler, or to the compiler name if it is in the PATH.

-- Configuring incomplete, errors occurred!
See also "/Users/swiftninjas/s4tf/build/buildbot_osx/swiftpm-macosx-x86_64/x86_64-apple-macosx/bootstrap/CMakeFiles/CMakeOutput.log".
See also "/Users/swiftninjas/s4tf/build/buildbot_osx/swiftpm-macosx-x86_64/x86_64-apple-macosx/bootstrap/CMakeFiles/CMakeError.log".
FAILED: build.ninja
/usr/local/Cellar/cmake/3.15.4/bin/cmake -S/Users/swiftninjas/s4tf/swiftpm -B/Users/swiftninjas/s4tf/build/buildbot_osx/swiftpm-macosx-x86_64/x86_64-apple-macosx/bootstrap
ninja: error: rebuilding 'build.ninja': subcommand failed
/Users/swiftninjas/s4tf/build/buildbot_osx/ninja-build/ninja
--- bootstrap: error: Command '['/Users/swiftninjas/s4tf/build/buildbot_osx/ninja-build/ninja']' returned non-zero exit status 1
./utils/build-script: fatal error: command terminated with a non-zero exit status 1, aborting
./utils/build-script: fatal error: command terminated with a non-zero exit status 1, aborting

I'll try building it on my mac laptop which seems to be able to build the toolchain a bit less flakily. In the meantime, macos CI will probably finish before that does, so I'll merge this PR before confirming if the macos toolchain build is fixed.

Hi,
My build fails with the following on macOS while trying to build swiftPM:
/Users/daniel/swift-source/swiftpm: error: manifest parse error(s):
swift (LLVM option parsing): for the --enable-experimental-cross-file-derivative-registration option: may only occur zero or one times!
Cheers,
Dan

@dbonner: the issue should be fixed after https://github.com/apple/swift/pull/29156! I'm verifying it now.


add GitHub action to auto-update the semver major tag

This will auto-update the v1 (or future majors) tag to the latest release using actions/publish-action.
This makes it so that the very examples from the repo's README.md make use of the latest releases (i.e. one that doesn't have a deprecation warning). As of right now @v1 resolution lags behind because it points to a branch https://github.com/denoland/setup-deno/tree/v1 which would propably best be deleted after this is merged (and manually ran to publish the tag without triggering a release).

As of right now @v1 resolution lags behind because it points to a branch https://github.com/denoland/setup-deno/tree/v1

Thanks for pointing this. I didn't know v1 points to v1 branch. Now main is also pushed to v1 branch.

This will auto-update the v1 (or future majors) tag to the latest release using actions/publish-action.

I'm not sure it's a good idea that we depend on that action as it explicitly discourages the usage in public & production repositories in README

Yeah, the point is to automate propagation of new releases. That it is pushed now is good but doesn't solve the problem for any future release.


Migrate 6 Unary Backward ops to TTNN

Unary Backward Tracking Issue : #9874 [Master issue : #9322 ]
List of ops required to be migrated : #10066

[x] lgamma_bw
[x] unary_sub_bw
[x] frac_bw
[x] trunc_bw
[x] log_sigmoid_bw
[x] fill_zero_bw

Merged #10066


Fetch images from backplane pipeline

Reclone pipeline on each run. Gather from backplane-pipeline repo (rather than pipeline repo).
Signed-off-by: Jakob Gray<EMAIL_ADDRESS>

/lgtm


Using  vs.  in criteria text

In updating the German translation, I noticed that in the english original, we sometimes use  and sometimes , seemingly interchangable.
Refreshing my memory with MDN Web Docs:

The  element represents stress emphasis of its contents, while the  element represents text that is set off from the normal prose, such a foreign word, fictional character thoughts, or when the text refers to the definition of a word instead of representing its semantic meaning.

I think we did it right in criteria text criteria.0.dynamic_analysis.details:

For purposes of this criterion the dynamic analysis tool needs to vary the inputs in some way to look for various kinds of problems or be an automated test suite with at least 80% branch coverage.

However, criteria text criteria.0.dynamic_analysis_enable_assertions.description uses  when  seems more appropriate:

It is SUGGESTED that the project use a configuration for at least some dynamic analysis (such as testing or fuzzing) which enables many assertions. In many cases these assertions should not be enabled in production builds.

Visually there is no difference for the user, so this issue is of low importance.
Should we even bother to review our use of  and  or just leave it be?

Doesn't matter


[Question] Redis Replication

Pardon my sysadmin ignorance, but if I have a Redis master/slave setup, is it possible to point the node client to multiple instances like with mongo urls? or do you handle that some other way?
Thanks!

The client doesn't handle multiple connections automatically. What were you wanting to do with multiple connections? If you were wanting to send some queries to go to the master, and some to the slave, that can easily be done with 2 clients. However, if you were wanting this to behave more like mongo WRT failover behavior, you should look into redis-sentinel.

@raydog but would I be able to use sentinel with node_redis?

You would be building node_redis clients using information from sentinel. There are several projects that would help you do that. My favorite is simple-sentinel, but do note: I am pretty biased source on that, since I wrote it. :P


QuickLogic: Update tests

This PR bumps the QuickLogic designs submodule and introduces various updates to qlf_k4n8 tests.

Requires #2152  to be merged first for the CI to pass.

The QuickLogic installed toolchain CI failure should disappear once #2153 is merged.


Extract error information from JSON.

When OSRM returns an error, it (often?) includes an error code/message in the returned JSON object. This change extracts this code/message and returns it to the caller of libosrmc.
This makes it easier to debug failures, but also makes it possible to react to errors such as NoRoute. An example of such a route is between 25.07165,55.402115 and 25.086226,55.385334 in the UAE, using the foot or bicycle profiles.

Hey there, thanks for this pull request (and the other ones) :)
Quick disclaimer before we go into details: this project was sort of a prototype and is lacking large parts of the API. I also haven't compiled or tested it against libosrm in the last two'ish years, and it's not used by me right now.
That said, if you want to pick it up I'm happy to guide you along and merge your improvements in.

Now to this pull request. I think it's a very good idea in general! We already have an error type here
https://github.com/daniel-j-h/libosrmc/blob/a968cfd3469c702127e508f808dd3692a66b2eba/libosrmc/osrmc.cc#L28-L30
Right now we only store a single generic message.
Here's what I think we should do instead:

[ ] store two strings: message, and code
[ ] parse message and code from the json object (like you do)
[ ] code should always be there (assert that)
[ ] message is optional, empty string is fine in this case I think
[ ] add another function osrmc_error_code  similar to the existing osrmc_error_message (see below)

https://github.com/daniel-j-h/libosrmc/blob/efa047df7b056a25344ff20040eac0d414a78ac3/libosrmc/osrmc.h#L162
In theory we could also make the error code an enum we expose to the user. But even in upstream libosrm these enum values are strings only and only documentation captures all possible values. Not sure I like this to be honest, see:
https://github.com/Project-OSRM/osrm-backend/search?q=TooBig&type=Code
Let me know what you think.

Quick disclaimer before we go into details: this project was sort of a prototype and is lacking large parts of the API. I also haven't compiled or tested it against libosrm in the last two'ish years, and it's not used by me right now.
That said, if you want to pick it up I'm happy to guide you along and merge your improvements in.

Thank you so much for giving such detailed feedback, so quickly! As this didn't appear to be used, I wasn't sure what to expect. :-)
I'm using this to create a Rust wrapper around libosrm, and it includes everything I think I'll need (except the durations in the Table API, hence the other PR). It seems to work great against the current libosrm, so that was a really nice surprise! I'm very happy to support it for my use-case.

Here's what I think we should do instead:

[x]  store two strings: message, and code
[x]  parse message and code from the json object (like you do)
[ ]  code should always be there (assert that)
[x]  message is optional, empty string is fine in this case I think
[x]  add another function osrmc_error_code  similar to the existing osrmc_error_message (see below)

Great idea! This makes it much easier for me to match on the error in my application. I can now match on the code.
I've done all of this, except asserting the code is always there. I've instead defaulted it to "Unknown" if it's missing (or if the JSON is never returned). This felt better, as libosrmc could become out-of-sync with libosrm, and I'd like it to still return something for the error even i

In theory we could also make the error code an enum we expose to the user. But even in upstream libosrm these enum values are strings only and only documentation captures all possible values. Not sure I like this to be honest, see:
https://github.com/Project-OSRM/osrm-backend/search?q=TooBig&type=Code

This would have been great, as it'd allow me to handle the errors without string matching (which is a bit gross). However, I don't think we could achieve this without significant changes to libosrm - I think sticking with this approach is probably good enough.

Merged with https://github.com/daniel-j-h/libosrmc/pull/8#issuecomment-473706030


Deprecate trin-cli

Description
The trin-cli was previously used to initiate sending a message from one Trin client to another.
It is no longer actively maintained or used
Solution
Either:

Mark the trin-cli crate as deprecated
Remove the trin-cli crate

We discussed this today & decided that it's worth investigating whether or not we should bring trin-cli back to life...

A functional/extendable cli utility can improve the workflow
trin-cli is fairly useful when interacting with testnet nodes
We should be able to leverage ethportal-api jsonrpsee client functionality to simplify the existing trin-cli logic

Therefore...
This issue remains valid. But, the solution should be to "Mark the trin-cli crate as deprecated", and remove it from our documentation.
However, if anybody finds some time, it's worth a day/two to investigate whether we can simplify the existing code here & revive trin-cli in a functional, useful manner.
Possible sources of inspiration

https://github.com/AgeManning/discv5-cli
...

I would like to attempt doing this one :)

I would like to attempt doing this one :)

Sure :100: , let us know if you have any questions.

We discussed this today & decided that it's worth investigating whether or not we should bring trin-cli back to life...

A functional/extendable cli utility can improve the workflow
trin-cli is fairly useful when interacting with testnet nodes
We should be able to leverage ethportal-api jsonrpsee client functionality to simplify the existing trin-cli logic

Therefore... This issue remains valid. But, the solution should be to "Mark the trin-cli crate as deprecated", and remove it from our documentation.
However, if anybody finds some time, it's worth a day/two to investigate whether we can simplify the existing code here & revive trin-cli in a functional, useful manner.
Possible sources of inspiration

https://github.com/AgeManning/discv5-cli
...

I am going to work on since I want to be able to play with trin's RPC with a cli then writing code and using ethportal-api
I made a issue to track it https://github.com/ethereum/trin/issues/730

We spoke on the call today and it seemed like the move is to remove trin-cli as a whole and move grafana to portalnet


⚠ SceneTime has degraded performance

In 0b44905, SceneTime ($ST) experienced degraded performance:

HTTP code: 200
Response time: 1793 ms

Resolved: SceneTime performance has improved in f485d83 after 9 minutes.


[Script]: Pixabay Website Scraper

Aim
I'd add the pixabay website web scraper, which would scrape all the image-data from the pixabay website for a particular query.
Details
This would be a well-defined scraper class. The user would be able to use the various methods of this class to get the desierd output. This class would both display and save the images scraped from pixabay.
Record

[X] I agree to follow this project's Code of Conduct
[X] I'm a GSSoC'23 contributor
[X] I want to work on this issue

@avinashkranjan please assign me this


Hydration issue in the blog website, maybe because of browser addons

Sorry I can not reproduce it reliably, it happened enough time for me to be annoyed, and it happened in (latest of all) of arc, chrome, edge, and even firefox.
Behavior: visit a page,  move around, next page, previous one, ... until one of them fails.

Maybe you can try this site:
https://infinitecanvas.cc/guide/lesson-001


Resolve grammar and styling issues

Resolves #1287

@jpreese : Thanks for your contribution! The author, @gewarren, has been notified to review your proposed change.


I don't see Enable ID token implicit grant from azure B2C

I don't see Enable ID token implicit grant under Azure B2C.
Tried to follow documentation, but don't see it.
https://docs.microsoft.com/en-us/azure/active-directory-b2c/tutorial-register-applications?tabs=app-reg-ga#enable-id-token-implicit-grant
Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 670bf490-966b-e72e-ab6c-1d189f9a1f58
Version Independent ID: a55b7372-87e9-c760-1a37-57728171395d
Content: Tutorial: Register an application - Azure AD B2C
Content Source: articles/active-directory-b2c/tutorial-register-applications.md
Service: active-directory
Sub-service: b2c
GitHub Login: @msmimart
Microsoft Alias: mimart

@chasexd
Thanks for your feedback! We will investigate and update as appropriate.

@chasexd
Thank you for your time and patience throughout this issue! It looks like this doc might be referencing old steps, but can you follow the below steps and see if that resolves your issue.
1- Navigate to your B2C Tenant
2- Search for and Select Azure AD B2C
3- Select App registrations, select your Application
4 - On the left side, select Authentication, scroll down until you see "Implicit grant and hybrid flows"

If you're still having issues finding this, please let me know.
Thank you!

@chasexd
I just wanted to check in and see if you had any other questions or if you were able to resolve this issue?

Nope thank you, we can close this. I'm using a native mobile app, hence the different ui.


when I open xboxkeyboard app it says stopped working and it closes. I downloaded the other two things and it closes

Hi, I got the same problem as you before, can you tell me something?
If yes, just install ScpVBus (x64 or x86) and update the pilotes by yourself.
Heres the link:
https://github.com/shauleiz/vXboxInterface/releases
I hope that I helped you :)

I meant drivers instead of pilotes sorry. I'm just saying that because some person would be confused.


Flaky-test: CLITest (and possibly a lot of other integration tests because of the same reason)

CLITest is flaky. It fails when test retries are disabled. This problem can be reproduced by running CLITest in IntelliJ.
It seems that the same root cause is causing test failures in other integration tests.
Bookies die in the test after this kind of error message failed to allocate 16777216 byte(s) of direct memory (used: 536870912, max: 536870912).
To investigate the issue I set the environment variable TESTCONTAINERS_RYUK_DISABLED=true to disable TestContainers automatic container cleanup. I also locally temporarily added these lines to PulsarCluster.stop method:
     public synchronized void stop() {
+        boolean leaveContainersRunning = Boolean.parseBoolean(System.getenv("TESTCONTAINERS_RYUK_DISABLED"));
+        if (leaveContainersRunning) {
+            log.warn("Pulsar cluster is left running since TESTCONTAINERS_RYUK_DISABLED=true.");
+            return;
+        }

After this, it's possible to use docker exec -it CLITest-euiia-pulsar-bookie-0 bash and get a shell to view the /var/log/pulsar/bookie.log file which is created by the tests/docker-images/latest-version-image/conf/bookie.conf config used to run bookies in the apachepulsar/pulsar-test-latest-version docker image. This file contained the following error message:
08:26:53.194 [SyncThread-7-1] INFO  org.apache.bookkeeper.bookie.EntryLogManagerBase - Creating a new entry log fi
le because current active log channel has not initialized yet
08:26:53.195 [SyncThread-7-1] ERROR org.apache.bookkeeper.proto.BookieServer - Unable to allocate memory, exiting
bookie
io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 16777216 byte(s) of direct memory (used: 5368709
12, max: 536870912)

After restarting the bookie service with supervisorctl start bookie, the bookie starts again and I was able to check the java process command line:
/usr/local/openjdk-8/bin/java -cp /pulsar/conf:::/pulsar/lib/*: -Dlog4j.configurationFile=log4j2.yaml -Djute.maxbuffer=10485760 -Djava.net.preferIPv4Stack=true -Xmx128M -XX:MaxDirectMemorySize=512M -XX:+UseG1GC -XX:MaxGCPauseMillis=10 -XX:+ParallelRefProcEnabled -XX:+UnlockExperimentalVMOptions -XX:+DoEscapeAnalysis -XX:ParallelGCThreads=32 -XX:ConcGCThreads=32 -XX:G1NewSizePercent=50 -XX:+DisableExplicitGC -XX:-ResizePLAB -Dio.netty.leakDetectionLevel=disabled -Dio.netty.recycler.maxCapacity.default=1000 -Dio.netty.recycler.linkCapacity=1024 -Dpulsar.log.appender=RoutingAppender -Dpulsar.log.dir=/pulsar/logs -Dpulsar.log.level=info -Dpulsar.log.root.level=info -Dpulsar.routing.appender.default=Console -Dlog4j2.is.webapp=false -Dpulsar.functions.process.container.log.dir=/pulsar/logs -Dpulsar.functions.java.instance.jar=/pulsar/instances/java-instance.jar -Dpulsar.functions.python.instance.file=/pulsar/instances/python-instance/python_instance_main.py -Dpulsar.functions.extra.dependencies.dir=/pulsar/instances/deps -Dpulsar.functions.instance.classpath=/pulsar/conf:::/pulsar/lib/*: -Dpulsar.log.file=bookkeeper.log org.apache.bookkeeper.server.Main --conf /pulsar/conf/bookkeeper.conf

I can see that -XX:MaxDirectMemorySize=512M is properly passed. I noticed that PULSAR_GC isn't used from tests/docker-images/latest-version-image/conf/bookie.conf so I created #9621 to fix that. However that's not the reason for the flakiness.
In tests/docker-images/latest-version-image/conf/bookie.conf there is configuration to set dbStorage_writeCacheMaxSizeMb="16",dbStorage_readAheadCacheMaxSizeMb="16" . However this is a no-op since apply-config-from-env.py script is called in
tests/docker-images/latest-version-image/scripts/run-bookie.sh . There is nothing that will put the environment variables defined in the supervisord config to conf/bookkeeper.conf. Therefore, the configuration for dbStorage_* should be directly in the run-bookie.sh script to fix the issue.

There's PR #9623 to fix this issue.


nix-update: 0.17.1 -> 0.17.2

Diff: https://github.com/Mic92/nix-update/compare/0.17.1...0.17.2
Changelog: https://github.com/Mic92/nix-update/releases/tag/0.17.2
Description of changes

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
23.05 Release Notes (or backporting 22.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 228737 run on x86_64-linux 1

2 packages built:

nix-update
nix-update.dist


Upgrade to parse5

I'm maintaining an internal tool at my company which depends on the analyzer and after updating to the latest version (^3.1.0) I've noticed that there is a conflict between the parse5 version with the @types/parse5 version. (in version 4 of parse5 the types are inside the repository of parse5 itself and not the types that are made by someone else, breaking the code).
The only fix I could do in order to update to this version and still use typescript for my tool was to do the same thing as the CLI: https://github.com/Polymer/tools/blob/master/packages/cli/tsconfig.json#L6 - skip type checking for dependencies (libs)
This works, but also feels a little bit bad.
Are there any plans to update to the latest version of parse5?

Yes we need to update to parse5 v5, just haven't gotten the chance. In some of our packages, we deal with the typings issue by forcing the resolution we want, like this: https://github.com/Polymer/tools/blob/6a55e9455a120fbbb9e1fb4e23f041ee9fbcc0e7/packages/analyzer/tsconfig.json -- this is better than skipLibCheck.
Updated this issue description to track upgrading all our packages to parse5 v5.


InsecureRequestWarning on Py2.7

InsecureRequestWarning,
2019-10-24 00:35:35 AEDT 335 INFO:archive_photos Fetching photo 'Taranto' (9/14)
/home/bob/.local/lib/python2.7/site-packages/urllib3/connectionpool.py:1004: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
running ubuntu 18.04.3 LTS

Certificate verification was disabled as a temporary response to #15 and #24, where verification was occasionally failing for unknown reasons.

cheers

Working on a better solution — we believe that Yahoo is sometimes malforming the certificate chain. Fix will probably involve including the correct certificate chain with the archiver.

Fixed by #44


bad zlib link in core/BUILD

even though https://github.com/tensorflow/tensorflow/issues/6594 fixed the link to zlib in workspace.bzl, I'm getting another error looking for zlib at a bad link during the bazel build. Here's the error:
ERROR: /opt/tensorflow/models/syntaxnet/tensorflow/tensorflow/core/BUILD:911:1: no such package '@zlib_archive//': Error downloading from http://zlib.net/zlib-1.2.8.tar.gz to /root/.cache/bazel/_bazel_root/9f6232783b216d8ac3748a33750481a1/external/zlib_archive: Error downloading http://zlib.net/zlib-1.2.8.tar.gz to /root/.cache/bazel/_bazel_root/9f6232783b216d8ac3748a33750481a1/external/zlib_archive/zlib-1.2.8.tar.gz: 404 Not Found: <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">

<title>404 Not Found</title>

Not Found

The requested URL /zlib-1.2.8.tar.gz was not found on this server.

Additionally, a 404 Not Found
error was encountered while trying to use an ErrorDocument to handle the request.

 and referenced by '//tensorflow/core:lib_internal'.
____Loading package: @local_config_cc//
ERROR: /opt/tensorflow/models/syntaxnet/tensorflow/tensorflow/core/BUILD:911:1: no such package '@zlib_archive//': Error downloading from http://zlib.net/zlib-1.2.8.tar.gz to /root/.cache/bazel/_bazel_root/9f6232783b216d8ac3748a33750481a1/external/zlib_archive: Error downloading http://zlib.net/zlib-1.2.8.tar.gz to /root/.cache/bazel/_bazel_root/9f6232783b216d8ac3748a33750481a1/external/zlib_archive/zlib-1.2.8.tar.gz: 404 Not Found: <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">

<title>404 Not Found</title>

Not Found

The requested URL /zlib-1.2.8.tar.gz was not found on this server.

Additionally, a 404 Not Found
error was encountered while trying to use an ErrorDocument to handle the request.

sorry the title is a bad description: the line in zlib is line 1136 and doesn't directly contain the link, not sure how the link gets called

Have you tried the patch in #6594 to replace it with 1.2.10?

I was trying that, but I believe the fix has been merged to master correct?   I suspect your code / environment / git is synced to an earlier commit -- try updating the branch and the problem should go away.  Hope that helps!

sorry my fault, it was a submodule that wasn't updated. thanks for responding!

How did you update that submodule? @bgrayburn

@harshsp31 been awhile since I did this, but should just need to go to head of master in tensorflow/models, then I probably did something silly like cd into the tensorflow submodule folder and pull, but you should probably do git submodule update --recursive --remote in the tensorflow/models folder to update any and all submodules.

@bgrayburn Thank you for helping me out. I found the fix :)


Fugit::Nat.parse with different times in the same hour not parsed as single cron

# When there are different hours, it works correctly
Fugit::Nat.parse('every day at 18:00 and 19:00 UTC').original
=> "0 18,19 * * * UTC"

# When there are different minutes in the same hour, it doesn't
Fugit::Nat.parse('every day at 18:00 and 18:15 UTC').original
=> "0 18 * * * UTC" # should be: "0,15 18 * * * UTC"

# More complex example (but possibly difficult to implement)
Fugit::Nat.parse('every day at 18:00 and 18:15 and 19:00 and 19:15 UTC').original
=> "0 18 * * * UTC" # should be: "0,15 18,19 * * * UTC"

Thanks again

Thanks a lot!

I'm closing this issue. Please tell me if you spot any further issue.
The fix is included in the 1.3.1 release I've just pushed.
Many thanks for discovering all those cases, it's much appreciated!


Confidence score for predictions?

Hi, first of all, congrats on your great work!
As far as I know, the visibility/occlusion value is inferred discretely (occluded or not) in model_inference.py with:
def compute_occ_pred_for_qp(self, green_trajectories_qp: torch.tensor, source_trajectories_qp: torch.tensor, traj_cos_sim_qp: torch.tensor, anch_sim_th: float, cos_sim_th: float):
  visible_at_st_frame_qp = traj_cos_sim_qp >= anch_sim_th
  dists_from_source = torch.norm(green_trajectories_qp - source_trajectories_qp[visible_at_st_frame_qp, :].unsqueeze(1), dim=-1)  # dists_from_source (M x T), dists_from_source[anchor_t, source_t] = dist

  anchor_median_errors = torch.median(dists_from_source[:, visible_at_st_frame_qp], dim=0).values  # T_vis
  median_anchor_dist_th = anchor_median_errors.max()  # float
  dists_from_source_anchor_vis = dists_from_source  # (T_vis x T)
  median_dists_from_source_anchor_vis = torch.median(dists_from_source_anchor_vis, dim=0).values  # T
  return ((median_dists_from_source_anchor_vis > median_anchor_dist_th) | (traj_cos_sim_qp < cos_sim_th))

Is there a way to calculate some "confidence" value used in some trackers or detectors? The goal would be to use it as a weight for the tracker's trajectory prediction.
Would it make sense to use a value such as median_dists_from_source_anchor_vis * traj_cos_sim_qp (if not occluded) or perhaps occlusion * cos_sims where cos_sims is the result of compute_trajectory_cos_sims in model_inference.py?
I would appreciate any guidance regarding this issue. Thank you for your time.

Hi @AtaAtasoy, thanks for your question!
Given a query point x_q and a tracked prediction x_t, there are several signals that can indicate the prediction confidence, most of which you already mentioned:

Correlation of refined features sampled at x_q and x_t
The alignment between trajectories originating at x_q and x_t. median_dists_from_source_anchor_vis can serve for this, but you may also consider all of the frames, and not just the anchor frames
The unimodality of the similarity of x_q to the features in frame t, i.e. how confidently does the refined feature of x_q match to the tracked feature x_t.

Let me know if you'll have further questions.

@AtaAtasoy I'm closing this issue for now. If you'll have further questions, feel free to open it again.


Versions of node and npm to use?

Sorry if this is a silly question. I'm not well versed in the node and npm communities.
I'm getting errors when running npm install. After some searching it seems to be related to the node-sass dependency and my version of node. I initially installed node 17. I've installed node 16 and am trying again to run npm install. I'm going to keep downgrading until node 10 before giving up. Will share my results here. If anyone has any tips or suggestions as to what I should try please share ❤

Logs from install with node 16

Click to expand!
```
npm WARN old lockfile
npm WARN old lockfile The package-lock.json file was created with an old version of npm,
npm WARN old lockfile so supplemental metadata must be fetched from the registry.
npm WARN old lockfile
npm WARN old lockfile This is a one-time fix-up, please be patient...
npm WARN old lockfile
npm WARN old lockfile node-sass: No matching version found for<EMAIL_ADDRESS>npm WARN old lockfile     at module.exports (/usr/local/Cellar/node@16/16.14.0/lib/node_modules/npm/node_modules/npm-pick-manifest/index.js:209:23)
npm WARN old lockfile     at /usr/local/Cellar/node@16/16.14.0/lib/node_modules/npm/node_modules/pacote/lib/registry.js:118:26
npm WARN old lockfile     at async Array. (/usr/local/Cellar/node@16/16.14.0/lib/node_modules/npm/node_modules/@npmcli/arborist/lib/arborist/build-ideal-tree.js:743:9)
npm WARN old lockfile  Could not fetch metadata for<EMAIL_ADDRESS>node-sass: No matching version found for<EMAIL_ADDRESS>npm WARN old lockfile     at module.exports (/usr/local/Cellar/node@16/16.14.0/lib/node_modules/npm/node_modules/npm-pick-manifest/index.js:209:23)
npm WARN old lockfile     at /usr/local/Cellar/node@16/16.14.0/lib/node_modules/npm/node_modules/pacote/lib/registry.js:118:26
npm WARN old lockfile     at async Array. (/usr/local/Cellar/node@16/16.14.0/lib/node_modules/npm/node_modules/@npmcli/arborist/lib/arborist/build-ideal-tree.js:743:9) {
npm WARN old lockfile   code: 'ETARGET',
npm WARN old lockfile   type: 'version',
npm WARN old lockfile   wanted: '1.44.0',
npm WARN old lockfile   versions: [
npm WARN old lockfile     '0.2.0',        '0.2.1',         '0.2.2',        '0.2.3',
npm WARN old lockfile     '0.2.4',        '0.2.5',         '0.2.6',        '0.3.0',
npm WARN old lockfile     '0.4.0',        '0.4.1',         '0.4.2',        '0.4.3',
npm WARN old lockfile     '0.4.4',        '0.5.0',         '0.5.1',        '0.5.2',
npm WARN old lockfile     '0.5.3',        '0.5.4',         '0.6.0',        '0.6.1',
npm WARN old lockfile     '0.6.2',        '0.6.3',         '0.6.4',        '0.6.5',
npm WARN old lockfile     '0.6.6',        '0.6.7',         '0.7.0-alpha',  '0.7.0',
npm WARN old lockfile     '0.8.0',        '0.8.1',         '0.8.2',        '0.8.3',
npm WARN old lockfile     '0.8.4',        '0.8.5',         '0.8.6',        '0.9.0',
npm WARN old lockfile     '0.9.1',        '0.9.2',         '0.9.3',        '0.9.4-rc1',
npm WARN old lockfile     '0.9.4',        '0.9.5-rc1',     '0.9.5',        '0.9.6',
npm WARN old lockfile     '1.0.0',        '1.0.1',         '1.0.2-alpha',  '1.0.2',
npm WARN old lockfile     '1.0.3',        '1.1.0',         '1.1.1',        '1.1.2',
npm WARN old lockfile     '1.1.3',        '1.1.4',         '1.2.0',        '1.2.1',
npm WARN old lockfile     '1.2.2',        '1.2.3',         '2.0.0-beta',   '2.0.0',
npm WARN old lockfile     '2.0.1',        '3.0.0-alpha.0', '3.0.0-beta.2', '3.0.0-beta.3',
npm WARN old lockfile     '3.0.0-beta.4', '2.1.0',         '2.1.1',        '3.0.0-beta.5',
npm WARN old lockfile     '3.0.0-beta.7', '3.0.0',         '3.1.0',        '3.1.1',
npm WARN old lockfile     '3.1.2',        '3.2.0',         '3.3.0',        '3.3.1',
npm WARN old lockfile     '3.3.2',        '3.3.3',         '3.4.0-beta1',  '3.4.0-beta.2',
npm WARN old lockfile     '3.4.0',        '3.4.1',         '3.4.2',        '3.5.0-beta.1',
npm WARN old lockfile     '3.5.1',        '3.5.2',         '3.5.3',        '3.6.0',
npm WARN old lockfile     '3.7.0',        '3.8.0',         '3.9.0',        '3.9.1',
npm WARN old lockfile     '3.9.2',        '3.9.3',         '3.10.0',       '3.10.0-1',
npm WARN old lockfile     '3.10.1',       '3.11.0',        '3.11.1',       '3.11.2',
npm WARN old lockfile     ... 44 more items
npm WARN old lockfile   ],
npm WARN old lockfile   distTags: { latest: '7.0.1', next: '4.8.3', beta: '4.11.0' },
npm WARN old lockfile   defaultTag: 'latest'
npm WARN old lockfile }
npm WARN deprecated<EMAIL_ADDRESS>See https://github.com/lydell/source-map-url#deprecated
npm WARN deprecated<EMAIL_ADDRESS>Please see https://github.com/lydell/urix#deprecated
npm WARN deprecated<EMAIL_ADDRESS>this library is no longer supported
npm WARN deprecated<EMAIL_ADDRESS>https://github.com/lydell/resolve-url#deprecated
npm WARN deprecated<EMAIL_ADDRESS>See https://github.com/lydell/source-map-resolve#deprecated
npm WARN deprecated<EMAIL_ADDRESS>Debug versions >=3.2.0 <3.2.7 || >=4 <4.3.1 have a low-severity ReDos regression when used in a Node.js environment. It is recommended you upgrade to 3.2.7 or 4.3.1. (https://github.com/visionmedia/debug/issues/797)
npm WARN deprecated<EMAIL_ADDRESS>Debug versions >=3.2.0 <3.2.7 || >=4 <4.3.1 have a low-severity ReDos regression when used in a Node.js environment. It is recommended you upgrade to 3.2.7 or 4.3.1. (https://github.com/visionmedia/debug/issues/797)
npm WARN deprecated<EMAIL_ADDRESS>Debug versions >=3.2.0 <3.2.7 || >=4 <4.3.1 have a low-severity ReDos regression when used in a Node.js environment. It is recommended you upgrade to 3.2.7 or 4.3.1. (https://github.com/visionmedia/debug/issues/797)
npm WARN deprecated<EMAIL_ADDRESS>Please upgrade  to version 7 or higher.  Older versions may use Math.random() in certain circumstances, which is known to be problematic.  See https://v8.dev/blog/math-random for details.
npm WARN deprecated<EMAIL_ADDRESS>request has been deprecated, see https://github.com/request/request/issues/3142
npm WARN deprecated<EMAIL_ADDRESS>This version of tar is no longer supported, and will not receive security updates. Please upgrade asap.
npm ERR! code 1
npm ERR! path /Users/taylor/workspace/static-timeline-generator/node_modules/gulp-sass/node_modules/node-sass
npm ERR! command failed
npm ERR! command sh -c node scripts/build.js
npm ERR!  In file included from ../src/binding.cpp:1:
npm ERR! In file included from ../../../../nan/nan.h:58:
npm ERR! In file included from /Users/taylor/.node-gyp/16.14.0/include/node/node.h:63:
npm ERR! In file included from /Users/taylor/.node-gyp/16.14.0/include/node/v8.h:30:
npm ERR! /Users/taylor/.node-gyp/16.14.0/include/node/v8-internal.h:492:38: error: no template named 'remove_cv_t' in namespace 'std'; did you mean 'remove_cv'?
npm ERR!             !std::is_same<Data, std::remove_cv_t>::value>::Perform(data);
npm ERR!                                 ~^~~~~~~
npm ERR!                                      remove_cv
npm ERR! /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/c++/v1/type_traits:710:50: note: 'remove_cv' declared here
npm ERR! template  struct _LIBCPP_TEMPLATE_VIS remove_cv
npm ERR!                                                  ^
npm ERR! 1 error generated.
npm ERR! make: *** [Release/obj.target/binding/src/binding.o] Error 1
npm ERR! gyp ERR! build error
npm ERR! gyp ERR! stack Error: make failed with exit code: 2
npm ERR! gyp ERR! stack     at ChildProcess.onExit (/Users/taylor/workspace/static-timeline-generator/node_modules/node-gyp/lib/build.js:262:23)
npm ERR! gyp ERR! stack     at ChildProcess.emit (node:events:520:28)
npm ERR! gyp ERR! stack     at Process.ChildProcess._handle.onexit (node:internal/child_process:291:12)
npm ERR! gyp ERR! System Darwin 20.6.0
npm ERR! gyp ERR! command<EMAIL_ADDRESS>"/Users/taylor/workspace/static-timeline-generator/node_modules/node-gyp/bin/node-gyp.js" "rebuild" "--verbose" "--libsass_ext=" "--libsass_cflags=" "--libsass_ldflags=" "--libsass_library="
npm ERR! gyp ERR! cwd /Users/taylor/workspace/static-timeline-generator/node_modules/gulp-sass/node_modules/node-sass
npm ERR! gyp ERR! node -v v16.14.0
npm ERR! gyp ERR! node-gyp -v v3.8.0
npm ERR! gyp ERR! not ok
npm ERR! Build failed with error code: 1
<details>

It's 14. Install using node v14


use discrete getters and setters for a computed property

Using the same function as both a getter and setter is deprecated in Ember 1.13. We should use a discrete getter and setter instead.

Is this really the only instance of the old getter/setter style?

Yep. By the way, the test was already failing.

:rowboat:


Understanding the Role of UVM and Circuit Simulators

Hi,
I'm new to circuit verification and currently learning how to use this tool. From what I understand, the tool can generate randomized instructions, run ISS emulation, and create a trace report to serve as a golden reference. Given that this process doesn't involve circuit simulation, I'm curious—why do we still need UVM and a circuit simulator in this context?

why do we still need UVM and a circuit simulator in this context?

Hi @mutianzh, if you ask five verification engineers about this you will get six different answers.  :laughing: Here is mine:

SystemVerilog/UVM is by far the most popular language and methodology for developing verification environments (testbenches) for ASIC and FPGA RTL models used in Industry today.  Given that, an SV/UVM implementation of riscv-dv makes sense.
Once you've got your reference trace report from your ISS, you'll need to generate a trace report through your ASIC/FPGA implementation.  Again, the most popular popular language and methodology for that is SV/UVM.

I hope this answers your question.  If it does, please close the issue.  If you still have questions, you can reach out to me directly (look for me on LinkedIn).


std.math: №3, conj for double and float

The change LGTM, but I'm not mister math, so I think we should wait for somebody else to take a look.

Oh, Mister Math is especially welcome in #2991.

could you and unittests similar to std.math no2 to cover all types.

Auto-merge toggled on


PyPi package doesn't contain any actual code

Hello,
it appears that something went wrong when you published you package to PyPi as downloading it (either through pip or manually) yields an archive file containing only metadata without any actual code, i suspect an issue with your setup.cfg file but I'm not 100% sure.
Best Regards,
Earthnuker

Hey @Earthnuker, thanks for raising that. I think I've fixed that tonight -- my first time publishing to pypi, it's a pretty convoluted process! Could you upgrade to 0.0.9 and let me know if you're still having issues?
py -m pip install --upgrade --no-cache-dir podqueue
py -m podqueue --help

Thanks!

Thanks for the extremely quick response!
That seems to have resolved the issue of the missing files, but now there seems to be too many files:
looks like it dumped the src folder in my site-packages folder instead of in a podqueue  subfolder:
Name: podqueue
Version: 0.0.9
Summary: Automate the archiving of podcast feeds, including show notes and images.
Home-page: https://github.com/tquin/podqueue
Author: Tyler Quinlivan
Author-email<EMAIL_ADDRESS>License: MIT
Location: c:\users\earthnuker\miniconda3\lib\site-packages
Requires: feedparser, requests
Required-by:
Files:
  podqueue-0.0.9.dist-info\INSTALLER
  podqueue-0.0.9.dist-info\LICENSE
  podqueue-0.0.9.dist-info\METADATA
  podqueue-0.0.9.dist-info\RECORD
  podqueue-0.0.9.dist-info\REQUESTED
  podqueue-0.0.9.dist-info\WHEEL
  podqueue-0.0.9.dist-info\top_level.txt
  podqueue\__init__.py
  podqueue\__main__.py
  podqueue\__pycache__\__init__.cpython-37.pyc
  podqueue\__pycache__\__main__.cpython-37.pyc
  podqueue\__pycache__\main.cpython-37.pyc
  podqueue\main.py
  podqueue\podqueue.egg-info\PKG-INFO
  podqueue\podqueue.egg-info\SOURCES.txt
  podqueue\podqueue.egg-info\dependency_links.txt
  podqueue\podqueue.egg-info\requires.txt
  podqueue\podqueue.egg-info\top_level.txt
  src\__init__.py
  src\__pycache__\__init__.cpython-37.pyc
  src\__pycache__\main.cpython-37.pyc
  src\main.py
  src\podqueue.conf
  src\requirements.txt

also, running it with my PodcastAddict export doesn't seem to do anything, but I'll open a separate issue for that

That fixed it!
thanks you very much


[AutoFormView] a method to provide properties instead of reflection

otherwise AOT can't get compiled.
btw i don't know why, my App got stuck when booting up if i use AutoFormView...... not sure why, still investigating.
btw, in the doc https://enisn-projects.io/docs/en/uranium/latest/infrastructure/AutoFormView,
Then you can use it like this:
<uranium:FormView Source="{Binding .}" />

i believe it's a typo? should be uranium:AutoFormView  i think?

otherwise AOT can't get compiled.
btw i don't know why, my App got stuck when booting up if i use AutoFormView...... not sure why, still investigating.
btw, in the doc https://enisn-projects.io/docs/en/uranium/latest/infrastructure/AutoFormView,
Then you can use it like this:
<uranium:FormView Source="{Binding .}" />

i believe it's a typo? should be uranium:AutoFormView  i think?

my App got stuck, i found the reason, if StyleClass missing, it will happen.....
for example i use this:
<Button input:FormView.IsSubmitButton="True" Text="Add" StyleClass="ElevatedButton" />
ElevatedButton missing caused the hanging.... the default styles provided by UraniumUI does not have this style key, i tried to search but no result.

otherwise AOT can't get compiled.
btw i don't know why, my App got stuck when booting up if i use AutoFormView...... not sure why, still investigating.
btw, in the doc https://enisn-projects.io/docs/en/uranium/latest/infrastructure/AutoFormView,
Then you can use it like this:
<uranium:FormView Source="{Binding .}" />

i believe it's a typo? should be uranium:AutoFormView  i think?

my App got stuck, i found the reason, if StyleClass missing, it will happen.....
for example i use this: <Button input:FormView.IsSubmitButton="True" Text="Add" StyleClass="ElevatedButton" /> ElevatedButton missing caused the hanging.... the default styles provided by UraniumUI does not have this style key, i tried to search but no result.

I'm sorry, just solved.
this was caused by the same reason i have found and reported to MAUI team: https://github.com/dotnet/maui/issues/23079
:(

btw, a question about usage, ReactiveAttribute is required? or i can actually use ObservableProperty too? my app does not use ReactiveUI.....

[Reactive] is just for demonstration, It'll work plain properties or fields with ObservableProperty attribute. I should add an information about it in the documentation 👍

Hi, sorry for the late reply, I was away for a while.
AutoFormView is an experimental component and at the beginning, its purpose was to build PoC CRUD operations faster.
But I know it should support AOT compilation and using reflection causes problems on AOT compilation. So, I agree to replace Reflection usage with Source Generator or a method provider/factory for properties

I got it. thanks  man!
this is absolutely a super component IMO!! I love it!
It makes things so simple ❤🔥


Can I use Pandora to do de novo local assembly of regions that have no read coverage when doing a mapping to reference?

Hello !
Can I use pandora and give my own gap region which is not in the reference as a loci?
The idea is that pandora denovo would perform a local assembly and fill the gaps ? do you think that it's possible ? I have a reference genome which has a gap, and a dataset of reads from other organisms.
Here is a picture of mapped reads from the other organism in question to my reference.

For instance I would supply this sequence and perform a denovo local assembly with pandora discover?
Then I would merge the denovo pandora variant from the discover into the reference and re-map the reads.
Thank you for your answer.

Hi there.  It sounds a very unnatural problem to solve with Pandora . Why don't you just use racon directly? When hours say your reference genome has a gap, do you mean no reads from your sample map to it? Can't it be a deletion?

The genome I have is recent, and I use it as a reference. However, I also have a collection of older genomes for which I have paired-end reads. These genomes probably have INDELs relative to the reference. The samples are actually quite distant phylogenetically. The heuristic behind this idea is that while most of the genome is already correct, I would not like to use tools like racon, which will correct the whole length of the genome. Ok, I will give racon a try!
Thank you for the advice.

Hi there - you can control what you give racon, you could just give it the region of the genome you want, and the reads you want to give it. hope that helps!


Boost page

Standards checklist:

[x] The PR title is descriptive.
[x] The PR doesn't replicate another PR which is already open.
[x] The PR has self-explained commits history.

[x] The code is mine or it's from somewhere with an Apache-2.0 compatible license.
[x] The code is efficient, to the best of my ability, and does not waste computer resources.
[x] The code is stable and I have tested it myself, to the best of my abilities.
[x] If the code introduces new classes, methods, I provide a valid use case for all of them.

Changes:
added boost page
Other comments:
This PR is closed #833

Removed package-lock.json downgrade to version 1. We use version 2 on master.
Removed LESS build minification. We don't use minified versions on master.

@j-bitmaker consider change img/Digifinex.svg.png name.


Local root dependency prevents use of the library

Hi @adam-james-v ! I just tried to update to the latest git version of svg-clj, but got a dependency resolution error because eyebrowse has a local root dep coordinate. Is this because the new git version depends on unpushed changes to eyebrowse? Should I fall back to the previous version for the time being?

I was able to get around this error by manually specifying the Git coordinate for eyebrowse.

Really sorry about that, I let the state of this project get a bit messy, and this is an unfortunate result. I'll be improving my approach to things, so stuff like this should (hopefully) not happen again.
I believe the latest push to the main branch should fix this -> that eyebrowse thing was purely an experiment anyway, and should not be needed for this library at all.


#1003 - DistributionsController#create refactor

Resolves #1003
Description
Basically, I deleted @distribution.valid? because when @distribution.save is called, the method does the necessary validations before committing to the database. With this change, I removed one render :new . I can delete the another render :new but this will require changes on the exception that is thrown so I think that's better to open another issue before making the changes.
Additional thanks to @dede999 who helped me with this issue.
Type of change

Refactoring
Bug fix (non-breaking change which fixes an issue) (?)

How Has This Been Tested?
All the tests run green.

Looks great, thank you!


XCM ROUTER, XCM API: Bring back PNPM

Fix PNPM so users can use it for XCM Router and XCM API.
This involves:

Update code
Update docs
Update readmes

Fixed with a switch to monorepo. PNPM is now supported.


Correct A/W link

@henke37 : Thanks for your contribution! The author(s) have been notified to review your proposed change.


https://.example.com/.well-known/openid-configuration is a 404

With NSS, both the main domain and the pod domain work as an IDP:

https://solidcommunity.net/.well-known/openid-configuration
https://michielbdejong.solidcommunity.net/.well-known/openid-configuration

With Pivot, the main domain works:

https://solidcommunity.net:8443/.well-known/openid-configuration

But subdomains don't:

https://michielbdejong.solidcommunity.net:8443/.well-known/openid-configuration is a 404 (in fact it's a 301 but that's due to #42)

Will look into this on Monday, should be easy I hope; in any case I don't think it's a true blocker for the migration.

It's interesting, /.well-known/web-identity works for the base and subdomains, but /.well-known/openid-configuration only for the base domain. I'm adding debug statement into the BaseRouteHandler on pivot.pondersource.com to debug this.

Reopening this because apparently https://jeff-zucker.solidcommunity.net:8443/.well-known/openid-configuration is still a 404 for some reason. Will investigate.


A welcoming message

A newbie here with the most heartfelt welcoming message

Nice work Kelkinkar!

Just wanted to let you know that your message was separate from the Welcome Wall. Do you want to try again to get the message onto the wall?


Add website to infrastructure

This PR adds an entry website, where we can pitch the idea about linfa and have some announcements/news section.

[x] add static page based on the Zola generator to docs/website: rendered
[x] move all implementations into algorithms/ because the root became too messy
[x] adds workflows which automatically builds the latest rust docs and website and publishes them to gh-pages
[ ] complete announcement in news section

sorry for the large number of file changes, you can search for diffs in a subpath with git diff master docs/website/ :sweat_smile:

Codecov Report

Merging #87 (1eb87fb) into master (d0363a1) will increase coverage by 0.09%.
The diff coverage is 85.71%.

@@            Coverage Diff             @@
##           master      #87      +/-   ##
==========================================
+ Coverage   55.14%   55.23%   +0.09%
==========================================
  Files          62       62
  Lines        5063     5071       +8
==========================================
+ Hits         2792     2801       +9
+ Misses       2271     2270       -1

Impacted Files
Coverage Δ

algorithms/linfa-bayes/src/gaussian_nb.rs
55.46% <ø> (ø)

...thms/linfa-clustering/src/appx_dbscan/algorithm.rs
21.42% <ø> (ø)

...infa-clustering/src/appx_dbscan/cells_grid/cell.rs
52.04% <ø> (ø)

...linfa-clustering/src/appx_dbscan/cells_grid/mod.rs
56.52% <ø> (ø)

...nfa-clustering/src/appx_dbscan/cells_grid/tests.rs
100.00% <ø> (ø)

...linfa-clustering/src/appx_dbscan/clustering/mod.rs
44.44% <ø> (ø)

...nfa-clustering/src/appx_dbscan/clustering/tests.rs
90.00% <ø> (ø)

...fa-clustering/src/appx_dbscan/counting_tree/mod.rs
44.28% <ø> (ø)

...-clustering/src/appx_dbscan/counting_tree/tests.rs
100.00% <ø> (ø)

...infa-clustering/src/appx_dbscan/hyperparameters.rs
22.22% <ø> (ø)

... and 54 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d0363a1...1d38c46. Read the comment docs.

Fantastic work on the website💪🏻 I believe that cleaning up the main folder by moving all the algorithms to their subfolder was a very good idea too and it looks much nicer now.
I only have two suggestions:
* Should we add the link to the website in the readme for linfa?

* In the `About` page of the website (in the mobile version) the table obviously does not fit, I was wondering if maybe it would be better to make only the table side-scrollable and not the whole page? This is a very picky comment so feel free to ignore it sweat_smile

yes and yes, will figure something out for the table later this day :)

Besides just wondering if we want to host directly from the rust-ml group, everything else looks good! I've clicked around the current site, and didn't run into any bugs. If you're satisfied, this looks good to go from me :)

I would publish the website at rust-ml.github.io/linfa/, because it's also under the rust-ml organization

okay let's merge

damn the links in README are not updated :sweat_smile: I will push another commit when the website is online

fixed in latest commit and everything seems fine :+1:

Everything seems to be working fine 🚀

Links to algorithms in About page are broken.

yep fixed in f79fe9e053d7387a11a0682590e2c7cb56640444

Nice website! Bravo! :clap: :clap: :clap:


suggesting a new category UI Inspiration

Added CodeMyUI and Inspiration UI to a new section called UI Inspiration. added a bunch of labels to free stuff in Design Pattern and Inspiration Tools.

@SaijoGeorge I thinks it's a great idea to make a new section. And thanks for the labels!


Ensure image e2e jobs are accessible via Prow

Currently, the containers are being built in Azure pipelines and require a /AzurePipelines run command from a collaborator of the repo to be run. This should be either integrated with prow so all tests can run via /retest alternatively should be moved to another backend.

/sig test-infra

/area devex

/area devex

/area dev-ex

/area dev-ex

/closed


⚠ Bofrost.nl has degraded performance

In 5d0d4f4, Bofrost.nl (https://www.bofrost.nl) experienced degraded performance:

HTTP code: 200
Response time: 1885 ms

Resolved: Bofrost.nl performance has improved in e779f9f.


jupyter server no authorization message

I'm running jupyter notebook as a server on a raspberry pi. I also run jupyter notebook in a virtualenv. I was able to run jupyterdrive by using the --user option. Because this is running as a server on my network I initiate jupyter using jupyter notebook --ip=<IP_ADDRESS> --port=8889. But when I go to the notebook interface using my browser I do not get the authorization message. Any suggestions? Thanks.

I am also facing the same problem. Is anyone able to solve this issue?


Review and integrate changes from SlicerSALT

https://github.com/DCBIA-OrthoLab/MFSDA_Python/compare/master...slicersalt:slicersalt-2019-02-13-0a67df1d8
cc: @juanprietob

Closing. This has been done.


Device language issue on iOS wallet

Bug title
Wrong symbols when using swedish as device language on ios
Bug description
Where there should be spaces there are instead _
To Reproduce
Change device language to swedish (only language tested.)
Platform and build

iOS 13.3.1
BEAM 4.1.2

**

translation issue


feat(i18n): homepage link for 404 pages

Hello,
This is hopefully a small non-breaking change.
This PR adds a homepage link to the 404 page.
This makes it easier to navigate to the correct page when following a dead link, particularly on mobile pages where the explorer tree is hidden.
The translations are based on Google Translate + asking some bilingual friends. Apologies if the direct translation doesn't make sense!

Have re-added Farsi support into this branch. Apologies, I didn't merge the changes in, as my v4 branch of my fork is currently being used for something else...
Currently showing up as a conflict for the added line.

hey, please make sure the merge conflict is resolved so we can merge!

Oops! Another language got merged while this PR was open. I've rebased this branch off the latest upstream/v4 to resolve.


unable to sync directory with system group # below 1000

Hi, I have a system group called data with a group id of <1000 (990) and when I try and sync my directory asd preview lists the group as 1000 rather than 990.
Is this expected?  I can't run the program on that synced directory from a user that belongs to that 990 group.
Many thanks

I ask because I am trying to run a program from a ramdisk and it doesn't seem to be able to access a config directory in my home drive.  Is it correct that programs on the ramdisk should not be able to access the homedrive?  I have checked the permissions and they seem ok.  The tmpfs is as follows in fstab:
tmpfs       /mnt/ramdisk tmpfs   nodev,exec,nosuid,nodiratime,size=4G   0 0

Never tried syncing with a gid <1000... is there something setup on the system that would prohibit the creation of files to your tmpfs by users in that group?

@millerthegorilla Is this still affecting you?


fix validation of non-existing bind-mount source

Unlike docker run -v.., docker service create --mount does not allow bind-mounting non-existing host paths.
This adds validation for the specified source, and produces an error if the path is not found on the host.
fixes https://github.com/docker/docker/issues/25484

ping @cpuguy83 @stevvooe PTAL

LGTM

LGTM


LEM support for cons, car, cdr and let

This requires the constraint generation that's implemented in #427

It is indeed


chore: fix example for operation security

security property on operation level is supposed to be an array of security requirement objects and not a single object -> https://www.asyncapi.com/docs/reference/specification/v2.5.0#operationObject
example before fix: https://studio.asyncapi.com/?url=https://raw.githubusercontent.com/asyncapi/spec/master/examples/operation-security.yml
example after fix: https://studio.asyncapi.com/?url=https://raw.githubusercontent.com/derberg/asyncapi/c61b29329b73867f98914c607f03015549169c34/examples/operation-security.yml

/rtm


[2.2.0]Bug or feature? Relative path route to root.

https://github.com/saleem-hadad/larecipe/commit/9ef07bbca51cddd18c42a20e3fd07cef5bfbd98c#diff-a917fe07e275932a280a02bec949accc
Describe the bug
When I use relative path in 2.2.0
  - [AccessTokenPlatform](#AccessTokenPlatform)
  - [NotificationEventStatus](#NotificationEventStatus)

The link in browser route to http://localhost/#AccessTokenPlatform
To Reproduce
Steps to reproduce the behavior:

Create a clean laravel project
Require larecipe 2.2.0
Add above doc

Expected behavior
Move to the correct position in current page.
I think the problem was added in this commit, but I can't find the issue, why it was added
The base should be

or removed directly.
Is it a bug or feature? And how can I fix it in 2.2.0

After upgrade from 1.x to 2.x I have the same problem.

@RichardDominik Is this issue related to getting re-routed to the /login page when larecipe.settings.auth is true and you're logged in?

Me too. I don't understand why this
https://github.com/saleem-hadad/larecipe/commit/9ef07bbca51cddd18c42a20e3fd07cef5bfbd98c#diff-a917fe07e275932a280a02bec949accc
was made. Deleting that addition fixes the issue.

I submitted a PR to fix this, based on @WillGoldstein's comment. I tested it to make sure nothing else was effected.

thanks @AbbyJanke

This was fixed with #167 and can be blosed

I've same issue now.

@jadamec the issue is fixed but see #171 for why you don't have the fix. Just delete the one line as seen in #167 for now.


Added resource management doc

This change is

Whole file has space as first column - looks like something non intentional.

Reviewed 1 of 1 files at r1.
Review status: all files reviewed at latest revision, 4 unresolved discussions.

docs/resource_managment.md, line 4 at r1 (raw file):

 ## Resource monitoring on node
 All data about current resource usage are collected by cadvisor, so when VM is started in Virtlet container (it's not using a separate container for VM) - cadvisor will return only resources used by `vmwrapper`, which uses this container only during pod start/cleanup
  (networking setup/teardown). This means that scheduler has info that virtlet controlled pods do not use any RAM/cpu when there are no limits set in pod definition.

additional space at the beginning of line?

docs/resource_managment.md, line 10 at r1 (raw file):

 1. `shares` - relative value of cpu time assigned, not recommended for using in production as it's hard to predict actual performance as it highly depends on neighbours groups.
 1. `CFS CPU bandwidth control` - period and quota - hard limits.
 `Parent_Period/Quota >= Child_1_Period/Quota + ..+ Child_N_Period/Quota`,

inconsistent spaces around ..

docs/resource_managment.md, line 24 at r1 (raw file):

 rchives/libvir-list/2015-June/msg00923.html).
 1. `emulator_period` and `emulator_quota` - for emulator threads => for each VM we have extra consuming by qemu threads and the amount is currently unlimited. At the same time benchmarking can show that on unlimited domains, qemu threads depending on type of operatio
 n (disk or networking I/O) can consume from ~40% to ~80% from overall guest VM physical CPU usage.

Line broken in middle of word.

docs/resource_managment.md, line 31 at r1 (raw file):

 #### CPU overcommit
 It's outlined that linux scheduler doesn't perform well in case of CPU overcommitment and if it's not caused real need (like having multi-core VM to perform build/compile, running application inside that can effectively utilize multiple cores and was designed for par
 allel processing) and widely recommended to use one vCPU per VM otherwise you can expect performance degradation.

Line broken in middle of word.

Comments from Reviewable

Review status: all files reviewed at latest revision, 9 unresolved discussions.

docs/resource_managment.md, line 21 at r1 (raw file):

 ### Libvirt CPU allocation:
 1. `shares` is set per each vCPU.
 1. `period` and `quota` are set per each vCPU =>  comparing to containers resources consumed by VM with current settings will be greater in numvCPUs times per VM then per container. (More details re reasons of libvirt per-vCPU cgroup approach https://www.redhat.com/a

"=> with current settings resources consumed by VM will be greater (comparing to containers) by numvCPU times per container."
this seems to be better, but i'm not sure if this was what author had in mind.

Comments from Reviewable

Review status: all files reviewed at latest revision, 22 unresolved discussions.

docs/resource_managment.md, line 14 at r1 (raw file):

 ### K8s CPU allocation:
 1. `shares` set per container.

are set per container

docs/resource_managment.md, line 25 at r1 (raw file):

 1. `emulator_period` and `emulator_quota` - for emulator threads => for each VM we have extra consuming by qemu threads and the amount is currently unlimited. At the same time benchmarking can show that on unlimited domains, qemu threads depending on type of operatio
 n (disk or networking I/O) can consume from ~40% to ~80% from overall guest VM physical CPU usage.
 1. vCPUs per VM - commonly recommended to have 1 set (see details in section **"CPU overcommit"** below).

it's commonly recommended to have vCPU count set to 1

docs/resource_managment.md, line 30 at r1 (raw file):

 #### CPU overcommit
 It's outlined that linux scheduler doesn't perform well in case of CPU overcommitment and if it's not caused real need (like having multi-core VM to perform build/compile, running application inside that can effectively utilize multiple cores and was designed for par

outlined where? any links? maybe the link below this paragraph? (need to make this clear)

docs/resource_managment.md, line 40 at r1 (raw file):

 ### Virtlet CPU resources management
 1. By default, all VMs are created with 1 vCPU.
 To change vCPU number for VM-Pod you have to add annotation `VirtletVCPUCount `with desired number, see [examples/cirros-vm.yaml](../examples/cirros-vm.yaml).

VirtletVCPUCount -- misplaced apostrophe.

docs/resource_managment.md, line 41 at r1 (raw file):

 1. By default, all VMs are created with 1 vCPU.
 To change vCPU number for VM-Pod you have to add annotation `VirtletVCPUCount `with desired number, see [examples/cirros-vm.yaml](../examples/cirros-vm.yaml).
 1. Taking into account **2** in **"Libvirt CPU Allocation"** Virtlet divides equally assinged cpu resource limit among VM's vCPU threads.

Due to p.2 in "Libvirt CPU Allocation", Virtlet spreads the assigned CPU resource limit equally among VM's vCPU threads.

docs/resource_managment.md, line 46 at r1 (raw file):

 ### K8s memory allocation
 Omitting memory setting, i.e. passed value 0, leads to unlimited memory usage for container
 doesn't support container memory swap, when using docker container is created with --memory-swappiness=0 (see more https://github.com/kubernetes/kubernetes/issues/7294).

"Setting memory limit to 0 or omitting it means there's no memory limit for the container."
As of the swap, having swap on k8s nodes in unsupported. It may work but such a cluster is considered to be misconfigured basically and only good for testing. This may be acceptable for some DIND/local-cluster setup but not for a real cluster.

docs/resource_managment.md, line 50 at r1 (raw file):

 ### [Libvirt memory allocation](http://libvirt.org/formatdomain.html#elementsMemoryAllocation)
 1. `memory` - allocated RAM memory at VM boot.
 1. `memtune=>hard_limit` - cgroup memory limit on all domain including qemu itself usage. However, it's claimed that such limit should be set accurately.

cgroup memory limit on all domains which includes the memory used by qemu processes. "However, it's claimed that such limit should be set accurately."  -- what's claiming this and what does it mean, "accurately"?

docs/resource_managment.md, line 54 at r1 (raw file):

Overcommit memory to a ~150% of physical RAM.

What does this mean? It's done always, triggered by some setting, it's max or recommended value?
Re swap, one should not use swap on k8s nodes in the production setting.

docs/resource_managment.md, line 59 at r1 (raw file):

 ### Virtlet Memory resources management
 1. By default, each VM is assugned to 1GB of RAM. To set other value you need set resource memory limit for container, see [examples/cirros-vm.yaml](../examples/cirros-vm.yaml).

each VM is assigned 1GB or RAM (note the typo in 'assigned')

docs/resource_managment.md, line 60 at r1 (raw file):

 ### Virtlet Memory resources management
 1. By default, each VM is assugned to 1GB of RAM. To set other value you need set resource memory limit for container, see [examples/cirros-vm.yaml](../examples/cirros-vm.yaml).
 2. Virtlet generate domain's xml with setting "memoryBacking"=>locked to prevent swapping out domain's pages.

Virtlet generates domain XML with memoryBacking=locked setting

docs/resource_managment.md, line 62 at r1 (raw file):

 2. Virtlet generate domain's xml with setting "memoryBacking"=>locked to prevent swapping out domain's pages.

 ## Summary of planned action items:

of the action items

docs/resource_managment.md, line 65 at r1 (raw file):

 1. Implement [CRI container stats methods](https://github.com/kubernetes/kubernetes/issues/27097) for Virtlet.

 1. According to **2** and **3** in **"Libvirt CPU Allocation"** we need to elaborate some rule of setting CFS CPU bandwidth limits spreaded among qemu and vcpu threads, thus k8s scheduler could have right assumptions on allocated resources on the node.

we need to invent some rule of setting CFS CPU bandwidth limit spread among QEMU and vCPU threads, so as to make k8s scheduler have right assumptions about the resources allocated on the node

docs/resource_managment.md, line 67 at r1 (raw file):

 1. According to **2** and **3** in **"Libvirt CPU Allocation"** we need to elaborate some rule of setting CFS CPU bandwidth limits spreaded among qemu and vcpu threads, thus k8s scheduler could have right assumptions on allocated resources on the node.

 1. Research on how to set up memory [hard limits](http://libvirt.org/formatdomain.html#elementsMemoryTuning) for VM-pod.

Research how to configure the hard limits on memory for VM pods

Comments from Reviewable

Review status: 0 of 1 files reviewed at latest revision, 22 unresolved discussions.

docs/resource_managment.md, line 2 at r1 (raw file):
Previously, ivan4th (Ivan Shvedunov) wrote…
on the node

Done.

docs/resource_managment.md, line 4 at r1 (raw file):
Previously, ivan4th (Ivan Shvedunov) wrote…
everywhere: cAdvisor
All the data ... inside the Virtlet container ...
also -- qemu/kvm processes run inside the Virtlet container too, not just vmwrapper. So perhaps this can be put as all the resource usage being lumped together and ascribed to Virtlet pod.

rephrased, pls check

docs/resource_managment.md, line 4 at r1 (raw file):
Previously, jellonek (Piotr Skamruk) wrote…
additional space at the beginning of line?

Done.

docs/resource_managment.md, line 8 at r1 (raw file):
Previously, ivan4th (Ivan Shvedunov) wrote…
the actual performance which highly depends on the neighboring cgroups

Done.

docs/resource_managment.md, line 10 at r1 (raw file):
Previously, jellonek (Piotr Skamruk) wrote…
inconsistent spaces around ..

Done.

docs/resource_managment.md, line 14 at r1 (raw file):
Previously, ivan4th (Ivan Shvedunov) wrote…
are set per container

Done.

docs/resource_managment.md, line 21 at r1 (raw file):
Previously, jellonek (Piotr Skamruk) wrote…
"=> with current settings resources consumed by VM will be greater (comparing to containers) by numvCPU times per container."
this seems to be better, but i'm not sure if this was what author had in mind.

rephrased, pls check

docs/resource_managment.md, line 22 at r1 (raw file):
Previously, ivan4th (Ivan Shvedunov) wrote…
can't understand this frankly ...

rephrased, pls check

docs/resource_managment.md, line 24 at r1 (raw file):
Previously, jellonek (Piotr Skamruk) wrote…
Line broken in middle of word.

Done.

docs/resource_managment.md, line 25 at r1 (raw file):
Previously, ivan4th (Ivan Shvedunov) wrote…
it's commonly recommended to have vCPU count set to 1

Done.

docs/resource_managment.md, line 30 at r1 (raw file):
Previously, ivan4th (Ivan Shvedunov) wrote…
outlined where? any links? maybe the link below this paragraph? (need to make this clear)

yep, below link contains more details. As this is all one paragraph summarizing the main aspects, I put it at the end of it.

docs/resource_managment.md, line 31 at r1 (raw file):
Previously, jellonek (Piotr Skamruk) wrote…
Line broken in middle of word.

Done.

docs/resource_managment.md, line 40 at r1 (raw file):
Previously, ivan4th (Ivan Shvedunov) wrote…
VirtletVCPUCount -- misplaced apostrophe.

Done.

docs/resource_managment.md, line 41 at r1 (raw file):
Previously, ivan4th (Ivan Shvedunov) wrote…
Due to p.2 in "Libvirt CPU Allocation", Virtlet spreads the assigned CPU resource limit equally among VM's vCPU threads.

Done.

docs/resource_managment.md, line 46 at r1 (raw file):
Previously, ivan4th (Ivan Shvedunov) wrote…
"Setting memory limit to 0 or omitting it means there's no memory limit for the container."
As of the swap, having swap on k8s nodes in unsupported. It may work but such a cluster is considered to be misconfigured basically and only good for testing. This may be acceptable for some DIND/local-cluster setup but not for a real cluster.

fixed, pls check.

docs/resource_managment.md, line 50 at r1 (raw file):
Previously, ivan4th (Ivan Shvedunov) wrote…
cgroup memory limit on all domains which includes the memory used by qemu processes. "However, it's claimed that such limit should be set accurately."  -- what's claiming this and what does it mean, "accurately"?

fixed, added link

docs/resource_managment.md, line 54 at r1 (raw file):
Previously, ivan4th (Ivan Shvedunov) wrote…

Overcommit memory to a ~150% of physical RAM.

What does this mean? It's done always, triggered by some setting, it's max or recommended value?
Re swap, one should not use swap on k8s nodes in the production setting.

yes, re swap and k8s, but this paragraph regards to memory overcommit considerations in common case.
rephrased to make it clearer.
More details are in the link below.

docs/resource_managment.md, line 59 at r1 (raw file):
Previously, ivan4th (Ivan Shvedunov) wrote…
each VM is assigned 1GB or RAM (note the typo in 'assigned')

Done.

docs/resource_managment.md, line 60 at r1 (raw file):
Previously, ivan4th (Ivan Shvedunov) wrote…
Virtlet generates domain XML with memoryBacking=locked setting

Done.

docs/resource_managment.md, line 62 at r1 (raw file):
Previously, ivan4th (Ivan Shvedunov) wrote…
of the action items

Done.

docs/resource_managment.md, line 65 at r1 (raw file):
Previously, ivan4th (Ivan Shvedunov) wrote…
we need to invent some rule of setting CFS CPU bandwidth limit spread among QEMU and vCPU threads, so as to make k8s scheduler have right assumptions about the resources allocated on the node

Done.

docs/resource_managment.md, line 67 at r1 (raw file):
Previously, ivan4th (Ivan Shvedunov) wrote…
Research how to configure the hard limits on memory for VM pods

Done.

Comments from Reviewable

Reviewed 1 of 1 files at r2.
Review status: all files reviewed at latest revision, 23 unresolved discussions.

docs/resource_managment.md, line 51 at r2 (raw file):

#### Memory overcommit
Overcommit memory value can reach ~150% of physycal RAM amount. This relies on assumtion that most processes do not access 100% of their allocated memory all the time. So you can grant guest VMs more RAM than actually is available on the host. However, this strongly depends on memory swap size available on the node and workloads of VMs memory consumptions.

s/physycal/physical/
s/assumtion/assumption/

Comments from Reviewable

Review status: all files reviewed at latest revision, 23 unresolved discussions.

docs/resource_managment.md, line 21 at r1 (raw file):
Previously, vefimova (Victoria Efimova) wrote…
rephrased, pls check

"consumption" is a wrong word here b/c it's actually the limit, the VM can consume much less CPU than that. I'd say ... so actual CPU quota is quota value from the domain definition times the number of vCPUs.

docs/resource_managment.md, line 22 at r1 (raw file):
Previously, vefimova (Victoria Efimova) wrote…
rephrased, pls check

emulator_period and emulator_quota denote the limits for emulator activities not tied to vCPUs. Benchmarks show that these activities may measure up to 40-80% of overall physical CPU usage by QEMU/KVM process running the guest VM. At this time Virtlet doesn't support setting these values, but there are plans to fix this in future.

Comments from Reviewable

Review status: 0 of 1 files reviewed at latest revision, 23 unresolved discussions.

docs/resource_managment.md, line 21 at r1 (raw file):
Previously, ivan4th (Ivan Shvedunov) wrote…
"consumption" is a wrong word here b/c it's actually the limit, the VM can consume much less CPU than that. I'd say ... so actual CPU quota is quota value from the domain definition times the number of vCPUs.

thx, fixed

docs/resource_managment.md, line 22 at r1 (raw file):
Thx, fixed.

At this time Virtlet doesn't support setting these values, but there are plans to fix this in future.

added this to Virtlet CPU resource management section

docs/resource_managment.md, line 51 at r2 (raw file):
Previously, jellonek (Piotr Skamruk) wrote…
s/physycal/physical/
s/assumtion/assumption/

Done.

Comments from Reviewable

Reviewed 1 of 1 files at r3.
Review status: all files reviewed at latest revision, 23 unresolved discussions.

Comments from Reviewable

Review status: all files reviewed at latest revision, all discussions resolved.

Comments from Reviewable


[BUG] A 400 error occurred while uploading a UDF resource in the create UDF function popup

Which version of Dolphin Scheduler:
-[dev-resource-tree]

@break60


problem in building the app

I have this problem

after I:
I've replaced the API keys just like you've suggested
Git cloned your project and load it into Unity
Opened the 'Main' scene
Changed the build settings: SDK--> windows 10, UWP build type --> D3D, Debugging -- >Unity c# project
Build it
Open up the sln file
debug-> start debugging

update to the latest version of windows and enable developer mode


Scrollbar not working for frameset.

I have a jsp with frameset in it. I want to apply the custom scroll to this jsp, since no body tag, i am keeping the scroll for the frameset.
Please find the code attached

The problem is, the div which appends once the this(mCustomScrollbar _mCS_1) class is applied to the frameset, is not visible.
I have inspected through firbug. please find the screenshot attached.
Please help me on this, its really very urgent.
Thanks

AmrutaNaidu,
Hi, I am working on the same problem, could you solve it?
Thanks.
Hernan Lencinas


corrected typo

good job

Thanks,
but changes are not applied to the main repo.
because, we need to merge this PR.


installation: added docker script to auto update images

Description
This PR adds a new script which automatically builds the docker images for multiple python versions, installs the required dependencies for flexmeasures, and updates the dependency files of the current project folder.
This simplifies the dependency upgrade chore by automating the updates using docker.
To run simply follow the following steps
cd ci
./update-packages.sh

The script will check if docker is installed, running, and controllable without root requirement before building the images.
The script will also automatically clean up the containers, images and builder caches once completed.

[x] I agree to contribute to the project under Apache 2 License.
[x] To the best of my knowledge, the proposed patch is not based on code under GPL or other license that is incompatible with FlexMeasures

@Flix6x I agree and created https://github.com/FlexMeasures/tsc/issues/10

Updated the PR to copy only the required files for updating the package versions.

@nhoening @Flix6x I was thinking if it was possible to integrate this into the CI. Each time a new package gets added to the requirement base files execute the update-packages.sh script automatically to update the requirements.txt files. We can specify in the CI yaml to track only changes to requirement base files.

I decided that we don't need to do that right now. Maybe later.


Update readme to specify default value praxis

Something that is not very clear while reading the documentation is what/if any default values are generated and how they behave for each different type.

@Syrou I started putting together a more detailed and organized documentation using docusaurus. You can see the current WIP here. I was wondering if you could take a look at how the supported types are currently described and get your opinion and feedback 🙌 Were you thinking about something like this, or is there something that you feel is still missing and/or unclear?

@hopeman15 Looks pretty good to me!


Density Matrix Simulator seems to mutate initial states sometimes

Found this while running density matrix simulations in a loop passing in the same python object as initial state each time. Fails input density matrix validity check on the second iteration. not sure if bug or hack for higher performance. I remember pointing out something similar in the wavefunction simulator to @dabacon  late last year and I think it was deemed a bug. Thoughts in this case?

Yeah I think initial states should be copied.  There is a similar problem in that the state is reused in the moment by moment iterator: 3100

@trevormccrt can you give an example of this failing?  Is it the initial state that is being mutated?

Yes. What i did to produce this error was very simple. start with an initial state density matrix of type np.complex64. Then in a for loop run various circuits starting from the same initial state. I found that on the second iteration the initial state object had been mutated. This would lead to a "density matrix is not hermetian" error at the start of the second iteration during input checking. Basically just the following snippet in a loop for various values of circuit:
 actual_final = cirq.DensityMatrixSimulator().simulate(         circuit, initial_state=qubit_rho_zero,         qubit_order=qubits).final_density_matrix
Wrapping qubit_rho_zero in np.copy solved the issue for me.


Grafana Alert Data

Environment

Grafana version: 10.4.1
Databricks plugin version: 1.2.4
Browser: Google Chrome
DBSQL version: 2023.50

Issue Description
When executing queries through the normal Grafana dashboard, the Databricks data source returns expected results and operates without issues. However, utilizing the identical query within the Grafana Alert Manager results in a response lacking meaningful data.
Steps to Reproduce

Configure a data source in Grafana to connect to Databricks.
Create a dashboard with a query to Databricks that successfully retrieves and displays data.
Use the same query in the Grafana Alert Manager.
Observe the lack of meaningful data in the alert manager's output, despite the query working in the dashboard.

Expected Behavior
The Grafana Alert Manager should return meaningful data similar to the dashboard when using the same queries.
Actual Behavior
No meaningful data is returned in the Alert Manager, despite the query executing successfully in the Databricks query history for both dashboard and alert contexts.
Additional Information

The Databricks query history shows the query executes successfully in both dashboard and alert contexts with no apparent errors.

Possible Impact
This issue prevents the effective use of Grafana alerts with Databricks as a data source, potentially impacting monitoring and alerting for important metrics.

Hi @FloHofstetter thanks for opening the issue. I'm not really able to reproduce the issue. For my test query the alerting query works fine and returns the same data as in the dashboard.

Could you try the same query as me using the samples dataset (which should be available on every Databricks instance) to check if the issue still persists.
My Time Range: From now-924021753s To now-900520953s
SELECT window.start, float(avg(o_totalprice))
FROM samples.tpch.orders
WHERE $__timeFilter(o_orderdate)
GROUP BY $__timeWindow(o_orderdate)
ORDER BY start ASC;

Hi @mullerpeter,
thank you for your quick response. Here are my results:
SELECT window.start, float(avg(o_totalprice))
FROM samples.tpch.orders
WHERE $__timeFilter(o_orderdate)
GROUP BY $__timeWindow(o_orderdate)
ORDER BY start ASC;

SELECT
  timestamp(o_orderdate),
  float(avg(o_totalprice))
FROM
  samples.tpch.orders
WHERE $__timeFilter(o_orderdate)
GROUP BY o_orderdate;

I used the time range: From now-924021753s To now-900520953s
So the first query has the same result as you describe. Thes second one has the same behaviour as I discovered with my real data.

Ok so I was able to reproduce the issue you are having. Seems as if Grafana has an issue with the unsorted data in the Alerting. If I add an ORDER BY to the end of the query it works.
SELECT
  timestamp(o_orderdate),
  float(avg(o_totalprice))
FROM
  samples.tpch.orders
WHERE $__timeFilter(o_orderdate)
GROUP BY o_orderdate
ORDER BY o_orderdate;

Could you try your original query with an ORDER BY measured_at at the end to see if that works for you too.
I'll need to dig a bit deeper into why this is an issue, but in the meantime this could fix your problem.

Hi @mullerpeter,
Thank you for your response. Changing the order resolved the issue, and I can now see the data in the graph within the alerting view.
I removed the float cast due to the presence of Null values in the columns. From my perspective, this issue is resolved. Please feel free to close it, or keep it open if you wish to explore further the ordering requirements of Grafana.
Best regards,
Florian


SQL retriever -  Feature Request / Question

Not sure if I am using the right terminology.
User Story: As developer I would like to create a RAG system based of txt-to-SQL. To do this I need be able to connect to a SQL db
I saw llamaindex lifted and shifted langchain's SQL wrapper. Wondering if the same would need to happen for DSPy.
https://github.com/run-llama/llama_index/blob/main/llama-index-core/llama_index/core/utilities/sql_wrapper.py
This would not be enough for the SQL based RAG system but it is a necessary component. Still digging into llamaindex's implementation to understand it better.

import datasets
ds = datasets.load_dataset("b-mc2/sql-create-context")

import dspy
demos = [dspy.Example(**d).with_inputs("context", "question") for d in ds['train']]
train, test = demos[:100], demos[100:200]

import dspy, dotenv, os
dotenv.load_dotenv(os.path.expanduser("~/.env"))  # load OpenAI API key from .env file
lm = dspy.OpenAI(model="gpt-3.5-turbo", max_tokens=4000)
dspy.settings.configure(lm=lm)

from dspy.evaluate import Evaluate
exact_match = lambda ex, pred, _trace=None: ex.answer == pred.sql_query

evaluator = Evaluate(
    devset=test,
    num_threads=30,
    metric=exact_match,
    display_progress=True,
)
program = dspy.TypedPredictor("context, question -> sql_query")
print(evaluator(program))

from dspy.teleprompt.bootstrap import BootstrapFewShot
compiled = BootstrapFewShot(
    metric=exact_match,
    max_rounds=1,
).compile(
    program,
    trainset=train,
)
print(evaluator(compiled))

Thanks for the example. I could not reproduce it because I am having an issue with datasets. it does not matter what version I tried I cannot download any dataset.
However, I tried with a small dataset of 7 examples. if I increase the max_round to > 1 it gives me an error (see bellow). Mentioning it as you may want to test on your end.
File ...\Lib\site-packages\dspy\teleprompt\bootstrap.py:109, in BootstrapFewShot._bootstrap(self, max_bootstraps)
106     break
108 if example_idx not in bootstrapped:
--> 109     success = self._bootstrap_one_example(example, round_idx)
...
101 kwargs = {**self.kwargs, **kwargs}
--> 102 model = kwargs.pop('model')
104 return self.class(model=model, **kwargs)
KeyError: 'model'

Hi @JPonsa ,
this error is not related to the datasets but with the configuration of lm in DSPy. Do you specify the model name when using an LM in DSPy?
For instance with the code above:
lm = dspy.OpenAI(model="gpt-3.5-turbo", max_tokens=4000)
dspy.settings.configure(lm=lm)

Confirmed user error. I must have missed setting the LLM. I can no longer reproduce the issue.

@thomasahle How do we pass test context and question after compiling , compiled = BootstrapFewShot(     metric=exact_match,     max_rounds=1, ).compile(     program,     trainset=train, ) print(evaluator(compiled))


Get event when focus out

can i get event when focus out from input field??????

This feature will be added whit #57.
You will be able to do this:
import { Component } from '@angular/core';
import { InlineEditorComponent, InlineEvent } from 'ng2-inline-editor';

@Component({
  selector: 'app-root',
  templateUrl: '<inline-editor #editor [(ngModel)]="title" type="text" (onBlur)="save($event, editor)"></inline-editor>',
  styleUrls: ['./app.component.css']
})
export class AppComponent {
  title = 'hi';

  save(event: InlineEvent, editor: InlineEditorComponent) {
    // InlineEvent is a wrapper of {event: NativeEvent, state: State of input when it was saved}
    this.title = event.state.value;
    editor.saveAndClose({
      state: {
        value: this.title,
      }
    });
  }
}

👍

This should be fixed in the last version (0.2.0-alpha.0). With the change of name, you should do an npm i @qontu/ngx-inline-editor and update your imports 👍


qqx not found

Problem or new feature
This directly from Google

odd. this works on [new raku](new-raku.finanalyst.org/syntax/qxx]. They should be the same.

@coke this seems to be a build problem, so please transfer to Raku/doc-website


Typo on age_suitability.html

I think there is a typo on age_suitability.html. The word nudiy in the emotion type table should be nudity.
I'm not sure if this is the appropriate way to fix the published web documents, but I've created a PR #38 which edits the html file directly.
Feel free to close the PR if it's inappropriate.
Thanks for opening up an awesome library.

Thanks @SDSTony !


build_tz_base inherits USER from build_sgx but commands expect to be root

I get the following error:
   => ERROR [build_tz_base 3/9] RUN dpkg --add-architecture arm64
  ------
   > [build_tz_base 3/9] RUN dpkg --add-architecture arm64:
  #18 0.301 dpkg: error: unable to create new file '/var/lib/dpkg/arch-new': Permission denied

I think it is because build_tz_base inherits USER $USER from build_sgx.

@basmaelgaabouri, what do you think of this?