Performance of List semigroup in state aggregation is slow

Summingbird online uses lists for storing state of each key in cache.
Ultimately the value that it sums (at least in SyncSummingQueue) looks like: Map[Key, (Seq[InputState], Value)]
Thus doing plus on list(the implementation of seq that summingbird uses in Summer and FinalFlatMap) semigroup is very common and is in the critical path of summingbird online. The performance of this semigroup is very slow because we do
semigroup.plus(existingValue, newValue)
while boils down to
oldList ++ List(newValue)
oldList is typically the bigger one. So the cost of above addition is proportional to the size of bigger list. Thus if we accumulate one value at a time in the list the cost is O(n^2) rather than O(n).
I've seen this show up in YourKit profiles.
Aggregating in batch doesn't help because the top level value being summed is a Map[Key, (List[State], Value)] and GenericMapMonoid doesn't do a sumOption on underlying values in the map when doing sumOption. So ultimately plus gets called on the list of state.
One option is to change the data structure used for storing list of state, we could use a vector for example.
Another possible solution is to somehow provide a different implementation for the List semigroup used for combining state lists. Changing the order should fix it for example. List(newValue) ++ oldList would be fast and for state the order doesn't matter much. We would acknowledge newer tuples first but that shouldn't matter much, afaik nothing relies on acking order. Potentially it could result in tuples timing out but typically timeouts are pretty large for the order in a single batch to matter.
Looking to hear thoughts on this.

See batched:
https://github.com/twitter/algebird/blob/develop/algebird-core/src/main/scala/com/twitter/algebird/Batched.scala
Wrapping with that type will force the use of sumOption and can address the
concerns here I think (fixes the O(N^2) for sure). Try and see if that
fixes it in your kit.
On Mon, Sep 19, 2016 at 11:16 Pankaj Gupta<EMAIL_ADDRESS>wrote:

Summingbird online uses lists for storing state of each key in cache.
Ultimately the value that it sums (at least in SyncSummingQueue) looks
like: Map[Key, (Seq[InputState], Value)]
Thus doing plus on list(the implementation of seq that summingbird uses in
Summer and FinalFlatMap) semigroup is very common and is in the critical
path of summingbird online. The performance of this semigroup is very slow
because we do
semigroup.plus(existingValue, newValue)
while boils down to
oldList ++ List(newValue)
oldList is typically the bigger one. So the cost of above addition is
proportional to the size of bigger list. Thus if we accumulate one value at
a time in the list the cost is O(n^2) rather than O(n).
I've seen this show up in YourKit profiles.
Aggregating in batch doesn't help because the top level value being summed
is a Map[Key, (List[State], Value)] and GenericMapMonoid doesn't do a
sumOption on underlying values in the map when doing sumOption. So
ultimately plus gets called on the list of state.
One option is to change the data structure used for storing list of state,
we could use a vector for example.
Another possible solution is to somehow provide a different implementation
for the List semigroup used for combining state lists. Changing the order
should fix it for example. List(newValue) ++ oldList would be fast and for
state the order doesn't matter much. We would acknowledge newer tuples
first but that shouldn't matter much, afaik nothing relies on acking order.
Potentially it could result in tuples timing out but typically timeouts are
pretty large for the order in a single batch to matter.
Looking to hear thoughts on this.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/twitter/summingbird/issues/689, or mute the thread
https://github.com/notifications/unsubscribe-auth/AAEJdtsKeYTtv-gpNeXUssb3DuKsuQCKks5qrtGLgaJpZM4KAzIv
.

Batched will keep things in memory and thus increase memory footprint. A lot of the jobs are memory constrained, there is not much space available to trade for time. IMO, best would be to use a different data type for Seq[InputState], perhaps java.util.ArrayDeque[InputState] or similar that has fast append.

Wait, how is ArrayDeque less memory than Batched?
Do we ever actually have lazily constructed things there? I think we have
always materialized all of them anyway.
On Fri, Dec 23, 2016 at 20:36 Pankaj Gupta<EMAIL_ADDRESS>wrote:

Batched will keep things in memory and thus increase memory footprint. A
lot of the jobs are memory constrained, there is not much space available
to trade for time. IMO, best would be to use a different data type for
Seq[InputState], perhaps java.util.ArrayDeque[InputState] or similar that
has fast append.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/twitter/summingbird/issues/689#issuecomment-269071878,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAEJdjfHfsviPW_ueRB6uqN0l-nAGoLWks5rLL16gaJpZM4KAzIv
.

Isn't this the input state we are keeping? Doesn't that have to stay
materialized in memory?
On Sat, Dec 24, 2016 at 10:43 P. Oscar Boykin<EMAIL_ADDRESS>wrote:

Wait, how is ArrayDeque less memory than Batched?
Do we ever actually have lazily constructed things there? I think we have
always materialized all of them anyway.
On Fri, Dec 23, 2016 at 20:36 Pankaj Gupta<EMAIL_ADDRESS>wrote:
Batched will keep things in memory and thus increase memory footprint. A
lot of the jobs are memory constrained, there is not much space available
to trade for time. IMO, best would be to use a different data type for
Seq[InputState], perhaps java.util.ArrayDeque[InputState] or similar that
has fast append.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/twitter/summingbird/issues/689#issuecomment-269071878,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAEJdjfHfsviPW_ueRB6uqN0l-nAGoLWks5rLL16gaJpZM4KAzIv
.

Yes, I deleted my comment when I realized the same :). I've used iterator
now.
On Sat, Dec 24, 2016 at 12:45 PM P. Oscar Boykin<EMAIL_ADDRESS>wrote:

Isn't this the input state we are keeping? Doesn't that have to stay
materialized in memory?
On Sat, Dec 24, 2016 at 10:43 P. Oscar Boykin<EMAIL_ADDRESS>wrote:

Wait, how is ArrayDeque less memory than Batched?
Do we ever actually have lazily constructed things there? I think we have
always materialized all of them anyway.
On Fri, Dec 23, 2016 at 20:36 Pankaj Gupta<EMAIL_ADDRESS>wrote:
Batched will keep things in memory and thus increase memory footprint. A
lot of the jobs are memory constrained, there is not much space available
to trade for time. IMO, best would be to use a different data type for
Seq[InputState], perhaps java.util.ArrayDeque[InputState] or similar that
has fast append.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
<
https://github.com/twitter/summingbird/issues/689#issuecomment-269071878>,
or mute the thread
<
https://github.com/notifications/unsubscribe-auth/AAEJdjfHfsviPW_ueRB6uqN0l-nAGoLWks5rLL16gaJpZM4KAzIv
.

—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/twitter/summingbird/issues/689#issuecomment-269099718,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAojhjW1S_cUzjUdudNN8BPITd1wXYC7ks5rLYSFgaJpZM4KAzIv
.

We ended up replacing list with chain to fix this.


Added functionality to add/delete multiple songs

Made commit function that has to be called when ready to commit changes in playlist to Spotify.
Add and delete functions work the same way, but without committing to playlist every time.

This looks good to me, do we need the get/set in python though?

Closes #9


🎉 UI Overhaul!

Why we need this!
The current design is very wonky, with no clear routes for navigating through the app. Multiple unnecessary clicks are required to achieve simple tasks.
Affected parts

Home Screen
Source code organization
Use of vanilla HTML/CSS

Solutions

Adopt any simple frameworks to divide the project's UI into modules, allowing for better modularity.
Make the application simple to use, with lesser pages and focusing on what the product is aimed at E.g. make landing page for entering and tracking calories since this is a calorie tracker.
Use pages that can dynamically render, thereby requiring no refreshes and no new pages for showing updated data.
Use good color palette for entire website.

Additional context

Looks like this issue has been completed as part of several other minor issues.

Do we want to make any more UI changes or can close this issues ? @Diksha-Maurya @amritav

Do we want to make any more UI changes or can close this issues ? @Diksha-Maurya @amritav

We can suggest the user the diet plan according to the goal/currect weight.

Cool,  i will close this issue then. 🚀


Remove old zlib in favour of built in

the kit had a dependency of zlib 1.0.5 - this is 13 years old, and is replaced by the built in zlib in node itself
this should fix this issue that users have reported:
https://github.com/kkaefer/DEPRECATED-node-zlib/issues/14
fixes #2405

just adding a comment here for people if they need a work around, assuming you're using a version of npm (and that's npm, not, nodejs - the versioning is different) greater than 8.3.0 (which introduced overrides) then you can exclude zlib by adding this into your package.json and trying running npm install again:
"overrides": {
  "zlib": "../_EXCLUDED_"
}

@oscarduignan thanks! I've updated my template repo, as the npx command will fail:
https://github.com/joelanman/govuk-prototype-kit-prototype

@36degrees cheers, happy for you to edit any of it!


HPax.encode/2 should accept bare keyword lists

HPax.encode/2 requires three-element tuples to be passed, where the first element of each tuple describes the encoding action to be applied (one of :store, :store_name, :no_store, :never_store). In all existing call sites in both Mint and bandit, these actions are always the same. I propose an HPax.encode/3 which takes a third argument containing the action type to apply to all entries, which would allow calling with a standard keyword list of headers as the second argument.
Opening the issue for discussion in advance of a pretty trivial, as it will also influence call-site refactors in both Mint and bandit.

Added!


Is there any way for users to inspect the connections between cuda kernels compiled from operators?

I would like to see the connections between all cuda kernels generated by hidet in .cache folder. It seems that the directory is organized by operator categories without any other information about the connection only contains operator named directory and hash-named operator cuda kernel instances.
I wonder if I could get enough information(some config or some in-code position to add some prints to help me get the map of hash-named kernels and operators) so that I can construct some NN by myself using these kernels.

Thank you for your replying and the reference .py code. Yes this is the way to get the task-operator mapping but I still cannot decide the positions of compiled kernels in network.
I wonder know if I can get the connections of these kernels.
For example, suppose I have some tasks:
dde7be8d40f119f8 : fused(y=float32(2304,), x=float32(1, 40, 2304), y=float32(3, 12, 40, 64), fused_ops='reshape add reshape rearrange', anchor='rearrange')

4742a24e5f0cf34e : fused(b=float32(8, 96, 2304), data=float32(40, 768), y=float32(1, 8, 40, 2304), fused_ops='broadcast reshape rearrange batch_matmul reshape', anchor='batch_matmul')

8315bfe1649dc27f : fused(b=float32(1, 768, 50257), data=float32(40, 768), y=float32(40, 50257), fused_ops='broadcast batch_matmul reshape', anchor='batch_matmul')

003b329f9684cc83 : fused(b=float32(8, 96, 3072), data=float32(40, 768), y=float32(1, 8, 40, 3072), fused_ops='broadcast reshape rearrange batch_matmul reshape', anchor='batch_matmul')

69b07ec79b8aaf99 : fused(y=float32(40, 40), x=float32(12, 40, 40), y=float32(96, 40, 5), fused_ops='reshape divs add softmax rearrange reshape rearrange', anchor='softmax')

289abe506ef9afa1 : fused(y=float32(40, 768), x=float32(40, 768), x=float32(1, 40, 768), z=float32(40, 768), fused_ops='reshape add add', anchor='add')

I would like to get a DAG-like description so that I can construct the network using these generated kernels:
dde7be8d40f119f8 -> 4742a24e5f0cf34e
         |                  L---------------------------|
         v                                              v
003b329f9684cc83 -> 69b07ec79b8aaf99 -> 289abe506ef9afa1 -> 8315bfe1649dc27f

Hi @VincentXWD,
I see. You can dump the compiled model like https://github.com/hidet-org/hidet/blob/main/tests/unit_tests/test_compiled_model.py to a single file. After you run the demo code, you will get a model.hidet file, which is a zip file and you can open it directly with zip file brower.
It looks like

All the kernels are stored in /kernels directory. The graph_string.txt stores the textual representation of the model while you can check the graph_execution.json to know the relationship between the operators and compiled kernels (the task_idx in each instructions entry).
See https://github.com/hidet-org/hidet/blob/main/python/hidet/runtime/compiled_graph.py#L437 to know how we load and run the model stored in model.hidet.

When you load a model.hidet, we will also extract all the contents (except weights.npz) to hidet's cache directory.
If you are using pytorch frontend, you might not be able to get the compiled model dumped to the disk. (We can add an option to support this functionality though)

Thanks @yaoyaoding. I found the cache/graphs/ directory and learned about the file graph_execution.json. It described all information that I want.
It seems that hidet finishes the load process in python frontend. Actually I want to try something using another heterogeneous computing framework to optimize the inference process of networks. So the weights is quite important for me, too. It's great if you could provide a dump method to save these parameters to disks. But I think I can dump it by myself at present.
Hidet is such a great project with clear architecture and high performance, also many instructions for users to reachout the intermediate data. And it's really a good choice to be one of a compiler backend of pytorch.
Digress from the topic at hand, do you have any intentions to build your own runtime library for users not only as a backend for pytorch? :-D

If you want to dump the weights to disk, you can add the relative logic to this function https://github.com/hidet-org/hidet/blob/main/python/hidet/drivers/build_graph.py#L285


Initial setup

@destogl travis is already enabled, I believe github actions can be largely copied over from the ros2_control repo and I also added this to the boilerplate project so you can assign tickets to the project directly

@bmagyar  thanks once again :)


Add docker in Development

🐳 🐳 🐳 🐳 🐳 🐳 🐳
Goal
This PR allows us to use a Gitlab instance directly connected to the gem.
Benefits

No need to have access to a Gitlab external instance (or create an account on Gitlab.com)
Can seamlessly switch to gitlab-ce/gitlab-ee in development

Looks great. Thanks!


Refactoring/backend/eclass search

js -> ts
update to mysql2
added parameter to chose between eclass property search via mysql database and webservice (webservice not implemented yet)

Looks good, I just added to commits to format indentation and make use of the "real" graph service inside the shared services directory


Improve ergonomics for multiple verified origins.

I believe this is closed via #19. Can you confirm, @PEConn

Yeah, I think #19 provides a nice example of how to do this.


[Storage] Add PITR support

History Notes:
(Fill in the following template if multiple notes are needed, otherwise PR title will be used for history note.)

[Storage] az storage account blob-service-properties update: add --enable-restore-policy and --restore-days
[Storage] az storage blob restore: Ad support to restore blob ranges
This checklist is used to make sure that common guidelines for a pull request are followed.

[ ] The PR title and description has followed the guideline in Submitting Pull Requests.

[ ] I adhere to the Command Guidelines.

add to S166.


Using the MongoDB Adaptor

Hi,
Does anyone have any examples of how to implement this with Doctrine MongoDB. The Adaptor seems to need to take a Collection how would I create this and then pass it in? The documentation just shows a string which is obviously incorrect. I've tried passing in for example from the document manager:
$documentManager = $this->container->get('doctrine.odm.mongodb.document_manager');
$collection = $documentManager->getDocumentCollection('AppBundle\Document\Reservation');

table = $this->createDataTable()
            ->add('guest', TextColumn::class)
            ->add('reference', TextColumn::class)
            ->createAdapter(MongoDBAdapter::class, [
                'collection' => $collection,
            ])
            ->handleRequest($request);

But this returns a "LoggableCollection" which fails the options validation, allowing a LoggableCollection then throws a "Projection cannot have a mix of inclusion and exclusion."
I feel I am missing something obvious here / MongoAdaptor isn't finished yet.
If anyone can help that would be great, I love the way this bundle is written and would love to use it.

Hi @marcusorjames, this adapter is written to be used with MongoDB extension.
For doctrine ODM, I've written a PR #18 that introduce DoctrineODM Adapter.
If you want to try this adapter you can declare a class ODMAdapter and copy the content of my file into your a class and in createAdapterMethod you can pass your custom adapter.
Let me know!

Amazing, yup thought I was missing something obvious. I will give it a go :)

MongoAdaptor isn't finished yet.

While more or less true, we're actually using it internally in production, just not in a very fancy way   :)
The provided MongoDBAdapter is indeed as @giovannialbero1992 stated meant to 'adapt' the MongoDB extension itself.
Keep us posted if you run into any issues so we can improve it together!

Right, so I am using Symfony 3 PHP7 with the alcaeus/mongo-php-adapter, looking at it it looks like mongodb-odm uses an old version of mongo-ext which the above adaptor is a work around: https://stackoverflow.com/questions/36964171/php-7-with-doctrine-mongodb-odm
So I am getting the "Install doctrine/mongodb-odm-bundle to use the ODMAdapter" exception.
Not sure what magic injects the registry into the adaptor extension?
Any ideas?

@marcusorjames do you have installed doctrine/mongodb-odm-bundle ?
If yes you should have "autowire" set to true and declare into service.yaml
    Doctrine\Bundle\MongoDBBundle\ManagerRegistry:
        alias: 'doctrine_mongodb'

Closing as inactive.


state that casting away const and then mutating is undefined behaviour

Related discussion<EMAIL_ADDRESS>I think there's a consensus now that casting away const and then mutating is always undefined behaviour.
Drive-by style fixes: title case, "immutableness" -> "immutability"

:white_check_mark:

Note that casting away a const qualifier and then mutating is undefined behaviour, too, even when the referenced data is mutable.

This sounds too harsh to me, I'd like to have a word on this from @WalterBright.

This sounds too harsh to me, I'd like to have a word on this from @WalterBright.

@MartinNowak I totally agree that it would be a good idea to get Walter's approval on this, but I don't see how it's too harsh. It's been brought up time and time again that D's const is physical const and that any attempt to mutate it is undefined behavior. Allowing anything else makes it so that you cannot rely on a const object not being mutated via a const reference. Walter has made it abundantly clear in the past that D's const is actually supposed to provide the guarantee that an object cannot be mutated via a const reference and that the compiler is free to assume that fact. Allowing the casting away of const and then mutating to ever be defined behavior violates this and makes it so that we're back to C++'s const except that it's transitive, and you have to be careful about the possibility of the object actually being immutable. But it's still basically C++'s const and not physical const at all if casting away and mutating is defined behavior. No D program should ever be casting away const to mutate. If it's doing that, it should not be using const.

Ping @WalterBright? (Does he get notices about these @ mentions?)
Btw, I just came across this on http://dlang.org/cpp_interface.html:
// No:
// ptr to const int
const(int)* p;
int* q = cast(int*)p;
*q = 3;   // undefined behavior

LGTM after spell correction.

Please use American spelling, i.e. behavior

fixed

Ping @MartinNowak @jmdavis. Walter gave his ok. Anything else to do here?


Upstream moby/buildkit dependency

This is more of a query than a request or bug report (I know @vito is busy with v6.0 - leaving this here for consideration).
This resource image seems to currently depend on moby/buildkit:master however the docker hub image vito/oci-build-task hasn't been updated in 2 months.
So my question is twofold:

If this is supposed to track moby/buildkit:master should it not auto-trigger (or trigger on a regular basis) on new versions of moby/buildkit:master?
Would it be preferable to track a particular tag of moby/buildkit? as in moby/buildkit:v0.6.3 for example? (and bump that explicitly as needed)

PS: Not sure if the pipeline building this resource image has a particular pinned SHA of moby/buildkit:master

Would it be preferable to track a particular tag of moby/buildkit? as in moby/buildkit:v0.6.3 for example? (and bump that explicitly as needed)

This would be preferable. I had to point to master at one point because I needed some changes that hadn't shipped. I'm going to point it back to v0.6.4.


Error in console on page load

Every time I refresh my project page, I get this error in my console -

Can you show me the code that caused this error?

I'm using the icon font using this script -

Try using this instead and see if that still gives you an error:
<script src="https://unpkg.com/feather-icons/dist/feather.min.js"></script>

// instead of

<script src="https://unpkg.com/feather-icons"></script>

Wow! Your solution worked. There is no error in the console and it also hugely improved the load time. Can you explain me what was the problem here?

Great! The problem is that https://unpkg.com/feather-icons is a shortcut that points to feather.js which has a relative path to its source map. However, https://unpkg.com/feather.js.map doesn't exist. By using the long URL (https://unpkg.com/feather-icons/dist/feather.min.js) instead of the shortcut, the relative path to the source map is correct. Also, I gave you the link to the minified version which is probably why it's faster.
I'll update the docs so no one else runs into this issue 👍

Cool! Thanks 😄


Legend position differs between 2.8.0 and master

Expected Behavior
Legend position in right top like in 2.8.0.
Also like filled legend more than empty frames
Current Behavior
master draws legends to mid right, not op like 2.8.0-
Steps to Reproduce (for bugs)
See:
https://codepen.io/vesal/pen/KKPMEQr
Context
See:
https://codepen.io/vesal/pen/KKPMEQr
Environment

Chart.js version: master vs 2.8.0
Browser name and version: Chrome
Link to your project:

It looks like the legend is not filled because of "fill": false and https://github.com/chartjs/Chart.js/pull/5621. @nagix I'm wondering why fill has an effect if the legend is based off the points (bullets 4 and 7 in your PR description)?
The legend placement looks far better to me in master though

I would prefer an option for legend vertical position. If I have
rising lines that ends to north-east corner, the 2.8.0 position
is better.
And an other option for legend behavior.  For linecharts I would like line legend,
not unfilled box.

Here is an example where North-East corner looks better:

Compared to this:

The best would be if legend for A is blue dot and for r green line with green dot in middle.

Here is an example where the filled legends looks much better than empty ones.  If I do not put fill=false, then the "lines" are filled.  And in this case when there is a sinking rate, puting legends
to south-east would look better.

When this was written, master referred to v2.9.x dev. Updated reproduce here https://codepen.io/etimberg/pen/mdVbbdL

Per my comment above, the original issue appears resolved in v3. Additionally legend configuration can be done by overriding the generateLabels callback to change the point style per dataset, etc.


For FindRootDirectory, it doesn't work when you open vim without any files

If I modify the function to remove this hunk of code:
  if !s:ChangeDirectoryForBuffer()
    return ''
  endif

it works fine. I read through the function definition for ChangeDirectoryForBuffer but didn't quite get why it works without that function. This may just be a non-issue but I want to make sure this is intended behavior before I just use my fork of vim-rooter

I'm dumb. My vim-rooter wasn't up to date, and updating it fixed this issue fo rme.


Infinite earring is not locally Euclidean

I think that requires some more justification.  Why is that exactly that the space is not locally Euclidean?


Update keyfiguresfinland

Hi @AnnMarieW
I went through the code and tried to hit most of the checkmarks.  I basically minimized everything by removing default parameters and replaced style parameters with classnames. The wrangling part in the beginning might be difficult to understand but it works.
I also changed the json file since for some reason Åland was not visible on the map. Now it works.
I replaced orjson with json since orjson is not in the requirements.txt. Orjson might faster though.
I've been running through issues occasionally with mapboxchoropleth. Sometimes the maps do not render due to javascript errors. It might be issue with browser plugins or for some reason the plotly component cannot retrieve the map data from mapbox. Also I've noticed that having a mapbox token makes this error less-occurring. I wonder if we have a chance to add a token in the code. This app works on my virtual environment with the requirements.txt from the root.

Thanks for doing the update!
I think the data wrangling at the start is fine.  People would replace that if they use their own data source, so it still checks the "app is extendable"  box.
I'm not opposed to adding orjson, if it's simple.  From my understanding, just having orjson in the environment speeds things up.  Would you like to see if that's the case?
It could be really helpful to have an example app with a mapbox token. However, we should make sure we can stay in the free tier in production.
Before we continue with the review, it's important that the app runs error free.  Just to be clear, are you still seeing errors occasionally even with a token?

@AnnMarieW
Yeah this app works just fine on production. I deployed it to Heroku and it works just fine.
I've been expanding this project a bit and I have a version where you can select map style and use hover data to visualize time series of a key figure. I have a version on Heroku  with a general token and a version on Render without any token. With the Render version I tried adding the token and it worked. I'm just saying adding the token gives a bit certainty on rendering since it is not a Dash/Python issue. I guess the token should not be defined in the app code. But anyways, this app works well even without the token on a virtual environment and on Heroku.
I'm also fine either ways adding or not adding orjson. In this case it does not make a big difference since the json file is loaded once in the beginning and is not huge. It might speed up but I doubt you could see the difference here.

Ok - sounds good!  Your site looks AWESOME :star_struck:   We will definitely put a link to it from the Example Index.  It will be great to show how a minimal example can grow into a full featured site.    And your site is a fantastic way to try out other themes, map types, figure templates, etc.
In the meantime, I'd like to tweak the styling of the version that will go in Example Index.  Here's a version to make it work on various screen sizes.  I'll make some inline comments in the code, and you can give it a try.

@AnnMarieW Thank you for the comments. I did not know I was using unnecessary classNames  that much :-)
I made styling corrections and removed the header + callback. I also changed the zoom and center of the map.


feat: add new format and implement VCDICredFormatHandler (Draft)

add VC_DI in CredFormat.Format
lay out VCDICredFormatHandler
add new schema classes for cred offer and request
implement CredExRecordVCDI

next step

Create additional functions create_credential_offer_vc_di and create_credential in AnoncredsIssuer

@tra371 overall looks good.  If you need a hand with the test let me know, I can show you how to run everything locally to help track down some of the errors that are getting reported.  (I know the code is in progress but it's a good idea to keep on top of these.)
Also you can flag the PR as "in draft" if it's not yet ready to merge,

@tra371 overall looks good. If you need a hand with the test let me know, I can show you how to run everything locally to help track down some of the errors that are getting reported. (I know the code is in progress but it's a good idea to keep on top of these.)
Also you can flag the PR as "in draft" if it's not yet ready to merge,

thank you @ianco yes that would be great if you could give me a pointer on that.. let us discuss more on discord

Looks like the faber demo was updated, can you update the faber doc (or even just add a comment to this PR) listing the parameters you use to run faber?

Looks like the faber demo was updated, can you update the faber doc (or even just add a comment to this PR) listing the parameters you use to run faber?
(I tried this ./run_demo faber --wallet-type askar-anoncreds --cred-type vc_di but it gives me an error Exception: Invalid credential type:vc_di)

ok i'm on it

When I run the demo (after making the changes locally that I mentioned in comments) I get the following error when trying to issue a credential from faber to alice:
$ AGENT_PORT_OVERRIDE=8010 ./run_demo faber --wallet-type askar-anoncreds --cred-type vc_di
... (paste the invite from faber to alice, then select option "1" to issue the credential) ...
[1/2/3/4/T/X] 1

#13 Issue credential offer to X
Faber      | 2024-02-20 18:44:17,298 aries_cloudagent.admin.server ERROR Handler error with exception: Unprocessable Entity
Faber      |Shutting down agent ...
 Faber      | Traceback (most recent call last):

Faber      |   File "/home/aries/.local/lib/python3.9/site-packages/webargs/asyncparser.py", line 90, in parse
Faber      |Faber      |     result = schema.load(parsed)
 Faber      |   File "/home/aries/.local/lib/python3.9/site-packages/marshmallow/schema.py", line 723, in load
=================
Faber      |     return self._do_load(
Faber      |   File "/home/aries/.local/lib/python3.9/site-packages/marshmallow/schema.py", line 910, in _do_load
Faber      |     raise exc
Faber      | marshmallow.exceptions.ValidationError: {'filter': {'_schema': ['V20CredFilterSchema requires indy, ld_proof, or both']}}
Faber      |
Faber      | During handling of the above exception, another exception occurred:
Faber      |
Faber      | Traceback (most recent call last):
Faber      |   File "/home/aries/aries_cloudagent/admin/server.py", line 181, in ready_middleware
Faber      |     return await handler(request)
Faber      |   File "/home/aries/aries_cloudagent/admin/server.py", line 218, in debug_middleware
Faber      |     return await handler(request)
Faber      |   File "/home/aries/aries_cloudagent/admin/server.py", line 451, in setup_context
Faber      |     return await task
Faber      |   File "/usr/local/lib/python3.9/asyncio/futures.py", line 284, in __await__
Faber      |     yield self  # This tells Task to wait for completion.
Faber      |   File "/usr/local/lib/python3.9/asyncio/tasks.py", line 328, in __wakeup
Faber      |     future.result()
Faber      |   File "/usr/local/lib/python3.9/asyncio/futures.py", line 201, in result
Faber      |     raise self._exception
Faber      |   File "/usr/local/lib/python3.9/asyncio/tasks.py", line 256, in __step
Faber      |     result = coro.send(None)
Faber      |   File "/home/aries/.local/lib/python3.9/site-packages/aiohttp_apispec/middlewares.py", line 33, in validation_middleware
Faber      |     data = await request.app["_apispec_parser"].parse(
Faber      |   File "/home/aries/.local/lib/python3.9/site-packages/webargs/asyncparser.py", line 94, in parse
Faber      |     await self._on_validation_error(
Faber      |   File "/home/aries/.local/lib/python3.9/site-packages/webargs/asyncparser.py", line 108, in _on_validation_error
Faber      |     await error_handler(error, req, schema, error_status_code, error_headers)
Faber      |   File "/home/aries/.local/lib/python3.9/site-packages/webargs/aiohttpparser.py", line 163, in handle_error
Faber      |     raise error_class(
Faber      | aiohttp.web_exceptions.HTTPUnprocessableEntity: Unprocessable Entity
Faber      |
Faber      | Shutting down
Faber      | Exited with return code 0

I'll open a PR to your repo with the changes I made locally

I'll open a PR to your repo with the changes I made locally

OK I can't open a PR to your repository for some reason, however you can see the changes I made locally (to get the DID and schema registration to work) here:
https://github.com/ianco/aries-cloudagent-python/commit/dfebc768a0af1066661453692d0c7afe2dddf8dc

I'll open a PR to your repo with the changes I made locally

OK I can't open a PR to your repository for some reason, however you can see the changes I made locally (to get the DID and schema registration to work) here:
ianco@dfebc76

thank you so much, @ianco.. i've applied these updates

I'll open a PR to your repo with the changes I made locally

OK I can't open a PR to your repository for some reason, however you can see the changes I made locally (to get the DID and schema registration to work) here:
ianco@dfebc76

@sarthakvijayvergiya ^^ make sure we cleanly included this

hey guys, partly my fault for an old unsigned commit, but also the commit history here has gotten muddy.  I cherry-picked all our commits in our branch and replayed on main and squashed, made a new PR over here: https://github.com/hyperledger/aries-cloudagent-python/pull/2830
I think it will be better to merge that one, otherwise rebases are going to be evil

New version of PR is here:  https://github.com/hyperledger/aries-cloudagent-python/pull/2830


Search

The ability to search for a specific game or person would be really handy.

Yep. Looks like I forgot to add this myself.

You can use this spreadsheet for that purpose: https://docs.google.com/spreadsheets/d/1C0138WmZDEO70DpgxUG2M-33A4CfIhOgwwsZnomTdjM/edit#gid=0
Note: It hasn't been updated in a few days, but it should have all the games.

Looks like FullText isn't going to be enough. Apparently there are some domain-specific search servers that are 10-100x faster.
SOLR - http://lucene.apache.org/solr/
Sphinx - http://sphinxsearch.com/

Sphinx is now in the VM.
http://sphinxsearch.com/docs/current.html#quick-tour

Delta Indexes with Sphinx
https://www.youtube.com/watch?v=rNprPmcKops

We could make a sitemap for all games and use Google's embed search, that's an option. Either way, a sitemap would be a great addition for the search engine crawlers.


[WebChat] Customization with Extending TypeScripts?

We are using WebChat to build a custom UI for the bot. There are some requirements to display thumbnail/hero cards with additional text fields and image fields. Currently, we tried updating the tsx files from the repository, built it and created the botchat.js. Kindly clarify the below queries.

Is this the recommended method of extending the TypeScripts? If yes, how do we make the src code up to date with the updates in repository?
Tried extending a file (say ActivityView.tsx and created ActivityViewExt.tsx) for implementing our custom changes, but the new file is not being taken up in the build.

Regards
Sreehari

@danmarshall thoughts?

@sreeharikm If you need to design custom card layouts, use the Adaptive Cards JSON spec.
You can find examples and a layout visualizer here:
http://adaptivecards.io/visualizer/

Thanks for the update, will check on Adaptive Cards.

@danmarshall Tried the Adaptive Cards, the HttpAction is not working. The sample code give in the documentation itself has the issue.
Any suggestions on the extending type scripts for custom functionalities? The worry is how do we incorporate further changes to the source code.

Hi @sreeharikm if you are only needing to add text and image fields then using AdaptiveCards will be an easier situation for you if you are concerned with code maintenance.

The worry is how do we merge further updates if we directly modify the source code

This is a primary function of GitHub. Recommend you read GitHub's Working with forks pages, with attention to Syncing a fork.
I'm going to close this issue here in BotBuilder, since this is related to Web Chat only. Feel free to open a new issue in the Web Chat repo.


New DALC API

This PR introduces new DALC API into optimint.
Most important changes:

BlockManager needs to keep track of DA layer height
single DA layer block can contain multiple Optimint blocks
sync is now more complicated - but I tried to keep it as simple as possible

Actually, there's no need to explicitly map DA layer height to Optimint height.
Resolves #281.

Codecov Report

Merging #341 (3c9a27b) into main (1375e5b) will increase coverage by 0.43%.
The diff coverage is 76.95%.

:exclamation: Current head 3c9a27b differs from pull request most recent head 3e28da3. Consider uploading reports for the commit 3e28da3 to get more accurate results

@@            Coverage Diff             @@
##             main     #341      +/-   ##
==========================================
+ Coverage   58.65%   59.08%   +0.43%
==========================================
  Files          44       44
  Lines        7092     7162      +70
==========================================
+ Hits         4160     4232      +72
  Misses       2361     2361
+ Partials      571      569       -2

Impacted Files
Coverage Δ

config/config.go
84.21% <ø> (ø)

types/pb/optimint/optimint.pb.go
43.99% <ø> (ø)

types/pb/dalc/dalc.pb.go
45.18% <62.26%> (+0.36%)
:arrow_up:

da/grpc/mockserv/mockserv.go
82.35% <83.33%> (+1.50%)
:arrow_up:

da/grpc/grpc.go
73.13% <84.00%> (+5.27%)
:arrow_up:

da/mock/mock.go
79.54% <84.21%> (+13.97%)
:arrow_up:

block/manager.go
63.13% <93.18%> (+3.61%)
:arrow_up:

state/state.go
92.10% <100.00%> (+0.43%)
:arrow_up:

store/store.go
68.05% <100.00%> (-1.49%)
:arrow_down:

... and 3 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1375e5b...3e28da3. Read the comment docs.

I'm confused how the tests are passing since the ephemeral cluster setup using an older DALC image which shouldn't have a compatible API...

IIRC in ephemeral cluster we only have single optimint node, which is an aggregator. It shouldn't sync, so it's not using changed API. Only change in part related to block submission was adding single field in DAResult - this will just have zero-value, and this shouldn't be crucial for Optimint operation.

Pinging all approvors (@liamsi @jbowen93 @adlerjohn @evan-forbes) ;) PR is updated. All comments addressed.


Fix: Failed to query server list

This fixes 'Failed to query server list.'
On a fresh install of the snap, make sure the Mono cert store is populated with the latest certificates. Else OpenRA will not be able to connect to the OpenRA Master Server (to query for online servers).

Hi, thanks for the PR. I've gone a different route with a single trust store for the whole system rather than per-user trust stores. This should build shortly and be available in the edge channel where I'll do a cursory check and verify that you can browse the multiplayer lists before pushing to stable.

This is now in the stable channel so you should see it come through automatically soon.


ADC values freeze after tft_init

Hello!
I've been trying to port this library to my self-designed PCB with the same MCU (F746). Everything else seems to work so far, but not commenting out tft_init results in adc_buffer values freezing and hadc1 goes into errorcode - 6 and hdma_adc1  errorcode - 2.  As soon as i comment tft_init out, the adc values update every breakpoint(so constantly working), and obviously library wont start.
Could you look into this? If one of you could try to use ADC1 with DMA on your discovery board, while enabling the library, does your ADC still continue to work?
I'm happy to provide everything to understand this problem better,

@tomtristan Not sure if you've solved this problem yet, but if you haven't, I'd be happy to test this for you if there's no hardware required besides the discovery board.

@embeddedt I think discovery board is enough to test this. You could try running attached CubeMX configuration on the discovery board, and see if your ADC freezes with this configuration(set the ADC DMA priority to low or medium, mine's set to very high(LvGL uses HIGH priority) because this bypassed/fixed this issue).
FEST19_Dashensoorika_LVGL_try2.zip

@tomtristan Sorry, I haven't had a chance to try your file in detail yet. Limited time...
I looked at it before but it didn't appear to include all components, so I wasn't sure how to proceed. If I get a chance, I will give it another try.


Create brgsmail

Official URL: https://www.brgs.org.uk/
IT Course: https://www.brgs.org.uk/sixth-form/our-courses/computer-science
Google screenshot with school logo: https://i.imgur.com/C1aQTLF.png

@alessiawilliams Please rename lib/domains/uk/org/brgsmail to lib/domains/uk/org/brgsmail.txt

@philipto Sorry - should now be fixed.

@alessiawilliams Pull request merged. Thank you!


CORGI-516 - optimise manifest generation

Follow up to PR #338
This applies the same principle applied there (for setting provides many to many component relationships) to ComponentNode relationship required by manifest generation.

I think we can update the provided_relationships_manifest template to use node.object_id instead of node.object.uuid to avoid another DB lookup on obj.


Issue running cloud masking on Sentinel Collection

Hi!
Whenever I try to run the ESA cloud masking on a sentinel collection I get the error: "object of type 'Image' has no len()"
my code  is as follows:
`imagecol = ee.ImageCollection("COPERNICUS/S2_SR").filterDate('2019-02-21', '2019-03-23').filterBounds(riv);
def s2cloud(imagecol):
return imagecol.updateMask(cloud_mask.sentinel2(imagecol))
imagecol2 = imagecol.map(s2cloud);
`
I really appreciate any help- thanks for this awesome toolbox!

Hello @WHBSpeiser ,
Try this:

imagecol = ee.ImageCollection("COPERNICUS/S2_SR").filterDate('2019-02-21', '2019-03-23').filterBounds(riv)

imagecol_masked = imagecol.map(cloud_mask.sentinel2())

and let me know =)

It looks like it works when I make the date range so that there is only one image in the collection! However, when I make the range any larger I get an "internal error" when trying to batch export the collection... weird!

Similar issue here, I tried that solution without success as @WHBSpeiser.
I also tried to map applyHollstein as shown below. An EEException is raised.
s2_aoi = (ee.ImageCollection('COPERNICUS/S2_SR')\
    .filterDate(start_date_str, end_date_str)\
    .filterBounds(aoi)\
    .filter(ee.Filter.lt('CLOUDY_PIXEL_PERCENTAGE', 20))
    )
s2_date_mosaic = tools.imagecollection.mosaicSameDay(s2_aoi)

# So far so good ! ! !
s2_masked = s2_date_mosaic.map(cloud_mask.applyHollstein)
s2_masked.getInfo()

# Whatever I do on the masked ImageCollection returns
EEException: Error in map(ID=9):
Image.select: Pattern 'B10' did not match any bands

Any clue how to get this done?
Btw...thank you for these tools @fitoprincipe!

This error is quite old now and we are relying on ee_extra for cloud masking from now on. If the problem persists let me know and open a new issue.


Datas accountability

Hi! Love the model. Can you tell me about your data sets? How were the voices collected? Thank you!

I may even add : do you have a guide for dummies to create custom voices ?

closing as duplicate of https://github.com/suno-ai/bark/issues/2


Anno 2205 crashes if State Cache is enabled

Anno 2205 (64bit DX11-only game) crashes if State Cache is enabled.
It seems that if cache file does not exists, game will crash immediately after launch but will create cache file, on second launch game will load to menu and crash in it or after map loading.
If State Cache is disabled with DXVK_STATE_CACHE=0 env variable, game works fine without crashes.
Software information
Anno 2205 Complete Edition from Ubisoft store.
System information

GPU: GTX 1060
Driver: 410.57
Wine version: vanilla 3.17
DXVK version: v0.81-1-g87f1cd2

Log files

d3d11.log:

info:  D3D11CoreCreateDevice: Probing D3D_FEATURE_LEVEL_11_0
info:  D3D11CoreCreateDevice: Using feature level D3D_FEATURE_LEVEL_11_0

dxgi.log: https://pastebin.com/aryuanGs

Can you post the full wine console output, and if possible, a stack trace?

https://pastebin.com/kp4RM0gH

There is a chance that the game itself has a use-after-free that usually works because nothing else touches the memory before the wait finishes. When the state cache is enabled, DXVK is doing allocations in parallel and that can reinitialize the freed memory, clobbering the sync object. If this is the case, it is a bug in the game. The only thing DXVK could do to work around such a bug is to implement a separate heap for itself, but that could be a significant amount of work.
I imagine that implementing it and testing the change would confirm/refute the idea that use-after-free is happening in the game code. It might be better to figure out how to apply UBSAN or ASAN to a winelib build.

@Shished How did you get the game workin in the first place? Every time I try to run it I get a
Fatal Python error: Py_Initialize: can't initialize sys standard streams
LookLookupError: unknown encoding: cp437

I tried setting the ENV but that didnt help.
set PYTHONIOENCODING=cp437

You need to set that env variable to utf8.

@Shatrico This is the same error I posted earlier. Just add the environment variable PYTHONIOENCODING and set it to utf8. I got it working pretty decently and my OS is german as well, so problem there. Add the variable under System options in Lutris when you right-click on Uplay and choose Configure.
Here's a proof, that it works fine:

ah thx now it works. on which settings do you run it because i had all on high but my pc freezes after some time and it only happens with anno

@Shatrico: We went a bit off-topic here. Let's talk somewhere else to not spam the ticket too much. The actual problem OP had was a crash when DXVK_STATE_CACHE was active not running the game after all.

@Shished Is the original bug actually still an issue? If so I'm just going to blacklist the game because there are no obvious bugs in the state cache implementation.

The state cache should now be disabled for this game. Not sure what's going on, but since this is the only game that has issues with it, I doubt there is a general bug in the implementation.

Shouldn't the bug still be open until the issue is fixed?
I think a tag like workaround applied would be better.

This issue cannot be fixed, and it's quite likely not even a DXVK bug.

I don't said its not a good fix. I just thought it would be better to let it open in terms of showing known issues.
sorry for ot: but from which anime is your github avatar?

@Thaodan is 2B from the game Nier:Automata

It's actually A2.

I think there is a regression with Anno 2205:
2018-12-16 10:57:37 [ 468] [DEBUG] PlatformHooks.cpp (113) : 'shell32.dll' hooked 01d4:fixme:ntdll:NtQueryInformationToken QueryInformationToken( ..., TokenSessionId, ...) semi-stub 01d6:fixme:kernelbase:AppPolicyGetProcessTerminationMethod 0xfffffffffffffffa, 0x23fd00 01cc:fixme:ntdll:NtQueryInformationJobObject stub: 0x90 9 0x74f884 112 (nil) 01d4:fixme:thread:create_user_shared_data_thread Creating user shared data update thread. 01d4:fixme:ntdll:NtQueryInformationToken QueryInformationToken( ..., TokenSessionId, ...) semi-stub 01d4:fixme:msvcp:_Locinfo__Locinfo_ctor_cat_cstr (0x23fb40 63 ) semi-stub 01d4:fixme:msvcp:locale__Locimp__Makexloc (0x23fb40 63 0x4ad6720 (nil)) semi-stub 01d4:fixme:msvcp:locale__Locimp__Makewloc (0x23fb40 63 0x4ad6720 (nil)) semi-stub 01d4:fixme:msvcp:locale__Locimp__Makeushloc (0x23fb40 63 0x4ad6720 (nil)) semi-stub 01d4:fixme:msvcp:_Locinfo__Locinfo_ctor_cat_cstr (0x23fb00 63 German_Germany.1252) semi-stub 01d4:fixme:msvcp:locale__Locimp__Makexloc (0x23fb00 63 0x4ad68a0 (nil)) semi-stub 01d4:fixme:msvcp:locale__Locimp__Makewloc (0x23fb00 63 0x4ad68a0 (nil)) semi-stub 01d4:fixme:msvcp:locale__Locimp__Makeushloc (0x23fb00 63 0x4ad68a0 (nil)) semi-stub 01d4:fixme:msvcp:_Locinfo__Locinfo_ctor_cat_cstr (0x23f9d0 63 ) semi-stub 01d4:fixme:msvcp:locale__Locimp__Makexloc (0x23f9d0 63 0x4adb8c0 (nil)) semi-stub 01d4:fixme:msvcp:locale__Locimp__Makewloc (0x23f9d0 63 0x4adb8c0 (nil)) semi-stub 01d4:fixme:msvcp:locale__Locimp__Makeushloc (0x23f9d0 63 0x4adb8c0 (nil)) semi-stub 01d4:fixme:msvcp:_Locinfo__Locinfo_ctor_cat_cstr (0x23f990 63 German_Germany.1252) semi-stub 01d4:fixme:msvcp:locale__Locimp__Makexloc (0x23f990 63 0x4ad7d90 (nil)) semi-stub 01d4:fixme:msvcp:locale__Locimp__Makewloc (0x23f990 63 0x4ad7d90 (nil)) semi-stub 01d4:fixme:msvcp:locale__Locimp__Makeushloc (0x23f990 63 0x4ad7d90 (nil)) semi-stub 01d4:fixme:msvcp:_Locinfo__Locinfo_ctor_cat_cstr (0x23f040 1 C) semi-stub 2018-12-16 10:57:40 [ 483] [DEBUG] Hooks.cpp (36) : --- Overlay started --- (C:\windows\system32\dxdiag.exe) 2018-12-16 10:57:40 [ 483] [INFO ] Hooks.cpp (47) : UI disabled via command line 2018-12-16 10:57:41 [ 483] [DEBUG] PlatformHooks.cpp (113) : 'kernel32.dll' hooked 2018-12-16 10:57:41 [ 483] [DEBUG] PlatformHooks.cpp (113) : 'kernel32.dll' hooked 2018-12-16 10:57:41 [ 483] [DEBUG] PlatformHooks.cpp (113) : 'shell32.dll' hooked 01e3:fixme:ntdll:NtQueryInformationToken QueryInformationToken( ..., TokenSessionId, ...) semi-stub 01d4:fixme:ntdll:NtQueryInformationToken QueryInformationToken( ..., TokenSessionId, ...) semi-stub 01e3:fixme:wbemprox:wbem_services_CreateInstanceEnum unsupported flags 0x00000030 01d4:fixme:ntdll:NtQueryInformationToken QueryInformationToken( ..., TokenSessionId, ...) semi-stub 01e3:fixme:wbemprox:enum_class_object_Next timeout not supported 01d4:fixme:msvcp:_Locinfo__Locinfo_ctor_cat_cstr (0x23ef00 1 C) semi-stub 01e3:fixme:ddraw:ddraw7_Initialize Ignoring guid {aeb2cdd4-6e41-43ea-941c-8361cc760781}. 01e3:err:winediag:MIDIMAP_drvOpen No software synthesizer midi port found, Midi sound output probably won't work. 01e3:err:dxdiag:output_text_information File creation failed, last error 3 01d4:fixme:win:RegisterTouchWindow (0x505b6 00000003): stub 01d4:fixme:imm:ImmReleaseContext (0x505b6, 0x66d14f0): stub 01d4:fixme:msctf:ThreadMgr_ActivateEx Unimplemented flags 0x4 01d4:fixme:msctf:ThreadMgrSource_AdviseSink (0x66d1390) Unhandled Sink: {ea1ea136-19df-11d7-a6d2-00065b84435c} 01d4:fixme:imm:NotifyIME NI_CLOSECANDIDATE 01d4:fixme:msctf:ThreadMgrSource_AdviseSink (0x66d1390) Unhandled Sink: {ea1ea136-19df-11d7-a6d2-00065b84435c} 01d4:fixme:msvcp:_Mtx_init_in_situ unknown flags ignored: 2 info:  Game: Anno2205.exe info:  DXVK: v0.94 warn:  OpenVR: Failed to locate module info:  Enabled instance extensions: info:    VK_KHR_get_physical_device_properties2 info:    VK_KHR_surface info:    VK_KHR_win32_surface info:  AMD RADV POLARIS10 (LLVM 7.0.0): info:    Driver: 18.3.1 info:    Vulkan: 1.1.70 info:    Memory Heap[0]:  info:      Size: 7936 MiB info:      Flags: 0x1 info:      Memory Type[0]: Property Flags = 0x1 info:    Memory Heap[1]:  info:      Size: 256 MiB info:      Flags: 0x1 info:      Memory Type[2]: Property Flags = 0x7 info:    Memory Heap[2]:  info:      Size: 8192 MiB info:      Flags: 0x0 info:      Memory Type[1]: Property Flags = 0x6 info:      Memory Type[3]: Property Flags = 0xe info:  D3D11CoreCreateDevice: Probing D3D_FEATURE_LEVEL_11_0 info:  D3D11CoreCreateDevice: Using feature level D3D_FEATURE_LEVEL_11_0 info:  Enabled device extensions: info:    VK_EXT_shader_viewport_index_layer info:    VK_EXT_transform_feedback info:    VK_EXT_vertex_attribute_divisor info:    VK_KHR_dedicated_allocation info:    VK_KHR_descriptor_update_template info:    VK_KHR_driver_properties info:    VK_KHR_get_memory_requirements2 info:    VK_KHR_image_format_list info:    VK_KHR_maintenance1 info:    VK_KHR_maintenance2 info:    VK_KHR_sampler_mirror_clamp_to_edge info:    VK_KHR_shader_draw_parameters info:    VK_KHR_swapchain 01d4:fixme:vulkan:wine_vk_device_convert_create_info Application requested a linked structure of type 0x3b9db032. 01d4:fixme:vulkan:wine_vk_device_convert_create_info Application requested a linked structure of type 0x3b9b3760. info:  DXVK: Read 494 valid state cache entries info:  DXVK: Using 4 compiler threads warn:  DXGI: VK_FORMAT_D24_UNORM_S8_UINT -> VK_FORMAT_D32_SFLOAT_S8_UINT info:  Presenter: Actual swap chain properties:   Format:       VK_FORMAT_B8G8R8A8_UNORM   Present mode: VK_PRESENT_MODE_IMMEDIATE_KHR   Buffer size:  1912x1053   Image count:  2 warn:  DXGI: MakeWindowAssociation: Ignoring flags 0075:fixme:win:GetDisplayConfigBufferSizes (0x2 0xc97f54c 0xc97f548): stub 01d4:fixme:msvcp:_Locinfo__Locinfo_ctor_cat_cstr (0x23ea60 1 C) semi-stub 01d4:fixme:msvcp:_Locinfo__Locinfo_ctor_cat_cstr (0x23ebd0 1 C) semi-stub 01d4:fixme:msvcp:_Locinfo__Locinfo_ctor_cat_cstr (0x23e4b0 1 C) semi-stub 01d4:fixme:msvcrt:type_info_name_internal_method type_info_node parameter ignored 01d4:fixme:msvcp:_Locinfo__Locinfo_ctor_cat_cstr (0x23db10 1 C) semi-stub 01d4:fixme:msvcp:_Locinfo__Locinfo_ctor_cat_cstr (0x23ee10 63 German) semi-stub 01d4:fixme:msvcp:locale__Locimp__Makexloc (0x23ee10 63 0x7f4cb30ca7b0 (nil)) semi-stub 01d4:fixme:msvcp:locale__Locimp__Makewloc (0x23ee10 63 0x7f4cb30ca7b0 (nil)) semi-stub 01d4:fixme:msvcp:locale__Locimp__Makeushloc (0x23ee10 63 0x7f4cb30ca7b0 (nil)) semi-stub 01d4:fixme:heap:RtlSetHeapInformation (nil) 1 (nil) 0 stub 01d4:fixme:ntdll:EtwEventRegister ({d2d578d9-2936-45b6-a09f-30e32715f42d}, 0x7a8300, 0x40663a0, 0x414f7f0) stub. [1216/105747:ERROR:main_delegate.cc(722)] Could not load locale pak for en-US [1216/105747:ERROR:main_delegate.cc(746)] Could not load cef_100_percent.pak 003a:fixme:nls:GetThreadPreferredUILanguages 00000038, 0x67b5f960, (nil) 0x67b5f968 003a:fixme:nls:get_dummy_preferred_ui_language (0x38 0x67b5f960 (nil) 0x67b5f968) returning a dummy value (current locale) 003a:fixme:nls:GetThreadPreferredUILanguages 00000038, 0x67b5f960, 0x7f4c800f4ce0 0x67b5f968 003a:fixme:nls:get_dummy_preferred_ui_language (0x38 0x67b5f960 0x7f4c800f4ce0 0x67b5f968) returning a dummy value (current locale) 003a:fixme:winsock:WSALookupServiceBeginW (0x67b5f580 0x00000ff0 0x67b5f578) Stub! [1216/105747:ERROR:network_change_notifier_win.cc(153)] WSALookupServiceBegin failed with: 8 003a:fixme:iphlpapi:NotifyAddrChange (Handle 0x67b5f850, overlapped 0x7f4c800f65a0): stub 003a:fixme:win:RegisterDeviceNotificationW (hwnd=0x2059c, filter=0x67b5f800,flags=0x00000000) returns a fake device notification handle! 003a:fixme:win:RegisterDeviceNotificationW (hwnd=0x2059c, filter=0x67b5f800,flags=0x00000000) returns a fake device notification handle! 003f:fixme:ver:GetCurrentPackageId (0x7fffff65f530 (nil)): stub [1216/105747:ERROR:proxy_service_factory.cc(132)] Cannot use V8 Proxy resolver in single process mode. 01d4:fixme:ole:CoInitializeSecurity ((nil),-1,(nil),(nil),0,3,(nil),0,(nil)) - stub! 01d4:fixme:wbemprox:client_security_SetBlanket 0x7f4ca80ee240, 0x7f4c801d33f0, 10, 0, (null), 3, 3, (nil), 0x00000000 01d4:fixme:wbemprox:client_security_Release 0x7f4ca80ee240 info:  Presenter: Actual swap chain properties:   Format:       VK_FORMAT_B8G8R8A8_UNORM   Present mode: VK_PRESENT_MODE_IMMEDIATE_KHR   Buffer size:  1920x1080   Image count:  2 warn:  DXGI: MakeWindowAssociation: Ignoring flags info:  DXGI: Setting display mode: 1920x1080@144 0075:fixme:win:GetDisplayConfigBufferSizes (0x2 0xc97f54c 0xc97f548): stub info:  Presenter: Actual swap chain properties:   Format:       VK_FORMAT_B8G8R8A8_UNORM   Present mode: VK_PRESENT_MODE_IMMEDIATE_KHR   Buffer size:  1920x1080   Image count:  2 01d4:trace:fps:X11DRV_vkQueuePresentKHR 0x7dcb8ac0 @ approx 0.00fps, total 0.00fps 004f:fixme:winhttp:get_system_proxy_autoconfig_url no support on this platform 004f:fixme:winhttp:WinHttpDetectAutoProxyConfigUrl discovery via DHCP not supported 01d4:trace:fps:X11DRV_vkQueuePresentKHR 0x7dcb8ac0 @ approx 375.66fps, total 376.32fps 0202:fixme:toolhelp:CreateToolhelp32Snapshot Unimplemented: heap list snapshot 0202:fixme:toolhelp:Heap32ListFirst : stub 01d4:trace:fps:X11DRV_vkQueuePresentKHR 0x7dcb8ac0 @ approx 503.66fps, total 439.59fps 01d4:trace:fps:X11DRV_vkQueuePresentKHR 0x7dcb8ac0 @ approx 823.45fps, total 567.01fps 01d4:trace:fps:X11DRV_vkQueuePresentKHR 0x7dcb8ac0 @ approx 904.73fps, total 651.17fps 01d4:trace:fps:X11DRV_vkQueuePresentKHR 0x7dcb8ac0 @ approx 854.10fps, total 691.65fps 01d4:trace:fps:X11DRV_vkQueuePresentKHR 0x7dcb8ac0 @ approx 699.73fps, total 693.00fps 01d4:trace:fps:X11DRV_vkQueuePresentKHR 0x7dcb8ac0 @ approx 912.06fps, total 724.23fps AL lib: (EE) ReleaseThreadCtx: Context 0x7dc2e7d0 current for thread being destroyed, possible leak! AL lib: (EE) ReleaseThreadCtx: Context 0x7f4c44001f50 current for thread being destroyed, possible leak! AL lib: (EE) ReleaseThreadCtx: Context 0x7dc2e7d0 current for thread being destroyed, possible leak!
After starting the game is on the screen where it says he is loading and then the game crashed and also closed uplay

Please bisect, and when you did, open a new issue.

sry, but my English is not the best, what you mean with "bisect"?

First of all, please check if it works with 0.93.

Its starting but then its crashing during playing the game

Then the regression is probably elsewhere, not in DXVK.

Then please bisect DXVK following this tutorial.

This bug does not reproduces for me anymore.
I launched game with wine 4.0-rc1 and DXVK 0.94 with State Cache force enabled, and it didn't crashed. A 500kb cache file was created and DXVK actually loaded it.
info:  DXVK: Read 267 valid state cache entries
info:  DXVK: Using 9 compiler threads

Then i tried 0.93 and 0.92 and they also worked.
I think it was a wine or Linux problem, not from DXVK.

Tomorrow or so I will take a look into bisect, it looks very complicated, but i can exclude a wine problem because i switched the versions and it still happens

@Shished weird. Can you test 0.93 just to rule it out?
Also, does this game require any sort of winetricks magic? If it works for you then I don't see why the issue @Shatrico has would be a DXVK bug.

because with 0.94 I already crashes when I start the game. And if it would be a Linux problem then no DX11 would run and that's not the case.

I tried to play this game with DXVK 0.92 and 0.93, now it does not crashes but crashed last time when i tested it before.
I installed vcrun2012 from winetricks so game wont complain about msvcp in terminal, also i disabled overlay64.dll in winecfg - that's uplay overlay.

I tried to play this game with DXVK 0.92 and 0.93, now it does not crashes but crashed last time when i tested it before.
I installed vcrun2012 from winetricks so game wont complain about msvcp in terminal, also i disabled overlay64.dll in winecfg - that's uplay overlay.

Tried it and did not help


error with possible filters after check last date

Describe the bug
after checking [x] use last date an error appears
To Reproduce
Steps to reproduce the behavior:

Go to https://test.visualize.admin.ch/create/new?copy=rvMNgJBlH4he
Click on use last date
See error

Expected behavior
no error message
Screenshots or video

Environment (please complete the following information):

Visualize environment and version: v3.27.1 aae7eec

Hi @t0b3, thanks for reporting! Should be fixed on TEST :)

Tested on INT LGTM. Tested with: https://int.visualize.admin.ch/v/diAWUz0rO_uM?dataSource=Prod


we should add this notebook to the repo

https://www.google.com/url?q=https://github.com/mnky9800n/python_for_hazard_scientists/blob/master/testing%2520python.ipynb&sa=D&ust=1507280304708000&usg=AFQjCNGeUCdGx2GLOBrLlmWO4b8apwSzAQ

I added a basemap and cartopy version of this since basemap and cartopy do not play well together in the same environment.


implement getDevices() for android and ios

Is your feature request related to a problem? Please describe.
It doesn't seem possible to get multiple devices to interact with them.
requestDevice() will never return a single result for my usecases.
EDIT: after rereading the spec, it might make more sense to leave getDevices as is, and rather add a new method called requestDevices() which takes the same filter args as requestDevice or alternatively, add a new set of functions that more closely aligns with other existing bluetooth modules/plugins like a scan function that return an observable or operate on a callback.

Thank you for using this plugin and for submitting this feature request.
It is already possible to call requestDevice() more than once and store the results, then you can interact with several devices at the same time.
But I assume you would prefer a single scan function (or similar) and get all discovered devices in a callback? Would you mind describing your use case in more detail? This would help me design this feature. Thanks.

You can? The Examples weren't clear about that, but how does it work if you have multiple devices with the same name offering the same services? The spec didn't seem to clearly say how you'd disambiguate in that situation.  There'd no such ambiguity by implementing getDevices()

I released a new version of the plugin which has requestLEScan and stopLEScan.


curl-install-sh: fatal: bad object from git clone steps

Operating system and version:
Windows Server 2012 R2
NodeJS 20.15.1
Git for Windows 2.45.2.windows.1
Cygwin1.dll 3.4.5
nvm debug output:

# command not found?

nvm ls output:

# command... not found.

How did you install nvm?

curl -o- https://raw.githubusercontent.com/nvm-sh/nvm/v0.39.7/install.sh | bash
What steps did you perform?
Ran the install command
What happened?

install.sh script output
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 16555  100 16555    0     0   140k      0 --:--:-- --:--:-- --:--:--  141k
=> Downloading nvm from git to '/home/avenger/.nvm'
=> Cloning into '/home/avenger/.nvm'...
remote: Enumerating objects: 369, done.
remote: Counting objects: 100% (369/369), done.
remote: Compressing objects: 100% (315/315), done.
remote: Total 369 (delta 42), reused 166 (delta 27), pack-reused 0
Receiving objects: 100% (369/369), 368.22 KiB | 30.68 MiB/s, done.
Resolving deltas: 100% (42/42), done.
remote: Enumerating objects: 366, done.
remote: Counting objects: 100% (366/366), done.
remote: Compressing objects: 100% (315/315), done.
remote: Total 366 (delta 42), reused 162 (delta 25), pack-reused 0
Receiving objects: 100% (366/366), 365.90 KiB | 30.49 MiB/s, done.
Resolving deltas: 100% (42/42), done.
fatal: bad object cdc56687ada0c47f97632b0049b0446aadbe3a3a
error: remote did not send all necessary objects
Failed to fetch origin with v0.39.7. Please report this!

What did you expect to happen?
Install nvm.
Is there anything in any of your profile files that modifies the PATH?

~/.bash_profile

If you are having installation issues, or getting "N/A", what does curl -I --compressed -v https://nodejs.org/dist/ print out?

$ curl -I --compressed -v https://nodejs.org/dist/
* STATE: INIT => CONNECT handle 0xa0001eef8; line 1909 (connection #-5000)
* Added connection 0. The cache now contains 1 members
* STATE: CONNECT => RESOLVING handle 0xa0001eef8; line 1955 (connection #0)
* [CONN-0-0] setup, init filter chain
* [CONN-0-0] cf_add(filter=SOCKET)
* [CONN-0-0] cf_add(filter=SSL)
* [CONN-0-0][CF-SOCKET] setup(remotehost=nodejs.org)
* STATE: RESOLVING => CONNECTING handle 0xa0001eef8; line 2029 (connection #0)
* family0 == v4, family1 == v6
*   Trying <IP_ADDRESS>:443...
* [CONN-0-0] connect(block=0)-> 0, done=0
* Connected to nodejs.org (<IP_ADDRESS>) port 443 (#0)
* ALPN: offers h2
* ALPN: offers http/1.1
*  CAfile: /etc/pki/tls/certs/ca-bundle.crt
*  CApath: none
* [CONN-0] Didn't find Session ID in cache for host HTTPS://nodejs.org:443
* [CONN-0-0][CF-SSL] TLSv1.3 (OUT), TLS handshake, Client hello (1):
* [CONN-0-0] connect(block=0)-> 0, done=0
* [CONN-0-0][CF-SSL] TLSv1.3 (IN), TLS handshake, Server hello (2):
* [CONN-0-0][CF-SSL] TLSv1.3 (IN), TLS handshake, Encrypted Extensions (8):
* [CONN-0-0][CF-SSL] TLSv1.3 (IN), TLS handshake, Certificate (11):
* [CONN-0-0][CF-SSL] TLSv1.3 (IN), TLS handshake, CERT verify (15):
* [CONN-0-0][CF-SSL] TLSv1.3 (IN), TLS handshake, Finished (20):
* [CONN-0-0][CF-SSL] TLSv1.3 (OUT), TLS change cipher, Change cipher spec (1):
* [CONN-0-0][CF-SSL] TLSv1.3 (OUT), TLS handshake, Finished (20):
* SSL connection using TLSv1.3 / TLS_AES_256_GCM_SHA384
* ALPN: server accepted h2
* Server certificate:
*  subject: CN=*.nodejs.org
*  start date: Feb 28 00:00:00 2024 GMT
*  expire date: Mar 30 23:59:59 2025 GMT
*  subjectAltName: host "nodejs.org" matched cert's "nodejs.org"
*  issuer: C=GB; ST=Greater Manchester; L=Salford; O=Sectigo Limited; CN=Sectigo RSA Domain Validation Secure Server CA
*  SSL certificate verify ok.
* [CONN-0-0] connect(block=0)-> 0, done=1
* STATE: CONNECTING => PROTOCONNECT handle 0xa0001eef8; line 2073 (connection #0)
* [CONN-0-0] connect(block=0)-> 0, done=1
* STATE: PROTOCONNECT => DO handle 0xa0001eef8; line 2103 (connection #0)
* Using HTTP2, server supports multiplexing
* Copying HTTP/2 data in stream buffer to connection buffer after upgrade: len=0
* h2h3 [:method: HEAD]
* h2h3 [:path: /dist/]
* h2h3 [:scheme: https]
* h2h3 [:authority: nodejs.org]
* h2h3 [user-agent: curl/7.87.0]
* h2h3 [accept: */*]
* h2h3 [accept-encoding: deflate, gzip, br, zstd]
* Using Stream ID: 1 (easy handle 0xa0001eef8)
> HEAD /dist/ HTTP/2
> Host: nodejs.org
> user-agent: curl/7.87.0
> accept: */*
> accept-encoding: deflate, gzip, br, zstd
>
* STATE: DO => DID handle 0xa0001eef8; line 2199 (connection #0)
* multi changed, check CONNECT_PEND queue
* STATE: DID => PERFORMING handle 0xa0001eef8; line 2318 (connection #0)
* Curl_readwrite(handle=0xa0001eef8) -> 0
* [CONN-0-0][CF-SSL] TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
* [CONN-0] Didn't find Session ID in cache for host HTTPS://nodejs.org:443
* [CONN-0] Added Session ID to cache for HTTPS://nodejs.org:443 [server]
* [CONN-0-0][CF-SSL] TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
* [CONN-0] Found Session ID in cache for host HTTPS://nodejs.org:443
* old SSL session ID is stale, removing
* [CONN-0] Added Session ID to cache for HTTPS://nodejs.org:443 [server]
* readwrite_data(handle=0xa0001eef8) -> 0
* Curl_readwrite(handle=0xa0001eef8) -> 0
* readwrite_data(handle=0xa0001eef8) -> 0
* Curl_readwrite(handle=0xa0001eef8) -> 0
* HTTP/2 found, allow multiplexing
< HTTP/2 200
HTTP/2 200
< date: Tue, 23 Jul 2024 22:31:52 GMT
date: Tue, 23 Jul 2024 22:31:52 GMT
< content-type: text/html
content-type: text/html
< cache-control: public, max-age=3600, s-maxage=14400
cache-control: public, max-age=3600, s-maxage=14400
< last-modified: Tue, 23 Jul 2024 19:35:45 GMT
last-modified: Tue, 23 Jul 2024 19:35:45 GMT
< cf-cache-status: HIT
cf-cache-status: HIT
< age: 10355
age: 10355
< vary: Accept-Encoding
vary: Accept-Encoding
< strict-transport-security: max-age=31536000; includeSubDomains; preload
strict-transport-security: max-age=31536000; includeSubDomains; preload
< x-content-type-options: nosniff
x-content-type-options: nosniff
< server: cloudflare
server: cloudflare
< cf-ray: 8a7f1f8aab5c5794-IAD
cf-ray: 8a7f1f8aab5c5794-IAD
< content-encoding: br
content-encoding: br

<
* readwrite_data(handle=0xa0001eef8) -> 0
* Curl_readwrite(handle=0xa0001eef8) -> 0
* STATE: PERFORMING => DONE handle 0xa0001eef8; line 2517 (connection #0)
* multi_done: status: 0 prem: 0 done: 0
* Connection #0 to host nodejs.org left intact
* Expire cleared (transfer 0xa0001eef8)

bottomline
If I download/checkout and edit install.sh and change all --git-dir="${INSTALL_DIR}/.git" --work-tree="${INSTALL_DIR}" with just -C "${INSTALL_DIR}" the script runs to completion.
`$ cat install.sh | bash`
=> nvm is already installed in /home/user/.nvm, trying to update using git
=> * (HEAD detached at FETCH_HEAD)
  master
=> Compressing and cleaning up git repository

=> Appending nvm source string to /home/user/.bashrc
=> Appending bash_completion source string to /home/user/.bashrc
=> You currently have modules installed globally with `npm`. These will no
=> longer be linked to the active version of Node when you install a new node
=> with `nvm`; and they may (depending on how you construct your `$PATH`)
=> override the binaries of modules installed with `nvm`:

C:\Users\user\AppData\Roaming\npm
└──<EMAIL_ADDRESS>=> If you wish to uninstall them at a later point (or re-install them under your
=> `nvm` Nodes), you can remove them from the system Node as follows:

     $ nvm use system
     $ npm uninstall -g a_module

=> Close and reopen your terminal to start using nvm or run the following to use it now:

export NVM_DIR="$HOME/.nvm"
[ -s "$NVM_DIR/nvm.sh" ] && \. "$NVM_DIR/nvm.sh"  # This loads nvm
[ -s "$NVM_DIR/bash_completion" ] && \. "$NVM_DIR/bash_completion"  # This loads nvm bash_completion

This happens because I'm running git for windows from a cygwin shell, so the linux-like path provided in --git-dir doesn't get translated correctly. It seems both -C and --work-tree are translated correctly. I didn't retry the script just dropping --git-dir as it would probably fail as my current working directory was not ~/.nvm.
So, perhaps replacing the command to use -C could be a bit more portable. Maybe checking "${OSTYPE}" == "cygwin" could create an exception, if using both work-tree and git-dir is meant to solve issues with a specific OS/environment.
Hope this helps improve NVM!
edit: this issue is probably the same reported in #3329.

The<EMAIL_ADDRESS>output indicates you have an npm-installed nvm, which isn't actually a working version of anything.
The issue with the git syntax suggests your git version is unsupported - we require v1.7.10, per the readme. What version do you have?

I had installed the<EMAIL_ADDRESS>where it informed me I needed to install it from the shell script. I understand it didn't do anything, I just didn't bother to remove it back then.
Git is 2.45.2 as I stated in the top (operating system/version).
I don't know, to me it really look like just a cygwin-to-git4win path conversion issue. Again, it installed when I switched to -C (which should be equivalent to the pair of git arguments). Thing is, I am calling git for windows with linux(cygwin) paths, thus the paths (in /home/user/.nvm format) doesn't work, as it would expect something like c:\cygwin64\home\user\.nvm, which cygwin can translate when -C is passed.
Unless I'm mistaken, cygwin automatically translates paths passed to non-cygwin commands. When it's in the format -C /home/user/.nvm. But it doesn't really try it when the arguments are tied --git-dir="/home/user/.nvm".
This issue should only trigger when using WSL or cygwin with non-native builds of git. The solution that works for me though, probably doesn't for WSL.

What happens if you use a cygwin-installed git, so that it's not using the windows git?

Using cygwin-installed git (yet, of course, Windows-installed node), it works. Tested in a somewhat similar station with git 2.31.1, node 14.17.6, and cygwin1.dll 3.2.0.

Windows-installed node shouldn't matter because nvm doesn't itself use node.
OK, thanks! That means that nvm's install script either needs to detect windows-installed git, ideally with feature detection, and either a) error out, or b) change the git commands so they work.
Alternatively, cygwin could (and probably should) add support for --git-dir if it already supports -C?

Windows-installed node shouldn't matter because nvm doesn't itself use node.

Oh, sure, right!

OK, thanks! That means that nvm's install script either needs to detect windows-installed git, ideally with feature detection, and either a) error out, or b) change the git commands so they work.

Ya, erroring (a) could be frustrating to the user, but not bulldozing directories where they shouldn't will definitively help at least measure the worth of treating this edge case. Adapting the commands (b) should involve some magic I'm not sure is worth for the script maintainability over the long run.
It would involve, after resolving ${INSTALL_DIR} something like this
conceptual script
if [ "${OSTYPE}" == "cygwin" ]; then
  if ldd "$(which git)" | egrep -q "^[ "$'\t'"]*cygwin1.dll "; then
    INSTALL_DIR_CONVERTED="$(cygpath -w "$(readlink -f "${INSTALL_DIR}")")"
  fi
fi

Basically, if under cygwin -and- the git command in path does not link against cygwin1.dll, we can safely tell it's windows version. Then path conversion only for git calls should take place.

Git-windows ldd output
$ ldd "$(which git)"
        ntdll.dll => /cygdrive/c/Windows/SYSTEM32/ntdll.dll (0x7ff81c780000)
        KERNEL32.DLL => /cygdrive/c/Windows/system32/KERNEL32.DLL (0x7ff81b6d0000)
        KERNELBASE.dll => /cygdrive/c/Windows/system32/KERNELBASE.dll (0x7ff819cf0000)
        msvcrt.dll => /cygdrive/c/Windows/system32/msvcrt.dll (0x7ff81ba00000)
        SHELL32.dll => /cygdrive/c/Windows/system32/SHELL32.dll (0x7ff819ed0000)
        SHLWAPI.dll => /cygdrive/c/Windows/system32/SHLWAPI.dll (0x7ff819e70000)
        USER32.dll => /cygdrive/c/Windows/system32/USER32.dll (0x7ff81c220000)
        combase.dll => /cygdrive/c/Windows/SYSTEM32/combase.dll (0x7ff81bff0000)
        GDI32.dll => /cygdrive/c/Windows/system32/GDI32.dll (0x7ff81bea0000)
        RPCRT4.dll => /cygdrive/c/Windows/system32/RPCRT4.dll (0x7ff81b590000)
        SspiCli.dll => /cygdrive/c/Windows/system32/SspiCli.dll (0x7ff819980000)
        sechost.dll => /cygdrive/c/Windows/SYSTEM32/sechost.dll (0x7ff81bb60000)

Git-cygwin ldd output
$ ldd $(which git)
        ntdll.dll => /cygdrive/c/WINDOWS/SYSTEM32/ntdll.dll (0x7ffc42e30000)
        KERNEL32.DLL => /cygdrive/c/WINDOWS/System32/KERNEL32.DLL (0x7ffc42cd0000)
        KERNELBASE.dll => /cygdrive/c/WINDOWS/System32/KERNELBASE.dll (0x7ffc40760000)
        cygintl-8.dll => /usr/bin/cygintl-8.dll (0x3fd310000)
        cygz.dll => /usr/bin/cygz.dll (0x3fa050000)
        cygiconv-2.dll => /usr/bin/cygiconv-2.dll (0x3fcdb0000)
        cygwin1.dll => /usr/bin/cygwin1.dll (0x180040000)

So, not sure this edgy case is worth this much trouble.

Alternatively, cygwin could (and probably should) add support for --git-dir if it already supports -C?

This brings us to another long piece. In summary, I was mistaken. Cygwin doesn't do any path conversion and it worked by luck. The -C was required to get rid of the bad object error, though, which I'm still not completely sure why it happened, as all other git steps were "going through". Details follows.
Gory details
I was double-checking this... and seems cygwin doesn't really do any path translation.
The output of
[ -z "${XDG_CONFIG_HOME-}" ] && printf %s "${HOME}/.nvm" || printf %s "${XDG_CONFIG_HOME}/nvm"
is
/home/user/.nvm
And I tried some commands to see what happens. And turns out that git-for-windows version does interpret the path and creates the directories.
Say, I have /home/user/ as my home directory, which from cygwin would translate to C:\cygwin64\home\user\.
I noticed what happened here was, all stuff was installed and set up in C:\home\user\.nvm.
When I tried git init /home/user/.nvm (based on v0.39.7's install.sh), what I got was:
Initialized empty Git repository in C:/home/user/.nvm/.git/
Thus, I see there's no conversion made by cygwin at all, git-for-win just install everything outside of the actual user's home. Just, for some reason, --git-dir= and/or --work-tree= mostly works. It clones in that "foreign" directory, checks stuff out. All having the "build environment" actually outside actual user home.
But then that step to check out the tag fails. Even though it shouldn't by looking into C:\home\user\.nvm (which is not the same ascygwin's /home/user/.nvm)
Then I believe -C does work because it is equivalent to the syntax used for git clone, that just passes the install path (that means, "change to that directory and do the commands").
In the end, I had /home/user/.nvm (install.sh:152)[https://github.com/nvm-sh/nvm/blob/v0.39.7/install.sh#L152] but also had C:\home\user\.nvm (which corresponds to /cygdrive/c/home/user/.nvm in cygwin).
It indeed worked because, at least
(a) I manually cloned nvm-sh/nvm into real cygwin /home/user/.nvm and checked out tag
(b) The commands from the install script succeeded with -C /home/user/.nvm being interpreted as -C C:\home\user\.nvm
So I had very close branches in both directories, so whenever the script called git-win, it worked on the "foreign" repo, but whenever the rest of the script referred to the actual directory, it found what it expected. 😄
Then again, no telling what else was left not done in one directory but done in another, if you follow the thought. It seemed to have worked, but I didn't try too many things, I'm new with nvm.
bottomline
In the end, for my use case, I was setting up a server service, something I'd need to run as network service, so as nvm is something user-scoped it wouldn't really help and I will need to keep node up-to-date in the server the oldschool way.
So that's another reason it could be safer to just error out and see if more people raise here hitting this wall.
This issue might also be affected by git-bash-here (git for windows context menu item). I believe they use MSYS, and it seems this one does auto path conversion so...


Fix LoginRequiredMiddleware for Django 2.0

Django 2.0 removed is_authenticated as a method, instead it is now accessed as an attribute.
Not sure if there are other places where 2.0 support is broken, this seems to be the only change needed for our website.
You could also rework the import MiddlewareMixin  part (and others) to check the version instead of trying/catching the import, but I'll leave that up to you.

Codecov Report

Merging #20 into master will not change coverage.
The diff coverage is 100%.

@@          Coverage Diff          @@
##           master    #20   +/-   ##
=====================================
  Coverage     100%   100%
=====================================
  Files           8      8
  Lines         250    254    +4
=====================================
+ Hits          250    254    +4

Impacted Files
Coverage Δ

django_auth_adfs/middleware.py
100% <100%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b030a89...d1a0a44. Read the comment docs.

Adding this also means adding django 2.0 in the test matrix.
Feel like adding this?

Sure, what does that involve?
(I'm relatively new to the python development cycle.)

It boils down to adding Django 2.0 into these 2 files:
https://github.com/jobec/django-auth-adfs/blob/master/tox.ini
https://github.com/jobec/django-auth-adfs/blob/master/.travis.yml
Give it a try. If you get stuck somehow, just ask.

Looks like there is something not compatible - I'll take a look on the weekend.

It looks like the way of doing unit tests has changed in django 2.0.
All tests are ok, just 1 where a real client request is simulated, failed.

I couldn't work out test_login_redir - django doesn't seem to realise that the user has to be logged in for the /test/ url, even though the LoginRequiredMiddleware is enabled. Do you know what's changed in 2.0? Couldn't find anything related.

Django 2.0 dropped support for the MIDDLEWARE_CLASSES setting and only takes MIDDLEWARE as a setting. This caused the session middleware not to be loaded and hence nothing was setting the session attribute on the request object.
It's fixed now.


cmd/compile: broken link https://rsc.googlecode.com/hg/testdata/slow.go in plive.go

In plive.go, there's this comment:
// the same type t. On https://rsc.googlecode.com/hg/testdata/slow.go, onebitwalktype1
// accounts for 40% of the 6g execution time.

The link no longer works though, and perhaps isn't even true anymore. We should update it appropriately.
/cc @rsc @griesemer

New link is at https://github.com/rsc/rsc/blob/master/testdata/slow.go

I just used cmd/compile -cpuprofile on slow.go, and the compiler's only spending 17% of its time in all of plive.go, most of which seems to be going towards livenessprologue and livenesssolve. It doesn't seem like onebitwalktype1 is a bottleneck for slow.go anymore, and it doesn't even show up.
Tangentially, compiling slow.go takes around 3 seconds on my laptop with Go 1.4's 6g, whereas at HEAD it takes around 1.8 seconds.
I think the comment can just be removed.


i click login and?

if i click login and join nothing happens.

With so little information which is insufficient to even reproduce, what kind of help are you expecting to get?

@Unihedro my command is java -jar DarkBot.jar -t spambot -O -o xSzymi1337 -b 500 -s ip --protocol 4 -d
awww... i record,wait

2 mins

https://www.youtube.com/watch?v=EtuQ6Fx7SLg&feature=youtu.be, sorry for music xD

https://www.youtube.com/watch?v=rx1LVA6PZ3I&feature=youtu.be

Have you tried without the proxies? There is a lack of debug info in regards to proxy support, so those issues are hard to diagnose without more info.

https://www.youtube.com/watch?v=xuTsyJaqNNg&feature=youtu.be

Help me plz

Hey Storm I Got A Problem With This Stuff  I Set My Codename As Owner Then I Used [!] Commands But They Don't Do Anything Then I Do !KILLALL Randomly Then If  A Mob Get Close To The Bot They Hit The Mobs Why???


Lime path library error (0.7.3 Ex Latest)

Describe your bug here.
this error on compile

Command Prompt/Terminal logs (if existing)
Called from lime.app.Promise::error lime/app/Promise.hx line 149
Called from lime.app.Promise::error lime/app/Promise.hx line 149
Called from lime.utils.Assets::loadLibrary lime/utils/Assets.hx line 480
Called from lime.app.Promise_lime_utils_AssetLibrary::error lime/app/Promise.hx line 149
Called from lime.utils.Preloader::updateProgress lime/utils/Preloader.hx line 293
Called from lime.utils.Log::error lime/utils/Log.hx line 37

Are you modding a build from source or with Lua?
Source
What is your build target?
Windows
Did you edit anything in this build? If so, mention or summarize your changes.
only moved crap around but not paths

Use lime 8.0.1

Use lime 8.0.1

but why i used it on 0.7.1h why is it not working for 8.1.1

Im going to look into this deeper bc im wanting to use this version of lime

also doesn't 0.7.2x use 8.1.1?

or did he revert it

could it be this commit to cause the error


GuestIssuer jwt_token.decode('utf-8') redundant?

guest_issuer.create() fails with
site-packages/webexteamssdk/api/guest_issuer.py", line 124, in create
    "Authorization": "Bearer " + jwt_token.decode("utf-8")
AttributeError: 'str' object has no attribute 'decode'

I believe this happens because jwt.encode() returns plain ASCII string which doesn't provide decode() method. My environment is Python3.9. "Authorization": "Bearer " + jwt_token works fine.

@JardaMartan could you specify the version of the dependencies (especially the jwt library) that you have installed? There used to be the reverse issue where a binary was returned and thus decode was necessary.

I'm using PyJWT 2.1.0 imported by the installation of webexteamssdk package. No other installs.
(venv) JMARTAN-M-N0F8:guest jmartan$ pip install webexteamssdk
Collecting webexteamssdk
  Downloading webexteamssdk-1.6-py3-none-any.whl (113 kB)
     |████████████████████████████████| 113 kB 3.4 MB/s
Collecting PyJWT
  Downloading PyJWT-2.1.0-py3-none-any.whl (16 kB)

----
(venv) JMARTAN-M-N0F8:guest jmartan$ pip freeze | grep -i jwt
PyJWT==2.1.0

thanks. I'll try and reproduce your error.

Ran into the same error using PyJWT. Apparently, it already provides the jwt token as a string, not a binary. The quick fix was to roll back to PyJWT==1.7.1.  I suppose something could be done to check version of the dependencies of this package.


Implemented Levenshtein edit-distance and Needleman–Wunsch alignment score bindings for Rust

Closes #82.

:tada: This PR is included in version 3.1.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Can we get an FFI for Python?

Happy to contribute, of course.

Hello @winstxnhdw
Here there are signatures to FFI methods (I used these to benchmark GxHash against well-known C hash functions):
https://github.com/ogxd/gxhash/blob/main/ffi/src/lib.rs
I'm not super familiar with FFI for Python. From what I recall there are several approaches (Cython?) but my knowledge may be out-of-date. In any case, I don't think it would be very different considering that these FFI signatures are quite simple, but I don't think I would include any Python-related things into this repository. It would make more sense to do it in a separate repository (that you can make and maintain if you want, it's MIT licensed so you're 100% free to do whatever you want with it)


Incorrect Zip Codes to County data mapping

Expected Behavior
85602 zip code to have two counties.
85602,Benson,AZ,COCHISE,,32.035885,-110.262611
85602,Benson,AZ,PIMA,,...,...

There's no surjection between the set of zip codes and set of counties.
A somewhat helpful explanation of this fact in reality by census bureau:
explanation_zcta_county_rel_10.pdf
The problem is generic, not just this zip code is affected. As I said, there's no surjection between the set of zip codes and set of counties in general.
Actual Behavior
85602 only has a single county: AZ, COCHISE.
85602,Benson,AZ,COCHISE,,32.035885,-110.262611

Steps to reproduce the problem

Look into the data.
Look at here: https://www2.census.gov/geo/pdfs/maps-data/data/rel/explanation_zcta_county_rel_10.pdf

Current Version: git @ 6599105
Operating System: not relevant

@MOZGIII thanks for reporting this. We are considering a refactor and plan to disconnect this relationship.


Upgraded Vue.js sample to GA

Q
A

New feature?
yes?

What's in this Pull Request?
As title says, vue sample updated to support GA release.

thx Sergei, appreciated. Good to get this one moved cross as well.


Compression is not yet supported

Hi,
I tried to extract a file from a rar and this is the error i get on my console "Compression is not yet supported". Does this mean that non-compressed file can't be extracted at this moment? If yes, when can we expect this library to support extracting compressed files?
Thanks

Hi, I'm looking to use this in a web application and I'm going to look into adding decompression support.  I haven't done this sort of thing before, so no guarantees on my ability to be successful, but I'll try.  :)


Merge release to master

Reviewing cheatsheet
Before merging the PR, comments starting with

❌ ❓must be fixed
🤔 💅 should be fixed
💭 may be fixed
🎉 celebrate happy things

@bot-gradle merge

The merge queue build has started. Click here to see all failures if any.


? Error

Basically i log into my minecraft account using my microsoft account, and i sign into there with my github. i start it up and it says i did not enter a password/username yet it says its not needed in config.toml.

Okay that is some historical stuff that I forgot to remove in config.toml. Basically you need to enter the username and password in the config file now. I will change it.

Okay that is some historical stuff that I forgot to remove in config.toml. Basically you need to enter the username and password in the config file now. I will change it.

well when i did enter it, it said it was the wrong password when it wasn't.

Okay that is some historical stuff that I forgot to remove in config.toml. Basically you need to enter the username and password in the config file now. I will change it.

well when i did enter it, it said it was the wrong password when it wasn't.

nevermind! i see you fixed this good stuff man


Changing the type of input

Is there a possible way to change the type of datepicker input from text to number. I would like to limit the input to numbers and don't allow any characters.

Wouldn't that prohibit slashes and dashes, both of which are necessary parts of date formatting?

Format I'm using is YYYY-MM-DD and type as number allows dashes.

@ljharb Is there a way I can track the input? When user types a date, at each character the user types, it is detected onDateInputChanges or something like that? It would help in limiting the types of input we would like the users to enter and display error if wrong text has been entered.

@sjain-mi9 This is something that has been floated around before. I think it's a good idea, but am not yet sure what the best way to implement it is.

can we have a prop to set the input type to "date"?
It could be fine to improve the mobile experience


Include useless stats in tests

Placeholder, I will describe more tests as in http://www.larsschwarz.com/google-web-fonts/ as info level tests

The only useful table in this page is about the Vendor IDs which look like they are registered to someone else:

Used Vendor ID
Vendor ID registered to

1ASC
Ascender

ADBE
Adobe

BROS
Michael Brosnan

FA
FontArte Type Foundry

FAT
Fatype

KORK
Khork OÜ

MYFO
MyFonts.com

TYPO
Typodermic

TYRE
typerepublic

URW
URW++

We already have a vendorID checker so I'm closing this

Actually I realise that there isn't a standalone tool that prints the vendorID value, so I request @felipesanches to make a simple fontbakery-fix-vendorid.py that just prints the vendorID and the filename, eg;
$ fontbakery-fix-vendorid.py fonta.ttf fontb.ttf fontc.ttf
ACME fonta.ttf
GOOG fontb.ttf
KORK fontc.ttf

Thanks!


declare composer 2.2 allow-plugins

Already applied during update dependencies https://github.com/symplify/symplify/pull/3862 https://github.com/symplify/symplify/blob/a8467446408b531effe3888fe476764205905837/composer.json#L243-L246
I am closing it.


Search Explorer 404 Message

Whenever you click on the search explorer link of the media sources it sends you to a 404 message. Even if the source exits.
Examples:

https://sources.mediacloud.org/#/sources/661465

https://sources.mediacloud.org/#/sources/194718

https://sources.mediacloud.org/#/sources/661572

This is very strange, but I do not see this behavior when clicking on the search in explorer link. Can you please try again and let me know if it's still happening?

Those seem to be working now lol. In an attempt to make me look bad but look at this one:

https://sources.mediacloud.org/#/sources/105818/feeds

Ok, thanks for rechecking that! Because we're operating at very diminished computing power right now, I imagine something went awry earlier resulting in the 4040s.

@dsjen  I do have other links that are doing it now if you want me to add them all here

Please do!!!
On Thu, Sep 3, 2020 at 11:55 AM titinfoundation<EMAIL_ADDRESS>wrote:

@dsjen https://github.com/dsjen I do have other links that are doing it
now if you want me to add them all here
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/mitmedialab/MediaCloud-Web-Tools/issues/1981#issuecomment-686587408,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABIFNIRWLXMSZHD6UVB2W5TSD636XANCNFSM4QTWK2YQ
.


WIP: [ART-3965] scan-sources: Use repoquery for rpm change detection

In https://github.com/openshift-eng/doozer/pull/764, the idea of using repoquery to detect outdated rpms has been proved in gen-payload. This PR will adopt the same approach in scan_sources.
Example run:
$ doozer --debug --assembly=stream --group=openshift-4.9 --rpms=openshift-clients --images=openshift-base-rhel8 config:scan-sources --yaml

images:
-   changed: true
    name: openshift-base-rhel8
    reason: RPM redhat-release-eula-8.4-0.8.el8 installed in openshift-base-rhel8-container-v4.9.0-202304010015.p0.gf020942.assembly.stream
        (x86_64) when redhat-release-eula-8.4-0.10.el8 is available in repo rhel-8-baseos-rpms;
        RPM redhat-release-8.4-0.8.el8 installed in openshift-base-rhel8-container-v4.9.0-202304010015.p0.gf020942.assembly.stream
        (x86_64) when redhat-release-8.4-0.10.el8 is available in repo rhel-8-baseos-rpms;
        RPM redhat-release-eula-8.4-0.8.el8 installed in openshift-base-rhel8-container-v4.9.0-202304010015.p0.gf020942.assembly.stream
        (ppc64le) when redhat-release-eula-8.4-0.10.el8 is available in repo rhel-8-baseos-rpms;
        RPM redhat-release-8.4-0.8.el8 installed in openshift-base-rhel8-container-v4.9.0-202304010015.p0.gf020942.assembly.stream
        (ppc64le) when redhat-release-8.4-0.10.el8 is available in repo rhel-8-baseos-rpms;
        RPM redhat-release-eula-8.4-0.8.el8 installed in openshift-base-rhel8-container-v4.9.0-202304010015.p0.gf020942.assembly.stream
        (s390x) when redhat-release-eula-8.4-0.10.el8 is available in repo rhel-8-baseos-rpms;
        RPM redhat-release-8.4-0.8.el8 installed in openshift-base-rhel8-container-v4.9.0-202304010015.p0.gf020942.assembly.stream
        (s390x) when redhat-release-8.4-0.10.el8 is available in repo rhel-8-baseos-rpms;
        RPM redhat-release-eula-8.4-0.8.el8 installed in openshift-base-rhel8-container-v4.9.0-202304010015.p0.gf020942.assembly.stream
        (aarch64) when redhat-release-eula-8.4-0.10.el8 is available in repo rhel-8-baseos-rpms;
        RPM redhat-release-8.4-0.8.el8 installed in openshift-base-rhel8-container-v4.9.0-202304010015.p0.gf020942.assembly.stream
        (aarch64) when redhat-release-8.4-0.10.el8 is available in repo rhel-8-baseos-rpms
rpms:
-   changed: false
    name: openshift-clients
    reason: No change detected

Replaced by a new PR.


gcc8 should be the default compiler

Issue description
#53760 was merged into staging, but somehow got dropped.
It would be helpful if the process with the staging and staging-next branches was documented better. In case it already is documented, that should be more discoverable.
Maybe the manual section could be extended a little?
Steps to reproduce
Technical details
Please run nix-shell -p nix-info --run "nix-info -m" and paste the
results.

staging-next: Things get merged to staging (basically always), and staging-next is there to make things smoother when getting the stuff to master.  Some more details were described in an RFC, but so far it's been mostly just two people actively taking part in this, so there hasn't been need for much coordination.

That PR was not really merged (in current state of history, at least); I don't know what's happened there.  In any case it's a relatively intrusive change, so it needs stabilizing on a separate branch with separate Hydra jobset before getting merged to staging.

Thanks, that clears things up.
Maybe a little seo for NixOS/rfcs would help.

That PR was not really merged (in current state of history, at least)

That is mostly what i'm wondering about, and the description in the rfc doesn't help either. I just want to know why it was removed, so a "revert"-commit would have helped. It may well be that the occasional force-push lessens the burden of maintenance, and I can't blame anyone for that though.


Fix bug, if items is an expression, not only key

Thanks for your util class.
I fixed situation, when user passed expression to tag:  items="data.row"

btw,
Would you like to contribute your solution to official jxls?
Like this guy did: https://bitbucket.org/leonate/jxls/issues/136/i-would-like-to-add-this-merge-command

@rj-hwang Could you have a look?


Ensure date/datetime representation in plots for Spark when providing Timestamp

When the user provides a timestamp-typed time_axis in PySpark, the time axis is binned in (nano)seconds. This should be displayed in as datetimes in the plots.

After a lot of debugging, I found that there is a bug in histogrammar with Spark DataFrames. The histogrammar converts timestamps in nanoseconds for binning calculations. However, it fails to convert it back to timestamp for Spark DataFrames. It is a bit more explained in the issue here. I have fixed the issue in histogrammar repo and submitted a PR.


Separation of the EF and Business Logic layers from the MVC

@xmichaelx Can you check it please?

Why you explicitly set table names in EF?

Good point. 👍  Do you recommend deleting it? Personally I like this - especially in Asp.Net Core Identity tables.
You can send your ideas please. :)

I didn't have issue with names provided by EF by default and for me it's just less code I have to maintain, but this is largely a personal preference, nothing big.
The other this is you have renamed some methods in IdentityController from UserSave and UserEdit and at least in VS this produces warnings:
Warning	CS0108	'IdentityController.User(string)' hides inherited member 'ControllerBase.User'. Use the new keyword if hiding was intended.

I recommend wrapping those User methods in block of:
#pragma warning disable CS0108
#pragma warning restore CS0108

Just so it's clear that we're doing this on purpose.

@xmichaelx I've changed the methods back to User because previous names UserSave and UserEdit produce wrong ViewName - https://github.com/skoruba/IdentityServer4.Admin/blob/206685577296f99047a45aff413165b07080a617/src/Skoruba.IdentityServer4.Admin/ExceptionHandling/ControllerExceptionFilterAttribute.cs#L58-L68
Any idea how fix it? :)

@skoruba No ideas so far, I'll review changes tonight.
Since database access is nicely separated now, is connecting IS to use database that is being modified by Admin something we would contemplate instead of using InMemory implementations?

@xmichaelx Yes, absolutely, we can use the database instead of InMemory store.

@xmichaelx @TomasHubelbauer - Thank you guys for the review. :)