Use clickhouse official docker image

Hello there :wave:
When this plugin was created, there weren't any official clickhouse docker image. Now the yandex image is not updated anymore so is lagging behind (last version of the yandex repository is 21.3.20)
WDYT?

Update: Version was incomplete

Do folks need to do anything to migrate to this, or is this a backwards-incompatible change?

It is a backwards-compatible change. ClickHouse became a separate entity from Yandex and they create a new user https://github.com/ClickHouse/ClickHouse/discussions/35389.
https://clickhouse.com/blog/introducing-click-house-inc

Do folks need to do anything to migrate to this

Don't think so because of what @nerg4l said. Unfortunately, I have been using this image since the beginning, so I'm not familiar with a running application with the old image and then updating it.

Anyone know whats going on in #66?

@epergo mind rebasing?

@epergo mind rebasing?

@josegonzalez done

Released in 1.37.0.


remove legacy parameter disable_character_fragments from lstm.train

fixes https://github.com/tesseract-ocr/tesseract/issues/2665
il1_adaption_test has already been removed by earlier commit.

@stweil the submodule tessconfigs will need to be updated in tessdata, tessdata_fast and tessdata_best. I don't think I can create a PR for that.

Thanks!

tessconfigs is now updated, too (several new commits).

Thanks, @stweil


No sys.stdin.buffer for Python 2

Ran into an issue when using xopen.xopen('-', 'r') in Python 2:
>>> xopen.xopen('-', 'r')
---------------------------------------------------------------------------
AttributeError                            Traceback (most recent call last)
<ipython-input-3-5448057e1aea> in <module>()
----> 1 xopen.xopen('-', 'r')
xopen.pyc in xopen(filename, mode, compresslevel)
    201                         r=sys.stdin,
    202                         rt=sys.stdin,
--> 203                         rb=sys.stdin.buffer,
    204                         w=sys.stdout,
    205                         wt=sys.stdout,

AttributeError: 'file' object has no attribute 'buffer'

Fix is to not create the mode lookup dictionary with the .buffer options if it's a non-Python 3 environment, which is what the PR does.

Nice catch, thanks for fixing this!


FIX: test_scale_mri too slow on Travis OSX

We have been seeing too many of these lately:
https://travis-ci.org/mne-tools/mne-python/jobs/488680214
This commit skips test_scale_mri on Travis-OSX to avoid it.

Merging to keep things green


Regression: SagaFixture.registerResource(EventStore) overwrites EventBus-Property

From Axon Framework 3.1.1 to 3.2.2 the behaviour of the saga fixture has changed.
Given a Saga using EventBus and EventStore:
class MySaga {
  @Inject
  private EventStore eventStore;

  @Inject
  private EventBus eventBus;
}

The Saga uses the EventStore to check if an aggregate instance exists and sends an event to the EventBus.
In the Saga Test we mocked the EventStore to return what is needed by the test scenario.
EventStore eventStore = mock(EventStore);
fixture.registerResource(eventStore);
// define the behaviour of the eventStore

After upgrading to Axon 3.2.2 now suddenly .expectPublishedEventsMatching(..) failed and stated that no events have been published. What happened was that the fixture registered the EventStore-Mock also as EventBus and the events desappeared in the mock.
I would not suspect the fixture to do this because the EventStore-Mock does not even implement the EventBus-Interface...
For anyone with the same problem here our solution: We extracted all direct calls of the EventStore and moved them in Projection-classes that we injected instead. These can be mocked easily.
I know this is no workaround but the cleaner solution. But I think old code should not be broken this way.

Hi @mvonrenteln,
I'm happy to hear you've figured out a different approach to achieving the query you were doing.
I was going to suggest such a solution myself at first too, as a dedicated query-model in your CQRS application makes sense from this perspective. In all, I'd typically suggest against wiring the EventStore or EventBus in a Saga for querying purposes.
Apart from that, the 'EventStore-Mock' you're talking about might not implement the EventBus interface, the EventStore interface however does. I'd guess that's very likely the culprit in this scenario. Additionally, you've noticed this change between 3.1 and 3.2 through commit  8146046, as that commit ensure that any registered resources will take precedence over the defaults.
Closing this issue, as the change is by design and your problem has been solved.


Performance degradation on Ubuntu 24.04

Describe the bug
It was reported that there was a 50% decrease in packet send rate in the latest LTS release of ubuntu. This issue is to take a look at that.
Environment:

OS: Ubuntu 24.04
Code Version: Unknown

I'm going to create a new VM with the latest Ubuntu to try to reproduce today.

It looks like the upgrade from 22.04 or 23.10 isn't working presently, so I can't use our template VM's. I need to read into how to create a VM in virsh from a .iso file directly. Might take a bit longer to investigate this...

I was able to test this on a VM running Ubuntu 24.04 and am not seeing performance degradation.
Ubuntu 23.10
 1:01 100% (0s left); send: 160291968 done (2.67 Mp/s avg); recv: 2091449 3.29 Kp/s (34.3 Kp/s avg); drops: 0 p/s (0 p/s avg); hitrate: 1.30%
Ubuntu 24.04
 1:01 100% (0s left); send: 167143616 done (2.79 Mp/s avg); recv: 2218044 3.60 Kp/s (36.3 Kp/s avg); drops: 0 p/s (0 p/s avg); hitrate: 1.33%


CLOUDSTACK-9369 Fixed Ldap regression

Ldap auto creation of accounts is broken due to the security fix for
CLOUDSTACK-9369.
There was an explicit check to not allow login incase the
user doesnt exist.  removed the same.

@rhtyd Can you review the fix?

@karuturi done, can you check Travis failure; push -f or close/reopen the PR to kick it again?

I am seeing the same Travis timeout on all the PRs. Will force push again

ping @rhtyd

We installed your jar file 4.9.2 with the changes and test the login. all thing work correctly. +1

LGTM.
@blueorangutan package

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-652


Issue reseting password after deploying to firebase

Hello,
I'm using firebase to deploy my vue 3 with vite-plugin-pages.
When trying to reset the password using firebase there is a generated link  that looks like that :https//ww.myapp.com/__/auth/action?mode=resetPassword***
I get a 404 when opening the page.
Is there anything that i can do to bypass the route check?
thanks a lot
Quentin

up

Normally when we use SPA you should redirect all path to index.html, that is the problem. so you should set redirect all path except /__/auth path in your web server settings.


Update usage from aiClient to chatClient in docs

I updated the usage of examples in the Spring AI API topic in the docs.
Thank you for taking time to contribute this pull request!
You might have already read the [contributor guide][1], but as a reminder, please make sure to:

Sign the contributor license agreement
Rebase your changes on the latest main branch and squash your commits
Add/Update unit tests as needed
Run a build and make sure all tests pass prior to submission

Thanks, much appreciated.


Build for iOS

Hi,
I finished my script to build the PDFium to iOS. All is here with manual patchs:
https://github.com/prsolucoes/mobile-pdfium
But i have some issues after compile. All issues is described here:
https://github.com/prsolucoes/mobile-pdfium/issues/1
Can you help me?

Hi,
It is working. If anyone wanna, it is building on travis and all instructions is here:
https://github.com/prsolucoes/mobile-pdfium
Thanks.

Hi,
You can get all here:
https://github.com/paulo-coutinho/pdfium-lib
Thanks.


Fix armv7-a SMP

Summary

This PR consists of the following 4 commits

commit1: arch: armv7-a: Fix style warnings in mmu.h
commit2: arch: armv7-a: Fix MMU settings for SDRAM in SMP mode

This commit fixes armv7-a deadlocks with D-cache in SMP mode.
In SMP mode, MMU for SDRAM area must be set to shareable

commit3: Update TODO and sabre-6quad/README.txt regarding SMP
commit4: boards: sabre-6quad: Add CONFIG_TESTING_GETPRIME=y to smp/defconfig

Impact

SMP only

Testing

Tested with sabre-6quad:smp (QEMU and dev board)

@patacongo
At last, I found root cause of the armv7-a SMP and D-cache issue and fixed it.

LGTM.


Modified the is_redirect method to check for code 300 server responses.

This is in reference to #66. I've attempted to simplify the check here by just looking at the server response as opposed to the previous battery, which could provide confusing feedback in certain cases.

I get what you're trying to do here, but this fundamentally changes what's being detected. Currently, pshtt's is_redirect method is trying to determine whether a domain's only purpose is to redirect away to some other domain -- in other words, if all endpoints redirect externally. This PR would cause pshtt to flag a domain if any of its endpoints redirect anywhere, and that's not desired.
This isn't common in most of the internet, but is very common in the USG for things like health campaigns or other awareness-raising issues. The shortness of .gov seems to serially tempt the White House and other agencies to brand an initiative as "something.gov" even if they plan to host it at a subdomain (for example, ethics.gov, and they want the "something.gov" to redirect you there.
This detection is useful for a number of things -- for HTTPS-tracking, we use it to give slightly different logic to conferring "Enforces HTTPS" if the domain is a redirect domain (we let its http:// endpoints immediately redirect to external https:// URLs, rather than first having to redirecting to one of its own https:// endpoints first).
The behavior you're flagging in #66, though, is definitely a bug:

The way is_redirect is currently written, a domain will get flagged as a redirect if all endpoints are down or otherwise code 400-ing. For example, imagine domain.tld, which only has its https endpoint up and happens to be returning for a 404 for its index. That will return true for is_redirect, which is confusing (and happening a bunch where I am).

I think we should add a conditional to the calculation that ensures that at least one of the endpoints is an external redirect. Something like:
# ...
  and (
    httpwww.redirect_eventually_to_external or
    http.redirect_eventually_to_external or
    httpswww.redirect_eventually_to_external or
    https.redirect_eventually_to_external
  )

Thoughts?

Moved resolution tracking to #66.


Add tables exclusion and inclusion at the schema creation level

Now, when filter added to the list of tables, Its filter only data copying process. The data schema needs to be responsive to the filter as well. To do this, you need to add arguments to the call of the command pg_dump
There are 2 steps with using pg_dump cli application.
https://github.com/datanymizer/datanymizer/blob/main/datanymizer_dumper/src/postgres/dumper.rs#L62
and
https://github.com/datanymizer/datanymizer/blob/main/datanymizer_dumper/src/postgres/dumper.rs#L134
Need to add inclusion and exclusion support to it.

[ ] Including
[ ] Excluding

I can take this one.

I can take this one.

Closed by #22 PR

Closed by #22 PR


Management Task missing from documentation

There is a MT named "Delete Aged Console Connection Data" which appears to be not documented here. Its description says "This task deletes aged console connection data from the site database."
It is present at least in 1706 and 1802.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 73746b8f-0bb3-a02c-fe91-85395fb33bdd
Version Independent ID: a7cee2bc-0b6e-e740-238b-9267c3cae370
Content: Reference for maintenance tasks - Configuration Manager
Content Source: sccm/core/servers/manage/reference-for-maintenance-tasks.md
Service: configuration-manager
GitHub Login: @aczechowski
Microsoft Alias: aaroncz

Thanks @MOn-STEr. Related to issue #486. I'm working with folks from Microsoft Premier to review and refresh the maintenance articles.

I revised this article, the change should publish live tomorrow


Cleanup css throughout entire site

Remove unnecessary css includes on each html file and eliminate unused css tags. Maybe there is a tool to help with this?

I agree. CSS is totally a mess right now!

I have attached my CSS report. The two major changes I would like to consider is adding a preprocessor and adopt a naming convention. I talk about both of these in the report in more detail. The report is heavily focused on good CSS principles to follow how we should implement them to improve the sites CSS architecture.
Makeability CSS Report.pdf

This is awesome Hank. Thank you for your work in clearly doing the
background research, exploring tools, writing up a thoughtful report, and
proposing a plan.
I would like to move forward with steps 1 and 2 in your proposal, which
include: "Run all CSS through a CSS analysis tool and fix errors" and "Find
and delete unused CSS." I think we should then engage in a larger
discussion about the other steps as they would require a pretty massive
rearchitecting of our current CSS and also require significant effort.
Jon
On Sat, Feb 9, 2019 at 6:32 PM Hank Tadeusiak<EMAIL_ADDRESS>wrote:

I have attached my CSS report. The two major changes I would like to
consider is adding a preprocessor and adopt a naming convention. I talk
about both of these in the report in more detail. The report is heavily
focused on good CSS principles to follow how we should implement them to
improve the sites CSS architecture.
Makeability CSS Report.pdf
https://github.com/jonfroehlich/makeabilitylabwebsite/files/2848464/Makeability.CSS.Report.pdf
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/jonfroehlich/makeabilitylabwebsite/issues/664#issuecomment-462098062,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABi-9fDSTb_6pzAM-E9EBNBOxd8pc2DJks5vL4TMgaJpZM4Xa22h
.

--
Jon Froehlich
Associate Professor
Paul G. Allen School of Computer Science & Engineering
University of Washington
http://www.cs.umd.edu/~jonf/
http://makeabilitylab.io
@jonfroehlich https://twitter.com/jonfroehlich - Twitter

Thank you for compiling this Hank! I learned from reading your report :)
On Sun, Feb 10, 2019 at 6:36 AM Jon Froehlich<EMAIL_ADDRESS>wrote:

This is awesome Hank. Thank you for your work in clearly doing the
background research, exploring tools, writing up a thoughtful report, and
proposing a plan.
I would like to move forward with steps 1 and 2 in your proposal, which
include: "Run all CSS through a CSS analysis tool and fix errors" and "Find
and delete unused CSS." I think we should then engage in a larger
discussion about the other steps as they would require a pretty massive
rearchitecting of our current CSS and also require significant effort.
Jon
On Sat, Feb 9, 2019 at 6:32 PM Hank Tadeusiak<EMAIL_ADDRESS>wrote:

I have attached my CSS report. The two major changes I would like to
consider is adding a preprocessor and adopt a naming convention. I talk
about both of these in the report in more detail. The report is heavily
focused on good CSS principles to follow how we should implement them to
improve the sites CSS architecture.
Makeability CSS Report.pdf
<
https://github.com/jonfroehlich/makeabilitylabwebsite/files/2848464/Makeability.CSS.Report.pdf
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
<
https://github.com/jonfroehlich/makeabilitylabwebsite/issues/664#issuecomment-462098062
,
or mute the thread
<
https://github.com/notifications/unsubscribe-auth/ABi-9fDSTb_6pzAM-E9EBNBOxd8pc2DJks5vL4TMgaJpZM4Xa22h
.

--
Jon Froehlich
Associate Professor
Paul G. Allen School of Computer Science & Engineering
University of Washington
http://www.cs.umd.edu/~jonf/
http://makeabilitylab.io
@jonfroehlich https://twitter.com/jonfroehlich - Twitter
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/jonfroehlich/makeabilitylabwebsite/issues/664#issuecomment-462137990,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ALGPL91SL-dbX2LkrsWhzWyVkQmNiUIWks5vMC6LgaJpZM4Xa22h
.

Thanks. Would you like me to go through the bootstrap CSS files as well and take out all unused CSS. Or keep it strictly to our CSS files?

Strictly to ours for now
Sent from my iPhone

On Feb 11, 2019, at 2:15 PM, Hank Tadeusiak<EMAIL_ADDRESS>wrote:
Thanks. Would you like me to go through the bootstrap CSS files as well and take out all unused CSS. Or keep it strictly to our CSS files?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

I am un-assigning myself from this after speaking with Jon. All that has been done is (1) any unnecessary css selectors were removed;(2) the format of the CSS files were updated. They are now formatted to 2 space indenting and a line between each selector.
Going forward, I would refer to the pdf I have attached. It has proposed steps explaining them in detail. Then next step would 3 in the document. 3, 4, 5, and 6 are all related and should be down around the same time. This is a fairly big task considering how much CSS there is on the website since it would require to rename/restructure most of it.
Everything I have learned while assigned to this is in the attached pdf.
Makeability.CSS.Report.pdf

Chrome has a CSS audit tool (type ctrl-shift-p or cmd-shift-p to enable).

Yikes, we scored an F 0/100 on yellowlab.tools audit!


Removed decision shown in assembly source tree

When I delete a decision from the source tree in the assembly it is gone.
But when I close the source tree on some higher node and reopen it the decision show up again.
Deleting it once more causes a 404 - so it in already gone in the db and just a rendering problem
https://data.dev.catalogue.life/catalogue/3/assembly?assemblyTaxonKey=9d98b9e8-10a5-4bc7-80cb-5ca3b1e883de&datasetKey=1011&sourceTaxonKey=xA

Ah, the UI used a wrong URL:

URL: https://api.dev.catalogue.life/dataset/3decision/10


Model.update should accept $inc, $pull, and friends

Right now its $set only and you have to use the underlying collection for anything else. It should still be smart about default values / casting etc.
see also http://groups.google.com/group/mongoose-orm/browse_thread/thread/662d20d60487ab0e

db.mf.update({},{'$pull':{'children':{'code':'SystemLogManager'}}},function(err){
...
})
mongodb OK!
mongoose  Fail!
why???
var Modulechildrenchema = new Schema({
code			:	String,
name			:	String,
funName			:	String,
menuFlag		:	Boolean,
description		:	String,
status			:	Boolean	,
ico				:   String,
children		:	[functionM],
});

@stevenxie can you retry with latest in master? I just rewrote the update method.


Pass CommandContext to getWsClient and getDynamicClientFactory methods.

Fixes https://issues.jboss.org/browse/JBPM-4655

merged into master, thanks @DuncanDoyle


Add and use snmalloc, mimalloc for allocation performance

Description of the new feature/enhancement

Github randomly revealed a project from Microsoft that upon investigation seems like it would be pretty useful here to possibly boost performance for allocations. https://github.com/microsoft/snmalloc
Proposed technical implementation details (optional)

https://github.com/microsoft/mimalloc is more general purpose while snmalloc is for message-passing specifically. Use both as needed in places where allocations need to occur and not simply removed.

So it looks all we need to do here is add it to the build steps. https://github.com/contour-terminal/contour/pull/341/ shows how it's done for cmake. MSVC makes it bit more difficult as you need to ensure build steps are done properly in order and while I'd like to take a stab at this, I'm concerned about messing the build up trying to add this. I'd start with mimalloc first in this case and follow all of it's recommendations for flags for C++:

For best performance in C++ programs, it is also recommended to override the global new and delete operators. For convience, mimalloc provides mimalloc-new-delete.h which does this for you -- just include it in a single(!) source file in your project. In C++, mimalloc also provides the mi_stl_allocator struct which implements the std::allocator interface.

Also see https://github.com/microsoft/mimalloc#override-on-windows for Windows specific optimizing.

@skyline75489 Are you comfortable with messing with the build steps to see how much of a boost we get in Process Explorer?

Chester is unfortunately currently already preoccupied.
Since the benefits in Contour were rather significant I'll look into this in his stead.


How to reproduce the architecture of this article

Hi @zhouhuan-hust ,
I am very interested in this paper.
Can you tell me how to reproduce it?
Thank you. I appreciate it
Jacky

Hello Jacky, thank you for your attention. I'll sort out my code and upload it shortly.

Thank you very much. I appreciate it.


orbit shape terms

abnormal orbit shape (child of abnormal orbit morphology MP:0010030)
DEF: any anomaly in the characteristic surface outline or contour of the orbits of an organism
SYN: orbit shape abnormalities
SYN: abnormal eye socket shape
round orbits
DEF: orbits have a more circular, rather than oval, appearance
SYN: round eye sockets
SYN: rounded eye sockets
SYN: rounded orbits
SYN: circular orbits
SYN: circular eye sockets
Annotations in J:237903, J:238326

abnormal orbit shape MP:0030103
round orbits MP:0030104


Has development stopped?

The repo was last updated a long time ago yet the android app was updated just this month.

I've made this point before, but updating the repo seems very low priority.
Chris
chris_debian

I'm not sure what that means. I just discovered this and have no history of what went down. A link in the README could help, or if this opensource version has been abandoned, archiving the repo would help indicate that.

It means they are not focused on keeping the repo up to date with what's actually published. They are still working on the project but they work primarily behind the scenes. Even getting support for platform-breaking issues can sometimes take months, it's not abandoned but the repo not likely to be updated any time soon.

I'm unclear about the way forward. As a long time (1998) user/ sys admin/ Information Architect, I know the importance of open source software, and the role of the developer AND the user.
If the developers aren't sufficiently resourced to publish the source code, then it's worrying because they could potentially be contravening the open source license.
I feel like I am contributing a lot of imagery, potentially for financial gain, by Grab, and also use by OSM, and it feels like the contributors are being forgotten about. I suspect like OpenStreetCam and OpenStreetView, and now Kartaview, this software is likely to be forked,
https://wiki.openstreetmap.org/wiki/KartaView
and users will move (using automated tooling, again) contributions to a new repository, like they did when Mapillary was acquired by Facebook.
Kartaview contributors are content for imagery to be used for commercial gain, but I think most are motivated by the support the imagery gives to OSM. It feels like the community is losing patience.
Can Grab/ Kartaview please clarify the current situation, so the contributors can make a decision about whether they should continue to support this endeavour?
I'm disappointed to be writing this, but some clarification is needed.
Chris
chris_debian

I've gone through this process with them like 3 or 4 times... Eventually, someone sees and responds and we hear about how the major rework is just around the corner, this time for real, and then they go dark for 6 months until the processing server crashes again and they are forced to come back for 15 minutes.
The app doesn't work on my pixel 6 and they killed the waylens project during one fo the acquisitions so as it stands I have no longer been able to contribute.
It sucks considering I've uploaded something like 43000mi/70000km worth of imagery but at this point, I can't even tell you what that number is because the site doesn't actually work anymore!

Our options are to start tagging random people who have in the past responded, and maybe get a response and have a little back and forth dialogue for a day or so then return to nothing or give up.

I just checked, and I can see my contributions:
https://kartaview.org/user/chris_debian
but besides that, I agree with your comments.
Chris

Yeah I forgot that it takes a while to show anything on my profile

Yeah, these responses really don't make me want to create an account and contribute any data. It seems like "opensource" is kind of loosely applies here without much transparency.

Since there is no answer, perhaps what we should do is find out how to export our data to preserve it for the next project or to put it online somewhere else.

@retiolus I get what you're saying, but am not sure whether a similar project exists, that could better maintain and publish the open source software, and have a use for the imagery. Removing the commercial element, is it possible, I wonder, to just use the imagery for OSM and associated projects. If the commercial element isn't working, can we just forget about it?
Anyone have any thoughts?
Chris
chris_debian

There was https://github.com/Streets-Data-Collaborative/osc-tools but unfortunately it appears I was the last one to commit to it and it hasn't been updated for the new site... I can look into it for archival purposes this week but I would really appreciate a staff member/maintainer responding to us...

@miruna-craciun @zhangtiedong0912 @chip-grab @zhaitianduo If any of you guys are still active on this project and able to respond to user concerns we would appreciate it.

@joeybab3 Good call. Maybe after a period, the main OSM mailing lists could be contacted, and this issue described briefly. This could be a way to raise awareness and give various stakeholders a chance to respond.
The submitted data is open, and commercial entities are free to use it, but the community also expects code to be published and to maintain a relationship with the community.
Grab, please reach out, you can make this better.
Chris
chris_debian

Personally I've just downgraded to the last open source release, as I'm slowly purging non free code from my phone, as far as possible at least.
Contacting the OSM mailing list seems like a good last resort. It's been over a year now since anything was published here, but the app has seen updates, so it seems worth doing.

Is anyone in this conversation from Grab/ developers?
Chris
chris_debian

Personally I've just downgraded to the last open source release

Was that the last version they released, rather than the one on Play?
Cheers,
Chris
chris_debian

Is anyone in this conversation from Grab/ developers?
Chris chris_debian

The people I tagged above are those I know that have/currently work on the project. Last time I got someone to respond by borderline harassing grab on twitter but I'd prefer not to do that again.

Completely understand @joeybab3 ; I noted that you'd referenced earlier contacts. It just seems weird that the company/ developers aren't communicating.

I've been contributing to this project for several years, for them to go months with major issues and not respond is quite par for course at this point. At least the server is still running, they had an issue where tracks didn't process for well over a month and there is no way to contact them when that happens.

Yes, by "the last open source release" I meant the latest one available from the releases section of this repo.

I'm not sure what that means. I discovered this app yesterday while looking for an opensource alternative to Mapillary which was bought by Facebook. This app isn't on F-Droid, so a little harder to retrieve by degoogled phones.
If the app isn't opensource anymore, maybe the repo should be archived. A link to the stuff you "said before" might be useful in the read me regardless of archive status, since new people like me have no idea what's going on.

I'm not sure what that means. I discovered this app yesterday while looking for an opensource alternative to Mapillary which was bought by Facebook. This app isn't on F-Droid, so a little harder to retrieve by degoogled phones. If the app isn't opensource anymore, maybe the repo should be archived. A link to the stuff you "said before" might be useful in the read me regardless of archive status, since new people like me have no idea what's going on.

There's not much to say/link. There are lots of short 1-5 comment dialogue bits spread around the various repos they have here and it all nets the same result. We've asked them(grab/telenav) to help us/update/fix things and they claim they will and then nothing happens.
If you don't want to use google play then go to the releases section of this repo and download the apk, but everyone responding to you here is just a user, we can't make them put it on FDroid or update this repo.

To put it simply, no, development hasn’t stopped for KartaView. Historically speaking, we have addressed numerous requests here on Github (especially where we noticed an interest on the community's end), and have always been focused on improvements our community sought. Naturally, there are certain aspects that require a larger bandwidth, which we don’t have at the moment.
However, if we see a desire to replicate parts of KartaView in your projects or support compilation initiatives, please reach out to us and we’ll act on it. Additionally, if there are features or tools that might spike interest but you need backup on set-up or handling certain requests, do reach out to<EMAIL_ADDRESS>

@miruna-craciun
Thank you for taking the time to reach out and respond to this thread. Simply put, I think the community would be somewhat happier if you (grabtaxi) could regularly 'push'/ publish the code for the latest release of the Kartaview application. This is a basic requirement of most open source licenses. If this isn't done, you (grabtaxi) are potentially in breach of the license, and are alienating the community that provides the imagery data that you want. I think it's just a question of being open.
These are just my thoughts, and I don't profess to represent the user community at large.
Thanks, again.
Chris
chris_debian

Anyone has a solution to export Kartaview data for the moment?

I don't, but haven't tried.
For the moment, I have decided to uninstall it, until the situation improves - I never open it anyway.

It would be ironic if we had to reverse engineer the API of a supposedly opensource app, wouldn't it?

At an undefined point in the future, when I have time and some more relevant-to-android skills, I'd be up for that.
Best solution is really to avoid the duplication of effort if possible, though.

@brmonaghan Bryce, could you DM me, I couldn't see how to.
Cheers,
Chris

Ahh, maybe it's not possible :-). I'll try to post my thoughts here.
Chris

Hi, all.
Just read about Mapilio, based on the open source code of Mapillary. Now to work out a way to move my imagery from KV.
mapilio
https://mapilio.com/app
https://mapilio.com/terms
https://mapilio.com/licenses
It is an app that is based on the open source of Mapillary. It is a project that is starting so it is promising, but it does not have many photos in its repository
Fingers crossed.
Chris

@brmonaghan Are you installing from Play?
https://play.google.com/store/apps/details?id=com.mapilio.app

Mapilio hasn't opensourced their server code from what I can see. https://github.com/mapilio
The important thing they opensourced is their mapilio-kit.

Mapilio Kit is a library for processing and uploading images to Mapilio.

It doesn't seem like a better option than Mapillary or any other proprietary service.

It's maintained.
Chris

It's maintained.

What is maintained?
Unless I'm missing something, https://github.com/orgs/mapilio/repositories does not even have a repository for android code? Kartaview android code in this repository seems outdated and has other problems as noted, but the Mapilio does not seem to have anything published? Surely "nothing" is even worse that "outdated" ?

Hi, all.
I've had some clarification from the Mapilio Devs.
https://forum.mapilio.com/t/where-is-the-open-source-mapilio-android-app-hosted/112/2
In essence, because the app is still in beta, they are not yet able to publish the code for the Android app. My main concern is that the imagery is covered by the Creative Commons license, and ownership remains with the person who captured the imagery, so this is a good thing.
I'm encouraged by what Mapilio is doing, but I can see why contributors may stick with Mapillary and KV. I'll monitor the situation, and see how it is giving back to the community. For me, I need an app that works, gives back to OSM, and has a two-way relationship with the community.
I hope this helps
Chris | chris_debian

(ref. Mapilio not being opensource and other issues: https://github.com/kartaview/android/issues/188#issuecomment-1507127472)

"However, we believe that keeping our software proprietary allows us to maintain a level of control over our development process and ensure the quality of our products."

Thanks for forwarding that, @retiolus . As I feared from their initial response, they are not interested in open source community at all, but would only prefer that mappers do work for them for free, while they profit without providing anything in return to that community.
I think they've thus set themselves up to fail - as basically only card with which you can have a chance playing against Facebook is to be open, use FOSS and respect privacy and thus gather all that community that wants open alternative to Facebook/Mapillary. And they've decided to throw away that card. But hey, it is their business, so they should be able to choose how to run (or ruin) it...
Anyway, nothing interesting for OSM community over there at Mapilio, move along...  Too bad. :disappointed:

Sadly, I suspect you're right :-(
Chris

Hi, all.
I've just been adding some information to the OSM Wiki, and specifically to an existing table, which compares different features of clients such as KartaView. Have a look if you get a moment, and obviously, if you're able to fill in any gaps, please do.
Many thanks,
Chris.


Setup.sh failed on Powerwall IP and password substitution

This was so timely. I have 2 PW+ and just set up the dashboard last night. Originally I noticed that only one PW was supported and then magically support for additional PW appeared by the time I got to doing this. I had made local changes to add the CQ for additional strings but then discarded them once I saw this. I have A, B, A1, B1 strings active and showing nicely on the dashboard.
Oh, one more thing. The setup.sh failed for me when it tried to substitute the PW ip and password. Unfortunately I do not have the output of the script. I am running on RPI 4b+.
Also, I was previously running the mihailescu2m version and I was able to seamlessly migrate to this dashboard without losing my historic data.

Originally posted by @nhasan in https://github.com/jasonacox/Powerwall-Dashboard/issues/2#issuecomment-1046269018

@nhasan On the setup.sh failure - the setup.sh script is using simple substitution with sed :
sed -i .bak "s/password/${PASSWORD}/g" powerwall.yml
sed -i .bak<EMAIL_ADDRESS>powerwall.yml
sed -i .bak "s/<IP_ADDRESS>/${IP}/g" powerwall.yml

If the user inputs for PASSWORD, EMAIL or IP contain the "/" character, it will fail.  Other escape characters could also cause problem.  I need to implement a more robust substitution method. Any thoughts?
Thanks for the feedback and raising the issue.

I tried to recreate this and found the root cause.
"sed -i .bak" fails due the space between option and the suffix. "sed -i.bak" works flawlessly.
As per the man page below, there is no space expected as well.
-i[SUFFIX], --in-place[=SUFFIX]

I believe this happened to me as well. I had to correct the file after running the script.

Thank you!  You are right.  Surprisingly it works on MacOS (with space or not) which is my test platform but fails on linux.  I'll push the fix.

Most people are going to use this on a Raspberry Pi. So it would make more sense to make that your test platform. Thanks for pypowerwall and this dashboard BTW. Very useful tools.

I agree @nhasan .  I now have a project today to spin up a spare RPi as a test node. :)
Thanks for feedback and kind note.  By the way, with pypowerwall proxy in your stack, you can query it to get raw data (read only) from the Powerwall API including some aggregate functions you might find useful for other projects (I use this for ESP32 driven displays for example).  Replace localhost with your RPi address:

pyPowerwall stats:  http://localhost:8675/stats
Powerwall firmware version and uptime: http://localhost:8675/api/status
Powerwall temperatures: http://localhost:8675/temps
Powerwall device vitals: http://localhost:8675/vitals
Powerwall strings: http://localhost:8675/strings
Key power data in CSV format (grid, home, solar, battery, batterylevel): http://localhost:8675/csv

I should add these to the readme.

I agree @nhasan . I now have a project today to spin up a spare RPi as a test node. :)
Thanks for feedback and kind note. By the way, with pypowerwall proxy in your stack, you can query it to get raw data (read only) from the Powerwall API including some aggregate functions you might find useful for other projects (I use this for ESP32 driven displays for example). Replace localhost with your RPi address:

pyPowerwall stats:  http://localhost:8675/stats
Powerwall firmware version and uptime: http://localhost:8675/api/status
Powerwall temperatures: http://localhost:8675/temps
Powerwall device vitals: http://localhost:8675/vitals
Powerwall strings: http://localhost:8675/strings
Key power data in CSV format (grid, home, solar, battery, batterylevel): http://localhost:8675/csv

I should add these to the readme.

This is awesome!

I am using Ubuntu 20.04.4 LTS in a VM on my home server. All out of RPi's and they are really hard to get right now!

I erased my virtual machine and installed from scratch last night with your latest updates. I am using Ubuntu Server 20.04.4 LTS.
The updated install script worked perfect.
The only issue I had was if you run git clone as 'sudo' you end up having permission errors with Grafana. I started over and ran git without 'sudo' and everything worked perfect. The install script need 'sudo' but not the initial git command. This may be obvious to the more experienced, but I am always surprised sometimes when 'sudo' ends up breaking something.
The dashboard updates are really nice. Thanks for all the work you have done on this.

Thank for testing this @cwagz !   I'm so glad you got it working and love the screengrab!  FWIW, I also did testing on my Raspberry Pi 4 (32-bit Debian Bullseye), Ubuntu and MacOS (M1).
On the issue you mention, you should not need to run 'sudo' for any of the steps.  I suspect your user is not part of the 'docker' group which is why the setup script required it.  If you run docker ps and get a permission error, that means your local user needs to be added to the docker group which can be fixed by:
sudo usermod -aG docker $USER

You may need to log out or reboot for that to take effect (see docker setup notes).  I'll add a note to the readme to help with that.
I do have a favor to ask... and ok to say no! :)  I would love to showcase your dashboard (the same section you posted above) on the readme to highlight the Inverter Power graph with two inverters.  Would you be willing to get a snapshot of a full 24hr cycle and upload it here for me to post?
Thanks again for your help.

I will upload some clean screenshots sometime tomorrow afternoon. They should be free of gaps now that I am on ethernet. I also will add my user to the docker group. Thank you.

Awesome!  Thanks again.  And good job on getting the ethernet run.  I put a note in the readme about 'sudo' and the docker tips in the troubleshooting section.  Good find.

I made a minor adjustment to dashboard.json to group the "string" graphs into what Grafana calls a "Row" that I labeled "Powerwall+".  There are now 3 rows: Live Monitoring, Monthly Analysis and Powerwall+.  It allows for collapsing and moving them around a bit easier.  If anyone wants to try it, you should be able to import just the dashboard.json.
BTW, in the jagged graph I posted you can tell we had good cloud cover here in Valencia.  The spikes to 6.5kW were due to the intriguing "cloud lensing" effect.  I'm thoroughly enjoying having solar and tweaking our Tesla Solar system. ;)

Cloudy day out here in Temecula as well. Should I wait for a solid 24-hour period with a sunny day before taking a screen grab for you?

Oh yes!  No rush.  It would be better to get a typical full graph.  If you can, when you do have a good example to screenshot, make the browser window narrow so that it is a bit easier to read (e.g. text size - similar to the one I posted above)?   Thanks again for your help!

The dashboard is working great. Thank you again.
I just disabled the strings that are not active on my system:

It turns out I have 7.56kW of panels installed on Inverter1 and 4.62kW of panels installed on Inverter2. I assume this will work out fine. I did hit 7.4kw on Inverter1 due to cloud lensing the other day. The chart above was for today and is much more normal. I still have some large trees that are shading my roof during different parts of the day. This should be gone soon as the sun ends up higher in the sky. Today is also the first day that I have produced more power than we will use.
I am going to move everything over from my VM server to an APU2 I had laying around.

Thank you @cwagz !   I updated the main page to include your example graphs but left my monthly graphs to give people an idea of how it will eventually populate: https://github.com/jasonacox/Powerwall-Dashboard
Thanks so much!!  This looks good.
I am wondering what other trending data may be interesting to the community.  I am currently pulling in all the vitals data in a splunk instance, specifically frequency, current, voltage.   Do you think any of these would be interesting to add to the dashboard?  Or perhaps others?

Before we got PTO my tankless water heater errored out several times with a code that basically said check power condition. Or loose PCB connection. I believe this was related to the battery in the Powerwall filling up and increasing the frequency on the house to 65Hz to turn off any non-Tesla solar inverters. Now that we have PTO the system just exports power, so this has not been an issue.
Even with that said I would actually find it very interesting to track all this data down in the area where the strings are. Or in its own panel below the strings. It could definitely come in handy when trying to troubleshoot a strange problem like I described above.
On another note: What do you think the storage requirements will end up being for all of this data? I have a 500GB SSD in my APU2 so I am not that worried about it, but I would like to keep several years of data if possible. It will be great for seeing how the system is aging.

Thanks!   That's a great example.  I'll see about getting those added.
As for space, I have data for 5 months and current InfluxDB is at 102MB.  Assuming linear, that means 1 year would be ~250MB/yr, so you will be in good shape.  However, that does make we wonder.  The default setup has InfluxDB retaining data for 2 years (730d).  We may want to update that to 10y or 25y to align with the expected life of the system considering the data footprint is so reasonable.
docker exec -it influxdb influx

ALTER RETENTION POLICY autogen ON powerwall duration 9125d
ALTER RETENTION POLICY strings ON powerwall duration 9125d replication 1
ALTER RETENTION POLICY pwtemps ON powerwall duration 9125d replication 1


Can’t be used with my iPad

Nice job!
But I’m trying to enable it on my iPad,unfortunately it doesn’t work. When I’m enabling it, it says “fail to load plugin pseudocode-in-obs”.

That's weird. I've tested on my iPad and if without preamble file toggled on, it works fine. This "failed to load xx" is triggered by Obsidian itself. Can you try to uninstall and reinstall Obsidian on your iPad? Or if you can open the dev panel to see if there's more info.

I‘ve just reinstalled the plugin and Obsidian, but I still received the same problem. I also refer to some related problems (such as remotely-save ca't be used in ios), and I imitated their solutions, hoping to solve my problem, unfortunately it still didn't work. Can you tell me your version of Obsidian and your plugin? I just want to know if it's the problem of my version.

Here is my version:

And it's working.
I am using official "Sync" for all data and plugin settings, maybe it'll make a difference. But I've never received the "Failed to load" notice.


Add change bottom bar index

Add an action which allowed us to change the current index of bottom bar
Add a mixin

format code
flutter format lib test example

@J-apparence format code
flutter format lib test example

Done

Codecov Report

Merging #1 (0819db9) into master (05f81c0) will increase coverage by 0.26%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master       #1      +/-   ##
==========================================
+ Coverage   96.06%   96.33%   +0.26%
==========================================
  Files           6        6
  Lines         178      191      +13
==========================================
+ Hits          171      184      +13
  Misses          7        7

Impacted Files
Coverage Δ

lib/bart/bart_scaffold.dart
100.00% <100.00%> (ø)

lib/bart/bottom_bar.dart
94.82% <100.00%> (+0.48%)
:arrow_up:

lib/bart/router_delegate.dart
91.30% <100.00%> (+1.56%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 05f81c0...0819db9. Read the comment docs.


How do I get an authorization token to use with this tool?

I'd prefer not to use my password on the command line with --password.  Is there external documentation I can read about how to do this quickly and easily (not a developer guide for how to set up an app to do this)?

See here: https://docs.github.com/en/github/authenticating-to-github/creating-a-personal-access-token
I will add a note to the README


Reorganized the error structure in Orbit.from_body_ephem().

The structure for the error raised while trying to obtain orbit of pluto and moon from ephemeris data has been changed. References Issue#401

Done!

Thanks @vedang08!


Add support for modules to require inherent to be present

This adds an additional function is_inherent_required to ProvideInherent trait. If a module implement this, it indicates that based on its interpretation of InherentData, an inherent of this module call type must be present in the current block.
This is particularly useful for pallets like anyupgrade for deliberate runtime hard forks. In those cases, the InherentData checks for block numbers, and if the block number is the current block, it requires an inherent to be present so that the hard fork code can be enacted.

Not sure how this anyupgrade pallet works, but how what would this Inherent do?

@bkchr The inherent is basically a sudo command. By default, the consensus/runtime rejects any inherent submitted to anyupgrade. With specific InherentData, particular sudo commands (with specific call data) are allowed at specific block heights. This is how it implements "hard forks".

Why isn't the hard fork initiated by some on-chain call?

@bkchr What type of on-chain call? Do you suggest using signed extrinsic instead of inherent?

Yeah, I would have assumed that the Governance issues a new runtime upgrade that reflects the hard fork.
Anything that could be executed by anyupgrader, should be call-able by the Governance as well?

@bkchr Who would be that "Governance" though? By design hard forks are user-initiated (not majority vote, not democracy, etc), so I currently haven't been able to think of a way to design that module while also keeping it to be "hard fork".

But it would require that the anyupgrade pallet is present? Which means that it requires that the Governance before accepted an update which adds this pallet.
If you as a user (group) want to hard fork, why not take the state at a given point and build a genesis out of it?

Wouldn't including anyupgrade in genesis runtime just work? Why would there be Governance required to add it?

If you as a user (group) want to hard fork, why not take the state at a given point and build a genesis out of it?

It's not trivial to support a complete version of this. The simple approach will assume that the hard fork point is finalized, which for most of the time is not the case. The complete approach will require the node to support building genesis state on the fly and also support having multiple genesis blocks on the same chain (because there may be multiple hard fork blocks). Besides, not all states can be easily transferred.

Inherents are only verified by block producers, so this still won't be a "hard-fork" module. Rather it will just be a validators-plutarchy module, which could be done better with an on-chain voting mechanism.
Hard-forking doesn't need any runtime support by definition.

@gavofyork Does block import / versifier handles inherent verification? https://github.com/paritytech/substrate/blob/master/client/consensus/babe/src/lib.rs#L725

(I discussed with @gavofyork on the hard fork issue and decided to write anyupgrade using block digests. Still, this PR isn't actually entirely about anyupgrade or hard forks, so I think it's useful to get it merged.)


feat: Collecting anonymous user statistics

Hi 🙋♂
I've been working on an implementation to collect anonymous user statistics, which are being visualized giving insights on how Stryker is being used.
When executing stryker init there's a new option at which a user can allow that Stryker will or will not collect and send the statistics. When this is allowed and Stryker is running, user statistics are being collected within the Stryker class and send to an Azure Function in a new class Statistics. Within Azure the statistics are processed and send to a database in MongoDB Atlas. I've been able to create these two dashboards (note that this is test data):

https://charts.mongodb.com/charts-project-0-yurnw/public/dashboards/9fe96c7a-d427-4bd9-a677-fdc0356f8732
https://charts.mongodb.com/charts-project-0-yurnw/public/dashboards/5f30c2da-172c-4991-bd2f-183e94725689

The code is not finished and needs some improvements, which includes (atleast) these two:

Filtering the errormessage that's being send is a string that can occasionally include the user's folder tree at which the error occurs.
The Statistics Class could be an Singleton object, which adds the option to add statistics any where within the process.

I hope you can use this further on.

@Jelle28 Based on some discussion, we've decided the following:

Your research report is the most valuable for us. It'll be used as the main document to decide on what statistics we want to collect and how to do it.
The focus is still on opt-out collecting. We'll take another look at privacy for error messages and test frameworks, as both are quite dynamic.
This PR will be closed for now. When we pick this up in the future we can use your code as a base to go on, but as is it's a little difficult to directly merge this (look at the merge conflicts already here, for example).

Thanks for the work you put in @Jelle28. We'll definitely work on this in 2020. Probably start smaller and build up in sever PR's


client method for getting write channel blockblob

Adds the missing API on BlockBlobClient to actually get the block blob SeekableByteChannel in write mode.
A few changes alongside API addition:

Limits public API WriteMode selection to just OVERWRITE. Left the implementation in for other modes but did not publicly expose.
Moves class that exposes write modes to mirror file share API.
Small javadoc correction.

API change check
APIView has identified API level changes in this PR and created following API reviews.
azure-storage-blob


⚠ Bofrost.at has degraded performance

In 527c462, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 1382 ms

Resolved: Bofrost.at performance has improved in 2f1064b.


Enhance the UI of project cards

The project cards look a bit bland. I can improve its UI and make it match the aesthetic of the website. Please assign it to me under GSSOC'23.

Are you still up for this?

Yes, sure. Thank you.

Hey @AnirudhPanda  I would like to kindly bring to your attention that an issue was raised by a contributor on May 20th. As of today, June 24th, it has come to my notice that no progress has been made regarding this matter. I am genuinely eager to take on this task and make the necessary modifications. Therefore, I kindly request you to assign it to me, as I assure you that I will complete it as soon as possible.

@Nishitbaria I was busy with some prior arrangements but I have started working on it and thus would like to keep the issue assigned to me. Thank you.

no problem @nishita2104 happy hacking ⚡


Default to a stable python release when running scripts.

Codecov Report
Base: 28.70% // Head: 28.70% // No change to project coverage :thumbsup:

Coverage data is based on head (91602cc) compared to base (4dc4a95).
Patch has no changes to coverable lines.

Additional details and impacted files
@@           Coverage Diff           @@
##           stable    #1020   +/-   ##
=======================================
  Coverage   28.70%   28.70%
=======================================
  Files          72       72
  Lines        5852     5852
  Branches      306      306
=======================================
  Hits         1680     1680
  Misses       4109     4109
  Partials       63       63

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


Add an optional ESLint config

While I'm ok with modifying my .eslintrc, I think it'd be cool for an option with the ESLint opt-in to configure it yourself, similar to this image:

vue-cli is agnostic to the stuff that templates decide to ask and generate, so you should probbably request this in the repository fo the template you want this for, maybe https://github.com/vuejs-templates/webpack


⚠ Bofrost.at has degraded performance

In 19f107d, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 1506 ms

Resolved: Bofrost.at performance has improved in bc3437d after 6 minutes.


Performance counter viewer: Capture counters crash

Description
When I load a capture that contains a compute pipeline, and attempt to fetch counters in the performance counter viewer, the application crashes (not responding).
For testing, I used one of the official Khronos samples: Compute shader N-Body simulation https://github.com/KhronosGroup/Vulkan-Samples).
As well as a sample from Sascha Willems' older vulkan samples repo (https://github.com/SaschaWillems/Vulkan): cloth simulation
Steps to reproduce

Launch application for capture:
Exe path: <path_to_vulkan_samples_exe>
Working Directory: <path_to_vulkan_samples_root>
Command-line arguments: sample compute_nbody
Take the capture
Go to performance counter viewer, click capture counters, select all generic counters, and press sample counters.

For your convenience, I have emailed you the compute shader n-body simulation capture.
Environment

RenderDoc version: 1.22 (tried 1.24 too)
Operating System: Windows 11
Graphics API: Vulkan
GPU: RTX 3060 TI

It looks like this only happens when you have command buffers on a compute-only queue. Compute dispatches on a normal graphics queue work fine with the counters. I'll look into fixing this, but if you avoid compute-only queues that would be a workaround in the meantime.

That commit should fix the issue, though unfortunately it seems there's a driver bug on NV that causes a device lost error (may easily manifest in an infinite progress bar fetching counters). It's been reported to NV and should hopefully be fixed in the next vulkan developer driver.


The meaning seems to lie in renaming existing work, even almost cloning existing codebase. Directly undermining the double-blind rule of conference submissions

I've browsed this repo and the corresponding arXiv. It seems like a manuscript of a course assignment level. The entire work can be regarded as an ablation experiment.
It is also a very confusing to disclose their submission status (CVPR 24), before the reviewing stage.

In this work, we explored and found that SNN VAE is robust to the spike order of the latent vector, and accordingly proposed a simpler and more direct sampling method.
Thank you for reminding us that we have hidden the submission status of this work.


Fix INotifyCollectionChanged link and clarify it can be used from C++ in more places

Redo of #123. Original PR comment follows.
Follow up to https://github.com/MicrosoftDocs/winui-api/pull/122. Fixes the broken link. When I first made the previous PR, I assumed it was WASDK docs, in which case the link would be correct. But it's not.
Also fixes more place where INCC is mentioned as .NET only.

@sylveon : Thanks for your contribution! The author(s) have been notified to review your proposed change.

@sylveon - thank you for submitting this PR!
@jwmsft - Can you review?
IMPORTANT: When this content is ready to merge, you must add #sign-off in a comment or the approval may get overlooked.
#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

@Jak-MS @jwmsft any updates?


Use DEFAULT_URI_TEMPLATE if not exists hostname

Anyone?

Hello @jamesls,
Could you please take a look at this PR?
Thank you!

it seems to me that this is a mistake and needs to be fixed

Hi @shadchin,
It doesn't look like this PR was ever tied to an issue or provided context on the change. There shouldn't be a case where hostname isn't populated in a normal region resolution flow. If that is the case, we'd need more information on how that state is being reached. The proposal here, seems reasonable in the context of the code at the time, but doesn't match the current state of botocore. Specifically, hostname as a variable no longer exists.
We're going to close this for now, but please feel free to open an issue with an explanation of how you're encountering this issue and we can talk through options. Thanks!


ROCm miopenStatusInternalError /MIOpen/src/sqlite_db.cpp:109: open memvfs: unable to open database file

🐛 Bug
On ROCm 4.2, with PyTorch 1.9.0 installed via
pip3 install torch -f https://download.pytorch.org/whl/rocm4.2/torch_stable.html

Running https://github.com/pytorch/examples/tree/master/mnist crashes oftentimes with the error below.
I use an MI50 GPU.
The error sometimes occurs at the very beginning of training, sometimes after the first epoch, sometimes within an epoch and sometimes not at all.
My impression is, that it might have to do with latency or data access.
The Python environment installation is on a data server connected via Infiniband.
The error is thrown from "/infiniband-shared-storage/.env1/lib64/python3.6/site-packages/torch/lib/libMIOpen-12425ccb.so.1".
On this device, I usually have to start my code 1-2 times before it actually works without crashing, but then there seems to be no problem. I have also installed it on a slow shared storage and there the problem is much more severe.
My interpretation of this is that there could be some connection instability for the specific command or that it requires getting the data within a short time frame.
We also have local installations of ROCm / MIOpen on each server ("/opt/rocm/lib/libMIOpen.so.1").
Is it possible to use the local shared object file instead of the one delivered with PyTorch? If yes, how can I do that?
(I tried it, but deleting and creating a symlink does not work)
MIOpen(HIP): Warning [FindWinogradSolutions] /MIOpen/src/sqlite_db.cpp:109: open memvfs: unable to open database file
MIOpen(HIP): Warning [FindDataDirectSolutions] /MIOpen/src/sqlite_db.cpp:109: open memvfs: unable to open database file
MIOpen(HIP): Warning [FindDataImplicitGemmSolutions] /MIOpen/src/sqlite_db.cpp:109: open memvfs: unable to open database file
MIOpen(HIP): Warning [FindFftSolutions] /MIOpen/src/sqlite_db.cpp:109: open memvfs: unable to open database file
MIOpen(HIP): Warning [FindWinogradSolutions] /MIOpen/src/sqlite_db.cpp:109: open memvfs: unable to open database file
MIOpen(HIP): Warning [FindDataDirectSolutions] /MIOpen/src/sqlite_db.cpp:109: open memvfs: unable to open database file
MIOpen(HIP): Warning [FindDataImplicitGemmSolutions] /MIOpen/src/sqlite_db.cpp:109: open memvfs: unable to open database file
MIOpen(HIP): Warning [FindFftSolutions] /MIOpen/src/sqlite_db.cpp:109: open memvfs: unable to open database file
MIOpen(HIP): Warning [FindWinogradSolutions] /MIOpen/src/sqlite_db.cpp:109: open memvfs: unable to open database file
MIOpen(HIP): Warning [FindDataDirectSolutions] /MIOpen/src/sqlite_db.cpp:109: open memvfs: unable to open database file
MIOpen(HIP): Warning [FindDataImplicitGemmSolutions] /MIOpen/src/sqlite_db.cpp:109: open memvfs: unable to open database file
MIOpen(HIP): Warning [FindFftSolutions] /MIOpen/src/sqlite_db.cpp:109: open memvfs: unable to open database file
MIOpen Error: /MIOpen/src/sqlite_db.cpp:109: open memvfs: unable to open database file
Traceback (most recent call last):
  File "main.py", line 137, in <module>
    main()
  File "main.py", line 128, in main
    train(args, model, device, train_loader, optimizer, epoch)
  File "main.py", line 44, in train
    loss.backward()
  File "/home/ssml/petersenf/testing/.env1/lib64/python3.6/site-packages/torch/_tensor.py", line 255, in backward
    torch.autograd.backward(self, gradient, retain_graph, create_graph, inputs=inputs)
  File "/home/ssml/petersenf/testing/.env1/lib64/python3.6/site-packages/torch/autograd/__init__.py", line 149, in backward
    allow_unreachable=True, accumulate_grad=True)  # allow_unreachable flag
RuntimeError: miopenStatusInternalError

To Reproduce
Steps to reproduce the behavior:
On a setup as described above:

wget https://raw.githubusercontent.com/pytorch/examples/master/mnist/main.py
python main.py

Environment
Collecting environment information...
PyTorch version: 1.9.0+rocm4.2
Is debug build: False
CUDA used to build PyTorch: N/A
ROCM used to build PyTorch: 4.2.21155-37cb3a34

OS: Scientific Linux release 7.9 (Nitrogen) (x86_64)
GCC version: (GCC) 4.8.5 20150623 (Red Hat 4.8.5-44)
Clang version: Could not collect
CMake version: Could not collect
Libc version: glibc-2.3.4

Python version: 3.6 (64-bit runtime)
Python platform: Linux-3.10.0-1160.25.1.el7.x86_64-x86_64-with-redhat-7.9-Nitrogen
Is CUDA available: True
CUDA runtime version: Could not collect
GPU models and configuration: Vega 20
Nvidia driver version: Could not collect
cuDNN version: Could not collect
HIP runtime version: 3.27.5
MIOpen runtime version: 2.11.0

Versions of relevant libraries:
[pip3] numpy==1.19.5
[pip3] torch==1.9.0+rocm4.2
[pip3] torchvision==0.10.0
[conda] Could not collect

$ yum info rocm-libs

Failed to set locale, defaulting to C
Available Packages
Name        : rocm-libs
Arch        : x86_64
Version     : <IP_ADDRESS>200
Release     : 21.el7
Size        : 4.0 k
Repo        : local-SL7-x86_64--install-repos-rocm
Summary     : Radeon Open Compute (ROCm) Runtime software stack
License     : unknown
Description : DESCRIPTION
            : ===========
            :
            : This is an installer created using CPack (https://cmake.org). No additional installation instructions provided.

Thanks @Felix-Petersen for reaching out.
Can you please share me the exact steps(step by step) to reproduce the problem.
Thank you.

Hi @Felix-Petersen
I am waiting for your update.
Can you please share me the exact steps(step by step) to reproduce and better understanding of the problem.
Thank you.

As there is no response from user for around 20 days, closing this ticket.
Request user to log a new ticket, if any, with all required details.
Thank you.


Cron setup doesn't actually run automatically, need to investigate if this is script or cron issue

Issue resolved - cron job was looking at the old file location instead of git clone, was unable to open browswer since running in headless mode, and was unable to find some of the paths specified.


implement Def.promise

See http://eed3si9n.com/promise-in-sbt for details.
This adds Def.promise a facility that wraps scala.concurrent.Promise. Project layer, there's an implicit for task-that-returns-promise (Def.Initialize[Task[PromiseWrap[A]]]) that would inject await method, which returns a task. This is a special task that is tagged with Tags.Sentinel so that it will bypass the concurrent restrictions. Since there's no CPU- or IO-bound work, this should be ok.
The purpose of this promise for long-running task to communicate with another task midway.

With a ProgressiveCallback too?https://github.com/netty/netty/blob/4.1/common/src/main/java/io/netty/util/concurrent/GenericProgressiveFutureListener.java


Angular and Svelte style properties are not transformed

I am interested in helping provide a fix!
No
Which generators are impacted?

[ ] All
[X] Angular
[ ] HTML
[ ] Qwik
[ ] React
[ ] React-Native
[ ] Solid
[ ] Stencil
[X] Svelte
[ ] Vue
[ ] Web components

Reproduction case
https://codesandbox.io/s/hungry-cache-trlkvp
Expected Behaviour
in angular [style]="obj" should be [ngStyle]="obj" and in svelte is more complex https://svelte.dev/tutorial/style-directive
Actual Behaviour
not doing anything
Additional Information
not sure if you want to cover this in mitosis

Sorry to many days without creating issues in your repo 😅 I’m on my phone but should be something like this.
https://mitosis.builder.io/?outputTab=react&code=import+{+useStore+}+from+"%40builder.io%2Fmitosis"%3B

export+default+function+MyComponent(props)+{
++const+state+%3D+useStore({
++++name%3A+"Steve"%2C
++++customStyles%3A
++++{+color%3A+'red'}
++})%3B
++
++return+(
++++<div+styles%3D{state.customStyles}>
++++++<input
++++++++css%3D{{
++++++++++color%3A+"red"%2C
++++++++}}
++++++++value%3D{state.name}
++++++++onChange%3D{(event)+%3D>+{+state.name+%3D+event.target.value+}}
++++++%2F>
++++++Hello
++++++{state.name}!+I+can+run+in+React%2C+Vue%2C+Solid%2C+or+Liquid!
++++<%2Fdiv>
++)%3B
}
basically you’re doing nothing (as usual in any property) but the property style has some special scenarios as I’ve explained above.

For Angular: it should be a 1-line addition to this map to map style to ngStyle:

https://github.com/BuilderIO/mitosis/blob/d2635b3cb325f49a827749cfb93fef518cdc2c03/packages/core/src/generators/angular.ts#L61-L65

For Svelte: one possible workaround would be to inject this styling helper whenever needed:
https://svelte.dev/repl/c7787db098e6495888036598586ec4f3?version=3.31.0

<script>
	function styling (node, vars) {
		Object.entries(vars).forEach(([ p, v ]) => { node.style[p] = v })
	}
</script>

<div use:styling={{ 'background-color': 'blue', color: 'white', padding: '12px' }}>
	Hi
</div>

low-overhead and will help bring Svelte on par with the other frameworks.

Hello this is open but there are merges, any update?

Yup, Forgot to close it! Should be fixed by #559


Fix #335 - Enable 'File' menu item so app is still usable when window is closed. r=jsantell

There's no reason to remove the File menu item when there are no windows open -- it merely makes the app unusable.
This is my proposal:

Keep the File menu item visible at all times
Open new window if user clicks New Window submenu item
Open new window if user clicks New Tab submenu item and there is no window open.

Happy to write a test if this functionality proposal hits the mark.

I think this sounds good, I'll review it hopefully by end of the day!

lgtm.

Coverage decreased (-0.1%) to 46.872% when pulling 7c5948d31150bb791ccb871ce6169755445deb33 on darkwing:issue-335 into 4635efaf2cc90fe758e22243eef293a9c3fbc7f0 on mozilla:master.


Added information on key sizes and key vault

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.:x: RyanLWilliams sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.

@RyanLWilliams : Thanks for your contribution! The author(s) have been notified to review your proposed change.

@RyanLWilliams - Thanks so much for making those updates.
#sign-off
PR reviewers, if you could add a period at the end of the sentence in the note, it would be much appreciated.

@ktoliver : Thanks for your contribution! The author(s) have been notified to review your proposed change.

@ktoliver : Thanks for your contribution! The author(s) have been notified to review your proposed change.

@ktoliver : Thanks for your contribution! The author(s) have been notified to review your proposed change.


Is this ready for testing?

Hi there,
Some of us are very interested to help you test this. Can you share your plans?

Howdy! I love that this was opened as an issue :)
I think this is relatively ready for a 0.1 release. I finally cracked the LiveView code, but need some time to write a new RTSP stack because Blink has a broken implementation. The current state can be tested, I've got additional refactoring and docs to be pushed shortly. Then on to fixing liveview
For those interested, the Blink RTSP is wrapped in a TLS socket, but just for transport. The protocol is just relayed and so ffmpeg and openRTSP fall over because the m= line doesn't include /TCP. Blink App clearly fails gracefully, but for the camera to operate via ffmpeg and homekit, we need to do some intercept and proxy the RTSP comms. It's just work from here on in.

yes. test away. fyi: liveview is not included yet


Closes #445

Related Issue
Closes #445
Description
I have made the FAQ Section responsive.
Please review the code.
Screenshots
Before:

After:

Checklist

[x] My code adheres to the established style guidelines of the project.
[x] I have included comments in areas that may be difficult to understand.
[x] My changes have not introduced any new warnings.
[x] I have conducted a self-review of my code.

@k-deepak04 Please add the required labels on all the pull requests so that the Pull Requests that are merged are considered for GSSOC'23 contributions

@k-deepak04 @rohansx Again a reminder, Please add the required labels on all the pull requests so that the Pull Requests that are merged are considered for GSSOC'23 contributions


The load_tests protocol is part of the Python standard library; using it shouldn't be a liability for us the way it is today.

Timely and related to what we're doing here: https://mail.python.org/pipermail/distutils-sig/2015-October/027003.html.

Thanks to @jtattermusch.


Make cert dir

Coverage remained the same at 51.196% when pulling 8523db5427a405e2c5ec9bea574cc4b28f24a417 on ywk253100:161117_prepare_2 into 4bf727c7e161169e8b1d279643f5a5a64f7229f9 on vmware:dev.


Change is_tty example to conform to new signature

Commit 0d1025c532b06c59898908e3def509f63eaa3257 changed the signature of
is_tty, but the example was not updated.

Thanks.


How to use?

I don't get it how to use this tool.
PatreonDownloader.exe --help leads to "Command not found"
PatreonDownloader.App.exe  --help leads to "Access denied"

PatreonDownloader.App.exe is the proper one.
I don't think I can help you with "Access denied" problem. This issue is not caused by PatreonDownloader.


Allow for higher versions of werkzeug

Install fails when a version of werkzeug greater than 0.10 is already present in the environment (current version is 0.10.4)

Hm, I think this build is failing because builds from pull requests don't have access to environment variables in Travis. Merging anyway, thanks.


fix: compiler ignores producing incorrect types

Closing this due to age. Some of this has already been implemented and others will be in a future PR.


Not able to scan images using RestAPI V1 ("analysis_status": "not_analyzed")

I am using anchore engine open source ( not enterprise) docker images and trying to scan the docker image using Rest API v1.
able to download the swagger using endpoint http://{servername:port}/v1/swagger.json
I am able to add the image but the image analysis status is always showing as "not_analyzed".
Below is the request and response while adding the image
Request:
{
"source": {
"tag": {
"pullstring": "webgoat/webgoat-8.0"
}
}
}
Response:
{
"analysis_status": "not_analyzed",
"analyzed_at": null,
"annotations": {},
"created_at": "2020-11-06T08:24:46Z",
"imageDigest": "sha256:e24bcaf41034c28b6a08aba94507a169ae23f2b87899e225a3d18fe8c36d26f5",
"image_content": {
"metadata": {
"arch": null,
"distro": null,
"distro_version": null,
"dockerfile_mode": null,
"image_size": null,
"layer_count": null
}
},
[....]
Below is the response when I tried to get the list of images using " GET /images"
{
"analysis_status": "not_analyzed",
"analyzed_at": null,
"annotations": {},
"created_at": "2020-11-06T08:24:46Z",
"imageDigest": "sha256:e24bcaf41034c28b6a08aba94507a169ae23f2b87899e225a3d18fe8c36d26f5",
"image_content": {
"metadata": {
"arch": null,
"distro": null,
"distro_version": null,
"dockerfile_mode": null,
"image_size": null,
"layer_count": null
}
},
"image_detail": [
{
"created_at": "2020-11-06T08:24:46Z",
"digest": "sha256:e24bcaf41034c28b6a08aba94507a169ae23f2b87899e225a3d18fe8c36d26f5",
"dockerfile": null,
"fulldigest": "docker.io/webgoat/webgoat-8.0@sha256:e24bcaf41034c28b6a08aba94507a169ae23f2b87899e225a3d18fe8c36d26f5",
"fulltag": "docker.io/webgoat/webgoat-8.0:latest",
"imageDigest": "sha256:e24bcaf41034c28b6a08aba94507a169ae23f2b87899e225a3d18fe8c36d26f5",
"imageId": "6664051b8808540cf920e5802e7eb025f9cb19346dcb0fc2be137a26979bb111",
"last_updated": "2020-11-06T08:24:46Z",
"registry": "docker.io",
"repo": "webgoat/webgoat-8.0",
"tag": "latest",
"tag_detected_at": "2020-11-06T08:24:46Z",
"userId": ""
}
],
"image_status": "active",
"image_type": "docker",
"last_updated": "2020-11-06T08:24:46Z",
"parentDigest": "sha256:e24bcaf41034c28b6a08aba94507a169ae23f2b87899e225a3d18fe8c36d26f5",
"userId": ""
}
Also all the services are up and running.
[
{
"base_url": "http://queue:8228",
"hostid": "anchore-quickstart",
"service_detail": {
"available": true,
"busy": false,
"db_version": "0.0.13",
"detail": {},
"message": "all good",
"up": true,
"version": "0.8.2"
},
"servicename": "simplequeue",
"status": true,
"status_message": "available",
"version": "v1"
},
{
"base_url": "http://catalog:8228",
"hostid": "anchore-quickstart",
"service_detail": {
"available": true,
"busy": false,
"db_version": "0.0.13",
"detail": {},
"message": "all good",
"up": true,
"version": "0.8.2"
},
"servicename": "catalog",
"status": true,
"status_message": "available",
"version": "v1"
},
{
"base_url": "http://analyzer:8228",
"hostid": "anchore-quickstart",
"service_detail": {
"available": true,
"busy": false,
"db_version": "0.0.13",
"detail": {},
"message": "all good",
"up": true,
"version": "0.8.2"
},
"servicename": "analyzer",
"status": true,
"status_message": "available",
"version": "v1"
},
{
"base_url": "http://api:8228",
"hostid": "anchore-quickstart",
"service_detail": {
"available": true,
"busy": false,
"db_version": "0.0.13",
"detail": {},
"message": "all good",
"up": true,
"version": "0.8.2"
},
"servicename": "apiext",
"status": true,
"status_message": "available",
"version": "v1"
},
{
"base_url": "http://policy-engine:8228",
"hostid": "anchore-quickstart",
"service_detail": {
"available": true,
"busy": false,
"db_version": "0.0.13",
"detail": {},
"message": "all good",
"up": true,
"version": "0.8.2"
},
"servicename": "policy_engine",
"status": true,
"status_message": "available",
"version": "v1"
}
]

As I am unable to scan using Rest APIs directly, using anchore-cli to scan images.
If I add images using Rest APIs, not able to see those images using "anchore-cli image list " command. If add images using anchore-cli, not able to see using Rest APIs "GET images" request.

I am also getting the same error. I can see the image using anchore-cli image list but not able to scan.

Hi @BhaskiBuzz I'm not sure I understand the failure you're describing. The POST /images is returning a 200 but the image record is staying in the 'not_analyzed' state for a long time, correct? How long does it stay in that state? Normally the analyzer process will check the queue every few seconds so it should pick up the task and transition the state to 'analyzing' fairly quickly if there are no other images in the system also in the queue.
You may see errors in the log of the catalog container or the analyzer container if they are having problems connecting with the queue service or the db.

Hi @zhill
Yes. The Post/images is returning a 200 but the image record is staying in the 'not_analyzed' state. The status is not changing even after a week.
I could not see any errors in catalog or analyzer container.
for the request "{{baseUrl}}/system/services", I can see all the services are up and running.  You can try using log level debug in the analyzer container (set it in config yaml or using env variable ANCHORE_LOG_LEVEL) and what we're looking for is the thread that is watching the task queue. There are several periodic processes that move tasks along the state-machine transitions so if any of them isn't running (very rare) then it could result in something being stuck.
You can also run curl http://localhost:8228/v1/queues/images_to_analyze/qlen in the simplequeue container and see if there is anything in the analysis queue. If that returns zero length then we know that the job was never queued and the problem is not in the queue or the worker, but upstream in the catalog or API components.

with debug level, I can see below logs for the analyzer container with some exception.
[service:worker] 2020-11-20 06:44:33+0000 [-] "<IP_ADDRESS>" - - [20/Nov/2020:06:44:33 +0000] "GET /health HTTP/1.1" 200 5 "-" "curl/7.61.1"
[service:worker] 2020-11-20 06:45:04+0000 [-] "<IP_ADDRESS>" - - [20/Nov/2020:06:45:04 +0000] "GET /health HTTP/1.1" 200 5 "-" "curl/7.61.1"
[service:worker] 2020-11-20 06:45:34+0000 [-] "<IP_ADDRESS>" - - [20/Nov/2020:06:45:34 +0000] "GET /health HTTP/1.1" 200 5 "-" "curl/7.61.1"
[service:worker] 2020-11-20 06:46:05+0000 [-] "<IP_ADDRESS>" - - [20/Nov/2020:06:46:05 +0000] "GET /health HTTP/1.1" 200 5 "-" "curl/7.61.1"
[service:worker] 2020-11-20 07:15:57+0000 [-] "<IP_ADDRESS>" - - [20/Nov/2020:07:15:56 +0000] "GET /health HTTP/1.1" 200 5 "-" "curl/7.61.1"
[service:worker] 2020-11-20 07:16:01+0000 [-] Traceback (most recent call last):
[service:worker] 2020-11-20 07:16:01+0000 [-]   File "/usr/local/lib/python3.6/site-packages/anchore_engine/clients/services/common.py", line 144, in get_service_endpoints
[service:worker] 2020-11-20 07:16:01+0000 [-]     raise Exception("cannot locate registered and available service in config/DB: " + servicename)
[service:worker] 2020-11-20 07:16:01+0000 [-] Exception: cannot locate registered and available service in config/DB: simplequeue
[service:worker] 2020-11-20 07:16:01+0000 [-] [Thread-8] [anchore_engine.clients.services.common/get_service_endpoints()] [ERROR] Error looking up service simplequeue
[service:worker] 2020-11-20 07:16:01+0000 [-] Traceback (most recent call last):
[service:worker] 2020-11-20 07:16:01+0000 [-]   File "/usr/local/lib/python3.6/site-packages/anchore_engine/clients/services/common.py", line 144, in get_service_endpoints
[service:worker] 2020-11-20 07:16:01+0000 [-]     raise Exception("cannot locate registered and available service in config/DB: " + servicename)
[service:worker] 2020-11-20 07:16:01+0000 [-] Exception: cannot locate registered and available service in config/DB: simplequeue
[service:worker] 2020-11-20 07:16:01+0000 [-]
[service:worker] 2020-11-20 07:16:01+0000 [-] During handling of the above exception, another exception occurred:
[service:worker] 2020-11-20 07:16:01+0000 [-]
[service:worker] 2020-11-20 07:16:01+0000 [-] Traceback (most recent call last):
[service:worker] 2020-11-20 07:16:01+0000 [-]   File "/usr/local/lib/python3.6/site-packages/anchore_engine/services/analyzer/init.py", line 399, in handle_image_analyzer
[service:worker] 2020-11-20 07:16:01+0000 [-]     qobj = q_client.dequeue(queuename)
[service:worker] 2020-11-20 07:16:01+0000 [-]   File "/usr/local/lib/python3.6/site-packages/anchore_engine/clients/services/simplequeue.py", line 52, in dequeue
[service:worker] 2020-11-20 07:16:01+0000 [-]     return self.round_robin_call_api(http.anchy_get, 'queues/{queue}', path_params={'queue': name}, query_params={'wait_max_seconds': max_wait_seconds, 'visibility_timeout': visibility_timeout})
Below is the response from queue container for the curl command
[anchore@d58995213076 anchore-engine]$ curl -v -u admin:foobar http://localhost:8228/v1/queues/images_to_analyze/qlen

Trying <IP_ADDRESS>...
TCP_NODELAY set
Connected to localhost (<IP_ADDRESS>) port 8228 (#0)
Server auth using Basic with user 'admin'

GET /v1/queues/images_to_analyze/qlen HTTP/1.1
Host: localhost:8228
Authorization: Basic YWRtaW46Zm9vYmFy
User-Agent: curl/7.61.1
Accept: /

< HTTP/1.1 200 OK
< Server: TwistedWeb/20.3.0
< Date: Fri, 20 Nov 2020 07:30:41 GMT
< Content-Type: application/json
< Content-Length: 4
<
"0"

Connection #0 to host localhost left intact

[service:worker] 2020-11-20 06:45:04+0000 [-] "<IP_ADDRESS>" - - [20/Nov/2020:06:45:04 +0000] "GET /health HTTP/1.1" 200 5 "-" "curl/7.61.1"
[service:worker] 2020-11-20 06:45:34+0000 [-] "<IP_ADDRESS>" - - [20/Nov/2020:06:45:34 +0000] "GET /health HTTP/1.1" 200 5 "-" "curl/7.61.1"
[service:worker] 2020-11-20 06:46:05+0000 [-] "<IP_ADDRESS>" - - [20/Nov/2020:06:46:05 +0000] "GET /health HTTP/1.1" 200 5 "-" "curl/7.61.1"
[service:worker] 2020-11-20 07:15:57+0000 [-] "<IP_ADDRESS>" - - [20/Nov/2020:07:15:56 +0000] "GET /health HTTP/1.1" 200 5 "-" "curl/7.61.1"
[service:worker] 2020-11-20 07:16:01+0000 [-] Traceback (most recent call last):
[service:worker] 2020-11-20 07:16:01+0000 [-]   File "/usr/local/lib/python3.6/site-packages/anchore_engine/clients/services/common.py", line 144, in get_service_endpoints
[service:worker] 2020-11-20 07:16:01+0000 [-]     raise Exception("cannot locate registered and available service in config/DB: " + servicename)
[service:worker] 2020-11-20 07:16:01+0000 [-] Exception: cannot locate registered and available service in config/DB: simplequeue
[service:worker] 2020-11-20 07:16:01+0000 [-] [Thread-8] [anchore_engine.clients.services.common/get_service_endpoints()] [ERROR] Error looking up service simplequeue
[service:worker] 2020-11-20 07:16:01+0000 [-] Traceback (most recent call last):
[service:worker] 2020-11-20 07:16:01+0000 [-]   File "/usr/local/lib/python3.6/site-packages/anchore_engine/clients/services/common.py", line 144, in get_service_endpoints
[service:worker] 2020-11-20 07:16:01+0000 [-]     raise Exception("cannot locate registered and available service in config/DB: " + servicename)
[service:worker] 2020-11-20 07:16:01+0000 [-] Exception: cannot locate registered and available service in config/DB: simplequeue
[service:worker] 2020-11-20 07:16:01+0000 [-]
[service:worker] 2020-11-20 07:16:01+0000 [-] During handling of the above exception, another exception occurred:
[service:worker] 2020-11-20 07:16:01+0000 [-]
[service:worker] 2020-11-20 07:16:01+0000 [-] Traceback (most recent call last):
[service:worker] 2020-11-20 07:16:01+0000 [-]   File "/usr/local/lib/python3.6/site-packages/anchore_engine/services/analyzer/init.py", line 399, in handle_image_analyzer
[service:worker] 2020-11-20 07:16:01+0000 [-]     qobj = q_client.dequeue(queuename)
[service:worker] 2020-11-20 07:16:01+0000 [-]   File "/usr/local/lib/python3.6/site-packages/anchore_engine/clients/services/simplequeue.py", line 52, in dequeue
[service:worker] 2020-11-20 07:16:01+0000 [-]     return self.round_robin_call_api(http.anchy_get, 'queues/{queue}', path_params={'queue': name}, query_params={'wait_max_seconds': max_wait_seconds, 'visibility_timeout': visibility_timeout})
[service:worker] 2020-11-20 07:16:01+0000 [-]   File "/usr/local/lib/python3.6/site-packages/anchore_engine/clients/services/internal.py", line 253, in round_robin_call_api
[service:worker] 2020-11-20 07:16:01+0000 [-]     urls = self.service_url_provider.get_all_urls(self.service, self.api_base)
[service:worker] 2020-11-20 07:16:01+0000 [-]   File "/usr/local/lib/python3.6/site-packages/anchore_engine/clients/services/internal.py", line 41, in get_all_urls
[service:worker] 2020-11-20 07:16:01+0000 [-]     endpts = get_service_endpoints(servicename)
[service:worker] 2020-11-20 07:16:01+0000 [-]   File "/usr/local/lib/python3.6/site-packages/anchore_engine/clients/services/common.py", line 161, in get_service_endpoints
[service:worker] 2020-11-20 07:16:01+0000 [-]     raise Exception("could not find valid endpoint for service ("+servicename+") - exception: " + str(err))
[service:worker] 2020-11-20 07:16:01+0000 [-] Exception: could not find valid endpoint for service (simplequeue) - exception: cannot locate registered and available service in config/DB: simplequeue
[service:worker] 2020-11-20 07:16:01+0000 [-] [Thread-8] [anchore_engine.services.analyzer/handle_image_analyzer()] [ERROR] Failure in image analysis loop
[service:worker] 2020-11-20 07:16:06+0000 [-] Traceback (most recent call last):
[service:worker] 2020-11-20 07:16:06+0000 [-]   File "/usr/local/lib/python3.6/site-packages/anchore_engine/clients/services/common.py", line 144, in get_service_endpoints
[service:worker] 2020-11-20 07:16:06+0000 [-]     raise Exception("cannot locate registered and available service in config/DB: " + servicename)
[service:worker] 2020-11-20 07:16:06+0000 [-] Exception: cannot locate registered and available service in config/DB: simplequeue
[service:worker] 2020-11-20 07:16:06+0000 [-] [Thread-8] [anchore_engine.clients.services.common/get_service_endpoints()] [ERROR] Error looking up service simplequeue
[service:worker] 2020-11-20 07:16:06+0000 [-] Traceback (most recent call last):
[service:worker] 2020-11-20 07:16:06+0000 [-]   File "/usr/local/lib/python3.6/site-packages/anchore_engine/clients/services/common.py", line 144, in get_service_endpoints
[service:worker] 2020-11-20 07:16:06+0000 [-]     raise Exception("cannot locate registered and available service in config/DB: " + servicename)
[service:worker] 2020-11-20 07:16:06+0000 [-] Exception: cannot locate registered and available service in config/DB: simplequeue
[service:worker] 2020-11-20 07:16:06+0000 [-]
[service:worker] 2020-11-20 07:16:06+0000 [-] During handling of the above exception, another exception occurred:
[service:worker] 2020-11-20 07:16:06+0000 [-]
[service:worker] 2020-11-20 07:16:06+0000 [-] Traceback (most recent call last):
[service:worker] 2020-11-20 07:16:06+0000 [-]   File "/usr/local/lib/python3.6/site-packages/anchore_engine/services/analyzer/init.py", line 399, in handle_image_analyzer
[service:worker] 2020-11-20 07:16:06+0000 [-]     qobj = q_client.dequeue(queuename)
[service:worker] 2020-11-20 07:16:06+0000 [-]   File "/usr/local/lib/python3.6/site-packages/anchore_engine/clients/services/simplequeue.py", line 52, in dequeue
[service:worker] 2020-11-20 07:16:06+0000 [-]     return self.round_robin_call_api(http.anchy_get, 'queues/{queue}', path_params={'queue': name}, query_params={'wait_max_seconds': max_wait_seconds, 'visibility_timeout': visibility_timeout})
[service:worker] 2020-11-20 07:16:06+0000 [-]   File "/usr/local/lib/python3.6/site-packages/anchore_engine/clients/services/internal.py", line 253, in round_robin_call_api
[service:worker] 2020-11-20 07:16:06+0000 [-]     urls = self.service_url_provider.get_all_urls(self.service, self.api_base)
[service:worker] 2020-11-20 07:16:06+0000 [-]   File "/usr/local/lib/python3.6/site-packages/anchore_engine/clients/services/internal.py", line 41, in get_all_urls
[service:worker] 2020-11-20 07:16:06+0000 [-]     endpts = get_service_endpoints(servicename)
[service:worker] 2020-11-20 07:16:06+0000 [-]   File "/usr/local/lib/python3.6/site-packages/anchore_engine/clients/services/common.py", line 161, in get_service_endpoints
[service:worker] 2020-11-20 07:16:06+0000 [-]     raise Exception("could not find valid endpoint for service ("+servicename+") - exception: " + str(err))
[service:worker] 2020-11-20 07:16:06+0000 [-] Exception: could not find valid endpoint for service (simplequeue) - exception: cannot locate registered and available service in config/DB: simplequeue
[service:worker] 2020-11-20 07:16:06+0000 [-] [Thread-8] [anchore_engine.services.analyzer/handle_image_analyzer()] [ERROR] Failure in image analysis loop
[service:worker] 2020-11-20 07:16:28+0000 [-] "<IP_ADDRESS>" - - [20/Nov/2020:07:16:27 +0000] "GET /health HTTP/1.1" 200 5 "-" "curl/7.61.1"

Hi @zhill any update on this.

Based on your logs it looks like the services are not able to connect to the simplequeue service, but that can sometimes be a normal result during system bootstrap or when services are restart and your initial system status output indicates services are ok.
Your qlen output indicates that the catalog is not pushing items into the queue at all, if that was run when at least one image was in the 'not_analyzed' status. Can you show the logs from the catalog service? If you see errors in that log recently then that is where we should look.

Hi @zhill, Closing this issue as I am able to send the request to the rest-endpoints using curl and scan the image. however sending request directly to the endpoint from postman is still shows ("analysis_status": "not_analyzed").
Thanks.


[0.15.0] const enums are not being exported anymore

monaco-editor version: 0.15.0
With the new 0.15.0 release, export const enum ... are not getting exported in the standaloneEditor anymore. As an example, paste this code to the playground:
require(['vs/base/common/scrollable'], ({ ScrollbarVisibility }) => {
    if (!ScrollbarVisibility) alert('ScrollbarVisibility has not been exported :(');
});

Looking at the sources, ScrollbarVisibility should get exported correctly:
https://github.com/Microsoft/vscode/blob/master/src/vs/base/common/scrollable.ts
Reading the history of that file, it looks like the changes made in this commit are causing the problem:
https://github.com/Microsoft/vscode/commit/67eacaa4a856be0b90435c71de1996a12ff02f61#diff-c4d985a76a54961df57cff1260208b54

This was never API and the change is intentional. We are moving our code base to use const enums internally because const enums get inlined in the generated JavaScript and they incur no overhead at runtime (i.e. there is no code generated for them, as you point out).
All the API enums that are present in monaco.d.ts are correctly exported, so I don't understand why you would reach for ScrollbarVisibility in vs/base/common/scrollable which is not API, instead of using monaco.editor.ScrollbarVisibility which is considered API and works.

Oh I see. Well in my special case I'm using the DomScrollableElement class to draw custom scrollbars on my own HTML elements in order to give them the same look & feel as the editor (overlay scrollbars that automatically hide when the element is not hovered).
Even though that might be a nasty grab to an internal API, I can still see valid use-cases for external contributions to access these kinds of enums. For example, if I want to define a custom content widget, I'd want to access the ContentWidgetPositionPreference from vs/editor/browser/editorBrowser, which also isn't exported any longer.
Wouldn't it be possible to still export these enums for the monaco-editor, while still inlining them at compile-time?

Oh never mind my last comment, I've read your answer incorrectly. Are all those enums accessible via monaco.editor.?

Only the enums that are considered API. The API is in monaco.d.ts -- e.g. the core editor one is at https://github.com/Microsoft/vscode/blob/standalone/0.15.x/src/vs/monaco.d.ts

I see. I'd still prefer to have those enums accessible from their original sources (paths) because it makes troubleshooting against the vscode sources somewhat easier, plus it would allow accessing enums that have not been added to the monaco.d.ts file explicitly for those special edge-cases.
It seems the Typescript compiler accepts a flag to enable this feature:

--preserveConstEnums
Do not erase const enum declarations in generated code.

Testing this functionality, it seems to inline the enums, while still exporting const enum declaration:
index.ts
import { Test } from './enum';
if (1 === Test.Hello) console.log('Hello!');

enum.ts
export const enum Test {
	Hello = 1,
	World = 2
}

Running tsc --preserveConstEnums index.ts results in:
index.js
"use strict";
exports.__esModule = true;
if (1 === 1 /* Hello */)
    console.log('Hello!');

enum.js
"use strict";
exports.__esModule = true;
var Test;
(function (Test) {
    Test[Test["Hello"] = 1] = "Hello";
    Test[Test["World"] = 2] = "World";
})(Test = exports.Test || (exports.Test = {}));

I can create a PR for this if you don't mind.

I am sorry, but I would not accept such a PR.
I do not want our code to pay the cost at runtime of evaluating:
var Test;
(function (Test) {
    Test[Test["Hello"] = 1] = "Hello";
    Test[Test["World"] = 2] = "World";
})(Test = exports.Test || (exports.Test = {}));

for no good reason.
You are reaching into the editor internal implementation and you cannot complain when that changes or breaks. That is how libraries work, internal stuff can break or disappear at any time. We try as best we can to maintain our API surface in a backwards compatible way.


fix: pandas and pyarrow were raising for repeated aggregations involving the same root name and the same aggregation function

closes #1612

What type of PR is this? (check all applicable)

[ ] 💾 Refactor
[ ] ✨ Feature
[ ] 🐛 Bug Fix
[ ] 🔧 Optimization
[ ] 📝 Documentation
[ ] ✅ Test
[ ] 🐳 Other

Related issues

Related issue #<issue number>
Closes #<issue number>

Checklist

[ ] Code follows style guide (ruff)
[ ] Tests added
[ ] Documented the changes

If you have comments or can explain your changes, please do so below

thanks for your review 🙏 !


Add support for showing code actions

Add support for showing code actions.
This PR adds initial support for code actions. At the moment, only for showing them, not applying.
I also made some adjustments to the hover popover, because it wasn't working after we switched the way we display the code.
The PopoverList used to display the actions popover was extracted and adapted from SuperEditor.
I also made some adjustments in the way we start LSP tests, to wait until the LSP notifies us it finished analyzing the project. Without this, some methods, like the code actions, just return an empty array.
It seems the code actions return some different options on Flutter master x stable. We should decide whether we want to target the stable or master branch.
It seems that, even with the latest changes, the file rename test isn't working on the CI, I'm letting this commented out for now.
https://github.com/user-attachments/assets/f104f543-a2b9-4bc4-b62c-ad904a3caa0e

cc @suragch @rutvik110


[SPARK-23928][SQL][WIP] Add shuffle collection function.

What changes were proposed in this pull request?
This PR adds a new collection function: shuffle. It generates a random permutation of the given array. This implementation uses the modern version of Fisher-Yates algorithm.
How was this patch tested?
New tests are added to CollectionExpressionsSuite.scala and DataFrameFunctionsSuite.scala.

Can one of the admins verify this patch?

Can one of the admins verify this patch?

For the tests, I was trying to do this:

assertEqualsInorgeOrder(shuffle(originSeq), originSeq)
But spark does not have assertEqualsInorgeOrder implemented. I was thinking to check Multiset of shuffle(originSeq) and originSeq. But had trouble using Multiset for expression and seq.
About the randomness, I was thinking to generate a Seq range(1, 501) and shuffle it 30 times. And it should produce at least 80% distinct permutations. Say using HashSet.add(shuffledResult). But I don't know how to implement this idea in scala and codeGen for expressions.

This is my 1st time contributing to spark and codeGen. I hope committers and contributors could help with tests, and also the shuffle function code. Thanks a lot!

@mn-mikke Can you give some comments on the tests code? I believe they need to be improved, using functions like Multiset? Thanks.

Thanks for your contribution!
You can refer Uuid and its test as I mentioned in a comment. Could you update this?
I'll revisit when you push new commits.

@pkuwm Btw, if you want to implement some algorithm like "Fisher-Yates algorithm" by hand, please add a comment near the code, and a link you referred hopefully.

Can one of the admins verify this patch?

@pkuwm Hi, any updates on this? If you have any questions, please let us know. Thanks!

Okay, I'll take this over, and ping you when I submit a PR to ask a review. Thanks!

@pkuwm I submitted a PR #21802 based on this. Could you take a look if you have time? Thanks!

@pkuwm . Could you close this PR since https://github.com/apache/spark/pull/21802 is merged?

Thanks for reminding, @dongjoon-hyun


Investigate nilable fields

It is unclear why if a lease grant is not requested before a keep_alive request, the header and the ID of LeaseKeepAliveResponse is returned but not the TTL. This should be investigated so that we will have a comprehensive deserialisation model system

etcd implements gRPC following proto3 which follows:
If a value is missing in the JSON-encoded data or if its value is null, it will be interpreted as the appropriate default value when parsed into a protocol buffer. If a field has the default value in the protocol buffer, it will be omitted in the JSON-encoded data by default to save space. An implementation may provide options to emit fields with default values in the JSON-encoded output.

The table for default values is as follows

Please note, proto3 docs does not mention of the ability to declare custom defaults
https://developers.google.com/protocol-buffers/docs/proto3#simple

@caspiano

Good investigation @dukeraphaelng, seems resolved