adding benchmark to extractor

This is a PR on top of the extractor PR at https://github.com/simdjson/simdjson/pull/2247
cmake --build build20  --target bench_ondemand

Preliminary benchmark suggests a small performance loss... The difference is small, but I observe it in two different benchmarks.
Can you check what you get?
partial_tweets
./build20/benchmark/bench_ondemand --benchmark_filter=partial_tweets

partial_tweets<simdjson_ondemand>/manual_time             147613 ns       160362 ns         4571 best_bytes_per_sec=4.35744G best_docs_per_sec=6.89998k best_items_per_sec=689.998k bytes=631.515k bytes_per_second=3.98438G/s docs_per_sec=6.77449k/s items=100 items_per_second=677.449k/s [BEST: throughput=  4.36 GB/s doc_throughput=  6899 docs/s items=       100 avg_time=    147612 ns]
partial_tweets<simdjson_ondemand_extract>/manual_time     160835 ns       173621 ns         4340 best_bytes_per_sec=4.14078G best_docs_per_sec=6.5569k best_items_per_sec=655.69k bytes=631.515k bytes_per_second=3.65681G/s docs_per_sec=6.21754k/s items=100 items_per_second=621.754k/s [BEST: throughput=  4.14 GB/s doc_throughput=  6556 docs/s items=       100 avg_time=    160835 ns]

kostya
./build20/benchmark/bench_ondemand --benchmark_filter=kostya

kostya<simdjson_ondemand>/manual_time           42895521 ns     46789562 ns           16 best_bytes_per_sec=3.23009G best_docs_per_sec=23.525 best_items_per_sec=12.3339M bytes=137.305M bytes_per_second=2.98109G/s docs_per_sec=23.3125/s items=524.288k items_per_second=12.2224M/s [BEST: throughput=  3.23 GB/s doc_throughput=    23 docs/s items=    524288 avg_time=  42895520 ns]
kostya<simdjson_ondemand_extract>/manual_time   45543115 ns     49405825 ns           15 best_bytes_per_sec=3.0295G best_docs_per_sec=22.064 best_items_per_sec=11.5679M bytes=137.305M bytes_per_second=2.80778G/s docs_per_sec=21.9572/s items=524.288k items_per_second=11.5119M/s [BEST: throughput=  3.03 GB/s doc_throughput=    22 docs/s items=    524288 avg_time=  45543115 ns]

@the-moisrex The problem might be algorithmic.
The extractor follows this algorithm:

Visit a key in the JSON. Compare it against all target keys until one is found.
Move to the next key, go back to 1.

In some instances, this is fine.
However, look how the reference ondemand code is like in the two instances that I have identified. We do...

'find_field("first key")' this moves you through the JSON up until you have found the key. In JSON files, the keys are often in predictible order and so we might be lucky and hit it first.
we do 'find_field("second key")'... this starts right after 'first key'.

And so on.
When the code is written to match the order of the keys in the JSON... this second approach is going to be more efficient than the extractor code.

So, possibly, we could use a hint parameter to choose the algorithm you want to use. If you think you know the order of the keys, you could use one algorithm, otherwise you could use another... ???

However, look how the reference ondemand code is like in the two instances that I have identified. We do...

'find_field("first key")' this moves you through the JSON up until you have found the key. In JSON files, the keys are often in predictible order and so we might be lucky and hit it first.
we do 'find_field("second key")'... this starts right after 'first key'.

And so on.

@lemire that was the idea from which I optimized find_all as well; but it wasn't as clean as I wanted it; let me add a feature to the iterator itself that finds the next key instead of searching for an specific key and leave the equality checking to us.

So, possibly, we could use a hint parameter to choose the algorithm you want to use. If you think you know the order of the keys, you could use one algorithm, otherwise you could use another... ???

I don't think a hint is a good idea. Is there a scenario that the current algorithm would perform better?

I'm gonna merge this.

@lemire See https://github.com/simdjson/simdjson/pull/2247#issuecomment-2365141766

@the-moisrex Conceptually, there might be different algorithms that are best. But I agree that your latest design is quite good and likely difficult to improve upon.


Allow monitoring toil clusters with a Grafana dashboard on the leader

I'm open to suggestions on packaging the configuration files more cleanly. Dockerizing the services individually seems to be the best way to do this, but I could also deploy them to the leader through ssh, or through the startup script in awsUserData.

V. excited to see this. I don't see any documentation. Can you add @adderan @joelarmstrong ?

This is ready for review, but it is rebased onto the autoscaling PR, so it will have to be merged after that one.

Can't wait to start using this.  Thanks!

This is ready, unless someone can think of a cleaner way to manage the containers. I think we were also waiting for people to test it. But it works for me.

Lon and and will test and report back.
On Oct 5, 2017 11:56 AM, "Alden Deran"<EMAIL_ADDRESS>wrote:

This is ready, unless someone can think of a cleaner way to manage the
containers. I think we were also waiting for people to test it. But it
works for me.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/BD2KGenomics/toil/pull/1773#issuecomment-334559474,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AKPMlBjqA6ieO0Y4n-2GE0xGdTPqkd1Aks5spSZOgaJpZM4OhnPP
.

@DailyDreaming and @jessebrennan, if this is ready, you need to approve it.

I could not get this running to a satisfying degree. I had to make some
modifications so that the docker images for grafana and prometheous would
be available from the remote machine (although from what I can tell this
would only be a issue for development / testing) .
Another thing was that it was very hard to get it to shutdown. ^C would
cause (some?) things to quit, but you'd be left with a blank terminal
session that could only be closed by closing the window.
Finally, although I could view a console at localhost:3000 I never actually
saw any data displayed there.
This could all just be user error, but I think the second issue I pointed
out should be addressed.
On Oct 12, 2017 4:18 AM, "Edwin Jacox"<EMAIL_ADDRESS>wrote:

@DailyDreaming https://github.com/dailydreaming and @jessebrennan
https://github.com/jessebrennan, if this is ready, you need to approve
it.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/BD2KGenomics/toil/pull/1773#issuecomment-336097888,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AKPMlDlZTDpykdiGlZEf9JIzOdloeBlxks5srfVugaJpZM4OhnPP
.

Was planning on running again to give some logs.
On Oct 12, 2017 8:44 AM, "jessebrennan"<EMAIL_ADDRESS>wrote:

I could not get this running to a satisfying degree. I had to make some
modifications so that the docker images for grafana and prometheous would
be available from the remote machine (although from what I can tell this
would only be a issue for development / testing) .
Another thing was that it was very hard to get it to shutdown. ^C would
cause (some?) things to quit, but you'd be left with a blank terminal
session that could only be closed by closing the window.
Finally, although I could view a console at localhost:3000 I never actually
saw any data displayed there.
This could all just be user error, but I think the second issue I pointed
out should be addressed.
On Oct 12, 2017 4:18 AM, "Edwin Jacox"<EMAIL_ADDRESS>wrote:

@DailyDreaming https://github.com/dailydreaming and @jessebrennan
https://github.com/jessebrennan, if this is ready, you need to approve
it.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/BD2KGenomics/toil/pull/1773#issuecomment-336097888,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/
AKPMlDlZTDpykdiGlZEf9JIzOdloeBlxks5srfVugaJpZM4OhnPP>
.

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/BD2KGenomics/toil/pull/1773#issuecomment-336178478,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AKPMlDE4xVEQ0auGHdF1NUKvYada6p1Uks5srjPNgaJpZM4OhnPP
.

I've gotten this to run without much of a hitch (it works brilliantly!!), but there are 2 problems I saw:

number of queued/running jobs can go negative on failures. This is on me, I think, I have updated my dashboard config a few times but didn't send the incremental updates to Alden.
in some situations, you can get a crash on restart (if an old mtail container isn't properly terminated, the new mtail container will fail to bind the port and die).

I have fixes in progress for both of these (easier to fix it than complain :)) but they're not ready yet.

I think maybe I should have the containers running as init scripts so they can be restarted automatically if they fail. And then the logger would docker attach to the mtail container. Deploying them when the pipeline starts is kind of clunky, now that I think about it more.

Okay, I think I've addressed the problems Jesse had. I've made it possible to configure the location of the containers with TOIL_DOCKER_REGISTRY so that it works the same way as the toil appliance, and the containers now terminate with only one Control-C.
This should be ready to merge, but I think someone will need to set the toil-prometheus, toil-grafana, and toil-mtail repositories to public on Quay so that people can download the containers.

@adderan I made the repositories public. I tried this with the sort example locally. Everything seems to run fine, but I only get spinning little wheels in my dashboard. What I am doing wrong?

@ejacox, @jessebrennan, when you're running locally and things are broken, are you running on Macs? As written this won't work on Macs, because --net=host is completely (and silently) broken on Macs. (To be fair, because Docker runs in a VM on Mac, it's not really possible to make --net=host work properly.)
We could probably rejigger things to use the default bridged mode (pointing to docker.for.mac.localhost rather than localhost on Macs). But that will break some things on Linux as well: on Linux the containers each have their own loopback interface, so if grafana tries to access prometheus at localhost:9090, that will point to the grafana container rather than the outside host. I think the way to address that is to point everything at the docker0 gateway, but really this just adds a huge amount of complexity.

Thanks @joelarmstrong. I suggest noting that the single machine mode doesn't work on a Mac and merging this once the updates are resolved. We can revisit the Mac issue later.

Hope you don't mind: I pushed a bit of an update to the dashboard config (fixing some stacking issues in the queued/running jobs graph that were probably inherited from my crappy config) and fixed a typo which caused the "desired size" log update to get missed.
This all seems to be working pretty well for me.

Jenkins, test this please

Jenkins, test this please.

Travis failed due to a timeout. Since Jenkins passed I think this is safe to merge.
I haven't tested Alden's force quit fix, but it looked fine to me.


[Feature] switch to bitcoincore-rpc

instead of handling node interaction manually, we should switch over to using https://crates.io/crates/bitcoincore-rpc.

i tried to tackle this today, but there are so many bugs, missing fields, and other discrepancies within the crate that i couldn't even implement /block with it. guess were sticking with the current custom impl for now


Auto start?

How can I start this extension automatically?

@rostamiani there is no way to start this extension automatically. You need to start it manually.


AutoTags Features, should it be enabled by default?

Just want to hear from you guys if it should be enabled by default. (Right now it is)
I think it compliments the search functionality.

I'll leave it as a default for now.


Use Utils.spawn over Utils.bash

i am hoping to update the Utils.spawn
from
    static spawn (cmdArgs: string[], cwd = process.cwd()): Promise<{stdout: string; stderr: string}> {
        return execa(cmdArgs[0], cmdArgs.slice(1), {cwd});
    }

async function sh (script)  {
    return execa("sh", ["-c", script]);
}

what do you think ?
main motivation is because, the current spawn does not allow pipelines, making it difficult to convert bash to spawn for commands like
https://github.com/firecow/gitlab-ci-local/blob/250bab2232a65f89f6813ebc67d99fe2b5b00dbf/src/parser-includes.ts#L203


Menu MY ACCOUNT & TEAM lost when responsive mobile size

Describe the Bug
the MY ACCOUNT & TEAM Menu
disappears when switching to a mobile size screen
Mobile Size  mode menu MY ACCOUNT & TEAM is KO

Desktop mode menu MY ACCOUNT & TEAM is OK

Database
MySQL
Relevant log output
No response
Which Umami version are you using? (if relevant)
umami v2.10.2
Which browser are you using? (if relevant)
Google Chrome Version 122.0.6261.69 (Official Build) (64-bit)
How are you deploying your application? (if relevant)
umami v2.10.2   avec docker pull ghcr.io/umami-software/umami:mysql-latest

Thank's <3

Fixed in v2.11.0


Update anomaly-detection.md

Rephrase the summary

@adieldar : Thanks for your contribution! The author, @orspod, has been notified to review your proposed change.

#sign-off


Feature: Option to schedule shows in collection in chronological order

If I have a collection of shows, I can't seem to find an option to schedule the episodes of these shows in chronological order. The option does exist if you schedule a specific show, but not if you try to schedule a collection of shows.
I'm looking for something like "Shuffle Chronologically", where the episodes in shows are in chronological order, but the show order is shuffled. As an addition you could also add the "Multiple" playout mode here, to be able to play x number of episodes of each show in chronological order.

So I think for the most part this is a documentation gap. Shuffle In Order should do exactly what you describe (shuffling the order of shows while keeping each show in chronological order).
I'll give the Multiple idea some thought.

Thanks for the quick response!
Hm, I did try that, and I now realize when looking closer that it is actually in chronological order, it's just that the shows have different starting points (some begin at s01, some at s07, other at s04 etc). Is there any way to reset the progression here, so they all begin at s01 when creating the schedule?

The shows all start with their earliest episode (chronologically). I suspect there are a few reasons why that may not appear to be the case late in the day.

Playouts always start building at midnight of the current day. So if you build a playout at 22:00 that means there are 22 hours of playout that get scheduled and then immediately trimmed for being in the past. This is kind of a holdover from a very early architectural decision, and I do have a backlog item to revisit whether this is still necessary.
Shuffling can cause shows to schedule at different rates because when a collection is shuffled, all items must be played once before any items are repeated. What this means for Shuffle In Order is that shows are "balanced" throughout the playout, kind of similar to how music playlists are shuffled. So if you have show A with 10 episodes and show B with 2, you might see A A A B A A B A A A.
Shuffling between shows is mostly random (meaning the playout does NOT advance as you described "multiple" above). If you have show A with 5 episodes and show B with 5 episodes, you may see something like AAABABBABBB.  This is another reason shows schedule at different rates.

I think what you are seeing is shows scheduling at different rates over a long period of time (building a playout late in the day). If this doesn't sound like what's happening, I'm happy to take a closer look.

Good catch, that behavior was an accidental carry over from another algorithm that didn't use ordering.
The behavior was corrected with #370 and Shuffle In Order will now start all collections/shows from the earliest episode as expected.

This fix is also in the latest release v0.0.58-alpha.

Oh wow, that was fast. Works as expected now, thanks for the fix!


Dead license link

Received via email
This link is dead: https://creativecommons.org/licenses/by-nc-sa/2.5/se/legalcode.sv
I want to include a verbatim copy of the license text in my work, not just a link to the explanation page. It seems other licenses have the same problem with their legal code pages.

Correct link appears to be https://creativecommons.org/licenses/by-nc-sa/2.5/se/legalcode

The legalcode link in https://creativecommons.org/licenses/by-nc-sa/2.5/se/ is broken; it links to the https://creativecommons.org/licenses/by-nc-sa/2.5/se/legalcode.sv and not https://creativecommons.org/licenses/by-nc-sa/2.5/se/legalcode.

This is because there is only one translation string for this sentence across all versions of the licenses.
The 4.0 translation guide (as far as I can recall) asks you to put a link to /legalcode. in whereas all other ported versions require you to leave that link to /legalcode
In consistent translations by the translation community and active communities that have both <4.0 ported versions and translated 4.0 have this issue.
See my pull for more on this: https://github.com/creativecommons/cc.i18n/pull/6


refactor(semantic): rename Reference::flag field to flags

[!WARNING]
This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

#5028
#5027
#5026  👈
#5025
#5024
#5023
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @overlookmotel and the rest of your teammates on  Graphite


Specify GOVUK_NOTIFY_TEMPLATE_ID_DEVISE in Terraform

This sets the environment variable via Terraform so we can customise it. The dev and review environments are going to use a template where personalisation is visible in the logs, whereas the other environments will use one where personalisation is not visible. This ensures that we don't leak any secret tokens in the logs.
Trello Card

We've decided to go down a different route:

In dev and review we'll use a team API key so emails are sent out.
We'll change the single Devise template to hide personalisation.
Therefore we don't need two templates.


product Picker

hey,
i want to implement like the one below how to implement it

when i click on button to add items the dialog appears to  select the items to add using check box how to do it.

https://github.com/volkanceylan/Serenity/issues/3897


adding tips about custom loading screen

do not hesitate to correct me if something is wrong here, I'm walking on eggshells :)

All good my friend! thanks a lot


Mast: Watch (?-i:d8ef82dd09d3b11674ef9c2a70890b41)(?#apnews.com)

Mast requests the watch of the watch_keyword (?-i:d8ef82dd09d3b11674ef9c2a70890b41)(?#apnews.com). See the MS search here and the Stack Exchange search in text, in URLs, and in code.

(?-i:d8ef82dd09d3b11674ef9c2a70890b41)(?#apnews.com) has been seen in 1 true positive, 0 false positives, and 0 NAAs.

Approved by Daniil in Charcoal HQ


Framed tickets that require doc input (Louis)

The Framed project will be retired.
https://github.com/SAP/cloud-commerce-spartacus-storefront/projects/4
We have many tickets in doc input still.

Found one ticket with doc required. Created this https://github.com/SAP/cloud-commerce-spartacus-storefront-docs/issues/247.
Will track there.


Redesign the "Mission" Section

You can make the "Mission" section more creative as per your aspect. Then share the sanspshot of changes in comment. I'll review and merge.

Can I work on this issue ?

I would like to work on this issue. Can you assign it to me ?

Yeah sure.

@soumita1234 can I work on this issue

@soumita1234 can I work on this issue

Yes you can. After changing share website link here before making PR.

I would like to work on this issue under LGMSOC21, please allow me.


image not show on mobile browser after resizing

this is the original image:
https://o9kwm2s9v.qnssl.com/production/test/iLXVN20170203114422.png
after resizing it to 1024, image not show on mobile browser:
https://ohe31mpy9.qnssl.com/test/test/FcvCj20170203114515.png
i changed nfnt to https://github.com/gographics/imagick, resizing works well.  so whats the problem with nfnt, could someone help me?

Could you post code that reproduces the issue? Preferable provide an image that causes the failure as well.


DynamicThemes Sample Project

This is a sample project demonstrating how themes (defined in Styles\Custom.xaml) can be set during runtime. There are a number of fixes in HamburgerMenu control (xaml and codebehind) to enable dynamic setting of themes.

Too large of a PR man.

@JerryNixon - It's a sample project. How small should a sample PR be to be considered and not rejected outright? This is not out of line compared with the other samples. Have you looked at the  sample in operation?


Share links missing in Safari

It looks like Safari isn't rendering the share links correctly.

Compared to Chrome (Version 58.0.3029.110 (64-bit))

The links do appear to be in the HTML when viewed in the Safari debugger

Any ideas what the cause might be?

Hi. This is weird. I've been testing it on Safari and everything seems ok. I'm on: Version 10.1.1 (11603.2.5). Maybe an adblock is at fault?

@dplesca  - You're correct. It was an Adblocker. Please accept my apologies...


Generate RPMs and DEBs

What have you changed?
Add building rpms and debs to the dist_artifacts job we're using in our distributed release builds.
As a result of this change we're now using 'prerequisites': https://www.gnu.org/software/make/manual/html_node/Automatic-Prerequisites.html
So you can build any of the distributed packages just by targeting them. Order doesn't matter and it'll do the least work possible.
make dist/tikv.rpm dist/tikv.deb dist/tikv.tar.gz dist/tikv-docker.tar.gz

These packages only install a stub systemd unit and the config template alongside the conventional directory topology.
What is the type of the changes?
Engineering/Feature
How is the PR tested?
Please select the tests that you ran to verify your changes:

Unit test
Integration test
Manual test (add detailed scripts or steps below)
No code

Does this PR affect documentation (docs) or should it be mentioned in the release notes?

If there is a document change, please file a PR in (docs) and add the PR number here.
If this PR should be mentioned in the release note, please update the release notes.

Does this PR affect tidb-ansible?
If there is a configuration or metrics change, please file a PR in tidb-ansible, and add the PR number here.
Refer to a related PR or issue link (optional)
#6081 #5777
Benchmark result if necessary (optional)
Any examples? (optional)
make dist_artifacts
dpkg -i dist/tikv.deb
yum install dist/tikv.rpm
docker load dist/tikv-docker.tar.gz

/run-all-tests

Here's a prompt you get on debian if the configs differ:

@Hoverbear  I run similar rpm package generated by tidb-helper. and we I test it in our production environment, service start failed becase the ExecStart commend parameter$CONFIGURATION_DIRECTORY/config.toml was parse to empty.
and when I use systemctl status tidb-server.service -l to check the status, it report something like:
Dec 20 19:23:00 localhost.localdomain systemd[1]: [/usr/lib/systemd/system/tidb-server.service:13] Unknown lvalue 'ConfigurationDirectory' in section 'Service'

It seems this kind of config settings donot have good enough compatibility.

Oh! Wild! I'll fall back to a non-env then. :) Thanks for this great catch.

This depends on https://github.com/tikv/tikv/pull/6408, resulting from changes to our component topology.

Closing. I am not longer involved with the project and have no stake in this merging. Feel free to create a new PR.


Unable to handle special characters on Windows

Due to the way windows works anirip/GO has issues dealing with reserved characters, as shown in log1.txt. I propose the affected characters should be stripped in order to enable the expected functionality on shows where Crunchyroll uses a reserved character in the name. The following characters (below) are from the page https://msdn.microsoft.com/en-us/library/windows/desktop/aa365247(v=vs.85).aspx under heading File and Directory Names, subheading Naming Conventions.
In practice the only character I've seen used is the ?(question mark), but I can't say they haven't used any of the other ones.
Reserved Characters
< (less than)
> (greater than)
: (colon)
" (double quote)
/ (forward slash)
\ (backslash)
| (vertical bar or pipe)
? (question mark)
* (asterisk)
log1.txt

That piece of code exists but was not applied to the name of the show, only to the episode name. I did push a code fix suggestion for that to the author.

I've merged your PR clickman. Sorry this isn't my most active project so I have a tough time keeping up with issues. Hopefully his change fixes your issue!


Connect to API

I have connected to the API

Hi @Victoria129
While you made a great effort in this project, unfortunately, I cannot proceed to review your code.

Invalid Code Review Request
You have submitted a project, that has no descriptive Pull Request description. Your Pull Request should have a short summary describing introduced changes in more detail. Kindly check the professional repo to learn more.
Your Code Review Request will be marked as invalid in your Dashboard, so please submit a new one once you are ready 🙏
Cheers and Happy coding!👏👏👏
Feel free to leave any questions or comments in the PR thread if something is not 100% clear.
Please, remember to tag me in your question so I can receive the notification.
Please, do not open a new Pull Request for re-reviews. You should use the same Pull Request submitted for the first review, either valid or invalid unless it is requested otherwise.

Invalid Code Review Request does not count into the code reviews limit.


Process.Start() is stuck on Cent OS 7 and Ubuntu 18.04

Issue Title
Process.Start() is stuck sometimes on Cent OS 7 and Ubuntu 18.04
General
Recently we updated Net core version used by Azure pipelines agent to 3.1.0, and it seems that for some customers issue appeared - Process.Start("chmod 600 ") is stuck for some reason (on line)
At the same moment calling this command from terminal works fine for customer. Agent process is being run under the root, nothing else changed in code for this call.
Here are Process.StartInfo parameters for call:
File name: '/bin/chmod'
Arguments: '600 '
Working directory: '/root/azagent'
UseShellExecute: false
CreateNoWindow: true
RedirectStandardInput: true;
RedirectStandardError: true;
RedirectStandardOutput: true
OS version: Cent OS 7 (centos-release-7-6.1810.2.el7.centos.x86_64), Ubuntu 18.04
Net core version: 3.1.0
According to logs it seems that chmod process is in zombie state after the call, and there's no return value from Process.Start() method:
https://github.com/microsoft/azure-pipelines-agent/issues/3093#issuecomment-721630338
You can also find more info in thread for issue.
Could you please take a look? Do you know if there were any similar issues - if so, is there any possible workaround/is it fixed?
Please let me know if you need some additional info.

I see you're redirecting stdin here -- chmod may be expecting you to close that before it can complete. Generally don't redirect the streams unless you intend to read/write them.

I see you're redirecting stdin here -- chmod may be expecting you to close that before it can complete. Generally don't redirect the streams unless you intend to read/write them.

@scalablecory thanks! We will try to disable redirect for the case when there's no input indented.

@scalablecory thanks! We will try to disable redirect for the case when there's no input indented.

cc: @tmds

cc: @tmds

According to logs it seems that chmod process is in zombie state after the call, and there's no return value from Process.Start()

Can you get the stacktraces from all threads? That will give us some information about where Process.Start is blocked, and maybe what other thread is blocking it.

Generally don't redirect the streams unless you intend to read/write them.

I'd generally recommend to redirect streams of apps you don't want the user to interact with directly.  After redirecting, you should close the input stream, and consume the output/error streams.

According to logs it seems that chmod process is in zombie state after the call, and there's no return value from Process.Start()

Can you get the stacktraces from all threads? That will give us some information about where Process.Start is blocked, and maybe what other thread is blocking it.

Generally don't redirect the streams unless you intend to read/write them.

I'd generally recommend to redirect streams of apps you don't want the user to interact with directly.  After redirecting, you should close the input stream, and consume the output/error streams.

Net core version: 3.1.0

Can you also try using the latest 3.1 patch version?

Net core version: 3.1.0

Can you also try using the latest 3.1 patch version?

@tmds yes thanks, I will increase logs verbosity and we will try it with a customer also

@tmds yes thanks, I will increase logs verbosity and we will try it with a customer also


Clearly communicate compatible postgresql version

With the introduction of the new CDB_QuantileBins, this extension is only compatible with postgresql versions 9.4+. There may be other features like being marked parallel which break backwards compatibility.
It would save users some headaches if there was a version check that aborted the install and communicated the supported versions if the pg version is not supported. For example: https://github.com/CartoDB/cartodb-postgresql/commit/39998a9c88e788d1982f468427531f7314e039ed#r28723290

cc @Algunenano

Being marked PARALLEL shouldn't affect since it's dropped for non compatible releases, so we could simply update the [dependencies])(https://github.com/CartoDB/cartodb-postgresql/blob/master/README.md#dependencies) in the README.
Although that would be enough I think we should be running the CI with whatever PG releases we want to support.

100% on the CI for PG releases. I'll do a quick PR to update the README


WIP: Add checkpointing within remote write;

For #6333, this PR adds a file per queue with the highest timestamp from a sample that has been sent by that queue. This allows the queue to restart from that point in the event of a restart, potentially decreasing the number of samples lost in the case of remote write being far behind or not able to flush when it shutdown last.
Feel free to ignore queue_manager_test.go for now. Once https://github.com/prometheus/prometheus/pull/6043 is merged the naming of the queue and therefore the naming of it's checkpoint file will be much simpler.
@csmarchbanks
Signed-off-by: Callum Styan<EMAIL_ADDRESS>

How did this interact with there being no ordering of samples by timestamp
within the WAL?
On Fri 22 Nov 2019, 18:43 Callum Styan<EMAIL_ADDRESS>wrote:

This PR adds a file per queue with the highest timestamp from a sample
that has been sent by that queue. This allows the queue to restart from
that point in the event of a restart, potentially decreasing the number of
samples lost in the case of remote write being far behind or not able to
flush when it shutdown last.
Feel free to ignore queue_manager_test.go for now. Once #6043
https://github.com/prometheus/prometheus/pull/6043 is merged the naming
of the queue and therefore the naming of it's checkpoint file will be much
simpler.
@csmarchbanks https://github.com/csmarchbanks
Signed-off-by: Callum Styan<EMAIL_ADDRESS>You can view, comment on, or merge this pull request online at:
https://github.com/prometheus/prometheus/pull/6363
Commit Summary

Add checkpointing within remote write; a file per queue with the

File Changes

A storage/remote/checkpoint.go
https://github.com/prometheus/prometheus/pull/6363/files#diff-0 (81)
M storage/remote/queue_manager.go
https://github.com/prometheus/prometheus/pull/6363/files#diff-1 (33)
M storage/remote/queue_manager_test.go
https://github.com/prometheus/prometheus/pull/6363/files#diff-2
(100)
M storage/remote/write.go
https://github.com/prometheus/prometheus/pull/6363/files#diff-3 (10)

Patch Links:

https://github.com/prometheus/prometheus/pull/6363.patch
https://github.com/prometheus/prometheus/pull/6363.diff

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/prometheus/prometheus/pull/6363?email_source=notifications&email_token=ABWJG5UG6WLYV64EYJO432LQVAK3PA5CNFSM4JQT5HX2YY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4H3OMUAA,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABWJG5QZSQRDDL5ED5NGCQLQVAK3PANCNFSM4JQT5HXQ
.

@brian-brazil If this is merged the feature should be labelled as best effort.
If we sent a sample with t1 from one series but there was still unsent samples from another series at t0, reading the checkpoint would mean we only send samples after t1. It seemed overkill to track the timestamp per series.

One of the points of the new design is that we don't lose data on things
like restarts, so I'm not sure that's something we'd want to be doing.
On Sat 23 Nov 2019, 17:57 Callum Styan<EMAIL_ADDRESS>wrote:

@brian-brazil https://github.com/brian-brazil If this is merged the
feature should be labelled as best effort.
If we sent a sample with t1 from one series but there was still unsent
samples from another series at t0, reading the checkpoint would mean we
only send samples after t1. It seemed overkill to track the timestamp per
series.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/prometheus/prometheus/pull/6363?email_source=notifications&email_token=ABWJG5UGEB7YE7JBMWGC52LQVFOGFA5CNFSM4JQT5HX2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEE7ZEUQ#issuecomment-557814354,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABWJG5UR4CY5RULBASNTYB3QVFOGFANCNFSM4JQT5HXQ
.

Right now we potentially lose more data on restarts than we would with this
PR.
On Saturday, November 23, 2019, Brian Brazil<EMAIL_ADDRESS>wrote:

One of the points of the new design is that we don't lose data on things
like restarts, so I'm not sure that's something we'd want to be doing.
On Sat 23 Nov 2019, 17:57 Callum Styan<EMAIL_ADDRESS>wrote:

@brian-brazil https://github.com/brian-brazil If this is merged the
feature should be labelled as best effort.
If we sent a sample with t1 from one series but there was still unsent
samples from another series at t0, reading the checkpoint would mean we
only send samples after t1. It seemed overkill to track the timestamp per
series.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<https://github.com/prometheus/prometheus/pull/6363?email_source=
notifications&email_token=ABWJG5UGEB7YE7JBMWGC52LQVFOGFA
5CNFSM4JQT5HX2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5
WW2ZLOORPWSZGOEE7ZEUQ#issuecomment-557814354>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/
ABWJG5UR4CY5RULBASNTYB3QVFOGFANCNFSM4JQT5HXQ>
.

—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/prometheus/prometheus/pull/6363?email_source=notifications&email_token=AAYYTHC3FFBHSTHHMWY2CMDQVFQRXA5CNFSM4JQT5HX2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEE7ZRLQ#issuecomment-557815982,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAYYTHB2LNKORFVSNOSBXULQVFQRXANCNFSM4JQT5HXQ
.

Why not checkpoint the segment number when we complete reading a segment?

Because we don't want to retransmit samples we've already sent. Segments are 128MB.
If we're 90% of the way through a segment B with some more buffered but the remote endpoint goes down, if we just use the segment number A as a checkpoint we would have to start from the beginning of B on a restart. Currently we wouldn't do that, nor we would attempt to transmit from part of the way through B for what was missing on shutdown. We simply take the time.Now() of when remote write started up and only send samples with timestamps higher than that.

I'd think it'd be better to retransmit than to drop samples.

During regular operation we try to do at least once delivery, and I think the goal should be to keep that behavior across restarts as well. If a segment number is too big, you could consider checkpointing the segment and offset.

I'd think it'd be better to retransmit than to drop samples.

Before we implement something that could result in (potentially) an entire segment being re-transmitted I'd want to confirm whether we documented an intention to not do something of that nature anywhere in the past, and whether current remote write implementations are handling duplicate samples properly.

If a segment number is too big, you could consider checkpointing the segment and offset.

For this approach I'd need to go back and do some refactoring of the way remote write tails the WAL and in addition I don't know if there's any guarantees for segments/offsets in a segment to be consistent across restarts. Repair and truncation could occur when Prometheus restarts.
I went with this implementation for now because I believe it gets us most of the benefit (not losing any samples) without adding a lot more code to maintain within remote write. If there's consensus that doing this checkpointing in a best effort isn't enough I'll close this and start on a design doc for other options.

I think if we are to implement checkpointing we should try to do it correctly. This implementation is better than what we have now, but will need to be updated in the future. Plus, we would probably still want to read this checkpoint too meaning multiple versions of checkpoint code.
I believe that once a page in a segment is written it is immutable, so the offset should be stable across restarts. If you look at the stackdriver sidecar they use an offset for their checkpoint.
One other thing to consider in any approach is the sharding calculation, it will need to be completely redone as the expectation that samplesIn >= samplesOut will no longer be valid.

I think if we are to implement checkpointing we should try to do it correctly. This implementation is better than what we have now, but will need to be updated in the future. Plus, we would probably still want to read this checkpoint too meaning multiple versions of checkpoint code.

Fair, I'll start a doc and we can discuss there/the mailing list.

I believe that once a page in a segment is written it is immutable, so the offset should be stable across restarts. If you look at the stackdriver sidecar they use an offset for their checkpoint.

My only concern is ensuring this is also true when the WAL is truncated/repaired when Prometheus is restarted. I think it is, since repair deletes the data after the corruption, and we always start writing to a new clean when we start.

One other thing to consider in any approach is the sharding calculation, it will need to be completely redone as the expectation that samplesIn >= samplesOut will no longer be valid.

Good point.


Steps to reproduce:
1.Take a formulaic assemblicator
2.try crafting a cake
3.Boom, no more buckets
Version (make sure you are on the latest version before reporting):
Forge: <IP_ADDRESS>3
Mekanism: <IP_ADDRESS>2
Minecraft: 1.11.2

Fixed in 1.11.2 development


Integration with Strava

Why
Strava allows walkers / runners / cyclists (myself included in this) to log their daily commute via GPS. It would be useful to have an integration which automates the daily totals for these activities.
Useful for

a more accurate comparison with driving, public transport etc
automation rather than entering into the app

How
Strava has an extensive API here https://developers.strava.com/

I will work on this please :)

Neat! Looking forward to seeing this!

Hi @nhc, how is it looking? :)

Is this still of interest and still being worked on? I'm happy to pick it up if needs be.

Is this still of interest and still being worked on? I'm happy to pick it up if needs be.

Please take it over. I started something last year and I didn't get very far. Apologies for not replying sooner.

Hey @ssmssam, hope you haven't spent too much time on this yet as we're unfortunately sunsetting North (tmrow.com/blog/sunsetting-north).
I'll close this issue so everyone is aware :)


Update external site Typography docs with new content

Child issue related to #4057
Galao Goal: To be completed by EOS

Oct 8 Update: PR created #4265
Next step: Review required

EOS Update: Reviewed, has been completed.


add c, java, c++

I also think that C would be a nice addition.
On anarchy golf, C is the 4th most golfed language (964 challenges completed), second only to Python, Perl, and Ruby, and surpassing JavaScript and J.
Java and C++ don't seem to get much attention there, and likely wouldn't here either.

Does it have to be Clang/GCC? Something like https://bellard.org/tcc/ would be a lot easier to support in a scripting environment.

Seems pretty easy to support, handles unicode, reading from stdin, and if you ignore the warnings, quite pithy ;-)
$ echo 'main(int n,char**a){for(int i=1;i<n;i++){puts(a[i]);}}' | tcc -run - foo ☃ bar
<stdin>:1: warning: implicit declaration of function 'puts'
foo
☃
bar

A few things to note:

TCC is currently not maintained (final release is 0.9.27 released December 2017).
Although TCC compiles faster, the executable produced by GCC is much faster, from a few tests, between 2 and 10 times faster, depending on the source.
Parameter evaluation order is reversed between GCC and TCC. For example:

i;main(){printf("%d %d %d\n", ++i, i, i++);}

Because GCC evaluates parameters strictly right to left, this will print 2 1 0. TCC prints 1 2 1, because it evaluates left to right, with bare references last. This isn't necessary incorrect - as I understand it parameter evaluation order is unspecified in the C standard - but a notable difference.
Barring the parameter order, and slow execution speed, my collection of C golf all compiles and runs fine, so it seems to be a viable choice.

@primo-ppcg Last stable release was 2017 but they do seem quite active in the repo: https://repo.or.cz/tinycc.git/shortlog
So I'll give it a go, worst case the compiler can be replaced like what happened with JavaScript a while back.

@primo-ppcg ION thanks for that implicit int trick, makes the above example even shorter:
i;main(int n,char**a){while(++i<n)puts(a[i]);}

@primo-ppcg ION thanks for that implicit int trick, makes the above example even shorter:
i;main(int n,char**a){while(++i<n)puts(a[i]);}

Even shorter:
main(int n,int**a){for(;*++a;)puts(*a);}

...assuming sizeof(int) == sizeof(char*) 😉

Don't forget codemirror!


AuthFlow().start() no callback and login view does not dismiss

Otherwise please fill in as much of the template below as possible or you can give us a pr.
-->

Version:
Guard 1.3.4
Xcode 14.1 (14B47b)

Severity:
High - The main functionality of the application does not work, API breakage, repo format breakage, etc.
Cannot get callback for Authing.start()
Description:

create new swift project
SPM add package https://github.com/Authing/guard-ios（currently Guard V1.3.4)
In ViewController.swift viewDidLoad() call Authing.start($appid)
Then call AuthFlow().start() and completion sign in and mfa, but do not receive callback, nor does the login view dismiss.

example: https://github.com/leonylcatwork/AuthingV2

我们使用了你的 demo 没有复现此错误，回调正常。


Don't allow users to remove their account

Fixes #51

As I said on IRC, this is not mergeable yet, because RSpec is exiting with the status code 2.

LGTM, merge it if all the tests are passing.


Update dtenv_template.sh

The Hyper key and OpenWeatherMap key can go, I think docker credentials too. We should also say that you need the Azure stuff only if using pulumi. And then it needs a section for the database credentials, currently it only has a section for the ones used by the unit tests.

resolved in #117


Carthage support, Swift 3.1 migration and other minor improvements.

tvOS and watchOS support.
Carthage support.
Swift 3.1 migration.
Added a project that includes the framework and test targets for each supported platform and also the Demo for iOS.
Bumped the pod version.
Updated the Travis CI config.

Awesome PR!
Thanks @arturgrigor

Thanks! 😃
Can you please add the 1.4.0 tag and also push it to the CocoaPods trunk?

@arturgrigor Yeah, already pushed!


test-branch/execute-job/comment-from-wrong-user-on-pr/b9ff83a2-2061-4daf-875e-4b028f4076bd

PR for testing d9d29a36738d9de733683cf3dc76e91f76331fc4

/canonical/self-hosted-runners/run-workflows d9d29a36738d9de733683cf3dc76e91f76331fc4


Fix arrow key navigation deleting mdc-chip-rows.

Chips are being deleted when the user navigates through an MDC backed MatChipGrid using the arrow keys. Key events on matChipRemove directives are handled within MatChip if the keycode is in a HANDLED_KEYS array. MatChipRow mistakenly overrides that array with all keys that it handles (including the arrow keys), when that field's only actual use is for MatChip to determine what keys should be handled in interactions from matChipRemove.
This PR removes that override and renames HANDLED_KEYS to REMOVE_ICON_HANDLED_KEYS to make it more clear to subclasses what overriding it would mean.
Verified that the fix works in the dev app and with a new test.

Merging this as it has already been submitted in google3

This doesn't hurt, but noting that the issue was already fixed by 19425.

That PR fixed it for most cases, but it was still broken for the arrow keys.

Oh gotcha! Thank you for the explanation and the fix!


Host name completion for ping command (feature request)

[x] I have read through the manual page (man fzf)
[x] I have the latest version of fzf
[x] I have searched through the existing issues

Info

OS

[x] Linux
[ ] Mac OS X
[ ] Windows
[ ] Etc.

Shell

[x] bash
[x] zsh
[x] fish

Problem / Steps to reproduce
fzf provides fuzzy completion for ssh and telnet commands by including hosts from /etc/hosts and ~/.ssh/config. This is a small feature request to provide the same capability to the ping command (and possibly traceroute as well). It would be particularly useful that one is able to quickly ping SSH hosts defined in ~/.ssh/config.

See https://github.com/junegunn/fzf#supported-commands
# Add this to your shell configuration file
_fzf_setup_completion host ping traceroute


Support & test remote HDFS access

We believe that accessing existing (remote) HDFS systems will be a common mode of input and output data. We want to support and test this mode of usage.
Some issues to pay attention to:

HDFS version support. Since one is supposed to use client libraries that correspond with the HDFS server version, this affects both our testing and packaging.
NameNode address support. Since its expected that many Spark apps will use the same HDFS (this is common usage) can we provide an option of how to specify the NameNode in a default configuration that means that each app config doesn't have to specify this. (Perhaps putting spark.hadoop.fs.defaultFS=hdfs://<host>:<port> in spark-defaults.conf is the right solution?)
Identity support. How will users identify their username to the HDFS. How will this be configurable? (For example export HADOOP_USER_NAME=<username> in conf/spark-env.sh)
Kerberos support. As an extension to the basic identity support, Kerberos is a commonly used mechanism to provide authentication of the identified user. When will we say we do/don't have support for Kerberos of these remote clusters.
Non-support of HDFS locality. Since we generally expect that these clusters are remote to the Kubernetes cluster, we don't expect to implement any kind of HDFS locality optimization.
Other concerns?

Regarding Kerberos support, we're currently running Spark on k8s in standalone mode, and needed to connect to a secure HDFS cluster. After considering a few approaches, we implemented the following:

A pod containing two containers:

One container that runs preexisting spark-yarn code to authenticate to HDFS with a Secret-supplied Kerberos keytab, generate/refresh Hadoop delegation tokens on a recurring schedule, and write the tokens to a shared local Volume. This preexisting code was essentially independent of YARN.
Another container that polls for changes to the local Volume and updates another k8s secret containing the delegation tokens.

A minor patch to Spark so its CredentialUpdater (and HDFSCredentialProvider) runs in the Spark driver and worker processes without YARN. This code picks up the k8s secret containing the delegation tokens.

Would be happy to share design details or code if this sounds like a strategy that would be generally useful and appropriate.

@mgilham thanks for sharing that approach to getting Kerberos authz support in Spark on k8s in standalone mode -- that's helpful to know that there's prior art.
Matt and I are unlikely to run into the Kerberized HDFS cluster problem for the next few months so this would be a great place for someone with a more immediate need to lead the way.  If you're able to share further design details or code related to this approach I think that would make it much easier for someone to scratch their own itch and add this in.

Identity support. How will users identify their username to the HDFS. How will this be configurable? (For example export HADOOP_USER_NAME= in conf/spark-env.sh)

I played with this a bit. I was hoping to find a way to pass the HADOOP_USER_NAME env var to the driver and executor pods, but I couldn't. It seems there is no easy way currently?

I was hoping to find a way to pass the HADOOP_USER_NAME env var to the driver and executor pods, but I couldn't.

FYI, this is the closest I got to. I issued the following command that uses spark.driver.extraJavaOptions to set the HADOOP_USER_NAME as a JVM property, (HADOOP_USER_NAME can be either a JVM property or an env var), and specifies spark.executorEnv for executors.

$ /usr/local/spark-on-k8s/bin/spark-submit --class org.apache.spark.examples.DFSReadWriteTest --conf spark.kubernetes.driverSubmitTimeout=360 --conf spark.app.name=spark-dfstest --conf spark.driver.extraJavaOptions="-DHADOOP_USER_NAME=kimoon" --conf spark.executorEnv.HADOOP_USER_NAME=kimoon /usr/local/spark-on-k8s/examples/jars/spark-examples_2.11-2.2.0-SNAPSHOT.jar /etc/hostname dfsreadwritetest-etc-hostname

The driver part worked and successfully created the HDFS dir under my user name. But executors failed with permission errors while trying to write in the dir as root.

2017-02-28 19:37:29 INFO  TaskSetManager:54 - Lost task 1.3 in stage 0.0 (TID 7) on spark-dfstest-1488310560364-exec-1, executor 1: org.apache.hadoop.security.AccessControlException (Permission denied: user=root, access=WRITE, inode="/user/kimoon/dfsreadwritetest-etc-hostname/dfs_read_write_test/_temporary/0":kimoon:supergroup:drwxr-xr-x
at org.apache.hadoop.hdfs.server.namenode.DefaultAuthorizationProvider.checkFsPermission(DefaultAuthorizationProvider.java:257)

Non-support of HDFS locality. Since we generally expect that these clusters are remote to the Kubernetes cluster, we don't expect to implement any kind of HDFS locality optimization.

I think locality is pretty important for spark jobs on HDFS. Currently we run spark on mesos, with mesos agents collocated with HDFS datanodes, and a good part of spark jobs are to process the data in HDFS.
To support this, we can add some code to let the user specify custom nodeSelector for the executor pods, e.g. spark.kubernetes.executor.nodeSelectors=group:hdfs

Some preliminary work for basic HDFS support is happening in https://github.com/apache-spark-on-k8s/spark/issues/130 to send the contents of HADOOP_CONF_DIR and YARN_CONF_DIR directories from submitter to the driver for use when accessing HDFS.
We expect this to cover two use cases I've seen in testing so far:

allow reading from hdfs:// URIs that refer to an HDFS cluster by nameservice, rather than NN FQDN, which enables reading from an HA NN cluster
allow writing to nameservice-based URIs as well, for e.g. spark.eventLog.dir values on an HDFS cluster

Obviously a lot more work to be done, but with these basics in place hopefully the group will be unblocked for more richer interactions with HDFS clusters, both in-kube and outside.

Kerberos support is being addressed by #379, #391.


Update street_types.txt

Updated street types based on TERYT database http://eteryt.stat.gov.pl/eTeryt/english.aspx?contrast=default (The central catalogue of streets ULIC)

Thanks! There's something going on with our Travis build, but not related to this PR. Looking into it.


light command

I had a very simple issue:
➤ light lt-cljs-tutorial.cljs
/usr/local/bin/light: line 22: /Applications/LightTable.app/LightTable.app/Contents/MacOS/Electron: No such file or directory
➤

The problem was in my ~/.zshrc shell profile (or ~/.profile or ~/.bash_profile or ~/.bash_rc) I had LightTable.app appended to LT_HOME:
export LT_HOME=/Applications/LightTable.app  # Incorrect
export LT_HOME=/Applications  # Correct
export LT_HOME=/Applications/  # Incorrect

Steps to Reproduce

Set export LT_HOME=/Applications/LightTable.app in your shell profile
Try running light somefile.txt

Environment

Info
Details

Light Table version
0.8.1

Operating system
10.11.5

I want to open another issue for the apparent lack of docs (using this search "opening lighttable from the command line with the light command"). Visual Studio Code I think sets the bar here, but again, this is another issue. Ideally, for mac users, the light command would be explained in the caveats section of a brew cask install.
At a minimum, when you run the light command, we should change these instructions to show what exactly the light command expects for the LT_HOME variable
➤ light
Sorry, cannot find LightTable.app.  Try setting the LT_HOME environment variable to the directory containing LightTable.app.
~ ➤

We should change it to say this:
➤ light
Cannot find LightTable.app.  Add this to your shell profile: (~/.bashrc, etc)
export LT_HOME=/Applications # If LightTable.app is in your /Applications folder
~ ➤

You don't even need to set LT_HOME at all. The light script already checks /Applications.
I'm also unsure what you mean by:

Ideally, for mac users, the light command would be explained in the caveats section of a brew cask install.

We don't publish a Homebrew formula (or bottle). If someone else published one you'll need to seek support from them.


No way to set the debug level up

Is there any way to set the ZOOKEEPER_LOG_LEVEL env?
https://github.com/strimzi/strimzi/blob/5d395aeb1ba55a4299fcdccf357cd6d0c418c167/docker-images/zookeeper/scripts/zookeeper_run.sh#L32
Same issue for the KAFKA_LOG_LEVEL

Good point. We have it supported in the containers it self, but not exposed this as user configurable to the users. Thanks for raising this issue - we will add it to our backlog.

@scholzj or @ppatierno anything in the pipe on your side or is it worth I take a look right now ?

@prune998 it isn't high priority on our side so if you want, a PR will be really welcomed! :)

Well, the way I was thinking of this was :

change the startup script in the Docker image to template the log4j.properties file
change the controler to set an ENV VAR with the needed log level, which is used by the startup script.

Any better thought ?

Yeah, I think that would be a good start. I think in a long term there might be a need for more flexibility than just log level. But that can be done later.

This has been now implemented through a different issue and can be closed.


testing pydantic v1.10.0a2

TO NOT MERGE
This is pull request is just to test pydantic v1.10, see https://github.com/pydantic/pydantic/discussions/4359

Hi, please can you kick off tests so I can check if v1.10 will break anything.

Codecov Report

Merging #86 (7bc8754) into master (7584cb1) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master      #86   +/-   ##
=======================================
  Coverage   91.14%   91.14%
=======================================
  Files          88       88
  Lines        4368     4368
=======================================
  Hits         3981     3981
  Misses        387      387

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

Yep, runned. Seems at least that my tests are fine with the new Pydantic version, @samuelcolvin

that's great, thanks so much.


all links in sideNav are not visible

Link in the bottom of sideNav are not visible in Desktops.

screenshot

Altough both #83 and #87 address the issue, I self-vote for #87.
The root cause of the issue is that min-h-full and lg:top-20 are specified simultaneously, so the sidebar extends outside the window.
#83 adds pb-20 class to the nav in the sidebar, preventing the links run out the window, but the sidebar itself extends outward yet.
#87 replaces lg:h-auto to lg:min-h-0, which fixes the height of the sidebar.


Comparison with other tuning methods

Thanks for your interesting work! I've some questions about your work:

In my opinion, TruthfulQA is just an ordinary dataset, and there is no difference between it and other datasets (like MedicalQA). So your work is just an interesting method to regress given datasets (by adjusting the distribution), or it can impore the general ability of the model to generate more "truthful" answer?

In Table1, you compared your method with Supervised Finetuning and Few-shot prompting, Is there more comparison between your mothod and other tuning methods like LLaMA+LoRA? If possible, could you compare your method with LLaMA+LangChain, because in practice if we want LLaMA to generate more precise answer, we'd consider LLaMA+LangChain first, though I think this method is inelegant and don't like the idea of LLM with database.

Hi there,

TruthfulQA is unique in that it's adversarially designed. It's intended to fool LLLM. On NaturalQuestions and Trivia QA, we show evidence that ITI improves model's ability to generate truthful answers in general.
From Lora and other parameter-efficient finetuning paper, we know that full finetuning acts as an upper bound for parameter-efficient finetuning methods, e.g., Bitfit, Lora, adapter.
You are welcome to try LangChain and share your results here ;)


scan-with-appsweep 2.0.2

Summary

Address warnings for step running locally on non-GNU machines
Properly handle custom build variants

New Pull Request Checklist
Please mark the points which you did / accept.

[x] I will not move an already shared step version's tag to another commit
[x] I read the Step Development Guideline
[x] I have a test for my Step, which can be run with bitrise run test (in the step's repository)
[x] I did run bitrise run audit-this-step (in the step's repository - note, if you don't have this workflow in your bitrise.yml, you can copy it from the step template.)
[x] I read and accept the Abandoned Step policy

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


fix walletLinkConnector url

Example from the demo app:
https://github.com/liteflow-labs/nft/blob/c450c80cec8b456bee0acd299d7cc1aa6d82d47e/apps/demo/pages/_app.tsx#L112-L116
the url should be set using a deployment variable from VERCEL and fallback to localhost for local dev.

@antho1404 is this issue still relevant regarding the work we are doing on Wagmi?

Keeping this open so we can double-check the result once the work on Wagmi is done

This issue was indeed fixed when migrating to wagmi


Align description

Closes https://github.com/MicrosoftDocs/office-docs-powershell/issues/6754
Aligning description as every other SPO cmdlet for this parameter, for example https://docs.microsoft.com/en-us/powershell/module/sharepoint-online/get-sposite?view=sharepoint-ps

Docs Build status updates of commit 56ee250:
:clock10: Pending: waiting for processors (7 builds ahead of you)
:warning: Docs Build is busy, currently there are 7 builds ahead of this one, for more information you can view the Build queue graph on the Docs Portal.

Docs Build status updates of commit 56ee250:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

sharepoint/sharepoint-ps/sharepoint-online/Get-SPOSiteUserInvitations.md
:white_check_mark:Succeeded
View (sharepoint-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

@Kateyanne Please merge this PR.

Docs Build status updates of commit 87af35b:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

sharepoint/sharepoint-ps/sharepoint-online/Get-SPOSiteUserInvitations.md
:white_check_mark:Succeeded
View (sharepoint-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel


DBZ-3969 Strings with binary collation shouldn't be parsed as Types.Binary

https://issues.redhat.com/browse/DBZ-3969
Strings with binary collation shouldn't be parsed as Types.BINARY by MySqlAntlrDdlParser.
As MySQL document  says:

The BINARY and VARBINARY data types are distinct from the CHAR BINARY and VARCHAR BINARY data types. For the latter types, the BINARY attribute does not cause the column to be treated as a binary string column. Instead, it causes the binary (_bin) collation for the column character set (or the table default character set if no column character set is specified) to be used, and the column itself stores nonbinary character strings rather than binary byte strings. For example, if the default character set is utf8mb4, CHAR(5) BINARY is treated as CHAR(5) CHARACTER SET utf8mb4 COLLATE utf8mb4_bin. This differs from BINARY(5), which stores 5-byte binary strings that have the binary character set and collation. For information about the differences between the binary collation of the binary character set and the _bin collations of nonbinary character sets, see Section 10.8.5, “The binary Collation Compared to _bin Collations”.

Nonbinary strings (as stored using the CHAR, VARCHAR, and TEXT data types) have a character set and collation other than binary. A given nonbinary character set can have several collations, each of which defines a particular comparison and sort order for the characters in the set. For most character sets, one of these is the binary collation, indicated by a _bin suffix in the collation name. For example, the binary collation for utf8 and latin1 is named utf8_bin and latin1_bin, respectively. utf8mb4 is an exception that has two binary collations, utf8mb4_bin and utf8mb4_0900_bin; see Section 10.10.1, “Unicode Character Sets”.

So, columns such as char binary, varchar binary are nonbinary strings type but using binary collation. Parsing them as Types.BINARY may produce incorrect default value.

Good spot, and the fix LGTM; merging. Out of curiosity: how did you notice this, did you encounter any actual issue with it?

@gunnarmorling Hah, When I do some tests of #2671.

Gotcha, thx!


Add a new Linux  Book

I want to add this book to the repo, I have studied this book myself and this is an amazing book to get started with.
Link: https://doc.lagout.org/operating system /linux/Beginning Linux Programming%2C 4 Ed.pdf

Sorry, is copyrighted content (see page 9)


Update fr.coffee

@amSaighi could you sign our CLA so we can accept your PR?

@amSaighi could you sign our CLA so we can accept your PR?

Done,
I must sign yo our CLA, after any username change ?

We check it by the username, so yes.


Conditional browser export resolved during ssrLoadModule

Describe the bug
Importing a local module with conditional exports will resolve to the browser export during SSR.
This only seems to affect local modules (i.e. modules not in node_modules).
A module with this package.json will result in browser.js being loaded when calling ssrLoadModule.
{
  "name": "my-module",
  "private": true,
  "type": "module",
  "exports": {
    ".": {
      "browser": "./browser.js",
      "default": "./ssr.js"
    }
  }
}

Reproduction
https://stackblitz.com/edit/vitejs-vite-vavgsk?file=main.js&terminal=dev
System Info
System:
    OS: Linux 5.0 undefined
    CPU: (4) x64 Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz
    Memory: 0 Bytes / 0 Bytes
    Shell: 1.0 - /bin/jsh
  Binaries:
    Node: 16.14.2 - /usr/local/bin/node
    Yarn: 1.22.10 - /usr/local/bin/yarn
    npm: 7.17.0 - /usr/local/bin/npm
  npmPackages:
    vite: ^3.1.0 => 3.1.2

Used Package Manager
npm
Logs
No response
Validations

[X] Follow our Code of Conduct
[X] Read the Contributing Guidelines.
[X] Read the docs.
[X] Check that there isn't already an issue that reports the same bug to avoid creating a duplicate.
[X] Make sure this is a Vite issue and not a framework-specific issue. For example, if it's a Vue SFC related bug, it should likely be reported to vuejs/core instead.
[X] Check that this is a concrete bug. For Q&A open a GitHub Discussion or join our Discord Chat Server.
[X] The provided reproduction is a minimal reproducible example of the bug.

The import './my-module'; in server.js should fail.
If the specifier starts with ./, it just resolves to that absolute path. It doesn't look for the package.json.
https://nodejs.org/api/esm.html#resolver-algorithm-specification