Enhancement: b3sum add -c --check flag for verification

Adding -c, --check would make b3sum a drop in replacement for b2sum in some scripts.

Is there interest in completing this feature? It looks like there are a few unresolved issues with PR #44 and those issues appear to be more policy (requirements) related than technical/implementation/defects.
I am a heavy user of "b2sum --check" and would like to use b3sum, for performance reasons. In one trivial use case I am able to check a dir of files in 42s with b3sum that takes 5m37s with b2sum. That's a big difference but atm I have to do the check out-of-band which is neither convenient or reliable (in my case).
I'd like to help get this feature released but not sure how to contribute.

I'm definitely interested in the abstract. It just hasn't been a priority of mine. There were some policy questions that came up in that PR, which I think it might be a good idea to for us to try to answer before we write much more code. Let me see if I can list them here:

Weird filepath support. Can filepaths contain e.g. newlines? Can they contain invalid UTF-8? "Do whatever Coreutils does here" could be a reasonable answer, but Coreutils actually does some very non-trivial things, and I'd want to make sure we really understand what those are.
Windows support. I don't know whether "do whatever Coreutils does" will work for us here. Can filepaths contain Windows path separators (\)? Should they do so by default on Windows? If so, is an output produced on Windows verifiable on Unix? What happens to paths from Unix systems that contain \ as a filename character? (Such paths aren't even representable on Windows as far as I know, so tools like Zip and Git have to use hacky escaping workarounds. I don't think we have to make everything magically work, but I'd like to have a good idea of what will work and what won't.)
Nonstandard hash parameters. Can we verify hashes that aren't 32 bytes? If so, should we auto-detect the hash length? Can we verify keyed hashes? My biggest concern here is that supporting short hashes could be a security problem.

For all of these things, I strongly lean towards "support as few things as possible now, such that we can choose to add features later as needed". Once we start encouraging people to start saving check files, it'll be painful to make any changes that break existing users.

Maybe some of these questions can get swept under the rug as "we don't construct paths ourselves, we just get them from the command line"? I'm not totally sure. In Rust terms, command line args come to us as OsString, and there's no "unopinionated" conversion from OsString to String or Vec<u8>.

Thank you for responding so quickly!
I suspect (hope) that the coreutils folks will adopt blake3 and create their own b3sum, with all the fancy rules they want. I liked you comment about aiming for a 90% solution at 10% the effort.
IMO, the contract must be that --check shall consume whatever b3sum produces as output. The output requirements should have priority and --check should do the best it can with whatever that is.
So...

Weird filepath support. b3sum must accept valid filepaths, for the OS it's running on. I haven't looked into what b3sum does now on output but I would expect it would backslash escape CR, LF and backslashes. I expect the output to be OsString since the output must be readable to the user. If we force output to UTF-8 the user won't be able to read it correctly if they're not using UTF-8.
Windows support. I believe it's the user's responsibility to deal with this. As you point out, a backslash could be present in a unix filename so the presence of a backslash cannot universally signal a windows path. This, to me, is part of the 90% solution approach.
Nonstandard hash parameters. The secret key is not output by b3sum (good thing) and therefore will not be available to --check. The consequence of this is that the input to --check will not have keys therefore either no hash uses a secret key or all use the same key. The tricky part is that b3sum must consume hashes via stdin which is where the secret key comes from. I'm inclined to require the user to prepend the hash stream with the secret key raw bytes. Not trivial, but possible. So, when --check is invoked with --keyed, the first 32 bytes are assumed to be the secret key and the remainder of the input is the hash stream. The secret key would be applied to all hashes. Variable lengths would need to be supported. I understand the security concern but, imo, --check should consume whatever b3sum produces. I'd leave it to the user not to harm themselves.

Re hash length. I would prefer that the hash length be part of the hash such that a 16 byte hash would produce a different value from the first 16 bytes of a 32 byte hash. IOW, truncating the hash to 1 byte would not produce the same hash as when computing a 1 byte hash. This would address your security concern, which exists irrespective of whether --check is doing the verification or users are doing that verification out-of-band.
Would it help if I documented coreutils' behavior wrt filepathing?

I'm interested in the feature and subscribed accordingly. I want to be able to use b3sum as a drop-in replacement for sha256sum, but verifying the sums myself increases the odds that the benefits of using BLAKE3 to produce the sums might end up wasted if my scripting after the fact isn't up to snuff.
I'm 100% in support of "support as few things as possible now, such that we can choose to add features later as needed" because my use case is probably the most feature-minimal: compare a single hash of default length as a string to the output of a hashing operation performed on a file in the current directory. I understand it's not as straight-forward as it sounds, it's just an example of how minimal my requirements are.
That said, while I've looked at the PR in the past, if someone can explain some concrete needs (i.e. if the above answers are the definite agreed-upon desired functionality) I might be able to try to contribute more tangibly.

Ok I understand the md5sum (and other Coreutils [HASH]sum utilities) behavior better now, based on this StackExchange question and the docs that it links to:

Without --zero, if file contains a backslash or newline, the line is started with a backslash, and each problematic character in the file name is escaped with a backslash, making the output unambiguous even in the presence of arbitrary file names.

For example, a filename with a newline in the middle looks like this:
\d41d8cd98f00b204e9800998ecf8427e  abc\ndef

And a filename with a backslash in the middle looks like this:
\d41d8cd98f00b204e9800998ecf8427e  abc\\def

Every other character (or I should say every other byte, since invalid UTF-8 is allowed) is copied literally to the output.
A subtle point here is that this is backwards-compatible with older versions of md5sum that did not do this escaping. That means an old checkfile with a literal, unescaped backslash in one of the filenames will still work today, even if it's coincidentally followed by an n character, because unescaping is only done with the line starts with a backslash. (Though I assume unescaped newlines are still hopeless.)
Another subtle point here is that, if --zero isn't used, it's possible to have a null character in the middle of a filepath. I don't think it's possible to make md5sum emit such a filepath, but it's certainly possible to insert a null character in the output manually, and then we have to ask what happens if md5sum consumes that doctored output. As far as I can tell, the answer is that it ignores all characters after the null, I assume because it passes the string directly to libc, which interprets the interior null as terminating. I think we should error out in this case, by explicitly checking parsed strings for interior null, rather than reproducing this behavior.

Summing all that up, I think "do exactly what md5sum does, but be more aggressive about panicking on interior nulls" could be a good policy on Unix. However, I think it's going to give us trouble on Windows.
The first problem is that Windows filepaths aren't "arbitrary bytes", but rather "arbitrary byte pairs" (that is, arbitrary 16-bit characters). If we converted byte pairs to bytes in the naive, literal way, then "abc" on Unix would correspond to "a\0b\0c\0" on Windows. That wouldn't be acceptable; even in the most trivial cases, check files wouldn't be portable between Unix and Windows. (And I'm not even going to guess at how a Windows terminal would display those bytes to the user.)
The more reasonable strategy is to parse Windows paths as UTF-16 and convert them to UTF-8, however this runs into the second problem: Windows paths aren't guaranteed to be well-formed UTF-16. They might contain unpaired "surrogate characters" which can't be represented in well-formed UTF-8. This is why "WTF-8" was defined, and it's essentially the entire reason the OsString type exists in Rust. (If the whole world was Unix, we could probably just use &[u8] and Vec<u8> everywhere we use OsStr and OsString today.)
It's tempting to say "ok, just use WTF-8 in the output," but the spec is quite adamant about this:

WTF-8 must not be used to represent text in a file format or for transmission over the Internet.

I'm not saying I wouldn't violate that rule if my life depended on it, but my life doesn't depend on it, and I'm going to take the authors at their word and assume that violating it would cause more harm than good :)

Given all that, here's what I propose:

All b3sum output is valid Unicode, always. We can leave open the possibility that we could detect some system/terminal encoding other than UTF-8, and convert to that as a final step, but for now this means all output is UTF-8.
Paths are received from the command line as OsString and opened in that form, so that hashing any file works. However, before emitting any output, paths are converted with .to_string_lossy(), replacing non-Unicode sequences with the � character.
When Unicode conversion is lossy, an additional line is emitted, in order to prevent b3sum from consuming the result as a valid check file. This could be anything that doesn't parse, but I recommend a comment line like: # Warning: Invalid unicode.
If --zero is not used, md5sum-like escaping is applied. All backslash and (Unix) newline characters are replaced with the escape sequences \\ and \n, and any line containing those escape sequences is prefixed with a \ character.
When consuming a check file, b3sum asserts that every line begins with a valid hash, with an optional \ character. (This is the part that will fail on comment lines, without requiring any comment-specific logic.) De-escaping is only done if the \ character is present. If de-escaping is done, any backslash sequence other than \\ and \n is an error. In addition, b3sum asserts that parsed filenames don't contain any interior null characters.
For now, --check is incompatible with any flags that modify the output, like --length or --keyed. Only unkeyed, 32-byte hashes can be checked. We can consider relaxing this in the future.

Major oversight above: We obviously shouldn't escape the backslashes in C:\foo\bar.txt on Windows. Does anyone know what md5sum does on Windows? (I see on Google that there is such a thing as "Coreutils on Windows", but I've never used it.) Maybe we can solve the problem with two additional rules:

After converting to Unicode strings, but before escaping, backslashes in Windows paths are normalized to forward slashes.
On Windows, b3sum reports an error if there are any backslashes in a filepath.

The goal there is that files with backslashes in their names can be hashed and checked on Unix, but attempting to check such a file on Windows is always an error. (The file cannot exist, and we don't want a name fragment to unintentionally match a directory name.)

Backslashes are escaped on Windows:
C:\Users\John>md5sum.exe \\.\C:\Users\John\Desktop\b3sum_windows_x64_bin.exe
\1d54334dd99612a139fbb51736290e85 *\\\\.\\C:\\Users\\John\\Desktop\\b3sum_windows_x64_bin.exe

Thanks, that makes sense. Looks like they don't have any special handling for Windows. I think we can do better, tentatively leaning towards the two rules I suggested above. Here's the scenario I'm imagining:

A Windows user clones this repo.

That user runs something like
b3sum README.md Cargo.tomlm src\lib.rs

(note the backslash) and captures the output as a checkfile.

They send the checkfile to a Unix user.

The Unix user clones this repo too, and then runs b3sum --check on the checkfile.

I don't think we should go crazy with cross-platform compatibility, since non-Unicode paths tend to be totally unrepresentable on other platforms anyway. But "unzip an archive and hash the files in it" is the core use case of --check, and if all the filenames in there are well-behaved, it seems reasonable to make it work. If I understand correctly, it'll work today with md5sum if you go from Unix to Windows, but not if you go from Windows (with standard backslash-separated paths) to Unix.

By the way, in @sneves output above, I see a * character at the start of the path. What's that doing there? Is that some special feature of md5sum that I don't know about yet?

putchar (file_is_binary ? '*' : ' ');
Indicates whether the file is read in fopen(name, "rb") or fopen(name, "r")

Ok, yeah, I think it's safe to say b3sum will just always use binary mode, and never print the *.

To be clear, * indicates binary mode.

Apparently it's "binary mode, if the difference is significant", which I assume means "only on Windows" in practice? Anyway, we'll always read raw bytes regardless of the OS, so I don't think we need to worry about it.

Ooo, credit where credit is due, it looks like macOS does not allow invalid Unicode filenames!

Looks like the Clap argument parsing library might have a bug on Windows that'll get in the way of testing this: https://github.com/clap-rs/clap/issues/1905

I've finished a --check implementation and pushed it to master. Its exact behavior is documented here: https://github.com/BLAKE3-team/BLAKE3/blob/master/b3sum/what_does_check_do.md. I'd really appreciate it if folks could test it out, especially folks on Windows. The intention is that producing a checkfile on Unix and checking it on Windows should work, and vice versa.

Basically as soon as someone tells me that they've tried this and it seems to work for them, I'm gonna release it :)

Linux

Simple case, no paths: Verified detection of mismatch, returns 1. All good return 0. As expected.
With path structure (rel and abs): a-ok
Unicode text "Funky näme.txt" as expected in hash output and verify output

Windows

Globbing does not work: eg b3sum *.rs return "b3sum: The filename, directory name, or volume label syntax is incorrect. (os error 123)"
Simple case, no paths: Verified detection of mismatch, return 1. All good return 0. As Expected.
With path structure  (rel and abs): a-ok
Noted that backslashes in path are converted to forward slash in output
Unicode text "Funky näme.txt" in looks like "Funky n├ñme.txt" in the output

Check works as expected and outputs "Funky näme.txt: OK"
Verified hash output looks right when viewed as UTF-8

Confirmed b3sum hash from Linux verifies on Windows and hash from Windows verifies on Linux

This is awesome! Thank you very much. This is going to speed up several of my workflows substantially.
nice to have (from b2sum):
--quiet          don't print OK for each successfully verified file

Thanks for kicking the tires!

Windows: Globbing does not work

T is expected. Globbing is done by the shell on Unix, and my understanding is that the Windows shell has never supported it, and every different program does its own thing (or nothing). That said, I don't know which tools go through the trouble of supporting globbing on Windows. It seems like it would create an awkward situation involving filepaths with literal * characters in their names...

Windows: Unicode text "Funky näme.txt" in looks like "Funky n├ñme.txt" in the output

Is there any right thing to do here? Presumably the current codepage can't even represent most characters?

nice to have (from b2sum): --quiet

That does sound nice to have, and it should be very quick to implement. Let me take a shot at it.
Relatedly, I'm curious if anyone actually uses --zero.

Thanks for kicking the tires!

Windows: Globbing does not work

T is expected. Globbing is done by the shell on Unix, and my understanding is that the Windows shell has never supported it, and every different program does its own thing (or nothing). That said, I don't know which tools go through the trouble of supporting globbing on Windows. It seems like it would create an awkward situation involving filepaths with literal * characters in their names...

Windows doesn't allow literal * or ? in filenames (or \, /,:,", <, > or | ). So, it should be safe to use the following when run on Windows (assuming it does what I think it does).
https://docs.rs/glob/0.3.0/glob/

Windows: Unicode text "Funky näme.txt" in looks like "Funky n├ñme.txt" in the output

Is there any right thing to do here? Presumably the current codepage can't even represent most characters?

I just noticed that the output of b3sum looks right unless it's directed to something that isn't console.  I also verified that notepad and notepad++ show the saved output correctly so are detecting UTF-8. It's really only the type command that doesn't 'do the right thing'. So, I'm a-ok with the behavior as-is.

nice to have (from b2sum): --quiet

That does sound nice to have, and it should be very quick to implement. Let me take a shot at it.
Relatedly, I'm curious if anyone actually uses --zero.

There's probably a tool out there that execs b2sum and doesn't want to be bothered with parsing the output. I don't know what it might be but I don't see a need to implement this option unless someone shows up asking for it.

The MSVC C runtime is already perfectly able to handle globbing on its own, however this is not enabled by default. By linking against setargv.obj, or by defining
extern "C" _crt_argv_mode __CRTDECL _get_startup_argv_mode()
{
    return _crt_argv_unexpanded_arguments;
}

oneself, globbing becomes transparently enabled.
So with some special linker incantations, it should be possible to enable globbing on Windows without any extra code.

Interesting. Reading through this thread, I found a link to the wild crate, which looks to be for exactly this problem. I'll try it out.

Shipped as part of version 0.3.4! Globbing and --quiet support included.

Not sure if this is a bug or a feature but it makes it unable to be a drop-in replacement for sha256sum.
using --check --quiet requires 2 places between the filename and hash otherwise we get Invalid space error.
root@node0:/tmp# b3sum --check --quiet <<< "0b8b60248fad7ac6dfac221b7e01a8b91c772421a15b387dd1fb2d6a94aee438 hi"
b3sum: Invalid space

root@node0:/tmp# b3sum --check --quiet <<< "0b8b60248fad7ac6dfac221b7e01a8b91c772421a15b387dd1fb2d6a94aee438
 hi"


Update manifests/p/Piriform/CCleaner/6.03/Piriform.CCleaner.locale.en-US.yaml

Fixes an issue where this package has multiple different monikers
Microsoft Reviewers: Open in CodeFlow

[Policy] Reset Labels


[stable/fluent-bit] Added support of Decode_Field_As to Regexp parser

Is this a new chart

NOTE: We're experiencing a high volume of PRs to this repo and reviews will be delayed. Please host your own chart repository and submit your repository to the Helm Hub instead of this repo to make them discoverable to the community. Here is how to submit new chart repositories to the Helm Hub.

What this PR does / why we need it:
Regexp parser acceps decoders as well as JSON parser, so I added same support to regexp parser section
@kfox1111 @edsiper @hectorj2f
Checklist
[Place an '[x]' (no spaces) in all applicable fields. Please remove unrelated fields.]

[ ] Chart Version bumped
[x] Title of the PR starts with chart name (e.g. [stable/chart])

@baznikin
Would you mind DCO and bump chart to latest please? Thank you.

@zanhsieh zanhsieh
I bump chart version, but failed to add DCO. How can I do it? sorry for my ignorance

@baznikin
What error occur when you follow the instruction?
https://github.com/helm/charts/pull/17148/checks?check_run_id=263573770

Aaaaaargh! I suppose I shoud drop this PR do do it again RIGHT was. I shoud change very first commit, so --amend won't work. I tried rebase technique but make it even worse.

New PR:
https://github.com/helm/charts/pull/18128


Uncaught Exception - WebSocket is not open: readyState 0

i think the stacktrace might be enough. Happens every 2-3 days.
Mar 03 18:40:57 loxberry node-red[8542]: 3 Mar 18:40:57 - [red] Uncaught Exception: Mar 03 18:40:57 loxberry node-red[8542]: 3 Mar 18:40:57 - Error: WebSocket is not open: readyState 0 (CONNECTING) Mar 03 18:40:57 loxberry node-red[8542]:     at WebSocket.send (/usr/lib/node_modules/node-red-contrib-luxtronik2-ws/node_modules/ws/lib/websocket.js:327:13) Mar 03 18:40:57 loxberry node-red[8542]:     at WebSocket.open (/usr/lib/node_modules/node-red-contrib-luxtronik2-ws/luxtronik2-ws.js:38:21) Mar 03 18:40:57 loxberry node-red[8542]:     at WebSocket.emit (events.js:311:20) Mar 03 18:40:57 loxberry node-red[8542]:     at WebSocket.setSocket (/usr/lib/node_modules/node-red-contrib-luxtronik2-ws/node_modules/ws/lib/websocket.js:172:10) Mar 03 18:40:57 loxberry node-red[8542]:     at ClientRequest.<anonymous> (/usr/lib/node_modules/node-red-contrib-luxtronik2-ws/node_modules/ws/lib/websocket.js:646:15) Mar 03 18:40:57 loxberry node-red[8542]:     at ClientRequest.emit (events.js:311:20) Mar 03 18:40:57 loxberry node-red[8542]:     at Socket.socketOnData (_http_client.js:510:11) Mar 03 18:40:57 loxberry node-red[8542]:     at Socket.emit (events.js:311:20) Mar 03 18:40:57 loxberry node-red[8542]:     at addChunk (_stream_readable.js:294:12) Mar 03 18:40:57 loxberry node-red[8542]:     at readableAddChunk (_stream_readable.js:275:11) Mar 03 18:40:57 loxberry systemd[1]: node-red.service: Succeeded.
Edit: I think i got the problem:
If you're running the command
npm install -g node-red-contrib-luxtronik2-ws
you get a version of the package, but that does not reflect the version of this repo.
The package from npm has no try-catch block around line 38 and 39.
Can you please update the npm package?
Version in
/usr/lib/node_modules/node-red-contrib-luxtronik2-ws/package.json
says 0.1.1 but the code does not reflect the repo.

Just bumped the version and pulished, check if that solves your issue.

Worked perfectly, the try catch block now exists. Thank you for the fast response!


Update coffeescript src to match edited js.

Somehow the generated js got out of sync with the coffeescript (maybe here?)

Thanks for this, but it's actually not needed. Those two lines that were removed somehow didn't get purged (or somehow got moved back) into the JS.  If you look, they're not even being used. We're not looking at sockets anymore, we're looking at server.connections.
If anything, this probably caused a memory leak over time. So thanks for pointing this out.
I regenerated the JS and pushed a new version to NPM after testing things out.


NLP: JAX transformer text classification

This PR adds a tutorial with JAX transformer text classification task on IMDB dataset. It follows one of the Keras tutorials. It's still missing the narrative.
@vfdev-5 I took most of the training, validation and visualization code from https://github.com/jax-ml/jax-ai-stack/pull/95.
I perform dataset preprocessing in a separate function in order to show usage of grain.RandomAccessDataSource.

It may be worth adding a few words about the Grain usage.

Sure! I added a few sentences about Grain.

I would add some "Next steps" notes, either finalizing with an interpretation of the results (why does our model work? Could we have chosen another one? What was the advantage in using the jax-ai-stack here?)

I expanded the last section a bit with what came to my mind - let me know if it should be expanded further.

do we want to be more explicit in these tutorials about which tools we are using are part of the jax-ai-stack?

I added Tools overview section with a few links to the most relevant libraries.

@jakevdp this should be ready now 🚀


getUniqueTaxa: return sorted?

Hi :)
Wouldn't it be convenient to sort the return value of getUniqueTaxa()? I see no advantage of keeping it unsorted? sort() would also remove the NA that can happen, which would be good too maybe?
https://github.com/microbiome/mia/blob/4a09bbed14c283dbcccf09ea21893c1c8f933f22/R/summaries.R#L135
Thanks!
Bela

Hi,
thanks for your suggestion! I agree that sorting might be nice to have. Also, NA is not very informative, and it cannot be used to subset.
We could add there sort = TRUE parameter, so user can choose if return value will be sorted. In addition to that, we could add there a line that removes all the NAs.
There are also other functions (e.g. getTopTaxa) that have this same issue. What do you think @antagomir @FelixErnst?
-Tuomas

Fine with me.
Sorting could happen in different ways, though: abundance, alphabetic, rank.. should the input argument consider these different optons?

I was thinking just alphabetical order. Those others are possible, but they would need more work. For example, getUniqueTaxa is just a wrapper for unique( rowData(tse)[[rank]] )
I'm not sure if that goes too complicated

Thanks! I agree. I would avoid sorting on abundance/prevalence as not required for this function. There is getTopTaxa

IMO unneccessary.
sort(getUniqueTaxa()) works fine, doesn't it? And it is less writing, than adding sort = TRUE

But since Tuomas hid the option in the dots, it is fine for me. Removing the NA by default is I think not a good idea, since a selected rank migh derive meaning from a NA value e.g. "The one bacteria which we cannot assign information on that rank is unique"

That's true, I added there na.rm to select whether to remove missing values or not

Awesome! :) Maybe sort could be TRUE by default?

Hmmm, that would make things easier, if user wants to get taxa in alphabetical order.
However, it is usually better to not do too much stuff that user is not expecting to happen. Especially, when this is some kind of extra functionality
Because of that, I suggest that sort = FALSE by default

Right - yes I agree for alphabetic sorting being enough for getUniqueTaxa but for getTopTaxa we might need other sortings because alphabetic may be misleading. However this is not necessarily too critical for now, if it would be lot of additional work

getTopTaxa returns currently taxa in "top score" order. I think alphabetical order is also nice option for this, if user wants for example top 50 taxa

I personally expected getUniqueTaxa to return alphabetic sorting. Other things in R, like level from as.factor or ggplot2 also always default to alphabetic sorting after all, independent of the order or the underlying data.
getTopTaxa should stay ordered by abundance as it is know imho.
Obviously all options are fine in the end, if we have the parameter to change the behavior. Thanks! :)

agreed with all

Ok, now sorting is also implemented. Another bigger reason for sort = FALSE by default is that we have wrapped this in internal function, because now this option can be hidden. This internal function is called from both getUniqueTaxa and getTopTaxa.
Because there can be only one default value in this kind of implementation, it had to be FALSE, so that taxa are not sorted in alphabetical order in getTopTaxa by default. (We could have implemented two internal function but that would not be convenient.)
To get suggested return value, use
getUniqueTaxa(tse, sort = TRUE, na.rm = TRUE)
Thanks Bela for your suggestions, these are very valuable!
-Tuomas

Awesome! And happy to help!


Invalid Keypair Permissions Crash

coda_crash_report_2020-11-11_13-00-05.457919.tar.gz

@sandhao you need to set the permissions correctly on the private keyfile.
Corrupted coda keypair: insecure permissions on `/usr/local/bin/my-wallet`. They should be 0600, they are 777\\\n  \\nHint: chmod 600 /usr/local/bin/my-wallet\\\

coda_crash_report_2020-11-11_18-25-43.776950.tar.gz

@gnosed this is a seperate issue can you open a new one.
"level":"Fatal","source":{"module":"Init__Coda_run","location":"File \"src/app/cli/src/init/coda_run.ml\", line 575, characters 2-26"},"message":"Unhandled top-level exception: $exn\nGenerating crash report","metadata":{"exn":"(monitor.ml.Error\n  (Failure \"bin_read_t: version read 2 does not match expected version 1\")\n

@gnosed looks like yours is covered here https://github.com/MinaProtocol/mina/issues/6623

@garethtdavies Yes, removing the .coda-config, fixed the problem. Thanks!

The error message and instructions should be much clearer in the next network due to #6741. Will close this once that PR has merged into the develop branch.


Only update topics if there are changes

If there are no changes to the topics no need to update it

@decyjphr I don't have permissions to merge :)

@tspascoal I added you as collaborator with write permissions for the future. I also merged that PR.


Incorrect source-mapping with CRLF

For Will: see flowtest directory provided by user on Discord.

Issue is VSCode treats CRLF as a single character, causing CharPos generated by rustc to map to the wrong VSCode range.

Fixed in #79.


Why does my Manageiq is not rendering compute and network data from openstack?

I'm using Manage iq of ivnachuk-3 version which is integrated with open stack of queens version. It is updating the Manage iq from open stack from only storage perspective, that too for block storage is correctly refreshed with up to date, object storage is not rendered properly. And also my Manage iq is not rendering data from open stack regarding compute and network perspective. Where does the error lies?
in this error snap, it is point out to different remote ip and host, it is not my remote ip. How to rectify this issue. Thanks in advance.

@andyvesel can you take a look?

Adding link to related discussion: http://talk.manageiq.org/t/wy-my-manageiq-integrated-with-openstack-is-not-getting-refreshed/5122

Could anybody who knows what's happening in open stack guide me on this?


Inquiry on Sub-head Layer and SNAC Customization

I have a couple of questions regarding the implementation of your audio codec:

I noticed that the sub-head layer is set to 7. Is this choice of number (7) specifically because SANC requires exactly 7 tokens to generate audio?

Regarding the SNAC output, does it support customizing the timbre of the generated audio? If so, how can this be achieved?

Thank you for your time and assistance!

hi,

yes, the SNAC we use has 7 tokens per frame.
for now, it does not support other timbre. If you have data, you may add a speaker embedding to achieve that. You may refer to zero-shot tts works for more info.

Thank you for your response.
I have an additional question.
In your configuration, the text vocabulary size is 152,000 (151,646 + 64), and the audio vocabulary size is 4,160 (4,096 + 64).
Although they contain similar semantic information, their dimensions differ significantly.
How do you address this discrepancy during the training stage?


Support for Android app bundles

Issue description
Google will require Android App Bundles for new apps starting August 2021. With that deadline approaching, I'm trying to adjust my workflows to use AAB files instead of APKs.
I've added --packageType=bundle parameter to my Ionic CLI build command which allows an aab file to be compiled successfully but the step doesn't recognise it and returns an error because there's no APK file.
Bitrise info

Build URL: https://app.bitrise.io/build/8f17b587-2c4f-4f75-bd8e-7c70ba003983#?tab=log
Bitrise Support enabled: YES
Log:

43 actionable tasks: 43 executed
Built the following bundle(s):
	/Users/vagrant/git/platforms/android/app/build/outputs/bundle/debug/app-debug.aab
Collecting android outputs
No apk generated```

Hi @GForceWeb ,
We released the 2.3.0 version of the step that should add proper aab support to the step.

Great, thanks for that @mateherber. Will Check that out


Nostr share on chapter completion

This is a test of sharing progress through nostr
It checks if you have a nostr extension and then adds a button to share via desktop
Mobile sharing is always visible
A few things to think about

I chose the blastr relay wss://nostr.mutinywallet.com because we are a post-only entity and we want to maximize the places that this post gets seen. If the user wants we could give them an option to set their own relay somewhere down the line.

Nostr Content

Code your own way through the mysteries of bitcoin @savingsatoshi

Preview (If you don't have a nostr extension, nothing will appear on outro-2 on desktop)

TODO

Compress images

Receiving this build error:
Type error: Property 'nostr' does not exist on type 'Window & typeof globalThis
from this code
const handleShare = async () => {
  42 |     if (
> 43 |      typeof window.nostr !== 'undefined' &&
     |                    ^
  44 |       !shared &&
  45 |       progress === (keys[10] || keys[keys.length - 1])
  46 |     ) {

I understand that the nostr object exists in the window type because of the extension but how can i make sure that typescript is happy in this situation that i am respecting type safety?
I tried extending the widnow interface but I may not have done it correctly as that didn't seem to work correctly.

Hey @benalleng I retargeted your branch to dev, please resolve conflicts when you come back from your well deserved vacation 🌴

Here are some visuals users can share along with the copy. Just keeping it simple and re-using the chapter success images. A link to the site can be in the text that goes with the image.

We should have a special message for the last one, when you complete the whole experience.
As far as the interaction, I don't think we need a modal. Let's just add a button and users can decide if they want to share (I really dislike annoying share pop-ups and hope we don't get into that habit with Nostr).

@GBKS do you generally like the post format where it is "chapter-conpletion-image" => "text" => "savingsatoshi npub"

You're right, it's getting a bit big. But not sure that's a huge issue. Ideal would be to have a custom link with a specific preview image, could that be an option?

I like it. It does not work for me on mobile though. I see the button on both Android and iOS. On iOS, I get an error message and the button label changes. On Android, nothing happens when tapping. I assume it's trying to use some URI scheme and I don't have a matching app installed, right? How can we fix that?
Regarding the relays, an alternative to blasting would be to use the window.nostr.getRelays(). I don't think all the extensions support this, so maybe just a thing to look into later?
I saw the image URL is set to share a 1920px wide image at 100% quality. Maybe change to 1200px and 75% quality for faster load times?
If we can fix the mobile issue, it'd be great to put this live soon.

Trying to think about how to check if a signer like Amber (Android) exists to only show it for that user just like on desktop

Regarding the relays, an alternative to blasting would be to use the window.nostr.getRelays(). I don't think all the extensions support this, so maybe just a thing to look into later?

definitely easy enough to do a fallback like windwo.nostr.getRelays() || blastr relay

Uploading signal-2023-11-28-161837_002.mp4…

For the general share button, you could also use the webshare API for browsers that support it. It pulls up an OS-native share sheet that has contextual options based on the users contacts, installed apps, etc.

webshare API for browsers that support it

I dont have a reasonable way to implement and test this with my current setup

could we say that the phone does not support Nostr sharing and point them towards a way to get that set up

Now that some browsers support mobile extensions this error handles both checking if the nostr.inent is undefined, i.e. the user does not have any nostr stuff on their device but also an error occurs if they simply reject the event whether on purpose or accidentally.

OK. Looking good. I'd make the X logo slightly smaller and change the button label to "Share via X". Seems more consistent with the other button. But then maybe let's merge this and see what happens?

You can visit
https://saving-satoshi-git-fork-benalleng-nostr-support-savingsatoshi.vercel.app/_next/image?url=%2Fassets%2Fimages%2Fnostr%2Fnostr-share-chapter-1.jpg&w=1200&q=75
to confirm that these links function with the correct hostname
or view it below noting the url


Remove orphaned localized files

Whoops!
There were 9 warnings that will prevent this PR from being merged. Please take a look, and either fix, or provide a justification for why they can't be fixed.
WARNINGS
src/content/es/fundamentals/security/credential-management/store-credentials.md - Unable to read file, was it deleted?
src/content/id/fundamentals/security/credential-management/store-credentials.md - Unable to read file, was it deleted?
src/content/it/fundamentals/performance/index.md - Unable to read file, was it deleted?
src/content/ja/fundamentals/security/credential-management/store-credentials.md - Unable to read file, was it deleted?
src/content/ko/fundamentals/security/credential-management/store-credentials.md - Unable to read file, was it deleted?
src/content/pt-br/fundamentals/security/credential-management/store-credentials.md - Unable to read file, was it deleted?
src/content/zh-cn/fundamentals/security/credential-management/store-credentials.md - Unable to read file, was it deleted?
src/content/zh-cn/workbox/overview.md - Unable to read file, was it deleted?
src/content/zh-tw/tools/workbox/overview.md - Unable to read file, was it deleted?

:tada: This has been pushed live to https://developers.google.com/web/


fix(store): make withprop primarily use initial value passed to it rather than one passed to propsFactory

PR Checklist
Please check if your PR fulfills the following requirements:

[x] The commit message follows our guidelines: https://github.com/ngneat/elf/blob/master/CONTRIBUTING.md#commit
[x] Tests for the changes have been added (for bug fixes / features)
[ ] Docs have been added / updated (for bug fixes / features)

PR Type
What kind of change does this PR introduce?

[x] Bugfix
[ ] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Build related changes
[ ] CI related changes
[ ] Documentation content changes
[ ] Other... Please describe:

What is the current behavior?

Issue Number: https://github.com/ngneat/elf/issues/238
What is the new behavior?
Does this PR introduce a breaking change?
[x] Yes
[ ] No

Other information

Still in progress. Haven't checked all cases.


Enveomics crashes when opened and says "retrieving enveomics" after terminal installation

Hi, I'm new to programming but have been working on metagenomics using our lab server. I'm trying to install enveomics on my windows 10 and have installed ruby and perl. My script shows the io/console error but it seems to run. When I open Enveomics, it stays on a frozen screen saying "retrieving enveomics" and it either crashes when I click on a tab or just crashes by it self. Any suggestions?

Hi, I have the same problem, have you solve it?

Yeah by just using the online server...
On Fri, Jul 10, 2020 at 12:14 AM zhangws119<EMAIL_ADDRESS>wrote:

Hi, I have the same problem, have you solve it?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/lmrodriguezr/enveomics-gui/issues/35#issuecomment-656503657,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AONZ243UZ7AEZB5X63JXULLR22WV3ANCNFSM4KOP6CPQ
.


Expose alarm limit configuration in the user-facing values file

[X] This contribution adheres to CONTRIBUTING.md.

What does this Pull Request accomplish?
The Alarm Service now enforces limits on the number of alarms that can be created. We've also added a facility to automatically delete active alarms that haven't been updated in a configurable number of days. This PR exposes this configuration in the user-facing values file.
Why should this Pull Request be merged?
From talking to @prestwick, we think it makes sense to expose the alarm limit and retention configuration in the user-facing values file, as it's something users may want to adjust. We're also going to point to this configuration from our public docs.
What testing has been done?
I verified the nesting matches what we have in the service's values file.

Holding this back pending the -08 release notes, as this pertains to functionality added in the -09 release.


LIS drivers for OpenLogic CentOS

The documentation suggests running: rpm -e hypervkvpd prior to installing microsoft-hyper-v package via yum.  We receive a dependency error when trying to remove hypervkvpd.  Should you include --nodeps in your example?  Is it safe to remove this package without the dependencies?  Better yet, can we use yum to remove it and all dependencies prior to installing microsoft-hyper-v?  The documentation should provide a bit more context here. We are using the CoreLogic CentOS 7.5 image from Azure Marketplace.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 978b668c-13f9-a75a-b7ca-17bb59e398a6
Version Independent ID: 8ab14f42-c192-3cde-7f94-7b481276f3d4
Content: Azure Premium Storage: Design for performance on Windows VMs
Content Source: articles/virtual-machines/windows/premium-storage-performance.md
Service: virtual-machines-windows
Sub-service: disks
GitHub Login: @roygara
Microsoft Alias: rogarana

Thanks for the feedback! We are currently investigating and will update you shortly.

@enlightenalpha I have assigned the issue to the content author to investigate further and update the document as appropriate.

#reassign: szarkos


Fix/paths

Added vite-tsconfig-paths

Could u merge these asap? Have some more hooks lined up (eg for storing api keys and interacting with the db)

Yess perfect, thanks for the quick merge 🔥
Wille move them, just noticed that matine has an useLocalStorage hook, so only a db one might be handy.
What are your thoughts on what should go into db versus local storage?


Issue with Firefox and Mobile

Hi Tim,
Thanks for this nice cropper - really easy to implement :)
I've had 2 issues:

Firefox on desktop: the canvas is not always being filled (especially not after the first attempt to select a file).
I've tried it on my mobile device (Samsung S4 - Chrome) - and the image inside the canvas cannot be moved.

It would be great if you could fix it.
Thanks,
Victor

Hi Victor,
Thanks for the issue. I've pushed a couple modifications. Can you try again with the latest version from the repo? If it fixes the issues, I'll push a new release to bower.

Hi Tim,
Thank you so much.
The first issue (FF on desktop) works like a charm :)
The second one (Chrome on Samsung S4 mobile device) - still doesn't work.
Supporting image cropping on mobile devices is less important for me, yet if you decide to fix it as well, I'll be more than happy to test it.
Again, thanks a lot - it's really awesome.
Have a great day,
Victor


Lookup user using BrooklynSecurityProviderFilterHelper

If not available in the context
This fixes a minor issue where the username is logged at the start of a rest request but at the end often fails because it doesn't look it up using BrooklynSecurityProviderFilterHelper.
Per @ahgittin 's suggestion it also adds the username to the logging context.  This means we can log the username with any activities that don't create a task.  This PR https://github.com/apache/brooklyn-dist/pull/186 will modify the log to do this.
It doesn't look like there are any unit tests here so I've just tested locally using the basicauth security provider - I assume this will work with other security providers but I think this will be specific to the provider.  It should at least do the same in both places now.

This looks good.
Just wondering if we want to set the user (in the REST LoggingFilter) as the task.id also, using an MDC like we do for tasks, so that if there is no task, you at least see the user id in the log messages. ?

Looks great.  Merging.

Docs updated in 4ce267ec3d8ef268a06ac9549a72711aa2cf402b


[INFINITY-2455] Properly parse ints in update errors

This PR properly handles integers (or non-string data type) in update specification errors.
The main problem was the the Found field in cosmosError was specified as a string, meaning that int data (e.g. the number of nodes) could not be properly unmarshalled.
I changed the field type (and that of Expected) to interface{} allowing all data types to be handed.
I also added two simple unit tests for two cases.

Thanks for the review and pushing this through @benclarkwood and @nickbp. I have created #1708 to backport these changes.


Beam "effects/run" question

Hi there -
Again, thank you, this tool is 1000% the missing link in making my Beam more useful in my setup.
In a past version of interactor there was the ability to set the direction of an effect (again, on a Beam here, so it constitutes like 25% of my animation possibilities 😂) but I can not seem to find info on it anywhere. Did that go away when "effects/run" was introduced? I know that I could go the route of sending a series of commands and use "set" after applying a theme, but I'm not 100% sure I can send more than one command at once to Interactor.
For example, I'm sending this command:
{     "command": "effects/run",     "args": {         "matcher": {             "product_identifier": "lifx_beam"         },         "apply_theme": true,         "theme_options": {             "colors": [                 {"kelvin": 1750, "brightness": 0.30},                             {"kelvin": 8000, "brightness": 0.30}                             ],             "theme": "HORIZONTAL_STRIPE"         },         "linear_animation": "MOVE",         "linear_options": {           "speed": 90         }     } }
Is it possible to control direction still within "effects/run"?
Also I feel like my usage of "HORIZONTAL_STRIPE" and "SPLOTCH" must be incorrect, as when I send it as above it just leverages the splotch.
You two are doing the lords work here. lol
Thank you in advance, and please forgive me if there is a glaringly obvious answer somewhere that I totally overlooked.

Again, thank you, this tool is 1000% the missing link in making my Beam more useful in my setup.

yay :)

and please forgive me if there is a glaringly obvious answer somewhere that I totally overlooked.

There's basically zero documentation for the interactor, and it won't be fixed anytime soon (or probs ever tbh), I will happily answer questions as a result hahha

Also I feel like my usage of "HORIZONTAL_STRIPE" and "SPLOTCH" must be incorrect, as when I send it as above it just leverages the splotch.

I deleted them when I did this https://github.com/delfick/photons-core/pull/17

Is it possible to control direction still within "effects/run"?

You want "linear_options": {"speed": 90, "speed_direction": "RIGHT"} (or "LEFT") - (long chain leads to here)

I can send more than one command at once to Interactor.

One command at a time, few commands do multiple things. Effects/run essentially does in that it can apply a theme first though!

You two are doing the lords work here. lol

:)

I genuinely do appreciate your responsiveness and willingness to help.  Gave that a shot, but it doesn't seem to want to obey. Tried both "RIGHT" and "LEFT" and they both flow from right to left.
'{
"command": "effects/run",
"args": {
"matcher": {
"product_identifier": "lifx_beam"
},
"apply_theme": true,
"theme_options": {
"colors": [
{"kelvin": 2000, "brightness": 0.30},
{"kelvin": 5500, "brightness": 0.20},
{"kelvin": 5500, "brightness": 0.10},
{"kelvin": 5500, "brightness": 0.00}
]
},
"linear_animation": "MOVE",
"linear_options": {
"speed": 10, "speed_direction": "RIGHT"
}
}

}'
Unless there's something wrong with the string I'm sending? Speed is obeyed, but speed_direction is ignored.
Anyway, I don't want to trouble you with bug hunting here. I can live without the direction control. Just being able to use this with HomeBridge to trigger animations vs. solid colors only is enough for me. :-)
Again, thank you for the timely response. Hope you're doing well!
Cheers

I genuinely do appreciate your responsiveness and willingness to help. It's not always common on GitHub lol

I know what you mean hehehe

Strange. Gave that a shot, but it doesn't seem to want to obey.

I brought out a beam and had a play and I now I remember how this works. You want this
{
    "command": "effects/run",
    "args": {
        "matcher": {
            "product_identifier": "lifx_beam"
        },
        "apply_theme": true,
        "theme_options": {
            "colors": [
                {"kelvin": 2000, "brightness": 0.30},
                {"kelvin": 5500, "brightness": 0.20},
                {"kelvin": 5500, "brightness": 0.10},
                {"kelvin": 5500, "brightness": 0.00}
            ]
        },
        "linear_animation": "MOVE",
        "linear_options": {
          "speed": 10, "parameters": {"speed_direction": "RIGHT"}
        }
    }
}

because photons doesn't inline the options when the field is "dynamic" so speed_direction should be in a "parameters" and then it works

Anyway, I don't want to trouble you with bug hunting here

Nah, this is fine. I don't have time or the mental space to work on photons so much, but very happy to help people figure out how to use it :)

Hope you're doing well!

2022 has been horrible but I'm starting to stabilise again, so that's nice :)

Just being able to use this with HomeBridge to trigger animations vs. solid colors only is enough for me. :-)

:)

Dope! Works like a charm. Thank you so much!


Spy targets are now rebound upon props change, and are thus made dynamic

This change allows for spy targets to be updated when they change (when the prop containing their list evolves), so the library works with a dynamic list of targets.

Here is a second commit to fix your code sample in the README : with Browserify, the React component is no longer what we get directly when requireing the library, since you moved to ES6 classes.

@neemzy Awesome! Thanks :)

Published as v1.1.0.


Water tap present should tag amenity=drinking_water instead of drinking_water=yes if tap supplies drinking water

Try mapping a tap that supplies drinking water, there are a least two relevant presets: the water tap preset (man_made=water_tap) and the drinking water preset (amenity=drinking_water).
The water tap preset asks if the water is drinkable and sets drinking_water=yes if it is, and =no if it isn't. I would suggest that it should tag amenity=drinking_water instead of  drinking_water=yes, if it is drinking water. (It can continue to set drinking_water=no if it isn't.) The fact that the amenity=drinking_water is a tap can be tagged by combining amenity=drinking_water with man_made=water_tap.
Reasons in favour:

a lot of data consumers expect any drinking water source to have the tag amenity=drinking_water: of the six featured layers on osm.org, five will only show the tap if it has amenity=drinking_water. Only one layer (CyclOSM) will show a man_made=water_tap with drinking_water=yes
this leads to counterintuitive results: a mapper who used iD to add a water tap that supplies drinking water and used the man_made=water_tap preset, was understandably surprised why their tap didn't show on the map (example)
in the data, there are 18 916 combinations of man_made=water_tap with amenity=drinking_water and only 7 739 combinations of man_made=water_tap with drinking_water=yes. So amenity=drinking_water seems to be the preferred way of tagging a tap with drinking water
the amenity=drinking_water Wiki page  is clear that a tap that supplies drinking water fits the definition, and the examples show the combination of amenity=drinking_water and man_made=water_tap of amenity=drinking_water. The water_tap page is less clear but in all the tagging examples, when the tag supplies drinking water it always has amenity=drinking_water (sometimes in addition to drinking_water=yes)

Reasons against:

the only real reason I can think of would be if there's a semantic difference between a "source of drinking water that is a tap" (amenity=drinking_water man_made=water_tap) and a "tap that supplies drinking water" (man_made=water_tap drinking_water=yes), but that seems rather tenuous

I asked the question in the community forum and although there were voices on both sides of the argument, only one person tried to make the argument that the two are semantically different, but no else one agreed with them. Most people agreed the current situation is less than ideal.

I don't think the current schema supports this mapping, does it?
Maybe we could use the deprecation rules as a work around to rework the "wrong" tags after they where added by the field?

The current schema supports adding an amenity=drinking_water but it doesn't ask what the drinking water is from (water fountain, tap, well, spring..)

I just read about the replacement key that might be a solution for this issue.
Maybe someone can try to set this up that man_made=water_tap+ drinking_water=yes triggers the replacement for a new, unsearchable preset of man_made=water_tap+amenity=drinking_water (that would be the desired tagging, yes?)?

Some more discussion shows that it's unfortunately more complicated than I thought at first. Some people are keen to make a distinction between a water tap whose main function is to provide drinking water (amenity=drinking_water) and one whose main function is something else (e.g. watering flowers) but where the water happens to be potable (drinking_water=yes). This is also reflected in the justification for closing the StreetComplete issue I created.
I have my doubts that this distinction is being consistently followed by mappers, but anyway.. would it make sense for the preset to enable mappers to tag either amenity=drinking_water or drinking_water=yes, effectively offering a three-way choice between those two and drinking_water=no?

Hey @osmuser63783 can you link to the SC issue as well, please.
I have to say, I am a bit lost on what we want to achieve here, now.
I am assuming you want to modify existing presets and maybe improve search terms?
Could you share the usecase, you want to optimize and the screenshots that users see now … vs. was should happen.
Eg. User searches for X in iD, sees Y but should also see Z. Selects Y but has no field A…

I think what happens is the following

Mapper sees a tap for drinking water
Mapper types either “tap” or "water" into the search in iD
Mapper selects the "water tap" preset and maybe also ticks the box for "drinkable"
Mapper gets confused why most maps don’t show their tap (that's because most maps only show amenity=drinking_water)

Of course you can say that (4) is just a rendering problem: maps could just show man_made=water_tap drinking_water=yes the way they show amenity=drinking_water. But even then the presets are poorly differentiated. It's not clear to the casual iD user that amenity=drinking_water is the better preset for taps that supply drinking water, at least when that is the tap's main purpose. The drinking water preset is barely visible in the search unless you literally type "drinking". (I haven't tested it in other languages but suspect it's similar.)
The SC issue is here: https://github.com/streetcomplete/StreetComplete/issues/5701

Thanks for the details!
It sounds to me, that we should try to get the search priorities sorted. I am not super familiar with this, but I suggest to start a PR and do some testing with the preview that will be generated.
For easy access: The prests:

man_made=water_tab  with field drinking_water=yes|no
amenity=drinking_water

Things you could try:

Add aliases https://github.com/ideditor/schema-builder?tab=readme-ov-file#aliases
Improve the terms https://github.com/ideditor/schema-builder?tab=readme-ov-file#terms
As a last resort, fiddle with the matchScore https://github.com/ideditor/schema-builder?tab=readme-ov-file#matchscore (but this will have side effects that are harder to fix than adding keywords)


fix links to PDF + EPUB in README.adoc

The name was changed during #282, but was then forgot to update in the README.

👍

:+1:


Add Haskell

Haskell :tada: I put some comments in the Dockerfile to explain parts that aren't obvious at first glance.
This image takes around 20 minutes to build because it compiles haskell-ide-engine from source (~200 dependencies), since there are no binary releases that I'm aware of.
TODO

[ ] Make sure this builds on CI (2 GB for docker build is not enough, but 8 GB works on my laptop - click the Docker icon in the icon bar, go to preferences, advanced, increase memory, then restart Docker for Mac) 3 GB is not enough either so we'll have to manually build and push the Haskell image to the Docker Hub

I found out that Travis only gives you 3 GB of RAM, which is not enough to build haskell-ide-engine. It seems we'll have to build and push Haskell manually, unless we can automate it some other way.

 It seems we'll have to build and push Haskell manually, unless we can automate it some other way.

Could we not push a new image which has haskell-ide-engine compiled? Then use that as the base?

Could we not push a new image which has haskell-ide-engine compiled? Then use that as the base?

Oh good idea, I'll go that route :+1:

@chrismwendt are there instructions for rebuilding it? Is the Dockerfile public? Would Docker hub maybe be able to build it automatically (vs Travis)?

@felixfbecker I'm adding instructions in https://github.com/sourcegraph/lsp-adapter/pull/77
Ideally, the owner of https://github.com/haskell/haskell-ide-engine would set up a Docker build. Until then, we'll manually build and push sourcegraph/haskell-ide-engine whenever we want to update it.


FEATURE REQUEST: barBorderRadius settings for individual corners

In the BarChart, the prop 'barBorderRadius' works as expected. However, it would be great to also have the following: barBorderRadiusTopLeft, barBorderRadiusTopRight, barBorderRadiusBottomLeft, barBorderRadiusBottomRight, to set the corners individually. I have a requirement where only the top Left/Right should be set individually.
So the option could be, barBorderRadius is set oevrride inidividual settings, but if not set than look for individual settings, and if noone is set, than defaults.

@hgjura Thanks for requesting this feature. It has already been developed and will be available in the next release. Please have a look at this issue. Here I have provided a workaround for the same.

This is not working for me. I set
cappedBars={true}
capRadius={8}
capThickness={8}
//barBorderRadius={8}
And I see no change. The bars are all square.
I reverse it at
This is not working for me. I set
// cappedBars={true}
// capRadius={8}
//  capThickness={8}
barBorderRadius={8}
And now all corners have radius.
Am I missing a prop somewhere?

Can you share the code? I will check.

@hgjura The problem here is that the default capColor is black, so it's invisible in black background. Adding the prop capColor={"lightgray"} solves the issue.


Added tab command and parser support for it

@KnytJC to implement functionality in execute() method of command.
Closes #191

Coverage decreased (-0.2%) to 69.782% when pulling 66feab94193b17ca6866f060997c1a120ceae9ff on tab-command into 6a90668097dae987bb611b34fde40c4a2c13a197 on master.

@kabir-plod implementation in place

Coverage decreased (-0.4%) to 69.589% when pulling 7dec0a0de42c8018ff53b142f29fa083ad0347bc on tab-command into 6a90668097dae987bb611b34fde40c4a2c13a197 on master.

Coverage decreased (-0.4%) to 69.589% when pulling cccf12fe154c09031b71521a0a6c5d294d6c81d6 on tab-command into 6a90668097dae987bb611b34fde40c4a2c13a197 on master.

Coverage decreased (-0.4%) to 69.476% when pulling 1141fd70a5431ef2e71b3b2234083a60361e5871 on tab-command into d588f3a20549a5edeb5651bd62580068ddf3dd0f on master.


Wondering how to create this design in bar chart

Dear Auther,
I have this design

It has three main features:

Stacked Bars Design : I think already implemented.
Cross Line Selection Indicator,, that will be visible when I select a bar.
Finally a line over the bar indicated another bar value crossing the bar ,, the green on in the following photo,,

Any advise on how to implement that.
Thanks

Hi. Unfortunately we don't support the indicator lines yet.


Settings Page not working in Lightning

Included in beta release version 3.51 (Beta 5) and higher

Included in production release version 3.51


oil refinery no dupe

oil refinery  which works by itself , no need for dupe operating.

Please, next time use the template for a mod request:
https://github.com/javisar/ONI-Modloader-Mods/issues/new/choose

i used it. honest

This issue was moved to javisar/ONI-Modloader#32


fixed test warnings

Coverage decreased (-2.4%) to 13.785% when pulling e27f2b99939352fa5ffd3e91664823e9e463f3c4 on travis-ci-coveralls-update into 9f7020c8415db1db1cb6a0ae1859cb99ec940929 on master.


refactor: Make sure close is only called once for transport WS handlers

When an error happens inside the handler I see a lot of RuntimeError: Unexpected ASGI message 'websocket.close', after sending 'websocket.close'. being raised by uvicorn: https://sentry.2u.app.br/share/issue/83c133f3792c4305b305f0ce31c8ad0c/
This usually happens because the init timeout handler calls close when another close has already being called (due to an error)
Are there any bad side effects for doing this?

Hi, thanks for contributing to Strawberry 🍓!
We noticed that this PR is missing a RELEASE.md file. We use that to automatically do releases here on GitHub and, most importantly, to PyPI!
So as soon as this PR is merged, a release will be made 🚀.
Here's an example of RELEASE.md:
Release type: patch

Description of the changes, ideally with some examples, if adding a new feature.

Release type can be one of patch, minor or major. We use semver, so make sure to pick the appropriate type. If in doubt feel free to ask :)
Here's the tweet text:
🆕 Release (next) is out! Thanks to Thiago Bellini Ribeiro for the PR 👏

Get it here 👉 https://github.com/strawberry-graphql/strawberry/releases/tag/(next)

@patrick91 it seems that the timeout PR also fixed this issue. I changed it to instead of doing what I was doing to instead just add a test to make sure it will not break in the future.
I also removed the RELEASE.md because I don't think a test is enough to justify a new release

Yes, the timeout PR specifically made sure that there were no race conditions in closing the websocket connection.


Removed note on downgrading with precision types

Fixes  #7607.
Removed note about precision on downgrades from INTERVAL, TIME, and TIMESTAMP pages.

This change is

Online preview: http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/f656ef12f7c88eed5bb0b3e2be095076682a0225/
Edited pages:

v20.1/interval.md
v20.1/time.md
v20.1/timestamp.md
v20.2/interval.md
v20.2/time.md
v20.2/timestamp.md


Markers sync

Feature Additions:

Ability to select states / rows in the markers chart.
Ability to select rows from any tree by clicking on the row name from tree.
Ability to navigate markers using "<" and ">".

These changes require an uplift of the timeline-chart before being merged into master.  See: https://github.com/eclipse-cdt-cloud/timeline-chart/pull/216.

@williamsyang-work I think this one is not needed anymore and you can close it.


auto start when user login

we can use windows scheduletasks, just add a button to make it more easy

The default installation method is to just copy the executable to the Startup folder under windows, so I think a button may not be neccessary.


ZIP timestamp nonsense

ZIP file local header has a DOS-format timestamp, which depending on implementation, is TZ relative but doesn't contain any TZ information.
Need to figure out a way to reconcile this...

self.eq(await core.count("file:bytes=$s -> file:subfile +:_archive:mtime=$t :child -> file:bytes +:name=perfection.png +:mime=image/png", opts={"vars": {"s": zip_sha256, "t":<PHONE_NUMBER>000}}), 1)

on GH actions, the ts is<PHONE_NUMBER>000, which is 4 hours off, suggesting a tz issue in the parsing code too


Export Texture to DDS to support Windows 10 Mixed Reality Portal

Microsoft has indicated that the textures that are to be used in the Windows 10 Creators Update Mixed Reality Portal need to be in DDS format.

I think I'd recommend using glTF-Toolkit to prepare assets for MR Portal. When there is a texture compression format in broader/multi-vendor use we can add support for it here.


missing translation in text field footer line

use OS with german menus
create e.g. a new participant

result: in the text field "Über mich" there are only english words in the footer line:

(body, p and strong)
Btw. what does "p" mean? i gues this means "paragraph", but if so, why is only the meaningless abbreviation"p" is used and why do the user need to know that it is a paragraph?

The status line in the footer contains the HTML DOM structure of the entered text. This is just a technical information which can ignored from normal user.  But sometimes an admin wants to know the  nested html tags (e.g. to reduce the formatting which was copy&paste from word). It's a plugin of CK Editor. We can't change the content.
=> won't fix


Replace master with main

In numerous scripts/docs we still use master instead of main.
This change should finish the conversion in language.
Signed-off-by: John Schnake<EMAIL_ADDRESS>

Green tests; going to merge. May find some broken links in the future but we'll just patch them as we go. I think this hit most , if not all, of what we needed.


Testing bug

Challenge use-a-retina-image-for-higher-resolution-displays has an issue.
User Agent is: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:54.0) Gecko/20100101 Firefox/54.0.
Please describe how to reproduce this issue, and include links to screenshots if possible.

<style>
  img {height:100px;width:100px;}
</style>

<img src="https://s3.amazonaws.com/freecodecamp/FCCStickers-CamperBot200x200.jpg" alt="freeCodeCamp sticker that says 'Because CamperBot Cares'">

I test it on Firefox on the Mac. it won't pass with his code. I confirmed.

Duplicate of #15259, so can be closed.


Top Level Binary; Refactoring

I intend to write a test that:

runs the program generated by auth_logic_verification to generate auth logic code
calls the auth logic compiler on the generated auth logic code
checks for the expected result

but that isn't here yet. I figured there is already of a delta to start code review on these changes. I can do that test as a separate PR or include it as a part of this one if you prefer.


ati-drivers :  15.7 -> 15.12

This update and set of patches enables the latest AMD radeon driver in nixos.
The patches mainly allow building upto (and hopefully beyond) linux kernel 4.3.
While this all seems good and well - there is a matter which will need discussion or a solution to.
As of this update, AMD are dropping support for pre-GCN cards - mainly
the Radeons of series 5000 and 6000. Those cards are about 5 years old now.
In order for nixos to continue to support those cards, the version of this package
previous will still work with those cards but that version does not compile past linux 4.1.
So - does this update need forking out into a new package in order to continue support for
pre-GCN cards? (linux 4.1 is a long term support kernel.)
Is the extra work worth it or should the pre-GCN support be dropped?
If pre-GCN support is to be dropped, please take this merge as is.
If support for pre-GCN is to be maintained, would one of the maintainers of this package please
come up with a solution?

Please properly name commit to follow our rules in CONTRIBUTING.md

@heydojo You have only changed the title of the pull request. Use git commit --amend to change the commit message and force push to heydojo:ati_unfree-crimson.

@pSub Thanks for the hint. I guess this is OK now?
Am I doing it right XD ?

Nearly, instead of merging you should do a rebase. (This saves one unnecessary commit)

Clearly my git fu is not up to par... XD

I believe that at least part of the issue (possibly all of) this patch tries to fix is linked to https://github.com/NixOS/nixpkgs/issues/8676
and as a result I won't be pulling or rebuilding until it is confirmed as fixed.
I am closing this commit as a result and will review again in due course.


LCFS - Calculate and Display Non-Compliance Penalty Payable (Line 11 of report summary)

Description:
Implement functionality to calculate and display the automatic non-compliance penalty payable for each fuel class (Gasoline, Diesel, Jet Fuel) in the compliance report. This involves applying the prescribed penalty rates to the difference between the required and net volume of renewable fuel supplied for each class.
Will need to add total renewable requirement penalty at some point. Will be dealt with in another card.
Wireframe: link
Purpose and benefit to user:
To provide users with a clear calculation of the automatic non-compliance penalty payable, ensuring they are aware of the financial implications of not meeting renewable fuel obligations.
Acceptance Criteria:

[ ]  Given I am a BCeID user, When I view the compliance report summary, then cells G11, D11, and J11 display the non-compliance penalty payable for the Gasoline, Diesel, and Jet Fuel classes, respectively.
[ ]  Given I am a BCeID user, When the formula is applied, then cell G11 correctly calculates the penalty using the formula (G4 - G10) x $0.30.
[ ]  Given I am a BCeID user, When the formula is applied, then cell D11 correctly calculates the penalty using the formula (D4 - D10) x $0.45.
[ ]  Given I am a BCeID user, When the formula is applied, then cell J11 correctly calculates the penalty using the formula (J4 - J10) x $0.50.

Development Checklist:

[ ]  Implement the calculation formula for the Gasoline class in cell G11: (G4 - G10) x $0.30.
[ ]  Implement the calculation formula for the Diesel class in cell D11: (D4 - D10) x $0.45.
[ ]  Implement the calculation formula for the Jet Fuel class in cell J11: (J4 - J10) x $0.50.
[ ]  Ensure that the calculations are accurate and the results are correctly displayed in the respective cells.
[ ]  Test the calculations thoroughly to ensure they accurately reflect the penalty amounts based on the provided formulas.

Notes:

Confirm the data in the referenced cells (G4, G10, D4, D10, J4, J10) is accurate and up-to-date.
Coordinate with the development team to ensure the formula implementation aligns with the overall compliance reporting structure.

Looks great. Only note is that these values should be shown with a dollar sign in front of it as a dollar value

Line 11 still not displaying with dollar symbol.


Introduce environment variable preset features

Changes introduce environment variable preset features (parity with tutum/mysql).

Adds the following from tutum/mysql:
    MARIADB_USER - Sets the admin account username (defaults to 'admin')     MARIADB_PASS - Sets the admin account password (defaults to random string, see docker logs <CONTAINER_ID>)     STARTUP_SQL  - SQL to import at startup (needs to exist, can be mounted)     ON_CREATE_DB - Database to create at startup.

@tifayuki


ARM32v6 version?

Hi, this image is very helpful, thanks for creating it! Is it possible to support ARM32v6 images? The use case here is building images with GRPCIO for the RPi Zero W.

This should be relatively straightforward, I will add the builds this week!

Hi, thanks for your interest in supporting this use case! Just wondering whether there has been any progress? I'm happy to contribute a PR if you're able to provide guidance on how to proceed and I can assist with the actual work. :)

Hey, sorry for the delay here. Happy to review a PR if still of interest :)


How to use the environment configuration to set different API endpoints.

It is very unclear how to set different API endpoints via the env/prod.ts and env/dev.ts files and how to access these values in an app, for example in a service that calls an external API. Clarification and an example would help a lot! Should I modify the files directly? Should I check the current environment? And if so, how?
Thanks.

It's not that hard. Here is an example.
//dev.ts
const DevConfig: EnvConfig = {
ENV: 'DEV',
API: 'wss://devapi.com'
};
//prod.ts
const ProdConfig: EnvConfig = {
ENV: 'PROD',
API: 'wss://prodapi.com/'
};
And then in your app.module.ts, import env.config.ts
import { Config } from '../../env.config';
Use it like this:
@NgModule({
imports: [
CommonModule,
FormsModule,
HttpModule
],
providers: [
{provide:$WebSocket,  useValue: new $WebSocket(Config.API) } //Will be different depending on environment.
]
})


WIP: BERT training for MLPerf

This is a work in progress for the BERT training bounty.
TODOs:

[x] Functionality to download dataset (verify etc.)
[x] Non-random dataset preprocessing steps
[ ]  Dataloader
[ ] Training loop
[ ] Distributed model training (Data parallel)
[ ] Performance optimizations for <24h

Can look at my preprocessing steps here: https://github.com/wozeparrot/tinygrad/blob/bert_train/extra/datasets/wikipedia.py
You don't have to do the cleanup/download straight from wikipedia because they provide the post cleaned up data here: https://drive.google.com/drive/u/0/folders/1cywmDnAsrP5-2vsr8GDc6QUc7VWe-M3v

I see, thanks for the hint!

Bounty locked, good luck!

Unlocking bounty, over 1 week has gone by without update.

New rule on mlperf training bounties. in order to lock the bounty, you must post weights that you trained in tinygrad that meet the accuracy requirement. Then we can look at speed and mergablity, but until there's weights, no lock.


browser scroll and resize issue

There was an issue where the location was incorrectly updated when the browser was zoomed out after zooming out and scrolling, so it was fixed as follows.
position() {
      super.position()

      const { element, parent } = this
      const { style } = element; const { scrollLeft } = parent; const { left, top } = parent.getBoundingClientRect()
      style.transform = `translate(${-1 * (left - scrollLeft)}px,${-1 * (top + window.scrollY)}px)`
    }

@choiDoYoung I'll take a look at it and get back to you

I'm closing this issue since there was no reply from @choiDoYoung.


Parallelism checklist

[x] Set up basic MPI and parallel reading of configuration
[x] Set up domain decomposition and halo regions (see #361)
[x] Extend NetCDF to parallel I/O (see  #363). If having single files for parcels gives us issues, we could still try a file-per-node strategy.
[x] Read and write parcels in parallel (see #365)
[x] Read and write grid from/t0 file (parallel IO) (see #367)
[x] Initialise parcels from grid (unit test: test_parcel_init.f90) (see #373)
[x] Field and parcel diagnostics (see #368)
[x] #449
[x] #371 (see #377)
[x] Implement grid halo swap (see #369)
[x] Implement parcel halo swap (see #362)
[x] Change blocking to non-blocking communication in parcel and field halo swaps to avoid deadlocks with large messages (fixed in #373 and in #376)
[x] Implement parallel par2grid (related to parcel intialisation) (unit test: test_trilinear.f90) (see  #374)
[x] Implement parallel grid2par (unit test: test_grid2par.f90) (see  #375)
[x] Implement solver and FFTs in parallel (unit tests: test_fft_3d.f90, test_fft_2_3d.f90, test_vor2vel.f90, test_lapinv0_1.f90, test_lapinv0_2.f90, test_diffz0.f90, test_diffz1.f90, test_velgradg.f90) (see #428)
[x] Implement parcel corrections in parallel (unit test: test_parcel_correction_3d.f90):

[x] gradient correction (unit test: test_gradient_correction_3d.f90) (see  #383)
[x] Laplace correction (unit test: test_laplace_correction_3d.f90) (see  #442)

[x] Extend timer module to MPI (see #443)
[x] Implement splitting with haloswap (unit test: test_ellipsoid_split.f90) (see #376)
[x] Implement parallel merging (see  #384)

[x] transfer of small parcels for nearest neighbour check
[x] nearest neighbour check on each memory domain
[x] selecting the correct nearest neighbour across domains
[x] establish the merging dual tree
[x] resolve the merging dual tree
[x] ~perform merges (unit tests: test_ellipsoid_merge_1.f90, test_ellipsoid_merge_2.f90)~

I close this issue as all tasks are done.


⚠ CodePush has degraded performance

In 89e5312, CodePush (https://codepush.appcenter.ms/v0.1/public/codepush/update_check?deployment_key=Fzqu71x4FXhOaKcAiwpqXkFQddjgYl2dIUW2K&app_version=4.4.1) experienced degraded performance:

HTTP code: 200
Response time: 10951 ms

Resolved: CodePush performance has improved in 0a64f6c.


Fix bug in agreements list

The slug key in the framework response is 'slug'
The slug key in the supplier framework response is 'frameworkSlug'

:+1:


crash when running latest game phases

https://paste.alloffabric.com/aqopefixig.properties
when running game phases.. the world starts.. generates and then closes out saying it can't connect to server.
I believe the paste is the juicy bit.

Thanks for the report! To start, you should be able to fix your issue by downloading this new 1.3.0 version of FibLib (I swear it's different) - this should fix your problem. I forgot to copy a mixin change to a few classes, and I also failed to test in a non-superflat world (both facts are related 😆)
I also noticed a separate crash related to syncing data to the player when they first join a world. If you get kicked to the multiplayer screen upon join after switching to the new FibLib version, you can use the 1.2.1 patch here. Let me know how it works out!

this works


UAT | Confirmation bar message

Confirmation message states "Relevant parties will be notified about the notice issued'
Message should state 'Relevant parties will be notified of the registration of the case'

Hi @rajeshcherukumalli  Please recheck this

Working fine.

its working fine in QA[sol] env.

TestCases: verified that message stating 'Relevant parties will be notified of the registration of the case'.

working fine in UAT env


ansible variables in molecule

Question

ansible --version
ansible <IP_ADDRESS>
  config file = /etc/ansible/ansible.cfg
  configured module search path = ['/usr/share/ansible']
  python version = 3.4.2 (default, Oct  8 2014, 10:45:20) [GCC 4.9.1]

molecule --version
molecule, version 1.24.0

In my ansible, I'm using variable (ansible fact) - ansible_eth0 :
...
lineinfile: dest=config.py line="ip = '{{ansible_eth0.ipv4.address}}'"
...

When I run it outside Molecule - it works. However, when I try the script with molecule converge I got:
`The error was: ansible_eth0 is undefined'.
Any idea how to pass ansible variables/facts into Molecule?

@xhudik that should work so long as your playbook.yml has gather_facts: yes.

Can you link me to your source?

here is the code: https://github.com/xhudik/kel/tree/master/roles
(you only need roles directory). I tried to do it as slim as possible...
any hint/idea appreciated ;)

Here is your problem.    You have no eth0.
[vagrant@edge ~]$ ip addr s
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN qlen 1
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet <IP_ADDRESS>/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host
       valid_lft forever preferred_lft forever
2: enp0s3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000
    link/ether 08:00:27:0a:d1:52 brd ff:ff:ff:ff:ff:ff
    inet <IP_ADDRESS>/24 brd <IP_ADDRESS> scope global dynamic enp0s3
       valid_lft 86305sec preferred_lft 86305sec
    inet6 fe80::1f68:6d39:c47d:a9c2/64 scope link
       valid_lft forever preferred_lft forever

true - i didnt realize this one! thanks a lot @retr0h

true - i didnt realize this one! thanks a lot @retr0h

🎸


Fliplr and Flipud flips the same images when using random_state

When using Fliplr and Flipud with the same random_state they always flip the same images.
Here's some code to show it:
import imgaug as ia
import imgaug.augmenters as iaa
import numpy as np
import matplotlib.pyplot as plt

def _get_light_image_augmenter(sq=None):
    aug = iaa.Sequential([
        iaa.Fliplr(0.5, random_state=sq),
        iaa.Flipud(0.5, random_state=sq)
    ], random_order=True, random_state=sq)

    return aug

img = ia.quokka()
aug_imgs = []

for i in range(20):
    sq = np.random.SeedSequence()
    img_aug = _get_light_image_augmenter(sq)

    aug_img = img_aug.augment(image=img)
    aug_imgs.append(aug_img)

plt.figure(figsize=(20, 10))
for i in range(20):
    plt.subplot(1, 20, i+1)
    plt.imshow(aug_imgs[i])
plt.show(block=True)

Is this intended? Would I need two different seed sequences for Fliplr and Flipud to flip different images?
I'm using imgaug 0.3.0 and numpy 1.17.5

Not sure if it is a good choice, but at least it currently matches the behaviour of numpy:
>>> import numpy as np
>>> import imgaug as ia
>>>
>>> sq = np.random.SeedSequence()
>>> ia.random.RNG(sq).integers(10000)
1705
>>> ia.random.RNG(sq).integers(10000)
1705
>>> ia.random.RNG(sq).integers(10000)
1705
>>> np.random.Generator(np.random.SFC64(sq)).integers(10000)
1705
>>> np.random.Generator(np.random.SFC64(sq)).integers(10000)
1705
>>> np.random.Generator(np.random.SFC64(sq)).integers(10000)
1705

They also don't seem to change their internal state when generating seeds:
>>> sq.generate_state(1)[0]
3429478982
>>> sq.generate_state(1)[0]
3429478982

Considering they don't change their state, I'm not sure if it is even possible to create different random number generators from the same seed sequence. The only way I could think of is to have a global counter for the number of generated RNGs and then use something like seed + counter.

I see. If I want a augmenter to be defined by a sing SeedSequence, would you say this is a better solution?
def _get_light_image_augmenter(sq=None):
    seeds = sq.generate_state(3)
    aug = iaa.Sequential([
        iaa.Fliplr(0.5, random_state=seeds[0]),
        iaa.Flipud(0.5, random_state=seeds[1])
    ], random_order=True, random_state=seeds[2])

    return aug

Yes, that looks more correct to me.
Just noticed that you could also use random_state=sq.spawn(1)[0] each time. That seems to produce different SeedSequence instances with each call.


Typo

'determins'

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: a56ba30d-5153-579e-bddf-ecac65f89873
Version Independent ID: 25fb9f1f-30b8-ec21-d6ff-b63d8107f5bc
Content: Performance considerations for Azure NetApp Files
Content Source: articles/azure-netapp-files/azure-netapp-files-performance-considerations.md
Service: azure-netapp-files
GitHub Login: @b-hchen
Microsoft Alias: anfdocs

@gvanteylingen
Thanks for your feedback! We will investigate and update as appropriate.

@gvanteylingen
Thanks for reporting this! We have created a PR for this issue and the changes should go live soon.


bitbake core-image-base fails with nothing provides /usr/bin/env

Hello,
First I want to say that this is my first step in Yocto, so probably there is something missed on my side, but I am stuck on that and can't find a solution. So I am trying to build an Yocto image with meta-flutter for raspberry pi 4, but
bitbake core-image-base fails with the error below.
For all of my layers I am using kirkstone branches. Before adding meta-flutter I successfully built an image and ran it on my Pi.
Any help would be appreciated.
Best regards.
ERROR: core-image-base-1.0-r0 do_rootfs: Could not invoke dnf. Command '/mnt/data/Projects/kribo/build/tmp/work/raspberrypi4-poky-linux-gnueabi/core-image-base/1.0-r0/recipe-sysroot-native/usr/bin/dnf -v --rpmverbosity=info -y -c /mnt/data/Projects/kribo/build/tmp/work/raspberrypi4-poky-linux-gnueabi/core-image-base/1.0-r0/rootfs/etc/dnf/dnf.conf --setopt=reposdir=/mnt/data/Projects/kribo/build/tmp/work/raspberrypi4-poky-linux-gnueabi/core-image-base/1.0-r0/rootfs/etc/yum.repos.d --installroot=/mnt/data/Projects/kribo/build/tmp/work/raspberrypi4-poky-linux-gnueabi/core-image-base/1.0-r0/rootfs --setopt=logdir=/mnt/data/Projects/kribo/build/tmp/work/raspberrypi4-poky-linux-gnueabi/core-image-base/1.0-r0/temp --repofrompath=oe-repo,/mnt/data/Projects/kribo/build/tmp/work/raspberrypi4-poky-linux-gnueabi/core-image-base/1.0-r0/oe-rootfs-repo --nogpgcheck install flutter-engine-release flutter-gallery-release flutter-pi-release psplash-raspberrypi run-postinsts locale-base-en-us locale-base-en-gb' returned 1:
DNF version: 4.11.1
cachedir: /mnt/data/Projects/kribo/build/tmp/work/raspberrypi4-poky-linux-gnueabi/core-image-base/1.0-r0/rootfs/var/cache/dnf
Added oe-repo repo from /mnt/data/Projects/kribo/build/tmp/work/raspberrypi4-poky-linux-gnueabi/core-image-base/1.0-r0/oe-rootfs-repo
User-Agent: falling back to 'libdnf': could not detect OS or basearch
repo: using cache for: oe-repo
oe-repo: using metadata from Wed 08 Jun 2022 03:13:09 PM UTC.
Last metadata expiration check: 0:00:01 ago on Wed 08 Jun 2022 03:13:09 PM UTC.
--> Starting dependency resolution
--> Finished dependency resolution
Error:
 Problem: package flutter-pi-release-git-r0.cortexa7t2hf_neon_vfpv4 requires libinput.so.10, but none of the providers can be installed
  - package flutter-pi-release-git-r0.cortexa7t2hf_neon_vfpv4 requires libinput.so.10(LIBINPUT_0.12.0), but none of the providers can be installed
  - package flutter-pi-release-git-r0.cortexa7t2hf_neon_vfpv4 requires libinput.so.10(LIBINPUT_0.21.0), but none of the providers can be installed
  - package flutter-pi-release-git-r0.cortexa7t2hf_neon_vfpv4 requires libinput.so.10(LIBINPUT_1.11), but none of the providers can be installed
  - package flutter-pi-release-git-r0.cortexa7t2hf_neon_vfpv4 requires libinput10 >= 1.19.4, but none of the providers can be installed
  - conflicting requests
  - nothing provides /usr/bin/env needed by libinput10-1.19.4-r0.cortexa7t2hf_neon_vfpv4
(try to add '--skip-broken' to skip uninstallable packages)

ERROR: Logfile of failure stored in: /mnt/data/Projects/kribo/build/tmp/work/raspberrypi4-poky-linux-gnueabi/core-image-base/1.0-r0/temp/log.do_rootfs.3443074
ERROR: Task (/mnt/data/Projects/kribo/meta/recipes-core/images/core-image-base.bb:do_rootfs) failed with exit code '1'

I haven't put together a manifest for RPI4 on Kirkstone yet.  The focus has been the lowest common denominator Zero2.
For Dunfell see:  https://github.com/meta-flutter/meta-flutter/blob/dunfell/.github/workflows/dunfell-rpi4-64.yml
You can also download an image to test.

This build has Flutter SDK 3.0.1: https://github.com/meta-flutter/meta-flutter/actions/runs/2464971404


Output file location?

Where does the new file save to?
When I run the command and arguments there is no saved file with the new name I have given it in the current directory. If I run it again there is a prompt to overwrite so it is saving somewhere.

I usually do 4.sav 4.sav followed by the rest of parameters. With a backup already made prior

Tried that also. It just keeps telling me that nothing is being done since it already has done it.

Found the problem. Antivirus was sandboxing to a virtual hard drive. Please disregard.

Ah, cool, glad you figured it out!  Have a good one!


[BUG REPORT]: SERF QPE DSS Records using 9999 instead of -FLT_MAX for missing cell values

SERF QPE DSS Records using 9999 instead of -FLT_MAX for missing cell values:

Suspect other SERFC products (QPF) and potentially LMRFC and other product have the same issue as well.

Issue noticed with MBRFC.  Attempts to replace 9999 with -FLT_MAX failed.  pydsstools needs investigation how it handles missing values.  Temporarily, zero is used of 9999 for missing QPE in MBRFC.  May need to extend to other QPE grids.  Use of CONUS grids can alleviate this issue until resolved.

Forked pydsstools repo has Gyanz's updates as branch 2.1.  Branch 1.6 is at the point his repo was first forked and is still represented in the develop branch.  As of his release v1.7, the following has been applied

HEC-DSS 7-IC, released Jan 22, 2021, headers and libraries included
Setup.py revised to build extension from source code
Wheel for Windows (Python 3.6 to 3.9) and Ubuntu 20.04 (Python 3.8)

The build from source with the Setup.py was failing due to possible file name error.  Issue submitted (https://github.com/gyanz/pydsstools/issues/29).  USACE/pydsstools 2.1 is the updated branch with the filename correction.  Still causing issue as stated in the referenced issue above.


Module not found error during indexing.

I am getting following error when trying to run the indexing. Anyone has any idea ?
import colbert.utils.distributed as distributedimport colbert.utils.distributed as distributed
ModuleNotFoundErrorModuleNotFoundError: : No module named 'colbert'No module named 'colbert'

Should I have to install the package like ColBERT ?

No, you don't need to. I have changed all the existing module references to colbert.
The code should work fine now.
Feel free to open the issue if it is still not working.


Import ABC from collections.abc for Python 3.10 compatibility.

Fixes #25

I have tested and verified that this works on Python 3.10.

Also tested this change working on Python 3.10. Looking forward to a pip release with this change included 👍


add: struct BytesView, trait ByteView & binary representation methods.

This is a direct port of practice-tested loneoutpost/core-extra/representation mooncake.
Contents
This PR includes 3 main parts

Abstractions trait ByteView & trait ByteMutView to indicate Byte sequences from any data source, read-only or writable.
Concrete type struct BytesView which indicates a read-and-writable Byte sequence sliced from a Bytes.
Binary representations of Int, Int64 and Double supporting any specified endianness.

Solid and complete tests and documentations provided.
Competing PRs
This PR is competing to #328 and #329.
Concrete struct BytesView...
is similar but different from #328. This PR makes the output type Byte instead of Int.
Abstractions trait ByteView & trait ByteMutView
... are new. Since Byte sequence can come from various sources (memory, disk, network...), I think adding such abstractions to core is critical for supporting various programs.
The whole @mem module_ appeared in #329
... which includes abstractions Loadable(read from bytes) or Storable(write into bytes) and implementations for primitive types, are removed.
This PR made these R/W operations (between primitive types and Byte views) simple methods in the primitive types' package, for the following reasons:

Loadable/Storable is actually an abstraction of serialization/deserialization(serde). As the practices from Rust community, serde is more appropriate to appear as a 3rd party package instead of a core feature.
Additionally, endianness conversions are not always considered enough to be a serde operation. It's called binary representation more often.
We cannot assume source and target of serde operations is memory. Binary representation operations may bypass memory entirely. @mem is more suggested to be reserved for usages dealing with real memory.

Notes
This PR somewhats implements #341.

note: actions check/cla-check failure might be a bug:

my commit is using CLA email<EMAIL_ADDRESS>my github primary email is<EMAIL_ADDRESS>both are verified by github

I think check/cla-check action should verify emails appeared in git log history, instead of primary email of github user?


feat: can reference any branch and have protos build correctly

Overview
Issue: https://github.com/orgs/xmtp/projects/8/views/4?pane=issue&itemId=26452558
This provides an example for being able to reference any xmtp/proto branch we want to target. Since xmtp-proto is shared, whatever branch we choose needs to be kept up to date with xmtp/proto#main.
Test Plan

Confirm that a new test field was added correctly
Ensure that cargo build passes in xmtp-proto and in xmtp-networking which consumes xmtp-proto

Open Question
What do you want to call our working branch? Should we utilize beta again?

Correction: it seems like the branch may need https://github.com/xmtp/proto/blob/main/proto/buf.yaml - so it has to be based off of recent main

FYI using xmtpv3 as the branch: https://github.com/xmtp/proto/tree/xmtpv3


How to send data from a web page to a Websoket server?

There is a php Websocket server (Workerman) and many clients in the form of devices (ESP8266), which exchange messages among themselves. Each device (clients) has its own unique key, which is sent when connecting to the server. Now I was able to do the messaging between the devices and the server. I want to add a web page to manage these devices (for example, several buttons to turn the device on and off and transfer the device key, which must be disabled). Questions: how do I send data from a web page to the server, and then send them to the required client? I thought about writing the key and command in a separate Json file from which to read the data once a minute, but this is not suitable because of the time interval. I would like to have the fastest process of sending commands from a web page to a server.

You can create a websocket connection in your web page and send command to any devices.

Hi Walkor! I tried to create a test WebSocket Server from the example below:
`<?php
require_once DIR . '/vendor/autoload.php';
use Workerman\Worker;
// Create a Websocket server
$ws_worker = new Worker("websocket://<IP_ADDRESS>:2346");
// 4 processes
$ws_worker->count = 4;
// Emitted when new connection come
$ws_worker->onConnect = function($connection)
{
echo "New connection\n";
};
// Emitted when data received
$ws_worker->onMessage = function($connection, $data)
{
// Send hello $data
$connection->send('hello ' . $data);
};
// Emitted when connection closed
$ws_worker->onClose = function($connection)
{
echo "Connection closed\n";
};
// Run worker
Worker::runAll();`
After running this server, I decided to connect to it via the Web application: https://www.websocket.org/echo.html
When I try to connect to this WebSocket Server, I see a message about an unsuccessful connection:
https://imgur.com/a/h9qzx1D
The most interesting is that ESP8266 in the form of WebSocket Client connects and works normally. I thought that the case in the Firewall, having disabled his error, did not disappear.

@DeltaVetal26
You provide the connection https://www.websocket.org/echo.html is wss not ws protocol. please check which one you want to use.
If you use ws protocol, in the websocket js use 'ws://'; if you use wss protocol, in the websocket use 'wss://', in the server add ssl config  follow this link
http://doc.workerman.net/faq/secure-websocket-server.html

@DeltaVetal26
I don't understand ESP8266 devices  work, can you sure this device use websocket protocol? or this device use tcp/udp protocol?
This following may help you

demo.php

<?php

require_once __DIR__ . '/YBase/Workerman/Autoloader.php';
use Workerman\Worker;

$app_work = new Worker("websocket://<IP_ADDRESS>:8000");

$app_work->onWorkerStart = function ($worker) {
    // create local tcp-server
    $inner_tcp_worker = new Worker("websocket://<IP_ADDRESS>:1234");

    $inner_tcp_worker->onMessage = function ($connection, $data) use ($worker){
        foreach($worker->connection  as $con) {
            $con->send($data);
        }
    };
    $inner_tcp_worker->listen();
};
$app_work->onConnect = function ($connection) {
    $connection->onWebSocketConnect = function ($connection) {

    };
};
$app_work->onClose = function ($connection) {

};

$app_work->onMessage = function ($connection, $data) {
    echo "app_work=>".$data."\n";
};

$app_work->runAll();

one browser

var ws = new WebSocket("ws://<IP_ADDRESS>:1234");
ws.onopen = function(e){console.log("onopen");};
ws.onmessage = function(e){console.log(e.data);};

another browser

var ws = new WebSocket("ws://<IP_ADDRESS>:8000");
ws.onopen = function(e){console.log("onopen");};
ws.onmessage = function(e){console.log(e.data);};

At last good luck for you!

@taozywu
Thank you very much for the code! One of these days I will check my server and say the results :)


Checkpointable error for FGSM attack using cleverhans

I am trying to attack on an image using cleverhans package and following is my code:
wrap = KerasModelWrapper(model)
fgsm = FastGradientMethod(wrap, sess=sess)
fgsm_params = {'eps': 0.3,
'clip_min': 0.,
'clip_max': 1.}
adv_x = fgsm.generate_np(x_validation, **fgsm_params)
for adv_x = fgsm.generate_np(x_validation, **fgsm_params) line I am getting error as
"Checkpointable._track_checkpointable() passed type <class 'keras.engine.input_layer.InputLayer'>, not a Checkpointable."
What can be the reason?

This looks like a problem with your model definition but it's hard to tell from the limited information you shared. Feel free to reopen if you are still facing this issue, but please add context to your question (e.g., code needed to reproduce the issue)


Second Merge Attempt

Fixed directory structure in line with recent changes (removing "client" and web3 items)
Updated - RaffleFeatured, RaffleGrid, CollectionFeatured, CreatorGrid, NavBar
Created - RaffleList, CollectionGrid, CollectionList, CreatorList
Cleaned up padding and margins for all view sizes, should be consistant now and show correct sizing for larger designed items.
Added on hover to all components as well as nav bar links

This PR is a fork sync and tidy up.