I have no problems at all using Arduino Pro Mini (3.3v version).

I have no problems at all using Arduino Pro Mini (3.3v version).
I have attached the Arduino and Windows code that I did use in the demo videos (#62).
dw1000.zip
Originally posted by @greymfm in https://github.com/thotro/arduino-dw1000/issues/54#issuecomment-184163980
I found this code and it works well to find the distance between anchor and tag, I need to know it mapped values on PC window

Hello, I've used your code but I can't upload the DW1000Ranging_Tag but the DW1000Ranging_Anchor worked fine
This is the problems:
Arduino: 1.8.9 (Windows 10), Board: "Arduino Pro or Pro Mini, ATmega328P (5V, 16 MHz)"
Sketch uses 22188 bytes (72%) of program storage space. Maximum is 30720 bytes.
Global variables use 1193 bytes (58%) of dynamic memory, leaving 855 bytes for local variables. Maximum is 2048 bytes.
avrdude: stk500_recv(): programmer is not responding
avrdude: stk500_getsync() attempt 1 of 10: not in sync: resp=0x9a
avrdude: stk500_recv(): programmer is not responding
avrdude: stk500_getsync() attempt 2 of 10: not in sync: resp=0x9a
avrdude: stk500_recv(): programmer is not responding
avrdude: stk500_getsync() attempt 3 of 10: not in sync: resp=0x9a
avrdude: stk500_recv(): programmer is not responding
avrdude: stk500_getsync() attempt 4 of 10: not in sync: resp=0x9a
avrdude: stk500_recv(): programmer is not responding
avrdude: stk500_getsync() attempt 5 of 10: not in sync: resp=0x9a
avrdude: stk500_recv(): programmer is not responding
avrdude: stk500_getsync() attempt 6 of 10: not in sync: resp=0x9a
avrdude: stk500_recv(): programmer is not responding
avrdude: stk500_getsync() attempt 7 of 10: not in sync: resp=0x9a
avrdude: stk500_recv(): programmer is not responding
avrdude: stk500_getsync() attempt 8 of 10: not in sync: resp=0x9a
avrdude: stk500_recv(): programmer is not responding
avrdude: stk500_getsync() attempt 9 of 10: not in sync: resp=0x9a
avrdude: stk500_recv(): programmer is not responding
avrdude: stk500_getsync() attempt 10 of 10: not in sync: resp=0x9a
Problem uploading to board.  See http://www.arduino.cc/en/Guide/Troubleshooting#upload for suggestions.
Invalid library found in C:\Users\Long Trinh\Documents\Arduino\libraries\espNowFloodingMeshLibrary-master: Missing 'paragraph' from library
Invalid library found in C:\Users\Long Trinh\Documents\Arduino\libraries\espNowFloodingMeshLibrary-master: Missing 'paragraph' from library
This report would have more information with
"Show verbose output during compilation"
option enabled in File -> Preferences.
Could you help me to solve that pls?

Your board is not connected or selected wrong in arduino IDE
On Thu, Oct 29, 2020, 11:38 AM socconlc<EMAIL_ADDRESS>wrote:

Hello, I've used your code but I can't upload the DW1000Ranging_Tag but
the DW1000Ranging_Anchor worked fine
This is the problems:
Arduino: 1.8.9 (Windows 10), Board: "Arduino Pro or Pro Mini, ATmega328P
(5V, 16 MHz)"
Sketch uses 22188 bytes (72%) of program storage space. Maximum is 30720
bytes.
Global variables use 1193 bytes (58%) of dynamic memory, leaving 855 bytes
for local variables. Maximum is 2048 bytes.
avrdude: stk500_recv(): programmer is not responding
avrdude: stk500_getsync() attempt 1 of 10: not in sync: resp=0x9a
avrdude: stk500_recv(): programmer is not responding
avrdude: stk500_getsync() attempt 2 of 10: not in sync: resp=0x9a
avrdude: stk500_recv(): programmer is not responding
avrdude: stk500_getsync() attempt 3 of 10: not in sync: resp=0x9a
avrdude: stk500_recv(): programmer is not responding
avrdude: stk500_getsync() attempt 4 of 10: not in sync: resp=0x9a
avrdude: stk500_recv(): programmer is not responding
avrdude: stk500_getsync() attempt 5 of 10: not in sync: resp=0x9a
avrdude: stk500_recv(): programmer is not responding
avrdude: stk500_getsync() attempt 6 of 10: not in sync: resp=0x9a
avrdude: stk500_recv(): programmer is not responding
avrdude: stk500_getsync() attempt 7 of 10: not in sync: resp=0x9a
avrdude: stk500_recv(): programmer is not responding
avrdude: stk500_getsync() attempt 8 of 10: not in sync: resp=0x9a
avrdude: stk500_recv(): programmer is not responding
avrdude: stk500_getsync() attempt 9 of 10: not in sync: resp=0x9a
avrdude: stk500_recv(): programmer is not responding
avrdude: stk500_getsync() attempt 10 of 10: not in sync: resp=0x9a
Problem uploading to board. See
http://www.arduino.cc/en/Guide/Troubleshooting#upload for suggestions.
Invalid library found in C:\Users\Long
Trinh\Documents\Arduino\libraries\espNowFloodingMeshLibrary-master: Missing
'paragraph' from library
Invalid library found in C:\Users\Long
Trinh\Documents\Arduino\libraries\espNowFloodingMeshLibrary-master: Missing
'paragraph' from library
This report would have more information with
"Show verbose output during compilation"
option enabled in File -> Preferences.
Could you help me to solve that pls?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/thotro/arduino-dw1000/issues/318#issuecomment-718394701,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AP4NQVQ2RZ4KIHRG36RR7JTSNEEWBANCNFSM4TCTBX4A
.

Your board is not connected or selected wrong in arduino IDE
…
On Thu, Oct 29, 2020, 11:38 AM socconlc @.***> wrote: Hello, I've used your code but I can't upload the DW1000Ranging_Tag but the DW1000Ranging_Anchor worked fine This is the problems: Arduino: 1.8.9 (Windows 10), Board: "Arduino Pro or Pro Mini, ATmega328P (5V, 16 MHz)" Sketch uses 22188 bytes (72%) of program storage space. Maximum is 30720 bytes. Global variables use 1193 bytes (58%) of dynamic memory, leaving 855 bytes for local variables. Maximum is 2048 bytes. avrdude: stk500_recv(): programmer is not responding avrdude: stk500_getsync() attempt 1 of 10: not in sync: resp=0x9a avrdude: stk500_recv(): programmer is not responding avrdude: stk500_getsync() attempt 2 of 10: not in sync: resp=0x9a avrdude: stk500_recv(): programmer is not responding avrdude: stk500_getsync() attempt 3 of 10: not in sync: resp=0x9a avrdude: stk500_recv(): programmer is not responding avrdude: stk500_getsync() attempt 4 of 10: not in sync: resp=0x9a avrdude: stk500_recv(): programmer is not responding avrdude: stk500_getsync() attempt 5 of 10: not in sync: resp=0x9a avrdude: stk500_recv(): programmer is not responding avrdude: stk500_getsync() attempt 6 of 10: not in sync: resp=0x9a avrdude: stk500_recv(): programmer is not responding avrdude: stk500_getsync() attempt 7 of 10: not in sync: resp=0x9a avrdude: stk500_recv(): programmer is not responding avrdude: stk500_getsync() attempt 8 of 10: not in sync: resp=0x9a avrdude: stk500_recv(): programmer is not responding avrdude: stk500_getsync() attempt 9 of 10: not in sync: resp=0x9a avrdude: stk500_recv(): programmer is not responding avrdude: stk500_getsync() attempt 10 of 10: not in sync: resp=0x9a Problem uploading to board. See http://www.arduino.cc/en/Guide/Troubleshooting#upload for suggestions. Invalid library found in C:\Users\Long Trinh\Documents\Arduino\libraries\espNowFloodingMeshLibrary-master: Missing 'paragraph' from library Invalid library found in C:\Users\Long Trinh\Documents\Arduino\libraries\espNowFloodingMeshLibrary-master: Missing 'paragraph' from library This report would have more information with "Show verbose output during compilation" option enabled in File -> Preferences. Could you help me to solve that pls? — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#318 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AP4NQVQ2RZ4KIHRG36RR7JTSNEEWBANCNFSM4TCTBX4A .

Hello again. I've fixed that problems but it's still don't work.
I've received something like this from the Tag:

Could you help me pls?

Never mind I've already fixed it. But the range seems like doesn't right. Any recommended

@Yasirsmb Are you still there??
Can I ask you one more question pls.
Your code is working fine for me with 1 or 2 anchors. But when I add the 3rd anchor, it's killed immediately and reconnected and killed again.
I've searched for the problem but can't find any solution with your code.
Do you know how to fix it?


Jobs: .With() extension methods.

As requested by @adamsitnik
Changelist:

Jobs: WithXxx() extension methods added back, docs updated.
Jobs, minor bug fixed: Id was cleared on explicit JobMode assignment + test for it (Test03IdDoesNotFlow).
Jobs.Accuracy, typo: AnaylyzeLaunchVariance => AnalyzeLaunchVariance, docs updated.

In the original design, the WithXXX() methods don't change the original job, it always creates a copy of the original job with requested change. Could we keep this approach?

@AndreyAkinshin  yep, I've think about that, but it feels very counterintuitive.
There're mutable properties, there's .Apply() method that updates the instance of the job and there're .With() methods that creates a new copy of the Job on each call. Kinda Js/PHP style : )
I'd prefer to keep standard Create-Modify-Freeze-Reuse approach until there're strong reasons against it.

Ok, let's consider the following situation: I want to have a dry job for Mono. Before the refactoring, I could take the predefined Dry job and create a DryMono job in the following way: Job.Dry.With(Runtime.Mono). It was the main use-case of the WithXXX() methods.

@AndreyAkinshin
Ok, I've fixed the .With() method logic. Should not break compatibility now.

Oops, last minute fix had broken smth.


Proofreading

I'm not a native English speaker and could've done some mistakes in the readme, code summary and UI text (especially in the settings editor). Any corrections either via comments here or direct pull requests are greatly appreciated ;)

I'll keep checking, haven't seen anything yet!

Hello @Elringus! I am a computing science student and currently enrolled in a technical writing class. We are required to proofread GitHub readme documents and proofread them. Should I go ahead and proofread the docs for this repository if you don't mind?

Sure, I've already merged the PR. I really appreciate the contribution, thank you :)


Update ACC model

This still requires some fixes for the reachability algorithm.
And we might want to outsource the helper functions.

lgtm, i'll outsource the helper functions to RA on the next patch release


feat: Make package ESM-friendly

Issue: Fixes https://github.com/gsoft-inc/wl-orbiter/issues/140
Summary

Adds "type": "module" to package
Add tsup to the project. tsup can turn the non-ESM code and non-ESM dependencies into ESM-compatible code.
Removed CSS import from a JS file. Node doesn't understand this syntax, which breaks some SSR implementations.

Chromatic won't run as it's an external PR.

Opened #143


Add getOccurrencesBetween, getNextOccurrence, getPrevOccurrence

This library gave me a great jump start on supporting recurring events. I've added a few things I'd be happy to see become part of the main line if you agree with them.
getOccurrencesBetween is the major addition. This returns occurrences between two dates (as when one is displaying just one month of a calendar, for example). The motivation for this was to allow recurrences that lack a COUNT or UNTIL_DATE to be used without arbitrarily imposing a limit on the number of occurrences. getNextOccurrence and getPrevOccurrence are really just conveniences.
I made some changes to occursOn and occursAt along the way. My own use case doesn't support frequencies below DAILY, so I probably haven't actually excercised occursAt heavily.
Thanks!
(Previously mentioned in #49.)

Thank you for this pull request. I think these modifications are very well implemented and should serve the code base well.


Minor contrib docs improvements

Description of changes
As discussed with @ethorsoe on Matrix. It's not perfect, but a bit better
Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Ohh maybe something like this would be nice:

:heavy_check_mark: Security fixes
:x: API change


Fix unit tests with sanitycheck

When we moved to yaml, we missed porting the 'unit' architecture. This is now being added again.
Fixes #4239

Unit tests are running fine in the cmake branch after applying this patch. I think this is safe to be merged.


Set Input_(Files,events,sizes) to the job attributes where available

would be good to add this into job classads:
INPUT_FILES = "/store/data/Run2016B/DisplacedJet/RAW/v2/000/274/157/00000/DE308367-FE24-E611-A134-02163E011A12.root,N+1, N+2, N..."
INPUT_EVENTS = "6479,N+1,N+2, N..."
INPUT_FirstEvent = "0,N+1,N+2, N..."
INPUT_LastEvent = "0,N+1,N+2, N..."
INPUT_LumiCount = "10,N+1,N+2, N..."
INPUT_Sizes = "4270814155,N+1,N+2, N...

And also the block name, which job is analyzing, but it is separate ticket here: https://github.com/dmwm/WMCore/issues/6972

Why FarFuture?

As discussed in #7267, it can't be done, thus closing this issue.


Update project to Swift 5 and Update Dependencies

Hello trivago!
We updated the framework and test targets (iOS and macOS) to Swift 5.
We also updated all dependencies:

Public:

antitypical/Result to 4.1.0 (Swift 4.2 / Compatible with Swift 5's Result)

Private:

jspahrsummers/xcconfigs to 1.0 (for Xcode 10.2)
AliSoftware/OHHTTPStubs to 7.0 (Swift 4.2)
Quick/Quick to 2.1.0 (Swift 4.2)
Quick/Nimble to `8.0.1 (Swift 4.2)

Updates to the project were minor. All tests are passing.
Looking forward for your feedback. We'll be happy to address any changes you think would be necessary or nice to have.
Notes:

There are some outstanding warnings showing in Xcode 10.2 for the localization that we haven't adressed.
We updated the version number to 3.7.0 but, probably, this is something you'll like us to leave out of the PR, right?

Folks, do you need any updates? Or you are no longer mantaining this library?

@fbeeper Hey, thank you for tackling this and sorry that this has taken so long. The project got lost in the shuffle of things and fell off of our radar. Going to see what I can do to get this merged and see if I can resurrect the project so it stays relevant. 🙂


Add tax codes handling by webhooks

I want to add tax codes handling (fetching all tax codes from API, saving tax code for a product/product type, fetching previously saved tax code) to sync webhooks.

Impact

[ ] New migrations
[ ] New/Updated API fields or mutations
[ ] Deprecated API fields or mutations
[ ] Removed API types, fields, or mutations
[ ] Documentation needs to be updated

Pull Request Checklist

[ ] Privileged queries and mutations are guarded by proper permission checks
[ ] Database queries are optimized and the number of queries is constant
[ ] Database migration files are up to date
[ ] The changes are tested
[ ] GraphQL schema and type definitions are up to date
[ ] Changes are mentioned in the changelog

@fowczarek I think it makes sense to benchmark only when the final PR is assembled (#8847). Updating new checkout line fields is going to affect the number of queries and #8733 might affect that


You just crashed my graphics driver with a live update.

Issue Type: Bug
Please don't update this editor while I code and let it wait for a restart.
Cheers!
VS Code version: Code 1.44.2 (ff915844119ce9485abfe8aa9076ec76b5300ddd, 2020-04-16T16:36:23.138Z)
OS version: Windows_NT x64 10.0.18362

Can you show me the error? What happened?

Also, if you don't want updates in the background, set update.enableWindowsBackgroundUpdates to false.

That setting will work perfectly. You can close this. For the error, I don't have any unfortunately. When the live update was triggered, my screen went white then the buffer had some misalignment in GPU it looked like. It was all glitchy, until I restarted.
Cheers!


hide user links for both admin and assessor

display sign out link for user even if registration is not completed
https://trello.com/c/ukSESHae/539-qae17imp-as-an-admin-assessor-i-don-t-want-to-be-able-to-see-or-interact-with-the-main-menu-ctas-when-i-view-a-user-s-applicatio

 [QAE17IMP] As an Admin/Assessor I don't want to be able to see or interact with the main menu CTAs when I view a user's application online, so I don't accidentally try and access a user's account when I am trying to access my own account


Adjust log levels

This downgrades some logging statements so SoCo does not log above the DEBUG level in normal use.
A single log level has been increased since it could be a real problem (client code raising an exception while handling an event).
Some related discussion in #792.

Coverage remained the same at 53.884% when pulling 46dd2757e1eaa09762ef9d0adfcb1b8d3601e9db on amelchio:downgrade-log-levels into 3cad3a3103cbfb5cf598f7ea3b6f0c14857673d7 on SoCo:master.

LGTM -- thanks.

Thank you, that was quick!


ws2812(worldsemi,ws2812-spi) does not work with blackpill_f401cc/blackpill_f411ce boards

Describe the bug
ws2812 based LED blinking but does not have correct color
overlay
&spi1 {
	led_strip: ws2812@0 {
		compatible = "worldsemi,ws2812-spi";
		reg = <0>;
		spi-max-frequency = <8000000>;
		frame-format = <32768>; /* SPI_FRAME_FORMAT_TI */

		chain-length = <5>;
		spi-one-frame = <0x70>;
		spi-zero-frame = <0x40>;
		color-mapping = <LED_COLOR_ID_GREEN LED_COLOR_ID_RED LED_COLOR_ID_BLUE>;
	};
};

source
...<skipped>...

#define STRIP_NODE DT_NODELABEL(led_strip)
#define STRIP_NUM_PIXELS DT_PROP(STRIP_NODE, chain_length)

struct led_rgb pixels[STRIP_NUM_PIXELS];

static const struct device *const leds = DEVICE_DT_GET(STRIP_NODE);

int main(void)
{
    memset(pixels, 0x00, sizeof(pixels));
    int dir = 1;

    while (1)
    {
        int rc = led_strip_update_rgb(leds, pixels, STRIP_NUM_PIXELS);

        if (pixels[0].r == 0 || pixels[0].r == 250)
        {
            dir = -dir;

            if (pixels[0].r == 0)
                pixels[0].r = 250;
            else
                pixels[0].r = 0;
        }

        pixels[0].r += 10 * dir;

        k_msleep(50);
    }

    return 0;
}

Expected behavior
LED fading in-out using red color
Impact
ws2812 driver

Works fine here, you probably have this set wrong:
		color-mapping = <LED_COLOR_ID_GREEN LED_COLOR_ID_RED LED_COLOR_ID_BLUE>;

and what is right for your opinion @thedjnK ? it is identical from sample/drivers )

@thedjnK it is impossible to run it on stm32f103 because of
[00:00:00.000,000] <err> spi_ll_stm32: Frame Format TI not supported

&spi2 {
	led_strip: ws2812@0 {
		compatible = "worldsemi,ws2812-spi";
		reg = <0>;
		spi-max-frequency = <4000000>;

		/* WS2812 */
		chain-length = <42>;
		spi-one-frame = <0x70>;
		spi-zero-frame = <0x40>;
		reset-delay = <50>;

		color-mapping = <LED_COLOR_ID_GREEN
				 LED_COLOR_ID_RED
				 LED_COLOR_ID_BLUE>;
	};
};

I've had this working for years on an stm32f103

Hi  @ku3mich

Describe the bug
ws2812 based LED blinking but does not have correct color

Is it blue or green instead of red ? If yes, as said @thedjnK, your color mapping is probably wrong. Note that this depends on the WS2812 device model you are using.

@ku3mich, Based on the information in the WS2812 datasheet, I recommend aligning spi-one-frame and spi-zero-frame with the specifications outlined in the datasheet. As an initial step, I suggest testing with spi-max-frequency = <4000000>;.


setQueryParams should provide a history.replace option

Most of the time, when I set query params I don't want to add an entry in the browser history, I just want to update the current entry.
setQueryParams could provide an option to choose weather it will history.push or history.replace.
This is a feature request.

same issue here~


make device property always return a device with index

What does this PR do?

Fixes #4849 by always returning a device index for cuda devices.
Before submitting

[ ] Was this discussed/approved via a Github issue? (no need for typos and docs improvements)
[ ] Did you read the contributor guideline, Pull Request section?
[ ] Did you make sure your PR does only one thing, instead of bundling different changes together? Otherwise, we ask you to create a separate PR for every change.
[ ] Did you make sure to update the documentation with your changes?
[ ] Did you write any new necessary tests?
[ ] Did you verify new and existing tests pass locally with your changes?
[ ] If you made a notable change (that affects users), did you update the CHANGELOG?

PR review
Anyone in the community is free to review the PR once the tests have passed.
Before you start reviewing make sure you have read Review guidelines. In short, see the following bullet-list:

[ ] Is this pull request ready for review? (if not, please submit in draft mode)
[ ] Check that all items from Before submitting are resolved
[ ] Make sure the title is self-explanatory and the description concisely explains the PR
[ ] Add labels and milestones (and optionally projects) to the PR so it can be classified; Bugfixes should be including in bug-fix release milestones (m.f.X) and features should be included in (m.X.b) releases.

Did you have fun?
Make sure you had fun coding 🙃

Hello @justusschock! Thanks for opening this PR.

In the file tests/utilities/test_dtype_device_mixin.py:

Line 104:1: E302 expected 2 blank lines, found 1

Do see the Hitchhiker's guide to code style


Improve RAM usage in Stellargraph

For graph operations, stellargraph relies on networkx which has a very nice API and strong community support.
The heavy memory requirements of networkx however limits the potential of stellargraph to be used as a production tool in realistic contexts (with huge graphs).

One way to improve this is to add another graph library (e.g. igraph) with a better memory management as an optional “back-end” graph processing engine.

I am mentioning igraph as I understand from the documentation below that igraph "(typically) needs 32 bytes per edge and 16 bytes per vertex. A graph with one million vertices and ten million edges needs about 320 Mbytes."
documentation slides

Another way (maybe longer term) to use directly the data without a graph library (e.g. data saved in HDF5 ) to produce the random walks.

Any interest in the community here to explore this further ?
Aha! Link: https://csiro.aha.io/features/SGML-39

Hi @almugabo thanks for the comments and suggestion.  We are aware of the heavy memory usage of NetworkX and are considering using a lighter graph format for StellarGraph.
In particular, we are looking at separating the StellarGraph class from the NetworkX Graph class in the future and providing a lighter-weight graph class which only stores what is needed for the graph structure. Formats we are considering are sparse matrix formats, or a custom graph class. We plan to continue to support NetworkX as an easy way to import graphs to StellarGraph but plan to extend support to other import methods in order to load large graphs.
If you have any more thoughts on this issue, please post them.

For a long term solution, one idea worth exploring is compressed sparse graph  from scipy.
I have not explored it myself yet but if it can easly handle weights then it could be a candidate for a stellargraph own graph format.

Any thoughts on using graph-tool graph objects instead of networkx? My 2GB graph-tool object explodes to 20GB in graphml, and overflows my RAM (over 128GB) when I try to convert to networkx. Networkx is also limited by it's pure python implementation. Graph-tool, by contract, has a mostly C/C++ backend and heavily evokes parallel processing with the option of approximate measures. Its hundreds to thousands of times faster than networkx. Because graph-tool heavily uses numpy, this switch would not be too difficult and would go along with almugabo's suggestion of scipy's compressed sparse graphs. Also, getting all neighbors is as simple as graph.get_vertices(), all edges are obtained with graph.get_edges(), etc. Every node and edge can have properties (e.g., labels, weights, etc.) that can be obtained with graph.vp.vertex_property_name.a. It's quite easy to rewrite functions that don't exist in graph-tool (e.g., bridging centrality) in vectorized forms, in other words.

Hi @AlexMRuch
thank you for your interest in our work and the code example. Memory and speed optimisations are on our to do list for the next major library release. We are currently evaluating different options for graph representations to potentially replace our dependence on networkx. Your use case and script will be very useful in this process.
Regards,
P.

You're very welcome, @PantelisElinas! If there's any way I can help, let me know!

Hi everyone, in 0.9.0, we've got an experimental implementation of StellarGraph backed by numpy and pandas (we didn't go with igraph because it seems to be a little awkward to install on some platforms, and it doesn't seem to be optimised for the sort of machine-learning/deep-learning queries that stellargraph uses).
This cuts memory use significantly, e.g. on one dataset (a reddit dataset that includes 1.2GB of node features), memory usage goes from 12.4 GB to 1.8GB. The pull request https://github.com/stellargraph/stellargraph/pull/668 contains some more details, as does the 0.9.0 release notes (see "Experimental features"). Working on moving this out of "experimental" continues, with #662 as the umbrella Epic.
This can be tested by using the StellarGraph(nodes=..., edges=...) (and StellarDiGraph(nodes=..., edges=...) constructor, passing in Pandas DataFrames for a homogeneous graphs, or a dict of DataFrames for a heterogeneous graph. The documentation for StellarGraph describes these in some more detail: https://stellargraph.readthedocs.io/en/v0.9.0/api.html#stellargraph.core.StellarGraph
Do note that this is experimental in the 0.9.0 release: it hasn't been fully tested, has some missing components, and is likely to change significantly before the next release. I think the following models can be successfully trained and predicted:

GCN
GAT
GraphSAGE
PPNP, APPNP

However, these were only tested on a single small dataset (Cora) and so may not work for larger/more complicated datasets. Other models definitely don't work (HinSAGE), and the rest haven't been tested.

What wonderful news! I'm also happy to hear that you all have chosen to go with numpy/pandas, as those libraries also play nicely with other libraries for deep learning on graphs (e.g., dgl can load sparse numpy matrices). Thank you so much for these additions! Looking forward to using them soon!


chore(#50): Add more descriptive instructions how to run docker container

feat(#50): Add more descriptive instructions how and where to run docker container.
Closes: #50

Blocked by #47

@yegor256  Could you merge that changes, please?

@volodya-lombrozo thanks@!


Content of .env file is not used

Describe the bug
According to the docs one can use an .env file to set environment variables for LS. So I did in order to change some keyboard shortcuts. However, it seems the file is not being used, in the browser still the original shortcuts are set. Here is the content of my .env file:
EDITOR_KEYMAP='{
  "media:step-backward": {
    "key": "left",
    "description": "Go one step back"
  },
  "media:step-forward": {
    "key": "right",
    "description": "Go one step forward"
  }
}'

To Reproduce
Steps to reproduce the behavior:

Clone Github repo into local folder via git clone https://github.com/heartexlabs/label-studio.git .
Create virtual env via python3 -m venv env
Start virtual env via source env/bin/activate
Create .env file in the root folder of the local repo clone (content see above)
Start LS via python label_studio/manage.py runserver

Expected behavior
I would expect the .env file to just work - maybe I need to put it into another folder?
Environment (please complete the following information):

OS: Ubuntu 20.04
Label Studio Version: 1.5.0dev from Github

.env files work with dockers only, for regular label-studio run please use the env variables.


Value too long varchar(275) error with src/AdminViews/v_generate_tbl_ddl.sql

When running v_generate_tbl_ddl.sql on certain databases, the script errors with the message:
ERROR:  value too long for type character varying(275)
When hacking at the script, I discovered that changing line 77 from this:
   ,'\t,' + pg_get_constraintdef(con.oid) AS ddl
to this:
   ,'\t,' + pg_get_constraintdef(con.oid)::VARCHAR(8000) AS ddl
addresses the problem for my use case. Unfortunately, I cannot speak to whether this would be the optimal way to solve this for all conditions due to the script's close ties with the deep inner workings of Redshift.

Have you tried with other values ( like 1024 instead of 8000 ) ?

8000 is semi-arbitrary. The size just has to be large enough to hold the text of a long FOREIGN KEY object name. 1024 would work until you had a DDL generation for a line needing 1025 characters.

On Oct 31, 2015, at 6:46 PM, ericfe<EMAIL_ADDRESS>wrote:
Have you tried with other values ( like 1024 instead of 8000 ) ?
—
Reply to this email directly or view it on GitHub https://github.com/awslabs/amazon-redshift-utils/issues/38#issuecomment-152778907.

Correct.  Given the max size of objects( tables and columns ) 1024 should be enough.
8000 has performance implications. If 1024 works for  you, I will go with that for now.

Pushed fix

Looks like the problem isn't fixed. The fix should go on line 89 in the --CONSTRAINT LIST section of the query. This can be reproduced by adding a UNIQUE constraint on a table using enough columns to blow past 288 characters. The fix is still the same as I described - change line 89 to:
,'\t,' + pg_get_constraintdef(con.oid)::VARCHAR(1024) AS ddl


How to handle upstream warnings in CI

There are some warnings popping up on the Python 3.9 tests having to do with external dependencies that are not quite staying uptodate. It seems like we should either pressure upstream library authors to update and release OR drop some of these dependencies. In particular, I am looking at crick (@jcrist), chest (@mrocklin), and fastparquet (@martindurant).
=============================== warnings summary ===============================
../../../../../usr/share/miniconda3/envs/test-environment/lib/python3.9/site-packages/crick/__init__.py:4
../../../../../usr/share/miniconda3/envs/test-environment/lib/python3.9/site-packages/crick/__init__.py:4
../../../../../usr/share/miniconda3/envs/test-environment/lib/python3.9/site-packages/crick/__init__.py:4
../../../../../usr/share/miniconda3/envs/test-environment/lib/python3.9/site-packages/crick/__init__.py:4
  /usr/share/miniconda3/envs/test-environment/lib/python3.9/site-packages/crick/__init__.py:4: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe.
  Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
    from .space_saving import SpaceSaving

../../../../../usr/share/miniconda3/envs/test-environment/lib/python3.9/site-packages/chest/core.py:1
../../../../../usr/share/miniconda3/envs/test-environment/lib/python3.9/site-packages/chest/core.py:1
../../../../../usr/share/miniconda3/envs/test-environment/lib/python3.9/site-packages/chest/core.py:1
../../../../../usr/share/miniconda3/envs/test-environment/lib/python3.9/site-packages/chest/core.py:1
  /usr/share/miniconda3/envs/test-environment/lib/python3.9/site-packages/chest/core.py:1: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3, and in 3.10 it will stop working
    from collections import MutableMapping

dask/array/tests/test_reductions.py::test_nan_object[min]
dask/array/tests/test_reductions.py::test_nan_object[min]
dask/array/tests/test_reductions.py::test_nan_object[min]
dask/array/tests/test_reductions.py::test_nan_object[max]
dask/array/tests/test_reductions.py::test_nan_object[max]
dask/array/tests/test_reductions.py::test_nan_object[max]
  /usr/share/miniconda3/envs/test-environment/lib/python3.9/site-packages/numpy/core/fromnumeric.py:86: RuntimeWarning: invalid value encountered in reduce
    return ufunc.reduce(obj, axis, dtype, out, **passkwargs)

dask/dataframe/io/tests/test_parquet.py: 2899 warnings
dask/bytes/tests/test_http.py: 2 warnings
dask/bytes/tests/test_s3.py: 21 warnings
  /usr/share/miniconda3/envs/test-environment/lib/python3.9/site-packages/fastparquet/parquet_thrift/parquet/ttypes.py:4446: DeprecationWarning: PY_SSIZE_T_CLEAN will be required for '#' formats
    iprot._fast_decode(self, iprot, [self.__class__, self.thrift_spec])

dask/dataframe/io/tests/test_parquet.py: 10278 warnings
dask/bytes/tests/test_http.py: 6 warnings
dask/bytes/tests/test_s3.py: 56 warnings
  /usr/share/miniconda3/envs/test-environment/lib/python3.9/site-packages/fastparquet/parquet_thrift/parquet/ttypes.py:2579: DeprecationWarning: PY_SSIZE_T_CLEAN will be required for '#' formats
    iprot._fast_decode(self, iprot, [self.__class__, self.thrift_spec])

dask/dataframe/io/tests/test_parquet.py: 515 warnings
  /usr/share/miniconda3/envs/test-environment/lib/python3.9/site-packages/fastparquet/parquet_thrift/parquet/ttypes.py:3572: DeprecationWarning: PY_SSIZE_T_CLEAN will be required for '#' formats
    iprot._fast_decode(self, iprot, [self.__class__, self.thrift_spec])

dask/dataframe/io/tests/test_parquet.py::test_roundtrip[fastparquet-df13-write_kwargs13-read_kwargs13]
  /usr/share/miniconda3/envs/test-environment/lib/python3.9/site-packages/fastparquet/writer.py:197: UserWarning: Coercing datetimes to UTC before writing the parquet file, the timezone is stored in the metadata. Reading back with fastparquet/pyarrow will restore the timezone properly.
    warnings.warn(

dask/dataframe/io/tests/test_hdf.py: 3315 warnings
  /usr/share/miniconda3/envs/test-environment/lib/python3.9/site-packages/tables/array.py:241: DeprecationWarning: `np.object` is a deprecated alias for the builtin `object`. To silence this warning, use `object` by itself. Doing this will not modify any behavior and is safe.
  Deprecated in NumPy 1.20; for more details and guidance: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
    (oid, self.atom, self.shape, self._v_chunkshape) = self._open_array()

dask/dataframe/io/tests/test_hdf.py::test_read_hdf[data0-assert_frame_equal]
  /usr/share/miniconda3/envs/test-environment/lib/python3.9/site-packages/tables/atom.py:1224: DeprecationWarning: tostring() is deprecated. Use tobytes() instead.
    return pickle.loads(array.tostring())

dask/dataframe/io/tests/test_parquet.py::test_categories_unnamed_index[fastparquet]
  /usr/share/miniconda3/envs/test-environment/lib/python3.9/site-packages/fastparquet/dataframe.py:127: FutureWarning: Setting the codes on a Categorical is deprecated and will raise in a future version. Create a new Categorical object instead
    index._data._codes = vals

dask/dataframe/tests/test_groupby.py::test_apply_or_transform_shuffle_multilevel[<lambda>0-<lambda>5]
dask/dataframe/tests/test_groupby.py::test_apply_or_transform_shuffle_multilevel[<lambda>1-<lambda>5]
  /usr/share/miniconda3/envs/test-environment/lib/python3.9/site-packages/_pytest/skipping.py:227: DeprecationWarning: NotImplemented should not be used in a boolean context
    if result:

Seems like the pytables issues are fixed on main and just waiting on a release.

Setting the codes on a Categorical is deprecated: I actually don't know what to do about this, we need this functionality, and I don't think there's any other public way to do it. When it gets removed, we'll be in trouble.

@martindurant reading the discussion in https://github.com/dask/fastparquet/issues/576, I thought this was already solved? Or this is a different case that cannot be solved as discussed in that issue?

I'm not sure why that issue was closed - it seems to indeed have solution(s), but it doesn't look like it's been implemented in the code.

I think we can go ahead and close this. It's probably better to open issues on the upstream libraries as these warnings crop up.


[DOCFIX] Update sitemap logic and relate checks

with following example in the menu-en.yml
 - title: example level 1
    buttonTitle: example_level_1
    subfiles:
      - title: Introduction
        url: /en/introduction/Introduction.html
      - title: Glossary
        url: /en/introduction/Glossary.html
      - subfiles:
            - title: example level 2
              buttonTitle: example_level_2
              subfiles:
                - title: example level2 doc
                  url: /en/introduction/Introduction.html
                - subfiles:
                    - title: example level 3
                      buttonTitle: example_level_3
                      subfiles:
                        - title: example level3 doc
                          url: /en/introduction/Introduction.html
      - title: Glossary
        url: /en/introduction/Glossary.html
  - title: What is Alluxioxx
    buttonTitle: What_is_Alluxioxx
    subfiles:
      - title: Introduction
        url: /en/introduction/Introduction.html

The output with format will looks like

also update the checks-doc script

alluxio-bot, merge this please


CLI Hangs on HTML type project

If you are reporting a bug or requesting support, start here:
Bug or support request summary
After install latest CLI version and when generating app of --html, cli always hangs on 95%. Same thing happens if try html example application (HTML)
Steps to reproduce

npm i -g<EMAIL_ADDRESS>getstorybook --html

(A screencast can be useful for visual bugs, but it is not a substitute for a textual description.)
Please specify which version of Storybook and optionally any affected addons that you're running

<EMAIL_ADDRESS>
Affected platforms

HTML

Screenshots / Screencast / Code Snippets (Optional)

Has show in the preview command line always hang on unnamed compat plugin.

Looks the same issue as in #3953

Released a fix in 4.0.0-alpha.16


Add default ordering for collections and subcollections queries

We don't have default ordering on API endpoints which could cause that resulted collection has random order.
Links
https://issues.redhat.com/browse/RHCLOUD-20048

For this what would you think about rather than adding that to every DAO we could just add a sort_by filter in the middleware if the user didn't pass a sort_by query parameter, like so:
diff --git a/middleware/filtering.go b/middleware/filtering.go
index 4da82eb..2567dcb 100644
--- a/middleware/filtering.go
+++ b/middleware/filtering.go
@@ -76,5 +76,6 @@ func parseSorting(c echo.Context) *util.Filter {
 		}
 	}

-	return nil
+	// no sort_by was passed - so we'll sort_by the id asc by default
+	return &util.Filter{Operation: "sort_by", Value: []string{"id asc"}}
 }

ends up with a sql query to /source_types looking like this:
{"@timestamp":"2022-10-28T13:12:09.652Z","@version":1,"app":"source-api-go","caller":"github.com/RedHatInsights/sources-api-go/logger.(*GormLogger).Trace","duration":3.68183,"filename":"/home/jlindgren/git/crc/sources/go-rewrite/dao/source_type_dao.go:41","hostname":"mewtwo","labels":{"app":"source-api-go"},"level":"debug","message":"SELECT * FROM \"source_types\" ORDER BY source_types.id asc LIMIT 100","rows":13,"tags":["source-api-go"]}

For this what would you think about rather than adding that to every DAO we could just add a sort_by filter in the middleware if the user didn't pass a sort_by query parameter, like so:

That's right - it is much simpler and cleaner solution, thanks @lindgrenj6 ! and ready for review again


clarify which subset of jsdoc and jsdoc version is supported in closure compiler

The Closure Compiler's type language derives from the annotations used by the JSDoc document-generation tool. This document describes the set of annotations and type expressions that the Closure Compiler understands.

https://developers.google.com/closure/compiler/docs/js-for-compiler?hl=en
https://github.com/google/closure-compiler/wiki/Using-JSDoc-Annotations-with-Closure-compiler
However when I go to read more about jsdoc tags and how to do some specific things I end up here
http://usejsdoc.org/tags-param.html
yet most of this syntax is unsupported
It would be super useful to provide some more explicit words around what exactly the subset is, and what version of jsdoc the rules are based off of

Those two pages are pretty complete. Is there functionality you know that works with the compiler that isn't covered by those pages?
If the syntax or annotations you are looking at isn't referenced on those pages, I would not expect it to work.

We've diverged pretty far from JSDoc at this point. The big table on that page is what we support. That first paragraph should maybe say "originally inspired by JSDoc, but has since added several Closure-specific annotations" or something like that.

As equally as important, jsdoc itself has added new syntax that the compiler doesn't support. Example
/** @param {string} [opt_arg] optional argument */

That's not supported

We've diverged pretty far from JSDoc at this po

:+1: good to know
I would just drop the jsdoc reference then because it is just confusing :grimacing: (at least was to me), as far as new functionality well, there are a bunch of nice things and syntax that jsdoc has that is not supported by closure, but given we are significantly diverged from jsdoc (TIL) I do not have a list of nice to haves off hand.

Added a little clarification to the developers.google.com page.

A+ thanks


Try to fix flaky overflow-group test

Adding getLoadingComplete to overflow-group to wait until after the first chomp. This means the additional chomp menu that gets added is then included in the children fixture will wait for. If this isn't enough, Ill need to add something similar to d2l-icon, but at least now d2l-icon is being included in the fixture wait calculations at all.

Initial vdiff run passed, but I'll run it a few times to check

Ok, five runs with no flakes!


WIP: sriov: Support enabling SR-IOV and use future VF in single desire state

When changing SR-IOV to add more VF interface, this patch allows user to
crate VF and use it in single desire state, for example with SR-IOV
disabled on eth1, you can apply this state:
---
interfaces:
  - name: sriov:eth1:1
    type: ethernet
    state: up
    ipv4:
      enabled: false
    ipv6:
      enabled: false
  - name: eth1
    type: ethernet
    state: up
    ethernet:
      sr-iov:
        total-vfs: 2

The implementation detail is introducing
MergedNetworkState.isolate_sriov_conf_out() to move ethernet
section to new MergedNetworkState if SR-IOV config desired. This new
PF only state will be applied first and the follow-up verification
process will wait all VF shows up before proceed the original
MergedNetworkState.
Unit test case and integration test case included.

Somehow the partial patch got merged. Will open new PR to fix it up.


Error mbedtls_pk_verify MBEDTLS_ERR_RSA_VERIFY_FAILED

I'm developing on Zephyr Project a library http_client and that library receive a server_signature (BASE64), that signature is made with a hash(sha256) of the string and the private key. At my library, I catch my public key and call "mbedtls_pk_parse_public_key" and runs everything right. In order to verify I call "mbedtls_pk_can_do( &pk, MBEDTLS_PK_RSA )" and "mbedtls_rsa_check_pubkey" and that functions return 0.
After I decode the server_signature using "mbedtls_base64_decode" and return 0.
But, when I call the verification function "mbedtls_pk_verify" returns MBEDTLS_ERR_RSA_VERIFY_FAILED, don't understand the reason.
I already tested the same data using OpenSSL and the verification returns true.
Bellow had where I do the verification, hash of data and public_key.
hash = "5b0908ea3740745c383cd21bb1436d2e715f7e85ae607ff9f278b0239bd7cd2f"

static const char server_signature[] = {
     "PsvfcGyV9boBqnXeJhkXGfoZVKE4+QyxAqsmB0OzmW1csA5neZCNLBeG6NncVbrS"
     "3Yq3mfqbe2RmbIi3oMKEfzeVarfLRQPcc/c3aaA9zqw6713dzYZj5Jdwo7h9a7LO"
     "/6NBQKQBMo+hDFQFndPdl9Y2eGpGphecbMjfu288UcwtQn/FBCs8ZaYIY7O8VmNS"
     "04J27Jp0dhbVGWqDWiWd2aGSgQ/6hfs39b0aDpE3OkgU/K4Ol4t0YLtmBXZAFIs2"
     "lElkqS1sfgHp3kllp5inpTZ1KWAjqP1jQgCkD7MxeZau7roryNdzRUDPAjlC0lZ3"
     "WuY7nBXSMtUNQPV05FWxKDxECQIdIETDDa48qBPTpUCkv+du5Otwi3g5ajLTWz9S"
     "zyw+zXS28znPlXHAnKlWYejy3zsBpBNsza8vhx0NwfUbdW/3R0oW5WtlrqVOLkJE"
     "XYdPUFyryrcyirNsVwa5yTBCZCoRTC0Us0/kRSqZeT/Z6lBkA/A3vMmaDhnG7VZ7"
     "WJtXium/OtBIVgPwQFmHNQ9Bu/5HLqV/qqSApoLihNHr1iAhpRXoY5XHMujzDzmZ"
     "kYJeqewz7hVEoQHITldW8Uny6SwQaWDlgFTcgyKSE60ULaX9TFzy0wz3xvGxqjZD"
     "ZXQ7WkCcbjcusXBAxCp/bI/LFtKdxUcEavaGYwg1ZRg="
};

static const char public_key[] = {
	"-----BEGIN PUBLIC KEY-----\r\n"
	"MIICIjANBgkqhkiG9w0BAQEFAAOCAg8AMIICCgKCAgEAyiPEMdY1tBIH9YXo4IFw\r\n"
	"dLLy9FPA1+bkfSFlHFRXZ+DIkfe/V36elvkfJmm3nM0HYqbDY+vqSE284VW3VeZA\r\n"
	"n0VNOlgvOQQ5foDlHSA7qv1OTlMXmVmZjY6GArjl5haDM1jkqLPUP2vbS7UJ2y/z\r\n"
	"SdJc83l2hpExapFMCUgTDDSBc0vKZRIjspjkJ0+dL7/K8UKDl/8QvF+q/j7REbne\r\n"
	"EYqyo/lwaf9EKzZvtsF6gphxT/eNKWbhlYEZrrHzydITceuxGqTlBV3Nn+tkCi+P\r\n"
	"ADgG/VPa1BG0b5xEyo6e12KgKJKMUmrvDh9UwXYvaWVKImzE0DCAVqbHNQInAtzs\r\n"
	"WkHW04w+Oeornbok57cZOMpG4fVHtMtLdFU/zRl2HxKqs+QLv8jh8JfY0MuPgqpW\r\n"
	"AtDwjyPMls4UrrrO3lWOPl5752GjcMmK27CSBI7g9XKsD/soM4/gmp2uuLRR5eMy\r\n"
	"wd3jeLjBu9f21A9YB1PoCyj21Kyx8PyXmaflNdWb5C1EOtsIR9J42Iua1K7Z3S0y\r\n"
	"RkpUxikR4l0LZ0gNa19+v1qqYye0qw+WzIBZk9VJPLp0i4lYaSlo/5kVUOXPeo5V\r\n"
	"Gf6+p6qVpuvd3pC6X/P1JnlObocQ8iaxEzmazzEUDN7gDAszpVMwNedpKKssw8uN\r\n"
	"aFHCXEDJgsstBC86OkLK64MCAwEAAQ==\r\n"
	"-----END PUBLIC KEY-----\r\n"
};

static int updatehub_check_signature(struct updatehub_context *ctx, char *package_uid)
{
	int ret, i, j, k, aux;
        char *dst;
	size_t olen = 0;
	mbedtls_pk_context pk;

 	mbedtls_pk_init(&pk );
	SYS_LOG_DBG("signature %d", strlen(server_signature));

	ret = mbedtls_pk_parse_public_key(&pk, public_key, strlen(public_key) + 1);
	if(ret != 0)
	{
		SYS_LOG_DBG("error parsing the public_key, %d", ret);
		return ret;
	}

   if( !mbedtls_pk_can_do( &pk, MBEDTLS_PK_RSA ) )
    {
        ret = 1;
        SYS_LOG_DBG( "failed! Key is not an RSA key\n" );
        return ret;
    }
    ret = mbedtls_rsa_check_pubkey(mbedtls_pk_rsa(pk));
   if(ret != 0)
	{
		SYS_LOG_DBG("Check pubkey failed");
		ctx->error_msg = "Check pubkey failed";
		return ret;
	}

	dst = k_malloc(512);
	memset(dst, 0, sizeof(dst));

       ret = mbedtls_base64_decode(dst, 512, &olen, signature, strlen(signature));
	if(ret != 0)
	{
		SYS_LOG_DBG("decode base64 failed");
		return ret;
	}

	ret = mbedtls_pk_verify(&pk, MBEDTLS_MD_SHA256, hash, 0, dst, 512);
	 if(ret != 0)
	{
		SYS_LOG_DBG("verify failed %d", ret);
	}

	k_free(dst);

	return 0;

}

Here https://github.com/chtavares592/verify_signature I developed a simple example on zephyr that my http_client needs to verify the signature.. and the same error occurs. I put the zephyr's app, the server and the keys. I don't know the reason for this problem if somebody can help I will be grateful.

@chtavares592 Thank you for your interest in Mbed TLS!
In brief look, I don't see something wrong in the flow of your calls.
But I do have a couple of general comments, which may cause some of your issues:

In your example, you have set hashas a string literal, and sent the sting literal( its length is 64 bytes) to mbedtls_pk_verify(), while the verification function receives the hash as a hex buffer( with buffer size of 32 bytes). This could be one of the causes for your failure.
I have seen in this example, and in your example link, that you refer length of pointers as sizeof which does not return the actual size of the buffer! When you call sizeof(pointer), it will return a size according to your platform architecture ( I assume 4 or 8 in your environment, but there are some architectures with smaller pointer lengths). So when you write your buffers, you may not write the full data that you think you  are writing.

@RonEld thanks for you answer me. I followed your tips and corrected that problems and I resolved to simplify the code removing the server side and letting just application working. But the problem doesn't resolve yet If you could see again o code modified I'll be grateful to help me. Thanks again.
https://github.com/chtavares592/verify_signature/blob/master/verify_signature/src/main.c

@chtavares592 I can't seem to find something wrong in your flow, (except a memory leak in your dst variable), assuming your hash function is correct.
You should verify that you have are using the public key which private key pair was used to generate the signature, of this specific hash.
You should erify that the input of the hash is as you think ( is the length 17 on both signing and verification?) You should check that the signature is in the correct byte order.

@RonEld I corrected the memory leak at dst variable. I already verify the keys and they are right. And the hash is ok too.
I took your public key, signature and data and integrated them to the pk_verify  sample application and got the same result.
The only thing I could think about at the moment is that at east one of your parameters you are using is incorrect.

Is the signature encoded in base64 correct? Is it the correct signature?
Is this the actual public key?
Is the data content and length correct?

@RonEld sorry to delay to answer.I'm trying to resolve this problem. I generated a new of key pairs and the signature on OpenSSL on the terminal and put in my app. The great news is the diff is less the others tests, now 19 diffs. But I continuous check my parameters and don't know the problem...  Thanks for helping me.

@RonEld , Do you know if there is an alternative form to verify the RSA signature?

@chtavares592 you could try directly thersa module instead of the pk wrapper, but I doubt it would help.
The fact that you now have 199 diffs instead of 22 diffs does really matter. You shouldn't get any difference.

@chtavares592 WE can't see anything wrong in the flow.
I would suggest you look how you generate the signature as well

@RonEld I'm signed with command line  echo -n test-verification | sha256sum | openssl dgst -sha256 -sign  private_key.pem -out /tmp/sign.sha256 - on terminal and after I use the conversion of base64 openssl base64 -in /tmp/sign.sha256 -out base64.txt for to get the signature.
The sha256sum is the same of my application.

@RonEld Now I changed my app and I sign and verify at the same app, and I get the signature is completely different than OpenSSL -sign or the node js signature... But returns zero the pk_verify function. If you could see my new implementation. Thanks. https://github.com/chtavares592/verify_signature/blob/master/verify_signature/src/main.c

@RonEld Indeed the problem is with the signature. I was able to get the signature through the pk_sign function and set it to "static unsigned char signature_ph_sign". The OpenSSL signature is the same as node js and completely different from pk_sign. Now I wanted to understand why this difference occurs, which makes the signatures so different. thank you. You can see here https://github.com/chtavares592/verify_signature/blob/master/verify_signature/src/main.c

@RonEld I finally can verify the signature, I found my mistake... I was signing the sha256sum of data's sha256sum. Thanks for helping and sorry for my dumb mistake.

@chtavares592
I am glad you resolved your issues. Mistakes happen. to answer your question:

Now I wanted to understand why this difference occurs, which makes the signatures so different.

When signing, there is a random element(notice you send a callback to the f_rng), which makes the signature different in every call. This is why it's strange you got same value in openssl as node js.
I am now closing this issue, as the issue is resolved.


fix: reset manifest version

What type of PR is this? (check all applicable)

[ ] 🍕 Feature
[x] 🐛 Bug Fix
[ ] 📝 Documentation Update
[ ] 🎨 Style
[ ] 🧑💻 Code Refactor
[ ] 🔥 Performance Improvements
[ ] ✅ Test
[ ] 🤖 Build
[ ] 🔁 CI
[ ] 📦 Chore (Release)
[ ] ⏩ Revert

Description
This is a hotfix to patch the issue mentioned at #121.
Related Tickets & Documents
Mobile & Desktop Screenshots/Recordings
Added tests?

[ ] 👍 yes
[x] 🙅 no, because they aren't needed
[ ] 🙋 no, because I need help

Added to documentation?

[ ] 📜 README.md
[ ] 📓 docs.opensauced.pizza
[ ] 🍕 dev.to/opensauced
[ ] 📕 storybook
[ ] 🙅 no documentation needed

[optional] Are there any post-deployment tasks we need to perform?
[optional] What gif best describes this PR or how it makes you feel?

Outdated. Will be resolved by #124.


Error: out of memory

Hi
when run your code, ERROR is:
Error: out of memory

@tavousi  what kind of OS are you on (windows, mac OSX, linux...) ?

windows

OK. Can you please show me the arguments you are passing to the script, and the output you are getting from the script?

Please look at the screenshot.it is all.

generateLifeCalender.py is this your own script? it has a different name than the script in my repository. If it is different, can you show me the contents?

nevermind, I can reproduce the error on my own windows machine. Looks like some problem with pycairo on windows, it works fine on ubuntu.
I will figure out the problem this weekend when I have some time. In the meantime, if you just want to generate a life calendar, the life calendar generator on my website https://www.ekn.io/calendar/ is working fine, since it's running on linux, so you can use that.

I don't change your script. Thanks for your comments.It is another screenshot.

you might try using the old version pycairo==1.11.1. even on ubuntu I've had issues with 1.20.1

you might try using the old version pycairo==1.11.1. even on ubuntu I've had issues with 1.20.1

To fix this issue on Windows you can install the pycairo module from binaries provided by Christoph Gohlke.
Uninstall actual pycairo module with pip uninstall pycairo
Go to this address https://www.lfd.uci.edu/~gohlke/pythonlibs/#pycairo
Download the binary corresponding to your Python version (cp37 -> Python 3.7, cp38 -> Python 3.9, cp39 -> Python 3.9)
Take also care to OS version, 32 bit (suffix win32.whl) or 64 bit (suffix win_amd64.whl)
Install the binary with pip install pycairo‑1.20.0‑cp37‑cp37m‑win_amd64.whl for example if Python 3.7 in 64 bit.
That's it


Revert "Revert "dispatch.summaries by default when possible""

Reverts vespa-engine/vespa#5541

@baldersheim please review
The only real change is in Dispatcher - the rest is to make things testable etc.
I've changed to read summaries in the same way as we do when receiving via fs4.
I think the 2*32-value etc. must be due to LongdataField doing return convert(value.asData(Value.empty().asData()));
but I do not understand how we get there, or why we don't see it in the other path ... I'll attempt to change it once this is done.

From offline discussion:

We must do this in just one way and this PR ensures that.
Longdatafield is for long arrays of bytes while Long is int64, so no worries there.


Set the NFS export to map all the users on the remote to the current user

Currently for NFS shares the driver maps the remote root user to the local root user
This causes issues where all files created by the remote are owned by local root and are unaccessible without modifying permissions.
I have changed the NFS mount to map all remote users to the current user, this means that files created by the remote now has the same permissions as the local user.
I think this will fix https://github.com/zchee/docker-machine-driver-xhyve/issues/99
NFS Reference

@jamesRaybould Sorry for a late reply :(
Thanks!
Good catch. I will test and merge.

@jamesRaybould I was tested. It will work :)
LGTM.

@zchee Thanks for this. Will test it this weekend.


fix user defined var

Any test case for this?

Any test case for this?

This bug will only be triggered by optimizer. There are already corresponding test cases in tck.


Update libhdfs3 conda recipe with new repo

The libhdfs3 source has moved to the Apache HAWQ repo. Need to update the conda recipe accordingly to point to: https://github.com/apache/incubator-hawq/tree/master/depends/libhdfs3

Note that this is still an open issue, but perhaps for the https://github.com/conda-forge/hdfs3-feedstock repo. This is blocked because there is currently no way to refer to libhdfs3 versions in their new repos.

OK, I misunderstood then. Not sure where the note belongs - you can have managerial final say on that.

I opened https://github.com/conda-forge/hdfs3-feedstock/issues/3 to track this. Thanks.


Saved State and Search

The generate saved state link does not track which function panel is open.  For example, if a set of search parameters are entered into a search screen and the map state is saved, the parameters are populated in the correct search, but the search function panel is not opened.

Saved state also comes up hidden behind the Details panel. I'm seeing this in MS Edge.

If anything is selected, the Selection function panel will display in a saved state. In absence of any selection, a saved state only shows the list of function panels, rather than the function panel that was actually active when the state was saved. I do not think that this was the intended behavior of the saved state functionality.

I've tested this issue in GPV 5.1 beta and this issue remains.


Update dependency on proc-macro2

Allow the latest version of proc-macro2.
I'm not sure the update breaks anything, however.

.28 is now latest, seems to work fine as well. bump?

fixed in v0.3.4


Is OctoPrint-Anywhere crashing my Octoprint service

Love the plug-in, i'm really hoping this isn't what is causing my issue. I have 2 machines running this plugin in and both are mysteriously stopping after a few hours of printing intermittently. Here is a copy of the log https://pastebin.com/ePBFfTwh
Any ideas?

From the logs it looks like somehow the connection from your OctoPi to the internet was shaky. The errors in logs were from every time when OctoPrint Anywhere tried but failed to connect to the server.
Although the connectivity issue doesn't seem to be caused by OctoPrint Anywhere plugin, I'll be happy to have a google hangout session to troubleshoot the problem. Feel free to email me at kenneth dot jiang at gmail dot com so that we can coordinate a time to chat.

@DigChaos It's pretty obvious now that the random crash issue is not caused by my plugin as it happens to other users without my plugin installed. This OctoPrint issue has more details.
Also please note that I have improved the plugin a lot by reducing the bandwidth it requires. The new version barely sends any data when nobody is watching the webcam feed. Please upgrade if you haven't done so.


copy html breaks on firefox

in https://static.nrk.no/core-icons/latest/index.html, when hitting "copy html" nothing is copied to the clipboard and this warning is shown in console:
document.execCommand(‘cut’/‘copy’) was denied because it was not called from inside a short running user-generated event handler.

fixed in #74


Add Rotate UI

https://daybrush.com/moveable/storybook/?path=/story/basic--rotatable

Hello there, is this topic under development ?

Hi @FikretCin
Not yet... sorry

This has been merged and will be released in v3.


[REVIEW ONLY] Enable Cookies

Fix for https://github.com/adobe/brackets/issues/8582

I am trying to get cookies from server in client app that is running on bracket but cookie only comes in response header (set-cookie). How to set it to browser cookie ??


Hide recovery and registration links on login page when those flows are disabled

Preflight checklist

[X] I could not find a solution in the existing issues, docs, nor discussions.
[X] I agree to follow this project's Code of Conduct.
[X] I have read and am following this repository's Contribution Guidelines.
[X] This issue affects my Ory Network project.
[X] I have joined the Ory Community Slack.
[X] I am signed up to the Ory Security Patch Newsletter.

Describe your problem
When disabling the recovery and registration flows the Account Experience needs hide the links on the page that navigate the user to the registration and recovery page.
Describe your ideal solution
Call the registration and recovery endpoints in the background when the login page is shown to verify if the recovery and registration pages are enabled.
Workarounds or alternatives
None.
Version
latest
Additional Context
No response

@jonas-jonas is this done already?

This will be available in the new account experience.


Dropdown on MPPWCC, MPPWSA, Top Women for Other Years portion of page

 Drop-Down Menu

 New section on Daily Newsletter

 New Section on CC Newsletter


Add more get options (include_tree_info, include_proof, include_version)

Change summary:

Add include_tree_info, include_proof, include_version flags to get options
Merge toJsObjectShallow() to toJsObject()
Use StateInfoProperties to generate meta data
Do some code refactoring

Related issues: https://github.com/ainblockchain/ain-blockchain/issues/505

PTAL at the revised parts. @liayoo

Thanks for the fast review, now merging..


Implement program in DE API

Definition of Ready

[ ] Does this meet the INVEST criteria?
[ ] Does this have a clearly defined user?
[ ] Does this have an estimate?
[ ] Does this have acceptance criteria?
[ ] Does this have sufficient context (wireframes, business rules, etc.)?
[ ] Is this traceable to a feature, epic, or PI?

User Story
As a user I want retrieve program data So that I can analyze it
Acceptance Criteria
Given that a user has entered one or more program codes in an upper-case or lower case format
When the API endpoint is executed
Then the system displays the records that match the criteria (containing data elements below)
Given that a user has entered one or more program codes without white space(s) before or after the delimiter
When the API endpoint is executed
Then the system displays the records that match the criteria (containing data elements below)
Given that a user has entered one or more program codes with white space(s) before or after the delimiter
When the API endpoint is executed
Then the system displays the records that match the criteria (containing data elements below)
Context
(User journeys, design mockups, architectural diagrams, business rules, data element definitions)
Data Elements
Results:
When the system identifies at least one record that matches the criteria, then for each record the system will display:
STATE
FACILITY_NAME
ORISPL_CODE
UNITID
ASSOC_STACKS
OP_DATE
SUM_OP_TIME
COUNT_OP_TIME
GLOAD
SLOAD
SO2_MASS
SO2_RATE
NOX_MASS
NOX_RATE
CO2_MASS
CO2_RATE
HEAT_INPUT
PRIMARY_FUEL_INFO
SECONDARY_FUEL_INFO
UNIT_TYPE_INFO
SO2_CONTROL_INFO
PART_CONTROL_INFO
NOX_CONTROL_INFO
HG_CONTROL_INFO
PRG_CODE_INFO
Testing
Test Case:
Tester:
Definition of Done

[ ] Have all Acceptance Criteria been agreed to and validated by the scrum team?
[ ] Has the code been unit tested and peer reviewed?
[ ] Have the functional tests been executed?
[ ] Have all defects been reviewed and dispositioned, resolved, or deferred?
[ ] Has the user story been accepted by the Product Owner?
[ ] Is the user story ready to be deployed to the test/staging environments?

During sprint planning on 3/17, the team decided to complete the DE API by creating tickets #967, #968, #969, #970


Can BIBFRAME  use openWEMI?

How would this work? Is it necessary?

I don't think that BIBFRAME and WEMI are compatible... WEMI is a four tier model while BIBFRAME is a three tier model.
In what ways were you thinking that they might work?

Here are some examples of how, in my thinking, BIBFRAME could make use of openWEMI. openWEMI classes would need to be defined as rdf:domain values on BIBFRAME properties. My understanding is that adding these properties would not interfere with the use of BIBFRAME qua BIBFRAME, but the BIBFRAME community would need to decide to use openWEMI.
Note that it would not be sufficient to subclass BIBFRAME classes to openWEMI. A primary reason is that BIBFRAME Work may combine openWEMI Work and Expression. The other reason is that BIBFRAME does not include domains for all of its properties so using subclassing would be an incomplete solution.
This property has a domain of .../bibframe/Work:
<owl:DatatypeProperty rdf:about="http://id.loc.gov/ontologies/bibframe/musicOpusNumber">
<rdfs:domain rdf:resource="http://id.loc.gov/ontologies/bibframe/Work"/>
<rdfs:range rdf:resource="http://www.w3.org/2000/01/rdf-schema#Literal"/>
<skos:definition>
Numeric designation of a musical work assigned by a composer, publisher, or a musicologist.
</skos:definition>
<rdfs:label>Music opus number</rdfs:label>
<dcterms:modified>2016-04-21 (New)</dcterms:modified>
</owl:DatatypeProperty>

It could also have a domain of .../openwemi/work and this would mean that the property confers both classes on its subject:
<owl:DatatypeProperty rdf:about="http://id.loc.gov/ontologies/bibframe/musicOpusNumber">
<rdfs:domain rdf:resource="http://id.loc.gov/ontologies/bibframe/Work"/>
<rdfs:domain rdf:resource="http://example.com/openwemi/Work"/>
<rdfs:range rdf:resource="http://www.w3.org/2000/01/rdf-schema#Literal"/>
<skos:definition>
Numeric designation of a musical work assigned by a composer, publisher, or a musicologist.
</skos:definition>
<rdfs:label>Music opus number</rdfs:label>
<dcterms:modified>2016-04-21 (New)</dcterms:modified>
</owl:DatatypeProperty>

BIBFRAME "carrier" could have the domain of ...openwemi/Manifestation:
<owl:Class rdf:about="http://id.loc.gov/ontologies/bibframe/Carrier">
<rdfs:label>Carrier type</rdfs:label>
<rdfs:domain rdf:resource="http://example.com/openwemi/Manifestation"/>
<skos:definition>
Categorization reflecting the format of the storage medium and housing of a carrier.
</skos:definition>
<dcterms:modified>2016-04-21 (New)</dcterms:modified>
</owl:Class>

BIBFRAME "illustrativeContent" is suggested to be used with either bf:Work or bf:Instance, but is generally considered to be FRBR Expression information.
<owl:ObjectProperty rdf:about="http://id.loc.gov/ontologies/bibframe/illustrativeContent">
<rdfs:range rdf:resource="http://id.loc.gov/ontologies/bibframe/Illustration"/>
<rdfs:domain rdf:resource="http://example.com/openwemi/Expression"/>
<skos:definition>
</skos:definition>
<rdfs:comment>Suggested use - With Work or Instance</rdfs:comment>
<rdfs:label>Illustrative content information</rdfs:label>
<dcterms:modified>2016-04-21 (New)</dcterms:modified>
</owl:ObjectProperty>

@niklasl Thanks for the detailed description. I like the idea of giving a unifying classes of creation and embodiment. I'm not sure how those intermediate classes can be squared with openWEMI but will see if others have ideas. The question is how to insert a class between Work and Endeavor, when Work has already been defined with Endeavor as its super-class. I presume this means one would end up with multiple superclasses for WEMI, e.g. Work would be a subclass of Creation and of Endeavor, and Creation would also be a subclass of Endeavor.
flowchart BT
A((Endeavor))
B((Creation))-->A
D((Work))-->B
D-->A

This looks complicated to me, and I wonder if there isn't a better solution.
Without openWEMI, I think your design looks like this, although you've given some different names to WEMI, if I understand correctly:
flowchart BT
A((Endeavor))
B((Creation))--> A
C((Embodiment))--> A
D((Work))--> B
E((Expression))--> B
F((Manifestation))--> C
G((Item))--> C

Here's a diagram of the KBV classes and subclasses:

I included the left hand side and "Serial Edition" for completeness, although they're not required for WEMI.
Writing "ow" for OpenWEMI, is this the correct mapping:
ow:Work = kbv:Work
ow:Expression = kbv:Instance
ow:Manifestation = kbv:Item
ow:Item = kbv:Representation
-- Graeme

Two diagrams showing explicit mappings between OpenWEMI and KBV.  The first diagram shows all classes separate; the second shows the case where openwemi:Endeavor is the same as kbv:Endeavour.

Here's a diagram of openWEMI and BIBFRAME:

Is each ow: class a sub-class directly of ow:Endeavor or are they nested
within a parent class?
Do bf: classes overlap 100% or only partially with ow: classes?
Hugh
On Sun, Jul 16, 2023 at 12:42 PM Karen Coyle @.***>
wrote:

Here's a diagram of openWEMI and BIBFRAME:
[image: Screenshot 2023-07-16 at 9 22 11 AM]
https://user-images.githubusercontent.com/1564129/253816144-00b59851-2013-46d3-9262-0abdab145f1f.png
—
Reply to this email directly, view it on GitHub
https://github.com/dcmi/openwemi/issues/7#issuecomment-1637135376, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAAJ2JXKS6PH7Y6NROBX5MDXQQKYHANCNFSM565X5OAA
.
You are receiving this because you were mentioned.Message ID:
@.***>

--
All the best,
-Hugh
Sent from my iPhone

@HughP The openWEMI classes are each subclasses of Endeavor. The Swedish national library has added an intermediary class between the WEMI classes and Endeavor. We think this can still work with openWEMI, as per the diagram above, assuming that their Endeavor class is subclassed to openWEMI:Endeavor. I'm less clear about the question of  subclassing their WEMI to openWEMI, and I think we need more discussion about that.
As for BIBFRAME, I think that's an open question. BIBFRAME vocabulary does not always make use of domains that would make it possible to connect properties in the vocabulary to WEMI or BF upper classes (bf:Work, Instance, Item). (This is how it looks to me, anyway.) There are some properties that look like:
<owl:DatatypeProperty rdf:about="http://id.loc.gov/ontologies/bibframe/musicKey">
    <rdfs:domain rdf:resource="http://id.loc.gov/ontologies/bibframe/Work"/>

but others are:
<owl:ObjectProperty rdf:about="http://id.loc.gov/ontologies/bibframe/geographicCoverage">
    <rdfs:domain rdf:resource="http://www.w3.org/2000/01/rdf-schema#Resource"/>

or:
<owl:DatatypeProperty rdf:about="http://id.loc.gov/ontologies/bibframe/mainTitle">
    <rdfs:domain rdf:resource="http://id.loc.gov/ontologies/bibframe/Title"/>

And I do not know why or what is intended. However, if we were to (theoretically) subclass bf:Work to ow:Work AND ow:Expression then when musicKey is used in instance data you would infer that the subject is a member of three classes: bf:Work, ow:Work, and ow:Expression.  rdf-schema#Resource is a kind of default, and would be SUPER openWEMI so there is no connection that we can make there.
BIBFRAME also has properties with a kind of internal class membership, like bf:Title, which unites all of the title properties, but which is not associated with any of the BF upper classes. The "upper" classes are used in instance data to define what some call "shapes." That is, the work "shape" is given a class of Work, but many of the properties used with Work do not have Work as a domain. I assume that somewhere there is a document or discussion that explains this, and if anyone can bring clarity to this, I would love to hear it!

Well, here's my attempt at making sense ...
(I hope you appreciate my attempt at white-out!)

What all of this brings up for me is that the defined vocabulary and the instance data are not one and the same. And that is definitely true if you concede that most applications are not making use of inferencing, therefore the instance data has its own structure. I think we need to make sure that the openWEMI vocabulary works both with and without inferencing, and that it doesn't interfere with the creation and validation of actual data. That's a big requirement, but worth thinking through.


[ai-flyout-menu] track open/close state of the filter-flyout menu

What package is this for?

[ ] React
[x] Angular

Summary
In the ai-flyout-menu, currently there's no way to react to the flyout's open/close state. Provide an @Output event to know the same?
Additional context Need this to close the pane when we use a custom header instead of the in-built header.
Specific timeline issues / requests
I'm working on utilising this in orderlines-table component for the CC team.

@JordanWSmith15 This one is for Angular. The react FlyoutMenu already provides an onChange prop to achieve this. I'm going to remove this from the March release.

Hi @kevinsperrine,
Do we have a way to know the filters state (isActive / isOpen) or something similar in Angular for now?

Hi @kevinsperrine, Do we have a way to know the filters state (isActive / isOpen) or something similar in Angular for now?

Sorry, @indieNik, I know very little about Angular, but I don't think there is. @zvonimirfras, @Donisius, or @sophiiae  Can you answer this?

@zvonimirfras, is there a timeline that is being followed for the releases? I can see that it has been moved to Angular Q1 - 2022. Does that mean this change will only be available at the end of Q1? One of my tasks has a dependency on this issue, hence the ask.


Not worked low script

Can u help me ?

Please give your platform/os

Please give your platform/os

Ubuntu	& Windows 10

How have you installed whatsfly ?
If you installed it via pip, please uninstall it and install via pip install git+https://github.com/cloned-doy/whatsfly.git, to install the main branch. If it doesn't work, you can try my PR: pip install git+https://github.com/Labfox/whatsfly.git
(you can also try to compile whatsfly dependencies as mentionned in #9 )

Just thinked, remove the + on the phone number


On startup, mempool should re-queue transactions that are still valid for the epoch and remove transactions that are no longer valid

originally creatd by @sdbondi

I'm not sure if this is needed, the network kinda has to be running all the time, so there won't be these cases where only a single node has a transaction

Closing this as it no longer applies


volume rm -f allows removing volume that is in use

As reported by @intesar in https://github.com/docker/docker/issues/31436#issuecomment-283206741, docker volume rm -f allows deleting volume that are in use. Steps to reproduce are below, but I suspect that the reference-counter is always updated if -f is used, even if removing the volume isn't actually successful.
I was able to reproduce both on docker 1.13.1, and on current master (https://github.com/docker/docker/commit/7298941)
Reproduction steps:
Create a volume;
$ docker volume create my-volume
my-volume

Start a container using that volume and add some files to the volume
$ docker run -dit --name my-container -v my-volume:/volume busybox sh -c 'touch /volume/one /volume/two && exec /bin/sh'
c76a270145efd47b4363554b67fadf74e6f4fa05daf045023a93e2366b38e65e

Try to remove the volume;
$ docker volume rm my-volume
Error response from daemon: Unable to remove volume, volume still in use: remove my-volume: volume is in use - [c76a270145efd47b4363554b67fadf74e6f4fa05daf045023a93e2366b38e65e]

Try to remove the volume with -f;
$ docker volume rm -f my-volume
my-volume

This looks to work, but doesn't actually remove the volume;
$ docker volume ls
DRIVER              VOLUME NAME
local               my-volume

$ docker exec my-container sh -c 'ls -la /volume/'

total 8
drwxr-xr-x    2 root     root          4096 Mar  1 11:06 .
drwxr-xr-x   19 root     root          4096 Mar  1 11:06 ..
-rw-r--r--    1 root     root             0 Mar  1 11:06 one
-rw-r--r--    1 root     root             0 Mar  1 11:06 two

However, running docker volume rm a second time, the remove succeeds (no -f needed);
$ docker volume rm my-volume
my-volume

The volume is removed;
$ docker volume ls
DRIVER              VOLUME NAME

And no longer attached to the container;
$ docker exec my-container sh -c 'ls -la /volume/'
total 0

/cc @cpuguy83

I have a fix, working on some tests


Error: java.lang.RuntimeException: Could not execute entrypoint stage 'main' due to errors, provided by 'mythicmetals'!

The game crashed whilst initializing game
Error: java.lang.RuntimeException: Could not execute entrypoint stage 'main' due to errors, provided by 'mythicmetals'!
Here is the crash log
crash-2023-01-30_20.13.19-client.txt

The alpha version of Mythic Metals requires the latest version of owo-lib. I have already bumped the version in the fabric.mod.json, so you are notified of this for the actual release.


Fix cygwin motif libXm detection

Cygwin uses extension .dll.a for library for linking to dll.
Add detection for libXm.dll.a on Cygwin for gui-motif to be buildable.

Used to use Athena on Cygwin and many other platforms for decades (at least 2).
Now forced to move on as Athena support has been removed and looks like nobody use motif on Cygwin either.


Bugfix/_has_len

What does this PR do?
Enable tests for dataloader where len is defined but can raise NotImplementedError (e.g. in some torchtext cases).
Continuation of PR #2293

Fixes #2277 #2293
Before submitting

[X] Was this discussed/approved via a Github issue? (no need for typos and docs improvements)
[X] Did you read the contributor guideline, Pull Request section?
[X] Did you make sure your PR does only one thing, instead of bundling different changes together? Otherwise, we ask you create a separate PR for every change.
[X] Did you make sure to update the documentation with your changes?
[X] Did you write any new necessary tests?
[X] Did you verify new and existing tests pass locally with your changes?
[x] If you made a notable change (that affects users), did you update the CHANGELOG?

PR review
Anyone in the community is free to review the PR once the tests have passed.
If we didn't discuss your PR in Github issues there's a high chance it will not be merged.
Did you have fun?
Make sure you had fun coding 🙃

Hello @thschaaf! Thanks for opening this PR.

In the file tests/trainer/test_dataloaders.py:

Line 371:1: E303 too many blank lines (3)

Do see the Hitchhiker's guide to code style

@Borda I commented out all
@pytest.mark.skip('TODO: speed up this test')
The local test ran successful on my laptop.

@Borda For your information the added test passed on all machines that showed "canceled" (e.g. https://github.com/PyTorchLightning/pytorch-lightning/runs/792966810?check_suite_focus=true). However I assume that the overall runtime was too long.
Ideally the runtime for the test should be increased.
What do you recommend to get the PR merged?

Ideally the runtime for the test should be increased.

tests shall not take longer than a min time and 10min is already quite a lot... :]

What do you recommend to get the PR merged?

let's think about another way around how to test the functionality with a minimal nb epochs/steps... what about setting max_steps in Trainer?

@Borda Does max_steps have an effect if max_epoch is 1 and the number of batches produced by the data loader is 2?
@awaelchli The tests were a copy and paste of test for CustomInfDataloader which has no len function. It might have been naive to use them as example, especially not noticing that they are skipped entirely.

@Borda , @awaelchli I am more and more convinced that there is something going on related to the test framework that I don't understand.
When I just run the test with pytest
pytest -v  -x  tests/trainer/test_dataloaders.py::test_train_not_implemented_error_dataloader_error tests/trainer/test_dataloaders.py::test_val_not_implemented_error_dataloader_error tests/trainer/test_dataloaders.py::test_test_not_implemented_error_dataloader_error tests/trainer/test_dataloaders.py::test_not_implemented_error_train_dataloader tests/trainer/test_dataloaders.py::test_not_implemented_error_val_dataloader
They finish on my laptop in about 2 seconds (total). This is probably the minimum that can be achieved, given all the overhead from starting the test framework etc. If I increase the number of batches that are processed the time increases modestly to 6 seconds for 150. So this would indicate that the new test are not the reason why the runtime is so long.
My suspicion was that something makes the test framework hang randomly when parallelism is used. That is why I disabled the parallel data loading, but it still happen that the process hands from time to time. This happen more frequent in the local test, and it does not necessary hang in the test that were added.
Do you have any ideas what it means that the above test passes often, but the local and integration test hangs relatively frequent?
Thanks!

@Borda , @awaelchli  Finally the tests ran through, but the solution is not encouraging. Looks like disabling parallel data loading in ModelTemplateData (num_workers=0) prevents the test framework from hanging. The test completed successfully in about 5 Minutes on Ubuntu.
This implies the issue has nothing todo with my bug fix from #2293 and indicates probably a more serious issue in Pytorch-lightning or the testing framework or the interaction. It could be still that there is a problem with the test that I copied, but it is not obvious why parallel data loading would make the test system so unstable just with the new test. Especially since the test got hanging in very different tests.
This seems not like a good solution, and I am worried that so far nobody seemed to have run into this issue, except maybe for the author of the original inf_dataloader tests. Since these test were skipped it makes me suspect that this problem could exist undetected for some time.
I am not happy with the solution, and hope that you or someone else can explain what is going on. How do you feel about merging this and creating a new issue?

@Borda Did you have time to look at my previous questions. (inlined below). In particular the one to create a new issue.

@Borda , @awaelchli Finally the tests ran through, but the solution is not encouraging. Looks like disabling parallel data loading in ModelTemplateData (num_workers=0) prevents the test framework from hanging. The test completed successfully in about 5 Minutes on Ubuntu.
This implies the issue has nothing todo with my bug fix from #2293 and indicates probably a more serious issue in Pytorch-lightning or the testing framework or the interaction. It could be still that there is a problem with the test that I copied, but it is not obvious why parallel data loading would make the test system so unstable just with the new test. Especially since the test got hanging in very different tests.
This seems not like a good solution, and I am worried that so far nobody seemed to have run into this issue, except maybe for the author of the original inf_dataloader tests. Since these test were skipped it makes me suspect that this problem could exist undetected for some time.
I am not happy with the solution, and hope that you or someone else can explain what is going on. How do you feel about merging this and creating a new issue?

@Borda Did you have time to look at my previous questions. (inlined below). In particular the one to create a new issue.

I hope I 'll get to this today, maybe we can contact on slack?

This implies the issue has nothing todo with my bug fix from #2293 and indicates probably a more serious issue in Pytorch-lightning or the testing framework or the interaction.

Mind describes your suspicion in a new issue so we can split the PR fix from others

It could be still that there is a problem with the test that I copied, but it is not obvious why parallel data loading would make the test system so unstable just with the new test. Especially since the test got hanging in very different tests.

@williamFalcon have you experienced something similar?

This seems not like a good solution, and I am worried that so far nobody seemed to have run into this issue, except maybe for the author of the original inf_dataloader tests. Since these test were skipped it makes me suspect that this problem could exist undetected for some time.

but they were skipped by your PR, right?

I am not happy with the solution and hope that you or someone else can explain what is going on.

maybe I am missing something, what are you not sure about this tests repair?

How do you feel about merging this and creating a new issue?

yes, that I would do...
cc: @awaelchli

@Borda Did you have time to look at my previous questions. (inlined below). In particular the one to create a new issue.

I hope I 'll get to this today, maybe we can contact on slack?

Sure. I have slack installed for work. How do I contact you or join the right slack channel or workspace?

but they were skipped by your PR, right?

Yes. I just locally enabled them and the inf_dataloader test don't take long at all.

Not so sure about the num_workers = 0 in the test. Sooner or later someone is going to change that and then has to debug these tests. I would rather not set it if we can't explain why it does not work. Maybe it has to do with raising the StopIteration?

@thschaaf This raises an ImportError now on the master branch, could you have a look?

@thschaaf This raises an NotImplementedError now on the master branch, could you have a look?

@awaelchli will do.

addressing the issue in #2375, @thschaaf pls check it there


Ephemeral os disk

Hi all,
the pr related to the issue #671
Still open:
robocop fixed (1)
Checklist:
Please check each of the boxes below for which you have completed the corresponding task:

[x] I have performed a self-review of my own code
[x] I have commented my code, particularly in hard-to-understand areas
[x] I have added tests that prove my fix is effective or that my feature works
[x] All unit tests pass locally (after my changes)
[x] Rubocop reports zero offenses (after my changes)

Please include below the summary portions of the output from the following 2 scripts:
pushd src/bosh_azure_cpi
  ./bin/test-unit
  ./bin/rubocop_check
popd

NOTE: Please see how to setup dev environment and run unit tests in docs/development.md.
Unit Test output:
1031 examples, 0 failures
Rubocop output:
Offenses:

lib/cloud/azure/vms/vm_manager.rb:22:5: C: Metrics/AbcSize: Assignment Branch Condition size for create is too high. [<85, 167, 47> 193.2/192]
    def create(bosh_vm_meta, location, vm_props, disk_cids, network_configurator, env, agent_settings, network_spec, config) ...
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

190 files inspected, 2 offenses detected, 1 offense auto-correctable

Changelog
Add Azure Ephemeral OS disk:
https://learn.microsoft.com/en-us/azure/virtual-machines/ephemeral-os-disks
Update bosh-cloud config to use ephemeral os disk:
"ephemeral_disk": {
      "size": 20480,
      "use_root_disk": true
    },
    "root_disk": {
      "placement": "cache-disk"
    }

New attribute at root_disk, placement
The placement can be set to: remote (default), cache-disk resource-disk
The disk calculation are change when use_root_disk is set to true and placement is different than remote.
The behaviour is that the size of the root and ephemeral disk are added  together.
"ephemeral_disk": {
      "size": 20480,
      "use_root_disk": true
    },
    "root_disk": {
      "size": 30720,
      "placement": "cache-disk"
    }

will result in a ephemeral os disk with the size of 51200 placed on the vm cache disk.
Regards

@rkoster @beyhan feel free to review my pr.
Thx

Would it be possible to squash down the commits in this PR? The merge from master, and various fix commits will not make git history easier to comprehend. -Thanks!

@HappyTobi could you squash the commits as @aramprice has asked?  If so could you add your review to github so we can merge?

@rkoster the shape of this looks good to me but I don't have enough context on Azure to do a deep dive on the actual implementation.

@rkoster rebase is done

I'm the wrong one to give the PR a detailed evaluation, but I do have one question:
What happens if the largest temporary root disk that Azure is willing to provide is smaller than what we ask Azure for?
For context about my concern, notice that Size limit for OS disk row of the first table here https://learn.microsoft.com/en-us/azure/virtual-machines/ephemeral-os-disks, says:

Cache size or temp size for the VM size or 2040 GiB, whichever is smaller. For the cache or temp size in GiB, see DS, ES, M, FS, and GS

To see the maximum temporary storage limit for each machine type, go looking at the various machine sizes here https://learn.microsoft.com/en-us/azure/virtual-machines/sizes-general. (In particular, note that extremely budget-conscious customers might choose a Standard_B2s, which has a temporary storage limit of 8GB, or maybe a Standard_DS2_v2 which has a 14GB limit.)
Also, notice that some machine types don't have a local temporary disk. What happens if the VM size selected has no local temporary disk? https://learn.microsoft.com/en-us/azure/virtual-machines/azure-vms-no-temp-disk

@klakin-pivotal
Thx for asking.

I'm the wrong one to give the PR a detailed evaluation, but I do have one question:
What happens if the largest temporary root disk that Azure is willing to provide is smaller than what we ask Azure for?

You will receive an error that the disk cache / resource disk is to big for the select vm-type. (Azure api error response)

For context about my concern, notice that Size limit for OS disk row of the first table here https://learn.microsoft.com/en-us/azure/virtual-machines/ephemeral-os-disks, says:

Cache size or temp size for the VM size or 2040 GiB, whichever is smaller. For the cache or temp size in GiB, see DS, ES, M, FS, and GS

To see the maximum temporary storage limit for each machine type, go looking at the various machine sizes here https://learn.microsoft.com/en-us/azure/virtual-machines/sizes-general. (In particular, note that extremely budget-conscious customers might choose a Standard_B2s, which has a temporary storage limit of 8GB, or maybe a Standard_DS2_v2 which has a 14GB limit.)
Also, notice that some machine types don't have a local temporary disk. What happens if the VM size selected has no local temporary disk? https://learn.microsoft.com/en-us/azure/virtual-machines/azure-vms-no-temp-disk

You also receive an error while creating the VM.
I think you have to think about disks and vm-types upfront before you start to deploy.
The default is like before so no one will run into an issue without changing anything explicit.
Lest take a look at the DSv2-series:
https://learn.microsoft.com/en-us/azure/virtual-machines/dv2-dsv2-series#dsv2-series
Standard_DS4_v2.
Here you can choose between: resource-disk with a max size of 56GB or a cache-disk with 344GB max size.
So it's like i mentioned before, it's important to check the sizes upfront.
With the implementations it's also possible to place the os_disk only to the resource or cache-disk and the ephemeral-disk to a "default" remote one, so the user have the complete choice / freedom to configure the disk for there use-case.

Cool. If Azure sends back a response that causes the Bosh VM Creation task to fail, then that handles that concern.
Do you have examples of the error responses that we get back from Azure?
I'm concerned that they may not written well enough for an operator to understand what has gone wrong and how to correct it. If this is the case, we would be required to detect these error conditions and emit a better error message.

@klakin-pivotal
sorry for the late reply.
The error message looks like:
Error message: {
  "error": {
    "code": "NotSupported",
    "message": "OS disk of Ephemeral VM with size greater than 50 GB is not allowed for VM size Standard_D2s_v3 when the DiffDiskPlacement is CacheDisk. Please refer to https://aka.ms/Ephemeral for more details."
  }
}

Think the message is fine to everyone understand what's wrong and where they get more information if required.

Thanks @HappyTobi


the only way to remove a row from a db is to reply to the message that mentioned the user

Only mentioning a specific user will cause a db insert. Only the specific user replying to the message they were mentioned in will cause them to be removed from the db via deletion.
The DB should be polled.

implemented in 004f49f61c70a5dd31453a606efbf65f2c3b2c03


Add spm distribution

I'd like to use this via SPM. I can also update the Beethoven project after this. Thanks.

Now the Readme install instructions better matches the others 🙂


Fixed colour regions and added local colour region cache

First of all apologies, it turns out my colour region change had a fatal flaw that slipped through the cracks.
This PR reverts those changes and instead uses a cached approach.
Now whenever a is_line_in_region is requested, if its not already cached, all lines before, including the requested line, will be placed in the cache.
When ever a change is made, that line and all lines below are cleared from the cache.
closes #17983

Thanks!


Any chance you can publish the latest update an crates.io?

When I check https://crates.io/crates/unicode_categories, I see version 0.1.1, but it is not actually up to date with this repository. I discovered this when I observed out-of-date unicode data.
I will try to import from the repository as a workaround, but it would be nice if the crate could be updated too. Thanks for the useful crate!
This might also close #9

You might be interested in finl_unicode, which I just released on crates.io. It supports the latest Unicode standard and is 10–20 times faster than unicode-categories.

You might be interested in...

Oh, i'm definitely interested. Thanks! :heart:


Added netstat and its child commands

Resolve conflicts
Make sure to check issue #3 page
More details on contribution guidelines have been provided

Resolve conflicts
Make sure to check issue #3 page
More details on contribution guidelines have been provided

netstat : to displays various network related information such as network connections, routing tables, interface statistics, masquerade connections, multicast memberships etc.
flags with netstat:-
-a: To List All Network Ports
-at: To List All TCP Ports
-s: To Show Statistics for All Ports
-au: To List UDP Ports connections
-l: To List all LISTENING Connections
-tp: To Display Service name with PID
-g: To Display IPv4 and IPv6 Information

Put these names of commands on issue page, not in PR


Create top-level rantly organization?

Hi @hayeah,
it seems that rantly development is progressing rather slowly.
What do you think of creating a top-level rantly organization and inviting more people as admins to the repository?
Rantly is one of the few options if you want to do property-based testing and it could use some community love ;)
Best
Martin

@nightscape if hayeah doesn't respond for a very long time I've been looking at moving forward with https://github.com/justincampbell/generative. Justin gave me admin access pretty quick and he and I both respond fairly quick to PRs. Wouldn't be a big deal to create a organization for it.
Generative though is more of a hacky way to do generative testing right now and isn't conducive to shrinking. I've been debating between approaches to change this very soon. (It's also rspec specific unfortunately, right now... the hacky part is taking advantage of the lazy evaluation of let in rspec).
I'm very interested in seeing generative and property based testing be more widely adopted in the Ruby community.

Oh, wow, I haven't found generative because I was always searching for property testing. I didn't know generative testing as term existed.
generative looks very nice, it might just be what I was looking for (especiallly the RSpec integration)!


[r19.03] slurm: add patch addressing CVE-2019-12838

Motivation for this change
https://nvd.nist.gov/vuln/detail/CVE-2019-12838
Including a prerequisite patch to allow the actual fix to apply cleanly
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[ ] NixOS
[ ] macOS
[x] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[x] Tested compilation of all pkgs that depend on this change using nix-shell -p nix-review --run "nix-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[ ] Fits CONTRIBUTING.md.

Notify maintainers
cc @

@GrahamcOfBorg build python37Packages.pyslurm
@GrahamcOfBorg test slurm

Thanks for fixing it!


Autoload subtitles

Autoload subtitles when there are subtitles available with the same name and no subtitles are specifically defined.
This would work great in combination with https://github.com/xat/castnow/pull/179. Since this will give you the ability to just turn the auto loaded subtitles off whenever they are not correct.

👍

@johman10, @hemanth...
There's a problem loading internet (audio) streams, and git bisect says that this commit is the source of the problem.  Example...
 node index.js http://bbcmedia.ic.llnwd.net/stream/bbcmedia_radio4fm_mf_p --address chromecast-studio --type audio/mpeg

Before this commit, everything is fine.  With this commit...
/home/blott/local/project/castnow/node_modules/chromecast-player/index.js:58
      ctx.options = extend(defaults, ctx.options);
                                    ^

TypeError: Cannot read property 'options' of undefined
    at /home/blott/local/project/castnow/node_modules/chromecast-player/index.js:58:41
    at next (/home/blott/local/project/castnow/node_modules/ware/lib/index.js:77:35)
    at /home/blott/local/project/castnow/node_modules/wrap-fn/index.js:121:18
    at Ware.<anonymous> (/home/blott/local/project/castnow/node_modules/wrap-fn/index.js:47:16)
    at next (/home/blott/local/project/castnow/node_modules/ware/lib/index.js:85:20)
    at Ware.run (/home/blott/local/project/castnow/node_modules/ware/lib/index.js:88:3)
    at player.<anonymous> (/home/blott/local/project/castnow/node_modules/chromecast-player/index.js:57:13)
    at /home/blott/local/project/castnow/node_modules/chromecast-player/index.js:30:10
    at /home/blott/local/project/castnow/node_modules/mutate.js/mutate.js:53:14
    at player.launch (/home/blott/local/project/castnow/node_modules/mutate.js/mutate.js:35:32)
zsh: exit 1     node index.js http://bbcmedia.ic.llnwd.net/stream/bbcmedia_radio4fm_mf_p

@smblott-github That must mean that @hemanth was right after all. Sorry about this. I can write a fix later today. Expect it here in about 5 hours.


Upgrade to version 2.2.3

Just a version upgrade.

@synapticarbors Hi, just wanted to see if this was ok to merge ? If there's any other changes needed then please let me know.

Thank you