commit 27401eb break upstream proxy support with gzip

1. Is bug reproducible with latest forwardproxy build?
Yes
and I've try build myself, a035ebe works, and 27401eb failed.
2. What are you trying to do?
forward with upstream caddy proxy
3. What is your entire Caddyfile?
upstream setting
xyz.xyz.info {
    forwardproxy {
        basicauth aaa aaa
        probe_resistance myaaa.local
        serve_pac        /foraaa.pac
        response_timeout 30
        dial_timeout     30
    }
    root /var/www/html
    gzip
}

local proxy setting
:54086 {
    forwardproxy {
        response_timeout 30
        dial_timeout     30
        upstream  https://aaa:aaa@xyz.xyz.info:443
    }
    root /root/bin/caddy/html
}

4. How is your client configured?
curl --connect-timeout 5 -m 35 --proxy <IP_ADDRESS>:54086 http://mydl.xyz.info/dl/aaa.txt

5.  If multiple servers are used (for example with upstream), describe those as well.
just start caddy from command line.
6. Please paste any relevant HTTP request(s) here.
curl --connect-timeout 5 -m 35 --proxy <IP_ADDRESS>:54086 http://mydl.xyz.info/dl/aaa.txt

7. What did you expect to see?
download the aaa.txt and print it on console
8. What did you see instead (give full error messages and/or log)?
502 Bad Gateway

23/Aug/2018:15:57:54 +0800 [ERROR 502 /dl/aaa.txt] failed to read http response: http2: server sent GOAWAY and closed the connection; LastStreamID=5, ErrCode=NO_ERROR, debug=""
23/Aug/2018:16:08:34 +0800 [ERROR 502 /dl/aaa.txt] failed to read http response: read tcp <IP_ADDRESS>:13532->199.xxx.xxx.249:443: i/o timeout
23/Aug/2018:16:10:50 +0800 [ERROR 502 /dl/aaa.txt] failed to read http response: read tcp <IP_ADDRESS>:14490->199.xxx.xxx.249:443: i/o timeout

use strace on both side, I've found upstream caddy actually write the response
[pid 13885] write(9, "GET /dl/aaa.txt HTTP/1.1\r\nHost: <IP_ADDRESS>\r\nUser-Agent: curl/7.52.1\r\nAccept: */*\r\nForwarded: for=\"<IP_ADDRESS>:33480\"\r\nVia: 1.1 caddy\r\n\r\n", 138) = 138
[pid 13885] write(8, "\27\3\3\0\0356\212\"\244\244\216 ~\246\254\25\242_L\2148\353s!k\272a\336\276/\33\10'x", 34) = 34
[pid 13885] write(8, "\27\3\3\0\35Vh\10\224\2\2529d\250\22[&\210\3k8\330\221\336\212\320\211\7\1V\363_?g", 34) = 34
[pid 13885] read(9, "HTTP/1.1 200 OK\r\nAccept-Ranges: bytes\r\nContent-Length: 8\r\nContent-Type: text/plain; charset=utf-8\r\nEtag: \"pdwlpn8\"\r\nLast-Modified: Thu, 23 Aug 2018 07:48:59 GMT\r\nServer: Caddy\r\nDate: Thu, 23 Aug 2018 08:23:06 GMT\r\n\r\nkillfbx\n", 32768) = 224
[pid 13885] write(8, "\27\3\3\0#\320\7\202\263\205\371A?C\222\371\36U\334\351#Xn\252\7J\324\205T\r\236%p \347m.5\253\260", 40 <unfinished ...>
[pid 13884] read(9, 0xc420684000, 32768) = -1 EAGAIN (Resource temporarily unavailable)
[pid 13885] <... write resumed> )       = 40
[pid 13884] read(8, "", 1024)           = 0
[pid 13884] write(8, "\25\3\3\0\22\272\345\177\262\24\324\33\257\34~\320\341e\247\330\346%2", 23) = 23
[pid 13880] shutdown(9, SHUT_WR)        = 0
[pid 13885] read(9, "", 32768)          = 0

and it seems local caddy has also received it
[pid  4305] write(6, "\27\3\3\0\243\315\252\307\367a\1\f\371\276Y\35vD\356D\240\275\347[\267\344Mj\336\240\242\265Ry%,\201z\305\17\353\37\201\255=\267,1=\334\310\20\7\3400\3]\354B\"1\223s\10\324=\\ \202\25\224>
\264\3712\331X\261\376\321\233\22\220-Q\7{}0\r\5\t\37\232\231a\310\310V\314\313G-)Zu-\343\275\34Wr6F\304?\177l\265\31?\364\fkk\"Z\2teS}\v%\274#\nuR\370G\310\245\261[\351\216p\2\365\10\227\244\212~M\240\307\347\216\6\273\370'@`H", 168) = 168
[pid  4331] read(6, "\27\3\3\0\0356\212\"\244\244\216 ~\246\254\25\242_L\2148\353s!k\272a\336\276/\33\10'x\27\3\3\0\35Vh\10\224\2\2529d\250\22[&\210\3k8\330\221\336\212\320\211\7\1V\363_?g", 1024) = 68
[pid  4331] read(6, 0xc4205b2000, 4096) = -1 EAGAIN (Resource temporarily unavailable)
[pid  4331] read(6, "\27\3\3\0#\320\7\202\263\205\371A?C\222\371\36U\334\351#Xn\252\7J\324\205T\r\236%p \347m.5\253\260", 4096) = 40
[pid  4331] read(6, 0xc4205b2000, 4096) = -1 EAGAIN (Resource temporarily unavailable)

but caddy don't think the request is finished.
9. How can someone who is starting from scratch reproduce the bug as minimally as possible?
use above config.

@bash99 27401ebe3f2142da6436cae1f16c1f373e9a3f3e is not the latest commit,
05b2092e07f9d10b3803d8fb9775d2f87dc58590 is. Did you try it?

I cannot reproduce your issue with the latest build: it works for me. I used the same exact setup as you did with locahost upstreaming proxy on :54086

@sergeyfrolov
I'm very sorry for miss a configuration line which proved to be critical.
it's broken with gzip config in upstream
xyz.xyz.info {
    forwardproxy {
        basicauth aaa aaa
        probe_resistance myaaa.local
        serve_pac        /foraaa.pac
        response_timeout 30
        dial_timeout     30
    }
    root /var/www/html
    gzip
}

I dug deeper into this issue, but had no success discovering the cause. I suspect it gets compressed twice or Content-Length is not updated properly somewhere.
@bash99 I will note, however, that the only reason for you to explicitly enable gzip is to compress your files that you host on xyz.xyz.info. Forward proxied traffic will be compressed, assuming both client and target support compression.

It appears to me that gzip writes header (which updates Content-Length and other things), only if header wasn't written already. Since the header is always written by the forwardproxy, gzip never will. However, apparently, data still gets compressed (potentially for a second time).
@mholt does that sound like a bug in gzip?

I'm not entirely sure, because even if it was a bug, I'm not sure how gzip could change the Content-Length header value after the headers are written. Notice how we just omit this, here: https://github.com/mholt/caddy/blob/d47b041923daf055bb97c94f29a7f5bf14a4cb2a/caddyhttp/gzip/gzip.go#L114-L119

But does it (re-)compress, when the data was compressed/header was written already?
Seems to me like it does (re-)compress, but perhaps shouldn't in either of those cases?

If it's already compressed, then you're right, it shouldn't re-compress, that might be a bug. It'd be the first I've/we've heard of it though :) (Seems a bit unusual.)

@sergeyfrolov Yes, I can live without the gzip config line.
One more thing I can provide is, if I use firefox/chrome to access upstream proxy directly (with gzip config line), I've no problem at all.


fibaro door sensor behaviour change after update

Hello,
I have something strange and didn t find anything on this,
i have upadated zwave-js-ui: to <IP_ADDRESS>d95700 (was from zwavejs2mqtt), and now my fibaro door sensor fgw002 no more reports the state (open or Close) in binary mode
Now the type of sensor_notification_access_control_door_state is sensor and reports in text.
But before it was binary_sensor_door_state and was reporting as binary_sensor. Do you know why ? Is it a bug ??is there any possibility to change this behaviour ?
thanks for your help (i will post capture to show)

@redridinghood314 Could you give some more context please? You update from which version? Why didn't you updated to latest release 8.10.1 ? What are you using zui for? Home Assistant or domoticz? I think this is related to mqtt discovery

sorry, i have forgotten which version i was before updating (but was still zwavejs2mqtt), and yes i use it with domoticz. but the issue seems to be in zwavejsui, here the sensor actually (fibaro door sensor) :
[url=https://zupimages.net/viewer.php?id=23/11/26cq.png][img]https://zupimages.net/up/23/11/26cq.png[/img][/url]
[url=https://zupimages.net/viewer.php?id=23/11/qbe9.png][img]https://zupimages.net/up/23/11/qbe9.png[/img][/url]
and the same one before
[url=https://zupimages.net/viewer.php?id=23/11/00ar.png][img]https://zupimages.net/up/23/11/00ar.png[/img][/url]
[url=https://zupimages.net/viewer.php?id=23/11/idts.png][img]https://zupimages.net/up/23/11/idts.png[/img][/url]
door state was binary, and now it reports only as sensor (not bianry_sensor).
i hope you can explain me.
thanks
regards

From which version did you upgraded?

sorry but i am not able to tell you (upgraded both operating system of my rapsberry and container from fresh install)

@redridinghood314 by checking the code what I do is to check how many states the valueId has, in case it has 2 posible states defined I create a binary sensor, if not I create a normal sensor:
https://github.com/zwave-js/zwave-js-ui/blob/master/lib/Gateway.ts#L1419
What I dunno is if something has changed on that specific valueId definition on driver side, @AlCalzone any clue?

See https://github.com/zwave-js/node-zwave-js/discussions/5453

thanks for answers, but i can't find anything on fibaro door sensor 2 reporting other value than open or closed (or i am not looking on the right place), here extract of fibaro manuel :
`Notification report:
The device uses Notification Command Class to report different
events.
Notification Type Event

Home Security Tampering, product covering removed
Access Control Door/window opened
Access Control Door/window closed
Power Management Replace battery now
Heat Alarm Overheat detected, unknown location
Heat Alarm Underheat detected, unknown location`

it looks like it is specific to aeotec sensor. does the modification has to be make on all type of door sensors ?

Can you share a driver log (level debug) of you opening the door?

like this ? 👍
2023-03-21T18:54:10.974Z - VALUE UPDATED  Arg 0: └─commandClassName: Notification └─commandClass: 113 └─property: Access Control └─propertyKey: Door state └─endpoint: 0 └─newValue: 23 └─prevValue: 22 └─propertyName: Access Control └─propertyKeyName: Door state

    {       "time": "2023-03-21T18:54:10.974Z",       "event": "value updated",       "args": [         {           "commandClassName": "Notification",           "commandClass": 113,           "property": "Access Control",           "propertyKey": "Door state",           "endpoint": 0,           "newValue": 23,           "prevValue": 22,           "propertyName": "Access Control",           "propertyKeyName": "Door state"         }       ]     }

@AlCalzone I don't understand what you mean here, as you can see here:
https://github.com/zwave-js/zwave-js-ui/blob/master/lib/Gateway.ts#L1434
https://github.com/zwave-js/zwave-js-ui/blob/master/lib/Gateway.ts#L1490
And: https://github.com/zwave-js/zwave-js-ui/blob/master/lib/Gateway.ts#L2447
I actually set the on/off payload in the discovery config, how could I discover it correctly without knowing the correct open state?
I should check the value before sending it to mqtt and always send the same when it's an open state?

sorry @AlCalzone if it's not what you wanted (please tell me where i can get driver log).

All good. It's not what I asked for but I got what I need.

do you know if it can be "easily" solved ?

This needs to be solved in the MQTT discovery. @robertsLando should know how easy that is.

@redridinghood314 we are discussing about possible solutions to this

thanks a lot ! tell me when you have found a solution and you want me to test !

https://github.com/zwave-js/node-zwave-js/pull/5614 adds an additional door sensor which just has open/closed states

Awesome 🎉

I submitted the fix needed on my side too, just need to wait for a new zwave-js release

will try as soon as possible (probably next week), i keep you informed ! thanks !!!

hello,
sorry for delay, i have now a basic switch in domoticz, works perferct ! thanks !


Improve README

Rather than showing 6 examples on relatively simple titles, and listing all the updates from the original PTN, could just show some hard inputs that cover most of the available fields and improvements made.
Also probably move installation instructions to the top, and make them shorter too.

Also maybe list the fields types (or possible types, when it can be a list) with the field list.

Waiting on merge.


Issuing credits

Issue 100000 credits to @lilian79511.

 Follow up
On Wednesday, 17-Apr-24 15:45:24 UTC by Gov4Git dev
Issued 100000 credits to member @lilian79511.


refactor: add approve and revert abi to crosschain

What this PR does / why we need it:
Which issue(s) this PR fixes:

Fixes #
Which docs this PR relation:
Ref #
Which toolchain this PR adaption:
No Breaking Change
Special notes for your reviewer:
CI Switch
ci-runs-only: [Chaos CI, Cargo Clippy, Coverage Test, E2E Tests, Code Format, Unit Tests]

Codecov Report

Merging #519 (4f899a2) into main (fdbc124) will increase coverage by 0.00%.
The diff coverage is 11.11%.

@@           Coverage Diff           @@
##             main     #519   +/-   ##
=======================================
  Coverage   18.06%   18.07%
=======================================
  Files         136      136
  Lines       18853    18853
=======================================
+ Hits         3406     3407    +1
+ Misses      15447    15446    -1

Impacted Files
Coverage Δ

core/cross-client/src/abi/crosschain_abi.rs
3.98% <11.11%> (+0.44%)
:arrow_up:


Add new InternalAffairs/CreateEmptyFile cop

This PR adds new InternalAffairs/CreateEmptyFile cop. It checks for uses of create_file with empty string second argument.
# bad
create_file(path, '')

# good
create_empty_file(path)

Before submitting the PR make sure the following are checked:

[x] The PR relates to only one subject with a clear title and description in grammatically correct, complete sentences.
[x] Wrote good commit messages.
[ ] Commit message starts with [Fix #issue-number] (if the related issue exists).
[x] Feature branch is up-to-date with master (if not - rebase it).
[x] Squashed related commits together.
[x] Added tests.
[x] Ran bundle exec rake default. It executes all tests and runs RuboCop on its own code.
[ ] Added an entry (file) to the changelog folder named {change_type}_{change_description}.md if the new code introduces user-observable changes. See changelog entry format for details.

Thanks!


Discussion - Sass

From @tdhartwick on December 17, 2015 17:28
We've Sassified our workflow! You can now access all of the mighty powers that Sass offers, including mixins, functions, and variables! We're really looking forward to seeing how people use variables within the new Foundation for Emails. The idea is to update a variable within your _settings.scss, such as a primary color, and see your style cascade everywhere it needs to go! We're interested in a few things around this:

Do we have the all the variables you expected?
How often do you think you'll use these Sass variables?
Did it work like you'd expect?

Copied from original issue: zurb/foundation-emails#10

From @macbookandrew on December 21, 2015 20:40
A couple of questions:

What’s the difference and why two scss folders? One in the project root and one in test/…maybe add some documentation on when to use which.
Why not use (external) CSS maps to help when doing major styling?

From @leemunroe on December 19, 2015 15:36
Looks good. I would expect to use the variables all the time. Just curious why you opted to not inline the CSS in "test" mode?

From @tdhartwick on December 21, 2015 23:52
@leemunroe From our experience, we like to check out our changes in Chrome to get a general idea of how things are going to look when we style it. Inlining also take a little extra time to process. Because of this, we set up our npm run production to not watch. Would you expect it to watch after you run npm run production?

From @tdhartwick on December 21, 2015 23:55
@macbookandrew Thanks for the feedback!

So right now we're using this to build our documentation as well. What people will be getting will be everything in the test/ folder. The other scss/ folder in the root is related to the docs, so don't worry about that folder.

Good catch, we'll be adding it!

From @macbookandrew on December 22, 2015 1:33
@tdhartwick I’m still a bit confused about the root scss/ folder, especially as test/scss/app.scss is pulling scss/ink.scss for all the components/structure and some base styles.

From @alfatreze on December 22, 2015 13:40
@macbookandrew I believe this makes it easier to test and submit pull requests!
For my part I am using the app.scss (not the best naming though!!!, email.scss maybe? I suppose it's a mix of foundation legacy and angular influence) to import the settings, ink and my own sass. If I change anything inside ink it is simpler for sending a pull request with my isolated changes there.

Now that 2.0 is out, we're going to close the discussion threads. Thanks so much for the feedback, and if you have further ideas, feel free to open new issues to get a discussion going :)


Request to root url with no trailing slash fails to route correctly

What version of Hono are you using?
4.3.4
What runtime/platform is your app running on?
Cloudflare Workers
What steps can reproduce the bug?
const app = new Hono();

app.post("/functionName?", (c) => {
   return c.text("Hit the endpoint", 200);
});

const response = await app.request("http://example.com", { method: "POST" });

expect(response.status).toEqual(200);
// Failed: expected 404 to equal 200

This seems to occur in the Worker runtime but not when I run the above with Node.
What is the expected behavior?
Expect the request to the root URL with no slash to route to the handler for "/".
What do you see instead?
Receive a 404 with the logger saying the request path is "m".
Additional information
I can see that in getPath, the request URL uses an indexOf('/', 8). When no trailing slash, the path is picked as req.url.slice(-1) and returns the last letter in the url (e.g. "m")

Hi @Carl-Foster
I can't reproduce it. Please provide a minimal project to reproduce it.

Test Repository: https://github.com/Carl-Foster/hono-3251
I was able to replicate this only when the Cloudflare nodejs_compat was 2024-05-02. In later versions of the compat, the error does not appear. While it was a bug in the compat library to not have the request be appended with a /, the unexpected behaviour proved very confusing.

Seems like a weirdly sporadic issue. Can use either one of these middleware to fix the issue
import { trimTrailingSlash, appendTrailingSlash } from 'hono/trailing-slash';
Usage:
const hono = new Hono()
   .use(trimTrailingSlash());

@Carl-Foster @ssadel
Thank you very much! This seems to be a Cloudflare-side bug. I'll ask them.

It seems to be resolved as mentioned on the Cloudflare side. The main issue I find is that the getPath in hono assumes that there is always a slash after the host name. This produced unexpected behaviour from the root cause of the Cloudflare requests not ensuring the path is always at least /.

Hi @Carl-Foster @ssadel
I've asked the Cloudflare team internally. The compatibility_date should be more recent than June 3. So, please edit your wrangler.toml and update the date like this:
compatibility_date = "2024-08-13"

Thanks @yusukebe . My issue has been resolved. Note that a fix in the getPath default implementation to ensure that there is always a path with an initial / may be wise.

Okay! This issue can be closed.


Calendar icon is still clickable when it's disabled

When I set this to disabled and show the calendar icon, it is still clickable and return value. Is possible to fix this bug?

Oh yeah, that's def a bug!  Maybe add a disable style to the icon at the same time.

#591
@majapw Please review the mentioned pull request

Fixed in v12.2.0!


feat: Add Gradient Brush

Fixes HarshKhandeparkar/rainbow-board#3
try to add a new brush i.e., Gradient Brush.

@HarshKhandeparkar did all the required changes please have a look on them 😊

The scariest part is still left: Docs!

The scariest part is still left: Docs!

Sorry, but i didn't get this 😅 .

@HarshKhandeparkar please have a look now ☺

@HarshKhandeparkar please review these changes. hope you likes them 😊

Thanks!

Welcome @HarshKhandeparkar and thanks to you as well 😊 without your help it won't be possible


[Feature Request]Hope to support Azure OpenAI service

Hope to support Azure OpenAI service

@shentry https://github.com/yoheinakajima/instagraph/pull/53


Add docs and tooling for heroku to hasura migration

Architecture diagram
Terminology guide
How to (procfile > dockerfile)
Advantages over heroku

Lots of heroku users in the hackathon. Let's get them all to move to hasura.

Assigning @rikinsk

https://docs.hasura.io/0.15/manual/guides/heroku-migration.html


Clarification about word locally

Instead of using local, be more explicit.

Please squash before merging.. next time:)
Pity that in GitHub Web UI "Squash and merge" doesn't create the merge commit though..


Issues with DataLoader

❓ Questions & Help
I'm facing the following error when trying to loop through the torch_geometric DataLoader.
TypeError: unsupported operand type(s) for +: 'int' and 'NoneType'
Some context, I saved each Data object into .pt torch files, and loaded them into a list via torch.load(). Then, I separate it into a train/validation set and loop through the train set. Not really sure how to debug this issue here.

Yeah, that error message is not really meaningful. It may come from a data object missing a specific key. You may want to check if this might be the case.

Hmm what do you mean by keys? From the docs, it looks like all the parameters x, edge_attr, ... are all optional. Is there a requirement that these need to be there? Because I labelled all the tensors in the Data object by their own names.

If you want to batch data objects, the DataLoader expects that all data objects share the same keys.

Hmm keys meaning I have to set them? Because what I did was to process my graphs, and just call Data(tensor_a = a, tensor_b = b , ... ). So this means I need to set keys in the Data object?

I am just referring to tensor_a and tensor_b as the keys here.

That's really odd then, all my tensors in Data have the exact same names since they were done using a for loop, the tensors are just different in size (since they are different graphs).

Can you show me the descriptions of a few data objects?
for data in dataset[:5]:
    print(data)

Here you go:

Mh, that looks correct to me. Can you upload a few of those data object so I can inspect potential bugs further?

I'm afraid as I can't as the data is sensitive. Any suggestions as how to debug it?

I expect the loader to fail here, so you should check the inputs/outputs of this call.

Looks like it's my edge indexes that have None instead of the integer value.

Ah I see, it is not a PyG bug, it is just that PyG cannot infer how your edge indices should be incremented. I will work on a better error message :)
In your case, you should overwrite the __inc__ method of Data to your specific needs, as suggested here.

Ah I see okay. So basically my Data object has 3 graphs in it, any suggestion how to increment the edge indexes?

I believe based on the number of nodes in dax and pax, e.g., dax_feat.size(0) and pax_feat.size(0).

So basically this function is used to increment the edge indexes, so that we can isolate the graphs? E.g. Graph 1 has nodes [0:10], Graph 2 has nodes [0:5], to avoid confusion in the edge indexes, we increment it such that Graph 2 [11:16] ?

Yes :)

Ah I see that's clear now. So I guess for dax and pax I can increment them by total size of the dax and pax graphs. Then for the assign graph, I'll just increment by the size of the assign graph.


printenv bash: warning: programmable_completion: printenv: possible retry loop when attempting to tab-complete

Checklist

[X] I have read through the manual page (man fzf)
[X] I have searched through the existing issues

Output of fzf --version
0.47.0 (0.47.0)
OS

[X] Linux
[ ] macOS
[ ] Windows
[ ] Etc.

Shell

[X] bash
[ ] zsh
[ ] fish

Problem / Steps to reproduce
Type printenv  and press TAB. Usually bash will trigger autocompletion for all environment variables, but fzf is causing it to throw:
bash: warning: programmable_completion: printenv: possible retry loop

I'm using NixOS and home-manager to manage my fzf install, and when I set enableBashIntegration to false, which prevents the bash completion files from being linked, the error goes away.

Please test if the problem is reproducible with the latest version, 0.49.0.

It will take some time until I can test on 0.49.0, but I also discovered that the issue occurs after export, i.e. export PATH=$PA<tab>

It will take some time until I can test on 0.49.0

You can just download the binary from https://github.com/junegunn/fzf/releases/tag/0.49.0 and run eval "$(./downloaded-fzf --bash)"

Likely a duplicate of #3674, and I can't reproduce it with the latest version of 0.49.0. Please reopen if you still have the problem after upgrading fzf.


59 book details endpoint

closes #59

Codecov Report

Merging #60 into master will not change coverage.
The diff coverage is 100.00%.

@@            Coverage Diff            @@
##            master       #60   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files           20        20
  Lines          248       257    +9
  Branches         5         5
=========================================
+ Hits           248       257    +9

Impacted Files
Coverage Δ

quran_tafseer/urls.py
100.00% <ø> (ø)

quran_tafseer/views.py
100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 806385f...9a1be2a. Read the comment docs.


Assign functionality to start & stop buttons

Description
This PR adds functionality to the start, stop and restart buttons in the control app.
Most of the changes can be found in control.py. This used to contain one large callback function (update_button_click) responsible for all the button callbacks (which were mostly empty), but since #92 Adrian has started moving button callbacks into their own functions which I think is a good move so I've followed suit here. I have written three new callbacks for the start, stop and restart buttons. The start and stop buttons are responsible for starting/stopping the live model, which it does via the new start_model and stop_model functions in datahub_api.py. These interact with the DataHub API introduced in this PR, which modifies the DataHub variable model_running which is tracked by the model.  I hope I've done this correctly, however it's difficult for me to test without access to the live model. The start/stop buttons also interact with data_interval to start/stop data and figure updates in the vis system. The restart button sends data_interval back to the beginning, which resets the pre-set data. It already effectively did this when connected to the OVE (via core.refresh_sections()), but now it also works outside the OVE. In theory I think this button should also send a restart signal to the model via the DataHub, but it doesn't seem to me like this is possible yet, so I've left this as a TODO. (EDIT: Actually I think stopping the model also restarts it, so this would just be a stop call followed by a start call - I will update)
I also had to rewrite some of the tests. The diffs look messy, but really I'm just moving the tests for each button into their own functions, and modifying tests for the start, stop and restart buttons in accordance with my changes.
Close #41 #61 #48
Type of change

[x] New feature (non-breaking change which adds functionality)
[ ] Optimization (non-breaking, back-end change that speeds up the code)
[ ] Bug fix (non-breaking change which fixes an issue)
[ ] Breaking change (whatever its nature)

Key checklist

[x] All tests pass (python -m pytest)
[x] Pre-commit hooks run successfully (pre-commit run --all-files)

Having said that, I am not entirely sure this will have any effect in the backend. The functions you have added connect to endpoints that, essentially, just set flags. But those flags, as far as I can tell, do nothing. They are not used anywhere else to define the behavior of the model. For example, the reset_data function in here, which presumably brings the data model back to its initial state, is not used.

As discussed, I believe Yue's model will check the DataHub for the model_running flag to decide when to start/stop the model (see here and here). When stopping the model, I belive the model will then use the signal_model_ready API call to indicate to the DataHub when the model is ready to start again by setting the model_resetting flag. We probably need to use this flag in either the vis system or the DataHub to prevent the model from starting until it's ready, but this functionality doesn't appear to be in place without changes to the DataHub (as far as I can tell). Also, you're right that the reset_data function isn't used at all, and I imagine this should be included in one of the API calls.
I'm going to leave everything as it is for now and merge it, and will suggest that Adrian takes a look at this PR when he's back. I think it won't need any drastic changes, but Adrian knows how all the parts interact better than I do.

@AdrianDAlessandro Can you check the start and stop buttons, and add the desired behaviour for the restart button? It all works when using the pre-set data, but not really sure what's required for the live model

@AdrianDAlessandro Can you check the start and stop buttons, and add the desired behaviour for the restart button? It all works when using the pre-set data, but not really sure what's required for the live model

Yes I checked them yesterday, they make the expected changes in the datahub, but the model needs to be developed to hook into the datahub, which is not up to us.

Ok. The restart button doesn't send any signals yet, just refreshes the page and resets the counter. Is this what we want?

Yea, should be fine. I can't see a simple way to send a stop and then start signal that doesn't cause a race condition with the Opal model


Subnet icon is missing

Can't find subnet icon...

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 6624d44c-f9f6-02f8-2c67-0f0637fed62e
Version Independent ID: 9346a8ff-bab5-be2c-9dc1-d546fda1efa9
Content: Azure Icons - Azure Architecture Center
Content Source: docs/icons/index.md
Service: architecture-center
GitHub Login: @doodlemania2
Microsoft Alias: pnp

Thanks for reporting - this issue is under review. This is a Microsoft Internal DevOps Bug ID # 440335

Hi @epomatti - Thank you for sharing your feedback! Since this channel is for driving improvements towards MS Docs, could you provide us with a specific URL of the MS Doc that your feedback is most applicable to? That way, we're able to connect you with the right team that is best suited to address your feedback.

@mike-urnun-msft updated question, don't know why it was missing.

Thank you for reporting this, @epomatti.
We've made several updates to the Azure Icons recently, and there are hundreds of new icons added.
The update is available for download here: https://learn.microsoft.com/en-us/azure/architecture/icons/
The subnet icon is located in the networking folder with the name 02742-icon-service-Subnet.svg
Thanks!
#please-close


[Docs] Countries in the local search example incorrect

On this page: http://semantic-ui.com/modules/search.html#/definition
The countries in the local search are mostly incorrect. It seems like all the countries all end with an 's' whether or not there should be an 's'. Example:
{ title: 'Ethiopis' },
{ title: 'European Unios' },
{ title: 'Finlans' },

Haha, at least thats a little funny. Probably a poor copy and paste job. Fixing.

Fixed in next release https://github.com/Semantic-Org/Semantic-UI-Docs/tree/f197567b3cb2edd8028297e0a96fea33b4fefb78


refactor: add missing props to generic components

🐝 PR preview in Swarm
Preview URL: https://bah5acgzapmem2ktsdb5gcbagcc5vj7t77mrqj4zlaxmtclwl5blsqsxq6ifq.bzz.link
Swarm Hash: 7b08cd2a72187a61040610bb54fe7ffb2304f32b05d9312ecbe857284af0f20b
Commit Hash: a4b2167dee83f8d8ed1b650ecec62d29b28c6f13
Commit Message: refactor: add missing props to generic components


Recent commit broke 'make frameworks'

This commit: 3596e501fc92946bc9092eb2637b4fb21e354b2a
broke make frameworks
with: export J2OBJC_ARCHS="iphone64 simulator simulator64 macosx macosx64"
Here is the error:
Both 'macos-arm64' and 'macos-x86_64' represent two equivalent library definitions.
make[1]: *** [../dist/frameworks/JRE.xcframework] Error 70
make: *** [jre_emul_dist] Error 2

+1

Fixed with commit 668ed8f.


WVJBIframe outside of document.body

as title.

This is intended. Feel free to reopen with more info if needed.


Natasha/metric type

Fixes #69 -- LGBM natasha/framework-api updated in parallel

removes extra "outdir" from store_predictions_df
removes extra "outdir" from compute_performance_scores
removes metrics from compute_performance_scores
requires compute_performance_scores to be spelled correctly
adds --metric_type
deprecates --loss
sets default for calc_infer_scores to True

Example calls now:
val_scores = frm.compute_performance_scores(
        params,
        y_true=val_true,
        y_pred=val_pred,
        stage="val"
    )

frm.store_predictions_df(
        params,
        y_true=val_true,
        y_pred=val_pred,
        stage="val"
    )

Fixed, someone approve please


Inadequate Exception Handling

Description

The code employs a generic except block for error handling during the HTTP request and JSON parsing processes. This approach makes it difficult to accurately diagnose and manage specific issues that may arise. It's advisable to implement targeted exception handling to precisely identify errors, aiding in effective troubleshooting and resolution..

Resolves: [#721 ]
Checklist

Before submitting this pull request, kindly verify that the ensuing checkpoints have been reached.

[ x] Have you adhered to the repository's defined coding convention rules?
[x ] Have you updated the 'documentation.md' file with the method/function documentation?
[x ] Have you sent a message along with the result or response?
[ x] Have you used the try-catch technique?
[x ] Has the method/class been added to the documentation (md file)?

Screenshots

Uploading a screenshot illustrating the approach you developed for validation is required.

Additional Notes/Comments

Any additional remarks or suggestions concerning this pull request are welcome.

I certify that I have carried out the relevant checks and provided the requisite screenshot for validation by submitting this pull request.
I appreciate your contribution.

@nikhil25803 Please review it.


Add kerberos authentication support for hdfs

kerberos authentication is widely used in hdfs. It's better for us to support it.
Context
HDFS (libhdfs) already provides kerberos authentication support. The only thing we need to do is add config at opendal side and pass to libhdfs. OpenDAL depends on hdrs for hdfs support.
So we should add kerberos authentication related config in hdrs first, and than add config in opendal for hdfs service.
Tasks

[ ] https://github.com/Xuanwo/hdrs/issues/111 (@zuston is working on)
[ ] https://github.com/Xuanwo/hdrs/issues/77
[ ] Add new config kerberos_ticket_cache_path for hdfs service
[ ] Setup integration tests for hdfs with kerberos

Assign me this . I would like to work and can you give me a little more context on this ?

Assign me this .

Thanks a lot! I will update the context in PR desc.

I'm not sure do you want to pick up this? @xonx4l I think I'm ready for integrating this after https://github.com/Xuanwo/hdrs/issues/111
cc @Xuanwo


How to use the PNG format in my own dataset?

On the "Convert your own dataset" page it says that the values in the panoptic map should use this format:
panoptic_label = semantic_label * label_divisor + instance_id
I assume this applies to both the "raw" and "png" format? If so, do I need to create single channel 32-bit PNG images, and how do I do that?
Of course it's straightforward to use the "raw" format but that results in massive TFRecord dataset size.

Hi ilaripih,
You can refer to how we created the panoptic map for KITTI-STEP dataset: https://github.com/google-research/deeplab2/blob/e038967579b9c9f8acf55edae5c20988bb6eb0cd/data/utils/create_step_panoptic_maps.py#L106
Here we encode the panoptic map with the following PNG format:
R: semantic
G: instance // 256
B: instance % 256

And we decode the png here: https://github.com/google-research/deeplab2/blob/e038967579b9c9f8acf55edae5c20988bb6eb0cd/data/build_step_data.py#L181-L186

Thanks for the quick response. To me it looks like the encode_panoptic_map code you're referring to is meant for creating intermediate PNG files before creating the final TFRecord dataset which uses the "raw" (int32) format. I'm creating the TFRecord dataset directly from my own dataset, skipping the intermediate steps.
I successfully encoded the panoptic labels in PNG format in "image/segmentation/class/encoded" and set the "image/segmentation/class/format" field to "png" but it looks like the Deeplab2 code still wants to use the raw format and is complaining about the PNG data:
Traceback (most recent call last):
  File "deeplab2/trainer/train.py", line 76, in <module>
    app.run(main)
  File "/usr/local/lib/python3.6/dist-packages/absl/app.py", line 312, in run
    _run_main(main, args)
  File "/usr/local/lib/python3.6/dist-packages/absl/app.py", line 258, in _run_main
    sys.exit(main(argv))
  File "deeplab2/trainer/train.py", line 72, in main
    FLAGS.num_gpus)
  File "/workspace/deeplab2/trainer/train_lib.py", line 191, in run_experiment
    steps=config.trainer_options.solver_options.training_number_of_steps)
  File "/workspace/models/orbit/controller.py", line 240, in train
    self._train_n_steps(num_steps)
  File "/workspace/models/orbit/controller.py", line 439, in _train_n_steps
    train_output = self.trainer.train(num_steps_tensor)
  File "/workspace/models/orbit/standard_runner.py", line 146, in train
    self._train_loop_fn(self._train_iter, num_steps)
  File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/eager/def_function.py", line 885, in __call__
    result = self._call(*args, **kwds)
  File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/eager/def_function.py", line 950, in _call
    return self._stateless_fn(*args, **kwds)
  File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/eager/function.py", line 3040, in __call__
    filtered_flat_args, captured_inputs=graph_function.captured_inputs)  # pylint: disable=protected-access
  File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/eager/function.py", line 1964, in _call_flat
    ctx, args, cancellation_manager=cancellation_manager))
  File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/eager/function.py", line 596, in call
    ctx=ctx)
  File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/eager/execute.py", line 60, in quick_execute
    inputs, attrs, num_outputs)
tensorflow.python.framework.errors_impl.InvalidArgumentError: 2 root error(s) found.
  (0) Invalid argument:  Input to DecodeRaw has length 18802 that is not a multiple of 4, the size of int32
	 [[{{node DecodeRaw}}]]
	 [[MultiDeviceIteratorGetNextFromShard]]
	 [[RemoteCall]]
	 [[while/body/_1/IteratorGetNext]]
	 [[while/body/_1/DeepLabFamilyLoss/MaXDeepLabLoss/maximum_bipartite_matching/while/body/_8657/DeepLabFamilyLoss/MaXDeepLabLoss/maximum_bipartite_matching/while/find_augmenting_path/while/body/_8938/DeepLabFamilyLoss/MaXDeepLabLoss/maximum_bipartite_matching/while/find_augmenting_path/while/mul/_724]]
  (1) Invalid argument:  Input to DecodeRaw has length 18802 that is not a multiple of 4, the size of int32
	 [[{{node DecodeRaw}}]]
	 [[MultiDeviceIteratorGetNextFromShard]]
	 [[RemoteCall]]
	 [[while/body/_1/IteratorGetNext]]

I think I'm hitting this line that forces the use of the "raw" format in panoptic datasets: https://github.com/google-research/deeplab2/blob/main/data/data_utils.py#L353
I'll try the raw/int32 format.

With the "raw" format I can run the training code.

Yes, current we only support "raw" format creating tfrecord dataset.
You might need to either try with raw format or modify the _decode_label in data_utils to decode png data.

Thanks. I can manage with the raw format, it's working.

Yes, current we only support "raw" format creating tfrecord dataset.
You might need to either try with raw format or modify the _decode_label in data_utils to decode png data.

may i ask you how transfer raw, i got same question.


v1.6.1 segfault with abi generation

v1.6.1 of eosio-cpp currently has a bug which causes a seg fault, but only with abi generation and under certain circumstances.

I believe I'm running into this error as well

@cryptosig This issue has been resolved. The problem we encountered was that the tool eosio-abigen segfaults when declaring a std::vector of itself within its own data structure.

For example:
#include <vector>

#include <eosio/contract.hpp>
#include <eosio/multi_index.hpp>

using namespace eosio;

struct [[eosio::contract]] main : eosio::contract {
   using contract::contract;

   struct [[eosio::table]] structure {
      std::vector<structure> vec;
   };

   [[eosio::action]] void act()
   { }
};

Compiles, but segaults during .abi generation.

#include <vector>

#include <eosio/contract.hpp>
#include <eosio/multi_index.hpp>

using namespace eosio;

struct [[eosio::contract]] con : eosio::contract {
   using contract::contract;

   struct [[eosio::table]] structure {
      std::vector<int> vec;
   };

   [[eosio::action]] void act()
   { }
};

Compiles and does not segault during .abi generation.

@johndebord How is this issue solved? 1.6.2 still SegFaults when a table references itself in a vector. Can we re-open this issue?

@znebby See issue #527, there's an ongoing discussion on that issue about table references in a vector.


metrics: fix TiKV Detail command regex escape issue

What is changed and how it works?

Issue Number: ref #15832
Touch #15833
As title, "\b" should be escaped as "\\b".
What's Changed:

Check List
Tests

Manual test (add detailed scripts or steps below)

Release note
None

/merge


Add VHUD

Added VHUD to UI/Activity Indicator, a simple HUD.
Project URL
https://github.com/xxxAIRINxxx/VHUD
Description
Simple HUD.
Checklist

[x] Only one project/change is in this pull request
[x] Addition in chronological order (bottom of category)
[x] Supports iOS 7 or later
[x] Has a commit from less than 2 years ago
[x] Has a clear README in English

          1 Error

  :no_entry_sign:
  Found 1 link issue

Link issue by awesome_bot

Line
Status
Link

638
301
https://github.com/comyarzaheri/TuningFork redirects tohttps://github.com/comyar/TuningFork

  Generated by :no_entry_sign: danger

Hey @RemyDCF, we gotta wait until this pull request is accepted before adding it to AwesomeiOS.
Thanks for contributing! 👍

The pull request on VHUD project was merged. Can you merge my pull request ?

Hey @RemyDCF, thanks for the update. Unfortunately I can't merge since there are conflicts. Please rebase your pull request.

Rebased

@RemyDCF you should remove <<<<HEAD from your commit. avoid to broken whole file

thanks @RemyDCF  :)


left requiring 50 tnt

wherever I target it always says it requires around 50 tnt

fixed by using M^3s download


refactor(client): migrate lower jaw buttons to Button component

Checklist:

[x] I have read and followed the contribution guidelines.
[x] I have read and followed the how to open a pull request guide.
[x] My pull request targets the main branch of freeCodeCamp.
[x] I have tested these changes either locally on my machine, or GitPod.

Ref #54892
As suggested by @huyenltnguyen, the hover effect issue got fixed by migrating it to the new fCC Button component.
It may be worth to migrate all the buttons in lower-jaw.tsx in this PR. If so, please let me know.
Video demo
https://github.com/freeCodeCamp/freeCodeCamp/assets/47751447/e77e0ecb-748b-4f05-9514-96ba62e9410d

@huyenltnguyen addressed comments. However, because of these changes, I found an issue that I can't get around. Asking for feedback.


ImportError: No module named pandas_bokeh

Getting this error on using the Linux notebook.
Importing python packages....
ImportErrorTraceback (most recent call last)
 in ()
4 import re
5 import pandas as pd
----> 6 import pandas_bokeh
7 pandas_bokeh.output_notebook()
8 import numpy as np
ImportError: No module named pandas_bokeh

Hi @gollima
This is likely due to the fact you don't have pandas_bokeh installed in your environment. We have included a setup cell at the bottom of the Notebook that you can run the first time you use the Notebook, this will install pandas_bokeh (as well as other packages the Notebook needs). Once you have run that cell scroll back up to the top and run the import cell again.

Hi @gollima.
I'll close this for now. If you are still having issues please let us know.


iX custom properties can not be set within a Shadow DOM (selector: :root .<theme-class>)

What happened?
When an iX component is loaded as a micro-frontend (aka remote) in a Shadow DOM within a non-iX container web app, iX's css custom properties can't be set by the iX-based micro-frontend. Therefore, the styling of the iX micro-frontend is broken!
A deep investigation of the issue brought to light the following findings:

Even simple ix-button colors are missing. This is due to undefined custom properties such as --theme-btn-primary--background (theme custom properties are defined as global css variables, e.g. in ix-brand-theme.css with the following selector :root .theme-brand-light; note that iX css files such as ix-brand-theme.css are imported by the micro-frontend).
The problem is that within a Shadow DOM the :root selector is not available (only :host), cf. https://stackoverflow.com/questions/73680718/use-root-in-shadow-dom.
Work-around: manually define or copy+paste custom properties and define them with a selector :host .theme-brand-light within the micro-frontend css definitions.

Therefore I suggest that iX provides a css file that defines custom properties in such a way that they can be used by micro-frontends in a Shadow DOM within a non-iX app. The selector for the custom properties could be extended, e.g.:
:root .<theme-class> -> :root .<theme-class>, :host <.theme-class>. Alternatively a separate css file could be provided for micro-frontends, using :host instead of :root as main selector.
What type of frontend frameware are you seeing the problem on?
Angular, Others
Which version of iX do you use?
v2.0.4
Code to produce this issue.
https://code.siemens.com/cct-ssp/m6/xcelerator-cross-bu/mfe-blueprint

Fixed brand-theme:
https://code.siemens.com/cct-ssp/m6/xcelerator-cross-bu/mfe-blueprint/-/blob/main/projects/mfe3/src/app/tariffs/ix-brand-theme.fixed.scss

Please provide an accessible code. Using Stackblitz or a GitHub repository.
Imo avoid linking siemens internal repositories on a public space.

We will close this issue. If this still occurs, dont hesitate to open a new issue!


False positive warning about Webpack 2

We are seeing this warning on CI trying to update Create React App to Webpack 3: https://github.com/facebookincubator/create-react-app/pull/2574#issuecomment-317191139. However we never explicitly use json-loader.
I wonder if it's possible that the warning has a false positive? For example https://github.com/webpack/webpack/pull/3374 makes webpack delegate to json-loader automatically here. Is there any chance that this could unintentionally trigger the warning?

+1

I noticed this issue when I have placed some dependencies for package.json under devDependencies. I have since moved everything back under dev and the warnings no longer occur.

@gaearon - I've stripped the deprecation warning entirely, this is a problem that needs to be fixed upstream as the whole thing is kind of circular.
<EMAIL_ADDRESS>

Thanks!

Thank you @d3viant0ne ! With the "json-loader": "^0.5.7" in the package.json, we get rid of thoses "useless" warning messages ! 🥇


Fix README.md after opentelemetry version bump (1.7.0)

For sure, the exporter initialization is now outdated and is done differently:
IntervalMetricReader
  .builder()
  .setMetricExporter(metricExporter)
  .setMetricProducers(Collections.singleton(meterProvider))
  .setExportIntervalMillis(exportInterval)
  .buildAndStart()

see: https://github.com/ScalaConsultants/mesmer-akka-agent/blob/0b9207fb27932b483c6dba694679a66a1c1a29c6/example/src/main/scala/example/Boot.scala#L49
Objective: Try to find other places like this and fix them along with the one mentioned above.

Updated while bumping otel versions to 1.10


error when starting webpack

Do you want to request a feature or report a bug?
yes it's a mistake

What is the current behavior?
webpack does not compile
If the current behavior is a bug, please provide the steps to reproduce.
C:\Idessign>webpack
The CLI moved into a separate package: webpack-cli.
Please install 'webpack-cli' in addition to webpack itself to use the CLI.
-> When using npm: npm install webpack-cli -D
-> When using yarn: yarn add webpack-cli -D

What is the expected behavior?
that webpack compiles correctly
If this is a feature request, what is motivation or use case for changing the behavior?
Please mention other relevant information such as the browser version, Node.js version, webpack version, and Operating System.
Node.js v8.9.3
webpack v4.
windows 8.1 professionnel
I compiled well with webpack v3 when I made the update to go to webpack v4 is here the error
C:\Idessign>webpack
The CLI moved into a separate package: webpack-cli.
Please install 'webpack-cli' in addition to webpack itself to use the CLI.
-> When using npm: npm install webpack-cli -D
-> When using yarn: yarn add webpack-cli -D
thank you in advance for help

Sooo, did you install the 'webpack-cli' ?
Cannot figure it out, while reading your post.

-> When using npm: npm install webpack-cli -D
-> When using yarn: yarn add webpack-cli -D

With webpack 4 you must also add webpack-cli to your dependencies. Once installed, webpack command would work as expected.


chore: remove await

Types

[x] 💄 Code Style Changes

Background or solution
目前整个启动过程不需要依赖这个 await，可以大幅提升启动时间
Changelog

remove useless await for extension contribution

Codecov Report

Merging #668 (7e390df) into main (cfa4fe4) will increase coverage by 0.02%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##             main     #668      +/-   ##
==========================================
+ Coverage   58.99%   59.01%   +0.02%
==========================================
  Files        1209     1209
  Lines       74650    74675      +25
  Branches    15465    15470       +5
==========================================
+ Hits        44038    44073      +35
+ Misses      27909    27901       -8
+ Partials     2703     2701       -2

Impacted Files
Coverage Δ

...ages/file-service/src/node/file-service-watcher.ts
71.18% <0.00%> (-1.70%)
:arrow_down:

...uick-open/src/browser/prefix-quick-open.service.ts
74.52% <0.00%> (-1.30%)
:arrow_down:

packages/core-common/src/utils/ipc.ts
83.33% <0.00%> (ø)

packages/core-browser/src/utils/electron.ts
50.00% <0.00%> (ø)

packages/core-browser/src/quick-open/index.ts
79.72% <0.00%> (ø)

...ges/extension/src/node/extension.service.client.ts
67.56% <0.00%> (ø)

...ges/editor/src/browser/workbench-editor.service.ts
62.67% <0.00%> (+0.11%)
:arrow_up:

packages/core-browser/src/bootstrap/app.ts
64.55% <0.00%> (+0.20%)
:arrow_up:

...components/src/recycle-tree/prompt/PromptHandle.ts
90.90% <0.00%> (+0.32%)
:arrow_up:

...kages/components/src/recycle-tree/tree/TreeNode.ts
77.55% <0.00%> (+0.42%)
:arrow_up:

... and 8 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update cfa4fe4...7e390df. Read the comment docs.


C# .NET 9

Tested versions

Used 44fa552343722bb048e2d7c6d3661174a95a8a3c
Latest VS Studio Professional Preview 2022

System information
Windows 11 Pro 27723
Issue description
The .NET 9 left preview and is on release-candidate state, due to this the godot global.json file which by default has "rollForward": "latestMajor", is jumping from .NET 8 to .NET 9 during the build and glue procedures, but godot itself cannot load .NET 9 binaries, due to changes on them from .NET 8 to .NET 9, we should either start adding .NET 9 binary support for godot (as in RC state it won't change the actual binary structure any further again on this version), or alter the global.json so it does not jump to RCs of new major releases. By default, by having the latest SDKs installed on the system, the godot will automatically try to use the .NET 9 and thus fail to load the resulting binaries afterwards.
It used to work perfectly while the .NET 9 SDK were marked as preview, after latest update from VS Studio Installer, which marked it as RC instead, this started happening.
Steps to reproduce
Simply have latest .NET SDK tools installed on your system and build normally.
Minimal reproduction project (MRP)
Its build issue, thus theres no MRP.

Every Godot C# project targets net6.0 or netstandard2.0, so I'm not sure what you mean by building .NET 9 binaries. The latest .NET SDK should always be used to build the C# projects, these projects will still target the framework version specified in their .csproj so they should be compatible with .NET 6 or greater regardless of the SDK version used to build them.
I'm also not sure what you mean by adding .NET 9 binary support for Godot. As far as I know, Godot is already compatible with .NET 9. The only issue is Godot will struggle with prerelease versions (such as .NET 9 right now) which requires you to set the DOTNET_ROLL_FORWARD_TO_PRERELEASE environment variable to 1, but this is only needed while .NET 9 is a prerelease and will not be needed when the stable version is released on November.
I tested building the Godot C# projects with dotnet-sdk-9.0.100-rc.1.24452.12-linux-x64 and I had no issues.

Every Godot C# project targets net6.0 or netstandard2.0, so I'm not sure what you mean by building .NET 9 binaries. The latest .NET SDK should always be used to build the C# projects, these projects will still target the framework version specified in their .csproj so they should be compatible with .NET 6 or greater regardless of the SDK version used to build them.
I'm also not sure what you mean by adding .NET 9 binary support for Godot. As far as I know, Godot is already compatible with .NET 9. The only issue is Godot will struggle with prerelease versions (such as .NET 9 right now) which requires you to set the DOTNET_ROLL_FORWARD_TO_PRERELEASE environment variable to 1, but this is only needed while .NET 9 is a prerelease and will not be needed when the stable version is released on November.
I tested building the Godot C# projects with dotnet-sdk-9.0.100-rc.1.24452.12-linux-x64 and I had no issues.

It's not about building actual C# projects for godot, that works as long as you put the .NET 8 as target for it.
The issue is when you compiling the actual engine editor, when you generate the mono glue and then proceed to build_assemblies.py to build that mono glue.

Sorry, that's what I meant. I'm running build_assemblies.py with .NET 9 and then launching the Godot editor with no issues.

Sorry, that's what I meant. I'm running build_assemblies.py with .NET 9 RC1 and then launching the Godot editor with no issues.
Every Godot engine assembly targets net6.0 or netstandard2.0, and can be compiled with .NET 9. User projects should be able to target net6.0 or greater (including net9.0).

For me this started happening after this latest update which is RC2.
Godot also fails to load project binaries if they using .NET 9 AOT, but works fine with .NET 8 AOT.

I have a similar issue.
I am starting to learn Godot - I am a somewhat experienced C# developer.
On Windows 11 - I installed Godot , created a new project, and selected VS as the editor.
Godotr version info:

I have VS2022 17.12.0 Preview 4 (latest preview as at this time).
dotnet --list-sdks shows these (earlier installations up to 7.0,120 are removed for brevity; no 8.x.x are present):
9.0.100-preview.6.24328.19 [C:\Program Files\dotnet\sdk]
9.0.100-rc.2.24474.11 [C:\Program Files\dotnet\sdk]
I created a project, added a root node, clicked the Add script button.
This was shown in the Ouput window:
Godot Engine v4.3.stable.mono.official (c) 2007-present Juan Linietsky, Ariel Manzur & Godot Contributors. --- Debug adapter server started on port 6006 --- --- GDScript language server started on port 6005 --- New Scene Root   /root/godot/modules/mono/editor/GodotTools/GodotTools/CsProjOperations.cs:13 - System.IO.FileNotFoundException: Could not load file or assembly 'System.Runtime, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a'. The system cannot find the file specified.   File name: 'System.Runtime, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a'      at GodotTools.ProjectEditor.ProjectGenerator.GenAndSaveGameProject(String dir, String name)      at GodotTools.CsProjOperations.GenerateGameProject(String dir, String name) in /root/godot/modules/mono/editor/GodotTools/GodotTools/CsProjOperations.cs:line 13   modules/mono/csharp_script.cpp:2854 - C# project could not be created; cannot add file: 'res://Node2d.cs'. Attach Script
VS2022 is opened but with no solution/code etc.

To allow pre-releases (such as .NET 9), set the DOTNET_ROLL_FORWARD_TO_PRERELEASE environment variable to 1.

Hi, don't know if it's useful or not, but I have been working with a project targeted at .NET 9.0 and it's been working rather well so far. Haven't had any issues so far.
I am running a 4.3-based self-compiled build, but it doesn't have anything but #79731 baked in. If I find something weird, I can update this thread. But I can vow for .NET 9 working flawlessly on a greenfield 4.3 project.

Hi, don't know if it's useful or not, but I have been working with a project targeted at .NET 9.0 and it's been working rather well so far. Haven't had any issues so far.
I am running a 4.3-based self-compiled build, but it doesn't have anything but #79731 baked in. If I find something weird, I can update this thread. But I can vow for .NET 9 working flawlessly on a greenfield 4.3 project.
EDIT: for context
$ dotnet version
9.0.100-rc.2.24474.11

$ uname -a
Linux ralsei 6.8.0-47-generic #47-Ubuntu SMP PREEMPT_DYNAMIC Fri Sep 27 21:40:26 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

Did you try AOT with it? afaik it wont load on .NET 9 but will on .NET 8.

To allow pre-releases (such as .NET 9), set the DOTNET_ROLL_FORWARD_TO_PRERELEASE environment variable to 1.

I'll give a try.

But still won't load AOT binaries i guess.

Works fine for me. What error are you getting?

But still won't load AOT binaries i guess.

Works fine for me. What error are you getting?

It used to say that the methods were not found, but after the latest .net update it seems to have been solved.


Submit a Cloud Definition: Utility computing

Do NOT copy/paste a definition from somewhere else. Read about the word you want to define and come up with your own definition. Copy/Paste submissions will be closed and not added.
Fill out the JSON with your submission:
    {
    "word": "Utility Computing",
    "content": "A valuable supplier capable of providing access to cost effective computing resources for the benefit of a given company or organization.",
    "learn_more_URL":"https://www.givainc.com/blog/index.cfm/2021/11/2/grid-computing-vs-cluster-computing-vs-utility-computing-vs-cloud-computing-advantages-disadvantages",
    "tag":"General",
    "abbreviation": "",
    "author_name":"Tyrik Emptage",
    "author_link": "https://www.linkedin.com/in/tyrik-emptage"
    }

Fill out the JSON below with the following.
Word (REQUIRED)
Utility Computing
Content (REQUIRED)
A valuable supplier capable of providing access to cost effective computing resources for the benefit of a given company or organization
learn more URL (REQUIRED)
https://www.givainc.com/blog/index.cfm/2021/11/2/grid-computing-vs-cluster-computing-vs-utility-computing-vs-cloud-computing-advantages-disadvantages
tag (REQUIRED and select one)

general

abbreviation (OPTIONAL)
If the word is commonly abbreviated, please provide it. For example, command line interface is often abbreviated as CLI.
author name (REQUIRED)
Tyrik Emptage
author link (REQUIRED)
https://www.linkedin.com/in/tyrik-emptage

Added, thank you.


Added notebook and data for reading ZMAP+ grids

Just polished it off last night.
It works well with the data file with nulls.
Should now handle also files without nulls (although I am not adding a data example for the latter, I've tested it on a mock one).

Thank you Matteo!


Write time series parallely

Time series are written in their own file, therefore, they can be treated in parallel. However, this feature is currently not supported by PowerSystemDataModel.

Blocked by ie3-institute/PowerSystemDataModel#415


Per Variant Release

Currently rez release releases all variants in a single pass, which is generally a good thing.
However, we are finding that in some cases we have to go back and release an additional variant to an existing package (for example, an additional boost variant).  We are unable to do this with the current implementation of rez-release.
One solution would be to increment the sub-patch version number (so 1.0.0 would become <IP_ADDRESS>) however this means releasing all variants again.  For some tools this takes many hours.  However for external packages (which we are currently releasing using the ExternalProjects macro in CMake we want the version number to match the external number.
Another solution would be to add a -v argument to rez release which behaves in a similar way to rez build.  This creates problems with tagging and if misused could result in a package being partially released.  That said this might become more necessary if we consider distributing variant builds across a CI system such as Jenkins.
Has anyone else encountered this problem?  Does anyone have any suggestions?

Closing - resources2 branch allows for installing variants into existing packages.

Closing - resources2 branch allows for installing variants into existing packages.

how is this achieved though? I am trying to figure out how to integrate rez release into a Jenkins pipeline, where I'd like to trigger a rez release for each build configuration separately, thus my variants list would list only a single variant I guess for each build configuration, and trigger rez release


⚠ ClamAV has degraded performance

In 024612b, ClamAV (https://spamassassin.apache.org/) experienced degraded performance:

HTTP code: 200
Response time: 184 ms

Resolved: ClamAV performance has improved in f60b9ea.


Having several local workers work on the same queue

I was hoping that a Node instance could handle several jobs of a same type concurrently. Something like this:
// only one worker will accept the "doThis" jobs
var worker = resque.worker('node', {
    doThis: function(){...}
});
workers.push(worker);

// several concurrent workers will accept the  "doThat" jobs
for(var i = 0; i < 5; i++){
    worker = resque.worker('node', {
        doThat: function(){...}
    });
    workers.push(worker);
}

$.each(workers, function(i, worker){
    worker.start();
});

But the doThat jobs fail, saying "error": "Missing Job: doThat". I assume that once a worker is listening to a queue, the others can't anymore. How can I achieve the desired result ?
Thank you.

Nevermind, I get the logic behind this. I'll just use different queues or have several workers that handle all the necessary job types. Thank you

You can have multiple workers performing jobs off the same queue.  Plus the worker can perform many jobs.  The problem I think you are running into is that you are putting multiple job types in the queue, in that case all workers bound to that queue need to be setup to perform all the various jobs you plan to enqueue.
Check out how I did it here and here.

Something like this should work
var jobs = {
  foo : function(){},
  bar : function(){}
};

// several concurrent workers
for(var i = 0; i < 5; i++) {
  workers.push(resque.worker('queue', jobs));
}

$.each(workers, function(i, worker) {
  worker.start();
});


Fether unable to find or connect with Parity on Mac OS X

iMac Retina 5K, 27-inch, Late 2015
macOS Mojave Version 10.14
32 GB RAM
3.12 TB disk
parity  version Parity-Ethereum/v2.2.10-stable-7b1d3e180-20190213/x86_64-macos/rustc1.32.0
fether 0.2.0
I have tried running parity and fether together in two ways:

By independently starting Parity and Fether
By using Fether to start Parity.
I get a similar failure in each case.

Patricks-iMac:~ pkh$ /Applications/'Parity Fether.app'/Contents/MacOs/'Parity Fether' --chain ropsten --light
[2019-02-14T03:56:22.914Z] INFO (fether/3321 on Patricks-iMac.local): Starting Parity Fether...
GVA info: Successfully connected to the Intel plugin, offline Gen9
[2019-02-14T03:56:22.991Z] INFO (@parity/electron:main/3321 on Patricks-iMac.local): Parity not found on machine.
[2019-02-14T03:56:22.997Z] INFO (@parity/electron:main/3321 on Patricks-iMac.local): Downloading from https://vanity-service.parity.io/parity-binaries?version=stable&os=darwin&architecture=x86_64.
[2019-02-14T03:56:28.739Z] INFO (@parity/electron:main/3321 on Patricks-iMac.local): Retrying.
[2019-02-14T03:56:28.741Z] INFO (@parity/electron:main/3321 on Patricks-iMac.local): Downloading from https://vanity-service.parity.io/parity-binaries?version=stable&os=darwin&architecture=x86_64.
[2019-02-14T03:56:35.082Z] INFO (@parity/electron:main/3321 on Patricks-iMac.local): Retrying.
[2019-02-14T03:56:35.085Z] INFO (@parity/electron:main/3321 on Patricks-iMac.local): Downloading from https://vanity-service.parity.io/parity-binaries?version=stable&os=darwin&architecture=x86_64.
[2019-02-14T03:56:43.414Z] INFO (@parity/electron:main/3321 on Patricks-iMac.local): Retrying.
[2019-02-14T03:56:43.416Z] INFO (@parity/electron:main/3321 on Patricks-iMac.local): Downloading from https://vanity-service.parity.io/parity-binaries?version=stable&os=darwin&architecture=x86_64.
[2019-02-14T03:56:47.787Z] ERROR (fether/3321 on Patricks-iMac.local): Checksum mismatch, expecting 1690ea47227e45b3b67256734e3020a958c9a4b6c458fa21bbda2f55d91819ed, got ca623463357e91611cf4ae31cc911dc59a5ba1f84d63155a6e0f4b6922435d5d.
Error: Checksum mismatch, expecting 1690ea47227e45b3b67256734e3020a958c9a4b6c458fa21bbda2f55d91819ed, got ca623463357e91611cf4ae31cc911dc59a5ba1f84d63155a6e0f4b6922435d5d.
at /Applications/Parity Fether.app/Contents/Resources/app.asar/node_modules/@parity/electron/lib/fetchParity.js:215:47
at step (/Applications/Parity Fether.app/Contents/Resources/app.asar/node_modules/@parity/electron/lib/fetchParity.js:47:23)
at Object.next (/Applications/Parity Fether.app/Contents/Resources/app.asar/node_modules/@parity/electron/lib/fetchParity.js:28:53)
at fulfilled (/Applications/Parity Fether.app/Contents/Resources/app.asar/node_modules/@parity/electron/lib/fetchParity.js:19:58)
at
at process._tickCallback (internal/process/next_tick.js:188:7)
The log file contains the following:
{"level":30,"time":1550116582914,"msg":"Starting Parity Fether...","pid":3321,"hostname":"Patricks-iMac.local","name":"fether","v":1}
{"level":30,"time":1550116582991,"msg":"Parity not found on machine.","pid":3321,"hostname":"Patricks-iMac.local","name":"@parity/electron:main","v":1}
{"level":30,"time":1550116582997,"msg":"Downloading from https://vanity-service.parity.io/parity-binaries?version=stable&os=darwin&architecture=x86_64.","pid":3321,"hostname":"Patricks-iMac.local","name":"@parity/electron:main","v":1}
{"level":30,"time":1550116588739,"msg":"Retrying.","pid":3321,"hostname":"Patricks-iMac.local","name":"@parity/electron:main","v":1}
{"level":30,"time":1550116588741,"msg":"Downloading from https://vanity-service.parity.io/parity-binaries?version=stable&os=darwin&architecture=x86_64.","pid":3321,"hostname":"Patricks-iMac.local","name":"@parity/electron:main","v":1}
{"level":30,"time":1550116595082,"msg":"Retrying.","pid":3321,"hostname":"Patricks-iMac.local","name":"@parity/electron:main","v":1}
{"level":30,"time":1550116595085,"msg":"Downloading from https://vanity-service.parity.io/parity-binaries?version=stable&os=darwin&architecture=x86_64.","pid":3321,"hostname":"Patricks-iMac.local","name":"@parity/electron:main","v":1}
{"level":30,"time":1550116603414,"msg":"Retrying.","pid":3321,"hostname":"Patricks-iMac.local","name":"@parity/electron:main","v":1}
{"level":30,"time":1550116603416,"msg":"Downloading from https://vanity-service.parity.io/parity-binaries?version=stable&os=darwin&architecture=x86_64.","pid":3321,"hostname":"Patricks-iMac.local","name":"@parity/electron:main","v":1}
{"level":50,"time":1550116607787,"msg":"Checksum mismatch, expecting 1690ea47227e45b3b67256734e3020a958c9a4b6c458fa21bbda2f55d91819ed, got ca623463357e91611cf4ae31cc911dc59a5ba1f84d63155a6e0f4b6922435d5d.","pid":3321,"hostname":"Patricks-iMac.local","name":"fether","type":"Error","stack":"Error: Checksum mismatch, expecting 1690ea47227e45b3b67256734e3020a958c9a4b6c458fa21bbda2f55d91819ed, got ca623463357e91611cf4ae31cc911dc59a5ba1f84d63155a6e0f4b6922435d5d.\n    at /Applications/Parity Fether.app/Contents/Resources/app.asar/node_modules/@parity/electron/lib/fetchParity.js:215:47\n    at step (/Applications/Parity Fether.app/Contents/Resources/app.asar/node_modules/@parity/electron/lib/fetchParity.js:47:23)\n    at Object.next (/Applications/Parity Fether.app/Contents/Resources/app.asar/node_modules/@parity/electron/lib/fetchParity.js:28:53)\n    at fulfilled (/Applications/Parity Fether.app/Contents/Resources/app.asar/node_modules/@parity/electron/lib/fetchParity.js:19:58)\n    at \n    at process._tickCallback (internal/process/next_tick.js:188:7)","v":1}

@pkeithhynes I couldn't reproduce. Could you make sure you're on the latest release for both please?
Fether: https://github.com/paritytech/fether/releases/tag/v0.2.0-beta
Parity-Ethereum: https://github.com/paritytech/parity-ethereum/releases/tag/v2.3.3

I loaded Parity-Ethereum 2.3.3 using Home-brew from the link above
Fether is at 0.2.0 beta.
Unfortunately I am having the same issue - Fether is not seeing Parity data whether I launch Parity separately or use Fether to try to launch it.
I assume I have messed up my configuration somehow....any ideas?

Problem resolved by starting parity in a terminal window and starting fether using the OSX dock icon.

@pkeithhynes cool, but are you still having the original issues? Are you able to get synced running just Fether?

closing as stale


Support for Thinkpad T460p?

I am requesting firmware patches for Thinkpad T460p.

ok...?

I think this is not what I am thinking of. Can you please delete the thread?

nope


Wicket js cleanup

Before moving to a new technology I'd rather clean up the current JavaScript first.
I've took the effort to separate all changes into separate commits, so anyone interested can assess the impact of that change more easily.
I'm looking at http://youmightnotneedjquery.com/ now.

Just a note that amd.html/.js fails currently. I'm unable to fix it though: as soon as I remove "WicketDebugWindow" from the requires, qunit isn't found. Strange.

Just a note that amd.html/.js fails currently. I'm unable to fix it though: as soon as I remove "WicketDebugWindow" from the requires, qunit isn't found. Strange.

I've just fixed it!

I'll create a Jira issue and merge.

Thanks to all!

I injected this JS into our wicket 7.10 application and send it to our build server to see how Selenium UI tests run.
passed: 1915 tests, failed 8. All 8 are failed due to inputchange removal (I didn't replace the behaviour class)

I injected this JS into our wicket 7.10 application and send it to our build server to see how Selenium UI tests run.
passed: 1915 tests, failed 8. All 8 are failed due to inputchange removal (I didn't replace the behaviour class)

Hi Andrew,
You will have to update your tests to trigger "input" event instead of
"inputchange" event.
Maybe we should provide support for inputchange to be mapped to input in
Java in 9.x, as we were doing for "on" prefix (onclick)?!
On Fri, May 17, 2019, 02:43 andreikondratev<EMAIL_ADDRESS>wrote:

I injected this JS into our wicket 7.10 application and send it to our
build server to see how Selenium UI tests run.
passed: 1915 tests, failed 8. All 8 are failed due to inputchange removal
(I didn't replace the behaviour class)
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/apache/wicket/pull/359?email_source=notifications&email_token=AABYUQS6KSXHOTOKWCTUBM3PVXWSTA5CNFSM4HLXS6C2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODVTKVYQ#issuecomment-493267682,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AABYUQQ6YXROJFY65DRYLB3PVXWSTANCNFSM4HLXS6CQ
.

Mi Martin!
I think it's redundant to add this support. They failed just because OnChangeAjaxBehavior hasn't been replaced.

I think this behaviour was broken before wicket cleanup http://examples8x.wicket.apache.org/ajax/on-change-ajax-behavior
Very similar thing is broken in wicket 8 demo

Ah, sorry. The demo works, it just a bit misleading without looking at the code. Created a PR to make it more obvious: #364


sbcli fails to create pod due to "No API token found for service account"

Seems to be an intermittent issue in openshift.io starter tier.
[dwhatley@precision-t sbcli]$ sbcli bundle provision es-apb -p dwhatley
List of available plans:
name: ephemeral
name: persistent
Enter name of plan you'd like to deploy: ephemeral
Plan: ephemeral
Enter value for parameter [application_name] (Name given to the Elasticsearch cluster), default: [elasticsearch]:
Enter value for parameter [cluster_size] (Number of Elasticsearch instances that the cluster will consist of), default: [1]:
Enter value for parameter [es_memory_limit] (Memory limit for Elasticsearch container), default: [512Mi]:
Enter value for parameter [es_version] (), default: [6.2.1]:
WARN Failed to create a InternalClientSet: unable to load in-cluster configuration, KUBERNETES_SERVICE_HOST and KUBERNETES_SERVICE_PORT must be defined.
INFO OpenShift version: v3.10.0-0.54.0
WARN Failed to create a InternalClientSet: unable to load in-cluster configuration, KUBERNETES_SERVICE_HOST and KUBERNETES_SERVICE_PORT must be defined.
INFO unable to retrieve the network plugin, defaulting to not joining networks - clusternetworks.network.openshift.io "default" is forbidden: User "djwhatle" cannot get clusternetworks.network.openshift.io at the cluster scope: User "djwhatle" cannot get clusternetworks.network.openshift.io at the cluster scope
INFO Creating RoleBinding bundle-8bf8f323-0f4b-4b4c-b089-9b1df6daa154
INFO Successfully created apb sandbox: [ bundle-8bf8f323-0f4b-4b4c-b089-9b1df6daa154 ], with edit permissions in namespace dwhatley
INFO Running post create sandbox functions if defined.
ERRO Failed to create pod: No API token found for service account "bundle-8bf8f323-0f4b-4b4c-b089-9b1df6daa154", retry after the token is automatically created and added to the service account

I've found that when I run into this issue, deleting all "bundle" serviceaccounts seems to help.
[dwhatley@precision-t sbcli]$ sbcli bundle provision awx-apb -p dwhatley
Plan: default
Enter value for parameter [awx_web_image] (Docker Image of AWX Web), default: [ansible/awx_web]:
Enter value for parameter [awx_web_image_tag] (AWX Web Docker Image Version), default: [1.0.3]:
Enter value for parameter [awx_task_image] (Docker Image of AWX Task), default: [ansible/awx_task]:
Enter value for parameter [awx_task_image_tag] (AWX Task Docker Image Version), default: [1.0.3]:
Enter value for parameter [awx_admin_user] (AWX Admin User), default: [admin]:
Enter value for parameter [awx_admin_password] (), default: [<nil>]: foobar
Enter value for parameter [awx_secret_key] (), default: [awxsecret]:
WARN Failed to create a InternalClientSet: unable to load in-cluster configuration, KUBERNETES_SERVICE_HOST and KUBERNETES_SERVICE_PORT must be defined.
INFO OpenShift version: v3.10.0-0.54.0
WARN Failed to create a InternalClientSet: unable to load in-cluster configuration, KUBERNETES_SERVICE_HOST and KUBERNETES_SERVICE_PORT must be defined.
INFO unable to retrieve the network plugin, defaulting to not joining networks - clusternetworks.network.openshift.io "default" is forbidden: User "djwhatle" cannot get clusternetworks.network.openshift.io at the cluster scope: User "djwhatle" cannot get clusternetworks.network.openshift.io at the cluster scope
INFO Creating RoleBinding bundle-0df0c69e-ab0f-4bd3-86bf-17f7afa1d16f
INFO Successfully created apb sandbox: [ bundle-0df0c69e-ab0f-4bd3-86bf-17f7afa1d16f ], with edit permissions in namespace dwhatley
INFO Running post create sandbox functions if defined.
ERRO Failed to create pod: No API token found for service account "bundle-0df0c69e-ab0f-4bd3-86bf-17f7afa1d16f", retry after the token is automatically created and added to the service account

[dwhatley@precision-t sbcli]$ oc delete serviceaccount $(oc get serviceaccounts | grep bundle | awk '{ print $1 }')
serviceaccount "bundle-0df0c69e-ab0f-4bd3-86bf-17f7afa1d16f" deleted
serviceaccount "bundle-6cb08beb-7020-41a2-931b-d3860551d959" deleted
serviceaccount "bundle-a54f6f72-50ee-4092-af54-2e24022d7afb" deleted
serviceaccount "bundle-ebb6c65b-cdf3-47ce-b9e3-ebf62a86b8e6" deleted
serviceaccount "bundle-f8e95923-5350-44e6-9cfe-c037da945460" deleted

[dwhatley@precision-t sbcli]$ sbcli bundle provision awx-apb -p dwhatley
Plan: default
Enter value for parameter [awx_web_image] (Docker Image of AWX Web), default: [ansible/awx_web]:
Enter value for parameter [awx_web_image_tag] (AWX Web Docker Image Version), default: [1.0.3]:
Enter value for parameter [awx_task_image] (Docker Image of AWX Task), default: [ansible/awx_task]:
Enter value for parameter [awx_task_image_tag] (AWX Task Docker Image Version), default: [1.0.3]:
Enter value for parameter [awx_admin_user] (AWX Admin User), default: [admin]:
Enter value for parameter [awx_admin_password] (), default: [<nil>]: foobar
Enter value for parameter [awx_secret_key] (), default: [awxsecret]:
WARN Failed to create a InternalClientSet: unable to load in-cluster configuration, KUBERNETES_SERVICE_HOST and KUBERNETES_SERVICE_PORT must be defined.
INFO OpenShift version: v3.10.0-0.54.0
WARN Failed to create a InternalClientSet: unable to load in-cluster configuration, KUBERNETES_SERVICE_HOST and KUBERNETES_SERVICE_PORT must be defined.
INFO unable to retrieve the network plugin, defaulting to not joining networks - clusternetworks.network.openshift.io "default" is forbidden: User "djwhatle" cannot get clusternetworks.network.openshift.io at the cluster scope: User "djwhatle" cannot get clusternetworks.network.openshift.io at the cluster scope
INFO Creating RoleBinding bundle-87f1a87b-08a2-448a-96be-94201bf2e757
INFO Successfully created apb sandbox: [ bundle-87f1a87b-08a2-448a-96be-94201bf2e757 ], with edit permissions in namespace dwhatley
INFO Running post create sandbox functions if defined.
Successfully created pod [bundle-87f1a87b-08a2-448a-96be-94201bf2e757] to provision [awx-apb] in namespace [dwhatley]
[dwhatley@precision-t sbcli]$

This turned out to be a quota limit on secrets in OpenShift online. When a serviceaccount is requested, OpenShift tries to create a token secret and sometimes a dockercfg secret which will both be attached to the new serviceaccount.
If a quota exists on secrets (limited to 20 in OpenShift online free tier), the serviceaccount will still be created, but it won't have the required secrets attached. The serviceaccount will have an annotation indicating that it is awaiting a pending API token secret:
[dwhatley@precision-t sbcli]$ oc describe serviceaccount bundle-815c9db2-d5da-4265-a346-5df2a51bd13e
Name:                bundle-815c9db2-d5da-4265-a346-5df2a51bd13e
Namespace:           dwhatley
Labels:              <none>
Annotations:         openshift.io/create-dockercfg-secrets.pending-token=bundle-815c9db2-d5da-4265-a346-5df2a51bd13e-token-5flfh
Image pull secrets:  <none>
Mountable secrets:   <none>
Tokens:              <none>
Events:              <none>

Since the error message is actually fairly accurate, I am closing this issue and plan to document this for OpenShift online free tier users to be aware of.

Documented tip for avoiding this issue in free tier: https://github.com/automationbroker/sbcli/pull/58


Refactor some duplicated code

This change is

 nice job!

Review status: 0 of 8 files reviewed at latest revision, all discussions resolved, some commit checks failed.

Comments from Reviewable

shouldn't we adjust recently merged secrets to the same? @gluke77 could you rebase and apply it also there?

@pigmej sure, will do

Reviewed 9 of 9 files at r1.
Review status: all files reviewed at latest revision, all discussions resolved, some commit checks failed.

Comments from Reviewable


pipelineX pick PRs from pipeline

Proposed changes
pick #23713 #23974 #24162 #25087

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

run buildall

run buildall


Remove unused imports

fixes https://github.com/NVIDIA/spark-rapids/issues/4124
build fails with unused imports
Signed-off-by: Thomas Graves<EMAIL_ADDRESS>

build


Support multiple species and builds with VEP

This is a big one, since it touches anything that uses VEP, which is most workflows.
We previously assumed that we'd point our tool to a VEP cache, and that it would always be human, and always match the version referred to in the vep tool docker version.  This doesn't work for mouse, or other species, and limits our ability to support multiple projects that may want to anchor themselves to a particular VEP build.
The solution is to expose a bunch of parameters for reference assembly, ensembl version, and species, so that they must be explicitly specified.  While I don't love adding extra complexity to the (already kind of overwhelming) input yamls, asking users to specify the  ensembl version and such seems like a reasonable ask, IMO.

Is the version really something we should parameterize when it's hardcoded in the Docker image:
Good thoughts. John and I had a conversation about this in slack:
https://mgibio.slack.com/archives/C1AHCQM5X/p1558713693016200

The gist of it is, that we essentially have a choice between maintaining separate VEP caches, and having many different VEP CWLs pointing to that docker container (or branches, etc),   or having one cache and making it a parameter.  The good news is that it should all be backwards compatible (and in most cases, forward compatible as well).  So even though the vep docker version is 95, it happily runs on mouse 96, for example, and we've used it as far back as versions in the 60s, IIRC.

This type of change with a collection of related parameters is really making me think a record type (like the "labelled file" might be handy)!
I don't know anything about those, but would be happy to learn! Maybe make an issue for it and we'll look at a future PR?

I should add that we also should update that VEP docker version from time to time (probably when we prepare a "major release" of the pipelines, like we're doing around version 95)

A record looks something like this:
https://github.com/genome/analysis-workflows/blob/92bdcd9fa879161834ecdb1c4c9ac7c46e940206/definitions/types/labelled_file.yml#L1-L8
and then can be used with a combination of an import like https://github.com/genome/analysis-workflows/blob/92bdcd9fa879161834ecdb1c4c9ac7c46e940206/definitions/pipelines/somatic_exome.cwl#L7-L9 and a reference like https://github.com/genome/analysis-workflows/blob/92bdcd9fa879161834ecdb1c4c9ac7c46e940206/definitions/pipelines/somatic_exome.cwl#L43-L44 (this example uses an array of them).

Added this issue :
https://github.com/genome/analysis-workflows/issues/679


how to predict model generated from keras model.save()?

Hi,
I have generated a keras model and saved it using keras model.save() function which results in saved_model folder consisting of assests,variable,keras_metadata.pb and saved_model.pb file.

Traceback (most recent call last):
File "/home/Desktop/Projects/nn-Meter/py3.9_env/bin/nn-meter", line 33, in
sys.exit(load_entry_point('nn-meter', 'console_scripts', 'nn-meter')())
File "/home/Desktop/Projects/nn-Meter/py3.9_env/nn-Meter/nn_meter/utils/nn_meter_cli/interface.py", line 266, in nn_meter_cli
args.func(args)
File "/home/Desktop/Projects/nn-Meter/py3.9_env/nn-Meter/nn_meter/utils/nn_meter_cli/predictor.py", line 56, in apply_latency_predictor_cli
latency = predictor.predict(model, model_type) # in unit of ms
File "/home/Desktop/Projects/nn-Meter/py3.9_env/nn-Meter/nn_meter/predictor/nn_meter_predictor.py", line 106, in predict
graph = model_file_to_graph(model, model_type, input_shape, apply_nni=apply_nni)
File "/home/Desktop/Projects/nn-Meter/py3.9_env/nn-Meter/nn_meter/ir_converter/utils.py", line 42, in model_file_to_graph
converter = FrozenPbConverter(filename)
File "/home/Desktop/Projects/nn-Meter/py3.9_env/nn-Meter/nn_meter/ir_converter/frozenpb_converter/frozenpb_converter.py", line 15, in init
parser = FrozenPbParser(file_name)
File "/home/Desktop/Projects/nn-Meter/py3.9_env/nn-Meter/nn_meter/ir_converter/frozenpb_converter/frozenpb_parser.py", line 16, in init
graph.ParseFromString(f.read())
google.protobuf.message.DecodeError: Error parsing message with type 'tensorflow.GraphDef'
How can i predict the model generated from saved_model.pb?
I saw in the examples provided there is single .pb file which can be predicted. So do i need to convert the saved_model folder into single .pb file? If so, how to convert saved_model to single .pb file?
I have attached the generated saved_model below for your reference.
Please respond as soon as possible.
Thanks.
mobilenetv1_0.zip

Hello, sorry for the late reply.
Our .pb converter currently only works with tensorflow 1.x, and these type of pb files have been deprecated in tf2. If you want to use it in tensorflow 2.x, you may encounter bugs like the one you mentioned. We suggest using an ONNX model for latency prediction.
Sorry for the inconvenience.
Jiahang

Th

Hello, sorry for the late reply. Our .pb converter currently only works with tensorflow 1.x, and these type of pb files have been deprecated in tf2. If you want to use it in tensorflow 2.x, you may encounter bugs like the one you mentioned. We suggest using an ONNX model for latency prediction. Sorry for the inconvenience.
Jiahang

Thank you for the quick response , we have already moved on by doing what you asked to do.


Select template from a dropdown instead of providing a URL/ID

Once the templates become established, the user experience would be better if users could select a template by name from a dropdown list rather than providing a URL/ID.
his should also lead to fewer errors when creating a report.

The app has default document IDs stored in settings, so we can also pre-populate the fields with those IDs (and add a setting for the default folder ID).
Since the form has language radio buttons, we could similarly add settings for Spanish IDs, and change the pre-populated fields if the user changes language (can move language to top of form).
That way, the user doesn't need to enter any data other than the optional document title.

Re-opening as this is not solved for Spanish.


gsheet support [feature request]

Would it be possible to add gsheet support as xlsx to this awesome library?

"gsheet support as xlsx" can mean:
A) interoperating with google sheets via XLSX: if the library can't read a file generated by google sheets that's a bug.  It may or may not be a bug if google sheets can't read a file generated by this library.  In any case, file an issue if you come across a bad import or export.
B) programmatically interacting with google sheets.  This is definitely out of scope, but if you follow the quickstart in https://developers.google.com/sheets/api/quickstart/js or https://developers.google.com/sheets/api/quickstart/nodejs , you can request or put arrays of arrays (which line up with aoa_to_sheet and sheet_to_json with header:1)
C) .gsheet file support:  The .GSHEET file is a JSON file with a url key corresponding to a google drive URL and a doc_id key corresponding to the Google Sheet key, so processing .GSHEET files means dealing with the google sheets API

Oh I see now, thanks @SheetJSDev for clarifying: I thought gsheet files actually had the payload like any file instead of carrying just the metadata to interact with gdoc service.
Thanks and sorry for the noise!


How do I add new python libraries like - openssl-dev, adal, cffi etc in my layer?

For either binaries or libraries, you can first try to just copy them off of an EC2 server and put them in the correct directories in the layer. You can find what AMI the Lambda environment uses here:
https://docs.aws.amazon.com/lambda/latest/dg/current-supported-versions.html
Sometimes the binaries depend on shared libraries or things are configured to look for paths that are outside of your control in the layer. If that happens, you must build them from source, using the Lambda support directories and then copy them to your layer.


Display detailed climb stats

Climb stats are available via the info API. This includes the precise quality and difficulty distributions, as well as all of the ascents (users, comments, etc.).

Hey!
I was wondering if I can work on this. Is there anything I need to know about reproducing the environment or using the info API. Or is the readme good enough?
Thanks

Hopefully the README should be good enough for setting up a development environment, but there haven't been many additional contributors yet, so feel free to reach out and let me know if you have any issues.
This particular issue is a little vague because I hadn't quite thought about exactly what this should look like. If you're familiar with the info page on the Kilter/Tension/etc. apps that could be a good starting point for design. If not, this issue may not be a great fit for you. I've marked a few issues with "good first issue" if you're interested in contributing to some other part of the app.
This repo doesn't use Node. The backend is in Python (Flask). I don't think any of the existing issues require a new API endpoint. Most of the issues will require some updates to both the backend (Python) and the front end (JS + HTML Jinja templates), including this one.

Ok yeah sure, I can try out one of the good first issues to get started.
Python flask is also not a problem, I have worked with that in the past.
Thanks

Dont know if you are still working on this Issue, but I think it could be split up into two parts

Detailed Stats about this particular climb
– How many sends overall
– Grade Distribution
– Comments

Personal Stats
see Issue #55

I don't think anyone is working on this one, it needed a bit more specification. I agree that it should be split up into multiple parts.

can try to make some mockups.
have already tried if I can come up with a solution to display the stats, but could be a bit too advanced for me :) not an easy task