Failing on ECMWF ensemble

I was just giving this a try.
I have 3 files coming from the ECMWF ensemble with all the members inside.

I just tried to
gribscan-index *.grib2 -n 8
gribscan-build *.index -o dataset.json --prefix /home/ekman/ssd/guido/ecmwf-ens/

But received
Traceback (most recent call last):
  File "/home/ekman/miniconda3/envs/models/bin/gribscan-build", line 8, in <module>
    sys.exit(build_dataset())
  File "/home/ekman/miniconda3/envs/models/lib/python3.10/site-packages/gribscan/tools.py", line 29, in build_dataset
    refs = gribscan.grib_magic(args.indices, global_prefix=args.prefix)
  File "/home/ekman/miniconda3/envs/models/lib/python3.10/site-packages/gribscan/gribscan.py", line 424, in grib_magic
    global_attrs, coords, varinfo = inspect_grib_indices(messages, magician)
  File "/home/ekman/miniconda3/envs/models/lib/python3.10/site-packages/gribscan/gribscan.py", line 323, in inspect_grib_indices
    dims, dim_id, shape = map(tuple, zip(*((dim, i, len(coords))
ValueError: not enough values to unpack (expected 3, got 0)

I don't know whether it's because of the files dimensions or whether I'm doing something wrong.

I've seen something like this before. I think this was related to variables which occur only in a single message (e.g. a single non-time-varying horizontal field).  https://github.com/gribscan/gribscan/commit/2899eac1675acb5ad3f7d64e23103c485c806956 is probably what you need. It's included in the current main, but unfortunately the latest PyPi release is one commit earlier 😬.

@guidocioni can you try with the latest main version?
@lkluft do you think we could get some new release?

I've seen something like this before. I think this was related to variables which occur only in a single message (e.g. a single non-time-varying horizontal field). 2899eac is probably what you need. It's included in the current main, but unfortunately the latest PyPi release is one commit earlier 😬.

@guidocioni can you try with the latest main version?
@lkluft do you think we could get some new release?

Let me try again and I'll get back to you.

Hey, so with the correction that you posted it seems to work, albeit the first step being slower.
For the second step I had to manually create a folder dataset.json, because otherwise it was complaining
Traceback (most recent call last):
  File "/home/ekman/miniconda3/envs/models/bin/gribscan-build", line 8, in <module>
    sys.exit(build_dataset())
  File "/home/ekman/miniconda3/envs/models/lib/python3.10/site-packages/gribscan/tools.py", line 32, in build_dataset
    with open(f"{args.output}/{dataset}.json", "w") as indexfile:
FileNotFoundError: [Errno 2] No such file or directory: 'dataset.json/atm2d.json'

After creating the folder it wrote a json file dataset.json/atm2d.json.
I'm not sure if I'm doing things correctly because I imagine you would have already included a check to see if that folder is existing or not...so it smells like I'm using one of the parameters wrong.
Anyhoe...when I tried to load into xarray
ds = xr.open_zarr("reference::/home/ekman/ssd/guido/ecmwf-ens/dataset.json/atm2d.json", consolidated=False)

Then I get a dataset with collapsed dimensions.

Again, sorry if I'm doing something wrong: zarr is kind of new to me.

This looks exactly like what I would expect. I also normally create the folder -o dataset.json or -o json.dir myself before running the gribscan-build command.


dark mode for website

would like to help here with making a dark theme for expressjs.com

Sounds awesome! I look forward to your contribution!

Just remove the background image every time u join a page of the website, or make a pr removing the file xd

Hello @MehfoozurRehman , I noticed that you opened this issue three months ago about adding dark mode. I'm interested in contributing to the project and was wondering if you are still working on this issue or if you would be willing to let me take a look at it? Please let me know if there's anything I can do to help.

Hey @dougwilson, is this issue still open? If yes, can you please assign me this issue?

What's pending here?

Hey everyone,
Apologies for my absence last year due to studies. I'm comfortable with the MERN stack but not Ruby. However, I use Express.js daily and am eager to implement dark mode. Can someone guide me on running the project locally? I'm ready to contribute.
Thanks,

ok so last year i tried doing the local run according to repo readme and again today i tried but

its giving me this error for some reason to make sure its not my local pc i am using github code spaces

Hey Guys, was this still active? And/or still being worked on? I'm looking to make some contributions here.

@chrisdel101 Please do....  I haven't delved into this issue, but if you can sort it out your contribs are welcome!

okay, I'm looking into this and will plan to handle it.

guys can someone please help me run the repo locally

Hey, just read the /README.md#local-setup

ok so last year I tried doing the local run according to repo readme and again today i tried but

its giving me this error for some reason to make sure it's not my local pc i am using GitHub code spaces.

these is the result of first steps I am not really familiar with the ruby ecosystem so please let me know what i am doing wrong.

i have sent this before the instructions in readme are not working for me please can you help here

i have tried on github codespaces and my local computer its the same

@MehfoozurRehman I've already started working on this, see above, and have made some significant progress. Prob not worth you also working on this also at this point.

@chrisdel101, it's okay. Please continue working on this. I was under the impression that this issue was abandoned, but if you can, please complete the pull request.

Re: your setup, the images above are not showing up for me. After you install Jekyll and run the serve command what happens?

this is what i am getting

Huh, yeah I have no idea why you are getting that. Seems like something is not intstalled correctly, or a gem is missing. I assume you did all these steps first:

https://jekyllrb.com/docs/installation/
https://jekyllrb.com/docs/

If something failed in the first two steps then the server will fail. You should have something like this before it will run
ruby-v
ruby 3.3.0

jekyll -v
jekyll 4.3.3

Install extra gem from /README.md#local-setup
gem install jekyll-redirect-from
Then after cloning/forking the expressJS repo, this is what I see:
bundle install
Fetching gem metadata from https://rubygems.org/..........
Resolving dependencies...
Fetching nokogiri 1.16.4 (x86_64-darwin)
Installing nokogiri 1.16.4 (x86_64-darwin)
Bundle complete! 3 Gemfile dependencies, 96 gems now installed.
Use `bundle info [gemname]` to see where a bundled gem is installed.

bundle exec jekyll serve
/usr/local/lib/ruby/gems/3.3.0/gems/jekyll-3.9.5/lib/jekyll.rb:28: warning: csv was loaded from the standard library, but will no longer be part of the default gems since Ruby 3.4.0. Add csv to your Gemfile or gemspec. Also contact author of jekyll-3.9.5 to add csv into its gemspec.
Configuration file: /Users/myComputer/code_work/jekyll/expressjs_copy/_config.yml
To use retry middleware with Faraday v2.0+, install `faraday-retry` gem
            Source: /Users/myComputer/code_work/jekyll/expressjs_copy
       Destination: /Users/myComputer/code_work/jekyll/expressjs_copy/_site
 Incremental build: enabled
      Generating...
                    done in 15.486 seconds.
 Auto-regeneration: enabled for '/Users/myComputer/code_work/jekyll/expressjs_copy'
LiveReload address: http://<IP_ADDRESS>:35729
    Server address: http://<IP_ADDRESS>:4000
  Server running... press ctrl-c to stop.
        LiveReload: Browser connected

yes so I have done the steps mentioned above It is saying the same thing for me just my ruby and Jakyell versions are different I am using GitHub code spaces for this these are the versions installed on that by default

ok so I was trying a few things i didn't know how to update the ruby version I changed the codespaces settings to use the beta docker image and gem update --system 3.5.9 updated the ruby using this. I don't know which one fixed it but now it's working

anyways appreciate the help please let me where you are in completing this and if you need any help with this issue

Hey guys, I ran into a problem.
This is the _layouts/home.html which is used for the main index.md. It pulls a JS file I added from the JS folder. It needs to run at the end of the page, and it works.
<html lang="{{ page.lang }}">
   <body class="en-doc">
   <script data-cfasync="false" src="../js/theme.js"></script>
   </body>
</html>

This is the _layouts/page.html which runs most of the other pages, for example installing.md.  It pulls a JS I added to the same folder just for test purposes.
<html lang="{{ page.lang }}">
   <body class="en-doc">
   <script data-cfasync="false" src="test.js"></script>
   </body>
</html>

I get ERROR 'en/starter/test.js' not found. It is ignoring the src, even abstolute paths, and pulling for path where the markdown file is located. How do I stop this? Why is this happening?

I'm stumped on this. I can't figure out why this is happening.

Fixed with #1490


[Simple Vi Mode v2] + [Space to Option_L] bug

Hi,
Thanks for creating and maintaining this master piece software.
It's the one of the most important softwares I can't live without.
However, I recently found an issue when I enable both Simple Vi Mode v2 and Space to Option_L(+ When you type Space only, send Space).
By holding S and then holding Space, then typing J, K, L.
It will send Option + Down, Option + Up, Option + Right as I expected.
But holding S and then holding Space and then typing H will give no response at all.
Really a weird behavior, probably a bug.

Just tested on version 10.22.0 and works fine on my end

I tried it on 3 different computers, none of them work.
Attached are the screenshots from my personal desktop.

However, I found that I hold S then Space then H, and release Space first.
It will send a Option + Left.


About the signal2vec model

Could you please provide the codes corresponding to the models and training of signal2vec model?
I only see the encodings.

The model is described in details in the related paper. I will create separate repository with the signal2vec model in the future.

Is there a repository yet for the signal2vec model training and using it with datasets other than the ones in nilmtk ?


Account for the old generation in memory measurements

The erlang gc information seems to report old and young generation
separately.
Here is an example from faulty measurements we used:
[
  old_heap_block_size: 0,
  heap_block_size: 610,
  mbuf_size: 77,
  recent_size: 0,
  stack_size: 14,
  old_heap_size: 0, # <--- notice me
  heap_size: 540,
  bin_vheap_size: 0,
  bin_vheap_block_size: 46422,
  bin_old_vheap_size: 0,
  bin_old_vheap_block_size: 46422
]

[
  old_heap_block_size: 2586,
  heap_block_size: 1598,
  mbuf_size: 0,
  recent_size: 198,
  stack_size: 14,
  old_heap_size: 355, # <--- notice me
  heap_size: 275,
  bin_vheap_size: 0,
  bin_vheap_block_size: 46422,
  bin_old_vheap_size: 0,
  bin_old_vheap_block_size: 46422
]

Notice how heap_size got smaller but together with the
old_heap_size memory was still consumed?
Yup, that's what we're talking about here.
So, always take both of them into account.
Solves #213 when combined with #214 - wanted to split it out because one is about handling faulty values in statistics/formatting and this one is nice and separate in the memory measurement department.

yeah sadly couldn't think of a way to test this... The only "test" I can think of is to inline Michals benchmarking suite and run an integration test against it... wanted to do that either way but I need both PRs merged for that. Will try that once both are merged :)
Thanks for the review :+1:

Even that test will be tricky because of variation in memory usage between environments. I was seeing pretty significant differences between my local machine and CI. I guess we could run that benchmark and at least ensure that none of the measurements come back negative?

@devonestes Oh just saw this. So, because the measurements were always the same and the new output code puts out N/A and the warning if things go horribly wrong we can test for their absence. So that's good. For me, it also seemed to work when eliminating all the other scenarios - so maybe even a unit test with these in the memory module would work... intriguing. See #218


Scrolling bug when calendar view extends outside of safe area

I have the calendar view extending to top and bottom edges of the screen:
NSLayoutConstraint.activate([
    calendarView.leadingAnchor.constraint(equalTo: view.layoutMarginsGuide.leadingAnchor),
    calendarView.trailingAnchor.constraint(equalTo: view.layoutMarginsGuide.trailingAnchor),
    calendarView.topAnchor.constraint(equalTo: view.topAnchor),
    calendarView.bottomAnchor.constraint(equalTo: view.bottomAnchor),
])

When I scroll to the end it glitches:
calendarView.scroll(
            toDayContaining: Date(),
            scrollPosition: .centered,
            animated: true)

https://user-images.githubusercontent.com/470753/105067755-e57e7000-5a34-11eb-9b38-f5cb892b3982.mov
If I constrain the top and bottom to the layoutMarginsGuide I don't have this issue. I'd prefer to extend to the edges of the screen so that I get the content under the navigation bar and home indicator visual effect.

Oh yikes! Definitely a bug, thanks for reporting. I'll look into this soon.

Oh yikes! Definitely a bug, thanks for reporting. I'll look into this soon.

@hiltonc fix will be merged Monday at the latest, thanks for reporting this bug!
https://github.com/airbnb/HorizonCalendar/pull/101

Awesome, thank you @bryankeller!

Fixed in v1.7.1 🙂


Extra newline when using browser shim in Deno

When using the browser shim in Deno, printing from a CLI program produces an extra new-line.
e.g., for this Rust project:
fn main() {
    println!("Hello World!");
    println!("Hello World!");
}

import * as wasip2 from<EMAIL_ADDRESS>
import { instantiate } from "./wasm/demo.js";

const imports = {};
for (let module of Object.keys(wasip2)) {
    for (let key of Object.keys(wasip2[module])) {
        if (!key.startsWith("_")) {
            imports[`wasi:${module}/${key}`] = wasip2[module][key];
        }
    }
}

const demo = await instantiate(
    (url) => fetch(new URL(`./wasm/${url}`, import.meta.url)).then(WebAssembly.compileStreaming),
    imports
);

demo.run.run();

results in
Hello World!

Hello World!

while the expected result would be
Hello World!
Hello World!

Thanks for the fix.
Note though that you probably want to be using the Node.js version in Deno as we do support the Deno platform.


[android] Player - Repeat forever bug (USD $50 in cryptocurrency bounty)

Steps to reproduce.

Start playing a song with "Repeat forever" mode on.
Play the song once until the end (fast forward if you want)
The song will repeat, however, the second time around the player stops. If you hit next, it plays the next song.

Theory:
This suggests that when the new player instance is created it's not carrying on correctly the playback mode that was set by the previous player.

@HimanshuSharma789 Maybe you'd like to get dirty with this one.
This is basically a never ending refactoring of an open source music player we integrated years ago called Apollo.
I've managed to simplify its code base greatly over the years, this is one annoying bug in playback.

Will also pay $50 in BTC or ETH for this bug to be fixed.

I cannot debug it properly but figured out something.

Whenever the track is ended it calls duration function to fetch audio length. I works perfectly for the first time but the second time it returns -1 (as audio duration). This is causing this problem.
mCurrentMediaPlayer != null     ----->    but still mCurrentMediaPlayer.getDuration(); generates error which leads to -1 from the catch block

awesome find.
when it generates the error, is it by anychance some sort of invalid state for the player when that happens?
any ideas on how to go about this, which doesn't involve caching the last duration value for that track on some temporary place?

As u stated in your first comment, you might need to look into variable mCurrentMediaPlayer , (mPlayer)
I have a feeling its not holding appropriate value as it should have. It might be because these values are not updated properly.
Even though if we return a value (lets say position=1) from above function

long result = mPlayer.seek(position);

also returns error

Gotta look then into refreshing the reference to mCurrentMediaPlayer, and/or mPlayer.
Perhaps when the song ends the first time, the player is destroyed and recreated.

fixed with a huge round of fixes on the player this year


AI ELO Card Dump issue

When I perform this step to run CPU Contests...
"In the client console run carddata which should create /Data/ClientDataDump/CardData/, copy the CardData folder to /Data/CardData/."
It spits out ClientDataDump/Card/Data instead of the expected ClientDataDump/CardData
If I'm meant to put "Data/Card/Data" instead of "Data/CardData" it is unclear based on these instructions. I did attempt to run it in command line with both configurations, either way, but the command line just states the decks hit an error attempting to duel one-another and then spits out a results folder with all decks at 1200 elo and all duels resulting in a draw. I have a feeling that has something to do with this Card/Data issue. Dunno if it's just a problem on my end, a problem with the instructions (or my own lack of comprehension) or something entirely different, so I thought I'd make a ticket.

Thanks!!
I attempted that, using the exact files from your build, and ended up getting the exact same errors.
"Error occurred when running duel sim deck1:247970.ydk deck2:247071.ydk"
Followed by the rest of the duels.
I then tried with the client open, the server open, both open and with the command menu in admin permissions just to be thorough. I also made sure to delete everything but the settings and decks between each attempt. Thoroughly stumped on this one, but it might just be something on my PC preventing me from running it? Thanks for all the help!

It most likely means the folder structure is still incorrect unfortunately. The error occurs when there are files missing which are required by the duel engine (or the duel engine isn't found where it should be ../masterduel_Data/Plugins/x86_64/duel.dll).

Hrm. Alrightie! I'll try to upload some images of my file structure and see if you'd be able to spot anything amiss! Though, if you're busy please feel free to disregard! Your help thus far has been more than necessary, and I'm grateful for this mod to begin with! Thanks for the hard work!
Main Folder

Data

And the Plugins folder

The CPUcontest folder is the very same one that you sent in your build.zip, down to the settings and decks. As is the CardData folder's contents. Upon running with this exact setup I get...

In your Yu-Gi-Oh!  Master Duel folder make a folder called Build. Move Data, YgoMaster.exe, YgoMasterClient.exe, YgoMasterLoader.exe inside of the Build folder.

Excellent! You're the best! Sorry for the confusion.


Improve Body Graphic

done in the first release for the transgender website in the summer 2020
The body graphic is not changed only some changes in colour and hair


Uploading the build artifacts to Maven Central

Hey, thanks for making this library!
I've been using it with Clojure with great success. However I was wondering if it is possible to upload the build artifacts from this project to Maven Central?
Forgive my ignorance as I am not that knowledgable about building Java artifacts nor do I understand how wrapping a SWIG interface affects things.
I see there are artifacts for a previous version: https://search.maven.org/artifact/com.github.mbelling/rpi-ws281x-java/1.0.0/pom
Unfortunately that version doesn't expose the same API (Color and LedStrip), though maybe that's due to a difference between building the code locally vs dling the artifacts.
Thanks for your time

Sure, I will see if I can get time to do this in the next week or so.

Awesome, thanks again for your time.

I changed the version to 2.0.0 since it changed so much, and uploaded the artifacts.  I am not sure what the cycle on getting artifacts to central is, but they should be there eventually. :)
Feel free to close this once you are able to get the artifacts, or I can close in a day or two.

The 2.0.0 artifacts are in maven central now. Closing.


drone orgsecret rm  404

I use drone orgsecret add daocloud.io docker_password  my_password successfully.
But when rm orgsecret, it said 404.

:wave: hey there, per our issue template, for end-user support please use one of our support channels, such as our chatroom or our mailing list.


Can't Publish Python 2.x or 3.x Version of a Kata

I've created a new Python kata and tried to enable both Python 3.x and 2.x in a standard way (i. e. Validate Solution and (Re-)Publish the kata). This kata is compatible with both versions of Python.
When I try to Re-Publish with Python 2.x enabled, it shows the following message:

Default Version is not a supported version

Another example of the same issue is this kata. There is also another kata with a fairly similar issue but without the above mentioned message.
Regards,
suic

It's just happened to me again. My guess is that there's some issue with the version dropdown box in the kata editor (at least for Python). I have a question regarding this: What is the default version of Python? Regards, suic

@suic86 ,
I think the same issue just happened again for me on this kata:
https://www.codewars.com/kata/simple-beads-count/python
Python 2 is unavailable but if I click Edit Kata and choose Python 2, the tests pass just fine?

@the-zebulan Try to republish with 2.7.6 selected in the dropdown. After I did this, I was able to select both versions in the trainer.

@10XL I've tried it and got:

Default Version is not a supported version


Account over LFS quota

I'm unable to clone the data due to an LFS error:
$ git clone https://github.com/wengong-jin/DSMBind.git
Cloning into 'DSMBind'...
remote: Enumerating objects: 61, done.
remote: Counting objects: 100% (3/3), done.
remote: Compressing objects: 100% (3/3), done.
remote: Total 61 (delta 0), reused 0 (delta 0), pack-reused 58
Unpacking objects: 100% (61/61), 51.86 MiB | 15.09 MiB/s, done.
Downloading data/antibody/test_HER2.jsonl (94 MB)
Error downloading object: data/antibody/test_HER2.jsonl (3cc268d): Smudge error: Error downloading data/antibody/test_HER2.jsonl (3cc268d539af711b87962c5807f4558ac00f6d4e7319b98b50652189c152e88e): batch response: This repository is over its data quota. Account responsible for LFS bandwidth should purchase more data packs to restore access.

Is the test data hosted anywhere else?  Perhaps https://zenodo.org/ could be a good option (and would include a DOI).

Yes the data is now moved to zenedo. Thank you for point it out!


text-field 0.6.2, destroying the element with error

first i assign a key prop to the element.when i reconstruct the element by change the key. the element shows an error, and my whole program corrupt.
the error is shown:
Uncaught TypeError: Cannot read property 'destroy' of null
at TextField.componentWillUnmount (index.js:133)
at callComponentWillUnmountWithTimer (react-dom.development.js:15173)
at HTMLUnknownElement.callCallback (react-dom.development.js:149)
at Object.invokeGuardedCallbackDev (react-dom.development.js:199)
.
.
.
.
.

Could you please paste some code in? Or a codepen or codesandbox?

I tried to recreate the error here https://codesandbox.io/s/6ly1w2n4rz but wasn't able to recreate, any ideas?

In the end my work around was to wrap my dispatch action call in a setTimeout with a delay of 0.
This stopped the error for now


[luajit] Add support for OSX

Port LuaJIT fails to build with OSX. This PR is aimed at fixing this problem.

Which triplets are supported/not supported?

No, but I have updated and committed the files ${VCPKG_ROOT}/versions/baseline.json and ${VCPKG_ROOT}/versions/l-/luajit.json after having run git rev-parse HEAD:ports/luajit and copied the value in baseline.json. Next time I'll use the tool provided.

This usage seems fine to me. Asking around...

Confirming: There was nothing wrong with the usage before (and I would prefer to see it put back). Adding CMake configure bindings, as suggested by @LilyWangLL and @JackBoosY would indeed be an improvement, but we shouldn't be blocking on documenting the actual usage here. (The usage is documenting the status quo, it isn't making the status quo worse)

Cf. https://github.com/microsoft/vcpkg/pull/24584#discussion_r867680343

A single find_library doesn't work for multi-config. (Not a problem for me. You decide.)
There are different library names across platforms. The find_library call must take care of this with NAMES and NAMES_PER_DIR.

Cf. #24584 (comment)

A single find_library doesn't work for multi-config. (Not a problem for me. You decide.)
There are different library names across platforms. The find_library call must take care of this with NAMES and NAMES_PER_DIR.

These are problems with the port, but they are status quo problems. Documenting the usage as it is is better than nothing, even if the world could use serious improvement.

That said, it's already removed, so no big deal. @fedapo if you would look at writing CMake configs for this port so that it would "just work" for people more easily that would be extremely helpful. Thanks for fixing MacOS :)

@BillyONeal Thank you. I'll think about it. I'm reluctant to introduce a library name - something like LuaJIT - to be used in find_package that has not been agreed upon with the library maintainer. This creates a dependency in client CMake script to an identifier that is only specific to vcpkg. That being said, I noticed that this is already occurring for other libraries and it is true that having a LuaJITConfig.cmake or similar available would simplify things.
I'll see if I find the time. Once again, thank you.

@BillyONeal Thank you. I'll think about it. I'm reluctant to introduce a library name - something like LuaJIT - to be used in find_package that has not been agreed upon with the library maintainer.

We agree that this is a problem, that's why when we create such targets we prefix them with "unofficial". See https://github.com/microsoft/vcpkg/blob/master/docs/maintainers/maintainer-guide.md#add-cmake-exports-in-an-unofficial--namespace

This creates a dependency in client CMake script to an identifier that is only specific to vcpkg. That being said, I noticed that this is already occurring for other libraries and it is true that having a LuaJITConfig.cmake or similar available would simplify things.

That's true, but any use of find_library and similar are likely to be specific to our layout too.

I'll see if I find the time. Once again, thank you.

Thank you!


InteractiveViewer is rebuilt on all user inputs

Is there an existing issue for this?

[X] I have searched the existing issues
[X] I have read the guide to filing a bug

Steps to reproduce

Run the code sample
Enter flutter performance
Enable "track widget rebuilds"
Move pointer around in the InteractiveViewer (even without zooming in at all)
Observe that at each pointer move interval the InteractiveViewer rebuilds. It can get to 200 rebuilds in just a few seconds.

Expected results
I don't believe this is expected behavior. A ListView for example only needs to be built once and can scroll without rebuilding. That said, I can't say this is incorrect behavior for certain. This doesn't seem to be documented anywhere and I don't see any github issue mentioning it. I believe rebuilding the InteractiveViewer becomes expensive when you use onInteractionUpdate: which may cause other widgets to rebuild. I can't say for certain about this either but I believe I am facing a performance issue due to this rebuilding behavior of the InteractiveViewer.
Actual results
The InteractiveViewer is being rebuilt on every input.
Code sample
Code sample
import 'package:flutter/material.dart';

void main() {
  runApp(const MyApp());
}

class MyApp extends StatelessWidget {
  const MyApp({super.key});
  @override
  Widget build(BuildContext context) {
    return MaterialApp(
      title: 'Flutter Demo',
      theme: ThemeData(
        colorScheme: ColorScheme.fromSeed(seedColor: Colors.deepPurple),
        useMaterial3: true,
      ),
      home: const Scaffold(
        body: Example(),
      )
    );
  }
}

class Example extends StatelessWidget {
  const Example({super.key});

  @override
  Widget build(BuildContext context) {
    return SizedBox(
      width: 350,
      child: InteractiveViewer(
        child: const SizedBox(
          height: 600,
          width: 350,
          child: Center(child: Text("content")),
        ),
      ),
    );
  }
}

Screenshots or Video
This is after about 10 seconds or less:

Screenshots / Video demonstration

Logs
Logs
[Paste your logs here]

Flutter Doctor output
Doctor output
[Paste your output here]

One thing I immediately notice is that LsitView is made of  a stateless ScrollView which creates a stateful Scrollable, while IneractiveViewer is directly a StatefulWidget. Now I do not know if ListVIew –  or rather the Scrollable – is internally rebuilding the same amount as the IneractiveViewer, and the ListVIew is just hiding the rebuilds of the Scrollable, or if the separation of ScrollView and Scrollable being stateless and stateful respectively is actually decreasing the number of necessary rebuilds. If the former, then this issue can be closed. Although I think this should be document somewhere as the way it stands it is very confusing to see  IneractiveViewer reach thousands of rebuilds while others are in the tens.

Thanks for the report @yakagami. While I do see the current screen value for InteractiveViewer does seem to go up as shown below:

But this I observed only upon trying to zoom in and not while moving around the cursor. I tried to emulator and zoomed in with the help of trackpad and then moving the cursor.
I didn't notice the value or rebuild happening while just moving around the mouse.
Did you also observe this on emulator or physical device with a mouse or with trackpad without zooming in ?

@darshankawar I just tried on android emulator pixel 3a as well as physical android device (no ios available) and it is rebuilding on each interaction. To be sure I completely reinstalled the sdk to make sure it was not due to any changes I made. Note this is immediate on app start without zooming in at all.
here is a video:
  rebuilds video
https://github.com/flutter/flutter/assets/92773903/dc47e901-ee36-40f2-9853-0fc1ae042d63

flutter -v
[√] Flutter (Channel stable, 3.13.6, on Microsoft Windows [Version 10.0.22621.2283], locale en-US)
    • Flutter version 3.13.6 on channel stable at
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision ead455963c (9 days ago), 2023-09-26 18:28:17 -0700
    • Engine revision a794cf2681
    • Dart version 3.1.3
    • DevTools version 2.25.0

Thanks for the update @yakagami
In above video, did you also pressed on trackpad while moving the mouse ? Because I see the rebuild occur while moving the cursor but only when I keep the trackpad pressed in order for cursor to be active in the emulator screen.

@darshankawar in that video I am using a tackpad and no mouse. On the physical device I am not using a trackpad.

@darshankawar

type
scrolling zoomed out
zooming in
scrolling while zooming in

physical mobile device
Y
Y
Y

emulator using trackpad
Y
N/A
N/A

emulator using mouse
Y
Y
Y

windows using trackpad
Y [0]
Y[0]
Y[1]

windows using mouse
N
Y
Y

[0] rebuilds much less frequently.
[1] rebuilds at the same frequency as scrolling while zoomed out on the physical device.
In all cases the InteractiveViewer rebuilds a few times in the beginning and especially the end of the input across all devices and inputs. On windows using mouse it stops after a few dozen milliseconds. I couldn't figure out how to zoom in using the trackpad on emulator.

hmmm. Adding print("rebuild"); to the build method shows that it is only rebuilding once or twice... The InteractiveViewer doesn't appear show up at all in the flutter inspector repaint boundary (I could be missing something here). Could this be a bug in flutter performance's "track widget rebuilds" method?

Thanks for the details provided. Based on the report and also the fact that it is replicable per verification, labeling for team's attention and tracking.

 stable, master flutter doctor -v
[!] Flutter (Channel stable, 3.13.6, on macOS 12.2.1 21D62 darwin-x64, locale
    en-GB)
    • Flutter version 3.13.6 on channel stable at
      /Users/dhs/documents/fluttersdk/flutter
    ! Warning: `flutter` on your path resolves to
      /Users/dhs/Documents/Fluttersdk/flutter/bin/flutter, which is not inside
      your current Flutter SDK checkout at
      /Users/dhs/documents/fluttersdk/flutter. Consider adding
      /Users/dhs/documents/fluttersdk/flutter/bin to the front of your path.
    ! Warning: `dart` on your path resolves to
      /Users/dhs/Documents/Fluttersdk/flutter/bin/dart, which is not inside your
      current Flutter SDK checkout at /Users/dhs/documents/fluttersdk/flutter.
      Consider adding /Users/dhs/documents/fluttersdk/flutter/bin to the front
      of your path.
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision ead455963c (5 days ago), 2023-09-26 18:28:17 -0700
    • Engine revision a794cf2681
    • Dart version 3.1.3
    • DevTools version 2.25.0
    • If those were intentional, you can disregard the above warnings; however
      it is recommended to use "git" directly to perform update checks and
      upgrades.

[!] Xcode - develop for iOS and macOS (Xcode 12.3)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    ! Flutter recommends a minimum Xcode version of 13.
      Download the latest version or update via the Mac App Store.
    • CocoaPods version 1.11.2

[✓] Chrome - develop for the web
    • Chrome at /Applications/Google Chrome.app/Contents/MacOS/Google Chrome

[✓] VS Code (version 1.62.0)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.21.0

[✓] Connected device (5 available)
    • SM G975F (mobile)       • RZ8M802WY0X • android-arm64   • Android 11 (API 30)
    • Darshan's iphone (mobile)  • 21150b119064aecc249dfcfe05e259197461ce23 •
      ios            • iOS 14.4.1 18D61
    • iPhone 12 Pro Max (mobile) • A5473606-0213-4FD8-BA16-553433949729     •
      ios            • com.apple.CoreSimulator.SimRuntime.iOS-14-3 (simulator)
    • macOS (desktop)            • macos                                    •
      darwin-x64     • Mac OS X 10.15.4 19E2269 darwin-x64
    • Chrome (web)               • chrome                                   •
      web-javascript • Google Chrome 98.0.4758.80

[✓] HTTP Host Availability
    • All required HTTP hosts are available

! Doctor found issues in 1 category.

[!] Flutter (Channel master, 3.16.0-6.0.pre.39, on macOS 12.2.1 21D62
    darwin-x64, locale en-GB)
    • Flutter version 3.16.0-6.0.pre.39 on channel master at
      /Users/dhs/documents/fluttersdk/flutter
    ! Warning: `flutter` on your path resolves to
      /Users/dhs/Documents/Fluttersdk/flutter/bin/flutter, which is not inside
      your current Flutter SDK checkout at
      /Users/dhs/documents/fluttersdk/flutter. Consider adding
      /Users/dhs/documents/fluttersdk/flutter/bin to the front of your path.
    ! Warning: `dart` on your path resolves to
      /Users/dhs/Documents/Fluttersdk/flutter/bin/dart, which is not inside your
      current Flutter SDK checkout at /Users/dhs/documents/fluttersdk/flutter.
      Consider adding /Users/dhs/documents/fluttersdk/flutter/bin to the front
      of your path.
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision e27dc0a3f5 (2 hours ago), 2023-10-08 22:51:26 -0400
    • Engine revision e58a9b3c54
    • Dart version 3.3.0 (build 3.3.0-1.0.dev)
    • DevTools version 2.28.1
    • If those were intentional, you can disregard the above warnings; however
      it is recommended to use "git" directly to perform update checks and
      upgrades.

[!] Android toolchain - develop for Android devices (Android SDK version 30.0.3)
    • Android SDK at /Users/dhs/Library/Android/sdk
    ✗ cmdline-tools component is missing
      Run `path/to/sdkmanager --install "cmdline-tools;latest"`
      See https://developer.android.com/studio/command-line for more details.
    ✗ Android license status unknown.
      Run `flutter doctor --android-licenses` to accept the SDK licenses.
      See https://flutter.dev/docs/get-started/install/macos#android-setup for
      more details.

[✓] Xcode - develop for iOS and macOS (Xcode 13.2.1)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Build 13C100
    • CocoaPods version 1.11.2

[✓] Chrome - develop for the web
    • Chrome at /Applications/Google Chrome.app/Contents/MacOS/Google Chrome

[✓] IntelliJ IDEA Ultimate Edition (version 2021.3.2)
    • IntelliJ at /Applications/IntelliJ IDEA.app
    • Flutter plugin version 65.1.4
    • Dart plugin version 213.7228

[✓] VS Code (version 1.62.0)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.29.0

[✓] Connected device (3 available)
    • Darshan's iphone (mobile) • 21150b119064aecc249dfcfe05e259197461ce23 • ios
      • iOS 15.3.1 19D52
    • macOS (desktop)           • macos                                    •
      darwin-x64     • macOS 12.2.1 21D62 darwin-x64
    • Chrome (web)              • chrome                                   •
      web-javascript • Google Chrome 109.0.5414.119

[✓] Network resources
    • All expected network resources are available.

! Doctor found issues in 1 category.

[!] Xcode - develop for iOS and macOS (Xcode 12.3)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    ! Flutter recommends a minimum Xcode version of 13.
      Download the latest version or update via the Mac App Store.
    • CocoaPods version 1.11.2

[✓] Chrome - develop for the web
    • Chrome at /Applications/Google Chrome.app/Contents/MacOS/Google Chrome

[✓] VS Code (version 1.62.0)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.21.0

[✓] Connected device (5 available)
    • SM G975F (mobile)       • RZ8M802WY0X • android-arm64   • Android 11 (API 30)
    • Darshan's iphone (mobile)  • 21150b119064aecc249dfcfe05e259197461ce23 •
      ios            • iOS 14.4.1 18D61
    • iPhone 12 Pro Max (mobile) • A5473606-0213-4FD8-BA16-553433949729     •
      ios            • com.apple.CoreSimulator.SimRuntime.iOS-14-3 (simulator)
    • macOS (desktop)            • macos                                    •
      darwin-x64     • Mac OS X 10.15.4 19E2269 darwin-x64
    • Chrome (web)               • chrome                                   •
      web-javascript • Google Chrome 98.0.4758.80

[✓] HTTP Host Availability
    • All required HTTP hosts are available

! Doctor found issues in 1 category.


Fixed hotplug mount locations.

Fixes #3909

@DavBfr Ok, found a memory corruption, best you run your changes with active address sanitizer before creating a new pull next time. (CMake option -DWITH_SANITIZE_ADDRESS=ON and -DWITH_SANITIZE_LEAK=ON for leaks)


Bumped development release number for 1.27

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

/approve

/lgtm

/unhold


useLoaderState returns undefined after router.invalidate() is called

Which project does this relate to?
Start
Describe the bug
Following the Getting Started guide this snippet is presented for copy-pasting:
function Home() {
  const router = useRouter()
  const state = Route.useLoaderData()

  return (
    <button
      type="button"
      onClick={() => {
        updateCount({ data: 1 }).then(() => {
          router.invalidate()
        })
      }}
    >
      Add 1 to {state}?
    </button>
  )
}

upon clicking the button, you are presented with "Add 1 to ?" in the UI. Refreshing the page presents the expected number.
Inspecting state shows that once the component rerenders, supposedly due to router.invalidate, it returns undefined.
Placing a console.log in the loader shows that its executed on page load and then never again, regardless of invalidation.
Your Example Website or App
None. The examples don't work, stackblitz won't let me fork the examples either.
Steps to Reproduce the Bug or Issue

follow the Getting Started guide to the end
fix the index.tsx not working because browsers remove trailing / for root routes making it unreachable since it's exact by changing it to something like home.tsx
click on Add 1 to ?
refresh the page
click on Add 1 to 1?
It becomes Add 1 to ?

Expected behavior
router.invalidate triggers another call to the route loader, and useRouteState does not return undefined
Screenshots or Videos

Platform

OS: macOS
Browser: Arc

dependencies:
@tanstack/react-router 1.82.2
@tanstack/router-devtools 1.82.2
@tanstack/start 1.82.6
react 18.3.1
react-dom 18.3.1
vinxi 0.4.3

devDependencies:
@tanstack/router-plugin 1.81.9
@types/react 18.3.12
@types/react-dom 18.3.1
@vitejs/plugin-react 4.3.3
vite 5.4.11

Additional context
I've encountered multiple bugs immediately out of the gate without even starting to write any code of my own.
I know it's beta, but that was a bit rough even for beta imho..

Just tried this out and I'm not seeing this bug.
Could you confirm that your route file is similar to this? https://github.com/TanStack/router/blob/main/examples/react/start-counter/app/routes/index.tsx
Or are you doing anything different here?
Also, it could be a long shot, but you could try upgrading the @tanstack/react-router and @tanstack/start packages.

It ended up being some weird interaction between many moving part, long-story short, what ended up solving it was removing an index.html file I had from before upgrading to Start.
Odd, huh?

is this reproducible?


Cannot read properties of undefined (reading 'validateOutgoingMediaTracks')

Hello, I found TypeError in the library: Cannot read properties of undefined (reading 'validateOutgoingMediaTracks')
Here are the steps to reproduce it:
My browser (Google Chrome) is closed, now I'm opening it for the first time - it's important!

Open https://sdk-cdn.mypurecloud.com/webrtc-sdk/demo/webpack/
Write access token in ‘Use custom access token’ and click Use manual auth token
Open Console
Click Start App
Find in Console error:

The error is repeated in both version 6 and 7.

Thanks @polyanka, I've opened a ticket and we'll clean that up.
The error shouldn't mess with anything within the SDK (although it is annoying). It looks like the window.navigator.mediaDevices.addEventListener('devicechange', /* ... */) fired before the SDK was fully authenticated and setup.

I am facing the same issue here. Do we have any updates on this one? It is really annoying warning to look at


App Config + Key Vault sample

Resolves #21800

nit:  The top-level directory for the sample, AppSecretsConfig uses a different capitalization scheme than you used for the other Key Vault stand-alone samples.   Not sure if that was intentional.

Does this sample belong to azure-sdk-for-net repo considering the library it uses is in https://github.com/Azure/AppConfiguration-DotnetProvider/tree/main/src ?

@jsquire asked:

The top-level directory for the sample, AppSecretsConfig uses a different capitalization scheme than you used for the other Key Vault stand-alone samples. Not sure if that was intentional.

Yes. Under ~/samples there was already a "CloudClipboard" sample and I figured with that and because we use PascalCase for other project (package) directories, I might as well. I'm not opposed to changing it, though, if you prefer. I also decided to put it here under ~/samples instead of ~/sdk/keyvault/samples because it makes use of both App Configuration and Key Vault.
@pakrym asked:

Does this sample belong to azure-sdk-for-net repo...

I believe so. I started an internal thread asking for opinions, and I know in the past @weshaggard has preferred this location as well. @jongio seemed to prefer this repo as well but also suggested Azure-Samples org, which tends to use a repo per sample. I figured in this repo, at least, we are all already members (I had to join Azure-Samples once a while back but didn't end up using it) and it gets compiled with our other samples so we can be sure it at least continues to be recompiled, not to mention works with our link checkers, etc.; though, I'm not sure the link checker runs on samples, but it probably should and if/when it does we'll be covered. @sima-zhu do you know if ~/samples are getting link-checked right now?

Merging to get the samples ingestion pipeline going so we can start referencing this ASAP. If @annelo-msft has further suggestions I am happy to start a new PR.

I'm not opposed to changing it, though, if you prefer.

I'm late to the party, but thought it worth a mention that I don't have a horse in the race.   It was just something that I noticed and wanted to raise awareness in case you hadn't intended it.


libuv won't generate

Trying to generate libuv, but with no luck
require 'ffi_gen'

FFIGen.generate(
  module_name: "LibUV",
  ffi_lib:     "libuv",
  headers:     %w[
                 uv.h
               ],
  cflags:      `llvm-config --cflags`.split(" "),
  prefixes:    [],
  output:      "libuv.rb"
)

with llvm-3.5.0_2 installed on Yosemite
here is backtrace
/Users/fazibear/.rubies/2.2.0/lib/ruby/gems/2.2.0/gems/ffi_gen-1.1.0/lib/ffi_gen.rb:328:in `block (2 levels) in read_named_declaration': undefined method `+' for nil:NilClass (NoMethodError)
	from /Users/fazibear/.rubies/2.2.0/lib/ruby/gems/2.2.0/gems/ffi_gen-1.1.0/lib/ffi_gen.rb:319:in `catch'
	from /Users/fazibear/.rubies/2.2.0/lib/ruby/gems/2.2.0/gems/ffi_gen-1.1.0/lib/ffi_gen.rb:319:in `block in read_named_declaration'
	from /Users/fazibear/.rubies/2.2.0/lib/ruby/gems/2.2.0/gems/ffi_gen-1.1.0/lib/ffi_gen.rb:311:in `each'
	from /Users/fazibear/.rubies/2.2.0/lib/ruby/gems/2.2.0/gems/ffi_gen-1.1.0/lib/ffi_gen.rb:311:in `read_named_declaration'
	from /Users/fazibear/.rubies/2.2.0/lib/ruby/gems/2.2.0/gems/ffi_gen-1.1.0/lib/ffi_gen.rb:295:in `block in declarations'
	from /Users/fazibear/.rubies/2.2.0/lib/ruby/gems/2.2.0/gems/ffi_gen-1.1.0/lib/ffi_gen.rb:282:in `each'
	from /Users/fazibear/.rubies/2.2.0/lib/ruby/gems/2.2.0/gems/ffi_gen-1.1.0/lib/ffi_gen.rb:282:in `declarations'
	from /Users/fazibear/.rubies/2.2.0/lib/ruby/gems/2.2.0/gems/ffi_gen-1.1.0/lib/ffi_gen/ruby_output.rb:10:in `block in generate_rb'
	from /Users/fazibear/.rubies/2.2.0/lib/ruby/gems/2.2.0/gems/ffi_gen-1.1.0/lib/ffi_gen.rb:146:in `indent'
	from /Users/fazibear/.rubies/2.2.0/lib/ruby/gems/2.2.0/gems/ffi_gen-1.1.0/lib/ffi_gen/ruby_output.rb:5:in `generate_rb'
	from /Users/fazibear/.rubies/2.2.0/lib/ruby/gems/2.2.0/gems/ffi_gen-1.1.0/lib/ffi_gen.rb:238:in `generate'
	from /Users/fazibear/.rubies/2.2.0/lib/ruby/gems/2.2.0/gems/ffi_gen-1.1.0/lib/ffi_gen.rb:479:in `generate'

Still can't get it to work.
here is a backtrace:
Warning: Could not process value of macro "UV_EXTERN"
Warning: Could not process value of macro "XX"
Warning: Could not process value of macro "XX"
Warning: Could not process value of macro "XX"
Warning: Could not process value of macro "UV_REQ_FIELDS"
Warning: Could not process value of macro "UV_HANDLE_FIELDS"
Warning: Could not process value of macro "UV_STREAM_FIELDS"
Warning: Could not process value of macro "XX"
/Users/fazibear/.rubies/2.2.0/lib/ruby/gems/2.2.0/gems/ffi_gen-1.2.0/lib/ffi_gen.rb:407:in `block in read_declaration': undefined method `+' for nil:NilClass (NoMethodError)
	from /Users/fazibear/.rubies/2.2.0/lib/ruby/gems/2.2.0/gems/ffi_gen-1.2.0/lib/ffi_gen.rb:372:in `each'
	from /Users/fazibear/.rubies/2.2.0/lib/ruby/gems/2.2.0/gems/ffi_gen-1.2.0/lib/ffi_gen.rb:372:in `read_declaration'
	from /Users/fazibear/.rubies/2.2.0/lib/ruby/gems/2.2.0/gems/ffi_gen-1.2.0/lib/ffi_gen.rb:346:in `block in declarations'
	from /Users/fazibear/.rubies/2.2.0/lib/ruby/gems/2.2.0/gems/ffi_gen-1.2.0/lib/ffi_gen.rb:338:in `each'
	from /Users/fazibear/.rubies/2.2.0/lib/ruby/gems/2.2.0/gems/ffi_gen-1.2.0/lib/ffi_gen.rb:338:in `each_with_index'
	from /Users/fazibear/.rubies/2.2.0/lib/ruby/gems/2.2.0/gems/ffi_gen-1.2.0/lib/ffi_gen.rb:338:in `declarations'
	from /Users/fazibear/.rubies/2.2.0/lib/ruby/gems/2.2.0/gems/ffi_gen-1.2.0/lib/ffi_gen/ruby_output.rb:10:in `block in generate_rb'
	from /Users/fazibear/.rubies/2.2.0/lib/ruby/gems/2.2.0/gems/ffi_gen-1.2.0/lib/ffi_gen.rb:150:in `indent'
	from /Users/fazibear/.rubies/2.2.0/lib/ruby/gems/2.2.0/gems/ffi_gen-1.2.0/lib/ffi_gen/ruby_output.rb:5:in `generate_rb'
	from /Users/fazibear/.rubies/2.2.0/lib/ruby/gems/2.2.0/gems/ffi_gen-1.2.0/lib/ffi_gen.rb:280:in `generate'
	from /Users/fazibear/.rubies/2.2.0/lib/ruby/gems/2.2.0/gems/ffi_gen-1.2.0/lib/ffi_gen.rb:745:in `generate'
	from libuv.rb:3:in `<main>'

Works for me with libuv from Debian testing... which version do you have?

Installed with brew: libuv-1.1.0 on Yosemite.

0.10 here. I don't have a newer version in the repository.


fix execute return type

@lilianammmatos @robrichard
This one is fairly uncontroversial, no?

@yaacovCR thanks for catching this. We changed how these types work based on feedback from the GraphQL WG so I don't think this is relevant any more.

Agree, looks like TS and flow types in sync. Thoughts on publishing these changes to graphql-experimental?
I know idea is to have separate tag within graphql package, but I am eager to get started...

@yaacovCR the latest changes are published to graphql-experimental

Amazing, thanks!


run the loader inside a running container

This resolves #213
Its not a perfect solution but it works and will allow us to do a new release.
A better solution is on #224 but it still needs some work

[Current coverage][cc-pull] is 84.80%

Merging [#225][cc-pull] into [master][cc-base-branch] will not change coverage

@@             master       #225   diff @@
==========================================
  Files            20         20
  Lines           967        967
  Methods           0          0
  Messages          0          0
  Branches          0          0
==========================================
  Hits            820        820
  Misses          147        147
  Partials          0          0

[][cc-pull]

Powered by Codecov. Last updated by 1b54a9c
[cc-base-branch]: https://codecov.io/gh/bigchaindb/bigchaindb/branch/master?src=pr
[cc-pull]: https://codecov.io/gh/bigchaindb/bigchaindb/pull/225?src=pr

:+1:
:100: / :100:


Build Microprofile Rest Client with Mutual TLS Authentication

Proposed title of the article
Build Microprofile Rest Client with Mutual TLS Authentication
Introduction paragraph (2-3 paragraphs)
In networking, layers are used to understand the complexity of networks.
Some network models such as the OSI and TCP/IP have been key in modern-day networks.
Security in systems is important considering that Security is not an afterthought of a system, rather an integral part.
In Microprofile, security is key. It is built side by side as the system is being developed to prevent unwanted integration errors.
One way of improving security is by adding TLS authentication to the application.
In this article, you will learn how to build a Microprofile Rest Client application with TLS authentication.
Key takeaways
At the end of this article, you will have gained the following knowledge:

What TLS authentication is
How and where it can be implemented
Setting up Mutual TLS authentication in a Microprofile application
Running the application

Pre-requisites
The basics of the article include the following:

Java language knowledge and use
A Java IDE setup in your machine.
A stable internet connection.

References
N/A
Templates to use as guides

How To Guide Template
Software Review Template
Tutorial Template

Good afternoon and thank you for submitting your topic suggestion. @franciskaguongo
Your topic form has been entered into our queue and should be reviewed (for approval) as soon as a content moderator is finished reviewing the ones in the queue before it.

@franciskaguongo
Just wanted to follow up on this topic, as we will be clearing up the queue where possible.
Just and FYI I will be closing this topic form just to help clear up the queue where possible - can be REOPENED at anytime when ready. 👍


Experimental API suggestion

Implementation for API spec described in #220. The new API provides better DX and improved bundle size.
Example API:
import { useQuery } from "@connectrpc/connect-react-query";
import { say } from "./gen/eliza-ElizaService_connectquery";

...

const { status, fetchStatus, error, data } = useQuery(say);

[ ] Figure out release structure (in parallel or whole replacement)
[x] Update documentation

Fixes #220

@tannerlinsley It'd be great to get your inputs on the new API. I think you also had feedback regarding what the hooks accept as input for the rpc requests.

@srikrsna-buf @timostamm Alright, i've updated the readme for a pass at documentation (update to doc page will obviously need to wait). I wanted to gauge a few ideas about release.

protoc-gen-connect-query: This plugin is now not even really connect-query related and is really just spitting out generic method descriptors. We can keep it like that for now, but if we create any other tools based on those descriptors, it probably makes sense to move this plugin elsewhere and rename it. We can obviously punt that decision till later but I wanted to raise it now.
connect-react-query: really just a rename and a v1 all at the same time. I thought it made sense to do the rename here as well as the v1 since both can be considered breaking so might as well make it a single breaking change.

@srikrsna-buf hmm, I see what you mean. So instead of having something link:
const [result1, result2] = useQueries({
  queries: [
    createUseQueryOptions(serviceMethod1, input1, options1),
    createUseQueryOptions(serviceMethod2, input2, options2)
  ]
});

We'd just document/encourage the following:
const [result1, result2] = useQueries({
  queries: [
    { queryKey: createConnectQueryKey(serviceMethod1, input1), queryFn: createConnectQueryFn(serviceMethod1, input1, options1) },
    { queryKey: createConnectQueryKey(serviceMethod2, input2), queryFn: createConnectQueryFn(serviceMethod2, input2, options2) },
  ]
});

I find that a little more error prone myself (due to potential mismatches between queryKey and queryFn) but it does admittedly reduce the API surface layer. We'd still need another function for infiniteQueries since the key generated for that is actually slightly different than our default key (since pageParam impacts the key).
Perhaps we can simplify the exported options a little bit though.The difference between suspense/non-suspense APIs are entirely within the options they take, to make it consistent with other APIs (like useQuery/useSuspenseQuery). Perhaps a function similar to our old API that just returns queryKey and queryFn would suffice, allowing the user to add other options as they desire (onError, onSuccess, etc) by just spreading the result. That would at least remove two APIs , createUseSuspenseInfiniteQueryOptions and createUseSuspenseQueryOptions.

@srikrsna-buf @timostamm updated docs and API to remove the dedicated createUseSuspense*Options APIs. I think this is as tiny an API I can get while still allowing for full access to typesafe react-query.

@timostamm i will definitely update the pr description to layout all the changes and why. Plus some migration examples.
As for #2, I was originally thinking that this plug-in was no longer react specific so it could be used for any version of connect-query but since that doesn't exist yet, perhaps that's optimizing for a later case that's not important. I would be down with renaming the plug-in.

I can't follow. The plugin name doesn't change, from what I can see.

@timostamm oh, i definitely misread, sorry. Yeah I can see why moving the rename to a different PR would make sense. I'll update.

@timostamm alright, removed package rename (which we'll discuss separately offline).


Remove the zoom-in effect

Hello
Thank you for this mod. Is it possible for you to remove the zoom-in effect when we open the HUD please ? This update would be amazing for the 1.12 version.
Ben

Thank you for your report
Mine Menu does not have any zoom-in effect. Must be some other mod perhaps using the same keybind to do some sort of zoom effect?

Sorry. I meant there is a kind of effect when you open the GUI, it's not like instant visible. I will make a gif to explain it better lol.

Oh, I thought you meant the Minecraft world zoomed in, when opening Mine Menu.
I'll take a look at it in a couple of days, currently don't have access to a computer I can easily code on.

No problem man. Here is a gif of my problem to understand better : https://giphy.com/gifs/ZZqDbUpEVfGqn4H7U3/html5 (sorry for the quality). I would like to not have this effect "zoom" when I open/close the menu.

Yea I understand you now.
I'll add a config option when I get time.

Sure. Thank you in advance :).

Also. Do you think that you can find a way to make the stone blocks (in the menu) customizable (allow to choose the blocks ID for each sections I mean) ? I have seen the option "removeStoneOnMenuButton" but it only removes the blocks i guess. I'm gonna check that now.


[SPARK-22640][PYSPARK][YARN]switch python exec on executor side

What changes were proposed in this pull request?
PYSPARK_PYTHON=~/anaconda3/envs/py3/bin/python \
bin/spark-submit --master yarn --deploy-mode client \
--archives ~/anaconda3/envs/py3.zip \
--conf spark.yarn.appMasterEnv.PYSPARK_PYTHON=py3.zip/py3/bin/python \
--conf spark.executorEnv.PYSPARK_PYTHON=py3.zip/py3/bin/python  \
/home/hadoop/data/apache-spark/spark-2.1.2-bin-hadoop2.7/examples/src/main/python/mllib/correlations_example.py

In the case above, I created a python environment, delivered it via --arichives, then visited it on Executor Node via spark.executorEnv.PYSPARK_PYTHON.
But Executor seemed to use PYSPARK_PYTHON=~/anaconda3/envs/py3/bin/python instead of spark.executorEnv.PYSPARK_PYTHON=py3.zip/py3/bin/python, then application end with ioe.
this pr aim to switch the python exec when user specifies it.
How was this patch tested?
manually verified with the case above.

Test build #84280 has started for PR 19840 at commit 8ff5663.

Test build #84280 has finished for PR 19840 at commit 8ff5663.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/84280/
Test FAILed.

cc @cloud-fan @ueshin

Should we set the pythonExec during the initialization of SparkContext at context.py#L191 instead of in PythonRunner? @jiangxb1987 @cloud-fan
Btw, just for confirmation, is spark.yarn.appMasterEnv.PYSPARK_PYTHON working? @yaooqinn

@ueshin cluster mode working, client not

i guess specifing PYSPARK_PYTHON=~/anaconda3/envs/py3/bin/python overwrites spark.executorEnv.PYSPARK_PYTHON by context.py#L156, where should use setIfMissing

I think in YARN we have several different ways to set PYSPARK_PYTHON, I guess your issue is that which one should take priority?
Can you please:

Define a consistent ordering for such envs, which one should take priority (spark.yarn.appMasterEnv.XXX or XXX), and document it.
Check if it works as expected for spark.yarn.appMasterEnv.PYSPARK_PYTHON and spark.executorEnv.PYSPARK_PYTHON.

I guess for other envs, it will also suffer from this problem, am I right?

@jerryshao ENVs are specified ok by yarn, but the pythonExec is generated in PythonRDD at driver side and delivered to executor side within a closure

Oh, I see. You're running in client mode. So this one --conf spark.yarn.appMasterEnv.PYSPARK_PYTHON=py3.zip/py3/bin/python is useless.
So I guess the behavior is expected. Because driver will honor PYSPARK_PYTHON env and ship it to executors. So the cluster will use same python executables.
With your above test, /path/to/python is different for driver and executors, will it bring in issues? Driver uses PYSPARK_PYTHON and executors uses spark.executorEnv.PYSPARK_PYTHON which points to different paths.
Normally I think we don't need to set PYSPARK_PYTHON in executor side.
Please correct me if I'm wrong.

Yes, you are right. we should use same python executables. But the same might mean binary same not just same path

I'm a little concerned about such changes, this may be misconfigured to introduce the discrepancy between driver python and executor python, at least we should honor this configuration "spark.executorEnv.PYSPARK_PYTHON" unless the executables of PYSPARK_PYTHON sent by driver is not existed. (Just my two cents)
ping @zjffdu , any thought?

Instead of setting PYSPARK_PYTHON=~/anaconda3/envs/py3/bin/python, what happens if you set PYSPARK_DRIVER_PYTHON=~/anaconda3/envs/py3/bin/python?

@vanzin PYSPARK_DRIVER_PYTHON won't work because context.py#L191 does't deal with it

use spark-2.2.0-bin-hadoop2.7 numpy examples/src/main/python/mllib/correlations_example.py
case 1

key
value

PYSPARK_DRIVER_PYTHON
~/anaconda3/envs/py3/bin/python

deploy-mode
client

--archives
~/anaconda3/envs/py3.zip

spark.yarn.appMasterEnv.PYSPARK_PYTHON
py3.zip/py3/bin/python

spark.executorEnv.PYSPARK_PYTHON
py3.zip/py3/bin/python

failure
Exception: Python in worker has different version 2.7 than that in driver 3.6, PySpark cannot run with different minor versions.Please check environment variables PYSPARK_PYTHON and PYSPARK_DRIVER_PYTHON are correctly set.

case 2

key
value

PYSPARK_DRIVER_PYTHON
~/anaconda3/envs/py3/bin/python

deploy-mode
cluster

--archives
~/anaconda3/envs/py3.zip

spark.yarn.appMasterEnv.PYSPARK_PYTHON
py3.zip/py3/bin/python

spark.executorEnv.PYSPARK_PYTHON
py3.zip/py3/bin/python

failure
java.io.IOException: Cannot run program "/home/hadoop/anaconda3/envs/py3/bin/python": error=2, No such file or directory at org.apache.spark.deploy.PythonRunner$.main(PythonRunner.scala:91)

case 3 & 4

key
value

PYSPARK_DRIVER_PYTHON
~/anaconda3/envs/py3/bin/python

deploy-mode
cluster(3) client (4)

--archives
~/anaconda3/envs/py3.zip

spark.yarn.appMasterEnv.PYSPARK_DRIVER_PYTHON
py3.zip/py3/bin/python

spark.executorEnv. PYSPARK_DRIVER_PYTHON
py3.zip/py3/bin/python

failure
Exception: Python in worker has different version 2.7 than that in driver 3.6, PySpark cannot run with different minor versions.Please check environment variables PYSPARK_PYTHON and PYSPARK_DRIVER_PYTHON are correctly set.

case 5 && 6

key
value

PYSPARK_PYTHON
~/anaconda3/envs/py3/bin/python

deploy-mode
cluster(6)

--archives
~/anaconda3/envs/py3.zip

spark.yarn.appMasterEnv.PYSPARK_DRIVER_PYTHON
py3.zip/py3/bin/python

spark.executorEnv. PYSPARK_DRIVER_PYTHON
py3.zip/py3/bin/python

failure
java.io.IOException: Cannot run program "/home/hadoop/anaconda3/envs/py3/bin/python": error=2, No such file or directory [executor side PythonRunner]

case 7

key
value

PYSPARK_PYTHON
~/anaconda3/envs/py3/bin/python

deploy-mode
cluster

--archives
~/anaconda3/envs/py3.zip

spark.yarn.appMasterEnv.PYSPARK_PYTHON
py3.zip/py3/bin/python

spark.executorEnv. PYSPARK_DRIVER_PYTHON
py3.zip/py3/bin/python

**success **
--

case 8

key
value

PYSPARK_PYTHON
~/anaconda3/envs/py3/bin/python

deploy-mode
cluster

--archives
~/anaconda3/envs/py3.zip

spark.yarn.appMasterEnv.PYSPARK_PYTHON
py3.zip/py3/bin/python

spark.executorEnv. PYSPARK_DRIVER_PYTHON
py3.zip/py3/bin/python

failure
java.io.IOException: Cannot run program "/home/hadoop/anaconda3/envs/py3/bin/python": error=2, No such file or directory [executor side PythonRunner]

case 9

key
value

not settingPYSPARK_[DRIVER]_PYTHON

deploy-mode
client

--archives
~/anaconda3/envs/py3.zip

spark.yarn.appMasterEnv.PYSPARK_PYTHON
py3.zip/py3/bin/python

spark.executorEnv. PYSPARK_DRIVER_PYTHON
py3.zip/py3/bin/python

failure
ImportError: No module named numpy

case 10

key
value

not settingPYSPARK_[DRIVER]_PYTHON

deploy-mode
cluster

--archives
~/anaconda3/envs/py3.zip

spark.yarn.appMasterEnv.PYSPARK_PYTHON
py3.zip/py3/bin/python

spark.executorEnv. PYSPARK_DRIVER_PYTHON
py3.zip/py3/bin/python

success
--

my humble opinions

spark.executorEnv. PYSPARK_* takes no affect on executor side pythonExec, which is determined by driver.
if PYSPARK_PYTHON is specified then spark.yarn.appMasterEnv. should be suffixed  by PYSPARK_PYTHON not PYSPARK_DRIVER_PYTHON
specifying PYSPARK_DRIVER_PYTHON fails all the cases, it may be caused by  https://github.com/yaooqinn/spark/blob/8ff5663fe9a32eae79c8ee6bc310409170a8da64/python/pyspark/context.py#L191 only deal with PYSPARK_PYTHON

@yaooqinn What's the difference between case 7 and 8? Looks like the same configuration but the different result?

@ueshin case 8 should be client deploy mode, excuse me for copy mistake, fixed

@yaooqinn OK, I see the situation.
In client mode, I think we can't use spark.yarn.appMasterEnv.XXX which is for cluster mode. So we should use environment variable PYSPARK_PYTHON or PYSPARK_DRIVER_PYTHON, or corresponding spark conf, spark.pyspark.python, spark.pyspark.driver.python.
In cluster mode, we can use spark.yarn.appMasterEnv.XXX and if there exist spark.yarn.appMasterEnv.PYSPARK_PYTHON or spark.yarn.appMasterEnv.PYSPARK_DRIVER_PYTHON, they overwrite original environment variables.
Btw, PYSPARK_DRIVER_PYTHON is for only Driver, not Executors, so we should handle only PYSPARK_PYTHON in executor and the priority of PYSPARK_DRIVER_PYTHON is higher than PYSPARK_PYTHON in Driver.
Currently we handle only environment varibale but not spark.executorEnv.PYSPARK_PYTHON for executor so we should handle it at api/python/PythonRunner as you do now or context.py#L191.

I can spark.executorEnv.PYSPARK_PYTHON in sparkConf at executor side ,  because it is set at context.py#L156 by conf.py#L153

@yaooqinn I meant it is not used for pythonExec.

@ueshin i see.

@ueshin context.py#L191 set for both driver and executor?

@yaooqinn It is used for executors.

I'm trying to understand what is https://github.com/apache/spark/blob/master/python/pyspark/context.py#L191 really achieving. It seems pretty broken to me and feels like the whole pythonExec tracking in the various places should be removed.
It causes this problem because it forces the executor to use the driver's python even if it's been set to a different path by the user.
It uses python instead of sys.executable as the default value.
And it ignores the spark.pyspark.python config value if it's set.
Instead, shouldn't the logic at https://github.com/apache/spark/blob/master/launcher/src/main/java/org/apache/spark/launcher/SparkSubmitCommandBuilder.java#L304 be used in PythonRunner (except for the driver python config) to find out the executor's python to use?

@vanzin
according to @ueshin 's explanation, PYSPARK_DRIVER_PYTHON is only for driver, if executor follows the order of SparkSubmitCommandBuilder.java#L304, we may not need so many configs, right?

That's what I said in my comment ("except for the driver python config").

So, any updates here?

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1718/
Test PASSed.

@yaooqinn do you plan to update this PR?

@vanzin I am not very familiar with python part context.py#L191, so handle it at api/python/PythonRunner as I did in this pr.
Maybe someone else could help, sorry for the delay.

Build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/4285/
Test PASSed.

Build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/4316/
Test PASSed.

Build finished. Test FAILed.

I didn't read the entire thread here but what you want is this:
--archives hdfs:///python36/python36.tgz#python36 --conf spark.pyspark.python=./python36/bin/python3.6 --conf spark.executorEnv.LD_LIBRARY_PATH=./python36/lib --driver-library-path /opt/python36/lib --conf spark.pyspark.driver.python=/opt/python36/bin/python3.6

@yaooqinn we should probably close this if you're not planning to look at the root of the problem, which seems to be on the python side.


[Feature Request] When the data volume is migrated to other nodes, maintain the original permissions

When the data volume is migrated to other nodes, maintain the original permissions
Request comes from: https://github.com/hwameistor/hwameistor/issues/828

The permissions on dir & files should keep same under expectation.

Permissions can be restored by APPs initContainers.

+1

disagree to close ...

This issue should be resolved by the latest version.


Error about linking avr-gcc

I have set up an environment and cloned the template, but when I do cargo run in the project directory, I get an error about cargo not being able to link avr-gcc.
Full error message
   Compiling first-arduino v0.1.0 (/var/home/gregorni/first-arduino)
error: linking with `avr-gcc` failed: exit status: 1
  |
  = note: LC_ALL="C" PATH="/var/home/gregorni/.rustup/toolchains/nightly-2024-03-22-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/bin:/var/home/gregorni/.opam/default/bin:/home/gregorni/.cargo/bin:/home/linuxbrew/.linuxbrew/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/home/gregorni/.local/bin" VSLANG="1033" "avr-gcc" "-mmcu=atmega328p" "/tmp/rustc5oWMeJ/symbols.o" "/var/home/gregorni/first-arduino/target/avr-atmega328p/debug/deps/first_arduino-65cdf4b7abba7cfb.arduino_hal-99453e04fd1e9bc0.arduino_hal.77352119ba531a0d-cgu.0.rcgu.o.rcgu.o" "-Wl,--as-needed" "-L" "/var/home/gregorni/first-arduino/target/avr-atmega328p/debug/deps" "-L" "/var/home/gregorni/first-arduino/target/debug/deps" "-L" "/var/home/gregorni/.rustup/toolchains/nightly-2024-03-22-x86_64-unknown-linux-gnu/lib/rustlib/avr-atmega328p/lib" "-Wl,-Bstatic" "/var/home/gregorni/first-arduino/target/avr-atmega328p/debug/deps/libcompiler_builtins-03a532b5526f00bb.rlib" "-Wl,-Bdynamic" "-lgcc" "-Wl,-z,noexecstack" "-L" "/var/home/gregorni/.rustup/toolchains/nightly-2024-03-22-x86_64-unknown-linux-gnu/lib/rustlib/avr-atmega328p/lib" "-o" "/var/home/gregorni/first-arduino/target/avr-atmega328p/debug/deps/first_arduino-65cdf4b7abba7cfb.elf" "-Wl,--gc-sections" "-no-pie"
  = note: /usr/lib/gcc/avr/13.1.0/../../../../avr/bin/ld: cannot find crtatmega328p.o: No such file or directory
          /usr/lib/gcc/avr/13.1.0/../../../../avr/bin/ld: cannot find -lm: No such file or directory
          /usr/lib/gcc/avr/13.1.0/../../../../avr/bin/ld: cannot find -lc: No such file or directory
          /usr/lib/gcc/avr/13.1.0/../../../../avr/bin/ld: cannot find -latmega328p: No such file or directory
          collect2: error: ld returned 1 exit status

error: could not compile `first-arduino` (bin "first-arduino") due to 1 previous error

I'm wondering if it may have to do with the fact that I installed avrdude with Homebrew, and avr-gcc with dnf.
I'm running Universal Blue (which is based on Linux Fedora Silverblue) version 39, but I'm building the project in a toolbx container for normal Fedora. I'm trying to build for an Arduino UNO.

Maybe you are missing the avr-libc?  I am seeing
-lc: No such file or directory

in your error log.  This indicated that the attempt to link libc failed.

Indeed, I was missing that. Installed it, and everything works now. Thanks! :heart:


Implement LORA\QLORA for all hardware

implement support for CPUs and other GPUs

I want to try running this based on SIMD feature on x86 CPU first. Wondering if I should do so.

You can definitely give it a shot! Have you looked into this? https://pypi.org/project/loralib/

Hey @VictorOdede, is this issue still open?

@Abdevna Yes it is!

Hi @VictorOdede, is this still open?


Link the get involved desktop dev to the getting started guide

http://elementaryos.org/docs/code

Want to back this issue? Place a bounty on it! We accept bounties via Bountysource.

Hm that guide is more focused on 3rd party developers though. There's reference material about reporting bugs, but it's not really a guide for hacking on other people's stuff as much as a guide on building your own stuff.

This guide is crucial for any developer to get started with the elementary stack (launchpad, cmake, granite, etc.)
Even someone that intends to fix an issue on an existing app needs to register to launchpad, get the source and dependencies (apt-get buil-dep etc).
Besides no one can know what will be the nature of the contribution.
It can be new plugins.
The recent example of the calculator is a good indicator of that.
The existing doc does a good job of introducing how to contribute to elementary.
It misses how to debug the application and more crucially how to get support from the elementary team.
Between launchpad, reddit, g+ and that ever elusive slack, a new contributor should know how to ask questions and contact the team.
(And I won't even mention IRC as it is a waste a time)
The last thing is to link to a well written descriptive list of suggestions for a newcomer.
Like the one that you provided embik when he wanted to get onboard.
That list should be advertised and kept up to date every two months.
Blueprints and wishlist bugs are not helpful enough.

Also see #283 for a discussion about getting started for developers

Okay a single bug report isn't the place to enumerate every request you have. Please file separate reports for each individual issue. All this documentation isn't going to be written all at once and probably not by the same person.
I'd argue that the "Get Involved" page assumes you already know how to code for elementary OS. It's not designed to be a tutorial. That job is done by the "Developer" page (which hasn't landed here yet).
I'm going to close this report due to the above. Again feel free to open separate reports for each new section of documentation you'd like to see.


Expand CODEOWNERS to include Robert, Kistine

This should make it easier to keep up with PRs

I'm open to this too, but I was thinking in the other thread of just adding them for _datasets*

Anyone with a GitHub account can make PRs :)

@BryanQuigley thanks for the catch! that makes sense

thanks!


Add submission recency categories for older than 1 month

Right now, almost everything shows up as "Older" which isn't particularly useful.
I'm sometimes interested whether sequences were uploaded 4 months ago or 4 years ago. The new categories fill that gap.
Testing
Looks good in CI test build

Nice. Probably consider a two-weeks category, something between the one-week and one-month category. 15 days is the lower quantile of the median turn-around time for most countries (Median TAT : 31, IQR[15.75, 56.50]). The incubation period is somewhere around there as well (7-14 days)

@BryanTegomoh were you thinking of collection -> submission delay? :)


[FLINK-8992] [e2e-tests] General purpose DataStream e2e test

What is the purpose of the change
This PR adds a general purpose Flink DataStream end-to-end test job, whose purpose is to cover main DataStream APIs and primitives and can be commonly used across several different end-to-end tests.
The initial version currently covers the following characteristics -

A generic Kryo input type.
A state type for which we register a KryoSerializer.
Operators with ValueState.
Allows verifying exactly-once / at-least-once
Allows configuring to use different state backends

For a full list of what we plan to add over time, please see description in the umbrella JIRA FLINK-8971.
Brief change log

a936aaa initial version of the general purpose job by @StefanRRichter
c7127a9 integrate job with end-to-end tests' current Maven project structure
fa82e2c Fix exactly-once bug in source, and allow enabling checkpointing
3182f0c Adapt savepoint e2e test to use the general purpose job.

Verifying this change
The savepoint e2e test serves as a good, generic e2e test script for the general purpose job.
It runs the job, takes a savepoint, and resumes again (potentially with a different parallelism).
Metrics monitoring is done in the test script to ensure that the job has made progress.
The job itself verifies exactly-once semantics; if there are no guarantee violations, there will be no output from the job. Whether or not there are outputs from the job is checked in the end by the test script (by checkpoint the .out files).
Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): (yes / no)
The public API, i.e., is any changed class annotated with @Public(Evolving): (yes / no)
The serializers: (yes / no / don't know)
The runtime per-record code paths (performance sensitive): (yes / no / don't know)
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Yarn/Mesos, ZooKeeper: (yes / no / don't know)
The S3 file system connector: (yes / no / don't know)

Documentation

Does this pull request introduce a new feature? (yes / no)
If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)

LGTM 👍 Will merge this.


Cycle 3 Funding: Homeier | General Maintainer

This issue is for tracking the cycle 3 project "Core Package Maintainer support for Derek Homeier". FR is in https://github.com/astropy/astropy-project/pull/278, and details of the proposal are at https://github.com/astropy/astropy-project/blob/main/finance/proposal-calls/cycle3/Homeier-Maintainer.md . Budget is $42,240, funded from the Moore grant (please submit invoices here)

@dhomeier - clarification question: when you put in this proposal, were you expecting to also spend down the remaining funds you got in previous cycles, or should we free that up and treat this as essentially a revised budget from now on? (either way is fine, just need to know which you intended)

@eteq, I have invoiced NumFOCUS, and received from them, the total amount of funding approved in #194 in two installments in June and December 2021, so to my accounting there should be nothing left from previous cycles.

@eteq and Finance Committee, in response to the call for extended funding from 9 May I am updating my request by additional work to be done on specutils, primarily file I/O:

As a follow up to astropy/specutils#1009 support more file formats outside of STScI applications, like examples presented by @kelle from https://github.com/dr-rodriguez/AstrodbKit2/blob/main/astrodbkit2/spectra.py#L92
Ensure read/write roundtripping for a range of standard formats in FITS, and add a generic loader (read + write) for HDF5
Support non-boolean masks as in astropy/specutils#685 (I may also be able to work on this under Aperio's STScI contract).

Depending on which/how many of these tasks are addressed I am expecting to invest 1-3 full-time weeks, i.e. 40-120 hours  @ 120 $ / hr.

Hi @dhomeier — the Finance Committee has approved your request for an extension. We approved additional expenditure of up to 120 hours at $120 (US) per hour, for a total of $14,400 (US). Please submit invoices to the Moore grant as described above. We encourage you to invoice for all this work, including the extension, by the end of December if possible, and certainly not later than 31 March 2024.

Thank you for the approval! It would be helpful if I could invoice at least some part in very early 2024, but if that overly complicates things with the grant, I'd certainly try to get it done by December.

“Very early 2024” is probably before 31 March, so that should be fine. :-)


Scale related updates to prod manifests files

run this locally: make clean ; make -j yaml-lint k8s-lint


HttpError handling

I have a situation where I need to discriminate between a HttpError raised by Koa (or any middleware) as opposed to any other type of error raised by the application - the latter should never occur if everything is correct, however the former is expected.
At the moment, I have a block of code like so:
import createError from "http-errors"
export async function errorHandler(ctx, next) {
  try {
    await next()
  } catch (err) {
    if (err instanceof createError.HttpError)
      // this type of error is expected, should produce minimal logging
    else
      // create an alert for this type of error, since it should never occur in normal operation
  }
}

This works, but I don't think it's ideal. The issue is that my project does not depend on the http-errors library directly; only in so far as these errors are raised by Koa when I call the throw or assert functions in a handler. I would prefer if I could handle this case by interacting with some aspect of Koa - if Koa delegates that to http-errors or some other library, I think that should be an implementation detail for Koa rather than meaning I need to introduce a library for this into my code.
So, this leaves me with two questions:

Is this the appropriate way to handle this situation, or is there some other mechanism I should be using?
If this is the correct way to handle this case, can Koa export the errors in use from other libraries?

+1

I think you raised a fair point (pun intended).
It makes sense be able to destruct it from library, e.g. const { HttpError } = require('koa').

i'm not sure why you even bother to do this. i would check the error's status code and only log if it's 5xx or unknown. the type of error object shouldn't be relevant

ex.
const status = ctx.status = err.status || 500
if (status >= 500) console.error(err.stack)
ctx.message = status > 500 ? 'some generic error message' : err.message

@jonathanong Because I have several different types of errors being created in different places, each contain a status code.
I can potentially identify that an error is not type A or B (where these are non-koa errors) by looking for discriminating properties, but this seems like a poor solution when I don't care about discriminating between those types of error. I specifically care about the errors raised by koa and need to treat them separately.

@jonathanong Hi, I test in the middleware, the code ctx.status = err.status || 500 will not work, the ctx.status is readable. The bottom code, if the err has no property status, the ctx.status will always 404, even if you set the status as ctx.status = 'http code'
koa version: 2.5.1
  .use(async (ctx, next) => {
    try {
      await next()
    } catch (err) {
      ctx.status = err.status || 500
      ctx.body = err.message
      ctx.app.emit('error', err, ctx)
    }
  })
  .use(router.routes())
  .use(router.allowedMethods())

Any update or solution for this item??

@RukaiYu there's a solution for this at #1159 but waiting to be merged. Given how long it has been sitting there, I wonder if that may not happen.
In the meantime, you can import HttpErrors as a transitive dependency without explicitly declaring it in your package.json. However that doesn't stop any minor changes to koa breaking your code and your IDE may well complain about the import of a package that you haven't declared a direct dependency on.

I have the same problem. I need to know which error is an HTTP error and which error is another error.

Any updates on this?̊̈ I have the exact same problem here :-(

This is resolved per #1159. I think we can close this bug.

Landed https://github.com/koajs/koa/commit/2d1c5981869e0fe6f5bc71b5c5582accfd125cc6 released with Koa 2.9

This is an issue now:
https://github.com/jshttp/http-errors/commit/e11f87db72bec8b3c457cf0e3df9e0cbb09c7e62


Unraid: Server isn't starting after downloading (FIX PROPOSED)

Any ideas what is going on? It should just deploy the container, download the files and make the necessary folders and logs etc. However it's not starting and not making any logs etc either. So I cannot even see what is going on.
Both the DIRs are just empty.
steamcmd.sh[8]: Restarting steamcmd by request...
tid(13) burning pthread_key_t == 0 so we never use it
Redirecting stderr to '/home/steam/Steam/logs/stderr.txt'
Logging directory: '/home/steam/Steam/logs'
minidumps folder is set to /tmp/dumps
[  0%] Checking for available updates...
[----] Verifying installation...
[  0%] Downloading update...
[  0%] Checking for available updates...
[----] Download complete.
[----] Extracting package...
[----] Extracting package...
[----] Extracting package...
[----] Extracting package...
[----] Installing update...
[----] Installing update...
[----] Installing update...
[----] Installing update...
[----] Installing update...
[----] Installing update...
[----] Installing update...
[----] Installing update...
[----] Cleaning up...
[----] Update complete, launching Steamcmd...
UpdateUI: skip show logotid(26) burning pthread_key_t == 0 so we never use it
Redirecting stderr to '/home/steam/Steam/logs/stderr.txt'
Logging directory: '/home/steam/Steam/logs'
minidumps folder is set to /tmp/dumps
[  0%] Checking for available updates...
[----] Verifying installation...
UpdateUI: skip show logoSteam Console Client (c) Valve Corporation - version<PHONE_NUMBER>
-- type 'quit' to exit --
Loading Steam API...OK

Connecting anonymously to Steam Public...OK
Waiting for client config...OK
Waiting for user info...OK
 Update state (0x3) reconfiguring, progress: 0.00 (0 / 0)
 Update state (0x61) downloading, progress: 0.00 (0 / 73781292)
 Update state (0x61) downloading, progress: 92.89 (68538412 / 73781292)
Success! App '1007' fully installed.
 Update state (0x3) reconfiguring, progress: 0.00 (0 / 0)
 Update state (0x61) downloading, progress: 10.84 (50712620 / 467785005)
 Update state (0x61) downloading, progress: 15.77 (73781292 / 467785005)
 Update state (0x61) downloading, progress: 69.11 (323268613 / 467785005)
 Update state (0x61) downloading, progress: 97.58 (456468989 / 467785005)
Success! App '1963720' fully installed.
tid(108) burning pthread_key_t == 0 so we never use it
Redirecting stderr to '/home/steam/Steam/logs/stderr.txt'
Logging directory: '/home/steam/Steam/logs'
minidumps folder is set to /tmp/dumps
[  0%] Checking for available updates...
[----] Verifying installation...
UpdateUI: skip show logoSteam Console Client (c) Valve Corporation - version<PHONE_NUMBER>
-- type 'quit' to exit --
Loading Steam API...OK

Connecting anonymously to Steam Public...OK
Waiting for client config...OK
Waiting for user info...OK
Success! App '1007' already up to date.
Success! App '1963720' already up to date.
xvinfo:  Unable to open display :99
Failed to start Xvfb, retry: 1
_XSERVTransmkdir: Owner of /tmp/.X11-unix should be set to root
X-Video Extension version 2.2
screen #0
 no adaptors present
chmod: cannot access './CoreKeeperServer': No such file or directory
-batchmode -logfile CoreKeeperServerLog.txt -world 0 -worldname Babs World -worldseed 0 -worldmode 0 -gameid 1q2w3e4r5t6y7u8i9o0pzxc -maxplayers 10 -season -1
Started server process with pid 137
./launch.sh: line 72: ./CoreKeeperServer: No such file or directory

I have the exact same issue.
Can you help me to get this running either way? I have no idea on how to apply your fix locally for me, or how to use the SteamCMD Docker you linked to for this.

Tried to fix this myself and propose a pull request but you've blocked contributions:
 /mnt/c/U/d/Doc/r/8/h/core-keeper-dedicated  on fix-issue-42 !1  git push --set-upstream origin fix-issue-42                                                            128 ✘  at 20:26:16
ERROR: Permission to escapingnetwork/core-keeper-dedicated.git denied to 825i.
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.

I'm pretty sure all you need to do is just add this to line 4 of entry.sh
# Fix ownership issue on Unraid
echo "---Taking ownership of data...---"
chown -R root:${GID} /opt/scripts
chmod -R 750 /opt/scripts
chown -R ${UID}:${GID} ${STEAMAPPDIR}

Hey @825i thanks for the proposed fix. Would you be so kind to make a PR with the suggested changes?

I'm getting the same error still after adding the proposed fix by @825i to the entry.sh
ubuntu@corekeeper:~/core-keeper-dedicated$ sudo docker compose up
[+] Running 2/2
 ✔ Network core-keeper-dedicated_default          Created                                                                                0.1s
 ✔ Container core-keeper-dedicated-core-keeper-1  Created                                                                                0.0s
Attaching to core-keeper-dedicated-core-keeper-1
core-keeper-dedicated-core-keeper-1  | /home/steam/steamcmd/steamcmd.sh: line 76:    25 Segmentation fault      (core dumped) $DEBUGGER "$STEAMEXE" "$@"
core-keeper-dedicated-core-keeper-1  | /home/steam/steamcmd/steamcmd.sh: line 76:    44 Segmentation fault      (core dumped) $DEBUGGER "$STEAMEXE" "$@"
core-keeper-dedicated-core-keeper-1  | /usr/bin/xvinfo:  Unable to open display :99
core-keeper-dedicated-core-keeper-1  | _XSERVTrans
core-keeper-dedicated-core-keeper-1  | mkdir: Owner of /tmp/.X11-unix should be set to root
core-keeper-dedicated-core-keeper-1  | Failed to start Xvfb, retry: 1
core-keeper-dedicated-core-keeper-1  | X-Video Extension version 2.2
core-keeper-dedicated-core-keeper-1  | screen #0
core-keeper-dedicated-core-keeper-1  |  no adaptors present
core-keeper-dedicated-core-keeper-1  | /usr/bin/chmod:
core-keeper-dedicated-core-keeper-1  | cannot access './CoreKeeperServer'
core-keeper-dedicated-core-keeper-1  | : No such file or directory
core-keeper-dedicated-core-keeper-1  |
core-keeper-dedicated-core-keeper-1  |
core-keeper-dedicated-core-keeper-1  | -batchmode -logfile CoreKeeperServerLog.txt -world 0 -worldname Core Keeper Server -worldseed 0 -worldmode 0 -datapath /home/steam/core-keeper-data -maxplayers 10 -season 0
core-keeper-dedicated-core-keeper-1  | Started server process with pid 83
core-keeper-dedicated-core-keeper-1  | ./launch.sh: line 72: ./CoreKeeperServer: No such file or directory

Here's my entry.sh for reference:
#!/bin/bash
mkdir -p "${STEAMAPPDIR}" || true

# Fix ownership issue on Unraid
echo "---Taking ownership of data...---"
chown -R root:${GID} /opt/scripts
chmod -R 750 /opt/scripts
chown -R ${UID}:${GID} ${STEAMAPPDIR}

# Override SteamCMD launch arguments if necessary
# Used for subscribing to betas or for testing
if [ -z "$STEAMCMD_UPDATE_ARGS" ]; then
        bash "${STEAMCMDDIR}/steamcmd.sh" +force_install_dir "$STEAMAPPDIR" +login anonymous +app_update "$STEAMAPPID" +app_update "$STEAMAPPID_TOOL" +quit
else
        steamcmd_update_args=($STEAMCMD_UPDATE_ARGS)
        bash "${STEAMCMDDIR}/steamcmd.sh" +force_install_dir "$STEAMAPPDIR" +login anonymous +app_update "$STEAMAPPID" +app_update "$STEAMAPPID_TOOL" "${steamcmd_update_args[@]}" +quit
fi

bash "${STEAMCMDDIR}/steamcmd.sh" +force_install_dir "$STEAMAPPDIR" +login anonymous +app_update "$STEAMAPPID" +app_update "$STEAMAPPID_TOOL" +quit

bash "./launch.sh"

Any ideas?

The error chmod: cannot access './CoreKeeperServer': No such file or directory may occurs if the docker system is not allowed to write on the hosts files system.
e.g. my docker-compose includes the following lines:
    volumes:
      - /srv/core-keeper/files:/home/steam/core-keeper-dedicated
      - /srv/core-keeper/data:/home/steam/core-keeper-data

This means, that the path /home/steam/core-keeper-dedicated is mapped to my hosts path /srv/core-keeper/files. As the Linux file authorisation is based on user and group you have to set the authorisation of the folder for the service user.
chown docker:docker /srv/core-keeper/ -R
chmod g+rwx /srv/core-keeper/ -R

See also Manage Docker as a non-root user
Or the easy (only recommended for test sytems) way: chmod 777 /srv/core-keeper/ -R

Ran into this today, looked inside the container and it seems the /home/steam/core-keeper-data directory is owned by root, so when the game tries to write there it segfaults.


Use exceptions for quitting from the emulation loop

Using the done kind of flags is complicated because with several run() calls in place, e.g., a tape_load() followed by a regular run(), the caller side would need to take explicit measures to make sure the the runs in the middle did not terminate due to user actions, such as pressing ESC or F10. These extra checks are easy to forget and misimplement whereas with exceptions it looks like it would be pretty straightforward and natural.
Once done, the stop() function should merely raise that exception.

Done in:
2c41499 [#10] Let exceptions to pass through emulator-run functions.
34f44cc [#10] Raise exception on stopping emulation.
72119d6 [#10] Introduce emulator-specific exceptions.


Add env[PATH] = /usr/local/bin:/usr/bin:/bin to php-fpm.conf

But still getting the following error
FailedToExecuteCommand `'gs' -sstdout=%stderr -dQUIET -dSAFER -dBATCH -dNOPAUSE -dNOPROMPT -dMaxBitmap=500000000 - ......

Any ideas on this please and I am using PHP7.1 with Laravel Valet.

After a reboot of my mac I get Imagick::__construct(): stream does not support seeking now

It appears that it doesn't like reading from S3, so saved it locally and all works. But I do want this to come S3 if possible, any suggestions?

Don't have experience or a need to make this work with S3, so can't help you with this.
If there's something the package can do to enable this, send a PR with tests.


Improvements

R = @kesla
T = patch
-Handle missing date in the tweet parser
-Support embedly vine embeds

This is great! :+1:


Feature/svcs 2143 the schema verification is too strict in validating condition properties

Not what I was expecting but seems good to me 👌 Not much to add to Aäron his comments

What were you expecting? 🤔


Fixing compiler warnings

The unused option rcond inxlinalg.hpp:lstsq worries me a bit. Maybe it should be passed somewhere?

thanks for this!

Thanks!

👍


Show the original message flashes

[ ] The message displayed to the user is different depending on if it is an error or simply a message.
[ ] Texts must be a one to one compare

See examples from original MiniTwit:

Easy

Seems to me to be solved after testing, closing issue.


Support new semi-sync variables in MySQL 8.0.26

MySQL 8.0.26 introduced two new plugins for semi-sync replication. From the changelog:

For semisynchronous replication, you can choose whether to use the new or the old versions of the system variables and status variables. New versions of the plugins that implement semisynchronous replication, one for the source server and one for the replica, are supplied that replace the terms master and slave with source and replica, and you can install these versions instead of the old ones:
The rpl_semi_sync_master plugin (semisync_master.so library) for the source has a new version rpl_semi_sync_source (semisync_source.so library)
The rpl_semi_sync_slave plugin (semisync_slave.so library) for the replica has a new version rpl_semi_sync_replica (semisync_replica.so library)
You cannot have both the new and the old version of the relevant plugin installed on an instance. If you use the new version of the plugins, the new system variables and status variables are available but the old ones are not. If you use the old version of the plugins, the old system variables and status variables are available but the new ones are not.
If the new rpl_semi_sync_source and rpl_semi_sync_replica plugins are used for ? semisynchronous replication:
rpl_semi_sync_slave_enabled is replaced by rpl_semi_sync_replica_enabled
rpl_semi_sync_slave_trace_level is replaced by rpl_semi_sync_replica_trace_level
rpl_semi_sync_master_wait_for_slave_count is replaced by rpl_semi_sync_source_wait_for_replica_count
rpl_semi_sync_master_enabled is replaced by rpl_semi_sync_source_enabled
rpl_semi_sync_master_timeout is replaced by rpl_semi_sync_source_timeout
rpl_semi_sync_master_trace_level is replaced by rpl_semi_sync_source_trace_level
rpl_semi_sync_master_wait_point is replaced by rpl_semi_sync_source_wait_point

Orchestrator still uses the old variable names even if the new plugins used and fails to enable/disable semi-sync replication. I created a PR in my fork but currently it just checks the MySQL version and patch number to determine which variable name to use.
I don't think it's enough though. Since admins can upgrade the MySQL version but continue to use old plugins (for whatever reason). Also, there are more changes needed across the codebase to use new variables names (for example https://github.com/openark/orchestrator/blob/master/go/inst/instance_dao.go#L466-L478)

up


⚠ GitLab Server has degraded performance

In bc1c166, GitLab Server (https://gitlab01.its-telekom.eu) experienced degraded performance:

HTTP code: 200
Response time: 11537 ms

Resolved: GitLab Server performance has improved in 85d9a73.


pod try doesn't work

the build fails, please check and then resubmit to cocoa controls

@aaronbrethorst checked - the problem is that currnetly github is under a DDOS attack which leads to pods being unable to download anything via https protocol. I'll update trunk and resubmit to cocoapods as soon as DDOS will end.

I don't think that's it.
lang: error: no such file or directory: '/tmp/CocoaPods/Try/Ophiuchus/Example/Pods/Target Support Files/Pods-Ophiuchus-Ophiuchus/Pods-Ophiuchus-Ophiuchus-prefix.pch'

clang: error: no input files
Command /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/clang failed with exit code 1

@aaronbrethorst On it

@aaronbrethorst fixed.

awesome, thanks :+1:


MRG: Fix anonymization

Ready for review/merge from my end.

Coverage decreased (-0.09%) to 90.689% when pulling 93cc2d7ed4f9b4827565460baa01b0d199b919b7 on Eric89GXL:anon into fdfe959904df04ad080170b459063890eb02ef1a on mne-tools:master.

thx @Eric89GXL


Add Api Management to public-ip-addresses

Add Api Management to public-ip-addresses

@asudbring
Can you review the proposed changes?
When the changes are ready for publication, add a #sign-off comment to signal that the PR is ready for the review team to merge.
#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

#sign-off