[Android] Deprecated Gradle features making it incompatible with Gradle 6.0

Current behavior

Task :@react-native-community_async-storage:generateDebugRFile
Changing the value for a property with a final value has been deprecated. This will fail with an error in Gradle 6.0.

Task :@react-native-community_async-storage:compileDebugJavaWithJavac FAILED
/Users/suraneti/cm-transit-app/node_modules/@react-native-community/async-storage/android/src/main/java/com/reactnativecommunity/asyncstorag
e/AsyncStorageModule.java:26: error: package com.facebook.react.module.annotations does not exist
import com.facebook.react.module.annotations.ReactModule;
^
/Users/suraneti/cm-transit-app/node_modules/@react-native-community/async-storage/android/src/main/java/com/reactnativecommunity/asyncstorag
e/AsyncStorageModule.java:33: error: cannot find symbol
@ReactModule(name = AsyncStorageModule.NAME)
^
symbol: class ReactModule
2 errors

FAILURE: Build failed with an exception.

What went wrong:
Execution failed for task ':@react-native-community_async-storage:compileDebugJavaWithJavac'.
Compilation failed; see the compiler error output for details.

Expected behavior
Run successful
Repro steps
npm install
react-native run-android

Environment

Async Storage version: 1.4.2
React-Native version: 0.59.9
Platform tested: Android (Worked fine on iOS)
Logs/Error that are relevant: -

Hi @suraneti,
Gradle 6.0 info is a warning. The real issue is reactnativecommunity/asyncstorag e/AsyncStorageModule.java:26: error: package com.facebook.react.module.annotations does not exist
Seems like your RN dependencies are not synced/added correctly. Try cleaning up your project/removing node_modules and install everything again.

@Krizzu after I've cleaned up gradle and re-install node_modules, problem seem to be solved now.

Im having this issue currently, cleaned gradel and reinstalled node_modules, any tips?

@MUllman here my RN info and library version, I still don't know what is root of this problem.

Async Storage version: 1.4.2

React Native Environment Info:
   System:
     OS: macOS 10.14.5
     CPU: (8) x64 Intel(R) Core(TM) i7-4770HQ CPU @ 2.20GHz
     Memory: 8.21 GB / 16.00 GB
     Shell: 3.2.57 - /bin/bash
   Binaries:
     Node: 10.15.0 - /usr/local/bin/node
     Yarn: 1.13.0 - /usr/local/bin/yarn
     npm: 6.9.0 - /usr/local/bin/npm
     Watchman: 4.9.0 - /usr/local/bin/watchman
   SDKs:
     iOS SDK:
       Platforms: iOS 12.2, macOS 10.14, tvOS 12.2, watchOS 5.2
     Android SDK:
       API Levels: 23, 24, 25, 26, 27, 28
       Build Tools: 26.0.1, 26.0.2, 27.0.3, 28.0.2, 28.0.3
       System Images: android-28 | Google APIs Intel x86 Atom, android-28 | Google Play Intel x86 Atom_64
   IDEs:
     Android Studio: 3.3 AI-182.5<IP_ADDRESS>99772
     Xcode: 10.2.1/10E1001 - /usr/bin/xcodebuild
   npmPackages:
     react: 16.8.3 => 16.8.3
     react-native: 0.59.9 => 0.59.9
   npmGlobalPackages:
     react-native-cli: 2.0.1
     react-native-git-upgrade: 0.2.7
     react-native-rename: 2.4.1

Check your app/build.gradle dependencies (if it has indeed RN dep), clean gradle and yarn caches, remove node_modules resync everything.
If you're working in android, remove .idea/modules and restart it.

Worked for me after I had been trying to debug the problem for several hours.
Further, try to also incorporate the step provided as a solution in this similar stackoverflow issue

Solution doesn't work on my app
Tried:

rm -rf node_modules/
clean gradle
npm i
npm start -- --reset-cache
unlink and link module

Issue still appears
AsyncStorageModule: error: package com.facebook.react.module.annotations does not exist

@wkwyatt maybe your RN < 0.60 and some library required RN >= 0.60

I think I had slightly different issue, but the error above was there too and what helped me was this
./gradlew clean
rm -rf ~/.gradle/caches/*

./gradlew clean is OKAY

After removing .gradle folder and build folder inside android folder of react native project, everything is work for me.

After removing .gradle folder and build folder inside android folder of react native project, everything is work for me.

It is ok for me!!

i fixed this problem by deleting the /android/.gradle folder and building it again with yarn android


No version on pending migrations

Additional information which could be helpful if relevent to your issue:
Code example (inline, gist, or repo)
Any fetch while running in server node
Runtime information:
NoMethodError (undefined method `version' for nil:NilClass):
/Users/kieranlafferty/.rvm/gems/ruby-2.3.1/bundler/gems/neo4j-3055f33273b7/lib/neo4j/migrations/check_pending.rb:10:in call' actionpack (<IP_ADDRESS>) lib/action_dispatch/middleware/callbacks.rb:38:in block in call'
activesupport (<IP_ADDRESS>) lib/active_support/callbacks.rb:97:in __run_callbacks__' activesupport (<IP_ADDRESS>) lib/active_support/callbacks.rb:750:in _run_call_callbacks'
activesupport (<IP_ADDRESS>) lib/active_support/callbacks.rb:90:in run_callbacks' actionpack (<IP_ADDRESS>) lib/action_dispatch/middleware/callbacks.rb:36:in call'
actionpack (<IP_ADDRESS>) lib/action_dispatch/middleware/executor.rb:12:in call' actionpack (<IP_ADDRESS>) lib/action_dispatch/middleware/remote_ip.rb:79:in call'
actionpack (<IP_ADDRESS>) lib/action_dispatch/middleware/debug_exceptions.rb:49:in call' actionpack (<IP_ADDRESS>) lib/action_dispatch/middleware/show_exceptions.rb:31:in call'
railties (<IP_ADDRESS>) lib/rails/rack/logger.rb:36:in call_app' railties (<IP_ADDRESS>) lib/rails/rack/logger.rb:24:in block in call'
activesupport (<IP_ADDRESS>) lib/active_support/tagged_logging.rb:70:in block in tagged' activesupport (<IP_ADDRESS>) lib/active_support/tagged_logging.rb:26:in tagged'
activesupport (<IP_ADDRESS>) lib/active_support/tagged_logging.rb:70:in tagged' railties (<IP_ADDRESS>) lib/rails/rack/logger.rb:24:in call'
actionpack (<IP_ADDRESS>) lib/action_dispatch/middleware/request_id.rb:24:in call' rack (2.0.1) lib/rack/runtime.rb:22:in call'
activesupport (<IP_ADDRESS>) lib/active_support/cache/strategy/local_cache_middleware.rb:28:in call' actionpack (<IP_ADDRESS>) lib/action_dispatch/middleware/executor.rb:12:in call'
actionpack (<IP_ADDRESS>) lib/action_dispatch/middleware/static.rb:136:in call' rack (2.0.1) lib/rack/sendfile.rb:111:in call'
railties (<IP_ADDRESS>) lib/rails/engine.rb:522:in call' puma (3.6.0) lib/puma/configuration.rb:225:in call'
puma (3.6.0) lib/puma/server.rb:578:in handle_request' puma (3.6.0) lib/puma/server.rb:415:in process_client'
puma (3.6.0) lib/puma/server.rb:275:in block in run' puma (3.6.0) lib/puma/thread_pool.rb:116:in block in spawn_thread'
Neo4j database version:
neo4j gem version: 8.0.0RC1
neo4j-core gem version: 7.0.0

Thank you for your catch, I'm taking a look 👍

@KieranLaffertySC Try to update to 8.0.0.rc.2, it should be fixed 👍

:metal:

Closing for now, please let me know if there are more issues 👍


[Bug report]:

Platform
Desktop, Mobile
Version
1.3.3
Description
App Version: 1.3.3
platform: win32
platformVersion: 10.0.19042
platformArchitecture: x64
cpuCount: 2
totalMem: 7915.5 MB
freeMem: 4365.6 MB
Error Type: Main Unhandled Promise Rejection
Error: Uncaught Error: net::ERR_NETWORK_CHANGED
Expected behaviour
An error occurs once in a while.
no problem to use
Actual behaviour
Even after updating, the error doesn't go away.
Laptops used exclusively for firefly
Can the issue reliably be reproduced?
No
Steps to reproduce the issue
No response
Operating System
Windows
Diagnostics
No response
Developer Profile
No
Profile Type
Software (Stronghold)
Staking
Previously staked
Crash Status
None of the above
Error Messages
App Version: 1.3.3
platform: win32
platformVersion: 10.0.19042
platformArchitecture: x64
cpuCount: 2
totalMem: 7915.5 MB
freeMem: 4365.6 MB
Error Type: Main Unhandled Promise Rejection
Error: Uncaught Error: net::ERR_NETWORK_CHANGED
Error Logs
App Version: 1.3.3

platform: win32
platformVersion: 10.0.19042
platformArchitecture: x64
cpuCount: 2
totalMem: 7915.5 MB
freeMem: 4365.6 MB

Error Type: Main Unhandled Promise Rejection

Error: Uncaught Error: net::ERR_NETWORK_CHANGED

Duplicate declaration

[X] I have searched the issues tracker this issue and there is none

Code of Conduct

[X] I agree to follow this project's Code of Conduct

I will close this issue, since it might be fixed in 1.4.1 and this cannot be reliably reproduced. If this issue is encountered again after 1.4.1, feel free to open it again!


TOOL: External links

User Story
“As a Forms Designer, I want all links to open in a new window, so I don't need to hand code this in forms flow, and I can be sure users are not popped out of the form when they check out a link.”
Acceptance Criteria
All links open in a new window
in all environments

Anchor links?

@Stella-Archer The changes are on DEV and TEST for your testing.
Testing instruction:

Please open this form on DEV and TEST
You'll see two links, first configured to be opened in a new tab, and second, configured to be opened on the same page.
Clicking on any of the two links will open a new tab.

Please note, that this fix converts all the links on the forms to be opened in a new tab. Per the need for an internal link, we can upgrade this solution to support internal links (for scrolling/navigation within the same form).

Tested successfully in TEST and DEV. Ready to be transferred to PROD

Another fix was implemented to only affect the forms links and not the TOOL. Also, the new fix, makes it easier to support internal links for navigation if needed in the future.

Iman to push to test and assign to Hasan to test

@HasanSifat The new fix is deployed to DEV and ready for testing. If you could, please test the links in the Telesowrk form when filling the form and when the manager sign-off as the new fix makes changes to the form. On top of that, you can test it here.
Thank you

Tested successfully in DEV. Ready to be transferred to TEST.

@HasanSifat Deployed to TEST and ready for the test.

Tested successfully in TEST. Ready to be transferred to PROD


Rename Name Environment does't work

Expected Behavior
I can't rename Environment, I have many duplicates called "New Environment" and none of them can be rename.
Actual Behavior
It should allow me to rename environments
Reproduction Steps
Go to any project
Check environment list
try to rename, and nothing happens no UI to edit the name.
Is there an existing issue for this?

[X] I have searched the issue tracker for this problem.

Additional Information
No response
Insomnia Version
2023.4.0
What operating system are you using?
Ubuntu
Operating System Version
Ubuntu 22.04.2 LTS
Installation method
Manually with file Insomnia.Core-2023.4.0.deb
Last Known Working Insomnia version
2023.4.0

@fedeValtira if you double click on New Environment title, does it let you rename?

yep I can, so why is there and not in the left side as endpoint we rename like that.


Hi I'm Interested!

Hi, I’m Zach.  It’s a goal of mine to be the good I want to see in the world, and to that end I see how Bright Peeps can be a part of that good.  I am currently taking CS 260 but have had previous experience with basic web development languages.  I’ve also taken CS 340 where I built a simple social media platform, so there’s a lot overlap there, at least in project design.  I’ve used MySQL for work, SQLite and DynamoDB in the CS program, but I’m open to learning whatever is needed.

Sweet! Welcome to the team! :)


Revert "Fix window undefined issue when SSR"

Reverts facebook/lexical#2229
Come to think of it, I'm not sure this is the right fix. @thegreatercurve this code path is on a DOM event listener, which means there must be a window present for it to fire to begin with?

@trueadm It's weird.  I guess maybe it's similar to a stale caching issue.


[Iron & Windows] Error code<PHONE_NUMBER> when running ROS 2 node with ros2 run

Hi, guys,
I am trying implementing the tutorial of "Using quality-of-service settings for lossy networks".
When I try to run the showimage node in the image_tools package using the ros2 run command:
ros2 run image_tools showimage

I get the following error:
[ros2run]: Process exited with failure<PHONE_NUMBER>

The steps to reproduce are:

Build the image_tools package

Source the setup script

Run ros2 run image_tools showimage

Then I see the above error code<PHONE_NUMBER> printed, as followed:
D:\Professional\ROS2\Tutorials\demos\image_tools>ros2 run image_tools showimage
[ros2run]: Process exited with failure<PHONE_NUMBER>

I have tried rebuilding the package but the issue persists.
I would appreciate any help in troubleshooting this error when running ROS 2 nodes. Let me know if more details are needed about the environment and setup.
Thank you!

Hi @tfoote,
I wanted to follow up and thank you again for your helpful guidance on this issue. As suggested, I have posted the question on Robotics Stack Exchange to get additional troubleshooting assistance:
https://robotics.stackexchange.com/questions/108275/iron-windows-error-code-3221226505-when-running-ros-2-node-with-ros2-run
This forum seems well suited for deeper technical discussions. I was hoping I could kindly ask if you might be willing to take a look and potentially provide your valuable insights. Your previous feedback on GitHub was much appreciated, and I believe your expertise could help me and others resolve this error.
I will continue working to provide any other useful debugging information asked by the community. Please let me know if there is any way I can make progress on this issue easier.
Thank you in advance for your consideration.
Regards,
Yucheng Song


Fixed line width measuring

Tested on a Nexus 5 running lollipop with a variety of texts in a textview.

Can you please show me a screenshot or something, of the issue itself? or a way to reproduce it?
Also, sadly, this doesn't seem to fix the issue I've found and written about, that the last letter of the current line can go to the next line.

@AndroidDeveloperLB Appologies for not being clear, this relates to the issue i raised about text not filling: https://github.com/AndroidDeveloperLB/AutoFitTextView/issues/11
The other issue i raised (#12), i think contains a solution to your other problem.
I'll try and get you a screenshot of the issue. But basically, the text is coming out far smaller than it could be on a square-ish textview. I'll probably also have to test on another device with an older version of android.
Could you try this and see if it breaks anything your end?

Before:
https://www.dropbox.com/s/rty07vxwmngvxsa/text_before.png?dl=0
After (with this fix applied):
https://www.dropbox.com/s/kmeg2vhejyz09eo/text_after.png?dl=0
Note that both textviews have some padding but similar results are observed without the padding. (In fact that was the situation I found this in)

I'm not sure what has happened here. You've create 3 thread about one issue? why didn't you just write it on the same thread?
The code you've written is the same as what you are suggesting here, and I've still noticed the issue I've written about.
Anyway, I'll now merge the pull request. Thank you for contributing.

#12 Is about casting an int.
This MR is about using a different API to measure line widths.
The approach on Github is generally to have one MR per issue. If for example, this MR caused a bug, we'd still have the issue open to track the problem.

ok, here's the issue I'm talking about:
https://github.com/AndroidDeveloperLB/AutoFitTextView/issues/15


Roller shutter switch Basic parameter missing, existing one have it

Hello everyone,
I have several TechniSat roller shutter switches, all of which have the same FW and SDK version.
Now I have added a new roller shutter switch with the same FW and SDK version.
On the new switch, I no longer see the Basic parameter in which the current shutter position is stored. Can I add it manually somehow?
Old roller shutter switch

New roller shutter switch

@HolBaum5 Already tried to re-interview your device?

I have re-intervied, refresed, updated-topics,  exclude and included again but the parameter is not displayed.

Please make a driver log, loglevel debug and attach it here as a file (drag & drop into the text field).

Attached the driver log.
zwave-js-ui-store.zip


Setting slider position of a multidimensional image

📚 Documentation

In the tutorial here, it says: In order to get or update the current position of the slider, use:
# to get the current position
viewer.dims.current_step
# to change the current position
viewer.dims.current_step = 3

However, with the synthetic dataset used in the tutorial, and using napari v0.4.18, viewer.dims.current_step gives a tuple output of (0, 255, 255) rather than an integer index. Thus, I have to change the current position instead with viewer.dims.current_step = (3, 255, 255), and that line of code from the tutorial doesn't quite work now.
I hope you can help to check this and see if I'm using the Viewer correctly. Thank you!

Is it a bug or is it a change that wasn't documented?
Looks like viewer.dims.current_step has been returning a tuple for quite some time—at least 0.4.17 which I had handy.
It makes some sense if you take something Cells_3D and move the z-slider to look at a different xy plane and then rotate the axes and adjust the x-slider.
viewer.dims.current_step will report the position of each slider.
And of course once you have a 4D image, where you will always have 2 sliders, then it's clear it needs to be a tuple.

I will backtrack, but then we do need a way to actually set the particular slider dimensions I think.

I will backtrack, but then we do need a way to actually set the particular slider dimensions I think.

You can still set the positions by passing the tuple.
e.g. open Cells_3D and merge the channels to a stack (contextual menu)
viewer.dims.current_step = (0, 40, 128, 128)
Sets both sliders.
And the sliders are labeled, so it's not horribly unintuitive.
(one thing is that you can set them out-of-bounds, so e.g. (2, 40, 128, 128) will give a black box)
Now, we could make a feature where something like current_slider_pos returned the position of just the currently active sliders, but I'm not sure that actually is a QoL improvement?

Sounds good

@melonora Thank you for your quick attention to this issue! I'm a new user of napari, so I wasn't sure if this is more like a bug vs. a documentation issue.
I think I do see Peter's point that slicing 2D planes through >3D images would have to return a tuple for the slice location.

No problem, I think one way we could do this is is by having a _set_current_step method with 2 arguments, steps and dim_indices. Either being a single int or a tuple of int, with both arguments being required to be of the same length and indices currently not being displayed. @ziyuanzhao2000 @psobolewskiPhD do you both think this would be more intuitive? In any case lets fix the docs first.

PR in napari/docs is open #241

I've merged that PR and I think this can be closed. If there is a feature request for some other way to programmatically move the sliders, then it can be a new issue.
Thanks everyone!


actions: fix linting, build packages, create a release

actions: fix linting, build packages, create a release

i see you are getting super expert on github workflows, amazing!

Not as crazy as what @enolfc pushed for the https://github.com/EGI-Foundation/cloud-info-provider with PR and spec/debian files updates via PR made from GitHub actions :)


masking some cells/ facets while using cellColors

Hi again,
I've been trying to use the scalebar and cellColors() to visualise facet-based data and have come across this problem. I have a DTM for which I have a list of values each of which maps to a facet ID. So in theory I could visualise the DTM based data. However within this list I also have facets to which there are no values / data to be shown, which I have by default set to 0.
However, when I showcase the data and put a scalebar in the side, I'm not able to just show only the facets to which I have the data. Since the undesired facets are set to 0., they also appear coloured and makes the visualisation a bit misleading. I tried to use argument 'alpha' to set the transparency, but it leads to loosing information about the terrain on the DTM where there are no values. So I'm not sure how to deal with this issue. Sometimes I have values that range from -1 through 2 for the facets, and as such, setting values to 0. will be misleading the visualisation itself. So I'm wondering whether there is a way to still show the coloured facets, but only show the mesh for the undesired facets (those that I'm setting to 0.), while preserving the terrain info.
I do not know if I made myself clear. Please let me know if it's not clear or you need more information.
Thank you in advance !

Thanks for the quick response. I'm actually working with cells / faces. It seems that there is no equivalent function to delete cells off a mesh within the library (deleteCells ?). So I wanna find a way to get the points corresponding to the set of cells/ faces that I wanna delete ?

or ideally what I'm after is just to keep the skeleton / cells without any colouring (defined by a cell / face ID) for a given / specified list of cells. This is to give a visual of the surface structure of the cells, for which there will be no data to be displayed.
In other words, as per the pumpkin example, I would prefer to have the empty cells without any colours so that the surface structure is visible. I've tried to play with the alpha keyword and it just makes the cells disappear (when set to 0. ) as if you were to have them deleted. Sorry for the repeated questions or if I sounded confusing. I'm new to this library and just trying to how I can get done what I want.
Thanks again !

what about ovelapping the same wireframe mesh (with optional scaling):
from vtkplotter import makeLUT, Sphere, show

mesh = Sphere()
wmesh = mesh.clone().wireframe().lc('k').lineWidth(0.1)
wmesh.scale(0.99)

# create some data array to be associated to points
data = mesh.points()[:,2]
data[10:90] = float('nan')

# Build a lookup table of colors:
#               scalar  color   alpha
lut1 = makeLUT([(-0.80, 'pink'       ),
                (-0.33, 'green',  0.8),
                ( 0.67, 'red'        ),
               ],
               vmin=-1, vmax=1,
               aboveColor='grey',
               belowColor='white',
               interpolate=False,
               )

mesh.pointColors(data, cmap=lut1).addScalarBar()

show(mesh, wmesh, axes=1, viewup='z')

Thanks again, this is a good idea to used a wired frame just underneath the mesh. It seems to work. But I have a one slight final problem with the colormap. I figured that you have set some of the data to be float('nan') so that they are transparent/ not considered by the colormap. Since this is a custom colormap I'm not sure how to do it with a standard matplotlib color map, say 'viridis' for example ?

In this case you don't need makeLUT

from vtkplotter import *

mesh = Sphere()

wmesh = mesh.clone().wireframe().lc('k').lw(0.1)
wmesh.scale(0.99)

data = mesh.points()[:,2]
data[10:90] = float('nan')
mesh.pointColors(data, cmap='viridis').addScalarBar()

show(mesh, wmesh)

well, I'm working with facets as I have to display facet-based data. So it seems that this does not work for facets, because in the way the properties of points and cells differ in vtkplotter ?
from vtkplotter import *

mesh = Sphere()
wmesh = mesh.clone().wireframe().lc('k').lw(0.1)
wmesh.scale(0.99)
data = mesh.cellCenters()[:,2]
data[10:200] = float('nan')
mesh.cellColors(data, cmap='viridis').addScalarBar()
show(mesh, wmesh)

As seen in the attached image, using cell-based coloring unfortunately leads to a maroon color facets.

well, finally I managed to get it solved by getting an array of facets mapping to their vertices using mesh.faces() though which I could find the 'points' that needed to be deleted and by eventually deleting them by calling deletePoints(). However I think there is much shorter way of doing that. I thought of posting this temporary solution, just in case someone like me runs into the same problem.
Thank you again for quickly reacting and helping out.

Thanks @ifermion - in the meanwhile i'll try to figure out why the nan trick is not working for cells..


chore(master): release 1.1.146

:robot: I have created a release beep boop
1.1.146 (2023-08-07)
Miscellaneous

deps: update dependency vite to v4.4.9 (5d61d69)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/wayofdev/keywind/releases/tag/v1.1.146 :sunflower:


add torch_dtype control for prepare_model_for_kbit_training

What does this PR do
This pr add torch_dtype parameter to prepare_model_for_kbit_training for better control of non-quantized modules.
Why I think this is necessary
The bnb lib MatMul8bitLt will use float16 for internal computing. It should be better if we keep the non-int8 in float16, especially when the model is already in half precision.
torch_dtype is set to torch.float32 by default. Should be ok for existing code.
Please leave comments. ^^

Still running some test with deepspeed.

Thanks for the addition. I agree it's a good idea to give users more control about the dtype in this situation. When you're finished testing, let us know.

In general, I would be in favor of giving the user more control but as @pacman100 explained well, casting to half precision could lead to several issues down the line.
I wonder if an alternative could be that we just add an option to skip casting to float32 entirely. We would add to the docs that users should choose that option only if they know what they're doing and want to cast the layers manually. Then it's their responsibility to choose the right dtype for the right layers.

For fp16,  I can make it work but need to clamp the MLP layer.  For bf16, it should be safe. Still waiting for the training to finish
@pacman100 I am thinking why the training is unstable under fp16. There are many efforts to make training stable such as gradient clipping and loss scaling. Maybe we should also add hidden-state clipping in transformer or peft lib?

@BenjaminBossan Thanks very much for comments.  I think that's ok for me, but its up to you guys.
PS: I think allowing model to be in lower precision is a trend, even in training.

I think I will close this for now, maybe re-open if my bf16/fp16 training runs well.  Thanks all for replying.


fix: prepend CARGO_MANIFEST_DIR to include path

Some of our users have been having problems with our usage of include_mmd!, see investigation here: https://github.com/paradigmxyz/reth/issues/6030#issuecomment-1888290062
The current implementation of include_mmd seems to introduce some ambiguity, at least between:

working on projects that use workspaces, and
working on a project that depends on a project that uses workspaces

Prepending CARGO_MANIFEST_DIR would break our existing usage of include_mmd! but allows the location for mermaid diagrams to be consistent across our project, and projects that depend on us.

@Rjected thanks for catching that. I'll increment the major and yank the current version.


Publish next Zebra release: 1.4.0

Prepare for the Release
These release steps can be done a week before the release, in separate PRs.
They can be skipped for urgent releases.
State Full Sync Test
To check consensus correctness, we want to test that the state format is valid after a full sync. (Format upgrades are tested in CI on each PR.)

[ ] Make sure there has been at least one successful full sync test since the last state change, or
[ ] Start a manual workflow run with a Zebra and lightwalletd full sync.

State format changes can be made in zebra-state or zebra-chain. The state format can be changed by data that is sent to the state, data created within the state using zebra-chain, or serialization formats in zebra-state or zebra-chain.
After the test has been started, or if it has finished already:

[ ] Ask for a state code freeze in Slack. The freeze lasts until the release has been published.

Checkpoints
For performance and security, we want to update the Zebra checkpoints in every release.

[ ] You can copy the latest checkpoints from CI by following the zebra-checkpoints README.

Missed Dependency Updates
Sometimes dependabot misses some dependency updates, or we accidentally turned them off.
This step can be skipped if there is a large pending dependency upgrade. (For example, shared ECC crates.)
Here's how we make sure we got everything:

[ ] Run cargo update on the latest main branch, and keep the output
[ ] If needed, add duplicate dependency exceptions to deny.toml
[ ] If needed, remove resolved duplicate dependencies from deny.toml
[ ] Open a separate PR with the changes
[ ] Add the output of cargo update to that PR as a comment

Prepare and Publish the Release
Follow the steps in the release checklist to prepare the release:
Release PR:

[ ] Update Changelog
[ ] Update README
[ ] Update Zebra Versions
[ ] Update End of Support Height

Publish Release:

[ ] Create & Test GitHub Pre-Release
[ ] Publish GitHub Release
[ ] Publish Rust Crates
[ ] Publish Docker Images

Make sure there has been at least one successful full sync test since the last state change, or

The last full sync was successful, but the lightwalletd full sync failed due to an unrelated devops bug #7796.
So I'm happy to call these done.
#7800 changes the sprout parameter data source we're using, so a full sync would be useful but not required. We've already checked they match the parameters used by zcashd.

The last full sync failed due to the same bug:
https://github.com/ZcashFoundation/zebra/actions/runs/6666908268

This is waiting on a manual full sync of Zebra and lightwalletd, because we've merged significant state and network changes since the last full sync:
https://github.com/ZcashFoundation/zebra/actions/runs/6686504232

Here is the cargo update output:
$ cargo update
    Updating crates.io index
    Updating ahash v0.8.3 -> v0.8.6
    Updating async-trait v0.1.73 -> v0.1.74
    Updating base64 v0.21.4 -> v0.21.5
      Adding bindgen v0.68.1
    Updating clap v4.4.6 -> v4.4.7
    Updating clap_builder v4.4.6 -> v4.4.7
    Updating clap_derive v4.4.2 -> v4.4.7
    Updating clap_lex v0.5.1 -> v0.6.0
      Adding const-oid v0.9.5
    Updating cpufeatures v0.2.9 -> v0.2.11
    Updating cxx-gen v0.7.109 -> v0.7.110
      Adding der v0.7.8
    Updating deranged v0.3.8 -> v0.3.9
    Updating ed25519 v2.2.2 -> v2.2.3
    Updating fiat-crypto v0.2.1 -> v0.2.2
    Updating futures v0.3.28 -> v0.3.29
    Updating futures-channel v0.3.28 -> v0.3.29
    Updating futures-core v0.3.28 -> v0.3.29
    Updating futures-executor v0.3.28 -> v0.3.29
    Updating futures-io v0.3.28 -> v0.3.29
    Updating futures-macro v0.3.28 -> v0.3.29
    Updating futures-sink v0.3.28 -> v0.3.29
    Updating futures-task v0.3.28 -> v0.3.29
    Updating futures-util v0.3.28 -> v0.3.29
    Updating hashbrown v0.14.1 -> v0.14.2
    Updating hyper-rustls v0.24.1 -> v0.24.2
    Updating iana-time-zone v0.1.57 -> v0.1.58
    Updating ipnet v2.8.0 -> v2.9.0
    Updating mio v0.8.8 -> v0.8.9
    Updating parking_lot_core v0.9.8 -> v0.9.9
    Updating pest v2.7.4 -> v2.7.5
    Updating pest_derive v2.7.4 -> v2.7.5
    Updating pest_generator v2.7.4 -> v2.7.5
    Updating pest_meta v2.7.4 -> v2.7.5
      Adding pkcs8 v0.10.2
    Updating portable-atomic v1.4.3 -> v1.5.1
      Adding powerfmt v0.2.0
    Updating redox_syscall v0.3.5 -> v0.4.1
    Updating rgb v0.8.36 -> v0.8.37
      Adding ring v0.17.5
    Updating rustix v0.38.20 -> v0.38.21
    Updating rustls v0.21.7 -> v0.21.8
    Updating rustls-webpki v0.101.6 -> v0.101.7
    Updating sct v0.7.0 -> v0.7.1
    Updating serde v1.0.189 -> v1.0.190
    Updating serde_derive v1.0.189 -> v1.0.190
    Removing socket2 v0.4.9
    Removing socket2 v0.5.4
      Adding socket2 v0.4.10
      Adding socket2 v0.5.5
      Adding spki v0.7.2
    Updating tempfile v3.8.0 -> v3.8.1
    Updating time v0.3.29 -> v0.3.30
    Updating tokio-util v0.7.9 -> v0.7.10
    Updating toml v0.8.3 -> v0.8.6
    Updating toml_datetime v0.6.4 -> v0.6.5
    Updating toml_edit v0.20.3 -> v0.20.7
    Updating tracing-log v0.1.3 -> v0.1.4
      Adding untrusted v0.9.0
    Updating uuid v1.4.1 -> v1.5.0
    Removing windows v0.48.0
      Adding windows-core v0.51.1
    Updating winnow v0.5.16 -> v0.5.17
      Adding zerocopy v0.7.20
      Adding zerocopy-derive v0.7.20

Oops must have been tagged on the wrong issue

The full sync passed in 2 days 2 hours:
https://github.com/ZcashFoundation/zebra/actions/runs/6686504232


Release v0.20.21

Just the dependency bumps that were left behind in #3262.

If #3268 is ready, we can include it, but it's not a major deal to end users.


Connection to AKS API is being intermittantly refused during CICD pipeline

Describe the bug
Starting to see, more and more this problem of the connection to the K8S endpoint being refused.
Think we need to add some retry logic, as well as some more debugging.

Run kubectl create namespace $NAMESP --dry-run=client -o yaml | kubectl apply -f -
The connection to the server byo-dns-78594b60.hcp.westeurope.azmk8s.io:443 was refused - did you specify the right host or port?
Error: Process completed with exit code 1.

Additional context
Error

Happened again

https://github.com/Azure/Aks-Construction/runs/4199076014?check_suite_focus=true#step:7:32


No acess to "User management" for remote users (created via LDAP)

I have successfully configured LDAP authentication. When I log in with LDAP credentials, a new remote user is created.
But when I create a new project with this user, I don't see the "User management" section in the project configuration. So I can't add other users.
Also when I log in as admin, I do see the section but no user shows up which makes sense since all the users have been created the same way so far (after a first login with LDAP credentials.)

Did you create a private or public project?  See http://kanboard.net/documentation/creating-projects

I created a private project. Does private mean only for me?
-------- Original message --------
From: Timo
Date:30/04/2015 07:50 (GMT+01:00)
To: fguillot/kanboard
Cc: "Thomas, E.D.R. (Emmanuel)"
Subject: Re: [kanboard] No acess to "User management" for remote users (created via LDAP) (#838)
Did you create a private or public project? See http://kanboard.net/documentation/creating-projects
—
Reply to this email directly or view it on GitHubhttps://github.com/fguillot/kanboard/issues/838#issuecomment-97669524.
This message may contain information that is not intended for you. If you are not the addressee or if this message was sent to you by mistake, you are requested to inform the sender and delete the message. TNO accepts no liability for the content of this e-mail, for the manner in which you use it and for damage of any kind resulting from the risks inherent to the electronic transmission of messages.

For information, I have made the project public but it doesn't change anything.

Yes, private means only you. As an LDAP user, I've managed to create a new project and User Management appears in the menu.

Thanks @lazki ! I had indeed created a private project. By setting the LDAP user as Administrator, I can now create team projects and add other users.
That being said, isn't it a bit odd that you need to be Administrator to create team projects ? Project leader and Administrator are different roles and usually different persons too, aren't they ?


ScalaCheck Schema DDL: add

scalacheck-schema-ddl is a module responsible for generating self-describing JSON instances out of JSON Schemas. It has schema-ddl in name because it leverages typesafe JSON Schema AST from Schema DDL project.
/cc @BenFradet @asoltysik

I think it'd make sense to externalize it as a different repo as it can be useful to people not using iglu at all, I created https://github.com/snowplow-incubator/json-schema-gen as a placeholder (we can definitely find a better name)

I have few counter-arguments (though I definitely prefer multi-repos):

It will depend on Schema DDL through JSON Schema AST and therefore several other Iglu libs (Scala Core at least)
I was planning to add Iglu Client shortcuts to generate schemas out of remote registries

It will depend on Schema DDL through JSON Schema AST and therefore several other Iglu libs (Scala Core at least)

why does this make having it in this repo mandatory?

I was planning to add Iglu Client shortcuts to generate schemas out of remote registries

same as above. Additionally this seems a bit out of the original scope to me. It'd better fit as a submodule, wdyt?

I'd argue that incorporating it to this repo will completely prevent wide-spread usage (SEO will be awful).

I'd argue that incorporating it to this repo will completely prevent wide-spread usage (SEO will be awful).

That's not in any way our priority though. Our priority is launching a BigQuery Loader for GCP - whatever is faster to that end.

why does this make having it in this repo mandatory?

Not mandatory at all. It was the point regarding people not using Iglu - there will be huge part of Iglu anyway. As of actual repo - ok, I'm moving it to same https://github.com/snowplow-incubator/json-schema-gen, I think it will be faster to keep it out of main repo.

...or actually https://github.com/snowplow-incubator/scalacheck-schema

scalacheck-schema

Nice name


Error: Connection closed while receiving data

When getting the info for a song, I sometimes get the error Error: Connection closed while receiving data.
I have no idea why it happens, as it looks random to me. Sometimes it happends, sometimes it works well.
I am simply using the following line (with the genius variable correctely initialized) :
final song = await genius.searchSong(artist: artist, title: title);

Error: Connection closed while receiving data
This error can be caused by a number of things and it's hard for me to know what is going on in your case with no further details of your usage, especially since it is random. It could be related to proxy settings, requesting large amount of data etc, it is hard to tell without more information.
I will need to be able to reproduce the issue in other to be able to help.

I understand, I will provide you with more info if I manage to understand where the issue might be coming from when I'll do more tests.


Optimization question

I noticed a few instances in the codebase where equals(Integer[0]) and equals(Integer[1]) are used. Maybe just an over-optimization but wouldn't it be more efficient to use isZero() and isUnit() in those cases?

Yes, it would be slightly faster and cleaner.

Really interesting thing though is that, even so, this library actually runs blazingly fast!

I've made some performance benchmarks comparing this library to other big integer libraries:
http://peterolson.github.io/BigInteger.js/benchmark/
I'd certainly pull in commits changing instances of equals(Integer[0]), although I doubt there would be any noticeable differences in performance overall. There are probably some bigger bottlenecks in the library.

Nah, too much stochastic noise from the random sampling to tell. None of the instances seemed to be performance-critical anyway.


Path separator issue when Drag & Drop

VS Code Version: 1.53.2
OS Version:

Local: Windows 10 (10.0.19041)
Remote: Ubuntu 20.04.2 LTS (GitHub Codespace and my own VPS)

Steps to Reproduce:

Open VSCode's Explorer and Terminal
Drag any file from VSCode's Explorer to Terminal
See text being pasted in Terminal

Does this issue occur when all extensions are disabled?: No. disabling any other extensions than Remote Connections won't fix this issue.

Description
While you are accessing a Linux computer using Remote Connection from Windows, Local and Remote have different directory separator. (with the same system, this is not problem at all)
When you DD a file from VSCode's Explorer to Terminal, directory separator from Local Windows computer (\) is used, which is different from Remote Linux computer (/).
In Windows, directory separator is backslash, but it is used for escape character in Bash or some other *nix shell.
Here's a screenshot tried this:

Expected
For example, when you DD'ed a file named CONTRIBUTING.md, should paste like /home/codespace/workspace/ytdl-patched/CONTRIBUTING.md .
Actual
With the same example above, pastes \home\codespace\workspace\ytdl-patched\CONTRIBUTING.md .

Duplicate of #109895


Does the training loss of Sound_residual_predict  only have one kind of Mrft_loss?

When I try to train sound_phsics_residual_predict , there is erro:
The SoundResidualCriterion need four paras(gt/predict audio and gt/predict fea), but the trainer only pass it gt/predict audio to calculate Mrft_loss.
Is the percept loss needing gt/predict fea necessary?

Thanks for pointing it out. It was redundant code that I forgot to clean. I tried adding perceptual loss before but I remembered it didn't help. So feel free to delete it

Thanks for pointing it out. It was redundant code that I forgot to clean. I tried adding perceptual loss before but I remembered it didn't help. So feel free to delete it

Thanks for your quick replying!
I have another questions:
When extrating phsics paras,  there are two number I cannot understand. One is frequency distance 10.76, and another is 60 / final_d.
Is there any reference material to explain these specific numbers？

Sorry for the confusion, the first number is a hard-code for 44100/2048/2, giving a rough range of the frequency range within one bin. The second one refers to '60dB'. You can check out the code in TDW repo.

Sorry for the confusion, the first number is a hard-code for 44100/2048/2, giving a rough range of the frequency range within one bin. The second one refers to '60dB'. You can check out the code in TDW repo.
Thank you for your prompt and detailed reply!!


Basic operations on integer literals

In the following examples I'm using 1 but imagine any literal integer (so 1 but not 1.0)

[ ] toFloat 1 -> 1
[ ] round 1 -> 1
[ ] ceiling 1 -> 1
[ ] floor 1 -> 1
[ ] truncate 1 -> 1

Compositions of these functions:

[ ] round << toFloat -> identity
[ ] ceiling << toFloat -> identity
[ ] floor << toFloat -> identity
[ ] truncate << toFloat -> identity

Should we also simplify floor 1.2 to 1? :thinking:

To add:
round (round n) -> round n
ceiling (ceiling n) -> ceiling n
floor (floor n) -> floor n
truncate (truncate n) -> truncate n

can be done using operationDoesNotChangeResultOfOperationCheck and operationDoesNotChangeResultOfOperationCompositionCheck

Those don't type check so we don't have to handle them.

True, those don't return number, my mistake


False positive for relative json link

We have a relative link to a json file in our md and linkspector finds it as invalid.
$ linkspector check
🚫 apps/github-cascading-app/README.md, ./schemas/config.schema.json, 404, 34, Cannot find: ./schemas/config.schema.json.
❌ Error: Some links in the specified files are not valid.

The link works well, you can find it here: https://github.com/AmadeusITGroup/otter/blob/main/apps/github-cascading-app/README.md
markdown-link-check finds it valid.
FILE: apps/github-cascading-app/README.md
  [✓] https://github.com/apps/otter-cascading
  [✓] ./schemas/config.schema.json

  2 links checked.

@vscaiceanu-1a Thank you for creating this issue. Currently, Linkspector only checks for hyperlinks, and link to a local file should have been skipped. I plan to implement local link checking sometime.


feat: algokit-utils-ts feature parity [WIP DRAFT]

Proposed changes
Work in progress ...
This PR is to be used as a temporary dev branch for all feature parity prs as we gradually progress with the refactoring efforts.
Implementation plan

[x] 1. Preparing codebase for breaking changes

Moving all v2 code into legacy_v2 folder inside src

Moving all v2 tests into legacy_v2_tests

Moving all beta abstractions related tests into tests - which will be expanding as refactoring progresses (some tests might be pulled back from legacy_v2_tests folder).

Keeping all individual .py files at the root of the algokit-utils to forward exports to ensure backwards compatibility

[x] 2. Breaking down beta module into dedicated modules that will represent the refactored v3 of utils-py

The proposed new structure is as follows:
algokit_utils/
├── __init__.py # contains old v2 exports from _legacy_v2 + new abstractions (eventually old exports will be phased out)
├── _legacy_v2/ # contents of most of current v2 .py files
├── clients/
│   ├── __init__.py
|   ├── models.py # data models specific to clients namespace
│   ├── client_manager.py
│   ├── dispenser_api_client.py # unchanged from v2 as there are no major breaking changes
│   └── algorand_client.py
├── accounts/
│   ├── __init__.py
|   ├── models.py # data models specific to accounts namespace
│   └── account_manager.py
├── assets/
│   ├── __init__.py
|   ├── models.py # data models specific to assets namespace
│   └── assets_manager.py
├── applications/
│   ├── __init__.py
|   ├── models.py # data models specific to applications namespace
│   ├── app_manager.py
│   ├── app_deployer.py
│   ├── app_client.py
│   └── app_factory.py
├── transactions/
│   ├── __init__.py
|   ├── models.py # data models specific to transactions namespace
│   ├── transaction_sender.py
│   └── transaction_creator.py
│   └── transaction_composer.py
├── models/
│   ├── __init__.py # currently exposes contents of old models.py which resides in _legacy_v2
│   └── common.py # Any number of common models reused in at least 2 different namespaces
├── _utils/ # marked as private module
│   ├── __init__.py
│   ├── debugging.py # previously was at the root as _debugging.py, instead it will now reside in a private _utils namespace, this is partly to also avoid awkward `from algokit_utils.utils` statements, all utils exposed to end user in _utils would need to be explicitly exported via `__all__` dunder in root `__init__.py`
│   └── ... any other misc # of .py files for commonly used methods
├── errors/
│   ├── __init__.py
│   ├── ... # any other custom errors which may benefit from extracting into separate module
│   └── logic_error.py
├── config.py # unchanged from v2 as there are no major breaking changes
└── ... `account.py` `application_client.py` and other legacy files all re exporting contents from `_legacy_v2` folder which contains the v2 abstractions -> required to insure backwards compatibility after users upgrade to this version AND to establish clear boundary between old vs new abstractions

New abstractions are significantly more type heavy, the v2 of utils-py contained a module named models at the root represented as a file, its turned into a folder now and re exposes the old legacy models, however the intent is to reuse it and later add more granular files inside for various abstractions (assets, apps, and etc)

Note that some files from legacy_v2 and/or root .py files that expose the contents of legacy_v2 for backwards compatibility will be resurrected and repurposed (if it will make sense, similar to what was done with models.py -> models folder)

[ ] 3. Implement TransactionComposer (previously AlgoKitComposer) and any dependant abstractions

Currently work in progress

[ ] 4. ... to be defined along with other steps

@neilcampbell @robdmoore , please note the bit around proposal with each folder having its own models.py might be revised. As im implementing the composer and moving out some of the legacy abstractions back to root models folder i might have to ditch the initial models per folder and create files account, transaction and etc under root models so that all models are under one namespace but primarily to avoid circular imports for abstractions that were moved out from legacy but are also used within legacy code (instead of duplicating them which i think can lead to bigger issues)


Adjust architecture diagrams/evidence from example (202205) to main branch - 1 subnet in prod vpc from 3

Evidence capture was using older example branch - recalculate for main branch
https://github.com/GoogleCloudPlatform/pbmm-on-gcp-onboarding/blob/main/environments/prod/prod-network.auto.tfvars
obrien.systems = 3 (example branch used for evidence)
cloudnuage.dev = 1 (main branch)


--exclude option is ignored for CLI run

I'm configuring GitLabCI job and need to exclude some folders from scanning scope.
I've tried many different formats of path for --exclude CLI param, but without success. checked also documentation.
My last try is:
./dependency-check/bin/dependency-check.sh Core -s ./ --project MyProj-FE --disableAssembly --exclude 'tests/**' --exclude 'dependency-check/**' -o ./reports -f ALL --prettyPrint
But folders are still included into scanning scope.
How to exclude them correctly (with all the content inside)?
I couldn't provide log because it may contain some sensitive data.

Sorry about the delayed response - the excludes uses Ant syntax. My guess is that you need to update to use: --exclude '**/tests/**/*'.

Thanks a lot! This form works well. It wasn't clear for me without examples how to build this correctly.


How to predict the segmentation result of a volume

Hi, I am very interested in segmentation of skm-tea. But I have two questions. After loading a DICOM data and the weights of a model, what should be done with the data before it is sent to the network? And how to send the data into the network to predict the mask of the data? Is there an example to show the process?

Hi, I am very interested in segmentation of skm-tea. But I have two questions. After loading a DICOM data and the weights of a model, what should be done with the data before it is sent to the network? And how to send the data into the network to predict the mask of the data? Is there an example to show the process? I would appreciate it if you could answer my questions.

Hi @XiaotianJia, thanks for this question. We recommend a volumetric zero-mean, unit-standard deviation normalization. We also recommend using the dosma library to load dicoms and orient scans.
I've included some example code to do this with models taking a single-channel input (e.g. rss, E1, E2) would be like below. The code assumes you are using the root-sum-of-squares (rss) of the two echoes. However, the volume can be replaced with whichever echo/echoes is/are the target for segmentation.
import skm_tea as st
import dosma as dm
import torch
import meddlr.ops as O

# Read the qDESS dicoms
echo1, echo2 = tuple(dm.read("/path/to/qdess/dicoms", group_by="EchoNumbers"))
echo1, echo2 = echo1.astype(np.float32), echo2.astype(np.float32)

# If you are using the rss, compute it here
rss = np.sqrt(echo1 ** 2 + echo2 ** 2)

# Put sagittal dimension first.
rss = rss.reformat(("LR", "SI", "AP"))

# Convert to torch tensor and add channel dimension.
# Sagittal dimension is the batch dimension.
# Note: An array copy is used because torch cannot handle negative strides, which are possible.
rss_tensor = torch.from_numpy(rss.A.copy()).unsqueeze(1)  # Shape: (Z, 1, X, Y)
rss_tensor = (rss_tensor - rss_tensor.mean()) / rss_tensor.std()

# Get the U-Net RSS model (feel free to replace with the model of your choice here)
model = st.get_model_from_zoo(
    "download://https://drive.google.com/file/d/1HLOXapcKSqfVr_2mSxR_OlgUXyarkkNd/view?usp=sharing",
    "download://https://drive.google.com/file/d/1QAcdPSh1VQ967Q1loiiZRFo0JBZb5yIs/view?usp=sharing",
).eval()

# Run the model
with torch.no_grad():
    output = model({"image": rss_tensor})

# Get the predictions
pred = O.logits_to_prob(output["sem_seg_logits"], "sigmoid")

# (Optional) Put them back into a MedicalVolume
seg_volume = dm.MedicalVolume(pred.permute((0,2,3,1)), affine=rss.affine)  # Shape: (Z, X, Y, C)

If you would like to use a pretrained models out of the box without having to worry about managing normalization, orientation, etc., the DOSMA library has a version of the model trained in tensorflow/keras that should be plug-and-play. This tutorial highlights how to use this model.

Thank you very much for your detailed answer, and it is very helpful to me.


Add support writing data to hdfs by executing INSERT INTO/CTAS.

Current INSERT INTO/CTAS only supprt write data to local file system, If we run the following SQL, the SQL will execute successfully, but no data can be queried from the table:
presto> create schema hive.tpch_parquet_1px with (location='hdfs://hdfsCluster/user/hive/warehouse/tpch_parquet_1px.db/');
CREATE SCHEMA
presto>
presto> create table hive.tpch_parquet_1px.lineitem with (format = 'PARQUET') as select * from tpch.sf1.lineitem;
CREATE TABLE: 6001215 rows

Query 20230714_073619_00015_8z7nw, FINISHED, 11 nodes
Splits: 301 total, 301 done (100.00%)
2:41 [6M rows, 1.97GB] [37.3K rows/s, 12.5MB/s]

presto> select * from hive.tpch_parquet_1px.lineitem limit 10;
 l_orderkey | l_partkey | l_suppkey | l_linenumber | l_quantity | l_extendedprice | l_discount | l_tax | l_returnflag | l_linestatus | l_shipdate | l_commitdate | l_receiptdate | l_shipinstruct | l_shipmode | l_comment
------------+-----------+-----------+--------------+------------+-----------------+------------+-------+--------------+--------------+------------+--------------+---------------+----------------+------------+-----------
(0 rows)

Query 20230714_073912_00016_8z7nw, FINISHED, 2 nodes
Splits: 1 total, 1 done (100.00%)
0:01 [0 rows, 0B] [0 rows/s, 0B/s]

because the data is actually written to the worker's local file system.

With this PR we can writing data to hdfs by executing INSERT INTO/CTAS.

@majetideepak sure, let me do it in a separate pull request.

@majetideepak When we support the native parquet write function in Gluten, we found that Velox Parquet Writer only support write data into local file system. And we filed PR#5400 to support writing data in HDFS path when calling the velox parquet writer. Can you also have a look if you have available time? Thanks.

Hi @majetideepak Based on #5700 I refactored the code logic,  could you help me review it again.

@JkSelf this PR seems to contain the HdfsFileSink implementation as well. Do we still need https://github.com/facebookincubator/velox/pull/5400?
Can you help review this PR as well? Thanks.

@JkSelf this PR seems to contain the HdfsFileSink implementation as well. Do we still need #5400? Can you help review this PR as well? Thanks.

Yes. It seems there is no need #5400. Thanks for your review.

@majetideepak Deepak, could you also help review this PR? thanks.

LGTM.

@JkSelf thank you for your review.

@majetideepak Deepak, do you have any further comment?

Hi @majetideepak thank you for your reply, I have modified the code according to the comments.

HI @majetideepak Deepak could you help me review this pr, thank you.

HI @Yuhta  Could you take a look at this for me? Deepak seems very busy these days, thank you.

@wypb My knowledge for cloud connectors is limited

@wypb sorry for the delay. Can you add a test for the INSERT INTO as well with HDFS as the target?

@Yuhta That's ok, thank you as well.

@majetideepak No problem, I'll add this test later.

HI @majetideepak I added the InsertInfoHdfsTest.cpp class to validate insert into hdfs, could you help me review this.

Hi @majetideepak thank you for your reply, I have modified the code according to the comments, please help me review the code, thank you.

@Yuhta Can you review and help merge this? Thanks!

@wypb linux-adapters is failing.

@majetideepak Yes, I'm looking into the cause of the failure.

@majetideepak Deepak Thanks for your review! Do you have any further comment?

@kgpai, @Yuhta can one of you please help with merging this change? Thanks.

hi @kgpai, @Yuhta could you please help me merging this change? Thanks.

Hi @kgpai Thanks for your review! Do you have any further comment?

HI @kgpai I just synchronized the latest code to solve the problem of MultiFragmentTest.exchangeStatsOnFailure test failure in linux-build. could you please help me review this again. thank you.

@kgpai Thank you.


[Suggestion] Config generator

Expected Behavior
Config generator (CLI/GUI). Might be based on yeoman or whatever suits.

I might throw something later if nobody do this.

+1 Would make it a lot easier on us. I've been stumbling with some problems editing the release configs. A GUI would probably help 40% of the problems that occur

Is anyone working on something like this? I was thinking something web-based, maybe it could be built as an option in the web project?   I'm at best an intermediate at javascript but I'd be willing to start throwing something together.  I'm not positive how inter-related the web project and this one are and I'm afraid if I do a pull-request with this functionality in that project that It wouldn't be seen as the right place and I'd have to do a bunch of re-work to get it to the right place? thoughts on this? where would be the "right" place for something like this?


Specify dependency on angular

This explicitly lists the dependency on angular, allowing concerned package managers and loaders to install/configure it intelligently.

Hello. I'd still like to see this change if there are no objections I think it would be beneficial.


Union of T and Any doesn't conform to T (T is a type variable)

Environment data

Language Server version: 2021.11.1-pre.1
OS and version: Window 7 x64
Python version (& distribution if applicable, e.g. Anaconda): 3.8.12 Anaconda

Sample code
from __future__ import annotations

from typing import Callable, TypeVar

T = TypeVar("T")

def get_value(key: str, gen: Callable[[], T]) -> T:
    try:
        value = globals()[key]  # Any
    except KeyError:
        value = gen()  # T
    return value  # Any | T

Expected behavior
No warning.
Actual behavior

Additional info
There would be no warning if the type of value were either T or Any instead of a union.

Thanks for the bug report. This will be fixed in the next release.

fixed in 2021.11.1 release


Can you please explain adding enemies to documentation?

Hi,
Ive been trying to make this run on a tileset that I bought and I'm a bit stuck. The tilemap is similar to Example2 as there is a thin layer above the walls. Can I use the same corridor correction file for my tileset that you used for Example 2, or will I have to write my own?
And from reading the comments on your blog, I understand that enemies can also be automaticaly spawned as part of the generation pipeline. But there is no mention of it in the documentation.
Can you please explain how that would be possible?
Thank you

Hey!
regarding the tilemap, it depends how similar the two tilesets are. You can try to use the correction file from Example 2 and if it doesn't work, try to write your own. To be more precise, you can use the correction task from Example 2 and provide your own correction layout as can be seen here https://ondrejnepozitek.github.io/ProceduralLevelGenerator-Unity/docs/corridorsCorrection.
Regarding the spawn of enemies:

"I created a simple pipeline task that will spawn game objects for you. You can find it here - https://gist.github.com/OndrejNepozitek/0316e90ebea833bd55576762c49ad4de
Usage:

Create instance of the task - Right click -> Create -> Dungeon generator -> Custom Tasks -> Spawn GameObjects
Add the task to the generator pipeline (see https://ondrejnepozitek.github.io/ProceduralLevelGenerator-Unity/docs/generatorSetup) after the generator itself
Open your room template and inside it create an empty "GameObjects" GameObject (the name is important - the task needs it to work)
Add GameObjects you would like to spawn as children of the "GameObjects"
Now after you generate your level, the pipeline task will go through all the spawned rooms, look for  "GameObjects" GameObject and then instantiate all its children (and correct their positions)"

So you would add your enemies as a child of "GameObject" in each room template and the task will instantiate them at the correct location.
I know that the way you have to correct corridors and spawn gameobject/enemies is far from ideal. I'm currently finishing an alpha version of this plugin that contains major changes in how are things done, trying to make everything simpler for the user. Example 2 will no longer need to have a door correction task and gameobjects inside room templates will be handled automatically by the plugin.

Thanks for replying. I'll give this a shot and let you know how I get along.
Would it be possible to give a time frame as to when can we expect the next version of your plugin?
Thanks

I would like to have the first alpha version available by the end of the week.

Thats very good news. Thanks.
I believe in that case it would not be wise to use this now. I'll just wait for the alpha version and work on other aspects of my game till then :)

Many thanks for the update - I'm excited to try it out. :)
Excellent idea with the pro version as your asset can do more in 2D than most available on the asset store.
Please link it here as well when its available on the asset store

I hope you'll like it. I'll let you when it's ready.
Also please let me know if you have any problems or questions about the plugin and I'll try to solve that as soon as possible,

Ive been trying to make this run on a tileset that I bought and I'm a bit stuck. The tilemap is similar to Example2 as there is a thin layer above the walls. Can I use the same corridor correction file for my tileset that you used for Example 2, or will I have to write my own?

You can now use the outline override feature for tilesets similar to Example 2 in the documentation.
Let me know if your tileset cannot be handled with this.


[CVP-1615]Adding base images for operator scorecard tests

This PR can be merged after : https://github.com/openshift/release/pull/16475 is successfully merged.
The operator-sdk scorecard will need to be run on all operator bundle images that are tested with the Operator verification pipeline.
To this end, a new step implementing this will need to be added to the cvp-common workflow in the OpenShift-CI/DPTP Prow configuration.
Image that will be used for runing scorecard tests needs to be made available on the OpenShift-CI app.ci cluster and specified in the prow workflow step configuration (PR mentioned above). This base_images configuration changes needs to be specified for each OCP version of the job redhat-operator-ecosystem-playground.

/retest

/cc @petr-muller @stevekuznetsov

Please pass tests make ci-operator-config should do the trick

/hold
Also, are these supposed to be used as an image to run multi-stage steps? If so, then using literal refence in step config (https://docs.ci.openshift.org/docs/architecture/step-registry/#referencing-a-literal-image) should be a better option - then you do not need to put such image in ci-op configs in base_images.

Changed the approach to using the literal reference:
https://github.com/openshift/release/pull/16475/files

I believe this can be closed now, since the literal reference approach was used in dependent PR.


glib::timeout_add_local accept FnOnce

I sometimes find myself in the situation of adding a timeout/callback that will be called exactly once. But the respective glib methods accept a FnMut at best. One could wrap a FnOnce like this and expose this as an alternative (untested code):
fn wrap_once_local(func: F) -> impl (FnMut() -> Continue + 'static)
where
    F: FnOnce() 'static,
{
    let mut func = Some(func);
    move || {
        func.take().unwrap();
        Continue(false)
    }
}

That's basically what https://gtk-rs.org/docs/glib/fn.timeout_future.html does, but having callback variants for these is probably also useful.

Sure, why not. How should I implement this? I could duplicate all existing functions with a _once version, or I could make a generic once adapter.

I would implement new _once() functions for these. The goal is to make it easy to use for the user :)
Note that there are also the _local() variants of the functions that should probably get a _once() variant too.
Internally you could use some kind of adapter if that makes anything easier for you, or duplicate the functions. Either way it's not a lot of code.

Shall I also do the idle_add family of functions, or only the timeout ones?

Probably makes sense for all of them

Does it make sense for the _source_s as well? I never used them, and don't know if one would want to pass an FnOnce into them.

Does it make sense for the _source_s as well? I never used them, and don't know if one would want to pass an FnOnce into them.

Probably not, those are very specialized and whoever needs them will surely be able to figure out how to do that themselves.


Feat support view as a independent unit of leading

Proposed changes

support view as a independent unit of leading hint
add random test check of leading hint query
add more test with data of leading hint query
add random test check of distribute hint

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

run buildall

run buildall

run buildall

run buildall

run buildall

run buildall

run buildall

run buildall

run buildall

run buildall

run buildall

run buildall

run buildall

run buildall

run buildall

run buildall

run buildall

run buildall


added a picard .dict and bwa index files of the sample genome

adding some files that hung me up when running the snakemake workflow dna-seq-gatk-variant-calling, hope this will help other folks get up and running, but rules should probably be added that do the following:
bwa index -a bwtsw genome.chr21.fa
java -jar $PICARDJARPATH/picard.jar CreateSequenceDictionary R= genome.chr21.fa

This happens here. But indeed, the workflow could have rules for that as well.


deleting explicit ActivityType setting - 1. it's broken 2. the default value is better anyway

Otherwise we get activity=='-' for these actors in monitoring whereas the default value for activity is the name of the actor (which is good)

cloud/blockstore/tests/csi_driver/test.py.test_nbs_csi_driver_mounted_disk_protected_from_deletion

флап


⚠ Fortnite has degraded performance

In 597e97c, Fortnite (https://fortnite.com) experienced degraded performance:

HTTP code: 200
Response time: 1469 ms

Resolved: Fortnite performance has improved in 058934e.


Different take on main highlighting go install and go run for ... servers/cli binaries

IMO that is anti-idiomatic. import paths should be optimized for importing to go code, not for installing via go install.
I could change my mind, but AFAICT, importable library at root is the idiomatic Go pattern, with main packages in subdirectories. I guess the real answer, like everything is, "it depends" and the important part is to not change package paths once they are published.

idioms vary, it's same as pkg/ - it used to be, before go:embed and debug.BuildInfo that you wouldn't "install" just using go install or run with just go run <url> but that's the past and I think it's important to socialize that
also I believe the text currently does reflect you can do either vs original text which implies you must move your binary to cmd/execname ?

I would consider it idiomatic, e.g. see https://github.com/robpike/ivy
I.e. if your primary thing you are shipping is a single binary or tool, then it's nicer at root. If it's a library and the binaries are just a supplement, then have them else. If you have multiple primary binaries, then having a cmd is nice.

That example is enough to convince me.


Developer::getAcceptedRatePlans() should use the same cache storage as DeveloperRateplan::getList()

Not covered in this PR:
DeveloperRatePlan::getList() does not respect/use $page_num and $page_size method parameters. This either should be fixed or method parameters should be deprecated in an upcoming release.


💲[Native Checkout] Disable non-numeric, non-decimal separator input for the amount

📲 What
Exactly what the title says
🤔 Why
We don't want users on iPads or with hardware keyboards to being able to input anything other than digits and decimal separator (localized)
🛠 How
Simply comparing input string to whether it's a numeric or decimal separator (based on Locale) and only allowing text field to proceed or not if it validates properly.
✅ Acceptance criteria
On iPad (with SW or HW keyboard connected) or on iPhone with HW keyboard connected (i.e. SIM) try the following input

[ ] Entering any digit<PHONE_NUMBER>) works
[ ] Entering decimal number separator (i.e. . for us local or , for jp locale) works
[ ] Entering multiple decimal number separators does not work
[ ] Entering anything else does not work

I had the opportunity to run on my device and have a couple suggestions that can improve (IMO) the UX:

How it currently works, we can add as much decimals as we want. What do you think if we allow the user to type a max of 2 decimals (or whatever is acceptable for the current localization)?
If we tap any amount, clear the textField, and tap anywhere on the screen to dismiss the keyboard, the textField will remain without text. I think it would be a good idea to reset the field to the minimum if this happens.

I can also create a card/PR to fix this, since it seems to be beyond the scope of this PR.

Thanks for the suggestions @Scollaco
I think for the amount of digits, we don't really have localized variants and I can imagine some currencies might support 3 some might prefer 2 so for now I would keep it this way and additionally fix this later on.
As for dismissing the keyboard when the field is empty, I believe I've discussed this with Danny and you're right..I'll see what I can do about it (since the logic is triggered on the VC not on the VM).
CC: @dannyalright in case you're strongly opinionated about any of these.

good eye, @Scollaco.

If we tap any amount, clear the textField, and tap anywhere on the screen to dismiss the keyboard, the textField will remain without text. I think it would be a good idea to reset the field to the minimum if this happens.

This is what I imagined would happen—the field would reset to the minimum.


A mirror for Guix?

Hi,
Would the Micro Mirror project potentially be interested in mirroring Guix?
I follow your Mastodon posts about the HP T620 devices and other topics with great interest!
Guix currently serves about 4.3 TB of continuously built artifacts from servers in Berlin (at the Max Delbrück Center for Molecular Medicine) and Bordeaux. We are popular in the academic high-performance segment and are going mainstream.
I personally live about two miles from Hurricane Electric's FMT2 data center.
Thanks for considering!
Kind regards
Felix Lechner

We can certainly explore pulling it into mirror.fcix.net. The Micro Mirrors are reserved for the highest demand projects, so it's unlikely that Guix has the CDN efficiency numbers to justify it.
The one thing we do require is a standard rsync upstream and load balancer to direct users to our mirror. Does Guix have that set up? I'm not seeing any mention of a MirrorBits or MirrorBrain running.

It looks like Guix is carried as part of the GNU project. The download links on https://guix.gnu.org/en/download/ seem to unfortunately point only at the tier0 GNU server and not the load balanced URL that redirects to the mirrors.
Is that the build artifacts you're talking about, or is there another folder of artifacts prior to what ends up under /gnu/?

Hi,
Having followed your blog, I believe that your proficiency with networks exceeds that of our six hundred contributors combined.
Your secondary DNS service, for example, is the coolest thing I have seen in a while. I was so inspired that I packaged bgpq3 for Guix in hope of eventually winning you as a user for our "one-minute" rapid deployment.
In Guix, system configurations usually a single file. I regularly move services from one device to another using just copy and paste, followed by guix deploy.
The build artifacts are served from https://ci.guix.gnu.org/ and https://bordeaux.guix.gnu.org/. Both are substitute servers, which means that users can draw on prepackaged build artifacts if their own equipment is too slow to build for themselves.
It usually is.
I spoke with the operators of those two servers and received permission to contact you. They know about your rsync requirement and your DNS multicast wizardry, but I'm a little bit helpless beyond that.
Kind regards
Felix Lechner

Got it, so the substitute servers are kind of like the macports mirrors.

Ignoring the build artifacts for a moment, I think all the download links on https://guix.gnu.org/en/download/ should be pointed at ftpmirror.gnu.org/... instead of ftp.gnu.org/..., because then mirror.fcix.net and all the other community mirrors are in play for your stable releases, which aren't currently the case.

For the substitute servers, how do clients pick one or the other? Is there a single URL that the build clients use which gets 302ed to these two servers and we're looking at adding a third one? Or does the client retrieve a list of servers to pull from and select it on their own? Essentially, if we pull this folder into mirror.fcix.net, how will clients automatically start using us?

How big of a folder of build artifacts are we talking about here? The /gnu/guix/ folder is only 11GB, so would it be right to liken the two substitute servers as the package repo where the /gnu/ folder is just the install media? Is the 4.3TB number the folder size? or the daily traffic number?

Hi,
I googled "Macports mirrors" and suppose they are similar. Substitute servers are different in that they continuously rebuild packages whose prerequisites have changed.
In Guix, all those package versions can peacefully co-exist (and regular users can install them at the same time without superuser privileges). When you install a Guix software package you also get the exact prerequisites with which the software was built.
Everything is fully reproducible. The design is different from many other Linux distributions, but the system eliminates entire classes of bugs and uncertainties. For example, there are no more missing shared library symbols.
Regarding your point 1, I will talk to the Guix web folks about linking to https://ftpmirror.gnu.org instead. Thank you for the suggestion!
The releases are used only for initial installations. Users will do a guix pull at their earliest opportunity to get the latest software.
As for your point 2, clients know about both substitute servers. I am not sure how they are prioritized at the moment. The servers rebuild packages independently. Having two different servers, plus the user's own equipment, allows users to check that their software is reproducible.
A single timestamp in the build products will render a build not reproducible.
The best way to start using a new mirror might be your DNS multicast magic. Does it work only for small UDP queries or also for large file transfers?
Regarding your point 3, I know that bordeaux keeps 4.3 TB of substitutes on hand. Some of those are dated and made available merely because users are generally slow to issue guix pull. (Due to poor speeds currently, it tends to be a somewhat expensive operation.) As I hinted before, that command causes users to request the latest versions of all packages going forward.
In addition, the substitute servers keep older versions on hand to enable client-side rollbacks in case there is unexpected breakage. On occasion, a new version of something is defective. Users can then just reinstall the previous version. In fact, both versions can be installed at the same time.
The ingenious use of symbolic links and environment variables makes that magic possible. I spent a long time with a major Linux distribution. Guix is the most exciting operating system I have seen in many years.
Kind regards
Felix Lechner

Hi,
Per your kind instructions, all links on the download page (item 1) now point to https://ftpmirror.gnu.org.
Felix

To follow up on this, looking at the two Guix build servers, it seems like if Guix wanted to scale serving the pre-built packages horizontally, it would make sense to set up a real mirroring infrastructure using something like MirrorBits or MirrorBrain and have a /guix/ and /guix-vault/ modules so the latest builds could be served from several mirrors, and if users wanted to roll back to an older build those could be available in the vault module.

Hi Ken,
You know everything about networking. Would you please be so kind to offer advice why GNU Guix has poor download speeds?
The main artifact server in Berlin, Germany serves files at great speeds in excess of 30 MB/s to some folks in Europe, but only at 500 kB/sec to many others (including myself). Many believe the issue is peering.
The fast connections are mostly located on European research networks. They probably tie directly to Germany's DFN. Is the poor connectivity in the U.S. related to the Hurricane Electric / Cogent problem, or is there another peering issue?
Here some stats from people for a related set of backup servers.
I tie into Hurricane Electric via Sail Internet, a Fremont ISP, but my speeds are also poor. My static IP is <IP_ADDRESS>.
Here is a large test file that may help with a diagnosis.
wget https://ci.guix.gnu.org/nar/lzip/c6qpr19zjlmvb729d01n7p7pfn65a9il-stellarium-23.2

Thank you so much!
Kind regards
Felix

I'm seeing the same 600kBps-1MBps sometimes, but then other times I'm seeing north of 100Mbps. Regardless of congested peering, not particularly shocking given how physically far away the box is. With a lot of work you might be able to find a specific smoking gun link, but getting anyone to fix it is unlikely.
[mirror@codingflyboy ~]$ wget https://ci.guix.gnu.org/nar/lzip/c6qpr19zjlmvb729d01n7p7pfn65a9il-stellarium-23.2 -O /dev/null
--2023-08-30 11:22:15--  https://ci.guix.gnu.org/nar/lzip/c6qpr19zjlmvb729d01n7p7pfn65a9il-stellarium-23.2
Resolving ci.guix.gnu.org (ci.guix.gnu.org)... <IP_ADDRESS>
Connecting to ci.guix.gnu.org (ci.guix.gnu.org)|<IP_ADDRESS>|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 262435305 (250M) [application/octet-stream]
Saving to: ‘/dev/null’

/dev/null           100%[===================>] 250.28M  11.8MB/s    in 39s

2023-08-30 11:22:56 (6.38 MB/s) - ‘/dev/null’ saved [262435305/262435305]

[mirror@codingflyboy ~]$ ping ci.guix.gnu.org
PING ci.guix.gnu.org (<IP_ADDRESS>) 56(84) bytes of data.
64 bytes from <IP_ADDRESS> (<IP_ADDRESS>): icmp_seq=1 ttl=51 time=145 ms
64 bytes from <IP_ADDRESS> (<IP_ADDRESS>): icmp_seq=2 ttl=51 time=144 ms
64 bytes from <IP_ADDRESS> (<IP_ADDRESS>): icmp_seq=3 ttl=51 time=144 ms
64 bytes from <IP_ADDRESS> (<IP_ADDRESS>): icmp_seq=4 ttl=51 time=144 ms
^C
--- ci.guix.gnu.org ping statistics ---
4 packets transmitted, 4 received, 0% packet loss, time 3003ms
rtt min/avg/max/mdev = 144.353/144.419/144.531/0.068 ms

So given that 144ms latency, I would suspect that the speed of light is more your issue than any specific congested peering, but it's also possible there's some congestion somewhere hurting it.
The real fix is not having users downloading from 140ms away if you want downloads to be faster than that. Time to set up a MirrorBits instance and routing clients to servers on the same continent as them.


avoid using symbol names that might raise complaints/warnings

This addresses https://github.com/Morgan-Stanley/hobbes/issues/32

Can such a change attempt work also without a merge commit at the beginning?
Would other commit descriptions be a bit nicer for the software users?


fix fix wrong replica allocation after restore

Proposed changes
Issue Number: close #xxx
Problem summary
How to reproduce:

create a table with replica allocation, eg:"replication_allocation"="tag.location.group_01:1, tag.location.group_02:1, tag.location.group_03:1"

Backup this table
Restore this table with specific replication allocation, eg: "replication_allocation" = "tag.location.default: 3"
After restore, executing show create table xxx, you will be the replication_allocation is still:"replication_allocation"="tag.location.group_01:1, tag.location.group_02:1, tag.location.group_03:1"

Not what we expected
But if you execute show partitions from xxx, the replication allocation of each partition is what we expected:"replication_allocation" = "tag.location.default: 3"

This is because when doing restore job, we forget to set the "default" replica allocation property of the table.
And the result of show create table is got from "default" replica allocation property, not from the real replica property of each partition
Checklist(Required)

Does it affect the original behavior:

[ ] Yes
[x] No
[ ] I don't know

Has unit tests been added:

[x] Yes
[ ] No
[ ] No Need

Has document been added or modified:

[ ] Yes
[ ] No
[x] No Need

Does it need to update dependencies:

[ ] Yes
[x] No

Are there any changes that cannot be rolled back:

[ ] Yes (If Yes, please explain WHY)
[x] No

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 37.89 seconds
load time: 549 seconds
storage size:<PHONE_NUMBER>4 Bytes
https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20221022095151_clickbench_pr_32725.html


Fix note callout to be warning.

In #8071 I updated the Stackdriver logging docs to use the default namespace throughout, and added a callout warning that this daemon has issues on non-GKE platforms. @x13n pointed out that this callout syntax was wrong, and it still rendered properly, but as a note instead of a warning. This fixes that.

Something got borked with this PR. I'm going to close and do another one.


changes to demo apps to work with 6.1 version

I dont have permission to create mapr-6.1.0 branch on repo. So sending the PR to merge into master branch. Please decide to which branch (master or mapr-6.1.0)  this change has to merged.

I added you as a core maintainer on the mapr-demos account
On Mon, Oct 22, 2018 at 5:17 PM Harshavardhan Thirividi <
<EMAIL_ADDRESS>wrote:

I dont have permission to create mapr-6.1.0 branch on repo. So sending the
PR to merge into master branch. Please decide to which branch (master or
mapr-6.1.0) this change has to merged.
You can view, comment on, or merge this pull request online at:
https://github.com/mapr-demos/mapr-db-60-getting-started/pull/9
Commit Summary

created mapr-6.1.0 branch and pom changes to reflect 6.1 version
strings are picked.
removing debug statement
updates to README.md to reflect the latest yelp dataset available.

File Changes

M README.md
https://github.com/mapr-demos/mapr-db-60-getting-started/pull/9/files#diff-0
(22)
M
ojai-examples/src/main/java/com/mapr/db/examples/OJAI_005_YelpComplexQuery.java
https://github.com/mapr-demos/mapr-db-60-getting-started/pull/9/files#diff-1
(16)
M pom.xml
https://github.com/mapr-demos/mapr-db-60-getting-started/pull/9/files#diff-2
(10)
M spark-examples/pom.xml
https://github.com/mapr-demos/mapr-db-60-getting-started/pull/9/files#diff-3
(13)

Patch Links:

https://github.com/mapr-demos/mapr-db-60-getting-started/pull/9.patch
https://github.com/mapr-demos/mapr-db-60-getting-started/pull/9.diff

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/mapr-demos/mapr-db-60-getting-started/pull/9, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAPSeuKkIiblpzOgn4UhhZk1IknhDE9Wks5unmAtgaJpZM4X0br0
.


API Authentication

Are you planning to add https://docs.ntfy.sh/subscribe/api/#authentication functionality to the node?
Temporary I added Authorization header to the request, but it'd be gr8 to have UI for configure credentials etc.

How did you do this, @rgolab ? With the n8n-nodes-ntfy package? Or via a custom outgoing webhook?

@skrollme I modified code of n8n-nodes-ntfy package - added header in the dist/nodes/Ntfy/Ntfy.node.js file

Thanks @rgolab. Tried it by myself and it is working in my n8n instance. I will create a PullRequets out of my state

See #6

Thanks for the fix @skrollme! I've been busy with other projects and haven't had time to work on this recently, so I appreciate the help.

I say "thank you" for the plugin you created in the first place, @cryingpotat0 ❤

One additional question @cryingpotat0 : Do you plan to release a new version of the package (including the support for authentication) at npmjs? I'm asking since I plan to overhaul my n8n setup soon and it would be easier to simply install the module from npmjs :D

Done!

Awesome, thank you, @cryingpotat0 👍


move initial peer dialing to swarm

Getting a set of connected peers and exchange messages with them frequently is required for a lot of protocols, for now this is managed in the gossip protocol, but we want to take this out to swarm and expose it to gossip the same is we do to other protocols.
related to #268

Was done inside #310


aztools/Az.Tools.Migration/New-AzUpgradeModulePlan.md - -ToAzVersion wrong info

Prerequisites

[X] Existing Issue: Search the existing issues for this repository. If there is an issue that fits your needs do not file a new one. Subscribe, react, or comment on that issue instead.
[X] Descriptive Title: Write the title for this issue as a short synopsis. If possible, provide context. For example, "Typo in Get-Foo cmdlet" instead of "Typo."
[X] Verify Version: If there is a mismatch between documentation and the behavior on your system, ensure that the version you are using is the same as the documentation. Check this box if they match or the issue you are reporting is not version specific.

Links
https://github.com/Azure/azure-powershell-migration/blob/main/powershell-module/help/New-AzUpgradeModulePlan.md
Summary
In the docs we say:
"-ToAzVersion
Specifies the Az module version to upgrade to. Currently, only Az version 10.3 is supported."
But on the samples we have -ToAzVersion latest everywhere and the latest version is the 11
https://www.powershellgallery.com/packages/Az/11.0.0
The doc should say something like " only Az version after 10.3 is supported, you can use latest for the latest version"
Details
In the docs we say:
"-ToAzVersion
Specifies the Az module version to upgrade to. Currently, only Az version 10.3 is supported."
But on the samples we have -ToAzVersion latest everywhere and the latest version is the 11
https://www.powershellgallery.com/packages/Az/11.0.0
The doc should say something like " only Az version after 10.3 is supported, you can use latest for the latest version"
Suggested Fix
The doc should say something like " only Az version after 10.3 is supported, you can use latest for the latest version"

This issue was originally logged in the azure-docs-powershell repo: MicrosoftDocs/azure-docs-powershell#2819. It's being moved to this repo because the article is autogenerated reference content and the source resides in this repo. Please follow-up with @hribeiro-msft if you have any questions.


Hotel - remapped with callback routing

This will be a routing managed with a rule
Make the target link /bananas/rule
Add a routing rule to config/routes.php, which remaps any request with the word "banana" in it, to the Golf controller, but using our own code

$route['bananas/rule] = function($fruit,$verb) {
    return 'golf';
};

Yes, this is lame, but my mind is not coming up with a good example that can be easily implemented
This will be handled by controllers/Golf::index(), already existing

done


Add description field to StubMapping

the way i figure, if the field is missing in existing mappings the field will get a null value so it should be backward compatible.

Closing due to inactivity


missing quote on README

this line on README is missing another single quote.
gem 'guard-rspec, '~> 4.7`

Fix here: https://github.com/guard/guard-rspec/pull/380
Thanks for reporting!


Speedup forge install with git shallow clone

Component
Forge
Describe the feature you would like
Right now, it appears that forge install clones the entire history of the git submodules.
But what we actually need is just the latest commit or a particular commit.
If possible, we can make it clone only the relevant commit.
https://github.blog/2020-12-21-get-up-to-speed-with-partial-clone-and-shallow-clone/
Of course, we will still need to clone all the dependencies recursively.
Additional context
No response

yes please, i'm finding forge install to be very slow, taking several minutes to install a single dep

Still having the same issue


Relationship between CI and significance tests

On this page there is this strong statement of equivalence.

There is a direct relationship between the CI around an effect size and statistical significance of a null-hypothesis significance test. For example, if an effect is statistically significant (p < 0.05) in a two-sided independent t-test with an alpha of .05, the 95% CI for the mean difference between the two groups will not include zero.

I always thought that this approach was usually reasonable in practice, but not true by definition. As in: I thought it was theoretically possible to construct valid confidence intervals which could not be used in the way described here.
A bad example of this might be:

Compute a 5% (yes five, not a typo) confidence interval in the normal way.
Define a 95% confidence interval as the set of two ranges [-infinity, lower_bound_5%] and [upper_bound_5%, +infinity].

Obviously one would never do that, but I think that would be a valid 95% confidence interval, because it "covers the true parameter 95% of the time" (which I think is the only requirement for a CI to be valid). Yet it cannot be used in the way described in the quote.
I would love to be corrected here. Are there any references that explain why the relationship between CI and statistical significance is indeed direct?

Hi, Lukas! The statement is indeed only true if you compute a CI 'the normal way' as you describe it - like a CI around a mean difference. It is possible, in theory, to contruct different 95% CI which does not correspond to a statistical test. To keep the text readable, I never go into detail in hypothetical edge cases. I feel that's a bit more defensible in a text that provides a formal treatment of these issues, while my textbook has a bit more applied focus. In general, any CI that you will get out of statistical software packages will show this relationship. I say in general, because there are sometimes dozens of ways to compute a CI, some with slightly better coverage, and then the relationship does not formally hold (but this happens at a number after the digit that has little relevance in practice).

Clear. Fair. Thank you. Good to hear I was not completely wrong all those years. 😅

I think another more technical consideration might be that CIs might be approximated (for example using Fieller's theorem) rather than exact. Using approximate CIs rather than exact p-values would impact precision.


docs: Integrations add drone ntfy

I recently wrote drone-ntfy, a drone plugin adding ntfy support to pipelines. This PR adds a link to my project to the integrations page.

Very cool. Thank you for your project :heart:


az functionapp vnet-integration add removes IP whitelisting from function apps. This was not happening 2-3 weeks ago. Also we were able to reference the vnet and subnet by name even if in a different resource group to the function app. This is no longer working and we need to add the full vnet/subnet resourceID

[Enter feedback here]

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: f714ea49-754e-486f-938d-5394399d233a
Version Independent ID: 2b0a24e2-be87-4dee-9991-5e35589a3b07
Content: az functionapp vnet-integration
Content Source: latest/docs-ref-autogen/functionapp/vnet-integration.yml
Service: azure-functions
GitHub Login: @rloutlaw
Microsoft Alias: routlaw

@madsd is this something to do with CLI moving to the new api? //CC @StrawnSC

@panchagnula / @madsd I just double checked and we haven't changed the CLI code for az functionapp vnet-integration add for the past few months, so it seems like this change is coming from the API

@sdowie73 this issue should have been mitigated. Sorry for the inconvenience.


Add issue template

This will help to ensure that any issue received will be organized and straight to the point.

I'm closing as this looks like a duplicate of #40 as both the PR and Issue template was added @lennyAiko


[BUG/ISSUE] Tray icon show not show the search results for installed packaged and available updates

Before submitting the issue

[X] I have checked that the bug is not a duplicate or, if it is, it needs to be reopened
[X] I have checked that I am running the latest version of WingetUI
[X] I have tried resetting and reinstalling WingetUI and the issue persisted or happened again
[X] I have checked the FAQ section for solutions
[X] I have read the contributing guidelines and I agree with the Code of Conduct

Describe the bug
When having a search filter in the "Installed Packages" and/or "Software Updates" tabs, the tray icon lists are being filtered as well and show whatever the search results. which of course is not right and is not right as the tray icon shows different number of "XXX packages found" and "Available updates: X".
See the screenshots below for the filtered results (result that outputs an empty package list):

"Installed Packages":

"Software Updates":

To Reproduce
Steps to reproduce the behaviour:

Go to "Installed Packages" and/or "Software Updates" tabs
Search for something
Open tray icon and see the contents of the "XXX packages found" and "Available updates: X"
They are being filtered according to the search results which should not be.

Expected behaviour
No filtering should be in place so that it won't be confusing, or either indicate that it's being filtered in some way in the tray icon.

Actually, what I plan to do is to add the search box on the context menu as well, so context-menu filtering is also possible.

This issue does not apply to WingetUI 3.0.0+/UniGetUI 3.1.0+


subnet aggregation issue

filter19.txt
filter20.txt
filter23.txt
filter01.txt
When aggregating IP addresses belonging to a single subnet, sometimes their traffic % will go to the top-level * aggregate instead of the subnet, even if there is enough traffic % from all the aggregated IP addresses combined to keep the subnet itself over the threshold range.
I attach 4 small .txt files with an example, with their respective threshold levels as part of the filename. The relevant part is the [src address] section.
There are 21 IP addresses in total, 20 from the same subnet (<IP_ADDRESS>/25) and 1 from outside.  With threshold 0.1% (filter01.agr) all addresses are shown. With threshold 1.9% (filter19.agr) some of the subnet addresses got aggregated to the subnet <IP_ADDRESS>/25 as expected, and the subnet contains a percentage of traffic (2.53%) over the 1.9% threshold  so itself is not aggregated. At threshold 2.0% and above however (filter20.agr, filter23.agr), no more addresses are aggregated but the subnet itself is aggregated to *, with the exact same traffic % as before, 2.53%)
I thought this might be because traffic % information from aggregated IP addresses is not always gathered and summed up on parent nodes because of post-order traversal, so the small % traffic that make up the  2.53%  sum get aggregated to * before they have a chance to get summed and rise above  the threshold, but I am not sure if that is the cause.  And when looking at packet % instead of byte %, the subnet was sitting comfortably above the threshold at 7.89% in both cases.

Ok apparently this is a design decision.
Subnets are judged more strictly against threshold, where the threshold is multiplied by
{ 1, 64, 64, 64, 64, 64, 64, 64,
     16, 32, 32, 32, 32, 16, 16, 16,
      4,  8,  8,  8,  8,  8,  4,  4,
      1,  4,  4,  4,  2,  2,  2,  4, 1};

depending on the length of the IP address/subnet.    I do not understand the reasoning behind this however


Network share doesn't work as normal import folder, only as drop source

If I add a network share as a normal folder it doesn't work:

[2016-10-06 19:26:56:836] Debug|BackgroundWorker.OnDoWork => MainWindow.workerImport_DoWork => Importer.RunImport_NewFiles ImportFolder: NA || C:\Users\Timofej\Desktop\JMM test\Library
[2016-10-06 19:26:56:845] Debug|BackgroundWorker.OnDoWork => MainWindow.workerImport_DoWork => Importer.RunImport_NewFiles ImportFolder: NA || \TIM-PC\Torrents\A Channel (2011) [Doki][1280x720 h264 BD AAC]
[2016-10-06 19:26:56:854] Debug|BackgroundWorker.OnDoWork => MainWindow.workerImport_DoWork => Importer.RunImport_NewFiles Found 0 files
[2016-10-06 19:26:56:854] Debug|BackgroundWorker.OnDoWork => MainWindow.workerImport_DoWork => Importer.RunImport_NewFiles Found 0 videos
[2016-10-06 19:26:56:854] Debug|BackgroundWorker.OnDoWork => MainWindow.workerImport_DoWork => Importer.RunImport_DropFolders Found 0 files
[2016-10-06 19:26:56:871] Debug|BackgroundWorker.OnDoWork => MainWindow.workerImport_DoWork => Importer.RunImport_DropFolders Found 0 videos

If I check drop source checkbox jmm is able to see files inside:

[2016-10-06 19:25:49:205] Debug|BackgroundWorker.OnDoWork => MainWindow.workerImport_DoWork => Importer.RunImport_DropFolders ImportFolder: NA || \TIM-PC\Torrents\A Channel (2011) [Doki][1280x720 h264 BD AAC]
[2016-10-06 19:25:49:205] Info|BackgroundWorker.OnDoWork => MainWindow.workerImport_DoWork => Importer.RunImport_DropFolders Processing File 1/25 --- \TIM-PC\Torrents\A Channel (2011) [Doki][1280x720 h264 BD AAC]\[Doki] A Channel - 01 (1280x720 h264 BD AAC) [7B48DEF0].mkv
[2016-10-06 19:25:49:336] Info|BackgroundWorker.OnDoWork => MainWindow.workerImport_DoWork => Importer.RunImport_DropFolders Processing File 2/25 --- \TIM-PC\Torrents\A Channel (2011) [Doki][1280x720 h264 BD AAC]\[Doki] A Channel - 02 (1280x720 h264 BD AAC) [4E702682].mkv
[2016-10-06 19:25:49:450] Info|BackgroundWorker.OnDoWork => MainWindow.workerImport_DoWork => Importer.RunImport_DropFolders Processing File 3/25 --- \TIM-PC\Torrents\A Channel (2011) [Doki][1280x720 h264 BD AAC]\[Doki] A Channel - 03 (1280x720 h264 BD AAC) [552095AC].mkv

It is a false positive since drop source was mounted as read-only.