Reduce python-for-android initial loading.

Reducing the loading time is a challenge, and here is my brainstorming so far. The android APK is a zip  file. Importing from a zip usually mean that we cannot import dynamic libraries too (.so).
The egg file format resolve that issue: by replacing distutils to setuptools in kivy, we can build a .egg. The native files are extracted on demand from the .egg. To use a .egg, you just need to copy it from the right python directory, or add it in the sys.path. But the .egg is a file too.

Is python would be able to load .egg from a .apk, without any decompression?
android can load dynamic library directly from the APK. would we be able to do the same? instead of letting the .egg extracting the file outside the egg for dlopen, could we try to use android API instead?
both approach don't resolve the data access, but it look like pkg_resources.resource_filename('kivy', 'data/glsl/header.vs') is automaticaly extract the file in the temporary dir, and ready to be used afterwise with open(). is pkg_resources.resource_filename() is sufficient? do we need to patch open()? do we need to make kivy pkg_resources dependant ?

That's all, i'll check all of thoses points and wrote the result here.

Want to back this issue? Post a bounty on it! We accept bounties via Bountysource.

Does this (https://www.androwish.org/index.html/wiki?name=ZIP+virtual+file+system) do anything of what you proposed when said "mount a zip"? Should i expect we talk about to do "it" with non-root? ¿It is /local/tmp folder good enough to place things?
I'm sorry if nothing has sense after all, just looked a bit and wanted to ask about.

Yes we can

Can you do it
?

I meant to close issue

Yea i understood that, I just was wondering if you had the rights to do that, anyways now that you have confirmed, please close it whenever you can

Closing as stale.


Scss partials not reloading when compass-rails is present

This seems related to rails/sass-rails#269
Steps to reproduce

Clone the repository https://github.com/Intrepidd/compass-rails-reload-bug
bundle install
launch rails server and go to http://localhost:3000/home/index
change color in test/home.scss file
reload your page, it should NOT change
rm -rf tmp/cache
remove compass-rails from gemfile
try again, this time it SHOULD work

@Intrepidd  So, I'm having some trouble with this it looks like we're not properly tracking asset dependencies, but I don't know where to look. I'm going to keep at it, but if you know more about Sass-rails I'd appreciate the help.

See #208

I don't know much about the code of compass-rails and sass-rails but I'll
try to have a look
On Sat, Jan 3, 2015, 05:33 Daniel P. Clark<EMAIL_ADDRESS>wrote:

See #208 https://github.com/Compass/compass-rails/issues/208
—
Reply to this email directly or view it on GitHub
https://github.com/Compass/compass-rails/issues/210#issuecomment-68583023
.

@danielpclark , I had a quick read through the code of sass-rails and compass-rails and indeed, I think you may be onto something :)
It was probably done otherwise before, but right now, in the evaluate method of the sass template that we override, we're not setting the dependencies as it's done in sass-rails

Give master a try, it works in my rails 4.1 app, but I have some older ones to test and I'll be adding more testing of the compilation step on the master branch.

@craigmcnamara, I was having the same issue here. I just pulled master, and it looks like it is working for me with sass-rails 5.0.1. I edited a partial, refreshed, and the changes showed up in my stylesheet and app.

I just cut 2.0.2.


Addition of an extra state so that it behaves as a tri state switch

Want to implement something like a switch that has three states, "ENABLED,PENDING,DISABLED" . Is it possible that something like this can be implemented
Something like this?

@velsonjr start with something like: https://codesandbox.io/s/hidden-microservice-17cfq and style it to suite your needs.
:notebook: this also can resolve https://github.com/gfazioli/react-toggle/issues/17 and https://spectrum.chat/react/help/custom-component-for-a-switch-with-off-pending-on-state-reactjs~02599d24-9098-4255-b3e4-610d74d4f777

@ChristianMurphy How do you add "optionClass" property?

The way it's documented in the readme.
See the example in https://spectrum.chat/react/help/custom-component-for-a-switch-with-off-pending-on-state-reactjs~02599d24-9098-4255-b3e4-610d74d4f777
@velsonjr please be respectful of open source maintainers time, we're helping folks for free, often on personal time.
Posting the same question in multiple places: requires duplicate effort to answer, wastes time, and can be frustrating.


Code for generating mDATA_train.pkl and mDATA_test.pkl

Thank you for your great work. I have studied on your code for some days and find out that I cannot generate the same pickle dataset with the existing code in this repo. I used the ./Patch_Generation/gen_patch_noLabel_stride_MultiProcessing_multiScales.py with default settings, and then use ResNet50 with 'https://download.pytorch.org/models/resnet50-0676ba61.pth' and 'https://download.pytorch.org/models/resnet50-19c8e357.pth' as pertained weights (with the same usage of CLAM) but they both cannot generate the same embedding as the provided pickle dataset. For many cases, the number of patches is different; and for all the cases, the specific embedding results are different (I just print them out and compare them with each other). On my self-generated dataset, DTFT-MIL can only achieve a ~80%AUC, but it is still better than AB-MIL.
I was recently researching on some different patch embedding methods for WSIs and I really want to figure out how you generate these pickle files. Appreciate it if you could release that part of code. Thank you very much.

Hi @wk5475 I did some work on TCGA dataset recently but found there are only about 3 million patches in level 1 of this dataset. Did you encounter the same problem or did I do something wrong?


[Enhancement] Remove the get schema call in TabletReader.

This patch first fetches the tablet metadata, and then obtains the tablet schema from it, avoiding extra gets of the tablet schema. This also prevents duplicate fetching of the tablet schema.
What type of PR is this:

[ ] BugFix
[ ] Feature
[x] Enhancement
[ ] Refactor
[ ] UT
[ ] Doc
[ ] Tool

Does this PR entail a change in behavior?

[ ] Yes, this PR will result in a change in behavior.
[x] No, this PR will not result in a change in behavior.

If yes, please specify the type of change:

[ ] Interface/UI changes: syntax, type conversion, expression evaluation, display information
[ ] Parameter changes: default values, similar parameters but with different default values
[ ] Policy changes: use new policy to replace old one, functionality automatically enabled
[ ] Feature removed
[ ] Miscellaneous: upgrade & downgrade compatibility, etc.

Checklist:

[ ] I have added test cases for my bug fix or my new feature
[ ] This pr needs user documentation (for new or modified features or behaviors)

[ ] I have added documentation for my new feature or new function

Bugfix cherry-pick branch check:

[x] I have checked the version labels which the pr will be auto-backported to the target branch

[x] 3.2
[x] 3.1
[ ] 3.0
[ ] 2.5

[FE Incremental Coverage Report]
:heart_eyes: pass : 0 / 0 (0%)

[BE Incremental Coverage Report]
:disappointed: fail : 10 / 13 (76.92%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
src/storage/lake/tablet_reader.cpp
9
12
75.00%
[79, 168, 171]

:large_blue_circle:
src/storage/lake/tablet.cpp
1
1
100.00%
[]

@Mergifyio backport branch-3.2

@Mergifyio backport branch-3.1


Use LatLng from latlong2 instead of PolylinePoint

the latlong2 package is well maintained and it's widely used for latitude-longitude representation. The usage of latlong2 would allow inter-compatibility with other packages like flutter_map.

Thank you for highlighting the benefits of latlong2. It's a well-maintained and widely used package for representing latitude and longitude coordinates. Interoperability with other packages like flutter_map is definitely a valuable consideration.
However, I'd like to raise awareness of a potential conflict with the latlng class included in the core google_maps_flutter package used for Google Maps integration in Flutter. Both packages define a class named LatLng, which could lead to confusion and errors for developers who use both latlong2 and google_maps_flutter in their projects.


Disable sharing memory for the stack collator

Disable sharing memory when stacking tensors to avoid warnings from Pytorch.

Job PR-1871-2 is done.
Docs are uploaded to http://autogluon-staging.s3-website-us-west-2.amazonaws.com/PR-1871/2/index.html


Ci/rebuild base image

trying to get cscs pipeline rebuild the base images

I think we still need one build with MKL. It can be without elpa.

Here for example?
RUN spack env create -d /sirius-env-cuda && \
    spack -e /sirius-env-cuda add  "sirius@develop %gcc build_type=RelWithDebInfo +tests +apps +cuda +magma ^mpich ^intel-oneapi-mkl threads=openmp" && \
    spack -e /sirius-env-cuda develop -p /sirius-src sirius@develop && \
    spack -e /sirius-env-cuda install --only=dependencies --fail-fast

I'll wait for the current run to finish, it seems it does not cache docker layers and restarts from scratch.

Here for example?
RUN spack env create -d /sirius-env-cuda && \
    spack -e /sirius-env-cuda add  "sirius@develop %gcc build_type=RelWithDebInfo +tests +apps +cuda +magma ^mpich ^intel-oneapi-mkl threads=openmp" && \
    spack -e /sirius-env-cuda develop -p /sirius-src sirius@develop && \
    spack -e /sirius-env-cuda install --only=dependencies --fail-fast

I'll wait for the current run to finish, it seems it does not cache docker layers and restarts from scratch.

I pushed slighly different version with explicit scalapack.

some rocblas dependency failed with:
    280    checking whether program_invocation_name is defined... yes
     281    checking whether program_invocation_short_name is defined... yes
     282    checking for pidfd_open... no
     283    checking for __NR_pidfd_open... yes
     284    checking for ncursesw... no
     285    checking for ncurses... no
  >> 286    configure: error: ncurses support missing/incomplete (for partial b
            uild use --without-ncurses)

Seems ubuntu changed ncurses package upstream which was picked up by spack external find

cscs-ci run

@toxa81, I'm confused too, the timings on the CI per test didn't  look unusually high. Is it possible jfrog is lagging when it tries to pull the image. The size is 12GB, afaik same as before.

oh...come on! now there is no scalapack eigen-solver in scalapack build

Sorry! I was not careful with the specs.

Sorry! I was not careful with the specs.

No worries, Simon!
I believe it was correct. I checked the output of "build cuda image" job which builds "/sirius-env-cuda-mkl-mpich". All was set properly.

Sorry! I was not careful with the specs.

No worries, Simon! I believe it was correct. I checked the output of "build cuda image" job which builds "/sirius-env-cuda-mkl-mpich". All was set properly.

Indeed, then I broke it with the last commit. I've removed it via force push, lets hope it will pickup the prebuilt container again.

Seems the pitfall was that both
build cuda image openblas (aka /sirius-env-cuda) and build cuda image (aka /sirius-env-cuda-mkl-mpich) pushed the container to jfrog.
https://github.com/electronic-structure/SIRIUS/blob/ci/rebuild-base-image/ci/cscs-daint.yml#L30
Tests seems running fine now.

I agree that JFrog might be lagging. The failures happen randomly

Both hang in band parallel test for He.

cscs-ci run default

cscs-ci run default

@simonpintarelli fantastic work!


urllib.error.HTTPError: HTTP Error 403: Forbidden

Traceback (most recent call last):   File "./covid19_status.py", line 24, in <module>     df = pd.read_html(url, index_col=0)[0]   File "/usr/lib/python3.8/site-packages/pandas/io/html.py", line 1085, in read_html     return _parse(   File "/usr/lib/python3.8/site-packages/pandas/io/html.py", line 895, in _parse     tables = p.parse_tables()   File "/usr/lib/python3.8/site-packages/pandas/io/html.py", line 213, in parse_tables     tables = self._parse_tables(self._build_doc(), self.match, self.attrs)   File "/usr/lib/python3.8/site-packages/pandas/io/html.py", line 733, in _build_doc     raise e   File "/usr/lib/python3.8/site-packages/pandas/io/html.py", line 714, in _build_doc     with urlopen(self.io) as f:   File "/usr/lib/python3.8/site-packages/pandas/io/common.py", line 141, in urlopen     return urllib.request.urlopen(*args, **kwargs)   File "/usr/lib/python3.8/urllib/request.py", line 222, in urlopen     return opener.open(url, data, timeout)   File "/usr/lib/python3.8/urllib/request.py", line 531, in open     response = meth(req, response)   File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response     response = self.parent.error(   File "/usr/lib/python3.8/urllib/request.py", line 569, in error     return self._call_chain(*args)   File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain     result = func(*args)   File "/usr/lib/python3.8/urllib/request.py", line 649, in http_error_default     raise HTTPError(req.full_url, code, msg, hdrs, fp) urllib.error.HTTPError: HTTP Error 403: Forbidden
I guess this is caused by a missing user agent that they're blocking?

Hey :)
Worldometer has blocked pandas requests.
Issue fixed  in this commit and this


Update readme with a more realistic example and explain event.detail

Ref: https://github.com/github/text-expander-element/pull/3#issuecomment-513858403. This updates the README code with a more realistic example.
In the real world, instead of rendering the suggestions on the page and filtering on client side, people may fetch('/emoji?q=' + text) to get filtered suggestions from the server side.
On github.com we first fetch, then memoize the fetch response, and then perform client side filtering.
The element code is extracted in this way so it does not dictate filtering and content generation logic.
cc @haacked

Thank you! This is really helpful!


Force push freezes client

Description
Force push freezes client, thread the push after data collection.
Steps to reproduce the bug
No response
Environment
No response
Additional context
No response

Is this referring to the force push action, or just opening the force push dialog? Asking because I've noticed the latter is very slow on a large BNDB; I think it took somewhere in the vicinity of 15-20 minutes to open on the binary I'm working on. I can open a separate issue if this is about the force push logic itself.

@alexrp can you open a new issue for this?


Script @auto-scripts was called via post-install-cmd

Code
$ ./bin/console deploy -v
[...]
Copying the updated code to the new release directory
[user@domain] Executing command: (export APP_ENV=prod; cd /dir/releases/20190919133916 && cp -RPp /dir/repo/* /dir/releases/20190919133916)
----- START -----
Here is mistake: cp -RPp /dir/repo/* /dir/releases/20190919133916)
The * character does not copy files starting with a dot. Please add:
&& cp -R /dir/repo/.e* /dir/releases/20190919133916) && cp -R /dir/repo/.g* /dir/releases/20190919133916)
Only .* cannot be added due to the presence of '..' in the folder.
----- STOP -----
[...]
Installing Composer dependencies
[user@domain] Executing command: (export APP_ENV=prod; cd /dir/releases/20190919133916 && /usr/local/bin/composer install --no-dev --prefer-dist --no-interaction --quiet)
| err :: Script @auto-scripts was called via post-install-cmd
[ERROR] Cancelling the deployment and reverting the changes
[...]
In Process.php line 256:
  [Symfony\Component\Process\Exception\ProcessFailedException] The command "ssh -A user@domain '(export APP_ENV=prod; cd /dir/releases/20190919133916 && /usr/local/bin/composer install --no-dev --prefer-dist --no-interaction --quiet)'" failed.
  Exit Code: 255(Unknown error)
[...]
  Error Output:
  ================
  Script @auto-scripts was called via post-install-cmd
[...]
Error reason
In /dir/releases/201909133916:
assets composer.json config package.json public symfony.lock tests var webpack.config.js bin composer.lock package-lock.json phpunit.xml.dist src templates translations vendor yarn.lock
There are no files starting with a dot (files are present in /dir/releases/20190919133916):
.env .env-test .git .gitignore

Same issue here

please fix it!

Any News?

I solve it adding this lines in deploy.php
 public function beforePreparing()     {         $this->runRemote('cp {{ deploy_dir }}/repo/.env {{ project_dir }}/.env');         $this->runRemote('cp {{ deploy_dir }}/repo/.env.development {{ project_dir }}/.env.development');     }

while I was waiting for a fix to this issue I put my .env file in the shared folder, which I think it's the best thing to do in order to hide sensitive data such as database coordinates and so on

I had simillar issue and i managed to fix that.
In my case It failing because symfony need dev dependencies for execute post-install-cmd composer script. and my production password was not urlencoded.
You cant see detailed error because --quiet option is on.

First way how to fix
Try to run  composer install --no-dev --prefer-dist --no-interaction and move missing dependencies from devDependencies to  dependencies.

Secound way how to fix
You can also ofcourse resolve this by changing composer install flags in your deploy.php file.
.... public function configure() {  ...  ->composerInstallFlags('--no-dev --prefer-dist --no-interaction --quiet') ; } ....
(remove --no-dev option from default settings --no-dev --prefer-dist --no-interaction --quiet)
or
( !!!! remove --quiet option and start deploy with -v option to resolve other petencional problems !!!! )

while I was waiting for a fix to this issue I put my .env file in the shared folder, which I think it's the best thing to do in order to hide sensitive data such as database coordinates and so on

But if the .env is a breaking change, rolling back will become another issue i think.

salut

you should make the .env file and set APP_ENV=prod after that run
composer dump-env prod
then run :
composer install --no-dev --optimize-autoloader


2 add manifest for aterlier toolbox

Closes #2

Your changes do not pass checks.
atelier-toolbox

[x] Description
[x] License
[x] Hashes
[x] Checkver
[x] Autoupdate
[ ] Autoupdate Hash Extraction

All changes look good.
Wait for review from human collaborators.
atelier-toolbox

[x] Description
[x] License
[x] Hashes
[x] Checkver
[x] Autoupdate
[x] Autoupdate Hash Extraction


Class is added that doesn't exist to  element

I have the following in a markdown file:
---
name: Striped Tables
category: Tables
---
Tables in angular/webapps should **only** be used for tabular data.

```table-types.html

		Striped Table Header
		Header 2
		Actions

		Row 1 cell 1
		Row 1 cell 2
		<button>Edit</button>

		Row 2 cell 1
		Row 2 cell 2
		<button>Edit</button>

		Row 3 cell 1
		Row 3 cell 2
		<button>Edit</button>

When it generates the styleguide, the html displays like this:

        Striped Table Header
        Header 2
        Actions

        Row 1 cell 1
        Row 1 cell 2
        <button>Edit</button>

        Row 2 cell 1
        Row 2 cell 2
        <button>Edit</button>

        Row 3 cell 1
        Row 3 cell 2
        <button>Edit</button>

It's adding in a class="table" which isn't in the markdown file, and I have no idea why. It only does this with table elements. Any idea why?

That class is added during the HTML generation step. Looks like it’s being applied too aggressively—we’ll fix!

Fixed in v0.6.8.
Thanks for reporting!


feat(importer): add rabin fingerprinting chunk algorithm

This is required to have feature parity with go-ipfs which supports rabin chunking algorithm.
Rabin chunker supports the following chunkerOptions, defaults mirror those in go-ipfs-chunker.

name
type
default

minChunkSize
Integer
avgChunkSize / 3

avgChunkSize
Integer
262144

maxChunkSize
Integer
avgChunkSize + (avgChunkSize /  2)

window
Integer
16

polynomial
String
0x3DF305DFB2A805

This currently works as is, however the parameters polynomial and windowsize are not configurable by the rabin library used. This makes it difficult to compare the output the go-ipfs implementation, since both these parameters are set to different values there.
Could use some advice on testing, the nature of the rabin chunking makes it difficult to test things like expected block sizes, and number of blocks.
These changes are required for ipfs/js-ipfs/issues/1283

@dordille I finally had a chance to review the code. It looks good so far.
Though the code coverage bot reports a decrease. It took me a while to figure out why, because I saw that you added tests. The problem is that your tests are not actually run, so please make them run and have another look at the coverage.
For further testing, the Go implementation could be an inspiration.

Is there a way to force a jenkins build without pushing a commit, I don't think the current failure is a result of my changes.

@dordille I think only people with merge permissions are able to retrigger a build. Sadly there's currently env related issues (workers running out of disk space). I'll make sure to have a clean run. If it should turn out that the failure is due to your code, I'll let you know. Sorry for the inconvenience.

Jenkins, ugh.  See https://github.com/ipfs/testing/issues/70 for the reasons behind the disk space thing.
Anyway this has been merged & published as<EMAIL_ADDRESS>


Update default PMD version to 6.21.0

Solves issue #197

Check whether pmd_cache_directory already exists before creating directory. This
resolves the error that was preventing multiple PMD release versions from being
cached.

Add console log that informs the user which PMD release version is running.

@azlam-abdulsalam resolved the find_java_home_1.default is not a function error by changing the import declaration of find-java-home to import findJavaHome = require("find-java-home");


Added OAM GBC palette flag constants

These are equivalent to just typing the corresponding number, but I feel like it's useful to explicitly define them.

Given that they are equivalent, I personally don't think they're needed.


894 passwords feedback

https://user-images.githubusercontent.com/1512805/131676542-a5a61bc4-c116-4507-bf24-1546ebea2b97.mov

Show screenshots of complete sign in/password reset flow
Sign in

Reset Password

Close #894, close #892, close #639, close #969

Also, the validation error message is not quite true. The password is 8 characters but the otp_code was wrong.

True! I updated the error message.

I would like to improve the UX though. I'm getting confused by the password and otp_code inputs in the very same UI component. If we cannot put them on different pages, could we at least make a visual split between the two?

I think we should still put them on different pages given the feedback we got from editors. I have a POC for that, but I’m not 100% sure about that yet, so I’d like to do that in a separate PR.
For users that don’t have OTP enabled, the OTP field isn’t displayed. As the primary use case for password resets is onboarding of new editors (i.e. they don’t have OTP enabled yet) and given that the ideal solution is a true two-step flow, maybe we can keep it like this for now?

@roschaefer Ich habe meinen Ansatz mal ein bisschen aufgeräumt und in #1035 gepusht (ab https://github.com/tactilenews/100eyes/pull/1035/commits/c66d8562789c45e470798852c98dae1437f2d1ef).


Linking molfams

Hi again Andrew!
I was wondering if it is already possible to link MFs to GCFs, as currently it is only the spectra that are linked. When quickly looking at the linking code I see this bit in methods.py:
# TODO molfam support still missing here (as in data_linking.py)

            # results is a (3, x) array for spec/molfam input, where (1, :) gives src obj ID, (2, :) gives
            # dst obj ID, and (3, :) gives scores
            # for GCFs you get [spec, molfam] with above substructure

            # NOTE: need to use sets here because if the "else" cases are executed
            # can get lots of duplicate object IDs which messes everything up

Does that mean that it is indeed not possible yet? Is there a workaround? And if not, I could also spend some time implementing this, maybe you could give me a nudge in the right direction on how to get started with this. :)
Thanks!

I think it should be possible, at least for Metcalf scoring. The code in data_linking.py does seem to set up all the data structures required for using MFs, but Florian Huber wrote most of it and I'm not 100% sure what my TODO comment in methods.py actually means looking at it now, it was added quite a while ago. It might be outdated or there might be some other problem I'm forgetting that led me to skip over it originally. I'll need to test it and see if anything breaks!
If you can leave this with me until next week (I'm on annual leave until Monday) then I can have a proper look at it. I don't think there would be too much to change in methods.py itself, but making the new linking mode available in the webapp would require a larger ripple of changes through that section of the code.
e.g. if I remember correctly the module that generates the data structures which manage all the links between objects in the tables is written with the assumption that linking only exists between "adjacent" pairs of object types: MF<=>Spectrum, Spectrum<=>BGC, BGC<=>GCF. So if we now want to add MF<=>GCF that might mean quite a lot has to be changed to accommodate this within the module itself, and then there will be further changes in how the webapp uses the module. But it should be doable.

Hey thanks for the quick reply :)

If you can leave this with me until next week (I'm on annual leave until Monday) then I can have a proper look at it.

Yes most definitely! It is definitely not urgent, but would be nice to play around with this a bit as well, as I see some links that would benefit from linking the whole MF to GCF instead of just the spectra.

MF<=>Spectrum, Spectrum<=>BGC, BGC<=>GCF. So if we now want to add MF<=>GCF

Hmm, but now GCF <=> Spectrum is already implemented right?

changes in how the webapp uses the module

I am now using the python code itself, as I want to add some code as well, so changes to the webapp are of less importance to me now.

MF<=>Spectrum, Spectrum<=>BGC, BGC<=>GCF. So if we now want to add MF<=>GCF
Hmm, but now GCF <=> Spectrum is already implemented right?
--> Yes, but the MF adds another layer of complexity here.
changes in how the webapp uses the module
I am now using the python code itself, as I want to add some code as well, so changes to the webapp are of less importance to me now.
--> sure, but it would be good to keep in mind that it should be compatible with the web app!
thanks @andrewramsay and enjoy your break!! :-)

Hmm, but now GCF <=> Spectrum is already implemented right?

If you're using the API directly yes you can already pass in GCFs to the scoring methods and get Spectra back, but the tables code that the webapp uses for filtering objects is a bit different - if you look here you can see some properties of the 7 database tables it ultimately creates. 4 of them directly correspond to the visible tables in the webapp, and then there are 3 further tables (mf_spectra, spec_bgc, bgc_gcf) which contain the links between each of those 3 pairs I mentioned. But perhaps we wouldn't even need to update this as much as I thought since the tables are only supposed to be for making selections of objects to run scoring on anyway, hadn't thought that all the way through.

I am now using the python code itself, as I want to add some code as well, so changes to the webapp are of less importance to me now.

Oh I see, that's good to know! As far as I'm aware most of the other users so far have been using the webapp so it'll be great to have someone using the Python API. If we can make the changes at that level as a first step it makes things a lot easier and it shouldn't be too hard to avoid breaking the webapp. Once we're happy with it I can update that separately.
Anyway I'll get back to this on Monday, but I do have a quick question about the implementation details. What is the difference between running Metcalf scoring on a MolFam vs on a list of all spectra in that MolFam? When you run the scoring on spectra each one receives its own Metcalf score (same for GCFs), so is there some kind of cumulative scoring that should be performed across the spectra in each MF in order to give an overall result for each one? If you use multiple MFs as input to scoring you'd want to be able to rank them somehow afterwards right?

Oh I see, that's good to know! As far as I'm aware most of the other users so far have been using the webapp so it'll be great to have someone using the Python API. If we can make the changes at that level as a first step it makes things a lot easier and it shouldn't be too hard to avoid breaking the webapp. Once we're happy with it I can update that separately.

Sounds good! Maybe also good to say what I am trying to do: We are trying to add an extra filtering step for the link results, where we filter out links based on non-matching bgc-class vs chemical-class. So let's say if a bgc is a terpene and a spectrum is peptide related than we consider this unlikely and filter it out/rank it down.

Anyway I'll get back to this on Monday, but I do have a quick question about the implementation details. What is the difference between running Metcalf scoring on a MolFam vs on a list of all spectra in that MolFam? When you run the scoring on spectra each one receives its own Metcalf score (same for GCFs), so is there some kind of cumulative scoring that should be performed across the spectra in each MF in order to give an overall result for each one? If you use multiple MFs as input to scoring you'd want to be able to rank them somehow afterwards right?

We were still discussing this a bit, but my idea is to just combine all strain occurrences from the spectra of a molfam to the strain occurrence of the molfam. This would especially help with compounds that produce slightly different spectra that are not grouped together in the cluster indices that well, so grouping them in Molfams would work better. Of course feel free to share your thoughts on this as well!
And indeed enjoy your break! :)

Just been looking at this a bit and I think there is definitely some work needing done in data_linking.py to make this scoring mode work properly.
Since the webapp hasn't had MF scoring as an option it hasn't been tested much, and I can see there are a couple of places where I've tweaked the original code to work better with NPLinker when it has Spectra/GCF input but not yet with MolFams.
Another issue is that data_linking.py has this parameter called include_singletons used when collecting the MF-GCF links that defaults to False:
https://github.com/sdrogers/nplinker/blob/e7b79c19771dee4f4a4353309ccab1dcb7b4a55d/prototype/nplinker/scoring/data_linking.py#L104
Does it make sense to include singleton MFs or should this be left as-is? I'm not sure there's anywhere else where we currently do much to distinguish between singleton and non-singleton MFs other than indicating them in the webapp.
If we don't want to include them this will probably mean some further changes are required as data_linking.py uses the internal IDs NPLinker assigns to each set of objects. If the singletons aren't included in the set of MFs the numbering may not be consecutive any more, and that will break things. Or are singleton MFs mostly useless to keep around anyway? I could filter them out earlier in the loading process if needed.
Out of interest do you have an example (maybe from a platform dataset) where you already know there are links between some MFs and GCFs? It would be a good way to check if any updates I make are working.

@andrewramsay thanks! I would also load in the singletons as they are part of the analysis, in fact they are MFs of size 1 ;-) - if that doesn't take too much effort of course....
Also, there are examples in the Paired Omics Data Platform of gene cluster to MF links, i.e. the famous Crusemann project contains quite a few of them: https://pairedomicsdata.bioinformatics.nl/projects/297c364c-b154-4edd-a7d5-68decf9effa2.4
I hope that this is helpful! 😎

I see. Well, if you could have a look what is causing that error and if that is not too deep down in the code, then you can decide whether filtering them out a priori is the better option....

Turns out some of the problems were being caused by the way we grafted on standardised Metcalf scoring over the original implementation. That's the part that the "TODO molfam support" comment was in reference to, I must have decided to skip it in favour of getting the Spectra/GCF modes working as quickly as possible.
You can see the line here: https://github.com/sdrogers/nplinker/blob/bfe558a6f1bacc3300a0fad87f0fffa3c78f7855/prototype/nplinker/scoring/methods.py#L495 which checks if standardised scoring is being used, and if not it skips that whole block where the TODO comment is.
I've made a couple of small changes to data_linking.py and have set it to include singletons by default now instead of ignoring them as far as Metcalf scoring is concerned: https://github.com/sdrogers/nplinker/blob/f7bb7d0539e67d775376391871184109a0f7058a/prototype/nplinker/scoring/methods.py#L468
If you pull the latest version of the code, you should then be able to get MolFam-GCF links by configuring the Metcalf scoring object like this:
npl = NPLinker(...)
npl.load_data()
mc = npl.scoring_method('metcalf')
mc.standardised = False
link_data = npl.get_links(npl.molfams[:10], mc)

From the quick testing I've done that seems to be working, so it might be a good short-term solution to allow you to do stuff with these links.
As for updating the standardised scoring, I'm not sure exactly how to do this. Normally when it has a Spectrum + a GCF, it can take the number of strains from each one and use that to look up the Metcalf score for that combination of values. https://github.com/sdrogers/nplinker/blob/f7bb7d0539e67d775376391871184109a0f7058a/prototype/nplinker/scoring/methods.py#L539
But if it has a MolFam + a GCF, should it count all the (unique) strains from each of the Spectra in the MolFam and use that as the value? Or does it need to be handled in a more complex way?

Good point @andrewramsay - here @grimur may also want to chip in. I think this would deserve some proper research and could well be part of a MSc project or follow-up work within the grant that was submitted or other projects. Until then, I would suggest to count all the (unique) strains from each of the MolFam spectra and use that value (as you suggest).

@louwenjjr I've just made some changes in c0ece3073bb5283e2aaffcbe2afaedecbd2688ce that you might want to try out. I'm not sure why I had done things the way I had originally but it seemed a bit overcomplicated even though it wasn't properly handling MolFams.
The new version should be more efficient and work the same way as data_linking.py does: give it Spectra or MolFam input and you get Spectrum<=>GCF or MolFam<=>GCF links respectively, give it GCF input and you will get some mix of GCF<=>Spectrum and GCF<=>MolFam links. Those should be easy to distinguish in the results using the type of the .target attribute for each ObjectLink.

Sounds very good Andrew, I'll give it a try!


Added pre-upgrade check to masters section

I think, I today ran into the problem that I upgraded a cluster that was not stable in the beginning. To avoid other users run into the same I added a little pre-upgrade check to the masters section.
I am not sure if this is true before the upgrade:
"Verify that curl http://<dcos_master_private_ip>:5050/metrics/snapshot has the metric registrar/log/recovered with a value of 1 for each master."
What are your changes?
What type of changes does your doc introduce?

[ ] Bug fix
[ ] New feature

What is the urgency level of this change?

[ ] Blocker
[ ] High
[x] Medium

I have completed these items:

[ ] I have tested all commands and code snippets.
[ ] I have built locally and tested for broken links and formatting.
[ ] I have made this change for all affected versions (e.g. 1.7, 1.8, and 1.9).
[ ] My doc follows the style guide: https://github.com/dcos/dcos-docs#contributing.

Ping @emanic, @sascala, or @joel-hamill for reviewing pull request changes.
If you included a comment with your commit, it appears here:

Can one of the admins verify this patch?

@branden please review

ping @hanken ^

@hanken are you still on this?

Can one of the admins verify this patch?

I will add this text to the other upgrade docs in a separate PR


Wheat generating fully grown in villages is missing its top block

Fix could either be making wheat generate properly when fully grown, or remove fully grown wheat from generation given the existence of beds/bedrolls now makes it less painful.

Fixed a while ago


chore: optimize block proposal and pbft leader selection

On block proposal only give up proposal if new dag block of same level was added to the DAG. Previous implementation would give up if an old DAG block was added to the DAG as well. This would unnecessary delay block proposal for both stale and non-stale blocks.
Pbft block leader selection now favors non-empty pbft blocks over empty ones.

prnet cleaned-up successfully


Clicks go through A, L, and P timeline options in Layout Editor

Upon scrolling the timeline down, when the "Add new", "Force loop", and "Pause" buttons line up with buttons underneath, clicks activate both the button hovered over and the one underneath it. Sometimes the tooltip for both appears too, showing the problem like so:

So far, this has caused me to accidentally duplicate animations, show only one animation layer unintentionally, and hide layers without intending to.

This bug is really a bad one. I will look into fixing it ASAP.


⚠ Bofrost.be has degraded performance

In 6bc2387, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 1868 ms

Resolved: Bofrost.be performance has improved in 6125bed after 1 hour, 8 minutes.


time_filter week might be broken

Issue Description
When getting post from a subreddit there are less entries with time_filter='week' than with  time_filter='day', which seems broken. A few days ago my code worked as expected.
Consider this example:
reddit = praw.Reddit([Censored for privacy])
posts_iter = reddit.subreddit('worldnews').top(time_filter='week', limit=1000)
entries = 0
for post in posts_iter:
    entries += 1
print(entries)

Result curently is 255 for day but only 17 for week.
System Information

PRAW Version: 6.2.0 (latest dev version)
Python Version: 3.4.3
Operating System: Ubuntu 14.04

Unfortunately this issue is on Reddit's end. Sometimes their listings don't get populated as they should. Consider mentioning it on /r/bugs.


Sprint board proposals for sprint 2/19 - 3/2

Please comment on this issue with proposals for our next two week sprint on:
Your capacity for this sprint, which begins Monday, 2/19 and goes through Friday, 3/2
Your proposals for what work items (links to issue numbers) you'd like to work on for this sprint.
Please have your comments in by the end of your day today so we can review in our sprint review meeting. Our sprint review/planning meeting is at 8am PST/5pm CET on Monday, 2/19.

Monday, 2/19 is a US holiday, so I will be attending the weekly call but otherwise not working that day. Other than that I will be available the rest of the sprint.
I intend to complete everything that's in the osls-demo organizational milestone and assigned to me, which is #21 #23  #26 #27 along with #11 for the website content.

Closing for end of sprint.


Automatically cleanup empty dirs in LocalFileSystem

Which issue does this PR close?
Closes #5976
Closes https://github.com/apache/arrow-rs/pull/5975
Rationale for this change
We want to automatically clean empty directories
What changes are included in this PR?
Update for delete method implementation for LocalFileSystem
Are there any user-facing changes?
Yes

Can we please make this configurable, disabled by default, and add some test coverage

@alamb added a test to catch an expected behavior and a few comments

Thanks again @fsdvh and @thinkharderdev


Empty lists as resource attribute value resolve to the predefined default, rather than an empty list.

[ ] A description of the bug
When setting roles: [] in a project_group resource, rather than the group having no project roles, it gets assigned the default value of ["viewer"]. I have noticed this issue before when defining users to a project in Terraform. What is peculiar is that the plan will clearly mark the "viewer" role to be removed from the plan, but after applying the permission still exists. Manually removing the viewer role resolves the issues as it is never recreated on apply once it is gone.

[ ] A fully functioning terraform snippet that can be copy&pasted (no outside files or ENV vars unless that's part of the issue). If this is not supplied, this issue will likely be closed without any effort expended.

resource "project_group" "pipeline-reader-groups" {
  for_each = var.team_to_users_map

  project_key = var.sdg
  name        = "${each.key}-pipeline-reader"
  roles       = []
  depends_on  = [resource.artifactory_group.pipeline-reader-groups]
}

The plan correctly points out the roles to be removed
# xxx["dct-gbs-mera"] will be updated in-place
  ~ resource "project_group" "pipeline-reader-groups" {
        id          = "dct:dct-gbs-mera-pipeline-reader"
        name        = "dct-gbs-mera-pipeline-reader"
      ~ roles       = [
          - "Viewer",
        ]
        # (1 unchanged attribute hidden)
    }

  # xxx["dct-runteam"] will be updated in-place
  ~ resource "project_group" "pipeline-reader-groups" {
        id          = "dct:dct-runteam-pipeline-reader"
        name        = "dct-runteam-pipeline-reader"
      ~ roles       = [
          - "Viewer",
        ]
        # (1 unchanged attribute hidden)
    }

It also claims in the apply that the updates were applied.
Versions of tf + providers:
terraform_1.7.5_linux_amd64.zip
jfrog/project v1.5.2
jfrog/platform v1.7.4
jfrog/artifactory v10.8.0
Expected behavior
roles: [] should apply what the plan states, and remove the default 'viewer' role.

@eelginUPS Thank you for the report. Projects do not allows group without a role assigned to it. You can verify this on the web UI.
When a new project_group is created with empty roles, Artifactory returns the group with one role which it defaults to the "Viewer" role since that has the least permission.
I missed this use case when I created this resource and did not have a test for this.
To avoid state drift, you should include "Viewer" in the roles list.
I'll be updating the resource to ensure roles attribute must have at least one item.


Error: segments out of order - (1060 starts at 0x1060, but next segment starts at 0x1010)

I was trying to split my tony hawk pro skater n64  ROM But got the following  error: Error: segments out of order - (1060 starts at 0x1060, but next segment starts at 0x1010)
I was following the quick start and ran create_config and then the split  command.  I understand that I should iterate and work on the  configuration file,   but I thought  that the command   would give me something barebones but that worked.  Was I mistaken or have I stumbled upon a bug?
here's the  config  file I  generated:
sha1: fc1b4dec85e6874fa7321edc24f5a1e78600d9d0
options:
  basename: tonyhawkproskater
  target_path: Tony Hawk's Pro Skater (USA).z64
  elf_path: build/tonyhawkproskater.elf
  base_path: .
  platform: n64
  compiler: GCC

  # asm_path: asm
  # src_path: src
  # build_path: build
  # create_asm_dependencies: True

  ld_script_path: tonyhawkproskater.ld
  ld_dependencies: True

  find_file_boundaries: True
  header_encoding: ASCII

  o_as_suffix: True
  use_legacy_include_asm: False
  mips_abi_float_regs: o32

  asm_function_macro: glabel
  asm_jtbl_label_macro: jlabel
  asm_data_macro: dlabel

  # section_order: [".text", ".data", ".rodata", ".bss"]
  # auto_link_sections: [".data", ".rodata", ".bss"]

  symbol_addrs_path:
    - symbol_addrs.txt
  reloc_addrs_path:
    - reloc_addrs.txt

  # undefined_funcs_auto_path: undefined_funcs_auto.txt
  # undefined_syms_auto_path: undefined_syms_auto.txt

  extensions_path: tools/splat_ext

  # string_encoding: ASCII
  # data_string_encoding: ASCII
  rodata_string_guesser_level: 2
  data_string_guesser_level: 2
  # libultra_symbols: True
  # hardware_regs: True
  # gfx_ucode: # one of [f3d, f3db, f3dex, f3dexb, f3dex2]
segments:
  - name: header
    type: header
    start: 0x0

  - name: boot
    type: bin
    start: 0x40

  - name: entry
    type: code
    start: 0x1000
    vram: 0x80000400
    subsegments:
      - [0x1000, hasm]

  - name: main
    type: code
    start: 0x1060
    vram: 0x80000460
    follows_vram: entry
    bss_size: 0x0
    subsegments:
      - [0x1060, asm]
      - [0x1010, data]
      - { start: 0x139E4, type: bss, vram: 0x80012DE4 }

  - type: bin
    start: 0x139E4
    follows_vram: main
  - [0xC00000]

ps: How does splat infer the compiler?  I was dreading having to  uncover that, but knowing that it was GCC should help a lot.

Ahh, yeah, this does look like a bug. Thanks for the report! I'd get rid of the data subsegment there and see what happens. If you're used to looking at mips, it should be pretty clear when actual code stops.
As for gcc vs ido, gcc uses j for branching, and ido uses b. So it's easy to know if you're ido vs gcc. To narrow it down further, usually some trial and error is needed.

Thanks for the quick response!   Deleting the data subsegment  stop the crashes:
Scanning 139E4: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 5/5 [00:00<00:00, 92.59it/s]
Splitting 139E4: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 5/5 [00:00<00:00, 13.36it/s]
Linker script 139E4: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████| 5/5 [00:00<00:00, 2010.50it/s]
Split 80 KB (0.64%) in defined segments
              header:     64 B (0.00%) 1 split, 0 cached
                 bin:     4 KB (0.03%) 1 split, 0 cached
                code:    76 KB (0.61%) 2 split, 0 cached
             unknown:    12 MB (99.36%) from unknown bin files

is 99.36%  common for  unknown  segments on a first run?
I'm starting to dread the journey ahead haha

If you're used to looking at mips, it should be pretty clear when actual code stops.

Sadly I have never worked with mips before, I have been a  programmer for many years  but this is my first real adventure with assembly and reverse engineering.
Any tips for a new comer?  I'm just trying to wet my feet  by modding some simple retexturing  and switching  the game music,  my idea was to split the rom to find out were the textures and other data are located.

Maybe join the decomp.me discord https://discord.gg/sutqNShRRs?
The images in the ROM are unlikely to have headers so it probably isn't trivial to identify all the textures

This is not a bug, the sections are out of order - im not sure if the warning could be made clearer?
    subsegments:
      - [0x1060, asm]
      - [0x1010, data]  # 0x1010 is lower than 0x1060

This is not a bug. Perhaps the error text could be clearer? It's unlikely to be able to point to the line of the yaml though I guess 😕
    subsegments:
      - [0x1060, asm]
      - [0x1010, data] # 0x1010 is lower than 0x1060

The bug is that (presumably) the create config script generated this - something in the code vs data detection

This seems to be an issue with the entrypoint parsing of the create_config script. The entrypoint of this game is not a "traditional" one, so splat chokes at trying to infer information from it.
I'm working on a fix so create_config can properly get the information from this kind of entrypoint. I'll also try to make create_config to not generate out of order segments.


cannot install any extentions

VSCode Version:
OS Version:

Steps to Reproduce:

Install any extention
Stuck installing (i waited 30 mins to make sure)

Does this issue occur when all extensions are disabled?: yes

Nevermind i fixed it, i changed my ipv4 and ipv6 dns to the dns of google


Convert to monorepo

Code changes

Rename python package to jupyter_suggestions and JS package to @jupyter-suggestions/*
Switch to a monorepo structure
Add script to install the project in dev mode and to bump version.

@jtpio I'm renaming the package to jupiter-suggestions to shorten the package name and avoid confusion when using this package with Jupyter Notebook.

@jtpio I'm renaming the package to jupyter-suggestions to shorten the package name and avoid confusion when using this package with Jupyter Notebook.

Sounds good :+1: We can also rename the repo afterwards for consistency.

Also quick question: do you envision the metapackage to be used for something in particular?

Also quick question: do you envision the metapackage to be used for something in particular?

not yet, I'm just copying the structure from JupyterCAD


MINOR: Fix sensor retrieval in stand-by task's constructor

Committer Checklist (excluded from commit message)

[ ] Verify design and implementation
[ ] Verify test coverage and CI build status
[ ] Verify documentation (including upgrade notes)

Call for review: @guozhangwang @mjsax @bbejeck @vvcephei @cpettitt-confluent @ableegoldman @abbccdda

Java 11/2.12 failed with ':core:integrationTest'
Java 11/2.13 passed
Java 8/2.11 passed
retest this please

NVM, I will update the commit message while merging :)


Fix various typos

Signed-off-by: Mark Roth<EMAIL_ADDRESS>

Description
Fixes small typos found while following the tutorial
Fixes #6145
How Has This Been Tested?
Viewed the notebooks after fixes.
Any additional notes for reviewers?

Changes look good - I've approved the build run. Do you have more changes?

Thanks. That's all for now. I'll open a new PR if I find more.


Removing project restrictions leaves Runner Specific.

If you assign a runner to specific project, but then remove all restrictions the runner is still marked as "specific" and cannot be used for Shared builds.
This was discovered with 7.9.3.

https://github.com/gitlabhq/gitlab-ci/issues/571#issuecomment-88065765


Settings for handling whitespace

A setting to ensure there's a single newline at the end of the file
A setting to trim trailing whitespace off the end of lines

Would really enjoy this feature 🤣: https://github.com/zed-industries/feedback/commit/488def20fbaf01a6bee60957aec476981c4e1661

This will be available in v0.76.0.


chore: add zabihhaqqani.json

Changes proposed

added my data on linkfree

Check List (Check all the applicable boxes)

[X] My code follows the code style of this project.
[ ] My change requires changes to the documentation.
[ ] I have updated the documentation accordingly.
[X] All new and existing tests passed.
[X] This PR does not contain plagiarized content.
[X] The title of my pull request is a short description of the requested changes.

Screenshots

Note to reviewers

Please review my pull request. Thank you!

Thank you!


Port to use the swift2 branch from ReactiveCocoa

These are all the changes required to get this framework compiling against RAC4 as it exists in the swift2 branch.

@neilpa Fixed, as requested! :)

We should leave this open until the Swift 2 branch of RAC 4 is merged into master.

I made a swift2 branch if you want to open a new PR against it.


Restore menu option doesn't work on new server?

Hi, me again unfortunately!! I'm trying to migrate to a new Hetzner server as the spec was better than my old server at a cheaper price :).
I have 3 days to complete migration before I have to pay for the old one again. I thought this would be easier than the Gooby > Omni upgrade but apparently not :(
I've got omni installed and omnimount is up and running and says 'healthy'. I tried to follow the migrating instructions here:
https://www.omnistream.cloud/omni-basics/backup-and-restore#h.2cxhk4px5kko
But I'm stuck on the last bit, restore backup from the menu.
When I go into omni menu > utilities > restore nothing happens. Well, there's a brief flash of the screen, like something tries to do something in the background, but nothing loads or displays, I just stay stuck on the menu - the below screen, which will just flash very quickly then stay there:

I can't find any log files to help with this, any ideas?
The only suspect thing I've noticed is if I do omni down / omni up, I see this nasty error:

Omni up:

I don't know if the jq error thing is causing trouble?
Also, I had automatic DNS management on my old server, will this get reconfigured if I eventually get to restoring?
Totally stuck now and not sure what to try next. Any advice welcome! Thanks :)
Edit: looks like the other open issue #39 has the same error coming up, wonder if they're related in some way...

I've had a scan through the codebase for jq references and I suspect it's something in check-dns but I could be wrong. Bash isn't my strength, nevermind trying to debug it :)

Actually, your screenshots are saying DNS management is disabled.  No action performed. so it should be exiting before jq even runs. Hmmm.

I wonder if when check-dns, del-dns run, the third line in those files (source ${OMNIHOME}/bin/dns_functions) both imports the functions in that file but also runs these lines at the bottom?
https://github.com/kelinger/OmniStream/blob/main/bin/dns_functions#L81
${CF_EMAIL} and ${CF_KEY} won't be set if you're not using CloudFlare management?

Hey @bifa2 I populated ${CF_EMAIL} and ${CF_KEY} and that made the jq error go away. So there's a small bug there hopefully the guys here can fix :) Thanks for working this out!
However the restore menu still won't work! Still just flashes quickly and doesn't load. It opens up fine on my old server. I can't spot anything obvious that I'm missing by looking at the restore script https://github.com/kelinger/OmniStream/blob/main/bin/restore, but I don't really know this language that well :). I checked that my mnt path can see the Backups folder and its showing up there. So don't think it's an issue with my mount. Stumped!

Oops posted with wrong ID :)
Hey @bifa2 I populated ${CF_EMAIL} and ${CF_KEY} and that made the jq error go away. So there's a small bug there hopefully the guys here can fix :) Thanks for working this out!
However the restore menu still won't work! Still just flashes quickly and doesn't load. It opens up fine on my old server. I can't spot anything obvious that I'm missing by looking at the restore script https://github.com/kelinger/OmniStream/blob/main/bin/restore, but I don't really know this language that well :). I checked that my mnt path can see the Backups folder and its showing up there. So don't think it's an issue with my mount. Stumped!

@thunderstorm654
On your new server, if you have the basic OmniStream up and do a
omni mounts
cd cloud
cd Backups
ls -l

Do you see your old server and the backups from it?

@thunderstorm654
On your new server, if you have the basic OmniStream up and do a
omni mounts
cd cloud
cd Backups
ls -l

Do you see your old server and the backups from it?

@kelinger yes both the old and new server are listed, the mount itself seems to be working great.

Here's a short video clip of what happens (not much!!) When trying to choose "restore":
https://user-images.githubusercontent.com/16837607/211187350-e475e14e-af56-44c9-ad23-6d0305ef3188.mp4

Update: the restore menu now doesn't work on my old server either - exactly the same behaviour. That's really odd as it was working on Friday. Only change that's happened is the backup occurred from the new server. Not touched old server config at all.
Been staring at the code for the restore and just don't get it - the Backups directory is there, nothing appears wrong - but the script just won't run at all it seems.
All the other menu options are functional but this one.

Well, this is definitely a bug but I have to wonder if I'm maybe not quoting a variable or something like that.  I haven't posted any code changes recently--especially to this part of the process--and the fact that it worked until Friday on your old server is perplexing.  Do you perhaps have a space or "unusual" character in your server name(s)?
Can you respond with a list of the directories under the ".../cloud/Backup" on your cloud mount?

Well, this is definitely a bug but I have to wonder if I'm maybe not quoting a variable or something like that. I haven't posted any code changes recently--especially to this part of the process--and the fact that it worked until Friday on your old server is perplexing. Do you perhaps have a space or "unusual" character in your server name(s)?
Can you respond with a list of the directories under the ".../cloud/Backup" on your cloud mount?

It is indeed perplexing haha love that! The only "special"-ish character is a - but that was in the old server name.
The directories (pasting from ls -l) are:
thunderstorm@hetzstorm:~/OmniStream/mnt/cloud/Backups$ ls -l
total 4
drwxr-xr-x 3 thunderstorm thunderstorm 4096 Jan  8 04:15 hetzstorm
drwxrwxrwx 1 thunderstorm thunderstorm    0 Oct 11 22:45 ss-ex42deb

Is there a way to run the restore another way perhaps? I did try calling the restore script directly via it's path in bin, and that also results in nothing happening too (expected, but consistent at least ha). If not what do you think the easiest way to move my stuff over would be? I wish I was better at bash scripting, unfortunately I work with Microsoft stuff and PowerShell or C# and while I get the general idea of what it's doing I'm not good at the syntax etc required here!

Well, the "-" certainly shouldn't be causing any issues.  But, just to test, I created a directory with a dash in it (actually used the same name you were using) and I got further than your video shows so it's still a head scratcher.
Yes, there is actually an easy way to restore manually (or semi-manually).  I want to wait for just a few more back-and-forth questions, though, lest we may never find the actual issue.  But rest assured, we'll get you back up and running one way or another!
In the meantime... let me check a few more things.

Well, the "-" certainly shouldn't be causing any issues. But, just to test, I created a directory with a dash in it (actually used the same name you were using) and I got further than your video shows so it's still a head scratcher.
Yes, there is actually an easy way to restore manually (or semi-manually). I want to wait for just a few more back-and-forth questions, though, lest we may never find the actual issue. But rest assured, we'll get you back up and running one way or another!
In the meantime... let me check a few more things.

No worries! Thanks for investigating. It's definitely really odd. As far as I know, it's the only menu choice that's playing tricks. Happy to try out anything you need to assist :)

I don't know if this is good or bad news.  I created a new instance with the basic Debian installation.  Then, I ran the OmniStream setup script.  After it installed all the Debian components, it installed Docker and Compose.  When it got to the point where it was presenting dialogs, it walked me through the email address, domain name, and rclone setup.  Then, when it asked if I wanted to do a restore, I said yes, and it mounted my cloud volume and listed the three servers I have backups from.
I believe that even this is further than you got, though.  When it was doing the installation or setting up rclone, did you see any errors flash by on the screen?

I don't know if this is good or bad news. I created a new instance with the basic Debian installation. Then, I ran the OmniStream setup script. After it installed all the Debian components, it installed Docker and Compose. When it got to the point where it was presenting dialogs, it walked me through the email address, domain name, and rclone setup. Then, when it asked if I wanted to do a restore, I said yes, and it mounted my cloud volume and listed the three servers I have backups from.
I believe that even this is further than you got, though. When it was doing the installation or setting up rclone, did you see any errors flash by on the screen?

Ugh, bad news from here. I reset the server and went again from scratch. All I did before running OmniStream setup was install a Debian image:
echo x | installimage -p /boot:ext3:1G,/:ext4:all -l 0 -r yes -i images/Debian-1011-buster-64-minimal.tar.gz -a -n hetzstorm && reboot
Then did:
apt update
apt install sudo
Then ran OmniStream.
I had fun with the rclone config again, when I paste in the conf contents it doesn't then prompt me to select which mount and errors trying to read the config folder (permissions). I had that months back when I did Gooby > OmniStream too. So I had to grant permissions to the config folder and then Omni edit and set the rclone mount name/service. Then Omni up brings up the mount successfully.
Went immediately to try and restore after the mount it working and same behaviour... Brief screen flash.
:( Damn! Can't get much more minimal than this but there must be something weird about hetzner maybe?!

I've tried using the latest Debian image available to install on the Hetzner server (Debian-1106-bullseye-amd64-base.tar.gz) and the only difference with that one is sudo is already installed and working.
However, with the OmniStream install I still face the rclone config file not popping up to select my mount after pasting/saving (I wonder if this works in a similar way to the restore menu?) , so have to manually update config folder perms as per last reply.
Then frustratingly the restore menu still doesn't work, exactly the same behaviour :( bangs head on desk

Are you running any of the OmniStream functions with sudo?  You should not be and may explain why the runtime doesn't have access to the rclone.conf file.
One other thing to try is to paste your rclone.conf manually into ~/.config/rclone.conf before running the setup (again, don't use sudo).  Then, when setup asks if you want to edit the file, say yes, let it open, and just save/exit.

Are you running any of the OmniStream functions with sudo? You should not be and may explain why the runtime doesn't have access to the rclone.conf file.
One other thing to try is to paste your rclone.conf manually into ~/.config/rclone.conf before running the setup (again, don't use sudo). Then, when setup asks if you want to edit the file, say yes, let it open, and just save/exit.

No, I follow the install instructions and create my user and switch to that to install. Not running anything OmniStream with sudo at all :). For some reason, my user account doesn't have access to the .config folder, so the OmniStream setup can't start the mount as it cannot access the conf file. So I only use sudo to grant access to the folder.
Any ideas RE the restore? Thanks :)

Sorry, this is a long response, but wanted to document where I got to! TLDR, I got a restore to work by copying and modifying the script to avoid one specific dialog, then there's a question for you about backups at the bottom :)

So, I've decided to take it apart line by line (I took a copy of the restore script into the root of my home directory, not messing with the one in bin :)) and work out where the restore script is falling over. BTW, it started working again on my old server (which makes me wonder was I going mad the other day and somehow looking at the wrong thing, as nothing changed!).
It falls over on my new server on this line, (https://github.com/kelinger/OmniStream/blob/main/bin/restore#L48):
CHOICE=$(dialog --clear \
	--backtitle "Restore OmniStream" \
	--title "Server selection" \
	--menu "Restore from which servers?" \
	0 0 0 \
	"${SERVERS[@]}" \
	2>&1 >$TERMINAL)

This line fails to create the dialog, so if the script proceeds any further it just stops/fails - no visible error but it just does nothing (as per the 'flash' when called from the menu route).
I checked the values set in variables up to this point (echo'ing them out) and both old & new servers.. both have the correct info in SERVERS and TERMINAL. I wondered if dialog was being funky, as I can't see anything wrong with this line at all, and it works on my old server, all your servers.. WTF! I checked the version I had installed of the dialog package, my old server had a slightly older version, so in some desperation I downgraded the one on my new one... no difference! LOL.
In the end, I have managed to get the restore working by commenting out this line and just manually setting SERVERS variable to my old server name. Then if I run my modified copied script manually, it proceeds and all the other menu options come up and work just fine (select which apps to restore, select diffs, all good!). I am really confused as to why that particular line doesn't work on my new server... it's hardly rocket science is it :). With the same dialog package version installed and same input it literally makes no sense. I'm feeling inclined to assume it's got to be something bizarre with the dialog package itself, which we'll probably never understand and it's seemingly isolated to just me and one server - despite about 5 full resets & OS reinstalls..!! The only difference between the servers is old one was set up with Gooby and upgraded to OmniStream, vs new is a fresh OmniStream install & OmniStream restore.
Unless, you have any other ideas why dialog would be bugging out here - without being able to replicate it, I'm all too familiar with how annoying that can be to understand :)
I'm happy to just utilise my slightly modified script for now, I think unless anyone else has an issue in future it's probably something bizarre only I'm getting.
I only have one question hopefully you can answer, RE the differential backups. I have forced another backup from my old server today and it has been uploaded successfully into gdrive. However when that's restored, the progress in Plex/Emby (which both have the differential backups enabled) is a couple of days out (I think Sunday). I tried doing another backup again, to double check the diff is getting updated (and it appears to), but same result of couple days out on progress. Am I correct in thinking I can force the backup to be totally re-done if I remove the snapshots from the 'snapshots' folder? It's not a big deal, I just have a few users who might (mildy) complain ;)

Well, that's a good find and it would mean (I suppose) that whatever was in the SERVERS variable that you avoided by hard coding it was causing the issue.  Is there any chance you could add a "echo $SERVERS ; exit" to the script to see what values it was (trying) to use?
Differential:
Many of the containers use databases like MySQL and file-level backups on databases aren't really the best way to do things.  In most cases, it won't cause issues because these aren't exactly apps that are pounding sequential updates from thousands of sources every second (think:  Amazon's shopping cart).  The "best" way to backup is to shutdown the container and then run backup (which, granted, isn't always possible nor desirable).  The second best is to use a program that actually uses the SQL engine's backup process to extract the data to a file(s) which are then backed up.  This isn't that kind of project and would add a ton of complexity.
So, instead, my personal practice is to use the cron job backup that OmniStream installs and that works most of the time.  But, if I'm going to wipe my server clean or move to a new server, I'll shut down all containers except OmniMount and then run backup manually.
Additionally, I believe that Plex, Emby, and most of the *arrs also do their own backups (see related documentation for their containers) so that even if your backup is bad due to a database corruption, there's another database file stored somewhere in their configs that can be used to get back to (or close to) the most recent image.
And actually, none of this has much to do with differentials at all.  It's just that with differentials, there are twice as many opportunities for a file like a database to be "active" while being backed up:  once with the base image backup and again with the daily differential.
I suppose if your viewing habits are predictable, you could create a backup script in the plugins (backup-start and backup-end are supported) that would do the shutdown and startup of the containers so that each backup is clean.  However, in my personal case, this works great until you have an all night movie-thon and the backup kicks off at the worst possible time.

@thunderstorm654 - have I answered all your questions (related to this topic)?  If so, can we close it out.

Hey @kelinger apologies I never got back to you with your previous reply! Sorted it all out in the end.
The servers variable was exactly the same on both, it really was a strange mystery but hopefully it won't show up again now I'm up and running 😄
Thanks again for all your replies and awesome work on OmniStream. Really happy with it, it's really easy to use and keep containers updated 😎


NamedTuple Error with python 3.9.5

I had this error running pytest in python 3.9.5
  File "/Users/clemat/.pyenv/versions/3.9.5/lib/python3.9/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1030, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
  File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 680, in _load_unlocked
  File "/Users/clemat/.pyenv/versions/3.9.5/envs/modelkit/lib/python3.9/site-packages/_pytest/assertion/rewrite.py", line 170, in exec_module
    exec(co, module.__dict__)
  File "/Users/clemat/dev/modelkit/tests/assets/conftest.py", line 18, in <module>
    from modelkit.assets.manager import AssetsManager
  File "/Users/clemat/dev/modelkit/modelkit/__init__.py", line 3, in <module>
    from modelkit.core.library import ModelLibrary, load_model  # NOQA
  File "/Users/clemat/dev/modelkit/modelkit/core/__init__.py", line 1, in <module>
    from modelkit.core.library import ModelLibrary, load_model
  File "/Users/clemat/dev/modelkit/modelkit/core/library.py", line 35, in <module>
    from modelkit.core.model import Asset, AsyncModel, Model
  File "/Users/clemat/dev/modelkit/modelkit/core/model.py", line 31, in <module>
    from modelkit.utils.cache import Cache, CacheItem
  File "/Users/clemat/dev/modelkit/modelkit/utils/cache.py", line 15, in <module>
    class CacheItem(NamedTuple, Generic[ItemType]):
  File "/Users/clemat/.pyenv/versions/3.9.5/lib/python3.9/typing.py", line 1881, in _namedtuple_mro_entries
    raise TypeError("Multiple inheritance with NamedTuple is not supported")
TypeError: Multiple inheritance with NamedTuple is not supported
======================================================================================= short test summary info ========================================================================================
ERROR  - TypeError: Multiple inheritance with NamedTuple is not supported

From what I see, this seems to be an update of NamesTuple in python 3.9
https://bugs.python.org/issue43923
https://bugs.python.org/issue40185
https://github.com/JustAnotherArchivist/snscrape/issues/111
https://github.com/Carsten-Leue/ReduxPY/issues/2

HTe simplest seems to rewrite the CacheItem class without NamedTuple

HTe simplest seems to rewrite the CacheItem class without NamedTuple

Indeed, it looks like we should use a dataclass instead. The goal with the NamedTuple was to get really fast instantiation of these items. I will work on a PR to fix this later today.

I just did this

it works but we loose the item typing

Of course, but do not want to lose typing 😄

Here is PR to fix this issue https://github.com/clustree/modelkit/pull/62

Closed in #62


A newer requests for the updated mapknowledge

@dbrnz Thanks for the update but I am running into an issue with the following message: Incorrect number of nodes for Keast neuron path 5.

This has to go in because the requirements.txt file is unresolvable without it.


Large contract text crashes the browser

If you load some contract text that is not much longer than a 100 lines. Then the browser hangs and crashes.

Thanks for the report. I could replicate the issue (on Chrome/MacOs X). Could you please let us know which platform/browser you are using?

Windows Chrome
Firefox on Windows seems a bit more forgiving, but it hangs a lot and because almost unusable after 100 lines.
The issue appeared to be around the template.buildGrammar() call

Yes, I just traced it there as well. This is the call building the internal grammar for the template. I've filed an issue against Cicero here:
https://github.com/accordproject/cicero/issues/232
So far, the system has been used mostly for single clause templates (possibly placed inside larger contracts) so we'll have to investigate.

Thank you

Note that I've had slightly better luck with shorter lines. In case that is a useful workaround until we fix this issue:

This might provide some useful hints (i.e., tokenizer) https://github.com/kach/nearley/issues/111

This problem can be traced to performance issues when using large strings in the Nearley parser used in Cicero. A PR to fix the problem (by upgrading to a more recent version of Nearley) is pending review here https://github.com/accordproject/cicero/pull/233
Once that PR is merged and a new version of Cicero is published, the template studio should work for much larger contract text.

The issue also happen for form feed:
bash-3.2$ npm install -g<EMAIL_ADDRESS>+<EMAIL_ADDRESS>added 10 packages from 9 contributors in 1.302s
bash-3.2$ nearleyc teststring.ne -o teststring.js
undefined:1
"a	b"
  ^

SyntaxError: Unexpected token  in JSON at position 2
    at JSON.parse (<anonymous>)
    at Object.value (~/.nvm/versions/node/v8.12.0/lib/node_modules/nearley/lib/nearley-language-bootstrapped.js:30:26)
    at Lexer.next (~/.nvm/versions/node/v8.12.0/lib/node_modules/nearley/node_modules/moo/moo.js:377:34)
    at Parser.feed (~/.nvm/versions/node/v8.12.0/lib/node_modules/nearley/lib/nearley.js:270:30)
    at StreamWrapper.write [as _write] (~/.nvm/versions/node/v8.12.0/lib/node_modules/nearley/lib/stream.js:14:18)
    at doWrite (_stream_writable.js:396:12)
    at writeOrBuffer (_stream_writable.js:382:5)
    at StreamWrapper.Writable.write (_stream_writable.js:290:11)
    at ReadStream.ondata (_stream_readable.js:639:20)
    at emitOne (events.js:116:13)
bash-3.2$ npm install -g<EMAIL_ADDRESS>+<EMAIL_ADDRESS>removed 1 package and updated 1 package in 0.676s
bash-3.2$ nearleyc teststring.ne -o teststring.js

@jeromesimeon This seems to be working magnitudes better now. Thanks!


Kcf - log pod events when pod launch fails

On pod create, if there is an exception (timeout or otherwise), collect pod events and log them.
Also added transaction/metrics for pod management activities (create/delete).
Description

Related issue and scope

[ ] I opened an issue to propose and discuss this change (#????)

My changes affect the following components

[ ] API
[ ] Controller
[ ] Message Bus (e.g., Kafka)
[ ] Loadbalancer
[x] Invoker
[ ] Intrinsic actions (e.g., sequences, conductors)
[ ] Data stores (e.g., CouchDB)
[ ] Tests
[ ] Deployment
[ ] CLI
[ ] General tooling
[ ] Documentation

Types of changes

[ ] Bug fix (generally a non-breaking change which closes an issue).
[x] Enhancement or new feature (adds new functionality).
[ ] Breaking change (a bug fix or enhancement which changes existing behavior).

Checklist:

[x] I signed an Apache CLA.
[x] I reviewed the style guides and followed the recommendations (Travis CI will check :).
[ ] I added tests to cover my changes.
[ ] My changes require further changes to the documentation.
[ ] I updated the documentation where necessary.

Codecov Report

Merging #4813 into master will decrease coverage by 6.93%.
The diff coverage is 0%.

@@            Coverage Diff             @@
##           master    #4813      +/-   ##
==========================================
- Coverage    85.2%   78.26%   -6.94%
==========================================
  Files         197      197
  Lines        8839     8879      +40
  Branches      619      607      -12
==========================================
- Hits         7531     6949     -582
- Misses       1308     1930     +622

Impacted Files
Coverage Δ

...in/scala/org/apache/openwhisk/common/Logging.scala
74.01% <0%> (-9.61%)
:arrow_down:

...re/containerpool/kubernetes/KubernetesClient.scala
21.05% <0%> (-5.62%)
:arrow_down:

...core/database/cosmosdb/RxObservableImplicits.scala
0% <0%> (-100%)
:arrow_down:

...enwhisk/connector/kafka/KamonMetricsReporter.scala
0% <0%> (-100%)
:arrow_down:

...e/database/cosmosdb/cache/ChangeFeedConsumer.scala
0% <0%> (-100%)
:arrow_down:

...ore/database/cosmosdb/cache/CacheInvalidator.scala
0% <0%> (-100%)
:arrow_down:

...core/database/cosmosdb/CosmosDBArtifactStore.scala
0% <0%> (-96.23%)
:arrow_down:

...sk/core/database/cosmosdb/CosmosDBViewMapper.scala
0% <0%> (-93.85%)
:arrow_down:

...tabase/cosmosdb/cache/CacheInvalidatorConfig.scala
0% <0%> (-92.31%)
:arrow_down:

...e/database/cosmosdb/cache/KafkaEventProducer.scala
0% <0%> (-77.78%)
:arrow_down:

... and 13 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 51de9d7...a21e2af. Read the comment docs.

Codecov Report
Attention: Patch coverage is 0% with 44 lines in your changes missing coverage. Please review.

Project coverage is 78.26%. Comparing base (51de9d7) to head (a21e2af).
Report is 383 commits behind head on master.

Files with missing lines
Patch %
Lines

...re/containerpool/kubernetes/KubernetesClient.scala
0.00%
43 Missing :warning:

...in/scala/org/apache/openwhisk/common/Logging.scala
0.00%
1 Missing :warning:

:exclamation:  There is a different number of reports uploaded between BASE (51de9d7) and HEAD (a21e2af). Click for more details.
HEAD has 15 uploads less than BASE

Flag
BASE (51de9d7)
HEAD (a21e2af)

19
4

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #4813      +/-   ##
==========================================
- Coverage   85.20%   78.26%   -6.94%
==========================================
  Files         197      197
  Lines        8839     8879      +40
  Branches      619      607      -12
==========================================
- Hits         7531     6949     -582
- Misses       1308     1930     +622

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


When will deprecated features be removed?

Heya :)
(I'm working at Companies House and looking at updating some stuff)
When I visit https://frontend.design-system.service.gov.uk/v4/sass-api-reference/#govuk-compatibility-govuktemplate-default-value

Deprecated: Will be removed in v5.0 with the rest of the compatibility mode suite of tools and settings

Is this now v6? or have these been removed already?

Nevermind I'm a silly billy and somehow navigated to version 4 😎


sound' has been declared but its value has never been read

Cannot find declaration file for module 'sound play'. "E: / work / work > Src / CMUI / node > modules / sound play / build / main. JS" implicitly has the type "any".
Try npm install @types/sound-play if it exists or add a new declaration (.d.ts) file containing declare module 'sound-play';ts(7016)
i don't know how to fix it.or because my use way is wrong.

@Lardu There is no type definitions for this package. You may want to define and declare its type by yourself.

@Lardu此软件包尚无类型定义。您可能需要自己定义和声明其类型。

Thank you very much. It worked


prototype: key list w/ data from veramo KeyManager w/ MemoryKeyStore

https://61e9a9a63a63fb003a76e6e7-njhonduftu.chromatic.com/?path=/story/veramo-veramokeylist--default


Undefined Behavior of mx.sym.where with shape-mismatched cond

Description
mx.sym.where(cond, x, y) still functions, given shape-mismatched cond. Would it be more reasonable if we raise a shape mismatched error?
Related API: http://mxnet.incubator.apache.org/versions/1.2.0/api/python/symbol/symbol.html?highlight=mxnet.symbol.where#mxnet.symbol.where
Environment info
mxnet-cu90==1.2.0
Minimum reproducible example
import mxnet as mx

cond = mx.sym.Variable('cond')
x = mx.sym.Variable('x')
y = mx.sym.Variable('y')
out = mx.sym.where(cond, x, y)
test = lambda c: out.eval(x=mx.nd.array([[2,3],[4,5],[6,7]]), y=mx.nd.array([[8,9],[10,11],[12,13]]), cond=mx.nd.array(c))

print(test([[1, 0], [1, 0], [0, 0]]))  #1. [[2,9],[4,11],[12,13]], as expected.
print(test([1, 0, 1, 0, 0, 0]))        #2. [[2,9],[4,11],[12,13]], undefined. Seems correct at least.
print(test([1, 0, 1, 0]))              #3. [[2,9],[4,11],[12,13]], undefined. Automatically adding trailing zeros?

print(test([[1, 1], [1, 0], [0, 0]]))  #4. [[2,3],[4,11],[12,13]], as expected.
print(test([[1, 1, 1], [0, 0, 0]]))    #5. [[2,3],[4,11],[12,13]], undefined. Automatically reshaping?
print(test([1, 0]))                    #6. [[2,3],[4,11],[12,13]], undefined. Automatically repeating?

print(test([1, 0, 1]))                 #7. [[2,3],[10,11],[6,7]], as expected.

Perhaps the root is here?

Call where_batch with M = x.Size()/cond.Size() if given shape-mismatched cond:
https://github.com/apache/incubator-mxnet/blob/v1.2.0/src/operator/tensor/control_flow_op.h#L297
Perform KERNEL_ASSIGN(out[i], req, (0 != cond[i/M]? x[i] : y[i]));, which results in automatic reshaping and repeating.
https://github.com/apache/incubator-mxnet/blob/v1.2.0/src/operator/tensor/control_flow_op.h#L97

@GokawaHaruki I think the problem is symbol.eval will only create one executor. The code will raise an error if it's written this way:
import mxnet as mx

cond = mx.sym.Variable('cond')
x = mx.sym.Variable('x')
y = mx.sym.Variable('y')
out = mx.sym.where(cond, x, y)
test = lambda c: mx.nd.where(mx.nd.array(c), mx.nd.array([[2,3],[4,5],[6,7]]), mx.nd.array([[8,9],[10,11],[12,13]]))

print(test([[1, 0], [1, 0], [0, 0]]))  #1. [[2,9],[4,11],[12,13]], as expected.
print(test([1, 0, 1, 0, 0, 0]))        #2. raise error

It is still a bug as the shape checking logic is not triggered.

I have created a JIRA https://issues.apache.org/jira/browse/MXNET-806 is created to track this bug and am working on it this week.


[AzureSpringCloudV0] Print app logs when deployment failed

Task name:
AzureSpringCloudV0
Description:
When deployment failed, we will print app logs to the screen for the customer to dignose.
Documentation changes required: (Y/N)
N
Added unit tests: (Y/N)
N
Attached related issue: (Y/N)
Customer reached us by icm.
Checklist:

[x] Task version was bumped - please check instruction how to do it
[x] Checked that applied changes work as expected

/azp run

/azp run

/azp run

/azp run


Automator: update proxy@master in istio/istio@master

Generated by Automator - 2023-12-25T02:27:47+00:00

@istio-testing: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name
Commit
Details
Required
Rerun command

integ-ambient_istio
6d020c51a0cf40f920827a9f8036e8c6e265fd8e
link
true
/test integ-ambient

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

/test integ-ambient


Move add_column_to_layer_tabular_data upstream

I'm a big fan of this method:
add_column_to_layer_tabular_data
Would anyone mind if we move it to napari-skimage-regionprops? For backwards compatibility we could then import it in utilities like this:
from napari_skimage_regionprops import add_column_to_layer_tabular_data

With this import, no code would have to be changed immediately.
I'm also thinking if this function (or a similar function) would resolve https://github.com/haesleinhuepf/napari-skimage-regionprops/issues/16
Maybe @jo-mueller has an opinion?

@ I'm all for it! It would fit there better anyway since it is mainly a table specific function! And regarding the issue raised I think this function would circumvent what Johannes was talking about

Hi @haesleinhuepf @Cryaaa ,
sounds like a good idea to me - another step of taking infrastructure code out of the clusters plotter and making it a bit more lightweight :)

would it be desirable to have this function throw a warning if, for instance, the passed column name was already in the target table

Yes, I think this is a good idea. Furthermore, how about adding a parameter overwrite_existing with default value False?


Making the images clickable again

Solves issue #10 , which was re-opened due to an issue causing the UI to revert

@Kaushik-Iyer fetch upstream and then I'll merge the pdf

I don't understand

Click on the "Sync Fork" Option next to "Contribute" which is used to open pull request.
Click on "Fetch Upstream".
Let me know when done.

I don't understand

Don't forget to star the repository :)

Discard 1 commit to make this branch match the upstream repository. 1 commit will be removed from this branch.
I'll have to remove my changes to do that i guess, and again make all my changes..

yes, I know it's hectic but without it problems might arise. So please do that

Tip: Always ensure that your branch is up to date before making changes

okay, hopefully this is the last time lol

yes just please wait for a couple of minutes, I'll comment here and then you can fetch the upstream


no valid dependencies for jdk, 14.* 😭

Hello,
thanks for providing the 15.* (see #14)! But at least @JeremyTwiggs and I now miss the 14.* :( Can we please get it back, for a few weeks maybe? :D
[INFO]     [creator]     Paketo BellSoft Liberica Buildpack 5.2.0
[INFO]     [creator]       https://github.com/paketo-buildpacks/bellsoft-liberica
[INFO]     [creator]       Build Configuration:
[INFO]     [creator]         $BP_JVM_VERSION              14.*            the Java version
[INFO]     [creator]       Launch Configuration:
[INFO]     [creator]         $BPL_JVM_HEAD_ROOM           0               the headroom in memory calculation
[INFO]     [creator]         $BPL_JVM_LOADED_CLASS_COUNT  35% of classes  the number of loaded classes in memory calculation
[INFO]     [creator]         $BPL_JVM_THREAD_COUNT        250             the number of threads in memory calculation
[INFO]     [creator]         $JAVA_TOOL_OPTIONS                           the JVM launch flags
[INFO]     [creator]       No valid JRE available, providing matching JDK instead. Using a JDK at runtime has security implications.
[INFO]     [creator]
[INFO]     [creator]     Paketo BellSoft Liberica Buildpack 5.2.0
[INFO]     [creator]       unable to find dependency
[INFO]     [creator]       no valid dependencies for jdk, 14.*, and io.buildpacks.stacks.bionic in [(jdk, 8.0.275, [io.buildpacks.stacks.bionic org.cloudfoundry.stacks.cflinuxfs3]) (jre, 8.0.275, [io.buildpacks.stacks.bionic org.cloudfoundry.stacks.cflinuxfs3]) (jdk, 11.0.9, [io.buildpacks.stacks.bionic org.cloudfoundry.stacks.cflinuxfs3]) (jre, 11.0.9, [io.buildpacks.stacks.bionic org.cloudfoundry.stacks.cflinuxfs3]) (jdk, 15.0.1, [io.buildpacks.stacks.bionic org.cloudfoundry.stacks.cflinuxfs3]) (jre, 15.0.1, [io.buildpacks.stacks.bionic org.cloudfoundry.stacks.cflinuxfs3]) (jvmkill, 1.16.0, [io.buildpacks.stacks.bionic org.cloudfoundry.stacks.cflinuxfs3])]
[INFO]     [creator]     ERROR: failed to build: exit status 1

Thanks!!

The buildpacks, going back to the inception of Cloud Foundry, have a policy of not shipping unsupportable versions of dependencies.  In this case, the OpenJDK community describes the support windows of releases, and they’re quite clear that for non LTS versions, a version becomes unsupported (as in we can no longer upstream fixes for CVEs) one month after the release of the next version.  To facilitate this, the .0 release of a version comes out “off-cycle” a month earlier than the quarterly release schedule would dictate
In the case of the 14 to 15 transition, the buildpack starting shipping both Java 14 and 15 with 4.0.0 on September 23rd.  With the release of 15.0.1 (along with Java 8 and 11 releases) we removed 14 in 5.0.0 on October 22.  This means that for four weeks we shipped both 14 and 15 giving the OpenJDK-designed window for migration.
This rapid and mandatory upgrade cycle is why both we and the OpenJDK maintainers recommend against going to production on non-LTS versions and instead only using them for testing.

perfect explanation, sounds reasonable, thanks!


Adding stylelint #105

The code coverage can be ignored, because the LeoModal component will be removed in the future.

I would like to do the review.

These errors don't occur when I run it. Do you have the right version? Because in the stylelintrc.json is the rule no-empty-source set null. So the no-empty-source errors should not occur.
The stylelint rule property-no-vendor-prefix used to cause errors with the non-standard vendor-prefixes. Thats why I ignored these properties for non-standard vendor-prefixes. But it seems like it is not used anymore because without this customizations it still shows no errors. So the lines from 7 to 10 in the stylelintrc.json can be removed.

@PiaSophieBe Please use the review functionality of GitHub...


Deprecates fedex integration (ADR-0004)

Breaking Change:
The FedEx integration has been deprecated and is pending for removal in Home Assistant 0.100.0.
Description:
This PR deprecates the FedEx integration since it relies on web scraping to function.
As per ADR-0004 this is no longer allowed. The integration should now be deprecated for 2 releases before permanent removal.
Related issue (if applicable): #24332 #13131
Pull request with documentation for home-assistant.io (if applicable): home-assistant/home-assistant.io#10070
Example entry for configuration.yaml (if applicable): n/a
Checklist:

[x] The code change is tested and works locally.
[x] Local tests pass with tox. Your PR cannot be merged unless tests pass
[x] There is no commented out code in this PR.
[x] I have followed the development checklist

If user exposed functionality or configuration variables are added/changed:

[x] Documentation added/updated in home-assistant.io

If the code communicates with devices, web services, or third-party tools:

[x] The manifest file has all fields filled out correctly. Update and include derived files by running python3 -m script.hassfest.
[x] New or updated dependencies have been added to requirements_all.txt by running python3 -m script.gen_requirements_all.
[x] Untested files have been added to .coveragerc.

If the code does not interact with devices:

[x] Tests have been added to verify that the new code works.

Can you update the breaking changes section to include instructions on how the user can continue to use this integration as a custom component?


ImageDemo question.

https://github.com/YunYang1994/tensorflow-yolov3/blob/f8ab03195c9d7c079f794419955078acf8456eb3/image_demo.py#L28
https://github.com/YunYang1994/tensorflow-yolov3/blob/f8ab03195c9d7c079f794419955078acf8456eb3/image_demo.py#L30
https://github.com/YunYang1994/tensorflow-yolov3/blob/f8ab03195c9d7c079f794419955078acf8456eb3/core/utils.py#L40

i have the same question


Use platform lineSeparator to join TextChunks

Running tests on windows generates an error caused by using \r to merge text in TextChunks.
Switch to System.lineSeparator() to fix tests.

I found this issue because I am having a similar problem. Just changing the within-cell line separator doesn't seem to fix it for me though. That seems to just change the test failures. E.g. making the change in Cell in the linked PR causes new failures for me like:
testExtractSpreadsheetWithArea(technology.tabula.TestCommandLineApp)  Time elapsed: 0.047 s  <<< FAILURE!
org.junit.ComparisonFailure:
expected:<...ATION,,,
"","11/12^M[(a)",12/13,Percentage,Absolute,
"","May/2013^M(b)","Jun/2013^M](c)",(c/a),(c-a),
C...> but was:<...ATION,,,
"","11/12^M[
(a)",12/13,Percentage,Absolute,
"","May/2013
(b)","Jun/2013
](c)",(c/a),(c-a),
C...>
        at technology.tabula.TestCommandLineApp.testExtractSpreadsheetWithArea(TestCommandLineApp.java:37)

Without that change (i.e. at current "head" adb7738c87) the test failure I get is:
Test set: technology.tabula.TestCommandLineApp
-------------------------------------------------------------------------------
Tests run: 13, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.918 s <<< FAILURE! - in technology.tabula.TestCommandLineApp
testLatticeModeWithColumnOption(technology.tabula.TestCommandLineApp)  Time elapsed: 0.013 s  <<< FAILURE!
org.junit.ComparisonFailure:
expected:<...phecomyiastratiosph^M[
ecomyioides",Says,bzzzzzzz
Fox,Says,"Ring-
dingdingdingdingeringedingGer
ing-
dingdingdingdingeringedingGer
]ing-dingdingdingding...> but was:<...phecomyiastratiosph^M[ecomyioides",Says,bzzzzzzz
Fox,Says,"Ring-^MdingdingdingdingeringedingGer^Ming-^MdingdingdingdingeringedingGer^M]ing-dingdingdingding...>
        at technology.tabula.TestCommandLineApp.testLatticeModeWithColumnOption(TestCommandLineApp.java:198)

I wonder if there might be something going on with the encoding of the test csv files when checked out under git on Windows?


that.cropper.setImage is not a function.

Hi there!
Thanks for the feature, look awesome. I m having an issue while using it in a modal. I am getting the following error message.
that.cropper.setImage is not a function. (In 'that.cropper.setImage(image)', 'that.cropper.setImage' is undefined)
Thanks !

is the cropper initialized at the moment when you want to execute setImage?
can you try and do it on afterViewInit?

maybe is the template reference variables that you don't set (#cropper).

Hi guys,
Thanks for your feedback.
My code is exactly like this plunker, expect that I have it embedded in a modal. I do have #cropper reference and not sure what to put on AfterViewInit...
Plunker:
https://embed.plnkr.co/V91mKCNkBQZB5QO2MUP4/
My code:

fileChangeListener($event) {
        var image:any = new Image();
        var file:File = $event.target.files[0];
        var myReader:FileReader = new FileReader();
        var that = this;
        myReader.onloadend = function (loadEvent:any) {
            image.src = loadEvent.target.result;
            that.cropper.setImage(image);

        };

        myReader.readAsDataURL(file);
    }

HTML:

<modal #modal>
    <modal-header [show-close]="true">

Upload picture

    </modal-header>
    <modal-body>

                Upload
                <input id="custom-input" type="file" (change)="fileChangeListener($event)">

    </modal-body>
    <modal-footer>

        <button type="button" class="btn btn-primary" (click)="Upload()">Upload</button>
    </modal-footer>
</modal>

After thinking the code a little more, I am getting the following error.
caused by: self.parentView._ImageProfileUploaderComponent_26_3.context.openEdit is not a function. (In 'self.parentView._ImageProfileUploaderComponent_26_3.context.openEdit('contractor')', 'self.parentView._ImageProfileUploaderComponent_26_3.context.openEdit' is undefined)
OpenEdit is actually my function to open the modal.

import {Component, OnInit, Input, ViewChild, AfterViewInit, Type} from "@angular/core";
import {ImageCropperComponent, CropperSettings, Bounds} from 'ng2-img-cropper';
import {Ng2Bs3ModalModule} from "ng2-bs3-modal/ng2-bs3-modal";
import {Bounds} from "ng2-img-cropper/src/model/bounds";

@Component({
    selector: "image-profile-uploader",
    templateUrl: 'app/commons/image-profile-uploader/image-profile-uploader.component.html',
    directives: [ImageCropperComponent]
})
export class ImageProfileUploaderComponent extends Type{
    data: any;
    cropperSettings: CropperSettings;
    @ViewChild('modal') modal;
    @ViewChild('cropper', undefined) cropper:ImageCropperComponent;

    constructor() {
        super();
        this.cropperSettings = new CropperSettings();
        this.cropperSettings.width = 100;
        this.cropperSettings.height = 100;
        this.cropperSettings.croppedWidth =100;
        this.cropperSettings.croppedHeight = 100;
        this.cropperSettings.canvasWidth = 400;
        this.cropperSettings.canvasHeight = 300;

        this.data = {};

    }

    openEdit(type:string)
    {
        var that = this;
        that.modal.open();
    }
    Upload()
    {

    }

    cropped(bounds:Bounds) {
        //console.log(bounds);
    }
    fileChangeListener($event) {
        var image:any = new Image();
        var file:File = $event.target.files[0];
        var myReader:FileReader = new FileReader();
        var that = this;
        myReader.onloadend = function (loadEvent:any) {
            image.src = loadEvent.target.result;
            that.cropper.setImage(image);

        };

        myReader.readAsDataURL(file);
    }
}

Is it possible to have either a plnkr or an error dump with the latest version of the cropper?
thanks

This seems to be an angular issue: https://github.com/angular/angular/issues/5415
While the issue does provide a work-around, it doesn't seem to work for some reason. Is there any way the image can be passed via input? That would likely just cut around this issue without any further trouble.

Hi there,
What about this issue?
I got the same.
David

Hi there,
It may be useful for someone else,  #cropper will not be defined by default since it is loaded inside ng-template (Modal).
It can be resolved by passing #cropper variable from view.

upload

fileChangeListener($event, cropperComp: ImageCropperComponent) {
this.cropper = cropperComp;
let image = new Image();
var file:File = $event.target.files[0];
var myReader:FileReader = new FileReader();
var that = this;
myReader.onloadend = function (loadEvent: any) {
image.src = loadEvent.target.result;
that.cropper.setImage(image);
};
myReader.readAsDataURL(file);
}
This worked for me.
Credit to @analuisamartins

I used this code https://github.com/web-dave/ngx-img-cropper/issues/51. it may useful to others.