Dev Cluster: "failed to create fsnotify watcher: too many open files"

On the dev cluster, I'm unable to see logs in times of heavy cluster usage (specifically 100 metadig workers and 20 indexer workers). The log is truncated with the messsage failed to create fsnotify watcher: too many open files
brooke@magnum-pi.local:~ $ kubectl logs -f metacatknb-0
# [...some log lines...]
<IP_ADDRESS> - - [16/Apr/2024:18:16:52 +0000] "GET /metacat/ HTTP/1.1" 200 82
<IP_ADDRESS> - - [16/Apr/2024:18:16:52 +0000] "GET /metacat/admin HTTP/1.1" 200 2314
failed to create fsnotify watcher: too many open files%
brooke@magnum-pi.local:~ $

See this discussion: https://serverfault.com/questions/1137211/failed-to-create-fsnotify-watcher-too-many-open-files
(I don't think we should max them out - see discussion - but increasing them "sensibly" would be good)

Looks like K8s has an internal way of handling this, but might not be safe for what we need to change here. I can also change the setting on all the node VMs outside of K8s.
https://kubernetes.io/docs/tasks/administer-cluster/sysctl-cluster/

We we were running LXD containers, all our hosts were configured with these settings: https://documentation.ubuntu.com/lxd/en/latest/reference/server_settings/

I'm going to changes these settings all all the K8s nodes, selectively taken from the LXD docs:
Add /etc/security/limits.d/k8s-limits.conf
*               soft    nofile          1048576
*               hard    nofile          1048576
root            soft    nofile          1048576
root            hard    nofile          1048576

Add /etc/sysctl.d/20-k8s.conf
fs.inotify.max_queued_events = 1048576
fs.inotify.max_user_instances = 1048576
fs.inotify.max_user_watches = 1048576

The docs recommend rebooting the VMs after making the changes.

Here are the current settings on k8s-dev-node-1:
outin@k8s-dev-node-1:~$ sudo sysctl -a | grep fs.inotify
fs.inotify.max_queued_events = 16384
fs.inotify.max_user_instances = 128
fs.inotify.max_user_watches = 1004077

outin@k8s-dev-node-1:~$ ulimit -n
1024

root@k8s-dev-node-1:~# ulimit -n
1024

I deployed the two config files to all the K8s VMs via Ansible: https://github.nceas.ucsb.edu/NCEAS/ansible-nceas/blob/master/k8s.yml
Looks like we might need to reboot all the nodes to apply the settings.

Rebooted k8s-dev-node-1 and verified the changes have been applied:
outin@k8s-dev-node-1:~$ sudo sysctl -a | grep fs.inotify
fs.inotify.max_queued_events = 1048576
fs.inotify.max_user_instances = 1048576
fs.inotify.max_user_watches = 1048576

outin@k8s-dev-node-1:~$ ulimit -n
1048576

root@k8s-dev-node-1:~# ulimit -n
1048576

thank you, @nickatnceas !

Hi @nickatnceas -- would you mind please repeating this process for the prod cluster, as soon as you have a spare moment? While trying to get the ADC instance working, I'm running into failed to create fsnotify watcher: too many open files when trying to view logs.
Thanks!

I deployed the settings to all K8s nodes, but did not reboot everything to make the setting apply. I will attempt to reboot all the nodes later today.

outin@k8s-node-1:~$ uptime -s
2024-04-15 20:28:40

I finished rebooting all the K8s nodes.


Problem loading audio file

@TheREALSaibot said in #12:

[...] in the home component I cant load in the sound file. My component is in 'src/components' and the audio file is in 'src/assets/audio' folder. I tried to replace the file and rewrite the route but nothing really works [...]

@TheREALSaibot are there any errors/warnings in the console? If you open the browser devtools and check the network tab, is the audio file loading there?

Glad to hear you figured it out 🙂


Unable to run npm install -g  @flxbl-io/sfp

Describe the bug
Unable to run npm install -g  @flxbl-io/sfp
getting error : "npm ERR! notarget No matching version found for<EMAIL_ADDRESS>To Reproduce
Steps to reproduce the behavior:
run npm install -g  @flxbl-io/sfp
Expected behavior
A clear and concise description of what you expected to happen.
I should not get an error

Our team is affected as well.

We are looking into it.. Meanwhile if you could use the docker as a workaround

Please switch to v39.0.3 for now until we resolves it

This is fixed in 39.2.3


Updated: Changed all test file suffixes to be .test.ts

Could you explain exactly how?

I could explain exactly how, but it will help your troubleshooting and investigation skills if you are able to do it yourself. Can you see that the build is failing? Click that and see what the error says - this should instruct you with what is wrong.
https://github.com/aerogear/graphback/pull/2138/checks?check_run_id=1193055080
Join our Discord for more guided help https://discord.gg/mJ7j84m

Fixed in https://github.com/aerogear/graphback/pull/2166


Possible to support loading and introspecting via ONNX.js?

Relates #2 and #8:
Might it be possible to support loading / introspecting (a subset of) models loaded via ONNX.js?
https://github.com/Microsoft/onnxjs
Curious because we would like to visualize our own PyTorch model / networks.
I'm assuming that this may be closed as out-of-scope, which is totally fine! Just wanna put it out there ;)

Some add'l links, on top of those provided here: https://github.com/poloclub/cnn-explainer/issues/8#issuecomment-624624004
https://medium.com/@santhoshkolloju/convert-your-pytorch-models-to-tensorflow-with-onnx-84c3bdd8d722

Hey, thanks for you suggestion!
Yeah we have considered onnx.js vs tensorflow.js when we started the project. From our experience, tensorflow.js was more straightforward at that time.
It is definitely possible to support loading models with onnx.js. In cnn-tf.js we converted the loaded model into a JavaScript array of objects, and all visualization code are using this array. Therefore, after constructing this array using onnx.js all other code should work as well :)
However, it might be a little bit tricky to modify the CNN Explainer code to inspect your model (assuming not tiny-vgg 😅) out of the box, as the visualization layout is especially designed for tiny-vgg in the current version.
I will close this issue for now, let me know if you have more questions :)


How to load two different infinity model on same page?

export default Ember.Route.extend(InfinityRoute, {
	model(){
		return {
			sellableProducts: this.infinityModel('product', {product_type: 1, perPage: 30, startingPage: 1, modelPath: 'controller.model.sellableProducts'}),
      adsProducts: this.infinityModel('product', {product_type: 0, perPage: 30, startingPage: 1,modelPath: 'controller.model.adsProducts'}),
      trendingProducts: this.store.query('product', {trending: true, product_type: 1})
		};
   },
   updateInfinityModel(newObjects){
      let infinityModel = this.get(this.get('_modelPath')).get('content');
      let content = newObjects.get('content');
      infinityModel.pushObjects(content);
   }

});

How to load two different infinity model on same page?

Hi @adityaU - currently the library only supports a single Infinity Model per Route.  I would love a PR for this functionality!

@hhff we're (potentially) running into this issue as well. Perhaps it would make sense to allow ember-infinity to be structured as a component? Components > everything else seems to be the overall direction Ember is moving in, too.

It's an ember anti-pattern to do data fetching from a component @asross - that's what routes are for.
It's not crazy for us two support multiple infinityModels on a route, we just don't currently.

It's an ember anti-pattern to do data fetching from a component @asross - that's what routes are for.
It's not crazy for us two support multiple infinityModels on a route, we just don't currently.

I'm hearing competing viewpoints on this. A lot of people inside my company are arguing that when you need composable/reusable access to the same data, it's okay and even good to do data fetching inside a component.
Imagine you want to embed an infinite-scrolling list in many different pages or dynamically inside a modal. Accomplishing this using subroutes would be extremely painful, because you'd have to create a new route for every new embedding. Components, on the other hand, are perfect for this.
You could probably work out something with multiple infinity models on a route each passed into a component, but that might be a headache, especially if the number of them is dynamic.

I disagree, a component is an encapsulation of "interaction & display logic".  To throw data fetching logic into the mix is only going to cause complications and muddying of concerns.
Components act on the data they are fed.   Ask anyone who's attempted to build a complex React app without Flux whether components should control their own data  (aka, me).
Comparability is important, but where the lines of separation are drawn is MORE important.  In Ember, the line is drawn on the URL (aka - the Route).
What you're saying is that Ember should not have routes - just a router and components.  That's chaos!  The reason these constructs exist is to bring order to complexity.  That's the ~ember way~.
TLDR: A bunch of very smart people decided (correctly) that components should not have access to the Ember Data store.  They should be an interface, not an island.  Ember Infinity has no plans to violate that.

FWIW, the infinity-loader component that ships with ember-infinity accepts a model agrument.
Supporting multiple infinityModels would be as simple as:
{{infinity-loader model=model.products}}

{{infinity-loader model=model.comments}}

Fair points, and the FWIW is worth a lot. I do still feel like there's something missing from Ember that could give you clear lines of separation and composability, but I can definitely see the imminent danger for things to spiral out of hand.
Supporting multiple infinity models on the same route seems like it would ensure that ember-infinity remains true to the Ember Way while at the same time not obstructing attempts to make its applications more composable.

What about this sort of thing:
return Ember.RSVP.hash({
				eventInstance: this.store.query('eventInstance', {
					slug: slug
				}),
				lineup: this.infinityModel("lineup", { perPage: 24, startingPage: 1, slug: slug, sort: 'familiarity desc', currentUserAttending: false })
			});

How can I get that working?

@wayne-o that should not be a problem, as you only have one infinityModel instance.
A big obstacle to supporting multiple infinityModel instances on the same route is that the InfinityRoute mixin is tightly coupled to a single Route's parameters. For instance, it defines a single _modelPath on the Route it's mixed in to, along with page params for that model.
However - I haven't tested this, but it should be possible, to mix in InfinityRoute to a different Ember.Object as long as a) that Ember.Object is provided a path to the model, and b) that Ember.Object has a reference to this.store. I would encourage ambitious & interested devs needing to solve this problem to try out that route and report back with issues.

:+1: what @davidgoli said.
It shouldn't be all that difficult to move the ember-infinity focus to an OO style instance based pattern.

If anyone needs this - please have a crack!  closing for now


Added celsius_to_fahrenheit feature and testing.

Pull Request Description

Type of Change

Closes #22

[ ] Breaking Change: Added new code that will cause some or all of the existing codebase to no longer work.

[ ] Bugfix: Added new code that fixes an identified bug and does not break the current codebase.

[ X] Documentation: Updated files that do not affect the current codebase or program logic.

[ ] Hotfix: Emergency update made to production ready code.

[X ] New Feature: Added new code and unit tests that does not break the current codebase.

[ ] Refactor: Improvements made to the existing codebase but does not add new features.

[ ] Security: Addresses security vulnerabilities, updating vulnerable code, updating vulnerable dependencies or removal of secrets that does not break the current codebase.

Related GitHub Issues

Checklist

[ ] I have created my change on a new branch (such as bugfix/, documentation/ or feature/)
[ ] My code conforms to the style guidelines of this project.
[ ] I have run all linting and formatting scripts against my new code.
[ ] I have added comments to my code (where applicable).
[ ] I have updated all documentation files (such as README.md) of my changes.
[ ] I have added working unit tests for my new feature.
[ ] All existing unit tests work.
[ ] I have not committed any secrets.
[ ] I have added all related GitHub issues to this Pull Request.
[ ] I have completed all steps as part of this checklist.

Feature Celsius to Fahrenheit added, issue 22

Good work jp-braun and thank you for your contribution!


Problem with jQuery

Hello,
I got a problem with including the jQuery in our project.
When I include a reference from the server everything works without any problems.
For example

When I include the local reference nothing work(path exist and the file is in the directory).
For example

When I run it with the local script i get some errors.

Any suggestion why this doesn't work?
Best Regards,
Deepika

Check path to jquery


LocalModelController creates LocalModelNode resource for ready nodes

What this PR does / why we need it:
This PR creates LocalModelNode CR from localmodel controller.
Note that this is a very early implementation.
Which issue(s) this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged):
Fixes #
Type of changes
Please delete options that are not relevant.

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

Feature/Issue validation/testing:
Please describe the tests that you ran to verify your changes and relevant result summary. Provide instructions so it can be reproduced.
Please also list any relevant details for your test configuration.

[ ] Test A

[ ] Test B
Updated a controller test.

Logs

Special notes for your reviewer:

Please confirm that if this PR changes any image versions, then that's the sole change this PR makes.

Checklist:

[ ] Have you added unit/e2e tests that prove your fix is effective or that this feature works?
[ ] Has code been commented, particularly in hard-to-understand areas?
[ ] Have you made corresponding changes to the documentation?

Release note:

Re-running failed tests

/rerun-all - rerun all failed workflows.
/rerun-workflow <workflow name> - rerun a specific failed workflow. Only one workflow name can be specified. Multiple /rerun-workflow commands are allowed per comment.

/lgtm
/approve


Render as Widget

Can we rendered as widget rather than  opening in  another window?

Do you meaning desktop_webview_window?
I have no idea to rendered a webview as widget on Windows and Linux.

Yess, desktop_webview_window
Do you have any idea about  rendering  a webview as widget on MACOS

I have some ideas, but haven't test it yet.
Maybe we just migrate the flutter official iOS webview implementation to macOS.
https://github.com/flutter/plugins/blob/master/packages/webview_flutter/webview_flutter_wkwebview/ios/Classes/FlutterWebView.m
But there is another issue. flutter do not support PlatformView on macOS now.  https://github.com/flutter/flutter/issues/41722
I guess webview on macOS support offscreen render, so maybe we can render it by flutter TextureWidget.
ref: https://pub.dev/packages/webview_windows

It may be feasible or impossiable, and this is just an idea to implement webview widgets, and there must be a lot of difficulties in the implementation.


No module named 'rawpy'

I'm getting ModuleNotFoundError for 'rawpy' library on my MacOS. I tried installing rawpy directly using 'pip install' / 'brew install' and also using .whl files of multiple versions downloading from org website. Didn't seem to be working anyways. Please help me with this? Thanks.
Traceback (most recent call last):   File "photo_raw_converter_svc/converter.py", line 5, in <module>     import rawpy ModuleNotFoundError: No module named 'rawpy'
This is my installed libraries in my venv
Cython==0.29.24 imageio==2.9.0 numpy==1.21.2 Pillow==8.3.2

@ManudattaG Thanks for letting me know !
I will have a look !!!

@ManudattaG Have you tried to run this inside your environment
 pip install Pillow rawpy imageio

?

@ManudattaG What MacOS version are you using ?

@achimoraites Yeah. I tried running pip install Pillow rawpy imageio inside my environment and this is the stacktrace
Collecting rawpy   ERROR: Could not find a version that satisfies the requirement rawpy (from versions: none) ERROR: No matching distribution found for rawpy
MacOS version -- Big Sur 11.6

Have you tried using Anaconda ?
You could also try to update pip
pip install --upgrade pip

And then try to run
pip install Pillow rawpy imageio

im getting this same issue on a m1 Mac on Monterey 12.3.1 and would love help with a resolution

Same issue here on M1 Pro macOS Monteray 12.1

pip install rawpy -
ERROR: Could not find a version that satisfies the requirement rawpy (from versions: none)
ERROR: No matching distribution found for rawpy

conda install rawpy - (with miniforge)
Collecting package metadata (current_repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.
Collecting package metadata (repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.

PackagesNotFoundError: The following packages are not available from current channels:

rawpy

Current channels:

https://conda.anaconda.org/conda-forge/osx-arm64
https://conda.anaconda.org/conda-forge/noarch

I will have a look !
meanwhile does this work for you ?
https://anaconda.org/appfanu/rawpy

Hello thanks,
I get the same error as "conda install rawpy" with both suggestions on the given link

@ManudattaG @adrienohana @pmm36
I just tried it in MacOS Monterey using Python v3.8.13
It worked without issues 🤔
Note that unfortunately i don't have an M1 machine to test it 😞
Here are the exact versions that were used
certifi==2021.10.8
imageio==2.16.2
numpy==1.22.3
Pillow==9.1.0
rawpy==0.17.1

I have included the requirements.txt file in the project as well
Here there is some extra info about my anaconda setup
 conda version : 4.12.0
 conda-build version : 3.21.4
 python version : 3.8.8.final.0
 virtual packages : __osx=10.16=0
                          __unix=0=0
                          __archspec=1=x86_64
  conda av metadata url : None
  channel URLs : https://repo.anaconda.com/pkgs/main/osx-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/osx-64
                          https://repo.anaconda.com/pkgs/r/noarch

 platform : osx-64
 user-agent : conda/4.12.0 requests/2.25.1 CPython/3.8.8 Darwin/21.4.0 OSX/10.16

OS specific
 System Version: macOS 12.3 (21E230)
 Kernel Version: Darwin 21.4.0

I am getting the same error on Raspberry Pi Zero running 32 bit Raspberry Pi OS, and Raspberry Pi 4B running 64 bit Raspberry Pi OS:

$ pip3 install rawpi
Defaulting to user installation because normal site-packages is not writeable
Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
ERROR: Could not find a version that satisfies the requirement rawpi (from versions: none)
ERROR: No matching distribution found for rawpi

I have published it as a package 📦 in PyPI, you could try to see if installing it from there works for you
pip3 install raw_image_converter

Dear @achimoraites,
Thank you for your help. I've just set up an environment with your requirements and the same python version . tried all of the above again (and pip3 install raw_image_converter) but it's still not working on my M1...
ERROR: Could not find a version that satisfies the requirement rawpy (from versions: none)
ERROR: No matching distribution found for rawpy

I tried cloning and downloading the repository as suggested on pypi.org but still could not figure out how to import from there

I tried using Pip it did not work then I installed it on m1 mac using the source as suggested here https://pypi.org/project/rawpy/. It worked

It works in x86 macos. And on m1 in x86 mode through rosetta
I did get it installed on a m1 mac mini over a year ago on an earlier
version of python and it works.
However I have been unable to reproduce on another machine without copying
the entire python environment from that machine.
And even then updating python causes it to stop working.
It'd not a deal-breaker at the moment because of rosetta, but I would
really like to build native m1 apps with it
On Fri, 15 Apr 2022, 05:58 Achilles Moraites, @.***>
wrote:

@ManudattaG https://github.com/ManudattaG @adrienohana
https://github.com/adrienohana @pmm36 https://github.com/pmm36
I just tried it in MacOS Monterey using Python v3.8.13
It worked without issues 🤔
Note that unfortunately i don't have an M1 machine to test it 😞
Here are the exact versions that were used
certifi==2021.10.8
imageio==2.16.2
numpy==1.22.3
Pillow==9.1.0
rawpy==0.17.1
I have included the requirements.txt file in the project as well
Here there is some extra info about my anaconda setup
conda version : 4.12.0
conda-build version : 3.21.4
python version : 3.8.8.final.0
virtual packages : __osx=10.16=0
                      __unix=0=0

                      __archspec=1=x86_64

conda av metadata url : None
channel URLs : https://repo.anaconda.com/pkgs/main/osx-64
                      https://repo.anaconda.com/pkgs/main/noarch

                      https://repo.anaconda.com/pkgs/r/osx-64

                      https://repo.anaconda.com/pkgs/r/noarch

platform : osx-64
user-agent : conda/4.12.0 requests/2.25.1 CPython/3.8.8 Darwin/21.4.0 OSX/10.16
OS specific
System Version: macOS 12.3 (21E230)
Kernel Version: Darwin 21.4.0
—
Reply to this email directly, view it on GitHub
https://github.com/achimoraites/Python-Image-Converter/issues/4#issuecomment-1099978295,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AYAJFDLJA7TLAX6CUHGTO7TVFEVUXANCNFSM5ECGR7JQ
.
You are receiving this because you were mentioned.Message ID:
@.***>

Ran in to this yesterday. Thought it might be that I’m testing the latest beta on my M1. Apparently not. Whom do I need to pay? ;)

Compile from source is the easiest way to get it running natively for Apple
silicon iirc correctly I had to manually download and install cmake for the
instructions on the rawpy page to work
On Sun, Nov 20, 2022, 10:21 AM SmartDucksWorks @.***>
wrote:

Ran in to this yesterday. Thought it might be that I’m testing the latest
beta on my M1. Apparently not. Whom do I need to pay? ;)
—
Reply to this email directly, view it on GitHub
https://github.com/achimoraites/Python-Image-Converter/issues/4#issuecomment-1321131549,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AYAJFDMWFKABKOFCQSLSPGLWJIQUVANCNFSM5ECGR7JQ
.
You are receiving this because you were mentioned.Message ID:
@.***>

Seems like this issue still exists on Apple Silicon. Tried installing from source too, as mentioned in the documentation, but repeatedly got ImportError. Should $PYTHONPATH be updated after the install?
Installation steps:
gh repo clone letmaik/rawpy
cd rawpy
pip3 intall .

Output:
nstalling collected packages: rawpy
  DEPRECATION: rawpy is being installed using the legacy 'setup.py install' method, because it does not have a 'pyproject.toml' and the 'wheel' package is not installed. pip 23.1 will enforce this behaviour change. A possible replacement is to enable the '--use-pep517' option. Discussion can be found at https://github.com/pypa/pip/issues/8559
  Running setup.py install for rawpy ... done
Successfully installed rawpy

However, scripts are unable to locate the package.

also the same error in M2 Macbook Air. Try all the methods above but still:
pip install rawpy
ERROR: Could not find a version that satisfies the requirement rawpy (from versions: none)
ERROR: No matching distribution found for rawpy

also the same error in M2 Macbook Air. Try all the methods above but still: pip install rawpy ERROR: Could not find a version that satisfies the requirement rawpy (from versions: none) ERROR: No matching distribution found for rawpy

m2 is the same architecture as m1 they are all Apple silicon arm64
Follow the instructions on the rawpy page, after manually downloading and installing cmake + enable command line tools in the cmake gui menu
ensure that typing cmake in the terminal works.
then install Libraw from source
git clone https://github.com/LibRaw/LibRaw.git libraw
git clone https://github.com/LibRaw/LibRaw-cmake.git libraw-cmake
cd libraw
git checkout 0.20.0
cp -R ../libraw-cmake/* .
cmake .
sudo make install
then install rawpy from source
git clone https://github.com/letmaik/rawpy
cd rawpy
pip install numpy cython
pip install .

@pmm36 amazing bro, it works. Thanks a lot

Great!
Glad to hear it :)
On Fri, 19 Jan 2024 at 00:03 GrousexyHKCN @.***> wrote:

@pmm36 https://github.com/pmm36 amazing bro, it works. Thanks a lot
—
Reply to this email directly, view it on GitHub
https://github.com/achimoraites/Python-Image-Converter/issues/4#issuecomment-1899572500,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AYAJFDKW5XH3WFMO23J6MFDYPHPAVAVCNFSM5ECGR7J2U5DIOJSWCZC7NNSXTN2JONZXKZKDN5WW2ZLOOQ5TCOBZHE2TOMRVGAYA
.
You are receiving this because you were mentioned.Message ID:
@.***>

This worked for me a few months ago. Something happened and I had to start from scratch with getting everything I was sing with rawpy reinstalled etc... Now when I try this "Failed to build rawpy
ERROR: Could not build wheels for rawpy, which is required to install pyproject.toml-based projects" Does anyone know what this might be? I have an M1 Pro Mac

This worked for me a few months ago. Something happened and I had to start from scratch with getting everything I was sing with rawpy reinstalled etc... Now when I try this "Failed to build rawpy ERROR: Could not build wheels for rawpy, which is required to install pyproject.toml-based projects" Does anyone know what this might be? I have an M1 Pro Mac

I had similar after reinstalling my machine, I ended up deleting all rawpy and Libraw folders created during the previous build and running through the compiling from source process from the beginning (ensuring cmake was installed and callable from the terminal first

This worked for me a few months ago. Something happened and I had to start from scratch with getting everything I was sing with rawpy reinstalled etc... Now when I try this "Failed to build rawpy ERROR: Could not build wheels for rawpy, which is required to install pyproject.toml-based projects" Does anyone know what this might be? I have an M1 Pro Mac

I had similar after reinstalling my machine, I ended up deleting all rawpy and Libraw folders created during the previous build and running through the compiling from source process from the beginning (ensuring cmake was installed and callable from the terminal first

Thank you this worked

Confirming that pmm36's approach worked for me as well on an M4 Mac Mini with Python 3.13.0. Thanks!


Only "click" setting if released within its MouseArea

Fixes issues with pressing a setting, holding mouse down, and releasing outside of the Setting's MouseArea

Here is what the bug looks like on master
Screencast from 03-06-23 13:25:13.webm


request: add directions callback

For markers there is a way to register callbacks for geocoding results; could this be implemented for directions as well? So once a route has been calculated (or not), a callback method that I set on the directions element will be fired with the result.

I noticed that the directions_changed event could be used. The only issue there is then that the directive only sets the directions if the result was OK, which doesn't give me any results when the result was not OK. I think it would be better if renderer.setDirections(response) would be called in any case, no?

Can someone make a PR for this? this is a very simple change to create an event.


Prepare to Rector next 2.0 with PHPStan 2 and PHPParser 5

Q
A

QA
yes

Description
Rector is upgrading to PHPStan 2 and PHPParser 5 at PR:

https://github.com/rectorphp/rector-src/pull/6431

this PR upgrade for compatiblity syntax.

Ready when Rector 2.0 released, rector/rector can be updated to:
- "rector/rector": "dev-main",
+ "rector/rector": "~2.0.0",

merging and will update renovate PR: https://github.com/laminas/laminas-servicemanager-migration/pull/194


[Medialaan] Episode extractor broken

Please follow the guide below

You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your issue (like this: [x])
Use the Preview tab to see what your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2018.05.26. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

[x] I've verified and I assure that I'm running youtube-dl 2018.05.26

Before submitting an issue make sure you have:

[x] At least skimmed through the README, most notably the FAQ and BUGS sections
[x] Searched the bugtracker for similar issues including closed ones
[x] Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

[x] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:
Add the -v flag to your command line you run youtube-dl with (youtube-dl -v <your command line>), copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', '-f', 'best', '-u', 'PRIVATE', '-p', 'PRIVATE', 'https://vtm.be/video/volledige-afleveringen/id/257695181487000']
[debug] Encodings: locale cp1252, fs mbcs, out cp437, pref cp1252
[debug] youtube-dl version 2018.05.26
[debug] Python version 3.4.4 (CPython) - Windows-10-10.0.17134
[debug] exe versions: ffmpeg 3.4, ffprobe 3.4, rtmpdump 2.4
[debug] Proxy map: {}
[Medialaan]<PHONE_NUMBER>87000: Downloading webpage
Traceback (most recent call last):
  File "__main__.py", line 19, in <module>
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpyarvtrja\build\youtube_dl\__init__.py", line 472, in main
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpyarvtrja\build\youtube_dl\__init__.py", line 462, in _real_main
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpyarvtrja\build\youtube_dl\YoutubeDL.py", line 2001, in download
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpyarvtrja\build\youtube_dl\YoutubeDL.py", line 792, in extract_info
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpyarvtrja\build\youtube_dl\extractor\common.py", line 500, in extract
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpyarvtrja\build\youtube_dl\extractor\medialaan.py", line 169, in _real_extract
IndexError: list index out of range

Description of your issue, suggested solution and other information
Similar to issue #16489 which was temporarily fixed in #16491.
Same issue with Youtube-dl version built with fix #16491.
Fix stopped working after 25/05/2018 (new GDPR law active)

Same issue here, medialaan is broken

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-o', u'%(title)s.%(ext)s', u'https://vtm.be/video/volledige-afleveringen/id/258016142873000', u'-v']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2018.11.23
[debug] Python version 2.7.15rc1 (CPython) - Linux-4.15.0-23-generic-x86_64-with-Ubuntu-18.04-bionic
[debug] exe versions: ffmpeg 3.4.4-0ubuntu<IP_ADDRESS>, ffprobe 3.4.4-0ubuntu<IP_ADDRESS>
[debug] Proxy map: {}
[Medialaan]<PHONE_NUMBER>73000: Downloading webpage
Traceback (most recent call last):
  File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
    "__main__", fname, loader, pkg_name)
  File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
    exec code in run_globals
  File "/usr/local/bin/youtube-dl/__main__.py", line 19, in <module>
  File "/usr/local/bin/youtube-dl/youtube_dl/__init__.py", line 472, in main
  File "/usr/local/bin/youtube-dl/youtube_dl/__init__.py", line 462, in _real_main
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 2001, in download
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 792, in extract_info
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 508, in extract
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/medialaan.py", line 169, in _real_extract
IndexError: list index out of range

It seems that the extractor is still broken for vtm.be/vtmgo
[dylan@desktop ~]$ youtube-dl https://vtm.be/vtmgo/afspelen/edc5d31c6-4b90-4623-9810-06762d79b48c
[Medialaan] edc5d31c6-4b90-4623-9810-06762d79b48c: Downloading webpage
Traceback (most recent call last):
  File "/usr/bin/youtube-dl", line 11, in <module>
    load_entry_point('youtube-dl==2<IP_ADDRESS>', 'console_scripts', 'youtube-dl')()
  File "/usr/lib/python3.7/site-packages/youtube_dl/__init__.py", line 474, in main
    _real_main(argv)
  File "/usr/lib/python3.7/site-packages/youtube_dl/__init__.py", line 464, in _real_main
    retcode = ydl.download(all_urls)
  File "/usr/lib/python3.7/site-packages/youtube_dl/YoutubeDL.py", line 2010, in download
    url, force_generic_extractor=self.params.get('force_generic_extractor', False))
  File "/usr/lib/python3.7/site-packages/youtube_dl/YoutubeDL.py", line 796, in extract_info
    ie_result = ie.extract(url)
  File "/usr/lib/python3.7/site-packages/youtube_dl/extractor/common.py", line 530, in extract
    ie_result = self._real_extract(url)
  File "/usr/lib/python3.7/site-packages/youtube_dl/extractor/medialaan.py", line 169, in _real_extract
    url, webpage, video_id, m3u8_id='hls')[0]
IndexError: list index out of range

Still broken for vtm.be/vtmgo in version 2020.03.24.

Still broken for vtm.be/vtmgo in version 2021.04.17.


CORE-12539 - Update OSGi versions

Test runtime-os is not negatively impacted: https://github.com/corda/corda-runtime-os/pull/3749


[Q] how to import this library in a chrome extension?

how to import this library in a chrome extension?

cannot find any "dist" folder and "exceljs.min.js" after downloading.


Lack of ‘FIND_COURSES、FIND_COURSES_PROMPT、LOOKING_FOR_COURSE’button

branch of master V2.5

@taojeff We've recently added the option to disable the Find Courses feature. If the COURSE_ENROLLMENT.TYPE != 'webview', 'native' or null, it default to no Find Courses.
Could you post your configuration file for COURSE_ENROLLMENT?

@taojeff I'm closing this issue, do let me know if you still need anything on this?


Avoid fusing dependencies of atop reductions

Previously we were comfortable fusing atop computations that contained
reductions with their dependencies.  This had two problems:

The non-reduction functions would receive lists of arrays that they
didn't know how to handle
We would have more data in ram for a task than was perhaps intended.

Now we avoid traversing past atop computations where reductions occur.
Fixes #4201

[x] Tests added / passed
[x] Passes flake8 dask

Merging tomorrow morning if there are no objections


[split] rcore, android changes

PR changes

Fixes the android compilation by moving #include <EGL/egl.h> from rcore_android.c (L10-L11) to rcore.h (R19-R22). This was necessary because the CORE.Window EGL members (R164-R167) need it.

Environment

Compiled following these wiki instructions (for android-29) on Linux Mint (21.1 64-bit).

Edits

1: added line marks.

@ubkp thanks for the review, I'd prefer to move it to rcore_android but CORE.Window needs some review to avoid exposing those platform-dependant properties (afair, EGL is only required by PLATFORM_ANDROID and PLATFORM_DRM).


show.bind does not handling falsy values inside a repeat

link to plunkr that shows the issue : http://plnkr.co/edit/DyiuUD?p=preview
title should have been show.bind does not handle falsy values :P

thanks @Aaike will take a look


Temporary login API added to the backend flask application

Summary by Sourcery
Add a temporary login API to the Flask application, enabling user authentication via Cognito. Implement session management to maintain user sessions securely, and introduce a protected route to verify user login status.
New Features:

Introduce a temporary login API to the backend Flask application, allowing users to authenticate using Cognito's USER_PASSWORD_AUTH flow.

Enhancements:

Add session management with a secret key and session expiration time to handle user sessions securely.

@sourcery-ai review


talk: fixing looping chatinput focus

This addresses #1083. Bug was introduced when I changed the useMedia hook to prevent multiple listeners, initialized was getting overwritten from true to false. I think this also addresses #1092?

Nice


Add/Update CODEOWNERS

Add line to CODEOWNES, or add file if it doesn't exist. Issuse https://github.com/cyberark/community/issues/70

Repo not owned by R&D.


Adding a call to a bridge

Hi,
I have looked through channels Create and Originate functions and it looks like they must have either an app or an extension linked to them, which from my understanding does not simply create a channel but rather establishes a link between the dialed party and either an app or an extension.
In my use case i'm simply trying to place a call to a remote number and add it to a local existing bridge.
What would be the best way to do that ?
Thanks

They do not require one.  You can pass a nil for the reference resource.


How general / universal is Chroma's patching?

Meaning, is it possible to use Overwatch's Chroma patching with other Chroma supported games (in the same vain as Logitech's wrapper), ie: Kerbal Space Program for example, or is it unique to each title?
Thanks in advance!
-WryZed

Universal, should work with most chroma games.

On Dec 16, 2016, at 18:48, WryZed<EMAIL_ADDRESS>wrote:
Meaning, is it possible to use Overwatch's Chroma patching with other Chroma supported games (in the same vain as Logitech's wrapper), ie: Kerbal Space Program for example, or is it unique to each title?
Thanks in advance!
-WryZed
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.

Thank you for the quick response, and the fantastic software! For Chroma related games, is it the binaries directory that needs to be patched? (As a general rule, I realise some may be specific)

Usually it's the folder with the game's exe. There are some rare cases where you have to place those in another directory. But for the most part, next to exe.

Lovely jubbly! Cheers for that!
-WryZed


Write unit tests for the ViewModels

We lost our beautiful 100% coverage status. We need MOAR® tests for the VMs.
Please note that this is a list of the tests missing, don't use the items as the names of the tests.
MainViewModel

[x] A new SmartGuess is added if the location service returns a valid location from getLastKnownLocation
[x] The SmartGuess service must strike if a category was wrongly set
[x] A new SmartGuess is added if updating a category that previously had no SmartGuess associated to it
[x] The update method marks a TimeSlot as setByUser

PagerViewModel

[x] The date observable does not pump new DateChanges unless the date changes
[x] Cover all possible cases for the shouldRefreshView method

[x] .inactive case sets the last inactive date
[x] Waking with .needsRefreshing sets the date to nil
[x] Waking with .needsRefreshing pumps a new refresh event
[x] Waking with .active and no settingsService.lastInactiveDate does nothing
[x] Waking with .active in date == today does nothing
[x] Waking with .active in a case that does not fall in the last two sets the lastInactiveDate to nil
[x] Waking with .active in a case similar to the previous bullet item pumps a new refresh event

TimelineViewModel

[x] The notifyEditingBegan method returns the indexth TimeSlot
[ ] The ViewModel fetches TimeSlots from the service whenever the app wakes up if it's set for the current
[x] If multiple slots are visually merge, only the last one shows the duration
[x] If multiple slots are visually merge, the last one shows the duration of all previous merged slots

CalendarViewModel

[ ] The selectedDate variable pumps new events to the dateObservable
[ ] The currentVisibleCalendarDate variable pumps new  events to the currentVisibleCalendarDateObservable
[ ] The maxValidDate returns the current date at all times
[ ] Test all cases for the canScroll method

[ ] Date comes before to install date
[ ] Date comes after current date
[ ] Date is valid

[ ] Test all the getActivities pipe methods. I won't list those, but it needs 100% coverage for every case of every method in the pipe.

@sofokli1 @Odrakir How do you feel about this issue? If you don't really want to do this right now, I'm fine with moving it.
And if there are arguments for not doing this at all, let me know!

This will be needed at some point but should not block the current milestone. So if this is what is needed for the milestone to finish, better move it somewhere else.

Ah, tests, love them, hate them... mostly hate writing them. I'll see if I can make some of them for this release.


Trying to deploy this starter on vercel i get a build error TypeError: pages.map is not a function

11:41:54.596  	Cloning github.com/capsloq/capsloq-website-frontend (Branch: master, Commit: c3fa738)
11:41:55.796  	Cloning completed in 1200ms
11:41:55.797  	Analyzing source code...
11:41:56.571  	Installing build runtime...
11:41:57.038  	Build runtime installed: 466.721ms
11:41:57.982  	Installing dependencies...
11:41:58.213  	yarn install v1.22.4
11:41:58.227  	warning package.json: No license field
11:41:58.274  	warning<EMAIL_ADDRESS>No license field
11:41:58.275  	[1/4] Resolving packages...
11:41:58.595  	[2/4] Fetching packages...
11:42:07.021  	info<EMAIL_ADDRESS>The platform "linux" is incompatible with this module.
11:42:07.021  	info<EMAIL_ADDRESS>is an optional dependency and failed compatibility check. Excluding it from installation.
11:42:07.024  	info<EMAIL_ADDRESS>The platform "linux" is incompatible with this module.
11:42:07.024  	info<EMAIL_ADDRESS>is an optional dependency and failed compatibility check. Excluding it from installation.
11:42:07.027  	[3/4] Linking dependencies...
11:42:07.028  	warning " ><EMAIL_ADDRESS>has incorrect peer dependency<EMAIL_ADDRESS>11:42:10.827  	[4/4] Building fresh packages...
11:42:11.304  	Done in 13.10s.
11:42:11.332  	Running "yarn run build"
11:42:11.605  	yarn run v1.22.4
11:42:11.619  	warning package.json: No license field
11:42:11.628  	$ next build
11:42:12.357  	info  - Creating an optimized production build...
11:42:12.428  	Attention: Next.js now collects completely anonymous telemetry regarding usage.
11:42:12.428  	This information is used to shape Next.js' roadmap and prioritize features.
11:42:12.428  	You can learn more, including how to opt-out if you'd not like to participate in this anonymous program, by visiting the following URL:
11:42:12.428  	https://nextjs.org/telemetry
11:42:23.388  	info  - Compiled successfully
11:42:23.388  	info  - Collecting page data...
11:42:23.559  	Warning: You have opted-out of Automatic Static Optimization due to getInitialProps in pages/_app. This does not opt-out pages with getStaticProps
11:42:23.559  	Read more: https://err.sh/next.js/opt-out-auto-static-optimization
11:42:23.993  	> Build error occurred
11:42:23.995  	TypeError: pages.map is not a function
11:42:23.995  	    at getStaticPaths (/vercel/workpath0/frontend/.next/serverless/pages/[[...slug]].js:4571:23)
11:42:23.995  	    at processTicksAndRejections (internal/process/task_queues.js:97:5)
11:42:23.995  	    at async buildStaticPaths (/vercel/workpath0/frontend/node_modules/next/dist/build/utils.js:17:80)
11:42:23.995  	    at async Object.isPageStatic (/vercel/workpath0/frontend/node_modules/next/dist/build/utils.js:24:549) {
11:42:23.995  	  type: 'TypeError'
11:42:23.995  	}
11:42:24.017  	error Command failed with exit code 1.
11:42:24.017  	info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.
11:42:24.027  	Error: Command "yarn run build" exited with 1
11:42:26.171  	Done with "package.json"

Fresh Fork, not sure why this is happening

Solved it. For future reference i did forget to add the --template attribute to the npx command
npx create-strapi-app backend --template https://github.com/strapi/strapi-template-corporate
Instead it installed a version of strapi backend where "pages" is not a content type e.g. it threw the error.

Happy to hear you fixed your problem!


handle() turns into a subcommand when other subcommands are present.

handle() should be treated as an invocable solo initializer when it is supplied in the context of subcommands. handle() should only turn into a subcommand if an initializer() is present..
If this module was named mycommand:

class Command(TyperCommand):

     def handle():
        pass

     @command()
     def subcommand()
         pass

handle() should be invoked with ./manage.py mycommand and subcommand with ./manage.py mycommand subcommand. The bug is that right now you have to invoke handle like this: ./manage.py mycommand mycommand

This is not actually possible. This is a limitation of Typer. You can almost do it by turning handle into a Typer callback (initialize()), setting invoke_without_command=True and not calling the initialize function if a subcommand was invoked. This gets you 95% of the way there. The problem arises if handle() takes any required positional arguments - this means those would have to be supplied for any of the subcommands to be invocable which is counterintuitive to what the interface would be bending over backwards to do.
I think the solution here is to just accept this, and add some how to documentation to implement some of these more complex call patterns. handle() should be allowed to be an initializer() though.


Flow renderer crashes upon creation

Open /glade/scratch/stasj/OKC_AuxScalar_0.vdc
Create a Flow renderer

Vapor will crash. Tested on OSX

This crash is cause by certain variables not present in the data folder. Do we have a convention on how to handle this situation? @StasJ @clyne @sgpearse

Waiting on #1971

I hope the issue submitter could follow our convention to put the data set in question in the appropriate directory.
For this particular data, it's been linked to: /glade/p/cisl/vast/vapor/Bugs/1907

As of 01/07/2019, this data set reports error when opened, before creating any new renderer:

@shaomeng needs to confirm that there is a problem opening the data set

Update:
@clyne  this data set opens properly right now, so discard the comment saying that it won't open.
Regarding the reported crash, it doesn't crash anymore and shows a notification window saying that some variables are missing. I think we can close this bug now.


feat(GridForm): re-read errors on submit

Overview
✨UPDATE✨

Clears previous error state onError and manually triggers validation so that the proper form errors are read by VO every time the Submit button is pressed.

PR Checklist

[ ] Related to designs:
[x] Related to JIRA ticket: web-1809
[x] I have run this code to verify it works
[x] This PR includes unit tests for the code change
[x] The alpha package of this PR is passing end-to-end tests in all relevant Codecademy repositories

PR Links and Envs

Repository
PR Link
PR Env

Monolith
Monolith PR
Monolith Env

Portal
Portal Link
Portal Env

📬Published Alpha Packages:@codecademy/gamut-kit@0.6.133-alpha.81d8e3.0@codecademy/gamut-labs@31.15.1-alpha.81d8e3.0@codecademy/gamut@47.3.4-alpha.81d8e3.0@codecademy/monaco@0.6.47-alpha.81d8e3.0<EMAIL_ADDRESS>
🚀 Styleguide deploy preview ready!https://6298f8475fd65e02fe239ddf--gamut-preview.netlify.appDeploy Logs

🚀 Styleguide deploy preview ready!https://6299040dee74cd08c16fbeaf--gamut-preview.netlify.appDeploy Logs

📬Published Alpha Packages:@codecademy/gamut-kit@0.6.133-alpha.807984.0@codecademy/gamut-labs@31.15.1-alpha.807984.0@codecademy/gamut@47.3.4-alpha.807984.0@codecademy/monaco@0.6.47-alpha.807984.0<EMAIL_ADDRESS>
📬Published Alpha Packages:@codecademy/gamut-kit@0.6.135-alpha.89278e.0@codecademy/gamut-labs@31.15.3-alpha.89278e.0@codecademy/gamut@47.3.4-alpha.89278e.0@codecademy/monaco@0.6.47-alpha.89278e.0<EMAIL_ADDRESS>
🚀 Styleguide deploy preview ready!https://629e1c797ea5354c9a69c87f--gamut-preview.netlify.appDeploy Logs

Confirmed this works as expected on the corresponding monolith and portal app PRs!
Is this something we could add a unit test for?

i've spent some time tryna figure out a way to mock clearErrors(), will spend some more time trying to figure it out!

📬Published Alpha Packages:@codecademy/gamut-kit@0.6.135-alpha.9ed211.0@codecademy/gamut-labs@31.15.3-alpha.9ed211.0@codecademy/gamut@47.3.4-alpha.9ed211.0@codecademy/monaco@0.6.47-alpha.9ed211.0<EMAIL_ADDRESS>
🚀 Styleguide deploy preview ready!https://629e85fe43e3160c170a2192--gamut-preview.netlify.appDeploy Logs

📬Published Alpha Packages:@codecademy/gamut-kit@0.6.136-alpha.0b011b.0@codecademy/gamut-labs@31.15.4-alpha.0b011b.0@codecademy/gamut@47.3.5-alpha.0b011b.0@codecademy/monaco@0.6.48-alpha.0b011b.0<EMAIL_ADDRESS>
🚀 Styleguide deploy preview ready!https://629ecdc6158e1319a5f79ba8--gamut-preview.netlify.appDeploy Logs

📬Published Alpha Packages:@codecademy/gamut-kit@0.6.136-alpha.b53e84.0@codecademy/gamut-labs@31.15.4-alpha.b53e84.0@codecademy/gamut@47.3.5-alpha.b53e84.0@codecademy/monaco@0.6.48-alpha.b53e84.0<EMAIL_ADDRESS>
🚀 Styleguide deploy preview ready!https://629ecf79524b221aa2ed7f24--gamut-preview.netlify.appDeploy Logs


Disable Watch on Kubernetes Metadata Filter Plugin

The https://github.com/fabric8io/fluent-plugin-kubernetes_metadata_filter has a watch functionality that watches for all pods in the system and caches the metadata of all pods. However, we've seen in our testing with our other fluentd collector that this OOM kills the fluentd container since the cache quickly fills up. This is pretty easy to run into especially with large clusters like ours (700+ nodes, 10k+ pods). We fixed this issue by disabling the watch functionality. Below is a code snippet of how to do that:
    <filter user.**>
      @type kubernetes_metadata
      tag_to_kubernetes_name_regexp '.+?\.containers\.(?<pod_name>[a-z0-9]([-a-z0-9]*[a-z0-9])?(\.[a-z0-9]([-a-z0-9]*[a-z0-9])?)*)_(?<namespace>[^_]+)_(?<container_name>.+)-(?<docker_id>[a-z0-9]{64})\.log$'
      watch false
      de_dot false
      annotation_match ["^civis\.io\/.*"]
    </filter>

Can we expose this setting as an environment variable for this image?

@salilgupta1 yes we can add this, as part of addressing #79, I will expose this setting and other settings that are not currently exposed to provide more control of the metadata filter plugin.

@salilgupta1 v1.2.0 and latest will contain these changes.


Consolidate and standardize all linting at the root level

Background:
Until recently, amp-github-apps had a huge backlog of package updates (>100 PRs). Once the grouping structure was optimized and auto-review + auto-merge was enabled, the backlog became considerably smaller (~15 PRs).
Problem:
Since each app maintains its own set of versions for eslint, prettier, etc., new linting package releases will trigger multiple PRs for the same upgrade. This can be solved by consolidating all linting at the root level.
PR Highlights:

Move all lint dependencies to the root package.json
Create a single linting npm script while continuing to use app-specific rules and settings
Update the main PR check script to run lint checks before app-specific tests
Remove app-specific linting dependencies and commands
Remove lint rules that conflict with prettier (e.g. here)
Apply auto-fixes by running npm run fix from the root dir

For easy reviewing, look at one commit at a time.
Future work:
If this PR yields good results, consolidate versions for other common infrastructure (e.g. testing libraries like jest)
Closes #1357

Final updates:

Updated lint check + all app-level tests are green.
Noise from in-flight and future upgrade PRs should further reduce.
Can make any other code changes via a follow up.
Apps can be re-deployed when other changes make it necessary.

Merging now.


Script doesnt apply properly. Must always refresh page or hit save.

If you filter a new word on any lemmy page, the filter will only work in that page. If you go page 2 of the same community or use lemmy's own search for the keyword, you will still find said filtered keyword. You have to hit F5 or once again click "Save"  as indicated on the guide and only then itll work for all cases described.
Naturally, having to refresh the website every time i go to the next page is not ideal. I should be able to set the specific keyword once and forget about it from then on.

I added this after filterPostsByKeywords(savedKeywords); (second to last line):
  const callback = function(mutationsList, observer) {
    filterPostsByKeywords(savedKeywords);
  };
  // Create an observer instance linked to the callback function
  const observer = new MutationObserver(callback);
  const config = { childList: true, subtree: true };
  // Start observing the target node for configured mutations
  observer.observe(document.getElementsByClassName("home")[0], config);

It most definitely is not an optimal solution, but it works and is good enough after few minutes of googling and editing.
It monitors changes in the main element and everytime there's a change, it runs the filters again.

I can take a look at this later, I'm currently wrapped up in a few other projects.
A more ideal solution would be watching for clicks to the next and previous page buttons and then running the filter. I'm open to PR's if anyone wants to make that change.


Doesn't work with Python 3.4

I tried using this library in both Python 2 and 3 with a BMP180 sensor from Adafruit. It works great with version 2.7.x, but I'm having 'unsupported operand type(s)' errors when trying to use this library with Python 3.4:

Please note that the sensor seems to be recognized, as shows the following screenshot:

I'm working with a Raspberry Pi model B if that helps.

Oh thanks for grabbing the details on the failure--yeah I don't think I've tested this one with Python 3.4 so stick with python 2.7 for now.  I'll try to take a look later this week though to see why the bit shift isn't valid in 3.4.  Thanks!

Yep, switched my project to Python 2.7 for now. Thank you.

I believe I found the issue, not sure exactly what the best fix is, though. Definitely a problem with the result of the addition of two ints becoming a float. Then the bitwise operators fail.
Changing it like below definitely fixes the issue. I have been testing with the debugging values, will test again with the actual unit when I get home. (There are three other instances where int addition yields a float)

Not sure exactly what the best practice fix is, but I will be more than happy to make this change.

@campenberger's fix in pull request #8 fixes this.

Oh this should be resolved now, a few months ago we did a pass adding python 2 and 3 support to all the libs.  Can see more details here: https://github.com/adafruit/Adafruit-Raspberry-Pi-Python-Code  Thanks!


Fix typo and add new translation

Improve Turkish github-git-cheat-sheet.

Thank you for this improvement, @sametcelikbicak!


Error

Using nodejs v16.6.1

@ffamilyfriendly

Sorry for rate reply! I cant seem to replicate this with the same version of node. Can you try running node with the flag --input-type=module? eg node --input-type=module  .

Still the same error

Solved by changing node-fetch version in package.json to 2.6.2. Why you dont have package.json in the repo?

Solved by changing node-fetch version in package.json to 2.6.2. Why you dont have package.json in the repo?

Glad to hear you got it to work! No clue why there is no package.json I'll take a look


Yep! 👍

Guys, you rock. Thank you.
On 24 April 2017 at 20:42, Richard Kuhnt<EMAIL_ADDRESS>wrote:

Yep! 👍
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/lukesampson/scoop/pull/1448#issuecomment-296800941,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AA4nLaQgd_Nw4QHH2fSHvXWsglA3m1vlks5rzPshgaJpZM4NGjxG
.


Fix: controllerrevision can not be updated

Description of your changes

Fixes #
I have:

[ ] Read and followed KubeVela's contribution process.
[ ] Related Docs updated properly. In a new feature or configuration option, an update to the documentation is necessary.
[ ] Run make reviewable to ensure this PR is ready for review.
[ ] Added backport release-x.y labels to auto-backport this PR if necessary.

How has this code been tested

Special notes for your reviewer

Fix: #2762


FrescoDrawee causing Image not to load on iOS

I am loading the FrescoDrawee inside the android tag and it works great, but when i try and run iOS the images don't show up and i get an undefined error.
<ios>
      <Image col="0" row="0" [src]='story.thumbnail | processThumbnail' stretch="aspectFill" loadMode="async" class="thumbnail" (doubleTap)="onDoubleTap()" ></Image>
</ios>
<android>
     <FrescoDrawee [imageUri]='story.thumbnail' aspectRatio="1" width="100%" class="thumbnail"></FrescoDrawee>
</android>

CONSOLE ERROR file:///app/tns_modules/nativescript-angular/zone-js/dist/zone-nativescript.js:344:22: Error: Uncaught (in promise): Error: Error in pages/list/list.swipe.1.html:14:24 caused by: undefined is not a constructor (evaluating 'new viewClass()')

If I remove the FrescoDrawee tag from inside the android tag the iOS view loads fine with the image.

Hi @rsquared86 ,
Using the <ios> and <android> tags in NativeScript + Angular project is not possible. In such scenarios you will need to use a different approach merging different platform specific HTML tags.
You can take a look at the implementation we have in our nativescript-ui-samples-angular repository. In that project take a look at the usage and implementation of the *tkIfAndroid and *tkIfIOS custom directives. The implementation of those directives can be found here and an example of how to use them here.

thanks, i used that approach and it seems to be working, although i can't use pipe directives in elements that use the tkIf directive. any suggestions?
<Image *tkIfIOS col="0" row="0" [src]='story.thumbnail | processThumbnail' stretch="aspectFill" loadMode="async" class="thumbnail" (doubleTap)="onDoubleTap()" ></Image>
throws an error on processThumbnail

undefined is not an object (evaluating 'self.parentView._pipe_processThumbnail_0.transform')

Closing this issue due to no activity. If you find this an interesting thread you can use the dedicated community forums here.


Finish hotfix/wronglink

Coverage remained the same at 76.174% when pulling 41271185bc0514b3f60b1d5d58493e34f3a3287f on develop into 6c376ea01126280e6ebd18a78ec845075f7a65bf on master.


TD-2221 New status "No Metrics" for Card Status

Contributes to TD-2221
Changes
Implemented the no-metrics status for the StatusCard component. This modification is essential for obtaining the No Metrics status in FLEET, ensuring consistency with the statuses in RESULT.
Dependencies
N/A
UI/UX
Light mode:

Dark mode:

Testing notes

npm run storybook and check StatusCard component includes the new option for no-metrics.

Author checklist before assigning a reviewer

[x] Reviewed my own code-diff.
[x] Branch has been run in docker.
[x] PR assigned to me or an appropriate delegate.
[x] Relevant labels added to the PR.
[ ] Appropriate tests have been added.
[x] Lint and test workflows pass.

Looks good to me.


add link to conflicting rules list to README

this closes #211

Thanks!

:tada: This PR is included in version 1.17.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Use com.precog http4s release 0.21.2

Might be worth making sure we get http4s in sdbe onto 0.21.1.


Libs created from this template not working on browser

AIO SDK libs (e.g. aio-lib-analytics) created from this template can be used in Runtime actions. However, in some cases they should be used directly on the client side to fetch data from the backend service (little or no processing) without making a detour to the actions. Using those libs in the client JS code is yet not working.
Expected Behaviour
I should be able to use the libs in client side code (e.g. useEffect() in React).
Actual Behaviour
This error is printed out in browser console: TypeError: Swagger is not a constructor.

Just discovered the unit tests are not passing with<EMAIL_ADDRESS>but pass on<EMAIL_ADDRESS>Can you try pinning swagger-client to 3.18.5 in your lib and see if it works? Still investigating the unit tests issue.

Scratch my instruction above, #35 has been resolved

FWIW - the error message above happens to any SDK depending on<EMAIL_ADDRESS>and earlier.

FWIW - the error message above happens to any SDK depending on<EMAIL_ADDRESS>and earlier.

Do you mean also the error doesn't happen on<EMAIL_ADDRESS>?

Do you mean also the error doesn't happen on<EMAIL_ADDRESS>?

It does. I should have written "the error message above ALSO happens to any SDK depending on<EMAIL_ADDRESS>and earlier".
However it's harder to reproduce on<EMAIL_ADDRESS>because it gives a different error on Parcel [1].
When I used the SDK on<EMAIL_ADDRESS>in a webpack powered websrc, I got the same error TypeError: Swagger is not a constructor.
[1]
@parcel/core: Failed to resolve '@swagger-api/apidom-reference/configuration/empty'

This template is designed for nodejs use in a runtime action or in cli tooling.  If you want a to generate web modules, I think that would be a new repo.


Stop using node_modules for testing

Install test modules (webpack and dependency) into a separate test_modules folder in order to avoid node_modules polution.
PR for issue #22

Looks great. Nice work. Feel free to merge.


Update Developer Guide

I think we should all make changes to the this branch instead

Coverage remained the same at 87.259% when pulling e7b846f34eeb11167e620bcd1657aca31628a780 on update-guides into 6c430a491f3360eeec1052ea009ec4eccf63baac on master.

Coverage remained the same at 87.259% when pulling 3703a7e91283fb6ae7c8f1dfdd503946092b9f49 on update-guides into 6c430a491f3360eeec1052ea009ec4eccf63baac on master.

Coverage remained the same at 87.259% when pulling 691a3fff7eb3d984e3876c6cb09e08c3b222a462 on update-guides into 6c430a491f3360eeec1052ea009ec4eccf63baac on master.

Coverage remained the same at 87.259% when pulling 36b751aec4707a570fce3c9849b70a0bfce6cf9d on update-guides into 6c430a491f3360eeec1052ea009ec4eccf63baac on master.

Coverage remained the same at 87.259% when pulling 0017aa9e335f5691f863bb3af53aa0d04d687197 on update-guides into 6c430a491f3360eeec1052ea009ec4eccf63baac on master.

Coverage remained the same at 87.259% when pulling f66d755fa1f98bd6687de9f41b0e0135613b244e on update-guides into 6c430a491f3360eeec1052ea009ec4eccf63baac on master.


UPN vs e-mail for contained users mapped to AD identities

Under the section Create contained users mapped to Azure AD identities there is a following statement:

Azure_AD_principal_name can be the user principal name of an Azure AD user or the display name for an Azure AD group.

However I can create a user from its primary e-mail address that is not the same as user principal name, but I cannot create a user from its alternative/secondary e-mail address. Here is an example user info:

Primary e-mail address<EMAIL_ADDRESS>User Principal Name (UPN<EMAIL_ADDRESS>Alternative e-mail address<EMAIL_ADDRESS>
And this works:
CREATE USER<EMAIL_ADDRESS>FROM EXTERNAL PROVIDER;
I cannot find any documentation if I can rely on primary e-mail address instead of UPN to assign access to Azure SQL Database.
What is more when I create a user from its primary e-mail address I cannot drop this user by its UPN:
DROP USER<EMAIL_ADDRESS>Cannot drop the user<EMAIL_ADDRESS>because it does not exist or you do not have permission.
However when I try to create the user from the UPN, but it was already created from the e-mail I get another error:
CREATE USER<EMAIL_ADDRESS>FROM EXTERNAL PROVIDER;
Failed to execute query. Error: The login already has an account under a different user name.
The error message refers to 'login' - I do not know how it relates to a contained database user which is the case here.
The SQL statement here:
IF NOT EXISTS (     SELECT  [name]     FROM    sys.database_principals     WHERE   [name] =<EMAIL_ADDRESS>) SELECT 0 ELSE SELECT 1;
returns '0' if the user was created from UPN in particular database.
And this SQL statement:
IF NOT EXISTS (     SELECT  [name]     FROM    sys.database_principals     WHERE   [name] =<EMAIL_ADDRESS>) SELECT 0 ELSE SELECT 1;
returns also '0' when user was created from an e-mail address in particular database.
However Azure SQL Server somehow knows that it is the same (contained) AD user when I try to create it from e-mail or UPN - the question is how can I check if particular AD user exists in particular database having just UPN or just primary e-mail of an AD user.
It would be nice to get this behavior documented somewhere.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 2d4a33b0-87d0-f60c-1b52-aeafa889e657
Version Independent ID: c281bdb7-c98c-6853-5077-41b3dd44d3a2
Content: Configure Azure Active Directory authentication - Azure SQL Database & SQL Managed Instance & Azure Synapse Analytics
Content Source: articles/azure-sql/database/authentication-aad-configure.md
Service: sql-db-mi
Sub-service: security
GitHub Login: @GithubMirek
Microsoft Alias: mireks

@bartlomiej-stys Thank you for the detailed feedback. This is being assigned to the content author to evaluate and update as appropriate.


How can I customize the grid checkbox?

Issue Type (delete the irrelevant ones)

[x] Question

Specs
What version are you using?
2.12.2
What browser?
safari

I would like to know if it is possible to customize the style of the checkbox, leave it with a different color and size of the pattern. Is this possible?

hey @avlima, You'd customize the style like any other checkbox. You can use .vgt-checkbox-col input selector for your style rules.
closing.

Maybe you don't know, but checkbox can't be customized directly, you need to add label, so this is really big problem as we can only use default ones.


Scroll while dragging

This package is great! Do you know of a scroll library that works well with this package, for both the html5-backend and the touch-backend? When the user is dragging an item and they reach the bottom edge of the screen, I want the parent container to scroll so they can drag the item to the bottom of the container.

Never mind. Answered my own question. I've found that react-dnd-scrollzone works great.
https://github.com/azuqua/react-dnd-scrollzone


Upgrade to Dart 1.13 --> Exception when using dart:web_sql

Just upgraded to Dartium 1.13.0 and now get this exception :

 Uncaught Unhandled exception:
The null object does not have a method 'call'.

NoSuchMethodError: method not found: 'call'
Receiver: null
Arguments: [Instance of 'SqlTransaction', Instance of 'SqlResultSet']
#0      Object._noSuchMethod (dart:core-patch/object_patch.dart:42)
#1      Object.noSuchMethod (dart:core-patch/object_patch.dart:45)
#2      SqlTransaction.executeSql. (dart:web_sql:412)

'I remain on Dartium 1.12.2 release to avoid this error'

Can you please provide some code that reproduces this issue?

Please re-try with Dart 1.24.2 Stable (Dartium 50).


Changes to Jibri recording flows

A summary of what was done here:

The 'status' values we pass between Jibri and Jicofo and Jicofo and the web were simplified:
a) States related to availability were removed.  We no longer communicate availability to the web client, the services (recording/live streaming) are enabled or disabled in the client and Jicofo will deny/fail to execute requests if no Jibris are available.
b) States that were actually temporary conditions, and not states (such as 'error' or 'busy') were shifted into a FailureReason value which can accompany the OFF state.
c) The only states now are ON, OFF, and PENDING.

XMPPError was removed in favor of using FailureReason.  XMPPError would only show up in ErrorIQ messages, which can only be sent as responses (not new IQs), and Jibri needs to send new IQ messages after it replies to the initial request with status updates.

A session id was added to distinguish a unique Jibri session.  This makes debugging a lot easier, but also paves the way for potentially duplicate, parallel services running at once (for example, 2 live streams in a single call).

The RecordingMode has been added to the RecordingStatus.  Since we no longer have only a single service (file recording OR live stream) configured, clients other than the one who started the service need to know which service type is being started so they can display the proper label in the UI.

This will have some accompanying changes in Jicofo and Jibri as well, don't merge it yet but please take a look.

a) States related to availability were removed. We no longer communicate availability to the web client, the services (recording/live streaming) are enabled or disabled in the client and Jicofo will deny/fail to execute requests if no Jibris are available.

So there's no need to do any indications in the UI for the availability ?

a) States related to availability were removed. We no longer communicate availability to the web client, the services (recording/live streaming) are enabled or disabled in the client and Jicofo will deny/fail to execute requests if no Jibris are available.
So there's no need to do any indications in the UI for the availability ?

We do give availability-related errors on the web, they just come from the Jicofo response to the request as opposed to the state being pushed ahead of time.


[EDQ-401] Renamed the 'table_metrics' scripts to be more informative.

Only modified weekly scripts
Updated the .gitignore to exclude any Excel files in the directory relating to the data quality metrics
Fixed typo in previous PR

@nishanthpp93 updated PR.

@nishanthpp93 let me know when you can approve this. I have another PR coming later today (basically just the same scripts going into the other scripts folder to ensure that we have consistent comparisons between weekly and combined datasets.


test: Bump migrate-svc-test image

In the new version [1], the client sends a request to the server
every 0.5s over the long-lived connection, and it expects a reply from
the server in 1s. The change can help to catch intermittent connection
failures during Cilium upgrades. The previous version could only catch
connections failing due to RST.
[1]: https://github.com/cilium/migrate-svc-test/commit/edc628b2df7bd1002d3499c7f65df8c0396502ff

Added the labels to backport to 1.{8,9} to improve coverage.
Will update packer-ci-builder after this PR has been merged.

test-me-please

Due to the problems with backporting this PR to v1.8, I have removed the needs-backport/1.8 label. If we want this on the 1.8 branch, I think that someone with more detailed understanding of the problem needs to take point on that backport specifically (/cc @kAworu @brb)
Related:
https://github.com/cilium/cilium/pull/14059#issuecomment-734247320


Autograph in Tensorflow 1.15  has unexpected behavior with "==" conditional statement

System information

Custom code: Yes
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Windows 10
TensorFlow version: 1.15.0 (git version v1.15.0-rc3-22-g590d6eef7e)
Python version: 3.6

Current behavior
Using autograph to translate python code with "==" conditional statement leads to unexpected behavior, where the value of the variable in conditional statement does not affect the output. The translation does not give an error, but leads to wrong implementation. This behavior is unique to "==" and does not occur with "<, >, <=, >=" conditionals.
Expected behavior
The code execution should be affected by truth state of "==" conditional statement. Although, one can get desired behavior by replacing "if z == 0:" with "if tf.math.equal(z, 0):" as a workaround, but one might not have access to replace this statement. This issue can lead to unintended consequences.
Code to reproduce the issue
This is a modification of square_if_positive code from TensorFlow documentation.
import tensorflow as tf
from tensorflow import autograph as ag

#minimal code for method to demonstrate issue
def foo(x, opt):
    if opt == 0:
        y = x * x
    else:
        y = -x
    return y

#graph construction
mdl = tf.Graph()
with mdl.as_default():
    converted_foo = ag.to_graph(foo)
    print(ag.to_code(foo))
    x = tf.placeholder(tf.float64, name='x')
    opt = tf.placeholder(tf.float64, name='opt')
    y = converted_foo(x, opt)

#graph execution
with tf.Session(graph=mdl) as sess:
    aval = sess.run(y, feed_dict={x:4, opt:0})
    print('output for opt = 0 is ' + str(aval))
    aval = sess.run(y, feed_dict={x:4, opt:1})
    print('output for opt = 1 is ' + str(aval))

Current Response:
output for opt = 0 is -4.0
output for opt = 1 is -4.0

Desired Response:
output for opt = 0 is 16.0
output for opt = 1 is -4.0

We can get desired response by modifying python source code of foo method, but that is not the ideal solution to this issue:
#minimal code for method to demonstrate issue
def foo(x, opt):
    if tf.math.equal(opt,0):
        y = x * x
    else:
        y = -x
    return y

Other info / logs
In Tensorboard, we can see that with "==" the truth state of "opt == 0" is completely ignored

However, with "tf.math.equal(opt,0)", we get desired graph:

I have tried on colab with TF version 1.15 and was able to reproduce the issue.Please, find the gist here. Thanks!

Indeed, AutoGraph does not convert equality operators by default, for historical reasons. However, this is only an issue in older versions of TF, and there is an optional flag to handle it in that case as well.
For a long time, Tensor objects did not implement the equality operator __eq__ (see https://github.com/tensorflow/tensorflow/issues/9359). AutoGraph does have the ability to rewrite it, if you call ag.to_graph(foo, experimental_optional_features=ag.experimental.Feature.EQUALITY_OPERATORS). The feature is not enabled by default to maintain compatibility with existing graph code.
Fortunately, we were able to fix the equality issue in TF 1.15 (see the release notes) and newer, but in 1.15 you still need to enable it manually (for reasons of backward compatibility). In essence, you need to call tf.enable_tensor_equality(). This behavior is already enabled by default in TF 2.0.


LCFS-985: Fixing filters in transaction and compliance report tables

Filters in transaction table and compliance report are working propertly backend.
Inputs are not case sensitive, user can type lower or capital letters
Date picker is added
Configuration in the front end to allow filters, including special configuration for Enum values
Add clear button to reset individual filters.

Thanks a lot for the review @dhaselhan


Transfer to TC39

@surma Could you please rename this to proposal-typedarray-stride and transfer it over to the tc39 org?

I've invited them to tc39-transfer.

Done :)


Add OVN TLS certs for metadata agent

Depends-On: https://github.com/openstack-k8s-operators/edpm-ansible/pull/615

recheck

/retest

/retest

Working on my local deployment https://github.com/openstack-k8s-operators/edpm-ansible/pull/615#issuecomment-2043490820

/lgtm

/retest

recheck

Force merging to break dependency cycle


Fixed Weak Hash

Switched to Bcrypt

Hi! Thank you for working on this PR and I think is a good idea to use library to enhance security level of the password :)


Issues with norm_params.pkl.

Hi, currently attempting to use the predict.py script for generating ESPs, but met with a number of thorny errors related to lines 153/4 (opening the norm_params file using pickle.load). It seems that the script should use the 'rb' mode, but this still leads to a UnicodeDecode error. Further attempts to directly load the norm_params.pkl file itself fails with an invalid load key.

might be due to the fact that python2 was used to save those .pkl but you're trying to read it from python3

Change encoding to "latin1" if you want to read the pkl from python3


About get object with Range

Hello,
We are using goofys with very big file : ~ 20 G
We are using mmap() on this file and then we do a lot of memcpy of block < 128K.
We are observing a lot of big range request on S3 bucket, ~ 5M  compare to 128K maximum.
Can you explain how get object with http range are done with goofys ?
Regards,
Nicolas Prochazka

When goofys detects that a file is being read sequentially (which is defined as 5MB of sequential read), goofys switches to readahead mode which prefetches the next 100MB in 20MB chunks. This allows us to read the object in parallel and speed up the read. See #21 for some background information.
Is that not working well for you?

Yes it is a problem for us. We are using raw image of filesystem so read
block is rarely sequencially, can we disable it ?
Regards,
Nicolas prochazka.
Le dimanche 25 septembre 2016, Ka-Hing Cheung<EMAIL_ADDRESS><javascript:_e(%7B%7D,'cvml','notifications@github.com');>> a écrit :

When goofys detects that a file is being read sequentially (which is
defined as 5MB of sequential read), goofys switches to readahead mode which
prefetches the next 100MB in 20MB chunks. This allows us to read the object
in parallel and speed up the read. See #21
https://github.com/kahing/goofys/issues/21 for some background
information.
Is that not working well for you?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/kahing/goofys/issues/114#issuecomment-249399638, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ABgm0FGfpX8oi6Gzs-9FoKXI0cntpDTTks5qteP2gaJpZM4KFLbB
.

How are you reading the raw filesystem images? goofys only goes into this mode if you already read 5MB sequentially. Could you describe the use case a bit more?

Typical use is very simple, Linux mmap file of 20g, then read block of size
from 8ko to 128ko, not sequentially, we are observing lot of 5mo chunk from
sdk/go on s3 log file
Regards,
Nicolas
Le dimanche 25 septembre 2016, Ka-Hing Cheung<EMAIL_ADDRESS>a
écrit :

How are you reading the raw filesystem images? goofys only goes into this
mode if you already read 5MB sequentially. Could you describe the use case
a bit more?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/kahing/goofys/issues/114#issuecomment-249434652, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ABgm0Feqdel6OQxxsiNzpK_rk-gCJlGjks5qtrCFgaJpZM4KFLbB
.

could you try the latest commit to see if that addresses the problem for you? goofys could still have some positives but we should fallback to doing regular GET quickly.
Note that since you are doing random read, performance will be quite bad since each read will map to a separate GET request. S3 isn't really designed for this use case.

hello,
i'm trying to compile from last commit, but when i try to mount bucket
nothing .
./goofys --debug_fuse --debug_s3 --region eu-west-1 xxx /aws2/
no debug
[root@retd bin]# ls /aws2/
no mount point
Regards,
Nicolas
2016-09-25 20:23 GMT+02:00 Ka-Hing Cheung<EMAIL_ADDRESS>
could you try the latest commit to see if that addresses the problem for
you? goofys could still have some positives but we should fallback to doing
regular GET quickly.
Note that since you are doing random read, performance will be quite bad
since each read will map to a separate GET request. S3 isn't really
designed for this use case.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/kahing/goofys/issues/114#issuecomment-249437223, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ABgm0D2ostADCCUQpf0ppeAAfa1mvFwWks5qtrw9gaJpZM4KFLbB
.

By default log goes to syslog unless you use -f
On Sep 26, 2016 5:15 AM, limbo127<EMAIL_ADDRESS>wrote:hello,
i'm trying to compile from last commit, but when i try to mount bucket
nothing .
./goofys --debug_fuse --debug_s3 --region eu-west-1 xxx /aws2/
no debug
[root@retd bin]# ls /aws2/
no mount point
Regards,
Nicolas
2016-09-25 20:23 GMT+02:00 Ka-Hing Cheung<EMAIL_ADDRESS>
could you try the latest commit to see if that addresses the problem for
you? goofys could still have some positives but we should fallback to doing
regular GET quickly.
Note that since you are doing random read, performance will be quite bad
since each read will map to a separate GET request. S3 isn't really
designed for this use case.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/kahing/goofys/issues/114#issuecomment-249437223, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ABgm0D2ostADCCUQpf0ppeAAfa1mvFwWks5qtrw9gaJpZM4KFLbB
.

—You are receiving this because you commented.Reply to this email directly, view it on GitHub, or mute the thread.

sorry,
[root@retd bin]# ./goofys -f  --profile logger --region eu-west-1 xxxx
/aws2/
2016/09/26 18:59:25.809219 s3.INFO Unable to detect bucket region, using
'us-east-1'
2016/09/26 18:59:25.809369 s3.INFO Falling back to v2 signer
2016/09/26 18:59:25.982517 main.ERROR Unable to access 'xxxx:
BucketRegionError: incorrect region, the bucket is not in 'us-east-1' region
2016/09/26 18:59:25.982581 main.FATAL Mounting file system: Mount:
initialization failed
it's working with 0.7 .
Regards,
Nicolas
2016-09-26 17:47 GMT+02:00 Ka-Hing Cheung<EMAIL_ADDRESS>
By default log goes to syslog unless you use -f
On Sep 26, 2016 5:15 AM, limbo127<EMAIL_ADDRESS>wrote:hello,
i'm trying to compile from last commit, but when i try to mount bucket
nothing .
./goofys --debug_fuse --debug_s3 --region eu-west-1 xxx /aws2/
no debug
[root@retd bin]# ls /aws2/
no mount point
Regards,
Nicolas
2016-09-25 20:23 GMT+02:00 Ka-Hing Cheung<EMAIL_ADDRESS>
could you try the latest commit to see if that addresses the problem for
you? goofys could still have some positives but we should fallback to
doing
regular GET quickly.
Note that since you are doing random read, performance will be quite bad
since each read will map to a separate GET request. S3 isn't really
designed for this use case.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/kahing/goofys/issues/114#issuecomment-249437223,
or mute
the thread
<https://github.com/notifications/unsubscribe-auth/
ABgm0D2ostADCCUQpf0ppeAAfa1mvFwWks5qtrw9gaJpZM4KFLbB>
.

—You are receiving this because you commented.Reply to this email
directly, view it on GitHub, or mute the thread.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/kahing/goofys/issues/114#issuecomment-249609929, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ABgm0Gfg6u37G47KBZ62jUbRVAh3jqywks5qt-j2gaJpZM4KFLbB
.

I can reproduce this issue with a bucket name that contains .

Could you try again with 780f54bf0581cf05c8dd42da0d2373b163fbdc8c?

Yes, my bucket contains .
Regards
Nicolas
2016-09-27 6:38 GMT+02:00 Ka-Hing Cheung<EMAIL_ADDRESS>
I can reproduce this issue with a bucket name that contains .
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/kahing/goofys/issues/114#issuecomment-249764610, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ABgm0GmqG4roXJjnVFUTOi56wcSez3FWks5quJ2wgaJpZM4KFLbB
.

is master working for you now?

Yes it 's ok for region parameter,,
but I have not yet test the big range request issue, I hope to do tomorrow.
Regards,
Nicolas
2016-09-28 20:39 GMT+02:00 Ka-Hing Cheung<EMAIL_ADDRESS>
is master working for you now?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/kahing/goofys/issues/114#issuecomment-250259672, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ABgm0JmfEkM2CzzP6O9a90TsQTiQglYCks5qurRRgaJpZM4KFLbB
.

Hello again,
With debug_s3 we cannot see range request log , or data receive, is it
possible to add them into debug mode ?
With debug_fuse, we can see our 32k block read appear as 128Ko on fuse
debug, is it a normal behaviour ?
Regards,
Nicolas
2016-09-28 21:13 GMT+02:00 nicolas prochazka<EMAIL_ADDRESS>
Yes it 's ok for region parameter,,
but I have not yet test the big range request issue, I hope to do tomorrow.
Regards,
Nicolas
2016-09-28 20:39 GMT+02:00 Ka-Hing Cheung<EMAIL_ADDRESS>
is master working for you now?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/kahing/goofys/issues/114#issuecomment-250259672, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ABgm0JmfEkM2CzzP6O9a90TsQTiQglYCks5qurRRgaJpZM4KFLbB
.

I am not sure why the request range doesn't show up in debug either, probably because aws-sdk-go doesn't include it.
For read size, could you try manually changing maxReadAhead in https://github.com/jacobsa/fuse/blob/master/connection.go#L56

Hello again,
Tests seems to be not conclusive, we are observing big paquet compare to our small read.
With s3log that are not in realtime, it's very difficult to give a complete use case, log complete s3 range request from goofys will be a good thing.
Regards

Are you sure s3 is the right solution for you if you worry about this? The per request cost and latency likely overwhelms the cost and latency caused by read-amplification.

Yes it works as we want execpt for goofys <-> S3 consumption
our client <---- good latency / bandwitch ---> EC2 VM goofys <---- big
bandwitch cause by big read range  request ?----> S3
Regards,
2016-10-05 0:03 GMT+02:00 Ka-Hing Cheung<EMAIL_ADDRESS>
Are you sure s3 is the right solution for you if you worry about this? The
per request cost and latency likely overwhelms the cost and latency caused
by read-amplification.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/kahing/goofys/issues/114#issuecomment-251527136, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ABgm0GZLz9TXfevp6k9GGvdpm6qpDLx2ks5qws0tgaJpZM4KFLbB
.

Hello,
in Handles.go , line 836, we can read : if offset != 0 {
bytes := fmt.Sprintf("bytes=%v-", offset)
In this case, If the last-byte-pos  value of range request  is absent, or if the value is greater than or equal to the current length of the entity-body, last-byte-pos is taken to be equal to one less than the current length of the entity- body in bytes
my question is , how body size is calculating ?   is it possible to add block read size + offset ?
Regards,
Nicolas

It's possible, but may not be desired since most people use goofys for streaming workload. Maybe you can try this locally and report back how much of a difference it makes? I can be convinced by a good benchmark.
you can probably use len(buf)+offset-1 as the last-byte-pos.

ok,
thanks for this explanation
Regards,
NIcolas
2016-10-07 7:15 GMT+02:00 Ka-Hing Cheung<EMAIL_ADDRESS>
It's possible, but may not be desired since most people use goofys for
streaming workload. Maybe you can try this locally and report back how much
of a difference it makes? I can be convinced by a good benchmark.
you can probably use len(buf)+offset-1 as the last-byte-pos.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/kahing/goofys/issues/114#issuecomment-252154937, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ABgm0HruQqh7eACJe6Tk9Y9UZkJmOEhlks5qxdV9gaJpZM4KFLbB
.

closing this for now. I think this usage is out of goofys' scope. Happy to help you further though


Chapter4 - Finetuning and Caltech256

Hi, do you happen to have the code for finetuning Resnet on Caltech 101, and the code for extracting on calnet256 ?
Thanks !

By the way, do you recommend freezing the conv layers when doing fine-tuning in this case ?
Or train on all the layers (conv + FC) ?
Thanks.

Well, when removing the following lines:
#     for layer in base_model.layers[:]:
#         layer.trainable = False

I get a much lower validation accuracy (0.7363 compared to 0.85) when finetuning Caltech101, so I would suggest putting back those lines in the code sample in chapter 4 after:

To compare the process of fine tuning a model optimized for classification tasks as opposed to similarity search, let’s recall how we fine tuned our model in Chapter 3 for classification:
My 2 cents :)

I tried running calculate_accuracy(feature_list_compressed[:]) on caltech256 with finetuned Resnet, I didn't get better accuracy than 69.69 using PCA.
On your table with PCA + brute force you report 95.34.
Can you provide hints / code regarding how you reached that good a score ?
Thanks much !

Hi, do you happen to have the code for finetuning Resnet on Caltech 101, and the code for extracting on calnet256 ?
Thanks !

Refer to the finetuning pipeline in chapter-3/1-keras-custom-classifier-with-transfer-learning.ipynb. You can read the Caltech101 dataset according to the code provided, just remember to update the Cats and Dogs dataset with Caltech101.
Once you have the trained model, use the code in chapter-4/1-feature-extraction.ipynb to extract the features.

By the way, do you recommend freezing the conv layers when doing fine-tuning in this case ?
Or train on all the layers (conv + FC) ?
Thanks.

Fine-tuning a few layers or the entire model depends on how large the dataset at hand is, and how similar it is to the original dataset the model was trained on. The more data you have, the more layers you are able to unfreeze. If you are training the ResNet50 model on the Caltech101 dataset you should be able to get a high enough accuracy with finetuning just the final few layers or training on the embeddings as demonstrated in Chapter-4

Well, when removing the following lines:
#     for layer in base_model.layers[:]:
#         layer.trainable = False

I get a much lower validation accuracy (0.7363 compared to 0.89) when finetuning Caltech101, so I would suggest putting back those lines in the code sample in chapter 4 after:

To compare the process of fine tuning a model optimized for classification tasks as opposed to similarity search, let’s recall how we fine tuned our model in Chapter 3 for classification:
My 2 cents :)

That's a good point. We will have to update the errata.

I tried running calculate_accuracy(feature_list_compressed[:]) on caltech256 with finetuned Resnet, I didn't get better accuracy than 69.69 using PCA.
On your table with PCA + brute force you report 95.34.
Can you provide hints / code regarding how you reached that good a score ?
Thanks much !

When we were running the code, we looked at the parameters such as num_feature_dimensions and played around to reflect the best accuracy possible. The value of num_feature_dimensions = 100 gave us the best accuracy and as such, we kept it in the code.
Just to verify - did you happen to edit the feature length, the number of images in Caltech256, model, or any other variables in chapter-4/1-feature-extraction.ipynb?

Hi, do you happen to have the code for finetuning Resnet on Caltech 101, and the code for extracting on calnet256 ?
Thanks !

Refer to the finetuning pipeline in chapter-3/1-keras-custom-classifier-with-transfer-learning.ipynb. You can read the Caltech101 dataset according to the code provided, just remember to update the Cats and Dogs dataset with Caltech101.
Once you have the trained model, use the code in chapter-4/1-feature-extraction.ipynb to extract the features.

Hi @jhagege we have updated the chapter-4/1-feature-extraction.ipynb notebook to reflect the finetuning code.

Great, thanks much !
On Tue, Nov 19, 2019, 9:58 AM Siddha Ganju<EMAIL_ADDRESS>wrote:

Hi, do you happen to have the code for finetuning Resnet on Caltech 101,
and the code for extracting on calnet256 ?
Thanks !
Refer to the finetuning pipeline in
chapter-3/1-keras-custom-classifier-with-transfer-learning.ipynb
https://github.com/PracticalDL/Practical-Deep-Learning-Book/blob/master/code/chapter-3/1-keras-custom-classifier-with-transfer-learning.ipynb.
You can read the Caltech101 dataset according to the code provided, just
remember to update the Cats and Dogs dataset with Caltech101.
Once you have the trained model, use the code in
chapter-4/1-feature-extraction.ipynb
https://github.com/PracticalDL/Practical-Deep-Learning-Book/blob/master/code/chapter-4/1-feature-extraction.ipynb
to extract the features.
Hi @jhagege https://github.com/jhagege we have updated the
chapter-4/1-feature-extraction.ipynb
https://github.com/PracticalDL/Practical-Deep-Learning-Book/blob/master/code/chapter-4/1-feature-extraction.ipynb
notebook to reflect the finetuning code.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/PracticalDL/Practical-Deep-Learning-Book/issues/44?email_source=notifications&email_token=ABZIIDAWAV6RIMTFUPSTMPLQUOMCJA5CNFSM4JOIQSG2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEENG5EY#issuecomment-555380371,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABZIIDDBKVZ7I2WSACTYMFTQUOMCJANCNFSM4JOIQSGQ
.


graph-tests: move docker and other test utilities to lib (1⃣ )

Background
As part of the effort done in https://github.com/graphprotocol/graph-node/pull/3410 , and based on a request from @dizzyd to break this PR into smaller pieces, here's part 1.
The goal of this PR is to move all the common parts from tests to live under lib, so other crates can eventually reuse those.
Changes
In this PR, I changed the following:

[x] Move docker utilities and expose them as part of graph-tests lib
[x] Adjust some dependencies and move from dev-dependencies to dependencies
[x] Move run_graph_node and stop_graph_node
[x] Move IntegrationTestSetup and a few more utilties

The goal is to eventually be able to reuse these helpers from another crate (performance-tests) that will be introduced in the next PR.

Compiled feedback from Graph Node Team:
4108

Great addition. Graph Node team proposes discussing how to move to a docker-compose where the containers can run entrypoint.sh scripts that take care of the dependency between containers.
4109
If we use this on the main repo, we would want to ensure that this will provide a good experience locally. As a consideration, there may be existing tools designed for this that could be used instead of adding infrastructure setup as code. Is this something you’ve considered?
4110
Can we run this on releases or release candidates instead of on every PR?

Other feedback/considerations:

Performance testing in isolation may not help much without generating serious load and without a well-prescribed setup in terms of hardware, etc. There is significant performance regression possible that will go unnoticed until the system is under serious load (e.g., performance issues from GraphQL validations were not visible in isolated testing but were nearly catastrophic under real load).
Loading enough data into the database by syncing one or more subgraphs where we would see performance issues from the database would take a long time—this sort of test requires having a large dataset that can be quickly imported by restoring or cloning a database.
Having a setup where we can programmatically spin up a graph-node and run queries to test correctness end-to-end would be very useful. No strong opinion whether the automation in these PRs gets us there.


rename reason-react-example to flow-react-example

I was using genType and the wording reason-react-example confused me at first. I suggest to rename it to flow-react-example.

Great, this makes perfect sense, thanks!.


Update _micro_functional-js.md

remove unnecessary underscores

Those underscores were my personal note that I had copied and pasted the whole micro, and that section was placeholder. But i forgot to remove them sometimes when i had finished. good catches.


Is it possible to update the metadata at run time via API from another source system?

Before asking a question

Review Legend documentation and frequently asked questions
Search existing issues since someone might have already asked a similar question.

Ask a question
Is it possible to update the metadata (e.g.: attribute definitions and their sample values) at run time via API from another source system?

This issue is stale because it has been open for 30 days with no activity. Please remove stale label or add any comment to keep this open. Otherwise this will be closed in 5 days.

This issue was closed because it has been inactive for 35 days. Please re-open if this issue is still relevant.


Bad string interpolation syntax in Medoo.php

Lines 870 and 1321 of Medoo.php, ver 2.1.7, use the wrong string interpolation syntax: " ... ${var} ... " rather than " ... {$var} ... ". As of php 8.2, this syntax is deprecated, and produces messages to that effect when the code is executed.

v2.1.8 was released with the fix. https://github.com/catfan/Medoo/releases/tag/v2.1.8