88 add unified way to add python packages

Description
Add a unified way to install python packages.
Fixes # (issue)
Time invested
Tim Dreier: ~45min
Type of change
Please delete options that are not relevant.

New feature (non-breaking change which adds functionality)
This change requires a documentation update

Does this PR introduce a breaking change?
No.
Most important changes
That the packages given in the requirements.txt are installed inside the container.
Checklist:

[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my own code
[x] I have commented my code, particularly in hard-to-understand areas
[x] I have made corresponding changes to the documentation
[x] My changes generate no new warnings
[x] I have added tests that prove my fix is effective or that my feature works (might be obsolete with CI later on)
[x] New and existing unit tests pass locally with my changes (might be obsolete with CI later on)

Don't know how this changes from #68 came in here. Creating new PR.


DOCS-182 -Add new UI hidden files for Send Data

Purpose of this pull request
This pull request adds Kanso instructions to articles in this section: https://help.sumologic.com/docs/send-data/
Select the type of change

[ ] Minor Changes - Typos, formatting, slight revisions
[x] Update Content - Revisions, updating sections
[ ] New Content - New features, sections, pages, tutorials
[ ] Site and Tools - .clabot, version updates, maintenance, dependencies, new packages for the site (Docusaurus, Gatsby, React, etc.)

Ticket (if applicable)
DOCS-182

Awesome! Thanks, @kimsauce!


Decrypt

I am trying to decrypt the encryption but it keeps encrypting further.  Is there something I am missing?
`string sKey = "help";
string siv = "test";
uint8_t * key =(uint8_t *) sKey.c_str();
uint8_t * iv =(uint8_t *) siv.c_str();
ucstk::Salsa20 salsa20(key);
salsa20.setIv(iv);
string sinput = "help";
uint8_t * input =(uint8_t *) sinput.c_str();
// uint8_t * output;

salsa20.processBytes(input, input, sinput.size());

cout << "Output: "<< input << "\n";`

Output : )┴à┴
`string sKey = "help";
string siv = "test";
uint8_t * key =(uint8_t *) sKey.c_str();
uint8_t * iv =(uint8_t *) siv.c_str();
ucstk::Salsa20 salsa20(key);
salsa20.setIv(iv);
string sinput = ")┴à┴";
uint8_t * input =(uint8_t *) sinput.c_str();
// uint8_t * output;

salsa20.processBytes(input, input, sinput.size());

cout << "Output: "<< input << "\n";

`
Output: hF}♣╔┤‼0o

Sorry for the late reply. Salsa's IV must be 8 bytes long, but you are using only 4 bytes for it, so you have Undefined Behavior in your code.
As a side note: this repo is really-really old, but there is a type-safe C++20 implementation of the Salsa stream cypher: https://github.com/everard/libecstk-crypto/blob/master/src/crypto_stream_salsa.hh
https://github.com/everard/libecstk-buffer/blob/master/src/buffer.hh


How to provide buffer space to the right of candlestick series?

Hi there
We would like to have the initialization/reset position off to the right of the most recent data point.  This is a common practice in candlestick charts as I'm sure you're well aware.
Haven't come across anything in the docs/source code that leads me to where this can be done.
Any suggestions?

ChartCanvas has a padding property. Try
padding={{
  left: 0,
  right: 100
}}

thanks @michaelr524 .
i want update data form socket or after 60s.
You have solution pls

adding a padding right will give you the space on right but that space will not be usable for future candles. I don't have any other solution other than setting xExtents appropriately


⚠ Bofrost.at has degraded performance

In 7ecb1b4, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 1742 ms

Resolved: Bofrost.at performance has improved in 342f9fe after 9 minutes.


Enable building code without System.Drawing.Common dependency

Reference Issue

What does this implement/fix? Explain your changes.

Enabled building library without System.Drawing.Common dependency by defining NO_SDC.
Any other comments?

I don't know how to surround NO_SDC.
Are there any rules ?

If you removeSystem.Drawing.Common package reference anything that does not compile. All the code that uses types  from System.Drawing.Common are surrounded by NO_SDC if/def.

If you removeSystem.Drawing.Common package reference anything that does not compile. All the code that uses types from System.Drawing.Common are surrounded by NO_SDC if/def.

In Svg.Skia I substituted the System.Drawing.Common with SkiaSharp alternative.

@wieslawsoltes - I have rebased this with master, please check if all still works with Svg.Skia and I haven't messed something up while resolving conflicts. Will merge if you give the ok.

@wieslawsoltes - I have rebased this with master, please check if all still works with Svg.Skia and I haven't messed something up while resolving conflicts. Will merge if you give the ok.

@mrbean-bremen Works fine with Svg.Skia. Thanks!

@wieslawsoltes
The questions are listed below.

Where is NO_SDC defined ?
How does SVG behave when NO_SDC is defined?

@wieslawsoltes
The questions are listed below.

Where is NO_SDC defined ?
How does SVG behave when NO_SDC is defined?

In my Svg.Custom project https://github.com/wieslawsoltes/Svg.Skia/blob/407a032aeaaf9a3716959e52e63aca6953f50c6d/src/Svg.Custom/Svg.Custom.csproj#L14
When it's defined I replace all removed functionality with my code.

@wieslawsoltes
Thanks !
@mrbean-bremen
This PR depends on Svg.Skia.
How about creating another branch ?

@H1Gdev - it is the other way around, Svg.Skia depends on this. It is not ideal, but I see this as a first step to factor out the drawing functionality as mentioned in #590. Anyway we need a way to handle the dropped support for Common.Drawing, and Svg.Skia already does a lot here. I would like to work both repos to be able to work together more seemlessly, and this change might be a step on this way.


Why did you ruin rest console?

from a convenience and UX experience you have ruined the best chrome extension there was, please allow me to roll back. This is so horrid. Everything takes several more clicks, how arrogant to feel you need a entire apps worth of space instead of just a tab.

Want to find a api call....nah you dont, BUT LOOK HOW PRETTY OUR NEW FONT IS!!!!!
http://imgur.com/zsWJRN1
Want to search for something?  that will be x2 extra clicks
Want to open in browser?  pshhh....were way to important for that. The personality your app now exudes is Kanye West.

http://restforchrome.blogspot.sg/2016/04/advanced-rest-client-is-not-in-tab.html

@fresh83 Thank you for an opinion.
From my side I can add that:

layout of the app is basically the same. There are some changes (like the left panel now collapses at some point) but I tried not to change many things
as referenced by @Izuzusama I had no choice upgrading the app
you can search for a saved request as you were able to do it earlier

Because there's no actual question or issue that I can fix I'd be inclined to close this issue as WAI.

Also....
•Cant click a api request from history alll the way across the line which is REALLY annoying.
•Cant adjust column sizes from history
•The clear button should be hidden or put behind several clicks. There is nothing worse than clearing it on accident, i realize their is a confirmation, but it still happens bc of it being placed where it is and its enough to make a grown man cry when it does .
Look im obviously this upset bc i loved the app prior, id be willing to pay for a browser version , the last thing devs with lots of apps open need is their web work to be happening in 3 programs instead of 2 (editor,browser,rest console....better would be 1)  Im not against the update , but I have a hard time believing that you could not allow the option to let the app be opened in a tab.
The design is pretty, I can appreciate that but you went a bit tooo appleish for the crowd you appeal to , we dont need or care about pretty all that much, you came up and got where you are by being super functional. Remember your roots.
Consider all my bullet points on this comment and op as the ongoing issues im reporting due to a lack of alternative mediums to express the frustration.

I would suggest you to create an issue for each bullet point you have. And make sure there are no duplicate on the way.
I like the browser tab thing but the developer has no choice in this. If you would like to complain, you can complain to chromium, but they have their reason too https://blog.chromium.org/2014/06/migrate-your-legacy-packaged-apps-to.html
And since this is an open source project, you can always contribute.

2 words....web-app

it just keeps getting better lol....http://imgur.com/XqJ9TZq

Hi,
Please, clear this issue up because I'm not sure where to start. One problem per issue report so it can be addressed properly.
I'm closing this as invalid.

of course you are....bc you know you abused success man. Just give us back
old rest as a web app man.
On Fri, May 13, 2016 at 4:47 PM, Paweł Psztyć<EMAIL_ADDRESS>wrote:

Hi,
Please, clear this issue up because I'm not sure where to start. One
problem per issue report so it can be addressed properly.
I'm closing this as invalid.
—
You are receiving this because you were mentioned.
Reply to this email directly or view it on GitHub
https://github.com/jarrodek/ChromeRestClient/issues/659#issuecomment-219155126

or a open repo we can install locally
On Sat, May 14, 2016 at 7:02 PM, Chuck Kelly<EMAIL_ADDRESS>wrote:

of course you are....bc you know you abused success man. Just give us back
old rest as a web app man.
On Fri, May 13, 2016 at 4:47 PM, Paweł Psztyć<EMAIL_ADDRESS>wrote:

Hi,
Please, clear this issue up because I'm not sure where to start. One
problem per issue report so it can be addressed properly.
I'm closing this as invalid.
—
You are receiving this because you were mentioned.
Reply to this email directly or view it on GitHub
https://github.com/jarrodek/ChromeRestClient/issues/659#issuecomment-219155126

For tab version - please review http://restforchrome.blogspot.com/2016/04/advanced-rest-client-is-not-in-tab.html so you'll know why.
Repo is public, open source and it's here. Clone, get, change, send PR as you wish :)

Dude its the internet....anything is possible, maybe not in the chrome
store, but it is indeed possible to allow what im asking.
On Mon, May 16, 2016 at 12:49 PM, Paweł Psztyć<EMAIL_ADDRESS>wrote:

For tab version - please review
http://restforchrome.blogspot.com/2016/04/advanced-rest-client-is-not-in-tab.html
so you'll know why.
Repo is public, open source and it's here. Clone, get, change, send PR as
you wish :)
—
You are receiving this because you were mentioned.
Reply to this email directly or view it on GitHub
https://github.com/jarrodek/ChromeRestClient/issues/659#issuecomment-219478247


support passing a custom port

What happens?
it'd be great to pass a custom port to the extension, i.e. CALL postgres_attach('dbname=defaultdb user=root host=<IP_ADDRESS>', port=26257, source_schema='public');
Today, I get the following
Error: Binder Error: Invalid named parameter "port" for function postgres_attach
Candidates:     suffix VARCHAR
    sink_schema VARCHAR
    source_schema VARCHAR
    filter_pushdown BOOLEAN
    overwrite BOOLEAN

To Reproduce
simply add port=portnum to the attach command
OS:
OSX 13.2
PostgreSQL Version:
13.0
DuckDB Version:
7
DuckDB Client:
CLI
Full Name:
Artem Ervits
Affiliation:
e.g. Cockroach Labs
Have you tried this on the latest master branch?

[X] I agree

Have you tried the steps to reproduce? Do they include all relevant data and configuration? Does the issue you report still appear there?

[X] I agree

I believe the port can be part of the connection string:
CALL postgres_attach('dbname=defaultdb user=root host=<IP_ADDRESS> port=26257', source_schema='public');

yes thank you @Mytherin, I confirmed and it works when you place the port inside the single quotes as you indicated. My mistake for not seeing the quotes.


Drastic drop in GPU speed after approximately 10 games

I'm getting an unexpected, but reliable, drop in GPU speed after running 11-ish games of Chapter07/01_dqn_basic.py using the --cuda option. For the first 10 games, I get speeds comparable with the textbook, but speed halves in game 11, and then down to a third in games 12+. I get similar behavior when running Chapter06/02_dqn.pong.py on the GPU too. This happens every time I run the code.
I'm running Python 3.6.10 on Windows 10. I'm using all the textbook's required packages, with the exception of Pytorch. Textbook recommends pytorch==0.4.0, but I couldn't get it to run so I installed pytorch==1.1.0 with cudatoolkits==10.0. I'm using an NVIDIA TITAN RTX, and my PC has 128GB ram.
I also get similar speeds (~400 f/s) when I run the code withOUT the --cuda option for the first 10 or so games but then it drops to around 10 f/s after that.
I have no idea what could be the cause of this. I'm relatively new to RL, CUDA and Python, so I'm not sure if it's a problem with the example code or something on my end.
Any ideas? Has anyone else reported this, or is it just me?

Hi! Speed drop after first several games is normal, as in the beginning, no
training is done, as we're populating replay buffer. Training is the most
heavy operation, so, 5-10x slowdown is ok.
But, of course it doesn't explain why you're getting slower speed than in
the book. It could be wide variety of reasons for that: slower card (I've
used gtx 1080ti), wrong drivers setup or just overheating.
пт, 3 июл. 2020 г., 8:37 alanballard<EMAIL_ADDRESS>
I'm getting an unexpected, but reliable, drop in GPU speed after running
11-ish games of Chapter07/01_dqn_basic.py using the --cuda option. For the
first 10 games, I get speeds comparable with the textbook, but speed halves
in game 11, and then down to a third in games 12+. I get similar behavior
when running Chapter06/02_dqn.pong.py on the GPU too. This happens every
time I run the code.
I'm running Python 3.6.10 on Windows 10. I'm using all the textbook's
required packages, with the exception of Pytorch. Textbook recommends
pytorch==0.4.0, but I couldn't get it to run so I installed pytorch==1.1.0
with cudatoolkits==10.0. I'm using an NVIDIA TITAN RTX, and my PC has 128GB
ram.
I also get similar speeds (~400 f/s) when I run the code withOUT the
--cuda option for the first 10 or so games but then it drops to around 40
f/s after that.
I have no idea what could be the cause of this. I'm relatively new to RL,
CUDA and Python, so I'm not sure if it's a problem with the example code or
something on my end.
Any ideas? Has anyone else reported this, or is it just me?
[image: 01_dqn_basic py cuda performance]
https://user-images.githubusercontent.com/39736471/86434283-f5f61580-bcb1-11ea-85ec-723734860c57.PNG
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/PacktPublishing/Deep-Reinforcement-Learning-Hands-On/issues/80,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAAQE2VSO7O7YJEVPOFWXWLRZVVC3ANCNFSM4OPPWUTQ
.

Thank you for your reply. It's been a struggle since I'm learning Python and RL at the same time (not too mention debugging GPU issues), but I've really enjoyed your book so far.
I'm using a NVIDIA TITAN RTX, so I would expect the performance to be at least as good as a GTX 1080ti, if not better. I've updated the drivers but there is no change in performance.

If I use the --cuda option, my GPU usage never exceeds 3% and my CPU usage is approximately 60% for all games. However, the speed drops from ~400 f/s to ~80 f/s after (approximately) game 10 or 11.

If I do not use the --cuda option, then my GPU usage is about 1% (same as internet browsing) and my CPU goes to 100% after game 10. As before, the speed for games #1-#10 is ~400 f/s, but without the cuda option, the speed drops to ~10 f/s after game 10 or 11.

So, for the first 10 games, I can achieve performance close to the textbook's whether I use the --cuda option or not. In either case, the speed dramatically drops after game 10, and my GPU usage is never greater than 3% regardless of which option I choose.
This behavior is almost identical to that reported here:
Issue #32
Maxim (or anyone else who might be reading this), when you have time, would you mind running Chapter07/01_dqn_basic.py --cuda from the 1st edition of the book and answer these questions:

In Chapter 7, pg, 167, you only report up to the 9th game. Can you let it run until game 15 or so and see if you also experience a really significant drop in speed during the game 10-15 range?
What % of your GPU and CPU are you using when you execute Chapter07/01_dqn_basic.py --cuda?

I'm not convinced that it's a bad thing that my GPU usage is so low. It's possible that even with maximum parallelization using the current code, I simply can't use more than 3% of my available GPU resources playing pong. If that's the case, then there may be another reason that the speed is so slow during training. I don't think there's any problem with your code, but it may be an issue of old packages vs. new Windows/GPU specs, or maybe old packages doing something unwelcome in my environment (like unnecessarily copying tensors).
I'm going to clone the git for your 2nd edition book, create a Python environment with the new package requirements and re-test the 2nd-edition version of the code there. That should at least let me know whether it's a package version issue.
Thank you for your help.

Below are benchmarks on my hardware (1080Ti, nvidia drivers 440.100, cuda 10.2, ubuntu) of the first edition code:
804: done 1 games, mean reward -21.000, speed 585.91 f/s, eps 0.99
1732: done 2 games, mean reward -20.500, speed 722.61 f/s, eps 0.98
2797: done 3 games, mean reward -20.000, speed 721.65 f/s, eps 0.97
3665: done 4 games, mean reward -20.250, speed 721.01 f/s, eps 0.96
4453: done 5 games, mean reward -20.400, speed 719.14 f/s, eps 0.96
5328: done 6 games, mean reward -20.333, speed 720.16 f/s, eps 0.95
6146: done 7 games, mean reward -20.429, speed 721.55 f/s, eps 0.94
7269: done 8 games, mean reward -20.375, speed 718.43 f/s, eps 0.93
8534: done 9 games, mean reward -20.111, speed 712.01 f/s, eps 0.91
9495: done 10 games, mean reward -20.200, speed 722.72 f/s, eps 0.91
10461: done 11 games, mean reward -20.273, speed 244.70 f/s, eps 0.90
11408: done 12 games, mean reward -20.250, speed 147.07 f/s, eps 0.89
12264: done 13 games, mean reward -20.308, speed 146.79 f/s, eps 0.88
13239: done 14 games, mean reward -20.286, speed 146.91 f/s, eps 0.87
14048: done 15 games, mean reward -20.333, speed 146.55 f/s, eps 0.86

During the training, GPU utilisation is about 35%
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 440.100      Driver Version: 440.100      CUDA Version: 10.2     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|===============================+======================+======================|
|   0  GeForce GTX 108...  Off  | 00000000:01:00.0 Off |                  N/A |
| 34%   63C    P2    76W / 250W |    583MiB / 11178MiB |     34%      Default |
+-------------------------------+----------------------+----------------------+
|   1  GeForce GTX 108...  Off  | 00000000:02:00.0 Off |                  N/A |
|  0%   37C    P8     9W / 250W |     10MiB / 11178MiB |      0%      Default |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                       GPU Memory |
|  GPU       PID   Type   Process name                             Usage      |
|=============================================================================|
|    0      4404      C   python3                                      573MiB |
+-----------------------------------------------------------------------------+

Without --cuda option, I'm getting 510 f/s during replay buffer population (first 10 games) and then, speed is decreasing to 15 f/s. So, speed up is 80-100 times, as it should be.
I see your hardware is much better than mine (my CPU is i5-6600k, system has 32GB of RAM, so, numbers should be better.
I'd start with general system/gpu troubleshooting by running standard deep learning benchmarks (like this one: https://github.com/ryujaehun/pytorch-gpu-benchmark) and comparing the numbers on them.
You might also try to take Chapter09 examples from the second edition. This chapter is devoted to apply GPU/PyTorch tricks to speed up pong game, so, it has plenty of numbers to compare with.
Here is the summary of chapter 9 samples performance on my hardware: https://www.dropbox.com/s/qz1tghrv1029efv/Chapter09-benchmarks.png?dl=0


Theme top banner obstructs heading when linking to header

So the RTD allows links to goto anchors but this damn header we put in hides it and it gets confusing to the user. I pressed an anchor link and it took me here:

If the top banner was not there we would see the section title however we cannot. We need things to scroll extra by the size of the banner up at the top.

Obsolete.


Why ?

Because in agar.io there is no lag, even though having all the options activated? , either graphics or anything..
Why not improve the performance of multiplayer? MultiOgar is good, but for example, petridish is 5 times better in performance
What is the maximum performance that can reach Multiogar?
Where can I increase server fps?
Where can I make the server nodes faster?

Because in agar.io there is no lag, even though having all the options activated? , either graphics or anything..
Why not improve the performance of multiplayer? MultiOgar is good, but for example, petridish is 5 times better in performance

Client sided.

What is the maximum performance that can reach Multiogar?

I don't know, it depends on a lot of things.

Where can I increase server fps?

You can do something similar to that here.

Where can I make the server nodes faster?

I don't get it.


Gov 510

@JaphethKo this is the master branch merge for https://riffyn.atlassian.net/browse/GOV-512.
The patch was merged to prod.


plugins_available becomes custom_plugins

As per description.
When loading the configuration, a new entry is dynamically entered, configuration.plugins, which merges the available plugins with the custom plugins added in the conf file.

LGTM


Fixed missing cloud_region in MQTT example

The readme mentions that the project ID blue-jet-123 is in asia-east1 but then it forgets to pass the cloud_region parameter which results in a Not authorized to connect (5) exception since the default region is us-central1.

@kurtisvg - Any ideas on why kokoro seems to be getting stuck?

@gguuss Kokoro won't trigger tests for PRs from outside GCP. You can manualy run with kokoro: run label


Symbolic coefficients on staggered stencils not working correctly

Setting coefficents=symbolic on a function with staggered and not specifying stencil coefficients results in derivatives defaulting to incorrect values. It appears that specifying coefficients does not change them from this incorrect default.
A short example:
from devito import Grid, Function, NODE, Eq, Operator, Coefficient, Substitutions
import numpy as np
shape = (11,)
extent = (10.,)
grid = Grid(shape=shape, extent=extent)
x = grid.dimensions[0]
f = Function(name='f', grid=grid, space_order=2, staggered=NODE)
g = Function(name='g', grid=grid, space_order=2, staggered=NODE,
             coefficients='symbolic')
h = Function(name='h', grid=grid, space_order=2, staggered=NODE,
             coefficients='symbolic')
vf = Function(name='v_f', grid=grid, space_order=2, staggered=x)
vg = Function(name='v_g', grid=grid, space_order=2, staggered=x)
vh = Function(name='v_h', grid=grid, space_order=2, staggered=x)
h_coeffs = Coefficient(1, h, x, np.array([0., -1., 1.]))
coeffs = Substitutions(h_coeffs)
eqf = Eq(vf, f.dx)
eqg = Eq(vg, g.dx)
eqh = Eq(vh, h.dx, coefficients=coeffs)
# Should all result in the same kernel
opf = Operator(eqf)
print(opf.ccode)
# Different stencil to the normal one. Should default to same
opg = Operator(eqg)
print(opg.ccode)
# Different stencil to normal one. Manually set to same
oph = Operator(eqh)
print(oph.ccode)

One would expect all of these operators to have the same ccode (ignoring differences in variable names). However, this is not the case. The latter two do not have the same stencil operation. Eq(vf, f.dxc).evaluate returns Eq(v_f(x + h_x/2), -f(x)/h_x + f(x + h_x)/h_x) whilst Eq(vg, g.dx).evaluate and Eq(vh, h.dx, coefficients=coeffs) both return Eq(v_g(x + h_x/2), g(x + h_x)/(2*h_x))

This was also found to affect substitutions at forward and backward time steps (although this may have been fixed since?). However, a new MFE is:
import numpy as np
from devito import *

grid = Grid(shape=(10, 10))
f = TimeFunction(name='f', grid=grid, space_order=2, coefficients='symbolic')

x, y = grid.dimensions
subs = Substitutions(
    Coefficient(1, f, x, np.array([2, 2, 2]) / x.spacing),
    Coefficient(1, f, y, np.array([2, 2, 2]) / y.spacing)
)

print(grad(f)._evaluate().subs(subs.rules))
# --> Vector((2/h_x)*f(t, x, y) + (2/h_x)*f(t, x - h_x, y) + (2/h_x)*f(t, x + h_x, y), (2/h_y)*f(t, x, y) + (2/h_y)*f(t, x, y - h_y) + (2/h_y)*f(t, x, y + h_y))

print(grad(f, shift=0.5)._evaluate().subs(subs.rules))
# --> Vector(f(t, x, y)*W(x, 1, f(t, x, y), x + 0.5*h_x) + f(t, x + h_x, y)*W(x + h_x, 1, f(t, x, y), x + 0.5*h_x), f(t, x, y)*W(y, 1, f(t, x, y), y + 0.5*h_y) + f(t, x, y + h_y)*W(y + h_y, 1, f(t, x, y), y + 0.5*h_y))

coefficents=symbolic is deprecated so should reopen if still an issue with the new api


[PicnobBridge] fix missing images

Each post image is missing. The value of data-src must have change at some point. There is no query parameter u anymore. data-src contains the actual image url. No more parsing required.

"context2" of the "Pull request artifacts" revealed another unrelated bug. The bridge breaks if any of the posts contains "Just now" as relative time (or any other value not handled by date_interval_create_from_date_string). While I am at it I also fixed that. Now invalid values will be ignored and the current date will be used.

thanks!


Open source this

This repo is a fork of https://github.com/eHealthAfrica/angular-eha.couchdb-auth, which is already open. The only change is this commit, which can easily be inspected now. I would say that it's better to open this now, before cumulating more commits which would be harder to review

:white_check_mark:


[WFCORE-6441] Bump the core management version to version 23

Jira issue: https://issues.redhat.com/browse/WFCORE-6441

Thanks @kabir


What configuration is required for model training?

Your work is great! What kind of GPU is required for model training? Can your model be trained on 4 12GB GPUs?

Actually, we use pre-trained models from others. Of course, you can train your own model, I think 4 12GB GPUs are ok.


Recognize carriage return as enter

Fixes #177.

Looks good to me! Also, thank you for adding tests for the feature.

Great! @calleerlandsson time for another release?

Thanks! Yes, I'll create one!


Reduce calls to uv_async_send when loop active

Fixes #865
Before

After

Still need needs RPS measuring, don't have access to a network that isn't noisy enough to measure

Further to this I see more time in uv_async_send (blue) than uv_write (red)

uv_async_send seems to have issues, compare exchange line highlighted, however it seems to occur before that with some crazy high clocks per instructions (CPI)

Benchmark:
dev:
[03:28:17.441] Starting scenario Plaintext on benchmark server...
[03:28:32.887] Warmup
[03:28:32.887] Starting scenario Plaintext on benchmark client...
[03:28:44.035] Scenario Plaintext completed on benchmark client
[03:28:44.035] RPS: 1098586.5
[03:28:44.035] Stopping scenario Plaintext on benchmark client...
[03:28:44.035] Benchmark
[03:28:44.035] Starting scenario Plaintext on benchmark client...
[03:28:55.168] Scenario Plaintext completed on benchmark client
[03:28:55.168] RPS: 1162003.97
[03:28:55.168] Stopping scenario Plaintext on benchmark client...
[03:28:55.168] Stopping scenario Plaintext on benchmark server...

This PR:
[03:29:00.251] Starting scenario Plaintext on benchmark server...
[03:29:22.758] Warmup
[03:29:22.765] Starting scenario Plaintext on benchmark client...
[03:29:33.938] Scenario Plaintext completed on benchmark client
[03:29:33.938] RPS: 1073761.82
[03:29:33.938] Stopping scenario Plaintext on benchmark client...
[03:29:33.938] Benchmark
[03:29:33.938] Starting scenario Plaintext on benchmark client...
[03:29:45.085] Scenario Plaintext completed on benchmark client
[03:29:45.085] RPS: 1090156.25
[03:29:45.085] Stopping scenario Plaintext on benchmark client...
[03:29:45.085] Stopping scenario Plaintext on benchmark server...

Similar numbers across multiple runs.
When was the last time you rebased though?

When was the last time you rebased though?

20 days ago? Will rebase...

Rebased - though it doesn't look good from your numbers...

Now the numbers look more like dev, so no noticeable perf gain :(

Closing then :cry:


No More /p add Command?

Im Making Mod Roles For My Group But /p add Is Gone?

Not follow template, and yes there is.


first class support for CI

Is your feature request related to a problem? Please describe.
It seems to me that aws-amplify did a great job in creating, manage and sharing cloud environments but when it comes to CI/CD process, it can be better.
the documentation has only a small area that mentions the headless scripts, which I found complex and also require external tooling for mocking the user manual steps in the setup process.
Describe the solution you'd like
Support for CI. as we store all the needed files in SCM we can add another file for CI with all the configs. most of the cli tools that I know that aim for CI knows how to fetch data from env vars or config files.
Describe alternatives you've considered
using the headless files. here again not sure what to use and in what order.
for example, I've aws creds as env vars, should I run aws_init.sh?

Agree with this.
Related issue: https://github.com/aws-amplify/amplify-cli/issues/1236

Thanks @ambientlight ,   this what works for me:
# .circleci/config.yml
executors:
  node-executor:
     docker:
      - image: circleci/node:latest
deploy:
    executor: node-executor
    steps:

@lielran
Could you provide more details on the kind of the CI/CD solution you'd like to have?
Do you want to integrate with existing CI/CD tools or you want the Aamplify CLI itself to be able to provide CI/CD capabilities?

Also, have you checked out the Amplify Console? console.amplify.aws?

Also, have you checked out the Amplify Console? https://console.amplify.aws

The Amplify Console is fine if you want to fragment your CI across several providers.  But if you want all of your builds to be in one place, then I'm afraid it's not helpful.

@UnleashedMind  So after trying Amplify console, I've decided to switch my CI/CD tool to CircleCi.
in "external"(not an aws service)CI/CD tool you have to install amplify by yourself and the configuration and setup is not easy.
the documentation point to the headless scripts which I found very not easy to integrate, slow and error prune (stdin/out to console that may change). I would try to avoid using the headless scripts.
I would like to see the amplify cli will support/have:

(also) support aws credentials as env vars (e.g. AWS_ACCESS_KEYS)
CI is doing git clone, therefore is missing some files for amplify to work. it should be easy to switch to the right amplify env and create them.
have documentation of ci/cd in multi aws accounts

@UnleashedMind: at very least amplify should be able to configure projects without requiring files that are .gitignored in default generated amplify project. (./amplify/.config/local-env-info.json and ./amplify/backend/amplify-meta.json)

OK - I'm trying to get this working and not having any luck... Maybe one of you have an idea:
Here is my Circle Config:
version: 2

# Docker image to use for setup
var_1: &docker_image circleci/node:11.14.0

# Job step for checking out the source code from GitHub. This also ensures that the source code
# is rebased on top of master.
var_2: &checkout_code
  checkout:
    # After checkout, rebase on top of master. By default, PRs are not rebased on top of master,
    # See https://discuss.circleci.com/t/1662
    post: git pull --ff-only origin "refs/pull/${CI_PULL_REQUEST//*pull\//}/merge"

# Cache key
var_3: &cache_key v1-{{ checksum "package-lock.json" }}

# Restores the cache that could be available for the current package.json
var_4: &restore_cache
  restore_cache:
    key: *cache_key

# Save cahce
var_5: &save_cache
  save_cache:
    key: *cache_key
    paths:
      - "node_modules"

# Attach to existing workspace
var_6: &attach_workspace
  attach_workspace:
    at: .

defaults: &job_defaults
  docker:
    - image: *docker_image

jobs:
  prepare:
    <<: *job_defaults
    steps:
      - *checkout_code
      - *restore_cache
      - run: npm install
      - *save_cache
      - persist_to_workspace:
          root: .
          paths:
            - node_modules
  build:
    <<: *job_defaults
    steps:
      - *checkout_code
      - *attach_workspace
      - run: npm run build
      - persist_to_workspace:
          root: .
          paths:
            - build
  test:
    <<: *job_defaults
    steps:
      - *checkout_code
      - *attach_workspace
      - run: npm run test
      - store_test_results:
          path: ./coverage
      - store_artifacts:
          path: ./coverage

  lint:
    <<: *job_defaults
    steps:
      - *checkout_code
      - *attach_workspace
      - run: npm run lint

  deploy-dev:
    <<: *job_defaults
    steps:
      - *checkout_code
      - *restore_cache
      - *attach_workspace
      - run: chmod 777 .circleci/write_aws_creds_file.sh && .circleci/write_aws_creds_file.sh
      - run: chmod 777 .circleci/amplify_init.sh && .circleci/amplify_init.sh
      - run: ./node_modules/.bin/amplify env checkout dev
      - run: ./node_modules/.bin/amplify publish -y --invalidateCloudFront

  deploy-prod:
    <<: *job_defaults
    steps:
      - *checkout_code
      - *restore_cache
      - *attach_workspace
      - run: chmod 777 .circleci/write_aws_creds_file.sh && .circleci/write_aws_creds_file.sh
      - run: chmod 777 .circleci/amplify_init.sh && .circleci/amplify_init.sh
      - run: ./node_modules/.bin/amplify env checkout prod
      - run: ./node_modules/.bin/amplify publish -y --invalidateCloudFront

workflows:
  version: 2
  build_accept_deploy:
    jobs:
      - prepare:
          filters:
            branches:
              ignore:
                - gh-pages
      - lint:
          requires:
            - prepare
      - build:
          requires:
            - lint
      - test:
          requires:
            - build
      - deploy-dev:
          requires:
            - test
      - deploy-prod:
          type: approval
          requires:
            - test

here is the scripts I'm using:
#!/bin/bash
set -e
IFS='|'

REACTCONFIG="{\
\"SourceDir\":\"src\",\
\"DistributionDir\":\"build\",\
\"BuildCommand\":\"npm run-script build\",\
\"StartCommand\":\"npm run-script start\"\
}"
AWSCLOUDFORMATIONCONFIG="{\
\"configLevel\":\"project\",\
\"useProfile\":true,\
\"profileName\":\"asdf\",\
\"accessKeyId\":\"asdf\",\
\"secretAccessKey\":\"asdf\",\
\"region\":\"us-east-1\"\
}"
AMPLIFY="{\
\"projectName\":\"asdfi\",\
\"defaultEditor\":\"code\"\
}"
FRONTEND="{\
\"frontend\":\"javascript\",\
\"framework\":\"react\",\
\"config\":$REACTCONFIG\
}"
PROVIDERS="{\
\"awscloudformation\":$AWSCLOUDFORMATIONCONFIG\
}"

./node_modules/.bin/amplify configure project \
--amplify $AMPLIFY \
--frontend $FRONTEND \
--providers $PROVIDERS \

and
#!/bin/bash

 mkdir -p ~/.aws/

 cat <<EOF > ~/.aws/credentials
[amplify]
aws_access_key_id=asdf
aws_secret_access_key=asdf
EOF

 cat <<EOF > ~/.aws/config
[profile amplify]
region=us-east-1
EOF

and my versions are:
    "react-scripts": "^3.0.1",
    "@aws-amplify/cli": "^1.7.1",
    "aws-amplify": "^1.1.28",

The Amplify Console has a script that simplifies the CI process using the Amplify CLI. Check this out: https://gist.github.com/swaminator/7408de774e24ecf031d0d9928f1fbae5

@swaminator - Can you share how that might look in the circle setup?

I'm using the following with CircleCI and it seems to be working well so far.
version: 2.1

orbs:
  aws-cli<EMAIL_ADDRESS>
executors:
  node:
    docker:
      - image: circleci/node:12.4.0

jobs:
  build_and_test:
    executor: node
    steps:
      - run:
          name: 'Show node and NPM versions'
          command: |
            node -v
            npm -v
      - checkout
      - restore_cache:
          key: v1-dependencies-{{ .Branch }}-{{ checksum "package-lock.json" }}
      - run: npm install
      - save_cache:
          paths:
            - node_modules
          key: v1-dependencies-{{ .Branch }}-{{ checksum "package-lock.json" }}
      - run:
          name: 'Run tests'
          command: |
            echo TESTS NOT IMPLEMENTED YET

  deploy:
    parameters:
      deploy_env:
        type: string
      chat_app_id:
        type: string
    executor: node
    steps:
      - run:
          name: Setup Environment Variables
          command: |
            echo 'export REACT_APP_CHAT_APP_ID="<< parameters.chat_app_id >>"' >> $BASH_ENV
      - checkout
      - restore_cache:
          key: v1-dependencies-{{ .Branch }}-{{ checksum "package-lock.json" }}
      - run: npm install
      - aws-cli/install
      - aws-cli/configure
      - run:
          name: 'Install aws-amplify CLI'
          command: |
            sudo npm install -g @aws-amplify/cli
      - run:
          name: 'Show AWS CLI and Amplify Versions'
          command: |
            aws --version
            amplify --version
      - run:
          name: 'Checkout Amplify << parameters.deploy_env >> Environment'
          command: |
            amplify env list
            amplify init --amplify "{\"envName\":\"<< parameters.deploy_env >>\"}" --providers "{\"awscloudformation\":{\"useProfile\":true,\"profileName\":\"default\"}}" --yes
      - run:
          name: 'Deploy to << parameters.deploy_env >>'
          command: |
            amplify publish --invalidateCloudFront --codegen "{\"generateCode\":false}" -- yes

workflows:
  Deploy:
    jobs:
      - build_and_test
      - deploy:
          name: DeployStaging
          deploy_env: staging
          chat_app_id: ${CHAT_APP_ID_STAGING}
          requires:
            - build_and_test
          filters:
            branches:
              only:
                - master
      - request_production_deploy:
          type: approval
          requires:
            - DeployStaging
          filters:
            branches:
              only:
                - master
      - deploy:
          name: DeployProduction
          deploy_env: production
          chat_app_id: ${CHAT_APP_ID_PRODUCTION}
          requires:
            - request_production_deploy
          filters:
            branches:
              only:
                - master

I ended up punting on Amplify and just using S3 directly using Circle S3 Orbs.
version: 2.1

# Docker image to use for setup
var_1: &docker_image circleci/python:2.7-node

# Job step for checking out the source code from GitHub. This also ensures that the source code
# is rebased on top of master.
var_2: &checkout_code
  checkout:
    # After checkout, rebase on top of master. By default, PRs are not rebased on top of master,
    # See https://discuss.circleci.com/t/1662
    post: git pull --ff-only origin "refs/pull/${CI_PULL_REQUEST//*pull\//}/merge"

# Cache key
var_3: &cache_key v2-{{ checksum "package-lock.json" }}

# Restores the cache that could be available for the current package.json
var_4: &restore_cache
  restore_cache:
    key: *cache_key

# Save cahce
var_5: &save_cache
  save_cache:
    key: *cache_key
    paths:
      - "node_modules"

# Attach to existing workspace
var_6: &attach_workspace
  attach_workspace:
    at: .

defaults: &job_defaults
  docker:
    - image: *docker_image

orbs:
  aws-s3<EMAIL_ADDRESS>
jobs:
  prepare:
    <<: *job_defaults
    steps:
      - *checkout_code
      - *restore_cache
      - run: npm install
      - *save_cache
      - persist_to_workspace:
          root: .
          paths:
            - node_modules

  lint:
    <<: *job_defaults
    steps:
      - *checkout_code
      - *attach_workspace
      - run: npm run lint

  build:
    <<: *job_defaults
    steps:
      - *checkout_code
      - *attach_workspace
      - run: npm run build
      - persist_to_workspace:
          root: .
          paths:
            - build

  deploy-dev:
    <<: *job_defaults
    steps:
      - *checkout_code
      - *attach_workspace
      - aws-s3/sync:
          from: build
          to: 's3://mybucket/'
          overwrite: true
          aws-access-key-id: AWS_ACCESS_KEY
          aws-secret-access-key: AWS_SECRET_ACCESS_KEY
          aws-region: AWS_DEFAULT_REGION
          arguments: |
            --cache-control "max-age=86400"

I'm not sure why Amplify would put anything in .gitignore that it needs to function from the browser because it will all be visible and therefore insecure anyway unless encrypted, which it doesn't do. The only thing that makes any of this secure is the jwt so I don't see the point in hiding/obfuscating any of this all it does is make ci/cd difficult. I should be able to 'git clone', 'npm install', 'npm run build', 'serve -s dist' and hit my app.

just released a first-class support for github actions: amplify-cli-action


Fixes npm - using stale package data

Resolves #3

Applied the suggested fix: https://github.com/npm/npm/issues/17146#issuecomment-310560565

Updating node version fixed that issue. Closing this PR.


Multiline messages are not working correctly with Markwon

Markwon version: 4.6.0

Please specify expected/actual behavior
I'm making a messaging app, and I need multi line messages, so people can press enter to add a new line to their message. I think that Markwon is messing with this. Whenever I want to type multi line messages and press send, all of the words are on one line.
Please specify conditions/steps to reproduce (layout, code, markdown used, etc)
I am using this code in MessagesAdapter
final Markwon markwon = Markwon.builder(context)
                    .usePlugin(StrikethroughPlugin.create())
                    .usePlugin(HtmlPlugin.create())
                    .build();

markwon.setMarkdown(holder.tvSentMessage, message.getMessage());

I'm tried with no markdown, and the issue is present.
I tried with blockquotes, the issue is still present.
Bold, italics, etc will obviously still have the issue present.

Hello @RoblokazPlays ,
this is a feature of commonmark specification on which this library is based. What you are asking is how to treat soft breaks as hard ones. Refer to the Soft line break section of the documentation page


Update e2e tests

Description
Adapt and implement end-to-end tests using Starknet Foundry in Cairo 2.6 from the Cairo0 repo.
Additional Information
[Easy  - Cairo - Low Priority]
Acceptance Criteria

[ ] Add the Starknet Foundry dependency
[ ] Adapt and pass e2e tests.

I can take this :)

Contribute to Carbonable during ODHack:
Provable environmental infra

Go to the CarbonableOD Telegram: https://t.me/carbonableOD
Present yourself and tell us which issue you want to pick
Explain shortly how you want to tackle the issue
Ask a question if you need some clarity
When you're selected you will be assigned to the issue

Hi @Khyati729 I'd love to work on this

Hey, may I take this one ?

@thomas192  hi, how you started yet? You can check my last curent PR code, which might be a good start to implement integration tests!

@thomas192 hi, how you started yet? You can check my last curent PR code, which might be a good start to implement integration tests!

Hey, thanks for the message I was able to get started yesterday using your PR :)

Hey @tekkac I have a question please see draft PR #6

Hello @tekkac I have a question please see draft PR #6


Support ARM64

As ARM64 devices (primarily through Apple Silicon) are becoming prevalent it would be nice if there would be a native arm64 build available as well. On macOS Rosetta works good enough, but for containers on macOS a native arm64 binary is preferred as it gives less dependencies on having the docker host "properly" installed and configured with qemu.
I cannot find the way how releases are made in the repository itself, otherwise I would have created a PR myself.

jattach natively supports Apple Silicon since release 2.0

@apangin We are using Amazon Linux VMs running on ARM ec2 instances for our container workloads
and it seems attach isn't working anymore - before we used it on x86 instances and it worked fine.
uname -a
Linux ip-10-0-1-205.eu-west-1.compute.internal 4.14.305-227.531.amzn2.aarch64 #1 SMP Tue Feb 14 09:55:25 UTC 2023 aarch64 aarch64 aarch64 GNU/Linux

/usr/local/bin/jattach
bash: /usr/local/bin/jattach: cannot execute binary file: Exec format error

Our installation procedure is just this (in Dockerfile):
RUN wget https://github.com/apangin/jattach/releases/download/v2.0/jattach -O /usr/local/bin/jattach && chmod +x /usr/local/bin/jattach

@jumarko Seems like you're launching x86 binary on ARM hardware. macOS has multi-arch binaries, but Linux doesn't - you need to build a separate binary for ARM.

@jumarko Yes, building is as simple as running make (with no arguments)


prepend_labels for strelka calls runs longer than 2 hours

User reported that prepend_labels for strelka calls runs longer than 2 hours
would be good to estimate the time needed from the number of samples and the number of variants (WGS/WES)

also look into using bcftools annotate to replace
separate_header_and_vars, prepend_labels and recombine_headers_and_vars

looking into using GNU parallel to split up the body of the VCF file to see if it helps


Large Theme Upgreyedd

#46

[x] #136 Merged

[x] Release Notes and Version Bump

[ ] Works On MACOS

[x] Works on Windows

[ ] Updated arrows to be themed

Code looks good.


Adding falcon gpt model - howto?

How would i start with adding the falcon-40b and falcon-7b model?
Am i correct to just copy+rename eg. GPT-NeoXT-Chat-Base-20B
And then:

Adjust the 'get_models.py' to the relevant hugginface
Adjust the 'models.toml' file ( or create from template)

Would that work?

Hi @NicoJuicy, thanks for the question.
I'd rather start with the MPT examples, they're a bit more advanced (ˋtransformers` models seemed to have memory leaks on GPU and it's addressed in these examples). Otherwise yes that's the way to go.
You might also want to edit how chat input is formatted during preprocessing for chat models, and check if the device_map fits your needs.

Thanks for the info. Some work has popped up and let's see if i can get back to this later on!
Nice work fyi!


⚠ Bofrost.at has degraded performance

In caa1d17, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 2096 ms

Resolved: Bofrost.at performance has improved in 1932d03.


API - Catalog of Events has inaccurate "change" and "change:[attribute]" parameters

Currently, it reads:

"change" (model, collection) — when a model's attributes have changed.
"change:[attribute]" (model, collection) — when a specific attribute has been updated.

The collection is not passed as the second argument to these events. Instead, it should read something like:

"change" (model, options) — when a model's attributes have changed.
"change:[attribute]" (model, newValue, options) — when a specific attribute has been updated.

You're quite right -- thanks for noticing the doc lag.


Add ability to specify custom component renderers

This PR adds the ability for plugins using the Bukkit, BungeeCord and Sponge platforms to specify their own ComponentRenderer<Locale> in place of the default translation renderer provided by adventure's GlobalTranslator.
This is loosely modelled off adventure-platform-fabric (though this PR doesn't implement support for multiple plugins' custom renderers on a single audience, as it doesn't seem necessary on Bukkit/BungeeCord/Sponge).
Things to consider:

Currently renderers can be set after the Audiences is created, so we pass around the whole FacetAudienceProvider. I'm not sure whether this is preferred, or if it would be better to make the current renderer final (but this would likely mean we'd have to remove the <platform>Audiences#create per-plugin caching behaviour, which most plugins are used to at this point)

Stripped-down example of usage

Closing in favour of #48, which is a more sensible approach to this.


Add hot module replacement for dev mode

Changes made (Addresses issue #1):

Added HotModuleReplacementPlugin and devServer configuration in webpack.config.js for development mode.
Updated index.jsx to accept hot module replacements.
Updated package.json scripts to set NODE_ENV before running start and build scripts.

Screen recording:
https://drive.google.com/file/d/1mDJClWHfNUZs5PnR4sTEzOnLfiVhxPqa/view?usp=sharing

Thanks, great work!
closes #1


Use the U gate to translate Qiskit U-like gates

Summary
Replace Us decomposition by the application of a the Braket U gate.
Details and comments
Since U has been added to the Braket SDK, we simplify the implementation here.
Bump qiskit-terra version to solve an occurence of https://github.com/Qiskit/qiskit/issues/7326

I think this is actually still worth finishing without waiting for the service; the service doesn't support the U gate, but the same goes for control modifiers, which are supported in the provider.


Styled components v5

@maxquinn  thanks for your PR! 💗 everything seems to look fine, but we need to change the commit message since we're using standarized commit messages. instead of running git commit ... run git cz and follow instructions in the terminal


Bad Request (400) for subfolders

Hi,
After specifying a subfolder under static for a group of scripts in PIPELINE_CSS I get a 400 error when trying to access a page where the group is loaded. However, moving the files to the top level of the static directory and taking out the subfolder in the setting gets rid of the error.
Setting that gives an error:
PIPELINE_CSS = {
    'master': {
        'source_filenames': (
            'sass/master.sass'
        ),
        'output_filename': 'css/master.css',
    },
}

Setting that works:
PIPELINE_CSS = {
    'master': {
        'source_filenames': (
            'master.sass'
        ),
        'output_filename': 'css/master.css',
    },
}

Any idea what might cause this?

Very odd indeed! Solved my problem! thank you!


InjectConnection support @m8a/nestjs-typegoose?

I'm looking for similar behavior as @nestjs/mongoose:
import { Injectable, Logger } from '@nestjs/common';
import { InjectConnection } from '@nestjs/mongoose';

@Injectable()
export class MyService {
  private readonly logger = new Logger(MyService.name);

  // eslint-disable-next-line no-useless-constructor
  constructor(
    @InjectConnection() private dbConnection: Connection,
  ) {}

  async test() {
    const transaction = await this.dbConnection.startSession();
    await transaction.withTransaction(async () => { ... /* my transactions */ ... })
    transaction.endSession();
    return
  }
}

Is this something that we can add to the lib?

Hey,
I don't see why not. :grinning:
PRs are welcome.
Scott

@smolinari lmk if this looks good!

That was fast.
LGTM
Scott

Fixed in #418
Scott

great, looking forward to the tag

@bneigher - 11.1.0 is released. Thanks for your help!
Scott

I should be thanking you for showing me the lib on discord! Haha. Cheers


S3/Azure Configuration Changes

S3 and Azure Bucket Variable Name changes to support both the Node instances.

Added a condition to configure storage between s3 and azure in node api.

Closed


Fails to build client when cluster has no CA bundle set

With 0.27.0 (don't know when it broke): When the local kube config has no explicit CA bundle set, kube fails to load the configuration:
Error loading kube config: Error loading kube config: Failed to get data/file with base64 format

It does load the CA bundle in create_client_builder:
    for ca in loader.ca_bundle()? {
        client_builder = hacky_cert_lifetime_for_macos(client_builder, &ca);
        client_builder = client_builder.add_root_certificate(ca.try_into()?);
    }

Which at some point calls load_certificate_authority, which dives into data_or_file_with_base64. However that expects either plain data, or a file:
match (data, file) {
        (Some(d), _) => { ...  }
        (_, Some(f)) => { ... }
        _ => Err(Error::KubeConfig(
            "Failed to get data/file with base64 format".into(),
        )),
    }

However, if you have a trusted certificate, then there is no need to add a CA bundle. This used to work in the past also with kube.

This was probably introduced during the rustls introduction. If you wanna make a PR from that commit, I'll get it out ASAP.

Released in 0.28.0. Sorry I didn't get time to do a maintenance release of it so now you get the big update :sweat_smile:
Thanks for the report + fix at any rate!


I want to add WEB D resources to your repo.

I want to add some cool web D resources to your repo
below is the image of various links related to this

I want to add more webD resources to your repo


Disable automatic announcement of new OSS releases

Remove the message New release published by [weave-gitops-bot](https://github.com/weave-gitops-bot) which is published automatically to the dev Slack channel.
It is displayed after the first stage of the release but before the actual image is built and pushed.
We'll use manual announcements for the time being.

Disabled with the \github unsubscribe command in the corresponding channel.

The automatic release notifications can be restored If release steps are rearranged to post the notification after the build-and-push image step is completed.


Improve gereral layout

set consistent horizontal padding for content
** content should no longer touch window borders
increase vertical space between structural view containers
introduce horizontal scrollbars for wide contents (e.g. tables)
Use bootstrap error color instead of hard coded color value

thanks for your PR


(from fork) Add recover to KeyVault access policy to enable TF to recover deleted secrets

PR for issue #1237
What is being addressed
Add recover to KeyVault access policy to enable TF to recover deleted secrets

PR recreated from branch in this repo.


Java classes shadowing

Hi,
It seems this SDK is shadowing Jackson classes interfering with its usability in a project using Jackson.
The jar should not be containing these classes. Instead, it should declare Jackson and other libraries as a transitive dependency. If it's absolutely needed that this library cannot have dependencies they should be at the very least be shaded. I am attaching a screenshot of what your SDK currently contains and we can clearly see that a lot of Jackson related classes are added (while ./gradlew dependencies in a project using this SDK shows it has no transitive dependencies)
This issue comes from this line in the build.gradle file
from configurations.runtimeClasspath.findAll { it.name.endsWith('jar') }.collect { zipTree(it) }

Hi @klamouri!
Sorry for the long reaction, but we finally fixed it in the v4
Thank you so much for your feedback!

Hi @ilfa,
We upgraded a while back but we still see those non shadowed classes (and no dependencies showing for this library)

@ilfa I sent a PR (#42) with a fix for this issue

@sshelomentsev can you pls take a look?


Acorn 1.1.0 warning

I see this warning when doing an npm install of this package:
npm WARN deprecated<EMAIL_ADDRESS>Accidental backwards-incompatibility in the AST walker

Thanks for reporting. I just tried bumping the acorn version to fix this, and it seems to have worked, can you confirm that you are no longer getting this warning? Make sure you're on<EMAIL_ADDRESS>

Can confirm this is fixed with 1.0.3. Thank you!


checkbox ':false-value' logic has some problem

Vue.js version
1.0.23
Reproduction Link

https://jsfiddle.net/z3xc9sc6/
Steps to reproduce
If set the ':false-value' on the checkbox, and the 'v-model' property is 'false' like value(eg: null, 0 ...), when the checkbox init, the v-model property will be set 'false'. I think the 'v-model' propery should set the value of ':false-value' instead of 'false'.
If user do 'check'/'uncheck' action, then the ':false-value' works fine.
What is Expected?
I think the 'v-model' propery should set the value of ':false-value' instead of 'false'.
What is actually happening?

In Vue, the data determines what what the UI looks like, not the other way around.

In the data, a: null, so the checked attribute is not set.
Vue will in this case not write back the false-value to the data. This is expected behavior. if you want a to have the value of b initially, then do that in ready()


Fixed dropdown button on WSL, fixed some warnings related to deprecated classes

Isssue #297
I failed to preserve the way the button looked, but at least now it's reliable. The button used to have an arrow down on the right, now it has three dots on the left. I can make it arrow down on the left, @eyalb181 wdyt?
https://github.com/user-attachments/assets/72657f67-8bcf-486d-aa65-749672916481

@Razz4780 Looks good. Up to you whether to keep the dots or change to an arrow


Add reconciler metrics

Add reconciler metrics for queue depth, reconcile count & reconcile latency.
Once this is checked in, more changes are needed on the serving repo to serve these metrics.

/hold

/cancel hold

/hold cancel

/assign @tcnghia
during absence of @mattmoor

/lgtm

/lgtm

/assign @vaikas-google
for /approve

/test pull-knative-pkg-go-coverage

@mattmoor This is ready for another look.

/lgtm
/approve


Test UI attempts to scroll to each and every test node whose state changes to running

Testing #21092

Could you provide a video or something? I am not sure exactly what you mean here. Thanks!

@connor4312, thoughts on this? Trying to think of if there is a good use case to always scroll or if is mostly just visually distracting.
https://github.com/microsoft/vscode-python/assets/26030610/753a1f8c-c158-4d77-afd5-7cb9a0658474

This is configurable via the testing.followRunningTest setting

Amazing! Thank you!


Merge Intervals in python

🚀 Feature
Given an array of intervals, merge all overlapping intervals, and return an array of the non-overlapping intervals that cover all the intervals in the input given an array of intervals, merge all overlapping intervals, and return an array of the non-overlapping intervals that cover all the intervals in the input
Have you read the Contributing Guidelines on Pull Requests?
Yes  I read it
Motivation
Want to contribute in the GSSoC'21
Pitch
For example, let the given set of intervals be {{1,3}, {2,4}, {5,7}, {6,8}}. The intervals {1,3} and {2,4} overlap with each other, so they should be merged and become {1, 4}. Similarly, {5, 7} and {6, 8} should be merged and become {5, 8}

/assign


PMod Public chat not being recolored via "Chat Color" plugin

Probably something to do with how PMod chat used to bypass public filter (different chat type)
Not sure if this happens with CC or PMs

PMod Public chat is the ChatMessageType 22 (which we don't support atm)

PMods use type 1 for Public (unsupported before PR 3706), 7 for PMs, and 9 for CCs. This was (surprisingly) the only type that wasn't supported.


Dovecot can't be created due to ABI (2.24 -> 2.25)

First, thank's for your great work.
I want to find an open alternative of poste.io and I found your project.
But I've a problem with the imap container (Dovecot):
Aug 02 19:52:32 imap(*******@******): Error: Couldn't load required plugin /usr/lib/dovecot/lib90_antispam_plugin.so: Module is for different ABI version 2.2.ABIv24(2.2.24) (we have 2.2.ABIv25(2.2.25))
Aug 02 19:52:32 imap(*******@******): Error: Internal error occurred. Refer to server log for more information.

So, I've this message every time I try to access to Roundcube (and I've got this message with Roundcube: Connection to storage server failed.)
How could I repair that ?
Best regards,

Thanks for reporting, I haven't yet tested yesterday's builds. This is probably related to the antispam plugin currently being installed from a shipped binary. I will rebuild the shipped binary and push it to all branches.

I just created #33 to get rid of this kind of issues for good before next time. Still build the new APKs.

Thank's

I am reopening this as this is not fixed and will probably affect other users.

Sorry, I had no thought.

I pushed commit e471a25 to fix this. Builds just finished on Docker Hub, could you try again?

Hi, I noticed next error:

I pulled and recreated all containers but It not working, do you know what can I do?

Did you pull containers from Docker Hub or build them from the docker-config.yml file? If the latter, disable the cache when building, otherwise cached intermediary containers with old versions of Dovecot will be used for the build.

I build the containers from my docker-compose.yml modified (I am tested on a t2.micro instance and I can't run clamav because I only have 1GB Ram), I always do this and it works fine.
Then I pulled the repo, and I tried with this commands but it not works:
docker-compose up -d --force-recreate
docker-compose up -d --build
I just do this:
docker-compose down --rmi all
docker-compose build --no-cache

....

Building milter
Step 1 : FROM alpine:edge
 ---> 3fc33d6d5e74
Step 2 : RUN echo "@testing http://nl.alpinelinux.org/alpine/edge/testing" >> /etc/apk/repositories  && apk add --update      rmilter@testing rsyslog  && rm -rf /var/cache/apk/*
 ---> Running in ce9d6640448e
fetch http://dl-cdn.alpinelinux.org/alpine/edge/main/x86_64/APKINDEX.tar.gz
fetch http://dl-cdn.alpinelinux.org/alpine/edge/community/x86_64/APKINDEX.tar.gz
fetch http://nl.alpinelinux.org/alpine/edge/testing/x86_64/APKINDEX.tar.gz
ERROR: unsatisfiable constraints:
  so:libfastjson.so.3 (missing):
    required by:
                 rsyslog-8.20.0-r0[so:libfastjson.so.3]
ERROR: Service 'milter' failed to build: The command '/bin/sh -c echo "@testing http://nl.alpinelinux.org/alpine/edge/testing" >> /etc/apk/repositories  && apk add --update      rmilter@testing rsyslog  && rm -rf /var/cache/apk/*' returned a non-zero code: 2

I just try it in to another host and I find the same error, I can´t up the containers now.

Okay, I have the same error here.
The dependency costraint sounds like a bug upstream in Alpine, I will check again tonight and try to ping them on IRC.

<kaiyou> Hey everyone, I have a dependency problem on edge, which I know happens from time to time, but do you know how long it usually takes to solve (cannot install rsyslog)
<kaiyou> Details: rsyslog requires so:libfastjson.so.3 but libfastjson now ships libfastjson.so.4 I believe
<hrw> kaiyou: so rsyslog needs bump and rebuild
* hrw hides

I will try and push something to patchwork to get the rsyslog package bumped.

Just had a discussion with ncopa, this should be fixed soon:
<ncopa> kaiyou_: i pushed rsyslog rebuild

It works perfectly now. Rmilter is built without errors through docker-compose build --no-cache
Thanks

And Dockerhub successfully built a minute ago. Closing this issue, thanks again.


fix: do not mark already resolved ids as external (optimize deps)

Description
our custom esbuild resolver sometimes resolves an id to a full path and calls build.resolve with it. this causes those paths to be marked as external.
Additional context
i'm not sure if there is a better solution. Ideally i would like to skip all plugins on build.resolve in esbuild, but that option is not available.
Is there any alternative?

What is the purpose of this pull request?

[X] Bug fix
[ ] New Feature
[ ] Documentation update
[ ] Other

Before submitting the PR, please make sure you do the following

[X] Read the Contributing Guidelines, especially the Pull Request Guidelines.
[x] Check that there isn't already a PR that solves the problem the same way to avoid creating a duplicate.
[x] Provide a description in this PR that addresses what the PR is solving, or reference the issue that it solves (e.g. fixes #123).
[ ] Update the corresponding documentation if needed.
[ ] Ideally, include relevant tests that fail without this PR but pass with it.

Resolved by not passing absolute paths to build.resolve.
I still think this us relevant


Added evaluations file and some bug fixes for the training

Added evaluations file and some bug fixes for the training

KEEP IN MIND - STOCKFISH IS ASS AS I SET THE DEPTH TO 1 TO GET THE TRAINING EVALUATIONS

based


Fixed #27035 -- Made it easier to change settings.DEBUG for test runs.

merged in a3a5ef4d0e3bf10ff80b26dd2635e40679156a2f, thanks!


dbus: build manpages from xml

Motivation for this change
I noticed that manual pages like dbus-send(1) and dbus-monitor(1) were missing from my system.
The docbook_xml_dtd_44 and docbook_xsl bits are necessary to prevent xmlto from trying to use the network during build. I copied from other nix packages that have the same issue. (Edit: Did it a cleaner way.)
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

I don't think my machine is powerful enough to run the nixpkgs-review for this change, given the sheer number of packages that depend on dbus. I confirmed the manpages were generated correctly and that simple binaries like dbus-send, dbus-monitor, and dbus-uuidgen work (I'm not sure how to use or test the others).

Also this should target staging branch as it causes a mass rebuild.

I have squashed and rebased onto staging. I have no idea why GitHub did that mass review request.

*

I don't think my machine is powerful enough to run the nixpkgs-review for this change, given the sheer number of packages that depend on dbus. I confirmed the manpages were generated correctly and that simple binaries like dbus-send, dbus-monitor, and dbus-uuidgen work (I'm not sure how to use or test the others).

This is what staging-next is for. I would just ensure that the package you're affecting has the intended changes in it.


Simulation instability (Archer)

Hi Kuangdai,
I hope you are well. I have ran a simulation with no 3D model and it worked fine. I then increased the Nr number (from 50 to 360) and included a 3D model in the simulation - it now blows up at the 2nd timestep. I assume the issue is with the 3D model input file but I cant work out what the error may be. Below are the inparam files as well as the logs from archer:
inparam_files.zip
log.txt
2hz_5_mfp_1_rad.o7520491.txt
2hz_5_mfp_1_rad.e7520491.txt
Any advice would be amazing! I note that in inparam.source I still use half_duraction rather than half_duration as I havent updated axisem since that was corrected :)

Vp > sqrt(2) * Vs at any time as required by positiveness of elasticity tensor.

Hi, thanks for getting back to me.
I re-ran the same simulation using new background velocities of Vp = 5800 and Vs = 3200 m/s. The same error occurred. I would have thought that, given the perturbations are 20 % positive perturbations, this would produce a Vp range of [5800, 6960] and a Vs range of [3200, 3840] - this gives a (sqrt(2)*Vs) range of [4525, 5430] such that the velocities would always satisfy this condition. Am I still making a mistake?

Try turning off both types of absorbing boundary first

It still blows up at the second timestep with both absorbing boundaries disabled (currently I am these simulations with a lower Nr value on my local computer, for reference).

Likely to be an error in the 3D file. Please post the script that generates the nc file here.

Have had t o upload as a .txt as .py files arent supported. Thanks for taking the time to look into this, I really appreciate it!
model_gen.txt

The range of x and y should be -125000 to 125000

I have changed the x and y range for the 3D model. It still throws the same error with or without the absorbing boundaries active.

In your script, change the ranges to
x = np.array([-125000, 125000])
y = np.array([-125000, 125000])
z = np.array([0, 125000])

Then plot the model using the following code:
import numpy as np
from netCDF4 import Dataset
import matplotlib.pyplot as plt

dset = Dataset('2hz_5_mfp_1_rad.nc')

vs=dset['vs'][:,:,:]

for z in range(vs.shape[-1]):
    plt.imshow(vs[:,:,z])
    plt.show()

I  don't think that's what you want.

Hi Kuangdai,
I agree thats not what I want! Running the code using
x = np.array([0, 125000])
y = np.array([0, 125000])
z = np.array([0, 125000])

gives the following which is what I am hoping for:

If the range must indeed be from -125 to 125 instead of 0 to 125 in x,y then I will need to re-write the model code accordingly. However, I am curious as to why the simulations I have previously run using the same model-generating code with 0 to 125 have all worked fine and not produced this error!

So what are the differences between your previous run and this one?

The major difference is that we set the flush to false in the inparam.output file and left the buffer at 1000. This was because the time to run the simulations got extremely large (>100 hours on a 1 Hz, 125 km^3 scale simulation on archer) for some reason but Claudia and I weren't sure why. Further, this instability initially occurred in a 1D simulation and this was resolved by reducing the courant number to 0.3 from 0.6. Given that the timing was drastically reduced by doing this, the freq. was then increased to 2 Hz.

I have also just noticed that the attenuation is set to CG4 within the inparam.model.yaml file when it was previously set to NONE but I dont know if that really would make any difference?

Maybe. Turn it off and see if it runs.

Hi Kuangdai,
It looks like turning off the attenuation does the trick, though I'm not sure why! Thank you so much for all your help and quick replies, I really appreciate it.

So it could be a bug in attenuation. Please upload full input folder.

Here's the input folder. This just ran on my local PC with an xy domain 0 to 125 km and setting attenuation to NONE.
input.zip
Thanks again for all your advice.

I changed attenuation into CG4 and FULL, both ran without instability.

This bug is fixed. Last time I could not trigger it because this bug was a compiler-specific.
Thanks.


Classification + leveldb fails

https://gist.github.com/tleyden/7601c7b8510333bc807c

Got past that issue, now its failing due to missing labels: https://gist.github.com/tleyden/3cd2f24b4830deb653b1

func addLabelsToToc(tableOfContents []string) ([]string, []string) { is being called with:
TRAINING_JOB: tocEntry test-data/000003.log 0
TRAINING_JOB: tocEntry test-data/CURRENT 0
TRAINING_JOB: tocEntry test-data/LOCK 0
TRAINING_JOB: tocEntry test-data/LOG 0
TRAINING_JOB: tocEntry test-data/MANIFEST-000002 0

and so labels is ending up as
Mar 14 17:58:46 ip-10-157-102-14.ec2.internal docker[28569]: 17:58:46.418053 TRAINING_JOB: labels: [.]

Working now


Add ability to ignore fields

#[ormlite(skip)] macro would be great!

I can imagine there’s use for this. The field would have to have a Default value, otherwise it couldn’t get populated.
Can you motivate this with your use case?

Having something in a struct that isn't stored in a database, for example. Like a runtime state.

Or if you're building a composite object from different tables.

This is now implemented on master, will be cut on the next release.


Show bidders how much DKP they have left!

I have another idea to make biding maybe go faster. Somewhere in the bidding window for the raiders to see how much DKP they have, so they don't have to re-open the DKP window. Because as a LM I forgot that they can't see the small window with bids and how much they have, that's only me who can see that. Might speed up the biding if you could see how much they have and maybe how much the others biding have.

++ would be nice

Please use the thumbs up emoticons @roaspeci. No need to spam.

Covered by #106


Fix tests when running as mocha | cat

Turns out npub runs the test suite differently than CI (e.g. TTY/colors) which causes some of our tests to fail. This change makes the tests pass with and without colors.

:rainbow: :shipit:


Row-level filtering and masking

Presto should support row-level filtering and data masking for more granular access controls to data.
The general approach would be for SystemAccessControl/AccessControl to provide filters/projections on the base table given an authorization identifier (user/role) that the query planner injects into the plan.
Some questions that need to be considered:

Are the filters/masks provided as an expression or a reference to a function (e.g., a table function)?
If an expression, is it provided as SQL text or IR?
In the case of SQL text,

What's the "environment" under which expressions get evaluated (path, catalog, schema, authorization identifier)?
What happens if the SQL has free variables? Do they get bound to the enclosing scope if possible? Or is it treated as an error? (this would require some complex changes to the analyzer)
What happens if the SQL has semantic errors (references to missing columns, type mismatch, missing functions, etc)? It might be hard/impossible to report a user-friendly error.

There are some potential benefits of modeling the filter/masks as references to (polymorphic) table functions:

The invocation semantics of functions in SQL is well-defined, especially around how the session and authorization contexts behave
It can potentially support opaque implementations (where the engine is not exposed to the filtering/masking logic) or transparent implementations by leveraging SQL-defined functions and related machinery.

Relates to https://github.com/prestosql/presto/issues/18

Presto should support row-level filtering and data masking for more granular access controls to data.
The general approach would be for SystemAccessControl/AccessControl to provide filters/projections on the base table given an authorization identifier (user/role) that the query planner injects into the plan.
Some questions that need to be considered:
* Are the filters/masks provided as an expression or a reference to a function (e.g., a table function)?

* If an expression, is it provided as SQL text or IR?

* In the case of SQL text,

  * What's the "environment" under which expressions get evaluated (path, catalog, schema, authorization identifier)?
  * What happens if the SQL has free variables? Do they get bound to the enclosing scope if possible? Or is it treated as an error? (this would require some complex changes to the analyzer)
  * What happens if the SQL has semantic errors (references to missing columns, type mismatch, missing functions, etc)? It might be hard/impossible to report a user-friendly error.

There are some potential benefits of modeling the filter/masks as references to (polymorphic) table functions:
* The invocation semantics of functions in SQL is well-defined, especially around how the session and authorization contexts behave

* It can potentially support opaque implementations (where the engine is not exposed to the filtering/masking logic) or transparent implementations by leveraging SQL-defined functions and related machinery.

Relates to #18

@martint Could we just leverage create VIEW to expose a subset of table (rows) to user ? then, we just need to grant SELECT privilege on VIEW to user - using connector level access control.

@l0yu, that's something that Presto supports today, but it requires someone to create those views and for users to know which views they are supposed to query. The feature we're discussing here is more powerful, as it would allow plugins and connectors to dynamically enforce filtering/masking policies based on the identity of the user without having to pollute the object namespace.

@l0yu, that's something that Presto supports today, but it requires someone to create those views and for users to know which views they are supposed to query. The feature we're discussing here is more powerful, as it would allow plugins and connectors to dynamically enforce filtering/masking policies based on the identity of the user without having to pollute the object namespace.

OK Cool !

It seems like the most user-friendly way to provide filters and masks is to allow connectors and access control plugins to describe them in terms of textual SQL expressions. This can be rationalized as an analog to dynamic views: the table and the filter/mask expressions form a dynamic view that's then parsed, analyzed and inlined into the query plan.
Clearly, the expressions must fit within some constraints:

The return type of a filter has to be boolean (or unknown, which would happen if the filter only ever returns null).
The return type of masks has to match the type of the column being masked to avoid breaking queries in hard-to-diagnose ways due to type mismatches further up the query tree.
All expressions need to be scalars (no aggregations or window functions) and no special functions such as grouping() can be involved.

Expressions can contain arbitrary subqueries (as part of an IN, EXISTS or quantified operator clause) and function references. This introduces a number of issues we need to resolve.
What authorization identifier is used to access tables and functions referenced by the filter?
Evaluating the filter and masks as the user who submitted the query is simple, but severely cripples the capabilities of this feature. Just like with views, being able to execute the filter with the permissions of a higher privilege user allows for more advanced filtering scenarios involving lookups into tables that might have restricted access. If we conceptualize row filters as just another form of dynamic views, where the view is returned "in parts" (the FROM clause and the WHERE clause separately), it follows that having a similar authorization model as views makes sense. In this case, the row filter would be returned by the plugin or connector together with an authorization identifier to be used to perform access checks on the tables and functions referenced by the filter.
This may seem pointless for a connector access control: if the connector is the one in charge of returning the filter for a table given a user identity, wouldn't that suffice to "trust" the filter and so any further permission checks on the filter should be skipped? Once we consider multiple connectors or global access control, it's clear that we need to perform those checks. Otherwise, a poorly written connector could result in a leak of information from another connector.
Should filters and masks be applied to tables/columns referenced by a filter or mask?
Assuming filters and masks are associated with an authorization identifier that will be for access control checks against any table referenced by them, should filters and masks be applied recursively to those tables? That would make sense if we want to have consistency, otherwise we'd next to explain why some access checks involve filters and masks and others don't.
However, applying filters and masks recursively introduces another potential problem: how far down the rabbit hole do we go? The solution to this may be to continue to resolve and apply row filters and masks as long as the given table and identity haven't been considered.
If both a connector and global access control provide masks for a column, what should the behavior be?
Some obvious choices are:

Require that only one of them provide masks and fail the query otherwis
Apply them all. In this case, in what order should they be applied?

What authorization identifier is used to access tables and functions referenced by the filter?

I think this decision should be left to a plugin, so connectors and access control plugins might return that identity along with the filter or mask.
I guess that in most cases it will be the same identity which is running the actual query. This is something that external service that stores authorization rules has to support in a first place. The ones that I most familiar with do not support that anyway. Because of that, we could also defer the support for using different authorization identifier to evaluate filter and mask until the moment we find the use case, otherwise it is going to be a "dead" code anyway.

wouldn't that suffice to "trust" the filter and so any further permission checks on the filter should be skipped?

I don't think so. We should still verify access. Even if plugin return a "trusted" identity that is going to evaluate filter and mask we still would need to make sure what access given "trusted" identity has.

Should filters and masks be applied to tables/columns referenced by a filter or mask?

I think so. I would expect to apply filter and then mask.

how far down the rabbit hole do we go?

I think we should go to the bottom with the caveat that planner would need to make sure that we are not within an endless loop.

If both a connector and global access control provide masks for a column, what should the behavior be?

I vote for Require that only one of them provide masks and fail the query otherwise. Notice that mask applies some semantic over a column (column is going to be a hash). If we consider the case of applying two masking functions then most like their semantics are conflicting (like one wants to generate a hash and other null). Choosing any of them might be misleading to the user. I don't expect this to be a common problem, so we could defer this until the moment we find actual valid use case for that. So failing for now sounds like a best choice.

If both a connector and global access control provide masks for a column, what should the behavior be?

Since the masks have different "masking strengths" (eg. asterisk for everything vs asterisk for everything except last 4 characters), in principle it is not safe to apply some mask.
Now consider a case of connector configured to apply a mask on credit_card_number  column.
If we now want to apply same security measure system-wide with a new system access control configuration, we will easily end-up having two masks for one column.
It is completely reasonable usage scenario and we should not fail in such a case. (If we failed, how would users resolve this problem?)
The masks should be applied both, in order: connector mask, then system-level mask.


Bump Ruby to 3.2.4

What?
This bumps Ruby to 3.2.4.
Related

https://github.com/alphagov/govuk-ruby-images/pull/92

We might be able to drop the patch version entirely and just use the 3.2 tag. (Or does whitehall still have some issue that stops us from doing that?)

Just to flag - as per a Slack chat - that .ruby-version needs a full version for rbenv which is the tool used in development environments.
If we want to go down this road we'd need to update govuk-docker and change guidance on dev environments to use a different ruby version manager.

Oh I think this was just a mistake — thanks for spotting!


PIL.UnidentifiedImageError

Hi, I am trying to run the command:
python thermal_analysis.py <flir_image_path>
but its throwing this error:
PIL.UnidentifiedImageError: cannot identify image file <_io.BytesIO object at 0x00000232575A1B88>
I did run requirements.txt and do the following:
Download exiftool ,
Extract 'exiftool(-k).exe' to the folder where I'm running the code from,
Rename it to 'exiftool.exe',
what do I do? Any kind of suggestions will be helpful. Thank you.

I assume you're running it in Windows. If possible, can you share your flir file?
Haven't seen this error before.

Thank you for your reply.Yes,I'm running it in Windows.This is my  flir file.

Can you upload the original file? I wanted to test it with the program. This seems to be a normal jpg image, not a FLIR thermal image.

Sorry, there was a little error in the picture I sent before. Now I sent the picture in PNG format which I collected from the laboratory through the infrared thermal imager.

What camera did you use to take this image?
While it is a 'thermal image', it doesn't contain any of the required metadata to use with this software, eg. raw sensor values.

        OK, I see. There is a problem with my infrared thermal image, which leads to a program error. Well, if you can, could you please send me an infrared thermal image of a person's face that can be used for my follow-up study? Thank you very much for your time to help me solve the problem.

<PHONE_NUMBER>1

<EMAIL_ADDRESS>

    Signature is customized by Netease Mail Master

        On 04/03/2021 19:49, rakshith95 wrote:

What camera did you use to take this image?
While it is a 'thermal image', it doesn't contain any of the required metadata to use with this software, eg. raw sensor values.
—You are receiving this because you authored the thread.Reply to this email directly, view it on GitHub, or unsubscribe.
[
{
@.": "http://schema.org",
@.": "EmailMessage",
"potentialAction": {
@.": "ViewAction",
"target": "https://github.com/detecttechnologies/Thermal_Image_Analysis/issues/6#issuecomment-812854455",
"url": "https://github.com/detecttechnologies/Thermal_Image_Analysis/issues/6#issuecomment-812854455",
"name": "View Issue"
},
"description": "View this Issue on GitHub",
"publisher": {
@.": "Organization",
"name": "GitHub",
"url": "https://github.com"
}
}
]

I don't have any unfortunately. You could try the FLIR forums or reddit or something. Closing this issue


[documentation] grammatical fixes to checkpoint.mdx

The changes made are grammatical and do not affect the ideas communicated in the file.

The changes made are grammatical and do not affect the ideas communicated in the file.

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.


Stop nested loops individually

Related to #308.
This requires Loop::stop() to be called for each level of loop nesting, which I think is more intuitive than the current behavior. I'm not sure if we documented that all levels of loop nesting are stopped, so I might consider the current behavior as undefined. This of course matters only if the same Driver instance is used when nested. Using two instances and calling stop on only one will not stop the other. With this PR, a single instance behaves the same as two instances.
With this behavior, calling Amp\Promise\wait() within Loop::run() doesn't matter, as only the inner loop will be stopped.

@bwoebi What's your opinion here?

Related to #84.


Changed semantics of requestTo(String)

This fixes #70

Coverage remained the same at 100.0% when pulling fee99843c552a2390286070d6025322eae1bd56c on whiskeysierra:bugfix/requestto-string into 4b04a498d6f2a45dd0a91d12e6d8ec7b61f05e1e on zalando:master.


Don't change paths of urls that start with data: in CSS

Without this fix the code translates from
background-image:url(data:image/png;base64,...);

to
background-image:url(some/relative/path/data:image/png;base64,...);

Thanks!


thermald: 2.4.9 -> 2.5

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://repology.org/metapackage/thermald/versions.
meta.description for thermald is: "Thermal Daemon"
meta.homepage for thermald is: "https://github.com/intel/thermal_daemon"
meta.changelog for thermald is: "https://github.com/intel/thermal_daemon/blob/master/README.txt"
Updates performed

Version update

To inspect upstream changes

Compare changes on GitHub

Impact

Checks done (click to expand)

built on NixOS
The tests defined in passthru.tests, if any, passed
found 2.5 with grep in /nix/store/3w0vlhp7m50hwa3hm04vpwy3hl3k5d5a-thermald-2.5
found 2.5 in filename of file in /nix/store/3w0vlhp7m50hwa3hm04vpwy3hl3k5d5a-thermald-2.5

Rebuild report (if merged into master) (click to expand)

1 total rebuild path(s)

1 package rebuild(s)

First fifty rebuilds by attrpath
thermald

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/3w0vlhp7m50hwa3hm04vpwy3hl3k5d5a-thermald-2.5 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A thermald https://github.com/r-ryantm/nixpkgs/archive/dc2629bc80a2d940878b2e9e90324f2f7072bf5d.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/3w0vlhp7m50hwa3hm04vpwy3hl3k5d5a-thermald-2.5
ls -la /nix/store/3w0vlhp7m50hwa3hm04vpwy3hl3k5d5a-thermald-2.5/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

thermald

Maintainer pings
cc @abbradar for testing.

Result of nixpkgs-review pr 184731 run on x86_64-linux 1

1 package built:

thermald


I use tsc to compile the .ts into .js and go to other directory,but I miss the css file

Suggestion

TS does not copy asset files.

TS does not copy asset files.

TS does not copy asset files.

I used node to copy files now.
thanks

TS does not copy asset files.

I used node to copy files now.
thanks


feat: update to eye v6.2.0

feat: update to eye v6.2.0

:tada: This PR is included in version 8.2.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release
v8.2.0

Your semantic-release bot :package::rocket:


Trouble connecting to bitpanda pro

Hello,
there seems to be an error connection to the bitpanda API, because I always receive an error when I'm trying to connect. I created the API key with access to read, trade and withdrawal. However some functions seem to work like client.get_market_ticker(Pair("BTC", "EUR")) This returns everything as expected but most of the functions are returning error messages.
The following example dow not work
from cryptoxlib.CryptoXLib import CryptoXLib
from cryptoxlib.Pair import Pair
from cryptoxlib.version_conversions import async_run
from cryptoxlib.clients.bitpanda.exceptions import BitpandaException
from cryptoxlib.clients.bitpanda.enums import OrderSide

async def main():
    apikey = "key"
    client = CryptoXLib.create_bitpanda_client(apikey)

    try:
        await client.create_market_order(Pair("BTC", "EUR"), OrderSide.BUY, "0.00021")
    except BitpandaException as e:
        print(e)
    await client.close()

if __name__ == '__main__':
    async_run(main())

Good to hear it works!


where does data for nodeId originate from?

https://github.com/saulocantanhede/tfgreek2/blob/main/docs/features/nodeId.md

The information that I have comes from this source:
https://github.com/Clear-Bible/macula-greek/blob/main/doc/MACULA Greek Treebank for the Nestle 1904 Greek New Testament.pdf


STORM-3087: Make FluxBuilder.canInvokeWithArgs check whether the actu…

…al argument type is assignable to Number before deciding that a method with a primitive parameter can be invoked
1.x version of https://github.com/apache/storm/pull/2695

Looks good, thx for your contribution.


Test scripts incomplete

Within the development branch you will find test scripts for the private client.  Before committing these to master, we will need test scripts for every function of this project.

ReedJessen is now owning the test script project.


Update direct-routing-border-controllers.md

@JohanFreelancer9 Copy editing is needed for this PR. Thanks.

@CarolynRowe PR has been copyedited and is ready for final review, could you please check and merge? Thanks!


Initialisation error

I am getting this error:
E (371) example: could not init nextion device
and I don't think its a hardware issue as I am able to communicate with Nextion display using Arduino library on UART2 ie Serial2 in Arduino.

I've just transfered it :thumbsup:
Give me some hours while I try that code on my hardware.

Hi @shaurya0406 can you try it? You'll need to delete and clone again because the submodule (iot-lib-nextion) was updated.
All tests passed and it worked on my hardware.


Daemon commands become increasingly slow over time

OS: NixOS 20.03, Linux kernel 5.4.41
Node version: 13.8.0, installed from NPM
I'm noticing that if the daemon has been running for a while, the CLI becomes increasingly slow. A simple hyperdrive status can take over a minute to complete. Stopping and restarting the daemon solves the issue, so I'm thinking it might be a memory issue.
I haven't been able to consistently reproduce it yet, but I'm under the impression that frequent use of the export command might have something to do with it. (I haven't been able to configure FUSE yet.)
Another option is that it's caused by frequent connections from a remote machine, which is also something I've been doing frequently when testing hyperup.
$ hyperdrive status
FUSE is not available on your platform.
The Hyperdrive daemon is running:

  API Version:             0
  Daemon Version:          1.13.12
  Client Version:          1.15.1
  Schema Version:          1.10.0
  Hyperdrive Version:      10.11.0
  Fuse Native Version:
  Hyperdrive Fuse Version:

  Holepunchable:           true
  Remote Address:          <redacted>:49737

  Fuse Available:          false
  Fuse Configured:         false

  Uptime:                  0 Days 5 Hours 11 Minutes 37 Seconds

Hey @brechtcs thanks for reporting this. In 1.13.13 we added periodic mem/cpu stats logging, which should help us trace any potential leaks. We've seen a few other issues related to memory usage so connecting it to the export command (potentially) could be a good tip. As could the frequent reconnections -- most of our use-cases involve long-running services, like Beaker, maintaining a sinlge connection.
The log file in 1.13.13 has also been scrubbed of any sensitive keys, so it's safe to upload -- then we can look at the stats over time.
Thanks again for the report.

Cool, I'll update the daemon and report back.

Quick update, I haven't really noticed this anymore since https://github.com/hypercore-protocol/hyperdrive-daemon/issues/69 started occuring, so maybe they're related? I guess it's equally possible that I'm not reaching the necessary uptime for this to become an issue though, so I'll keep monitoring it.