Update for Flask WTFO 3.0 deprecations

classifyintentsapp/app/main/forms.py:9: DeprecationWarning: Required is going away in WTForms 3.0, use DataRequired
  name = StringField('What is your name?', validators=[Required()])
classifyintentsapp/app/main/forms.py:21: DeprecationWarning: Required is going away in WTForms 3.0, use DataRequired
  email = StringField('Email', validators=[Required(), Length(1, 64),
classifyintentsapp/app/main/forms.py:24: DeprecationWarning: Required is going away in WTForms 3.0, use DataRequired
  Required(), Length(1, 64), Regexp('^[A-Za-z][A-Za-z0-9_.]*$', 0,
classifyintentsapp/app/main/forms.py:51: DeprecationWarning: Required is going away in WTForms 3.0, use DataRequired
  code = RadioField('code_radio', coerce=int, validators=[Required()])
classifyintentsapp/app/main/forms.py:57: DeprecationWarning: Required is going away in WTForms 3.0, use DataRequired
  project_code = RadioField('project_code_radio', coerce=int, default='1', validators=[Required()])
classifyintentsapp/app/auth/forms.py:9: DeprecationWarning: Required is going away in WTForms 3.0, use DataRequired
  email = StringField('Email', validators=[Required(), Length(1, 64),
/classifyintentsapp/app/auth/forms.py:11: DeprecationWarning: Required is going away in WTForms 3.0, use DataRequired
  password = PasswordField('Password', validators=[Required()])
classifyintentsapp/app/auth/forms.py:21: DeprecationWarning: Required is going away in WTForms 3.0, use DataRequired
  Required(),
classifyintentsapp/app/auth/forms.py:29: DeprecationWarning: Required is going away in WTForms 3.0, use DataRequired
  Required(), Length(1, 64), Regexp('^[A-Za-z][A-Za-z0-9_.\ ]*$', 0,
classifyintentsapp/app/auth/forms.py:33: DeprecationWarning: Required is going away in WTForms 3.0, use DataRequired
  Required(), EqualTo('password2', message='Passwords must match.')])
classifyintentsapp/app/auth/forms.py:34: DeprecationWarning: Required is going away in WTForms 3.0, use DataRequired
  password2 = PasswordField('Confirm password', validators=[Required()])
classifyintentsapp/app/auth/forms.py:47: DeprecationWarning: Required is going away in WTForms 3.0, use DataRequired
  old_password = PasswordField('Old password', validators=[Required()])
classifyintentsapp/app/auth/forms.py:49: DeprecationWarning: Required is going away in WTForms 3.0, use DataRequired
  Required(), EqualTo('password2', message='Passwords must match')])
classifyintentsapp/app/auth/forms.py:50: DeprecationWarning: Required is going away in WTForms 3.0, use DataRequired
  password2 = PasswordField('Confirm new password', validators=[Required()])
classifyintentsapp/app/auth/forms.py:55: DeprecationWarning: Required is going away in WTForms 3.0, use DataRequired
  email = StringField('Email', validators=[Required(), Length(1, 64),
classifyintentsapp/app/auth/forms.py:61: DeprecationWarning: Required is going away in WTForms 3.0, use DataRequired
  email = StringField('Email', validators=[Required(), Length(1, 64),
classifyintentsapp/app/auth/forms.py:64: DeprecationWarning: Required is going away in WTForms 3.0, use DataRequired
  Required(), EqualTo('password2', message='Passwords must match')])
classifyintentsapp/app/auth/forms.py:65: DeprecationWarning: Required is going away in WTForms 3.0, use DataRequired
  password2 = PasswordField('Confirm password', validators=[Required()])
classifyintentsapp/app/auth/forms.py:74: DeprecationWarning: Required is going away in WTForms 3.0, use DataRequired
  email = StringField('New Email', validators=[Required(), Length(1, 64),
classifyintentsapp/app/auth/forms.py:76: DeprecationWarning: Required is going away in WTForms 3.0, use DataRequired
  password = PasswordField('Password', validators=[Required()])

Implemented in #43.


training Berkeley fc8s for segmenation with digits

Hi,
I am trying to train berkeley fc8-s for segmentation on a 2class problem.
Here is my proto.txt
original.prototxt.txt
Up to fc7, I am using the pre-trained model from
http://dl.caffe.berkeleyvision.org/fcn8s-heavy-pascal.caffemodel
after fc-7 and from score_fr, layer names and num_output is changed to be learned from scratch
I get an almost flat loss, anyone has tried this before?
Why this network doesnt learn, whereas the alexnet learns much better

That could be due to improper initialization of some conv/deconv layers. Go through this thread and see if you find a solution:
https://groups.google.com/d/msg/digits-users/uHwQ1VV3-Wg/yTyk_Y8FFgAJ

thanks, great advice!


Cannot change stroke width

How can you change the icon stroke width?
I've tried:
<SearchIcon strokeWidth={1} />
<SearchIcon className="stroke-1" />
From what I can tell these are hardcoded in the icons, so this doesn't take affect?
Please let me know if there is an alternative here? Thank you

+1 just came across this issue as well today, would love to be able to adjust this width as 2 is too thick for when icons are scaled up in size


OLM doesn't add imagePullSecrets value to the operator service account after upgrading to SDK 1.34.1

Bug Report
We recently upgraded to SDK 1.34.1 and observed that the service account created by the OLM after installing the operator on kubernetes cluster (v1.27) doesn't have the imagePullSecrets value defined.
In the service account definition file located at operator/config/rbac/service_account.yaml , it has imagePullSecret defined correctly.

What did you do?
Upgraded operator code to SDK 1.34.1, K8s v1.29 and Go 1.21.9 .
What did you expect to see?
Operator should be able to create serviceAccount as defined in the source file in operator/config/rbac/service_account.yaml
What did you see instead? Under which circumstances?
Operator creates the serviceAccount however it doesn't have the imagePullSecret key value defined.
Environment
Operator SDK v1.31.4
Go: 1.21.9
Operator K8s version: 1.29
Operator type:
Go operator
/language go
Kubernetes cluster type:
Test environment : IBM Kubernetes service v1.27
$ operator-sdk version
operator-sdk version: "v1.34.1", commit: "edaed1e5057db0349568e0b02df3743051b54e68", kubernetes version: "1.28.0", go version: "go1.21.7", GOOS: "linux", GOARCH: "amd64"
$ go version (if language is Go)
go version go1.21.9 linux/amd64
$ kubectl version

Possible Solution

Additional context

HI @rahulsb Does the file in /bundle have the imagePullSecrets?

HI @rahulsb Does the file in /bundle have the imagePullSecrets?

Which file in bundle should have it ? I do not see service_account.yaml in bundle folder.
I see manifests and metadata folder. And manifests contains CRD,CSV, configMap and webhook service files

Is this for the controllers service account? Or an additional service account?

Is this for the controllers service account? Or an additional service account?

it's Controller service account.

Since there is no SA file in the bundle for the controller this is by design, you have two options:

Add imagePullSecrets to you CSV that references a Secret (Secrets are an allowed type in a bundle, though I don't recommend this)
You can create an additional Service Account, and have that included in the bundle, then use kustomize to swap that out in the CSV.

Most operator authors go with the first option. Hope this helps.


feat: Implement Spark-compatible CAST from non-integral numeric types to integral types

Which issue does this PR close?
Closes #350
Rationale for this change
Improve compatibility with Spark
What changes are included in this PR?

Functionality to "Spark compatible cast" floats, doubles, and decimals to bytes, shorts, ints, and longs
Enhanced decimal tests to check for cast edge cases

How are these changes tested?
CometCastSuite test case passes.

Thank you @rohitrastogi this looks really great! Could you also run mvn package -DskipTests to regenerate compatibility.md file to include the newly supported cast expressions?

I ran mvn package -DskipTests to regenerate compatibility.md.


[FancyZones editor - Create canvas layout]: Focus order moves incorrectly in the 'Canvas layout editor' dialog.

Microsoft PowerToys version
"0.35.0"
Running as admin

[ ] Yes

Area(s) with issue?
FancyZones Editor
Steps to reproduce
Test Environment:
OS: Windows 10 Build 21354.1
App version: 0.35.0
App name: PowerToys
Screen Reader: Narrator
Tool: Accessibility Insight for Windows
Repro Steps:

Launch 'PowerToys' application.
Application will get open with default list item 'General' selected.
Navigate to 'FancyZones' at the left side of the pane and activate it.
Now navigate to 'Launch layout editor button and activate it.
FancyZones editor window will get open.
Navigate to 'Create custom layout' button and activate it.
Choose layout type dialog gets open.
Select 'Canvas layout' radio button.
Now navigate to 'Create' button and press 'enter' key to activate it.
Canvas layout window will get open
Navigate on the canvas layout via 'Tab/Shift tab' key.
Observe the issue.

User Impact: Priority-2
If focus order is not aligned with either the meaning or operation of the UI, it would be confusing for the Keyboard dependent users who navigate documents sequentially and expect the focus order to be consistent with the sequential reading order
MAS Reference:
https://microsoft.sharepoint.com/:w:/r/sites/accessibility/_layouts/15/Doc.aspx?sourcedoc={54673D5E-1EBB-47DA-988B-52B4BF912771}&file=MAS 2.4.3 – Focus Order .docx&wdLOR=c4DFF4A95-9900-4BC2-848B-25C9BCAB4FB7&action=default&mobileredirect=true&cid=a25d6198-15aa-4dee-80fc-6e4f5a4adf16
Note: Same issue repro for Grid layout editor dialog.
MAS2.4.3_Under canvas layout_Focus moves incorrectly.zip
✔ Expected Behavior
Focus order should navigate in the sequence as 'Top to bottom' and 'left to right' in the 'Canvas layout editor' dialog.
Here, focus order should move as : Add new zone button > save & apply button > Cancel button
❌ Actual Behavior
Focus order moves incorrectly in the 'Canvas layout editor' dialog.
Here, focus order moves as : Add new zone button > Cancel button > save & apply button
Other Software
No response

Resolved with the release of v0.41.


[BEAM-1913] TFRecordIO should comply with PTransform style guide

https://issues.apache.org/jira/browse/BEAM-1913
R: @aviemzur

Changes Unknown when pulling 7d89bb4661907a3e129c78d29fb8f7e68db12a24 on jkff:tf-style into ** on apache:master**.


Review implementation of programming exercise set numbers

The fix for issue #87 was accidentally pushed to develop.
Please check the implementation doesn't require any changes.
See: https://github.com/uccser/cs-unplugged/compare/c656a0dc035f6286dbeec2fa90fc202a7f698046...develop

LGTM


Feature: display list of documentation jobs

It may useful to have a view with job statuses of documentation generation (and maybe deps checks too)

Awesome ;)
The missing part is to be able to display logs of error task.
Do you think it's easy to ad that ?

On main it should be displayed in a popup when clicking on the failure badge.
I am in the process of refactoring all this a little but to handle multiple doc targets and also make the log more robust in the same process. But the interface will not change much.


Missing README files

There is no README file under the directories <*-binding> except nosqldb-binding and mapkeeper-binding.
Version: 0.1.4

This is mostly taken care of. All bindings have READMEs except for:

gemfire

gemfire is getting replaced by Apache Geode as soon as they have a release. I think the PR includes a README.


basic tests for students

This pr adds some built-in tests to the second notebook. Those tests check the basic functionality of Normal and InferenceModel classes for ease of debugging. This functionality was previously requested by in the SST notebook.
Quick glance: https://colab.research.google.com/github/justheuristic/dgm4nlp/blob/solutions/notebooks/sentencevae/SentVAE_Solutions.ipynb
Note: The code there is still a solution version, you will need to manually change your solution code into "assignment mode".
Changes

Added basic tests for Normal
Added basic tests for InferenceModel
Added minimalistic run example for BowmanLM and eval_elbo
Renamed _Normal to Normal (assuming it was a debug trick)
changed Normal.mean and Normal.stddev into properties (for code below to work)
Made sure InferenceModel uses not emb_size (not defined yet) but self.embedder.embedding_dim
InferenceModel outputs changed to match instructions

was [num_lstm_layers=1, batch_size, num_latent]
now [batch_size, num_latent]

Notes:

tested in colab
no changes to the interface except what was explicitly stated above
github diff is huge cuz it's jupyter. pls ignore it
Your code still has :param bidirectional: ??? in BowmanLM

[need a few minutes for a re-run with one more hotfix]


Replace contains for includes, since contains has been deprecated

This PR replaces the use of .contains for .includes since .contains is no longer a method on the array in the latest versions of Ember.
https://www.emberjs.com/deprecations/v2.x/#toc_ember-runtime-enumerable-contains

https://www.emberjs.com/deprecations/v2.x/#toc_ember-runtime-enumerable-contains

@jamiebikies We're trying to move to a version of Ember that no longer supports this. Do you need any additional information prior to merging this PR?


Mouse scrolling not working properly

In vim when you want mouse scrolling to scroll instead of just moving your cursor, you set in your .vimrc these:
set mouse=a
set ttymouse=xterm2

I tried to set these options in pyvim, but there are none. They should either be options, or enabled by default.

Yes, we don't have mouse support yet... I really hope to be able to implement that some day. That would be great for all applications using prompt-toolkit. But it's not an easy one. So, probably I will postpone this until all other important things are working.

Mouse support appears to be working for me in PyVim even under PyMux.


Drop cluster name from intrusion detection controller

Description
We are not going to set CLUSTER_NAME for intrusion detection. For managed cluster, Voltron will set this value. Inside a management cluster, Linseed will default to cluster
For PR author

[ ] Tests for change.
[ ] If changing pkg/apis/, run make gen-files
[ ] If changing versions, run make gen-versions

For PR reviewers
A note for code reviewers - all pull requests must have the following:

[ ] Milestone set according to targeted release.
[ ] Appropriate labels:

kind/bug if this is a bugfix.
kind/enhancement if this is a a new feature.
enterprise if this PR applies to Calico Enterprise only.

Is this a pick of a PR to master? If it was I would review and approve.


[BugFix] Fix the bug of get min/max string stats for string type in DeltaLake catalog

Why I'm doing:
BUG1: MinString/MaxString of ColumnStatistics is not really set.
BUG2: The MinValue/MaxValue need be deep copy, otherwise the MinValue/MaxValue of ScanFileScan will be modified.
What I'm doing:
What type of PR is this:

[x] BugFix
[ ] Feature
[ ] Enhancement
[ ] Refactor
[ ] UT
[ ] Doc
[ ] Tool

Does this PR entail a change in behavior?

[ ] Yes, this PR will result in a change in behavior.
[x] No, this PR will not result in a change in behavior.

If yes, please specify the type of change:

[ ] Interface/UI changes: syntax, type conversion, expression evaluation, display information
[ ] Parameter changes: default values, similar parameters but with different default values
[ ] Policy changes: use new policy to replace old one, functionality automatically enabled
[ ] Feature removed
[ ] Miscellaneous: upgrade & downgrade compatibility, etc.

Checklist:

[ ] I have added test cases for my bug fix or my new feature
[ ] This pr needs user documentation (for new or modified features or behaviors)

[ ] I have added documentation for my new feature or new function

[ ] This is a backport pr

Bugfix cherry-pick branch check:

[x] I have checked the version labels which the pr will be auto-backported to the target branch

[x] 3.3
[ ] 3.2
[ ] 3.1
[ ] 3.0
[ ] 2.5

@Mergifyio backport branch-3.3


Fix the call link of rectangle(Rectangle)

Hi,
I've found that the call link is wrong in the javadoc of rectangle(Rectangle) method, so I've fixed it.
Best regards,
Dgzt

Nice catch, thanks!


Feat/dynamiclayers

Makes the additional layers text autocomplete and the gerber generator use the list of currently active layers

Oops, meant to PR this into MY OWN main, sorry about that 😅


[JS] Use reusable array buffers when available

Describe the enhancement requested
See https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/ArrayBuffer/resize. We should be able to use them in our buffers in builders.
Component(s)
JavaScript

Done in https://github.com/apache/arrow/issues/39251


Successive scatter plots don't adjust the X-axis to display all data

I'm using ScottPlot to display some log data in scatter plots.  I've noticed that when I add the first scatter the X-Axis scales in order to fit all of the data, but when I add subsequent scatters this does not happen.  Is there a way I can make this happen?  I have the bottom axis set to display DateTime values if that matters.
I'm using ScottPlot.WPF version 5.0.36.  Thanks!

Hello, suggest to try adding the code: myPlot.Axes.AutoScale(); or myPlot.Axes.AutoScaler.InvertedX = true;

I have the same issue and I use the Plot.Axes.AutoScale(). I just posted my issue to Discord and I'm a little concerned that there's no traction on your issue in 2 weeks...

I've noticed that when I add the first scatter the X-Axis scales in order to fit all of the data

Indeed! The very first time a plot is rendered, myPlot.Axes.AutoScale() is called automatically. This is what allows plots to good when they are created in console applications.
This design is because ScottPlot doesn't assume plots are created in interactive GUI applications. Many times (console apps, servers, etc.) a plot is created once and returned as an image. Modifying plots after they are rendered is something that only happens in interactive applications, and those have a few extra considerations (most of which are demonstrated in the interactive demos https://scottplot.net/demo/5.0/)

but when I add subsequent scatters this does not happen. Is there a way I can make this happen?

Indeed! Since you're modifying plots after they've been rendered, call myPlot.Axes.AutoScale() to force the axis limits to be adjusted to fit the data. Because this operation is a bit costly (it has to iterate every data point, and ScottPlot supports plots with millions of data points) this isn't called more than once at startup, so users who make changes to interactive plots can decide when the best time is to call this method.

I'm a little concerned that there's no traction on your issue in 2 weeks

This is a fair concern! Issues with code examples and/or screenshots tend to get responses faster from the open source community.


T[] Issue

From MR #131 is one case fix. I write test where provide [GV and it broken again.

MR #137 sorry for multiply merges =)


Allow users to add data about accidents

Users should be allowed to add data about accidents.
For example, alot of accidents don't have weather data so a user needs to be able to add this data and it needs to be stored on a different database.

How would this effect data integrity?
I think it would be best if this is a separate section where it's clear that it mentions user additional data and not the origin's.

I think so too. We need to discuss about it.


Fix missing ending underscore in _Analysis_assume_

@mnatsuhara : Thanks for your contribution! The author(s) have been notified to review your proposed change.

#label:"aq-pr-triaged"


user-guides: services: cross-link to dns admin guide

We need to expand the DNS admin guide further. But, link to it for now.

This change is

@philips, do you see the staged version? It's here: http://deploy-preview-1250.kubernetes-io-vnext-staging.netlify.com/docs/user-guide/services/
I checked the link you added and it looks like it 404s. Is it because that doc hasn't been merged yet?

Link still 404s; also, there is now a merge conflict. @philips , can we revisit this?

This now has a merge conflict as well.

Fixed this issue in a separate commit: http://kubernetes.io/docs/user-guide/services/#dns

THanks for taking care of this.


[BitSail][Connector] Support Druid sink connector

Is your feature request related to a problem? Please describe
A clear and concise description of what the problem is.
Example: I'm always frustrated when [...]
Describe the solution you'd like
A clear and concise description of what you want to happen.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.

duplicate with #110


[useInput][base-ui] Incorrect inputRef in the return value of useInput

Duplicates

[X] I have searched the existing issues

Latest version

[X] I have tested the latest version

Steps to reproduce 🕹
Link to live example: https://codesandbox.io/s/use-input-returned-inputref-kjyyn8?file=/src/App.tsx
Steps: As shown in the example, make an input with useInput and try to use the inputRef from the return value, e.g. to focus the input
Current behavior 😯
It's returning
{
  inputRef: useForkRef(inputRef, inputRefProp, handleInputRefWarning)
}

https://github.com/mui/material-ui/blob/master/packages/mui-base/src/useInput/useInput.ts#L91
Expected behavior 🤔
I think it should just return the inputRef:
{
   inputRef: inputRef
}

Context 🔦
Material UI's InputBase uses the inputRef to check the input state on mount, in case it was filled before hydration, to ensure that Label components are in the correct state:
// Check the input state on mount, in case it was filled by the user
// or auto filled by the browser before the hydration (for SSR).
React.useEffect(() => {
  checkDirty(inputRef.current);
  // eslint-disable-next-line react-hooks/exhaustive-deps
}, []);

I found it wasn't working as expected while working on v6 Label components which rely that "filled" state (https://github.com/mui/material-ui/pull/39483/commits/6e8dca5784a52cec6111644766abd46865d68f25)
Your environment 🌎

npx @mui/envinfo
  Don't forget to mention which browser you used.
  Output from `npx @mui/envinfo` goes here.

This inputRef is meant for syncing and not used directly, explanation here


1.52.5 - sap.m.Dialog: Dialog broken when using contentHeight="100%"

OpenUI5 version:
1.52.5
Browser/version (+device/version):
Chrome  63.0.3239.132 (Mac)
Any other tested browsers/devices(OK/FAIL)
Firefox 58.0.2 (Mac) - FAIL
Safari 11.0.2 (Mac) - FAIL
URL (minimal example if possible):
http://jsbin.com/lizatewafe/2/edit?html,output (openui5 1.52.5 -> dialog broken)
http://jsbin.com/poqaruzava/edit?output (openui5 1.50.8 -> dialog OK)
User/password (if required and possible - do not post any confidential information here):
not required
Steps to reproduce the problem:

create a sap.m.Dialog with contentHeight="100%", stretch="true", a title and a beginButton
open dialog

What is the expected result?
Dialog should fill the complete height of the browser window.
Header and footer of the dialog should be displayed.
What happens instead?
Content area of the dialog fills the complete height of the browser window.

Any other information? (attach screenshot if possible)

There was a change in regard to this: https://github.com/SAP/openui5/commit/05aab36795c5211ad1547129c1cfe64f515da429

Dialog is now with height: 90% and width: 93% only on desktop
On phone the dialog takes the whole viewport(no change)

Same issue: https://github.com/SAP/openui5/issues/1876
Also the documentation is now improved: https://github.com/SAP/openui5/commit/6a5239de5e3f05d7fe144531602a90d0ec3453b5

Hi, i don't think this is a duplicate to #1876. These are two different issues!
#1876 addresses, that the Dialog is not stretched to the full width and height of the browser window on desktop devices, even when the stretch option is set to true. This is now wanted by design, OK.
This issue addresses, that the rendering of the dialog is broken, when the stretched option is set to true and the contentHeight is set to 100%. Then the dialog header and/or the footer are placed outside the browser window and are no longer accessible/visible.

Hi @ffleige ,
Thank you for your finding. The issue is fixed and is going to be down-ported to 1.52.
Best Regards,
Svetoslav


ES Version in compatibility matrix

Version: All
Operating System: N/A

Hi,
I'm not sure if its needed or not, but do all Logstash versions support all Elasticsearch versions? If not, can you please list which range of version is supported per Logstash version?
I was wondering if i can just upgrade Logstash & Kafka, while keeping my ES 1.5 cluster, or i need to upgrade ES as well.
Thanks

The nice thing about Logstash is that its plugins control their dependencies. The only relevant dependency for ES is when using an ES plugin (input, filter, or most likely output).
Logstash 2.x, for the Elasticsearch output, uses the HTTP handler by default, which is backwards compatible with ES 1.x and you can safely upgrade Logstash without upgrading ES.
I strongly recommend that you upgrade to a later version of ES 1.x (at least ES 1.7), if not ES 2.4.x. Not only are there performance reasons, but there's also consistency reasons as well.

hey @shaharmor, I hope @pickypg's answer helped you out! Closing this issue because I feel like this is a question better suited for discuss.elastic.co.


Fix groupId so that we can publish to maven central

The following has been configured for maven central: io.github.lsd-consulting

TODO:
Update maven badge once sync has been enabled


Add OSCRouter

Adds an OSCRouter, a way for people to forward OSC messages, allowing several OSC apps to be used at once (context: only 1 app is allowed per port. This is a workaround). For example, people can send face tracking messages to SlimeVR, which will send them along with the OSC Trackers messages. Works the other way around too; SlimeVR can receive data from VRChat, use it and forward it to another port.
Makes OSC code much better and easier to work with, especially to add more OSC applications.
Also changes a bit of wording in GUI.

needs https://github.com/SlimeVR/SolarXR-Protocol/pull/81
closes https://github.com/SlimeVR/SlimeVR-Server/issues/324

Please rebase @Louka3000

I’m not home and CI isn’t clear about where the formatting problem is .-.

Please rebase @Louka3000

Got it :3


data: durgaprasad118

Fixes Issue

Changes proposed

Check List (Check all the applicable boxes)

[x] My code follows the code style of this project.
[ ] My change requires changes to the documentation.
[ ] I have updated the documentation accordingly.
[ ] All new and existing tests passed.
[ ] This PR does not contain plagiarized content.
[ ] The title of my pull request is a short description of the requested changes.

Screenshots

Note to reviewers

Are there any issues to be resolved?


Explore Value Types (Including Binary for Timestamp Proof)

The values in our key-value store will have multiple types. For instance, the actual value is likely to be a UTF-8 string, but we also want to include the timestamp of the attestation and a signature, which would cause us to want to use JSON with 'timestamp' and 'signature' as keys in that JSON. Another complication is that our timestamping proof, if we use OpenTimestamps, is a binary .ots file, and we need to include that in the key-value store.
We need to figure out how to best encode all of the information that we need to put in the key-value store, given what is available to us as options in Hyperbee/Hypercore.
Methods
@RangerMauve's HyperbeeDeeBee uses BSON so if we use it, we might be able to avoid going to a low-level solution, like doing our own conversions. Let's start with HyperbeeDeeBee and see whether we hit any roadblocks. See comment below.
Background
From the Hyperbee documentation:

Property
Description
Type
Default

valueEncoding
Encoding type for the values. Takes values of 'json', 'utf-8', or 'binary'.
String
'binary'

keyEncoding
Encoding type for the keys. Takes values of 'ascii', 'utf-8', or 'binary'.
String
'binary'

From the HyperCore documentation:

Property
Description
Type
Default

valueEncoding
one of 'json', 'utf-8', or 'binary'
String
'binary'

Yeah I would strongly advise using BSON instead of rolling new stuff or having to deal with custom JSON bits. In particular, using BSON means that you can sort stuff by date more easily with the built in indexing support.

It might be worth it to store the "raw" OTS stuff in the document, but then add a Date property along side it so that you can index over it and perform range queries easily.

Thanks so much, @RangerMauve. I'll start with HyperbeeDeeBee then, and will let you know if we hit any roadblocks there!

It might be worth it to store the "raw" OTS stuff in the document, but then add a Date property along side it so that you can index over it and perform range queries easily.

This sounds like what we want ideally from a timestamping service - the timestamp date as a signed attestation just like any other property/value. None of the main existing timestamping services give this because they think it undermines the untrusted nature, but I think this is extremely helpful in addition to a proof. Not everyone wants or needs to follow the entire proof, just like not everyone needs to run their own Bitcoin node. It'd be nice if they did, but we all have limited resources.
Does that cover what you meant here, or is there something else too?

Just wanted to flag that hyperbeedee's AGPL license will conflict with our current MIT license for the repo.

@RangerMauve, is there any chance that hyperbeedee's license could change to be compatible with MIT?

Hmm, I'm not sure TBH. Is MIT a hard requirement? I'd really like to avoid corpos coming in and close sourcing work behind paywalls and the such. 😅

Since you aren't modifying the hyperbeedeebee source it might be enough to just link to it somewhere, right?

Not really. We wouldn't be able to use it at all with AGPL. Many orgs have a policy of basically not taking any code that is AGPL bc of the risk to their existing codebase.

This was updated to using dag-cbor 2023-04-14 in this PR https://github.com/starlinglab/uwazi-hyperbee-prototype/pull/14


baseurl used twice?

Hi again digitalcraftsman,
Please take a look at the source of http://suntong.github.io/blogs/. I see
  <link href="suntong.github.io/blogs/index.xml" rel="alternate" type="application/rss+xml" title="Sfxpt Blog" />
  <link href="suntong.github.io/blogs/index.xml" rel="feed" type="application/rss+xml" title="Sfxpt Blog" />

<link rel="icon" href="suntong.github.io/blogs/suntong.github.io/blogs/favicon.ico">
<link rel="apple-touch-icon" href="suntong.github.io/blogs/suntong.github.io/blogs//apple-touch-icon.png" />
<link rel="stylesheet" href="suntong.github.io/blogs/suntong.github.io/blogs/css/style.css">
<link rel="stylesheet" href="suntong.github.io/blogs/suntong.github.io/blogs/css/font-awesome.min.css">
<link rel="stylesheet" href="suntong.github.io/blogs/suntong.github.io/blogs/css/monokai.css">
<link rel="stylesheet" href="suntong.github.io/blogs/suntong.github.io/blogs/fancybox/jquery.fancybox.css">

I.e., I see the suntong.github.io/blogs/ has been doubled up, e.g., <link rel="stylesheet" href="suntong.github.io/blogs/suntong.github.io/blogs/css/style.css">. What could be the problem?
I've put my config.toml at https://gist.github.com/suntong/2b529ce26099d6f26278. Could you take a look for me please?
Thanks

Hello @suntong,
with your posted config I was able to reproduce the issue. Currently, your base url is set to
baseurl = "suntong.github.io/blogs/"

But it seems that Hugo doesn't like it if you don't specify the protocol that is used to serve the site. However, adding http:// or https:// before your baseurl should solve your problem.
baseurl = "https://suntong.github.io/blogs/"

Yep, that solve it nicely. Can't trace where the typo was coming from now. Thanks.


Added some more clarity around HA connections and failover.

We have started the 3.1 documentation folder "for real". This pull requests makes changes to 2.9.0; please consider whether this should be forward-ported to 3.1 before merging it.

@garyverhaegen-da can you check? it seems that any docs change needs your approval. is this really intended?

@daravep: @garyverhaegen-da and I can both approve docs PRs, we're currently setting up @cathyjung-da to do so as well.

Basically, you just lost Marci's previous approval when we lost Marci.


No support for modern cipher suites

PassCore Server

OS: Windows Server 2012 R2
Provider: Active Directory

Describe the bug
Application does not appear to work if only modern TLS 1.2 cipher suites are enabled.
To Reproduce
Steps to reproduce the behavior:

Run IISCryptoGUI as admin
Disable everything but TLS 1.2 on both Client and Server.
Disable all ciphers but AES 128/128 and AES 256/256
Disable MD5 hashing
Enable only the following cipher suites:
TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384_P521
TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384_P384
TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256_P521
TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256_P384
TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256_P256
TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA384_P521
TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA384_P384
TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256_P521
TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256_P384
TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256_P256
TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P521
TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384
TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256
TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256_P521
TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256_P384
TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256_P256

Expected behavior
Application should function as expected.
Desktop (please complete the following information):

OS: Windows 10 1903
Browser: Firefox 68.4.1esr, Edge 80.0.361.62

Additional context
.net core 3.0 does have support both for GCM ciphers and SHA256/384 integrity hashes, yet the application will only accept TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA_P256 and none of the above mentioned suites.

Do you mount passcore in IIS? Is IIS able to handle those ciphers?


Docker volumes are not passed to command

I'm running Kitchen from a Bundle, which perhaps is causing this issue, but I can't get seem to get kitchen-docker to append -v as the docs describe. When I open .kitchen/logs/kitchen.log The command ran is:
docker -H unix:///var/run/docker.sock build -f /Users/josephstump/dev/goldstar/chef-repo/Dockerfile-kitchen20161205-14351-1q4p8vt .

Here's the driver output from kitchen diagnose:
    driver:
      binary: docker
      build_context: true
      build_options:
      cap_add:
      cap_drop:
      disable_upstart: true
      dns:
      - <IP_ADDRESS>
      - <IP_ADDRESS>
      image: ubuntu:16.04
      instance_name: jenkinsubuntu1604-josephstump-JoesGoldstariMaclocal-t4qs6upi
      kitchen_root: "/Users/josephstump/dev/goldstar/chef-repo"
      log_level: :info
      name: docker
      platform: ubuntu
      private_key: "/Users/josephstump/dev/goldstar/chef-repo/.kitchen/docker_id_rsa"
      privileged: false
      provision_command:
      - apt-get install traceroute apt-transport-https cpio apt-utils
      - wget -O - http://apt.goldstar.com/sources.list | sed '/dell/d' | sed '/percona/d'
        | sed 's/precise/xenial/g' | tee /etc/apt/sources.list
      - apt-key list | grep -q 63F32BB8 || wget -qO- http://apt.goldstar.com/public.gpg
        | apt-key add -
      - DEBIAN_FRONTEND=noninteractive apt-get update
      - DEBIAN_FRONTEND=noninteractive apt-get install -y --no-upgrade etch
      - ls -alF /mnt/etch
      - etch --gen --local /mnt/etch /etc/passwd /etc/shadow /etc/sudoers
      - curl -L https://www.opscode.com/chef/install.sh | bash
      public_key: "/Users/josephstump/dev/goldstar/chef-repo/.kitchen/docker_id_rsa.pub"
      publish_all: false
      remove_images: false
      run_command: "/usr/sbin/sshd -D -o UseDNS=no -o UsePAM=no -o PasswordAuthentication=yes
        -o UsePrivilegeSeparation=no -o PidFile=/tmp/sshd.pid"
      run_options:
      security_opt:
      socket: unix:///var/run/docker.sock
      test_base_path: "/Users/josephstump/dev/goldstar/chef-repo/test/integration"
      tls: false
      tls_cacert:
      tls_cert:
      tls_key:
      tls_verify: false
      use_cache: true
      use_sudo: false
      username: kitchen
      volume: "/Users/josephstump/dev/goldstar/etch:/mnt/etch"
      wait_for_sshd: true

All of the provision_commands run fine until it gets to needing /mnt/etch.

Setting up volumes is something you do when running a container, not when building an image. What are you trying to do that isn't working?

I have a local directory with things in it that are needed to bootstrap a node correctly. Let's say it's some shell scripts and configs. I need those before the provisioner runs (I know, this is not how it's supposed to go, I'm trying to refactor my way out of here).
So I'll rephrase: How do I expose /path/on/my/laptop to the thing kitchen-docker creates when it's provisioning the thing.

I see what's going on now. The build_image part of the process ignores volumes entirely. Looks like to do this properly I'd need to get an ADD /path/on/my/laptop to the dockerfile_contents. I'll look into that route.

Yep, sounds like you probably want a custom Dockerfile template :)

@coderanger any interest in me issuing a PR that allows people to insert ADD to #build_dockerfile? Perhaps something like provision_add or something that works like provision_command and inserts ADD statements to the generated Dockerfile?

No, I've said in the past I won't accept that. We've already gone way too far on adding explicit "support" for things which should be handled by Docker. In this case just make your own Dockerfile template and do it there.


Issue/doc update

REVIEWERS
@hmunfru
DESCRIPTION
Correct some mistakes and visualization problem in the documentation.

LGTM


Change about to occur in Casper API

We're currently accessing Snapchat's API by spoofing the app using Casper, to use Casper however we have to spoof the actual Casper client. Due to recent events there's a bunch of upcoming security challenges on Casper's end which we'll need to address ASAP. https://www.facebook.com/casper4snapchat/posts/1650721461860775

Their api becomes unusable... ?

And now?

Hum, the end of the Aventure ?

What happens from here on out? Is this the end?

This is solution ?

@filfat And now? What is the app?

I'm working on it

Ping @liamcottle would be awesome if you could read & respond to the email i sent you :)

Is Casper a necessity? I know it helps with the logins, but can't they simply be implemented via the static token, then client token passing like describe here and implemented here

@pvrs12 The implementation still uses casper, and the SC-API isn't currently updated (to my knowledge)

@craycraycoco Oh, duh. I didn't read it enough...

Did this get fixed

@christurek only temporarily; We're required to switch to the new API by next week.

Hey @filfat when you emailed him did you use one of his predefined subject titles from here?
https://www.liamcottle.com/contact

@Ahuge yep

https://itunes.apple.com/us/app/snap-hack-lite-for-snapchat/id782424957?mt=8 Seems to still work; perhaps they have figured out how to generate the X-Snapchat-Client-Auth-Token & X-Snapchat_UUID headers. I'll try to capture it's traffic later today.

It's possible ?

liam said he'd get back to you as soon as he could. Hold tight

hype

Liam back ? For Swift ?

@filfat I did send him this yesterday, so he should reply soon...

Humm.. Cool If it is positive

Awesome! :D

@filfat in the mean time is build 0.1.141 still working for me, so nice to just watch my new received snaps :D :+1:

Liam's response.
Hi Filiph,

Great to see someone working on another Windows Phone app for Snapchat!

Unfortunately right at this point in time, my Public API has been taken offline, due to a few reasons, the first being that it runs off the Android API.

The Snapchat Android API can't be used at this stage by third party applications, as it requires some data from Google servers which can't be retrieved by devices with the Xposed Framework, which we used in order to spoof a few things, which Google has now patched... In turn causing that route to no longer work.

As for the iOS Snapchat API, this requires Client Tokens and Client Auth Tokens for logins and each endpoint request.

Due to how this works (my backend, which I can't disclose the operation techniques of), I can't open it up to the public at this stage.

The main reason I can't do this, is due to the traffic load, which causes quite a few issues for myself and how the backend works.

I have quite a few other developers wanting access to my Private API's used in Casper, but as I said I can't allow that just yet, hence why I've added the extra security in the latest update, to prevent access to it...

If I do build and release a Public API, I'll make a post on the Casper Facebook page, so make sure to follow that for updates on the API etc.

I do plan to build a public API, however as I said, not just yet.

Cheers,
Liam Cottle```

@filfat is it possible to develop a way into snapchat's API without the use of Casper? That seems like the only way that SwiftSnapper is going to work now.

Oh... can not find another solution? The end?

If split developers in 2, for example, as mentioned above, has yet a build running, a part could use it to develop other app resources while another search or creates an way to generate the tokens and implement in SwiftSnapper
Sorry for my english

What's the solution? Work in conjunction with Casper to deliver a w10m version?

@christurek I like the Idea, casper for W10 & W10M would be nice for us and some more credit for @liamcottle.

Hi @filfat What’s the current status of the project?

@eDameXxX not the place to discuss that. See #2


Handle analytical mode in community_detection during parallel changes

Description
NB: PR taken over by @antepusic; connected with https://github.com/memgraph/memgraph/pull/1395
Since there are no ACID guarantees in analytical storage mode, the graph may get modified by parallel transactions while the user’s query is running. Query procedures and functions that return graph elements (nodes and relationships) should be robust to the deletion of graph elements, and this PR aims to fix that.
This PR contains changes to query modules that ensure the intended behavior:

Query modules written with the C and C++ APIs check the existence of values that may contain graph elements before returning them (Python API query modules do this under the hood)

Pull request type

[x] Bugfix

Related issues
Resolves https://github.com/memgraph/memgraph/issues/1036 (together with https://github.com/memgraph/memgraph/pull/1395)
######################################
Reviewer checklist (the reviewer checks this part)
Module/Algorithm

[ ] Core algorithm/module implementation
[ ] Query module implementation
[ ] Unit tests
[ ] End-to-end tests
[ ] Code documentation
[ ] README short description
[ ] Documentation on memgraph/docs
[ ] Update GQLALchemy signatures in query builder using query module signature generator

######################################

And you have build errors, please take care about that before requesting review again. For next time tip: it is better to request review after build errors are fixed since it gives reviewer more confidence that hey this is good and meaningful fix without negative impact on the rest of the system

My initial idea was to make body of GetInnerNodeIdOpt a default implementation for GetInnerNodeId, so we will have just one implementation. I mentioned about this HERE
Currently. we have 2 implementations and users should think which one they need to use in their modules.
@antoniofilipovic what do you think?

@vpavicic As this PR is the MAGE side of https://github.com/memgraph/memgraph/pull/1395/, they are covered by the same docs PR (https://github.com/memgraph/documentation/pull/361) and should both be linked in the same release note.


[Query] Sarama managing connections.

Versions
Version : 1.26.1
| Sarama | Kafka | Go |
Problem Description
Hi all,
Is it a good idea to always create my producers and consumers with NewProducer(), NewConsumer() instead of NeProducerFromClient(), NewConsumerFromClient() ?
I think this creates multiple connections to kafka. From message rate point of view, kafka may not see a difference, will the number of connections be a significant overhead on kafka or sarama?
Biggest reason for using the first set of methods are individual topics need different configurations (eg: partitioner, ack method, AutoCommit, initial offset) which are attached to the Client, so if you need different configs, you need to create connections.
let us know your views.
Thanks,
Harshana

Can someone help me with this query ? Please...

Let me ask the question differently
Can I re-use the same sarama.Client to subscribe to two channels, one with sarama.OffsetNewest and the other with sarama.OffsetOldest ? or should I create two clients for this purpose ?
Thanks,
Harshana

Is it a good idea to always create my producers and consumers with NewProducer(), NewConsumer() instead of NeProducerFromClient(), NewConsumerFromClient() ?

It depends, how many instances of your app is going to be running at the same time?, how many producers/consumers objects are you planning to create on each instance? how many brokers does your cluster has? is the cluster busy regarding TCP connections?

Is it a good idea to always create my producers and consumers with NewProducer(), NewConsumer() instead of NeProducerFromClient(), NewConsumerFromClient() ?

It depends, how many instances of your app is going to be running at the same time?, how many producers/consumers objects are you planning to create on each instance? how many brokers does your cluster has? is the cluster busy regarding TCP connections?

Thank you d1egoaz for the response.
There will be at maximum 6 instances running (normally 2). But there are about 50+ other similar apps. Each at least having 2 ~ 3 consumers and 1 or 2 producers. Which will end up 5 connections from each instance to kafka broker.

TBH it seems it could be easily handle by kafka, and Sarama should no have issues as well.
Best thing to do, is to give it a try, service by service, and collect numbers on the kafka cluster side to see if there is any impact.

thanks @d1egoaz . My thinking was also in similar lines. Will go with the simplest possible solution and think of sophisticated client management if it is required.
Thanks,
Harshana

let us know how it goes.


[BEAM-2454] Remove unused BeamPipelineCreator class

The BeamPipelineCreator class appears to be unused (presumably the functionality there moved at some point into BeamQueryPlanner). Assuming there are no other plans for it, we should remove it.

R: @xumingming
R: @XuMingmin

LGTM

Changes Unknown when pulling 51f549251bc54f112490014fa7ec5d41da7717d6 on takidau:DSL_SQL into ** on apache:DSL_SQL**.

Changes Unknown when pulling 51f549251bc54f112490014fa7ec5d41da7717d6 on takidau:DSL_SQL into ** on apache:DSL_SQL**.


Improve release process

Update documentation to

split off to a release branch prior to deploy
include dependabot non-debug updates

Add release environment with review on release branches
https://youtu.be/oU2yZT-eysw

The current description is just a suggestion. If you have a better way of managing many packages in one repo, please let us know.


Can‘t reproduce the results for ’MobileNetv2Plus ‘

Hi，
I  kept the default setting of this code and replace the student model with MobileNetV2Plus in LightNet. However, the results with distillation is even worse than that without. Can you show me more details about how to train with MobileNetV2Plus ? It would be very helpful.

You can use the original training settings in LightNet. Or you can try to adjust the loss weight in your situation. It is wired that the distillation results are worse. We always get a better results with the distillation items.


[Wave Collect] [Tax] Update the Create, Delete and Rename API for tax codes

The Newdot taxes API needs couple of changes as found by @kosmydel working on the UI parts:

when using SetPolicyTaxesEnabled we can have multiple taxes enabled at the same time so the param needs to be JSONARRAY not a single JSONOBJECT
the DeletePolicyTaxes command expects a list of names of taxes and not a list of taxCodes as the param name suggests which is confusing
When renaming a tax using RenamePolicyTax, there is no validation for already existing tax names

Lets fix these items
Upwork Automation - Do Not Edit

Upwork Job URL: https://www.upwork.com/jobs/~013d991bde7ae0309e
Upwork Job ID:<PHONE_NUMBER>722294272
Last Price Increase: 2024-03-14

@mountiny is the only PR here the web PR, meaning there's no contributor's involved?

correct this is done, can close, thank you


Feature request: HostName regex

Hi,
Is it possible to extract hostname regular expression from Regexy::Web::Url into separate class?

For sure, thanks for suggestion :+1:

done #6

awesome, thanks! :+1:

I've just looked into implementation and it seems that hostname passed as IPv4/6 will be treated as invalid. Is it intentional?

@take-five yes, according the specification ip address is not a valid hostname. If you want to match both hostnames and ip addresses you could use something like r = Regexy::Web::IPv4.new | Regexy::Web::IPv6.new | Regexy::Web::Hostname.new

@take-five I thinking of  creating alias for  Regexy::Web::IPv4.new | Regexy::Web::IPv6.new | Regexy::Web::Hostname.new, something like WebAddress or ServerAddress, WDYT? I don't want to confuse people who expect Hostname regexp to work according RFC.

@vladimir-tikhonov, yes, I think alias is a perfect solution


update support matrix rke

Should we add a mention about We don't support Kubernetes in Docker in general?


[9.x] Move array access to container contract

Laravel's container (and by extension application) allows for its services to be retrieved via array access, e.g.:
$app = app();
$cache = $app['cache'];

The problem however, is that most of the time code doesn't actually "know" if the container supports being accessed as an array, because neither the container nor the application contract enforces it.
The framework itself uses this feature, primarily in service providers. Which is a context where it cannot be sure array access is supported, because the application is type-hinted as the application contract, which does not implement the array access interface.
Example:
https://github.com/laravel/framework/blob/b86e57e062fea77cc388c66b93fd006717f28c0f/src/Illuminate/Queue/QueueServiceProvider.php#L143
What does this PR do?
It moves ArrayAccess from the framework's container implementation, to the container contract. Meaning all code will now be sure that array access is supported when interacting with an application or a container.
Breaking change
This is a breaking change for any custom applications or containers that do not extend from Laravel's container or application. But these custom containers and applications would likely already have implemented ArrayAccess to be compatible with framework code. Because of this I estimate the impact to be very minimal.

No we shouldn't do this. The container contract should be separate.

I don't think this is a bad change given how the container is often used. This does not make it match reality a bit more. @driesvints can you explain your objections a bit more?

@taylorotwell there's a lengthy discussion with lots of reason on why to not do this in https://github.com/laravel/framework/pull/26747. Attempts have been made for this in the past: https://github.com/laravel/framework/pull/26747 & https://github.com/laravel/framework/pull/26378 but they've all been reverted.
Interfaces should stay as small as possible. An implementation can implement multiple interfaces but they shouldn't depend on each other. A container doesn't depends on ArrayAccess to function properly. A container needs to fetch and store bindings. The fact that it can do that with the behaviour of an array is a separate concern that isn't a requirement for a container to function properly. I strongly recommend we don't do this.
Here's also an excellent read on the subject: https://jamison.dance/12-13-2019/keep-interfaces-small

A container needs to fetch and store bindings. The fact that it can do that with the behaviour of an array is a separate concern that isn't a requirement for a container to function properly.

@driesvints while I agree with what you're saying here, fact of the matter is that currently Laravel does require array-like behaviour from its container contact, because multiple components are accessing it as such.
The way I see it there are two ways to fix this issue:
The first solution is what this PR is trying to do (and #26378 previously, later reverted in 0b9abba058d4fb8f9025ab8e28b437ee6ca94435). I would argue for this change, because it's a way smaller change than the alternative. On top of that, having ArrayAccess only exist on the container implementation (and not the interface) limits its usefulness as we can only treat the object like an array when we're sure which implementation it is, which defeats the whole purpose of having an interface in the first place.
The other solution would be to make the framework adhere to the current container and application interfaces as was previously attempted in #26364. This does not address the fact that in reality one would almost never be able to treat the container like an array, unless doing a type check first. (Which isn't the biggest deal, because the make method exists)

I also believe #26364 to be a solution but I want to strongly recommend not to go ahead with the current PR.

FWIW, also vote for a direction like #26364 but not to change the contract, this feels definitely the wrong way.


Added option -use-symlinks to the publish actions.

This modification adds the -use-symlinks command line option as implemented in pull request https://github.com/smira/aptly/pull/519

Closing this as the feature got implemented different way


Adding snapshotter.type flag install command

Part of rancher/elemental#1241

Codecov Report
Attention: Patch coverage is 80.64516% with 6 lines in your changes are missing coverage. Please review.

Project coverage is 72.56%. Comparing base (e56244d) to head (361b2c0).

Files
Patch %
Lines

pkg/types/v1/snapshotter.go
62.50%
6 Missing :warning:

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1987      +/-   ##
==========================================
+ Coverage   72.50%   72.56%   +0.05%
==========================================
  Files          76       76
  Lines        8883     8894      +11
==========================================
+ Hits         6441     6454      +13
+ Misses       1910     1907       -3
- Partials      532      533       +1

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Issues with pip dependency with this example

I'm trying to go use this example in order to deploy my lambda functions  using terraform with their python library dependencies.
However, when following this example, I hit this error.
null_resource.build_lambda_function (local-exec): pip : The term 'pip' is not recognized as the name of a cmdlet, function, script file, or operable program. Check the spelling
Is there a step that needs to be done to insure terraform has pip installed when it is deploying to aws? If so, where would this go in your examples?

after thinking this over a bit more....I think this can be resolved by just installing pip locally in your virtual environment or add pip install to github action.

Yeah, I hit an error with pip missing too, had to apt install python3-pip on my local for testing this out. Should be mentioned in the docs.


The code for training

thanks for you model. and where can I get the code for training?

Duplicated issue (https://github.com/clovaai/CRAFT-pytorch/issues/2).
Sorry for your inconvenience.
@backtime92 kindly published the reimplementation of CRAFT with training codes.
You can refer to the repo https://github.com/backtime92/CRAFT-Reimplementation.

Excuse me, I'm looking at the code for the training and I noticed that the part that calculates the affinity maps is commented, why? According to the article, this segment of the affinity maps is very important for the word generation, I ended up confused.

Excuse me, I'm looking at the code for the training and I noticed that the part that calculates the affinity maps is commented, why? According to the article, this segment of the affinity maps is very important for the word generation, I ended up confused.


Simple Rnn's (LM RNN)

Can anyone make an example of how to do a simple RNN? One with Back propagation through time would be sufficient.  Basically, ones similar to the one in this paper (LM RNN).
http://www.fit.vutbr.cz/research/groups/speech/publi/2010/mikolov_interspeech2010_IS100722.pdf

The simplest RNN example we have is parity_problem. https://github.com/mila-udem/blocks-examples/tree/master/parity_problem. Also, we have a Markov chain modelling demo https://github.com/mila-udem/blocks-examples/tree/master/markov_chain, which is more like language modelling, but uses more advanced Blocks components.


Report store errors back to client instead of panicking

Example: We won't support all filters for all types, so we should

Try to only expose filters that we support in the GraphQL schema
Allow the Store to return useful errors when filters are not supported for certain value types.

The following parts are affected by this:

All store methods should return a Result<..., GraphQlError> https://github.com/graphprotocol/graph-node/blob/master/graph/src/components/store.rs#L126
The Resolver and StoreResolver should return Result<q::Value, GraphQlError> from all methods: https://github.com/graphprotocol/graph-node/blob/master/graphql/src/store/resolver.rs
All GraphQL execution functions that call the resolver should return Result<q::Value, Vec<GraphQlError>>: https://github.com/graphprotocol/graph-node/blob/master/graphql/src/execution/execution.rs#L51
These functions should roll child errors into their own error vector and return all errors side by side.
execute_query and execute_subscription will be affected by this as well and should put the error vector into the QueryResult struct.

Part 0 is something we can do later and skip for now.


Various dummydroid fixes/improvements

Updated the user-agent to (at that moment) latest Angler device
Show the AndroidID capitalized to the user (in general it is used in this form in other locations, and more common way to show hex)
Updated the device defaults to be the most supreme device possible (with the exception of leanback/android TV 'features'), With the idea it is easier for users to remove than to add lines. (Thought: it might be cool to offer features described in the android docs 'checkbox' fields?)
Added the oauth hack with sdk17
Added the possibility to add devices on brand new accounts that had no devices registered yet (was otherwise not possible)

Pending further research, I think, "sdk_version" is actually of no consequence. What matters is "add_account". It seems like Google no longer assigns the "googleplay" service to newly created accounts. Likely because that means implicitely accepting the Play TOS without telling the user (obviously a no go if the user just wanted to use gmail). What an Android device does on first setup is login into ac2dm, then send a broadcast intent notification that is picked up by the vending apk which then does some complicated dance and finally submits a DFE request stating "TOS accepted".
The TOS can also be accepted by logging in through the webversion of play.

I was able to accept any ToS via the Play website during my testing with @therealssj, I needed irrespective of going to the Play website this "add_account" when setting up the first device with a brand new account.
What do you mean with the "DFE request"?


Chocolatey won't start

Was working fine last time I used it a couple weeks or so ago, but now it won't launch. I tried, twice, both times got the following error:
Failed to start application.
Configuration system failed to initialize

More details available in application logs.

Log attached.
ChocolateyGui.20200414.log

Just ran choco list -l and it looks like every single installed program has the message "A corrupt .registry file exists at... .registry.bad..."

I like the idea of chocolatey, and I don't mind dealing with some issues in order to both benefit from it and help in its development, but I can't afford to simply not be able to get anything done because it completely breaks and nobody responds. I'd like to continue using it and helping out, but should I just uninstall it and be done with it?

In order to best help, it would really help if you provide some additional information.  For example, what version of Chocolatey are you using?  What version of Chocolatey GUI?  What operating system?  When did this happen?  What commands were you trying to use at the time this occurred?
I know that there was an issue regarding the .registry.bad files, but I believe that this was addressed, so I can't speak to exactly what caused this to happen.
Have you tried what is suggested in the error output?
A corrupt .registry file exists at C:\ProgramData\chocolatey\.chocolatey\7-taskbar-tweaker.5.8\.registry.bad.
 Open this file in a text editor, and remove/escape any characters that
 are regarded as illegal within XML strings not surrounded by CData.
 These are typically the characters &, `<`, and `>`. Again, this
 is an XML document, so you will see many < and > characters, so just
 focus exclusively in the string values not surrounded by CData. Once
 these have been corrected, rename the .registry.bad file to .registry.
 Once saved, try running the same Chocolatey command that was just
 executed, so verify problem is fixed.
 NOTE: It will not be possible to rename the file in Windows Explorer.
 Instead, you can use the following PowerShell command:
 Move-Item .\.registry.bad .\.registry

Chocolatey version 0.10.15. GUI is latest version, though I can't provide a version number since it won't open. Win10x64. Not trying any commands, as I stated, I simply tried launching it. After multiple unsuccessful attempts to launch the GUI, I tried the commands mentioned above.
I did not try applying the fix recommended for a couple reasons. One, I didn't want to mess with anything until seeking help, since the current/broken state may be useful for troubleshooting. Second, and more importantly, I just don't have the time. It would likely take more time to go through the dozens of files and scrutinize them for any possible issues than it would to reset the computer to its initial state and reload it with software the old-fashioned way, not to mention there's no guarantee--and in fact every reason to believe the opposite--that the issue wouldn't just occur again, and as much as I don't want to perform an extensive repair procedure that would take who knows how long, I certainly don't want to have to do it every couple weeks.

@vertigo220 what you decide to do is ultimately up to you of course.
I have only known this to happen on one other machine, and the fix suggested in the error message was the approach that was used to resolve it.

Ok, so it's an uncommon issue, and of course I was unlucky enough to experience it, but the fact remains it is an issue, and a rather serious one, and it should be investigated to figure out and fix the cause, not just patched up and hope it doesn't happen again. And I'm willing to help figure it out, but I'm not willing to spend potentially hours "fixing" it only to possibly have it recur, not to mention the other issues I'm having with the program.
I don't mean to come across as negative as I'm sure I am, but being a beta tester is one thing, using software with either no or extremely inconvenient recourse for the multiple issues encountered in its use is another. I really want chocolatey to work, but so far it has cost me a significant amount of time and resulted in two separate computer setups with significant issues.

I got the same issue. Chocolatey GUI won't start, either I get the same error message or I just get an "empty window frame", and it hangs forever. After starting Chocolatey GUI, a bunch of my registry files get "corrupted", but I actually checked and there's no error in the XMLs. Command line Chocolatey will tell me which packages to fix, so I rename them and everything works fine from the command line, but as soon as I try to launch the GUI, the same thing happens.
I've tried to uninstall Chocolatey GUI and reinstall it, even deleted all the files manually and all the registry entries for it too.
Nothing seems to help, please advise. Should we reopen this issue or should I create a new one?
Chocolatey version: 0.10.15
Chocolatey GUI version: 0.18.1

It feels like I'm running into the same issue. Renaming the user.config didn't solved it - the file doesn't appear in my log file. Any idea what I have to delete to run it again?
2024-10-18 17:33:02,541 24540 [ERROR] - Error deserializing response of type chocolatey.infrastructure.app.domain.PackageFiles:
 '.', hexidezimaler Wert 0x00, ist ein ung ltiges Zeichen. Zeile 1, Position 1.
2024-10-18 17:33:02,541 24540 [WARN ] - This is try 1/3. Retrying after 400 milliseconds.
 Error converted to warning:
 '.', hexidezimaler Wert 0x00, ist ein ung ltiges Zeichen. Zeile 1, Position 1.
2024-10-18 17:33:02,944 24540 [ERROR] - Error deserializing response of type chocolatey.infrastructure.app.domain.PackageFiles:
 '.', hexidezimaler Wert 0x00, ist ein ung ltiges Zeichen. Zeile 1, Position 1.
2024-10-18 17:33:02,945 24540 [WARN ] - This is try 2/3. Retrying after 600 milliseconds.
 Error converted to warning:
 '.', hexidezimaler Wert 0x00, ist ein ung ltiges Zeichen. Zeile 1, Position 1.
2024-10-18 17:33:03,547 24540 [ERROR] - Error deserializing response of type chocolatey.infrastructure.app.domain.PackageFiles:
 '.', hexidezimaler Wert 0x00, ist ein ung ltiges Zeichen. Zeile 1, Position 1.
2024-10-18 17:33:03,548 24540 [ERROR] - Maximum tries of 3 reached. Throwing error.
2024-10-18 17:33:03,548 24540 [WARN ] - Unable to read files snapshot file:
 '.', hexidezimaler Wert 0x00, ist ein ung ltiges Zeichen. Zeile 1, Position 1.
2024-10-18 17:33:03,555 24540 [WARN ] -
Chocolatey upgraded 0/0 packages.
 See the log for details (C:\ProgramData\chocolatey\logs\chocolatey.log).
2024-10-18 17:33:03,557 24540 [DEBUG] - Sending message 'PostRunMessage' out if there are subscribers...
2024-10-18 17:33:03,559 24540 [ERROR] - Die Eingabe ist keine g ltige Base-64-Zeichenfolge, da sie ein Nicht-Base-64-Zeichen, mehr als zwei Leerstellen oder in den Leerstellen ein Zeichen enth lt, das ung ltig ist.
2024-10-18 17:33:03,561 24540 [ERROR] - More Details: System.FormatException: Die Eingabe ist keine g ltige Base-64-Zeichenfolge, da sie ein Nicht-Base-64-Zeichen, mehr als zwei Leerstellen oder in den Leerstellen ein Zeichen enth lt, das ung ltig ist.
   bei System.Convert.FromBase64_Decode(Char* startInputPtr, Int32 inputLength, Byte* startDestPtr, Int32 destLength)
   bei System.Convert.FromBase64CharPtr(Char* inputPtr, Int32 inputLength)
   bei System.Convert.FromBase64String(String s)
   bei chocolatey.infrastructure.cryptography.DefaultEncryptionUtility.DecryptString(String encryptedString)
   bei chocolatey.infrastructure.app.utility.ArgumentsUtility.<DecryptPackageArgumentsFile>d__1.MoveNext()
   bei System.String.Join(String separator, IEnumerable`1 values)
   bei chocolatey.infrastructure.app.services.NugetService.<List>d__15.MoveNext()
   bei System.Collections.Generic.List`1..ctor(IEnumerable`1 collection)
   bei System.Linq.Enumerable.ToList[TSource](IEnumerable`1 source)
   bei chocolatey.infrastructure.app.services.NugetService.GetInstalledPackages(ChocolateyConfiguration config)
   bei chocolatey.infrastructure.app.services.NugetService.SetLocalPackageNamesIfAllSpecified(ChocolateyConfiguration config, Action customAction)
   bei chocolatey.infrastructure.app.services.NugetService.Upgrade(ChocolateyConfiguration config, Action`2 continueAction, Boolean performAction, Action`2 beforeUpgradeAction)
   bei chocolatey.infrastructure.app.services.NugetService.Upgrade(ChocolateyConfiguration config, Action`2 continueAction, Action`2 beforeUpgradeAction)
   bei chocolatey.infrastructure.app.services.ChocolateyPackageService.Upgrade(ChocolateyConfiguration config)
   bei chocolatey.infrastructure.app.runners.GenericRunner.Run(ChocolateyConfiguration config, Container container, Boolean isConsole, Action`1 parseArgs)
   bei chocolatey.infrastructure.app.runners.ConsoleApplication.Run(String[] args, ChocolateyConfiguration config, Container container)
   bei chocolatey.console.Program.Main(String[] args)
2024-10-18 17:33:03,561 24540 [DEBUG] - Exiting with 1
2024-10-18 17:34:01,111 29308 [DEBUG] - XmlConfiguration is now operational
2024-10-18 17:34:01,144 29308 [DEBUG] - Adding new type 'CygwinService' for type 'IAlternativeSourceRunner' from assembly 'choco'
2024-10-18 17:34:01,145 29308 [DEBUG] - Adding new type 'CygwinService' for type 'IInstallSourceRunner' from assembly 'choco'
2024-10-18 17:34:01,145 29308 [DEBUG] - Adding new type 'PythonService' for type 'IAlternativeSourceRunner' from assembly 'choco'
2024-10-18 17:34:01,145 29308 [DEBUG] - Adding new type 'PythonService' for type 'IListSourceRunner' from assembly 'choco'
2024-10-18 17:34:01,146 29308 [DEBUG] - Adding new type 'PythonService' for type 'IInstallSourceRunner' from assembly 'choco'
2024-10-18 17:34:01,146 29308 [DEBUG] - Adding new type 'PythonService' for type 'IUninstallSourceRunner' from assembly 'choco'
2024-10-18 17:34:01,147 29308 [DEBUG] - Adding new type 'RubyGemsService' for type 'IAlternativeSourceRunner' from assembly 'choco'
2024-10-18 17:34:01,147 29308 [DEBUG] - Adding new type 'RubyGemsService' for type 'IListSourceRunner' from assembly 'choco'
2024-10-18 17:34:01,148 29308 [DEBUG] - Adding new type 'RubyGemsService' for type 'IInstallSourceRunner' from assembly 'choco'
2024-10-18 17:34:01,149 29308 [DEBUG] - Adding new type 'SystemStateValidation' for type 'IValidation' from assembly 'choco'
2024-10-18 17:34:01,149 29308 [DEBUG] - Adding new type 'CacheFolderLockdownValidation' for type 'IValidation' from assembly 'choco'
2024-10-18 17:34:01,401 29308 [DEBUG] - Adding new type 'EmptyOrInvalidUrlMetadataRule' for type 'IMetadataRule' from assembly 'choco'
2024-10-18 17:34:01,402 29308 [DEBUG] - Adding new type 'FrameWorkReferencesMetadataRule' for type 'IMetadataRule' from assembly 'choco'
2024-10-18 17:34:01,402 29308 [DEBUG] - Adding new type 'IconMetadataRule' for type 'IMetadataRule' from assembly 'choco'
2024-10-18 17:34:01,403 29308 [DEBUG] - Adding new type 'LicenseMetadataRule' for type 'IMetadataRule' from assembly 'choco'
2024-10-18 17:34:01,403 29308 [DEBUG] - Adding new type 'PackageTypesMetadataRule' for type 'IMetadataRule' from assembly 'choco'
2024-10-18 17:34:01,404 29308 [DEBUG] - Adding new type 'ReadmeMetadataRule' for type 'IMetadataRule' from assembly 'choco'
2024-10-18 17:34:01,404 29308 [DEBUG] - Adding new type 'RepositoryMetadataRule' for type 'IMetadataRule' from assembly 'choco'
2024-10-18 17:34:01,405 29308 [DEBUG] - Adding new type 'RequireLicenseAcceptanceMetadataRule' for type 'IMetadataRule' from assembly 'choco'
2024-10-18 17:34:01,405 29308 [DEBUG] - Adding new type 'ServicableMetadataRule' for type 'IMetadataRule' from assembly 'choco'
2024-10-18 17:34:01,405 29308 [DEBUG] - Adding new type 'VersionMetadataRule' for type 'IMetadataRule' from assembly 'choco'
2024-10-18 17:34:01,411 29308 [DEBUG] - Registering new command 'cache' in assembly 'choco'
2024-10-18 17:34:01,412 29308 [DEBUG] - Registering new command 'list' in assembly 'choco'
2024-10-18 17:34:01,412 29308 [DEBUG] - Registering new command 'rule' in assembly 'choco'
2024-10-18 17:34:01,413 29308 [DEBUG] - Registering new command 'template' in assembly 'choco'
2024-10-18 17:34:01,413 29308 [DEBUG] - Registering new command 'export' in assembly 'choco'
2024-10-18 17:34:01,414 29308 [DEBUG] - Registering new command 'info' in assembly 'choco'
2024-10-18 17:34:01,414 29308 [DEBUG] - Registering new command 'help' in assembly 'choco'
2024-10-18 17:34:01,415 29308 [DEBUG] - Registering new command 'config' in assembly 'choco'
2024-10-18 17:34:01,415 29308 [DEBUG] - Registering new command 'feature' in assembly 'choco'
2024-10-18 17:34:01,416 29308 [DEBUG] - Registering new command 'new' in assembly 'choco'
2024-10-18 17:34:01,416 29308 [DEBUG] - Registering new command 'outdated' in assembly 'choco'
2024-10-18 17:34:01,416 29308 [DEBUG] - Registering new command 'pack' in assembly 'choco'
2024-10-18 17:34:01,417 29308 [DEBUG] - Registering new command 'pin' in assembly 'choco'
2024-10-18 17:34:01,417 29308 [DEBUG] - Registering new command 'push' in assembly 'choco'
2024-10-18 17:34:01,418 29308 [DEBUG] - Registering new command 'apikey' in assembly 'choco'
2024-10-18 17:34:01,418 29308 [DEBUG] - Registering new command 'source' in assembly 'choco'
2024-10-18 17:34:01,418 29308 [DEBUG] - Registering new command 'uninstall' in assembly 'choco'
2024-10-18 17:34:01,419 29308 [DEBUG] - Registering new command 'upgrade' in assembly 'choco'
2024-10-18 17:34:01,419 29308 [DEBUG] - Registering new command 'search' in assembly 'choco'
2024-10-18 17:34:01,420 29308 [DEBUG] - Registering new command 'unpackself' in assembly 'choco'
2024-10-18 17:34:01,420 29308 [DEBUG] - Registering new command 'install' in assembly 'choco'
2024-10-18 17:34:01,486 29308 [INFO ] -


feat: update ecosystem page

What changed? Why?
Notes to reviewers
How has it been tested?

🟡 Heimdall Review Status

Requirement
Status
More Info

Reviews

🟡
0/2

Denominator calculation

Show calculation

1 if user is bot
0

1 if user is external
0

From .codeflow.yml

1

Additional review requirements

Show calculation

Max
0

0

From CODEOWNERS

0

Global minimum
0

Max

1

1

1 if commit is unverified
1

Sum
2

@dschlabach you've got to resolve merge conflicts before merging

Review Error for alessey @ 2024-12-05 20:51:36 UTC
User failed mfa authentication, public email is not set on your github profile. see go/mfa-help

Review Error for alessey @ 2024-12-05 21:05:21 UTC
User failed mfa authentication, public email is not set on your github profile. see go/mfa-help

Review Error for alessey @ 2024-12-05 21:06:06 UTC
User failed mfa authentication, public email is not set on your github profile. see go/mfa-help

Review Error for brendan-defi @ 2024-12-05 21:07:35 UTC
User failed mfa authentication, see go/mfa-help


Thread 1: signal SIGABRT

Continuing from the thread: #694
This issue does not related to Firebase for 2 reasons:

i can log in with Facebook.
when in i don't configure the client ID in ComponentDidMount i get an error

it is something connected to linking problem, looks like the app does not find the GoogleService-Info.plist, which i can not understand since it was there at the beginning and the info within looks ok.
does anyone encountered this issue?
Thanks,

Hi there! Sorry you're having an issue. As the issue template explains, we require that you provide a runnable example (please try reproducing the bug with our example app) that reproduces the bug in a github repository. Please try to minimize the superfluous code and focus only on reproducing the bug.
please create a new issue with this and we'll be happy to review it!


fix Dict's IntoIterator

It turns out that RocDict's IntoIterator was broken: it segfaulted when reading values! After some experimentation, it turns out that RocList.get was accessing the wrong memory (it appears to have been wrong for short lists, at least?)
In RocDict's case, however, iterating over a slice of the list instead of manipulating memory directly works fine, so I've just done that and dropped the problematic get implementation for now (as RocDict's' IntoIterator was the only consumer.) If some brave soul wants to try implementing get again, great! But that's not me right now, and I don't want to leave broken code in the codebase waiting to bite someone else.
@zwilias: this fixes the segfault we saw yesterday!

just to link stuff together: this fixes the problems in https://github.com/roc-lang/rbt/pull/58


add factory for dropin files

Add a factory for dropin files so they can be simply defined in hiera

I have made the changes with the empty hash default. About dedicated type, isn't that a repitition as the structure of the variables is already set in the definition of the defined resource.


fix(cli): Statically compile msvc runtime

fixes https://github.com/tauri-apps/tauri/issues/11642 ref https://github.com/swc-project/swc/pull/7965
i only added it for x64 for now but we should monitor x32 (swc removed it for this one again) and aarch64 (swc never added it). x32 is fairly rare as a dev system and aarch64 didn't seem much testing in general (as a dev system) so i'd prefer to wait and see if it's needed.
note that i don't know if any other tooling (rust etc) need the dyn runtime so that's also something to monitor

as long as it helps our users i'm fine with it.. though most people should have msvc installed right?


I cant find transformAlignment in AnimateContainer

Hi
I usually use transformAlignment property with transform of AnimationContainer. But I cant find it in flutter-tizen. I suspect it would be flutter versioning issue..

The property is available in Flutter 2.0.0 which was released a few days ago but flutter-tizen is still based on the previous stable version (1.22.6). The migration will be done in about 2 weeks. Thank you for your patience.


qx serve: better error handling if port is in use

if you have a qx serve process running, and start another one by mistake, you get a rather cryptic error message:
$ qx serve
events.js:182
      throw er; // Unhandled 'error' event
      ^
Error: listen EADDRINUSE :::8080

with a stack trace. It would be better to output a clear error message such as "Port 8080 is in use. Stop the running server or use a different port."

This has been fixed.


Tests for standalone reading/writing semantic dbs under JVM/JS

Creating a note for myself in order not to forget to do this.

We have such tests now in https://github.com/scalameta/scalameta/blob/f7463f78227e092b5dab0a05667733b0a2b23952/scalameta/tests/shared/src/test/scala/scala/meta/tests/CrossPlatformSemanticSuite.scala writing + reading in JVM and reading only in JS


include LICENSE in source distributions

Thank you for trio-websocket!
This PR ensures the LICENSE file is included in sdist distributions, which, while not required by the terms of the MIT license, is helpful for downstreams.
In my case, I'm looking to package this for conda-forge, which generally requires some license documentation for all packages. We're not blocked, as such, as we can source it from github from the same tag, but keeping everything in one tarball makes things a bit more reliable.
Thanks again!

Pull Request Test Coverage Report for Build 206

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 95.761%

Totals

Change from base Build 187:
0.0%

Covered Lines:
497

Relevant Lines:
519

💛  - Coveralls

Pull Request Test Coverage Report for Build 206

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 95.761%

Totals

Change from base Build 187:
0.0%

Covered Lines:
497

Relevant Lines:
519

💛  - Coveralls

Thanks!


Remove expired online apps

Trello ticket
If an online-application is completed but the number is not passed to staff within three months the application should be deleted.  The threshold is set to 4 months here to allow some time for delays in processing by the  court.

There were the following issues with your Pull Request

Commit: 29ee32608454d2980ebafae7422743da4c87e53f
Your commit message body contains a line that is longer than 72 characters

Guidelines are available at https://github.com/ministryofjustice/fr-staffapp

This message was auto-generated by https://gitcop.com

There were the following issues with your Pull Request

Commit: 29ee32608454d2980ebafae7422743da4c87e53f
Your commit message body contains a line that is longer than 72 characters

Guidelines are available at https://github.com/ministryofjustice/fr-staffapp

This message was auto-generated by https://gitcop.com

There were the following issues with your Pull Request

Commit: 29ee32608454d2980ebafae7422743da4c87e53f
Your commit message body contains a line that is longer than 72 characters

Guidelines are available at https://github.com/ministryofjustice/fr-staffapp

This message was auto-generated by https://gitcop.com

There were the following issues with your Pull Request

Commit: 29ee32608454d2980ebafae7422743da4c87e53f
Your commit message body contains a line that is longer than 72 characters

Guidelines are available at https://github.com/ministryofjustice/fr-staffapp

This message was auto-generated by https://gitcop.com

From a platforms perspective, I have usually opted with having a rake task and using  https://github.com/ministryofjustice/cron-formula in the deploy repo because this approach lets you control things like "do i run this on every instance or just on one instance" , as well as logging into a separate file which can then be shipped, as well as not running multiple "services" within the container, and finally you have also 1 centralised place for jobs etc.
From our discussion you said this is not mission critical so even if it falls off our radar for a few days it's still fine, so in this case I 'd say the use of whenever is fine. 👍

LGTM 👍

This is on hold until a Business decision on what the retention period needs to be. (Refer to the HwF Product Manager).

Stale PR


[UI] EKS - Seeing "(not allowed by template)" in EKS k8s version dropdown

Version: master-head (v2.3) (8/15/19)
What kind of request is this (question/bug/enhancement/feature request):
Bug
Steps to reproduce (least amount of steps as possible):

On any rancher install (fresh or not) try to create an EKS cluster. Click on the K8s Version dropdown.

Result:
For some reason the unsupported k8s versions say "(not allowed by template)" on them. EKS /g/clusters/add/launch/amazoneks page should have nothing to do with templates.
Perhaps what is mentioned here is helpful: https://github.com/rancher/rancher/issues/22149#issuecomment-521476099

This is how I see the k8s dropdown now in Amazon EKS comparing master-head (v2.3) (08/22/2019) and v2.2.8.
v2.3 (08/22/2019):

v2.2.8:

Not Allowed is not showing anymore, but I would need to double check the supported versions for 2.3 before closing this issue. @davidnuzik

I'm closing as the original reported issue is resolved now (see previous comment).
I'll follow up in a separate issue for the supported/unsupported versions if needed.


Transcribing mt3 step error

When running the transcribing step on a .wav file (subwoofer lullaby from minecraft volume alpha if that helps) I'm now getting an error stating "ImportError: fluidsynth() was called but pyfluidsynth is not installed."

Nevermind, I don't know what happened but the issue seems to have fixed itself, unless someone changed something, in which case thanks!


gjson Example Function

Codecov Report

Merging #1610 (42bccb4) into master (7812f41) will increase coverage by 0.05%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #1610      +/-   ##
==========================================
+ Coverage   70.56%   70.62%   +0.05%
==========================================
  Files         443      443
  Lines       42232    42232
==========================================
+ Hits        29802    29827      +25
+ Misses      10514    10476      -38
- Partials     1916     1929      +13

Flag
Coverage Δ

go-1.15
70.62% <ø> (+0.09%)
:arrow_up:

go-1.16
?

go-1.17
?

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

os/gspath/gspath_cache.go
75.43% <0.00%> (-19.30%)
:arrow_down:

net/gtcp/gtcp_pool.go
28.40% <0.00%> (-10.23%)
:arrow_down:

os/gmutex/gmutex.go
94.73% <0.00%> (-2.64%)
:arrow_down:

net/gtcp/gtcp_conn.go
29.64% <0.00%> (-2.02%)
:arrow_down:

container/gtree/gtree_avltree.go
97.21% <0.00%> (-0.60%)
:arrow_down:

os/glog/glog_logger_rotate.go
65.85% <0.00%> (ø)

encoding/gjson/gjson_api.go
83.18% <0.00%> (+7.07%)
:arrow_up:

encoding/gjson/gjson_api_new_load.go
69.19% <0.00%> (+9.47%)
:arrow_up:

encoding/gjson/gjson_implements.go
100.00% <0.00%> (+10.52%)
:arrow_up:

encoding/gjson/gjson_api_encoding.go
77.08% <0.00%> (+14.58%)
:arrow_up:

... and 1 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7812f41...42bccb4. Read the comment docs.


Float8 autoquant weight only

Added weight-only float8 quantization technique to autoquant. It runs the default kernel where dequantize is performed on float8 weight tensor followed by linear.
Test plan:

some additional things you should add:

this option should probably detect the type of gpu you're using and only add float8 if its relevant
make sure if you run it on H100 for Llama that when the op in question is chosen, it actually speeds things up
add to CI like you mention, you can see the tests in the PR:
https://github.com/pytorch/ao/pull/804/files

As discussed offline. I've added the autoquant in a separate list and architecture check. New kernels need to be added in future to improve the time. The current time is equivalent with int8.


[Docs] Schema-based Reference Generation

We should implement schema-based API reference generation.
Will add more info as I research more.
Examples:

Spectaql
Docusaurus Plugin
Anvil

I investigated the following options:

https://www.npmjs.com/package/docusaurus-graphql-plugin
https://www.npmjs.com/package/@edno/docusaurus2-graphql-doc-generator
https://www.npmjs.com/package/spectaql

All 3 tools had difficulty generating API docs from our GQL schema files, due to numerous linter errors (see #3136). However as they all support introspection, I was able to auto-generate API docs from the cloak dev server itself.
See examples of the auto-generated API output at https://vikram-dagger.github.io/.
Summary of results:

The first two tools generate markdown and a sidebar, so can be immediately integrated with Docusaurus. SpectaQL generates HTML, so can be integrated only as a separate set of static pages. This also means it does not automatically inherit the current doc site's CSS, it needs to be manually set up to match the existing doc site's layout and CSS. Alternatively, we would need to run a second process to convert the HTML to markdown, after which the files can be treated like other Docusaurus content.
The first tool produces output in a hardcoded output directory, so the files need to be manually moved to the correct location. The other two tools don't have this issue.
SpectaQL docs, by virtue of being separate HTML pages, always open in a new tab as this is the Docusaurus default behaviour.
All three tools generate unified reference docs ie. core and extension APIs are merged in the output docs. This is because they use the GraphQL introspection API. If we wish to show our core and extension APIs separately in the navigation tree (which IMO is preferable), we would need to instead use the schema files as source, writing a script that runs the docs generator once for each schema and then move each set of generated files to the correct location in the Docusaurus filesystem.

Recommendation:
Simply because it seems to require the least work to connect with the existing Docusaurus site and the output seems reasonable, I suggest using the second option https://www.npmjs.com/package/@edno/docusaurus2-graphql-doc-generator. However, before deciding, I recommend looking at the navigation structure, layout and content of the generated API docs for all three examples to see if one of them is significantly better than the others.
Next steps:

Decide which generator to use
Decide on merged or separate core/extension API docs
Fix linter errors in GraphQL schema files

Thanks for taking care of this @vikram-dagger, both for the work and the summary of each alternative. :pray:
I really did not have enough time to dig into this, but I agree the second option is the best one based on your insights.

First cut of auto-generated docs included in https://github.com/dagger/dagger/pull/3160

Nice work! 🎉
The "queries" are not really useful it seems:

I'm not very sure how to correct this since the output is based on the schema obtained from introspection - for auto-generated docs, we would probably need to find a way to represent this in the schema itself so it gets reflected in the output docs. Maybe add an example in the schema? Separately, I have checked and it's possible to exclude some sections (eg. queries) from being generated.

I think comments are used to generate text for GraphiQL docs, but not sure if they are the most suitable solution in this case.

@vikram-dagger can I close this since we are using #3668 to make a decision?

I think we should leave it open as this may come up again for the GraphQL launch

Reviving this one, currently working on it.

I'm not very sure how to correct this since the output is based on the schema obtained from introspection - for auto-generated docs, we would probably need to find a way to represent this in the schema itself so it gets reflected in the output docs. Maybe add an example in the schema? Separately, I have checked and it's possible to exclude some sections (eg. queries) from being generated.

In case this is still an issue: I communicated with the author of this extension and he provided a solution to filter out unwanted sections.

The upside of using the Docusaurus plugins is that we get the same style and site for both the API and the SDK docs. However, both plugins are short on content quality, as they only reproduce the schema in markdown files.
spectaql on the other hand, doesn't have Docusaurus as a limitation (it's not forced to output .md files). This makes spectaql a better choice for content quality, but at the same time it breaks with having the API docs and SDK docs in the same docs site.
From a user standpoint, rich and ready-to-use content is more valuable than CSS styling and one docs site to tackle all documentation, so my thinking is: let's dig more into spectaql which allows more fine-grained customization on the output and then we'll see how to best integrate it into docs.dagger.io. I think that, for now, having a title with the same hierarchy as the rest of the SDKs in the docs and making it a link to api.docs.dagger.io, is the best choice.
This is still open for discussion though. Will come back with updates on the different possibilities around spectaql.

spectaqlar (cuack :duck:) analysis Juli. Looking forward to this :open_hands:

@crjm can you provide a summary here, so @shykes knows what to review/approve? I want to make sure that we don't get stuck on last minute feedback.

In summary, we have an API reference generated from the schema files that live in core/schema using spectaql instead of Docusaurus. This reference has examples for each query and, possibly, a link to an execution of that query in the Playground.
This is the reference in it's current state
The main reason we didn't choose Docusaurus is basically time. The Docusaurus plugins that generate schema-based documentation did not allow enough customization (cannot provide examples, etc), while spectaql did.
However, there's a better approach, but more time-consuming: a custom Docusaurus plugin (injects data into Docusaurus). This way the API reference would live inside the Docusaurus SPA and share styles with the documentation. If the GraphQL release date gets pushed, I might have enough time to make it. It's a question of tradeoffs.


Throttler not working normally after upgrade from 5.4.2 to 6.2.2

after upgrading the gem to latest, started seeing unexpected behaviour on throttlers, rolling back to 5.4.2 fixes the issue but that version is far behind. Could not find time to look deep on where it happens. Redis is used locally and production.
at 5.4.2 the gem throttles properly, example send 200 req/s and set limit at 1 req/s, only one req/s gets allowed, same test on 6.x.x allows sometimes 3 req/s. Setting the limit to 50 req/s, and sending 500 req/s on > 6  releases, allows sometimes 120 req/s which can bring bad expectations.

Hi @Altareq ,
Thank you for reporting.
In order to help troubleshoot, can you please let us know...

Are you using rack-attack within a Rails application?
Which Rails version are you using?
What is Rails config.cache_store =  set to on production?
Which redis gem version are you using?
Are you explicitly setting Rack::Attack.cache.store =  in your config?
Was the rack-attack update part of a larger update, including more gems? In particular rails or redis gem?

Thanks in advance.

Hello @grzuy ,

Yes it is a Rails application.
Rails version <IP_ADDRESS>.
redis_store Redis running local as a single master instance, Redis is running in cluster mode in production with a master and several replicas, cluster managed by sentinels.  (problem happens in both environments).
redis gem version 4.1.3.
No Rack::Attack.cache.store is not set manually.
Yes it was an update with few other gems, including rails to <IP_ADDRESS> redis to 4.1.3 redis-store to 1.8.1.

After several hours looking into why throttling stopped working properly, we did not find anything suspicious, so we locked the rack-attack gem back at 5.4.2 and throttling worked again without problems. All other gems were not changed.
Let us see if you can reproduce, otherwise let me know if you need any other details.
Thanks for your help.

Hi @Altareq,
Would it be possible for you to test with incrementing rack-attack version to v6.0 and then to v6.1? So that we can narrow down the problem to a more specific version?
Thanks in advance!

Closing for lack of information to further triage the problem.
@Altareq Happy to re-open if we get more information.
Thanks for reporting.

@Altareq Did you find the issue or you are still using 5.4.2?


Scatter plot dashboard cell doesn't render

Steps to reproduce:
List the minimal actions needed to reproduce the behavior.

Create a dashboard cell with the Flux code below, type = graph
Close configuration view
Mouse over the dashboard cell; no issues.
Open the configuration view
Change type to scatter
Close configuration view
Mouse over the dashboard cell; you get message An InfluxDB error has occurred.

Here's the flux code behind that dashboard cell; it's taking data from the http telegraf plugin, hitting public aws endpoints. I'm wondering if the fact that I'm removing _value is an issue.
from(bucket: "initial")
  // Although we just want the last measurement,
  // collect the last 60 minutes of to ensure we have something to report.
  |> range(start: -60m)
  |> filter(fn: (r) => r._measurement == "http_response")
  |> filter(fn: (r) => r.company == "Amazon")
  |> filter(fn: (r) => r.service == "AWS")
  |> filter(fn: (r) => r._field == "result_code")
  // You need to put these filters later for some reason.
  |> filter(fn: (r) => r.subservice == "DynamoDB")
  |> filter(fn: (r) => r.region == "us-east-2")
  |> group()
  |> sort(columns: ["_time"], desc: true)
  // If the result field is success, then return "Up", else "Down".
  |> map(fn: (r) => ({
  // Create a new column called Availability.
    r with Availability:
      if (r.result != "success" or int(v: r.status_code) >= 500) then (0)
      else (1)
    }))
   // Drop all columns except Availability and _time.
   // If we don't keep _time, we can get the message that "not latest value found".
   // If we don't drop _value, we'll display the result code (a number).
   |> keep(columns: ["Availability", "_time"])

Expected behavior:
You should be able to mouse over a scatter cell in a dashboard and not have issues.
Actual behavior:
The dashboard cell displays an error when you mouse over it.

Here's a video showing of happens:
https://www.dropbox.com/s/n7gkidfvuj3tpg3/InfluxDB 2 bug - dashboard cells error out 2020-02-24 at 9.16.24 AM.mov?dl=0
Environment info:

System info: Run uname -srm and copy the output here
InfluxDB version: Run influxd version and copy the output here
Other relevant environment details: Container runtime, disk info, etc

uname -srm
Darwin 19.3.0 x86_64
influxd version
InfluxDB 2.0.0-beta.4 (git: 3e054aaca) build_date: 2020-02-24T18:12:53Z
Config:
Copy any non-default config values here or attach the full config as a gist or file.

Logs:
Include snippet of errors in log.
Performance:
Generate profiles with the following commands for bugs related to performance, locking, out of memory (OOM), etc.
# Commands should be run when the bug is actively happening.
# Note: This command will run for at least 30 seconds.
curl -o profiles.tar.gz "http://localhost:8086/debug/pprof/all?cpu=true"
curl -o vars.txt "http://localhost:8086/debug/vars"
iostat -xd 1 30 > iostat.txt
# Attach the `profiles.tar.gz`, `vars.txt`, and `iostat.txt` output files.

I have something similar.  When I touch the cells in this scatter plot, I get the error that something is wrong.  Mine can be found in tools, under "Log File Studies V1.x" and I am trying to show the four services as scatter plots over time.

This seems to be a prod issue that was introduced in the following PR:
https://github.com/influxdata/giraffe/commit/f8920cf9097a9eb21097dd72fd6a178afd0bbe1e
I still haven't managed to narrow it down, but it might have something to do with the Tooltip additions since the ScatterHoverLayer component makes use of it. More specifically, it looks like the issue is that the ScatterHoverLayer doesn't have the lineData property that is required for getting the correct sort order:
https://github.com/influxdata/giraffe/commit/f8920cf9097a9eb21097dd72fd6a178afd0bbe1e#diff-91b5987f198cda42b904bbfe44f6dc9fR31
A potential solution would be to refactor the implementation to consider undefined parameters

I'm having this identical issue with InfluxDB 2.0 Cloud.