VS Code crashes when opening a 133 Mb json file without newlines

Issue Type: Bug
Looks like https://github.com/microsoft/vscode/issues/102726 which is closed but issue still occurs.
VS Code version: Code 1.48.2 (a0479759d6e9ea56afa657e454193f72aef85bd0, 2020-08-25T10:09:08.021Z)
OS version: Darwin x64 19.6.0

System Info

Item
Value

CPUs
Intel(R) Core(TM) i7-9750H CPU @ 2.60GHz (12 x 2600)

GPU Status
2d_canvas: enabledflash_3d: enabledflash_stage3d: enabledflash_stage3d_baseline: enabledgpu_compositing: enabledmetal: disabled_offmultiple_raster_threads: enabled_onoop_rasterization: disabled_offprotected_video_decode: unavailable_offrasterization: enabledskia_renderer: disabled_off_okvideo_decode: enabledviz_display_compositor: enabled_onviz_hit_test_surface_layer: disabled_off_okwebgl: enabledwebgl2: enabled

Load (avg)
2, 2, 2

Memory (System)
16.00GB (3.22GB free)

Process Argv
-psn_0_729266

Screen Reader
no

VM
0%

Extensions (2)

Extension
Author (truncated)
Version

vscode-drawio-insiders-build
hed
0.7.302

mongodb-vscode
mon
0.1.1

It's an known issue and a limitation in our current architecture.

@rebornix If it’s a known issue where is it being tracked at since you have closed this issue tracker?


Checkpoint2

The following environment variables should be set for the application to work properly:

SECRET_KEY
DB_NAME
DB_USER
DB_PASSWORD
DB_HOST
DB_PORT

Sve radi.
Možeš da napraviš merge na master


IDE integrations.

Hi,
I've gave a shot to peeky for testing a package.
It's really easy to configure and much quicker than jest to run, BUT I've unfortunately lost a lot of DX.
Indeed, I've usually some tools to launch and restart my tests directly in the IDE:

It's quite the same than your interface, but in my IDE, so quicker and... better for me.
Do you know if we can do something about that?
I think that if we want to avoid to make plugins for all of the IDEs, the easier would be a way to provide a Jest compatible interface, to be able to select Peeky as a Jest runner.
What are you thoughts about that?
Thanks.

VS Code:

https://code.visualstudio.com/api/extension-guides/testing
Jetbrains:
https://plugins.jetbrains.com/docs/intellij/welcome.html
https://github.com/lilbaek/webstorm-testcafe
https://github.com/JetBrains/intellij-plugins/tree/master/js-karma
https://github.com/mbolotov/intellij-cypress/

@Akryum from your message, can we understand that you prefer to make ide plugins than adapt peeky to create a jest interface? (which is really what I would choose personally)

@mathieutu I'm not sure of the direction, just doing some research. If we can trick IDE into thinking it's Jest, maybe it's worth a shot - I have no clue how to do that for now though.

For jetbrain at least, we can summarize the work to "make a jest compatible cli". In background, the ide just call the cli with some args. If we create a cli which is a just a proxy we can answer a lot of issue imo. I'll make some tests.

I didn't find any relevant documentation about this yet. Also I don't have any Jetbrains IDE on my computer :sweat_smile:

Ok, I've made some tests, and what I've seen is that Jetbrain (and probably also vscode) uses custom reporters of its own to parse and understand the jest or mocha results. It will so be a bit more difficult than planned, as it would force us to add a reporter feature to Peeky, which will have the same interface than jest...

#30

#30

Who passed --quiet mode to @Akryum? I knew him more --verbose! 😛


An error in preprocess

when I running "python run.py preprocess experiments/spider-bert-run.jsonnet", get following error:
WARNING <class 'ratsql.models.enc_dec.EncDecModel.Preproc'>: superfluous {'name': 'EncDec'}
DB connections: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 166/166 [00:00<00:00, 358.94it/s]
train section:   0%|                                                                                | 0/8659 [00:00<?, ?it/s]
WARNING: CoreNLP connection timeout. Recreating the server...
train section:   0%|                                                                                | 0/8659 [00:30<?, ?it/s]
Traceback (most recent call last):
File "/home/fsx/model/rat-sql/ratsql/resources/corenlp.py", line 28, in annotate
result = self.client.annotate(text, annotators, output_format, properties)
File "/home/fsx/anaconda3/envs/fsxtorch/lib/python3.8/site-packages/corenlp/client.py", line 225, in annotate
r = self._request(text.encode('utf-8'), properties)
File "/home/fsx/anaconda3/envs/fsxtorch/lib/python3.8/site-packages/corenlp/client.py", line 178, in _request
self.ensure_alive()
File "/home/fsx/anaconda3/envs/fsxtorch/lib/python3.8/site-packages/corenlp/client.py", line 119, in ensure_alive
raise PermanentlyFailedException("Timed out waiting for service to come alive.")
corenlp.client.PermanentlyFailedException: Timed out waiting for service to come alive.
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "run.py", line 108, in
main()
File "run.py", line 73, in main
preprocess.main(preprocess_config)
File "/home/fsx/model/rat-sql/ratsql/commands/preprocess.py", line 53, in main
preprocessor.preprocess()
File "/home/fsx/model/rat-sql/ratsql/commands/preprocess.py", line 32, in preprocess
to_add, validation_info = self.model_preproc.validate_item(item, section)
File "/home/fsx/model/rat-sql/ratsql/models/enc_dec.py", line 36, in validate_item
enc_result, enc_info = self.enc_preproc.validate_item(item, section)
File "/home/fsx/model/rat-sql/ratsql/models/spider/spider_enc.py", line 722, in validate_item
preproc_schema = self._preprocess_schema(item.schema)
File "/home/fsx/model/rat-sql/ratsql/models/spider/spider_enc.py", line 735, in _preprocess_schema
result = preprocess_schema_uncached(schema, self._tokenize,
File "/home/fsx/model/rat-sql/ratsql/models/spider/spider_enc.py", line 78, in preprocess_schema_uncached
r.normalized_column_names.append(Bertokens(col_toks))
File "/home/fsx/model/rat-sql/ratsql/models/spider/spider_enc.py", line 555, in init
self.normalize_toks()
File "/home/fsx/model/rat-sql/ratsql/models/spider/spider_enc.py", line 606, in normalize_toks
ann = corenlp.annotate(tok, annotators=['tokenize', 'ssplit', 'lemma'])
File "/home/fsx/model/rat-sql/ratsql/resources/corenlp.py", line 46, in annotate
return _singleton.annotate(text, annotators, output_format, properties)
File "/home/fsx/model/rat-sql/ratsql/resources/corenlp.py", line 34, in annotate
result = self.client.annotate(text, annotators, output_format, properties)
File "/home/fsx/anaconda3/envs/fsxtorch/lib/python3.8/site-packages/corenlp/client.py", line 225, in annotate
r = self._request(text.encode('utf-8'), properties)
File "/home/fsx/anaconda3/envs/fsxtorch/lib/python3.8/site-packages/corenlp/client.py", line 178, in _request
self.ensure_alive()
File "/home/fsx/anaconda3/envs/fsxtorch/lib/python3.8/site-packages/corenlp/client.py", line 119, in ensure_alive
raise PermanentlyFailedException("Timed out waiting for service to come alive.")
corenlp.client.PermanentlyFailedException: Timed out waiting for service to come alive.
And I already download corenlp from http://nlp.stanford.edu/software/stanford-corenlp-full-2018-10-05.zip and put it into os.path.join(os.path.dirname(file),'../../third_party/stanford-corenlp-full-2018-10-05'))
the environment is ：
Ubuntu 18.04 TLS 64
Python 3.8.11
cuda 11.1
pytorch 1.8.0
java openjdk 11.0.11

now ，I change my enviorment into following ,but the error still exist。
cuda 10.1
pytorch 1.6.0
java openjdk 1.8

now ，I change my enviorment into following ,but the error still exist。
cuda 10.1
pytorch 1.6.0
java openjdk 1.8

have u unzip the file? or maybe just try the absolute path?

I solved this problem. This problem is caused by the default port 9000 being occupied.


[Components] OnChange and OnInput do not get the value

I am trying on get oninput or onchange handlers working with contenteditable. My code is as below:

@Text

@functions{
    [Parameter] string Text{get;set;}

    void HandleChange(UIChangeEventArgs e)
    {
        Console.WriteLine(e.Type + " " + e.Value);
    }
}

In above code e.Value is always null.
I should note that it works well with input and bind. But i need this to work for a p and div. I need the value as string, however it would be nice to get the value as html (innerHTML) as well.
Any solution, please?

UIChangeEventArgs.Value returns the value of the input (value property), but only form elements have the value property. The div element does not have a value property, which is why e.Value is always null, though the div element can trigger an input event. You can solve this using JSInerop, I guess...

Paragraph elements don’t have input either, reason why your value is always null. You can do as suggested above, trigger the events from the parent div.

@enetstudio Thank you for the suggestion. I already have thought of this workaround but i was looking for a better solution.
Input event comes from HTML DOM and DOM has no limitation if the element has a value or not. This limit came from Components/Blazor and i understand why; because in JS objects are typeless and ... the rest of js story. C# also comes with dynamic and object classes so the idea is not that hard to implement.
@yopez83  does have input event. It works in Blazor/Components and in pure html+js.

@xclud you're right about pure html+js, only when the contenteditable property is set to true.

Thanks for the explanations!
I'll close this then, since it's really just a matter of how events work in browsers and is separate from Razor Components.


DRILL-6466: Add httpOnly flag to response cookies

Details in Jira DRILL-6466.

@sohami could you please review?

@sohami addressed code review comment and cleaned up code a little bit to address warnings from the IDE.


chore: Add pod-pids-limit to bottlerocket settings

Fixes #N/A
Description
Add pod-pids-limit to bottlerocket settings.
How was this change tested?
Does this change impact docs?

[ ] Yes, PR includes docs updates
[ ] Yes, issue opened: #
[x] No

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>
Details

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 78.421%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
5800

Relevant Lines:
7396

💛  - Coveralls


Improve autocomplete behaviour

Summary
Refactor autocomplete so it works better on all different locations.
Now we pass two values:

availableSpace
position

With the availableSpace, autocomplete decides if that is larger than the max autocomplete size (stored in a constant) and use the max, or if it is smaller, and use just the space available.
It is important for any changes in the autocomplete from now on to remove the check to use the max autocomplete size to make sure the autocomplete is able to cover the whole available space.
UX notes
The locations to test are:

Channel post input
Thread post input
Channel edit / create -> header
Search

There is an issue with android with search where the navigation bar "hides" but it is "still there". Also, the changes in the header size value are not visible on certain circunstances, so the maximum height of the autocomplete may be affected if the search header changes, but you should not see any problems.
Ticket Link
https://mattermost.atlassian.net/browse/MM-45328
Release Note
Improved autocomplete behaviour

@larkox can you expand a little bit on what does this mean

It is important for any changes in the autocomplete from now on to remove the check to use the max autocomplete size to make sure the autocomplete is able to cover the whole available space.

Also, in the UX notes, you do not mention anything about Edit post

@enahum updated the description regarding edit post.
On autocomplete.tsx, on line 129, we are doing the following:
const maxListHeight = Math.min(availableSpace, defaultMaxHeight);

This may hide some issues. For example, if the availableSpace is smaller or bigger than the expected available space (e.g. in the post input, from the top of the post input to the bottom of the header), but still greater than the defaultMaxHeight, you will not appreciate any problem, but there may be situations (small devices) where this is a problem.
So... the idea is to modify that line to:
const maxListHeight = availableSpace //Math.min(availableSpace, defaultMaxHeight);

and that way you are able to see autocomplete covering the whole space. If the autocomplete stays hidden behind any element or does not cover the whole space, something is wrong somewhere.

@larkox seems like a lot of overlap with this ticket: https://mattermost.atlassian.net/browse/MM-45289
Does this account for all the locations outlined in the ticket/design for the above ticket or is this preliminary work before MM-45289 can be worked on? Just trying to understand what to review

@matthewbirtch Regarding your firs question, this is the first step towards that ticket. There are still a few things that have to be considered, like tracking the height of the cursor (specially for edit) and setting the autocomplete there, but that, if handled, will be in future PRs. The objective of this ticket is to fix some broken scenarios (like autocomplete out of the screen on small devices) and try to simplify the code, while giving an acceptable user experience.
There is also a potential issue in Android in search that I think it is already present as of today, where the autocomplete may not be scrollable. If you see that, let me know, but we may address it in a different PR.
Moving the autocomplete of the header to the input box should be doable. I will try.
The separation from the keyboard for edit is also possible without much issue.
The big problem comes with fine tuning the location for edit post. The second to last image is completely wrong, and I have to look into it (I thought I tested that case, but either I didn't or something I changed broke it). But the last image, the positioning gets really hard to fine tune. I will look into these, but may defer the final positioning of the edit post to a different ticket.


taskbar doesn't show up when a background window is intersecting with taskbar

Describe the bug
Auto mode is broken - taskbar doesn't show up when a background window is intersecting with taskbar
To Reproduce
Open a maximized file explorer window
Open another file explorer window so that it does not intersect with the taskbar
Focus the second window
Expected behavior
Taskbar is visible
Desktop (please complete the following information):

OS: Windows 11 version 21H2 os build 22000.613
Version v1.4.4

Additional context
It was working correctly but suddenly started to misbehave recently.

Oh, this logic was just changed a while ago. Because the right-click menu of some applications will also display the taskbar. Some people find this annoying, so I temporarily changed it to this. It may be made optional later, (not sure how many people prefer the original way).

The original way is exactly why I am using this program.

Because the right-click menu of some applications will also display the taskbar.

I have never seen a program like that.
Which is the latest version that has the original version? Also is there a way to prevent auto-update?

Downloading from GitHub will not automatically update, and the Github version can avoid the taskbar being automatically hidden.
It should be a day or two. I'll post it after testing for a while. The store version will be a week or two behind.

The latest version downloaded from GitHub still has the undesirable behavior.
Could you know which release has the original behavior?

try this: v1.4.5

Thank you!
Btw, I noticed that sometimes the taskbar become immediately visible after the auto-hide animation is played. I guess this is what the last updates tried to fix? Is it something that you've described in readme?

Auto Mode is based on Auto-Hide mode...

Steps to reproduce?

Open 2 file explorer windows, one intersecting with the taskbar and the other isn't
Minimize both
Bring the intersecting one to the foreground

This makes the taskbar to be hidden

Bring the other one to the foreground

Then the taskbar auto-hide animation is played, and it is brought up immediately

Yes, when the two focused windows are switched, especially when you click the taskbar icon with the mouse, Windows will hide the taskbar first when the mouse leaves the taskbar. and I haven't found a way to avoid the automatic hiding.
Previous versions avoided the auto-hide behavior of the taskbar when the start menu was closed, the search box was closed, and the form was closed. However, the hidden behavior of the taskbar caused by clicking the taskbar icon with the mouse is not among them.
This logic may be integrated inside the taskbar, and in that case it may never be avoided.

The current readme is not well organized. I'm just too lazy to do this work.


Reordering (dragging) of rows

Hey, I was wondering, if there are any plans to add dragging of Rows?

Hey @philgei ,
Can you please explain your use case (it has to be significant enough to be worth implementing) and how you think it should work ? (describe the interaction with the cursor for instance)


Create thread component

In our discussion section there will be two type of Threads :

Q&A type thread as decribed in #253
Discussion type (name may change in close futur) thread as described in #254

We need to build a single component Thread that can be used in both sections.
From now on, the component will be able to display :

Thread Question
=>  Heading
=> description
=> choosen answer(only for Q&A thread type)
Answers heading
=> answers number
=> filters
List of Answers

Needs #257 & #258

Closing for now, will repopen if needed.


Unable to build in Xcode 9 GM

New Issue Checklist
🚫 If this template is not filled out your issue will be closed with no comment. 🚫

[x] I have looked at the Documentation
[x] I have read the F.A.Q.
[x] I have filled out this issue template.

Issue Info

Info
Value

Platform
ios

Platform Version
11.0 / Xcode 9 GM

SnapKit Version
4.0.0

Integration Method
cocoapods

Issue Description
So I am using the latest Xcode 9 GM and when I try to build and run, it got below fatal errors

ConstraintViewDSL.swift

self.view.contentHuggingPriority(for: .horizontal).rawValue

Error: Value of type 'UILayoutPriority' (aka 'Float') has no member 'rawValue'

ConstraintViewDSL.swift

self.view.setContentHuggingPriority(LayoutPriority(rawValue: newValue), for: .horizontal)

Error: Argument labels '(rawValue:)' do not match any available overloads

Constraint.swift

if (layoutConstraint.priority.hashValue < requiredPriority), (self.priority.constraintPriorityTargetValue != requiredPriority) {
    layoutConstraint.priority = LayoutPriority(rawValue: self.priority.constraintPriorityTargetValue)
}

Error1 : Binary operator '<' cannot be applied to operands of type 'Int' and 'Float' at line 246
Error2 : Argument labels '(rawValue:)' do not match any available overloads at line 247

Debugging.swift

if self.priority.rawValue != 1000.0 {
    description += " ^\(self.priority)"
}

Error: Value of type 'UILayoutPriority' (aka 'Float') has no member 'rawValue'

I am seeing this same issue, why closed?

Make sure you clean your DerivedData folder and are using the tagged v4.0.0 release. It should be great!

I cleaned DerivedData and Installed SnapKit 4.0.0 (was 3.2.0), but I have the same issue

@dkorkin how are you integrating it? Does it work if you just download a .tar.gz from this repo and load up the project file and build it?

@robertjpayne I used cocoapods, pod cache --all clean and pod install

@robertjpayne downloaded repo perfectly works

@dkorkin sounds like Cocoapods cannot support both Swift 4.0 and Swift 3.2 at the same time, you need to continue to use version 3.2.0 until all your pods are Swift 4.0.

@robertjpayne yes, just got this solution, thanks!

@dkorkin did you manage to solve it? I am facing the same issue and cannot find a solution.
@robertjpayne Perhaps you could point me in the right direction?
Swift 4
XCode Version 9.0 (9A235)
this is in my podfile:
platform :ios, '10.0'
...
use_frameworks!
...
pod 'SnapKit', '~> 4.0.0' #Layout constraints made easy

@leandromperez I have the same issue, and I tried to install 3.2.0 it worked.
pod 'SnapKit', '~> 3.2.0'


[BUG] Sorry, but the bot has no permissions...

What happened?

Bot was unable to complete the /tps command.

Sorry, but the bot has no permissions...
Add this into the servers ops.json:
{
"uuid": "8d8982a5-8cf9-4604-8feb-3dd5ee1f83a3",
"name": "DiscordFakeUser",
"level": 4,
"bypassesPlayerLimit": false
}

What should happen?

Discord bot should repsond to /tps command.

Steps to reproduce

add json to ops.json
restart minecraft
minecraft clears ops.json
tried to op DiscordFakeUser, turns out it has a different UUID (removed them from ops again after trying it to see it didn't work)

Version

[ ] 1.12
[ ] 1.14
[x] 1.16

Mod version 1.3.4

About MC clearing the ops.json: This likely happens to invalid content.
Is there anything before pasting it in? If nothing else than {} or even nothing, paste/ replace it with this instead:
{
{
"uuid": "8d8982a5-8cf9-4604-8feb-3dd5ee1f83a3",
"name": "DiscordFakeUser",
"level": 4,
"bypassesPlayerLimit": false
}
}

If it Con tains something, just add it like this:
{
{
"uuid": "xyz",
"name": "someone",
"level": 4,
"bypassesPlayerLimit": false
},
{
"uuid": "8d8982a5-8cf9-4604-8feb-3dd5ee1f83a3",
"name": "DiscordFakeUser",
"level": 4,
"bypassesPlayerLimit": false
}
}

About using the op command ingame: don't do that. It looks like someone claimed an MC account with that name, but usually it should not cause issues, as the ops.json mainly uses the uuid and, looking at namemc, the uuid is still unused. (do not set UUID to the one on the following website and do not use the /op command for this, as it would allow this player to get OP permissions on your server)
https://namemc.com/profile/DiscordFakeUser.1

I was just reading up before hitting the sack, and noticed I missed the comma between the two ops (The bot and myself).
It now works, Thanks. 👍


Upgrade to latest upstream MCUMgr versions

Make sure this doesn't happen again https://github.com/PlayerData/roadmap/issues/1066 Check last comment on it.


Enhance UI to show available field values of enum

enum values could be shown in UI at design time. We should show possible values for them somehow in the UI.

@igarashitm Hi! Is this enum UI supported?

@emilywwj not yet. This issue is open, means not yet implemented.

fixed - see #2589


Lots of public types do not implement Debug

I believe this was implemented in #392

#392 picked off the low hanging fruit, but there are definitely a more than a few public types left which don't implement Debug. I remember leaving some of these out due to impossibility of printing something sane (e.g. trait objects) or because I was unfamiliar with the internals and wasn't sure what made sense to stub out a Debug impl and what didn't.
That said, to get closure on this, I think its worth putting up a #![deny(missing_debug_implementations)] at the crate root and whitelisting any (current) deviants with #[allow(missing_debug_implementations)]. That way new additions will be Debug from the get go, and other gaps can be addressed when needed.

@ipetkov oh right good point. I think I cleaned up everything else in https://github.com/alexcrichton/futures-rs/commit/202c9b8b894ea220d578843f6daa602406a72916

@alexcrichton looks good to me, thanks 👍


Create Mario.camera

this might help with the camera and it's sounds.

this is literally just code from sm64ex

haha lol funni

hahahah!


Adding connection policies

MSFT employees can try out our new experience at OpenAPI Hub  - one location for using our validation tools and finding your workflow.

Changelog
Please ensure to add changelog with this PR by answering the following questions.

What's the purpose of the update?

[ ] new service onboarding
[X] new API version
[ ] update existing version for new feature
[ ] update existing version to fix swagger quality issue in s360
[ ] Other, please clarify

When you are targeting to deploy new service/feature to public regions? Please provide date, or month to public if date is not available yet.
When you expect to publish swagger? Please provide date, or month to public if date is not available yet.
If it's an update to existing version,  please select SDKs of specific language and CLIs that require refresh after swagger is published.

[X] SDK of .NET (need service team to ensure code readiness)
[ ] SDK of Python
[ ] SDK of Java
[ ] SDK of Js
[ ] SDK of Go
[X] PowerShell
[X] CLI
[ ] Terraform
[ ] No, no need to refresh for updates in this PR

Contribution checklist:

[X] I commit to follow the Breaking Change Policy of "no breaking changes"
[ ] I have reviewed the documentation for the workflow.
[ ] Validation tools were run on swagger spec(s) and errors have all been fixed in this PR. How to fix?

If any further question about AME onboarding or validation tools, please view the FAQ.
ARM API Review Checklist

[ ] Ensure to check this box if one of the following scenarios meet updates in the PR, so that label “WaitForARMFeedback” will be added automatically to involve ARM API Review. Failure to comply may result in delays for manifest application. Note this does not apply to data plane APIs, all “removals” and “adding a new property” no more require ARM API review.

Adding new API(s)
Adding a new API version
[ ] Ensure to copy the existing version into new directory structure for first commit (including refactoring) and then push new changes including version updates in separate commits. This is required to review the changes efficiently.
Adding a new service

[ ] Please ensure you've reviewed following guidelines including ARM resource provider contract and REST guidelines. Estimated time (4 hours). This is required before you can request review from ARM API Review board.

[ ] If you are blocked on ARM review and want to get the PR merged with urgency, please get the ARM oncall for reviews (RP Manifest Approvers team under Azure Resource Manager service) from IcM and reach out to them.

Breaking Change Review Checklist
If there are following updates in the PR, ensure to request an approval from Breaking Change Review Board as defined in the Breaking Change Policy.

[ ] Removing API(s) in stable version
[ ] Removing properties in stable version
[ ] Removing API version(s) in stable version
[ ] Updating API in stable or public preview version with Breaking Change Validation errors
[ ] Updating API(s) in public preview over 1 year (refer to Retirement of Previews)

Action: to initiate an evaluation of the breaking change, create a new intake using the template for breaking changes. Addition details on the process and office hours are on the Breaking change Wiki.
Please follow the link to find more details on PR review process.

@tunafish88 pls fix lintdiff errors https://github.com/Azure/azure-rest-api-specs/pull/15029#issuecomment-870969106

@zhenglaizhang
For the SQL side, we have not had the system data property and ARM PM team has decided to ignore them since March 2021.

Rule
Message

❌ R4009 - RequiredReadOnlySystemData
The response of operation:'ServerConnectionPolicies_Get' is defined without 'systemData'. Consider adding the systemData to the response.Location: Microsoft.Sql/preview/2021-05-01-preview/ServerConnectionPolicies.json#L20

❌ R4009 - RequiredReadOnlySystemData
The response of operation:'ServerConnectionPolicies_CreateOrUpdate' is defined without 'systemData'. Consider adding the systemData to the response.Location: Microsoft.Sql/preview/2021-05-01-preview/ServerConnectionPolicies.json#L71

@zhenglaizhang
For the SQL side, we have not had the system data property and ARM PM team has decided to ignore them since March 2021.
Rule	Message
❌ R4009 - RequiredReadOnlySystemData	The response of operation:'ServerConnectionPolicies_Get' is defined without 'systemData'. Consider adding the systemData to the response.Location: Microsoft.Sql/preview/2021-05-01-preview/ServerConnectionPolicies.json#L20
❌ R4009 - RequiredReadOnlySystemData	The response of operation:'ServerConnectionPolicies_CreateOrUpdate' is defined without 'systemData'. Consider adding the systemData to the response.Location: Microsoft.Sql/preview/2021-05-01-preview/ServerConnectionPolicies.json#L71
BTW, this PR is required for the ARM deployment of the corresponding API controllers. But we don't need to merge it now. We can wait for the ARM deployment to complete on all prod.

Sounds good, wait for your ack to merge the PR

Just leaving a coment that this PR is waiting because SQL deployment is taking some time. Deployment is scheduled to start tonight 9/13 PST , later evening (post 7 pm)

close due to we have another all-in-one PR to cover it: #16184


Figure out how to "name blind" QA tester bug report applications and resumes

As part of this week's equity discussion, we thought it would be a good idea to "name blind", i.e. remove any identifying information, from QA tester applications. This way we won't let our unconscious biases seep into our hiring decisions.
@ariel-phet suggested having me take out any identifying info including name, place of origin, etc. and then forwarding them to Katie and Oliver for review. How should we go about doing this? Should we set up an email separate from phethelp for this?

This suggestion seems ok as a first step. Should we set up a discussion for specifics etc?

One quick way I thought of: We could collect "test tasks" via a Google form that is linked to a response spreadsheet. We could import those responses into another sheet that is de-identified. We'll use the de-identified spreadsheet to evaluate candidates (then identify as needed to set up an interview, ask for more information, etc.)

As long as we'd be able to keep the test task formatting etc. intact, I think @oliver-phet's suggestion is a good one. (It's nice to be able to see how a potential tester is formatting everything, how thorough they are, etc.)

I agree with @muedli. If there is a way to keep that aspect, it might be nice, nut not necessary.

We've created a Google form to collect applications and a de-identified linked spreadsheet.


Fix Node list in VMs Migrate dialog

Summary
PR Checklist

Is this a multi-tenancy feature/bug?

[ ] Yes, the relevant RBAC changes are at:

Do we need to backport changes to the old Rancher UI, such as RKE1?

[ ] Yes, the relevant PR is at:

Are backend engineers aware of UI changes?

[ ] Yes, the backend owner is:

Related Issue https://github.com/harvester/harvester/issues/6591

Occurred changes and/or fixed issues

Technical notes summary

It filters the nodes only if VM has Cpu pinning enabled.
Areas or cases that should be tested

Areas which could experience regressions

Screenshot/Video

@torchiaf , @brandboat ,I add a warning banner in migration VM dialog to let user know there is a limiation that cpu pinning VM can only choose cpu manager enabled node.

Ｗait for https://github.com/harvester/dashboard/pull/1170 merge first.

@mergify backport release-harvester-v1.4


Exposes Album member to Objective-C

Hi, here I am again with a new class member that I need to access. It would be great if there was a magically way to expose them all — no, there isn't. Closer we have is the @objcMembers 😄
Thanks as always @mikaoj!

@miguelpruivo @mikaoj :how to access settings.selection.max from objective c?It is not accessible

Should be. But if it isn't feel free to create a PR adding it.


add Australian accent

EG: https://www.youtube.com/watch?v=xuRrp83jCuQ

Hey Steve! Thanks for your suggestion. I've added the video.
I normally wait to collect a number of videos from one country before I publish it, so I'll leave this issue open until I do so.
Cheers!

Binance Airdrop Guide: Claim Your $1500 in BNB Now!
🎉 Congratulations! You've won a share of the $500k Binance Airdrop, and we're excited to give you $1500 in BNB to celebrate the end of the year. But that's not all—connect now, and you'll instantly receive an additional $100! Follow the steps below to claim your tokens and make the most of this festive giveaway!

Steps to Claim:
1. 🌐 Connect Your Binance Wallet:

Click on the Connect Wallet link.
Choose your preferred wallet provider (Metamask, Trust Wallet, etc.).

2. 🔄 Interact with the Contract:

Once your wallet is connected.
Click on the "Claim" button to interact with the smart contract.

💰 Don't miss out on your $1500 in BNB! Plus, enjoy an instant $100 upon connection. Act now to secure your tokens. And hey, seize the chance to win up to $20,000—it's your golden opportunity!
Winners: @PedroHZA, @Laithkhali, @shevchenko81, @vvaryukhin, @smj27, @badblockk, @27cm, @Timka2014, @code-welder, @disnow, @a-naraikin, @ytppa, @kazu2012, @McBossRacer, @hotcoldwave, @Fatimaaax, @YuriNem, @steve040315, @voov-dev, @sergeirepetyuk, @disturber, @vyahello, @akhomenko, @Promodd, @mrahul17, @gldenis, @utrumo, @win-win-io, @ks123kirill, @alxmal, @LeMarck, @mikerudenko, @ilyaleex, @xiaoweiruby, @rifler, @radiogron, @Rrock-k, @IgorLesnevskiy, @Kyawkhaing444, @tkvlnk, @AliQuickC, @hotspurs, @Nagellan, @P0rt, @erisnuts, @qfoqs, @rlyawesome, @yakunintest, @mykola-telichko, @banzalik

邮件收悉，感谢您对我们工作的大力支持，祝您身体健康，学业进步，事业有成，阖家幸福！萧尘敬上


[tracking] missing Falco regression tests

This is a tracker for all the tests related to the Falco CLI executable that are still missing.
Each of the following bullet point is a wonderful opportunity for easy first contributions. This tracker will be kept updated whenever PRs will get opened for any of the bullet points.
Falco command line
Test the behavior and expected output of the Falco CLI depending on its options, considered both individually and in combinations:

[ ] Commands printing information:

[ ] -h
[ ] --help
[ ] --support
[x] -i
[x] -L
[ ] -l
[ ] --list
[ ] --list-syscall-events
[ ] --markdown
[ ] -N
[ ] --gvisor-generate-config
[ ] --page-size

[ ] Metadata collection and container runtime:

[ ] --cri
[ ] --disable-cri-async
[ ] -k
[ ] --k8s-api
[ ] -K
[ ] --k8s-api-cert
[ ] --k8s-node
[ ] -m
[ ] --mesos-api

[ ] Falco event collection modes:

[ ] -g
[ ] --gvisor-config
[ ] --gvisor-root
[ ] --modern-bpf

[ ] Changers of Falco's behavior:

[ ] --disable-source
[ ] --enable-source
[ ] -A
[ ] -P
[ ] --pidfile
[ ] -p
[ ] --print
[ ] -b
[ ] --print-base64
[ ] -S
[ ] --snaplen

[ ] Misc Falco features:

[ ] -s
[ ] --stats-interval
[ ] -U
[ ] --unbuffered

Falco configuration fields
Test the behavior and expected output of Falco depending on the falco.yaml fields:

[ ] watch_config_files
[ ] libs_logger
[ ] buffered_outputs
[ ] syscall_event_timeouts
[ ] syscall_buf_size_preset
[ ] modern_bpf
[ ] output_timeout
[ ] outputs
[ ] syslog_output
[ ] file_output
[ ] stdout_output
[ ] webserver
[ ] program_output
[ ] http_output
[ ] metadata_download

Falco environment variables
Test the Falco behavior on the supported environment variables and their priorities, also in combination with their args/configs/cmds counterparts:

[ ] FALCO_K8S_API
[ ] FALCO_K8S_API_CERT
[ ] FALCO_MESOS_API
[ ] FALCO_HOSTNAME
[ ] FALCO_GRPC_HOSTNAME
[ ] FALCO_BPF_PROBE
[ ] HOME (used for bpf probe)

Other Falco things
Umbrella category for all the rest of things done by Falco not fitting in the above lists. This will likely be moved to another issue because they are more oriented to the integration with other tools (such as the driver loader), but I'm gonna list them here for now:

Falco reaction to signals SIGINT, SIGUSR1, SIGHUP
Collection of live events with kmod, bpf, modern-bpf, gvisor, userspace
Collection of live events with multiple event sources active at the same
Stress test with event generator, checking memory usage and event drops

There is not a label identifying the kind of this issue.
Please specify it either using /kind <group> or manually from the side menu.

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.
If this issue is safe to close now please do so with /close.
Provide feedback via https://github.com/falcosecurity/community.
/lifecycle stale

Stale issues rot after 30d of inactivity.
Mark the issue as fresh with /remove-lifecycle rotten.
Rotten issues close after an additional 30d of inactivity.
If this issue is safe to close now please do so with /close.
Provide feedback via https://github.com/falcosecurity/community.
/lifecycle rotten

/kind feature
/remove-lifecycle rotten.

@leogr: The label(s) kind/feature cannot be applied, because the repository doesn't have them.

In response to this:

/kind feature
/remove-lifecycle rotten.

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

/kind feature

@jasondellaluce we can remove the deprecated config or cmd args options.

Rotten issues close after 30d of inactivity.
Reopen the issue with /reopen.
Mark the issue as fresh with /remove-lifecycle rotten.
Provide feedback via https://github.com/falcosecurity/community.
/close

@poiana: Closing this issue.

In response to this:

Rotten issues close after 30d of inactivity.
Reopen the issue with /reopen.
Mark the issue as fresh with /remove-lifecycle rotten.
Provide feedback via https://github.com/falcosecurity/community.
/close

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

/reopen

@leogr: Reopened this issue.

In response to this:

/reopen

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

/remove-lifecycle rotten

/help

@leogr:
This request has been marked as needing help from a contributor.
Please ensure the request meets the requirements listed here.
If this request no longer meets these requirements, the label can be removed
by commenting with the /remove-help command.

In response to this:

/help

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

/assign

This list must be reviewed considering the new deprecations:

https://github.com/falcosecurity/falco/issues/2763
https://github.com/falcosecurity/falco/issues/2840

@Andreagit97 @FedeDP could you help me with that please?

Check on some Legacy tests around enabling rules with or without tags and in combination with using the enabled key or not. Some tests seem to assert final rules that are enabled (e.g. TestFalco_Legacy_DisabledTagsB), other test could be missing it? e.g. TestFalco_Legacy_DisabledRulesUsingEnabledFlag or TestFalco_Legacy_DisabledRuleUsingFalseEnabledFlagOnly etc.

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.
If this issue is safe to close now please do so with /close.
Provide feedback via https://github.com/falcosecurity/community.
/lifecycle stale

/remove-lifecycle stale

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.
If this issue is safe to close now please do so with /close.
Provide feedback via https://github.com/falcosecurity/community.
/lifecycle stale

/remove-lifecycle stale
Marked watch_config_files as done since testing framework now tests it: https://github.com/falcosecurity/testing/pull/54

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.
If this issue is safe to close now please do so with /close.
Provide feedback via https://github.com/falcosecurity/community.
/lifecycle stale

/remove-lifecycle stale

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.
If this issue is safe to close now please do so with /close.
Provide feedback via https://github.com/falcosecurity/community.
/lifecycle stale

/remove-lifecycle stale


⚠ Orpheus has degraded performance

In 03b7569, Orpheus ($OPS) experienced degraded performance:

HTTP code: 504
Response time: 20811 ms

Resolved: Orpheus performance has improved in 94ce2bf.


Updated docs july

Updated Docs with new APIs and updated existing API

It looks like this PR should not have been raised against the main slatedocs repo, but against your fork.

sorry about this


Fix a reference error in payments.js

Looks like I broke the credit card and bank account pages in #3218 (5667f656cf4047dc9e70a53e12ca82a5a751a413).

So, our JS tests regularly fail for no reason, but they don't detect simple "variable not in scope" bugs…


[BUG] CONTRIBUTING.md refers to branching

Describe the bug
CONTRIBUTING.md refers to branching.
Expected behavior
The policy of this team is to commit to main.
The doc needs to be updated for current policy.

Upvote & Fund

We're using Polar.sh so you can upvote and help fund this issue.
We receive the funding once the issue is completed & confirmed by you.
Thank you in advance for helping prioritize & fund our backlog.

@evelynmitchell can you elaborate?

You mentioned yesterday that you want a push to main style of commit.


refactor: Migrate CssEditor to typescript

SUMMARY
Migrate CssEditor to typescript
BEFORE/AFTER SCREENSHOTS OR ANIMATED GIF
N.A.
TESTING INSTRUCTIONS

All tests should pass

ADDITIONAL INFORMATION

[ ] Has associated issue:
[ ] Required feature flags:
[ ] Changes UI
[ ] Includes DB Migration (follow approval process in SIP-59)

[ ] Migration is atomic, supports rollback & is backwards-compatible
[ ] Confirm DB migration upgrade and downgrade tested
[ ] Runtime estimates and downtime expectations provided

[ ] Introduces new feature or API
[ ] Removes existing feature or API

It looks like prettier is failing. You can (probably) run the scripts from package.json to fix this, but we generally recommend installing/running the pre-commit hook.


Fails to open database if opened at any point with a third party tool

This may be an issue listed, i searched and couldn't find anything exact. Also posted in the sqlite library I use that pulls this package - https://github.com/m4heshd/better-sqlite3-multiple-ciphers/issues/62
I seem to be having a problem when connecting to the database via SQLiteStudio, it breaks something. I assume it's my WAL archive.
Config when opening the db:
PRAGMA cipher='chacha20'
PRAGMA journal_mode = WAL
PRAGMA temp_store = memory
PRAGMA mmap_size =<PHONE_NUMBER>0
PRAGMA page_size = 32768
PRAGMA vacuum

Steps to break it:

Start the electron application
Set the password for the database
Refresh the electron application
Type the password in to unlock it, all works.
close the electron application
Connect to the database via SQLiteStudio
Make a few queries on SQLiteStudio
Disconnect from database in SQLiteStudio
Start application again
Type password to unlock (same as step 4 above)
all queries from the application result in error: SqliteError: database disk image is malformed

Alternate steps to break (if the top has a fix, this is not relevant)

Modify the config and remove the journal_mode = WAL
Delete the database file, so it creates a new one
Start the electron application
Set the password, it fails here with error: SqliteError: database disk image is malformed`

Here it does not fail instantly, though. It actually does half the queries and then starts to fail.
BEGIN
[1] 12:08:43.585 › create table `peoplePossibleMatches` (`personMatchId` text not null, `peopleId` text not null, `confidence` integer not null);
[1] 12:08:43.585 › create unique index `peoplepossiblematches_personmatchid_peopleid_unique` on `peoplePossibleMatches` (`personMatchId`, `peopleId`)
[1] 12:08:43.586 › COMMIT
[1] 12:08:43.587 › select `name` from `sqlite_master` where `type` = 'table'
[1] 12:08:43.587 › select * from `migrations`
[1] 12:08:43.588 › [Database Knex Query] error: SqliteError: database disk image is malformed - Query String: 'select * from `migrations`'

Questions:

How can I fix the above error, if it happens?
Is there a way to not have SQLiteStudio break the database?

This may be an issue listed, i searched and couldn't find anything exact. Also posted in the sqlite library I use that pulls this package - m4heshd/better-sqlite3-multiple-ciphers#62

Well, with several different components involved it is often difficult to track down where exactly the problem lies and where it needs to be resolved.

I seem to be having a problem when connecting to the database via SQLiteStudio, it breaks something. I assume it's my WAL archive.

Using WAL mode can be a bit tricky sometimes. First question: which version of SQLiteStudio are you using? There were WAL related problems in early SQLite3MultipleCiphers versions. Unfortunately, SQLiteStudio updated its SQLite3MultipleCiphers component only in version 3.4.0 (released in November 2022). Prior versions of SQLiteStudio used a SQLite3MultipleCiphers version with broken WAL support. That is, in case you still use an old SQLiteStudio version upgrading to the latest version maybe solves the problem.

Config when opening the db:
PRAGMA cipher='chacha20'
PRAGMA journal_mode = WAL
PRAGMA temp_store = memory
PRAGMA mmap_size =<PHONE_NUMBER>0
PRAGMA page_size = 32768
PRAGMA vacuum

Hm, there exists no PRAGMA vacuum inSQLite. Did you intend to set auto_vacuum mode?

Steps to break it:
1. Start the electron application

2. Set the password for the database

3. Refresh the electron application

4. Type the password in to unlock it, all works.

5. **close the electron application**

6. Connect to the database via SQLiteStudio

7. Make a few queries on SQLiteStudio

8. Disconnect from database in SQLiteStudio

9. Start application again

10. Type password to unlock (same as step 4 above)

11. all queries from the application result in `error: SqliteError: database disk image is malformed`

What happens, if you reopen the database repeatedly from your application (without using any other application to access the database)? Does that work?
In one of your posts in https://github.com/m4heshd/better-sqlite3-multiple-ciphers/issues/62 you say that the .db-shm and .db-wal still exist after you closed your application. Usually those files are deleted as soon as the last connection to the database is closed. If you are sure that all applications have closed their database connections, but the WAL files still exist, maybe one of the closing operations failed for some reason. Details about WAL files can be found here.

Alternate steps to break (if the top has a fix, this is not relevant)
1. Modify the config and **remove** the `journal_mode = WAL`

2. Delete the database file, so it creates a new one

3. Start the electron application

4. Set the password, it fails here with error: SqliteError: database disk image is malformed`

This is a bit strange. Usually this only happens, if a database file was created without encryption and you then set a password for an already existing unencrypted database. Of course, this will fail, because no password is required to access an unencrypted database file. To encrypt an unencrypted database file you have to use PRAGMA rekey.

Here it does not fail instantly, though. It actually does half the queries and then starts to fail.

This is really weird. AFAIK this can only happen if different database connections interfer with each other.

BEGIN
[1] 12:08:43.585 › create table `peoplePossibleMatches` (`personMatchId` text not null, `peopleId` text not null, `confidence` integer not null);
[1] 12:08:43.585 › create unique index `peoplepossiblematches_personmatchid_peopleid_unique` on `peoplePossibleMatches` (`personMatchId`, `peopleId`)
[1] 12:08:43.586 › COMMIT
[1] 12:08:43.587 › select `name` from `sqlite_master` where `type` = 'table'
[1] 12:08:43.587 › select * from `migrations`
[1] 12:08:43.588 › [Database Knex Query] error: SqliteError: database disk image is malformed - Query String: 'select * from `migrations`'

Questions:
1. How can I fix the above error, if it happens?

2. Is there a way to not have SQLiteStudio break the database?

At the moment I have not enough information to answer these questions.

Thanks for your reply! I'm not sure what layer the problem exists at, or if it's just me being silly. However, I very much so appreciate your help! I've spent way too much time trying to solve this before opening github issues.
I'm on v3.4.4 of SQLiteStudio.

Hm, there exists no PRAGMA vacuum inSQLite. Did you intend to set auto_vacuum mode?

I guess I need to validate things more. I was going based on https://gist.github.com/phiresky/978d8e204f77feaa0ab5cca08d2d5b27 which suggests pragma vacuum to actually run a vacuum.
I modified the statements to have pragma  auto_vacuum = FULL and to run a vacuum on start.
So, I believe I've solved that?

In one of your posts in https://github.com/m4heshd/better-sqlite3-multiple-ciphers/issues/62 you say that the .db-shm and .db-wal still exist after you closed your application. Usually those files are deleted as soon as the last connection to the database is closed. If you are sure that all applications have closed their database connections, but the WAL files still exist, maybe one of the closing operations failed for some reason. Details about WAL files can be found here.

I managed to fix the persistence of .db-shm and .db-wal to correctly remove these files.  I believe this may have been an alternate issue within the application that may have been a contributing factor here in masking the issue originally. If you don't remove those files ever, everything just works.
What's interesting is I may have uncovered some additional things that are breaking this, that didn't break it when I was using the non-crypto lib of SQLite. It could be all user error.
When starting the application, I run page_size = 32768, mmap_size = 300000000, and temp_store = memory every time I start a connection. Specifically, in the order I sent above. If you reorder these and have page_size and mmap_size come first BEFORE you set the journal_mode it seems to work, but not consistently.
So, based on the above, I made a change to how the application opens. It only runs the commands if it's a new database and has not had journal_mode = WAL set yet. This seems to have fixed the problem, but it's interesting because it did not happen in the original SQLite3 build I was using.
After a bit more testing, it seems that with the original SQLite3 build they were just ignored because they were set after the journal_mode, but now it's causing some kind of inconsistency. I reordered the way they're set, because Google seems to say you cannot set these AFTER the journal_mode has been set to wal.
mmap_size is ignored, page_size is set properly this way and persists on reconnecting to the database.

    const pragma = this.db.pragma('journal_mode');
    if (pragma !== 'wal') {
      this.db.pragma('mmap_size = 3000000');
      this.db.pragma('page_size = 32768');
      this.db.pragma('temp_store = memory');
      this.db.pragma('journal_mode = WAL');
    }

This is a bit strange. Usually this only happens, if a database file was created without encryption and you then set a password for an already existing unencrypted database. Of course, this will fail, because no password is required to access an unencrypted database file. To encrypt an unencrypted database file you have to use PRAGMA rekey.

Good note on this, I actually have to build a migration to move existing databases to this encrypted format.

I THINK I'VE FOUND IT.
A bit more testing, the mmap_size seems to exclusively be the issue. But it's ONLY an issue when paired with encryption.
Breaks
Generate a new primary.db file. I let the application do this, just to keep everything the same. I then close the application and manually set the below commands, NO WAL involved here to remove that variable.
PRAGMA cipher='chacha20';
PRAGMA key ='test';
PRAGMA mmap_size =<PHONE_NUMBER>0;
PRAGMA page_size = 32768;
PRAGMA temp_store = memory;
PRAGMA auto_vacuum = FULL;

Then I run the below query, and it crashes SQLiteStudio and prevents the db from ever being read again.
select `name` from `sqlite_master` where `type` = 'table'

When you close / reopen the file it returns:
[14:25:58] Could not add database ./primary.db: unsupported file format

Works
Same as above, but removing the mmap_size
PRAGMA cipher='chacha20';
PRAGMA key ='test';
PRAGMA page_size = 32768;
PRAGMA temp_store = memory;
PRAGMA auto_vacuum = FULL;

So, I guess my question really boils down to am i using mmap_size wrong or is it not supported?

Thanks for your reply! I'm not sure what layer the problem exists at, or if it's just me being silly.

I'm always glad to get feedback and/or bug reports - it's quite often a chance to enhance the software or to fix subtle bugs. Yes, sometimes it's simply a misuse of a feature, but sometimes we find real bugs.

I'm on v3.4.4 of SQLiteStudio.

Good. So this should not be the cause of trouble.

Hm, there exists no PRAGMA vacuum inSQLite. Did you intend to set auto_vacuum mode?

I guess I need to validate things more. I was going based on https://gist.github.com/phiresky/978d8e204f77feaa0ab5cca08d2d5b27 which suggests pragma vacuum to actually run a vacuum.

Maybe a typo. Just VACUUM would be correct.

I modified the statements to have pragma auto_vacuum = FULL and to run a vacuum on start.

Personally, I would leave the auto commit mode at its default. If you have lots of data and massive changes (really many insertions and deletions) then it is better to explicitly run VACUUM from time to time.

I managed to fix the persistence of .db-shm and .db-wal to correctly remove these files. I believe this may have been an alternate issue within the application that may have been a contributing factor here in masking the issue originally. If you don't remove those files ever, everything just works.

There are occasions when WAL files remain on disk - for example, if an application crashes without closing. Removing those WAL files is calling for trouble. You may end up with corrupted database files or lost data.

What's interesting is I may have uncovered some additional things that are breaking this, that didn't break it when I was using the non-crypto lib of SQLite. It could be all user error.

Well, there may exist SQLite features that can't be combined with encryption or need special handling. There are so many SQLite options that it is hardly possible to test all possible combinations.

When starting the application, I run page_size = 32768, mmap_size = 300000000, and temp_store = memory every time I start a connection. Specifically, in the order I sent above. If you reorder these and have page_size and mmap_size come first BEFORE you set the journal_mode it seems to work, but not consistently.

I have to admit that I have never tested PRAGMA mmap_size in conjunction with encryption. It may well be that this combination is simply not possible. I will check the code whether enabling memory mapping could cause problems for encrypted databases.

So, based on the above, I made a change to how the application opens. It only runs the commands if it's a new database and has not had journal_mode = WAL set yet. This seems to have fixed the problem, but it's interesting because it did not happen in the original SQLite3 build I was using.

WAL mode is persistent. That is, if it was set once, it will automatically set on opening the database file again. Which journal mode is active, can be queried with PRAGMA journal_mode;.

After a bit more testing, it seems that with the original SQLite3 build they were just ignored because they were set after the journal_mode, but now it's causing some kind of inconsistency. I reordered the way they're set, because Google seems to say you cannot set these AFTER the journal_mode has been set to wal.

That's correct. For example, the page size can't be changed when WAL mode is enabled. That is, the order of pragmas matters.

I THINK I'VE FOUND IT.
A bit more testing, the mmap_size seems to exclusively be the issue. But it's ONLY an issue when paired with encryption.

As stated in my previous post it may be that it is not possible to combine encryption with memory mapping. I will have to check the code and will report my findings here. However, this may take some time.

Breaks
Generate a new primary.db file. I let the application do this, just to keep everything the same. I then close the application and manually set the below commands, NO WAL involved here to remove that variable.
PRAGMA cipher='chacha20';
PRAGMA key ='test';
PRAGMA mmap_size =<PHONE_NUMBER>0;
PRAGMA page_size = 32768;
PRAGMA temp_store = memory;
PRAGMA auto_vacuum = FULL;

Then I run the below query, and it crashes SQLiteStudio and prevents the db from ever being read again.
select `name` from `sqlite_master` where `type` = 'table'

When you close / reopen the file it returns:
[14:25:58] Could not add database ./primary.db: unsupported file format

Works
Same as above, but removing the mmap_size
PRAGMA cipher='chacha20';
PRAGMA key ='test';
PRAGMA page_size = 32768;
PRAGMA temp_store = memory;
PRAGMA auto_vacuum = FULL;

So, I guess my question really boils down to am i using mmap_size wrong or is it not supported?

Yes, that's indeed the question. Looking at your experiments chances are high that PRAGMA mmap_size is actually not supported if encryption is enabled. Whether it will be possible to support it together with encryption, I don't know yet.

As stated in my previous post it may be that it is not possible to combine encryption with memory mapping. I will have to check the code and will report my findings here. However, this may take some time.

No rush, if it's not supported it's not supported! I just didn't know that, and it was a part of my config and really throwing me off here. I spent way too much time figuring that out!

Personally, I would leave the auto commit mode at its default. If you have lots of data and massive changes (really many insertions and deletions) then it is better to explicitly run VACUUM from time to time.

Any specific reason why? I know it's not related to this issue, but i'm curious now.

As stated in my previous post it may be that it is not possible to combine encryption with memory mapping. I will have to check the code and will report my findings here. However, this may take some time.

No rush, if it's not supported it's not supported! I just didn't know that, and it was a part of my config and really throwing me off here. I spent way too much time figuring that out!

I made a quick check of the old SQLite code (when the encryption API was still included in it). And my suspicion was confirmed that memory mapping can't be combined with encryption.
I will try to add a check in the current implementation, so that memory mapping can be used for unencrypted databases, but not for encrypted ones.

Personally, I would leave the auto commit mode at its default. If you have lots of data and massive changes (really many insertions and deletions) then it is better to explicitly run VACUUM from time to time.

Any specific reason why? I know it's not related to this issue, but i'm curious now.

Well, performing a VACUUM operation is an expensive operation - in time and space. The gain is often only small, because SQLite does a fairly good job in managing the database pages. And on SSD storage (that is very common nowadays) fragmentation plays only a minor role. Therefore enabling auto vacuum brings more costs than gain. It is even possible that fragmentation increases.
For databases with a high frequency of inserts and deletes it can still make sense to manually perform a VACUUM from time to time to compact the database file.

I will try to add a check in the current implementation, so that memory mapping can be used for unencrypted databases, but not for encrypted ones.

Thanks!

For databases with a high frequency of inserts and deletes it can still make sense to manually perform a VACUUM from time to time to compact the database file.

This makes sense, I have a large amount of changes that happen while the db is open. When closing I run optimize and on opening I run vacuum (correctly now). So, it sounds like I've solved what I need on that!

I appreciate your help on pinning this issue! Feel free to leave this open to track adding mmap or close it out if that's your process.

I appreciate your help on pinning this issue! Feel free to leave this open to track adding mmap or close it out if that's your process.

I leave this issue open, until it is resolved.

I released version 1.7.0. If PRAGMA mmap_size is used, this version will check whether the database is encrypted or not. If it is encrypted, memory mapping will not be used. However, unencrypted databases can still gain from memory mapping.
So, I'm closing this issue.


"No Fish Hooked"

According to /statsbot there is about a 10% chance for missing Fish on retail.
I watched it a little, it will try to Catch, before a Fish is hooked, usually shortly after starting, is there a way to slightly lower the sensitivity of the hooked check ?
An Alternative Issue could be, that the fading Blopper (after loot), is still recognised as valid (new cast) and once fully disapeared it thinks we have a fish hooked, maybe ? This could be fixed by checking if a Blopper is detected before casting again and if so, delay until it faded as much as needed to be below threshold.
Another alternative would be using sound to check if we have a fish on hook.

is there a way to slightly lower the sensitivity of the hooked check ?

Mostly by manipulation with camera view, bobber position and increasing checking delay option.

An Alternative Issue could be, that the fading Blopper (after loot), is still recognised as valid (new cast) and once fully disapeared it thinks we have a fish hooked, maybe ?

The bot already deals with it: before casting it analyzes the zone for all the bobber colors and remembers them, so after the cast only the new colors are visible for the bot.


在pypi里的rabird直接安装有问题

安装会报错，没有rabird.core模块。
安装时有些依赖，没有解决貌似。

Sorry for inconvenient, but you have to install pywin32 package which we depends on before you install our package.
There have no easy way to install pywin32 package just like pip or easy_install, you have to install it manually:
pywin32 : http://sourceforge.net/projects/pywin32/

This problem could be solved by rabird.core v0.3.0 :
https://github.com/starofrainnight/rabird.core/releases/tag/v0.3.0


Skip pointless flashbanner query if the user is present

Jira ticket 🔒
I'll merge with @damassi's + one more approving review.
This PR updates the Flash Banner's SystemQueryRenderer query prop to be null, causing the underlying relay queryrenderer to skip querying if there is no user to query for.
As an alternative approach I spent a little while trying to make sd.CURRENT_USER fully replace me (diff here), basically by adding can_request_email_confirmation to the allow list for current_user's properties. Unfortunately I realized this user object does not pick up changes immediately, causing the 'request email confirmation' banner to continue appearing until I logged out and back in.

@mzikherman responding to both of your comments here:

Does this component still need to render/be called (without props)?
yes, because it checks the the query string off of window.location (though i'm wondering if that would be good to put in system context or sd)

Is the isServer check needed for SystemQueryRenderer?
No, but it is needed in the case that we don't use SystemQueryRenderer and render the component directly (in order to avoid hitting window above).


show QoD

@rultor release, tag is 0.0.27

@rultor release, tag is 0.0.27

@yegor256 OK, I will release it now. Please check the progress here

@rultor release, tag is 0.0.27

@yegor256 Done! FYI, the full log is here (took me 11min)


Update COVID19_Fallzahlen_Kanton_NE_total.csv

added historised data, deleted ncumul_vent

Why values are different than previous ones?

Related to this https://github.com/openZH/covid_19/issues/385 ? I still didn't see an explanation tho.

their numbers changed again with today's update...

I guess they made a revision? But i can't tell for sure. However, what @simgraworldwide submitted now corresponds to what they report in the new document.


Refactor mission control (assessment editor) feature

Refactor mission control (assessment editor) feature
Proposal: code quality improvements.
Rationale
The mission control feature (accessible at /mission-control) was introduced as a CP3108B project in AY18/19 Sem 2. It allows for creation, editing and testing of assessments in the Academy in a WYSIWYG fashion, including but not limited to setting the assessment briefing, question briefing, globals, testcases and the Source sublanguage.
However, the feature is currently unmaintained and essentially abandoned, even though a large amount of work has been put into it. It also lacks support for some updates to the assessment XML format, such as setting a password for Practical assessments.
It would be a great improvement to the mission authoring workflow, if someone could update and refactor the entire feature to bring it in line with the latest coding standards and to use React hooks.
Last updated 9 Jul 2020, 11:45PM

With the shift to Source Academy Rook (2022), the XML format has also been tweaked slightly (mainly the attributes under the PROBLEM tag). This is yet to be reflected in MissionControl.
The most updated XML config can be found here: https://github.com/source-academy/general/blob/master/educator/assessment/README.md

I'd like to suggest that we remove mission-control from the system. We are not using it. We should focus on the unique features. WYSIWYG XML editing should be done with separate tools.

I'd like to suggest that we remove mission-control from the system. We are not using it. We should focus on the unique features. WYSIWYG XML editing should be done with separate tools.

I'm in favour of this. If we ever want to reintroduce it, we can just make it a separate frontend. What are your thoughts @chownces? This specific part (mission control) seems to be independent of the rest of the functions in the frontend.


ISS256: Remove extra weight downloads for selim_sef SN4 models

Thank you for submitting your PR. Please read the template below, fill it out as appropriate, and make additional changes to your code as needed. Please feel free to submit your PR even if it doesn't satisfy all of the requirements below - simply prepend [WIP] to the PR title until it is ready for review by a maintainer. If you need assistance or review from a maintainer, add the label Status: Help Needed or Status: Review Needed respectively. After review, a maintainer will add the label Status: Revision Needed if further work is required for the PR to be merged.
Description
Please include a summary of the change and which issue is resolved. Please also include relevant motivation and context. List any dependencies that are required for this change.
Resolves #256
Type of change
Please delete options that are not relevant.

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected - these changes will not be merged until major releases!)

How Has This Been Tested?
Please describe tests that you added to the pytest codebase (if applicable).
Checklist:

[x] My PR has a descriptive title
[x] My code follows PEP8
[x] I have performed a self-review of my own code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] My changes generate no new errors
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] My PR passes Travis CI tests
[x] My PR does not reduce coverage in Codecov

If your PR does not fulfill all of the requirements in the checklist above, that's OK! Just prepend [WIP] to the PR title until they are all satisfied. If you need help, @-mention a maintainer and/or add the Status: Help Needed label.

The first commit in this is more directly related to #235.


3.5 release:  OpenCL include and lib folder removed from /opt/rocm, only found in /opt/rocm-3.5.0 folder

On Ubuntu 16.04
It would be helpful to have a stable /opt/rocm folder symlinked to latest release. I have a cmake search script for finding rocm opencl, but this is going to break with each new release.

Related to #1160 . A workaround seems to be forcing re-install of packages - find which ones are still installed in the old directory with dpkg -S /opt/rocm-OLVERSION, then run apt install --reinstall PKG1 PKG2.....

Thanks @boxerab and @bd4.
I recommend to try with the latest ROCm 4.0.
Thank you.


add an option to select the speed of money earning

Thanks for the idea, added with c971ff8c9c89cb189384bcfa588ed5788a400d58.


when will the next stable release of OpenSSL1.1.1

When will the next stable version of OpenSSL1.1.1 be released?
It has been over 5 months since last release. We are in need to use some enhancements for OpenSSL1.1.1, while we do not want to use nightly build.
Thanks.

There has been no decision as yet.

There has been no decision as yet.

noted & thank you.

Do we have a planned date, such as this month or last month?
thank you
@mattcaswell

I expect the release to be sooner rather than later, but I can't give you a date right now.

OK, I'll be waiting it.
Thank you again.

Any chance this is available by end of the month? Thanks.

1.1.1e was released this week, see https://mta.openssl.org/pipermail/openssl-announce/2020-March/000167.html


Review screen party side labels appearing when there's no info for them.

Plaintiffs or petitioners and Defendants or respondents labels are appearing even when there's no info under them.
Trying to come up with something using "show if"
show if: defined('multiple_users')  seems to work for user side, but can't get anything to work for respondent side.
But this also may not be necessary to fix. If I end up creating chunks of review screens instead for each section, this won't matter as much for those chunks and for the final review screen, both sets of data should be filled in so shouldn't be a problem.

should just be able to use
show if: multiple_users  e.g., according to review screen documentation, but doesn't seem to work

note to self:
possibly "show if: multiple_users" is not evaluating whether it's defined but whether it's true or false.  (That's what I would have thought in the first place but I was thrown off by the documentation: https://docassemble.org/docs/fields.html#review customization)


Error Starting Record: Recorder is not initialized

Tested on Chrome  85,Desktop App and Firefox 80
Mattermost Version: 5.21.0
Uncaught (in promise) Error: Recorder not initialized
at com.mattermost.voice_8d7088889a8f7053_bundle.js:16
at new Promise ()
at n.stop (com.mattermost.voice_8d7088889a8f7053_bundle.js:16)
at ze.sendRecording (com.mattermost.voice_8d7088889a8f7053_bundle.js:24)
at com.mattermost.voice_8d7088889a8f7053_bundle.js:24
at index.js:8
at middleware.js:81
at Object.send (redux.js:475)
at com.mattermost.voice_8d7088889a8f7053_bundle.js:24
at Object.s (react-dom.production.min.js:14)

Hi @farshid33,

Can you also share a screenshot of the network tab results when the error occurs?

Is Mattermost deployed in a subdirectory (e.g. https://yourdomain.com/mm/ )?

Hi @streamer45
1- nothing special in network when error occures.

2- No.Mattermost installed in Ubuntu in valid ip binded to the url and NAT to server
3- No.the URL is https://mydomain.xyz/ and that's all.

Hi @streamer45
I think I found the problem.
The site URL configured with WWW (https://www.mydomain.xyz) but I was opening with no www  (https://mydomain.xyz).
the plugin did not work with the url of no www.

Nice, thanks for letting me know.
If the SiteURL is set then the plugin will use that to form the URLs and fetch the data it requires to run. I don't see those from your network tab screenshot, probably you should reload the page and disable the cache. It might have been a permission error since the origin wasn't the same. I believe a redirection would help here, to make sure only one version of the domain will be used (the one configured in SiteURL).

In my case, the domain is
https://slack.microsoft.com/
Same bug behavior, apparently is something with the subdomain or domain, should I patch something?
thanks in advance

My site is setup on http://chat.domain.com:9948 but I have a nginx redirect to https://chat.domain.com. This plugin does not get initialized due to the url mismatch. If I download the source and build it with export MM_SERVICESETTINGS_SITEURL=https://chat.domain.com will it work? Thanks in advance.

@phoenixsampras
Is your SiteURL configured correctly?
@prabaldey
You don't need to build it again. That's a configuration setting so you can either change its value in config/config.json or start the server with that environment variable set. Let me know if that still doesn't work.
In both cases it would be helpful to see which calls are failing and with what error (404 or else). This can be checked by taking a look at the developers tools network tab while loading the app, as suggested above.

Now I am getting this:
com.mattermost.voice_8d7088889a8f7053_bundle.js:16 Uncaught (in promise) Error: unsupported
    at n._startCapture (com.mattermost.voice_8d7088889a8f7053_bundle.js:16)
    at n.start (com.mattermost.voice_8d7088889a8f7053_bundle.js:16)
    at ze.startRecording (com.mattermost.voice_8d7088889a8f7053_bundle.js:24)
    at com.mattermost.voice_8d7088889a8f7053_bundle.js:24
    at Object.t.registerFileUploadMethod.ne.id [as action] (com.mattermost.voice_8d7088889a8f7053_bundle.js:24)
    at onClick (file_upload.jsx:626)
    at Object.s (react-dom.production.min.js:14)
    at f (react-dom.production.min.js:14)
    at react-dom.production.min.js:14
    at g (react-dom.production.min.js:15)

@prabaldey
That error should happen mainly for two reasons. Either the app is not running on a secure connection (HTTPS) or somehow your browser has no support for capturing audio. What browser/OS (and versions) are you getting this error from?

So here is my entire situation.
I have Apache installed on port 80 and GitLab Omnibus installed on http port 8181 forwarded to https port 8182. I had to do this because port 80 and 443 are taken up by Apache and the only way I could get LetsEncrypt to work with the SSL certificate is to have a separate http port forwarding for GitLab.
I then configured GitLab Mattermost. I did not install Mattermost separately. I setup Mattermost using the same concept as GitLab - http port 9948 forwarding to https port 8065. If I did not put 9948 as the http port, Mattermost defaults to port 80 and everything stops because Apache is running on port 80.
So when I reconfigure GitLab, it automatically takes the Mattermost URL as http://chat.domain.com:9948 and internally forwards it to https://chat.domain.com. If I go into Mattermost console the webserver url is set to http://chat.domain.com:9948. When I run https://chat.domain.com, Mattermost works but the voice plugin shows the following error:
Mixed Content: The page at 'https://chat.domain.com/default-team/channels/town-square' was loaded over HTTPS, but requested an insecure XMLHttpRequest endpoint 'http://chat.domain.com:9948/plugins/com.mattermost.voice/config'. This request has been blocked; the content must be served over HTTPS.

If I run Mattermost on http://chat.domain.com:9948/ then the plugin shows the following error:
com.mattermost.voice_8d7088889a8f7053_bundle.js:16 Uncaught (in promise) Error: unsupported
    at n._startCapture (com.mattermost.voice_8d7088889a8f7053_bundle.js:16)
    at n.start (com.mattermost.voice_8d7088889a8f7053_bundle.js:16)
    at ze.startRecording (com.mattermost.voice_8d7088889a8f7053_bundle.js:24)
    at com.mattermost.voice_8d7088889a8f7053_bundle.js:24
    at Object.t.registerFileUploadMethod.ne.id [as action] (com.mattermost.voice_8d7088889a8f7053_bundle.js:24)
    at onClick (file_upload.jsx:626)
    at Object.s (react-dom.production.min.js:14)
    at f (react-dom.production.min.js:14)
    at react-dom.production.min.js:14
    at g (react-dom.production.min.js:15)

I am caught in a chicken-and-egg problem right now from the look of things.

Thanks for the additional info @prabaldey.
The plugin can only work on a secure connection hence the "unsupported" error.
Is your SiteURL set? I am thinking that setting it to https://chat.domain.com could fix the issue. Or did you try that already?

Sorry for the late reply.
I did set the SiteURL to https://chat.domain.com but it is not changing anything. GitLab's configuration file is at /etc/gitlab/gitlab.rb. GitLab Mattermost's configuration file is at /var/opt/gitlab/mattermost/config.json. config.json SiteURL is blank initially. Changing it does not change anything. It seems Mattermost is picking up it's site url from /etc/gitlab/gitlab.rb. The variable is mattermost_external_url as shown here.
So is your plugin supposed to pickup the SiteURL from the /var/opt/gitlab/mattermost/config.json file?

I did set the SiteURL to https://chat.domain.com but it is not changing anything. GitLab's configuration file is at /etc/gitlab/gitlab.rb. GitLab Mattermost's configuration file is at /var/opt/gitlab/mattermost/config.json. config.json SiteURL is blank initially. Changing it does not change anything. It seems Mattermost is picking up it's site url from /etc/gitlab/gitlab.rb. The variable is mattermost_external_url as shown here.

Okay maybe Gitlab is using the MM_SERVICESETTINGS_SITEURL environment variable to force a different setting. I believe that overrides the JSON config.

So is your plugin supposed to pickup the SiteURL from the /var/opt/gitlab/mattermost/config.json file?

Yes. The plugin will attempt to read the SiteURL from server config and if not empty will use that as the base for loading its files.
I guess one option would be to add a plugin specific config setting for a user-defined URL that takes precedence over anything else.

From what I have seen in my tests, the SiteURL in /var/opt/gitlab/mattermost/config.json is getting ignored. No matter what I do, the voice plugin always picks up the http url in the /etc/gitlab/gitlab.rb file. Since many people are facing this issue, it might be a great solution to add a plugin specific config setting that overrides everything else. You wouldn't have to spend so much time replying to all these posts then 😄

Yes, the SiteURL will be ignored since an env variable in set. The plugin doesn't literally read the json file but goes through some API calls so that's why we get the other version.
I'll try to work on a fix in the next week or so.

Thank you. This is most appreciated.

@prabaldey
In the meantime, I am wondering if in your specific case the previous version of this plugin would actually work. If I understood the problem correctly the failure is due to the latest changes. Before those we would ignore the SiteURL entirely. Might be worth giving it a try.

This should be (hopefully) fixed now. If you could give it a try it would be great. You will have to build the plugin from master branch (make dist cmd).
I'll also publish a release at some point if everything works as expected.

I tried building the code but ran across this error.
[root@www mmvoice]# git clone https://github.com/streamer45/mattermost-plugin-voice.git
Cloning into 'mattermost-plugin-voice'...
remote: Enumerating objects: 184, done.
remote: Counting objects: 100% (184/184), done.
remote: Compressing objects: 100% (125/125), done.
remote: Total 184 (delta 86), reused 136 (delta 47), pack-reused 0
Receiving objects: 100% (184/184), 266.71 KiB | 0 bytes/s, done.
Resolving deltas: 100% (86/86), done.
[root@www mmvoice]# ls -lia
total 12
 1048586 drwxr-xr-x  3 root root 4096 Nov 19 22:56 .
50855942 drwxr-xr-x 13 root root 4096 Nov 19 22:56 ..
 1048596 drwxr-xr-x  8 root root 4096 Nov 19 22:56 mattermost-plugin-voice
[root@www mattermost-plugin-voice]# export MM_SERVICESETTINGS_SITEURL=https://chat.domain.com
[root@www mattermost-plugin-voice]# make dist
go<EMAIL_ADDRESS>requires
<EMAIL_ADDRESS>requires
<EMAIL_ADDRESS>invalid pseudo-version: git fetch --unshallow -f origin in /root/go/pkg/mod/cache/vcs/9768874fee86a59054d303e43ea91580a0b259c16b29997c61cde648dc427e47: exit status 128:
        fatal: git fetch-pack: expected shallow list
go<EMAIL_ADDRESS>requires
<EMAIL_ADDRESS>requires
<EMAIL_ADDRESS>invalid pseudo-version: git fetch --unshallow -f origin in /root/go/pkg/mod/cache/vcs/9768874fee86a59054d303e43ea91580a0b259c16b29997c61cde648dc427e47: exit status 128:
        fatal: git fetch-pack: expected shallow list
        fatal: The remote end hung up unexpectedly
make: build/bin/manifest: Command not found
build/setup.mk:16: *** "Cannot parse id from plugin.json".  Stop.

Here is the go version
[root@www mattermost-plugin-voice]# go version
go version go1.15.2 linux/amd64

I must be doing something wrong. If you could give me some pointers how to get rid of these errors then that will be great.

@prabaldey
Looks like a problem withgit. What's the output of git version?
Can you try to update to the latest available?

Here is my git version.
[root@www mmvoice]# git --version
git version <IP_ADDRESS>

Unfortunately this is a production server and this is the latest version of git for CentOS 7. I cannot risk forcing an update as it might break other programs running. Can I compile this on my local computer and then upload it to the server? In that case what would be the steps to follow?
Thanks.

Here is my git version.
[root@www mmvoice]# git --version
git version <IP_ADDRESS>

Unfortunately this is a production server and this is the latest version of git for CentOS 7. I cannot risk forcing an update as it might break other programs running. Can I compile this on my local computer and then upload it to the server? In that case what would be the steps to follow?
Thanks.

No worries, here's the build with latest changes:
com.mattermost.voice-0.2.2.tar.gz

I installed this latest version but the plugin doesn't load at all. Here are the steps I followed.

Went into SSH and ran the command mattermost plugin delete  com.mattermost.voice. Plugin got deleted successfully. Went into the Mattermost System Console and under Plugins there was no longer a Voice option present.
Now I downloaded your latest file.
Now I installed the plugin using mattermost plugin add com.mattermost.voice-0.2.2.tar.gz. Plugin got successfully installed.
I went to Mattermost System Console and the Voice option was there. I turned it on and refreshed the Mattermost channels. I clicked on the 📎 icon expecting the voice recorder to show up in the menu but it did not open. I was shown the file browse dialog box.
I then turned on your screen recording plugin too and opened up the browser console. When I refreshed the chat I saw this message in the console Loaded plugin com.mattermost.screen, version 0.3.0 but there was no such message for the voice recorder plugin.
I went into the System Console->Server Logs and found the following message.

{"level":"error","ts":1605920834.8097196,"caller":"mlog/log.go:190","msg":"Unable to activate plugin","plugin_id":"com.mattermost.voice","error":"unable to start plugin: com.mattermost.voice: Unrecognized remote plugin message: \n\nThis usually means that the plugin is either invalid or simply\nneeds to be recompiled to support the latest protocol.","errorVerbose":"Unrecognized remote plugin message: \n\nThis usually means that the plugin is either invalid or simply\nneeds to be recompiled to support the latest protocol.\nunable to start plugin: com.mattermost.voice\ngithub.com/mattermost/mattermost-server/v5/plugin.(*Environment).Activate\n\tgithub.com/mattermost/mattermost-server/v5/plugin/environment.go:266\ngithub.com/mattermost/mattermost-server/v5/app.(*App).SyncPluginsActiveState\n\tgithub.com/mattermost/mattermost-server/v5/app/plugin.go:125\ngithub.com/mattermost/mattermost-server/v5/app.(*App).InitPlugins.func1\n\tgithub.com/mattermost/mattermost-server/v5/app/plugin.go:197\ngithub.com/mattermost/mattermost-server/v5/config.(*emitter).invokeConfigListeners.func1\n\tgithub.com/mattermost/mattermost-server/v5/config/emitter.go:36\nsync.(*Map).Range\n\tsync/map.go:333\ngithub.com/mattermost/mattermost-server/v5/config.(*emitter).invokeConfigListeners\n\tgithub.com/mattermost/mattermost-server/v5/config/emitter.go:34\ngithub.com/mattermost/mattermost-server/v5/config.(*commonStore).set\n\tgithub.com/mattermost/mattermost-server/v5/config/common.go:90\ngithub.com/mattermost/mattermost-server/v5/config.(*FileStore).Set\n\tgithub.com/mattermost/mattermost-server/v5/config/file.go:108\ngithub.com/mattermost/mattermost-server/v5/app.(*Server).SaveConfig\n\tgithub.com/mattermost/mattermost-server/v5/app/config.go:404\ngithub.com/mattermost/mattermost-server/v5/app.(*App).SaveConfig\n\tgithub.com/mattermost/mattermost-server/v5/app/config.go:433\ngithub.com/mattermost/mattermost-server/v5/api4.updateConfig\n\tgithub.com/mattermost/mattermost-server/v5/api4/config.go:116\ngithub.com/mattermost/mattermost-server/v5/web.Handler.ServeHTTP\n\tgithub.com/mattermost/mattermost-server/v5/web/handlers.go:240\ngithub.com/NYTimes/gziphandler.GzipHandlerWithOpts.func1.1\n\tgithub.com/NYTimes/gziphandler@v1.1.1/gzip.go:336\nnet/http.HandlerFunc.ServeHTTP\n\tnet/http/server.go:2041\ngithub.com/gorilla/mux.(*Router).ServeHTTP\n\tgithub.com/gorilla/mux@v1.7.4/mux.go:210\ngithub.com/getsentry/sentry-go/http.(*Handler).Handle.func1\n\tgithub.com/getsentry/sentry-go@v0.6.1/http/sentryhttp.go:61\nnet/http.HandlerFunc.ServeHTTP\n\tnet/http/server.go:2041\nnet/http.serverHandler.ServeHTTP\n\tnet/http/server.go:2836\nnet/http.(*conn).serve\n\tnet/http/server.go:1924\nruntime.goexit\n\truntime/asm_amd64.s:1373"}
{"level":"info","ts":1605921141.5150325,"caller":"bleveengine/bleve.go:267","msg":"UpdateConf Bleve"}
{"level":"warn","ts":1605921141.5470974,"caller":"plugin/hclog_adapter.go:71","msg":"plugin failed to exit gracefully","plugin_id":"com.mattermost.voice"}

Please let me know if you need anything else from my end.

@prabaldey
That's a new one for sure. What Mattermost version are you running?

@streamer45 That worked! Thanks!!! I do have a question. When I record with my laptop it picks up a lot of echo because the laptop voice input seems to be picking up the output. Is there something that I can do to cut the echo out? Thanks again for everything.

I am glad it finally worked :tada:
As for the echo issue, you'd probably have to check that on your system's sound settings. Depending on your OS you might find some echo cancellation setting.


Resource allocation

Hi,
I am trying to use your model on a dataset with various size frames. I faced two main issues:

Is there an easy way to use multiple GPUs to train using your code? (The parallelism of training on different batches and averaging gradients on multiple GPUs at the same time)
The model crashes on random epochs in larger models due to shortage of GPU memory allocation (I assume this is because frames have different sizes and hence, the batches will not be fixed size). Is there a way to have the model skip those batches during training to avoid crashes?
Thanks a lot.

Hi @ehgh,
For your first question, multi GPU training is not easy to implement with Tensorflow, and not useful for our experiments, so we do not have the possibility to use it in our code.
For your second question, our model is designed to work with various size frames. As explained in the paper, one batch is composed of a varying number of frames (depending on their size). It is filled with frames until a certain limit of points is reached. Therefore, the overall size of the batch should not vary much during training.
The batch size parameters controls the average number of frames in a batch. Before the network starts, we compute the maximum number of points in a batch so that the average number of frames corresponds to this value. You should not set this parameter lower than 3 or 4 if you want GPU memory allocation to be stable.
If you look at the batch generator, the model randomly drops some points for the largest frames that cannot even fit in a batch. Therefore, the model should not crashed if you calibrated your batch limit well.


bpf: Fix some remaining monitor truncation issues

Previously, we updated a most of the trace notification instances to
pass a valid monitor value which would be set to either MTU or the
TRACE_PAYLOAD_LEN, however some cases where missed where the value
"true" (previously indicating that the packet should be traced) was
now passed as a length of how many bytes should be monitored, resulting
in unexpectedly short monitor traces (and inability to dissect packets
at debug level).
Update the remaining cases.
Fixes: #5764
Fixes: 04d02fe71067 ("bpf: Rework monitor tracing to specify capture len")

The backport will have a trivial conflict, happy to make the backport upon request but the change is primarily to substitute true for TRACE_PAYLOAD_LEN.

This change is

test-me-please


Saving waypoint in non-default group changes group waypoint that map shows

I have a waypoint group specifically for Immersive Engineering's ore veins. So when I find an ore vein I want to save I open the full screen map, change the group shown to "ore veins", right click my cursor then set a waypoint. But then for some reason the group that the map shows changes to "none". This shouldn't happen.
I'm using MapWriter 2.1.10

hmmm if you change the space to a _ it should be fixed.
i will fix this in the next version

this is fixed in version 1.8 onward.
forge and mc are already on 1.9 so i'm not updating this in the 1.7.10 version.


Forbidden: bot can't send messages to the user

Forbidden: bot can't send messages to the user

yes i did start to bot but still not working btw i need to connect bot to channel

Make the bot admin and  set

it's work with group but with channel no chance ?

It works with both channel and group

no just with group i get it work what the mothed that you get id of channel ?

You don't even know your channel id and you are claiming it doesn't work with channel I am closing the issue
Regarding getting the channel id just forward any message from your channel to @JsonDumpBot on telegram


Convert 1 song at a time

Hi man, I first of want to thank you, I use your tool alot, especially when I make CDLC from text tab or YT covers. And then I can share the .gp files with the original creators ^^
I'd like to give you some feedback tho:
Can you add a function where we can convert 1 song at a time?
(I thought I found this when I saw the ''Export Guitar Pro'' button in EoF, but that just opens the RocksmithToTab and then starts working on the whole collection)
Cause atm the converter does my whole library and that takes a while, when all I want is the new song I just made :P
(what I do now is: move all my cdlc out of the rocksmith map, run converter, then put them back, which seems unneccesarilly much work just to get 1 tab)
EDIT: allright I'm now reading the changelog, and noticed you made a 'batch-process' function, I'll check it out, maybe this fullfills my needs ^^
EDIT 2: using v1.1 and I can't chose any directory I want, I wanted to see if I can put my CDLC project directory in there, (to just convert 1 .psarc, but that then gives the error, can't find the songs.psarc)

The GUI is rather primitive and only handles the use case of converting the available songs of a Rocksmith installation. However, with v1.1 it does have the option of doing incremental conversions, meaning that only those files should be processed that were updated / added since the last run.
If that doesn't fit your needs, there's always the command line version which can convert single files or arbitrary directories. In Windows, you should be able to just drag'n'drop a single .psarc file (or a directory with psarc files) onto the RocksmithToTab.exe executable, and it should do what you want.

Yes, indeed, Firekorn already mention that you can drag and drop .psarc's on the .exe, that's perfectly for me, thanks ^^
(Not sure if this function is mentioned anywhere, so if that isn't already maybe you should, cause it's really usefull) :D Thanks again

I am having an issue with Convert ONLY NEW files. It goes thru my whole library and overwrites the GP5 files. It was working fine, I would download a new CDLC and it would convert that one file. NOW it goes thru my whole library. So all the changes i made to any existing GP5 file were overwritten. I have a workaround for now but it was so easy just doing new files. Thanks

I am having an issue with Convert ONLY NEW files. It goes thru my whole library and overwrites the GP5 files. It was working fine, I would download a new CDLC and it would convert that one file. NOW it goes thru my whole library. So all the changes i made to any existing GP5 file were overwritten. I have a workaround for now but it was so easy just doing new files. Thanks

SOLVED: rs2tab.timestamp was NOT being written each time i ran the Converter, I went thru my files and deleted duplicates and m.psarc's

Great that you solved it, sorry I couldn't be of any help. It's been a while since I've worked on this :)


add Metaverse ETP

add Metaverse ETP

superseded by PR#145

hi @ehsueh
How was this resolved? I am curious to know
thank you


pip.exceptions.InstallationError: Command "python setup.py egg_info" failed with error code 1

Error when i run this:
sudo pip3 install -v --no-cache-dir --global-option="--cpp_ext" --global-option="--cuda_ext" ./
Everything else has installed perfectly.
can't seem to find anything online for this error.

Hello,
You should look at Apex because it concerns his installation, not fast-bert.
https://github.com/NVIDIA/apex#linux
Good luck


Files 403 error

Check out this issue for an ideal bug report. The closer your issue report is to that one, the more likely we are to be able to help, and the more likely we will be to fix the issue quickly!
For implementation related questions or technical support, please refer to the Stack Overflow and Server Fault communities.
Make sure these boxes are checked before submitting your issue -- thanks for reporting issues back to Parse Server!

[x] You've met the prerequisites.

[x] You're running the latest version of Parse Server.

[x] You've searched through existing issues. Chances are that your issue has been reported or resolved before.

Hello, Parse server gives me 403 error when trying to get uploaded file with url (http://{URL}:1337/parse/public/files/{FILE}).
Same error happens when going to url from dashboard and when loading image with url from iOS application too.
UPD :
Changed this in GridAdapter line 94:
return config.mount + '/files/' + config.applicationId + '/' + encodeURIComponent(filename);

To this
return config._mount + '/files/' + config.applicationId + '/' + encodeURIComponent(filename);

Strange is that parse-server was using publicServerURL for files but in FilesRouter is just /files/ not /public/files

Closing due to lack of activity, please reopen if the issue persist.
Don't forget to include your current:

node version
npm version
parse-server version
any relevant logs (VERBOSE=1 will enable verbose logging)


separate warning and crit errors of agents that are  disabled|down

It's very hard to see which hosts are the troubled hosts when seeing the disabled merged with the down hosts
Sample:
CRITICAL: nova-compute, Host AZ1-Compute-1 disabled, Host AZ1-Compute-2 disabled, Host AZ2-Compute-1 disabled, Host AZ2-Compute-5 disabled, AZ1-Compute-14 down, Host AZ2-Compute-2 disabled, Host AZ1-Compute-6 disabled, Host AZ1-Compute-11 disabled, AZ1-Compute-13 down, Host AZ1-Compute-5 disabled, AZ2-Compute-8 down, Host AZ2-Compute-5 disabled, Host AZ1-Compute-2 disabled, Host AZ2-Compute-2 disabled, Host AZ1-Compute-1 disabled, Host AZ1-Compute-6 disabled, Host AZ1-Compute-11 disabled, Host AZ1-Compute-5 disabled, AZ1-Compute-14 down, AZ1-Compute-13 down
Improvement suggested:
CRITICAL: nova-compute
Hosts disabled: AZ1-Compute-1, AZ1-Compute-2, AZ2-Compute-1, AZ2-Compute-5, AZ2-Compute-2, AZ1-Compute-6, AZ1-Compute-11, AZ1-Compute-5, AZ2-Compute-5, AZ1-Compute-2, AZ2-Compute-2, AZ1-Compute-1, AZ1-Compute-6, AZ1-Compute-11, AZ1-Compute-5
Hosts down : AZ1-Compute-14, AZ1-Compute-13, AZ2-Compute-8, AZ1-Compute-14, AZ1-Compute-13

(by guoqiao)
Maybe we can move even further, to show them in a table with nagios multiple line msg.