custom validator functions?

i might be missing something here and (i think) there was a discussion about stuff like that in #6, but i can't figure out how one might be able to implement custom validators. is that an existing feature? and if not, is that a deliberate design decision?
otherwise thanks for the great module, using it a lot!

@dasantonym thanks, I am really glad you like it.
what specifically are you trying to validate?

thanks for the quick response! i need to verify iso durations and timestamps and check if a value is a uri or a specific version of a uuid.
since all those cases are string values i could probably use something akin to the "notemptystring" example and empty the value using a transform if it doesn't conform, but i thought i'd ask before doing this since it seems a bit hacky. what do you suggest in this case?

it's harder right now to generate error messages, since that wasn't really what I designed this code to do
my original use-case was something like this:

I have a giant mess of JSON/XML/CSV etc
I know the format I expect to have at the end of the process
I have 0 trust that the fields are there / typecasted / etc but I want the best possible result
I don't want to have to null check nested objects all of the time

error messages were added later by PR
if you want to just verify the value of a date you can use:
onValueSet (post-typecast value, clear after it is set)
transform (pre-typecast value, clear it here before it even gets set)
getter (let any value be set but control if and how it comes out when it is read)
more info on those params in the docs :)

i see, thanks for the clarification! i first thought about forking and adding stuff but i guess this just goes towards "let's do mongoose without mongodb!" and unnecessarily bloats the module.
i guess i'll be good with what's already there and i have some ideas. just wanted to make sure i'm not missing anything. thanks again!


Fill view and correlation masks correctly for single view in Vulkan RD

In the case of a single view, these changes are needed to avoid the following validation errors:

VUID-VkSubpassDescription2-multiview-06558
If the multiview feature is not enabled, viewMask must be 0

VUID-VkRenderPassCreateInfo2-viewMask-03057
If the VkSubpassDescription2::viewMask member of all elements of pSubpasses is 0, correlatedViewMaskCount must be 0

Thanks!


Moving to Bountysource

Just a minor note, currently running and have been running a Patreon campaign since around August. However bountysource now has 'salts'. Which is their version of a recurring monthly campaign.
Bountysource is a bit more expensive to make a withdraw (10% flat plus an additional 3-7% from paypal) so thats a downside to it, the upside its way easier to distribute amongst a team and putting bounties on issues is free.
Bounties have also been enabled for the repository.

---
Want to back this issue? **[Post a bounty on it!](https://www.bountysource.com/issues/26686608-moving-to-bountysource?utm_campaign=plugin&utm_content=tracker%2F12689110&utm_medium=issues&utm_source=github)** We accept bounties via [Bountysource](https://www.bountysource.com/?utm_campaign=plugin&utm_content=tracker%2F12689110&utm_medium=issues&utm_source=github).

The page is over at https://salt.bountysource.com/teams/amok
Depending on how you click through you might get the old fundraiser page or the new salt page.. It's a bit odd.

Feedback was generally, use patreon so sticking with it.


Improve logging

Applicable spec:  N/A
Overview

Improve logging when the charm is blocked
Rationale

N/A
Juju Events Changes

N/A
Module Changes

N/A
Library Changes

N/A
Checklist

[x] The charm style guide was applied
[x] The contributing guide was applied
[x] The changes are compliant with ISD054 - Managing Charm Complexity
[x] The documentation is generated using src-docs
[ ] The documentation for charmhub is updated
[x] The PR is tagged with appropriate label (urgent, trivial, complex)

Approving but I'm curious: whats the difference?

One of the places where the exception was raised was not logging anything


First-class reference cursor implementation to improve performance

Monkey's are great. I find myself using them quite a bit. However, my usage is always about making a reference to some centrally stored data.
For example, let's say I have the following tree
data
-- messages
---- messageA
------ title: "This is message A"
---- messageB
------ title: "This is message B"
UI
-- messageListView
---- messageViewA
------ message: monkey to /data/messages/messageA
------ someUiState: true
------ someOtherUiState: false
---- messageViewB
------ message: monkey to /data/messages/messageB
------ someUiState: false
------ someOtherUiState: true
-- NotificationBar
---- newMessagesView
------ message: monkey to /data/messages/messageB
From the above, you can see that two UI widgets can share the same message messageB and still have messageB stored in one place. This is great because now I only have to modify messageB and all UI updates accordingly.
However, it turns out that messageB gets copied into the UI state. I can get around this by storing a version field in messageB that gets updated whenever messageB is updated:
data / messages / messageB
-- title: "This is message A"
-- version: 42
And then monkey the version field in messageB instead...
UI / messageListView / messageViewB
-- message: monkey to /data/messages/messageB/version
-- refPath: ["data", "messages", "messageB"]
Now, whenever I need the messageB in my messageViewB, I simple do:
var path = messageViewCursor.get('refPath');
var message = tree.get(path);
This approach has two advantages:

I don't need to monkey the entire message AND my views reactively update whenever a message gets updated (assuming message here is an atomic UI component ).
I get a modifiable copy of message in my view (monkey data is not modifiable).

However, this approach also has disadvantages:

This approach does not work across the parent hierarchy unless you also update the version number for every parent until the root. For example,

data
-- version: 123
-- messages
---- version: 456
---- messageA
------ version: 789
If I am monkeying data/version, then modifying data/messages/messageA does not update references, unless you recursively change version up the chain. Why does this matter? For example, a messageViewList can have a reference to a messages array, and each item messageItemView in messageViewList references a message in the messages array. If a message changes, the messageItemView queues for a re-render, but the messageViewList does not detect any change. In systems like React, this will effectively mean no re-render at all since messageViewList is the parent that does not rerender.
2 It's difficult to manage all these version fields yourself in the application layer, especially since there are implicit writes when some parts in the supplied path do not exist.

It would be really neat to have this functionality natively in Baobab. This might mean adding some hidden fields or maintaining a separate structure internally than the input.

Hello @atifsyedali. Let me read you and see what can be done :smile:.

I am not sure I understand what you mean by:

However, it turns out that messageB gets copied into the UI state.

Sorry for closing. I misclicked.

Sorry, I think I misunderstood a performance problem I am having by thinking entire monkey data is cloned (I have persistable=false).
The performance problem I am having is when there is a monkey in each item in an array. This is quite slow for some reason and I thought it might be because the entire monkey data is being copied. I am no longer sure if this true tho.

Normally, monkeys within an array should not even work. Anyway, the data returned by the monkeys is never cloned, just frozen if the tree is immutable.

Monkeys within arrays actually work if you have a monkey nested 2+ levels below...e.g.
array: [
{
parent: {
child: monkey {..}
}
},
{
...
}
]
I have removed the arrays from my code and that reduced my page load time from 9s to 5s. However, I still notice cursor.set(..) taking a very long time for me (note I have a lot of monkeys).

Well I am surprised this even work because I remember shunting monkeys when dealing with arrays. I must have missed something somewhere. However, your use case is indeed a tricky and cannot be performant. Why do you have so many monkeys? Is your code available somewhere we could check it together to see if something can be done about it or the lib?

Unfortunately it is closed source. For now I am reducing the amount of monkeys being used. But is there some performance improvement that you think can be made w.r.t monkey handling? For example, I noticed all monkeys are listening on the entire tree write (maybe I am wrong) --- perhaps a monkey can listen to only the cursors it cares about?

Monkeys already listen only to the cursors it cares about. The thing is to do so (and this is also how cursors work under the hood) they have to listen to the tree to understand whether its updates affect them. There is another way to code the internals of the library that could enhance performance in your precise use case but that would be nefarious for general use cases. But generally, I wouldn't vouch for having a lot of "dynamic" monkeys. You seem to use them as class getters and this is not a good use case for reducers. What exactly is the job of your monkeys here?

I am using monkeys as references to centralized data in my views. This allows me to build complex views in React that can render quickly without having to explicitly pass down data from root components. So far, it's worked well. However, as I load real-world data, I started to notice performance problems. Digging a bit more, it turns out it is not just monkeys, it is any object that I create has slow performance. I think this goes back to using more efficient persistent data structures like mori or immutable-js.
I switched over to mori entirely (wrote cursors on top of mori with referencing ability) and saw a dramatic performance improvement. Closing this defect because I think I wasn't using the right tool...Baobab is still excellent but I don't think it was meant for large amount of data.

You are right @atifsyedali. Baobab is meant to be halfway between immutable/persistent data structures and raw JavaScript object so that one may read the tree's data easily and without requiring the component to deal with more constrained API such as mori or immutable-js' ones. But if you need to deal with vast amount of data that will change fairly fast then yes, you should definitely switch to them.
If I can bother you some more, did you find specific points in Baobab that were particularly not performant? You seem to have had quite an experience with things people don't tend to develop very commonly and your insight is therefore very valuable on the subject.


custom comparator does not update rows

What kind of change does this PR introduce? (check one with "x")

[x ] Bugfix
[ ] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Build related changes
[ ] CI related changes
[ ] Other... Please describe:

What is the current behavior? (You can also link to an open issue here)
When a custom comparator for a column is configured, the table is not sorted.
What is the new behavior?
A custom comparator should return a new array, which will be picked up by the change detection and update the view.
Does this PR introduce a breaking change? (check one with "x")

[x ] Yes
[ ] No

Custom comparators HAVE TO return a new array.
Not sure if it'll break anything, but it is an API change. Also added test.
If this PR contains a breaking change, please describe the impact and migration path for existing applications: ...
Other information:
…detection can pick it up and update the view.

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.Gerhard Boer seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.

Perfect.  Thanks for your contribution!


Need documentation on accessing specific validators on a given input in a form?

From here: https://github.com/angular/angular/issues/8311 .

@tchoulihan There is a reference on how to achieve this in Show and Hide Validation Error messages section of Forms documentation.

That link doesn't show how to show specific error messages for specific validators failed. The issue I provided shows that you can use .errors, which should be in that Forms doc.

Sorry, I did not notice that you were referring to .errors. Nevertheless maybe I did not understand exactly your question.What if you provide a different error message for each validator such as:

 First name is required

  Last name is required

Isn't that you try to achieve?

That is the incorrect way to do it.
As described in https://github.com/angular/angular/issues/8311, the correct way is something like:

  Name is required
  Contains illegal characters

It should be in the docs, but it isn't.

@tchoulihan you can check the new cookbook Form Validation that shows some examples on how to access errors.


Add better docs for override_repo

This is only a Readme.md file change and doesn't impact production. Merging.


Exporter 1.1.7 Pre-release with blender 3.3 - issues

Hello there,
I am running tests with the new 1.1.7 exporter with relative Blender 3.3 and I encountered a couple issues so far that stop our workflow:
1)  Export failure with 1.17
The new exporter fails to export the main assembly file, I isolated the issue to a single "animation action".
If this "action" exists in blender (even if not exported), the export will fail
the action "2" in picture, is the problem, even if this is not selected to be exported, the exporter will fail.
Deleting this action solves the issue, but to spot what the issue was, I had to isolate this action among thousands of them.

A blend file is attached here for this error
Export_Fail_Action_issue.zip
2) Export times
with blender 3.1.2 and exporter 1.1.6
Complex Interior export = 2 min
Complex Exterior export = 1 min
with Blender 3.3 and exporter 1.1.7
Complex Interior export = 55 min
Complex Exterior export = 6 min
the new exporter 1.1.7. exporting time makes the new exporter with blender 3.3, unusable for production.
3.1.2 has unfortunately missing features, therefore also not that useful in the meantime.
I cannot share the upcoming model with the public for you to replicate the issue.
There are more issues to come that wasn't able to isolate yet.

Your second issue is is due to a core blender change to the way animation are done.  Blender has changed this from version 3.1 to 3.2+. You need to remain at Blender 3.1 for models developed in 3.1,  Only new projects started in blender 3.3 will export faster.
The exporter version 1.1.7 (1.3.0) will work with blender 3.1 and 3.2+

For your first issue. was this file made in Blender 3.1 and you now try to export in 3.3?  I can reproduce the problem in 3.3.  I can export the blend file in Blender 3.1 with the 1.3.0 (1.1.7) version of the exporter in Blender 3.1

May we use this blend file as an example to Khronos of the issue.  The errors seem to point directly to current khronos code not being compatible with blend files fromBlender 3.1

May we use this blend file as an example to Khronos of the issue. The errors seem to point directly to current khronos code not being compatible with blend files fromBlender 3.1

Hi Rohn,
to be honest, the whole assembly with animations was initially created with Blender 3.2 and exporter 1.1.6 until 80% of completion.
The export times were already long very with blender 3.2 and exporter 1.1.6
We then basically moved to from 3.2 to 3.1.2 because export times were under 1 min time instead of 1h, also other exporter limitations were not existing with 3.1.2.
The issue is we cannot finish the project with blender 3.1.2 because the Asobo exporter has 1.1.6 missing features when it comes to export animated skinned meshes (there is another thread where I explain these here: https://github.com/AsoboStudio/glTF-Blender-IO-MSFS/issues/184)
We need blender 3.3 and exporter 1.1.7 to be as performant as Blender 3.1.2 and exporter 1.1.6

We are attempting to figure out why the export times are so long.  We believe it's an issue with how Blender/Khronos have changed the animations internal to the blend file.  I am in the same boat, long exports.
The exporter ver 1.3.0 will work with Blender 3.1.2 - There is only a single shader node name change  for 3.3 and we check what version blender you are running.  Is it the ASOBO exporter missing the skinned mesh features or is it Khronos gltf core Blender missing that feature.

May we use your blend file that you gave us above to show khronos/Blender group an issue with 3.1 to 3.4 file problems.

May we use your blend file that you gave us above to show khronos/Blender group an issue with 3.1 to 3.4 file problems.

The blend file above is the not the entire aircraft assembly, it's just a surface, the export times there are very fast.
I cannot share with them a confidential assembly, I would need to create a dummy of it.

I just want to show them that blender 3.3.3 errors out while blender 3.1.2 works when exporting the gltf.  You blend file above exports with 3.1 but has an error with 3.3

I just want to show them that blender 3.3.3 errors out while blender 3.1.2 works when exporting the gltf. You blend file above exports with 3.1 but has an error with 3.3

Feel free to share it, I am actually almost done with creating a dummy from the main assembly, this file takes very long to export.
I would need the guy's email to send him the data privately, you can send that to me as a private msg

I see you have left a post on the khronos thread, that's the guy we are trying to convince that there is an issue.

Hi there, any improvement on the export timing?
Blender 3.3 is now officially supported by Asobo but to export a complete assembly takes more than 1hour...
the same file on blender 3.1 takes less than 2 minutes.
please support this.

Hello,
Export timing is handled by io_scene_glTF official exporter, we only add extensions to some parts of the final gltf so that it is compatible with Microsoft Flight Simulator. For now we need to stick to Blender 3.3 because it's the last Long Term Support version they have.
Thank you for your report.


[release-1.4] Fix a group of mixer attributes generated from k8s when pod name contains dot

This is an automated cherry-pick of #20026

@zhranklin could you please make the google bot above happy?


1.1.9

Summary by CodeRabbit

New Features

Introduced new test scripts for enhanced testing capabilities.
Updated prompting system with more detailed example responses.
Revised tipping command to accept a single username and added a token parameter.
Added a new command /id for retrieving group IDs.
Implemented a new gated group chat feature with an admin bot.

Bug Fixes

Improved user information handling by normalizing input parameters.
Enhanced error handling for command execution issues.

Documentation

Enhanced clarity in documentation for the ENS agent and other components.
Updated various sections to reflect changes in functionality and structure.
Corrected typographical errors in the fine-tuning documentation.
Added a new section for "AI Skills" outlining a framework for building AI agents.
Introduced comprehensive guides for username resolution and gated group chat setup.

Chores

Removed outdated tutorials and test files to streamline the codebase.
Updated configuration files for better organization and clarity.

@coderabbitai resolve

@coderabbitai pause

@coderabbitai summary

Thank you! changes made in up coming PR!

@coderabbitai summary

@coderabbitai cna you resume summary

@coderabbitai resume

@coderabbitai summary

@coderabbitai show me the summarrry


Update home page statuses to open, upcoming & closed

-update the text for homepage status filters
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of the met-public license (Apache 2.0).

Codecov Report

Merging #1547 (bd2facf) into main (79a8314) will increase coverage by 0.00%.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main    #1547   +/-   ##
=======================================
  Coverage   71.92%   71.92%
=======================================
  Files         338      338
  Lines        9973    10009   +36
  Branches      727      741   +14
=======================================
+ Hits         7173     7199   +26
- Misses       2678     2688   +10
  Partials      122      122

Flag
Coverage Δ

metweb
65.32% <ø> (+0.04%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.
see 6 files with indirect coverage changes


Desktop loading Haven listing (Phsyical Good, Used) shows placeholder for Condition value

Brief Description: Desktop loading Haven listing (Phsyical Good, Used) shows placeholder for Condition value
Operating System (OS and version): Mac
OpenBazaar version (shown on About OpenBazaar page in menu): v2.3.4
Reproducible (Always / Almost Always / Sometimes / Rarely / Couldn't Reproduce):  Always
Steps to reproduce:

Create Used Physical Listing in Haven
(Example: https://openbazaar.com/store/QmWjUvxugYHZ1qKKZVt7qRHdFzWG5PzL6GUo35TiiuwQLQ/test-textiles or ob://QmWjUvxugYHZ1qKKZVt7qRHdFzWG5PzL6GUo35TiiuwQLQ/store/test-textiles)

Observed Behavior:
Placeholder for the "used" text.
Expected Behavior:
Just the word "used" or similar.
Additional info (links, images, etc go here):
https://www.dropbox.com/s/084otbu7hlxofkv/screen shot 2019-07-20 at 3.19.22 pm.png?dl=0

@mg I can't get that listing to load. Would you mind posting a screenshot of how it looks on desktop, I'm not sure what you mean by placeholder?
Also if you could post the payload of http://localhost:4002/ob/listing/QmWjUvxugYHZ1qKKZVt7qRHdFzWG5PzL6GUo35TiiuwQLQ/test-textiles.
Thanks.


Participant email status is wrong

Kayako ticket 310960
mail status says "not received" but participant confirms it was received and opened

Tested but unable to reproduce. Tested with multiple parties, multiple emails (providers) and multiple mail clients. All showed the correct status of the mail. No false positives

Thanks for taking the time to check this @mvanspringel


Feature/hybrid runtime group

Short Description
Remove datafactor attribute from tasks, add HybridRuntimeGroups
Proposed Changes

flexible hybrid runtime groups when candidate is detected

Fixes:

context pad: element cannot be replaced by itself
remove existing groups to avoid multiple groups

Follow-up at #47


Ship -Os variants

They are slower, but roughly half the size.
We should ship an -Os variant of every wasm module and let the user select either small module size or performance.

042472cab0be82b4b19a6ad4d265872bd030f0bd adds an option to generate size-optimized builds but the reduction is only marginal.
Closing this issue for now, as compiler flags alone (-Os/-Oz/inline limit) won't be enough.
We probably need to look into making dependencies such as Parquet optional.


visual studio code no writing

Could help me please editor visual studio code no working, no writing thanks

/needsMoreInfo


Move kotlin lib onboardingpayload to package matter

The plan is to consolidate all kotlin libraries into package matter to integrate seamlessly with existing Kotlin libraries to create a complete suite of Kotlin APIs.
This is a mechanical package name adjustment with no changes to the underlying logic.

Holding land this PR after all affected companies are fully aware of this change.


helpwanted: subdirectories not recognised

Heya, so I'm running a mono repository with the following stack, however, whenever I try to use your extension it won't see any of my packages. I'm not very good with regex so that might be the issue (reset it to standard now).
root: smartcloud-dev
./package.json
./packages/public/components/package.json
./packages/public/webfront/package.json
./packages/public/webpanel/package.json
./packages/containers/discord/package.json

Those settings are for the icons only.
You need to configure your monorepo using one of npm7, yarn, lerna, pnpm, ...
The easiest in your case, would be to edit the package.json file in your top-level directory and add a workspace key as in:
``json
{
"workspaces": [
"packages/**/*",
],
}


Group "static" functions separately from instance methods

In cases where we assign functions to a constructor, it would be useful if the docs separated these from the method listing.  The two groups could be called "Methods" and "Functions" on a doc page.  For example, the ol.geom.Polygon doc could list ol.geom.Polygon.circular under "Functions" and the rest of the methods under "Methods."
If this is more trouble than its worth, blame it on #2345.

Want to back this issue? Place a bounty on it! We accept bounties via Bountysource.

@tschaub is is still relevant?


Callling .\vscode\scripts\code.bat --version does not print the version

VSCode Version: 1.15.0, commit b689bbe99ea8ecc602520ed8c8b775d46429bc4f
OS Version: Windows 10 build 15063

Steps to Reproduce:

Compile VSCode from its source
Open a command line and run .\vscode\scripts\code.bat --version
VSCode will not print version and will open normally

It is expected to:

VSCode print its current version and exit, if there is not a VSCode instance running
VSCode print its current version and keep running, if there is a VSCode instance running

Reproduces without extensions: Yes

Update:
Calling it with --help also does not print help.

It's .\scripts\code-cli.bat --version

Thanks!

But when should I use code-cli.bat and code.bat?
It was asked on stack overflow, but no answers:

StackOverflow$45205159 What are the files code.bat and code-cli.bat on VSCode Editor project?

You should use code-cli.bat when you want to test the cli features, and code.bat otherwise.

Seems by the context, with cli you mean Command Line Interface. But why the otherwise? Why I should not always use the code-cli.bat?
It means there are features present on code.bat which are not present on code-cli.bat?


Change return type of addTextureTask to IAssetTask

Currently it uses the more specific ITextureAssetTask which will disallow e.g. that:
const task = this.loader.addTextureTask("download texture", "/textures/" + file)
task.onError = (task, message, exception) => { }

Which works for all the other tasks.
Current workaround:
typecasting

That's interesting! Probably because of the strict function types that was just introduced. I assume you are using typescript 2.6?
I think we will need a better solution that this eventually. I am merging this and will later check how we can improve this.
Thanks a lot!

Wow, that was fast!
Yep, that's probably why.


Export prometheus metrics at /metrics

Problem

I'd ultimately like to expose metrics to prometheus from most of my operators so having a blessed way to do it via the built in kopf aiohttp server would be very nice, rather than rigging something up in each project.

on.probe is close, but i'd like something prometheus can scrape directly.
Proposal

My preferred solution would be to have kopf natively support prometheus via its existing aiohttp server. That means it would set up an aiohttp route that did something ran the prometheus collector and served the results. Ideally would also be a handler so can mix in metrics that have been generated dynamically at probe time.
Failing that a hook to allow me to at least piggy back on the existing aiohttp and reduce some of the duplicate boiler plate code.
I think prometheus is the most common monitoring tool on kubernetes so others may find this useful too.

One pattern with prometheus is to make a custom 'Collector' class that yields MetricFamily objects. We would have a aiohttp view that created such a collector and it would call all the kopf.on.prometheus handlers and allow them to yield metric families:
from prometheus_client.core import GaugeMetricFamily

@kopf.on.prometheus
def collect_prom_metrics(self):
    my_measurement = GaugeMetricFamily('my_measurement', 'some description', labels=["label"])
    my_measurement.add_metric(["mylabel"], 52)
    yield my_measurement

This technique is used if you are calculating the metric or sampling it from an external source.
The other option is used when you are instrumenting the operator itself:
from prometheus_client import Counter
MY_COUNTER = Counter(
    "resource_created", "Resource created by operator", ["labelkey1", "labelkey2"]
)

@kopf.on.create(...snip...)
def myhandler(**kwargs):
    MY_COUNTER.labels("labelvalue1", "labelvalue2").inc()

I'm thinking of working on this is people think it would be good to have. I hope to implement it in a way that keeps the prometheus dependency optional.
Although it would be good to instrument kopf itself at some point I think that is a seperate feature/request.
Checklist

[x] Many users can benefit from this feature, it is not a one-time case
[x] The proposal is related to the K8s operator framework, not to the K8s client libraries

My approach to this was going to be to add a route to the existing aiohttp.web.Application(), the question is would it be ok for the functionality to live in probing.py or does it need breaking out somehow?

Hm. First of all, I am not familiar with Prometheus, so have to read & learn the concepts first, before making any judgements.
Nevertheless, despite I understand that Prometheus is a popular (or the most popular) monitoring tool now, it all can change. Beside, there can be other opinions, and I do not like pushing my or someone's personal preferences as unavoidable defaults for everyone (see a counter-example: Black).
Before we go into deep integration with Prometheus with same-named decorators in the public interface, I would like to clarify few things:
Can the Prometheus metrics be served in a separate thread on a separate port as in their README? What are the benefits of tight integration? is it the usage of the probing/metrics decorators?
Can this Kopf's feature be generalised for any monitoring system? Perhaps, different endpoints with different output formatters?
Can Kopf be extended or redesigned somehow, so that becomes extensible for these metrics and endpoints, but does not contain them directly? Specifically, can Kopf be made pluggable, and Prometheus-specific tooling implemented as another Python library with some hooks/connections points to Kopf (see pytest plugins as an example)? The authentication subsystem can also benefit from this pluggability.
Also, can you please clarify why kopf.on.probe is not sufficient? Is it a different output format only? Or are there other challenges of using the probe-handlers?

Also, @kopf.on.prometheus sounds unusual. The original intention was to use verbs there (on.create), with growing urge to replace them with proper English nouns representing events or actions (on.creation). In a work-in-progress branch I already have a case that does not fit the convention, and use a separate decorator naming convention: @kopf.daemon (no .on.). We can think of @kopf.metric — but the question is: do we need it at all (see above)?

All good points!
Can the Prometheus metrics be served in a separate thread?
In general I don't like using their threaded web server in a thread when aiohttp is available. This is probably a personal preference thing, but at a technical level there are 2 main issues:

If you want to run a collector that uses async you can't use their server.
You have done some good work to integrate the aiohttp server into the kopf lifecycle. I want to leverage that. Theirs (i assume) uses daemon threads so the OS will just pull the rug from under the thread when kopf exits.

Can this Kopf's feature be generalised for any monitoring system?
The problem with a generic monitoring integration is that they all provide helpers that you'd have to implement to be as nice to use. For example:
REQUEST_TIME = Summary('request_processing_seconds', 'Time spent processing request')

# Decorate function with metric.
@REQUEST_TIME.time()
def process_request(t):
    """A dummy function that takes some time."""
    pass

This will generate 2 metrics: request_processing_seconds_count and request_processing_seconds_sum.
Building an abstract version of this is probably not something that belongs in kopf, even though monitoring is very important for most operators.
Can Kopf be extended or redesigned somehow, so that becomes extensible for these metrics and endpoints, but does not contain them directly?
There are maybe 3 changes I would like if there wasn't native prometheus integration:

Factor the aiohttp code out of probing.py so it can be reused by the operator for its own services. This is mostly about the little details like not handling signals and having it automatically shutdown when kopf goes away.

I would quite like to be able to control the routes (at least at my own) to a single aiohttp. It's arguably a taste thing but I don't want to listen on multiple ports if i don't need to.

I'm glad for kopf.on.startup() and @kopf.on.cleanup(), but one pattern that might be useful is kopf.background_task - something that is started on startup and it gets .cancel() and awaited on cleanup automatically. I take this a bit further in some of my code and restart background tasks if they hit an unhandled exception.

import asyncio

import kopf
import kopf_prometheus
from prometheus_client import Counter

MY_COUNTER = Counter('my_requests_total', 'HTTP Failures', ['method', 'endpoint'])

async def my_collector():
    yield SomePrometheusMetric()
    yield SomeOtherMetric

async def my_looping_function():
    while True:
        c.labels('get', '/').inc()
        asyncio.sleep(1)

kopf.background_task(my_looping_function)
kopf.background_task(kopf_prometheus.listen, port=8080, collectors=[my_collector])

Are there other challenges of using the probe-handlers?
This is mostly just down to the output format plus the richness of the prometheus_client API. You could probably serialize the prometheus data into probe format, but then you'd need get it back into prometheus format. A prometheus metric has a timestamp and multiple labels associated with it (and that means a single metric maybe listed multiple times) so there are some challenges there too, possibly.

… integrate the aiohttp server into the kopf lifecycle. I want to leverage that.

That is exactly the point I see as problematic here:
aiohttp is an internal implementation detail, the current way to expose the liveness via HTTP. The public interface only has the concept of liveness probes and some rudimentary metrics (domain-level concepts), not the way how they are exposed to K8s (implementation details).
Injecting endpoints assumes either that the internal implementation detail (aiohttp server) is exposed and made part of the Kopf's public interface (see leaky abstractions), or that Kopf is extended with a lot of features which are more suitable for a web server (e.g. routes and endpoints).
Neither of this looks good. I prefer that the framework is not pulled back by the presence of aiohttp specifically when it comes to changing the way the HTTP(S) probes are served — as long as other features on their abstraction levels (e.g. liveness probes) could be served.

One way how this could be generalised is, indeed, a daemon-handler for the whole operator. I currently have them implemented per-object in my own branch (and struggle only with some dirty tricks to be resolved to a clean code).
But it can be easily extended to have per-operator daemons, and those daemons can be async def functions that run their own web servers (maybe even aiohttp in the same event loop), and cancelled as all other async coroutines with the operator shutdown.
Reproducing your example:
import kopf
import kopf_prometheus  # somehow, by someone

@kopf.daemon(errors=kopf.ErrorsMode.TEMPORARY, backoff=10)
async def prometheus_server(**_):
    server = kopf_prometheus.create_async(port=8080, collectors=[my_collector])
    await server.run()  # the same asyncio event loop as the operator

@kopf.daemon()
def my_looping_function(stopped, **_):
    while not stopped:
        c.labels('get', '/').inc()
        time.sleep(1)  # asyncio-safe: runs in a thread

The pre-operator daemons are not in that branch yet, but once per-resource daemons are there, it is easy to implement.
@Jc2k What do you think on this? Would this feature solve the problem (assuming that someone somehow will make a Kopf<->Prometheus connector library).

PS: Maybe even a global timer:
@kopf.on.timer(interval=1)
def my_timing_function(**_):
    c.labels('get', '/').inc()

Yes, this sounds great! I would probably make such a prometheus connector if kopf.daemon was available.
Seperately I do have use for a timer as well, but not for the interval=1 case thankfully :D


[T2A1][T1-04]Dao Han

Refactored some code

@DaoHanLim Some comments added. Please close the PR after reading comments.


package.json: tidy up a couple things

Remove the duplicated chai entry.
Move uuid into devDependencies.

@davidvgalbraith

+1

This moves uuid to engines, not devDependencies. Will prepare a quick fix.


Add installation instructions for optional packages to documentation

We now have a few optional packages that can be installed alongside featuretools after merging in #551.
We should include these in the documentation in the install page. We should also update the github readme.

resolved by #617


fix: Update the tauri version to resolve tauri error

Thanks! I'm running into the same error:
error[E0308]: mismatched types
    --> /home/karlk/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tauri-2.0.0-beta.17/src/webview/mod.rs:1078:5
     |
1077 |   pub fn url(&self) -> Url {
     |                        --- expected `url::Url` because of return type
1078 |     self.webview.dispatcher.url().unwrap()
     |     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ expected `Url`, found `String`

This PR fixes it for me.

Thanks for this PR but it only upgrades the version for the main crate. The version also needs to be bumped for the docs and examples to ensure it's working.


Search results and Quick navigation

This branch implements:

Search results page
Tags redirect to the search results page with filter
Quick navigation with ctrl+k, looks for exact, tags, and search

Currently, this branch contains a client patch to tweek-clients, once tweek-clients is updated this patch is no longer needed

After merging tweek-clients the patch should be removed, right?

Yes


Version 3.0/PSR-7 integration?

Dear ZF Team,
Is there a roadmap or plans for version 3.0 of this component, making it PSR-7 compilant?
Thinking about it, I can see 3 major responsibilities of this repo:

HTTP message abstraction
header manipulation
HTTP client

With zend-diactoros covering "HTTP message", zend-http could be ultimately split into two repositories. A lot of PSR-7 applications could benefit from good header manipulation library (I didn't see anything like this centered around PSR-7 yet), that can be developed without spending time on migrating the client (well, we have Guzzle).
What do you think?
best,

For migration purposes, we will be keeping the component essentially as-is. The ZF2 MVC utilizes this component heavily, and we do not want to make migration from 2 to 3 difficult for MVC applications.
Additionally, the HTTP client predates Guzzle by several years, and is in use in a large number of applications; we do not want to make migration too difficult.
We will likely steer people towards PSR-7 implementations in the future, and I expect we'll take some of the header implementations here and migrate them to another library for folks to consume; however, we'll keep them intact here for existing users.
Otherwise, this component will not have active development going forward.

Thanks for your explanation.
So, if I understand it correctly, ZF3 MVC will still be based on zend-http's HTTP abstractions instead of PSR-7 (perhaps with some bridge, like in Symfony)?
I was asking, because I'm actually already using part of this library in my PSR-7 project, but it just feels bad to include full zend-http and its dependencies only to parse Content-Type header. Likely some of header classes would become easier to use if they had PSR-7 specific methods (like FIG Cookies).
Is there anything that can be done to make this separate header library sooner than later? I don't think there is a PSR-7 library like this around, and likely the demand will rise soon (even for Apigility 2.0?).

there is https://github.com/zendframework/zend-psr7bridge for it, it can be closed.

This repository has been closed and moved to laminas/laminas-http; a new issue has been opened at https://github.com/laminas/laminas-http/issues/26.


VB Documentation?

Hi there :),
I have a game on the Xbox Live market place that I would like to incorporate Leaderboards and Stats, but I don't see any C# or VB documentation on how to go about this.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 79bc388d-6b0d-d201-19a9-4055cb14ef88
Version Independent ID: aa039e5c-9126-265c-773e-9db63471e6fd
Content: Updating Stats 2017 - UWP app developer
Content Source: windows-apps-src/xbox-live/leaderboards-and-stats-2017/player-stats-updating.md
Product: windows
GitHub Login: @KevinAsgari
Microsoft Alias: kevinasg

Hello aaronlevicarrick,
Is your game built with Unity or a UWP title?
If it's built with Unity, you may want to read Player Stats and Leaderboards in Unity

Aaron thanks for getting back so quick,
It is a uwp game written in vb.

From: Aaron-Micheal Blackman<EMAIL_ADDRESS>Sent: Friday, August 24, 2018 10:05:53 AM
To: MicrosoftDocs/windows-uwp
Cc: aaronlevicarrick; Author
Subject: Re: [MicrosoftDocs/windows-uwp] VB Documentation? (#930)
Hello aaronlevicarrick,
Is your game built with Unity or a UWP title?
If it's built with Unity, you may want to read Player Stats and Leaderboards in Unityhttps://docs.microsoft.com/en-us/windows/uwp/xbox-live/get-started-with-creators/add-stats-and-leaderboards-in-unity
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/MicrosoftDocs/windows-uwp/issues/930#issuecomment-415821066, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AorpSjGxJQ3yJyiGuD11-JuUCDfATKM3ks5uUDJxgaJpZM4WKbKZ.

Hello Again,
In your query you asked for C# or VB code examples.
Would C# code be sufficient for your needs? I ask because while I can't make any promises on turn around time, the turn around time for adding C# code snippets will likely be shorter.

C# would be great i can program in both
Sent from my Windows Phone

From: Aaron-Micheal<EMAIL_ADDRESS>Sent: 8/24/2018 10:59 AM
To<EMAIL_ADDRESS>Cc<EMAIL_ADDRESS><EMAIL_ADDRESS>Subject: Re: [MicrosoftDocs/windows-uwp] VB Documentation? (#930)
Hello Again,
In your query you asked for C# or VB code examples.
Would C# code be sufficient for your needs? I ask because while I can't make any promises on turn around time, the turn around time for adding C# code snippets will likely be shorter.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/MicrosoftDocs/windows-uwp/issues/930#issuecomment-415835749, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AorpSm0UiwG_tfdNYX_HuB9RfslcbY8qks5uUD7wgaJpZM4WKbKZ.

Hello again aaronlevicarrick!
I added the C# equivalent snippets to the code already contained in the article. You should be able to see the changes around 12pm tomorrow. I hope that helps.

Thanks a bunch!! You rock, this is a big help
Sent from my Windows Phone

From: Aaron-Micheal<EMAIL_ADDRESS>Sent: 8/24/2018 3:49 PM
To<EMAIL_ADDRESS>Cc<EMAIL_ADDRESS><EMAIL_ADDRESS>Subject: Re: [MicrosoftDocs/windows-uwp] VB Documentation? (#930)
Hello again aaronlevicarrick!
I added the C# equivalent snippets to the code already contained in the article. You should be able to see the changes around 12pm tomorrow. I hope that helps.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/MicrosoftDocs/windows-uwp/issues/930#issuecomment-415902102, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AorpSiH7d9h5i5xl6CXl4DtJu3rKolTqks5uUILxgaJpZM4WKbKZ.

I'm glad I could help =)


[en] Update operator.md

fix subject

@divya-mohan0209
I'll take your advice cause it's more readable.
Thanks.

Please could you squash & merge the changes into one commit? I'll add an LGTM and have another sig docs reviewer approve it then

@divya-mohan0209
Done!

/lgtm

/approve


Can't show methods of String in "libcollections\str.rs"

Race only show methods of String in "libcollections\string.rs" but none in "libcollections\str.rs"
The code below only show "truncate" but not include the method "trim" of &str
let mut s = String::new();
s.tr
platform:win7 x64
rust 1.2.0 stable

The method "trim" of str that I want to display was not there.

Hi Varding,
Thanks for the issue, I'll take a look, possibly this evening
On Tue, Aug 11, 2015 at 2:57 AM, varding<EMAIL_ADDRESS>wrote:

[image: image]
https://cloud.githubusercontent.com/assets/4688041/9188469/0671f6f6-400f-11e5-96ce-90907cdda811.png
The method "trim" of str that I want to display was not there.
—
Reply to this email directly or view it on GitHub
https://github.com/phildawes/racer/issues/328#issuecomment-129673267.

@phildawes is there anywhere online is there tutorials to show a newbie how to install racer? Im not familiar with the terminal and I really like what racer is purported to do. As a newbie any feature that can cut time can give me more time to study and learn the Rust language. Im trying to install it for use in ATOM and have no clue what i'm doing. Im on mac OS X 10.10.3

@Rodney-Gabriel. I'm afraid being familiar with your environment (e.g. the terminal, your editor) is pretty-much a prerequisite for using rust/racer, as I don't have the available time/manpower to orient instructions to an absolute beginner, sorry.

Hi @varding, Thanks for the issue. I'm afraid resolving &str methods for String requires racer being able to follow deref-coercions. I've opened #334 for this enhancement.

@phildawes
Great! Thank you for your hard work on Racer!!


Jean-Philippe Paradis fails to remove users as requested. Can't recommend this website.

Be very careful about using this website and anything related to the owner 'Jean-Philippe Paradis' alias 'Hexstream'.

Don't be fooled by his policies. He does not care.

The policies very extensively explain why I can't simply remove objectors.
Nobody has even tried to challenge these extensive rationales as of yet.

I'm not sure what it is you claim I do not care about.
I care about the Common Lisp community, for instance.
I don't believe you do.

I don't want anything other than NOT appearing with my personal data in any of your websites.

See note in bold here.
You will not be able to intelligibly debate about the policies until you read them and understand them.

I'm not sure how this translates into a "hostage" situation.

 Just delete me.

Civil society is built on policies. Is civil society childish, then?

Delete me.

That may be why you behave like an entitled child.

You have yet to explain how this translates into a "hostage" situation.

I don't want to explain anything. Just remove me.

I don't care for what you are available. I don't want to be on your website. Delete me.

Per the policies which you don't care about but are still in force, I cannot simply remove objectors.
As previously stated, you may register as an Objector if you wish, and this is the only remedy I have to offer you.
Thank you, and please consider having a good night's sleep before engaging further.

Look, I don't want to register. I want to be removed.

This is the third time I have to ask how this translates into a "hostage" situation.

 Instead you want me to register.  I want to be deleted.

delete me from your website

I hope one day you'll look back on your current behavior and laugh.

delete me from your website.

May you grasp this opportunity for great personal growth.

I have opened a privacy violation issue at Github. You will hear from them.

This is within expectations. I am looking forward to it.

delete my data instead.

I was looking forward to a healthy public debate, yet all you have to offer is empty repeated demands (and a threat).

This is the fourth time I have to ask how this translates into a "hostage" situation.

Delete me.

You are wasting your own time, and mine also.

Delete me, now.

Rainer Joswig (lispm) shat here then deleted all his messages in shame, I'm not sure what the hell kind of a strategy that is...


update quickstart generate sample

Related issue
N/A
Proposed Changes
Fix quickstart RBAC
Checklist

[x] I have read the contributing guidelines.
[x] I have inspected the website preview for accuracy.
[x] I have signed off my issue.

/cherry-pick release-1-13-0


Use svg deploy with balena button

@xginn8 @iamsolankiamit check #1532 for updated version. This can be closed once that is merged.

Closing in favor of #1532


Fix Paella 7 with no segments

This patch fixes the issue that Paella player 7 will run into an error if a video has no segments, for example, because the slide detection did not run.

Fixed in paella-slide-plugins in:
https://github.com/polimediaupv/paella-slide-plugins/pull/4
Your pull request should…

[x] have a concise title
[x] close an accompanying issue if one exists
[x] be against the correct branch
[x] include migration scripts and documentation, if appropriate
[x] pass automated tests
[x] have a clean commit history
[x] have proper commit messages (title and body) for all commits

This fixes the bleating goat test video, which didn't work without this.  The rest of the default testing videos are blocked by #5536


Auto-eject from machines not working with Thermal Dynamics

I have elite enriching factory chewing coal ores. Output side (blue) is set to back where is a Warp itemduct. That in turn connected to ME interface from AE2 with a filter with "Allow over-sending". So basically it's trying to put item into pipe with infinite and instant transfer capacity. But it's not sending anything. If i add resonant servo to pull instead it will work, but it only keeps up with 2 of the output slots, leaving 5 processing lines go idle.
I tested outputting to right side into chest and it works. Also this bug i've seen at random times in many different versions of Mekanism, that machines are not out auto-ejecting.
Mekanism-1.7.10-<IP_ADDRESS>8

I can't even begin to tell how bad that setup sounds.

All other mods machines are fine with outputting into those ducts though, including TE and EnderIO. So how can you tell which mod is using API's or something wrong, TD or Mek? Would you think TD contains any EnderIO specific code?
Not sure what you mean by bad setup, it's made for endgame carrying capacity. ME interface can handle way more items than almost any sum of machines can output.

While ME can handle any load, TD can't. It's severely limited by the
servos. ExU pipes are much better for close ranges.
It's pretty likely that EIO has some related code.
I can't see the code right now, but it looks like there's simply no
autoimport slot in the pipes.

Checked EIO code. It seems to actually do the insertion through cofh apis.

I ran into a similar issue yesterday, only with logistics pipes (from the LP mod, not Mek's version). I had four enrichment chambers in a row, each one block apart from the others. Itemducts inputting into the top, power into the bottom, with basic logistics pipes handling output at the back... Only the enrichment chambers would not eject into the logistics pipes. The enrichment chambers were configured to auto-eject with their output set to the back, but nothing. I've got a room full of TE, EIO, and Mek machines, and they all output into the logistics pipes just fine except for the Mekanism ones. Eventually I just replaced those logistics pipes with itemducts, with signalum servos pulling out the back, ran the item ducts to feed into my logistics pipes network, and that worked. Not a big deal, but a little weird.

I don't think this is an issue on my end, assuming you're using the latest release of Mekanism.  I'd be happy to reconsider if this is isolated to be on my side.

This is simply Mekanism not implementing the CoFH API. Nothing more.

And yeah i tested on the very latest (1.7.10-<IP_ADDRESS>1) version of Mekanism. Those 2 other machines are outputting into pipe fine:
http://imgur.com/a/TqLn8


no statistic for user

Hello
I use redhat and external mysql server (aws) after migrating to external mysql, no showing user statistics. Can someone  advice what to edit ?

@golimer can you confirm that RADIUSDesk is not using references to localhost? This is because the installer does a default installation with localhost as the local MySQL instance.

Yes it's true. So that is why asking where to change variable.... :( cause i use aws and have seperate mysql is much safer than in one place with plaintext passwords :)

To make changes to some of the variables, check roles/radiusdesk/vars/RedHat.yml. Look for variables like rd_db_user, rd_db_password, rd_db_name and mysql_db_hosts. Let me know how it goes. I might try using a seperate AWS server to see what needs to be tweaked.

everything works in production except user history
after /usr/share/nginx/html/cake2 /usr/share/nginx/html/cake3 changing mysql credentials

@golimer sounds like an issue with the upstream project (RADIUSDesk) and not the installer. You can reach me via email muffycompoqm[at]gmail[dot]com so we can troubleshoot some more. There may be some hard coded references (to mysql on localhost) somewhere in the codebase of RD but we will have to find out.

@golimer, thank you the feedback once again, I have added the ability to use an external AWS RDS mySQL server by enabling an option in the variables file (roles/radiusdesk/vars/{Debian|RedHat}.yml) called enable_aws_rds_support. Changing this to true and supplying your RDS endpoint/host, and master username & password should point RADIUSDesk to the appropriate database references. I will work on a small documentation to others will benefit from this. Thank you again for point this requirement out.


.travis.yml - Added swiftlint unlink to script

Current coverage is 93.10% (diff: 100%)

No coverage report found for master at fe821fa.

Powered by Codecov. Last update fe821fa...4fe9208

@calebkleveter - Thanks man!


Define high level metric(s) to guide data acquisition strategy (March 31st) (Generative workshop)

Completed in late April


not all vendor list are shown in the dropdown list : purchase module

only 20 vendor name  list is available on vendor dropdown

last 5 customer name is repeating

issue closed


Component API

Changes
As we increase our dependence on our own SQL tools, I think it was time we added an API to easily add and maintain different services.

[x] Install components if not installed
[x] Check the state of a component (installed or not)
[x] Improve version control of individual components
[x] Added SQL_TO_CSV component
[x] Added IFS_WRITE component
[x] Inner component dependencies? (SQL_TO_CSV depends on IFS_WRITE)
[ ] Fix handling of null values in SQL_TO_CSV
[ ] Write components to a new dedicated library if available
[x] Test cases for runSQL API using SQL_TO_CSV
[ ] Encoding tests (steal from #1983) to verify SQL_TO_CSV
[ ] Improve type system of ComponentManager
[x] #1968 merged

How to test this PR
Examples:

Run the test cases

Checklist

[x] have tested my change
[ ] have created one or more test cases
[ ] updated relevant documentation
[ ] Remove any/all console.logs I added
[ ] have added myself to the contributors' list in CONTRIBUTING.md

@worksofliam @sebjulliand I think it would be great if the extension would

check the component versions installed on the server on first connect after extension update and install any component not there or not up to date
use a versioning method that also covers CL objects - CL programs don't have long comment like SQL objects, and we may introduce non-SQL components later on (we had that for command definitions before it was moved to the CL extension). We could use the object text to have the version information, e.g. 'v1 Code for IBM i: Get something...'.

@chrjorgensen Per your second point: each component has their own getInstalledVersion method which returns a number. Each component can have their own version checker. So for CL, we might use SQL to get the object text, whereas for SQL objects we might use the comments.

@codefori/core Any chance I can get a midpoint review on this API changes so far?

Here are some of the failing tests due to some issues in SQL_TO_CSV that I am going to need some help with:

This one looks like it should be passing?

@sebjulliand Thanks for your review and commits! I take it you are okay with my implementation of the getComponent API?

Got this error:

@chrjorgensen Any chance I can get your help correcting / adding the GRANT to each SQL component here after the create statements?

@worksofliam Sure. Do we agree that all users should be able to replace the SQL components?

@worksofliam I added GRTOBJAUT to all SQL components instead of GRANT... since GRANT does not give *OBJMGT required when replacing a function / procedure.
https://www.ibm.com/docs/en/i/7.5?topic=statements-create-function-sql-table

We still have two failing tests which, until I have fixed, will hold this PR up:

This one less important:

CALL ILEDITOR.SQL_TO_CSV('With MEMBERS As (         SELECT           rtrim(cast(a.system_table_schema as char(10) )) as LIBRARY,           b.avgrowsize as RECORD_LENGTH,           a.iasp_number as ASP,           rtrim(cast(a.system_table_name as char(10) )) AS SOURCE_FILE,           rtrim(cast(b.system_table_member as char(10) )) as NAME,           coalesce(rtrim(cast(b.source_type as varchar(10) )), '''') as TYPE,           coalesce(rtrim(varchar(b.partition_text)), '''') as TEXT,           b.NUMBER_ROWS as LINES,           extract(epoch from (b.CREATE_TIMESTAMP))*1000 as CREATED,           extract(epoch from (b.LAST_SOURCE_UPDATE_TIMESTAMP))*1000 as CHANGED         FROM qsys2.systables AS a           JOIN qsys2.syspartitionstat AS b             ON b.table_schema = a.table_schema AND               b.table_name = a.table_name       )       Select * From MEMBERS       Where LIBRARY = ''QSYSINC''         And SOURCE_FILE = ''QRPGLESRC''                         Order By NAME DESC', '/tmp/vscodetemp-O_jj1aTKjM')

--DB2>
--  ?>
--
-- **** CLI ERROR *****
--         SQLSTATE: 22001
--NATIVE ERROR CODE: -302
--Conversion error on variable or parameter SQLP_L2.FILE_CONTENT.

Niels provided me with an updated IFS_WRITE that supports the clob parameter. I need to update the version used here to use that instead.
https://gist.github.com/NielsLiisberg/cd2350aee85f5b2e967993faf7ea7595

@sebjulliand @chrjorgensen
This PR is now open again and ready to be tested. Some questions:

SQL_TO_CSV and IFS_WRITE were added to this PR, but it is not using them. I hate to say it, but CPYTOSTMF is significantly faster than SQL_TO_CSV, as proven by the test suite (specifically the 'getMemberList (advanced filtering)' test). Do you think we should just remove those component?

@worksofliam Didn't we start using pure SQL to get the line numbers and line dates from members, which CPYTOSTMF does not provide?
If people using these are punished performance-wize, so be it. Could be a motivator for moving to streamfiles and git! 😉

@chrjorgensen

which CPYTOSTMF does not provide?

Right, but we only use CPYTOIMPF on temporary objects in QTEMP!

@sebjulliand I have removed SQL_TO_CSV and IFS_WRITE from this PR seeing as they were completely disabled anyway. Tests are still passing as expected (other than the one about tabs!)
(Whoops, I ran the tests without a workspace open!!)


I get a error: illegal instruction (core dumped) when run my program on linux terminal with python

my codes as below:
import dlib
from scipy import misc
predictor_path = '/home/mylinux/002.jpg'
face_path = '/home/mylinux/shape_predictor_68_face_landmarks.dat'
detector = dlib.get_frontal_face_detector()
predictor = dlib.shape_predictor(predictor_path)
win = dlib.image_window()
img = misc.imread(face_path)
win.clear_overlay()
win.set_image(img)
dets = detector(img, 1)
print("Number of faces detected: {}".format(len(dets)))
dets = detector(img, 1)
print("Number of faces detected: {}".format(len(dets)))
for k, d in enumerate(dets):
print("Detection {}: Left: {} Top: {} Right: {} Bottom: {}".format(
k, d.left(), d.top(), d.right(), d.bottom()))
# Get the landmarks/parts for the face in box d.
shape = predictor(img, d)
print("Part 0: {}, Part 1: {} ...".format(shape.part(0),
shape.part(1)))
# Draw the face landmarks on the screen.
win.add_overlay(shape)
win.add_overlay(dets)
dlib.hit_enter_to_continue()
I run it and get error( illegal instruction(core dumped) ),so I use ipython run it step-by-step,and i found when run the statement（shape = predictor(img,d)）,the error information occur.
Can someone give me some suggestions? thanks!

http://dlib.net/faq.html#Whywon'tthePythonbindingscompilework

@davisking   I  follow the guide of  Getting Started on Unix Variants, and finish "Easy build and install". After that I get  Boost binaries in the path: /home/mylinux/boost_1_61_0/PREFIX/lib, but the error occurs again at the same position when I run it.
Maybe I put the Boost binaries in the wrong path? Is that problem?

I don't know.  You should look at the build output and see what boost it is finding.  It's probably not finding the one in your home folder.
If you are using a linux variant like ubuntu I would just install boost and python with the package manager.  Then they will be compiled correctly.

@davisking Yeah，I am using ubuntu 14.04.1. Anyway, thank you for your detailed answers, I will try it!

I use ubuntu 14.04 as well.  If I do pip install dlib it works.  Assuming I've installed boost and python via apt-get.


Support for 256 colorspace

Hi @wincent, I am your big fan and your screencasts and dotfiles repo inspires me a lot :)
So thank you for that!
I have a question related to your version of base16 colorschemes.
It seems like Lua version of colorschemes misses the part of code responsible for supporting of 256 colorspace.
If we check for example 3024 colorscheme we will notice that Lua version for some cterms looks in the following way
local cterm01 = "10"
local cterm02 = "11"
local cterm04 = "12"
local cterm06 = "13"
local cterm09 = "09"
local cterm0F = "14"

Whereas Vimscript version has a switch to adjust cterms to 256 colorspace
if exists("base16colorspace") && base16colorspace == "256"
  let s:cterm01        = "18"
  let g:base16_cterm01 = "18"
  let s:cterm02        = "19"
  let g:base16_cterm02 = "19"
  let s:cterm04        = "20"
  let g:base16_cterm04 = "20"
  let s:cterm06        = "21"
  let g:base16_cterm06 = "21"
  let s:cterm09        = "16"
  let g:base16_cterm09 = "16"
  let s:cterm0F        = "17"
  let g:base16_cterm0F = "17"
else
  let s:cterm01        = "10"
  let g:base16_cterm01 = "10"
  let s:cterm02        = "11"
  let g:base16_cterm02 = "11"
  let s:cterm04        = "12"
  let g:base16_cterm04 = "12"
  let s:cterm06        = "13"
  let g:base16_cterm06 = "13"
  let s:cterm09        = "09"
  let g:base16_cterm09 = "09"
  let s:cterm0F        = "14"
  let g:base16_cterm0F = "14"
endif

As a result when I tried to switch to Lua version I am getting weird colors in my vim.
Was that part missed intentionally and I need to adjust somehow my environment to get it working as it was working with vimscript colorschemes?

Here is the initial commit that shows the actual step from Vimscript to Lua — as it says:

This is the most straightforward port of the base16-vim files I could do, to make it easier to see what changed in the move from ".vim" to ".lua".

If I recall correctly, I was thinking I could just drop the base16colorspace stuff as it didn't seem necessary — but perhaps it is. To be honest, I am not 100% sure I understand what the base16 docs mean here:

256 colorspace
If using a Base16 terminal theme designed to keep the 16 ANSI colors intact (a "256" variation) and have sucessfully modified your 256 colorspace with base16-shell you'll need to add the following to your ~/.vimrc before the colorsheme declaration.
let base16colorspace=256  " Access colors present in 256 colorspace
This will cause vim to access the colours in the modified 256 colorspace. Please do not enable this simply because you have a 256 color terminal as this will cause colors to be displayed incorrectly.

🤔
FWIW, I am using base16-shell in iTerm, but I don't think I've ever needed to set base16colorspace...

Thank for the fast reply! 😃
I also do not fully understand the difference and influence of those 16/256 colorspaces.
I have a number of places where I have that magic 256 number mentioned where it is related to colors.
I have 'xterm-256color' set in Terminal/Report terminal type. I changed it to get powerlevel10k theme working for zsh.
I tried to change Report terminal type to other values without any luck :)
Currently I switched back to Vimscript colors for Neovim and it works fine with base16colorspace set to 256.
If I understand what was the issue with Lua version of colors and how to fix it I will report in that issue

Finally I managed to get everything working without a need to set base16colorspace to 256 😀
The option that I was missing in my init.lua was
vim.opt.termguicolors   = true

After it was added I were able to use Lua bases color schemes without any issues.
Thank you for the assistance!

After it was added I were able to use Lua bases color schemes without any issues.

Excellent, glad to hear you got it sorted.


Feat: adding the generated App

STATUS: INVALID 🔴
Hey @Dongmo12, 👋🏽
I'm invalidating this PR simply because of the following reasons:-

The PR message is missing.
Linters are not running
You have inappropriately applied the Github flow. You are comparing the develop branch to the master.

Make all the necessary changes and submit another CRR once you are ready.


Move test code into test file

All sits in main for now

Refactor is done. Just adding more tests as I go along


[SPARK-31095][BUILD] Upgrade netty-all to 4.1.44.Final

What changes were proposed in this pull request?

Why are the changes needed?

Does this PR introduce any user-facing change?

How was this patch tested?

Test build #119633 has started for PR 27869 at commit b3a3ba1.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24363/
Test PASSed.

Test build #119634 has started for PR 27869 at commit 9d8aa72.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/24364/
Test PASSed.

Test build #119633 has finished for PR 27869 at commit b3a3ba1.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Test build #119634 has finished for PR 27869 at commit 9d8aa72.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/119633/
Test PASSed.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/119634/
Test PASSed.

Hi, @srowen and @HyukjinKwon .
Could you review this, please?

Thank you so much, @HyukjinKwon ! Merged to master/3.0.

What is the reason we merge this into branch-3.0 after the code freeze? What bug are you trying to fix? I do not think we should bringing more than 200 changes from netty into a release branch without detailed justification.

Actually, yeah. What about we merge into the master only as the RC for 3.0 will be going to out soon? It legitimately includes bug fixes from the dependency but might be better to avoid porting these considering the timing of the release window.

Hi, @yucai .
This is bug fixes like the following.

CVE-2019-20445 reported at https://issues.apache.org/jira/browse/SPARK-31095 by the author.
netty/netty#10017 java.security.AccessControlException: access denied ("java.io.FilePermission" "/etc/os-release" "read".

Thanks for clarifying it, @dongjoon-hyun. Looks we should backport as it includes CVE.

Thank you, @HyukjinKwon .

thank you @dongjoon-hyun


Simplify mono - remove use of autoconf

@nosami @directhex @knocte I'd like to remove the use of autoconf, which seems like overkill in this repo and causes problems on OSX since you have to homebrew that tool.
The attached gets the prefix from the location of the mono command, and assumes that mono and msbuild are on the command line
See also https://github.com/Microsoft/visualfsharp/pull/4358, more or less the same commit in visualfsharp repo

Removing autoconf is fine by me so long as you still have a "configure" script that checks for dependencies. You could even code it as an .fsx script (I have an example of this approach in this project if you're curious: https://github.com/knocte/gwallet ).

Removing autoconf is fine by me so long as you still have a "configure" script that checks for dependencies.

I've removed all trace of configure.  If you need something like that please add whatever dependency checking you want into the Makefile.  The checks on dependencies were largely out of date in any case (checking for Mono 4.0 when Mono 5.0 is actually needed)

@dsyme If you build Mono yourself into a custom prefix, fsharp/fsharp isn't installed inside of it (neither is anything else such as msbuild).
Looks like you might have disabled one of the mechanisms I use to test Mono fixes for F#. I would always build Mono into a custom prefix for testing.

Yes, configuration phase is not only to check dependencies, @nosami good point. This would also make it impossible to create debian packages for F#.

The checks on dependencies were largely out of date in any case (checking for Mono 4.0 when Mono 5.0 is actually needed)

If they were out of date, they should have been fixed, not removed. By being removed, now someone might install F# with even Mono 3.x, only to find later that it doesn't work.

To use a custom prefix use
make prefix=whatever

thanks

Does this allow for staging?
Lets's say you build bakes $prefix into itself, e.g. the fsharpi launch script hardcodes $prefix/lib/fsharp/fsi.exe
During package build, you need to stage the package in a temporary directory, e.g. $CURDIR/debian/tmp, such that $CURDIR/debian/tmp/bin/fsharpi contains hardcoded references to $prefix/lib/fsharp/fsi.exe
Usually, this is accomplished by passing a DESTDIR= value to make install
Is this still possible?

@directhex Yes, you can pass DESTDIR to make install.
If you guys need to make changes please do.   Just don't bring back autoconf


Column with cards

Resolves #1.

Column component requires name prop, but you didn't update the place where they're used (app/page.jsx)


[Spring-Cloud]remove preview parameter and fix warning message

This checklist is used to make sure that common guidelines for a pull request are followed.

For new extensions:

[ ] My extension description/summary conforms to the Extension Summary Guidelines.

About Extension Publish
There is a pipeline to automatically build, upload and publish extension wheels.
Once your PR is merged into master branch, a new PR will be created to update src/index.json automatically.
The precondition is to put your code inside this repo and upgrade the version in the PR but do not modify src/index.json.

Spring-Cloud

Spring-Cloud


Only if Modified Recipe to then run Zip or other methods

The base problem that causes this request:
I have a Download task that downloads multiple files to a directory.  These files are huge and and I am able to get them to download to a subdirectory using the Download tasks and the check if modified is great.  The problem is the "Extraction" phase of the download the Zip is always executing.
I am looking for an easy way to keep the easy of use of the multiple file download with a prevention of unzipping if a file is not modified.
Current Example:
task temp_download_example(type: Download) {
    String base = gradle.ext.nexusUrl.toString() + gradle.ext.repo_directory.toString() +  gradle.ext.base_filename.toString()
    String file1 = gradle.ext.nexusUrl.toString() + gradle.ext.repo_directory.toString() +  gradle.ext.file1_filename.toString()
    String file2 = gradle.ext.nexusUrl.toString() + gradle.ext.repo_directory.toString() +  gradle.ext.file2_filename.toString()
    String file3 = gradle.ext.nexusUrl.toString() + gradle.ext.repo_directory.toString() +  gradle.ext.file3_filename.toString()
    String file4 = gradle.ext.nexusUrl.toString() + gradle.ext.repo_directory.toString() +  gradle.ext.file4_filename.toString()
    String file5 = gradle.ext.nexusUrl.toString() + gradle.ext.repo_directory.toString() +  gradle.ext.file5_filename.toString()
    String file6 = gradle.ext.nexusUrl.toString() + gradle.ext.repo_directory.toString() +  gradle.ext.file6_filename.toString()
    String file7 = gradle.ext.nexusUrl.toString() + gradle.ext.repo_directory.toString() +  gradle.ext.file7_filename.toString()
    String destdir = getRootDir().toString() + "/" + gradle.ext.file_version.toString() + "/"
    src([
            base.toString(),
            file1.toString(),
            file2.toString(),
            file3.toString(),
            file4.toString(),
            file5.toString(),
            file6.toString(),
            file7.toString(),
    ])
    dest destdir
    onlyIfModified true
    retries 5
    acceptAnyCertificate true
    doLast {
        System.out.println("Extracting Files")

        copy {
            from zipTree(destdir + gradle.ext.base_filename.toString())
            from zipTree(destdir + gradle.ext.file1_filename.toString())
            from zipTree(destdir + gradle.ext.file2_filename.toString())
            from zipTree(destdir + gradle.ext.file3_filename.toString())
            from zipTree(destdir + gradle.ext.file4_filename.toString())
            from zipTree(destdir + gradle.ext.file5_filename.toString())
            from zipTree(destdir + gradle.ext.file6_filename.toString())
            from zipTree(destdir + gradle.ext.file7_filename.toString())
            into rootProject.projectDir.toString()
        }
    }
}

Downloading and unzipping of small sets of files can be prevented individually.  I have to do the copy after the download to make sure the files exist.
The request is a FLAG to prevent secondary doLasts, etc..  after based on if a file is modeled.
If there is a recipe then I apologize, I have not found one.

The recipe you provided has the same issues as the original setup.
I modified the downloadZipFiles to put:
onlyIfModified true
retries 5
acceptAnyCertificate true
I believe the behavior I am looking for is that the downloadAndUnzipFile would not be supplied a file to unzip if the file was not re-downloaded.  The variable: downloadZipFile.outputs.files could be only supplied with the actual files when they are actually downloaded again.
As a default task, unzipping the data alone is over 4 minutes.  Both methods above stop the download if the file exists already and is not modified.  That saves 30 plus minutes in our remote work environments of today.
Great Product.

OK. So, do I understand you correctly that you were able to solve the issue?

No,  The feature request is to prevent the unzip task to even run if the file is already downloaded and not modified.  The current functionality is to return the files as downloaded even if they had not been downloaded due to not being modified.  That causes the zip copy functions to activate which causes a delay that is not needed after initial download.

Interesting. For me, it displays UP-TO-DATE on the console for the unzip task, but I guess Gradle still has to traverse all files inside the ZIP file to compare them with the files in your target directory in order to determine if the task is up to date or not, which also takes some time. If you want to skip that too then you can simply add the following line to the downloadAndUnzipFile task:
onlyIf { downloadZipFile.didWork }

This way, the task will only be executed if the download task was executed too.


Add Bugbounty topics

Thank you for contributing! Please confirm this pull request meets the following requirements:

[x] I followed the contributing guidelines: https://github.com/github/explore/blob/master/CONTRIBUTING.md
[x] I have no affiliation with the project I am suggesting (as a maintainer, creator, contractor, or employee).

Which change are you proposing?

[ ] Suggesting edits to an existing topic or collection
[x] Curating a new topic or collection
[ ] Something that does not neatly fit into the binary options above

Curating a new topic or collection

[x] I've formatted my changes as a new folder directory, named for the topic or collection as it appears in the URL on GitHub (e.g. https://github.com/topics/[NAME] or https://github.com/collections/[NAME])
[ ] My folder contains a *.png image (if applicable) and index.md
[x] All required fields in my index.md conform to the Style Guide and API docs: https://github.com/github/explore/tree/master/docs

400 repositories concerned by this tag so it's interesting to add it. Moreover bugbounty take an important place in the security field.

Please note: we will close your PR without comment if you do not check the boxes above and provide ALL requested information.

Thanks again @remiflavien1!


Update Traceur

Ideally we can update to 0.0.84 and work out the options to set to get source maps working. If there are issues it would be good to follow them up soon so that Traceur doesn't get held back to 0.0.82 for too long.

Have some time this evening :crescent_moon:


Add support for HealthStatus for Auto Scaling Groups

Add support for the set-instance-health aws autoscaling API.
It only sets the HealthStatus that will be returned through describe-auto-scaling-groups, it does not actually terminate the instances.   It also ignores the ShouldRespectGracePeriod parameter since that applies to the AutoScaling health check termination behavior (see the Custom Healthcheck section of the docs).  Implementing the actual health checking and automatic replacing would be more involved.

Coverage increased (+0.0009%) to 92.568% when pulling 685e9163a836904787fdb04ffaabae8050d611d3 on carleton-stripe:asg-health-status into efefc1714ed2e6b4993f2157014968dfb8e93f1c on spulec:master.

Coverage increased (+0.0009%) to 92.568% when pulling 685e9163a836904787fdb04ffaabae8050d611d3 on carleton-stripe:asg-health-status into efefc1714ed2e6b4993f2157014968dfb8e93f1c on spulec:master.

@carleton-stripe Great work!

This is now released as Moto 1.1.24

Awesome, thanks!


fix: hard limit on field size while parsing line protocol

Per https://docs.influxdata.com/enterprise_influxdb/v1.9/write_protocols/line_protocol_reference/
we only support 64KB, but 1MB is a more realistic practical limit. Before this commit there was
no enforcement of field value size.
Closes #21841
Describe your proposed changes here.

[ ] CHANGELOG.md updated with a link to the PR (not the Issue)
[x] Well-formatted commit messages
[x] Rebased/mergeable
[x] Tests pass

We don't catch everywhere that can build a point, but this covers the write ingress which is the most important one.

Closing as we want to make this configurable


"No data found on page" / "No tracks found..."

Hi,
I'm using Mopidy v3.1.1 with mopidy-youtube v3.3.r2.g9db86ff-1
The extension is loaded correcly by Mopidy, but I can't search anything on youtube.
On the web interface (mopidy-musicbox v3.1.0-2), it saying "No tracks found...", and in the mopidy's stdout/stderr see below :
INFO     2021-05-18 14:34:23,604 [53610:YouTubeBackend-6] mopidy_youtube
  youtube LibraryProvider.search "{'any': ['naruto openings']}"
INFO     2021-05-18 14:34:23,604 [53610:YouTubeBackend-6] mopidy_youtube
  Searching YouTube for query "naruto openings"
INFO     2021-05-18 14:34:23,604 [53610:YouTubeBackend-6] mopidy_youtube
  session.get triggered: search
INFO     2021-05-18 14:34:23,604 [53610:YouTubeBackend-6] mopidy_youtube
  session.get triggered: bs4api run_search
INFO     2021-05-18 14:34:24,506 [53610:YouTubeBackend-6] mopidy_youtube
  nothing in the soup, trying japi
ERROR    2021-05-18 14:34:24,507 [53610:YouTubeBackend-6] mopidy_youtube
  No data found on page
ERROR    2021-05-18 14:34:24,507 [53610:YouTubeBackend-6] mopidy_youtube
  search error "No data found on page"
INFO     2021-05-18 14:34:24,507 [53610:YouTubeBackend-6] pykka
  Exception returned from YouTubeBackend (urn:uuid:8241b5bb-0d98-472b-89fd-eb34af678281) to caller:
Traceback (most recent call last):
  File "/usr/lib/python3.9/site-packages/pykka/_actor.py", line 186, in _actor_loop
    response = self._handle_receive(envelope.message)
  File "/usr/lib/python3.9/site-packages/pykka/_actor.py", line 286, in _handle_receive
    return callee(*message.args, **message.kwargs)
  File "/usr/lib/python3.9/site-packages/mopidy_youtube/backend.py", line 177, in search
    playlists = [entry for entry in entries if not entry.is_video]
TypeError: 'NoneType' object is not iterable
WARNING  2021-05-18 14:34:24,507 [53610:Core-8] mopidy.core.library
  YouTubeBackend does not implement library.search() with "exact" support. Please upgrade it.

Using Archlinux, totally updated, with linux-lts v5.10.37-1-lts
Thank you

Could be a problem of Google consent cookie, please check here :
https://github.com/natumbri/mopidy-youtube/issues/170

@T0MuX  is this still a problem?
If it is, maybe try the yt-playlists branch, which has had a bit of work done to it recently?
If not, maybe write something about how you fixed it and close the issue?
Cheers,
Nik

Hi, sorry for the late.
I updated everything (whole system, and mopidy-youtube), and still have the same issue :
INFO     2021-07-23 11:28:44,079 [33764:YouTubeBackend-6] mopidy_youtube
  youtube LibraryProvider.search "{'any': ['battle tapes']}"
INFO     2021-07-23 11:28:44,079 [33764:YouTubeBackend-6] mopidy_youtube
  Searching YouTube for query "battle tapes"
INFO     2021-07-23 11:28:44,079 [33764:YouTubeBackend-6] mopidy_youtube
  session.get triggered: search
INFO     2021-07-23 11:28:44,079 [33764:YouTubeBackend-6] mopidy_youtube
  session.get triggered: bs4api run_search
INFO     2021-07-23 11:28:44,341 [33764:YouTubeBackend-6] mopidy_youtube
  nothing in the soup, trying japi
ERROR    2021-07-23 11:28:44,342 [33764:YouTubeBackend-6] mopidy_youtube
  No data found on page
ERROR    2021-07-23 11:28:44,342 [33764:YouTubeBackend-6] mopidy_youtube
  search error "No data found on page"
INFO     2021-07-23 11:28:44,342 [33764:YouTubeBackend-6] pykka
  Exception returned from YouTubeBackend (urn:uuid:2094864d-1c91-4dca-bee5-3c28043bb40b) to caller:
Traceback (most recent call last):
  File "/usr/lib/python3.9/site-packages/pykka/_actor.py", line 186, in _actor_loop
    response = self._handle_receive(envelope.message)
  File "/usr/lib/python3.9/site-packages/pykka/_actor.py", line 286, in _handle_receive
    return callee(*message.args, **message.kwargs)
  File "/usr/lib/python3.9/site-packages/mopidy_youtube/backend.py", line 177, in search
    playlists = [entry for entry in entries if not entry.is_video]
TypeError: 'NoneType' object is not iterable
WARNING  2021-07-23 11:28:44,343 [33764:Core-8] mopidy.core.library
  YouTubeBackend does not implement library.search() with "exact" support. Please upgrade it.

Hi, I still have this issue, is it possible to open it again please ?

Sure. I can't replicate the error though, so it will be hard to fix...  Are you able to try with python 3.7 or 3.8?

Reopening

Sure. I can't replicate the error though, so it will be hard to fix... Are you able to try with python 3.7 or 3.8?

@T0MuX try the new fix/thumbnails.
While I was trying to fix the thumbnail support, I started to get an error a bit like yours. Turns out the format of the data YouTube was sending changed unexpectedly. I fixed it - maybe it will solve your problem?

@T0MuX  am I ok to close this issue?  I've merged everything into develop.


syzlang: resource providers

For resources we have 2 types of values: special values that are fully static and constant (e.g. -1 for fd) and fully dynamic values that are obtained via syscalls (constructors).
It can make sense to introduce something in between for performance reasons. Values that are static, but not constant. A good example is generic netlink family id's:
https://github.com/google/syzkaller/blob/40bcfdd59ea157005ce91e1f942716810324a17f/executor/common_linux.h#L1578-L1622
we need to execute 5 system calls just to get the id, which is effectively const, but is not known in advance.
There are 2 sub-types of such values:

Values that are consts/numbers but are just not known in advance (e.g. netlink ID).
Handles which creation is not interesting to fuzz, but still we need to execute a syscall in the process context to create/obtain the handle (fuchsia's syz_process_self/syz_thread_self/syz_vmar_root_self/syz_job_default maybe an example of this, but not sure if we really need to call them, or they just return something like 0xffffffff).
Different solutions are possible and some solutions will work only for (1) but not for (2).

E.g. for syz_genetlink_get_family_id the simplest solution may be to cache the values in static variables in the function. Then we just need to arrange a call to this function in the parent fork-server process, then all child test process will already have it cached. This should also work for some handles (but not necessary for fuchsia because it has more explicit handle inheritance rules).
Or we could obtain and remember all these values during machine checking only once and then pass back to manager and manager will pass them to all new VMs, so that they will not need to do any additional work (they will know right away that netlink family "fou" is id 42). This will require more changes and won't work for handles (because we don't have any initialization per-process).
However, the benefit is that something similar may also work for string flags, e.g. set of filesystems available on the machine, set of network device names, set of files in /procfs, etc. We could probe these things once during machine checking and then distribute to new VMs.
But maybe we don't want to mix solutions for integers and strings. Netlink family id's are harder because we can't persist concrete value in corpus/reproducer (value changes from machine to machine). But strings can be persisted, if we use, say, "/proc/stat" we can persist it in corpus and reproducers...

A related issue #481 for opening all files in procfs/sysfs.

Another use case is BPF LSM attach IDs.
These can be extracted on the host with (unclear if there is a reasonable way to extract them on the target):
$ bpftool btf dump file ./vmlinux | grep "FUNC 'bpf_lsm_"
[28425] FUNC 'bpf_lsm_verify_prog' type_id=28424 linkage=static
[28426] FUNC 'bpf_lsm_perf_event_write' type_id=9722 linkage=static
[28427] FUNC 'bpf_lsm_perf_event_read' type_id=9722 linkage=static
[28428] FUNC 'bpf_lsm_perf_event_free' type_id=9720 linkage=static
[28429] FUNC 'bpf_lsm_perf_event_alloc' type_id=9722 linkage=static
[28431] FUNC 'bpf_lsm_perf_event_open' type_id=28430 linkage=static
...

Mapping hooks to IDs in every program looks too expensive. This would require reading whole BTF info, parsing and extracting the single ID.
This is similar to what we would need to generic netlink IDs. BPF LSM attach IDs are also changing from build-to-build, so we can't hard-code them in corpus reproducers.
I don't see a better/simpler solution than having both bulk extraction of these IDs during machine check so that fuzzer can use them without additional mapping and also having something different for C reproducers so that they can extract these IDs dynamically.

I am thinking perhaps we could have a pseudo-syscall that maps hook name to an ID. The fuzzer will use that pseudo-syscall, and it's also can be executed as normal and inserted into C reproducers. So everything works. But during exec encoding step, if we have the precomputed dictionary, as an optimization we can short-circuit this call to use the result directly.
This may be a reasonable way to fit this capability into the system design.

One more usecase: syzkaller can fetch wiphy identifiers for the devices created in initialize_wifi_devices(). These nl80211_wiphy identifiers are essential for a number of nl80211 commands to succeed (e.g. NL80211_CMD_NEW_INTERFACE), but we cannot extract them using descriptions only as it requires parsing a netlink response.

One more usecase: syzkaller can fetch wiphy identifiers for the devices created in initialize_wifi_devices().

Is there a pseudo-syscall that fetches them currently checked-in or in a PR? Having some concrete pointers will make it more actionable in future.
Also, are they stable across reboots? Or only within a single boot? Or only for the concrete devices (need to re-fetch for each test process)?

No, we don't fetch them at the moment. Neither in the master, nor in PRs. Most nl80211 commands do not need it, so now it is substituted by a random integer (these ids form an increasing sequence, so there's a chance that syzkaller will generate a proper value).
Wiphys are related to concrete devices, so we need to re-fetch them in each test process.


Feature Request: show orphan process at the ancestor branch for process tree

Just click on the 'name' column twice in 'Processes' tab.

Just click on the 'name' column twice in 'Processes' tab.

root
├─ancestor
│  ├─parent
│  │  └─process
the process show in root when parent terminated, but i think show in ancestor is appropriate choice

show orphan process

This would require storing information about terminated processes for long durations and would be considered/become a memory leak. You can press F6 to pause updating if you need the parent process information.


VS Code is processing slow to compile the code.

It started at the beginning of the installation and the continues.
By somehow it got the correct processing speed,but only for about a week,but again it is performing the same as earlier,slow.

Please see https://github.com/Microsoft/vscode/wiki/Performance-Issues for creating actionable performance problem issues.
/label info-needed terminal

This issue has been closed automatically because it needs more information and has not had recent activity. See also our issue reporting guidelines.
Happy Coding!


I/O error: Permission denied

Describe the bug
DRFL tries to use privileged ports but it has no access to them which causes I/O error: Permission denied and supposedly a bug in handling of this case which causes free(): invalid pointer.
To Reproduce
Compile and run this snippet:
#include <chrono>
#include <iostream>
#include <string>
#include <thread>

#include "DRFLEx.h"

const std::string IP_ADDRESS = "<IP_ADDRESS>";

void rt_reconnections() {
  DRAFramework::CDRFLEx robot;
  int timeout = 1000;
  while (true) {
    if (!robot.connect_rt_control(IP_ADDRESS)) {
      std::cout << "Cannot open connection" << std::endl;
      break;
    }
    std::cout << "Connected" << std::endl;
    std::this_thread::sleep_for(std::chrono::milliseconds(timeout));
    if (!robot.disconnect_rt_control()) {
      std::cout << "Cannot disconnect" << std::endl;
      break;
    }
    std::cout << "Disconnected" << std::endl;
    std::this_thread::sleep_for(std::chrono::milliseconds(timeout));
  }
}

int main() {
  rt_reconnections();
  return 0;
}

After a certain amount of time you'll see the following output:
usClientPort : 18891
Connected
Close UDP Connection
Disconnected
usClientPort : 12316
Connected
Close UDP Connection
Disconnected
usClientPort : 912
I/O error: Permission denied
free(): invalid pointer
Aborted (core dumped)

Expected behavior
DRFL does not use privileged ports(<1024) on Linux.
Version

DRFL: GL010118
OS: Ubuntu 20.04

@kirillmorozov
Thanks for reporting the bug. In the future, we will block access attempts to ports that are not accessible on the API.


Issue upgrading to highcharts v10.0.0: Series don't

Hi blacklabel team!
I find some issues when I upgrade the highcharts version to v10.0.0. The same code worked without no problems using highcharts 8.x.x and 9.x.x
The series at the beginning is not displayed showing the next message in browser console (tested in chome and edge):

Then, if the windows or container is resized the series is displayed:

At the start:

After resize browser window

Thanks so much in advance.

Thank you!
The issue should be fixed with v2.4.0 release


Add WithIntakeHostname

What does this PR do?
Add a WithIntakeHostname agent option.
Which scenarios this will impact?
Agent using a Fakeintake, although the change should be transparent (backward compatible).
Motivation
Use a custom intake name in a test, without copy pasting the implementation of WithFakeintake.
Additional Notes
Implementation is exactly the same as WithFakeintake.

❓ question
Would you use it to test against an intake other than the fakeintake ? Would you use one real DD intake ?

Would you use it to test against an intake other than the fakeintake ? Would you use one real DD intake ?

As discussed IRL this is used when you need a custom intake name when playing with DNS.
I guess it could also be used for a real DD intake, but the site setting handles that.


Check for Zombie process at Suite Start and teardown

Need to check Zombie process at BMC ready and Host run time as given below.
Basically we should not have zombie process
ps | grep -i 'z'
PID USER VSZ STAT COMMAND
1059 root 0 Z [flasher.exe]
1064 root 0 Z [flasher.exe]
1094 root 0 Z [python]
1101 root 0 Z [pcie_slot_prese]
1133 root 2972 S grep -i z

https://github.com/openbmc/openbmc/issues/206  - Existing issues.

@SrideviRamesh  The above command is not the correct way to find zombie process.. The Zombie generally will have a status either as defunct or Z in the PS stat
PID USER       VSZ  STAT COMMAND
A simple grep is not going to reliably tell if a process is a Zombie or not... Take a look around how to accurately find out from the list.. a simple grep will result in wrong listing of non defunct process

okay .. I will try it

Looks like base ps command output format had changed (I checked it in VERSION_ID="v1.99.0-131-ga81f31c-dirty"). And I am not seeing no zombie as of now. To check zombie, we need to use "ps -o stat" command to automate.

ps -o stat | grep -i Z , we can use it. Then if Z stat is available, then we can display corresponding process details using ps -o stat,user,comm,ppid etc..

Why the  -i flag to grep ? you are looking for a Z only, not also a z.  Although -w (whole words) might sense.

@mdmillerii yup, -i not needed

Infra support for check Zombie process is added using https://github.com/openbmc/openbmc-test-automation/issues/236

@SrideviRamesh  Whats remaining here.. the utility are in.. now do the remaining needed..

Closing .. Open new one if there is needed


How do I calculate its registration accuracy？

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Describe the solution you'd like
A clear and concise description of what you want to happen.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.

There are many ways this could be done, and it is more about the type of analysis or study you are trying to conduct than the software itself.
One simple example would be to apply a known transform to the data, then try to register to the original data and calculate some sort of error.
I’m closing this issue as it seems off topic to the core of the library.


Payload Queue

If a payload is sent and subtitle processing is already taking place due to a prior payload, the new payload would not be picked up and processed. This means that if multiple issues are submitted in Overseerr at a given time, only 1 of them would be processed.

I have found a potential solution, but will have to test more. Will give an update later today.


fix(ui): update structure display

closes #266
closes #273

:tada: This PR is included in version 1.37.1 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Missing packages during install on Kali Light

Empire Version
1.5/1.6
OS Information (Linux flavor, Python version)
Kali 64 bit light (2016.2)
Python 2.7.12+
Expected behavior and description of the error, including any actions taken immediately prior to the error. The more detail the better.
install.sh completes successfully but Empire reports it is missing OpenSSL when run.
Fresh install of Kali Light.Kali Light doesn't include libssl-dev or PyOpenSSL; I assume the full version does...
Screenshot of error, embedded text output, or Pastebin link to the error
http://pastebin.com/fydKcJgJ
Any additional information
To fix:
apt-get install libssl-dev
pip install pyopenssl
2.0_beta branch seems to already have libssl-dev but probably also needs pyopenssl?

Fixed. Thanks for the heads-up!!