Verify images from tar file or local podman cache

Currently cosign verify images from remote registries. We work in airgapped network where internet connection or connection to registry is not possible. The images are uploaded to system via tarball and loaded to locally via docker|podman load -i command.
Request to add a feature to verify the image from tar file or available locally in cache. Understand that there are many different container managers and formats but we can fix it only for OCI format images and to docker/podman/containerd managers, the ones which are most popular in the community.

This is not quite the same as https://github.com/sigstore/cosign/issues/2255 so I'm going to rename

I think the workaround right now would be to spin up that podman service that imitates a docker daemon.
cosign verify is a little difficult in this scenario because you'd need to get the signatures in somehow.

You mean podman API service and load image to cache? How does it work?

I meant the Docker compatibility mode. But on second thought that still doesn't work. You need a full registry for the workaround at the moment ☹

Hence my feature request please 🙂

Hello there! Resuming this discussion since I have a problem similar to @muzammil786...

cosign verify is a little difficult in this scenario because you'd need to get the signatures in somehow.

Wouldn't the cosign download signature command work in this scenario? Can, the output of that command, be used with the --payload/--signature option of the verify command?
I'm asking because I tried and things are not quite working as expected. @znewman01 am I missing something?


Handle empty rules

Blocked by #17
.cow {}
.cow .dog { padding: 8px }

Moved to:

https://github.com/red-perfume/red-perfume-css/issues/10


Mopidy support

Description
I didn't see in the docs any mention of mopidy compatibility. Is it supposed to work with mopidy?
I couldn't get a connection going when I tried it
Proposed solution
No response

It should work somewhat. Rmpc does not officially support mopidy, because its MPD protocol implementation is very old and mopidy-mpd is basically unmaintained. You can check the issue here https://github.com/mopidy/mopidy-mpd/issues/68.
Anyway, even if you manage to make rmpc connect to mopidy, there will most likely be unexpected side effects, errors and album art will simply not work at all, sorry :(


Request for dontmemorise.com

Checklist

[x] I'm reporting a new site support request
[x] I've verified that I'm running youtube-dl version 2019.07.02
[x] I've checked that all provided URLs are alive and playable in a browser
[x] I've checked that none of provided URLs violate any copyrights
[x] I've searched the bugtracker for similar site support requests including closed ones

Example URLs

Website:
https://dontmemorise.com
Playlist:
https://dontmemorise.com/course/view.php?id=72

Description

Guys add support for dontmemorise.com

Your website is using Vimeo to host its videos. And youtube-dl is able to download video from Vimeo.
The problem here is that your website doesn't allow you to go directly to the page of one of those videos. It redirects you to a page with the list of all the videos in the course.

Ok, I was able to download one of those videos manually so, in theory, It should be possible for youtube-dl to automatically download the entire playlist.
But it's not going to be straightforward since the url that we need is buried in a "frame-ception" that need to be loaded from the main page (Vimeo doesn't want you to be able to play the video from outside of dontmemorise.com).


Mirrors should prepend mirror-only status to the README

If someone stumbles upon a specific plugin mirror without knowing about this repository, it can make it hard to find the right place to contribute.  The sync to mirrors script should probably prepend some information about how that repo is a read-only mirror and for contributions it should link to this repository.

Personally i'd prefer to keep the sync script as simple as possible (though i'd like to hear @JonasKruckenberg opinion on that, especially since he created that script in the first place).
Do you think it would be enough to change the repo description like we did in the websocket repo https://github.com/tauri-apps/tauri-plugin-websocket

and adding a link to the upstream repo in the #contributing section (which would also show up in this repo but whatever)?

Yeah I think this is a good idea, maybe we can add a second update-readme script to keep things tidy

Closing this as i'll try to get rid of the mirrors in v2.


transform foo bla; into let () = ... rather than let _ = ...

From gitter:

do you mean by default when you do expr ; expr ? If so, then I believe you can accomplish that with the compiler flag called "strict sequence" iirc.

using let () = foo bla warns when the returned value of foo bla isn't unit. Using let _ = foo bla discards the return value, which might not be intended.

@chenglou I believe that doing
let result = {
   somethingWithSideEffects ();
   200;
};

Will warn if  somethingWithSideEffects () doesn't have return type unit (with strict-sequence warning enabled). Would this do what you want in most cases?

FWIW, let _ = ... is the source of a lot of subtle bugs, including hiding unintended partial function application.

@jordwalke yeah that works but I was more thinking about somethingWithSideEffects () by itself, which compiles to let _ = somethingWithSideEffects (). At the top.

I believe strict-sequence warning would work at the top level too.

This would still be very nice to have.  Reason's syntax allows for almost script-like top level expressions which can be very useful:
print_endline("Hello world");

but it doesn't complain, even with -strict-sequence enabled, if the expression is does not evaluate to unit:
// This doesn't warn
"Hello world";

so it's easy to let bugs from partial or no application fall through.

For clarification - the small examples in my previous comment exist at the top level of a file/module, not with a let binding.

Would a PR making this change be accepted at this point?


Add property to enable/disable registration of the "old" GraphQLAPI in-Coordination implementation

Currently system property stargate.rest.enableV1 (SYSPROP_ENABLE_SGV1_REST) exists to allow either enabling or disabling of registration of the Coordinator co-located (running within Coordinator) REST API implementation. The idea is to allow disabling (and possibly re-enabling) of this endpoint dynamically, during transition to Stargate V2.
Similar property should be added for GraphQL API for same reason: the most likely use case is to disable registration at first, and only after validating goodness of the new implementation (running in production for a while) actually removing the old implementation.

Decided that we do not need this functionality: we will just keep old implementation around until we have proved that SGv2/Quarkus one works well enough, then remove (see #2117)


line is too big

In reading view, It doesn't render like the image in README

the progress line is too thick

and in live preview, it renders like this

Hi @imeed166,
0.3.0 is released and the badge won't take whole line to display.
But it still render incorrectly in the Live Preview, I will check later.

Also, in reading mode, in dark mode, the text is not readable.

Live Preview rendering has been fixed.
I will tweak the default style for better contract.

Live Preview rendering has been fixed.
I will tweak the default style for better contract.


Manual Merge Request for Change Logo #21166

I want to manually merge to my PR https://github.com/solana-labs/token-list/pull/21166, i would like to change my token image. Thanks a lot

https://github.com/solana-labs/token-list#duplicate-token


Require server package before user permissions

The postgresql user is created by the server package, but this file
resource may be evaluated before the package is installed resulting in
permission failures.

suddenly realizing how happy i am that postgresql only has one main distributor…


RAT-325: Changed CLI-default logging level to WARN

Rather than moving the file lists to the noisier DEBUG level I update the default logging level to WARN.  This seems appropriate for CLI.
The default logging level only applies to the CLI and  tests.
In all other extant UIs the logging is performed by the native system and so the logging needs to be set there.

Thanks again, I will add the changelog entry directly on master after merging.


Double-click for select fails to select long lines wrapping

Seems like Double-clicking on long lines (that wrap to the next line(s)) fails to copy the entire contents (regardless of the wordDelimiter setting).
Whenever using double-click to select a portion to copy, the application should select any number of lines until the next wordDelimiter, and don't be restricted to a single-line.
-K

This issue should be filed on the Windows Terminal repository, however I believe the double and triple click functionality is currently by design. You're welcome to request this new feature though. :)
https://github.com/microsoft/terminal

(Please do not file a new request for this. It is tracked by microsoft/terminal#4009)


Publish CA Payroll

OPS Build status updates of commit acc7106:
:clock10: Preparing: average preparing time is 47 sec(s)

OPS Build status updates of commit acc7106:
:clock10: Full build: average full build time is not available, there is no data for this repository.

Note: A full build takes more time than an incremental build.  This is the expected behavior of the build system.

OPS Build status updates of commit acc7106:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

dynamics-gp/TOC.md
:white_check_mark:Succeeded
View

dynamics-gp/payroll/CAN18YETax.md
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/1321b6b1ae5737c7f3666a5687a0971a.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/186556e90cedfeb6194c02f83db72afd.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/1920e57c57e82dc3c19c95314e3d5a71.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/1be31223032f1b37c757cbbe1e3cb46a.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/2019man.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/2019nb.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/2019nf.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/2019nu.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/2019nwt.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/2019on.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/2019pe.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/2b8973e411c454b40a693d90ae16fcb5.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/2c41179ff8ba1abcc6cadc65fbbc7635.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/42ebd1be6b4c08905a6f4e6f227e3ffa.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/43c41d6d92bf037073c58efbb5db1b8e.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/4f1cad425ae40e4ffc274821c90f78ae.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/501b27b62d8f06e48230b4cb060096ee.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/5c712257e392e55d920a654015317e67.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/60c97782c29012c9a2236999504287cd.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/66b59f76edc553b98cb4cfd19933339e.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/6e43cb871680e95145cd6d3eabd95c22.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/6e4fbb0d876cf4b3219275f82ba177de.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/70bbe3a956d53a6a55de9909e755ead2.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/7c21feb26199a76da8e688028e24ec68.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/7ca3cdcb008fb67221d00f41bc6f4a30.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/823a871a0bc6b883d0604177259ed74a.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/86e404331aaf9838e8506ae9342e029b.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/8c70bc2d5deef913af861abbeb9a0f6c.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/a4468528be0cb1279552ac57075426b0.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/a8ad5c9cef0e728e7cb5281d10e3dc7d.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/ab2019.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/add3957ca15e82ffcc0030301a4938b3.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/bc2019.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/bdbfe9ffa244a5e25e485ead0fcc14da.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/c9ec6d52ede743fe09ad725a4d4ba6e3.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/colorschememapping.xml
:white_check_mark:Succeeded

dynamics-gp/payroll/media/d08124d39e013829e1684f22e71ea507.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/d53f3602d56d2d8628ff577d0c487175.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/e27a5be148275137edd9eb98a75c454d.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/e5f714e91cd576667172a587304dcebf.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/f2965a79fee4e1cf18638ec6b0774e02.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/filelist.xml
:white_check_mark:Succeeded

dynamics-gp/payroll/media/header.htm
:white_check_mark:Succeeded

dynamics-gp/payroll/media/image001.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/image002.gif
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/image003.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/image004.gif
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/image005.gif
:white_check_mark:Succeeded
View

This comment lists only the first 50 files in the pull request.
For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.

OPS Build status updates of commit acc7106:
:clock10: Preparing: average preparing time is 47 sec(s)

OPS Build status updates of commit acc7106:
:clock10: Incremental building: average incremental building time is 21 sec(s)

OPS Build status updates of commit acc7106:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

dynamics-gp/TOC.md
:white_check_mark:Succeeded
View

dynamics-gp/payroll/CAN18YETax.md
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/1321b6b1ae5737c7f3666a5687a0971a.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/186556e90cedfeb6194c02f83db72afd.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/1920e57c57e82dc3c19c95314e3d5a71.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/1be31223032f1b37c757cbbe1e3cb46a.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/2019man.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/2019nb.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/2019nf.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/2019nu.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/2019nwt.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/2019on.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/2019pe.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/2b8973e411c454b40a693d90ae16fcb5.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/2c41179ff8ba1abcc6cadc65fbbc7635.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/42ebd1be6b4c08905a6f4e6f227e3ffa.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/43c41d6d92bf037073c58efbb5db1b8e.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/4f1cad425ae40e4ffc274821c90f78ae.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/501b27b62d8f06e48230b4cb060096ee.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/5c712257e392e55d920a654015317e67.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/60c97782c29012c9a2236999504287cd.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/66b59f76edc553b98cb4cfd19933339e.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/6e43cb871680e95145cd6d3eabd95c22.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/6e4fbb0d876cf4b3219275f82ba177de.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/70bbe3a956d53a6a55de9909e755ead2.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/7c21feb26199a76da8e688028e24ec68.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/7ca3cdcb008fb67221d00f41bc6f4a30.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/823a871a0bc6b883d0604177259ed74a.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/86e404331aaf9838e8506ae9342e029b.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/8c70bc2d5deef913af861abbeb9a0f6c.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/a4468528be0cb1279552ac57075426b0.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/a8ad5c9cef0e728e7cb5281d10e3dc7d.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/ab2019.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/add3957ca15e82ffcc0030301a4938b3.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/bc2019.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/bdbfe9ffa244a5e25e485ead0fcc14da.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/c9ec6d52ede743fe09ad725a4d4ba6e3.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/colorschememapping.xml
:white_check_mark:Succeeded

dynamics-gp/payroll/media/d08124d39e013829e1684f22e71ea507.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/d53f3602d56d2d8628ff577d0c487175.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/e27a5be148275137edd9eb98a75c454d.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/e5f714e91cd576667172a587304dcebf.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/f2965a79fee4e1cf18638ec6b0774e02.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/filelist.xml
:white_check_mark:Succeeded

dynamics-gp/payroll/media/header.htm
:white_check_mark:Succeeded

dynamics-gp/payroll/media/image001.jpg
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/image002.gif
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/image003.png
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/image004.gif
:white_check_mark:Succeeded
View

dynamics-gp/payroll/media/image005.gif
:white_check_mark:Succeeded
View

This comment lists only the first 50 files in the pull request.
For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Move InsecureUrlResolver to better place

Move InsecureUrlResolver to driver-utils or some similar place.
packages/runtime should have zero references to IUrlResolver or IResolvedUrl.

May be test-driver-utils?

Please assign this ticket to me. I have started working on it

May be test-driver-utils?

It seems that it is already in packages\runtime\test-runtime-utils\src\insecureUrlResolver.ts


Allow text files to be edited even when empty

Description
This is done by making sure the opened file can be encoded as text.
Has been tested against a plethora of file types.
Related Issues

#1722

Checklist

[x] I read and understood the contributing guide as well as the code of conduct
[x] The issues this PR addresses are related to each other
[x] My changes generate no new warnings
[x] My code builds and runs on my machine
[x] My changes are all related to the related issue above
[x] I documented my code

Screenshots
https://github.com/CodeEditApp/CodeEdit/assets/49006567/1d4bc58e-b4f5-457e-9478-05854c2f870f

I'll close #1723 in favor of working on it here, it clearly doesn't solve the entire problem.

The previous commit works as expected. I made the document's content optional, we can then check to see if the content is not nil.
There is a helper sourceEditorText binding in CodeEdit/Features/Editor/Views/CodeFileView.swift for loading the text content into the CodeEditSourceEditor.

Showing the visuals for this commit description.
WITH EXTRA CHECKS:
https://github.com/CodeEditApp/CodeEdit/assets/49006567/e828799c-8f2e-456f-b46d-e38d6e410cef
WITHOUT THE EXTRA CHECKS:
https://github.com/CodeEditApp/CodeEdit/assets/49006567/d9897c4b-e71f-4c07-ab05-357b91a51b3b


[flutter_tools] don't force service worker cache files to be absolute

Description
Along with the change to make index.html paths relative, this allows flutter for web applications to be hosted anywhere. Also updates index.html in flutter gallery
Fixes https://github.com/flutter/flutter/issues/50580

I take it this didn't make it into the beta channel that got pushed 2 days ago right?


Collection set causes error with add:false option

Working example:
var books = new Backbone.Collection({id: 1, title: 'Book1'});

books.set([{id: 1, title: 'updated title for first book'}, {id: 2, title: 'Book2'}], {add: false});

the result will be collection with only one model with id: 1
Not working example:
var books = new Backbone.Collection({id: 1, title: 'Book1'});

books.set([{id: 2, title: 'Book2'}, {id: 1, title: 'updated title for first book'}], {add: false});

P.S. The result of the second example is:
Uncaught TypeError: Cannot read property 'id' of undefined

Worked fine for me on http://backbonejs.org/. I'll reopen if you can post a failing test case.

Sorry, looks like it's already fixed in current version, but it didn't work in 1.1.2.
Thanks.


Perfetto UI can't show TRACE_EVENTS in kernel

after I got xxx.perfetto, I open it in Pefetto UI, but can't see the tracepoints I added in kernel, but when I transform it into xxx.systrace, and can see it in the file. something like this:
function1 can't show in UI, but funtion2 can show.
   xxxx  ( 7363) [001] .... 2832.825592: func:B|7363|function1
   xxxx  ( 7363) [001] .... 2832.825592: func:E|7363|function1

   xxxx  ( 7363) [001] .... 2832.825592: func:B|7363|function2
   xxxx  ( 7363) [001] .... 2832.825592: func:E|7363|

function1 is got in kernel code,  I defined a TRACE_EVENT with 3 args, (pid, function_name, is)
#include <linux/tracepoints.h>
TRACE_EVENT(func,
TP_PROTO(int pid, const char *name, bool isbegin),
....
TP_printk("%s|%d|%s", isbegin ? "B" : "E",
pid,  name)
)
#define K_TRACE_END(name) trace_func(pid, name, 0)
#define K_TRACE_BEGIN(name) trace_func(pid, name, 1)
how to use it:
K_TRACE_BEGIN("function1");
function1();
K_TRACE_END("function1");
and function2 is got in user space with atrace_begin/end
atrace_begin("function2");
function2();
atrace_end();
I can see both user space and kernel space trace  open with the lagecy UI, when I use systrace script to ctach trace.
but why perfetto can't ?

This is working as intended from the Perfetto side. The first thing to note is that, for performance reasons, Perfetto does not look at the "stringified" version of ftrace events. It is instead reading the binary structs which is a lot more efficient. This explains why you are getting a discrepancy between systrace and Perfetto.
On the Perfetto side, what is happening here is a subtle mix of a couple of things:

For ftrace events we don't know, we encode them as "generic" events on device: these are JSON like key-value pairs.
For generic events, we don't do any special handling when we process the trace (e.g. in the UI) so you won't see any slices generated from them.

There's a couple of ways to proceed

Instead of writing a new ftrace event, you can piggy back on writing to /sys/kernel/tracing/trace_marker (I think trace_printk might be the canonical way to do that from the kernel) which is what atrace does.
You can add upstream support for your new tracing event into Perfetto similar to what Samsung did for their "atrace-like" ftrace event in https://r.android.com/2692206 and https://r.android.com/2727564

OK I found some context from a bug where we were talking to another OEM. The canonical way we recommend is as to change your K_TRACE_BEGIN macro to:
    char buf[128];
    snprintf(buf, 128, "B|%d|%s\n", current->tgid, name);
    trace_printk(buf);

and K_TRACE_END macro to:
    char buf[128];
    snprintf(buf, 128, "E|%d\n", current->tgid);
    trace_printk(buf);

Then if you enable the ftrace/print event in Perfetto, everything should just work.

Not sure what you mean by your message: please clarify how exactly how you are collecting your traces, what you are expecting to see and what you're seeing instead.

I know my problem.
just want to confirm one thing.
cmd1: python2 systrace.py -b 10960 sched view idle freq power irq -o "test_trace.html"
In my test, catching trace using systrace script can parse below prints, and show in Pefetto UI
xxxx  ( 7363) [001] .... 2832.825592: func:B|7363|function1
xxxx  ( 7363) [001] .... 2832.825592: func:E|7363|function1
but can't parse below for traces from kernel (with trace_printk)
xxxx  ( 7363) [001] .... 2832.825592: func:B|7363|function2
xxxx  ( 7363) [001] .... 2832.825592: func:E|7363|
cmd2 : python record_android_trace  -t 10s -b 10960 sched view idle freq power irq  ftrace/print -o test.perfetto-trace
but catching trace with perfetto script is the opposite, can't parse the first pair of  print, but can parse the 2nd pair and show in UI.
Is the differece designed to be like this ?

with same code,
catch trace with systrace script: the contents in xx.html is like this :
  xxx    (   8132) [003] .....  3019.817127: func1: B|8132|func1
  xxx    (   8132) [003] .....  3019.817127: func1: E|8132

while catch trace with perfetto script, convert into .systrace,  the contents is like this:
   xxx  ( 7878) [001] .... 2732.264747: tracing_mark_write: B|7878|func1
   xxx  ( 7878) [002] .... 2732.265127: tracing_mark_write: E|7878

Is the differece designed to be like this ?

Yes this is an intentional difference, see below.

it's weird, why using systrace script, the contents before B becomes func1 instead tracing_mark_write ?

That's how trace_printk works in the kernel. The difference between Perfetto and systrace.py again comes from the fact that Perfetto reads the binary ftrace pipe for performance reasons while systrace reads the text pipe. The text makes trace_printk messages use the name of the kernel function as the name in the textual ftrace.
Another OEM used the following trick to have this consistent between Perfetto and systrace.py:
static noinline int tracing_mark_write(bool begin, const char *name)
{
	if (begin) {
            char buf[128];
            snprintf(buf, 128, "B|%d|%s\n", current->tgid, name);
            trace_printk(buf);
        } else {
            char buf[128];
            snprintf(buf, 128, "E|%d\n", current->tgid);
            trace_printk(buf);
        }
	return 0;
}

#define K_TRACE_BEGIN(name) tracing_mark_write(1, name)

#define K_TRACE_END() tracing_mark_write(0, 0)

Because the function calling the trace_printk function is called tracing_mark_write, that causes both systrace.py and Perfetto to be consistent with each other.


System.PlatformNotSupportedException: 'Compiling JScript/CSharp scripts is not supported'

Moved project from .NET 4.8 to .net 7.0 using MSMQ.Messaging
And I've got "System.PlatformNotSupportedException: 'Compiling JScript/CSharp scripts is not supported'" exception while accessing  to Body:

MSMQ.Messaging used in .net standart 2.0 library project which executes in .net 7.0 service.
I've tried to change Target OS, but it doesn't help.
Used XmlMessageFormatter

Found the Issue, it is because custom Type used


Improvement Topic Update

What is currently missing?
Currently when creating a Topic Update it is required to set the otherParams as the topicId.
This is not an intuitive way of storing the information and should be changed.
How could this be improved?
The value should be stored or supplied in a way that makes sense and is easy and intuitave to understand when you read the code.
The method to update its self only supports one topic at a time but accepts a list of topics.
This should also be changed.
Is this a feature you would work on yourself?

[ ] I plan to open a pull request for this feature

@aindriu-aiven I would like to work on this!

Hey @Sadaf-A absolutely no problem assigned to you now.
I will add some more detail to the issue shortly to give you some more background

Hey @Sadaf-A would you still like to work on this, it is something we are hoping to include for release 2.7 around December 13th.

Hey @Sadaf-A would you still like to work on this, it is something we are hoping to include for release 2.7 around December 13th.

I would love to. I'm a little busy right now will continue on the day after tomorrow.
Thank You

Thanks @Sadaf-A


Syntax of remote_servers in hiera

Having trouble figuring out how to code this module for multiple rsyslog servers from within hiera. Have tried multiple entries with just the server parameter as well. Any advice?

Given that the node classification is done, for example:
node default {
  include rsyslog::client
}

'rsyslog::client::remote_servers' expects an array so in YAML that would be:
:rsyslog::client::remote_servers:
 - host: log.domain.net
   port: 601
   protocol: tcp

Again showing JSON feels way more natural as a Hiera backend.


Make mysql command work out of box

Currently, running mysql command in a running container requires a lot of command line arguments, like hostname, username and password. I would be in favour of enabling the unix socket. This is the easiest way to do it and is the same way we do it with PostgreSQL.
Also, I'd like to create a bash script in standard path named "mysql" that will scl_source the collection and do an exec mysql. This way docker exec -ti mysql as well as oc exec will work out of box and will in my opinion greatly enhance the user experience. This I think we should also do for PostgreSQL and MongoDB images.
@mfojtik @bparees thoughts? cc @hhorak

@mnagy I thought we already have socket enabled and that is the way you connect to mysql when docker exec. If not, then it is a bug.

+1 for making the command line arguments voluntary
About the "mysql" wrapper -- I don't see any other solution to enable this, so +1 as well. It's not nice though that this wrapper may conflict with the system binary (provided by non-SCL mariadb package).

@hhorak it is possible to make mysql consume parameters as env variables? so you don't have to set them?

It seems like it should be possible: https://dev.mysql.com/doc/refman/5.5/en/environment-variables.html

@mnagy before going to create bash script, please explore if we can do it 'clean' way without wrappers.

@mfojtik enabling the socket seems a better solution than working with env vars (and very easy one at that) wrt to wrapper script, we already determined that this can't be done in any other way, remember @hhorak's matrix?
@hhorak I'll try to figure out a path that won't collide, but this should not be a concern since we'll be pretty sure MariaDB packages won't be installed.

@mfojtik there are no environment variables for user and dbname afaict (didn't find any at least), but to avoid passing parameters there is $HOME/.my.cnf that should have correct permissions.

OK, I misunderstood this... I thought this is a bug where when you enter the container namespace and execute 'mysql' you will not be connected to mysql as admin user.... now I understand what @mnagy is trying to solve here... docker exec 123456 mysql where the mysql is a wrapper bash script... I don't like that solution... we should stop providing wrappers for stuff like this. This should be fixed in SCL collection and provided by the SCL mysql package, not by this hacky workaround.

@hhorak @mnagy also the solution here is to execute this command:
docker exec 123456 /bin/sh -c mysql
@hhorak also you should talk to Docker folks about providing some hook mechanism to inject your SCL vars/scl enable before we enter the running container.

@mfojtik SCL packages can't provide such a wrapper. If they could, they could just install the binary directly into $PATH. I don't know about patching docker, it's questionable if they'd want to provide a hook mechanism, although that would help things.
And yes, running /bin/bash -c mysql (/bin/sh won't) might do the trick, but it seems to me too verbose if you can simplify it and only need mysql. Reason why I think we should do it is that for other images (those not using SCL), running mysql will work out of box. I'm afraid that users will be confused when it won't work for our images.
@danmcp @bparees thoughts?

@mnagy I think /bin/bash -c mysql is reasonable and we can document that. Having to ship extra wrapper with the same name as the RPM binary is too hackish to me.

@mfojtik well, tested it and /bin/bash -c mysql does not work. You need to execute bash and then execute mysql. Adding -l to bash won't make it work as well.

@mfojtik as @mnagy said, shipping the wrapper in the RPM is no go, it is actually against SCL concept to not influence the base system. The wrappers were consulted already before and they were explicitly denied by PM. Although you're right about the request to the Docker folks, I will at least try to do something about it.

@mnagy that command should work, if not we should fix it. It seems like the .bashrc file is not picked up and the collection is not enabled properly.

@hhorak @mnagy if SCL don't want wrappers, why should we go against that?

Could the discussed 'docker exec cont-entry mysql' help here?

Ouch, sorry, it was changed to container-entrypoint example:
https://github.com/sclorg/rhscl-dockerfiles/blob/master/rhel6.postgresql92/usr/share/cont-docs/70-general.txt

@praiskup @hhorak I thought we all agree that this should work out-of-box without having middle-man script (looking at the matrix from May/11).

@mfojtik There is one case that doesn't work (#6 in the matrix from May/11) -- non-bash binary run as docker exec, which is exactly the case with docker exec -ti mysql. That's why @mnagy suggested the wrapper.

@hhorak but docker exec $CID /bin/bash -c "mysql" should work according to matrix, or I'm wrong?

@mfojtik not implemented in our images.

@mnagy what you mean 'not implemented' in our images? i thought that is the reason why we have $HOME/.bashrc and bash reads it when it starts.

@mfojtik it only works for bash. For bash -l you need something in /etc/profile and for other uses (bash -c, executing a bash script) you need to set BASH_ENV.

@mnagy can you make a PR to set BASH_ENV for our images? and test it.

@mfojtik just BASH_ENV? What about /etc/profile.d/?

@mnagy @mfojtik I also don't like the wrapper script approach, it was a problem in v2 because no one understood that we'd supplanted the normal binary with an alias(we used an alias in v2 for a similar use case) and there were subtle differences in behavior that confused people who thought they were running the normal binary but were actually getting the wrapper alias.

@bparees +100 I thought we can do much better in Docker than in v2

@bparees bash wrapper script is not the same as binary. And the /opt/rh/.. path set by scl enable precedes ordinary $PATH. This means that if you're in a (scl enabled) bash session, running mysql will execute the correct binary. The wrapper would only be executed in a non-enabled bash session (bash -l unless we chose to add .bashrc also to /etc/profile/) or during docker/oc exec.

I meant, not the same as an alias.

@mnagy I don't see docker exec CID /bin/bash -c mysql as a big problem. At least we are not hiding that we actually execute a bash to enable SCL and we make it explicit for users. Having two executables named "mysql" will be confusing for users and it cripple the PATH when executing it the way you propose.

@mnagy it's the same in that it's magic a user is unware of that has unpredictable behavior if you think you're running the binary.


OpenCV dlls in plugins directories cause issues when building for HoloLens 2

If you have added binaries for the x86 wsa player, it seems that an arm solution fails to build because it assumes these binaries will exist.

Could use empty dlls. Could also try directory.props to exclude the files based on configuration


[Linear] Keyboard Shortcut for "Open Project in Linear"

Extension
https://www.raycast.com/linear/linear
Description
I would love to open the project in the "Search Projects" Command with ⌘+⏎.
Who will benefit from this feature?
No response
Anything else?
No response

@raycastbot assign me


feat(pyproject): add project urls

Fix #1 by adding some key links for this project. Let me know if you would like to add more to this one. These are supported so far.

Thank you for your contribution! I noticed a small typo in your PR where 'urls' is written as 'ulrs.' Could you please correct that? Additionally, I prefer the key names to be in lowercase. If you could make these adjustments, I’d be happy to review the PR again. Thanks for your help!


Arrays/Slices

We need to figure out how allocation, freeing etc will work for arrays/slices/etc. Since we have modules done, we can start adding it to the stdlib.

@MovingtoMars Any ideas to get the ball rolling?

@MovingtoMars dropped the following on IRC yesterday:
00:07:21 <mvtmrs> my idea so far:
00:07:27 <mvtmrs> - []T for arrays
00:07:32 <mvtmrs> - [&]T for slices
00:08:21 <mvtmrs> and then
00:08:35 <mvtmrs> mem::alloc_array<T>(num: int) -> []T
00:09:59 <mvtmrs> which solves all the problems with ARC, I think
00:10:13 <mvtmrs> slices don't need to be ARCed, just the backing arrays
00:10:21 <mvtmrs> since slices can't go out of scope before the backing array does
00:10:27 <mvtmrs> so only backing arrays need to be checked
00:11:23 <mvtmrs> (slices are basically references to a part of an array, with a specified length)
00:12:13 <mvtmrs> note the difference here:
00:12:35 <mvtmrs> &someArray ---> &[]int
00:12:49 <mvtmrs> someArray[:] ---> [&]int
00:15:39 <mvtmrs> this also prevents the problem of whether a slice points to data that should be freed, or static data

LGTM

Types:
[4]int // fixed-size array
[]int // array
[&]int // slice

Allocating arrays:
mem::allocArray<T>(n: int) -> []T

Slicing:
array := []int{1, 2, 3, 4, 5, 6, 7, 8, 9, 10};
slice := array[3:8]; // array[inclusive:exclusive]
// slice is [&]int with length 5

Could we allow for foo[3:] and foo[:3] to slice from X to end or start to X?

yep

Nice, :+1:
@kiljacken what are your thoughts on this?

LGMT :+1:


Added 'ignore' option, tests for it and it's description in the README.

Tried to follow the current code style and use ES5 for compatibility reasons.

can this merge?  need an ignore or glob option

when can merge it; i also need a ignore option

any plans to merge this?

The auth Latest commit 824b9f1  on 24 Mar 2015;  so I search another node-require-directory

14 pending pull requests, I think it's time to try the node-require-directory indeed.

Hey folks,
I'm sorry for my delay in responding to these issues and PRs. I've found it hard to find the time and motivation to maintain an active role in growing this project. The module has worked perfectly fine for my company in production for years now, and I've been hesitant to add features to it and risk making it bloated when it currently is nice and simple.
But I now realize that the module can still grow for other people's needs, and it shouldn't hurt us. I just can't commit to taking on the maintainer role anymore.
Is there anyone that's passionate and interested in maintaining this project? If so, I'll be happy to add you as a collaborator to this repo as well as to the package on npm. Let me know!
Thank you again for all your contributions.
Cheers,
Aseem

@aseemk I'll take it - I've been using this for years across a number of applications, but a few basic features (like this one) + maintenance would be nice.

@contra: Invited. Thank you!

Hi (new maintainer) - I've merged https://github.com/aseemk/requireDir/pull/27 which does the same thing, and was the first PR submitted to solve this problem. You should be able to achieve the same functionality with that. I'll be publishing it to npm shortly.


Can BRUNO's Window client switch Chinese language?

If not, it is recommended to add a language switching function to the settings

@dong-lufei , at this point bruno is not ready for any sort of localization, Chinese or otherwise.

When can localization be put on the agenda?
Language is often very influential.

@helloanoop are there any plans for this at all? It's obvioulsy the problem that gets more dificult to solve the longer it is put away, because more and more content gets hardcoded in the default language.

Looking forward to new progress on this issue


[MB-9756] Move common error types from services package to apperror package

Description
This PR moves all the current common error types found in pkg/services/errors.go (in the services package) to pkg/apperror/errors.go and the apperror package.  These errors are used by packages other than the services package, so its probably better to have them isolated in their own top-level package to avoid having other packages pull in all the services package code and possibly run into circular import errors.
Reviewer Notes
This is a big PR, but note that it is only doing the file/package refactor.  GoLand made this super easy with its refactor capability.
We will likely have some follow-up PRs that revisit errors with specific services and such, but doing this refactor first helps minimize the changes in the follow-up PRs as well as keeps us from maintaining both old and new package versions for a while (and possibly having people accidentally writing new code using the old package).
Setup
Make sure everything builds fine and all tests continue to pass.
Code Review Verification Steps

[ ] Request review from a member of a different team.
[ ] Have the Jira acceptance criteria been met for this change?

References

Jira story for this change

Messages

:book:
:link: MB-9756

  Generated by :no_entry_sign: dangerJS against af8a696b1ac4eda028077fec9c5654abcec8ff58


Word Counter Issue solved

Related Issue
This issue is related with word counter project
Closes: #786
Describe the changes you've made
I have Solved an error in the word counter project , previously it was showing the wrong number count for the words type in the input box.
Describe if there is any unusual behaviour of your code(Write NA if there isn't)
NA
Checklist:

[x] My code follows the style guidelines of this project.
[x] I have performed a self-review of my own code.
[x] I have commented my code, particularly in hard-to-understand areas.
[x] I have made corresponding changes to the documentation.
[x] New and existing unit tests pass locally with my changes.

Screenshots

For two words it work fine.
Would you be able to fix this when one word is there it shows zero.

Yes I will

Hey @swapnilbhakare any updates ? Would you be able to fix it ?

@swapnilbhakare  Reply Otherwise I'll assign to someone else.

i will do sir

It's working correctly now even for one word.

Its working well now.

Looks Good.

Keep Contributing.

@neha07kumari Will assign you something else.


[LUM-491] - Integrate e2e tests for controllers and github workflow

NB: Gitguardian was activated as I passed a secret related to a beam that I triggered locally in seed data. No risk involved here.


Unicode/Swedish character support with Google Drive

Unicode/Swedish characters entered in code and stored on Github corrupted or lost when the file is reloaded. Reported by a runpython.org user.

Download works OK. Upload is corrupting.

Closed in release v2.1.16 58bbd08


Upgraded to dropwizard 5.0 with metrics tagging support

As far as I can see the dropwizard 5 is backwards incompatible with 4.x. It would probably be good to have a different artifact opencensus-contrib-dropwizard5 for this work. That way if people are using both versions (via different libraries) they can still export metrics from both.

t would probably be good to have a different artifact opencensus-contrib-dropwizard5 for this work

good call, @bogdandrutu - just pushed a new version with a separate dropwizard5 module and keeping the old one

Please add a line to CHANGELOG ->
Add an util artifact opencensus-contrib-dropwizard5 to translate Dropwizard metrics5 to OpenCensus.

@amuraru friendly ping

@bogdandrutu @mayurkale22 let me know how it looks


etsy

go to https://www.etsy.com/
search for tables in the search box
click on some listings
add a listing to the cart

@ryanjduffy https://github.com/RecordReplay/playwright-tests/blob/main/qawolf/etsy_search_listings_click_listings_add_listing_to_cart.js


I can't login I'm to weak for this program

Please help me your website is very helpful please help me 😭 there's a error after I click loggin
https://github.com/user-attachments/assets/3f57c0ff-6776-45e1-9e08-03acf53d4871

The error occurs when the backend or API endpoint for handling the POST request to /login is not properly configured or not reachable. and i didn't attach it for security purposes.


Fix godocs

rename package and fix compile errors to resolve examples not showing up in godocs. tested locally

Hey @dbut2 what's the benefit to this?

@tobiemh This will allow these examples to be show in the public go docs, https://pkg.go.dev/github.com/surrealdb/surrealdb.go
Example example for fmt.Print https://pkg.go.dev/fmt#example-Print


Adjust logging levels for third party libraries

Codecov Report

Merging #7453 (5048cee) into dev (6cad119) will decrease coverage by 0.03%.
The diff coverage is n/a.

:exclamation: Current head 5048cee differs from pull request most recent head 1025852. Consider uploading reports for the commit 1025852 to get more accurate results

@@             Coverage Diff              @@
##                dev    #7453      +/-   ##
============================================
- Coverage     41.30%   41.26%   -0.04%
+ Complexity     3667     3663       -4
============================================
  Files           634      634
  Lines         26411    26411
  Branches       2959     2959
============================================
- Hits          10908    10899       -9
- Misses        14475    14487      +12
+ Partials       1028     1025       -3

Impacted Files
Coverage Δ

...r/plugin/registry/zookeeper/ZookeeperRegistry.java
48.64% <0.00%> (-7.21%)
:arrow_down:

...er/master/dispatch/host/assign/RandomSelector.java
77.77% <0.00%> (-5.56%)
:arrow_down:

...org/apache/dolphinscheduler/remote/utils/Host.java
37.77% <0.00%> (-2.23%)
:arrow_down:

...e/dolphinscheduler/remote/NettyRemotingClient.java
52.11% <0.00%> (-1.41%)
:arrow_down:

...er/master/processor/queue/TaskResponseService.java
64.04% <0.00%> (+3.37%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6cad119...1025852. Read the comment docs.

Why mergeable would auto-remove label chore?

Why mergeable would auto-remove label chore?

Ha, didn't notice this, not sure why


iOS 14 support for unity SDK

Hi! Any news on when iOS 14 support would be released for the Unity SDK? I see that support for iOS 14 has already been released for the iOS SDK.
Thanks!

Hello @jmarisalandanan,
The Unity SDK is in testing and should be released in a day or two.

@jmarisalandanan Flurry Unity plugin 3.0.0 released!
Update for version 3.0.0

Upgrade Flurry iOS SDK version to 11.0.0
Support iOS 14 Compliant
Support the iOS SKAdNetwork conversion
Support opening Privacy Dashboard

@poting-oath Thank you!

Reopening due to recent development that Apple will delay ATT's implementation and found that 11.1.0 now has an option to make ATT optional. Any news for a Unity SDK update?

Hello @jmarisalandanan, We will release a new version of the plugin by the end of the week making ATT optional.

Hi @flurrydev
Is it will it be sufficient to manually update the iOS libFlurry.a from 11.0.0 to the 11.1.0 version inside the Unity project?
Thanks!

@jmarisalandanan @mvl-illumix
will it be sufficient to manually update the iOS libFlurry.a from 11.0.0 to the 11.1.0 version inside the Unity project?
Yes this will resolve the issue.

Unity plugin 3.1.0 released:

Upgrade Flurry Android SDK version to 12.7.0
Upgrade Flurry iOS SDK version to 11.1.0


Type-Definitions for MindAR for react projects in Typescript

Hello!!
First of all thanks for this tremendous open-source AR library, I have been using it extensively, alongside your Udemy course.
I tried to use the mind-ar npm package in a ts-react project, but there does not seem to be a type definition file for the mind-ar library...

yes. Unfortunately, we don't have a typescript version.


can FIM or MIM support updating custom attributes in Azure AD?

scenario: user account details are in Active Directory. I want to use Azure AD to authenticate to a SaaS - let's call it MyDetails.com. MyDetails.com support just in time (JIT) provisioning. In other words, users in MyDetails.com are created automatically after authentication, where Azure AD issues the claims for provisioning.
 This is SENSITIVE personal information - you would NEVER put this in Active Directory. Instead, it's in a database; let's call it SensitiveDB.
Now, I can create these custom attributes in Azure Active Directory, but Azure AD Connect will only let me populate them from Active Directory. I think I have two options;

develop something that populates via Graph API
deploy Microsoft Identity Manager (MIM) to synchronise SensitiveDB attributes with Azure AD.
I am speculating on the MIM option. Does it include an Azure AD connector? If it does, does it support Azure AD custom attributes?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 6865c730-34cc-42a7-544e-597536b1bfd5
Version Independent ID: b2955f76-2767-bb73-e00a-8017c9514094
Content: Hybrid Identity: Directory integration tools comparison
Content Source: articles/active-directory/hybrid/plan-hybrid-identity-design-considerations-tools-comparison.md
Service: active-directory
Sub-service: hybrid
GitHub Login: @billmath
Microsoft Alias: billmath

@anwarmahmood1 Thanks for your feedback! We will investigate and update as appropriate.

@anwarmahmood1 what do you mean about including an Azure AD connector? It would need to be installed.

Please post this question to MSDN as it is more of a product question than a document question. https://social.msdn.microsoft.com/Forums/en-US/home?forum=WindowsAzureAD


update the environment variables which are declared in the zappa settings. json file.

I have declared  my zappa_settings.json file like this
{
"dev": {
"s3_bucket": "zappa-for-mock",
"app_function": "mock_server.app",
"runtime": "python3.9",
"slim_handler": true,
"delete_local_zip": true,
"lambda_description": "aws:states:opt-out",
"aws_region": "us-east-1",
"profile_name": "default",
"project_name": "mockserver39",
"aws_environment_variables": {
"number": "12222121311",
"order_id": "1000212",
"status": "status"
}
}
}
Now i have run the - "zappa update dev" . Now the environment variables are set in the AWS with the above values.
Now i am trying to overide the variables by using this command - zappa update dev --set number=12222121355.  but the values are not getting overwritten.
How can i achieve this from the runtime only.
Can someone help me this.
Awaiting your reply.

Hi @kalyangcp123 number is not a variable in Zappa settings.
You may have seperate .env file.

Hi @souravjamwal77
can you point me to an article on how to do this? I did not find any with
google.

@kalyangcp123
https://github.com/zappa/Zappa#setting-environment-variables

I believe that environment variables set with aws_environment_variables will be available in the aws lambda console.
You should be able to update the value directly there.

Hi @monkut I had a call with @kalyangcp123 and his use case is to update env variables regularly. Now, once a lambda environment is invoked it may keep same environment variables during its execution or any async invocation or unless lambda cools down and new environment is commenced again.
He needs to update the values like order Id, number and status regularly and for this use he can use either a DB or S3 remote env or Dynamo DB to update the values regularly.
Let me know if I'm incorrect.

Ok, closing.


Fixing hairpin nat issues #6830

https://github.com/rancher/rancher/issues/6830

Also the root cause for: https://github.com/rancher/rancher/issues/6831


oragono.io/abbreviated-handshake

The intent here is to speed up reattaches for mobile clients. Basically:

The client will reconnect, do CAP negotiation and SASL as usual
The client will additionally request a vendor cap oragono.io/abbreviated-handshake
Upon CAP END, the server will send 001 but none of the other conventional registration numerics; in particular 005 and the MOTD will be skipped
The server will probably send JOIN lines for all joined channels (as usual), but will not send RPL_NAMREPLY

@kylef is going to take a look at the potential impact of this.

Regarding the 005 and all, sometimes those do change for legitimate reasons. Could we send some hashed value that represents those, that client client can store, and if the hashed value they get from us differs from what they have stored the client knows they should run VERSION and get the updated isupport tokens?

Note from koragg, clients use the endofmotd/nomotd numerics to basically see that they are connected. We'll need to either send one of those, or send our own bespoke custom verb so clients can realise they're connected.
wrt ^, maybe the value of oragono.io/abbreviated-handshake could be the isupport timestamp/value/etc, since that can also get updated by the server anytime with cap-notify? idk.

From some initial benchmarking, it seems to me that the cost of the handshake is dominated by establishing the TLS connection and then the back-and-forth of conventional CAP negotiation, not by the registration numerics. Here's the test I ran (contains a non-sensitive password):
https://gist.github.com/slingamn/c84b95452153e208b5d78f240930d664
script.txt is what the client side of the handshake would look like under oragono.io/abbreviated-handshake, plus a final QUIT. bench.go sends this entire handshake optimistically at once, without waiting for server responses. In my testing, once the TLS connection is established, the entire handshake can be done in approximately 1 RTT to the server. (This includes password checking, which is about a millisecond with the recommended Oragono config.) Increasing the size of the MOTD didn't seem to change much, which suggests that optimizing the length of the server-sent registration numerics won't have that much impact.
Caveat: all of this is on wires, it could be that on mobile it's more important to get the server's response under the MTU, or into fewer send calls.
cc @ProgVal

@kylef is going to take a look at the potential impact of this.

These figures are best effort and may be slightly off, I didn't necessarily make this data 100% ms accurate and are subject to me rounding them and not computing ms when the times are >1 second. This is more to get a feel of the difference, if we have a particular aspect that we want to look at in more detail I can get more specific and accurate data.
Oragono
Connecting to a very small Oragono instance. Small amount of channels with practically empty NAMES list. Completing a reconnect with znc-playback which contains no new messages from prior session.
Generally results in receiving 72 messages with a total of 8577 bytes (just counting for the IRC messages, not their representation in TLS/TCP/IP). Client sends 15 messages coming in at 584 bytes.
Capability Negotiation looks like the following, including a PLAIN SASL login.
2021-02-28 15:43:38.343491+0000 C: CAP LS 302
2021-02-28 15:43:38.344397+0000 C: NICK kyle
2021-02-28 15:43:38.345008+0000 C: USER kyle 0 * Kyle
2021-02-28 15:43:39.224672+0000 S: :irc.example.com CAP * LS * :account-notify account-tag away-notify batch cap-notify chghost draft/channel-rename draft/chathistory draft/event-playback draft/languages=16,en,~bs,~de,~el,~en-AU,~es,~fi,~fr-FR,~it,~nl,~no,~pl,~pt-BR,~ro,~tr-TR,~zh-CN draft/multiline=max-bytes=4096,max-lines=100 draft/register=before-connect draft/relaymsg=/ draft/resume-0.5 echo-message extended-join invite-notify labeled-response message-tags multi-prefix oragono.io/nope sasl=PLAIN,EXTERNAL server-time setname
2021-02-28 15:43:39.238604+0000 S: :irc.example.com CAP * LS :sts=duration=2592000,port=6697 userhost-in-names znc.in/playback znc.in/self-message
2021-02-28 15:43:39.244438+0000 C: CAP REQ :account-tag batch chghost echo-message invite-notify labeled-response message-tags multi-prefix sasl server-time userhost-in-names znc.in/playback znc.in/self-message
2021-02-28 15:43:40.993935+0000 S: @time=2021-02-28T15:43:40.596Z :irc.example.com CAP * ACK :account-tag batch chghost echo-message invite-notify labeled-response message-tags multi-prefix sasl server-time userhost-in-names znc.in/playback znc.in/self-message
2021-02-28 15:43:40.996027+0000 C: AUTHENTICATE ******************
2021-02-28 15:43:41.854455+0000 S: AUTHENTICATE +
2021-02-28 15:43:41.864019+0000 C: AUTHENTICATE ******************
2021-02-28 15:43:42.820749+0000 S: @time=2021-02-28T15:43:42.422Z :irc.example.com 900 * * kylef :You are now logged in as kylef
2021-02-28 15:43:42.823244+0000 S: @time=2021-02-28T15:43:42.422Z :irc.example.com 903 * :Authentication successful
2021-02-28 15:43:42.824470+0000 C: CAP END

Connection
Connect Time
Capability Negotiation
Registration to fully synced

Edge
7s
4s
4s

3G
1s
1s
1s

LTE
790ms
700ms
550ms

DSL
250ms
500ms
500ms

ZNC + Freenode + znc-playback
ZNC generally skips a back and forth with SASL because it uses a server password which the client is able to send without negotiating sasl, asking for plain, etc. This also includes a cap-notify update after cap end because ZNC will update client once it knows which network it is connected to, with some upstream server features. This includes the client sending a push notification identification for Palaver Push.
ZNC test does contain a lot more data because it is more "real world" I have joined larger channels with large NAMES for this test. Across the full session, we received 201 messages with 54277 bytes. We sent 20 messages at 767 bytes.
The handshake (prior to 001) looks something like the following:
2021-02-28 16:36:25.945505+0000 Connecting
2021-02-28 16:36:29.904985+0000 C: CAP LS 302
2021-02-28 16:36:29.905952+0000 C: PASS *************
2021-02-28 16:36:29.906527+0000 C: NICK kyle
2021-02-28 16:36:29.907093+0000 C: USER kyle 0 * Kyle
2021-02-28 16:36:30.799897+0000 S: :irc.znc.in CAP unknown-nick LS :batch cap-notify echo-message multi-prefix palaverapp.com server-time userhost-in-names znc.in/batch znc.in/playback znc.in/self-message znc.in/server-time-iso
2021-02-28 16:36:30.803899+0000 C: CAP REQ :batch multi-prefix palaverapp.com server-time userhost-in-names znc.in/playback znc.in/self-message
2021-02-28 16:36:32.934564+0000 S: @time=2021-02-28T16:36:32.526Z :irc.znc.in CAP kyle ACK :batch multi-prefix palaverapp.com server-time userhost-in-names znc.in/playback znc.in/self-message
2021-02-28 16:36:32.937400+0000 C: PALAVER IDENTIFY ***** **** *****
2021-02-28 16:36:32.938299+0000 C: CAP END
2021-02-28 16:36:34.753761+0000 S: @time=2021-02-28T16:36:34.345Z :irc.znc.in CAP _kylef_ NEW :account-notify away-notify extended-join
2021-02-28 16:36:34.803777+0000 S: @time=2021-02-28T16:07:30.014Z :moon.freenode.net 001 kyle :Welcome to the freenode Internet Relay Chat Network jjjjj

Connection
Connect Time
Capability Negotiation
Registration to fully synced

Edge
4s
5s
5s

3G
1s
1s
2.5s

LTE
700ms
1s
1s

DSL
500ms
1s
1s

I'd also point out that is for single server, 1 connection. In real world you may be connected a few networks at once which competes for networking resources.

ZNC generally skips a back and forth with SASL because it uses a server password which the client is able to send without negotiating sasl, asking for plain, etc.

I kind of want to make a "RFC 4959 but for IRC" to cut out this one round-trip...


invoice expiry watcher cancels cancelled invoices, causing lots of errors in the logs

Background
There seems to be some logic in invoice_expiry_watcher.go which automatically cancels invoices as soon as they expire. In general, I think this is a great idea. However, I think this code also calls CancelInvoice for invoices that have already been cancelled. As a result of this, my log file shows countless errors like the following:
21:01:31.738 [ERR] INVC: Unable to cancel invoice: 3183323db058dbf197f25e0ba0a86b370b4e2934e0e291ce7bb58fe27bf0a99f: unable to locate invoice

Your environment

version of lnd: some recent master (0.14ish)

Steps to reproduce

Create invoice
Cancel invoice
Wait for invoice to expire
Look at logs

Expected behaviour
The invoice is cancelled in step 2 and nothing noteworthy happens at 3./4.
Actual behaviour
An error is logged.

Thanks for reporting, indeed this error is very annoying, but fortunately it's easy to fix.


Some Kiosk Discs (Cat-R) aren't dumping

Thanks for your awesome software :)
I'm preserving Kiosk discs with redump.org and we have recently dumped a dozen Kiosk discs perfectly with a Kiosk unit.
However, there are a couple discs that just would not dump and wudump froze up. Between myself and someone else, we tested two different copies of the August 2014 kiosk disc (GPK, DEMO CAT-I AUG '14 USA-PT / 100147/ 100148 - DISC, CAT-I RTL AUG '14 USA-PT) and it would not complete (mine stalling at 15% dumped).
Is this something Wudump could update fix? Thanks again :)

wudump is just a main loop that calls part of IOSU (basically part of the wiiu operating system) to get a block from a disc and tries to do so until that call does not return any error, meaning that really I cannot change anything as there really is no code to begin with to change, its all official nintendo code, as to why for some consoles/discs problems seem to occur I have no idea sadly.

Thank you very much for your reply. Interesting that the discs will play fine - so they can be read by the console - except during the dumping phase.


Add unittests for ApplicationContext

What's it for?

What's it for?

https://github.com/oam-dev/kubevela/pull/1519#issuecomment-829786124

@wonderflow Somehow test coverage of ApplicationContext controller decreased badly, so I made a separate PR to increase the it #1586.


Issue of infinite-loop

In demo/15-infinite-loop.html, I have coded below;
var swiper = new Swiper('.swiper-container', {
pagination: '.swiper-pagination',
nextButton: '.swiper-button-next',
prevButton: '.swiper-button-prev',
slidesPerView: 5,
centeredSlides: true,
paginationClickable: true,
spaceBetween: 30,
loop: true
});
when I run it on mobile device, I get a issue.
It works well when I swipe from right to left (<-).
But when I swipe from left to right(->), sometimes in left half area of screen, I can't see Slide items.

Try to increase loopedSlides parameter

I have tried to increase loopedSlides parameter.
Still I get same issue when I swipe.
But it is better than older.
Thank you.


Impossible to add a deck after removing

Hi,
If I remove a deck and try to add it again it gives an error message saying that the deck already exists.

Do you delete the deck like a classic deck or by do firstly delete deck by tools -> manage remote deck -> remove deck ?

I was deleting it just as a classic deck. I didn't know it was a two steps process. Thanks!


looking for a new feature in powertoys run

Description of the new feature / enhancement
a way to make the search bar in powertoys run permanent
Scenario when this would be used?
when I'm on my desktop and need to find something fast without a command
Supporting information
if this feature is available I would like to understand how to enable it

Thanks for your message. This is a Duplicate of another issue: /dup #3344. Additional comments may be added there.


[bug]Modify the error serial number

I found on the contributing guide page that some serial numbers are incorrect on the Chinese page and the English page, so I submitted this pr.

Thanks for your fix
/approve

Thanks for your fix
/approve


Bad failure mode on malformed flag to iree-run-module

The following command hangs forever:
iree-run-module -module_file=/does/not/exist

The issue is that the flag passed with a single dash (a mistake people are likely to make given LLVM accepting them) is being interpreted as a positional argument and then iree-run-module happily proceeds looking for input on stdin. I think there are a few things we can do to make this better, although it is a tricky edge case:

Update our documentation to consistently use two dashes for long options. IMO it's bad that LLVM accepts a single dash for long options. It flies in the face of all the conventions I know of.
Error out on args that start with a single dash, when parsing flags: https://github.com/google/iree/blob/f6d36fecb5c1a5ca281318ea589cdad7eeb24bab/iree/base/internal/flags.c#L342-L345. It should still be possible to pass a literal dash with \-
Add error checking for unexpected positional arguments to flags parsing.
Make stdin something that has to be explicitly requested.
Print that we are reading from stdin when reading from stdin

If LLVM supports -- we should change all our docs to that - then less confusion/chances for mismatches. It makes sense for people to copy parts of commands and it triggers me when I see someone who (understandably) uses both in the same invocation :P
We can also enable support for - - it sucks but for the reasons you mention we should probably be consistently inconsistent along with LLVM just as an ease of use thing, even if we document everything as --.

There was a similar bug that hangs when an invalid option is given. iree-benchmark-module --module-file=foo.vmfb. The option does not exist. The right one is --module_file=foo.vmfb. It just hangs waiting input from stdin instead of reporting a bad option.


Add Journal of Translational Science

The publisher, Open Access Text, is already listed on the publishers page.

The Journal of Academic Social Science Studies-JASSS has been indexed by DOAJ. İt is not predatory.
DOAJ LINK:
https://doaj.org/toc/2147-2971?source={"query"%3A{"filtered"%3A{"filter"%3A{"bool"%3A{"must"%3A[{"terms"%3A{"index.issn.exact"%3A["2148-4163"%2C"2147-2971"]}}%2C{"term"%3A{"_type"%3A"article"}}]}}%2C"query"%3A{"match_all"%3A{}}}}%2C"size"%3A100%2C"_source"%3A{}}


Icon button

OK! This got bigger than expected.
https://openedx.atlassian.net/jira/software/c/projects/ENT/issues/ENT-3311
Styles:
https://www.figma.com/file/wC5LTEbZaFqHmLKvM1owoM/Paragon-2019?node-id=73%3A386
This component came out of a component that I added to frontend-app-admin-portal, and subsequent discussions with Gabe Weinberg about a similar component that was planned.
It's an icon component with (optional) tooltip and (optional) click handler. If it's a given a click handler,  it's given the button role and responds to the user pressing spacebar when the element is focused (which is how buttons are supposed to behave for screen readers).
This PR adds several hooks to Paragon, though for now we're only exposing useWindowSize. I'm open to exposing the others, but less immediately sure of their utility. Let me know about folder structure for hooks...
TESTING:
I'm having trouble with testing for an element in focus. I think the next step is to mock the hooks instead of testing the focus directly? But other thoughts are welcome. (There's one skipped test in that vein.)
Something I changed is making a Modal test fail, but I'm not sure what.
I'm working on figuring out how to test the hooks.
update: Mocked the hook for the component, still need help testing the hook. Tried approx. ten million ways to trigger a focusin event. (enzyme does not actually trigger the focus event, it just calls onFocus, which won't work here.)
PACKAGES ADDED:

eslint addon for hooks that has been super useful.

Coverage increased (+0.03%) to 88.528% when pulling 33eed7172b6a156f4bd30c15e060a4598c971751 on lbirch/icon-button into 182406ff6f8ce4160e4cad729448c860ad772e18 on master.

:tada: This PR is included in version 10.1.1 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Update container version/tags in complete-demo.yml; relates to #390

Relates to https://github.com/microservices-demo/microservices-demo/issues/390

This influences the DeployDoc's as well; the script parses this yaml file to determine which docker images are used.


Line numbers in Cargo.toml related error messages please

As rust projects grow it becomes more important to have excellent error messages.
Part of that is being able to pinpoint the source span of an issue in a particular Cargo.toml (in the same way that rustc does). This enables IDEs to be able to go directly to the source line in question.
When we're dealing with one crate at a time this is less of an issue, but if you're dealing with 100 crates then line numbers really help speed up getting to the location of the error so that it can be quickly fixed.
(Apoligies if this is a dupe, I did look but surprisingly couldn't find a similar issue)

I see we can use toml::Spanned for fields in the TomlManifest that we're interested in giving detailed line number information about - I'd suggest we start with just dev/build/dependencies having associated line numbers and see where we go from there.

There are similar issues such as #7548 and #6144. It would be nice, but quite a large change.

I'm going to close as a duplicate of the above linked issues.


Severe Bug - The program fails to start with the command 'pnpm start', urgent fix required

Describe the bug
The program fails to run at all when following the steps to set it up and execute the commands. After cloning the repository git clone git@github.com:ai16z/eliza.git, and going through the setup process including installing prerequisites like Python 2.7+, Node.js 23.1+, and pnpm, editing the .env file and character file as instructed, and then running the commands pnpm i and pnpm start, the program doesn't start. Tried again with the latest code today but still faced the same issue. It's quite surprising that such a serious problem exists and it seems no one has addressed it yet.

To Reproduce
Clone the repository: git clone git@github.com:ai16z/eliza.git
Ensure the following prerequisites are installed:
Python 2.7+
Node.js 23.1+
pnpm
Edit the .env file:
Copy .env.example to .env and fill in the appropriate values.
Edit the TWITTER environment variables to add your bot's username and password.
After setting up the .env file and character file, run the following commands:
pnpm i
pnpm start

Expected behavior
[Describe here what you expected to happen when following the above steps. For example, you might expect the bot to start successfully and perform its intended functions without any errors.]

Screenshots

Try checking out v0.0.10 and running that

Also curious if ‘pnpm run dev’ works.  I just pulled the code 2 hrs ago and it started for me. I was just iuaing the basic agent though.  Didn’t config twitter.  But good idea to try the tagged version mentioned previously

Try pnpm run dev. The problem is start doesn't run tsc. I pushed a fix for this to main.
There is an error in your code, tsc will show what it is

I'm closing this because I think it's a bug related to JSON formatting or something, not broken main


[FEATURE] Add rest api to get list of trigger types - TRIGGER_TYPE

Is your feature request related to a problem?
Currently we need to hard-code list of trigger types in code and need to refer back to this repository from time to time to see if any additional types are added
What solution would you like?
Need to get a list of trigger types returned from a rest api
What alternatives have you considered?
Hard-coding the trigger types in code
Do you have any additional context?
Trigger types can be found here

@rblcoder Currently each trigger type is associated to specifc monitor type.
We encourage you to raise a PR to add support for such an API if you have a use case to list trigger types but i personally see more value in fetching the monitor types as that will help determine the trigger type

@eirsep Would it be better to derive the trigger type from the monitor type?


Firefox Icons not loading properly

Describe the Bug
The bug is that icons you set inside of the settings once your server is setup will load just fine on a chromium based browser (Tested on both Edge, Chrome, Brave & Opera)
However when you open up firefox the logo when bookmarked will turn back into the standard icon for BookStack and not change to your new icon.
Steps to Reproduce
Open Firefox, Create ubuntu 22.06 LTS bookstack Server, use name server to call it & change the icon under Settings from Admin account.
Now it won't show correctly, but if you then go to any chromium based browser it works just fine.
Expected Behaviour
Icon loads properly and shows when changed in the Bookmark
Screenshots or Additional Context
Tested on 121.0.1 & 122.0.1 of firefox.
Browser Details
121.0.1
Exact BookStack Version
v23.12.2

Hi @WilliamBjerglund,
From my testing Firefox can pick up the icons fine (favicons, bookmark icons, homepage icons) but it can aggressively cache these images, which is fair enough since these are part of common UIs.
You might find that they change in time.

Hi @ssddanbrown
I hope you are right and for now i guess i will to close this issue and hope it goes away with time. I just thought it might be a bug since we were a total of 5 people in our Project who had this issue, and still do.


[SPARK-34330][SQL] Literal's constructor support UTF8String

What changes were proposed in this pull request?
Since when UnsafeRow.getString return UTF8String, but Literal.apply() don't support UF8String.
In this patch support it.
Why are the changes needed?
Make Literal's constructor support UTF8String
Does this PR introduce any user-facing change?
When s is instance of UTF8String
user can use Literal(s)
How was this patch tested?
Not need

ping @maropu @cloud-fan

Test build #134781 has started for PR 31438 at commit 27c7eb8.

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39368/

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39368/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39368/

Test build #134781 has finished for PR 31438 at commit 27c7eb8.

This patch passes all tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
case class Literal(value: Any, dataType: DataType) extends LeafExpression

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/134781/


feat(coralogix): log full user agent if it is not normalized

:tada: This PR is included in version 2.11.0 :tada:
The release is available on:

v2.11.0
v2.11.0
GitHub release

Your semantic-release bot :package::rocket:


How to close permission view ?

Hello,
i'm sorry to request that, but I don't know how to close the permission view when user deny permissions.
i'm using didDeniedPermission and compare with all permissions requested, but how to close the view ?
Thanks

you should call this:
public func dismiss(withDialog: Bool)

for dialog example.


manta sv calling error

Ran upon another error in the latest dev version of bcbio-nextgen
[2018-03-27T12:07Z] Timing: structural variation
[2018-03-27T12:07Z] multiprocessing: detect_sv
Traceback (most recent call last):
  File "/home/genetik-devel/bcbio/tools/bin/bcbio_nextgen.py", line 241, in <module>
    main(**kwargs)
  File "/home/genetik-devel/bcbio/tools/bin/bcbio_nextgen.py", line 46, in main
    run_main(**kwargs)
  File "/home/genetik-devel/bcbio/share/bcbio/anaconda/lib/python2.7/site-packages/bcbio/pipeline/main.py", line 43, in run_main
    fc_dir, run_info_yaml)
  File "/home/genetik-devel/bcbio/share/bcbio/anaconda/lib/python2.7/site-packages/bcbio/pipeline/main.py", line 87, in _run_toplevel
    for xs in pipeline(config, run_info_yaml, parallel, dirs, samples):
  File "/home/genetik-devel/bcbio/share/bcbio/anaconda/lib/python2.7/site-packages/bcbio/pipeline/main.py", line 174, in variant2pipeline
    samples = structural.run(samples, run_parallel, "standard")
  File "/home/genetik-devel/bcbio/share/bcbio/anaconda/lib/python2.7/site-packages/bcbio/structural/__init__.py", line 177, in run
    for xs in to_process.values()))
  File "/home/genetik-devel/bcbio/share/bcbio/anaconda/lib/python2.7/site-packages/bcbio/distributed/multi.py", line 28, in run_parallel
    return run_multicore(fn, items, config, parallel=parallel)
  File "/home/genetik-devel/bcbio/share/bcbio/anaconda/lib/python2.7/site-packages/bcbio/distributed/multi.py", line 86, in run_multicore
    for data in joblib.Parallel(parallel["num_jobs"], batch_size=1)(joblib.delayed(fn)(x) for x in items):
  File "/home/genetik-devel/bcbio/share/bcbio/anaconda/lib/python2.7/site-packages/joblib/parallel.py", line 804, in __call__
    while self.dispatch_one_batch(iterator):
  File "/home/genetik-devel/bcbio/share/bcbio/anaconda/lib/python2.7/site-packages/joblib/parallel.py", line 662, in dispatch_one_batch
    self._dispatch(tasks)
  File "/home/genetik-devel/bcbio/share/bcbio/anaconda/lib/python2.7/site-packages/joblib/parallel.py", line 570, in _dispatch
    job = ImmediateComputeBatch(batch)
  File "/home/genetik-devel/bcbio/share/bcbio/anaconda/lib/python2.7/site-packages/joblib/parallel.py", line 183, in __init__
    self.results = batch()
  File "/home/genetik-devel/bcbio/share/bcbio/anaconda/lib/python2.7/site-packages/joblib/parallel.py", line 72, in __call__
    return [func(*args, **kwargs) for func, args, kwargs in self.items]
  File "/home/genetik-devel/bcbio/share/bcbio/anaconda/lib/python2.7/site-packages/bcbio/utils.py", line 52, in wrapper
    return apply(f, *args, **kwargs)
  File "/home/genetik-devel/bcbio/share/bcbio/anaconda/lib/python2.7/site-packages/bcbio/distributed/multitasks.py", line 311, in detect_sv
    return structural.detect_sv(*args)
  File "/home/genetik-devel/bcbio/share/bcbio/anaconda/lib/python2.7/site-packages/bcbio/structural/__init__.py", line 197, in detect_sv
    for svdata in caller_fn(items):
  File "/home/genetik-devel/bcbio/share/bcbio/anaconda/lib/python2.7/site-packages/bcbio/structural/manta.py", line 27, in run
    tx_workflow_file = _prep_config(items, paired, tx_work_dir)
  File "/home/genetik-devel/bcbio/share/bcbio/anaconda/lib/python2.7/site-packages/bcbio/structural/manta.py", line 91, in _prep_config
    for region in _maybe_limit_chromosomes(data):
  File "/home/genetik-devel/bcbio/share/bcbio/anaconda/lib/python2.7/site-packages/bcbio/structural/manta.py", line 109, in _maybe_limit_chromosomes
    std_chroms.append(contig.name)
NameError: global name 'std_chroms' is not defined

Sorry about the issue. This was a typo that got fixed yesterday:
https://github.com/bcbio/bcbio-nextgen/commit/776ef06a8732b976428d1d354219d7d72978dd46
If you update with bcbio_nextgen.py upgrade -u development it should hopefully avoid the issue and run cleanly for you. Hope this gets your analysis working.

I'm still having an issue with manta.
Manta still fails, and I cannot seem to understand why.  See error below:
/home/genetik-devel/bcbio/share/bcbio/anaconda/share/manta-1.3.2-0/libexec/GetAlignmentStats --ref /home/genetik-devel/bcbio/share/bcbio/genomes/Hsapiens/hg19/seq/hg19.fa --output-file /home/genetik-devel/Projects/svcalls/calling/work/bcbiotx/tmppj60Nw/manta/workspace/alignmentStats.xml.tmpdir/alignmentStats.xml.003.xml --align-file /home/genetik-devel/Projects/svcalls/calling/work/align/14-3306/14-3306-sort.bam
FATAL_ERROR: 2018-Apr-06 13:19:39 /builder/src/c++/lib/manta/ReadGroupStatsUtil.cpp(260): Throw in function void ReadGroupOrientTracker::finalize(const ReadCounter&)
Dynamic exception type: boost::exception_detail::clone_impl<illumina::common::GeneralException>
std::exception::what: Can't determine consensus pair orientation of read group '' in bam file '/home/genetik-devel/Projects/svcalls/calling/work/align/14-3306/14-3306-sort.bam.
	The most frequent orientation is 'Rm' (57% of 54224 total used read pairs)
	The fraction of 'Rm' among total high-confidence read pairs needs to be more than 0.9 to determine consensus pair orientation.
	Total sampled reads: 3818416
	Total sampled paired reads: 3818416
	Total sampled paired reads passing MAPQ filter: 3755852
	Total sampled high-confidence read pairs passing all filters: 54224

A hint might be that the read group is empty in the error msg. However looking in the bam header, it's there:
@RG	ID:14-3306	PL:illumina	PU:14-3306	SM:14-3306

Output from alfred qc does not help me either:
ME	ME
Sample	14-3306
Library	14-3306
#QCFail	0
QCFailFraction	0
#DuplicateMarked	0
DuplicateFraction	0
#Unmapped	335509
UnmappedFraction	0.0808109
#Mapped	3816271
MappedFraction	0.919189
#MappedRead1	1908182
#MappedRead2	1908089
RatioMapped2vsMapped1	0.999951
#MappedForward	1908121
MappedForwardFraction	0.499996
#MappedReverse	1908150
MappedReverseFraction	0.500004
#SecondaryAlignments	1156
SecondaryAlignmentFraction	0.000302913
#SupplementaryAlignments	0
SupplementaryAlignmentFraction	0
#SplicedAlignments	0
SplicedAlignmentFraction	0
#Pairs	2076468
#MappedPairs	1908211
MappedPairsFraction	0.91897
#MappedSameChr	1907357
MappedSameChrFraction	0.918558
#MappedProperPair	1905816
MappedProperFraction	0.917816
#ReferenceBp<PHONE_NUMBER>
#ReferenceNs	239850702
#AlignedBases	392068296
#MatchedBases	390475716
MatchRate	0.995938
#MismatchedBases	1592580
MismatchRate	0.004062
#DeletionsCigarD	20322
DeletionRate	5.18328E-05
HomopolymerContextDel	0.570613
#InsertionsCigarI	11157
InsertionRate	2.84568E-05
HomopolymerContextIns	0.409519
#SoftClippedBases	1110926
SoftClipRate	0.0028335
#HardClippedBases	0
HardClipRate	0
ErrorRate	0.00697579
MedianReadLength	124
DefaultLibraryLayout	3
MedianInsertSize	109
MedianCoverage	0
SDCoverage	1.86657
MedianMAPQ	60

Par;
Thanks for continuing to debug this and the detailed report. Looking through the statistics for the reads, my guess is that the small insert size is the likely issue:
MedianReadLength	108
MedianInsertSize	102

Most SV callers will have trouble with these as I believe heavily overlapping reads aren't always reported in a consistent way. This older manta thread discusses some of the issues with this type of data: https://github.com/Illumina/manta/issues/21
My suggestion would be to remove split/discordant read based callers like delly and manta on this sample and try to stick with a depth based caller like CNVkit only. Hope this helps.

Thanks!


Paging the result for attributes

I am trying to get members of a group and find their email address. The AD group contains 50k+ results. When I query the AD group I can only get 1500 results. I tried the acquire_next_page flag but couldn't get the next set of attributes.

There's no built-in solution for getting all the values from an Active Directory.
But according to this article you can do something like this:
import bonsai
from collections import defaultdict

...

res = conn.search("cn=your_entry_with_many_values,dc=test", 0)
attrs = defaultdict(list)
while True:
    next_ranges = []
    for key in res[0].keys():
        grps = re.match("([^;]+);range=([0-9]+)-([0-9]+)", key)
        if grps:
            name, _, upper_bound = grps.groups()
            attrs[name].extend(res[0][key])
            next_ranges.append("{name};range={idx}-*".format(name=name, idx=(int(upper_bound) + 1)))
    res = conn.search(res[0].dn, 0, attrlist=next_ranges)
    if all("-*" in k for k in res[0].keys() if k != "dn"):
        for k in next_ranges:
            key = k.split(";")[0]
            attrs[key].extend(res[0][k])
        break;

The attrs dictionary will have all the assigned values for your many valued attributes.

Thank you this seems to help fix the bug.


Creating the deployment package (BYOC)

bring-your-own-container
Azure Functions lets you host your Python functions on Linux in your own custom container. You can use one of the following options to build the container:
1. Build locally
Download and customize the sample
Clone the sample app repository to your local machine, then change to the directory that contains the sample code.
git clone https://github.com/Azure/azure-functions-docker-python-sample.git
cd azure-functions-docker-sample

Build the image from the Docker file
The Dockerfile describes the environment that is required to run the function app on Linux.
To build the Docker image, run the docker build command, and provide a name mydockerimage, and a tag v1.0.0. Replace <docker-id> with your Docker Hub account ID.
docker build . --tag <docker-id>/mydockerimage:v1.0.0

Push the custom image to Docker Hub
Before you can push an image, you must sign in to Docker Hub using the docker login command. Replace <docker-id> with your account name and type in your password into the console at the prompt.
docker login --username <docker-id>

After you have signed in, you push the image to Docker Hub by using the docker push command.
docker push <docker-id>/mydockerimage:v1.0.0

Now, you can use this image as the deployment source for a new function app in Azure.
2. Build using a CI server
@1st1 @elprans
Deployment Workflow
https://docs.microsoft.com/en-us/azure/azure-functions/functions-create-function-linux-custom-image#create-and-deploy-the-custom-image

\cc @1st1 @elprans


[SPARK-21932][SQL][TEST]Add  test CartesianProduct join case and BroadcastNestedLoop join case in JoinBenchmark

What changes were proposed in this pull request?
this PR  describe add new two test case. test CartesianProduct join and BroadcastNestedLoop join. We understand the effect of CodeGen on them. and through these two test cases, we can know Per Row (NS),  is much more delayed than our previous hash join.
How was this patch tested?
add new test case.

Can one of the admins verify this patch?

Leave a comment

@srowen Actually, I think this one makes sense. Because the two open test cases are tested, we connect the Cartesian product and the broadcast nested loop join. When we understand the two connections, from the side, we can open these two test cases to find out. Per Row (NS), for example, is much more delayed than our previous hash join. Second, in our JoinBenchmark test, the two test cases are missing. I wonder if you agree with this?

Can one of the admins verify this patch?

You haven't actually added tests, and that's not all this PR does. At the least, this doesn't match the intent you describe, and should be closed. I'd back up and describe the test you want in the JIRA.

okay, do you mean I need to change the title?

Leave a comment


Updates to the permissions API to better match with what permissions plugins are doing

Based on discussions with some of the Sponge permissions plugin developers, we found that the current permissions API is inadequate for some of the more complicated features of existing permissions plugins.
To fill in some of the gaps, I've put together these changes which:

Add a distinction between cached subjects, which are immediately available, and uncached subjects, which are loaded asynchronously.
Add events for permissions changes
Add the concept of a subject type definition which allows specifying metadata about a certain subject type.

On a related note I've just been told by @lucko that SubjectData#setPermission is allowed to perform the change asynchronously such that a call immediately after to hasPermission might not reflect the change.
I disagree with this behaviour and think that it is not unreasonable to have the requirement to update any cached storage of the set permission to reflect the change immediately as that is what people will expect. Otherwise the javadocs of that method will have to be updated that you cannot rely on the change being visible immediately.
Letting the change not be immediately visible means that there is no way to know when a change will go through and if you have logic that requires knowing this you are shit out of luck (for example, granting someone a permission then performing an action on their behalf before removing the permission from them again).

I'd like to get some of the issues noted above resolved.

@lucko
With https://github.com/SpongePowered/SpongeAPI/pull/1524 being merged very soon, do you want to salvage some aspects of this one so it can be merged as well? I know events would be nice here.

I'm happy with the content of the other PR.
Quoted from #1524

This PR addresses no. 2 above, but depending on the success of this, I may also attempt to address the others over time.

I think events need a bit more thought before they're added. Same goes for the other aspects imho.

@lucko Can you take this over and salvage what you can + other additions you want?

Uhh, it's really just events missing now. I personally would opt for something very simple.
zml was trying to add events for every time a single permission/option/parent was added/removed.
This becomes a very clunky event API, and also in my experience, very difficult to implement for the service provider.
In my opinion, a single SubjectDataUpdateEvent would suffice.
Effectively, "hey plugin, fyi, something about this Subjects data has changed. you might wanna update any internal caches you have".
(the only really discussion would be whether that should be called async or not. it would obviously need to be consistent across providers, and also probably need to be optionally called)
This covers the most common usage, which is chat formatting plugins, and plugins which sync "group data" with external applications. (specifically things like Enjin)
I'd be happy to PR this, but I don't think I'd do a good job of anything more complex, if it was decided that Sponge wanted something more than just a simple update event.

@lucko I think that event would be fine and if someone asks later, we can address then.

@Zidane Does this seem ok?
https://github.com/lucko/SpongeAPI/commit/6d73959cc772e8c0619d170c894a230a6277479e

@lucko Can you open a PR so we can get some comments going on it? Closing this in favor of that.


Ability to stay in background and get updates every minute

Hi!
I'm the main developer of the Nightscout Nightguard iOS App.
We have always been struggling about getting more background updates working in iOS.
Looks like you are able to get updates every minute. But seems to me that this is done using
the BLE-Connectivity. Or is there any other trick I (hopefully) missed? ;-)
cu,
Dirk

Ah - too bad. I expected that. Remote push should work, but are more complicated for a user to setup :-(
Thanks for your fast feedback!


Problem/Interview comments attaches

PR includes

[ ] Refactor
[x] Feature

Related issues
Resolve #507


Access SSL service through VPN and nginx reverse proxy

Hi :)
First of all, sorry if I'm asking anything obvious, I'm fairly new to the Docker ecosystem. I've already posted a question on SO, but hadn't any luck.
My issue is:
I have a wordpress site that I want to access only behind my VPN, and through https protocol.
With the docker-compose.yml file thereafter, I get to connect to openvpn, and access my wordpress site through http://<IP_ADDRESS>/, but not https://<IP_ADDRESS>/, nor http://example.com or https://example.com. Server is Digital Ocean droplet, which I added an A record for example.com pointing to <IP_ADDRESS> and a CNAME that's an alias for example.com. nginx-gen template is https://github.com/jwilder/docker-gen/blob/master/templates/nginx.tmpl.
docker-compose.yml:
version: "2"

services:
  openvpn:
    cap_add:
      - "NET_ADMIN"
    image: "kylemanna/openvpn"
    container_name: "openvpn"
    ports:
      - "1194:1194/udp"
    restart: "always"
    volumes:
      - "./volumes/openvpn-data/conf:/etc/openvpn"
    networks:
      private:
        ipv4_address: <IP_ADDRESS>

  nginx:
    restart: "always"
    image: "nginx"
    container_name: "nginx"
    ports:
      - "80:80"
      - "443:443"
    volumes:
      - "/etc/nginx/conf.d"
      - "/etc/nginx/vhost.d"
      - "./volumes/www/wordpress:/usr/share/nginx/html"
      - "./volumes/certs:/etc/nginx/certs:ro"
    networks:
      proxy:

  nginx-gen:
    restart: "always"
    image: "jwilder/docker-gen"
    container_name: "nginx-gen"
    volumes:
      - "/var/run/docker.sock:/tmp/docker.sock:ro"
      - "./volumes/templates/nginx.tmpl:/etc/docker-gen/templates/nginx.tmpl:ro"
    volumes_from:
      - "nginx"
    entrypoint: "/usr/local/bin/docker-gen -notify-sighup nginx -watch -wait 5s:30s /etc/docker-gen/templates/nginx.tmpl /etc/nginx/conf.d/default.conf"

  letsencrypt-nginx-proxy-companion:
    restart: "always"
    image: "jrcs/letsencrypt-nginx-proxy-companion"
    container_name: "letsencrypt-nginx-proxy-companion"
    volumes_from:
      - "nginx"
    volumes:
      - "/var/run/docker.sock:/var/run/docker.sock:ro"
      - "./volumes/certs:/etc/nginx/certs:rw"
    environment:
      - NGINX_DOCKER_GEN_CONTAINER=nginx-gen
    networks:
      proxy:

  mysql:
    image: "mariadb"
    restart: "always"
    volumes:
      - "./volumes/var/mysql:/var/lib/mysql"
    environment:
      - MYSQL_DATABASE=myapp
      - MYSQL_USER=user
      - MYSQL_PASSWORD=password
      - MYSQL_ROOT_PASSWORD=password
    networks:
      private:
        ipv4_address: <IP_ADDRESS>

  wordpress:
    image: "wordpress"
    restart: "always"
    hostname: "example.com"
    links:
      - "mysql"
    ports:
      - "8080:80"
    volumes:
      - "./volumes/www/wordpress:/var/www/html"
    environment:
      - VIRTUAL_HOST=example.com
      - VIRTUAL_PORT=80
      - LETSENCRYPT_HOST=example.com
      -<EMAIL_ADDRESS>      - WORDPRESS_DB_USER=user
      - WORDPRESS_DB_NAME=myapp
      - WORDPRESS_DB_PASSWORD=password
    networks:
      proxy:
      private:
        ipv4_address: <IP_ADDRESS>

networks:
  private:
    ipam:
      config:
        - subnet: <IP_ADDRESS>/16
  proxy:

I'm not entirely sure wether the issue is on letsencrypt, openvpn or nginx side (cc @kylemanna @jwilder), though I would suggest it is letsencrypt side. Might also be my docker-compose skills ...
Any help would be greatly appreciated :)

Let's Encrypt is designed to provide free certificates to the owner of a public domain/dns host, equals to your website dns name.
To ensure you're really the owner, LE asks your website to host a particular challenge/token (that's the job of this docker companion to handle this mechanism) then it sends a http get request to your website to check if you really managed to add this token on your website (and if you can do that, you're the website owner, so you're granted to retrieve the certificate).
Obviously, your A record must be associated to a public IP (not 172.xxx) for LE to fetch your token. That's why it fails in your case.
I'm pretty sure that this is not (yet?) implemented in this docker image (but I can be wrong), but for case like yours, or case when you can't modify a production website, there is another way to prove to LE you're the owner. You can put the challenge/token into a dedicated DNS txt record.
Check the LE'S doc (https://letsencrypt.org/how-it-works/)

There are a lot of issues there.
<IP_ADDRESS>/16 is a public IP range (@lounagen the private range you are referring to is <IP_ADDRESS>/12), you don't want to use that for private networking and you certainly don't  want to have your domain's DNS records pointing to a public IP that is most probably not yours.
You bind the same directory to both the wordpress container webroot and nginx-proxy webroot. Again you absolutely don't want to do that, both should be completely separate.
If you wordpress container is supposed to be only available through the vpn, ports "8080:80" defeat that and makes it available from the outside.

Thanks for you help !
So if I understand correctly, I need to point my DNS records towards the public IP of my server, and handle the routing with nginx directly (i.e pointing example.com to <IP_ADDRESS>) ?
I think I'll continue in the nginx-proxy repository, thansk again !

For a setup this specific you'll probably be better not using the le-companion and nginx-proxy at all and obtaining your certificates in manual mode with certbot (using another challenge method as @lounagen suggested), then setting up this cert manually in the wordpress container's apache.
You'll also need openvpn to tell connecting client to use a DNS server that resolve your domain to the correct private IP on your docker network (so probably something you'll have to set up too).

I did not see @buchdag answers, sorry.
I was thinking about trying this and, as you mentioned, provide another port than 80 for the wordpress image.
But if this does not work, I'll definitely go with the manual mode and find some way to automate the DNS TXT record update (because, if I understood correctly, whenever certbot issues a new CA for my domain, previous TXT record becomes obsolete and does not prove ownership anymore).