Reduce I/O by fusing repeated getitems on arrays

Consider the following term
    # x[1000:2000][15:20]
    (getitem,
      (getitem, x, (slice(1000, 2000),)),
      slice(15, 20)

This is equivalent to the following much faster term
    # x[1015: 1020]
    (getitem, x, (slice(1015, 1020),))

This happens a lot when we use from_array and then slice
>>> d = da.from_array(x, blockshape=(1000,))  # First round of getitem
>>> d[1015:1020]  # Second round of getitem

If we can optimize then we cut down a lot on I/O.  This is also pretty typical as people block in a bulk way but pull out thin slices.  This ends up being very important when slicing into large volumetric arrays (e.g. @shoyer 's work with xray) and gives us a lot of leeway with choosing bad chunk sizes.
I would break this problem into two sub-problems

A function to operate on terms, enacting the transformation shown in the above example, although being aware of multiple slices and possibly integer values as well.  This requires attention to detail but is not very complex from a dask perspective.  If we can get either of them to dive into these problems again @nevermindewe and @PeterDSteinberg have shown talent here.
A function to apply such a transformation within nested terms (e.g. what happens if this subterm is within yet another function call).  This is more in line with previous work done by @eriknw or @jcrist.  In particular in relation to recent work on Rewrite Rules #82 how do we cleanly extend traversing terms and applying general callables?  What's the best way to enable these transformations?

This is actually useful enough that I wrote a whole special class to encapsulate this logic for xray, LazilyIndexedArray. There may be some relevant logic there for task 1 (e.g., how to slice a slice object).

Well, matching can easily find these terms, RewriteRule could be generalized to take in an arbitrary right hand side. If it's a function, it accepts a dict representing the match. If it's a term, a specific subs function is created and linked in, so that rewriting is always match -> validate (for non linear patterns) -> apply func. I have something like this already written up for SymPy, I'll port it over the weekend/early next week.

Here is a first pass on problem 1
from operator import getitem

def test_fuse_getitem():
    pairs = [((getitem, (getitem, 'x', slice(1000, 2000)), slice(15, 20)),
              (getitem, 'x', slice(1015, 1020))),

             ((getitem, (getitem, 'x', (slice(1000, 2000), slice(100, 200))),
                        (slice(15, 20), slice(50, 60))),
              (getitem, 'x', (slice(1015, 1020), slice(150, 160)))),

             ((getitem, (getitem, 'x', slice(1000, 2000)), 10),
              (getitem, 'x', 1010)),

             ((getitem, (getitem, 'x', (slice(1000, 2000), 10)),
                        (slice(15, 20),)),
              (getitem, 'x', (slice(1015, 1020), 10))),

             ((getitem, (getitem, 'x', (10, slice(1000, 2000))),
                        (slice(15, 20),)),
              (getitem, 'x', (10, slice(1015, 1020))))

        ]

    for inp, expected in pairs:
        result = fuse_getitem(inp)
        assert result == expected

def fuse_getitem(term):
    (_, (_, x, a), b) = term

    c = fuse_slice(a, b)

    return (getitem, x, c)

def normalize_slice(s):
    start, stop, step = s.start, s.stop, s.step
    if start is None:
        start = 0
    if step is None:
        step = 1
    return slice(start, stop, step)

def fuse_slice(a, b):
    if isinstance(a, slice):
        a = normalize_slice(a)
    if isinstance(b, slice):
        b = normalize_slice(b)

    if isinstance(a, slice) and isinstance(b, int):
        return a.start + b*(a.step if a.step is not None else 1)
    if isinstance(a, slice) and isinstance(b, slice):
        start = a.start + a.step * b.start
        if b.stop is not None:
            stop = a.start + a.step * b.step * b.stop
        else:
            stop = None
        if a.stop is not None:
            if stop is not None:
                stop = min(a.stop, stop)
            else:
                stop = a.stop
            stop = stop - ((stop - start) % b.step)
        step = a.step * b.step
        if step == 1:
            step = None
        return slice(start, stop, step)
    if isinstance(a, tuple) and not isinstance(b, tuple):
        b = (b,)
    if isinstance(a, tuple) and isinstance(b, tuple):
        j = 0
        result = list()
        for i in range(len(a)):
            if isinstance(a[i], int):
                result.append(a[i])
                continue
            result.append(fuse_slice(a[i], b[j]))
            j += 1
        return tuple(result)
    raise NotImplementedError()

Doesn't handle the stranger slicing conditions (e.g. negative steps) nor is it exhaustively tested (e.g. steps at all)

Addressed problem 2 with #106. Just make a function that accepts a dict of matches and returns a term, and use it as the rhs of the rule.

@jcrist @mrocklin Very nice!
I have a pretty exhaustive test suite that I wrote for xray -- it basically just checks all permutations of a long set of slices against the output that would be generated from numpy array:
https://github.com/xray/xray/blob/0d164d848401209971ded33aea2880c1fdc892cb/xray/test/test_indexing.py#L85
Happy to help put things together but it looks like you already have a good start.
RE rewrite rules: what about optimizing cases like x.mean(axis=1)[:5]? Ideally, there would be some notion of operations that can commute along a given axis.

I'm fooling around with this in #107 .  Feedback and test cases heartily welcomed there.  It's getting a bit crazy.


GetIpInfoBatch: panic: interface conversion: interface {} is *interface {}, not *ipinfo.Core

The GetIPInfoBatch method does not work, it always creates this error interface conversion: interface {} is *interface {}, not *ipinfo.Core
Example code:
        client := ipinfo.NewClient(nil, nil, "<TOKEN>")

	batchResult, err := client.GetIPInfoBatch(
		[]net.IP{
				net.ParseIP("<IP_ADDRESS>"),
				net.ParseIP("<IP_ADDRESS>"),
		},
		ipinfo.BatchReqOpts{
			BatchSize:       10,
			TimeoutPerBatch: 0,
			TimeoutTotal:    5,
		},
	)

	if err != nil {
		fmt.Println(err)
	}
	fmt.Println(batchResult)

Expected output: IP Info for the batch
Actual output:
panic: interface conversion: interface {} is *interface {}, not *ipinfo.Core

goroutine 1 [running]:
github.com/ipinfo/go/v2/ipinfo.(*Client).GetIPStrInfoBatch(0x140000b6490?, {0x140000cc1c0?, 0x0?, 0x10?}, {0x0, 0x0, 0x5, 0x0, 0x0})
        /Users/jc/.gvm/pkgsets/go1.18.1/global/pkg/mod/github.com/ipinfo/go/v2@v2.8.0/ipinfo/batch.go:310 +0x17c
github.com/ipinfo/go/v2/ipinfo.(*Client).GetIPInfoBatch(0x100394ccc?, {0x140000c5e48, 0x2, 0x11?}, {0x0, 0x0, 0x5, 0x0, 0x0})
        /Users/jc/.gvm/pkgsets/go1.18.1/global/pkg/mod/github.com/ipinfo/go/v2@v2.8.0/ipinfo/batch.go:282 +0x8c
main.GenerateIpinfoMap({0x10046b5a0?, 0x140000c5f50?, 0x140000c5f28?})
        /Users/jc/Dev/ipinfo_api.go:22 +0x250
main.main()
        /Users/jc/Dev/main.go:55 +0xd4
exit status 2

Are you putting a real token and not getting rate limited? Either of these may cause the issue, but please do confirm.

I just checked and I was able to replicate the error if you put an empty string in the client as token then it throws this error
client := ipinfo.NewClient(nil, nil, "")

So putting the token should solve your issue.
cc: @UmanShahzad

I see. Can we fix so that it doesn't panic, and instead just returns an error?

I am using my real token - just redacted it for the post:
	client := ipinfo.NewClient(nil, nil, "39b807185xxxxx")

Doesn't seem like I'm being rate limited - brand new account and testing with only a single IP in the request

I see. Can we fix so that it doesn't panic, and instead just returns an error?

I think a simple check on the token can solve this issue.

I am using my real token - just redacted it for the post:
	client := ipinfo.NewClient(nil, nil, "39b807185xxxxx")

Doesn't seem like I'm being rate limited - brand new account and testing with only a single IP in the request

I am unable to replicate this error I've tried different scenarios and the only scenario giving me this error is when you pass "" as token. I also noticed you are using SDK version 2.8.0 you can try updating to 2.9.0 meanwhile I'll look into it further and try to find the cause of this problem.

The error also occurs if we put an invalid IP in the batch request
batchResult, err := client.GetIPInfoBatch(
		[]net.IP{
			net.ParseIP("<IP_ADDRESS>"),
			net.ParseIP("<IP_ADDRESS>"),
			net.ParseIP(""),
			}

Will do a patch release then you can try again.

@jcace just released v2.9.1 your error should be fixed in this patch.
Thank you for your feedback! 😃

thanks! looks like it works now. Tested v2.9.1
Must've been an invalid IP address because I'm getting expected result now. Error message is much better too when I pass in an invalid one.


Implement user dropdown for profile picture avatar and update mobile menu

This PR addresses #68. Some of the links obviously do not work (and can also be updated if we decide to change them).
Because the dropdown features a logout button, the previous one has been removed from the desktop variant
The mobile menu has also been updated; what used to be the "My profile" link is now a collapsible button that reveals all four links / actions (this includes the logout button which has been moved from its previous location) that can be accessed on the desktop variant. The only relevant difference between the mobile and desktop variants is that the mobile one doesn't feature the email, as I am not sure how I feel about featuring non-clickable elements in it (unless the email part is also supposed to be a hyperlink?).
There are a few minor changes I have gone with that deviate from the wireframes:

I have increased the padding of the middle links in the desktop variant to make them easier to click
I also added a divider after the email for better separation

let me know if there's anything to fix / change / revert / etc.

closes #68


Update kind and helm/kind-action

Update kind to v0.11.1 and the helm/kind-action to v1.2.0

This seems to fix the kind GH action job failures we've been seeing on master recently. No idea why though :shrug:

Seems like other people have been hitting the same mystery: https://github.com/helm/kind-action/issues/42


Tool: Error handling on initial submission

Issue
Upon initial form submission in the tool, certain error cases are not adequately addressed, affecting all forms. Two scenarios arise:

If Camunda is offline and a user submits a new form:

User receives an error: "Submission Failed" (screenshot 1)
A new submission appears under "Submitted Forms" with a default status of "New" (screenshot 2)

If Camunda is online but an issue occurs in the workflow:

User sees a success message on the website (screenshot 3)
A new submission is created under "Submitted Forms" with a status of "null" (screenshot 4)
API and Camunda logs are also included in screenshots 5 and 6.

Private Zenhub Image
Private Zenhub Image
Private Zenhub Image
Private Zenhub Image
Private Zenhub Image
Private Zenhub Image

Progress report:
Exploration for error 2 is complete. Code responsible for capturing the error was identified.
Next:

Throw error when Camunda workflow is broken. This will cover error 2.
Recover from error. This means submission in Formio and application in API should be deleted and the draft (resubmitted) should be undelete and kept for user so they don't lose data.
Do the same thing for error 1. When Camunda is down

Progress report:
Throw error and show erro message on the website when Camunda workflow is broken. This will cover error 2.
Next:
Recover from error, other words, making the initial submission transactional (either all go or nothing). This means submission in Formio and application in API should be deleted (when workflow is broken) and the draft (resubmitted draft) should be undelete and kept for user so they don't lose data.
Do the same thing for error 1. When Camunda is down

@ayushdamani
This is ready for testing on TEST. I think it's easiest to set a time and test it together. It would need someone to inentilally break the workflow to test out handing the error cases. Please ping me when you're ready for the test.

Iman and Ayush to test today

Tested with Iman in TEST.
Number 2 worked perfectly. Number 1 needs some more work.
Bringing this back to in-progress.

Tested with Iman in TEST environment.
The second acceptance criteria is working as accepted.
Moving to PO :)


deployment issue

Hello,
I have installed the pod,inherited a viewcontroller from AMSlideMenuMainViewController and created a table view which inherits AMSlideMenuRightTableViewController.
viewcontroller viewdidload:
 UIStoryboard *mainStoryboard = [UIStoryboard storyboardWithName:@"Main"
                                                             bundle: nil];
 MenuTableViewController *controller = [mainStoryboard instantiateViewControllerWithIdentifier:@"MenuTableView"];
 self.rightMenu = controller;

When I launch my application configureRightMenuButton is not triggered.
Any ideas? am I missing something,I didn't add the mainvc but I added the methods of mainvc to my viewcontroller and I didn't add anything to the appdelegate. I already have my navigationcontroller in my app in the storyboard,but I need to implement your lib in my application.
Thx

As I understand You want to use the lib without storyboards. In that case, all points of this guide are mandatory.
Or you can just watch this video tutorial .

I was able to add the right menu but sadly the rightmenu button is not displayed in the navigationbar.
And the right table view is opened by default behind my viewcontroller on load.
I debugged and not exceptions or errors

Please, just follow to the video tutorial from my previous comment.

can u send the image picker third party working class file..urgent
On Fri, Jun 26, 2015 at 12:13 PM, Artur Mkrtchyan<EMAIL_ADDRESS>wrote:

Please, just follow to the video tutorial from my previous comment.
—
Reply to this email directly or view it on GitHub
https://github.com/SocialObjects-Software/AMSlideMenu/issues/157#issuecomment-115546547
.


After scanning a location check-in QR code the location information modal cannot be canceled

Describe the bug
If the user previously has not agreed to the event/location check-in when scanning an event QR code (e.g. this), a modal explaining the check-in will be shown. The button asks for consent (German: "Einverstanden"), but the user does not have a different choice than pressing it (apart from restarting the App).
The same modal is shown if you already agreed and then (in the check-in tab bar entry) select the dotted menu in the top right and then "Informationen". The difference is that now a cross is shown to dismiss this screen (though I don't understand why the consent button is still shown, because the user clearly already consented):

Expected behaviour
As a user I would expect to have a choice if the wording asks for my consent.
Possible Fix
I think either the wording of the button should be changed and/or the user should get a choice to cancel (e.g. with the "x" and maybe also with dragging the modal down to dismiss it).
Avoid duplicates

[x] Bug is not mentioned in the FAQ
[x] Bug is specific for iOS only, for general issues / questions that apply to iOS and Android please raise them in the documentation repository (probably iOS specific - did not test it on Android)
[x] Bug is not already reported in another issue

Technical details

Device name: iPhone14,3
iOS version: 15.3
App version: 2.15.1

Internal Tracking ID: EXPOSUREAPP-11230

Related: #3773

Thanks for your report @miallo. We have created an internal ticket for it and will raise this topic internally.
Internal Tracking ID: EXPOSUREAPP-11230

Corona-Warn-App Open Source Team

@miallo Thanks for reporting here. Feedback: As long as the user does not give his consent, the consent screen stays open in the "Check-In" Tab. This is intendet. The user can still use all other functions of the app without giving his consent by switching to another tab. There is no need to dismiss the screen without giving consent, this would anyhow just open the screen again if you go to the check-in tab.

Closing due to the abovementioned reasons. Internal ticket was set to obsolete


Long cells disappear too early

I use very long tables. And now I noticed an unpleasant bug. I used MultiGrid and too long cells disappear from the screen before they go beyond its border. I was trying to set up using overscanColumnCount and overscanRowCount but it didn't work.

React-virtualized verison: 9.20.1

I'm getting the same bug. As soon a column is off the screen, the cell is removed from the DOM, irrelevant of what overscanColumnCount is set to.

Thanks @bradwoods - setting those defaults solved the issue for me


Provide a test for istio ingress in testrunner

Signed-off-by: Manuel Buil<EMAIL_ADDRESS>Why is this PR needed?
It addresses a business case. We need a test for istio ingress
Fixes #
Reminder: Add the "fixes bsc#XXXX" to the title of the commit so that it will
appear in the changelog.
What does this PR do?
please include a brief "management" technical overview (details are in the code)
Anything else a reviewer needs to know?
Special test cases, manual steps, links to resources or anything else that could be helpful to the reviewer.
Info for QA
This is info for QA so that they can validate this. This is mandatory if this PR fixes a bug.
If this is a new feature, a good description in "What does this PR do" may be enough.
Related info
Info that can be relevant for QA:

link to other PRs that should be merged together
link to packages that should be released together
upstream issues

Status BEFORE applying the patch
How can we reproduce the issue? How can we see this issue? Please provide the steps and the prove
this issue is not fixed.
Status AFTER applying the patch
How can we validate this issue is fixed? Please provide the steps and the prove this issue is fixed.
Docs
If docs need to be updated, please add a link to a PR to https://github.com/SUSE/doc-caasp.
At the time of creating the issue, this PR can be work in progress (set its title to [WIP]),
but the documentation needs to be finalized before the PR can be merged.
Merge restrictions
(Please do not edit this)
We are in v4-maintenance phase, so we will restrict what can be merged to prevent unexpected surprises:
What can be merged (merge criteria):
    2 approvals:
        1 developer: code is fine
        1 QA: QA is fine
    there is a PR for updating documentation (or a statement that this is not needed)

Test passed!
https://ci.suse.de/view/CaaSP/view/v5 Dashboard/job/caasp-jobs/job/dev/job/e2e-test/94/


+autoProvision ignores numactl settings

Original issue: https://charm.cs.illinois.edu/redmine/issues/2016

Runs on 64 threads when numactl is limited to 12:
policy: default
preferred node: current
physcpubind: 0 1 2 3 4 5 6 7 8 9 10 11
cpubind: 0 1
nodebind: 0 1
membind: 0 1 2 3 4 5 6 7
Charm++: standalone mode (not using charmrun)
Charm++> Running in Multicore mode: 64 threads (PEs)
Charm++> Using recursive bisection (scheme 3) for topology aware partitions
Converse/Charm++ Commit ID: v6.9.0-rc2-0-ge8d6e0c-namd-charm-6.9.0-build-2018-Oct-25-11430

Note that it does follow Comet's queueing system setup, and warns that there is something odd:
Intel(R) processor family information utility, Version 4.1 Update 3 Build 20131205
Copyright (C) 2005-2013 Intel Corporation.  All rights reserved.

=====  Processor composition  =====
Processor name    : Intel(R) Xeon(R)  E5-2680 v3
Packages(sockets) : 1
Cores             : 12
Processors(CPUs)  : 12
Cores per package : 12
Threads per core  : 1

=====  Processor identification  =====
Processor	Thread Id.	Core Id.	Package Id.
0       	0   		0   		0
1       	0   		1   		0
2       	0   		2   		0
3       	0   		3   		0
4       	0   		4   		0
5       	0   		5   		0
6       	0   		8   		0
7       	0   		9   		0
8       	0   		10  		0
9       	0   		11  		0
10      	0   		12  		0
11      	0   		13  		0
=====  Placement on packages  =====
Package Id.	Core Id.	Processors
0   		0,1,2,3,4,5,8,9,10,11,12,13		0,1,2,3,4,5,6,7,8,9,10,11

=====  Cache sharing  =====
Cache	Size		Processors
L1	32  KB		no sharing
L2	256 KB		no sharing
L3	30  MB		(0,1,2,3,4,5,6,7,8,9,10,11)
policy: default
preferred node: current
physcpubind: 0 1 2 3 4 5 6 7 8 9 10 11
cpubind: 0
nodebind: 0
membind: 0 1
/var/spool/slurmd/job19830854/slurm_script: line 14: nvidia-smi: command not found
Charm++: standalone mode (not using charmrun)
Charm++> Running in Multicore mode: 12 threads (PEs)
Charm++> Using recursive bisection (scheme 3) for topology aware partitions
Converse/Charm++ Commit ID: v6.9.0-rc2-0-ge8d6e0c-namd-charm-6.9.0-build-2018-Oct-25-11430
Warning> Randomization of virtual memory (ASLR) is turned on in the kernel, thread migration may not work! Run 'echo 0 > /proc/sys/kernel/randomize_va_space' as root to disable it, or try running with '+isomalloc_sync'.
CharmLB> Load balancer assumes all CPUs are same.
Charm++> Running on 1 hosts (1 sockets x 12 cores x 1 PUs = 24-way SMP)
Charm++> Warning: Internally-determined PU count does not match hwloc's result!

Is there any change with #2250 (merged) and #2265?

Any update to this with #2265?


Follow up on issue #29

#29 cannot be reopened, follow up here.

@DNikolaevAtRocket do you have a small test case that I can repeat? for example
./testpds -t "rb,type=record" -i "//'DATASET(MEMBER)'"

reopened old one.


Fixes ipfs.swarm.peers call when using js-ipfs-api

Currently the return type for ipfs.swarm.peers is different depending on whether we're talking directly to a js-ipfs or js-ipfs-api (issue opened here).
This PR updates the proxy to take this into account so that it doesn't error when passed a PeerId where it is expecting a PeerInfo (https://github.com/tableflip/ipfs-postmsg-proxy/commit/eb0aa43416ad79c4a84b0aaa48a035f54d4d6dae).

It would be great to actually fix the issue https://github.com/ipfs/js-ipfs/issues/1248


Lower vs Upper Case returning different results, but why?

Hello there person with my first name haha. Could you please tell me why searching the same word with different cases returns different results? Please try searching "truth" and then"Truth" in my fiddle link.
VTH Writings
I am using Lunr to build a hybird library app containing 4000-5000 pages of small religious tracts. Currently my fiddle demo only has the first 20 pages of just 1 tract. Is my current method of building the doucments obj the most efficient? To be more clear, I have in mind to place the entire library of tracts, 4000+ pages, inside the documents object all on the one javascript file. Not sure if this is what people actually do. Thank you for your help and guidance!

I figured out the issue by using regex and .match() method properly.


Feature: filter charges by ledger generation issues

partially done within #622
rest will be done under #612

Keeping this task for future rethink, as the need for simple ledger-issues charges filter still stands


docs: troubleshooting guide for logging

Document to explain how to change logging level for our libraries and underlying libraries.
Credit: I used @BenWhitehead 's snippet in bits benwhitehead/6166544285433856.

very minor nit: guilde -> guide in PR title

Thanks Tomo, this is very helpful! FYI, we are planning to improve the whole logging experience as part of the Observability project, so a lot of things could change, but this guide is pretty accurate as of now.

Looks good! IIRC, I have used this page previously for logging some of the HTTP requests for REGAPIC: http://googleapis.github.io/google-http-java-client/http-transport.html
I think your guide should cover the cases. Just FYI if you wanted to add anything else.

Looks good! IIRC, I have used this page previously for logging some of the HTTP requests for REGAPIC: http://googleapis.github.io/google-http-java-client/http-transport.html
I think your guide should cover the cases. Just FYI if you wanted to add anything else.

Thanks for then note Lawrence! I think it should be already covered by com.google.api.level=ALL as com.google.api.client.http is a sub-package of com.google.api.


Singularity edition

Looked at singularity as well, but it is currently awaiting the release and packaging of "Apptainer 1.0.0"
apk add singularity
The current apk version in 3.14 is singularity 3.8
Upgrading requires the new Go version, from Alpine 3.15
checking: host Go compiler (at least version 1.16.12)... not found! (the available system version is 1.16.10-r0)

Try this again, later.


Use build type to determine nightly or release

Now we have 'darga' nightly, we can't rely on the word 'master' being in the file name to determine if it's a nightly build or not.
@abellotti @Fryguy please review

LGTM!!  👍


Add query param for searching users whose name contains a certain prefix term in the /users endpoint

As of now, the endpoint /users/:user-name returns a specific user if it's found in the collection and not found if it doesn't exist. However, we would also need to get all users whose names match the particular prefix someone is querying for. this can be done via adding a query param in the /users endpoint.

please assign this to me

Done. Let me know the ETA.


Create interface CompanyStatement

This PR was created to create the CompanyStatement interface to obtain the company data when the getCreditStatement function is executed.

:tada: This PR is included in version 1.0.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Update state of Action-related controls

Enabled, Visible, Checked states of Action-related controls must be able to update easy.

Implemented


Rust-based cftime Implementation for Python

Is your feature request related to a problem?
I developped a rust based project with python bindings code to parse the CF time conventions and deal with datetime operations.
You can find the project on GitHub at https://github.com/antscloud/cftime-rs.
It was something missing in the rust ecosystem to deal with NetCDF files, As the project in Rust hits its first working version, I wanted to explore the maturin ecosystem and the Rust as a backend for python code.
I ended up creating a new cftime  implementation for python that have significant perfomance improvement (somewhere between 4 times to 20 times faster depending on the use case) over cftime original Cython code.
There are surely missing features compared to cftime  and need to be tested more, but I think it could be interested as a replacement for some xarray operations (mainly for speed) regarding some of the issues of topic-cftime label
Please, let me know if xarray team could be interested. If you are, I can open a pull request to see it is possible, where it breaks the unit tests and if it's worth it
Describe the solution you'd like
No response
Describe alternatives you've considered
No response
Additional context
No response

Please, let me know if xarray team could be interested. If you are, I can open a pull request to see it is possible, where it breaks the unit tests and if it's worth it

Absolutely!
Ideally we'd work on https://github.com/pydata/xarray/issues/155 some but for now I'd starting hacking here: https://github.com/pydata/xarray/blob/338fc9268a1ea41dbb861906fdf2e79d939e2df3/xarray/coding/times.py#L803

Thanks for sharing @antscloud!  This seems like a cool library, and looks fairly cleanly written from first glance.  I have some questions about some design decisions, but we can save those until later.
Would you be willing to open an issue within the cftime repository itself?  Before discussing wholesale switching from one datetime type to another in xarray, which would be disruptive to xarray and downstream users, I'm wondering if changes could instead be discussed/made upstream?  An initial question I am curious about is: to what extent are the performance limitations of cftime language-based vs. algorithm-based?  This is a backend-related question, which, regardless of the answer, would in principle allow for maintaining the same frontend API (and thus require no changes in xarray).
Finally, one other question which would be relevant before moving forward with anything in cftime or xarray is: how tied are you to the AGPL license?  Would you be open to switching to a more permissive license instead of a copyleft license?  The reason for asking is that copyleft licenses restrict the types of licenses that can be used in work that depends on your project (see for example discussion here).


[WIP] Containers Provider topology as a view type

Revival of #6115 - Depends on #8726
@martinpovolny @abonas @epwinchell @serenamarie125

@miq-bot add_label ui, providers/containers, topology, wip

Before we discuss the hacky code in this PR, Is this (conceptually) the way we want topology view for provider to look like?

If the dashboard, summary and topology are just different views of the same data, then sure, a view toolbar definitely makes sense..
Are they though? So far, I'm not seeing any way to show topology under a specific thing, nor any dashboard but the one in overview, so maybe not..
If not.. I'd guess it'd make more sense to add the topology link as one of the items in textual summary..

/cc @andyvesel

/cc @dclarizio

As we are planning to implement topology on many of our existing objects, this is exactly how we would like to proceed.  I also think that if we can allow navigation to related objects, then the resulting screen we jump to would also display its topology view when we get there, thus allowing a kind of linked topology navigation scenario.  Anyway, just an idea. :)

Here's the mockup we showed at the Summit for the VM screen. In this case, we limited the connections displayed to one level.

Is the breadcrumb ok where it is?
@martinpovolny Can you help me make that toolbar look better?

.
@zeari breadcrumb looks fine to me

"display name"  stuck to left separator should be fixed. as well as the position of all elements is not very centralized inside the toolbar

If this change is ok, ill add a followup commit removing regular topology

@miq-bot remove_label wip

Ready for final review...

@abonas All comments handled except the breadcrumb bottom margin

Updated. I think this is good to merge.

Fixed comments. @himdel Thanks for the review!

@himdel Fixed comments, also removed data and generate_topology from container_topology_controller

@himdel ping

Works like a charm, thanks @zeari..


How to add a dialog after a video?

What is your question?
How to add a dialog after a video? (just combining 2 scripts responsible for the dialog and video do not work or are activated at the same time) (lua, json)

only possible in source code


Create api/wasm/cpp/Makefile.base and use for WASM c++ compiles.

Create api/wasm/cpp/Makefile.base and use for WASM c++ compiles.

[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by:
To fully approve this pull request, please assign additional approvers.
We suggest the following additional approvers:
If they are not already assigned, you can assign the PR to them by writing /assign  in a comment when ready.
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment


Array of string was not implemented?

We migrated to the new driver and we're getting java.lang.IllegalArgumentException: Only singleton array is allowed. I checked the repo and see that Array of numbers was implemented but not array of other stuff. Am I right? Is there a way to overcome this error?

Both select ['a','b']::Array(String) and select [('a'),('b')]::Array(Tuple(String)) work for me.
Could you please provide some more information like version of the driver and steps to reproduce the issue? If you have code snippet(SQL/Java) for reproducing that would be even better.

Sure!
We're using "0.3.2-patch5" version of jdbc, client, http-client
We have a table in CH with a field of type Array(String) and we're trying to insert into it.
(Code is in scala, we use doobie library, we implemented our own doobie Put instance, but also checked with postgres instance and implicit converters and it fails the exact same way)
This is the error we're getting
java.lang.IllegalArgumentException: Only singleton array is allowed, but we got: [user-agent: http4s-blaze/0.15.2, X-Forwarded-For: <IP_ADDRESS>]
	at com.clickhouse.client.ClickHouseValue.update(ClickHouseValue.java:1148)
	at com.clickhouse.jdbc.ClickHouseConnection.createArrayOf(ClickHouseConnection.java:40)
	at com.clickhouse.jdbc.ClickHouseConnection.createArrayOf(ClickHouseConnection.java:23)
	at com.zaxxer.hikari.pool.HikariProxyConnection.createArrayOf(HikariProxyConnection.java)

I checked the repo and see that Array of numbers was implemented but not array of other stuff.

Unlike array of primitives, array of String is simply treated as Object. That's why there's no update(String[]) method in ClickHouseValue class and it's not handled specifically in update(Object).

We have a table in CH with a field of type Array(String) and we're trying to insert into it.

I see. I assume that you're using PreparedStatement for batch insert.
If that's the case, could you please use input function as shown in examples? To be more specific, instead of insert into mytable values(?,?,?), use insert into mytable select col1, col2, col3 from input('col1 String, col2 DateTime64(3), col3 Array(String)'), or insert into mytable for convenience. The differences are:

the first query has no type information so the driver has to "guess" based on type of given parameters, and worse than that, the driver will generate a large SQL statement like insert into table values(...)(...)... and send it to server
the last two provide type information needed by the driver, so it can take care of type conversion automatically and stream the data(in binary format) to the server, which is usually faster with less memory usage(on client side) and network traffic

Meanwhile, since there'll be another patch release this weekend. I'll see if I can enhance the driver accordingly.

Starting from 0.3.2-patch6, insert into table(col1,col2,col3) values(?,?,?) is treated as insert into table(col1,col2,col3)(streaming instead of sending large SQL with values expression). select col1,col2,col3 from table where 0 will be issued for type inferring when creating PreparedStatement. This means you no longer has to change code by switching to input function.
However, the implementation is naive as it will still build large SQL for cases like insert into table(col1,col2,col3) values(? + 0,?,?).

If using insert into mytable select col1, col2, col3 from input('col1 String, col2 DateTime64(3), col3 Array(String), do I still need to use
ps.setString(1, "test");
ps.setInt(3, 123);

?
Can I just use ps.setObject(index, obj) for any types of data for simplicity? And can ps.setObject(index, obj) handle String[] correctly in this case?

Besides why only 1 element array is allowed as shown here?
IIUC, if user trying to insert [0.1, 0.2] it will throw this illegal argument exception. Similarly for other collections.

do I still need to use ps.setString(1, "test") & ps.setInt(3, 123) ?

Yes. input('col1 String, col2 DateTime64(3), col3 Array(String)') was parsed(without additional network call), so the driver knew there are 3 typed parameters.

Can I just use ps.setObject(index, obj) for any types of data for simplicity? And can ps.setObject(index, obj) handle String[] correctly in this case?

Maybe not. By default, the driver use SQL-based PreparedStatement, which will simply convert parameters to string, substitute ? placeholders, and then send the large SQL to server. It's inefficient as it's text-based and it involves lots of string concatenation, not to mention it has problem dealing with binary values.
When you pass a timestamp/LocalDateTime to PreparedStatement, it's difficult for the driver to figure out how to format the parameter because it has no idea what the column type is - is it DateTime32 or DateTime64? If it's the latter, what's the precision?

Besides why only 1 element array is allowed as shown here?

Because in general ClickHouseValue represents a single value instead of multiple values. Those update(*) methods are just for convenience(to convert value from one type to another) and performance(especially when asm-based optimizer is available and correct update method was invoked).

IIUC, if user trying to insert [0.1, 0.2] it will throw this illegal argument exception. Similarly for other collections.

Yes, it's expected. Keep in mind that ClickHouseValue is just an interface. If you are dealing with Array, it's better to use ClickHouseArrayValue or classes under com.clickhouse.client.data.array package instead.

Thanks for the details @zhicwu, really appreciate it!

Thanks @zhicwu!


"dig" not in PATH after nix-shell -p bind

Hi,
I am new to NixOS. Sorry if I report something wrong or stupid, but this seems like a bug:
Describe the bug
When switching to nix-shell -p bind (as recommended by nix when I try to execute the dig command), dig is still not found in the PATH.
Steps To Reproduce
[root@server123:/]# nix-shell -p bind

[nix-shell:/]# dig example.com
The program 'dig' is not in your PATH. You can make it available in an
ephemeral shell by typing:
  nix-shell -p bind

[nix-shell:/]# echo $PATH
/nix/store/s0366zs7fkc3gffmc1fqnam896fvzi0y-bash-interactive-5.1-p16/bin:/nix/store/nln9q1q55z0cd8aw57vi0l10j1prgqsk-patchelf-0.14.5/bin:/nix/store/lsm1agffk0qv9yym55b3zdzx76gjkxcq-gcc-wrapper-9.5.0/bin:/nix/store/zva0i57cbablmnvrfx8zcr9jmpjqpgnd-gcc-9.5.0/bin:/nix/store/xrcvvcp3vwbr0gif0g024wmb938xzqhq-glibc-2.35-163-bin/bin:/nix/store/7mjrrj68fz00x7im4nkjv6sc298fqq95-coreutils-9.1/bin:/nix/store/1vn18k40gdamllkkw9wqsp1m0imaf396-binutils-wrapper-2.38/bin:/nix/store/4m0ql1nd3kahkcj9ah1s78pc689mfmhf-binutils-2.38/bin:/nix/store/hl8nri87pl7fkcdfy49aavaml83yykpa-bind-9.18.4/bin:/nix/store/7mjrrj68fz00x7im4nkjv6sc298fqq95-coreutils-9.1/bin:/nix/store/s9x16skrq8f9ykzrxysa98c06q3q9z1k-findutils-4.9.0/bin:/nix/store/3a7sdmh9hwzkwww346dfwxcw2q793ram-diffutils-3.8/bin:/nix/store/vfndbx1ylzlr660bgm48222bsplyp0hs-gnused-4.8/bin:/nix/store/450zz8z1vhb0mhmjvqg0ngvk7p2njzpx-gnugrep-3.7/bin:/nix/store/jj9ypmp0hpx2jy67niq6n4a7mi16mzd3-gawk-5.1.1/bin:/nix/store/48xvsfhmfixskfpazgvwn4xjgbayi1z4-gnutar-1.34/bin:/nix/store/avnsbf9d3m8dqynvlzhda5p7rl3fbnhi-gzip-1.12/bin:/nix/store/l4fqm8z2yqp96r2zbc5bn5g1qa66b6qq-bzip2-1.0.8-bin/bin:/nix/store/yaikhg6vn6hikb9fg01dfy082z52im7h-gnumake-4.3/bin:/nix/store/0rvrid3zvjcdn33685f4d3qncwiajnrh-bash-5.1-p16/bin:/nix/store/gmnikjmndd25ida53l51gqhw4kwadcdx-patch-2.7.6/bin:/nix/store/dcs3ab4xc0g015p0gwmgx9f6g0899scz-xz-5.2.5-bin/bin:/nix/store/c61z5409smzwagkhiv1d3fb6hxkr62g3-file-5.42/bin:/run/wrappers/bin:/root/.nix-profile/bin:/etc/profiles/per-user/root/bin:/nix/var/nix/profiles/default/bin:/run/current-system/sw/bin

[nix-shell:/]# ls -l /nix/store/hl8nri87pl7fkcdfy49aavaml83yykpa-bind-9.18.4/bin
total 1372
-r-xr-xr-x 1 root root  13168 Jan  1  1970 arpaname
-r-xr-xr-x 1 root root  23536 Jan  1  1970 ddns-confgen
-r-xr-xr-x 1 root root  53712 Jan  1  1970 dnssec-cds
-r-xr-xr-x 1 root root  39104 Jan  1  1970 dnssec-dsfromkey
-r-xr-xr-x 1 root root  39160 Jan  1  1970 dnssec-importkey
-r-xr-xr-x 1 root root  42032 Jan  1  1970 dnssec-keyfromlabel
-r-xr-xr-x 1 root root  51528 Jan  1  1970 dnssec-keygen
-r-xr-xr-x 1 root root  33576 Jan  1  1970 dnssec-revoke
-r-xr-xr-x 1 root root  42264 Jan  1  1970 dnssec-settime
-r-xr-xr-x 1 root root 105648 Jan  1  1970 dnssec-signzone
-r-xr-xr-x 1 root root  34048 Jan  1  1970 dnssec-verify
-r-xr-xr-x 1 root root  53016 Jan  1  1970 mdig
-r-xr-xr-x 1 root root 573568 Jan  1  1970 named
-r-xr-xr-x 1 root root  38816 Jan  1  1970 named-checkconf
-r-xr-xr-x 1 root root  38072 Jan  1  1970 named-checkzone
-r-xr-xr-x 1 root root  38072 Jan  1  1970 named-compilezone
-r-xr-xr-x 1 root root  13912 Jan  1  1970 named-journalprint
-r-xr-xr-x 1 root root  19000 Jan  1  1970 named-rrchecker
-r-xr-xr-x 1 root root  14040 Jan  1  1970 nsec3hash
-r-xr-xr-x 1 root root  43424 Jan  1  1970 rndc
-r-xr-xr-x 1 root root  23632 Jan  1  1970 rndc-confgen
-r-xr-xr-x 1 root root  23536 Jan  1  1970 tsig-keygen

[nix-shell:/]#

Expected behavior
Either the nix-shell-hint should reflect the correct command or dig should be in the PATH of nix-shell -p bind.
Additional context
I haven't used bind on this machine.
Notify maintainers
@globin
Metadata

system: "aarch64-linux"
host os: Linux 5.15.55, NixOS, 22.11 (Raccoon), 22.11pre398667.39d7f929fbc
multi-user?: yes
sandbox: yes
version: nix-env (Nix) 2.10.3
channels(root): "nixos"
nixpkgs: /nix/var/nix/profiles/per-user/root/channels/nixos

You do get it by nix-shell -p bind.dnsutils or nix-shell -p dnsutils.  (Yes, this case is confusing.)

Hi&Thanks @vcunat !! Is there a easy way to change the hint to one of those commands? (If not feel free to close the issue since it is not that important to me)

Hi. Same here. It's little bit confusing.  Issues here helped.

This issue seems like a duplicate of #140897 , which points to https://github.com/NixOS/nixos-channel-scripts/issues/26 as the reason for the incorrect hint.

OK, let's close this one as duplicate to concentrate the discussion better.

systemd[1]: Started DNSSEC key rollover. nsd-dnssec-start[492709]: /nix/store/57fladh8c6dnzcva1fy7qq9wik5vw0bq-unit-script-nsd-dnssec-start/bin/nsd-dnssec-start: line 7: /nix/store/3h8ayi2ksj6kmfxb1qj8f2wj06a1jiay-bind-9.18.7/bin/dnssec-keymgr: No such file or directory systemd[1]: nsd-dnssec.service: Main process exited, code=exited, status=127/n/a
I would be happy to test.


always generate posix paths in manifests

I've adapted the manifest builder to always build paths with forward slash. My reading of the documentation is that Python on Windows will translate these automatically.
@kityansiu does this fix generating the turnstile example for you?

Well shoot. I was hoping that by using the posix-specific path class it wouldn't auto detect and use windows path separators. Back to the drawing board <_<

@weisenje after reading more documentation (and testing on a spare laptop) I think this commit is the fix


Feature: Sphinx support for FSG and JSGF grammars

I added a keyword to recognize_sphinx called grammar which allows to pass the path of a grammar file to the function. I also added documentation to the source as well as the rst-file. Tests have been adapted as well.
The changes do not require refactoring or changes related to design.
Three remarks I have so far:

Logging output

Since the builder for FSG and JSFG are not part of the decoder, they are not influenced by the disabled logging configuration. I haven't found an easy way to suppress the logger output (yet)

Generation of FSG files

If a JSFG file is passed, recognize_sphinx will create a FSG file at the same location to speed up the initialisation process next time it is triggered. However, files popping up after calling a speech recognition might not be expected behaviour

language weight parameter is fixed to 7.5 at the moment

I could extend the grammar block to check for tuples and use the second parameter as lw in case that is considered useful. The meaning of this parameter is explained here. In this case the user may pass a string (considered a path to a grammar) or a tuple consisting of (grammar_path, weight).

Regarding the logging output, I think that shouldn't be an issue, since ALSA startup will usually also print debug messages anyways. As for the FSG files, I think the documentation does a good job of letting the user know.
Looks good to me - thanks for the patch!


[GEMM Performance]  gemm perf with other data types and shape get to 80% of oneDNN

in Iteration 2, for gemm 4096x4096x4096xf16, we can get ~95% of oneDNN.
now we want to extend the gemm to more data types and shapes.
we use 08-experimental-block-pointer.benchmark.py as our test case.
data types: fp16, bf16
shapes: (m=n=k)[256, 512 ... 4096]

@Dewei-Wang-sh  to split the ticket into the smaller ones


What should be described to DaSEH students about course evaluations?

Summary
In syllabus.Rmd there was a description of how students will evaluate the intro_to_r course at JHU. In #14 this was removed.
What should be told to the students about how they can evaluate the DaSEH course? What plans are already in place and do we need to make a survey or something?

We will definitely survey the students, and we also have IRB approval to do so. We'll add these soon!

I can change it to be vague for now! (and not about jhu)


Need apt-transport-https

Include instructions to install apt-transport-https package before apt-get update

Nice catch, thanks!!


Frontend doesn't start up on windows

Javascript console: Uncaught (in promise) The filename, directory name, or volume label syntax is incorrect. (os error 123) bundle.js:70

Fixed in latest commit


Post installation Not showing anything

Issue description
Post installed sentinl ,It showing no watcher.
Please find screenshot.

Step to performed install sentinl:

root@elasticsearch /usr/share/kibana/plugins # ./kibana-plugin install https://github.com/sirensolutions/sentinl/releases/download/tag-6.2.2/sentinl-v6.2.1.zip
restart kibana

kibana version: 6.2.1

@agarwalshivam456 by default there will be exactly no watchers but I see the issue here seems all replacements are missing, including dates and parameters. Could you check your Kibana logs for errors?

Resolved.
I was installing snapshot plugin.
Post installation of Gulp plugin ,It's working normally.
However I found that installation guide is not mentioned properly. Please mention proper steps to install it.

@agarwalshivam456  did you do anything specific? I've attempted to install following the gulp directions but am having the same result.

Install Sentinl:

git clone https://github.com/sirensolutions/sentinl
cd sentinl
Install NPM
curl -sL https://deb.nodesource.com/setup_7.x | sudo -E bash -
apt-get install nodejs
Install below dependencies:
npm install -g gulp
npm link gulp
npm install -g lodash --save
npm link lodash
npm install -g mkdirp --save
npm link mkdirp
npm install -g rsync --save
npm link rsync
npm install -g bluebird --save
npm link bluebird
npm install -g gulp-eslint --save
npm link gulp-eslint
npm install -g rimraf --save
npm link rimraf
npm install -g gulp-zip --save
npm link gulp-zip
npm install -g minimist --save
npm link minimist
npm install -g gulp-util --save
npm link gulp-util
gulp package --version=6.2.1   #######Version must be same as kibana version######

./kibana-plugin install file:///root/sentinl/target/gulp/sentinl-v6.2.1.zip  #########(Run command under path : /usr/share/kibana/bin)###########

@lmangani Do i have to install any other plugin apart from sentinl to configure threshold based alert.
Or we can create same from sentinl ?

@agarwalshivam456 is there are a reason you are not using our ready packages? I would strongly suggest so - SENTINL does not have other requirements, its self standing when properly compiled.

@lmangani what do you mean by ready packages?
You can see my steps to install sentinl in above comment. Am i missing something there?
As i don't find option to create threshold base alert in sentinl.

The default example and template is for a treshold alert. You need to know what you're doing and check out the available documentation, mixing an installation and configuration issue is not going to help either. please start here: http://sentinl.readthedocs.io/en/latest/Watcher-Examples/
Presentation of generics: https://www.slideshare.net/secret/gobTp9S3omqn9a

@lmangani Can you please help me out here. I am getting below error after created a watcher.
#######################################################
Error: fail to get watcher 7d806e96-4a3d-4be3-8a35-a0655484bab6
at Watcher. (http://kibana.nlpcaptcha.in/bundles/sentinl.bundle.js?v=16573:1:268707)
at tryCatch (http://kibana.nlpcaptcha.in/bundles/vendors.bundle.js?v=16573:70:99706)
at Generator._invoke (http://kibana.nlpcaptcha.in/bundles/vendors.bundle.js?v=16573:70:101781)
at Generator.prototype.(anonymous function) [as throw] (http://kibana.nlpcaptcha.in/bundles/vendors.bundle.js?v=16573:70:99990)
at step (http://kibana.nlpcaptcha.in/bundles/sentinl.bundle.js?v=16573:1:264876)
at http://kibana.nlpcaptcha.in/bundles/sentinl.bundle.js?v=16573:1:265037
at
#########################################################
Watcher Configuration:
{
"actions": {
"email_admin": {
"throttle_period": "0h15m0s",
"email": {
"to": "mail-id",
"from": "mail-id",
"subject": "Alarm",
"priority": "high",
"body": "DE Forntendservers Service failures {{ payload._id}}: Current Value {{ payload.hits.total }} [Threshold : 1]"
}
}
},
"input": {
"search": {
"request": {
"indices": "indices-name",
"body": {
"size": 0,
"query": {
"filtered": {
"query": {
"query_string": {
"query": "code:500",
"analyze_wildcard": true
}
},
"filter": {
"range": {
"@timestamp": {
"from": "now-15m"
}
}
}
}
}
}
}
}
},
"condition": {
"script": {
"script": "payload.hits.total > 1"
}
},
"transform": {},
"trigger": {
"schedule": {
"later": "every 5 minutes"
}
},
"disable": false,
"report": false,
"title": "shivam watcher"
}


Enable unsafe legacy SSL renegotiation

Description
This PR fixes the issue discussed in #5422 when connecting to a server with outdated/misconfigured SSL. This is a draft PR to discuss if a full PR would be accepted. A full PR would only add the OP_LEGACY_SERVER_CONNECT SSL context flag if the ssl_insecure switch is passed.
Checklist

[ ] I have updated tests where applicable.
[ ] I have added an entry to the CHANGELOG.

Doing this only when ssl_insecure is set sounds good to me! Some notes:

This is only required for mitmproxy<->server connections, so we can move it to create_proxy_server_context.
Let's add a legacy_server_connect boolean argument there and pass ssl_insecure as the value in the tlsconfig addon.
Ideally OP_LEGACY_SERVER_CONNECT would be directly exposed by cryptography/pyOpenSSL. I'm happy to handle that part though once this PR is in. :)

@mhils Thanks for the guidelines. Let me know if this is ok as implemented.

Ideally OP_LEGACY_SERVER_CONNECT would be directly exposed by cryptography/pyOpenSSL. I'm happy to handle that part though once this PR is in. :)

:+1:

Looks great, thanks! I've filed PRs with cryptography and pyOpenSSL. :)


Update react_component.sublime-snippet

This PR adds a default value for $1 placeholder - it takes $TM_FILENAME	(Name of the file being edited, including extension.) and tries to strip off one or multiple extensions and assume that is the component name.
This will support flow when you create a component in a separate file, like MyComp.js.jsx and run rcc.
Tested it on:
Stable channel, build 3065

Thanks!


lower resolution lower quality video chosen by default

Checklist

[x] I'm reporting a broken site support issue
[x] I've verified that I'm running youtube-dl version 2020.01.24
[x] I've checked that all provided URLs are alive and playable in a browser
[x] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[x] I've searched the bugtracker for similar bug reports including closed ones
[x] I've read bugs section in FAQ

Verbose log

PS C:\Users\<username>\Downloads> youtube-dl https://www.reddit.com/r/AbruptChaos/comments/ezu8m5/the_party_didnt_look_so_boring/ -v
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['https://www.reddit.com/r/AbruptChaos/comments/ezu8m5/the_party_didnt_look_so_boring/', '-v']
[debug] Encodings: locale cp1252, fs mbcs, out cp437, pref cp1252
[debug] youtube-dl version 2020.01.24
[debug] Python version 3.4.4 (CPython) - Windows-10-10.0.17763
[debug] exe versions: ffmpeg git-2020-01-31-62d92a8, ffprobe git-2020-01-31-62d92a8
[debug] Proxy map: {}
[RedditR] ezu8m5: Downloading JSON metadata
[Reddit] x49kcxq2sbf41: Downloading m3u8 information
[Reddit] x49kcxq2sbf41: Downloading MPD manifest
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on 'https://v.redd.it/x49kcxq2sbf41/HLS_360_v4.m3u8'
[hlsnative] Downloading m3u8 manifest
[hlsnative] Total fragments: 11
[download] Destination: The party didn‘t look so boring 😮😮-x49kcxq2sbf41.fhls-1220.mp4
[download] 100% of 7.37MiB in 00:14
[debug] Invoking downloader on 'https://v.redd.it/x49kcxq2sbf41/audio'
[download] Destination: The party didn‘t look so boring 😮😮-x49kcxq2sbf41.fdash-AUDIO-1.m4a
[download] 100% of 1005.47KiB in 00:01
[ffmpeg] Merging formats into "The party didn‘t look so boring 😮😮-x49kcxq2sbf41.mp4"
[debug] ffmpeg command line: ffmpeg -y -loglevel "repeat+info" -i "file:The party didn‘t look so boring 😮😮-x49kcxq2sbf41.fhls-1220.mp4" -i "file:The party didn‘t look so boring 😮  -x49kcxq2sbf41.fdash-AUDIO-1.m4a" -c copy -map "0:v:0" -map "1:a:0" "file:The party didn‘t look so boring 😮😮-x49kcxq2sbf41.temp.mp4"
Deleting original file The party didn‘t look so boring 😮😮-x49kcxq2sbf41.fhls-1220.mp4 (pass -k to keep)
Deleting original file The party didn‘t look so boring 😮😮-x49kcxq2sbf41.fdash-AUDIO-1.m4a (pass -k to keep)

Description

Running the above command downloads a lower res, obviously lower quality video with artifacts. It chooses hls-1220 as opposed to dash-VIDEO-1. That should not happen, unless I'm missing something. Is there a way to prevent this? You say in one of your posts

Formats are sorted by quality.

That's not the case, as apparent from this link. I understand that it is hard to estimate the quality of the video programmatically. But I'd say the resolution can be just as telling of video quality as the bitrate, so why not give a weight to both instead of limiting it to bitrate alone?
I know this is anecdotal, but it might also be helpful to have the option to give priority to DASH videos over everything else, as those tend to have the highest quality, according to my limited experience.

hls-1220 has higher reported bitrate thus has better quality. bitrate is preferred over height.


Spaces in the Color Tip

Currently the colorTip space is not available between the Default text less and color tip.
Spaces need to be included to have the nice view and camel case of the characters.
The sample solution is shown below

I can contribute for this.


Abhahn/sql server private preview

Motivation and Context

Description

Contribution Checklist

[ ] I have built and tested the code locally and in a deployed app
[ ] For frontend changes, I have pulled the latest code from main, built the frontend, and committed all static files.
[ ] This is a change for all users of this app. No code or asset is specific to my use case or my organization.
[ ] I didn't break any existing functionality :smile:

Fix for #873 and #867


Flutter Demo App running in Chrome goes blank when dragging the window from one external monitor to another.

I encountered this issue while running the Flutter demo counter app in Chrome. This issue does not occur on the iOS simulator, android emulator, or desktop.
Chrome version: Version 106.0.5249.103 (Official Build) (arm64)
MacBook Pro (16-inch, 2021), 16 GB, macOS 12.6
External Monitor 1 (HDMI via USB-C): Samsung U28R550UQN
External Monitor 2 (HDMI): Asus ZenScreen Touch MB16AMT (Portable monitor)
Workaround: Refresh the browser or drag the window back to monitor 1.
Note: Launching the app on monitor 2 will display the app as expected, but dragging it to monitor 1 and then back to monitor 2 exhibits the same unexpected behavior.
https://user-images.githubusercontent.com/233583/196306592-63f1701e-bcb2-420e-b26f-84c91816d674.mp4

Related, although that one was fixed https://github.com/flutter/flutter/issues/77605


Add wordlist for RCE of length > 3 as 932235

The refactoring of 932100 and 932105 did not consider attacks without evasion attempts. This commit adds a new rule, 932235, that detects attacks using the word lists that were previously used by 932100 and 932105 (combined since the rule length limit for httpd no longer applies).

Excellent. Will review later today. It is in sync with unix-shell, right?

I haven't checked yet. I just used the last version of 932100 and 932105. I'll check and let you know.

@fzipi checked.


Issue parsing json into database

When attempting to parse the json file, generated by call_transcript_make_bed function, into the database multiple errors flagged that can be traced back to how the json file is formatted including what the key names are.

[ ] ensure all expected database values are included in the json file generated. - missing panel_id_v and omim_no
[ ] update key names to match database headers

Currently open with pull request #65.
unable to test as variant validator is down (500 Error) will pull request into develop when able to test.


Broken hyperlinking for bulleted lists

Content after Step 1: Complete your technical planning is not hyperlinking correctly.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 04567f90-44e2-7fe8-9d61-688adecb48fc
Version Independent ID: 7c6675fc-948a-c26d-bfba-bde517670f87
Content: Deploy SharePoint and OneDrive for Microsoft 365 Enterprise - Microsoft 365 Enterprise
Content Source: microsoft-365/enterprise/sharepoint-online-onedrive-workload.md
Service: o365-solutions
GitHub Login: @JoeDavies-MSFT

@yogkumgit  - Can I pick this, please assign it to me

@milesgratz  Thank you for your feedback. We have made changes to the document via PR# https://github.com/MicrosoftDocs/microsoft-365-docs/pull/2394
Thanks
Sri

@msbemba  Thank you very much for the contribution and updating the documentation with PR. @milesgratz Hope this update is helpful for you. Thanks for taking out some time to open the issue. Appreciate and encourage you to do the same in future also.


Add ability to use React components in formatting?

Motivation
Situation where you have a link inside of string that you have to translate like this:

I tried to look from the api but I could not find a function that would allow me to pass component to localisation string. It just prints for example You have to [object Object] in order to use our app.

Can you provide example?

<View style={{ flexDirection: 'row' }}>
  <Text>{t('text.before.break')}</Text>
  <YourTextComponent style={{ marginHorizontal: 2 }} />
  <Text>{t('text.after.break')}</Text>
</View>

Something like this

I don't think @zoontek 's example is a good internationalization practice. Depending on the language, and what you're trying to internationalize, your component might change the position (component might be moved at the end or beginning, single words may become multiple words, etc.), that's why interpolation should be the right solution. Yahoo's react-intl supports this kind of 'rich text' interpolation, but apparently the owner of this project said that is not on the scope of this project.
Fortunately, someone one posted a function that does what this library should by default:
https://github.com/AlexanderZaytsev/react-native-i18n/issues/38#issuecomment-312888888


Update envoy gateway version

update envoy version from 0.6.0 to 1.0.0

What type of PR is this?
/kind documentation

thanks for updating this doc @mahmut-Abi, can you also update the Envoy Gateway implementation from Beta to GA, tia

i am bot sure it has been GA.

i will rebase it

Congrats to everyone working on Envoy Gateway! @arkodg do you want to submit an updated conformance report along with this?
/ok-to-test
/release-note-none
/approve

@robscott I can raise a follow up for the conformance report, ( nothing has changed from the test coverage perspective )

Sounds good, thanks @arkodg!
/lgtm


Add Travis script with a cronjob to update data automatically every day

Well, it would be awesome... I write it down here, to remember this.

Done with GH Actions.

Not sure if submodule auto-updates itself


added try and catch functions to fix the issue

This change resolves #228 by adding a try statement that runs the libmagic library and the default code of detecting the file type using using libmagic library and If it fails except statement runs which using splittext() function to find the file type and does not require libmagic library
Signed-off-by: Yousuf<EMAIL_ADDRESS>

Thank you for your feedback and for the changes you've made to my code. I apologize for not being aware of the practice of resolving conversation before committing; as a new contributor, I'm still learning the ropes.
Could you please let me know if there are any more changes that you would like me to make to the code? I'm eager to improve my skills and ensure that my contributions meet the project's standards.

Hey MthwRobinson,
I hope this message finds you well. I recently submitted a pull request to your repository and I noticed that it has been days since I committed the code. I understand that you may be busy with other responsibilities and priorities, but I just wanted to follow up and inquire about the status of my pull request.
If there is any additional information or action required from my end, please do let me know. I am eager to contribute to your project and would appreciate any updates you can provide.

It looks like 51 files are updated on this PR now, which doesn't seem right. I'm assuming those are auto-formatting changes. Can you double check you black versions? You can install the correct version with pip install -r requirements/test.txt.

Ok thanks for the info I will resolve the issue as fast as I can

Also double check that you're using the right line length for black. That might be why you're getting so many changes.
black --line-length 100

I have made the necessary changes to the code as per your suggestions please let me know if I have made any mistakes or if any more changes are required. Thank you for your time and attention to this matter. I look forward to hearing back from you.

Hey I ran make tidy on your branch but the PR still shows 31 files changed, most of which are formatting changes. This PR should only change a couple files (maybe 5 or 6). We won't be able to merge this one until you back out those formatting changes. I'd recommend closing this PR and opening a new one that just contains your changes to filetype.py and whichever other files had actual code changes. Alternatively, you could try to revert those changes based on the git history.

Ok i will do the necessary changes as soon as I can


Include LICENSE in compiled jar

Also added a licenses block to the pom

@ProbablePrime please follow up!

Ahh sorry @pahimar you can re-request a review once you've changed stuff and that'll notify me. :D

By default, Github will notify you when new changes are pushed to a PR that you're watching

I did not notice >.< my bad!


Stop Process By ID

How to stop process by ID?
I am using stable version.
Thanks.

$process = new BackgroundProcess('/usr/bin/php queue.php');
        if ($process->isRunning(15371)) {
            $process->stop();
        }

BackgroundProcess handles the PID internally. The parameter you passed to isPassing() does actually do nothing. If you want to stop a process manually by PID you can check out the source code of the stop() method. See https://github.com/cocur/background-process/blob/master/src/BackgroundProcess.php#L94


Restrictions

A hard requirement before launching on mainnet is that we can make future changes in such a way that we avoid breaking existing inscriptions.
One way to do this is to create restrictions which narrow down the set of inscriptions that we accept, so that we can add features and simultaneously relax those restrictions.
Looking at our future features, these restrictions could be:

Only one inscription per sat. Inscriptions applied to already inscribed sat are invalid.
Only one inscription per transaction. If there is more than one inscription in a transaction's inputs, all of them are ignored.
Only taproot witnesses are checked for inscriptions. All other witnesses are ignored
Only witnesses that do not contain OP_SUCCESS are checked for inscriptions.
Disallow empty data pushes in the inscription body. An empty data push in the inscription body serves no purpose, and disallowing it could allow it to be used in the future.

There are a lot of restrictions here, but each is pretty simple to implement, so this would get us a path to launching on mainnet before too long.

Closing this in favor of individual issues.


I have two gridster :A and B,than i want to take one widget from A to B

I have seen multiple-grids demo, but cannot interact between them

Did you ever find a solution to this?

I also have a need for this. I need to pull whatever out of bootstrap modal into the main view.


Add optimization that prunes nested -tags

An optimization that prunes nested -tags when they contain exactly one  and nothing else (except whitespace nodes).  This looks a bit like removeNestedGroups except it only touches  tags without attributes (but can remove -tags completely from a tree, whereas this optimization always leaves at least one  tag behind).
Closes: #215

(have seen the flake error, will look at it later)

I need to follow up on something before it can be merged.


⚠ Mobitopup has degraded performance

In 2358ab5, Mobitopup (https://napcard.voz.tech) experienced degraded performance:

HTTP code: 200
Response time: 5333 ms

Resolved: Mobitopup performance has improved in c57fe00 after 421 days, 8 hours, 48 minutes.


test: remove hard coded keys from remaining tests

The objective oif this PR is removing hard coded ssh keys from the remaining tests, mainly go tests.
This pull request includes:

[ ] adequate testing for the new functionality or fixed issue
[ ] adequate documentation informing people about the change such as

[ ] create a file in news/unreleased directory if this change should be mentioned in the release news
[ ] submit a PR for the guides repository if this PR changed any behavior described there: https://www.osbuild.org/guides/

Ok so the test was not yet ready apparently. It was updated and merged in #1524 and already uses your script for generating new ssh keys. This PR can therefore be closed.


Increase package compatibility

Hi Kadirnar,
Thanks for implementing this tracker. Based on work in other forks, I made some changes to the package:

Remove Pytorch dependency (this was done in a fork by @0xNOY)
Changed the dependency on lap to lapx to have compatibility with python >= 3.10 (following the example of forks by @gimletlabs and @TomDarmon )
Relaxed the dependence to improve package resolution in a larger project.
I ran into an exception in update() when dets is an empy array/tensor.
Fix issue #2 by adding an xyxy2ltwh() function.

It would be nice to see these revisions upstreamed. Feel free to cherrypick.

I can't test it because I'm very busy. Did you test it?

Understandable! I do use this repo in my own code, so yes I did.
Important to note however that due to fixing #2 the coordinates are different that the original repo, in which the resulting bboxes were misaligned (the top left corner was at the detection's center). If one relies on exact position, that this can be considered a breaking change.


No vpncmd option for DHCP static routing table

There does not seem to be a vpncmd command to edit the static route table of the secureNAT dhcp server.

There is 'PUSHROUTE' option in 'DhcpSet' command.

DhcpSet [/START:start_ip] [/END:end_ip] [/MASK:subnetmask] [/EXPIRE:sec] [/GW:gwip] [/DNS:dns]
[/DNS2:dns2] [/DOMAIN:domain] [/LOG:yes|no] [/PUSHROUTE:"routing_table"]
/PUSHROUTE - Specify the static routing table to push.
Example: "<IP_ADDRESS>/<IP_ADDRESS>/<IP_ADDRESS>, <IP_ADDRESS>/<IP_ADDRESS>/<IP_ADDRESS>"
Split multiple entries (maximum: 64 entries) by comma or space characters. Each entry must be specified in the "IP network address/subnet mask/gateway IP address" format.
This Virtual DHCP Server can push the classless static routes (RFC 3442) with DHCP reply messages to VPN clients.
Whether or not a VPN client can recognize the classless static routes (RFC 3442) depends on the target VPN client software. PacketiX VPN Client and OpenVPN Client are supporting the classless static routes. On L2TP/IPsec and MS-SSTP protocols, the compatibility depends on the implementation of the client software. You can realize the split tunneling if you clear the default gateway field on the Virtual DHCP Server options. On the client side, L2TP/IPsec and MS-SSTP clients need to be configured not to set up the default gateway for the split tunneling usage.
You can also push the classless static routes (RFC 3442) by your existing external DHCP server. In that case, disable the Virtual DHCP Server function on SecureNAT, and you need not to set up the classless routes on this command.
See the RFC 3442 to understand the classless routes.

Hi @sanderux . As @MtCedarNet mentioned you can use the PushRoute option in vpcmd. Is this what you are looking for. This issue has seen no reply since a couple of month and I'd like to close it within the next few days if it remained inactive

Hi, Thanks for the answer. We have since moved to a different solution but thanks.


[#178898838] terraform: ensure alertmanager configs are valid yaml/json

Having to use an external module here because terraform has no native support for throwing errors deliberately.
Do take a look at it and see if you think it's weird: https://github.com/Invicton-Labs/terraform-null-assertion
See how it makes a deliberate call to a non-existent program as a means of throwing an error during the plan phase. Liability?
 And as a result its error message looks a bit weird.
The other way of doing it was to use a special provider, but that was even weirder and probably more of a liability.
Using depends_on ensures even a targeted/partial terraform apply should require this check to be performed.
If we're ok with this, do you think I should also put similar checks on the alert yamls in terraform/modules/prom-ec2/paas-config/?

Failure now using updated external module 😆

Certainly uglier but doesn't do the weird external call-out.


RowGroup size recommendation is too low for optimal use of Parquet

From the README:
var writer = await parquet.ParquetWriter.openFile(schema, 'fruits.parquet');
writer.setRowGroupSize(8192);

This is way off compared to the intended size of RowGroups for Parquet files. The initial implementation suggests to use 128MiB as the RowGroup size to neatly fit a HDFS block.
Using very tiny RowGroup sizes removes the main benefit of the Parquet format, being columnar, utilising vectorized execution and a good trade-off between compression ratios and CPU usage due to encoding the data with the knowledge of its data type.
The smallest unit in a Parquet file, a page, is normally set to 1 MiB which is much more than 200x the recommended RowGroup size. Some implementations have used 64KiB which is also greater.

Note that the value is currently not specified in bytes, but as a number of records. Assuming an average row size of 4k, the current default row group size would come out to ~16MiB.
I think 128MiB in a single row group could be a tad too much for node.js, but we could definitely try increasing the default. However just today somebody opened a bug report because they ran into an issue where apparently the default was too high for them (due to much larger rows I believe).
I think the proper long-term solution would be to change the code so that the user can specify the limit in bytes. However that would require some larger changes to the code or us adding a second code path to "estimate" the record size before the actual encoding happens.


Add GitHub.cli 0.10.1

https://github.com/cli/cli/releases/tag/v0.10.1
Microsoft Reviewers: Open in CodeFlow

/AzurePipelines run

Why was pipeline cancelled?

Duplicate of #2136
Sorry for the delay on this.  GitHub CLI 0.10.1 (#2136)


Feature Request: Workflow for updating image (or settings) used for a container

In Container Station, the web-based GUI does not provide a simple way to edit settings of any created container. While this works fine when images are kind of well understood and easy instructions exist to set them up, it does not work very well when one is experimenting/developing new images.
Some of the settings are changeable once the container is created. For example "CPU", "Memory" or "Auto-start" seem to be editable. It would be really useful if these edition capabilities were extended to the whole set of information concerning a container: the image used, the environment variables, the volumes that can be mounted, etc. A restart would then be required for changes to take effect.
This feature would allow one to experiment and adjust the use of containers through the web interface without the need to SSH into the machine, which will help on the usability of Container Station.
As of today, the only solution the user has (apart from SSH'ing into the machine as I saw in other threads) is to destroy and re-do the container from scratch, which is quite tedious.

Currently we only provide settings to modify Auto-start/CPU/Memory/Network mode/device. And the modified container will not use the original image name.
In fact, the Docker container does not provide an easy way for the user to reset the settings. Therefore, we recommend that if you want to modify more settings, you can re-create the container.


Feature request - I would like the ability to specify redis channel name

Currently, when subscribing an application to redis events, via adding a listener, there's no easy way to specify a channel name.  The problem with this is that in a clustered environment, where each member of the cluster is responsible for updating the same redis keys, e.g., session keys, then all members of the cluster will receive all notifications for all the updates, even if they are only interested in the updates that they made.
One way to get around this is to specify a unique channel name for each member of the cluster, resulting in only being notified of the updates that it is responsible for.
I have been able to achieve this by subclassing the Redisson class, in my case the RedissonMapCache, and overloading the channel naming methods.  I've demonstrated that this works.  One problem with this is that without additional modifications or extensions to Redisson, it won't work with batching.  Ideally, if one could provide a mechanism for modifying the channel name, that would be great.
thanks, Mitchell

Consulted in Gitter. Solved with alternative methods.


Remove use of the uu standard library module

which is being removed in Python 3.13, by backporting https://github.com/python/cpython/commit/407c3afe1986f4c43cb0e68e28b90da30eebd738
Partial fix for https://github.com/PythonCharmers/python-future/issues/640 .
Also:

Backport small fixes from upstream email library module
Remove unused imports
Test also on Python 3.10

Test failure unrelated.


News Breaks Reality

Description

Reading the news and checking the second page causes a loop of loading the map over and over. Happens to other players if they interact with the same PDA.

fake news :trollface:

Screencast from 2024-05-24 13-52-34.webm
I could not reproduce this, are there more steps involved?

That's all I got from the player that reported it. The moment the game started bugging out and repeatedly reloading the map was specifically after they checked the next news page and would not stop even after dropping the PDA. If another player interacts with it, it automatically goes to the news app and hits them with the same bug.


ge requirements

figure out how to get data on ge requirements, and decide how the algo will decide which courses to pick/certain pathways.
maybe the algo will decide these certain pathways.

have dropdown for now to pick either csu or uc transfer

we need to extract pdf requirements for GEs, with uc/csu transfers we can use pdfs from assist.org
https://medium.com/geekculture/how-to-scrape-pdfs-pdf-scraping-in-the-real-world-using-python-e312bfa6fcfe
articulation csu
articulation igetc uc/csu

we could not get requirements, in correct format from de anza. we will change model to get highest rating professor


Please add the ability to swipe through pages while holding the zoom

Right now I’m using a simple library for image zoom ->
https://github.com/jsibbold/zoomage
Do you mean to have a image zoomed, and while zooming being able to scroll next?
Or you mean that you also want to scroll next and keep the same zoom as before?

Yes，I also want to scroll next and keep the same zoom as before. Thank you for your reply. This is a very good library，Hope it can be updated continuously.


Can't import Svelte components

Some (or most) Svelte components can't be imported from the JS. Looks like the bundler doesn't know how to fetch the subcomponents.
import Icon from<EMAIL_ADDRESS>works, but https://github.com/fedorovvvv/svelte-media-queries doesn't.

I'm trying to import and use TanStack Table.
Here is the code
https://tanstack.com/table/v8/docs/examples/svelte/basic
I'm getting this error
82a46731-3460-4e72-ada4-22e9c91d51fa:40 Uncaught (in promise) Error: <svelte:component this={...}> is not a valid SSR component. You may need to review your build config to ensure that dependencies are compiled, rather than imported as pre-compiled modules.  It looks like it can't run in the official Svelte repl either: https://svelte.dev/repl/2963fee288204943b76c5853781b6eed?version=3.59.1
This looks like a component that would need to be managed and bundled externally to be consumable from within Primo.

@mingfang I can't get it to work either, although it doesn't seem to be related to this particular issue. It looks like it can't run in the official Svelte repl either: https://svelte.dev/repl/2963fee288204943b76c5853781b6eed?version=3.59.1
This looks like a component that would need to be managed and bundled externally to be consumable from within Primo.

@mateomorris Thanks for trying.

@mingfang module imports have been improved a lot - so now you can import TanStack table or locally developed components (will have a post on that soon). Here's an example of a block using TanStack table:
TanStack Table.json.zip


Need DHCP option 15: domain-name

palletjack2kea needs to generate config that sends DHCP option 15: domain-name, so that DHCP clients know how to look up short names.

Code written, waiting for #52.

sigh Kea 1.1.0 introduced the ability to specify options on a per host basis.
# rpm -q kea
kea-1.0.0-9.el7.x86_64

Tried the generated configuration with a hand-built Kea 1.1.0-beta. The configuration loads, and according to tcpdump the server sends option 15 Domain-Name. However, it does not send the Hostname option, and Anaconda thinks it's called localhost.localdomain.

Not a problem with this code: #54.

Reopened due to killed pull request merge.

For now, we're OK with sending the same boot-file to everyone, since we can chain load Solaris from PXELINUX, and every machine wants the same domain name anyway. This means we can survive using Kea 1.0.0.


Updater has a weird title

Description
The Titlebar is called "Overlay plugin update"

That probably intentional.

well, i just wanted to report it as i havent found anything and i noticed it just the other day.
the updater isnt shown every time so it might slip the eyes of the devs.
plus i dont know if the updater was being copied over from the overlay plugin or is used via an exposed api.

I believe it used the same system.

This no longer happens.  Thanks for the bug report!


Generated java Gapic client tests don't include @RunWith annotation

Example:
https://github.com/googleapis/java-bigtable/blob/8f53b43880be905ea0221d255fe6f81ffe7161e9/google-cloud-bigtable/src/test/java/com/google/cloud/bigtable/admin/v2/BaseBigtableTableAdminClientTest.java#L92-L93

@miraleung , is this still valid issue to be tracked in this repo?


cannot run enduro with s3

After setting up s3, my project won't run. I get this error message. This is what happens whether I run juice pack -f, juice pull, or just enduro start.
<?xml version="1.0" encoding="UTF-8"?> <Error>NoSuchKey<Message>The specified key does not exist.</Message><Key>juicebox/juice.json</Key><RequestId>C755B9F8AD70628E</RequestId><HostId>pChEn3ve9fmYPI5yt4GSsnjg/ZFn+oa+npQGzJve8APEEOc5L/wCLoeeyZH4JnneQ1lmz1cxqFo=</HostId></Error>
enduro.json:
{ 	"project_name": "daronscustombuildings", 	"project_slug": "dcb", 	"juicebox_enabled": true, 	"s3": { 		"bucket": "{my bucket name}", 		"region": "us-west-1" 	} }
enduro_secret.json:
{ 	"secret": { 		"s3": { 			"S3_KEY": "{IAM access key from aws}", 			"S3_SECRET": "{IAM secret key from aws}" 		} 	} }
Am I missing something here?
I've tried updating enduro, I've checked that juicebox is enabled and I do have a juicebox/juice.json file, and double checked that my keys are entered in correctly.
Please help!

Is your bucket, bucket folders, and files all public and accessible? Can you go to the individual links and view the files?

When I click on my bucket, all the files are listed and I can click on them. Bucket permissions are set to public.

Is there any way to see an example bucket set up?

enduro website uses buckets: https://github.com/Gottwik/enduro_website/blob/master/enduro.json
I think the error is saying there is no juice.json file in the bucket. Can you see if there is juicebox/juice.json in your bucket?
Could you try updating enduro(npm i enduro -g), maybe you have a weird,buggy version.

Was able to fix the issue by manually uploading a juicebox folder and the juice.json file to my bucket. Thanks for the help. :)

Can someone show the file and directory structure for adding this? I'm experiencing the same issue.

@alpinstang I believe that happens when there isn't a juice.json file in the bucket. A workaround is to manually push the file once. From then on it should all work


In CI, run e2e tests on the build

Fixes https://github.com/badges/shields/issues/3267
npm run e2e still starts server using npm run start, which is convenient for development.

Again have some problems with CI. Closing in favour of https://github.com/badges/shields/pull/3269


Internal group

Im implementing  network diagram using internal groups features.
2 main groups (in each main group that contain 2-3 internal group).
I got the following trouble:

it is not smoothly to moving node of network diagram .
When i added more node,The rendered network diagram like dancing.

In your wiki, i figured out that is still a experimental Features.
Could you tell me when final version of this feature is release?
OR what should i do to make up these issues

@VeryNewUser1 Thanks for your report! As you pointed out, the internal group feature is still experimental, and there are some technical issues to fix. I have no planned date to release it as an official feature.
But if you can send me your .json and .html, I'll investigate what's going on in your environment.


TypeError: _handle_redirect_headers() takes 2 positional arguments but 3 were given

django-unpoly version: 0.1.2
Python version: Python 3.8
Operating System: OSX

Description
On a request that results in a redirect, django-unpoly crashes with:
2021-09-25 19:58:30,512:    ERROR -- Internal Server Error: /redacted/18/
Traceback (most recent call last):
  File "/Users/dpursehouse/myproject/.tox/py38/lib/python3.8/site-packages/django/core/handlers/exception.py", line 47, in inner
    response = get_response(request)
  File "/Users/dpursehouse/myproject/.tox/py38/lib/python3.8/site-packages/django_unpoly/middleware.py", line 72, in __call__
    response = self._handle_redirect_headers(request, response)
TypeError: _handle_redirect_headers() takes 2 positional arguments but 3 were given

What I Did
Looking at the code, the method is defined as:
def _handle_redirect_headers(self, response: HttpResponseBase):

but is called with:
response = self._handle_redirect_headers(request, response)

Seems to have been introduced by 5341997acd22844be4372adfad12ef2a4ad0d382

@dpursehouse Thanks for the bug report. I will upload a fixed version to PyPi.

Thanks @jwaschkau , it's working now!


Overhaul - no prototypes

First step for moving this package a little bit into the present

[x] Replace all prototypes with ES classes
[x] Update standard and mocha

Did the browserify build cause any problems? I'm for removing it, but that would be a major change, so I would like to combine the change with the ESM stuff at a later point.

fixed in #30


feat: support specifying provider branch in verifications

Fixes https://github.com/pact-foundation/pact-js/issues/750 (for the pact-node package)

Nice. I think it would be ideal if users didn’t have to configure this, though

Yeah. There is the option on the consumer side, so it would make sense to have a similar auto-detect on the provider.


Urgent: Please clean up repository and combine Jupyter notebooks

Hello
We are grading your project and see that your repository is just a mess:

[ ] There are unnecessary files (docx) everywhere
[ ] Youripynb files are not located in the right place.
[ ] Your ipynb files are not consolidated into analysis.ipynb files, please rename them and unless you have a really good reason to separate the files, each person should have their own.

Please make these changes within the next 36 hours so we can grade your work, and please confirm receipt of this message.

@sairafurqan - also tagging you in this.

Thank you for allowing us to make these changes. I believe that we have made all the changes you have specified.
If there are any other issues or changes that we failed to address please let us know and we will make them asap.
PS - Anton and I both have an exam at 7pm tonight so if there are more changes that need to be made please let us know as soon as possible (I recognize you are probably extremely busy with grading).
Thanks,
Coleton

From: Firas Moosvi @.>
Sent: April 18, 2023 12:40 PM
To: ubco-W2022T2-data301/project-group-group38 @.>
Cc: ColetonBilodeau @.>; Assign @.>
Subject: [ubco-W2022T2-data301/project-group-group38] Urgent: Please clean up repository and combine Jupyter notebooks (Issue #3)
Hello
We are grading your project and see that your repository is just a mess:

There are unnecessary files (docx) everywhere
Youripynb files are not located in the right place.
Your ipynb files are not consolidated into analysis.ipynb files, please rename them and unless you have a really good reason to separate the files, each person should have their own.

Please make these changes within the next 36 hours so we can grade your work, and please confirm receipt of this message.
—
Reply to this email directly, view it on GitHubhttps://github.com/ubco-W2022T2-data301/project-group-group38/issues/3, or unsubscribehttps://github.com/notifications/unsubscribe-auth/A5GNOK37KS6XT2CXEZWFQPDXB3U2XANCNFSM6AAAAAAXDCYZPI.
You are receiving this because you were assigned.Message ID: @.***>

Thanks that should be enough.


Help! I am getting the following Error!

I followed your configuration steps but i am getting the following error: Problem: parameter_absent | Advice: > oauth_parameters_absent | oauth_consumer_key
Please assist. Thanks in Advance

Hi,
The problem is due to consumer_key and consumer_secret missing from the config file. Please add your consumer key and consumer secret (that pesapal sent you when you signed up for a business account) to your config file found in
your_site/app/config/packages/ejimba/pesapal/config.php
if you cant locate the file above,
run the command
php artisan config:publish ejimba/pesapal

Hey,
Thanks for getting back to me.
But I must be doing something wrong. I have the Consumer Key
and  Consumer Secret already configured.
Thanks.
On Fri, Sep 25, 2015 at 10:40 PM, Ejimba Eric<EMAIL_ADDRESS>wrote:

Hi,
The problem is due to consumer_key and consumer_secret missing from the
config file. Please add your consumer key and consumer secret (that pesapal
sent you when you signed up for a business account) to your config file
found in
your_site/app/config/packages/ejimba/pesapal/config.php
if you cant locate the file above,
run the command
php artisan config:publish ejimba/pesapal
—
Reply to this email directly or view it on GitHub
https://github.com/Ejimba/pesapal/issues/1#issuecomment-143334363.

You are welcome.


Responsible Disclosure - Check if admin already created by a public API endpoint

Portainer - Check if admin already created by a public API endpoint
PRODUCT DESCRIPTION
PORTAINER IS AN OPEN-SOURCE LIGHTWEIGHT MANAGEMENT UI WHICH ALLOWS YOU TO EASILY MANAGE YOUR DOCKER HOSTS OR SWARM CLUSTERS
BACKGROUND

Portainer until 1.19.2

VULNERABILITY DETAILS
Portainer provides an API endpoint (/api/users/admin/check) to verify that the admin user is already created. This API endpoint will return 404 if admin was not created and 204 if it was already created. This "feature" allows anyone to receive unauthorized access on the host when the portainer is configured incorrectly.
PROOF OF CONCEPT
Manual steps to reproduce the vulnerability:

docker run --rm -it -p 9000:9000 -v /var/run/docker.sock:/var/run/docker.sock portainer/portainer
curl -X GET -s -o /dev/null -w "%{http_code}" http://<IP_ADDRESS>:9000/api/users/admin/check
If curl return 404, open web-browser and create a admin password. xdg-open http://<IP_ADDRESS>:9000

Applying this around the world with shodan:
git clone git@github.com:lichti/shodan-portainer.git
virtualenv --python python3 .venv
source .venv/bin/activate
pip install -r requirements.txt
export SHODAN_API_KEY=xxxxxxxxxxxxxxxxxxxxxxx
python portainer.py

If you has a paid plan, you can use a filters:
export SHODAN_FILTER = 'country:"BR"'
python portainer.py

Output example:
Country: US | ISP: Digital Ocean | http://142.x.y.158:9001/
Country: CA | ISP: Atlantic.net  | http://45.x.y.165:9000/
Error: skipping 206.x.y.63

WORKAROUND
Forcing the admin password by extra parameter on portainer CLI - configuration.html#admin-password. On source code portainer.go#L13-L14.
VULNERABILITY DISCLOSURE TIMELINE
2018-11-19: Vendor was contacted
AUTHOR & REVISION
Author: Gustavo Lichti<EMAIL_ADDRESS>Revision:
More info:
shodan-portainer

Hi @lichti
Thanks for reporting this issue.
This is a matter of mis-configuration that could lead to a potential vulnerability. While we are not keen to force the setup of the default administrator credentials at deployment time, we're thinking about introducing a timer that would shut down the Portainer instance if an administrator account has not been created after 5 minutes.
This would balance the potential vulnerability exploit with UX and deployment simplicity which are core values of the software.
Any thoughts or alternative you'd like to propose?

Hi @deviantony,
Thanks for the answer, shutdown instancet portainer if admin account was not created after awhile, it's an idea. But another idea is to create a token at application startup, and to create the admin password, you need to put that token. The user can get this token with docker logs.

@lichti
Yeah sounds like we could also output a random temporary password in the logs and ask the user to set their own password after the first authentication but it would just complexify deployments.
As we'd like to keep our deployment procedure simple, we cannot really leverage docker logs as an extra manual step after deployment to retrieve some information that must then be passed in the UI.

We wont be doing that… that UX is counter to Portainer’s vision…
The shutdown process after 5 minutes is sufficient in my book…
From: Gustavo Lichti<EMAIL_ADDRESS>Sent: Tuesday, 20 November 2018 5:12 p.m.
To: portainer/portainer<EMAIL_ADDRESS>Cc: Subscribed<EMAIL_ADDRESS>Subject: Re: [portainer/portainer] Responsible Disclosure - Check if admin already created by a public API endpoint (#2475)
Hi @deviantonyhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_deviantony&d=DwMFaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=0fx0h4vB56iTLpw2McH1ZD6TqG_QGpbggVOB-PfMJpM&m=f8MBY6GykHZ915R_7P7UDyA8lD72-yp5kfxIuS205FQ&s=Rd20h4OSNedxuyanAaq2Az5b9PGq8XGmdg2THoRIpSU&e=,
Thanks for the answer, shutdown instancet portainer if admin account was not created after awhile, it's an idea. But another idea is to create a token at application startup, and to create the admin password, you need to put that token. The user can get this token with docker logs.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHubhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_portainer_portainer_issues_2475-23issuecomment-2D440131631&d=DwMFaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=0fx0h4vB56iTLpw2McH1ZD6TqG_QGpbggVOB-PfMJpM&m=f8MBY6GykHZ915R_7P7UDyA8lD72-yp5kfxIuS205FQ&s=lcQ8lQKfLZDLOJcfAU3KXYSv3tgjcsQd9jt5js-01oY&e=, or mute the threadhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AWGrldzyENfkYLU6QjoPmCpnuk2nFa6vks5uw4EZgaJpZM4YqCy4&d=DwMFaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=0fx0h4vB56iTLpw2McH1ZD6TqG_QGpbggVOB-PfMJpM&m=f8MBY6GykHZ915R_7P7UDyA8lD72-yp5kfxIuS205FQ&s=IYOr8s9caFzrcKvg7rVpDNwBLWCjD5U_e1juB3FvSSk&e=.

Deployment procedure simple is good, but don't must to create a potential vulnerability. Sound good shutdown after five minutes, but are five minutes exposted to de world. Sound very simple to me the user configure a initial password by CLI parameter or environment variable.

CVE: https://nvd.nist.gov/vuln/detail/CVE-2018-19367

in my humble opinion, "--no-authentication" should not exist. Integration with oauth and saml are more important features and do not exist. But "--no-authentication" is forced by user by CLI parameter.

I do:
docker run --rm -it -p 9000:9000 -v /var/run/docker.sock:/var/run/docker.sock portainer/portainer --no-auth
And:
curl -X GET -i http://<IP_ADDRESS>:9000/api/users/admin/check
HTTP/1.1 404 Not Found
Content-Type: application/json
X-Content-Type-Options: nosniff
X-Frame-Options: DENY
X-Xss-Protection: 1; mode=block
Date: Tue, 20 Nov 2018 17:54:10 GMT
Content-Length: 110
{"err":"No administrator account found inside the database","details":"Object not found inside the database"}
In this case, the Endpoint must return 204 and not 404.

UX cannot ignore security, to facilitating initial setup. We need aware users about scurity, and we need help them about this, not facilitating the setup but explaning the ploblem.

Whatever we decide to do, it will not involve getting a password from logs, that is a terrible experience for a product aiming to simplify things.
We will more than likely just allow the user to set a password as part of the cli command when deploying portainer, and if they dont, then they get 5 minutes to set one from the ui before portainer exits.
That way the user can choose their risk exposure vs simplicity.
Rgds,
Neil Cresswell
On 21/11/2018, at 7:03 AM, Gustavo Lichti <notifications<EMAIL_ADDRESS>wrote:
UX cannot ignore security, to facilitating initial setup. We need aware users about scurity, and we need help them about this, not facilitating the setup but explaning the ploblem.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHubhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_portainer_portainer_issues_2475-23issuecomment-2D440373570&d=DwMCaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=0fx0h4vB56iTLpw2McH1ZD6TqG_QGpbggVOB-PfMJpM&m=jtaQqD5yy1LJuwG_-kVi7nGOorESxgL9KZNPMk35dNA&s=05NS90_1_hoEeqQnka4H3w9OwMrUemms8v3OspMh9SM&e=, or mute the threadhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AWGrla1z8-5FYqJmqblBKlBosS9pw70BQXks5uxEP2gaJpZM4YqCy4&d=DwMCaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=0fx0h4vB56iTLpw2McH1ZD6TqG_QGpbggVOB-PfMJpM&m=jtaQqD5yy1LJuwG_-kVi7nGOorESxgL9KZNPMk35dNA&s=Dhe_AoTAP_Es9v4tACCawsKUAQw2hV3Fu0FGYSl_qY4&e=.

I also dont want that flag, but every time we try to take it away, there is massive negative feedback, so its here to stay unfortunately.
Rgds,
Neil Cresswell
On 21/11/2018, at 6:50 AM, Gustavo Lichti <notifications<EMAIL_ADDRESS>wrote:
in my humble opinion, "--no-authentication" should not exist. Integration with oauth and saml are more important features and do not exist. But "--no-authentication" is forced by user by CLI parameter.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHubhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_portainer_portainer_issues_2475-23issuecomment-2D440369316&d=DwMCaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=0fx0h4vB56iTLpw2McH1ZD6TqG_QGpbggVOB-PfMJpM&m=8jEKGyObe-ABvOyPdV3ry9WKEPT_aXQOEjSMI2qqGV4&s=wsNywrYtUbvwrWDSeD_9arYxt33a8jy9Gex_6iAmz0I&e=, or mute the threadhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AWGrlTad9DoHnfMdExHIeLncvFnq8DPmks5uxEDjgaJpZM4YqCy4&d=DwMCaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=0fx0h4vB56iTLpw2McH1ZD6TqG_QGpbggVOB-PfMJpM&m=8jEKGyObe-ABvOyPdV3ry9WKEPT_aXQOEjSMI2qqGV4&s=k97NPbeA31cRN8EriNd8hinZ2OJXLk_qt8EKLQDhZ7c&e=.

Have you guys considered disputing/rejecting this CVE with the National Vulnerability Database? This doesn't seem to qualify as a report-able CVE.
Where are the CVEs for open S3 buckets, MongoDBs and Elasticsearch instances?

I wasnt even aware you can dispute the submission.
The original submitters point is that Portainer has an obligation to protect our users from themselves and their own bad decisions... ie we do not allow you to expose Portainer without authentication from the outset.
We dont agree with that, and have elected to allow our users to make their own decisions, which means the CVE remains. We did however put in place a mitigation that says if an admin account doesnt exist within 5 minutes of Portainer starting, then shutdown, which will hopefully mitigate some risk.
N
Rgds,
Neil Cresswell
On 13/12/2018, at 4:30 PM, William Easton <notifications<EMAIL_ADDRESS>wrote:
Have you guys considered disputing/rejecting this CVE with the National Vulnerability Database? This doesn't seem to qualify as a report-able CVE.
Where are the CVEs for open S3 buckets, MongoDBs and Elasticsearch instances?
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHubhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_portainer_portainer_issues_2475-23issuecomment-2D446830619&d=DwMCaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=0fx0h4vB56iTLpw2McH1ZD6TqG_QGpbggVOB-PfMJpM&m=07Rz1GUXZR9TwogvhRajSiMWgLxT3aWP6ya-qfP6n_Q&s=8l4L83s1Gk_s_C6BQjP2kshzhFTu-qNDBtFLOKHj0_c&e=, or mute the threadhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AWGrlcWCgFh2CubHeupj5h7py7UhucoMks5u4cnsgaJpZM4YqCy4&d=DwMCaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=0fx0h4vB56iTLpw2McH1ZD6TqG_QGpbggVOB-PfMJpM&m=07Rz1GUXZR9TwogvhRajSiMWgLxT3aWP6ya-qfP6n_Q&s=24AVi4bQA9LhTiYMJG3ZzAVavfQnnwbSXAqMqLXD-HY&e=.