cmd/compile: unexpected memequal call in short string comparison

(Using Go tip, 8818b4d27)
Compiling this code on amd64,
type BoxType [4]byte

func (t BoxType) EqualString(s string) bool {
        return string(t[:]) == s
}

I would expect that to compile to something pretty minimal, since the memory comparison must always be 4 bytes, but instead I see a call to memequal:
"".BoxType.EqualString STEXT size=103 args=0x20 locals=0x28
        0x0000 00000 (./bmff/bmff.go:62)        TEXT    "".BoxType.EqualString(SB), $40-32
        0x0000 00000 (./bmff/bmff.go:62)        MOVQ    (TLS), CX
        0x0009 00009 (./bmff/bmff.go:62)        CMPQ    SP, 16(CX)
        0x000d 00013 (./bmff/bmff.go:62)        JLS     96
        0x000f 00015 (./bmff/bmff.go:62)        SUBQ    $40, SP
        0x0013 00019 (./bmff/bmff.go:62)        MOVQ    BP, 32(SP)
        0x0018 00024 (./bmff/bmff.go:62)        LEAQ    32(SP), BP
        0x001d 00029 (./bmff/bmff.go:62)        FUNCDATA        $0, gclocals·a20105803dd226ab8faa525f9ceddf12(SB)
        0x001d 00029 (./bmff/bmff.go:62)        FUNCDATA        $1, gclocals·69c1753bd5f81501d95132d08af04464(SB)
        0x001d 00029 (./bmff/bmff.go:63)        MOVQ    "".s+64(SP), AX
        0x0022 00034 (./bmff/bmff.go:63)        CMPQ    AX, $4
        0x0026 00038 (./bmff/bmff.go:63)        JEQ     56
        0x0028 00040 (./bmff/bmff.go:63)        XORL    AX, AX
        0x002a 00042 (./bmff/bmff.go:63)        MOVB    AL, "".~r1+72(SP)
        0x002e 00046 (./bmff/bmff.go:63)        MOVQ    32(SP), BP
        0x0033 00051 (./bmff/bmff.go:63)        ADDQ    $40, SP
        0x0037 00055 (./bmff/bmff.go:63)        RET
        0x0038 00056 (./bmff/bmff.go:63)        LEAQ    "".t+48(SP), AX
        0x003d 00061 (./bmff/bmff.go:63)        MOVQ    AX, (SP)
        0x0041 00065 (./bmff/bmff.go:63)        MOVQ    "".s+56(SP), AX
        0x0046 00070 (./bmff/bmff.go:63)        MOVQ    AX, 8(SP)
        0x004b 00075 (./bmff/bmff.go:63)        MOVQ    $4, 16(SP)
        0x0054 00084 (./bmff/bmff.go:63)        PCDATA  $0, $1
        0x0054 00084 (./bmff/bmff.go:63)        CALL    runtime.memequal(SB)
        0x0059 00089 (./bmff/bmff.go:63)        MOVBLZX 24(SP), AX
        0x005e 00094 (./bmff/bmff.go:63)        JMP     42
        0x0060 00096 (./bmff/bmff.go:63)        NOP
        0x0060 00096 (./bmff/bmff.go:62)        PCDATA  $0, $-1
        0x0060 00096 (./bmff/bmff.go:62)        CALL    runtime.morestack_noctxt(SB)
        0x0065 00101 (./bmff/bmff.go:62)        JMP     0

Ideally we'd just do a 4 byte (potentially unaligned) load from the string into a register and compare with the receiver?
/cc @josharian @randall77 @rasky

In case someone wants to look into this, the relevant bit of code to soup up is from walk.go, func walkexpr, near the beginning of case OCMPSTR:
		// Rewrite comparisons to short constant strings as length+byte-wise comparisons.
		var cs, ncs *Node // const string, non-const string
		switch {
		case Isconst(n.Left, CTSTR) && Isconst(n.Right, CTSTR):
			// ignore; will be constant evaluated
		case Isconst(n.Left, CTSTR):
			cs = n.Left
			ncs = n.Right
		case Isconst(n.Right, CTSTR):
			cs = n.Right
			ncs = n.Left
		}

This code tries to detect strings with known length by looking for constant strings. Fixing this issue would involve adding detection of strings converted from byte (and rune) slices of known length.
Might (maybe) be a decent starter compiler issue.

I’m continuing to try to get started (or maybe continually trying) so I’d like to have a look at this.

@ChrisALiles  are you working on this? I've encountered this pattern in internal code, so I was thinking on implementing this optimization.

Yes, after some struggle, I have a prototype fix working and I was planning
to spend the next week or two expanding it.
However, I’m happy to leave it to you if you want it. It’s been a very
educational experience for me and that’s the main thing.
On Fri, 29 Jun 2018 at 7:22 am, Ilya Tocar<EMAIL_ADDRESS>wrote:

@ChrisALiles https://github.com/ChrisALiles are you working on this?
I've encountered this pattern in internal code, so I was thinking on
implementing this optimization.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/golang/go/issues/24765#issuecomment-401177125, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AeohTsScMDorv55Jnee_EbANIXBdDJXaks5uBUkMgaJpZM4TLsBG
.

I have a small fix in walk to address Josharian’s “len” example but the
rest is in ssa rules.
On a first look, your change is much better (simpler and more compact) than
what I’ve come up with.
On Sat, 30 Jun 2018 at 6:29 am, GopherBot<EMAIL_ADDRESS>wrote:

Change https://golang.org/cl/121697 mentions this issue: cmd/compile:
inline runtime.memequal if possible
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/golang/go/issues/24765#issuecomment-401465343, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AeohTmWuG0HUbae6je_MuHSM_5JfBKQcks5uBo4lgaJpZM4TLsBG
.

CL 130255 is probably only of academic interest at best seeing that CL 121697 has already been submitted, but I thought I would send it anyway because it cost me a fair amount of effort. A couple of notes: 1. I originally tried to find a way to fix this in walk and found a way to handle Josharian's "len" example above, so I left that in. 2. Don't send it to the bots - it fails in test/codegen because I wasn't brave/silly enough to try anything with architectures other than amd64/386.

@ChrisALiles CL 121697 is not submitted, due to trybot failures. My understanding is that main problem is that replacing call to memequal with store to the stack may change stack layout and cause write after stack end. I didn't had time to fix that.


Support Ng ultrawarm

what

Adds support for AWS Elasticsearch ultrawarm instance type

why
Needed to deploy clusters with ultrawarm node types
references

https://aws.amazon.com/about-aws/whats-new/2020/05/aws-announces-amazon-elasticsearch-service-ultrawarm-general-availability/
https://github.com/terraform-providers/terraform-provider-aws/pull/12668

/rebuild-readme

/test all

@ngamber Looks like tests are failing because the ES resource doesn't like one of your defaults:
Error: expected cluster_config.0.warm_count to be in the range (2 - 150), got 0

  on ../../main.tf line 122, in resource "aws_elasticsearch_domain" "default":
 122: resource "aws_elasticsearch_domain" "default" {

Would you mind updating that default to be null and we'll give that a shot?

superseded by #71


npm: recommendation for standalone CLI projects

The recommendation for a standalone CLI project should be that when publishing npm-shrinkwrap.json file, it should only contain dependencies and not dev-dependencies.
Dev dependencies are best practice for the developer(s) of the CLI, for stability and consistency between environments. However, running npm shrinkwrap will only take the package-lock.json file and rename it, resulting in a largenpm-shrinkwrap.json which contains both dependencies and dev-dependencies. When a consumer installs this CLI it will install all dependencies, and not only those needed for runtime.
My recommendation:

Committing the package-lock.json file to the CLI project (never the npm-shrinkwrap.json)
In the publish pipeline do the following

prepack script should:

Remove dev dependencies (i.e. npm prune --production)
Delete package-lock.json file
Running npm shrinkwrap

pack will then take the "slim" npm shrinkwrap
postpack script should revert changes:

checkout package-lock.json
delete the npm-shrinkwrap.json

The reason to delete the package-lock.json file is that npm prune --production only deletes files from the node_modules folder and does not update the package-lock.json file, and the npm shrinkwrap only rename the package-lock.json to npm-shrinkwrap.json if it exists. When package-lock.json does not exist, the npm-shrinkwrap.json file is created from the existing dependencies tree (which after the prune command represents the committed package-lock.json file, without the dev dependencies)
There's also the save the planet reason. An example for the impact of such a change to a single package in terms of storage:
https://github.com/barzik/branch-name-lint/pull/50

That is an impractical recommendation, since it requires pruning, and it’s irrelevant since dev deps won’t be installed anyways.
It’s not the community’s job to keep things small, it’s npm’s.

That is an impractical recommendation, since it requires pruning, and it’s irrelevant since dev deps won’t be installed anyways.
It’s not the community’s job to keep things small, it’s npm’s.

Yeah, I figured it's an unpopular opinion.
I think that since publish is usually the last thing you do in a CI/CD pipeline, it's fine to prune dev dependencies. Just like you would do before you pack a deployable without dev dependencies, for example, a server.
As for the second part, npm install installs everything in the shrinkwrap file, not only "runtime" dependencies. You can check for yourself:
npm init -y
npm install -D branch-name-lint

it installs more than 500 dependencies that include all dev dependencies that this package uses. (instead of only 70 runtime dependencies).
We can argue if this is an npm issue or not, but in practice, having dev dependencies in the shrinkwrap file results in redundant dependencies in your node_modules folder which means it also adds time to your CI/CD pipeline during npm install.
So I think it can count as best practice...

Ah, right - run npm shrinkwrap --only=prod iirc?

I remember looking for such a flag when I wanted this behavior, and couldn't find such.
Nothing in the documentation either.
AFAIK, if there's a package-lock.json file, npm shrinkwrap renames it to npm-shrinkwrap.json.
If there isn't a lock file, npm-shrinkwrap.json is created from the existing node_modules tree.

Try it. There's also npm shrinkwrap --omit=dev.

Already have. Same result.
The log to the console:
npm notice package-lock.json has been renamed to npm-shrinkwrap.json

npm shrinkwrap --production? Airbnb has used one of these for years, so although I can't remember the exact incantation, I'm quite confident it's a feature of shrinkwrap :-)

Looks like this is a confirmed bug with the npm CLI and dev dependencies should not be installed when a project has a npm-shrinkwrap.json file

Looks like this is a confirmed bug with the npm CLI and dev dependencies should not be installed when a project has a npm-shrinkwrap.json file npm/cli#4323

Interesting.
Not sure I agree with their interpretation of the bug. I think the bug is in the npm shrinkwrap command and not in the npm install. I don't see any reason the npm-shrinkwrap.json should contain dev dependencies at all. That's what package-lock.json is for. But again, I might be in the minority here.
So maybe we can settle on "best workaround practice"

Is there any consensus emerging from the discussion?
Will the fix in https://github.com/npm/cli/issues/4323 address the concern without the need to update the recommendation?

Is there any consensus emerging from the discussion?
Will the fix in https://github.com/npm/cli/issues/4323 address the concern without the need to update the recommendation?

I think that a fix to the issue (as they interpret the bug) will only be a partial solution. As long as the shrinkwrap file contains all dev dependencies, it will still depend on npm update adoption by users. I believe that most users will not get the fix, and will still have all dev dependencies installed.

I think the npm best practices document needs to identify best (workaround) practices, given the mechanisms that currently exist and the limited patience of developers :-).
If there's no practical/easy way to do something in a package manager (like npm), or its defaults are "wrong", then I recommend creating a separate little project within this OpenSSF WG to resolve it. Once it's resolved in the tool(s), we can update the guide to match :-).
That said: It'd be really helpful if we could clearly state what that problem is, so that a separate little project can work on it. Anyone want to take a crack at it? First attempt (please fix):

It should be easy in npm to create a standalone CLI project that specifically locks its runtime dependencies but not its development dependencies (dev-dependencies). Currently you can run npm shrinkwrap but this results in a large npm-shrinkwrap.json which contains both dependencies and dev-dependencies. npm currently intends to work around this with https://github.com/npm/cli/issues/4323 where the dev-dependencies aren't installed, but this is confusing and misleading - including such unused information is likely to confuse users and tools.


Copying files to clipboard opens Google drive

I tried to share some files and clicked on copy to clipboard but instead of copying text to clipboard,the app opens Google drive.
How to reproduce

Long press on a file to select
Click share and click  copy to clipboard
The application will take you somewhere else

On Android 7.1.2

That's because you are trying to copy the file. Not it's contents. Since the android clipboard can't handle files, it redirects you to Google Drive.
I've been planning on an editor feature but I don't know when that's coming.
(related to #19)

Oh okay, I'll look into it!
That's why I wrote "related". :)

Did you use the "share" or the "copy path to clipboard" feature?

Which of those two?
The "share" feature tries to share the file itself. If this launches Google Drive this is just a fallback from Google because the clipboard can't handle files.
The "copy path to clipboard" feature copies the file's path to clipboard. If this opens Google drive, I'd love to see logs or something like this.

@crysports are you still interested in getting this fixed?
Otherwise I would close this issue.

I am closing this issue as I cannot reproduce it anymore. It is be fixed in 2.0.


Issue #983 Integration: Increase freq and num of reps for status check wait

Addresses Issue #983:

changed wait time from 4x2min to 15x1min (also rearranged lines: first check status, then crc oc-env, then oc login)
removed redundant lines (crc status was checked in Scenario immediately above)

Retest this please

Not needed anymore https://github.com/code-ready/crc/issues/983#issuecomment-647986011


test implicit string concat

opening to run CI

@jnewb1 this used to fail with pylint, can you see if https://github.com/commaai/openpilot/pull/29294 regressed this?


Attenuator not being applied to state

Before posting a bug report

[X] I have searched exisisting GitHub issues to make sure the issue does not already exist.

Expected behavior
If I apply an Attenuator to a state, I would expect the output state to be mixed and to have had loss applied to it.
Actual behavior
The state does not seem to be affected by the Attenuator.
Reproduces how often
Always.
System information
Mr Mustard: a differentiable bridge between phase space and Fock space.
Copyright 2018-2021 Xanadu Quantum Technologies Inc.

Python version:            3.10.4
Mr Mustard version:        0.3.0-dev
Numpy version:             1.21.6
Numba version:             0.55.1
Scipy version:             1.8.0
The Walrus version:        0.19.0
TensorFlow version:        2.9.1
Torch version:             None

Source code
state = Vacuum(2) >> Sgate(1.15,modes=[0,1]) >> Rgate(np.pi/2,modes=[1]) >> BSgate(np.pi/4,modes=[0,1]) << Fock(4)
state = state >> Attenuator(0.5, modes=[0])
state.is_pure ##returns True but should be False

Tracebacks
No response
Additional information
No response

oh wow. it seems like channels are not applied correctly when a state is in fock representation:
Fock(10) >> Attenuator(0.5) only affects the norm

Found the reason: there was a mismatch between is_unitary and _is_unitary. fixing it now


Update stage instructions for the later stages for the streams extension

As pointed out by @LakshyaMittal3301, in the later stages, the instructions say that the response when a blocking read times out is a nil bulk string ($3\r\nnil\r\n). This is "nil" (a string), not a nil value.
The nil value representation of a bulk string is as follows $-1\r\n.
The stage instructions should be updated to reflect this.

Fixed by: codecrafters-io/build-your-own-redis#151


Continue discussion from #283 ...generation of DH interfaces...current standards like MIxS 6...

I am closing #283 since https://github.com/microbiomedata/nmdc-schema/pull/292 provides a mechanism for dynamically importing and potentially overlaying MIxS 6 into the NMDC schema.
The discussion brought up soem other issues including:

dynamic integration of terms from other LinkML schemas (beyond MIxS)
best practices for integrating LinkML schemas over w3ids, other URLs, git submodules or local filesystem

Those could be explored more in other issues.
@ssarrafan

Generation of DH templates is routine and stable now. Extraction of terms from a MIxS LinkML resource (or a static resource of our own authoring) can be performed with sheets_and_friends and the  and sheets-for-nmdc-submission-schema


CustomSQL mix information when running checks

Hi.
I am currently checking/monitoring 2 services using the "CustoSQL" function. However, the information from one check is mixed with the other from time to time. For example, I have a CPU monitor and a message monitor that are defined under querys in the CustomSQL.xml file. When the CPU monitor does a check, it may return the correct CPU information or it may return the output of the message check query.
In my opinion, the solution could be to use various .xml files with the functions of each check and thus avoid combining information, but the plugin always points to /usr/local/nagios/etc/objects/CustomSQL.xml and does not allow using another path or different file.
Is there a way to solve it?

Hi,
Check the function ID of each custom SQL is unique and not contain special characters would be the first thing maybe.
Cheers Will.

Hi, i have this on my CustomSQL.xml:

CPU Utilization
single-value
SELECT AVERAGE_CPU_UTILIZATION FROM TABLE(QSYS2.SYSTEM_ACTIVITY_INFO())
80
90

Message Problems
single-value
SELECT COUNT(*) FROM QUSRSYS.QASXPROB WHERE WSXPST != 'C'
1
2

is your function ID ok though?


New Bluesky user

Title
Moaid Hathot
Bluesky profile url
https://bsky.app/profile/moaid.bsky.social
Twitter profile (url or username)
https://x.com/MoaidHathot
Category
dotnet
Type
microsoft

Hi @merill, the Github Action failed. Although my name is visible in bluesky.ms I'm not sure the label is visible in the actual website (I'm subscribed to the label)


Renaming and refactoring lockfree

For now, this PR is intended to be more of a discussion than anything else. Changes will be applied incrementally accordingly to discussions.
Following a discussion with @bartoszmodelski, @Sudha247 and @polytypic , lockfree is going to be renamed and refactored to include domain safe data structures in general and not just lock free ones.
I wrote down what was discussed previously but everything is still open for discussion.
Renaming this repository
Several propositions have been made to rename the repository.

dsds or dssquare or dsquare  or ds2 for domain safe data structures
Saturn
Any additional opinions about these names are welcomed.

Renaming current data structures
The data structures are going to be renamed following the example of Java.utils.concurrent,
Rules for naming data structures are the following:
1, The implementations that should be used by default are named the simplest way.
2. The others are named according to their limitations or, if it is not enough, from their specific features.
3. As aliases are easy to use in OCaml, using long but explicit names is alright.

Current name
New name

Michael_scott_queue
Queue

Treiber_stack
Stack

Spsc_queue
One_prod_one_cons_queue

Mpsc_queue
One_consumer_queue

Mpmc_relaxed_queue
Relaxed_queue

Ws_deque
Work_stealing_deque

a blocking queue
Blocking_queue

Improve README and overall documentation
Including adding examples.
Add more data structures
That includes blocking, obstruction-free, wait-free (...) data structures obviously. We should also consider adding  data-structures implemented with transactions (see kcas). We could simply add a Tx or Xt prefix to their names.

Just commenting here that while there is now a kcas_data package in the kcas repository, I'm not at all opposed to moving kcas_data (or kcas for that matter) under a common repository for concurrent data structures.  I think that having concurrent data structures in a single place could help with discoverability and documentation (less redundancy, opportunity to better guide users to pick the right data structures for their needs, ...).  One thing that I would consider, though, is to break things into multiple packages, i.e. a single repository, but multiple packages.

It seems that dsds got some traction. I like it. Perhaps, given that it's Domain-safe Data Structures, we can shorten the name to just dds? Also makes it a little easier to pronounce. With dsds I will probably end up calling it just ds in speech quite quickly anyway but I might be splitting hairs here.
I like the rest of the proposal:

Naming rules and the proposed names.
Expanding the readme and including examples.
Having various domain-safe structures here. That'll help us guide the users to what they really need.

I generally prefer names that explicitly say what the project does, rather than an abstract name from nowhere that people have to learn and appropriate. It requires less marketing.
So anything that looks like dsds is fine by me (we're not talking about a mainstream brand). You can also look for inspiration in the names of similar libraries in other languages.
Why not just dsafe?

We had a chat about this offline with @lyrm @polytypic @balat a few days ago.

The naming convention proposed is fine.
This PR is a preparation for adding other data structures like the one in kcas_data and @DeltaCube23's work on lock-based domain-safe data structures.
Documentation update will follow in a separate PR by @lyrm.
If we end up having multiple sub-packages within this repository, for e.g. one for non-composable lockfree structures, one for lock-based, one for composable structures, etc. they need to be synced for releases. It's easier to have them released together with the same version numbers (or not), as confirmed by @Leonidas-from-XIV. Do we have any concerns about this?

The one thing we ought to decide yet is the name. I don't have strong opinions on this, but I don't know dsds is going to be fairly obvious to an average OCaml user? Maybe Dsafe is a reasonable compromise which tells us what the library does, as well as is relatively easy to remember? Any ideas on this appreciated.
So, we can essentially undraft this after the updates mentioned above and review and merge. Of course we need to settle on a name. :))

Yay! We're nearly there.
Some minor edit suggestions below. More general questions here -
* Do we want to refer to the library as `Saturn` or `saturn`, in plain text?

Good point. Saturn is better. I will correct that.

* I see the module names are changed for `Treiber_stack` to `Stack`, etc. Do we want to change the file names as well? (`stm_triber_stack`, etc.)

My thought was : if we ever want to change the default stack to another implementation and still want to keep the treiber implementation (for a specific use-case for example), we will have to rename everything.
Do you see a better reason for renaming ?

My thought was : if we ever want to change the default stack to another implementation and still want to keep the treiber implementation (for a specific use-case for example), we will have to rename everything.

Fair enough. The PR looks good to me otherwise.


Ubuntu 21.04 not install nvm

Operating system and version:
nvm debug output:

nvm ls output:

How did you install nvm?

curl -o- https://raw.githubusercontent.com/nvm-sh/nvm/v0.38.0/install.sh | bash
% Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
Dload  Upload   Total   Spent    Left  Speed
100 14926  100 14926    0     0   153k      0 --:--:-- --:--:-- --:--:--  153k
=> Downloading nvm from git to '/home/user/.nvm'
What steps did you perform?
What happened?
fatal: couldn't find remote ref v0.38.0
Failed to fetch origin with v0.38.0. Please report this!
fatal: the remote end hung up unexpectedly
What did you expect to happen?
Is there anything in any of your profile files that modifies the PATH?

If you are having installation issues, or getting "N/A", what does curl -I --compressed -v https://nodejs.org/dist/ print out?

What happens if you try to git clone this repo?

Same here, it seems that it is downloading the repo but fails to update the .zshrc file.
I had to manually add
export NVM_DIR="$HOME/.nvm" [ -s "$NVM_DIR/nvm.sh" ] && \. "$NVM_DIR/nvm.sh" # This loads nvm
into the .zshrc file and then it worked

@B3r the error message in the OP is explicitly that it fails to download the repo. it seems like your issue is different; could you file a new one for that?

Access

Closing, pending a response from @sas2job.


Support s3 api copy-object across repositories

Fixes #2162
Currently supports copy-object only for the same repository.

Not part of this PR, but maybe we should open a new Issue for adding copy to our API, we already have the capability. WDYT?


[ARCTIC-1242][ams] Optimizing plan thread should only plan tables in pending status

Why are the changes needed?

fix, #1242
Brief change log

optimizing-check thread pool skips pending tables and only changes optimizing status from idle to pending
optimizing-planner thread skips idle tables and only plans tables in pending

How was this patch tested?

[ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

[ ] Add screenshots for manual tests if appropriate

[x] Run test locally before making a pull request

Documentation

Does this pull request introduces a new feature? (yes / no)
If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)

Verified in a local scenario, running from 17:00 ~ 17:50 for 50 minutes, the table in Pending status went from 70+ to 20+.
The utilization rate is now ~36%.


MarkupSafe on 2.1.0 breaks Jinja

The dependency of MarkupSafe just says >=2 but this breaks with the recent update to Jinja.
Traceback (most recent call last):
[23](https://github.com/MichaelVoelkel/lintly-flake8-github-action/runs/5247805255?check_suite_focus=true#step:4:23)
  File "/usr/local/bin/lintly", line 8, in <module>
[24](https://github.com/MichaelVoelkel/lintly-flake8-github-action/runs/5247805255?check_suite_focus=true#step:4:24)
    sys.exit(main())
[25](https://github.com/MichaelVoelkel/lintly-flake8-github-action/runs/5247805255?check_suite_focus=true#step:4:25)
  File "/usr/local/lib/python3.9/site-packages/click/core.py", line 829, in __call__
[26](https://github.com/MichaelVoelkel/lintly-flake8-github-action/runs/5247805255?check_suite_focus=true#step:4:26)
    return self.main(*args, **kwargs)
[27](https://github.com/MichaelVoelkel/lintly-flake8-github-action/runs/5247805255?check_suite_focus=true#step:4:27)
  File "/usr/local/lib/python3.9/site-packages/click/core.py", line 782, in main
[28](https://github.com/MichaelVoelkel/lintly-flake8-github-action/runs/5247805255?check_suite_focus=true#step:4:28)
    rv = self.invoke(ctx)
[29](https://github.com/MichaelVoelkel/lintly-flake8-github-action/runs/5247805255?check_suite_focus=true#step:4:29)
  File "/usr/local/lib/python3.9/site-packages/click/core.py", line 1066, in invoke
[30](https://github.com/MichaelVoelkel/lintly-flake8-github-action/runs/5247805255?check_suite_focus=true#step:4:30)
    return ctx.invoke(self.callback, **ctx.params)
[31](https://github.com/MichaelVoelkel/lintly-flake8-github-action/runs/5247805255?check_suite_focus=true#step:4:31)
  File "/usr/local/lib/python3.9/site-packages/click/core.py", line 610, in invoke
[32](https://github.com/MichaelVoelkel/lintly-flake8-github-action/runs/5247805255?check_suite_focus=true#step:4:32)
    return callback(*args, **kwargs)
[33](https://github.com/MichaelVoelkel/lintly-flake8-github-action/runs/5247805255?check_suite_focus=true#step:4:33)
  File "/usr/local/lib/python3.9/site-packages/lintly/cli.py", line 74, in main
[34](https://github.com/MichaelVoelkel/lintly-flake8-github-action/runs/5247805255?check_suite_focus=true#step:4:34)
    build.execute()
[35](https://github.com/MichaelVoelkel/lintly-flake8-github-action/runs/5247805255?check_suite_focus=true#step:4:35)
  File "/usr/local/lib/python3.9/site-packages/lintly/builds.py", line 76, in execute
[36](https://github.com/MichaelVoelkel/lintly-flake8-github-action/runs/5247805255?check_suite_focus=true#step:4:36)
    diff = self.get_pr_diff()
[37](https://github.com/MichaelVoelkel/lintly-flake8-github-action/runs/5247805255?check_suite_focus=true#step:4:37)
  File "/usr/local/lib/python3.9/site-packages/lintly/builds.py", line 86, in get_pr_diff
[38](https://github.com/MichaelVoelkel/lintly-flake8-github-action/runs/5247805255?check_suite_focus=true#step:4:38)
    return self.git_client.get_pr_diff(self.config.pr)
[39](https://github.com/MichaelVoelkel/lintly-flake8-github-action/runs/5247805255?check_suite_focus=true#step:4:39)
  File "/usr/local/lib/python3.9/site-packages/lintly/backends/github.py", line 171, in get_pr_diff
[40](https://github.com/MichaelVoelkel/lintly-flake8-github-action/runs/5247805255?check_suite_focus=true#step:4:40)
    diff = client.get(diff_url, headers={'Accept': GITHUB_DIFF_HEADER})
[41](https://github.com/MichaelVoelkel/lintly-flake8-github-action/runs/5247805255?check_suite_focus=true#step:4:41)
  File "/usr/local/lib/python3.9/site-packages/lintly/backends/github.py", line 85, in get
[42](https://github.com/MichaelVoelkel/lintly-flake8-github-action/runs/5247805255?check_suite_focus=true#step:4:42)
    return self._do_request('get', url, data, headers)
[43](https://github.com/MichaelVoelkel/lintly-flake8-github-action/runs/5247805255?check_suite_focus=true#step:4:43)
  File "/usr/local/lib/python3.9/site-packages/lintly/backends/github.py", line 112, in _do_request
[44](https://github.com/MichaelVoelkel/lintly-flake8-github-action/runs/5247805255?check_suite_focus=true#step:4:44)
    raise NotFoundError(response.content, status_code=response.status_code)
[45](https://github.com/MichaelVoelkel/lintly-flake8-github-action/runs/5247805255?check_suite_focus=true#step:4:45)
lintly.backends.errors.NotFoundError: b'{"message":"Not Found","documentation_url":"https://docs.github.com/rest/reference/pulls#get-a-pull-request"}'

I stumbled upon it by using Lintly that depends on Jinja2.

Erm, your source depends on >=2.0, this is a dependency of Jinja and it breaks Jinja's code, how is this something I should do when using Jinja?


Added code blocks

Something went wrong with PR preview build please check

Something went wrong with PR preview build please check

Something went wrong with PR preview build please check

Something went wrong with PR preview build please check


[microTVM] Update Zephyr RVM name and box version

cc @alanmacd @areusch @gromero @guberti

let's merge this after https://github.com/apache/tvm/pull/11634 is merged.

Currently testing it with hardware CI. Let's wait until testing is confirmed.


Why I modified the static folder(index.html), but after recompile no change?

Why I modified the static folder(index.html), but after recompile no change?
Do I need to use tool 'go-bindata' to regenerate static pkg？

go-bindata needed~~

Maybe it will be nice to have this done automatically by make if there is go-bindata installed and an informative message otherwise (it took me some time to figure out how exactly to generate the same static_gen.go).


Update DEVELOPER.md

Summary
Added some brief information regarding Linux Environment Variables as it seems to be incomplete without this
Full changelog
Environment variables are dynamic values that affect the programs or processes running on a server. They exist on every operating system, and their type may vary. Environment variables can be created, edited, saved and deleted.
Linux environment variables are placeholders for information stored within the system that passes data to programs launched in shells or sub-shells.
Issues resolved
Fix #XXX

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Okk will make the further changes
On Wed, 9 Dec, 2020, 3:02 pm Enrique García Cota<EMAIL_ADDRESS>wrote:

@kikito requested changes on this pull request.
Thank you for this suggestion, but we don't think it is needed. The
DEVELOPERS.md document intented audience is someone already familiar with
the concepts you added. The same way a kitchen recipe does not explain how
to bring water to boil, we should not be explaining basic concepts like
environment variables there.
Your PR points however to something that is indeed missing from that doc,
which is explaining the intended audience and prerequisites for a developer
willing to install Kong. It could be at the very top of the file. "Being
familiar with basic concepts like environment variables" would be on such
list.
I'll leave this PR open for a while in case you want to transform to
include that missing section instead.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/Kong/kong/pull/6620#pullrequestreview-547993210, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AN7G5DB2KCZHPX7BY7YRHTTST473BANCNFSM4UKCJFZA
.

I made the further changes do have a look at it!!

Hey do have a look at it and do tell me if you have any other suggestions..

Hey !! Do have a look

Hello, that is not what I was talking about. I suggest something like this:
## Intended audience and prerequisites

These instructions are intended for developers who want to start working with Kong.

As a prerequisite, the developer needs to be fluent in basic linux knowledge (like what an environment variable is, and what a linux distribution is) as well as familiar with virtualization software (VirtualBox and Docker)

Hello, that is not what I was talking about. I suggest something like this:
## Intended audience and prerequisites

These instructions are intended for developers who want to start working with Kong.

As a prerequisite, the developer needs to be fluent in basic linux knowledge (like what an environment variable is, and what a linux distribution is) as well as familiar with virtualization software (VirtualBox and Docker)


VM: Call MountInstanceSnapshot when mounting vm snapshots

Detect when instance being mounted is snapshot and call MountInstanceSnapshot on pool.
Unify the mount behaviour when restoring snapshot for both LXC and Qemu.

Signed-off-by: Thomas Parrott<EMAIL_ADDRESS>

Testsuite passed


Specter fails with newer cljs versions

This repo reproduces the problem: https://github.com/darwin/pesky-select-star
This is a new issue with 0.13.x so likely has something to do with the new inline caching implementation.

Was able to reproduce with (multi-path STAY STAY)

The problem had something to do with a change in how ClojureScript decides to use a macro or a function if both are defined in same namespace. Not sure exactly, but updated the macros for exec-select* and exec-transform* to generate cljs-compatible code if in cljs environment.

Fixed!
We are green: https://travis-ci.org/binaryage/dirac/builds/167658548


Add latancy and bandwith statistics.

Storjnode should cache basic statistics to enable better debugging and improvements:

Average file transfer speed usage.
Average establish transfer connection time.
and many more

Coved by https://github.com/Storj/storjnode/issues/41


Use ImageSource instead of BitmapId everywhere

In previous PRs it was made possible to load image streams through a url. The underlying idea of working with such a url is that this url itself could serve as the key for the cache, not needing a bitmapId. The first implementation of bitmapPath did not work like that yet. BitmapPath's were also assigned a bitmapId. So in the case of bitmapPath's this was an extra layer on top of the bitmapPath. This PR attempts to remove that. I introduced a BitmapPathRegistry that should function like that. Eventually this may replace the BitmapRegistry entirely.
This is just te beginnen of a rewrite of the mechanism to cache bitmapPath. I split off a new BitmapPathRegistry which should only store bitmapPath items. So in todays version we have two mechanisms which does not make this better right away.

This ended up as a very big yak shaving. The purpose was to use ImageSource instead of BitmapId everywhere but this led to some additional work.
In the previous situation the interface depended on skia objects. There was no explicit dependency but the skia objects were passed into the platform independent styles with object pointers and where cast back to skia objects in the renderer. This kind of dependency on skia should be in the custom renderers only. This was the case in a number of classes, and was reflected in the object pointers used in the SymbolCache.
In the previous situation we used a singleton for the BitmapRegistry, which made it hard to track its logic. This has been replaced with regular instances used as cache. More work needs to be done on caches, but this is something for v6 where we will look at the rendering logic.
Caching of tiles is now separated from caching of symbols. Although they are both images they are treated in quite different ways.
The CustomSvgStyleSample also depended on such logic. To get the same functionality it is now possible to use the SymbolStyle.SvgFillColor and SymbolStyle.SvgStrokeColor, and it is a lot simpler for users to do so. This is in itself quite a big feature.
The CalloutStyle logic has been rewritten. It is now possible to create the callout outline and to put it around a custom SKPicture. Eventually I think that any style should be immutable, and that changes in the appearance should come from the feature data. This will take some more iterations, probably not before the release of v5.
Sprite logic has been rewritten. You can now specify a region to be sampled from the ImageSource.


Split country codes

In this pr country codes are separated into two files. The original source file is still kept as is.

Im not sure what value it brings having the same content just in upper and lower case?
That to me, feels overkill?

@g0tmi1k What I did was to seperate an already existing file into two variants.
There was an environment where an app only takes lowercase for one field and upper case for another, so splitting them makes life easier during fuzzing.


[DOC] update default model_access_mode for model group

Description
I see that when I create model group without mentioning model_access_mode, it is defaulting to private and not restricted.
Model Group creation:

Model group information:
{
  "took": 1,
  "timed_out": false,
  "_shards": {
    "total": 1,
    "successful": 1,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": {
      "value": 1,
      "relation": "eq"
    },
    "max_score": 1.540445,
    "hits": [
      {
        "_index": ".plugins-ml-model-group",
        "_id": "ARQBmosBbA7S7gCnC1jL",
        "_version": 1,
        "_seq_no": 16,
        "_primary_term": 1,
        "_score": 1.540445,
        "_source": {
          "owner": {
            "backend_roles": [
              "admin"
            ],
            "custom_attribute_names": [],
            "roles": [
              "own_index",
              "all_access"
            ],
            "name": "admin",
            "user_requested_tenant": null
          },
          "created_time":<PHONE_NUMBER>739,
          "access": "private",
          "latest_version": 0,
          "last_updated_time":<PHONE_NUMBER>739,
          "name": "test111",
          "description": "This is a test model group"
        }
      }
    ]
  }
}

Check List

[ ] New functionality includes testing.

[ ] All tests pass

[ ] New functionality has been documented.

[ ] New functionality has javadoc added

[X] Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@rbhavna Could you please review this PR? Thanks.

yes it is expected. The default it private: https://opensearch.org/docs/latest/ml-commons-plugin/model-access-control/#registering-a-private-model-group

yes it is expected. The default it private: https://opensearch.org/docs/latest/ml-commons-plugin/model-access-control/#registering-a-private-model-group

Thanks for confirming. So, we can merge the PR? @dhrubo-os , @rbhavna


Update PWA docs to point at the cra-template-pwa package

The links in the Progressive Web App docs page refer to some files which used to live inside cra-template package but now exist in the cra-template-pacakge in the cra-template/pwa repo. I've updated the template links to point to the new location, as well as some minor edits to account for serviceWorker.js being renamed to serviceWorkerRegistration.js.

This is great. Thanks @slieschke!


Why is there no options for Type Customization as well as HTML custom template for Toast?

I am using this plugin but am facing issues which are as follows:-

I did not find a way in which I can have my own icons for specific events
I wanted to know a way in which this plugin can take an HTML as an input and generate the template for the toast, i.e Custom Toast

I may be misunderstanding your questions, but unless I am, both of these particular issues are already solved and implemented within the library and can be customized to meet your needs.

Yes, you can use your own icons by overriding either the typeClasses or the iconClasses for the toasterConfig, depending on how thoroughly you need to override the templates.  You can then use your own CSS and class definitions for each of the overrides.  You can see an example of this here: http://plnkr.co/edit/gZTxVXD8lN3fibqhDYod?p=preview

Yes, you can provide your own custom HTML by utilizing the BodyOutputType.Component type OR BodyOutputType.TrustedHtml if you only need to override simple layout behavior.  See https://github.com/Stabzs/Angular2-Toaster#body-output-type and http://plnkr.co/edit/Duc4JfIqsa4UnPRFq3pG?p=preview

If this isn't sufficiently clear, please let me know what you're looking for.


multiplayer

whenever i try to go into multiplayer it just says "unable to connect to steam servers", do i need to open steam and then do it or?

BRML is separate from Steam, so you'll need to host your own server. If your friends also have BRML, they'll be able to connect.


⚠ Jenkins Plugins Artifactory has degraded performance

In 6671365, Jenkins Plugins Artifactory (https://get.jenkins.io/plugins/artifactory/) experienced degraded performance:

HTTP code: 200
Response time: 1248 ms

Resolved: Jenkins Plugins Artifactory performance has improved in 8c4928e after 1 hour, 43 minutes.


Extension setting not appearing after installing for the first time

Do I need to add some sort of reload property to the extension?

Unable to reproduce


Add get_data instructions to pipeline running instructions

Adds documentation to support rail_base PR #20

Thanks. Maybe:

Point out that ceci gets installed along with rail_base, so you can do pip install rail_base and that will get you both
Clarify what “point at the root of rail” means.   I think that is just the same as activativectge conda env, but I’m not sure

Word, that makes sense that ceci would be bundled in now. I'll just remove that line in that case
Fair, that could stand to be reworded - the pipeline needs to be run from the rail/ directory, or the relative paths in the pipeline won't work


WriteBatch is not thread safe

From what I can see, WriteBatch is not thread safe. We should change the put method to take a mut ref instead.
https://github.com/facebook/rocksdb/blob/e03377c7fd86f117c6c64d35955140dab400eb3c/db/write_batch.cc#L525-L547

I think the user will rarely use a WriteBatch cross multi-threads, maybe make it with no send, no sync?

It may be a workaround, but certainly not a good design and feels weird.

I think it's pretty common to have multiple writes distributed across threads, that should include WriteBatch, no?

... it's pretty common to have multiple writes distributed across threads ...

That's exact the reason why DB::write is synchronized.

... that should include WriteBatch ...

No. Generally, WriteBatch is created and flushed in the same thread.


How can we pass hybrid_top_k as a parameter to VectorIndexRetriever

Question Validation

[X] I have searched both the documentation and discord for an answer.

Question
I'm developing a hybrid search-based chat engine.To setup the retriever, I am using following configuration:
retriever = index.as_retriever(similarity_top_k=6, sparse_top_k = 12, vector_store_query_mode="hybrid")
I understand that, by default, the retriever returns the number of documents specified by similarity_top_k. However, I need different top_k values for dense retrieval and hybrid retrieval results. While exploring the documentation, I found that VectorStoreQuery has a hybrid_top_k parameter to control the number of documents retrieved post fusion of dense and sparse results. Unfortunately, it seems that VectorIndexRetriever does not directly support this parameter.
Is there an alternative method to configure different top_k values for dense and hybrid retrievals within VectorIndexRetriever? If not, is there a recommended approach to achieve this behavior?

I attempted a workaround by modifying the retriever.py file in the llama-index-core package. Specifically, I adjusted the code to pass the hybrid_top_k parameter to the init and _build_vector_store_query functions. However, I'm unsure if this approach is recommended or if there's a better, more standard way to achieve this.


Python 3.12.1 could not find a version that satisfies the requirement safety (from versions: none)

safety version:3.0.1
Python version:3.12.1
Operating System:Alpine Linux (Docker python:3.12.1-alpine3.19)

Description
Safety fails to install due to the following error:
ERROR: Could not find a version that satisfies the requirement safety (from versions: none)
ERROR: No matching distribution found for safety

What I Did
RUN python3 -m pip install --upgrade pip==23.3.2 wheel safety==3.0.1 setuptools

This was actually a silly issue on my end. If anyone else encounters similar errors like this, check your firewall. We have a local proxy to cache packages, and our firewall was blocking access to this package in our local cache.


autochdir is only available with big builds

Make sure, that autochdir option is only checked, if it is available. For smaller vim builds, this might not be available.
fixes #908

thanks.


Missing services and characteristics on OS X El Capitan

Mac OS X El Capitan
MacbookPro mid 2012
BLE Adaptor: Broadcom 20702A3
I'v been trying to connect to an Ollie by Sphero, but I'm not getting any data for the services and characteristics when running the peripheral-explorer.js tool. This is the output:
peripheral with ID 6d700ca9b9b944348adeb122c19600ca found
  Local Name        = 2B-7683
  TX Power Level    = -10
  Service Data      =
  Service UUIDs     =

services and characteristics:

However, I'm able to get this information when using the Bluetooth explorer from the Hardware IO Tools, as shown here http://i.imgur.com/shdtYCn.png
Running  sudo DEBUG=* node ./node_modules/noble/examples/peripheral-explorer.js 6d700ca9b9b944348adeb122c19600ca outputs the following:
https://gist.github.com/daetherius/6df79ca6c28964740893
Any ideas? Thanks in advance!

@daetherius what happens when if you try the LightBlue app from the Mac App store?
CoreBluetooth or blued might be confused, so you can try:

Killing and restarting blued
Clearing the CoreBluetooth cache: http://stackoverflow.com/a/23573314/2020087

@sandeepmistry Thanks for your response. Actually, I've already tried both solutions you provided before submitting this issue.
LightBlue app seems to retrieve a list of services correctly http://i.imgur.com/TpGzS2M.png

Any news? I'm still having this problem.

Hey - having same issues as referenced in above from @deadprogram

Actually, @daetherius is the one with that problem. Interestingly, I am able to connect from my own recent model Macbook Air.

Still having the issue. Oddly enough my MAC does show that it is connected to what looks like the Ollie but then the script just hangs saying 2016-03-11T13:58:03.171Z : [Robot 1] - Starting device 'ollie'.
http://i.imgur.com/GWNigCS.png

@daetherius @b44p
  yosemite-bindings xpcEvent: {
  "kCBMsgId": 40,
  "kCBMsgArgs": {
    "kCBMsgArgDeviceUUID": {
      "type": "Buffer",
      "data": [
        109,
        112,
        12,
        169,
        185,
        185,
        68,
        52,
        138,
        222,
        177,
        34,
        193,
        150,
        0,
        202
      ]
    },
    "kCBMsgArgResult": 23
  }
} +151ms

This message is blued sending a disconnect event. I would suggest looking the Xcode Hardware IO tools PacketLogger app for any hints. Unfortunately this is out of scope for noble. It could also be caused by the firmware version running on the peripheral.
I'm going to close this for now, unless you have more information to narrow down it to something specifically in noble and not OS X/blued.


cmake: Drop share subdirectory in depends toolchain file

There are no reasons to keep the share subdirectory in the path to the toolchain file generated by the depends build subsystem.
This topic was discussed  during the call on 2024-04-04.
Required for the following build docs update.

Friendly ping @theuni @TheCharlatan @m3dwards @fanquake @vasild @pablomartin4btc :)


Regards GUI

Hi seliverstov,
I tried to run this project , its running fine , can u provide some code of GUI for this project.

Hi,
We do not have any plans for GUI at least until the end of the year.


Specification for interface between Vanilla RPCv2 node and Solana Validator Node

Connectivity Spec

Network latency: 1ms up to worst case 200ms
Network throughput: TBD (should be able to handle geyser updates for block/transaction, account updates, cluster info) plus buffer for bursts from buffer
Reliability: nodes might get disconnected for 200ms without notable interruption of RPC API service

This is the SLA bw geyser/consumers?


Create Webpage

This should be a github page that explains the project and has screenshots and some basic documentation for end users.

The photoshell website should probably have info about rawphoto as well.


Image upside down on mobile

I have a  in my template. On mobile the image is displayed upside down. On dekstop everything is displayed well.
I don't use additional markup inside the tag.

There's a bug report template provided for a reason. How do you expect us to help you with so little information?


Add uniqueRepo webhook validation for each session within the backupconfiguration

Signed-off-by: Anisur Rahman<EMAIL_ADDRESS>

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.Anisur Rahman seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.Anisur Rahman seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.1 out of 2 committers have signed the CLA.:white_check_mark: anisurrahman75:x: Anisur RahmanAnisur Rahman seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


initial sign in issues

Everything goes well until I go to sign into my account for the first time. It doesn't accept my password, and it doesn't re-route me to an error page showing me the authorization code. It simply just returns me to the outlook sign in page with validation errors. I cannot figure out where I went wrong, nor where I would go to correct this. Any friendly nudges in the right direction would be much appreciated! TIA-Sam

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 4c2b9dc3-f219-c8cb-ea4b-bd5aa2f1c3e4
Version Independent ID: e9135d54-69e9-cdc9-732f-d5d9d12e94e5
Content: How to use Outlook REST APIs in an ASP.NET MVC app - Outlook Developer
Content Source: docs/rest/dotnet-tutorial.md
Product: outlook
GitHub Login: @jasonjoh
Microsoft Alias: jasonjoh

It would be good to put breakpoints on the OnAuthenticationFailed and OnAuthorizationCodeReceived functions and see what's happening there.

Yeah, it's not bouncing back to either of those methods in the OWIN Startup.cs. It's simply refreshing the outlook login screen

Ok. You said it refreshes with "validation errors". Can you provide those? Are they displayed on the page?


FancyZones - Support for quick profile Layout template apply from systray icon options or right click on taskbar entry to support quick changes based on use case

While working from home I would like to be able to change my applied monitor profile based on whether I am in "productivity mode" or "meeting mode" etc.  To support this use case I have different  layouts that I apply depending on whether I'm coding / attending a meeting etc.
Currently:

I have to dive into settings -> click Fancy zones -> lauch layout editor -> select monitor -> apply template

Desired Behavior:

Click FancyZones Systray Icon -> Select Montor (1,2 etc.) -> click profiles to apply to the monitor

or

right click fancy zones entry in task bar (assuming its been loaded) and have options available to quick apply a profile without having to go into settings.

#2 solution implies that you are already running fancyzones, so I think #1 would be preffered as it has less friction for entry point given that fancy zones entry will always be in the system tray.
Thanks Team for improving my home work setup !
-Chris

If you'd like to see this feature implemented, add a 👍 reaction to this post.

I also frequently change between "coding" mode (focus) and Teams conference mode.
For me, the best option would be a shortcut to toggle layouts on the active monitor (where cursor is).
The fancy solution would be to have some icons at the top of the screen for my fav layouts - so that while I shift-drag a window to place in zone, I can hover over an icon on the top of the screen to change the active layout while in the drag operation.


Choo v5

A bunch happened here! I hope this isn't too much a pain to review:

I changed choo 4 logic to choo 5 logic
I refactored the dat manager logic out of the repos model. The dat manager shouldn't be coupled to choo in any way, so it helps in multiple respects to have it live in its own file. While doing that I also simplified it a little
I renamed the main-view model to welcome, as it's only responsible for the welcome screen and thus the name is more obvious
I renamed the window model to drag-drop, for the same reasons
I removed lib/param-router as it wasn't used any more
I renamed a bunch of events, to make them more human friendly. Mostly removing namespaces  like error:quit -> quit and making them more human like repos:delete -> delete dat. I would see reasons to undo this though as well.
I removed cases where a model was using the event system to communicate with other parts of the same model, using functions instead
While I was refactoring already, I moved the monkey patching required to run our integration tests to its own lib, to declutter the repos model
I refactored pages/main by splitting out elements into elements/empty and elements/welcome. There's now no more css in this file :)
In the end, all the QA passed, except known issues found and fixed in master after this branch was created

In total this is -90 lines of code, and a huge speed up (thanks to choo 5)! :)
Once the reviews are done, I'll do the non trivial work of rebasing this branch onto master, and update to use all choo-* dependencies from npm.

btw, travis fails because test:integration is still active in this branch, which will be solved after rebasing onto master.


Remove link to archived "Data models" page on ReportStream website

Describe the bug
The ReportStream website archived the Data Models page in Dec 2023 (see #12347). However, we forgot to remove the link to that page on the Security page.
Impact on ReportStream
An external user flagged the broken link when browsing the site looking for data transmission options for Minnesota.
Steps to reproduce
Steps to reproduce the behavior:

Go to 'about/security'
Scroll down to the last accordion 'What data does ReportStream send?'
Click 'standard data schema' hyperlink.
See 'Page not found' 404 message.

Additional context
Consult with @audreykwr assuming the content will be adjusted.

Remove "in our standard data schema" from sentence so it just reads "ReportStream always sends synthetic, non-PII data in our standard data schema during testing."


Mocking real positions and calculating the corresponding return rate

The current portfolio assumes that all assets maintain the same proportions/weights unless changed manually. This is more like the stock indices in the real market.
To mock real positions, i.e., assuming that all assets maintain the same amount unless changed manually, we need to keep each asset's market value up to date and calculate the return rate accordingly.
This function is pending further research.

Should consider:
“cash" in a portfolio


☂ Describe breaks on Number column (and other statistics inconsistencies)

This happens because the Iterable<Number>.std() function accepts Number but doesn't convert them to Double (like mean() does).
There are a couple more missing actually:

[x]  cumSum

Misses Byte, Short
Has DataColumn overloads but not Iterable/Sequence

[ ]  mean

Has Sequence<Double | Float> but not for other Number types

[ ]  median

Misses Float, Byte, Short, Number (it only works on Comparable)
Needs to handle other types consistently
No Sequence overloads
Cannot skipNA (if applicable)

[ ]   min and max

internal Iterable<T>.min and max are not used and can be removed. Stdlib functions for Comparable sequences and iterables are used instead.
Misses Number (it only works on Comparable)
Short and Byte are converted to Int for some reason

[ ]  std

Breaks if type is Number
Short and Byte are cast to Int which works but is a bit iffy
Iterable overloads missing for Number, Short, Byte
Sequence overloads missing
Nullable overloads missing for Iterable (and sequence)

[ ]  varianceAndMean

also provides std(ddof: Int) function without docs of what ddof even means, as well as count. Could have a better name. Also can produce nulls?? this screams for documentation.
variance functions are missing on DataColumns entirely (had to be added separately for Kandy)
Misses Short, Byte, Number, and nullable overloads
Misses Sequence overloads

[ ]  sum

Has TODOs where types are amiss
Misses Float(!), Short, Byte, Number in various Iterable overloads.

[ ] All are also missing BigInteger as we're supporting BigDecimal too.

[ ] There are plenty of public overloads on Iterable and Sequence. It's fine to have them internally, but I feel like we're clogging the public scope here. mean, for instance, is already covered in the stdlib.

[ ] We need to honor some conversion table (see below)

As mentioned here https://github.com/Kotlin/dataframe/issues/543, some functions like median(ints) might result in an unexpectedly rounded Int in return. It might be better to let all functions return Double and then handle BigInteger / BigDecimal separately for now, as they're java-specific for now.

It may be best to first just fix some of the most annoying bugs or obvious oversights, like those relating to describe() or missing types.
Next a revamp may be best. We'll need to hide public functions that are not on DataColumn as @AndreiKingsley will probably make a statistics library for that anyway.
I'd also recommend making and honoring a conversion table. Something like:
mean:
Int -> Double
Short -> Double
Long -> Double
Float -> Double (maybe?)
BigInteger -> BigDecimal
BigDecimal -> BigDecimal
...

sum:
Int -> Int
Short -> Int
Byte -> Int
Float -> Float
BigInteger -> BigInteger
...

min/max:
T -> T
(Don't convert Short/Byte to Int :angry:)

median:
Int -> Double (for even lists)
...

std:
...

TODO


form controls not aligned when using sm size modifier

Since the beta release horizontal forms aren't aligned (labels and inputs) when using sm class.
Bootstrap 4 beta
https://run.plnkr.co/plunks/MfUsegsN0r7kgfvkKKzh/
Bootstrap 4 alpha.6
https://run.plnkr.co/plunks/nSYKZ417hxbeNWSnqRbx/

duplicate of https://github.com/twbs/bootstrap/issues/23447
This PR #23121 should fix issue with .col-form-label


Unable to sign in: Could not get list of tenants

Storage Explorer Version: Version: 1.18.1
Build Number: 20210304.5
Platform/OS:  macOS Big Sur 11.2.3
Architecture: x64
Regression From:  1.17.x
Bug Description
Says I have to reenter my credentials...I do and I have done this for multiple accounts, I login successfully then get
"Unable to sign in: Could not get the list of tenants"
{
"message": ""Could not get the list of tenants""
}
Steps to Reproduce
Try to login to any active azure portal account in storage explorer
Expected Experience
View my storage and generate a SAS
Actual Experience
Cant view any storage in any account
Additional Context
This just started

I have exactly the same problems. Already tried to switch MSAL on, but impossible to log in after upgrading to 1.18.1.

Pretty serious problem as of now I cannot login to any of my customers storage, nor my own!!!!

Something else bigger seems to be wrong on the Azure portal side. I logged into 3 accounts new browser...shows no subscriptions for any of them! some are corporate accounts that obviously have subscriptions, and I am getting welcome and a tour questions on these!?>!?!??!?!?!? WTF

https://downdetector.com/status/windows-azure/
Well here you go! DOWN

It seems to be solved, can login again at three different servers, so must have been the Azure problems.

Sounds like this issue was created during last weeks AAD outage. If any of y'all are continuing to have issues, please either contact support or open a new issue here. Thanks!


Digital Twin: Add Partners quote on home page

Add Partners quote on home page of Digital Twin website.
AI File sent to @Vilnite
See below

For this can we please add a new Testimonials component

[ ] to DT website
[ ] to examplesite

https://tailwindui.com/components/marketing/sections/testimonials

From information provided:

[ ] make partner's logo clickable and linking to a specific partners description page
[ ] make person's image clickable and linking to a specific persons descriptions page


Repo sync for protected CLA branch

The pull request is created from main637842746618800122 to main to fix git push error for protected CLA branch

@SyntaxC4 : Thanks for your contribution! The author(s) have been notified to review your proposed change. @cjgronlund, @mblouin


Upgrade to mod_auth_openidc 2.1.5

We're a couple releases behind now.  2.1.4 and 2.1.5 are primarily bug and security fixes, none of which appear to be related to features we are using, but we should still upgrade sometime soon...no huge rush, though.

mod_auth_openidc is now up to 2.2.0.  We should upgrade to keep in sync.


ember-cli-update to 2.16.2

Result of running ember-cli-update on the project.

@jgwhite @acburdine any idea when we can expect this?


Makefile.local

I have 2 VPS from Vultr NS1 (Master) and NS2 (Slave). How do I fill in the overrides for NS2 in the Makefile.local, do I leave the MASTER and MASTER_HOST blank to designate that NS2 is slave? Is the slave set up with the same exact procedure as the master other than different overrides in Makefile.local. Thanks

It's not clear, but the only change for slave role is MASTER=no while using the same procedure.
MASTER =      no
MASTER_HOST = ns1


Allowing null buffers

Hello! =)
In the spec for the C Data Interface there are allowable scenarios in Arrow-C++ where null buffers get created:

for the null bitmap buffer, if ArrowArray.null_count is 0;
for any buffer, if the size in bytes of the corresponding buffer would be 0.

The latter case has been bumped into by a couple of people independently:
While writing a numerically typed empty table to a Feather file v1 with memory map on:
import polars as pl
import pyarrow as pa

t = pa.table([pa.array([], type=pa.uint64())], names=['a'])

pa.feather.write_feather(t, 'out.ipc', version=1)

tbl = pa.feather.read_table('out.ipc', memory_map=True)
tbl['a'].chunks[0].buffers()
[None, <pyarrow.Buffer address=0x0 size=0 is_cpu=True is_mutable=False>]  <-- Note the 0x0 address

Writing and reading a table through IPC:
import pyarrow as pa

def pass_table_through_ipc_and_back(tbl: pa.Table) -> pa.Table:
    sink = pa.BufferOutputStream()

    with pa.ipc.new_file(sink, tbl.schema) as writer:
        writer.write_table(tbl)

    buf = sink.getvalue()

    with pa.ipc.open_file(buf) as reader:
        tbl_out = reader.read_all()

    return tbl_out

tbl = pa.Table.from_pylist([{'a':[]}], schema=pa.schema([pa.field('a', pa.large_list(pa.int64()))]))
tbl_out = pass_table_through_ipc_and_back(tbl)

print(tbl['a'].chunks[0].buffers())
#  [
#    None,
#    <pyarrow.Buffer address=0x54868020080 size=16 is_cpu=True is_mutable=True>,
#    None,
#    <pyarrow.Buffer address=0x1040cd100 size=0 is_cpu=True is_mutable=True>
#  ]
print(tbl_out['a'].chunks[0].buffers())
#  [
#    None,
#    <pyarrow.Buffer address=0x54868050178 size=16 is_cpu=True is_mutable=False>,
#    None,
#    <pyarrow.Buffer address=0x0 size=0 is_cpu=True is_mutable=False>  <---- Note the 0x0 address
#  ]

If using polars, which uses arrow2, you get an OutOfSpec, thrown here.
From my perspective, considering that null buffers are allowed in Arrow-C++, I would propose removing the requirement in arrow2. My argument is that it is too strict of a requirement. You bump into situations like this where folks need to find workarounds for writing and reading empty tables when using software that has arrow2 as a dependency.
Why did the requirement get added? Is there an important purpose requiring non-null buffers serves (i.e. would something non-ideal happen further down the line)? Is it possible to remove it?

Hi @anjakefala. It can be that we are too strict here. I have to take a better look later to see what we must/can do in such a case.

Thanks so much for looking into it @ritchie46!

#1528 allows null buffers. Though in the example above it is not yet very useful as we don't support feather v1.

Hi @ritchie46!
I just did a local installation of polars using https://github.com/jorgecarleitao/arrow2/commit/92050ec64877fe1348116e0f5dc6e06b949c0519 as the arrow2 revision, and that indeed resolved this issue for me. =) I appreciate it!
Do you happen to have any timelines for when this fix will formally appear in polars?

I just saw that the main branch of polars has had its arrow2 dependency updated. :blush: Thank you!


Why I can not install this plugin?

Hope this issue get solved. I made some modifications to Obsidian Official in order to update my repository status, which may have caused some malfunctions.


[Bug] seems a dead loop after loading gemm_config.in

Checklist

[X] 1. I have searched related issues but cannot get the expected help.
[x] 2. The bug has not been fixed in the latest version.

Describe the bug
I install lmdeploy using pip.
After run this command on V100 using vicuna-13B-v1.5
python profile_generation.py workspace --input_seqlen 512 --output_seqlen 192 --test_round 1
before tuning, it runs ok. After tuning, it seems to goto a dead loop with the cpu usage 100%.

After I replace the library using the lib I compiled by myself, the problem is solved.
lmdeploy/lmdeploy/build# cp lib/_turbomind.cpython-38-x86_64-linux-gnu.so /opt/conda/lib/python3.8/site-packages/lmdeploy/lib/_turbomind.cpython-38-x86_64-linux-gnu.so

Reproduction
python profile_generation.py workspace --input_seqlen 512 --output_seqlen 192 --test_round 1
Error traceback
![image](https://github.com/InternLM/lmdeploy/assets/26128514/8b38c1b8-964e-4e6a-8b81-3c2c9502dae4)

After I replace the library using the lib I compiled by myself, the problem is solved.
Is there anything different in the lib you compiled?

I'm not quite clear, maybe I just add the -DSM=70, maybe nothing.
It's werid.

Can you reproduce the error again?

Yes. It can be reproduced by installing lmdploy via pip. You run it ok on your machine?

Of course. I did not do tuning.

I paste my gemm_config.in？ You can try put it in your workding directory.
batch_size, seq_len, head_num, size_per_head dataType ### batchCount, n, m, k, algoId, customOption, tile, numSplitsK, swizzle, reductionScheme, workspaceSize, stages, exec_time
1 1 40 128 1 ### 1 15360 1 5120 113 -1 -1 -1 -1 -1 -1 -1 0.202213
1 1 40 128 1 ### 1 5120 1 5120 110 -1 -1 -1 -1 -1 -1 -1 0.079022
1 1 40 128 1 ### 1 13824 1 5120 113 -1 -1 -1 -1 -1 -1 -1 0.188743
1 1 40 128 1 ### 1 5120 1 13824 110 -1 -1 -1 -1 -1 -1 -1 0.189207
1 1 40 128 1 ### 1 7680 1 5120 110 -1 -1 -1 -1 -1 -1 -1 0.114368
1 1 40 128 1 ### 1 5120 1 2560 21 0 11 1 0 0 0 14 0.046746
1 1 40 128 1 ### 1 6912 1 5120 108 -1 -1 -1 -1 -1 -1 -1 0.103753
1 1 40 128 1 ### 1 5120 1 6912 110 -1 -1 -1 -1 -1 -1 -1 0.102635

Where was the file put? In my comprehension, the vicuna weights were changed after tuning. Right?

I need to clarify that: tuning here doesn't mean finetune with the model. It mean tune the cublas gemm algorithms.

I used vicuna-7b-v1.3 since I did not get vicuna-13B-v1.5. lmdeploy/turbomind/chat.py works fine for me. Did you try other models?

Reproduced the error. Seems the prebuilt package lib can not handle the gemm_config.in you provided.
@irexyc Could you have a look?

@sleepwalker2017
What is your cuda version when you build lmdeploy?
The prebuild package are build with cuda 11.8. There are some difference when parse the data https://github.com/InternLM/lmdeploy/blob/main/src/turbomind/utils/cublasAlgoMap.cc#L60-L66

My cuda version is 11.7.  when the llama_gemm and the package lib are compiled in the same environment, the problem is solved， is that right?

Sounds reasonable.


Add ml-commons to 1.3.9 manifest

Description
Add ml-commons to 1.3.9 manifest
Issues Resolved
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Codecov Report

Merging #3284 (dc84816) into main (3929350) will decrease coverage by 0.29%.
The diff coverage is n/a.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
@@            Coverage Diff             @@
##             main    #3284      +/-   ##
==========================================
- Coverage   91.74%   91.46%   -0.29%
==========================================
  Files         172      172
  Lines        4991     4991
==========================================
- Hits         4579     4565      -14
- Misses        412      426      +14

Impacted Files
Coverage Δ

src/system/temporary_directory.py
64.44% <0.00%> (-28.89%)
:arrow_down:

src/system/os.py
94.73% <0.00%> (-5.27%)
:arrow_down:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


Make octicon cache key construction more performant

We currently use an intermediate array and string to construct the key for the octicon cache. I tried using Hash#hash instead and got almost a 2.5x speedup and a ~16% memory reduction 😄  I saw a nearly 3x speedup without the call to correct_key_args?, but it's nice to have that arg safety.
There are two other improvements in here too: 1) passing system arguments one at a time, and compacting/uniquing in-line. These combined with the hashing trick result in a cumulative 24% memory reduction.

Sure! Here are the results of the speedup via benchmark-ips:
Warming up --------------------------------------
         get_key_old    62.735k i/100ms
             get_key   144.985k i/100ms
Calculating -------------------------------------
         get_key_old    601.260k (± 5.7%) i/s -      3.011M in   5.025841s
             get_key      1.438M (± 5.0%) i/s -      7.249M in   5.055706s

Comparison:
             get_key:  1437699.7 i/s
         get_key_old:   601259.7 i/s - 2.39x  (± 0.00) slower

I used allocation_stats to measure memory usage. Total allocated memory for 10 Primer::OcticonComponent.new(icon: :alert)s went from 15440 bytes to 11680 bytes. Here's the script I used:
stats = AllocationStats.new(burn: 3).trace do
  10.times do
    Primer::OcticonComponent.new(icon: :alert)
  end
end

table = stats
  .allocations(alias_paths: true)
  .group_by(:sourcefile, :sourceline, :class)
  .to_text

puts table

total_bytes = stats.allocations.all.inject(0) do |memo, stat|
  memo + stat.memsize
end

puts "Total: #{total_bytes} bytes"

Thanks @manuelpuyol :)


Loading Models that require execution of third party code (trust_remote_code=True)

I am trying to load MPT using the AsyncLLMEngine:

engine_args = AsyncEngineArgs("mosaicml/mpt-7b-chat", engine_use_ray=True)
engine = AsyncLLMEngine.from_engine_args(engine_args)

But I am getting this error:
ValueError: Loading mosaicml/mpt-7b-chat-local requires you to execute the configuration file in that repo on your local machine. Make sure you have read the code there to avoid malicious use, then set the option trust_remote_code=True to remove this error.
Is there any workaround for this or could it be possible to add the option to trust remote code to EngineArgs?

Hi @nearmax-p, could you install vLLM from source? Then this error should disappear. Sorry for the inconvenience. We will release the next version very soon.

I see, thank you very much, this worked! One more issue I came across is that MPT-30B doesn't seem to load on 2 A100 GPUs.
I used the following command:
engine_args = AsyncEngineArgs("mosaicml/mpt-30b-chat", engine_use_ray=True, tensor_parallel_size=2)
engine = AsyncLLMEngine.from_engine_args(engine_args)

And got the following response:
```llm_engine.py:60] Initializing an LLM engine with config: model='mosaicml/mpt-30b-chat', tokenizer='mosaicml/mpt-30b-chat', tokenizer_mode=auto, dtype=torch.bfloat16, use_dummy_weights=False, download_dir=None, use_np_weights=False, tensor_parallel_size=2, seed=0)````
But the model is never loaded properly and can be called (I waited for 20+ minutes and the model was already downloaded from the huggingface hub on my device). Have you encountered this before?

@nearmax-p thanks for reporting it. Could you share how large your CPU memory is? It seems such a bug occurs when the CPU memory is not enough. We haven't succeeded reproducing the bug, so your information would be very helpful.

@WoosukKwon Sure! I am using an a2-highgpu-2g instance from gcp, so I have 170GB of CPU RAM. This actually seems like a lot to me

@nearmax-p Then it's very weird. We've tested the model on the exactly same setup. Which type of disk are you using? And if possible, could you re-install vLLM and try again?

@WoosukKwon Interesting. I am using a 500GB balanced persistent disk, but I doubt that this makes a difference. I will try to reinstall and let you know what happens. Thanks for the quick responses, really appreciate it!

@nearmax-p Thanks! That would be very helpful.

following up on the discussion. I incurred in the same problem trying to load xgen-7b-8k-inst (I am not sure it is supported but being based on llama I think it should)
I have installed vllm from source, as suggested, but when I run:
llm = LLM(model="xgen-7b-8k-inst")
I get:
  File "/opt/conda/envs/pytorch/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py", line 669, in from_pretrained
    raise ValueError(
ValueError: Loading /home/ec2-user/data/xgen-7b-8k-inst requires you to execute the tokenizer file in that repo on your local machine. Make sure you have read the code there to avoid malicious use, then set the option `trust_remote_code=True` to remove this error.

where should I set trust_remote_code=True?
Any feedback would be very welcome :)

@WoosukKwon I tested my code after reinstalling vllm (0.1.2), unfortunately, nothing has changed. Maybe I should have mentioned that I am working from an nvidia pytorch Docker image. However, all other models run just fine.

@WoosukKwon now checking it outside of the container, will get back to you

@nearmax-p If you are using docker, could you try increasing the shared memory size (e.g., to 64G?)?
docker run --gpus all -it --rm --shm-size=64g nvcr.io/nvidia/pytorch:22.12-py3

@WoosukKwon alright, it doesn't seem to be related to RAM, but to distributed serving. Outside of the container, I am facing the same problem, even with mpt-7b, when I use tensor_parallel_size=2. With tensor_parallel_size=1, it works.
I've used the default packages that were installed after installing vllm, I've only uninstalled pydantic, but I'd assume that that doesn't cause any issues

@WoosukKwon Narrowed it down a bit. It is actually only a problem when using the AsyncLLMEngine.
from vllm.engine.arg_utils import AsyncEngineArgs
from vllm.engine.async_llm_engine import AsyncLLMEngine
from vllm.sampling_params import SamplingParams
from vllm.utils import random_uuid
import asyncio

engine_args = AsyncEngineArgs(model="openlm-research/open_llama_7b", engine_use_ray=True)
engine = AsyncLLMEngine.from_engine_args(engine_args)

sampling_params = SamplingParams(max_tokens=200, top_p=0.8)
request_id = random_uuid()
results_generator = engine.generate("Hello, my name is Max and I am the founder of", sampling_params, request_id)

async def stream_results():
    async for request_output in results_generator:
        text_outputs = [output.text for output in request_output.outputs]
        yield text_outputs

async def get_result():
    async for s in stream_results():
        print(s)

asyncio.run(get_result())

This script causes the issue. When writing an analogous script with the normal (non-async) LLMEngine, the issue didn't come up.

Hi @nearmax-p , we faced a similar issue - As a quick fix, setting engine_use_ray to False worked for us


Default value of Angular Material's md-select is not translated

When using the <md-select> directive from Angular Material, the translations appear correctly translated in the list once you click on the dropdown widget. However, the first value that is selected by default (in my case, from a data-binding) is not correctly translated until the md-select is clicked upon, at which point it becomes updated.

@doppio  Please provide a running demo/sample.

friendly reminder: @doppio any update on this?

Closed due inactivity.

I did some testing, maybe the next googler will save some time with this info.
Doesn't work (the label is not translated):
My label
<translate>My label</translate>
{{ 'My label' | translate }}

Works but is deprecated and doesn't look as nice:
<md-select-label>{{ 'My label' | translate }}</md-select-label>

Works and looks nice but is without a label element:
<md-input-container>
  <md-select ng-model="selectedState" placeholder="{{ 'My label' | translate }}">

Plunker: https://embed.plnkr.co/aRD0aTljBc7846suJNGC/

Check out this issue in Angular Material's queue: https://github.com/angular/material/issues/8781
i solved this problem with a little hint from DevVersion over there.


shading not working when building sbt 1.0 plugins

in ensime we see this
[info] Shading 7 JAR(s):
[info]   /home/fommil/.coursier/cache/v1/https/repo1.maven.org/maven2/io/get-coursier/coursier-cache_2.12/1.0.0-RC12/coursier-cache_2.12-1.0.0-RC12.jar
[info]   /home/fommil/.coursier/cache/v1/https/repo1.maven.org/maven2/io/get-coursier/coursier_2.12/1.0.0-RC12/coursier_2.12-1.0.0-RC12.jar
[info]   /home/fommil/.coursier/cache/v1/https/repo1.maven.org/maven2/org/scala-lang/modules/scala-xml_2.12/1.0.6/scala-xml_2.12-1.0.6.jar
[info]   /home/fommil/.coursier/cache/v1/https/repo1.maven.org/maven2/org/scala-lang/scala-library/2.12.3/scala-library-2.12.3.jar
[info]   /home/fommil/.coursier/cache/v1/https/repo1.maven.org/maven2/org/scalaz/scalaz-concurrent_2.12/7.2.13/scalaz-concurrent_2.12-7.2.13.jar
[info]   /home/fommil/.coursier/cache/v1/https/repo1.maven.org/maven2/org/scalaz/scalaz-core_2.12/7.2.13/scalaz-core_2.12-7.2.13.jar
[info]   /home/fommil/.coursier/cache/v1/https/repo1.maven.org/maven2/org/scalaz/scalaz-effect_2.12/7.2.13/scalaz-effect_2.12-7.2.13.jar
[info] :: delivering :: org.ensime#sbt-ensime;1.12.16-SNAPSHOT :: 1.12.16-SNAPSHOT :: integration :: Sun Sep 24 16:44:33 BST 2017
[info] 	delivering ivy file to /tmp/fommil-sbt/home/fommil/Projects/ensime-sbt/target/ivy-1.12.16-SNAPSHOT.xml
[info] Main Scala API documentation to /tmp/fommil-sbt/home/fommil/Projects/ensime-sbt/target/api...
[info] Compiling 6 Scala sources to /tmp/fommil-sbt/home/fommil/Projects/ensime-sbt/target/scala-2.12/sbt-1.0/classes...
[info] Found 6817 class(es) in JAR(s) to be shaded
[info] 778 classes already filtered out by shaded namespace coursier
[info] 3298 classes already filtered out by shaded namespace scalaz
[info] 2741 remaining class(es) to be shaded
model contains 22 documentable templates
[info] Main Scala API documentation successful.
[info] Packaging /tmp/fommil-sbt/home/fommil/Projects/ensime-sbt/target/sbt-ensime-1.12.16-SNAPSHOT-javadoc.jar ...
[info] Done packaging.
[info] Packaging /tmp/fommil-sbt/home/fommil/Projects/ensime-sbt/target/scala-2.12/sbt-1.0/sbt-ensime-1.12.16-SNAPSHOT.jarg ...
[info] Done packaging.

and it just hangs forever here with the CPU spinning....

Best ticket number. Ever.

Quickly looked at it. The 2741 remaining class(es) to be shaded is suspicious here. It means things outside the coursier and scalaz namespaces (from the shadedNamespaces setting) is getting shaded too. In the output, it says the JAR of scala-library and scala-xml are about to be shaded. For whatever reason, these are only pulled by the dependency on coursier, so are shaded too.
That can be prevented by explicitly depending on them, with
libraryDependencies ++= Seq(
  "org.scala-lang" % "scala-library" % scalaVersion.value,
  "org.scala-lang.modules" %% "scala-xml" % "1.0.6"
)

That solves the problem for me.

that's probably paradise... but nothing is appearing in the jar file except my files. Nothing from coursier or scalaz.

to reproduce, take these https://github.com/ensime/ensime-sbt/blob/50176bc969cc102dad93eebd8a986a7857ebb6f8/build.sbt#L9-L31
and put them into the build.sbt in the 2.0 or 3.0 branch (currently both the same)

The lines above fix the problem. I started from https://github.com/ensime/ensime-sbt/pull/360/commits/dd40ab0066a30b2279595d112ae05af123a14847, re-enabled shading, ran into the problem, and fixed it with those lines.

Also, the sbtLauncher := … isn't necessary anymore with sbt-coursier 1.0.0-RC12.

awesome, I'll look into this and hopefully release 2.0.1 before announcing

good stuff, that seems to have fixed it!