Investigate possible issue with text alignment for deuterocanonical books and unusual versifications

See here for more information: https://github.com/sillsdev/serval/pull/471 (and here - https://github.com/sillsdev/serval/issues/442#issuecomment-2316192212)
Let's add some tests to verify that we are handling ALL of the deuterocanonical books properly (same amount of testing as for the standard English versification books.

The issue identified was that the mapping between DAN and SUS was incorrect because of a bug in the preprocess code. To really verify that all books work, there are a few main points where this could mess up:
* In the versification files themselves (there could be a VRS error - how do we handle it?)

I'd be curious for Damien's thoughts, but I wouldn't worry to much about incorrect .vrs files. As the saying goes, 'garbage in garbage out'. I don't think we can take responsibility for this, and undefined behavior is appropriate behavior when bad data is provided. This is something that's skirting the edge of the purview of Serval/Machine. If we do anything at all about this, I'd suggest just a quick validation of the .vrs file (if that's possible) and throw a meaningful error if it's just plain invalid. We simply can't account for all the possible bad .vrs files out there, and furthermore, I'm not sure how often this is an issue: Seems like Paratext should have an automatic check for this or something (?).

* In the ParallelCorpus algorithm mapping versifications

* In the preprocess script (as there was here)

What exactly was the bug?

* In the USFM update script when the new USFM files are created.

This should be less of an issue, right, since we're not doing aligning here so much as just (potentially) changing versification? Where are you imagining an error like this would creep in?

Where should we make tests for this?
* First, ensure that there are unit tests for preprocess and USFM update to specifically verify that the target references are used, not the source references.  These test may already exist.

Yes, we should do this - at least for preprocessing. I'm not sure a test exists that specifically covers this.

Then, use ParallelCorpus level testing to verify the following:
* Note: Versification mappings are already tested in SIL.Scripture: https://github.com/sillsdev/libpalaso/blob/master/SIL.Scripture/Versification.cs

* We want to make sure we are testing improper versification mappings or mismatched between the VRS files and the SFM files including:

  * Verses in SFM but not in vrs
  * Verse in vrs, but not in SFM
  * Double mapping?  Two different verses map to the same location?  What do we do?  Do we throw an error, use the first one or combine the verses (i.e., Daniel 13 and BEL are both defined)

Like I said above, I don't know if these are things we really can/should test.

* Mapping between books works

* Mapping between chapters works

* Mapping where both the source and target have odd (non-original) versification (i.e. Target has DAN, Orig has BEL, Source has SUS (can this even happen?) - make sure it makes the trip successfully through).

I think these are all in scope, and hopefully, Mudi has covered some of these in his tests so far (?).

* I don't see the immediate value in testing all versifications or all deuterocanonical books - just in testing the edge cases.  I am assuming that SIL.Scripture does full testing of these books.

Yep, I agree.


xwm: attempt to load libxcb-image.so.0 first

It makes more sense than the .so file: it's a known SONAME that ought to
contain the ABI we're looking for and .so file is not going to be present for
installations without development packages.

Uh, oh, this is done in more places too. Not good for Linux distribution packaging at all.
Let's try another approach, pull request #46

I'll close this then.


fix: update to see-lingua v0.6.3

fix: update to see-lingua v0.6.3

:tada: This PR is included in version 12.16.2 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release
v12.16.2

Your semantic-release bot :package::rocket:


[WFLY-14993] Upgrade WildFly HTTP Client to 1.1.8.Final

Jira: https://issues.redhat.com/browse/WFLY-14993
    Release Notes - WildFly EJB HTTP Client - Version 1.1.8.Final

        Bug

[WEJBHTTP-59] -         EJB over HTTP getting java.lang.ClassNotFoundException to Unchecked Exception

        Task

[WEJBHTTP-60] -         Update project with a dependency on wildfly-elytron to use individual modules

        Component Upgrade

[WEJBHTTP-61] -         Upgrade wildfly-transaction-client from 1.1.11.Final to 1.1.14.Final

[WEJBHTTP-62] -         Upgrade XNIO to 3.8.4.Final

@fl4via I queued up https://ci.wildfly.org/viewQueued.html?itemId=263624 to re-run the failed Linux - JDK 8 job.

The CI comment on this shows tons of failed jobs but https://ci.wildfly.org/project.html?projectId=WF_PullRequest&branch_WF_PullRequest=pull%2F14470 shows this sha passing on all jobs so I'm going to treat the CI comment as noise due to the recent CI disruption.


Add bailout case to sourcemap searching code

Fixes #25209
The test I added (a namespace with 580k blank lines inside it) drops from 21s to 1s with this change, so I think this aughta solve the problem.
cc @rbuckton who's more familiar with the performance aspects of v8's implementation, since optimizing this, even though it's only run once per file (per edit, potentially, since files are discarded on edit), is probably a good idea. It's be nice if you could remark on this style of matching - I don't think string slicing is worse than the gm regex we were using before, but I'm unsure, personally (I think it's better with the bail case we have now?).

I'm questioning the value of checking in the massive test file. It's not more likely to fail than a small test file. If performance regresses, it'll just take longer to pass. Which is not a test failure anyone's likely to notice.
Other than that -- I've confirmed these changes fix #25209 and they look fine to me.

Which is not a situation that anyone's likely to notice.

20s longer of tests usually get noticed. Usually. At least they have in the past, since the test duration metrics are recorded locally, and that duration is amplified when testing on less powerful machines. (And if anything the git history will be useful if it regresses and someone notices only by how their tests have started to take significantly longer) Unfortunately, I don't think I can actually make it large enough to crash or otherwise error (without crashing both before/after for other reasons anyway, like the file being way too large to fit in memory), and we don't have any test logic for fail-on-too-slow (which is always hard to set a bar for when test are running on multiple machines with different performance profiles). There is a test timeout of 40s... I could try to make it large enough to trigger the timeout in a pre-fixed situation? It probably just means doubling the length of the file to 1m lines.

Usually performance tests are separate from functional tests, because of the reasons you pointed out. These two kinds of tests have fundamentally different definitions of pass and fail.
I'm not too familiar with how we structure tests in this repo. If there's precedence for this, and you believe it adds value, then OK by me.
Thanks for the fix!


Game of Thrones Quotes

Please resolve the spacing issues and convert wordlist name to lowercase just so it's matching overall site text.

@salmannotkhan please check the PR for the changes which you have suggested, I have if there are any more you can suggest thank you.

Please rename the wordlist file also

renamed the files


Cannot read property 'match' of undefined

Hi! Awesome to see this project!
I keep getting these errors for path of '/'
path-parser.js:282 Uncaught TypeError: Cannot read property 'match' of undefined
    at Path../node_modules/path-parser/dist/es/path-parser.js.Path.urlTest (path-parser.js:282)
    at Path../node_modules/path-parser/dist/es/path-parser.js.Path.test (path-parser.js:170)
    at _loop_1 (route-node.js:131)
    at matchChildren (route-node.js:192)
    at RouteNode../node_modules/route-node/dist/es/route-node.js.RouteNode.getSegmentsMatchingPath (route-node.js:474)
    at RouteNode../node_modules/route-node/dist/es/route-node.js.RouteNode.matchPath (route-node.js:372)
    at Object.matchPath (utils.js:133)
    at Component.onMount (component.js:29)
    at emitLifecycleEvent (util-browser.js:46)
    at Component.___emitLifecycleEvent (Component.js:481)

It seems to be due to options.initialRoute being undefined after a few iterations:

Hm, just setting initialRoute to the same as defaultRoute I'm fine:
router routes=routes  options={ defaultRoute: 'home', initialRoute: 'home' }

Ok, I can close this too I guess since I now understand what initialRoute is :)


gradewindow connected to database

gradewindow connected to database
session variables used

-insert to coursetable redirection done
-print, edit, insert - first session then course checked
-edit, print - cutoff and total students according to the grades


Option to show scene bounding box

And also calculate a loose-fitting bounding box for the depth point clouds:

Checklist

[x] I have read and agree to Contributor Guide and the Code of Conduct
[x] I've included a screenshot or gif (if applicable)

very nice feature for debugging our boxes for us and great feature for finding outliers for everyone else \o/


fix: remove LocaleCode enum

This enum often causes tree shaking issues as it’s an Enum Value and it’s only used as a type. Changing in favour of inference based typescript types and an string literal.
Disabled useless auditjs check
BREAKING CHANGES:
LocaleCode enum -> LocaleCode string literal
locales.en -> locales.english
orderedLocales -> orderedLocaleCodes

📦 Published PR as canary version: 2.0.0--canary.7.99e624cb6936f29a3f2d413ca47480a589d4d7bb.0

:sparkles: Test out this PR locally via:
npm install<EMAIL_ADDRESS># or
yarn add<EMAIL_ADDRESS>

:rocket: PR was released in v2.0.0 :rocket:


debug convert paths utilities  make the debug adapter to exit

This scenario is happening when interaction between live share and the new tracking debug adapter API.
When live share start sharing we flow all of the events back into our host adapter process that will interact with our agent. One particular case is the stopped event where our live share host treat it in a special way by requesting more info into the 'real' debug adapter (threads/scopes/variables..etc..) before notifying our joined sessions. When stepping really fast in a node js app it happen that request were made into the adapter when the state is running and so sometimes the scope request will fail.
The problem being reported is in the following vscode source file:
src\vs\workbench\parts\debug\common\debugUtils.ts
function convertPaths(msg: DebugProtocol.ProtocolMessage, fixSourcePaths: (toDA: boolean, source: DebugProtocol.Source | undefined) => void): void {
....
case 'response':
const response = <DebugProtocol.Response>msg;
if (response.success) { <==== without this line the debug adapter exit
switch (response.command) {
Note:
Processing a response and some expected contents will fail for other scenarios too.
The ask is to add this extra line check, that immediately fix our live share issue we were seeing when quickly stepping.

@rodrigovaras great catch, thx!


Province mapping ck3 = 8782 is invalid. We cannot find related county.

Province mapping ck3 = 8782 is invalid. We cannot find related county.
I have used conertor-mod after playing Imperator Rome

configuration.txt
log.txt
Log and configuration is here

[code]

Compatible with CK3 1.3 and EU4 1.31
...
2021-05-31 16:05:32     [INFO] <> Savegame version: 1.1.3
[/code]
PEBKAC


Implements run and states for x86 MacOS

Not sure what's up with the Windows build

It seems that we can't access the EFER register, but I assume the features we are interested in are already turned on?.

Not sure what to do about set_cs :(

I assume we're interested in ARM Linux and ARM Windows as well?

Seems like the Hypervisor Framework on macOS is the worst. A lot of restrictions.

I assume we're interested in ARM Linux and ARM Windows as well?

If someone wiling to work on this.

BTW I'm surprised that WHP has a very good API.

BTW I'm surprised that WHP has a very good API.

Microsoft takes pride in Hyper-V, so... Makes sense.

I think the segment registers can be set and read with this:
https://developer.apple.com/documentation/hypervisor/1441144-hv_vmx_vcpu_write_vmcs?language=objc
Here is a list of field ids. The segment registers do appear more than once. For example, for cs there's, VMCS_GUEST_CS, VMCS_HOST_CS, VMCS_GUEST_CS_LIMIT and VMCS_GUEST_CS_AR
https://developer.apple.com/documentation/hypervisor/1469436-virtual_machine_control_structur?language=objc

Should be VMCS_GUEST_CS. Not sure what the purpose of the other ones.

I guess the contents are the same as .Segment.Anonymous.Attributes on Windows? :eyes:

I guess the contents are the same as .Segment.Anonymous.Attributes on Windows? 👀

This really implementation specific. Maybe finding some example on the internet should be easier if the docs does not help?

Just found a very good example: https://github.com/utshina/AHF-simple

A good example indeed. I managed to implemente exit_reason for x86 mac because of it

By the way the vm stuff seems to work correctly for now on my Linux machine.

No.

Oh, Where does it stop for you?

It is never stop because of hlt. In other words, it work as expected. Did you try on the latest main of from your branch?

Both, In main, I panic here
https://github.com/obhq/obliteration/blob/573eca32403983bd2b4c6cafda9ed9630a3362b5/src/core/src/vmm/mod.rs#L615-L617
In my branch, i the same things happens in a different place, but it is equivalent.

The problem may be caused by a different Linux version or different CPU. What is your Linux version and CPU model? I was tested this with Arch on Ryzen 5600G.

EndeavourOS (Which is Arch-based), kernel version 6.9.7, cpu 11th Gen Intel(R) Core(TM) i5-11400H @ 2.70GHz

I suspect this #905 or https://github.com/firecracker-microvm/firecracker/issues/668 if your Linux running inside a VM.

I completely forgot that the issue applies to me :joy:  That might very well be it.

No nested VMs for me though.

It doesn't seem to be it

Strange. At least on Windows with Ryzen it is working according to https://github.com/obhq/obliteration/pull/916#issue-2443300798

Can we ask another people who are using Linux with AMD to test this? If it is working I'm pretty sure it is because of #905.

What address should I set fr the TSS?

I don't know but any virtual address need to be mapped to physical address via page table otherwise the CPU will trigger page fault, which we currently does not setup a handler to handle it.

But the TSS that we have to set is a physical address, no?

I don't know. You should take a look on Intel manual. But AFAIK the only place that need to be a physical address is page tables and cr3.

It seems that I can get some information about the exit

BTW you should not make this PR contain too many things.

The exception is 0x80000021, the error code is 0.

We are not alone: https://forum.proxmox.com/threads/vm-shutdown-kvm-entry-failed-hardware-error-0x80000021.109410/

In our case I suspect TSS because 0x80000021 mean invalid guest state.


Fix segfault exposed by Ruby

Fixes #1622

Green

Umm, we probably shouldn't merge a "core" file, right?


WebDAV COPY, MOVE and LOCK commands should be added

COPY, MOVE, LOCK, UNLOCK, PROPWATCH, and MKCOL are part of the WebDAV protocol and can also be used for REST APIs. The commands should therefore be added.
There are even more WebDAV methods. Instead of adding them, it might be useful to let the user type in a method that is not available.

it might be useful to let the user type in a method that is not available.

Let me check this possibility. It will also make the tool extensible.

Can now be done using custom methods.


very slow load times in middle east

i'm currently in the middle east and load times are extremely slow. i checked with some tools and received similar results.
riyadh: 5s -- https://app.site24x7.com/tools/public/5qfyebzzNI2JhFgI1io/Y5urM/COMBkVESO9o85yhpakgVnuqawUZdywtFoIZH3aD6LHMxkscHc=.html

tel aviv: 2s -- https://www.dotcom-tools.com/website-speed-test?type=summary-report&id=fb6926b700ad4716a2d6005154f35953

I'm seeing load times of up to a minute.
time curl 'https://cdnjs.cloudflare.com/polyfill/v3/polyfill.js?features=globalThis&flags=always' > /dev/null

real	1m16.356s
user	0m0.018s
sys	0m0.015s

it seems like the problem is my internet provider. any request to cdnjs.cloudflare.com takes extremely long.


Segmented algorithms module

Same deal as #3957 (also depends on it), but for segmented algorithms.

The following file should be added to this module:
#include <hpx/traits/segmented_iterator_traits.hpp>

The following file should be added to this module:
#include <hpx/traits/segmented_iterator_traits.hpp>

Thanks, good catch! I'll update this first thing on Monday.


DECSCUSR 0 should reset to the user-defined cursorStyle

VS Code Version: 1.88.1
OS: Linux
Steps to Reproduce:

Add "terminal.integrated.cursorStyle": "line" to your settings.json
Run these commands in the integrated terminal:

printf "\033[4 q" # set cursor style to an underscore
printf "\033[0 q" # this should restore the cursor to the user-defined preference
printf "\033[ q"  # (this has the same effect as "0")
# ...but instead we end up with a "block" cursor

Relevant code: https://github.com/xtermjs/xterm.js/blob/2edc65baaa50f8b99c67f3df6f8d5d93c70a69e6/src/common/InputHandler.ts#L2732-L2738
Many popular terminals implement this behavior (e.g kitty, alacritty, Windows Terminal, ...)
More info on the topic: https://github.com/microsoft/terminal/pull/7379
xterm issue: https://github.com/xtermjs/xterm.js/issues/3293

hello. @Tyriar   I am sossost, a new contributor. I would like to solve this problem. Is it possible??

Hey folks, I'm new to the codebase and wanted to start contributing, I took a quick look at the issue and seems like the fix is on the xterm side, is it ok if I work on this issue?

Hey folks, if the issue still open i would like to work this .

Hey folks, I am new to opensource.  Can i give it a try?

Hello, can i work on this.

If you'd like to work on this the fix will be in xterm.js: https://github.com/xtermjs/xterm.js/issues/3293

thanks. Will work on this.

Hi @Tyriar is anyone working on issue, if no I could work on this!
Or maybe anything similar, I am new to this repo and would be nice to get started, thanks in advance!

@Arup-Chauhan doesn't look like anyone's working on it. There's some good insight into how to do it here https://github.com/xtermjs/xterm.js/issues/3293#issuecomment-2217365974

@Arup-Chauhan doesn't look like anyone's working on it. There's some good insight into how to do it here xtermjs/xterm.js#3293 (comment)

Great, so I will try and get started with it.
Please assign me the issue.
Also, can I make a draft PR for doing this issue? will mark it ready for review once the work is done.

@Arup-Chauhan we don't normally assign issues to external people but it's here that you're planning on working on it. Yes a draft PR is fine if you want some early feedback

seems to work fine in native Ubuntu WSL. Just info for anyone working on it

seems to work fine in native Ubuntu WSL. Just info for anyone working on it

Hi  @alekcunn, thanks for the info!
I have a fix that I proposed on the xterm.js repo
I will start off by testing this on a Windows machine first.


NumPy 2.0 in Dependencies

NumPy 2.0 in deps.
Update pre-commit.

Do you want a new release? Then please bump version in pyproject.toml to 0.1.28.

Do you want a new release? Then please bump version in pyproject.toml to 0.1.28.

Done, thanks for the pointer.


Cannot specify a File

Targetpath says "Path to the folder or file you want to publish", however if you try a file path it errors with
"The source directory provided does not exist, or is not a directory.", unless I'm getting the syntax wrong:
targetpath: '$(Build.ArtifactStagingDirectory)/testfile.txt'

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 41baa0b5-175c-a697-4b7d-c150259c6e6b
Version Independent ID: 75085b15-1acc-526a-0495-74a13c42c1d5
Content: Publish Pipeline Artifacts task - Azure Pipelines
Content Source: docs/pipelines/tasks/utility/publish-pipeline-artifact.md
Product: devops
GitHub Login: @mitchdenny
Microsoft Alias: midenn

Any update when the resolution for this issue will be released?

Wildcard support is not implemented yet. You can use the ‘’’.artifactignore’’’ file for now.


Better separation of Model from View.

StyledTextArea is a Node and as such takes care of rendering the visual representation of a document. In other words, StyledTextArea is the view. A big part of the model is represented by EditableStyledDocument, which is independent of the view. However, some parts of the model currently leak into StyledTextArea; namely undo/redo, caret position and selection. As a result, for example, to test undo/redo, one needs to instantiate the view, even though undo/redo itself doesn't depend on the view.
I propose to introduce a class (StyledTextAreaModel) to encapsulate the model.

So the proposed StyledTextAreaModel would have an EditableStyledDocument and it would move ESD's plain and rich text changes EventStreams to the model itself. Then StyledTextArea would be passed the model itself as Constructor param (and possibly some other things), right?
However, due to #152, and in providing the foundation for #222 to be implemented, if caret position and selection are stored in the Model, how would each View know what to display? Would the Model have a list that stores the caret positions and selection IndexRange of each StyledTextArea that displays the model, each of which is bound to its corresponding StyledTextArea property?

EditableStyledDocument would stay without change. StyledTextArea's plain and rich text changes would move into StyledTextAreaModel and StyledTextArea would just delegate the corresponding methods to model. Model would not be shared, each area would have its own. However, EditableStyledDocument could be shared by multiple models, as it is now.

Ah, ok that clarifies a lot.

See my PR (#242)


bumpp cli doesn't respect args

Describe the bug
Reproduction
cd /tmp
mkdir -p bumpp-repro
cd bumpp-repro
git init
npm init -y
npx bumpp -r --all --commit=\"release: %s\" --tag=\"%s\" --no-push

Expect
Git tag name should not have the prefix v
Actual
git tag

v1.0.1
(END)

cc @Bernankez for #20.
Reproduction
See above
System Info
System:
    OS: macOS 14.5
    CPU: (12) arm64 Apple M2 Max
    Memory: 217.36 MB / 64.00 GB
    Shell: 5.9 - /bin/zsh
  Binaries:
    Node: 18.18.0 - ~/Library/Caches/fnm_multishells/95167_1713107646834/bin/node
    Yarn: 1.22.21 - ~/Library/Caches/fnm_multishells/95167_1713107646834/bin/yarn
    npm: 9.9.2 - ~/Library/Caches/fnm_multishells/95167_1713107646834/bin/npm
    pnpm: 8.15.6 - ~/Library/Caches/fnm_multishells/95167_1713107646834/bin/pnpm
    bun: 1.1.3 - ~/.npm-global/bin/bun

Used Package Manager
pnpm
Validations

[X] Follow our Code of Conduct
[X] Read the Contributing Guide.
[X] Check that there isn't already an issue that reports the same bug to avoid creating a duplicate.
[X] Check that this is a concrete bug. For Q&A, please open a GitHub Discussion instead.
[X] The provided reproduction is a minimal reproducible of the bug.

Thanks! --tag="xxx" should also be a valid parameter format and I missed that point. I'll make a PR to fix it later.


How to build query in complicated case

Hi team,
I am trying to build a pact record, url: /odata/CHAIR?$filter=PERSON_CREATE/Active eq true or USED_FOR/STATUS eq 'Guard'
with pact record build script as:
.path("/odata/CHAIR")
.method("GET")
.query("$expand=TYPE_ATTRIBUTES($expand=DATA_TYPE/pfs.STRING)")
I met the exception:
java.lang.AssertionError: Pact Test function failed with an exception, possibly due to Mismatches(mismatches=[UnexpectedRequest(request=	method: GET
path: /odata/ENTITY_TYPE('CHAIR')
query: [$expand:[TYPE_ATTRIBUTES($expand=DATA_TYPE/pfs.STRING)]]
headers: [Connection:Keep-Alive, Host:localhost:8080, User-agent:Apache-HttpClient/4.5.2 (Java/1.8.0_161)]
Please help to show me how to build the query ???
Many thanks!

@uglyog @bethesque Sorry if annoying you but i really need to build the pact records with complicated request as above, please help on it! I use PactDslWithProvider library for info

Thanks @bethesque so much! I jumped to the Slack channels 💃

Ok, it is the root cause. I fixed it. Thanks and please close the question!


Redesign of alt-text indicator

Is your feature request related to a problem? Please describe.

The alt-text indicator often obscures part of the image.
Describe the solution you'd like
Move the alt indicator below the image, and include the alt text alongside:

With ellipses to constrain text if that's a concern:

Additional context

Care should be taken so that only one batch of alt-text is read by screen readers/accessibility tools, on encountering the image.
This will raise the profile of alt as it'll draw the eye to the 'secret' text
This will remove one of the 'punishments' put on those that use alt (i.e. their images are not obscured)

It shows the alt message when you click and view the image. I personally think it's much cleaner this way. I wonder what you think.

Can leave the on-click behaviour - but looking for a solution to move the ALT indicator (that currently obscures the image) without it feeling 'unbalanced' by having a mass of black space to its right.
Having it displayed as a caption may not be the best way to do it - but something else in that space I think is important to make it not look 'wrong'

Yeah. That's a good point. I also don't like how it covers the entire screen, while I can still read the post on X (or Twitter).

BlueSky puts the alt message in the image tag, but it can definitely be improved.

On X (Twitter), you still need to hover on the alt block to view the message though. I think it could display the alt message below the image when you click or hover on the block.


[ISSUE-580] Add sorted file related metrics to collect PartitionSorter status

What changes were proposed in this pull request?
Why are the changes needed?

What are the items that need reviewer attention?
Related issues.
Related pull requests.
How was this patch tested?
/cc @related-reviewer
/assign @main-reviewer

ping @waitinfuture @FMX


Connecting to an AWS Account instructions doesn't show how to use the new CUR report

DBR is the old style of report from AWS. CUR is the new style and provides more insight into the costs, when will Cloudyn support CUR?

Document details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 29c7c1b9-bd95-4a38-e4e4-df773be67c79
Version Independent ID: d8448440-9d78-1e1c-f739-bd1c03cceae1
Content: Connect an Amazon Web Services account to Cloudyn in Azure
Content Source: articles/cost-management/connect-aws-account.md
Service: cost-management
GitHub Login: @bandersmsft
Microsoft Alias: banders

@nmarchini Thanks for the Comment. We are actively investigating and will get back to you soon.

#in-process

@nmarchini I just received an update that AWS support is currently in Private preview. The plan is to be in Public preview by the first quarter of 2019. If you are interested in joining the ongoing private preview , please send mail to<EMAIL_ADDRESS>with your subscription details and a link to this GitHub issue (for context) and I will connect you directly with the feature owner.
Cheers

Thanks, are there any public details of what the new feature set will be for the new platform?

@nmarchini Not that i'm aware off. Would strongly recommend participating in the Preview to connect directly with the feature team for more details on feature roadmap.


Add a flag (false by default) for large loadable types pass

radar rdar://problem/28680453
Add a flag (and test cases) that help with future development of this pass

@swift-ci Please smoke test


Mega refactor

Progress

[ ] Use ChatGPT or GitHub Copilot to add a description header to each of the Actions in the .github/workflows directory
[x] Make sure GitHub Pages action works
[ ] Make sure publishing action works
[x] Make sure wiki action works
[ ] Make sure PR testing action works
[x] Make sure linting action works
[ ] Make sure main testing (every week) works
[ ] Answer "How do I create a feature?" in the wiki
[ ] Answer "What's the bash_modules/ folder for?" in the wiki
[ ] Answer "How does a feature work?" in the wiki
[ ] Answer "Why are some things features, and other things not?" in the wiki
[ ] Answer "How do I test my feature?" in the wiki
[ ] Answer "What's a good way to install $X in my feature?" in the wiki
[ ] Answer "What are the implicit dependencies of all features?" in the wiki
[ ] Answer "How do M1 macs vs x86 work?" in the wiki

Most important changes

Revamps documentation to be more user friendly and fit new architecture
Reduces GitHub Actions usage to a single instance, not a matrix
Adds a GitHub Pages site instead of readmes
Uses a Create-React-App-style of feature generation
Removes the ability to declare hard dependencies on other features
Removes the integration of the devcontainers-contrib/cli repo

Why these changes are a good idea
See #290 for more.

Feature generation from a YAML file seems like a good idea, until you compare it to generating Python code from a YAML file. That YAML file inevitably becomes your entire domain-specific programming language. Instead, if we provide a scaffold and let the user build on-top of that scaffold with pre-made functions like assert_nodejs() or other common functions, we...

Keep the install.sh focused on actually installing the core thing and not on repeatedly defining functions.
Are able to abstract common operations to a bash_modules/ folder.

Having hard dependencies on something like Python to install something like the Bikeshed CLI seems OK in theory, but in practice it means that you now need to either...

Add in a suite of options to manage the sub-feature like "pythonSubFeature__version" and "pythonSubFeature__installPath"
Accept that if the user doesn't provide the feature, you'll just install it with default options
(IMO the most practical and predictable option) fail fast and instruct the user to install critical pre-requirements.

Having these dependencies declared as assertions lets users configure them on their system manually. It's sort of the whole "make this dev env act like a dev's PC" argument. You want these devcontainer configs to feel like the steps you would take when setting up an Ubuntu installation.
For instance, the Apache ActiveMQ thing that requires Java to be installed. In a typical environment, you're referred to "you must have Java installed for this to work". Another good one is something like  CMake or some other meta-toolchain thing that requires some other components to exist on the system. Ideally you want to layer these things on top of each other using features like:
{
  "image": "ubuntu:22.04",
  "features": {
    "python": "3.10" // Overrides the pre-installed Ubuntu Python
    "clang": "14"
    "cmake": "3", // Requires clang or gcc!
    "node": "16",
    "deno": "latest",
    "jdk": "19",
    "activemq-classic": "latest" // Requires java!
  }
}

Note how we can take a base image and then incrementally layer thing together? This is the whole point. I think we should embrace that and not auto install things that don't make sense to be auto-installed. There are some cases where ensure_*() functions are OK. This just comes down to feeling and debate.
For instance, I think that Python firmly fits into the category of "user should explicitly specify" while curl is conventionally just "install it if it doesn't exist".
One of the primary factors might be how much said tool is expected to change between versions, therefore how important it is to have the user explicitly say what version they want? IDK.

Executive summary of how the new version works
Let's say you want to make a new feature. Let's say it's for Deno.

Read CONTRIBUTING.md
Fork
Open MAIN in CODESPACES
Run tools/create-feature.js
Add source bash_modules/ensure_curl.sh to install.sh
Add some magic commands to make it install a specific version (or LATEST if no $VERSION)
Add a link to the Deno install instructions
Add a README.md with a brief description saying that this adds the Deno binary to usr/local/bin/ or whatever
Run tests (starter test command is prompted in tools/create-feature.js)
Add a scenario to test supplying version
Run tests again
Commit
Push
Open PR
Tests run ONLY on this new feature (changes only)
Maintainer merges
DONE!

The highlights are that:

The PR Action will ONLY test the changed/added features
bash_modules/ is back
There's NO TESTS run when main is merged. Main branch is only tested every week. PRs should cover any test failures, since if it doesn't touch it, it shouldn't break it, and therefore won't be tested.
Deployed IMMEDIATELY from main to ghcr.io
GitHub Pages is used for docs. Using PHP template SSG-ish thing. Can be changed to Next.js or some other SSG later if you want.

@danielbraun89 Am I accidentally running actions on this devcontainers-contrib/features? Cause that's what it looks like...

I'll close this FOR NOW to stop these way-too-frequent actions from running on this repo. I'm still working on my own forked copy, don't worry!


Create marketplace_mobile_filter_2.html

Here is the component I have built.

Here is a screenshot of that.

good job @nishit3134
Congrats 🎉, your PR got merged. To be eligible for the swags from ClueLess. Follow this steps.

Star this repository. ⭐
SignIn / SignUp in [ClueLess Website](https://www.clueless.tech/) .
Go to profile section from the top right hand corner.

Comment your profile URL under this comment tagging the person who merged your PR.

That’s it. Follow the leaderboard !
And don’t forget to share your achievement with your friends.

@rupsha014  https://www.clueless.tech/profile/admin/111650900


[FEATURE] Request to create a contribution.md guide

Description
I couldn't find guide to understand the code of bot. It will be easy if we can create one. It can help in solving issues faster.
Screenshots
No response
Additional information
No response

Can I work on this issue?


The corresponding paper for Weight loss

Hi, Thank you for your job. Can you tell me which paper has come up with weight loss ? Thank you a lot.

It is not public now.

OK, thanks for your reply. Hope to see your great work.


Pythonista3

Pythonista was released，would you prepare to adapt to it with python3?

You can still use StaSh with the new release. The launch_stash.py script contains a python2 shebang that will allow it running in Python 2 mode even when you have Python 3 as default interpreter.
With above being said, I do plan to make stash python 3 compatible. In fact, the py3 branch exists for this very purpose. However the work is not completed as there are some issues porting the various command scripts, especially git as one of its dependency is Python 2 only.
Since new Pythonista can run both 2 & 3 code, I am thinking to port only the StaSh main programs to Python 3 and leaves the command scripts to Python 2. However, one critical missing piece is to invoke the corresponding Python interpreter from with StaSh based on the shebang line of a script. This is going to involve some objc hacks and I haven't had time to work on it. @jsbain could you please shed some light on this?

I think i was able to execute a script that was already loaded in the editor, but not a generic script.   I forget.  I think I concluded it was going to be difficult to do it seamlessly from within a script.  But there may also be a way from a cdll, I have not played with that, not sure if both are accessible...

Well ,  very thanks to your tool, and stash is real nice project!

@jsbain
I tried with PA3PythonInterpreter object and it can run an arbitrary script using the runScriptWithFileAtPath_argv_ method. I am not sure how it would work when putting in a separate thread though and that's something to test.
However, I was NOT able to get the PythonInterpreter object to work. There is this runFile_argv_captureExceptions_completion_ method, but I don't know what do you pass as the third and fourth arguments.
Since I plan to make StaSh main programs PY3 compatible, it is more important to get PythonInterpreter to work as most of the command scripts are PY2.

I try ssh & gh in pythonista3 and two scripts are broken.

I Have gotten this to work through the editor tab:
https://gist.github.com/e64581caa4588625896594882870c50c
The file needn't be open, but some file needs to be open (tab must exist).  If interpreter is already running, you must wait for running to end or your request is ignored.  See code to do so (not thread safe, but a Lock could work).
The main drawback-- globals are cleared.
I tried swizzling a few of the PythonInterpreter methods to log when they are called, so we can see what the argument types are, but the run_asFiles do not seem to get called.  Need to try again with a few others, or maybe swizzle the call selector stuff.
BTW, if you have not yet installed @dgelessus's faulthandler in his pythonista_startup repo... do so immediately!  When things crash in objc it shows the exception, etc.

Aha!
I2=ObjCClass('PythonInterpreter').sharedInterpreter()
I2.runWithOptions_(({ 'captureExceptions':0,
								'script':'print "hello"\n',
								'scriptPath':"<string>"}))

There is no obvious way to get exceptions or return codes back to py3.

@jsbain Would it be possible to give each command an ID, then run the script with something like
try:
    exec script in <namespace to be passed> #run script
except Exception as e: #catch exception
    dump_exception(e, os.path.join(<some_temp_dir>, command_id)) #save exception to file
and let StaSh read the file to print the exception?

Another option would be to use a socket, such as an AF_UNIX socket which talks through a file id.
Since many scripts use _stash, on the py2 side, stash must be enabled, and when scripts are called something will need to be done to synchronize the state.  If a py2 script runs a py3 command, things might start getting dicey..

actually, i guess it is possible to communicate on the objc side. Also, it feels like it should be possible using ctypes to call the c level commands for running a line, but i have not investigated yet

@jsbain Thanks for all the diggings.
The runScriptAtPath_withInterpreterVersion_arguments_ method does NOT seem to be useful if it has to run with on_main_thread. This is because all stash commands runs in separate thread and is not compatible with this requirement.

@syslot ssh works fine for me. What's the exact error message you had? Also maybe worthwhile to create a separate issue if you are still experiencing problems.

I don't think it has to be run on the main thread. It seemed like a good idea, but might not be needed.
Sent from my iPad

On Jun 15, 2016, at 7:34 PM, ywangd<EMAIL_ADDRESS>wrote:
@jsbain Thanks for all the diggings.
The runScriptAtPath_withInterpreterVersion_arguments_ method does NOT seem to be useful if it has to run with on_main_thread. This is because all stash commands runs in separate thread and is not compatible with this requirement.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

The standard Python C API might be useful for this too. I did some simple tests and it seemed to work properly. Maybe the C API has better ways of detecting exceptions and such than Pythonista's methods.

I was thinking that too.... How do you get access to the different interpreters from that standard Python C API?  are there different static libraries to reference,  or something, or are names mangled differently?

Think I posted this on the forum a while back... you can create a ctypes.CDLL with the path of the PythonistaKit3 or PythonistaKit executable, then you have access to the Python 3 and 2 API respectively.

C API is probably more stable for the x-interpreter calls if it is usable. However, I tried with following simple code and it crashes Pythonista.
import ctypes
import os
import sys

EXE_DIR = os.path.dirname(sys.executable)
p3f = 'PythonistaKit3'

dll = ctypes.CDLL(os.path.join(EXE_DIR, 'Frameworks', p3f + '.framework', p3f))

dll.PyRun_SimpleString.argtypes = [ctypes.c_char_p]
dll.PyRun_SimpleString.restype = ctypes.c_int
dll.PyRun_SimpleString('print(42)')

My default interpreter is 2.7. I tried similar code with Python on my laptop and it crashes as well. I have no idea where to look at. Help is highly appreciated! @dgelessus @jsbain

@ywangd This is a piece of code I wrote a while ago. It doesn't run Python code (I have code that does that too, but it's buried somewhere in the Pythonista 3 thread) but maybe you can work based on this.
import ctypes
import os
import sys

FRAMEWORKS = os.path.join(os.path.dirname(sys.executable), "Frameworks")

def get_python_version(name):
	dll = ctypes.CDLL(os.path.join(FRAMEWORKS, name + ".framework", name))
	dll.Py_GetVersion.argtypes = []
	dll.Py_GetVersion.restype = ctypes.c_char_p
	return dll.Py_GetVersion().decode("ascii")

print(get_python_version("PythonistaKit"))
print(get_python_version("PythonistaKit3"))

@dgelessus I did make my crashing code following the example you pasted. Your example did run. However it just won't allow the execution of another python script.

@ywangd You probably need to work with the other interpreter's GIL to be able to call most API functions. See this section of the Python C API manual, specifically the PyGILState_Ensure and PyGILState_Release functions.
Are you in the Pythonista Slack channel? If you're not - I recently found a way to create a fully separate Python interpreter in Pythonista (by copying the PythonistaKit3.framework) but I haven't done much with it yet, so I don't know how practical this is.

Any progress on this?
The current version (master branch) doesn't allow python3 code, even with shebang.

@Dutcho Its about 30% done. There is a experimental python3-command in bennr01:restructure (use selfupdate -f bennr01:restructure to switch to the branch), but it is still mostly bugged and untested.
Working so far:

executing python3 code from stash (python3 -c "print 2+2" will show a SyntaxError)
I/O (but not perfectly)
sys.argv and cwd (but not really tested)
Errors

** Known Bugs:**

The REP-loop in the python3-command does not work (=python3 without args wont work)
Some modules executed with python3 -m module_name_here give weird errors (python3 -m cmd gives a NameError for "PROMPT")
You need to press return after the python3 command finishes in order to exit the script

Still needs to be implemented::

the _stash global for python3 scripts (it will probably use some sort of a RPC system)
function to kill the python3 script
correct exit codes
automatic version detection using a shebang


Add a new Observation class to observable.ttl

Add a new Observation class to observable.ttl where

Observation is a subclass of Action
core:name="observe"
the observables that were observed during the observation are expressed in the action:object property
the identity, tool, software (etc.) that made the observation is expressed in the action:performer property
any tool or other instrument used to make the observation is expressed in the action:instrument property
the time at which the observation occurred is expressed in the startTime and endTime properties

This will make it explicitly clear how to convey observations and do so in a manner which is consistent with the rest of UCO.

Potential solution in branch Issue-157-sdb

What distinguishes the usage of this from an InvestigativeAction?

This is from my viewpoint as a cybersecurity operations person. Continuous monitoring is done for indicators of security issues. Continuous monitoring is a matter of making regular observations. An observation of an indicator of compromise may indeed trigger and investigation. That investigation may in turn lead to InvestigativeAction.
In short: Observations are not all within the context of an investigation.

That helps me out.  Thank you!

This issue has been changed to "committed" due to the merge of PR #172 into branch develop. It's now staged for merging into master (for 0.4.0 release).

Fixed in https://github.com/ucoProject/UCO/releases/tag/0.4.0


concept and methods + add UiO use cases.

@annefou - very nice. Please see if my feedback makes sense.

@annefou - very nice. Please see if my feedback makes sense.

@annefou - very nice. Please see if my feedback makes sense.

it totally makes sense. Thanks a lot.


Revert 1 spiritdivine patch 1

I did not see any changes in this pull request, as it looks like the data commit was reverted, so I will close it.
@Spiritdivine please create a new pull request


[4.0] [Type checker] Warn deprecated @objc used to satisfy protocol requirements

Explanation: Warn about uses of declarations which have inferred @objc due to the
deprecated Swift 3 rules when the declarations are used to satisfy a
requirement of an @objc protocol.
Scope: Improves the migration experience for SE-0160.
Radar: rdar://problem/32431838
Risk: Very low; introduces a warning that is only enabled when a particular warning flag is passed to the compiler.
Testing: Compiler regression testing,

@swift-ci please test

Build failed
Jenkins build - Swift Test Linux Platform
Git Commit - 7f70d33e78f5a75a38a90d774d3a7306d374c0da
Test requested by - @DougGregor

@shahmishal , the failure in that Linux test implies that LLDB wasn't branched at a compatible point:
/home/buildnode/jenkins/workspace/swift-PR-Linux/branch-swift-4.0-branch-06-02-2017/lldb/source/Plugins/ExpressionParser/Swift/SwiftPersistentExpressionState.cpp:179:43: error: no member named 'getIdentifier' in 'swift::DeclName'
22:08:13     name_str = (value_decl->getBaseName().getIdentifier().str());
22:08:13                 ~~~~~~~~~~~~~~~~~~~~~~~~~ ^
22:08:13 1 error generated.

@swift-ci please test Linux

Build failed
Jenkins build - Swift Test Linux Platform
Git Commit - 7f70d33e78f5a75a38a90d774d3a7306d374c0da
Test requested by - @DougGregor

@swift-ci please test Linux

Build failed
Jenkins build - Swift Test Linux Platform
Git Commit - 7f70d33e78f5a75a38a90d774d3a7306d374c0da
Test requested by - @DougGregor


Can WinAppDriver be used to automate online office apps?

Can WinAppDriver be used to automate online office apps like Excel, word and powerpoint online?

Word Yes
Excel don't know, but the probably also yes
Powerpoint, I don't use Powerpoint

Thanks for the response! I understand that it can be used for desktop apps excel, word and powerpoint. Did you use it for Word Online?

I do not use Office online, never will

Office 365 is a web product, it will be automated using browser automation tools like Selenium or Cypress.io

@naeemakram
It is not as simple as that, spend some time, figure out how you might select a single word within the document.

@DLightstone do you have any code written for MS Word desktop app using java?

@swethakucherlapatiTR
sorry, I do not work in Java
I have no Java MS Word code

@naeemakram
It is not as simple as that, spend some time, figure out how you might select a single word within the document.

I know it must be very hard. You can select the entire text using Ctrl + A, Ctrl + C and then read the contents of clipboard to get all the text. But that's as far as I've gone(in an Excel application)

@naeemakram
Not hard, impossible
You need to use Word Automation to manipulate the document.

@DLightstone What is Word Automation? I am trying to edit a Microsoft word document and sendKeys() is not helping.

@swethakucherlapatiTR
Perhaps you have heard of Google
Do you know how to use it also?
https://www.google.com/search?client=firefox-b-1-d&q=word+automation

Microsoft Office applications expose an object model which allows you to automate various aspects of the application. Same is leveraged for creating macros. Please see the link below for more information about office automation using VBA.
https://docs.microsoft.com/en-us/previous-versions/office/troubleshoot/office-developer/automate-word-create-file-using-visual-basic

@ naeemakram
Perhaps you are familiar with the expression
Give a man a fish and he eats for a day
Show a man how to fish and he eats for the rest of his life

Office 365 is a web product, it will be automated using browser automation tools like Selenium or Cypress.io
WinAppDriver is designed specifically for desktop Windows applications.

How can we automate office 365 apps using cypress?
are there any libraries to be added in the project?


Call overreact using Julia

[ ] Overreact.jl
[ ] Graphical User Interface (Reactive.jl) → Maybe I should implement it online as an API

@schneiderfelipe, please assign me on this issue
Deadline: 25/12
*don't worry about the deadline, @schneiderfelipe, 😂😂 it is only for me. You will be able to check it out after of your summer break.

Correct #31 in Julia Version of Overreact

I think it would be nice to keep this issue for Overreact.jl and open a separate one for the GUI/API thing (in fact, I think this belongs more to Overreact.jl than to this repo). Let me know what you think.

Overreact.jl is still a private repository in my profile. We can keep this issue open until we fork it to geem-lab. (but you're right)

Great, I think it's a good solution. I'll create the GUI tag for now then.

@schneiderfelipe Have you seen the Overreact.jl repo?


SYSTEM_INFO does not implement Default

This issue was raised in #839, with a plan to be fixed with #656. Unfortunately, #656 was closed as completed, but SYSTEM_INFO still doesn't implement Default.
From my understanding, the problem at the time was the Anonymous union attribute.

What crate and version are you testing?
The SYSTEM_INFO struct does implement Default in the windows crate and has done so for some time.
The windows-sys crate does not implement Default by design.

I just noticed I'm using windows-sys in this project. Sorry for the noise and thanks for the quick answer!


feature: Mirr function

This PR adds the mirr function and it's respective tests

@gyanesh-m another one !


Fixes false positives for Y090 in relation to PEP-646

Fixes #472

Could you also add an entry to CHANGELOG.md?


feat: trying to add announcements

Don't forget to handle case where file is empty or does not exist at all - Notification should not be displayed in that case.


Cannot properly resolve aliases in pinocchio, due to glazed

Actually a bug in pinocchio that was covered up by the previous implement of default values in glazed


Update Sailbot Workspace and ROS documentation

Purpose

#UBCSailbot/sailbot_workspace#61

Changes

[ ] [TBD] Migrate dev container documentation to here
[ ] Remove ROS 1 bridge section
[ ] Update run page

[ ] Create collapsible admonition(s) raye branch (existing documentation)

[ ] Update ros tutorials documentation

[ ] Link to the humble versions of the tutorials
[ ] Skim through to see if there are any new features to take a note of

Resources

Logging into container registry: https://docs.github.com/en/packages/working-with-a-github-packages-registry/working-with-the-container-registry#authenticating-to-the-container-registry

Pending:

https://github.com/UBCSailbot/sailbot_workspace/issues/76
https://github.com/UBCSailbot/sailbot_workspace/pull/70
https://github.com/UBCSailbot/sailbot_workspace/pull/79

Setup instructions: for Linux, install Docker Engine and not Desktop


Misc: How can I get Hass.Agent to start without me logging in

I have hass.agent on a headless computer that runs Blue Iris. the memory on the Blue Iris slowly climbs over the course of a month so I have hass.agent sending the memory usage to Home Assistant. When the memory stays over 85% I send a command to reboot the computer. The issue is that when the computer reboots it doesn't log in automatically so hass.agent doesn't start. I need to manually remote in to the computer to log in for hass.agent to start. Is there a way to start it without logging in?

Hello, the default way to have HASS.Agent working while user is not logged in is to use the Satellite Service https://hassagent.readthedocs.io/en/latest/introduction/#satellite-service
I'm not sure if it supports the sensors that you're after though.


add %archives section

add a section for 'archive.extracted' (maybe %archive?).

extracted archives should likely go between PACKAGES  and FILES


[very minor] consider renaming to recycle.js

A friend and I were talking about this project and he mentioned that to improve its Google-ability, cycle-react could be renamed as recycle.js as it is not only an amalgam of React and Cycle but also represents the recycling of ideas from both.
Although recycle is taken on NPM as recycle, the project doesn't exist anymore on Github, hence the name recycle.js.
Any thoughts @pH200? Also, if it wasn't clear, this project is awesome and way more approachable and usable to me than Cycle.js, so thank you for writing it!

I don't think you can ask for much better google-ability for an amalgamation of cycle and react than cycle-react. If I search for "use react with cycle", it's the first thing that comes up. "recycle" may be a more clever name, but it's certainly not more googlable, especially if you don't already know what you're looking for.

@ryanhiebert well I brought this up partially because I find way more resources about using Cycle.js with React than anything specific to this project, not to mention that Googling "cycle-react-native" only brings up the link to this repo and everything else is about Cycle.js and React Native.
I can also imagine that if this project were to become the de facto way for integrating Rx and React (in the Cycle way of course), searching "cycle react" will only get more lost in the Cycle.js + React search results, whereas nothing relevant comes up when searching "recycle js" at the moment, and if you were to search "recycle react", you would definitely end up here.
Anyways, I'm not wedded to this at all, just wanted to start discussion. Thanks for your input!

I think the issue is that, frankly, there aren't many blog posts or examples to find, even with more google-able terms.
That said... honestly, cycle-react is only, like, 300 lines of code?  It's fairly easy to dig into.
To cycle react, you basically just need to know how to use

React

and

RxJS

Fortunately you can google tons of examples for each of those separately.  Cycle-react to me is really less about being Cycle.js and more about being Rx.JS + React, and I like it that way.  There's not very much to say about cycle-react itself.

@sunny-g I understand. We really need a solid introduction of how to use Cycle-React in the real world as you said. I don't like to change the name right now, but examples and blog posts as well as the projects in production are the missing parts without any question.


hssi: 100G test updates

Loop on (new) PKT_TX_COUNT CSR before ending test.
Display new BlockID CSR in dump.
Implement controls for PKG_GEN_CTRL register.

Signed-off-by: Tim Whisonant<EMAIL_ADDRESS>

Coverage decreased (-0.1%) to 60.925% when pulling 321d1381d7484b65c3240c49892e45238a6b6bc5 on tswhison/hssi_100g into 5ee6ce9ddc0f79bf503ef2c7d627ecb94a11966b on master.


SPI slave almost don't works while OTA update (IDFGH-3660)

Environment

Development Kit:      none
Module or chip used:  ESP32-WROVER-B
IDF version (run git describe --tags to find it): v4.0.1
Build System:         idf.py
Operating System:     Windows
(Windows only) environment type: Plain Command Prompt
Using an IDE?: VSCode
Power Supply:         external 3.3V

Problem Description
SPI slave can't be used while OTA in progress. First five seconds (during flash erasing) interrupts almost completely disabled (purple line on screenshots - pin set inside interrupt handler). Later, while received firmware is writing to flash, interrupts are sometimes blocked too.
How can I increase SPI IRQ priority to prevent that? Or what can I do else?
Steps to reproduce

Prepare spi slave configuration with regular spi transfers.
Run HTTPS OTA
You will miss many packets during OTA

Screenshots

Flash erasing 5 seconds block

IRQ blocked during further  flashing

Ok, looks like interrupts are really disabled during OTA update. But not all - interrupts from IRAM still enabled.
So I have marked my SPI hadler as IRAM interrupt: esp_intr_set_in_iram(spihost[host]->intr, true); (it already was in IRAM section), added IRAM_ATTR attribute to almost all functions, which are called from this IRQ.
And now I am getting Guru Meditation Error: Core  0 panic'ed (Cache disabled but cached memory region accessed) in first IRQ during OTA.
Backtrace shows that error was here: 0x4008b94e: get_rst_en_mask at .../components/driver/periph_ctrl.c:133

Part of periph_ctrl.c
static IRAM_ATTR uint32_t get_rst_en_mask(periph_module_t periph, bool enable)
{
    switch(periph) {    //! <-- line 133 is here
        case PERIPH_RMT_MODULE:
            return DPORT_RMT_RST;
        case PERIPH_LEDC_MODULE:
            return DPORT_LEDC_RST;
        case PERIPH_UART0_MODULE:
            return DPORT_UART_RST;
        case PERIPH_UART1_MODULE:
            return DPORT_UART1_RST;
        case PERIPH_UART2_MODULE:
            return DPORT_UART2_RST;
        case PERIPH_I2C0_MODULE:
            return DPORT_I2C_EXT0_RST;
        case PERIPH_I2C1_MODULE:
            return DPORT_I2C_EXT1_RST;
        case PERIPH_I2S0_MODULE:
            return DPORT_I2S0_RST;
        case PERIPH_I2S1_MODULE:
            return DPORT_I2S1_RST;
        case PERIPH_TIMG0_MODULE:
            return DPORT_TIMERGROUP_RST;
        case PERIPH_TIMG1_MODULE:
            return DPORT_TIMERGROUP1_RST;
        case PERIPH_PWM0_MODULE:
            return DPORT_PWM0_RST;
        case PERIPH_PWM1_MODULE:
            return DPORT_PWM1_RST;
        case PERIPH_PWM2_MODULE:
            return DPORT_PWM2_RST;
        case PERIPH_PWM3_MODULE:
            return DPORT_PWM3_RST;
        case PERIPH_UHCI0_MODULE:
            return DPORT_UHCI0_RST;
        case PERIPH_UHCI1_MODULE:
            return DPORT_UHCI1_RST;
        case PERIPH_PCNT_MODULE:
            return DPORT_PCNT_RST;
        case PERIPH_SPI_MODULE:
            return DPORT_SPI01_RST;
        case PERIPH_HSPI_MODULE:
            return DPORT_SPI2_RST;
        case PERIPH_VSPI_MODULE:
            return DPORT_SPI3_RST;
        case PERIPH_SPI_DMA_MODULE:
            return DPORT_SPI_DMA_RST;
        case PERIPH_SDMMC_MODULE:
            return DPORT_SDIO_HOST_RST;
        case PERIPH_SDIO_SLAVE_MODULE:
            return DPORT_SDIO_RST;
        case PERIPH_CAN_MODULE:
            return DPORT_CAN_RST;
        case PERIPH_EMAC_MODULE:
            return DPORT_EMAC_RST;
        case PERIPH_AES_MODULE:
            if (enable == true) {
                // Clear reset on digital signature & secure boot units, otherwise AES unit is held in reset also.
                return (DPORT_PERI_EN_AES | DPORT_PERI_EN_DIGITAL_SIGNATURE | DPORT_PERI_EN_SECUREBOOT);
            } else {
                //Don't return other units to reset, as this pulls reset on RSA & SHA units, respectively.
                return DPORT_PERI_EN_AES;
            }
        case PERIPH_SHA_MODULE:
            if (enable == true) {
                // Clear reset on secure boot, otherwise SHA is held in reset
                return (DPORT_PERI_EN_SHA | DPORT_PERI_EN_SECUREBOOT);
            } else {
                // Don't assert reset on secure boot, otherwise AES is held in reset
                return DPORT_PERI_EN_SHA;
            }
        case PERIPH_RSA_MODULE:
            if (enable == true) {
                // Also clear reset on digital signature, otherwise RSA is held in reset
                return (DPORT_PERI_EN_RSA | DPORT_PERI_EN_DIGITAL_SIGNATURE);
            } else {
                // Don't reset digital signature unit, as this resets AES also
                return DPORT_PERI_EN_RSA;
            }
        case PERIPH_WIFI_MODULE:
        case PERIPH_BT_MODULE:
        case PERIPH_WIFI_BT_COMMON_MODULE:
        case PERIPH_BT_BASEBAND_MODULE:
        case PERIPH_BT_LC_MODULE:
            return 0;
        default:
            return 0;
    }
}

As I can see from address 0x4008b94e, this function successfully allocated in IRAM section (according to memory map).

Memory map

What else can I do?

Also I should add that I am using SPI slave in DMA mode and "DMA workaround" functions inside SPI IRQ were caused that crash.

Ok, finally I got it. So how to use spi slave during OTA update (I think, this manual will be applicable to any other hardware interrupts):

Don't use DMA! Functions to work with DMA are located inside flash, which is inaccessible during OTA. So in this case you are limited to 32 byte data transfer in single SPI transaction.
Move your SPI IRQ handler to core 1. To do it just launch spi_slave_initialize() and others from task, which is  pinned to core 1. This is needed to prevent interrupt blocking by WiFi and bluetooth (they all are on core 0)
Allocate your SPI SLAVE functions in IRAM. In sdkconfig:

CONFIG_SPI_SLAVE_IN_IRAM=y
CONFIG_SPI_SLAVE_ISR_IN_IRAM=y

Don't forget to add IRAM_ATTR attribute to your callback and to all functions, which are used inside.
Add .intr_flags=ESP_INTR_FLAG_IRAM to spi_bus_config struct, which is passed as argument 2 in spi_slave_initialize(). This will acknowledge driver that your IRQ is located in IRAM and can be safely called while flash is disabled.

Also I edited IRQ handler in driver (removed RTOS queue usage because I don't need it in my case), but not sure that it matters.


Fix: reference key error in LLMContextPrecisionWithoutReference

fix to #1567

thanks a lot @xizhou-vw for catching this and contributing the fix 🙂 ❤


Is the project still maintained?

Hi,
Given the number of pull requests and issues unanswered, I wonder if the project is still maintained.
Do you have more information?

Answer is: sort of?
The original author @thenikso did a fabulous job, but was very up front about not being able to maintain it and asked for someone else to take over. There's been some great work by @HyperBrain and others, but it deserves a fairly sustained amount of effort to keep pace with both Webpack and Serverless. It's possible one or more maintainers will emerge, or it will be moved to the serverless organization and maintained there.
As for me and my co-workers, we're considering removing the plugin, running webpack, and pointing serverless to the output.
NODE_ENV='production' node_modules/.bin/webpack --config webpack.config.js -p

In my experience this plugin offers the best integration of webpack and Serverless. It would be a loss if it would simply be shut down 😢 Especially building and testing React applications (including server-side rendering) are a pain without the plugin.
Nevertheless, to keep it usable the most important bugs have to be fixed (the ones that really block the use). I could have a look at some of the bugs and try to fix them, but as I'm already quite busy maintaining and contributing to other projects (my ones and Serverless) in my spare time, taking it over completely is currently not an option.

Perhaps the pull request hack is called for:

Whenever somebody sends you a pull request, give them commit access to your project.

If yourself and others who have contributed pull requests were given access by @domaslasauskas or @thenikso (and also be able to add still more contributrors) it might get this project to a more sustainable place.

I agree with @StevenACoffman and I'm glad to help.

I also use this heavily and would be happy to help.

Our project at this moment is quite dependent on this plugin, and i personally would like to see this plugin moving forward as it is the best integration with with webpack and serverless i have seen. I would be happy to dedicate some of my time weekly for the forseable future making contributions for this project. How would you guys would like to go on about doing this?
Picking issues and trying to solve it, or just bring in suggested features as we need them and collectively review the pull-requests?

Of the volunteers, @HyperBrain has a well established track record, and at the very least can add a few more maintainers here. @thenikso please add him as a collaborator to this github repo.
While it is possible for a new github organization to emerge, and this code to be moved there, in the mean time these are the steps remaining:

[ ] @thenikso adds the npm username maintainers as below 1
[ ] @thenikso adds @HyperBrain as a collaborator to the github repo as below 1
[ ] Potential maintainers provide both their npm userid and github user id here (e.g. hyperbrain for npm and HyperBrain for github)
[ ] @HyperBrain can add first few others as they step forward.

1 share npm maintainership like so:. ↩
cd serverless-webpack
npm adduser hyperbrain
npm owner add hyperbrain

2 share github maintainership like so:. ↩

Navigate to the repository on Github you wish to share with your collaborator.
Click on the "Settings" tab on the right side of the menu at the top of the screen.
On the new page, click the "Collaborators" menu item on the left side of the page.
Start typing the new collaborator's GitHub username into the text box.
Select the GitHub user from the list that appears below the text box.
Click the "Add" button.

Hey guys, great to see efforts to build a community of maintainers around this heavily used plugin.
Just wanted to drop a line that there's also this GitHub org: https://github.com/serverless-community-labs
Maybe worthwhile to contact the developers of the Simulate plugin to build up one org where mature plugins are brewed 🍻 .

Wonderful news! I am very sorry for not having being able to sustain the work on this plugin. I'll execute what @StevenACoffman proposes within tomorrow.
Thank you all for the support and I hope to be back contributing in the near future.

@HyperBrain you should be all set! Please feel free to contact me privately if you need anything concerning this repo.
Also if it would be best for the community to move this repo to a new organization I am all for it.

@thenikso Thank you 🥇 . I will contact you if I have any questions or problems moving forward. Now the way should be clear to get the project to an active state again and setup a team to proceed.
Moving it to a new organization would be a goal for the next weeks then. I'll concentrate on the next steps over the upcoming weekend.

Guys apologies i have been on holidays with limited internet, if you want to add me, my npm is the same as github.

Great to see this up and running again. I landed up doing a fork of this just so I could fix some of the annoying bugs.
I will keep a tab on this and see if I can assist with contributions.

@SkippyZA 👍 Please check the recently released version 2.0.0, which contains some of the open PRs (see the release notes). Version 2.1.0 is about to be released soon (here are the planned features/fixes).
The major improvements in Version 3.0.0 are here
You're welcome to contribute. There are still a lot of issues open that could need some help 😃 . If you have fixed something and think that has to be added too, create an issue for it and (incase you already fixed it) open a PR.


VSCode freezing frequently after medium to long usage

VSCode Version: 1.28.0
OS Version: Windows 10

Steps to Reproduce:
After update to 1.27.0, I started seeing some freezing under vscode, but I didn't investigate further at the time. But after this month's 1.28.0 update, it happened 8 times in the last 8 minutes. I collected some stats when the vscode window is hung, and it seems like the main window process is using around 50% of CPU without me even typing anything. It unfreezes for some time, but if I type for 10 seconds, it freezes again. It used to crash in 1.27.0 on freezing, but that hasn't occurred yet in 1.28.0.
Here are some logs on running code --status:
Version:          Code 1.28.0 (431ef9da3cf88a7e164f9d33bf62695e07c6c2a9, 2018-10-05T14:58:53.203Z)
OS Version:       Windows_NT x64 10.0.17134
CPUs:             Intel(R) Core(TM) i5-6200U CPU @ 2.30GHz (4 x 2400)
Memory (System):  7.84GB (1.01GB free)
VM:               0%
Screen Reader:    no
Process Argv:     .
GPU Status:       2d_canvas:                    enabled
                  checker_imaging:              disabled_off
                  flash_3d:                     enabled
                  flash_stage3d:                enabled
                  flash_stage3d_baseline:       enabled
                  gpu_compositing:              enabled
                  multiple_raster_threads:      enabled_on
                  native_gpu_memory_buffers:    disabled_software
                  rasterization:                enabled
                  video_decode:                 enabled
                  video_encode:                 enabled
                  webgl:                        enabled
                  webgl2:                       enabled
CPU %   Mem MB     PID  Process
    0       53   23948  code main
    0       65    9652     shared-process
   43      489   10304     window (ΓùÅ _xxxxxxxxxxx.js - catalyst-v2 - Visual Studio Code)
    0        6    1448       electron-crash-reporter
    0      164    7136       extensionHost
    0        8    9008         "C:\Users\khs\AppData\Local\Programs\Microsoft VS Code\Code.exe" "c:\Users\khs\AppData\Local\Programs\Microsoft VS Code\resources\app\extensions\json-language-features\server\dist\jsonServerMain" --node-ipc --clientProcessId=7136
    0       87   10024         electron_node eslintServer.js
    0        5   14308         "C:\Users\khs\AppData\Local\Programs\Microsoft VS Code\Code.exe" "c:\Users\khs\AppData\Local\Programs\Microsoft VS Code\resources\app\extensions\css-language-features\server\dist\cssServerMain" --node-ipc --clientProcessId=7136
    0       15   17304         electron_node server.js
    0       35   22260         electron_node server.js
    0        9   22416         C:\Users\khs\.vscode\extensions\ms-vsliveshare.vsliveshare-0.3.735\dotnet_modules\vsls-agent.exe --autoexit --pipe c5c82c8296d544e0a222cb091facc52e --service https://insiders.liveshare.vsengsaas.visualstudio.com/
    0        3   20344           console-window-host (Windows internal process)
    3      529   24552         electron_node tsserver.js
    0        8   22408           electron_node typingsInstaller.js typesMap.js
    0       12   15476       watcherService
    0        5   21268         console-window-host (Windows internal process)
    0        5   18536       searchService
    0       89   10492     gpu-process
    2       86   13816     window (Process Explorer)

Workspace Stats:
|  Window (ΓùÅ _xxxxxxxxxx.js - catalyst-v2 - Visual Studio Code)
|    Folder (yyyyyyy): more than 22404 files
|      File types: go(5411) html(3113) js(2081) png(569) css(427) h(300)
|                  gql(288) md(197) sc(100) feature(93)
|      Conf files: makefile(17) launch.json(2) package.json(2)
|                  webpack.config.js(2) settings.json(1) tasks.json(1)
|                  jsconfig.json(1)
|      Launch Configs: go chrome

Does this issue occur when all extensions are disabled?: Can't confirm.
This issue happens erratically, but whenever it does occur, it's mostly after prolonged usage (5 hours+). So disabling extensions is not a viable solution for me. I also have a dump file, is there a secure channel to share this info?

I also get this notification whenever vscode comes out of the freeze:

But inspecting the processes shows that it's actually the main window which is using CPU and not any extension or the extension host.

@kumarharsh what's your list of installed extensions?

@kumarharsh what would also be really helpful is collecting a CPU profile of the main window process when this happens. The steps for how to do this are described here https://github.com/Microsoft/vscode/wiki/Performance-Issues#the-rendererwindow-process-consumes-a-lot-of-cpu

I also saw a lot of freezing start with a recent VSCode update, and now after 1.28.0 ctrl+P is crashing after VSCode has been open for a few minutes, and everything is much slower than normal even while working.
code --status in the middle of a ctrl+P search hang yields nothing of interest that I see:
Version:          Code 1.28.0 (431ef9da3cf88a7e164f9d33bf62695e07c6c2a9, 2018-10-05T14:58:53.203Z)
OS Version:       Windows_NT x64 10.0.16299
CPUs:             Intel(R) Core(TM) i7-6820HQ CPU @ 2.70GHz (8 x 2712)
Memory (System):  15.79GB (3.39GB free)
VM:               0%
Screen Reader:    no
Process Argv:
GPU Status:       2d_canvas:                    enabled
checker_imaging:              disabled_off
flash_3d:                     enabled
flash_stage3d:                enabled
flash_stage3d_baseline:       enabled
gpu_compositing:              enabled
multiple_raster_threads:      enabled_on
native_gpu_memory_buffers:    disabled_software
rasterization:                enabled
video_decode:                 enabled
video_encode:                 enabled
webgl:                        enabled
webgl2:                       enabled
CPU %   Mem MB     PID  Process
0       75   25376  code main
0       74   13608     shared-process
0      254   26740     window (ΓùÅ unresolvedTokens.Tests.ps1 - ldxWorkspace (Workspace) - Visual Studio Code)
0       69   18568       searchService
0        6   19560       winpty-process
0      197   10008         C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe
0       10   12584         console-window-host (Windows internal process)
0      118   20216       watcherService
0       94   20556       extensionHost
0       37    8740         "C:\Users\tdrake\AppData\Local\Programs\Microsoft VS Code\Code.exe" "c:\Users\tdrake\AppData\Local\Programs\Microsoft VS Code\resources\app\extensions\json-language-features\server\dist\jsonServerMain" --node-ipc --clientProcessId=20556
0        6   28408       winpty-process
0      399   18848         C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe -NoProfile -NonInteractive -ExecutionPolicy Bypass -Command "& 'C:\Users\tdrake.vscode\extensions\ms-vscode.powershell-1.9.0\modules\PowerShellEditorServices\Start-EditorServices.ps1' -HostName 'Visual Studio Code Host' -HostProfileId 'Microsoft.VSCode' -HostVersion '1.9.0'-AdditionalModules @('PowerShellEditorServices.VSCode') -BundledModulesPath 'C:\Users\tdrake.vscode\extensions\ms-vscode.powershell-1.9.0\modules'-EnableConsoleRepl -LogLevel 'Normal' -LogPath 'C:\Users\tdrake.vscode\extensions\ms-vscode.powershell-1.9.0\logs\1539205049-82662100-5710-43bc-b45c-d1da8468ffb31539205045741\EditorServices.log' -SessionDetailsPath 'C:\Users\tdrake.vscode\extensions\ms-vscode.powershell-1.9.0\sessions\PSES-VSCode-25376-518528' -FeatureFlags @()"
0       10   21088         console-window-host (Windows internal process)
0      226   31716     gpu-process

Please provide a CPU profile when this happens. Pls see https://github.com/Microsoft/vscode/wiki/Performance-Issues

though it does get very slow sometimes.

When it gets slow please consult the Process Explorer  'Help>Open Process Explorer' and check whether the Extension Host process is consuming a lot of CPU. If it does, then please create a CPU profile of the Extension Host process ad described in the Performance wiki page.

I've been running into this issue quite a lot lately, though it only happens to me after VS code has been running for some time (eg, 2+ hours of consecutive development). As time goes on, the freezes happen more and more frequently, often getting to a point where it's freezing on each keystroke before I restart the program (which does resolve the freezing issues).

This first profile is of code when it's running fine (to provide some sort of baseline):

Version:          Code 1.28.1 (3368db6750222d319c851f6d90eb619d886e08f5, 2018-10-11T18:13:53.910Z)
OS Version:       Windows_NT x64 10.0.17134
CPUs:             Intel(R) Core(TM) i7-3770K CPU @ 3.50GHz (8 x 3510)
Memory (System):  15.69GB (4.02GB free)
VM:               0%
Screen Reader:    no
Process Argv:     C:\Users\dalla\Projects\my-proj\Desktop
GPU Status:       2d_canvas:                    enabled
                  checker_imaging:              disabled_off
                  flash_3d:                     enabled
                  flash_stage3d:                enabled
                  flash_stage3d_baseline:       enabled
                  gpu_compositing:              enabled
                  multiple_raster_threads:      enabled_on
                  native_gpu_memory_buffers:    disabled_software
                  rasterization:                enabled
                  video_decode:                 enabled
                  video_encode:                 enabled
                  webgl:                        enabled
                  webgl2:                       enabled
CPU %   Mem MB     PID  Process
    1       70   14956  code main
    0       89     248     window (Process Explorer)
    0       76    6028     shared-process
    1      192    9308     gpu-process
    2      416   12776     window (ΓùÅ create.component.ts - Desktop - Visual Studio Code)
    0       10    1740       electron-crash-reporter
    0      363   10372       extensionHost
    0       28    3192         C:\Users\dalla\.vscode\extensions\ms-vsliveshare.vsliveshare-0.3.790\dotnet_modules\vsls-agent.exe --autoexit --pipe 60868fd75fee4f93814c621d00ea620b --service https://insiders.liveshare.vsengsaas.visualstudio.com/
    0        5   12072           console-window-host (Windows internal process)
    0       29    7812         "C:\Users\dalla\AppData\Local\Programs\Microsoft VS Code\Code.exe" "c:\Users\dalla\AppData\Local\Programs\Microsoft VS Code\resources\app\extensions\html-language-features\server\dist\htmlServerMain" --node-ipc --clientProcessId=10372
    0       71    9956         electron_node server.js
    0      240   11896         electron_node server.js
    0       19   15060         "C:\Users\dalla\AppData\Local\Programs\Microsoft VS Code\Code.exe" "c:\Users\dalla\AppData\Local\Programs\Microsoft VS Code\resources\app\extensions\json-language-features\server\dist\jsonServerMain" --node-ipc --clientProcessId=10372
    0       47   16460         "C:\Users\dalla\AppData\Local\Programs\Microsoft VS Code\Code.exe" "c:\Users\dalla\AppData\Local\Programs\Microsoft VS Code\resources\app\extensions\css-language-features\server\dist\cssServerMain" --node-ipc --clientProcessId=10372
    0       65   17292         electron_node tslintServer.js
    0        5   18192         "C:\Program Files\Git\cmd\git.exe" -c core.quotepath=false -c color.ui=false blame --root --incremental --contents - -- src/app/core/models/content/ContentType.ts
    0        5   10156           console-window-host (Windows internal process)
    0        4   13428           git.exe -c core.quotepath=false -c color.ui=false blame --root --incremental --contents - -- src/app/core/models/content/ContentType.ts
    0      220   18344         electron_node tsserver.js
    0       17    1936           electron_node typingsInstaller.js typesMap.js
    0        5   18452       winpty-process
    0       46   11216         C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe
    0        3   18820           C:\WINDOWS\system32\cmd.exe /c ""C:\Users\dalla\AppData\Roaming\npm\ng.cmd" serve"
    0      581    7916             node   "C:\Users\dalla\AppData\Roaming\npm\\node_modules\@angular\cli\bin\ng" serve
    0      245   16692               electron_node worker.js
    0        8   18640         console-window-host (Windows internal process)
    0       14   18944       watcherService
    0        5    6748         console-window-host (Windows internal process)
Workspace Stats:
|  Window (ΓùÅ create.component.ts - Desktop - Visual Studio Code)
|    Folder (Desktop): 334 files
|      File types: ts(200) html(42) scss(42) js(20) json(9) png(4) svg(3)
|                  ico(2) eot(1) yml(1)
|      Conf files: package.json(1) tsconfig.json(1) tslint.json(1)
|                  settings.json(1)

This is a profile taken while it was frozen (the main thing I see is the window process is using significantly more CPU than normal):

Version:          Code 1.28.1 (3368db6750222d319c851f6d90eb619d886e08f5, 2018-10-11T18:13:53.910Z)
OS Version:       Windows_NT x64 10.0.17134
CPUs:             Intel(R) Core(TM) i7-3770K CPU @ 3.50GHz (8 x 3510)
Memory (System):  15.69GB (3.99GB free)
VM:               0%
Screen Reader:    no
Process Argv:     C:\Users\dalla\Projects\Liiingo\Desktop
GPU Status:       2d_canvas:                    enabled
                  checker_imaging:              disabled_off
                  flash_3d:                     enabled
                  flash_stage3d:                enabled
                  flash_stage3d_baseline:       enabled
                  gpu_compositing:              enabled
                  multiple_raster_threads:      enabled_on
                  native_gpu_memory_buffers:    disabled_software
                  rasterization:                enabled
                  video_decode:                 enabled
                  video_encode:                 enabled
                  webgl:                        enabled
                  webgl2:                       enabled
CPU %   Mem MB     PID  Process
    0       70   14956  code main
    1       86     248     window (Process Explorer)
    0       76    6028     shared-process
    0      221    9308     gpu-process
   20      388   12776     window (ΓùÅ create.component.ts - Desktop - Visual Studio Code)
    0       10    1740       electron-crash-reporter
    0      378   10372       extensionHost
    0       27    3192         C:\Users\dalla\.vscode\extensions\ms-vsliveshare.vsliveshare-0.3.790\dotnet_modules\vsls-agent.exe --autoexit --pipe 60868fd75fee4f93814c621d00ea620b --service https://insiders.liveshare.vsengsaas.visualstudio.com/
    0        5   12072           console-window-host (Windows internal process)
    0       29    7812         "C:\Users\dalla\AppData\Local\Programs\Microsoft VS Code\Code.exe" "c:\Users\dalla\AppData\Local\Programs\Microsoft VS Code\resources\app\extensions\html-language-features\server\dist\htmlServerMain" --node-ipc --clientProcessId=10372
    0       68    9956         electron_node server.js
    0      263   11896         electron_node server.js
    0       19   15060         "C:\Users\dalla\AppData\Local\Programs\Microsoft VS Code\Code.exe" "c:\Users\dalla\AppData\Local\Programs\Microsoft VS Code\resources\app\extensions\json-language-features\server\dist\jsonServerMain" --node-ipc --clientProcessId=10372
    0       47   16460         "C:\Users\dalla\AppData\Local\Programs\Microsoft VS Code\Code.exe" "c:\Users\dalla\AppData\Local\Programs\Microsoft VS Code\resources\app\extensions\css-language-features\server\dist\cssServerMain" --node-ipc --clientProcessId=10372
    0       65   17292         electron_node tslintServer.js
    0        5   18192         "C:\Program Files\Git\cmd\git.exe" -c core.quotepath=false -c color.ui=false blame --root --incremental --contents - -- src/app/core/models/content/ContentType.ts
    0        5   10156           console-window-host (Windows internal process)
    0        4   13428           git.exe -c core.quotepath=false -c color.ui=false blame --root --incremental --contents - -- src/app/core/models/content/ContentType.ts
    0      247   18344         electron_node tsserver.js
    0       17    1936           electron_node typingsInstaller.js typesMap.js
    0        5   18452       winpty-process
    0       46   11216         C:\WINDOWS\System32\WindowsPowerShell\v1.0\powershell.exe
    0        3   18820           C:\WINDOWS\system32\cmd.exe /c ""C:\Users\dalla\AppData\Roaming\npm\ng.cmd" serve"
    0      581    7916             node   "C:\Users\dalla\AppData\Roaming\npm\\node_modules\@angular\cli\bin\ng" serve
    0      245   16692               electron_node worker.js
    0        8   18640         console-window-host (Windows internal process)
    0       14   18944       watcherService
    0        5    6748         console-window-host (Windows internal process)
Workspace Stats:
|  Window (ΓùÅ create.component.ts - Desktop - Visual Studio Code)
|    Folder (Desktop): 334 files
|      File types: ts(200) html(42) scss(42) js(20) json(9) png(4) svg(3)
|                  ico(2) eot(1) yml(1)
|      Conf files: package.json(1) tsconfig.json(1) tslint.json(1)
|                  settings.json(1)

And finally, attached is the CPU profile. It froze 3-4 times while I was taking this profile, so hopefully there is something helpful in it.
CPU-20181016T182948.zip
I've disabled my extensions to see if removing them will help, but only time will tell.

@dallastjames re https://github.com/Microsoft/vscode/issues/60325#issuecomment-430450560 The cpu profile doesn't show any load, please profile when the machine isn't responding. Please file a separate issue. Thanks
@kumarharsh you didn't attach just a CPU profile but a full profile... It shows that everything is just slow on your machine, there isn't a single thing that stands out.

@jrieken that profile was taken while vscode was not responding ( the machine was still responsive it was just vscode that would hang ) and it hung multiple times during the profile. What I think is happening (for me at least) is that it is extension related and not an issue with vscode. I disabled all my extensions and haven't seen the problem come back so I've been adding back the extensions slowly to try to determine which one is the issue. So, I dont think vscode was the issue in my case. :)

and it hung multiple times during the profile.

So what do you mean by "hung"? For me that means you cannot interact with VS Code anymore, e.g. clicks aren't honoured, the cursor doesn't move anymore, etc. Does hung for you mean that it doesn't provide suggestions or squiggles anymore?

Yeah you're thinking the same as me. Code would stop responding: clicks are ignored, cant type, cant change files, no suggestions, etc. It would be in that state for 10-15 seconds at a time before it would become responsive again.

Same with me.

It unfreezes for some time, but if I type for 10 seconds, it freezes again

@jrieken as of now, attaching a CPU profile is not possible because when I start vscode with the debug extensions flag, the graphql-for-vscode fails to initialize and just prints '9' in the terminal. This is most probably an issue with the plugin, not vscode, but I haven't got around to investigate what it is exactly. I will attach a CPU profile after fixing that bug in the extension.

Ok, if it freezes then the CPU profile should show load. Extension run in a separate process so that extensions going crazy don't freeze the editor itself... So, please to CPU profile when things are getting freezy.


Fix Sentry Version

Use GIT_VERSION to display it in Sentry instead of package version
Closes: #3438

2023-01-25T10:07:48.520651Z  INFO version: git:2a54941f03d6c934396acee82c8e6bc13ebe42ea-modified failpoints: true, features: []
It's how the version will be sent to Sentry

Yeah, I was just wondering where will sentry know that this message comes from the pageserver binary? Because before this PR, it could had parsed the version string to know that. Does each pageserver have a different project in sentry, and so the SENTRY_DSN pointing to the project is to determine this?

yes, there are DSNs per each project


about mask prompt train

Have you conducted training with masks as prompts in videos? I noticed that your paper mentions related training.

Currently not. We current input high-freq component and patch embedding as the visual prompt, which can be directly obtained from the image. We are trying different prompts recently, some works will be releasing soon


Flaky proptest

https://github.com/firezone/firezone/actions/runs/10889378879/job/30217097456?pr=6705

The problem with this test is that in the test we keep the routes that we have in a BTreeMap but there's no track of what resource added the route, so if there are 2 CIDR resource that have the same route and we remove one of them the test will believe we no longer have that route when in reality we still have it due to the other resource.


add API GATEWAY API key to profile requests

need to track / monitor requests coming from server requests.
browser based requests will continue to use the profile-anonymous-consumer API gateway user
dependant upon https://github.com/unstoppabledomains/infrastructure/pull/270
deployed to staging:

SRE-1387
https://linear.app/unstoppable-domains/issue/SRE-1387/work-with-mobile-app-and-resolution-and-udme-and-ecomm-to-provide-them

/gcbrun

/gcbrun

/gcbrun

/gcbrun

/gcbrun

/gcbrun

/gcbrun


Fix link to github repo

Issue #19

Thanks @ilyankou . Looks like I caused that bug while renaming items in constants.js. Sorry!


Laravel-mix npm run production hangs at "91% additional asset processing" then exits to command line

Laravel Mix Version: 1.0.6
Node Version: 6.11.0
NPM Version: 5.0.3
OS: Ubuntu Server 16.04.2 LTS

Description:
During my application's deploy process, running npm run production causes laravel-mix and/or webpack to hang at 91% additional asset processing, and then exits to the command line without completing asset compilation. This issue has been mentioned on the webpack issue tracker and has been closed, but I can't seem to figure out what the actual solution is for a laravel-mix user, aside from updating everything to the latest version(s) which did not seem to help. I believe this is occurring because I have a very large SPA project with many Vue components and it is running out of memory while minifying/concatenating everything. (Running npm run dev works fine.) I don't know enough about webpack personally, I just use laravel-mix.
Steps To Reproduce:

Large single-page-app project with lots of Vue components and vue-router. (Sorry I cannot provide this.)

As a side note, the package.json file above also gives me issues with unmet peer dependencies when I run npm list --depth=0. I see an UNMET PEER DEPENDENCY for<EMAIL_ADDRESS>but also npm ERR! peer dep missing<EMAIL_ADDRESS>for multiple other packages. This is why I was trying to include them both somehow, but I don't know how to install multiple versions of webpack the correct way to meet these peer dependencies.

Check if your Ubuntu server has a pagefile. Like you have mentioned that it could be a lack of memory.

@ruchern It's a default Amazon EC2 instance, and apparently they don't have swap files enabled by default. (Running swapon -s gives an empty result.) I will look into setting up swap on it. Meanwhile, I'm wondering if there is any laravel-mix or webpack configuration that can take care of this, as well.

Create a swapfile 2x the size of the phyiscal ram.

I don't think laravel-mix or webpack has anything to do with this. It is definitely a lack of ram where npm actually needs.

@ruchern You sure about that? This comment says that "reading the string content should be avoided until you are done appending" -- so probably a webpack issue more than laravel-mix issue. I am just hoping that laravel-mix picks up the version of webpack that contains the fix, which is supposedly already fixed.

Ok, so I did two things to remedy this situation:

I rewrote my deploy script so that npm run production is run locally and then rsynced to the server. This alone solved the problem, but since memory was an issue and there was no swap enabled, I also...
Enabled swap as per this comment and made sure it was 2x the size of physical ram.

Things are working now, although I did step 1 first, so I haven't had a chance to confirm that the swap alone would resolve it.

@shorlbeck It happened to me on my production server where I only had 512MB of RAM. I added a 2 GB swapfile and the compiling continued past 91% additional processing.

.setPublicPath('public') worked here!

Anyone coming back to this page, I can confirm creating swapfile fixed the problem for me.
OS: Ubuntu 18.04.3 LTS
Node: 10.17.0
NPM: 6.11.3
Laravel-mix: 2.1.14
RAM: 4GB
Swap: 4GB

I had the same issue. sometimes it's working sometimes not.
@BibekStha as you suggest I created a swapfile now. now yarn production is working fine.
I Followed https://linuxize.com/post/how-to-add-swap-space-on-ubuntu-18-04/ this link
@BibekStha can u suggest tutorial for this or above link will work perfectly


Refactor Input component

[ ] Cleanup code
[ ] optimize
[ ] #7
[ ] #14

67222eff9e023605be5d4a8b14f816464e4bf53c closes this issue


Association between SQL and memory relations

Association from sql relation to memory relation does not seem to work.
  config.relation(:companies) do # default adapter is sql
    schema(:companies, infer: true) do
      associations do
        belongs_to :market_data, foreign_key: :symbol, view: :capitalization, override: true
      end
    end
  end

  config.relation(:market_data, adapter: :memory) do
    # do we need schema?
    schema do
      attribute :symbol, ROM::Types::String
      attribute :cap, ROM::Types::String
    end

    def capitalization(_assoc, companies)
      MARKET.select do |company|
        companies.pluck(:symbol).include? company[:symbol]
      end
    end
  end

Full example
require 'rom'
require 'rom-repository'
require 'rom-sql'
require 'logger'
require 'pry'

gateways = {
default: [:sql, 'sqlite::memory'],
memory: [:memory]
}
rom = ROM.container(gateways) do |config|
sql = config.gateways[:default].connection

sql.create_table(:companies) do
  primary_key :id
  column :name, String
  column :symbol, String
end

config.relation(:companies) do
  schema(:companies, infer: true) do
    associations do
      belongs_to :market_data, foreign_key: :symbol, view: :capitalization, override: true
    end
  end
end

config.relation(:market_data, adapter: :memory) do
  # do we need schema?
  schema do
    attribute :symbol, ROM::Types::String
    attribute :cap, ROM::Types::String
  end

  def capitalization(_assoc, companies)
    MARKET.select do |company|
      companies.pluck(:symbol).include? company[:symbol]
    end
  end
end
end

companies = rom.relations[:companies]
companies.changeset(:create, [{ name: 'Google', symbol: 'GOOG' }]).commit
companies.changeset(:create, [{ name: 'Facebook', symbol: 'FB' }]).commit
companies.changeset(:create, [{ name: 'Apple', symbol: 'AAPL' }]).commit

# Our external source of market data
MARKET = [
{ symbol: 'FB',   cap: '518B' },
{ symbol: 'GOOG', cap: '754B' },
{ symbol: 'AAPL', cap: '895B' }
]

result = companies
       .where(symbol: ['FB', 'AAPL'])
       .combine(:market_data)

$ ruby sql_memory_combine.rb
/home/cutalion/.rvm/gems/ruby-2.4.1/gems/rom-sql-2.4.0/lib/rom/sql/associations/many_to_one.rb:15:in `call': undefined method `qualified' for #<ROM::Memory::Schema:0x00000003971910> (NoMethodError)
	from /home/cutalion/.rvm/gems/ruby-2.4.1/gems/rom-sql-2.4.0/lib/rom/sql/associations/many_to_one.rb:50:in `prepare'
	from /home/cutalion/.rvm/gems/ruby-2.4.1/gems/rom-core-4.1.2/lib/rom/relation.rb:301:in `eager_load'
	from /home/cutalion/.rvm/gems/ruby-2.4.1/gems/rom-core-4.1.2/lib/rom/relation.rb:290:in `node'
	from /home/cutalion/.rvm/gems/ruby-2.4.1/gems/rom-core-4.1.2/lib/rom/support/memoizable.rb:47:in `block (2 levels) in define_memoizable_names!'
	from /home/cutalion/.rvm/gems/ruby-2.4.1/gems/rom-core-4.1.2/lib/rom/relation.rb:271:in `block in nodes'
	from /home/cutalion/.rvm/gems/ruby-2.4.1/gems/rom-core-4.1.2/lib/rom/relation.rb:268:in `each'
	from /home/cutalion/.rvm/gems/ruby-2.4.1/gems/rom-core-4.1.2/lib/rom/relation.rb:268:in `reduce'
	from /home/cutalion/.rvm/gems/ruby-2.4.1/gems/rom-core-4.1.2/lib/rom/relation.rb:268:in `nodes'
	from /home/cutalion/.rvm/gems/ruby-2.4.1/gems/rom-core-4.1.2/lib/rom/relation.rb:252:in `combine'
	from /home/cutalion/.rvm/gems/ruby-2.4.1/gems/rom-core-4.1.2/lib/rom/support/memoizable.rb:47:in `block (2 levels) in define_memoizable_names!'
	from sql_memory_combine.rb:60:in `<main>'

Download example

This is clearly a bug. rom-sql assumes that the other schema must be qualified too. I'm not entirely sure how to solve it at the moment, but probably adding this interface to core wouldn't be such a bad idea. WDYT @flash-gordon ?

I'm not sure it would make sense for other gateways/adapters (how do call all rom-whatever gems?)
What if we qualify schema right before calling it. In the ROM::SQL::Schema#call method?

@solnic but we qualified schemas in rom-sql 2.0, I believe those .qualified calls aren't even needed. Specs from rom-sql and rom/repo passing

@flash-gordon I thought about it before 2.0 final was released, but I realized it would create an implicit requirement that associations can only work when relations are qualified, and you may end up with un-qualified attributes by a mistake...on the other hand, current auto-qualification in associations is...implicit behavior 😆 So, we could try removing it and test it out with real apps to make sure (at least we) don't have use cases where some code actually relies on auto-qualification in associations.

We ran into this issue as well. Kind of a bummer and now we are just going to move the yaml relation to sql

OK let's finally address it in 5.0 and rom-sql 3.0