Release OSB 1.7.0

Is your feature request related to a problem? Please describe
Release OpenSearch 1.7.0
Important Dates and Deadlines

Announce Code Freeze Date and Release Date on Public Slack Community Channel: 6/11/2024
Code Freeze Date: 6/18/2024
Release Date: 6/20/2024

Ran into an issue during release process. We were able to release to PyPi and are able to pull in the latest version and confirm it works. However, when we were testing Dockerhub staging, we came across the following error.
benchmark@c5aca43430ba:~$ opensearch-benchmark --help
Traceback (most recent call last):
  File "/usr/local/bin/opensearch-benchmark", line 5, in <module>
    from osbenchmark.benchmark import main
  File "/usr/local/lib/python3.11/site-packages/osbenchmark/benchmark.py", line 37, in <module>
    from osbenchmark import version, actor, config, paths, \
  File "/usr/local/lib/python3.11/site-packages/osbenchmark/test_execution_orchestrator.py", line 33, in <module>
    from osbenchmark import actor, config, doc_link, \
  File "/usr/local/lib/python3.11/site-packages/osbenchmark/worker_coordinator/__init__.py", line 26, in <module>
    from .worker_coordinator import (
  File "/usr/local/lib/python3.11/site-packages/osbenchmark/worker_coordinator/worker_coordinator.py", line 44, in <module>
    from osbenchmark import actor, config, exceptions, metrics, workload, client, paths, PROGRAM_NAME, telemetry
  File "/usr/local/lib/python3.11/site-packages/osbenchmark/workload/__init__.py", line 25, in <module>
    from .loader import (
  File "/usr/local/lib/python3.11/site-packages/osbenchmark/workload/loader.py", line 41, in <module>
    from osbenchmark.workload import params, workload
  File "/usr/local/lib/python3.11/site-packages/osbenchmark/workload/params.py", line 42, in <module>
    from osbenchmark.utils.dataset import DataSet, get_data_set, Context
  File "/usr/local/lib/python3.11/site-packages/osbenchmark/utils/dataset.py", line 13, in <module>
    import h5py
  File "/usr/local/lib/python3.11/site-packages/h5py/__init__.py", line 25, in <module>
    from . import _errors
  File "h5py/_errors.pyx", line 1, in init h5py._errors
ValueError: numpy.dtype size changed, may indicate binary incompatibility. Expected 96 from C header, got 88 from PyObject

We were able to discover the root cause was due to the recent numpy 2.0.0 release and how it conflicts with h5py 3.10.0. Our local desktops did not encounter this issue b, the Docker container only had Python 3.11 installed and needed to pull in numpy, which is why it pulled in the latest version.
We can either solve this either by restricting the setup.py to use numpy versions less than 2.0.0 or we can remove the restriction for h5py in this line of the dockerfile
https://github.com/opensearch-project/opensearch-benchmark/blob/fcf4c9cac3dd6c8b834b1f67a9b2f0f4abd67b4d/docker/Dockerfile#L18

Since this impacted the Docker image, we will go ahead and do a copy-over. We'll re-release with a patch version.

I think rather than bumping to a major version let us pin the numpy to last released 1.x version, which is 1.26.4.


[WIP] Swift 2.0

#95

@daltoniam could you make a CocoaPods release for Swift 2.0 compatibility?

@vyshane You can do pod 'Starscream', :git => 'https://github.com/daltoniam/Starscream.git', :branch => 'Swift-2.0'

@ricardopereira Ah, sweet! TIL.

@ricardopereira thank you much. @vyshane I most certainly will once Swift 2.0 goes full release. In the mean time @ricardopereira is the right approach until then.


(docs) Use fully qualified docs URLs

Changes to the docs site structure resulted in changed or removed
redirects for absolute URLs (ie. /puppet/latest/...) as well as
for URLs referring to the references subdirectory.
Update Markdown docs in comments and heredocs to use fully
qualified URLs (https://puppet.com/docs/...) and update their
targets to avoid relying on redirects that no longer exist.

CC @jbondpdx


Terminal access

Hi, thank you for this. Made my life so much easier :) Is there any possibility to enable/disable the init option for the default scene directly from the terminal/cmd before opening the notebook?

Not officially, sorry. But you could modify the notebook by sed or something like that. Basically in the notebook metadata, there is a substruct "scenes_data" which has a key "init_scene". If it is null, no scene is an init scene. If it points to a scene name, this scene will be the init scene. What I could do, though, is to add an option "suppress_init": true/false so that you wouldn't loose information by switching off the initialization.


Fix broken link

Removed extra parenthesis.

@skwan,
Thanks for your contribution as a Microsoft full-time employee or intern. You do not need to sign a CLA.
Thanks,
Microsoft Pull Request Bot

@skwan : Thanks for your contribution to the Azure documentation! The author, @bryanla, has been notified to review your proposed change.

Thanks @skwan
#sign-off


Add undefined-function, which will be called, if a function is undefined

undefined-function may be predefined like this
(def undefined-function (macro extern (name rest))
  (def args (var auto \ (get-varargs-list mc (- (arg-count mc) 1) rest)))
  (report-undefined-function-error name args)
  (exit 1)))

This only is useful, if in different contextes different version of this function may be used. Normally in some special package (for example the current package for debug reasons).
This would require, that functions of some package will use the version of undefined-function as it is defined in this package, even if it is not imported to the current package, which the functions would belong to.
(for example when you call (pkg.fn args) (pkg.undefined-function pkg.fn args) will be called.
This will enable some nice features I have in mind. See referencing issue

I think there are other ways to handle this in general, and
particularly in the context of #155.  For example, rather than
expanding argument forms to safe.{name}, safe could instead expand
them to convert-to-safe {name}, which could use the various exists
functions from the introspection module to determine what to do.

yes, in most cases this can be done in different ways. And if there is really a case, where undefined-function is really helpful, there could be written a macro, which converts all function calls inside into (call-or-undefined fn …), a macro which expands to undefined-function or to the function call.
(which is similar to safe)
But it's currently not that easy to write such macros, since macro expansion seems not to work correctly and there is no way to manually macroexpand something (see #157)


PyTorch installation errors [BUG]

Bug description
I did an install of the PyTorch version of Transformers4Rec and tried to run the example code in the ReadMe. However, the needed torchmetrics library was not automatically installed and needed to be installed by hand.
After installing torchmetrics manually following error appeared:
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-4-77b1c0b67bb1> in <module>()
----> 1 from transformers4rec import torch as tr
      2
      3 schema: tr.Schema = tr.data.tabular_sequence_testing_data.schema
      4 # Or read schema from disk: tr.Schema().from_json(SCHEMA_PATH)
      5 max_sequence_length, d_model = 20, 64

8 frames
/usr/lib/python3.7/importlib/util.py in find_spec(name, package)
    112         else:
    113             if spec is None:
--> 114                 raise ValueError('{}.__spec__ is None'.format(name))
    115             return spec
    116

ValueError: transformers.__spec__ is None

Steps/Code to reproduce bug

Install PyTorch version.
Try the example code.

Expected behavior
Automatic installation of depenencies.
Environment details

Transformers4Rec version: 0.1.1
Platform: Google Colab
Python version: 3.7.12
Huggingface Transformers version: 4.9.2
PyTorch version (GPU?): 1.9.0+cu102
Tensorflow version (GPU?): 2.6.0

@pintonos thanks for reporting this. Please do pip install torchmetrics==0.3.2. This will fix the error. If you are using our nvcr.io/nvidia/merlin/merlin-pytorch-training:21.09 docker images, torchmetrics should be installed automatically. Feel free to respond if you still have issues/questions.

We should make this clearer in our docs. In order to install all dependencies for the PyTorch part of the API you can run: pip install "transformers4rec[pytorch]"

We should make this clearer in our docs. In order to install all dependencies for the PyTorch part of the API you can run: pip install "transformers4rec[pytorch]"

@marcromeyn we already have pip install transformers4rec[torch,nvtabular] in the docs. You suggest to add more explanation around that?

It seems there is a difference between transformers4rec[torch,nvtabular] and transformers4rec[pytorch,nvtabular]. Latter is working fine.

@pintonos thanks! we will fix the README.

@rnyak fixed the README to have the correct torch install instructions in #260 - closing


wayland-server: ListeningSocket has no way to bind to a passed socket FD

ListeningSocket in wayland-server has no constructor that takes an OwnedFD, which makes it impossible to use it to implement Wayland socket handover as described in the KDE wiki.
Wayland socket handover makes it possible for a compositor to recover from crashes without the whole session dying with it, and also makes it possible to implement things like Systemd socket activation for Wayland in the future.
What's missing is a constructor for ListeningSocket that takes an OwnedFD and the socket name, and uses wl_display_add_socket_fd() to add the socket FD to the display. As far as I know, the lock file is supposed to be locked by the creator of the socket, not the receiving compositor.

I looked at the implementation of ListeningSocket and it seems to be built on the assumption that it owns the socket and the lock file. If I understand this correctly, a passed socket that is not owned by the compositor would need a different wrapper type then.


Patch 2

This PR is stale because it has been open 45 days with no activity. Remove stale label or comment or this will be closed in 10 days.


Android does not work, bad Read Me

If you create a new project, then follow your Read Me for React-Native versions > .30, it will not build.

Dear parkerdan,
The readme contains The installation for Android which supports react-native versions > 30.
You may check it more carefully, and you can try the full demo(https://github.com/cyqresig/ReactNativeComponentDemos).

Yeah... I did...your instructions are still wrong.  I forked it, fixed it, and improved it...but thanks for getting the ball rolling on this much needed package.

@parkerdan How did you get this to work? I am still failing

See my GitHub,

On Nov 3, 2016, at 12:15 PM, Dennis Wamala<EMAIL_ADDRESS>wrote:
@parkerdan How did you get this to work? I am still failing
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

Thanks @parkerdan


Add deprecated repair JMX API tests

Test for CASSANDRA-9570.
In the future, when @Deprecated repair methods are removed, this test will be obsolete.

Do these deprecated methods only exist in 2.2? Why are we not testing them in previous versions?

These are deprecated in 2.2 and no longer used from nodetool repair. So 2.1 and before are (kind of) tested through repair test.
From 2.2, nodetool uses unified repairAsync method.

+1, thanks.


Improve ungrouped query

Refer #262

improve implementation of ungrouped query API
fix and add small tests
fix large tests

@yongpingchen LGTM!


The large md file cannot be opened, the program crashes after clicking

System Info
My system is win11, using qwen1.5-7b.gguf,bge-large-zh-v1.5
Environment/Platform

[ ] Website/web-app
[ ] Browser extension
[ ] Server-side (e.g., Node.js, Deno, Bun)
[X] Desktop app (e.g., Electron)
[ ] Other (e.g., VSCode extension)

Description
Put large md file cannot be opened, click on the md file program immediately crashes
Reproduction
1.Open large md file program crashes

Hi there. 👋  I think this issue is meant for another repo (since we do not support running .gguf models). If it is for transformers.js, please provide more information and you can reopen the issue.


[c++] SOMAArray::write Modified To Take in ArrayBuffers

Issue and/or context:
Separated out from PR https://github.com/single-cell-data/TileDB-SOMA/pull/1449.
Changes:
Previously, SOMAArray write buffers were set with set_column_buffer. The write function now takes in an ArrayBuffers data structure directly.
Notes for Reviewer:
N/A

Codecov Report
Patch coverage has no change and project coverage change: -11.83 :warning:

Comparison is base (63ec394) 64.05% compared to head (0de0243) 52.23%.

:exclamation: Current head 0de0243 differs from pull request most recent head 93f9fab. Consider uploading reports for the commit 93f9fab to get more accurate results

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.
Additional details and impacted files
@@             Coverage Diff             @@
##             main    #1476       +/-   ##
===========================================
- Coverage   64.05%   52.23%   -11.83%
===========================================
  Files          99       71       -28
  Lines        8219     5764     -2455
===========================================
- Hits         5265     3011     -2254
+ Misses       2954     2753      -201

Flag
Coverage Δ

python
?

r
52.23% <ø> (+0.18%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.
see 35 files with indirect coverage changes

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


chore(curriculum): validate registration form project

Checklist:

[x] I have read freeCodeCamp's contribution guidelines.
[x] My pull request has a descriptive title (not a vague title like Update index.md)
[x] My pull request targets the main branch of freeCodeCamp.
[x] I have tested these changes either locally on my machine, or GitPod.

Closes #46540

I decided to break the step into two, because this is still early and I don't want to overwhelm the campers

running

npm run update-step-titles

gave me this error

there were two duplicated step 42 and step 43, I had to delete them and fix the meta

npm run update-step-titles

runs without issue, but it won't hurt to double-check if I did something wrong

@lasjorg I have cleared tab issues 👍

@moT01 nice catch, I deleted a step after the merge conflict. but I can't recreate it npm run lint:challenges run with error, I will open a third pr


[request] need to add dev/prod build support

Should be added trigger between prod/dev build based on node env to be able to provide optimized resourses for production usage

the trigger is not necesary due to minification functionality should be hanlded on end-user side.
For manual usage of the bundle in production index.production.js is created


Parameterized query

Is it possible to use this library to create a SPARQL query using parameters? I'm trying to avoid string concatenation for building my queries, but I can't find any library that does this.
For example:
    sparql = SPARQLWrapper ("endpoint")
    sparql.setQuery ('select * where { ?sbj ex:name "' + name + '" }')

should be instead
    sparql = SPARQLWrapper ("endpoint")
    sparql.setQuery ('select * where { ?sbj ex:name $name }', name='Alice')

From: the RDFLib SPARQL intro documentation:  “Variables can also be pre-bound, using initBindings kwarg can be used to pass in a dict of initial bindings, this is particularly useful for prepared queries, as described below.”
https://rdflib.readthedocs.io/en/stable/intro_to_sparql.html#prepared-queries

I've tried that example already, but I can't get initBindings to work with a SPARQL endpoint + JSON return format.

It's a feature of RDFLib sparql queries of RDFLib graphs: “The method rdflib.plugins.sparql.prepareQuery() takes a query as a string and will return a rdflib.plugins.sparql.sparql.Query object. This can then be passed to the rdflib.graph.Graph.query() method.” As you've discovered, SPARQLWrapper doesn't support this feature but it is possible to use the RDFLib library to create a SPARQL query using parameters.

The problem is

the Graph() object doesn't seem to be able to connect to SPARQL endpoints, only to local, in-memory stores
SPARQLWrapper only accepts a string, not a Query() object
the Query() object doesn't have a "convert_to_string_with_bindings()" functionality


Question: how to markdown spacebars?

Hi,
I tried to markdown the following and couldn't succeed marking down spacebars:
{{#template name="markdownBody"}}

  <template name="yourTemplate">
    {{#fixedDrawer args 200 options}}
      Your content
    {{/fixedDrawer}}
  </template>

{{/template}}

Any guidance on this would be very much appreciated! Thanks!

I think it would just work if you did this:
{{#template name="yourTemplate"}}
    {{#fixedDrawer args 200 options}}
      Your content
    {{/fixedDrawer}}
{{/template}}

I'm sorry I meant this:
{{#template name="markdownBody"}}

##Syntax
` ` `
  <template name="yourTemplate">
    {{#fixedDrawer args 200 options}}
      Your content
    {{/fixedDrawer}}
  </template>
` ` `

{{/template}}

I want to show the spacebar code like how GitHub markdown displays spacebar code.

Ohh, yeah is your problem that it's parsing the {{ tags?
In that case you can declare a global helper that just returns "{{" and use the helper; you might also be able to use the HTML entities for the brackets.

Thanks a lot! Got it worked now!


Rename tip to master in travis build file

Travis favors master now, and gimme even fails in some cases with "tip".

Coverage remained the same at 91.423% when pulling 4832eb1528c76d32fe8fd01875e70b247cc47c6d on kernle32dll:fix-tip-naming into 72f342f3f4a3468579ccf0aee996db5925bad2e1 on tarent:master.


Is it possible to get rid of ads in site search?

e.g. a search for 'metadata' returns with the following. I think it doesn't help with site clarity. Don't know how search is set up, so possibly we're stuck with it.

The search uses Google Custom Search Engine:
https://cse.google.com/cse/
I've investigated removing the ads, but I don't think it's possible unless we change to a different search mechanism.
We use the Docsy theme on top of Hugo static site generator. Hugo mentions a few search options:
https://gohugo.io/tools/search/
If we do decide to implement a different search, we should consider contributing the solution to the Docsy theme.

/help-wanted

/area docs
/priority p2


Add cloud-builds to list of filtered Pub/Sub topics.

cloud-builds is another gcp service topic. It should not show up in the list of topics to manage.

Also add the repository-changes.* topics to the list. I wish we would have a common prefix to mark the built-in topics.

are there any repository-changes.* other than repository-changes.default?

Yes, there's a topic per repository created in the project.

Thinking on moving to Q3, is this something you can take care of this week?

I can take care of it this week.

Great, thank you for taking care of it.


Could not init the profile: Error: access_denied, message=Signature is invalid

Hey there,
I am getting the error message in the title when trying to initialize a profile with: ksm profile init XX:...; I thought maybe I did get the secret token wrong in the first place, but when I tried to remove one random character from it, ksm bailed out with a different error message instead (which leads me to believe that the token might indeed be correct):
Error: Could not init the profile: Error: access_denied, message=Unable to validate application access

So what am I doing it wrong? Do you know what could be going on here? I even did a little bit of printf-debugging, but unfortunately it did not lead me anywhere interesting:

Request URL: https://keepersecurity.com/api/rest/sm/v1/get_secret
Request Headers: {'Content-Type': 'application/octet-stream', 'Content-Length': '310', 'PublicKeyId': '10', 'TransmissionKey': 'BK7fpjoKwHtRQO L15TwAcIhHqPmyq0cPJIRCXJubgeI3Ld+K4yHgCun8RI3TgPa+rEgqTl4MYDGd7ZK+KHtZCdhKeZqfmnGvDBRLFRkHEUHWrzNkdD+Lv3n5n4MqcKps3WwXyGtZzzYEkpuR1t+10Lpya7aAxCtpxvQoe90=', 'Authorization': 'Sig nature MEUCIFLGmtaF64ZtanwMnjTeI3v/Sq1K+7Ovz7DYFmk2APOSAiEAqafS7ll9ioK5eIK6CfA2zcvdO8i0ezPHuqKwSl2EuYo='}
Response content: {"path":"https://keepersecurity.com/api/rest/sm/v1/get_secret, POST, p ython-requests/2.27.1","additional_info":"","location":"default exception manager - api validation exception","error":"access_denied","message":"Signature is invalid"}

Also, I tried running ksm profile init ... from different OSes (Windows, Ubuntu, and MacOS), but the error message is always the same.
Thanks in advance,
M.

@iamFIREcracker
That means that the token has already been initialized. Here is a screenshot of the same error I got when I tried to use already initialized token.

In the above you can see that I successfully initialized one time token, then I tried to reinitialized the same token and got the same error as you did.
You can only initialize a new token that has never been used before.

Alright, I spent a little bit more time on this today, and I think the issue I experienced had something to do with file permissions:

I created a new Application (on Keeper) and saved the activation token somewhere; popped open a new terminal, typed in: ksm profile init --token ..., an it just worked!

I tested this with different OSes:

MacOS w/ pip-installed ksm
Ubutnu 20.04 LTS w/ pip-installed ksm
Windows PowerShell w/ manually-installed "Keeper Secrets Manager CLI"

I created another application and saved the activation token somewhere; clicked on the "Keeper Secrets Manager CLI" (basically a link to keeper-ksm.exe shell), typed in: profile init --token ..., but then the ksm shell window abruptly closed; I could see an error message being logged, but I actually had to record my screen to see what was going on (I could not catch the error on time):ksm had a problem: [Errno 13] Permission denied: 'C:\\Program Files (x86)\\Keeper Secrets Manager CLI\\keeper.ini'

So, in retrospect, I think Keeper was successfully able to verify my authentication code; it's just that it crashed after that, while trying to store the result inside the .ini file, so when I tried to use the same authentication token again, it found it already being used and threw that "Invalid signature" error back at me.
Could have the error message been clearer? Could have the app caught the original permissions-related issue, gracefully? Yes, sure, but I am glad I were finally able to make this work.
Thanks again for the support,
M.


chore(weave): Move shared trace server components into trace_server_common and exclude trace_server from dist

Move files under trace_server that are used by the client into trace_server_common
trace_server is excluded from the build

Companion: https://github.com/wandb/core/pull/24677

Added core companion


the package did not work on azure app service

Hi everyone,
I ran this function on the azure app service and got this error.
function :
const bufferPdf = async (html, options) => {
try {
return new Promise((resolve, reject) => {
pdf.create(html, options).toBuffer(function (err, buffer) {
if (err) {
return reject(err);
}
resolve(buffer);
});
});
} catch (e) {
console.log('ERROR [bufferPdf]:', e);
}
};
the Error :
2022-05-13T19:14:38.225244279Z: [ERROR]  events.js:377
2022-05-13T19:14:38.225273879Z: [ERROR]        throw er; // Unhandled 'error' event
2022-05-13T19:14:38.225279879Z: [ERROR]        ^
2022-05-13T19:14:38.225283879Z: [ERROR]
2022-05-13T19:14:38.225287679Z: [ERROR]  Error: write EPIPE
2022-05-13T19:14:38.225291579Z: [ERROR]      at afterWriteDispatched (internal/stream_base_commons.js:156:25)
2022-05-13T19:14:38.225303979Z: [ERROR]      at writeGeneric (internal/stream_base_commons.js:147:3)
2022-05-13T19:14:38.225309279Z: [ERROR]      at Socket._writeGeneric (net.js:787:11)
2022-05-13T19:14:38.225313379Z: [ERROR]      at Socket._write (net.js:799:8)
2022-05-13T19:14:38.225317179Z: [ERROR]      at writeOrBuffer (internal/streams/writable.js:358:12)
2022-05-13T19:14:38.225321079Z: [ERROR]      at Socket.Writable.write (internal/streams/writable.js:303:10)
2022-05-13T19:14:38.225325179Z: [ERROR]      at PDF.PdfExec [as exec] (/home/site/wwwroot/node_modules/html-pdf/lib/pdf.js:156:15)
2022-05-13T19:14:38.225329079Z: [ERROR]      at PDF.PdfToBuffer [as toBuffer] (/home/site/wwwroot/node_modules/html-pdf/lib/pdf.js:46:8)
2022-05-13T19:14:38.225332979Z: [ERROR]      at /home/site/wwwroot/services/email.service.js:22:33
2022-05-13T19:14:38.225336679Z: [ERROR]      at new Promise ()
2022-05-13T19:14:38.225341079Z: [ERROR]  Emitted 'error' event on Socket instance at:
2022-05-13T19:14:38.225344879Z: [ERROR]      at emitErrorNT (internal/streams/destroy.js:106:8)
2022-05-13T19:14:38.225348579Z: [ERROR]      at emitErrorCloseNT (internal/streams/destroy.js:74:3)
2022-05-13T19:14:38.225352278Z: [ERROR]      at processTicksAndRejections (internal/process/task_queues.js:82:21) {
2022-05-13T19:14:38.225356078Z: [ERROR]    errno: -32,
2022-05-13T19:14:38.225369278Z: [ERROR]    code: 'EPIPE',
2022-05-13T19:14:38.225373078Z: [ERROR]    syscall: 'write'
2022-05-13T19:14:38.225376478Z: [ERROR]  }

Hi. Locally working fine but I got the same error when the code is running on a Linode server. (and the server crashes somehow after pdf generate error 502 Bad Gateway)
events.js:377
      throw er; // Unhandled 'error' event
      ^

Error: write EPIPE
    at afterWriteDispatched (internal/stream_base_commons.js:156:25)
    at writeGeneric (internal/stream_base_commons.js:147:3)
    at Socket._writeGeneric (net.js:798:11)
    at Socket._write (net.js:810:8)
    at writeOrBuffer (internal/streams/writable.js:358:12)
    at Socket.Writable.write (internal/streams/writable.js:303:10)
    at PDF.PdfExec [as exec] (/opt/app/node_modules/html-pdf/lib/pdf.js:156:15)
    at PDF.PdfToBuffer [as toBuffer] (/opt/app/node_modules/html-pdf/lib/pdf.js:46:8)
    at /opt/app/dist/template/services/PdfService.js:8:30
    at new Promise (<anonymous>)
Emitted 'error' event on Socket instance at:
    at emitErrorNT (internal/streams/destroy.js:106:8)
    at emitErrorCloseNT (internal/streams/destroy.js:74:3)
    at processTicksAndRejections (internal/process/task_queues.js:82:21) {
  errno: -32,
  code: 'EPIPE',
  syscall: 'write'

code: https://github.com/MaurerKrisztian/template-api-tm

@AriGabay I found some solution:
If I understand correctly the problem is this package need fonts and try to reach phantomJs but not exist in the environment
https://github.com/marcbachmann/node-html-pdf/issues/612#issuecomment-854249720
https://github.com/marcbachmann/node-html-pdf/issues/35#issuecomment-155144094

Exactly same issue...
I cant solve it...
I try to add config option in many ways this no luck...
phantomPath: "../../../node_modules/phantomjs-prebuilt/bin/phantomjs",

phantomPath: "../../../node_modules/phantomjs/bin/phantomjs",

phantomPath: "./node_modules/phantomjs/bin/phantomjs",

Any luck? Facing a similar issue on my Azure App Service with Node 18 - LTS (18.16.0).

@shreyasgombi I think I managed to solve it, but it was a while ago, I don't quite remember what exactly I tried. I hope this Dockerfile helps https://github.com/MaurerKrisztian/template-api-tm/blob/main/Dockerfile

I'm creating HTML and converting it to pdf with jspdf,jspdf-autotable

@shreyasgombi I think I managed to solve it, but it was a while ago, I don't quite remember what exactly I tried. I hope this Dockerfile helps https://github.com/MaurerKrisztian/template-api-tm/blob/main/Dockerfile

Any idea how to use the Docker file on Azure App Service (Web App)? I'm a newbie to Azure app service. Should I include it in my app project and build?

@shreyasgombi I think I managed to solve it, but it was a while ago, I don't quite remember what exactly I tried. I hope this Dockerfile helps https://github.com/MaurerKrisztian/template-api-tm/blob/main/Dockerfile

Any idea how to use the Docker file on Azure App Service (Web App)? I'm a newbie to Azure app service. Should I include it in my app project and build?

Idk, I don't use Azure.

@shreyasgombi I think I managed to solve it, but it was a while ago, I don't quite remember what exactly I tried. I hope this Dockerfile helps https://github.com/MaurerKrisztian/template-api-tm/blob/main/Dockerfile

Any idea how to use the Docker file on Azure App Service (Web App)? I'm a newbie to Azure app service. Should I include it in my app project and build?

Idk, I don't use Azure.

Ah, ok. got it. May be @AriGabay can suggest?

The Docker file needs to be in the backend (App Service).
I think you should use jspdf,jspdf-autotable for creating a pdf file.

Ok,
So adding this bash -c "apt-get install libfontconfig -y && /opt/startup/init_container.sh" to the Startup Command did the job!
Thanks for the help though. 😃 ❤

This can be resolved in Azure by going to the Web App container in portal.azure.com, and under Settings -> Configuration -> General Settings -> Startup Command change to, for example,
apt install libfontconfig -y && OPENSSL_CONF=/etc/ssl/ npm start
This will add the correct font library and fix phantomjs's SSL error that you'd get after that's resolved.


Plugin ut

Codecov Report

:exclamation: No coverage uploaded for pull request base (main@275f371). Click here to learn what that means.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main       #3   +/-   ##
=======================================
  Coverage        ?   68.88%
=======================================
  Files           ?        2
  Lines           ?      225
  Branches        ?       41
=======================================
  Hits            ?      155
  Misses          ?       50
  Partials        ?       20

Help us with your feedback. Take ten seconds to tell us how you rate us.


Bubble sort python

Add bubble sort (python)
Issue #41
FileName BubbleSort.py

This branch of yours cannot be merged, as the base branch you chose earlier was the master branch, and it has C++ implementations. Just copy this code into a new branch made made from the python branch and then push to the python branch. Sounds a bit complicated, I know


[Bug]: Cookie SameSite "none" not available as an option

Package
lucia-auth
Describe the bug
The sameSite attribute for cookies allows "lax" and "strict" but is missing "none".
https://github.com/lucia-auth/lucia/blob/83960e28021d3515aa0144f70906cc09740a1f97/packages/lucia/src/auth/cookie.ts#L9
https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/Set-Cookie#samesitesamesite-value
Is there a reason for this?
I can create a PR to add it but wanted to check first.

Third party cookies are being deprecated by browsers, so I don’t see a reason to support it

Ah gotcha, that makes sense.
Any suggestions on displaying authenticated content inside an iframe on a different domain securely?

Makes sense. Yeah if you could make a PR for it, I can merge it


There is no validation when inputting an App Setting name with more than 64 characters

OS: Win10
Build Version: 20210816.16
Regression: Not a regression
Repro Steps:

F1 --> Azure Static Web App: Add New Setting... --> Select one Static Web App -> Select environment -> Input an App Setting name with more than 64 characters.
Check whether there is a validation for the invalid app setting name.

Expect:
There is a validation "App setting key cannot be more than 64 characters in length.".
Actual:
There is no validation.
More Info:

This issue also reproduces on the previous released Static Web Apps extension 0.7.1.
An error occurs when adding the new setting which name contains more than 64 characters.

The key character length limits for App Service and Functions appear to be different:
App Service:
Linux: 100 characters
Windows: No limit
Functions:
100 characters

This issue has become stale and is at risk of being closed. The community has 60 days to upvote the issue. If it receives 5 upvotes we will keep it open and take another look. If not, we will close it. To learn more about how we handle issues, please see our documentation.
Happy Coding!


Implementing TTL capability to saveAll overwritten methods

I added the TTL tests for the saveAll methods. The default TTL set through the annotation for the JSON repository is not working.

The code looks good so far... I'll work on it today (Sep 5th) and I'll send it back for review.


Check panel if panel is NGS panel

Issue to address the error of obtaining an empty json when pulling an non NGS panel.

This issue is resolved in commit ce2aea5


Saving to netCDF with 0D dimension doesn't work

I'm using xarray 0.9.1.
When I have an array
<xarray.Dataset>
Dimensions:       (category: 1, lat: 672, lon: 720, species: 1)
Coordinates:
  * lat           (lat) float64 30.03 30.09 30.16 30.22 30.28 30.34 30.41 ...
  * category      (category) <U3 'agr'
  * species       (species) <U4 'PM10'
  * lon           (lon) float64 -29.94 -29.81 -29.69 -29.56 -29.44 -29.31 ...
Data variables:
    TNO-MACC3_EU  (lon, lat) float64 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 ...

and try to write to netCDF using .to_netcdf(), I get an
IndexError: tuple index out of range

I can fix this by manually doing
d_['species'] = np.atleast_1d(d_['species'])
d_['category'] = np.atleast_1d(d_['category'])

before calling .to_netcdf().
I believe it would be good if xarray would do this check on its own and apply the coorection on-the-fly to allow saving to netCDF in this case as well.

Sorry I missed this earlier.
Do you know how you created this Dataset? Xarray should not let you make a dataset with a 0D dimension variable: that is a violation of its data model.

Sure :smile:
I first open a DataArray:
grid_eu_coarse_noborder = xr.open_dataarray('tno-macc3_eu-no-nld-no-border_area.nc')
grid_eu_coarse_noborder

<xarray.DataArray 'TNO-MACC3_EU' (species: 12, category: 15, lon: 720, lat: 672)>
[87091200 values with dtype=float64]
Coordinates:
  * lat       (lat) float64 30.03 30.09 30.16 30.22 30.28 30.34 30.41 30.47 ...
  * category  (category) object 'pow' 'res' 'inc' 'pei' 'exf' 'sol' 'tra1' ...
  * species   (species) object 'CH4' 'CO' 'NH3' 'NMVOC' 'NOX' 'BC_1' ...
  * lon       (lon) float64 -29.94 -29.81 -29.69 -29.56 -29.44 -29.31 -29.19 ...

from which I select using .loc[] and convert to Dataset:
grid_eu_coarse_noborder.loc['NOX', 'pow'].to_dataset()

<xarray.Dataset>
Dimensions:       (lat: 672, lon: 720)
Coordinates:
  * lat           (lat) float64 30.03 30.09 30.16 30.22 30.28 30.34 30.41 ...
    category      <U3 'pow'
    species       <U3 'NOX'
  * lon           (lon) float64 -29.94 -29.81 -29.69 -29.56 -29.44 -29.31 ...
Data variables:
    TNO-MACC3_EU  (lon, lat) float64 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 ...

which then cannot be saved:
grid_eu_coarse_noborder.loc['NOX', 'pow'].to_dataset().to_netcdf('test.nc')

---------------------------------------------------------------------------
IndexError                                Traceback (most recent call last)
/home/eb/software/LAMOSpy/0.2-intel-2016a-Python-3.5.1/lib/python3.5/site-packages/xarray-0.9.1-py3.5.egg/xarray/core/utils.py in __len__(self)
    395         try:
--> 396             return self.shape[0]
    397         except IndexError:

IndexError: tuple index out of range

During handling of the above exception, another exception occurred:

TypeError                                 Traceback (most recent call last)
<ipython-input-8-fb260f3bec4b> in <module>()
----> 1 grid_eu_coarse_noborder.loc['NOX', 'pow'].to_dataset().to_netcdf('test.nc')

/home/eb/software/LAMOSpy/0.2-intel-2016a-Python-3.5.1/lib/python3.5/site-packages/xarray-0.9.1-py3.5.egg/xarray/core/dataset.py in to_netcdf(self, path, mode, format, group, engine, encoding, unlimited_dims)
    951         return to_netcdf(self, path, mode, format=format, group=group,
    952                          engine=engine, encoding=encoding,
--> 953                          unlimited_dims=unlimited_dims)
    954
    955     def __unicode__(self):

/home/eb/software/LAMOSpy/0.2-intel-2016a-Python-3.5.1/lib/python3.5/site-packages/xarray-0.9.1-py3.5.egg/xarray/backends/api.py in to_netcdf(dataset, path, mode, format, group, engine, writer, encoding, unlimited_dims)
    567     try:
    568         dataset.dump_to_store(store, sync=sync, encoding=encoding,
--> 569                               unlimited_dims=unlimited_dims)
    570         if isinstance(path, BytesIO):
    571             return path.getvalue()

/home/eb/software/LAMOSpy/0.2-intel-2016a-Python-3.5.1/lib/python3.5/site-packages/xarray-0.9.1-py3.5.egg/xarray/core/dataset.py in dump_to_store(self, store, encoder, sync, encoding, unlimited_dims)
    891
    892         store.store(variables, attrs, check_encoding,
--> 893                     unlimited_dims=unlimited_dims)
    894         if sync:
    895             store.sync()

/home/eb/software/LAMOSpy/0.2-intel-2016a-Python-3.5.1/lib/python3.5/site-packages/xarray-0.9.1-py3.5.egg/xarray/backends/common.py in store(self, variables, attributes, *args, **kwargs)
    233         cf_variables, cf_attrs = cf_encoder(variables, attributes)
    234         AbstractWritableDataStore.store(self, cf_variables, cf_attrs,
--> 235                                         *args, **kwargs)
    236
    237

/home/eb/software/LAMOSpy/0.2-intel-2016a-Python-3.5.1/lib/python3.5/site-packages/xarray-0.9.1-py3.5.egg/xarray/backends/common.py in store(self, variables, attributes, check_encoding_set, unlimited_dims)
    202         self.set_attributes(attributes)
    203         self.set_variables(variables, check_encoding_set,
--> 204                            unlimited_dims=unlimited_dims)
    205
    206     def set_attributes(self, attributes):

/home/eb/software/LAMOSpy/0.2-intel-2016a-Python-3.5.1/lib/python3.5/site-packages/xarray-0.9.1-py3.5.egg/xarray/backends/common.py in set_variables(self, variables, check_encoding_set, unlimited_dims)
    214             check = vn in check_encoding_set
    215             target, source = self.prepare_variable(
--> 216                 name, v, check, unlimited_dims=unlimited_dims)
    217             self.writer.add(source, target)
    218

/home/eb/software/LAMOSpy/0.2-intel-2016a-Python-3.5.1/lib/python3.5/site-packages/xarray-0.9.1-py3.5.egg/xarray/backends/netCDF4_.py in prepare_variable(self, name, variable, check_encoding, unlimited_dims)
    272
    273         if self.format == 'NETCDF4':
--> 274             variable, datatype = _nc4_values_and_dtype(variable)
    275         else:
    276             variable = encode_nc3_variable(variable)

/home/eb/software/LAMOSpy/0.2-intel-2016a-Python-3.5.1/lib/python3.5/site-packages/xarray-0.9.1-py3.5.egg/xarray/backends/netCDF4_.py in _nc4_values_and_dtype(var)
     78     if var.dtype.kind == 'U':
     79         # this entire clause should not be necessary with netCDF4>=1.0.9
---> 80         if len(var) > 0:
     81             var = var.astype('O')
     82         dtype = str

/home/eb/software/LAMOSpy/0.2-intel-2016a-Python-3.5.1/lib/python3.5/site-packages/xarray-0.9.1-py3.5.egg/xarray/core/utils.py in __len__(self)
    396             return self.shape[0]
    397         except IndexError:
--> 398             raise TypeError('len() of unsized object')
    399
    400

TypeError: len() of unsized object

@andreas-h you can drop the 0D dimensions:
d_ = d_.drop(['category', 'species'])
d_.to_netcdf(...)

Thanks, @darothen ! However, I believe I shouldn't have to, but xarray should do the right thing automatically.
Maybe I want to use the dataset after saving for something else, which would mean I'd have to do something like d_.drop(['category', 'species']).to_netcdf(...), which I don't like too much ...

Yeah, I tend to agree, there should be some sort of auto-magic happening. But, I can think of at least two options:

Coerce to array-like, like you do manually in your first comment here. That makes sense if the dimension is important, i.e. it carries useful metadata or encodes something important.

Coerce to an attribute on the DataSet.

I use workflows where I concatenate things like multiple ensemble members into a single file, and I wind up with this pattern all the time. I usually just drop() the offending coordinate, and save it as part of the output filename. This is because tools like cdo really, really don't like non lat-lon-time dimensions, so that can interrupt my workflow sometimes. Saving as an attribute bypasses this issue, but then you lose the ability to retain any metadata that was associated with that coordinate.

It looks like we have some sort of special logic that calls len() when it shouldn't, thereby precluding scaling scalars string variables in netCDF files.

bisecting tells me that this seems to have been fixed by 8632cd7b3f468865db4dc9e5c09075f941dc70f2 (#1648):
import xarray as xr
import numpy as np

da = xr.DataArray(
    np.linspace(0, 1, 2 * 3 * 4).reshape(2, 3, 4),
    coords={"x": ["a", "b"], "y": ["x", "y", "z"], "z": np.arange(4)},
    dims=("x", "y", "z"),
    name="abc",
)
da.loc["a", "x"].to_dataset().to_netcdf("test.nc")
xr.open_dataset("test.nc").load()  # to verify that the netcdf file is valid

only fails before that commit.

closing as I believe this to have been fixed by #1648


chore: dynamic year on the chainsafe cli notice

Motivation
As discussed in https://github.com/ChainSafe/lodestar/pull/5466 we don't really know why the year is even there but it "looks correct" so let's keep it and make sure it always up to date.
Description
Makes year on the chainsafe cli notice dynamic.

Q: Is it really necessary to print the year?
--
While it has been a common practice to include the year in copyright notices, it's not universally required, especially in many jurisdictions, including the United States. This tradition started because under the old U.S. copyright law (before 1978), the copyright would only last for 28 years from the date of publication, but could be renewed for another 28 years if the copyright was properly noticed, and the renewal registered. This is why you often saw, and still see, copyright notices with a year in them.
However, under the Berne Convention for the Protection of Literary and Artistic Works, which the U.S. joined in 1989, copyright is automatic and does not require registration or a copyright notice. Many other countries are also signatories to this convention.
So, in many cases, including the year in a copyright notice is not strictly necessary. However, it's still a common practice because it can provide certain benefits:

If you are not in a Berne Convention country, or are dealing with someone who is not, the notice may be required or beneficial.
It makes it clear to everyone when the work was produced, which can be useful information.
It may help in a legal dispute where the date of creation is relevant.

In the case of software projects, it's also common to include the range of years during which the project has been updated. This can help indicate the lifespan and active maintenance period of the project. However, it's worth noting that every jurisdiction may have slightly different rules about what is required or beneficial in a copyright notice.
It's always a good idea to consult with a legal expert if you're unsure about the specific requirements or benefits for your situation.

it's also common to include the range of years during which the project has been updated. This can help indicate the lifespan and active maintenance period of the project

I kinda like this part but can also just remove it, no strong opinion either way as long as it does not display outdated information

I like it too, no real reason but for the vibe. Feels like it gives a sense of the progression of the project, gives confidence in the project

:tada: This PR is included in v1.9.0 :tada:


Package request: llvmPackages_18

Project description

Metadata

homepage URL: https://llvm.org/
source URL: https://github.com/llvm/llvm-project/releases/tag/llvmorg-18.1.0
license: Modified apache 2.0
platforms: unix, windows

A new LLVM package is out now which means new llvmPackages.
Add a :+1: reaction to issues you find important.

Will be closed by #296284


bug(armazuredata): Wrong API version for armazuredata.NewSQLServerRegistrationsClient

Bug Report
Example Go code using v0.5.0 of the API:
package azuredata

import (
        "context"
	"github.com/Azure/azure-sdk-for-go/sdk/azcore/arm"
	"github.com/Azure/azure-sdk-for-go/sdk/resourcemanager/azuredata/armazuredata"
)

func fetchSqlServerRegistrations(ctx context.Context) error {
	svc, err := armazuredata.NewSQLServerRegistrationsClient(...)
	if err != nil {
		return err
	}
	pager := svc.NewListPager(nil)
	for pager.More() {
		p, err := pager.NextPage(ctx)
		if err != nil {
			return err
		}
		fmt.Println(p.Value)
	}
	return nil
}

output of go version - go version go1.19.3 darwin/arm64

I'm getting an error when trying the above code. The error is:
The resource type 'sqlServerRegistrations' could not be found in the namespace 'Microsoft.AzureData' for api version '2019-07-24-preview'. The supported api-versions are '2019-05-10-preview'

Setting the API version via ClientOptions to 2019-05-10-preview fixes the issue.
Looks like the client defaults to 2019-07-24-preview:
https://github.com/Azure/azure-sdk-for-go/blob/a97519174f72085debd57f0b1189aaa2b62f5f7b/sdk/resourcemanager/azuredata/armazuredata/zz_generated_sqlserverregistrations_client.go#L268

@erezrokah, due to our version policy, we could not release a SDK with previous api version, could you continue to use the above workaround for your work?  Thanks

Thanks for the quick reply @lirenhe ❤ I can use the workaround, however is it expected that the default API version used by this package causes an error? I would expect the client defaults to work (or at least no set a version altogether)

I believe this is a service decision not to support sqlServerRegistrations in the latest api version. The Go SDK is auto generated from the Swagger spec so could you create a support ticket for the service team to clarify this behavior?

so could you create a support ticket for the service team to clarify this behavior?

Thanks for the reply @lirenhe, how should I got about doing that? Can you please link to the team's ticketing system?

Please follow this:  https://learn.microsoft.com/en-us/azure/azure-portal/supportability/how-to-create-azure-support-request

Thanks @lirenhe I submitted a support ticket and will report back once I have more information

Hi all 👋 I got the following response from Azure Support.
TDLR: This API is deprecated and we should use<EMAIL_ADDRESS>Redacted response(s):
SQL Server Registry is no longer supported, and that customer should use the Arc-enabled SQL Server Extension to register for security updates now.
--------------------------------------------------------------------------------
To get started using REST API's, view the intro guide here: https://learn.microsoft.com/en-us/rest/api/azure/

and to view the SQL Server Instance specifications: https://github.com/Azure/azure-rest-api-specs/blob/main/specification/azurearcdata/resource-manager/Microsoft.AzureArcData/preview/2022-03-01-preview/examples/CreateOrUpdateSqlServerInstance.json

You can view the documentation for the Go SDK here<EMAIL_ADDRESS>
SQL Server Registrations are represented as SQL Server Instances in Azure, so to "register" your instance, you would need to use either the REST APIs or the Go SDK to create a SQL Server Instance resource in Azure, and the parameters in your create request should map to what is described in the documentation here: https://learn.microsoft.com/en-us/sql/sql-server/end-of-support/sql-server-extended-security-updates?view=sql-server-ver16#single-sql-server-instance

Closing as resolved


Ruby syntax highlighting w/ either cursorline or relativenumber causes lag from high CPU usage

With ruby syntax highlighting on, turning on cursorline or relativenumber
settings causes lag due to high CPU usage when moving the cursor up and down.
The conditions below exaggerbate the problem to help make it obvious and
reproducible, but the same problem exists at lesser scale with smaller terminal
sizes. This is a significant problem though, because when CPUs are otherwise
bogged down (eg. when pair programming with someone via screen share on Google
Hangouts), moving the cursor in a ruby file can be ridiculously slow.

What steps will reproduce the problem?
1. Temporarily rename ~/.vim/ and ~/.vimrc to ensure nothing but vanilla vim
2. Resize the terminal window so that ~100 lines are visible (normal for large
monitors)
3. Open a ruby file with non-trivial syntax:
https://raw.githubusercontent.com/rails/rails/f43f56e/activerecord/lib/active_re
cord/associations.rb
4. :syntax on
5. :set relativenumber
6. Hold down j or <down> for 1-2 seconds. (Ensure the system's keyboard repeat
rate is not slow, ideally maxed)
7. Notice that CPU usage for the vim process is at 100%, accompanied by choppy
redrawing and lag. Upon releasing the j/<down> key, buffered keypresses
continue to move the cursor down.

What is the expected behavior?
1. With the same file open and under the same conditions, :set syntax=java
2. Notice there is no longer excessive CPU usage or any lag when moving the
cursor up and down. The cursor stops moving immediately when the key is
released.

---

I understand that ruby's syntax is complex and nontrivial to parse. If there's
no clear way to reduce CPU usage for parsing ruby syntax for syntax
highlighting, are there other ways you can think of to prevent the syntax
highlighting from having to be recalculated when the screen is redrawn for
relativenumber and cursorline? Can we profile and find where the problem lies?

---

I can reproduce this in Vim 7.4 on both Ubuntu and OSX:

VIM - Vi IMproved 7.4 (2013 Aug 10, compiled Nov 12 2014 20:26:50)
MacOS X (unix) version
Included patches: 1-488
Compiled by Homebrew
Huge version without GUI.  Features included (+) or not (-):
+acl             +farsi           +mouse_netterm   +syntax
+arabic          +file_in_path    +mouse_sgr       +tag_binary
+autocmd         +find_in_path    -mouse_sysmouse  +tag_old_static
-balloon_eval    +float           +mouse_urxvt     -tag_any_white
-browse          +folding         +mouse_xterm     -tcl
++builtin_terms  -footer          +multi_byte      +terminfo
+byte_offset     +fork()          +multi_lang      +termresponse
+cindent         -gettext         -mzscheme        +textobjects
-clientserver    -hangul_input    +netbeans_intg   +title
+clipboard       +iconv           +path_extra      -toolbar
+cmdline_compl   +insert_expand   +perl            +user_commands
+cmdline_hist    +jumplist        +persistent_undo +vertsplit
+cmdline_info    +keymap          +postscript      +virtualedit
+comments        +langmap         +printer         +visual
+conceal         +libcall         +profile         +visualextra
+cryptv          +linebreak       +python          +viminfo
+cscope          +lispindent      -python3         +vreplace
+cursorbind      +listcmds        +quickfix        +wildignore
+cursorshape     +localmap        +reltime         +wildmenu
+dialog_con      -lua             +rightleft       +windows
+diff            +menu            +ruby            +writebackup
+digraphs        +mksession       +scrollbind      -X11
-dnd             +modify_fname    +signs           -xfontset
-ebcdic          +mouse           +smartindent     -xim
+emacs_tags      -mouseshape      -sniff           -xsmp
+eval            +mouse_dec       +startuptime     -xterm_clipboard
+ex_extra        -mouse_gpm       +statusline      -xterm_save
+extra_search    -mouse_jsbterm   -sun_workshop    -xpm
   system vimrc file: "$VIM/vimrc"
     user vimrc file: "$HOME/.vimrc"
 2nd user vimrc file: "~/.vim/vimrc"
      user exrc file: "$HOME/.exrc"
  fall-back for $VIM: "/usr/local/share/vim"
Compilation: /usr/bin/clang -c -I. -Iproto -DHAVE_CONFIG_H
-F/usr/local/Frameworks -DMACOS_X_UNIX  -Os -w -pipe -march=native
-mmacosx-version-min=10.10 -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=1
Linking: /usr/bin/clang   -L. -L/usr/local/lib -L/usr/local/lib
-F/usr/local/Frameworks -Wl,-headerpad_max_install_names -o vim        -lm
-lncurses -liconv -framework Cocoa   -fstack-protector
-L/System/Library/Perl/5.18/darwin-thread-multi-2level/CORE -lperl -framework
Python   -lruby.2.0.0 -lobjc

AND

VIM - Vi IMproved 7.4 (2013 Aug 10, compiled Aug 15 2013 11:04:13)
Included patches: 1-5
Modified by<EMAIL_ADDRESS>Compiled by buildd@
Huge version without GUI.  Features included (+) or not (-):
+arabic          +file_in_path    +mouse_sgr       +tag_binary
+autocmd         +find_in_path    -mouse_sysmouse  +tag_old_static
-balloon_eval    +float           +mouse_urxvt     -tag_any_white
-browse          +folding         +mouse_xterm     +tcl
++builtin_terms  -footer          +multi_byte      +terminfo
+byte_offset     +fork()          +multi_lang      +termresponse
+cindent         +gettext         -mzscheme        +textobjects
-clientserver    -hangul_input    +netbeans_intg   +title
-clipboard       +iconv           +path_extra      -toolbar
+cmdline_compl   +insert_expand   +perl            +user_commands
+cmdline_hist    +jumplist        +persistent_undo +vertsplit
+cmdline_info    +keymap          +postscript      +virtualedit
+comments        +langmap         +printer         +visual
+conceal         +libcall         +profile         +visualextra
+cryptv          +linebreak       +python          +viminfo
+cscope          +lispindent      -python3         +vreplace
+cursorbind      +listcmds        +quickfix        +wildignore
+cursorshape     +localmap        +reltime         +wildmenu
+dialog_con      +lua             +rightleft       +windows
+diff            +menu            +ruby            +writebackup
+digraphs        +mksession       +scrollbind      -X11
-dnd             +modify_fname    +signs           -xfontset
-ebcdic          +mouse           +smartindent     -xim
+emacs_tags      -mouseshape      -sniff           -xsmp
+eval            +mouse_dec       +startuptime     -xterm_clipboard
+ex_extra        +mouse_gpm       +statusline      -xterm_save
+extra_search    -mouse_jsbterm   -sun_workshop
+farsi           +mouse_netterm   +syntax
   system vimrc file: "$VIM/vimrc"
     user vimrc file: "$HOME/.vimrc"
 2nd user vimrc file: "~/.vim/vimrc"
      user exrc file: "$HOME/.exrc"
  fall-back for $VIM: "/usr/share/vim"
Compilation: gcc -c -I. -Iproto -DHAVE_CONFIG_H     -g -O2 -fstack-protector
--param=ssp-buffer-size=4 -Wformat -Wformat-security -Werror=format-security
-U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=1     -I/usr/include/tcl8.5  -D_REENTRANT=1
 -D_THREAD_SAFE=1  -D_LARGEFILE64_SOURCE=1
Linking: gcc   -L. -Wl,-Bsymbolic-functions -Wl,-z,relro -rdynamic
-Wl,-export-dynamic -Wl,-E  -Wl,-Bsymbolic-functions -Wl,-z,relro
-Wl,--as-needed -o vim        -lm -ltinfo -lnsl  -lselinux  -lacl -lattr -lgpm
-ldl  -L/usr/lib -llua5.1 -Wl,-E  -fstack-protector -L/usr/local/lib
-L/usr/lib/perl/5.14/CORE -lperl -ldl -lm -lpthread -lcrypt
-L/usr/lib/python2.7/config-x86_64-linux-gnu

Original issue reported on code.google.com by<EMAIL_ADDRESS>on 13 Nov 2014 at 4:26

The Ruby syntax highlighting logic is certainly the cause. I haven't found lazy redraw or ttyfast to help much at all. When you're working on a remote machine this becomes very obvious. Here's my syntime report:

I think we're due a simpler Ruby syntax file. I'll take a look/stab at it but those regex expressions look very complex and bound to cause problems for not catching all of Ruby's syntax rules etc.

Am 2015-03-26 00:09, schrieb Corey Prophitt:

The Ruby syntax highlighting logic is certainly the cause. I haven't
found lazy redraw or ttyfast to help much at all. When you're working
on a remote machine this becomes very obvious. Here's my syntime
report:

I think we're due a simpler Ruby syntax file. I'll take a look/stab at
it but those regex expressions look very complex and bound to cause
problems for not catching all of Ruby's syntax rules etc.

This has been a long standing issue on the vim bugtracker and I have
created an issue on the vim-ruby group. Unfortunately, there hasn't
been any reactions. (Sorry no github acces currently, so can't provide
the issue number).
(Please note, that this repository is experimental and existing issues
should at least currently most like being kept editing on the
google code site).
Best,
Christian


#define all cache types except for alias types and the color type

Inspired by Delta in Discord.

:tada: This issue has been resolved in version 3.0.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Support bare-metal servers with hcloud-cloud-controller-manager

/kind feature
Describe the solution you'd like
Right now you only support Robot (bare-metal) servers when using syself/hetzner-cloud-controller-manager.
hetznercloud/hcloud-cloud-controller-manager (HCCM) added support for Robot servers in December 2023. It would be awesome if you would also support this with CAPH.
Anything else you would like to add:
As far as I could tell, the main problem is that CAPH expects the provider ID for bare-metal servers to be formatted as hcloud://bm-$ROBOTID. HCCM uses the format hrobot://$ROBOTID.

https://github.com/syself/cluster-api-provider-hetzner/blob/c05f7aadc50cba9fee88a176776a511bb3a83174/api/v1beta1/hetznerbaremetalmachine_types.go#L40-L41
https://github.com/syself/cluster-api-provider-hetzner/blob/c05f7aadc50cba9fee88a176776a511bb3a83174/pkg/scope/baremetalhost.go#L142-L151
https://github.com/syself/cluster-api-provider-hetzner/blob/c05f7aadc50cba9fee88a176776a511bb3a83174/controllers/csr_controller.go#L328
https://github.com/syself/cluster-api-provider-hetzner/blob/c05f7aadc50cba9fee88a176776a511bb3a83174/pkg/services/baremetal/baremetal/baremetal.go#L895-L897

Related to https://github.com/hetznercloud/hcloud-cloud-controller-manager/issues/702
Environment:

cluster-api-provider-hetzner version:
Kubernetes version: (use kubectl version)
OS (e.g. from /etc/os-release):

@apricote would you be able to contribute here?


feat!: json schemas for device config and mappings

What kind of change does this PR introduce? (Bug fix, feature, docs update, ...)

breaking change

What is the current behavior? (You can also link to an open issue here)

The options and mappings types for devices are handwritten typescript interfaces.

What is the new behavior (if this is a feature change)?

These types are now generated from json-schemas.
The schemas are then used in Sofie to generate the UI for user input.
Some of the breaking changes are not strictly necessary, but make the generated types be more consistent and easier to work with.

The structure of Mapping has changed. It has an options: TOptions property, which is a generic for the specific mapping type. It could be possible to avoid this, but that would result in more complex and confusing types and this new structure matches what we are doing elsewhere in Sofie.
Mappings are now required to have a mappingType property. In many cases, there is a signle mapping type, so this has a single value. It could be made so that this is not the case, but that adds more complexity in other places.
Various mapping types were using numeric enum values. These are now required to be string enums. Trying to avoid this could complicate the type generation, and would likely result in string vs number issues, as the json schema would want them to be a string

Other information:

The structure of Mapping has changed. It has an options: TOptions property

I am wondering if I should undo portion of the change, as its going to be the trickier one to handle in Sofie (some complex migrations).
I think it would be easier than I originally thought to handle here. Each mapping could be generated as MappingThingInternal, with an autogenerated wrapper of export type MappingThing = Mapping & MappingThingInternal.

Codecov Report
Base: 30.95% // Head: 31.49% // Increases project coverage by +0.54% :tada:

Coverage data is based on head (3aa950d) compared to base (d5acb87).
Patch coverage: 50.80% of modified lines in pull request are covered.

Additional details and impacted files
@@              Coverage Diff              @@
##           release49     #237      +/-   ##
=============================================
+ Coverage      30.95%   31.49%   +0.54%
=============================================
  Files             67       75       +8
  Lines           8510     8604      +94
  Branches        2163     2185      +22
=============================================
+ Hits            2634     2710      +76
- Misses          5357     5373      +16
- Partials         519      521       +2

Impacted Files
Coverage Δ

packages/timeline-state-resolver-types/src/atem.ts
100.00% <ø> (ø)

...ages/timeline-state-resolver-types/src/casparcg.ts
100.00% <ø> (ø)

...ckages/timeline-state-resolver-types/src/device.ts
100.00% <ø> (ø)

...ine-state-resolver-types/src/generated/abstract.ts
100.00% <ø> (ø)

...eline-state-resolver-types/src/generated/vizMSE.ts
100.00% <ø> (ø)

...ges/timeline-state-resolver-types/src/hyperdeck.ts
100.00% <ø> (ø)

...ackages/timeline-state-resolver-types/src/index.ts
100.00% <ø> (ø)

packages/timeline-state-resolver-types/src/lawo.ts
100.00% <ø> (ø)

packages/timeline-state-resolver-types/src/obs.ts
100.00% <ø> (ø)

packages/timeline-state-resolver-types/src/osc.ts
100.00% <ø> (ø)

... and 41 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


NDRS-455: fix contract runtime initialization issue

When we changed to use WithDir for the storage component (to enable setting the correct path for LMDB), we overlooked doing that for the contract runtime, which piggybacks on the storage config for this path.
This PR fixes that, and also cleans up some unused functions from utils (they weren't being flagged by the compiler as they were unnecessarily pub rather than pub(crate)).

bors r+


Field 'unique' is not a supported option?

Just tried migrating from Meteor aldeed:collection2 to aldeed:collection2-core, and using npm requirement for simpl-schema, and now got this:
Error: Invalid definition for key field: "unique" is not a supported option

The collection is as simple as:
thatschema = new SimpleSchema({
    key: {
        type: String,
        unique: true
    },
    value: {
        type: String,
        optional: true
    },
    modified: {
        type: Date
    }
});

While in npm docs it clearly says i can use unique: true/false

I had the same problem.  I think you need the schema-index package as well:
meteor add aldeed:schema-index

See https://github.com/aldeed/meteor-collection2#important-note-the-version-in-this-repo-is-deprecated


CSS transform doesn't work?

I was styling the menu, and wanted to make it so when I hover, the icon grows slightly bigger. I tried using transform: scale(1.2), but that didn't work, and said that there was an error in CSS file and it fell back to GTK theme. Out of curiosity I also tried transform: rotate(20deg);, and that also caused it to fail.

I haven't ever tried this property. You may want to take a look at this: https://docs.gtk.org/gtk3/css-properties.html

Ah ok, didn't know it was rendering css through gtk, although now that makes sooooo much more sense (not only with this but everything else using gtk). I was reading the CSS docs for web development on W3 schools.
Thanks a lot, I will close this issue for now then, and read the gtk docs and find a solution tommorow.
Love the nwg-bar too, feels great, fits in nicely with my system themes after customization, and super simple!


Barrating widget updates are not stored correctly

Hi - I found an issue with the barrating control in which I have several different questions along with a barrating. I would watch the answers being set from onValueChanged and what would happen is that as soon as i selected an item from barrating, it would overwrite several of the other answers. However, upon save() the answers would come back in the set but the one for the barrating would not.
What was happening is that this control is based upon the "dropdown" and would call the handleOnChange() to set the question value in its state. However, when the value is set by clicking on a star ($el.barrating("set", question.value);), the jquery-barrating calls change() on the select element, but the QuestionDropDown.handleOnChange() isn't called -- the event needs to be explicitly fired (see below the comment). Hopefully this will save someone a few headaches!
    afterRender: function (question, el) {
      var theEl = el;
      var $el = $(el).is("select") ? $(el) : $(el).find("select");
      var isUpdating = false;
      // update the values
      var updateValueHandler = function () {
        if (!isUpdating) {
          $el.barrating("set", question.value);
        }
      };

      // tell the barrating library to render our stuff!
      $el.barrating("show", {
        theme: question.ratingTheme,
        initialRating: question.value,
        showValues: question.showValues,
        showSelectedRating: false,
        onSelect: (value, text) => {
          isUpdating = true;
          question.value = value;

          // IMPORTANT!! Manually dispatch the event to the dropdown to trigger handleOnChange in SurveyJS!
          // if handleOnChange() is not called, the question store gets corrupted!
          var event = new Event('input', { bubbles: true });
          var select = theEl.getElementsByTagName("select")[0];
          select.dispatchEvent(event);
          isUpdating = false;
        }
      });
      question.valueChangedCallback = updateValueHandler;
      updateValueHandler();
    },
    willUnmount: function (question, el) {
      var $el = $(el).is("select") ? $(el) : $(el).find("select");
      $el.barrating("destroy");

      question.valueChangedCallback = null;
    }

Hello! Thank you for the contributing!
We've checked your code and don't fully understand the root of the problem.
Could you please provide a plunker or json to reproduce the bug?

Hi - I can try to put together a plunker but the easiest way to reproduce it is to set a browser breakpoint in QuestionDropDown.handleOnChange() and then click a star in the widget. You'll see that the breakpoint is never hit, which messes up the state. However, if you then add in the code I mentioned above and try it again, you'll see that the breakpoint is hit and the state is no longer out of sync with the jquery-barrating component.

@chambleton I'm sorry but the code you've sent doesn't belong to the https://github.com/surveyjs/widgets/blob/master/src/jquery-bar-rating.js repository. We'll be happy to investigate the issue on the minimal live sample (plunker or other sanbox). Thanks for understanding.

@chambleton Another way - you can provide us with exact steps how to reproduce the issue on our demos or samples.


500-error not behaving properly in main site

URL: https://readthedocs.org/500/
Expected Result
The cute
          .
         ":"
       ___:____     |"\/"|
     ,'        `.    \  /
     |  O        \___/  |
   ~^~^~^~^~^~^~^~^~^~^~^~^~

   Fail.  Check back in a bit!

Actual Result
A really ugly
Internal Server Error
Preliminary diagnosis
A local deployment give those debug information:
 Traceback (most recent call last):
   File "/usr/local/lib/python2.7/wsgiref/handlers.py", line 85, in run
     self.result = application(self.environ, self.start_response)
   File "/usr/local/lib/python2.7/site-packages/django/core/handlers/wsgi.py", line 177, in __call__
     response = self.get_response(request)
   File "/usr/local/lib/python2.7/site-packages/django/core/handlers/base.py", line 230, in get_response
     response = self.handle_uncaught_exception(request, resolver, sys.exc_info())
   File "/usr/local/lib/python2.7/site-packages/django/core/handlers/base.py", line 296, in handle_uncaught_exception
     return callback(request, **param_dict)
 TypeError: server_error_500() takes at least 2 arguments (1 given)

I think that the handler500 (in readthedocs/urls.py) using the server_error_500  (in readthedocs/core/views/__init__.py) is not correct because of the extra exception parameter. According to official docs this parameter is not expected.
Could not find anywhere where that parameter exception is being used. Is it safe to remove entirely? Same with the 404, I suppose that the ugly error received in https://readthedocs.org/404/ is due to the same mismatch.

Thanks for your report. This was fixed at https://github.com/rtfd/readthedocs.org/commit/8de1770d


.sql heuristic falls back to SQL

Description
This is part of a series of PRs for SQL, see #4884.
Do not use the classifier strategy for .sql, fallback to SQL. The premise here is that classifying any SQL variant as SQL is less wrong than classifying it as the wrong variant.
Adds some new patterns to SQL PL and T-SQL to keep everything working, at least for current samples.
Checklist:

[x] I am fixing a misclassified language

[ ] I have included a new sample for the misclassified language:

Sample source(s):

[URL to each sample source, if applicable]

Sample license(s):

[x] I have included a change to the heuristics to distinguish my language from others using the same extension.

Makes sense to me. Any thoughts @pchaigno and @Alhadis?


Wrong API version for Deployment kind

https://github.com/infrawatch/smart-gateway-operator/blob/7ac81f607ad6fd145d9c49758c5c351af7d5bf42/roles/smartgateway/templates/deployment.yaml.j2#L1
I believe our apiVersion needs to be apps/v1. Currently doesn't deploy a SG properly on vanilla k8s.

That's the same place the error occurred in OCP v4.4

@pleimer awesome thanks! ok so I think we can change the apiVersion here, test on 4.3, and if it works there without issue, we can just make this the new default.


Module-Scoped Host Definitions

This patch fixes #827 where a libStorage host may not be defined at the root of a configuration but instead scoped to a module. With this patch if host detection fails (root configuration / running, local host) when initializing the module subsystem a warning is logged and the modules themselves must explicitly define the host to which to connect.
This patch does not support starting a new host from a module-scoped host definition. The module-scoped host properties are for overriding the host to which to connect only.

Hi @codenrhoden,
The Scope call was in the ActivateLibstorage function as it was common to all components. I relocated it to ensure it wasn't dependent upon LS being activated. It's required so that you're able to redefine rexray. prefixed properties inside of other configuration sections.

Codecov Report

Merging #885 into release/0.9.1 will decrease coverage by <.01%.
The diff coverage is 0%.

@@               Coverage Diff               @@
##           release/0.9.1   #885      +/-   ##
===============================================
- Coverage            8.8%   8.8%   -0.01%
===============================================
  Files                 25     25
  Lines               2975   2977       +2
===============================================
  Hits                 262    262
- Misses              2677   2679       +2
  Partials              36     36

Impacted Files
Coverage Δ

util/util.go
26.21% <0%> (-0.17%)
:arrow_down:

util/util_client_agent.go
0% <0%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 25eed85...f64b993. Read the comment docs.

@cduchesne has tested and approved the patch.


Different format on submit

Hi guys,
does exists an option to use a different format on submit?
For example I have to show a date with italian format: "d-m-Y"
but save it in the standard format: "Y-m-d"
Thoughts?

necessary thing

This is extremely useful to have a possibility to configure different date and time formats for display into UI and for sending to DB.
@xdan , @demis-palma , @u01jmg3 , @gsilis , @lampslave , @isaacws  and the rest of Dev Team.
Guys, please, tell if this is something you are going to implement in one of closest releases?
or, maybe, this is already done, however omitted into the docs?
grateful for you reply

I think it's unnecessary functionality for datepicker. If you want it, you can catch form submit, convert value and trigger submit again. Or initialize datepicker for dummy input (without name=) and copy value to real input:
onChangeDateTime: function (newDateTime, $input) {
    $myInput.val(newDateTime.dateFormat('d.m.Y'));
}

thank you @lampslave for such quick reply
your suggestions is exactly what I'm doing now)
however I do not think this is a good idea to have additional input element in DOM tree just to displaying date in different format
e.g. I have 5 different date fields on one page and 3 of them should be displayed in one format and 2 others in another one, so you advice me to have 5 additional input fields to store the actual values for submitting?

I advice to use single format (because it's easy for users) or make your backend code smarter so it can parse more formats. Example for Django.

None of those solutions are good, popping extra inputs on every page that has an datepicker would be really annoying and make the code pretty ugly. Same goes to listener for submit, would need to identify every date/datetime/time value, and would need to be set to every page.
It get even worse when we talk about internationalization, u would need pass the format to datepicker params, and for whatever other location that would parse it to the back-end format...
And making the parsing on the back-end is not a good option deepening on the framework used, like Rails, to solve this on back-end would be necessary to monk patch an Ruby method, or on the controller map every date/time params that every actions could ever receive and parse.
It is far more logic that plugin handle it, like u already know the format inputed by the user, would just need to parse for 2 different formats, the one displayed, and the one back-end one, and make a display html and hide the true value. It would also make easyer for editing the records, as back-end would not need to parse it to the user format, as the picker would have the back-end format and could reverse parse form the input.
also,the official jquery datepicker does have it, one for the user, and one format to send, u dont need to configure both.


template-ui: Hook i18n

Pass the message ID through the API provided by the plugin.
On the plugin side, use kolibri i18n utility to create a translator for the given namespace and return the translated message.
Helps #604

I rebased this on master to get the tests against the recent dependency changes. That said, I tried this locally with the nullish coalescing operator part uncommented and got the same linter errors. I don't know why that's happening.


longRunningRecognize - gRPC Error (code: 3, codeName: INVALID_ARGUMENT, message: Invalid resource field value in the request., details: [reason: RESOURCE_PROJECT_INVALID

I'm trying to use longRunningRecognize to transcribe a file I've got in a bucket. The bucket is under the same project as Cloud speech. I can run recognize() with a local file but I am getting the below error when using longRunningRecognize().
gRPC Error (code: 3, codeName: INVALID_ARGUMENT, message: Invalid resource field value in the request., details: [reason: RESOURCE_PROJECT_INVALID
domain: googleapis.com
metadata: {service : speech.googleapis.com}
metadata: {method : google.cloud.speech.v2.Speech.BatchRecognize}
], rawResponse: null, trailers: {google.rpc.errorinfo-bin
Below is my code. Is there something I've done wrong? I've checked the service account permissions for the bucket and it has the following: Cloud Speech-to-Text Service Agent, Storage Legacy Bucket Owner, Storage Legacy Object Owner, Storage Admin
final speechToText =SpeechToTextV2.viaServiceAccount(serviceAccount, projectId: 'matters-dictation');

final config = RecognitionConfigV2(
    autoDecodingConfig:AutoDetectDecodingConfig(),
    features: RecognitionFeatures(
        enableSpokenPunctuation: true,
        enableAutomaticPunctuation: true),
    model: RecognitionModelV2.long,
    languageCodes: ['en-GB']);

final response = await speechToText.longRunningRecognize(config, "gs://matters_dictation/welcome.wav");

Thanks for responding. I've just tried that and that has worked. Is V2 compatible at all? If not I'll just stick to V1.
And also, as this just returns a name, is there a simple way to get the transcript. I know this has been asked a couple times before but I couldn't see how to do it? Thanks

Ok good. I haven't had time to test longRunningRequest with V2 yet. I guess there is still a bug. I will have a look at it soon and hope to fix the bug soon.
For your second question. Could you try this code?
    speechToText.longRunningRecognize(config, '...').then((Operation operation) {
      /// If the value is `false`, it means the operation is still in progress.
      /// If `true`, the operation is completed, and either `error` or `response` is
      /// available.
      if(operation.done) {
        final response = operation.response as LongRunningRecognizeResponse;
        setState(() {
          text = response.results
              .map((e) => e.alternatives.first.transcript)
              .join('\n');
        });
      }
    });

Sorry I've not been able to try it sooner. I've had a go with the above code just now. Operation.done is never triggered, it is always false, I've waited for a while to see if any response but still doesn't seem to be working. I've checked on the API dashboard and I can see the request with a status code 200 and no errors. It's a 2 min 30 file but I've still not got a response after 25 minutes.

And operation.response is also always empty? Can you check if operation.response is not empty or if operation.error is not empty? Ignore operation.done.

operation.response and operation.error are both empty.

I'm experiencing the same issue here as well 👀. It seems that longrecognize is still not supported as no text is being generated.

Hi @KyMHP and @Freedisch
Sorry for the late response. I have finally found time to take a closer look at this problem. I have found the error and fixed it.
I also added a new function called pollingLongRunningRecognize() with version 4.3.0 of google_speech. This now automatically takes over the polling of the operation and then returns the result as soon as the operation has been completed.
Please test it once and give feedback if it works now.


[Feature Request] Add AadIssuerValidator.ValidateAsync

Is your feature request related to a problem? Please describe.
Currently the issuer is obtained using a blocking call: effectiveConfigurationManager.GetBaseConfigurationAsync(CancellationToken.None).ConfigureAwait(false).GetAwaiter().GetResult().Issuer;
Describe the solution you'd like
Add a new method that is async.

https://github.com/AzureAD/azure-activedirectory-identitymodel-extensions-for-dotnet/pull/2075


Update st2 pack to employ new chatops features

There's two major problems I've faced during this PR:

the {{ trigger }} returned by core.st2.generic.notifytrigger may by itself include jinja templates which would then end up trying to be resolved by st2action and in some cases would result in the whole execution failing due to absence of required context variables

st2.execution_list creates an execution that includes another N previous executions into itself. Really not hard to imagine what would happen if you try to run in multiple times in succession. For those lacking imagination:

command document too large
File "/usr/lib/python2.7/dist-packages/st2actions/worker.py", line 113, in _run_action
result = self.container.dispatch(liveaction_db)
File "/usr/lib/python2.7/dist-packages/st2actions/container/base.py", line 83, in dispatch
else self._do_run(runner, runnertype_db, action_db, liveaction_db))
File "/usr/lib/python2.7/dist-packages/st2actions/container/base.py", line 138, in _do_run
result, context)
File "/usr/lib/python2.7/dist-packages/st2actions/container/base.py", line 206, in _update_live_action_db
liveaction_db=liveaction_db)
File "/usr/lib/python2.7/dist-packages/st2common/util/action_db.py", line 196, in update_liveaction_status
liveaction_db = LiveAction.add_or_update(liveaction_db)
File "/usr/lib/python2.7/dist-packages/st2common/persistence/base.py", line 155, in add_or_update
model_object = cls._get_impl().add_or_update(model_object)
File "/usr/lib/python2.7/dist-packages/st2common/models/db/init.py", line 174, in add_or_update
instance.save()
File "/usr/local/lib/python2.7/dist-packages/mongoengine/document.py", line 267, in save
upsert=True, **write_concern)
File "/usr/local/lib/python2.7/dist-packages/pymongo/collection.py", line 750, in update
docs, check_keys, self.uuid_subtype, client)

Just to cross-post and provide context here...
A good pattern in ChatOps if the data is unsafe, authenticated, or otherwise too verbose... is to give a minimal amount of information and/or a weblink to get a user to where they need to be. Having access in the context of chat to quickly navigate around is the objective here.
In the specific case here. Would maybe a link to the WebUI be sufficient to meet the above criteria?

Oh, that's possible?
Really nice examples ^^

yeah, now when we solved double rendering, there's really quite a lot of stuff we can do with chatops

YES!!!! :heart:

Anyone against merging this? I'm pretty sure it's safe now since every new install will come with the new chatops, and old installs already have the pack. Also, long due!

https://stackstorm.slack.com/archives/stackstorm/p1455170538006813

Extended the PR a bit, brought execution lists back (we need to do something with execution_list, I filed an issue, but it's outside the scope of this PR). Merging.
There's a Travis failure unrelated to the PR:
Command "/home/travis/build/StackStorm/st2contrib/virtualenv/bin/python -u -c "import setuptools, tokenize;__file__='/tmp/pip-build-UaL4Oq/wit/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-u3RaSE-record/install-record.txt --single-version-externally-managed --compile --install-headers /home/travis/build/StackStorm/st2contrib/virtualenv/include/site/python2.7/wit" failed with error code 1 in /tmp/pip-build-UaL4Oq/wit


[Feature] Add option to delete files after export

Provide the option to delete files in the app when exporting

Can i do this issue? Is it about deleting all files after making a backup?

Its the exact opposite of "delete imported files".
So a file in photok should be removed from photok once it was exported to the regular file system.

Of course with a option in the settings. Same as delete imported images

Implemented in #259


Support for Windows version greater than RS3 or higher

When I execute the compiled binary it shows the usage. And when I debug the lxlaunch.cpp Visual Studio shows this error at StartDefaultInstance():
Exception thrown at 0x00007FFEB48511F0 (ntdll.dll) in lxlaunch.exe: 0xC0000005: Access violation reading location 0xFFFFFFFFFFFFFFFF.

I'm using Windows RS3. Am I doing anything wrong? Or Is this source code not apply for RS3?

Not updated for RS3 :)
On Fri, Feb 9, 2018 at 10:44 AM Biswapriyo<EMAIL_ADDRESS>wrote:

When I execute the compiled binary it shows the usage. And when I debug
the lxlaunch.cpp Visual Studio shows this error:
Exception thrown at 0x00007FFEB48511F0 (ntdll.dll) in lxlaunch.exe: 0xC0000005: Access violation reading location 0xFFFFFFFFFFFFFFFF.
I'm using Windows RS3. Am I doing anything wrong? Or Is this source code
not apply for RS3?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/ionescu007/lxss/issues/14, or mute the thread
https://github.com/notifications/unsubscribe-auth/AFxIePvuWK8y46mYt7wQsU9gBpYb0YL4ks5tTJH0gaJpZM4SAXOo
.

--
Best regards,
Alex Ionescu

Closing.... Waiting for future answer!

Microsoft provides public API for WSL in RS3.
https://msdn.microsoft.com/en-us/library/windows/desktop/mt826874

I know that. But those function may not be permanent. And I want to run any ELF binary like this report does.

I think private APIs may not be permanent.

Are there plans to update this for RS3 and RS4?

I've proceed something with IDA. wslapi.dll is just a layer to talk with wsl.exe. All the WSL functions just opens up a wsl.exe process (with some arguments). If someone reverse wsl.exe then my mission will be successful.

@ionescu007 This issue is for compiling the source code in Visual Studio 2017. I can't compile it.

@ionescu007 I've checked the wslapi.dll in IDA. The CLSID and IID in CoCreateInstance() are same in RS2 and RS3. But the difference may be in the output (the interface pointer) of that function.
How do you get _LX_SESSION struct? I want to reverse that WSL APIs. Any procedure or article or book?

@Biswa96 have you gotten any progress in getting this project running for newer Windows builds?

I can't reverse the COM interface of the LxssManager. I'm little weak at OOP.

I can't reverse the COM interface of the LxssManager. I'm little weak at OOP.
But I reverse the WslLaunch() and WslLaunchInteractive() which run wsl.exe using standard handles.

Now your COM interface discussion over in the WSL page makes a bit more sense. There may be something you can run with Kali.exe to get more detailed info on the COM interface.

Those kali.exe and ubuntu.exe uses wslapi.dll and I'm reversing that DLL file and LxssManager.dll.

I was actually referring to using Kali to hack the COM interface. A quick google search yielded no results on what specific exploit is needed but surely there's something there.

The COM interface can be known using Visual Studio.

Do you know how LxssManagerProxyStub.dll talk with LxssManager.dll? All CoCreateInstance() in wslapi.dll, wsl.exe, wslhost.exe goes to that proxy DLL.

I've successfully (HRESULT is S_OK) reverse the WslSession COM interface but can't connect it with conhost.

How does WSLtty (or Mintty if you have Cygwin) look with it?

Sorry, I've little knowledge about HOW console works. I didn't fully reverse wsl.exe.

Check out my first release https://github.com/Biswa96/WSL_Reverse/releases/tag/v0.0
This only uninstall distro with COM.

I'll test it when I have time. I'll need to install another distro first so I don't lose anything. Only have Debian now due to SSD space so I'll test out with Ubuntu 18.04 since that's the newest Store release (and hopefully uses the updated launcher code).

So all your options provide Error: 0x80070005 from regular CMD. I looked at Event Viewer and maybe got this:

The application-specific permission settings do not grant Local Activation permission for the COM Server application with CLSID {D63B10C5-BB46-4990-A94F-E40B9D520160}
and APPID {9CA88EE3-ACB7-47C8-AFC4-AB702511C276} to the user computername/user SID (S-1-5-21-3787357036-3943707039-2759964770-1001) from address LocalHost (Using LRPC) running in the application container Unavailable SID (Unavailable). This security permission can be modified using the Component Services administrative tool.

This may be an unrelated error to some other various thing but doubtful.
When I ran CMD in admin mode: I got Error: 0x80070040 I didn't find anything in Event Viewer for this at all.
However I found Issue #62 of WSL (which dealt with lxrun) to be related. We have get rid of lxrun and use wsl.exe  (or bash.exe for pre-RS4) instead.
Bear in mind I'm running build 17134 with latest KB so my results may be different as a result.

Microsoft changes the COM interface from 17134. I reverse wsl.exe from build 17666. @DarthSpock  For test in 1803 you may remove the 15, 16 from the .hpp file.

Reversing is almost done. This question is for @ionescue007.
The CreateLxProcess function may be similar with your version. Is there any legal issue if I borrow some code from this repo? What should I do?

Reversing is almost done. This question is for @ionescu007.
The CreateLxProcess function may be similar with your version. Is there any legal issue if I borrow some code from this repo? What should I do?

Why don’t you submit a PR against my repo with the proposed changes?
On Fri, Jun 1, 2018 at 2:03 PM Biswapriyo Nath<EMAIL_ADDRESS>wrote:

Reversing is almost done. This question is for @ionescu007
https://github.com/ionescu007.
The CreateLxProcess function may be similar with your version. Is there
any legal issue if I borrow some code from this repo? What should I do?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/ionescu007/lxss/issues/14#issuecomment-394008387, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AFxIeOwpqkWnviosnxtTSg98fuHg-ZApks5t4awYgaJpZM4SAXOo
.

--
Best regards,
Alex Ionescu

I'm not expert of console like you. So I may make mistake. Ok, if reversing is complete I shall try.

@ionescu007 I'm not an expert of console, I may make mistake. If reversing is complete I shall try.
Just one function remains. How did you reverse the CreateLxProcess()? In RS4, IDA shows 15 arguments. One guideline will be enough for me 🙏

Just used symbol files and tried to understand what the arguments do/mean.
Took a while. There isn’t no easy hint :)
On Sat, Jun 2, 2018 at 10:36 AM Biswapriyo Nath<EMAIL_ADDRESS>wrote:

@ionescu007 https://github.com/ionescu007 I'm not an expert of console,
I may make mistake. If reversing is complete I shall try.
Just one function remains. How did you reverse the CreateLxProcess()? In
RS4, IDA shows 15 arguments. One guideline will be enough for me 🙏
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/ionescu007/lxss/issues/14#issuecomment-394104050, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AFxIeJVXTpkdoRdPccW4cFoahKclMlmsks5t4s01gaJpZM4SAXOo
.

--
Best regards,
Alex Ionescu

[From the bikeshed] The changes are probably going to be related to the fairly significant interop changes (WSL # 2370 et al). Y'all know that already, and I know the observation isn't going to shed any practical light on the params. Mostly just stopping by to say "thanks" for taking the time to have a look at all. It is appreciated.

I reversed all the installing, uninstalling, configure function. Just that one remains. And wsl teams heavily used C++ standard library in LxssManager. That's the problem I faced.

@therealkenc I reversed all the installing, uninstalling, configure function. Just that one remains. And wsl teams heavily used C++ standard library in LxssManager. That's the problem I faced.
The interoperability feature is maintained by wslhost.exe. All the Device CTL codes are same in ADSS. Another IOCTL is in bash.exe and wsl.exe. It waits for the the Linux instance to be closed.

@ionescu007 Can you email me? I've something to ask about reverse engineering and lawsuits.

@DarthSpock I release a version for 17134. May you try it? Provide feedback if any.

I haven't had time recently to test out but will give it a spin soon.

Most of the CreateLxProcess() function parameter goes to unknown IOCTLs.

Hmm, that seems to make sense. So far I've discovered that the install of a tar.gz doesn't work, same with uninstall. The -d, -G, and -g options appear to work just fine though.  Once I installed Ubuntu 18.04 through normal means, I tried the set options but they failed. I then tried launching my Debian instance and before the prompt appeared, I recieved an error about bash not being read by demsg that instead I get " function not implemented". Then I can't enter any commands at all. The Ubuntu 18.04 is the same. Restarting the LXSS Manager service hasn't worked and neither has rebooting. It appears I may need to disable and re-enable WSL feature and see if that works but haven't had a chance to try it yet. I noticed you updated the repo 6 hours ago but didn't test with that version.

@DarthSpock Can you mail me?

@ionescu007 Most of the CreateLxProcess() function parameter leads to unknown IOCTLs. How can I know which IOCTL takes what InputBuffer and OutputBuffer?

@Biswa96 Sorry I couldn't get back sooner. I was preoccupied with other things and I had a random BSOD on Sunday which I was troubleshooting in my spare time. It was repeating a loop to Windows recovery. After many oddities, I was able to get it to restore yesterday to a previous backup of mine which was before running the wslreverse. I was too busy doing updates to different software Windows-side so haven't touched my Debian install yet but should be fine. I'll be able to verify later.

I was doing that in 17134.1 VM.  The new update change its version to 17134.81. That may change the COM vtable.
So I move to my insider build 17686. I'll continue to this brach. Also in this build there is 13 parameters instead of 15 (see previous commnet).

Does anyone know what this string means    =::=::\\

He he! After so much trying, One simple thing I can't do. I can't detect the standard handles array size. Alas! 😭

@ionescu007  @therealkenc @DarthSpock Project is done with 19H1 builds. You can see commits in my repository WslReverse.

Is there anything special?

@ysc3839 The interesting thing is the interopt aka. the connection between wsl.exe and wslhost.exe.
There is also a connection b/w wsl.exe and Hyper-V.
Also a hidden pseudo console in wsl.exe. The bash.exe is deprecated.

Has anyone any idea on how to connect this COM/Console process to mintty or other terminals? Do new Pseudo console APIs work?

I'm sure you saw the ConPTY blog post. I haven't tried it yet myself, but there is enough there to get started. And yes, your "threads, events, [kitchen sink]" observation relates to the (maybe a little harsh) Rube Goldberg quip I made in the WSL hub. But that's all implementation detail. The user-facing API is what it is. The API is (to a first order) a MSFT ordained winpty replacement.
Marshaling the tty bytes in and out of WSL is still done over the publicly undocumented lxbus I assume, but you don't have to do it that way. You can do it over AF_INET (like wslbridge), or, if Sunil ever got around to finishing his work, AF_UNIX. So "connect" it however you want. For example you could just use ssh for the endpoints like this. Or telnet, for all it matters.
There's been a few hints on Hyper-V. If I had to speculate (and I do) they are tip-toeing towards virtual network devices so they can put the container asks (Docker etc) to bed. Maybe other stuff.

@therealkenc Yes, I see the ConPty blog. But the user mode thing of ConPty is less less complicated that @rprichard's winpty. The blog hasn't mention many hidden things. HPCON* phPC is a struct of three handles.

New VM Mode in WSL build 18262 (don't know what it is).


Pixiv login failed. API changed.

see https://github.com/upbit/pixivpy/issues/158
Pixiv change its login API. this program can't login pixiv too.

Im having the same problem:
[15:20:02.159][Info] [www.pixiv.net] Logging in... [15:20:03.222][Warning] [www.pixiv.net] No OAuth2 token type received: {"has_error":true,"errors":{"system":{"message":"Invalid grant_type parameter or parameter missing","code":1508}},"error":"invalid_grant"} [15:20:03.222][Info] [www.pixiv.net] Login finished: failure.
using email and a new password with special chars too

Any news yet? :(

I've just recently encountered this issue myself, not really much we can do except for a hotfix. As in for news, it seems the developer has recognized the issue, but hasn't pushed out anything yet.

@op8867555 would you be open to making a PR with your change if it's working?
That seems to also be the workaround suggested in pixivpy (using the refresh token forever).

@Bionus I just rebase my change and made a PR for it. It is somehow working but I'm not sure about it.

Thanks! It should now be fixed in the Nightly version, as long as you find a way to get an access and a refresh token.
If you've used Pixiv with Grabber before, they should already be pre-filled. Otherwise, this script should do the trick:
https://gist.github.com/upbit/6edda27cb1644e94183291109b8a5fde#file-readme-md

Traceback (most recent call last):
File "C:\WINDOWS\system32\pixiv_auth.py", line 6, in
import requests
ModuleNotFoundError: No module named 'requests'
All of this is foreign to me so i have no idea what I'm doing wrong..but line 6 definitely says "import requests"
Also not sure why it made me put it in system32, because if i didnt i just got an error

It might be a good a idea to mention this script somewhere in the documentation, because it took me a quite a while to figure out what these tokens were and how to get them.