[SPARK-33599][SQL] Group exception messages in catalyst/analysis

What changes were proposed in this pull request?
This PR group exception messages in /catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis.
Why are the changes needed?
It will largely help with standardization of error messages and its maintenance.
Does this PR introduce any user-facing change?
No. Error messages remain unchanged.
How was this patch tested?
No new tests - pass all original tests to make sure it doesn't break any existing behavior.

Test build #132610 has started for PR 30717 at commit 3e51ed7.

Test build #132610 has finished for PR 30717 at commit 3e51ed7.

This patch fails Scala style tests.
This patch merges cleanly.
This patch adds no public classes.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132610/

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37215/

Test build #132617 has started for PR 30717 at commit 815d668.

Test build #132617 has finished for PR 30717 at commit 815d668.

This patch fails Scala style tests.
This patch merges cleanly.
This patch adds no public classes.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132617/

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37215/

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37220/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/37215/

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37220/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/37220/

Test build #132630 has started for PR 30717 at commit af91864.

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37232/

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37232/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/37232/

Test build #132637 has started for PR 30717 at commit 882c2bf.

Test build #132630 has finished for PR 30717 at commit af91864.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Test build #132637 has finished for PR 30717 at commit 882c2bf.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132630/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132637/

retest this please

Test build #132644 has started for PR 30717 at commit 882c2bf.

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37240/

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37248/

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37240/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/37240/

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37248/

Test build #132644 has finished for PR 30717 at commit 882c2bf.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132644/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/37248/

retest this please

Test build #132737 has started for PR 30717 at commit 882c2bf.

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37338/

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37338/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/37338/

Test build #132737 has finished for PR 30717 at commit 882c2bf.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132737/

cc @allisonwang-db @cloud-fan

Test build #132762 has started for PR 30717 at commit dbbada0.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132762/

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37364/

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37364/

Test build #132797 has started for PR 30717 at commit 1dfd2e3.

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37399/

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37399/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/37399/

Test build #132797 has finished for PR 30717 at commit 1dfd2e3.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132797/

@allisonwang-db cc @cloud-fan @HyukjinKwon @maropu

Test build #132917 has started for PR 30717 at commit 9a06fc9.

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37521/

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/37521/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/37521/

Test build #132917 has finished for PR 30717 at commit 9a06fc9.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/132917/

cc @cloud-fan @allisonwang-db

thanks, merging to master!

Hi, @cloud-fan and @beliefer . Could you check the GitHub Action?

hmm, I thought the GA only brings extra Scala 2.13 check than jenkins. @beliefer can you check the docgen error in GitHub Action?

@dongjoon-hyun seems GA for the master branch is healthy: https://github.com/apache/spark/commits/master . This was probably transient errors.


go command complains about Ctty not valid

whenever I use the go command on MacOS X Catalina I get the following error:
jum@isis > ~/player > master > reflex -s -- go run player.go [00] Starting service [00] fork/exec /Users/jum/go/bin/go: Setctty set but Ctty not valid in child ^CInterrupted (interrupt). Cleaning up children...  jum@isis > ~/player > master > go version go version devel +8194187a2d Sun May 24 01:19:35 2020 +0000 darwin/amd64  jum@isis > ~/player > master >
Anything I can do about this?

Appears to have been an issue with my daily tip go installation.


Email notifications

we need an email service for notifications
design notes

use AWS Pinpoint instead of AWS SES since we can build on Pinpoint to do SMS and marketing campaigns
fold notifications into the service layer similar to how we did identity

priority notes

another project needs this so we want to prioritize this soon

supercedes https://github.com/navapbc/template-infra/issues/567


Crawl portion of autopipeline misses CT and RTSTRUCT files

Running  autopipeline /Users/katyscott/Documents/SARC021/images/ /Users/katyscott/Documents/SARC021/med-imageout/ --n_jobs 1 --update --overwrite doesn't find all of the CT and RTSTRUCT files in the images directory.
My images directory contains four directories total - one sample has two directories each. Each sample directory contains subdirectories containing CT and RTSTRUCTs as DICOMs. There are three different CT scans for each sample and RTSTRUCTs associated with most of them.
The output of the crawl only finds one of the three sets of CT and RTSTRUCT combinations for the first sample and two of the three CTs and one RTSTRUCT set for the second sample.
When I call the crawl_one function on its own, it appears to find all of the files. So somewhere between this and the output, the files are getting lost.

Hello, I have had a similar problem on a dataet, wher no file was found. Uponfurther inspection, it seems, that the condition for recursive search with glob (in src/imgtools/utils/crawl.py, l.17) is too strict. Inded, it only looks for files ending in ".dcm", which is not always the case for DICOM files :)
I simply changed the condition to "*", to include all files. This allowed the tool to find my patients and is actually what is present in the article's branch F1000Research
Hope this helps !

Overall, this strict matching of only "*.dcm" is a problem in multiple places in the code, for example further down the line I had the same issue with RT Structure Set files conversion
Sometimes thee files will end in .dcm, other times .DCM, other times no suffix at all !
I think it would be necessary to check the files are DICOM another way, to make this tool agnostic to the filename suffix :)


Ensure system-manager doesn't kill NB Engine containers

Currently it do it if system requirement are not satisfied.
An environment variable can be defined to disable this check.
Maybe this check should be done only before/during the installation of the NB Engine (and before an update).
This require nuvlabox/nuvlabox#23.

this can be closed as the system check only run at start and it does not cleanup any containers anymore (it sets the nb operational status to DEGRADED instead)


code.original_subtoken file not found

when I am training or evaluating, getting an error

OSError: No such file: ../../data/python/test/code.original_subtoken

Please suggest where could I find those folder data/python/test and data/python/train.

All the code released is tested, so if you face any error at your end, it means you didn't go through the documentation carefully. We do not want to help someone who doesn't help himself/herself.

All the code released is tested, so if you face any error at your end, it means you didn't go through the documentation carefully. We do not want to help someone who doesn't help himself/herself.


export to excel don't work

if in the the query tab i try to export to other than csv, i have an error 500.
pleqse find the error in the case i try to export to excel

[I 160604 22:37:26 handlers:132] Browser Connected: http://localhost:5000/beancount/query/?time=2016&query_string=balance+from+year+%3D+2014
INFO:livereload:Browser Connected: http://localhost:5000/beancount/query/?time=2016&query_string=balance+from+year+%3D+2014
ERROR:fava.application:Exception on /beancount/query/ [GET]
Traceback (most recent call last):
File "/usr/lib/python3.4/site-packages/flask/app.py", line 1817, in wsgi_app
response = self.full_dispatch_request()
File "/usr/lib/python3.4/site-packages/flask/app.py", line 1477, in full_dispatch_request
rv = self.handle_user_exception(e)
File "/usr/lib/python3.4/site-packages/flask/app.py", line 1381, in handle_user_exception
reraise(exc_type, exc_value, tb)
File "/usr/lib/python3.4/site-packages/flask/_compat.py", line 33, in reraise
raise value
File "/usr/lib/python3.4/site-packages/flask/app.py", line 1475, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/lib/python3.4/site-packages/flask/app.py", line 1461, in dispatch_request
return self.view_functionsrule.endpoint
File "/usr/lib/python3.4/site-packages/fava/application.py", line 191, in query
if not config['HAVE_EXCEL']:
TypeError: 'module' object is not subscriptable
[E 160604 22:37:35 wsgi:355] 500 GET /beancount/query/?result_format=xls&query_string=balances+from+year+%3D+2014&time=2016 (::1) 425.78ms
ERROR:tornado.access:500 GET /beancount/query/?result_format=xls&query_string=balances+from+year+%3D+2014&time=2016 (::1) 425.78ms
ERROR:fava.application:Exception on /favicon.ico [GET]
Traceback (most recent call last):
File "/usr/lib/python3.4/site-packages/flask/app.py", line 1817, in wsgi_app
response = self.full_dispatch_request()
File "/usr/lib/python3.4/site-packages/flask/app.py", line 1477, in full_dispatch_request
rv = self.handle_user_exception(e)
File "/usr/lib/python3.4/site-packages/flask/app.py", line 1381, in handle_user_exception
reraise(exc_type, exc_value, tb)
File "/usr/lib/python3.4/site-packages/flask/_compat.py", line 33, in reraise
raise value
File "/usr/lib/python3.4/site-packages/flask/app.py", line 1473, in full_dispatch_request
rv = self.preprocess_request()
File "/usr/lib/python3.4/site-packages/flask/app.py", line 1660, in preprocess_request
func(request.endpoint, request.view_args)
File "/usr/lib/python3.4/site-packages/fava/application.py", line 346, in pull_beancount_file
g.beancount_file_slug = values.pop('bfile', None)
AttributeError: 'NoneType' object has no attribute 'pop'
[E 160604 22:37:35 wsgi:355] 500 GET /favicon.ico (::1) 5.48ms
ERROR:tornado.access:500 GET /favicon.ico (::1) 5.48ms`

Have you updated to the latest version? I can't find the indicated error on the latest master.

This was fixed in 92299346.


please finish the license

please change the license to http://unlicense.org/ or add version 2 of https://en.wikipedia.org/wiki/WTFPL.
I need a more specific license to include use it. thanks

Fixed via #10


Severe Vulnerabilities in Moby BuildKit and OCI runc: CVE-2024-23651, CVE-2024-23652, CVE-2024-23653, CVE-2024-21626

Hello everyone,
is IoT Edge EFLWO affected and if so, until when will there be an update?
Detailed background
https://socradar.io/severe-vulnerabilities-in-moby-buildkit-and-oci-runc-cve-2024-23651-cve-2024-23652-cve-2024-23653-cve-2024-21626/
This release contains security fixes for the following CVEs
affecting Docker Engine and its components: https://github.com/moby/moby/releases/tag/v25.0.2
Thanks!
Kind regards,
Matthias

Hi @Prov-Matthias , yes, EFLOW was affected. The patched version was in our latest release.

Thank you for the update @SummerSmith


use currentColor to inherit current font color

Make all spinners inherit current set font color

made a pull request to spinkit instead. cheers!

:+1:
If he doesn't update soon, let me know and I'll just merge this!

@hontas This was used as inspiration for what has become 3.0

Cool :)


system diagnostics tool

thank you guys for this great tool!  I have seen the latest update about the doctor feature, just wondering how to use it, I can't find the example or tutorial in nowhere. my application becoming really slow after comprehensive crawling. this would help. thx verymuch!

@razorxl Thanks for your kind words. May I know please what "Docker features" you are referring to? And for your information, the new version, 0.3.74, the scraping process became very efficient - it's around 100 milliseconds. Above that, there are two important components that came to the game (this year): one is an executor, which is very efficient to use whatever resources are available adaptively to crawl multiple URLs at the same time. The second one is a scraper that gets the website and uses graph search algorithms and extracts everything to all the layers of that website. If you give me a little bit more information about the way you do it, I may be able to help you reach the efficiency that you want. Thanks again.


Map ECC HSIL result to CIN 3, rather than HSIL, Unspecified.

See https://github.com/ccsm-cds-tools/ccsm-cds-with-tests/issues/95 and https://github.com/ccsm-cds-tools/ccsm-cds-with-tests/issues/97, which describe how the mapping of ECC HSIL needs to be changed from "HSIL, Unspecified", to Histologic CIN3.

This would resolve the following issue: https://github.com/ccsm-cds-tools/ccsm-cds-with-tests/issues/95.


Cypress 12

Can you kindly add support to Cypress 12?

How long will take to support cypress 12?

Duplicate see https://github.com/dmtrKovalenko/cypress-real-events/issues/353

released in 1.7.6


adding .items() to iterate through dict in scvi/data/_utils.py line 191

Error raised during model = scvi.model.SCVI(adata)

Thanks for catching this, perhaps we should add a test in which extra covariates are setup and then an scvi model fit is performed?


COMMANDS DON'T WORK

I compiled the file and executed it and my bot id online. When i send this command in channel .grab photos or .grab passwords or .grab discord it says "Grabbed Password Saved" and "No Camera Found"
Like what is wrong with this?

Nothing is wrong? You dont have a camera

I compiled the file and executed it and my bot id online. When i send this command in channel .grab photos or .grab passwords or .grab discord it says "Grabbed Password Saved" and "No Camera Found"
Like what is wrong with this?

no camera found is well... just what it says
the passwords grabber is a bit outdated so you just gotta wait for an update

Ok sir 🫡


build-optimizer: enum wrapping pass is unsafe in atypical use cases

From @clydin on October 23, 2017 14:27

Bug Report or Feature Request (mark with an x)
- [X] bug report -> please search issues before submitting
- [ ] feature request

Area
- [X] devkit
- [ ] schematics

Versions

Repro steps

An enum member can contain an initializer which may have side effects.  Currently all enums are wrapping in an IIFE and annotated with PURE which will prevent the side effects from occurring if the enum is unused.
function getValue() {
  console.log('hi');
  return 6;
}

enum Test {
  ValueA,
  ValueB = getValue()
}

Desired functionality

As this will most likely be an extremely rare occurrence, a documentation note may suffice.  Additionally a warning or informational message may also be useful when an enum is encountered with a member containing a non-constant expression.
Mention any other details that might be useful

Copied from original issue: angular/devkit#234

@alexeagle looks like you typo'd the workaround label?

Just verified this locally and I'm still able to reproduce on v9.1.7. I didn't look into the pure comments for Terser, but running the following code:
function getBar(): number {
  console.log('Getting bar');
  return 2;
}

enum MyEnum {
  foo = 1,
  bar = getBar(),
}

Will print "Getting bar" with run with ng serve and will print nothing with ng serve --prod. Most likely the enum is getting tree shaken because it is unused and assumed to be pure via Terser comments when it actually isn't. I don't see any warning or compile-time error as a result of using a side-effectful function in an enum initializer.


set failOnError: false to read these buggy Samsung images

detail here: https://github.com/lovell/sharp/issues/1578

Thank you very much for this fix.
From the theory it looks good and I will merge it.
For curiosity: Do you have some test images so that I can play around and verify it?

The bug is present in about 0.3% of all photos taken by my Galaxy phone.
Sorry, but images containing a bug are not intended for publication.

Mm. Understood and accepted. If you stumble across an image which can be released for the public, please do not hesitate to send it for test coverage.
I do understand that your PR solves a problem. However I do not understand the error behavior of the gallery. Does the extractor fails silently without your fix? What is the new behavior? Also for this reason an example image would be awesome.


Is there a specific tag and label I should use when I build this from dockerfile

Hey just wondering if there is any specific info I need to write for the tag or label on the build command

Yes, thank you for your warning, I just tested and the latest label is not working.
You can use this command to start your server:
docker run -d --name pavlov-shack-server -p 7000:7000/udp -p 7400:7400/udp -p 7777:7777 -p 7777:7777/udp -p 8177:8177 -p 8177:8177/udp -p 9100:9100 -e SERVER_NAME=<your_server_name> -e [RCON_PWD=<rcon_password>] -e [RCON_PORT=<rcon_port>] -e [UPDATE_SERVER=True] -v pavlovData:/home/steam/pavlovserver/Pavlov/Saved powersjk/pavlov-vr-shack-server:1.2.0

The Docker Hub was updated, and the latest tag is working now.


Asynchronous Xopt does not make a dump file

Hi, I recently updated my xopt from 1.4.1 to 2.2.2. I noticed that running Xopt in parallel (processes, threads, MPI) does not make a dump file anymore. This makes it difficult to see the data and resume halted optimizations.
I'm running https://github.com/ChristopherMayes/Xopt/blob/main/docs/examples/basic/xopt_parallel.ipynb
The only modification I made is adding dump_file: dump.yaml to the initialization file.

It looks like this is a bug: https://github.com/ChristopherMayes/Xopt/issues/235
@ndwang What generator are you using? CNSGA now has its own population file output, which you can restart with. You don't need the dump file for that.

It looks like this is a bug: #235
@ndwang What generator are you using? CNSGA now has its own population file output, which you can restart with. You don't need the dump file for that.

@ChristopherMayes Thanks for looking into this. I found xopt.utils.read_xopt_csv can parse populations files easily and do basically the same thing. I just really liked X = Xopt.from_file('dump.yaml')


Dropdown component onClick fires twice.

<Dropdown onClick={ function(value, event){ console.log("Click: ", event, value) }} >
   Bird
   Cow
   Cow Bird Pick Cat Dog Monkey Human
   Monkey
   eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee
</Dropdown>

fixed by https://github.com/DigitalRiver/react-atlas/pull/455


views: add template folder to blueprint

Adds missing template folder to blueprint to align with the docs in https://inveniordm.docs.cern.ch/customize/authentication/#show-the-login-button

@ntarocco, I added you as a reviewer because you made that change on the docs that introduced the mismatch https://github.com/inveniosoftware/docs-invenio-rdm/commit/1550d6a3bf482a424908034c9327d3f5385bd01f

Oups I am sorry! Did I create any issue? Sorry about that!

All good! I was following the documentation myself, and I encountered this error. I believe it is more a bug we found rather than an issue you created 😉
The templates should have been there from the beginning.


setRequestInterception(true) will abort some requests?

Steps to reproduce
Tell us about your environment:

Puppeteer version: 1.9.0
Platform / OS version: mac OS X 10.14
URLs (if applicable):https://m.weibo.cn/u/6385759349?uid=6385759349
Node.js version: v9.6.1

What steps will reproduce the problem?
I wanna log all requests produced by a website until a special request appear.
const puppeteer = require('puppeteer');

(async function main() {
    try {
        const browser = await puppeteer.launch({ headless: false });
        const page = await browser.newPage();

        await page.setRequestInterception(true);
        page.on('request', interceptedRequest => {
            console.log(interceptedRequest.url());
            interceptedRequest.continue();
        });

        // make a promise to wait until a special request finished
        let limit_url = 'containerid=1076';
        let limit_prom = page.waitForResponse(response => {
            return response.url().indexOf(limit_url)>-1
        });

        // start working
        let url = 'https://m.weibo.cn/u/6385759349?uid=6385759349';
        let goto_prom = page.goto(url, {waitUntil : ["load", "domcontentloaded", "networkidle0"]}).catch(e => {console.log(e)});

        // wait both promise finished
        await Promise.all([limit_prom, goto_prom]);

        await page.close();
        await browser.close();
    } catch (err) {
        console.error(err);
    }
})();

But here is the problem:when I set true to function named setRequestInterception, some request wouldn't send. Does setRequestInterception(true) conflict with waitForResponse or there are something went wrong about setRequestInterception(true)
I tried this:
        /*
        await page.setRequestInterception(true);
        page.on('request', interceptedRequest => {
            console.log(interceptedRequest.url());
            interceptedRequest.continue();
        });
        */

log requests with function waitForResponse and it worked, but I can't log or do something about every single request with event request.
What is the expected result?

What happens instead?

Having similar issue

Dupe of #3471; closing this in favor of umbrella bug.


for of loop assigned to object field issue

Hi,
Sorry if duplicate (couldn't find one):
a: for x,y of {} => x => Fails with Unexpected '}'
a: for x of {} => x => Works fine
a= for x,y of {} => x => Works fine
a: for x,y in [] => x => Works fine

The problem occurs at lexer rewrite pass. Specifically regarding implicit object. The comma after x is interpreted as field separator of the implicit object rather than a part of the loophead.
IMHO this is (yet again) a problem with current (hacky) lexer design. It has something to do with how for loop is handled right now, which I planned to fix (but couldn't find time as it's a big change).
Tokens after rewrite:
{ ID:a : FOR: ID:x }: , ID:y OF { } INDENT:0 ID:x DEDENT:0 NEWLINE:\n


Adds improved support for Windows.

ssh-keygen swapped out for a pure JS implementation.

yusss thank you!!!


Bug in kmeans baseline function?

After running the function to extract the kmeans centroids as baselines, I saved some of these centroids as png images and noticed some of them look like noise which might suggest the presence of a bug, however, I haven't gone through the code myself.
Here are a few of the centroids generated for MNIST class 3:

Any idea of what might be the cause? If it is an actual bug I guess this would impact the values presented in the paper.
For reference, here is the code I used:
data = dataset_distillation.utils.baselines.kmeans_train(state, p=2)
imgs, labels = data[-1]  # Use last step
for i, img in enumerate(imgs):
    torchvision.utils.save_image(img, f"{i}.png", nrow=1, padding=0)

Thank you.

Thanks for pointing this out. It is possible that some centers didn't have data assigned to them. I initialized the cluster centers as random noise, but I should have done a cleverer initialization scheme like kmeans++.

Fixed in https://github.com/SsnL/dataset-distillation/commit/3837bc2b2808a04a99f26a6e71261789f45b43a8. arXiv will be updated soon.


Missing semicolon not linting in css

When there is only one property for a certain selector, and it's missing a semicolon, CSSLint won't show it as error. For instance:
a {
color: #0083e8
}
This won't show as error.

Is it really an error? As far as I know, the last rule in the section doesn't need a semicolon


i'm how fix

Game name: (please, specify the game name)
Engine version: (specify engine version, if known)
Platform: (specify platform, if known)
Error message: SerializedFile with index 4810 was not found in dependencies
Stack trace:    в uTinyRipper.SerializedFile.FindAsset(Int32 fileIndex, Int64 pathID, Boolean isSafe)
в uTinyRipper.Converters.ProjectAssetContainer.FindAsset(Int32 fileIndex, Int64 pathID)
в uTinyRipper.Classes.PPtr1.FindAsset(IAssetContainer file)    в uTinyRipper.Classes.PPtr1.ExportYAML(IExportContainer container)
в uTinyRipper.Game.Assembly.SerializableField.ExportYAML(IExportContainer container, Field& etalon)
в uTinyRipper.Game.Assembly.SerializableStructure.ExportYAML(IExportContainer container)
в uTinyRipper.Classes.MonoBehaviour.ExportYAMLRoot(IExportContainer container)
в uTinyRipper.Classes.Object.ExportYAMLDocument(IExportContainer container)
в uTinyRipper.Converters.YAMLAssetExporter.Export(IExportContainer container, IEnumerable1 assets, String path)    в uTinyRipper.Project.SceneExportCollection.Export(ProjectAssetContainer container, String dirPath)    в uTinyRipper.Converters.ProjectExporter.Export(String path, GameCollection fileCollection, IEnumerable1 files, ExportOptions options)
в uTinyRipper.GameStructure.Export(String exportPath, Func`2 filter)
в uTinyRipperGUI.MainWindow.ExportFiles(Object data)

uTinyRipper has been abandoned, but you can try my AssetRipper fork. In the event that AssetRipper encounters issues while ripping your files, feel free to post an issue on that repository.
AssetRipper is actively being developed with the intent to recover games as best as possible. Weekly releases are normally on Sunday or Monday. I encourage you to help out if you're able and willing. Code contributions can be submitted via pull requests.
If you like the work I've done and want to see it continue, please consider sponsoring me. It really does help with development. These are some of the notable things I've implemented since taking over development:

2020+ support
APK, XAPK, and IPA reading with SharpZipLib
Dummy shaders (so everything isn't pink when you open the project)
IL2Cpp support via an integration of Cpp2IL
Better game platform support
Full script decompilation with the ILSpy decompiler
Cross-platform support
Multiple configuration options
Numerous performance improvements
Support for all asset types

Sponsorship Links:

GitHub Sponsors
Patreon
Paypal


[full-ci] bump web to v7.0.0-rc.17

Bumps web to v7.0.0-rc.17

E2E tests failed: https://drone.owncloud.com/owncloud/ocis/19933/84/1
:boom: To see the trace, please open the link in the console ...

npx playwright show-trace https://cache.owncloud.com/public/owncloud/ocis/19933/tracing/user-login-can-be-managed-in-the-admin-settings-admin-2023-3-6-08-58-55.zip


Use a canonical key when updating the read cache. Map SWSS_RC_NOT_EXECUTED to ABORTED in p4rt.

Use a canonical key when updating the read cache. Map SWSS_RC_NOT_EXECUTED to ABORTED in p4rt.
rkavitha@0c0d9cfbd72e:/sonic/src/sonic-p4rt/sonic-pins$ bazel build $BAZEL_BUILD_OPTS ...
INFO: Analyzed 233 targets (4 packages loaded, 511 targets configured).
INFO: Found 233 targets...
INFO: Elapsed time: 32.502s, Critical Path: 29.76s
INFO: 36 processes: 4 internal, 32 linux-sandbox.
INFO: Build completed successfully, 36 total actions
rkavitha@0c0d9cfbd72e:/sonic/src/sonic-p4rt/sonic-pins$ bazel test $BAZEL_BUILD_OPTS ...
INFO: Analyzed 233 targets (0 packages loaded, 0 targets configured).
INFO: Found 151 targets and 82 test targets...
INFO: Elapsed time: 19.595s, Critical Path: 4.97s
INFO: 23 processes: 1 internal, 8 linux-sandbox, 14 local.
INFO: Build completed successfully, 23 total actions
//gutil:collections_test                                        (cached) PASSED in 0.2s
//gutil:io_test                                                 (cached) PASSED in 0.2s
//gutil:proto_matchers_test                                     (cached) PASSED in 0.3s
//gutil:proto_test                                              (cached) PASSED in 0.3s
//gutil:status_matchers_test                                    (cached) PASSED in 0.2s
//gutil:table_entry_key_test                                    (cached) PASSED in 0.1s
//p4_pdpi:ir_tools_test                                         (cached) PASSED in 0.3s
//p4_pdpi/netaddr:ipv4_address_and_network_address_test         (cached) PASSED in 0.2s
//p4_pdpi/netaddr:ipv6_address_test                             (cached) PASSED in 0.2s
//p4_pdpi/netaddr:mac_address_test                              (cached) PASSED in 0.3s
//p4_pdpi/packetlib:packetlib_fuzzer_test                       (cached) PASSED in 15.3s
//p4_pdpi/packetlib:packetlib_test                              (cached) PASSED in 0.1s
//p4_pdpi/packetlib:packetlib_test_runner                       (cached) PASSED in 0.1s
//p4_pdpi/packetlib:packetlib_unit_test                         (cached) PASSED in 0.8s
//p4_pdpi/string_encodings:bit_string_test                      (cached) PASSED in 0.3s
//p4_pdpi/string_encodings:byte_string_test                     (cached) PASSED in 0.2s
//p4_pdpi/string_encodings:decimal_string_test                  (cached) PASSED in 0.3s
//p4_pdpi/string_encodings:decimal_string_test_runner           (cached) PASSED in 0.0s
//p4_pdpi/string_encodings:hex_string_test                      (cached) PASSED in 0.0s
//p4_pdpi/string_encodings:hex_string_test_runner               (cached) PASSED in 0.0s
//p4_pdpi/string_encodings:readable_byte_string_test            (cached) PASSED in 0.2s
//p4_pdpi/testing:helper_function_test                          (cached) PASSED in 0.4s
//p4_pdpi/testing:info_test                                     (cached) PASSED in 0.1s
//p4_pdpi/testing:info_test_runner                              (cached) PASSED in 0.1s
//p4_pdpi/testing:main_pd_test                                  (cached) PASSED in 0.0s
//p4_pdpi/testing:mock_p4_runtime_server_test                   (cached) PASSED in 0.3s
//p4_pdpi/testing:packet_io_test                                (cached) PASSED in 0.1s
//p4_pdpi/testing:packet_io_test_runner                         (cached) PASSED in 0.0s
//p4_pdpi/testing:rpc_test                                      (cached) PASSED in 0.1s
//p4_pdpi/testing:rpc_test_runner                               (cached) PASSED in 0.1s
//p4_pdpi/testing:sequencing_test                               (cached) PASSED in 0.1s
//p4_pdpi/testing:sequencing_test_runner                        (cached) PASSED in 0.1s
//p4_pdpi/testing:table_entry_gunit_test                        (cached) PASSED in 0.4s
//p4_pdpi/testing:table_entry_test                              (cached) PASSED in 0.1s
//p4_pdpi/testing:table_entry_test_runner                       (cached) PASSED in 0.1s
//p4_pdpi/utils:annotation_parser_test                          (cached) PASSED in 0.2s
//p4_pdpi/utils:ir_test                                         (cached) PASSED in 0.3s
//p4rt_app/p4runtime:ir_translation_test                        (cached) PASSED in 0.4s
//p4rt_app/p4runtime:p4info_verification_schema_test            (cached) PASSED in 0.4s
//p4rt_app/p4runtime:p4info_verification_test                   (cached) PASSED in 0.4s
//p4rt_app/p4runtime:packetio_helpers_test                      (cached) PASSED in 0.5s
//p4rt_app/sonic:app_db_acl_def_table_manager_test              (cached) PASSED in 0.5s
//p4rt_app/sonic:app_db_to_pdpi_ir_translator_test              (cached) PASSED in 0.5s
//p4rt_app/sonic:packetio_impl_test                             (cached) PASSED in 0.4s
//p4rt_app/sonic:packetio_port_test                             (cached) PASSED in 0.3s
//p4rt_app/sonic:state_verification_test                        (cached) PASSED in 0.2s
//p4rt_app/sonic/adapters:fake_sonic_db_table_test              (cached) PASSED in 0.0s
//p4rt_app/tests/lib:app_db_entry_builder_test                  (cached) PASSED in 0.0s
//p4rt_app/utils:event_data_tracker_test                        (cached) PASSED in 0.0s
//p4rt_app/utils:table_utility_test                             (cached) PASSED in 0.4s
//sai_p4/instantiations/google:clos_stage_test                  (cached) PASSED in 0.2s
//sai_p4/instantiations/google:fabric_border_router_p4info_up_to_date_test (cached) PASSED in 0.0s
//sai_p4/instantiations/google:middleblock_p4info_up_to_date_test (cached) PASSED in 0.0s
//sai_p4/instantiations/google:sai_p4info_fetcher_test          (cached) PASSED in 0.3s
//sai_p4/instantiations/google:sai_p4info_test                  (cached) PASSED in 0.5s
//sai_p4/instantiations/google:sai_pd_proto_test                (cached) PASSED in 0.0s
//sai_p4/instantiations/google:sai_pd_util_test                 (cached) PASSED in 0.2s
//sai_p4/instantiations/google:union_p4info_up_to_date_test     (cached) PASSED in 0.0s
//sai_p4/instantiations/google:wbb_p4info_up_to_date_test       (cached) PASSED in 0.1s
//sai_p4/tools:p4info_tools_test                                (cached) PASSED in 0.3s
//p4rt_app/event_monitoring:app_state_db_port_table_event_test           PASSED in 0.5s
//p4rt_app/event_monitoring:config_db_node_cfg_table_event_test          PASSED in 0.5s
//p4rt_app/event_monitoring:config_db_port_table_event_test              PASSED in 0.5s
//p4rt_app/event_monitoring:state_verification_events_test               PASSED in 0.5s
//p4rt_app/sonic:app_db_manager_test                                     PASSED in 0.4s
//p4rt_app/sonic:response_handler_test                                   PASSED in 0.3s
//p4rt_app/sonic:vrf_entry_translation_test                              PASSED in 0.4s
//p4rt_app/tests:acl_table_test                                          PASSED in 0.8s
//p4rt_app/tests:action_set_test                                         PASSED in 0.6s
//p4rt_app/tests:api_access_test                                         PASSED in 0.5s
//p4rt_app/tests:arbitration_test                                        PASSED in 0.6s
//p4rt_app/tests:fixed_l3_tables_test                                    PASSED in 1.5s
//p4rt_app/tests:forwarding_pipeline_config_test                         PASSED in 2.0s
//p4rt_app/tests:grpc_behavior_test                                      PASSED in 5.0s
//p4rt_app/tests:p4_constraints_test                                     PASSED in 0.1s
//p4rt_app/tests:p4_constraints_test_runner                              PASSED in 0.1s
//p4rt_app/tests:p4_programs_test                                        PASSED in 0.8s
//p4rt_app/tests:packetio_test                                           PASSED in 2.9s
//p4rt_app/tests:port_name_and_id_test                                   PASSED in 0.7s
//p4rt_app/tests:response_path_test                                      PASSED in 1.3s
//p4rt_app/tests:role_test                                               PASSED in 0.6s
//p4rt_app/tests:state_verification_test                                 PASSED in 0.7s
Executed 22 out of 82 tests: 82 tests pass.
There were tests whose specified size is too big. Use the --test_verbose_timeoutINFO: Build completed successfully, 23 total actions

Co-authored-by: Robert Halstead<EMAIL_ADDRESS>

@kishanps , Can you please review.
Thanks

@rkavitha-hcl The tests failed, maybe there was a problem in the conflict resolution I did after the prev code merge. Pls fix.


utf8 charset header was missing in basic layout

the meta tag for charset is missing in "basic" layout but included in "starter" layout.
I just added  utf8 charset to hyde/layouts/basic/layout/base.j2

Ooops... sorry, I just closed this PR.


Feature: ng serve build and watch only

I'm hosting my website with apache (backend is written in Perl). I configured the cli to output the compiled/built files to the apache www folder.
I'd like to use "ng serve" (or another command) to continuously watch my files and run the build if there were changes. "ng serve" would do, but I don't need to host my website on any port, apache does it for me.

ng build --watch should do it for you.

It's not doing it. Doesn't capture when I change the files.
System: latest Gentoo with Gnome 3.2
Latest angular-cli, latest npm, latest node.

Eh that's weird. So ng serve captures the file changes, but ng build --watch doesn't?

Sorry, ng serve doesn't capture either. :\

That's all it says:
$ ng build --watch
Hash: e1fda1b06970e21f1e6e
Time: 11412ms
chunk    {0} main.bundle.js, main.bundle.map (main) 24.4 kB {2} [initial] [rendered]
chunk    {1} styles.bundle.css, styles.bundle.map, styles.bundle.map (styles) 177 kB {3} [initial] [rendered]
chunk    {2} vendor.bundle.js, vendor.bundle.map (vendor) 2.92 MB [initial] [rendered]
chunk    {3} inline.bundle.js, inline.bundle.map (inline) 0 bytes [entry] [rendered]

Ok then that's a different issue... One I don't have an answer to off the top of my head.
The answer to this issue is ng build --watch, but there seems to be something stopping the file watchers from working in your setup. Can you open a new issue for this?
We have a somewhat obscure poll option but it only works for ng serve, so it's no good for your case.


Sean Yeo: Shortcuts for undo and redo

There are no keyboard shortcuts for undo and redo.
Credits to Sean Yeo for testing.

Resolved


Add topic scoring & reduce pubsub spam

Add topic scoring to both the GPBFT topic and the manifest topic.
Use hashing for message IDs in the manifest network and increase the rebroadcast time.
In the manifest validator, drop messages with old sequence numbers.

Bump the pubsub topic versions at the same time?


Add tooltips for hashtable key completions

PR Summary
Fixes https://github.com/PowerShell/PowerShell/issues/15450
Add tooltips for hashtable key completions
Add completion for calculated properties for Compare-Object and ConvertTo-HTML
Add argument completer for the Property parameter of ConvertTo-Html
Use resource files instead of dictionary for comment completion tooltips
Correct me if I'm wrong but I assume there's no need for tests for the tooltips and probably not for the argument completion for Compare-Object and ConvertTo-HTML since I'm just adding entries to the switch/if statements.

PR Context

PR Checklist

[X] PR has a meaningful title

Use the present tense and imperative mood when describing your changes

[X] Summarized changes
[X] Make sure all .h, .cpp, .cs, .ps1 and .psm1 files have the correct copyright header
[X] This PR is ready to merge and is not Work in Progress.

If the PR is work in progress, please add the prefix WIP: or [ WIP ] to the beginning of the title (the WIP bot will keep its status check at Pending while the prefix is present) and remove the prefix when the PR is ready.

Breaking changes

[X] None
OR
[ ] Experimental feature(s) needed

[ ] Experimental feature name(s):

User-facing changes

[X] Not Applicable
OR
[ ] Documentation needed

[ ] Issue filed:

Testing - New and feature

[X] N/A or can only be tested interactively
OR
[ ] Make sure you've added a new test if existing tests do not effectively test the code changed

Tooling

[X] I have considered the user experience from a tooling perspective and don't believe tooling will be impacted.
OR
[ ] I have considered the user experience from a tooling perspective and opened an issue in the relevant tool repository. This may include:

[ ] Impact on PowerShell Editor Services which is used in the PowerShell extension for VSCode
(which runs in a different PS Host).

[ ] Issue filed:

[ ] Impact on Completions (both in the console and in editors) - one of PowerShell's most powerful features.

[ ] Issue filed:

[ ] Impact on PSScriptAnalyzer (which provides linting & formatting in the editor extensions).

[ ] Issue filed:

[ ] Impact on EditorSyntax (which provides syntax highlighting with in VSCode, GitHub, and many other editors).

[ ] Issue filed:

@daxian-dbw Can you review?


[META] Support Hybrid Disk/Memory Algorithms

Overview
One common problem around dense vector search is the amount of memory required to implement a solution that delivers high performance and recall. The problem is grounded in the fact that many ANN algorithms require fast, random access to the full floating representations of the vectors  as well as auxiliary data structures (in-memory algorithms). HNSW is one example of such an algorithm. While there are techniques, like Product Quantization, that allow the memory footprint of the algorithm to be greatly reduced, it can be difficult to achieve high recall (refer to a blog I wrote awhile ago around IVFPQ vs. HNSW for billion-scale search: https://aws.amazon.com/blogs/big-data/choose-the-k-nn-algorithm-for-your-billion-scale-use-case-with-opensearch/). Anecdotally, users typically want a recall above 0.9, where recall is defined as the ratio of neighbors returned that are ground truth nearest neighbors. Similarly, techniques such as scalar quantization and dimensionality reduction can also be employed, but some users may want a more significant reduction in memory.
Another approach that has gained a lot of interest is utilizing fast access disks (i.e. SSDs) in order to extend memory. I will refer to these algorithms as hybrid algorithms. hybrid algorithms will keep some kind of a small representation of the index in memory and the rest on disk. Then, during search, the algorithms will intelligently select a few items to read from disk with the goal of optimizing query latency/working set size/recall tradeoff. A few popular examples are:

DiskANN — an hybrid graph traversal approach — https://suhasjs.github.io/files/diskann_neurips19.pdf
faiss IVF on disk — mapping the IVF algorithm to store vectors on disk — https://github.com/facebookresearch/faiss/blob/main/benchs/distributed_ondisk/README.md
SPANN — a partitioning based approach similar to IVF —  https://arxiv.org/pdf/2111.08566.pdf

For OpenSearch, given the potential benefit, we should investigate adding support. There are several approaches that we can take to add support:

Integrate already existing functionality from faiss
Add new engines to support new algorithms
Enhance existing engines with new/modified algorithms
Do nothing

For each approach, there are also a lot of factors to consider - (integration feasibility into OpenSearch, support for aux features such as filtering, etc.). At the moment, we do not have enough data to figure out what route to go. Therefore, we will need to conduct an investigation into existing approaches. This issue is a general META issue that tracks the project as a whole. All feedback/collaboration is welcome. If there are approaches that you have tried that worked well (or not so well), please share your experiences!
Tasks
(Task list is subject to evolve)

[ ] Research approaches and compile comparison report with respect to performance as well as feasibility wrt OpenSearch [ISSUE: TBD]
[ ] (If applicable) Create RFC suggestion integration plan
[ ] (if applicable) Create proof of concept integration with OpenSearch
[ ] (if applicable) Conduct performance evaluation against OpenSearch
[ ] (if applicable) Productionalize code

Related Issues
related issue: #758

@jmazanec15 Thanks for creating this issue. I kind of align on the high level task, but would love to see more breakdown of these tasks with time bound investigation and scope.
Is there any specific feedback you are looking here?

Please +1 if you wish to have this feature prioritized

Thanks @navneet1v

but would love to see more breakdown of these tasks with time bound investigation and scope.

Sure, will evolve this as we go. Mainly put out the issue for tracking purposes.

Is there any specific feedback you are looking here?

Not specific feedback - would like to see if anyone has used a disk based approach and wants to share their opinion. This is a tracking issue, not an RFC. There will be more issues to come seeking more direct feedback.

+1 LGTM

adding the below resources, looks like a similar issue came out in Lucene:
https://foojay.io/today/jvector-1-0/
https://github.com/apache/lucene/issues/12615
credit to @reta for bringing those to my attention


Minor tweaks to utils and new TypeRegistry process

I've been working on a new way of reading types from yaml -- PR coming in the next couple weeks -- but found these small improvements to the existing codebase which seemed appropriate and would be good to get in sooner.

this is pretty simple - @neykov @grkvlt could one of you cast a quick eye over it?

@ahgittin (cc @neykov) I haven't looked thoroughly enough at the BrooklynTypeRegistry and RegisteredType before, to give a proper review of this.
It would be useful for me (and other contributors I'm sure) to get an overview of the type registry, and of your new way of reading types (we don't need to wait until the PR to get an overview - in fact posting to the dev@brooklyn mailing list for such big changes would be good).

LGTM. Merging - can address changes in next PRs.

@aledsage yes, i'd like to talk about that.  nearly have something cool to show.


Apple Watch support

Would be great if it could work on Apple Watch (:

Added in https://github.com/marmelroy/Localize-Swift/commit/aa00158a1bdbd24654e44d3786f61727039acd3a
(to be packaged in the next release)


Business and Functional Requirements

Emily Blattmachr, Sr. Proposal Writer at Resource Data
N/A
Do you have a list of identified business and functional requirements?

Yes. Section 3.02 describes the requirements.


Should I modify redtail ros packages or create new packages ?

Hi,
To implement redtail project by adding new features, I am working on ROS for a while, but got stuck. I want that the drone flies along the x and y directions (like _altitude_gain:=2)  for searching a specific object (i.e maze) after gaining specified altitude. If we split the tasks into 2

For movement along the x and y directions, how can I add the feature of flying along x and y directions?  Which ros files of redtail should I modify? or Should I create new files?

For searching specific object (idk if YOLO detects maze or not), I need to use image processing. Is there any easy way to do this by using ROS? (i.e readily available ros packages)

Best.

There are few things you may want to consider.

If you goal is to simply move laterally, then you can use the same approach we used in our px4_controller which is a waypoint navigation via MAVROS. To move the drone in x,y directions, px4_controller publishes waypoints using setpoint_position topic. Please refer to MAVROS wiki and px4_controller sources for more details.

If your goal is to perform complex navigation using data from multiple sensors then you should look at ROS navigation stack.

Our YOLO DNN was trained on PASCAL VOC dataset so it recognizes only simple classes from that dataset. If you want something else, you can either train a different DNN or use some other computer vision techniques (e.g. from OpenCV). ROS provides integration with OpenCV via vision_opencv package.

Thank you Alexey, you provided good points.
One more thing. I am trying to change the location of the host computer for qgroundcontrol. Should I modify the redtail/ros/packages/px4_controller/launch/mavros_caffe_ctl.launch for fcu_url and gcs_url?

fcu_url parameter specifies the address of FCU (e.g. real Pixhawk or the simulator). gcs_url specifies the address of a machine where GCS (Ground Control Station, e.g. QGroundControl) is running. See this for more details.
As for the map in QGC - since you don't have a GPS lock, it will use default map which is Zurich. You can probably change that to something else but I haven't tried that. Hopefully QGC documentation can provide more details.

Thank you for the information.

I needed to reopen the topic. You said that I don't have GPS lock. However, when I start the gazebo simulator with mavros and QGroundControl, there is written GPS lock: 3D Lock under the GPS status toolbar. Doesn't that mean that I have a GPS lock ?


container option doesn't work

Expected behaviour
Calendar should be appended in de container selector used
Actual behaviour
The calendar is appended in default container 'body', but when the container option is adde by 'data-date-container' it works.
Datepicker version used
1.8
ex. 1.6.1.
Example code
$('.calendarbug').datepicker({container: ".wrapper"})

Sorry I found the bug in my code
I did:
$('.calendarbug').datepicker("setDate" ,date);
and after:
$('.calendarbug').datepicker({container: ".wrapper"});

I close it because it's a behaviour not a bug.


Creating Infrastructure using Pulumi

Moving the PR from https://github.com/ossf/package-feeds/pull/40

Should the test be passing here? Or do we need to setup the secret first?

We need to set up the secret for PULUMI_ACCESS_TOKEN and GOOGLE_CREDENTIALS


console.log(2) in the source file

You must have left it by mistake:
https://github.com/NetanelBasal/ngx-take-until-destroy/blob/master/src/take-until-destroy.ts#L26

Thanks, fixed in 4.1.2.


Updated text for the day of the week that we host the meetup

@ benedmunds This won't actually make it to the homepage since you didn't run composer build.  The build-check job above is failing

Fixed in 46c494e550734647182a73cf06581a3e3609efeb via #25


Turning off cache for development

How do you  turn off the cache for development purposes? It is frustratingly difficult to develop now as this image caches so agressively (which is awesome for production though).

The conf/html and conf/phpconfigs that are supplied are opinionated as the readme details.  Those configs are templates for people to build upon, tear down or toss away.  Why not create your own conf/yourownconfig that reflects a dev, stage or production setup?  You can create a conf/dev, conf/stage and conf/prod configs that reflect your desired setup.  You can easily create a compose file dev.yml, stage.yml and prod.yml that makes running everything super simple.

The challenge with any pre-built set of configurations is that it depends on what you are developing.  Is it html, php, python, something else?   Is it just cache or anything else? I don't know. You could always use basic for a local development configuration but I'm guessing that is not what you want.  The goal of releasing this was to allow others to build upon. You could always contribute by creating a development configuration and I would be happy to review a pull request. If you just want to fork, that is up to you.


Minimize GHA permissions

Set the GitHub Actions token permission to null in most workflows.
This results in:
GITHUB_TOKEN Permissions
Metadata: read
The default permissions, used without the null override, are:
GITHUB_TOKEN Permissions
Actions: read
Checks: read
Contents: read
Deployments: read
Discussions: read
Issues: read
Metadata: read
Packages: read
Pages: read
PullRequests: read
RepositoryProjects: read
SecurityEvents: read
Statuses: read
Two jobs require non-null permissions to function.
The Anchore vulnerability scan GHA that reports results on merges needs
security-events write permission to publish SARIF reports using
github/codeql-action/upload-sarif. Fails with HTTP 403 otherwise.
The dependent issues GHA needs PR/issues write permissions to add/remove
dependent labels. It needs status write permission to block/unblock
PRs when dependencies are missing/met. Fails with HttpError otherwise.
Signed-off-by: Daniel Farrell<EMAIL_ADDRESS>

FYI I verified the dependent issues PR write permission here:
https://github.com/dfarrell07/lighthouse/runs/7997670733?check_suite_focus=true#step:2:19
and the statues permission here:
https://github.com/dfarrell07/lighthouse/runs/7998606414?check_suite_focus=true#step:2:22

The next version of this PR (https://github.com/submariner-io/admiral/pull/405) has a better commit message and answers a question that had be bothering me about why we need write permissions when we seem to see read as the default.

The next version of this PR (submariner-io/admiral#405) has a better commit message and answers a question that had be bothering me about why we need write permissions when we seem to see read as the default.

tl;dr we're reducing the permissions even more than this commit message makes it seem


feature: end-to-end NER pipeline

Description
This PR aims at providing an end to end pipeline to perform the following workflow:
- train a model on a given dataset
- evaluate the model on a given test dataset
- test the trained model on a set of tests
- augment the training set based on the tests outcome
- retrain the model on a the freshly generated augmented training set
- evaluate the retrained model on the test dataset
- compare the performance of the two models

This way the user is able to train a model and tests behaviours that matter using langtest. Based on the outcome of those tests langtest will augment the original training set with samples on which the model failed. The model will then be retrained on this augmented dataset and compared to the original on the generated set of tests.
It for now supports the transformers library and the NER task. The datasets can be passed in conll or csv format.

[x] I've used pydantic for typing when/where necessary.
[x] I have linted my code
[x] I have added tests to cover my changes.

I am stuck trying to update the poetry.lock file.. For some reason poetry gets stuck trying to resolve the dependencies


Is this a shortcut syntax for defining target state?

Just wondering is the following code from the TodoMVC is a shortcut for defining target state?
I had flipped through the doc a couple of times but didn't find where it mentioned what the . and the minimal syntax meant, hence the question.
'SHOW.all': '.all',
'SHOW.active': '.active',
'SHOW.completed': '.completed',

Added to docs, here's a preview:

Child state nodes can be targeted relative to their parent by specifying a dot ('.') followed by their key:
const optionsMachine = Machine({
  id: 'options',
  initial: 'first',
  states: {
    first: {},
    second: {},
    third: {}
  },
  on: {
    SELECT_FIRST: '.first', // resolves to 'options.first'
    SELECT_SECOND: '.second', // 'options.second'
    SELECT_THIRD: '.third' // 'options.third'
  }
});

By default, relative targets are internal transitions.


Limitation of LayerConfiguration.addEntry()

We've been OK, but I think this will matter more when we release jib-core as a library.
Let's say I have
/usr/home/user/extra-files/file1
/usr/home/user/extra-files/file2
/usr/home/user/extra-files/sub/file3
/usr/home/user/extra-files/sub/file4
/usr/home/user/extra-files/sub/directory/file5
/usr/home/user/extra-files/sub/directory/file6

Some observations (abusing Java syntax):

Adding the root directory: addEntry([/usr/home/user/extra-files/], /dest/in/image) results in/dest/in/image/extra-files/file1
/dest/in/image/extra-files/file2
/dest/in/image/extra-files/sub/file3
/dest/in/image/extra-files/sub/file4
/dest/in/image/extra-files/sub/directory/file5
/dest/in/image/extra-files/sub/directory/file6

Adding files: addEntry([/usr/home/user/extra-files/file1], /dest/in/image) results in/dest/in/image/file1

Now, suppose that I want to put only some of the files from /usr/home/user/extra-files/ into /dest/in/image/extra-files/ so that the image will look like
/dest/in/image/extra-files/file1
/dest/in/image/extra-files/sub/file3
/dest/in/image/extra-files/sub/directory/file5

Currently, the only way I can see to achieve this is to create three separate layers with different destination paths like below. There seems no way to create a single layer that contains the three files.
addEntry([/usr/home/user/extra-files/file1],
         /dest/in/image/extra-files)
addEntry([/usr/home/extra-files/sub/file3],
         /dest/in/image/extra-files/sub)
addEntry([/usr/home/extra-files/sub/directory/file5],
         /dest/in/image/extra-files/sub/directory)

Lastly, I think the following Javadoc of addLayer() is not correct:
     * @param sourceFiles the source files to build from. Source files that are directories will
     *     have all subfiles in the directory added (but not the directory itself)

As can be seen from the example above, if the source path is a directory, the directory itself is added too. (extra-files/ in the above example)

Yep! I'm actually fixing this currently via #956.

Yes, this is no longer an issue.


[Feature] HMR with multiple clients

What is the current behavior?

Create a new react-native project either with react-native-cli or create-react-native-app
Open app on simulator
Open app on device
Disable live reloading and enable hot reloading on both of them
Make changes
Only the most recently connected client will update

What is the expected behavior?
Both clients should hot reload
Please provide your exact metro-bundler configuration and mention your metro-bundler, node, yarn/npm version and operating system.
Default react-native configuration for 0.45 (react-native-cli) and 0.44 (create-react-native-app). This is a longstanding issue that as far as I know has been present since the inception of HMR in react-native. Yarn 0.24., macOS 10.12.4

+1

The HMR code is still in react-native/local-cli.

@cpojer - is it moving here? if so, where's the best place for this issue? I imagine it will just be ignored or closed on react-native and then have to be re-opened here if it moves to metro

It may move here but for now the code is in react-native and the change needs to be made there. Sorry about the confusion.


useReanimatedKeyboardAnimation doesn't look smooth like the Reanimated UseAnimatedKeyboard hook in IOS when closing the keyboard

Describe the bug
Hello! I'm creating a chat app and using fakeView. I'm using useReanimatedKeyboardAnimation but the height value is faster than useAnimatedKeyboard height value in iOS. Also how to add instets bottom? when i use useReanimatedKeyboardAnimation i use it like this: height: height.value ? Math.abs(height.value) : insets.bottom but it is not working with useAnimatedKeyboard (jumping)
Code snippet
Add your code snippet where error has been occurred.
<>
const { height } = useReanimatedKeyboardAnimation(); // ---- useAnimatedKeyboard ----

const fakeView = useAnimatedStyle(
() => ({
	height: height.value ? Math.abs(height.value) : insets.bottom,
}),[],);

<View style={styles.container}>
	<Chats.MessagesList
		data={allMessages}
	/>
	<Chats.MessageActions
		chat={chat}
		setMessages={setMessages}
	/>
	<Animated.View style={fakeView} />
      </View>
</>

Repo for reproducing
I would be highly appreciate if you can provide repository for reproducing your issue. It can significantly reduce the time for discovering and fixing the problem.
https://github.com/kirillzyusko/react-native-keyboard-controller/blob/main/example/src/screens/Examples/ReanimatedChatFlatlist/index.tsx
To Reproduce
Steps to reproduce the behavior:

Use ReanimatedChatFlatlist example
Open on ios simulator
Change useReanimatedKeyboardAnimation to useAnimatedKeyboard
Check the difference when opening/closing the keyboard.

Expected behavior
A clear and concise description of what you expected to happen.
The keyboard closes smoothly, as when using the useAnimatedKeyboard hook.
Screenshots
If applicable, add screenshots to help explain your problem.
useReanimatedKeyboardAnimation:
https://github.com/kirillzyusko/react-native-keyboard-controller/assets/99968085/c6514ea1-c8fd-4f5d-9687-ffa51bdf8d9f
useAnimatedKeyboard:
https://github.com/kirillzyusko/react-native-keyboard-controller/assets/99968085/21ba6bf7-dfa8-4a53-9f57-db41c9503bc5
Smartphone (please complete the following information):

Desktop OS: [MacOS]
Device: [Phone14]
OS: [iOS 16.6]
RN version: [0.72.7]
RN architecture: [old]
JS engine: [Hermes]
Library version: [1.9.5]

Additional context
Add any other context about the problem here.

Hello @devoren
If you want to have the same behavior as reanimated hook, then you can use something like this:
const useAnimatedKeyboard = () => {
  const height = useSharedValue(0);

  useKeyboardHandler({
    onMove: (e) => {
      'worklet';

      height.value = e.height;
    },
  }, []);

  return { height };
}

However it's strange that there is no back animation. In my example app it's present:
https://github.com/kirillzyusko/react-native-keyboard-controller/assets/22820318/0cd79e51-a0e6-40f0-bc7e-237833e7c214
The only difference I see in RN version (0.72.4 vs 0.72.7), iOS version (17.2 vs 16.6), device (iPhone 15 Pro simulator vs iPhone 14).
The described problem I observed in RN 0.73 🤔 But I haven't figured out what is causing this problem yet

@kirillzyusko Hey! im sorry, RN version is 0.72.6. Yeah no back animation and height value is jumping from -326 to -0 when closing the keyboard.

Yeah no back animation and height value is jumping from -326 to -0 when closing the keyboard

@devoren that how it was designed to work. When keyboard appears it will also instantly change the height from 0 to -326. iOS kind of schedules layout animations and because of that animation actually happens.
When you are using onMove handler then you will get intermediate values, but they will not be perfectly synchronized with a keyboard (they will be always kind of one frame behind, because I'm pulling keyboard coordinates via DisplayLink and it fires a callback before next frame).
Can you try to clone the repo and run example app? Are you observing the same problem there? What is the react-native-reanimated version you are using?

"react-native-reanimated": "^3.6.1". Okay i will try it today, thank you!

@kirillzyusko Hello! Sorry for the late feedback. I tried the example but the back animation is still not working. Can you check flatlist example? Chat works but chat flatlist example not. RN 0.72.4v, ios 16.4, iphone 13
https://github.com/kirillzyusko/react-native-keyboard-controller/assets/99968085/81719a10-6dc0-4d87-b196-6b8e8d37fc48

Hm, very interesting @devoren
I'll investigate it, but for now I'd suggest you to go with:
const useAnimatedKeyboard = () => {
  const height = useSharedValue(0);

  useKeyboardHandler({
    onMove: (e) => {
      'worklet';

      height.value = e.height;
    },
  }, []);

  return { height };
}

Since you are animating height (i. e. non UI props) it's better to sync up values on every frame 🙂

In production, the "back animation" is better than DEV mode, and also the back animation only doesn't show up if I dismiss the keyboard by pressing the list rather than the keyboard back button. @kirillzyusko thank you ❤

@focux @nandorojo @devoren @jongbelegen looks like you are all experienced this problem.
I fixed it in 1.11.5 version and published it on npm so you can use useReanimatedKeyboardAnimation/useKeyboardAnimation hooks as before and it should work as expected 👀
If it doesn't work in your case (for some reasons), please open a new issue 🙏

Sounds good. Thank you so much!

Confirm it got fixed in v1.11.5, thanks! 🙏


Fixing a write-after-end-of-array bug in janus_evaluate_search

Hi Janus Dev Team,
In testing our API I ran into a segfault in the case where the number of actual returned search results was less than the number of requested returned search results.
I ended up tracing the problem to a bug in janus_io.cpp. Essentially the similarity_matrix array was being indexed as if the code were accessing it from the start of the array, but really the similarity_matrix pointer was getting incremented during the loop so the indexing should have been relative to the current row.
This pull request fixes that bug. It also adds an extra check to see if the janus_search function ended up returning more search results than requested. I just figured if I was making changes I might as well add this check in as well.
Thanks,
Stephen Rawls (ISI)

P.S.
Not sure how you want to handle the phase 1 branch, but this bug is also present in the phase 1 branch.

Thanks Stephen this looks good to me.  I'll update the phase1 branch once you merge this.
Ben

Hi Ben. I removed the now obsolete variable as suggested. Do you mean I should merge into the master branch? I'm still new to github and unsure of the correct protocol--I created a feature branch for my pull request because I thought maybe that's what I was supposed to do. Should I have instead just given a pull request for the master branch?

Hi Stephen, yes I do mean to merge into the biometrics:master branch which is what will happen if you click the "Merge pull request" button below.  Since you don't have direct write access to this repo Github forked your own copy for you, which you can then make changes to as you have been and merge your changes back into the original janus repository here.

Hi Ben,
Sorry for the confusion, I thought you meant I was suppose to merge into master, which I was unsure of how to do (e.g. merge into master in my fork? how would that effect this pull request?).
Looks like you merged into master, so that's good.
Quick question: should we send a courtesy e-mail to<EMAIL_ADDRESS>to point folks to this change in case other teams encounter the bug?
Thanks!
Stephen

Yes if you could send a quick email to the mailing list that would be appreciated, thanks!

Ok will do. Just to confirm: you are going to change phase1 branch as well? Or do I need to issue another pull request?

No I will change the phase1 branch, thanks.


Non-exported modules visible in bundle

I'm not sure if I'm missing something here, or if this is the expected behavior. If I've got two files:
internal.js
export const value = 123;

external.js
import { value } from './internal';
export function run() {
    alert(value);
}

If I use builder to bundle external.js, I end up with the following result (trimmed):
System.register("internal.js", [], ...);
System.register('external.js', ['internal.js'], ...);

In other words, two public modules are registered - 'internal' and 'external'. Given the nature of the source code, and the fact that 'external.js' was specified as the source, I'd have expected the internal.js module to be hidden. As it stands, a consumer of the bundle would be able to import either when I'd intended only the exports of 'external.js' to be available.
Is this intended, or am I doing something wrong?

Yes by default all modules are public in SystemJS.
I'd advise rather using a project like Rollup (http://rollupjs.org) to handle these kinds of internal optimizations, then move to SystemJS builder to handle the public tree builds. We're working on integration of Rollup for these kinds of optimizations, but these workflows are not yet ready in SystemJS Builder.

Thanks Guy, I'll take a look at Rollup - first I've heard of it, looks promising!


Redistributing the model in other format

Hello,
I was able to use phoGPT in CPU-only mode with llama.cpp . I would want to convert the model into the llama.cpp's own format (.GGUF) and post it to HuggingFace (similar to this repo for example). I have gone through the LICENSE file and it looks like this would be fine. However I still want to make sure if am I allowed to perform such action?
Regards,

Yes.
Details are presented in the Section "1. License Rights and Redistribution." in the LICENSE.


Mekanism pipes crashing server

Greetings!
I have been using the latest Mekanism 1.10.2 build (301) in my private pack, which I am still testing. It works fine mostly, but there is one reproducible crash issue relating to pipes. When I teleport back to my base area (usually coming through the Nether Portal, but the method does not matter, happens with other methods, too), the server instantly crashes with a ticking block entity error. Crash log:
https://hastebin.com/edinarimoq.pl
This happened several times now, always pointing to a block that was occupied by a Mekanism pipe (Ultimate Mechanical Pipe, Elite Logistical Transporter, at this point I think all of them are affected). The pipes in question are not in direct contact with the teleport location, but some blocks off to the side. When I remove them, the crashes stop happening. Crash happens fairly often, but not on every occasion, maybe 50% of the time I teleport back there. Base is not chunkloaded prior to teleporting.
The client gets kicked out on server crash, but remains stable itself. This is purely a server issue. Running on Forge <IP_ADDRESS>1, using Asie's FoamFix on both client and server (coremod/anarchy version on the client, lawful version on the server). I'd be happy to provide further information, just tell me what you need.
My workaround for now is not using Mekanism pipes, at least not in the vicinity of teleporting locations.

Thank you for your descriptive report! I've got 2 questions:
Can you show a picture of the surroundings of the crashing pipe? Trying to replicate the issue over here.
And can you replicate it without foamfix?

Here is a picture of the pipe from the crash report (right in the middle between the Immersive Engineering Coke Ovens). It did happen with several others. Basically, as long as any Mekanism pipe was near, the crash would occur. Now that I think of it, Universal Cables are exempt from this - still have them, but no crashes. It might be important that all the pipes in question had been set to force-extract on at least one end. My (wild) guess is that the code doing the force-extract is triggering the issue.
I will make a test run without Foamfix next.

Turns out I meant to include Foamfix in the server package, but never got around to it. These crashes are happening without Foamfix - while the client has it, the server is the one that is crashing.

Shouldn't be an issue anymore in 1.11 :)


Ingress Changes

I was troubleshooting nginx-ingress and the TLS passthrough option on Minikube was a bit painful to set. So, for now, I switched the ingress to the Openshift router, where the TCP load-balancing works as expected and things are easier to debug.
To install:
make install-router
make deploy IMG=quay.io/project-flotta/flotta-operator TARGET=k8s

No need to update the documentation?

No need to update the documentation?

Just a follow-up PR in docs as soon this is finished :-)


Incognito browser context shares the same cookies

async function newPageWithNewContext(browser) {     const context = await browser.createIncognitoBrowserContext();     const page = await context.newPage();     return page }
Currently I'm using the above function to create multiple contexts under one browser. However, I've noticed that these pages share the same cookies (where in the API docs it was mentioned that the cookies/sessions are different). Is there any way I could fix this, or is there any way to run instances of Puppeteer without using as much RAM/CPU usage?

However, I've noticed that these pages share the same cookies (where in the API docs it was mentioned that the cookies/sessions are different)

@jjason685 Browser contexts do not share any cookies - unless there's a bug. Do you have a repro? We'd love to debug.

I'm having the same issue

I'm having an issue replicating the issue for some reason now. Earlier, it would open tabs inside a single browser instance. Now, it opens different windows instead.

Actually, I've found a way to replicate this issue.
My server file: https://gist.github.com/jjason685/20d83ab49bff9a40d1d9d41427145bbd
My test file: https://gist.github.com/jjason685/79bf37acba80a2c1f0af4f6c7a1cdf37
After running the server file, I run the test file. Upon running, this logs out:
No cookie, sending.
Received cookie from instance
indicating that the second page used the same cookies as the original instance.

I’m also using puppeteer-extra, could it be the issue? Did you try without the plugin?

@val92130 I just tested with default puppeteer and it seems to be working fine. I tested without the plugin and still had the cookie sharing issue. I believe this isn't an issue with default puppeteer itself so  I'll open an issue in https://github.com/berstend/puppeteer-extra#readme


Twinny with VScode on Fedora will not post to embeddings.

Describe the bug
Twinny with VScode on Fedora will not post to embeddings.  FIM and Chat work fine.
To Reproduce
Install Microsoft build of VScode on Fedora.  Set up RAG model in providers.  Attempt to embed workspace.
Expected behavior
Should see activity in inference provider's logs.
Screenshots

Logging
attached (empty)
1-Twinny.log
API Provider
Using the ollama proxy that openwebui provides.  /ollama/api/embed
Chat or Auto Complete?
Embeddings
Model Name
mxbai-embed-large:latest
Desktop (please complete the following information):

OS: Fedora 40 Gnome
Browser n/a
Version 3.17.24

Additional context
I completed the same steps in a windows vm.  The post to embed shows up but errors.
"POST /ollama/api/embed HTTP/1.1" 422 Unprocessable Entity
I reinstalled Twinny and reset my providers.  Neither helped.

This was a user error on my end.  I had https prepending my hostname which I assume made the url look like https://https://example.com
Might be an improvement that could be made, or at least log the issue somewhere.

This was a user error on my end.  I had https prepending my hostname which I assume made the url look like https://https://example.com
Might be an improvement that could be made, or at least log the issue somewhere.


NBC-32 # Evergreen - Overwrite Files Prompt

Changed

NBC-32: bm buildbot evergreen cmd with no --force flag functionality

Will now prompt for confirmation to overwrite existing files instead of throwing an error

--force flag functionality has not changed, it now by passes the confirmation prompt

@mymattcarroll there are merge conflicts now, probably from a recent PR

I clicked "Request Changes" in the GitHub Review feature thing just to see what it does. Feel free to knock me back. :)


Wrong vararg with struct.

If you know it already, please forgive me.
I think this project is great, so I am very excited on it.
I am trying some and I feel the test of verarg is not working well on Linux.
The problem occurs in c-tests/lacc/vararg.c.
It is successful when it's on Windows with compiled by MSVC.
If I am doing something wrong, please let me know.
Environment: WSL on WIndows 10.
$ uname -a
Linux *** 4.4.0-18362-Microsoft #1049-Microsoft Thu Aug 14 12:01:00 PST 2020 x86_64 x86_64 x86_64 GNU/Linux
$ gcc -v
Using built-in specs.
COLLECT_GCC=gcc
COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/7/lto-wrapper
OFFLOAD_TARGET_NAMES=nvptx-none
OFFLOAD_TARGET_DEFAULT=1
Target: x86_64-linux-gnu
Configured with: ../src/configure -v --with-pkgversion='Ubuntu 7.5.0-3ubuntu1~18.04' --with-bugurl=file:///usr/share/doc/gcc-7/README.Bugs --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --prefix=/usr --with-gcc-major-version-only --program-suffix=-7 --program-prefix=x86_64-linux-gnu- --enable-shared --enable-linker-build-id --libexecdir=/usr/lib --without-included-gettext --enable-threads=posix --libdir=/usr/lib --enable-nls --enable-bootstrap --enable-clocale=gnu --enable-libstdcxx-debug --enable-libstdcxx-time=yes --with-default-libstdcxx-abi=new --enable-gnu-unique-object --disable-vtable-verify --enable-libmpx --enable-plugin --enable-default-pie --with-system-zlib --with-target-system-zlib --enable-objc-gc=auto --enable-multiarch --disable-werror --with-arch-32=i686 --with-abi=m64 --with-multilib-list=m32,m64,mx32 --enable-multilib --with-tune=generic --enable-offload-targets=nvptx-none --without-cuda-driver --enable-checking=release --build=x86_64-linux-gnu --host=x86_64-linux-gnu --target=x86_64-linux-gnu
Thread model: posix
gcc version 7.5.0 (Ubuntu 7.5.0-3ubuntu1~18.04)

I did just make to generate c2m.
By the way, make test was failed as below, so it might be my mistake.
I am sorry I have no idea because I believe I did not a special thing.
$ make test
... (omitted)
100000009
1.000000
3.000000
4.000000
5.000000
6.000000
7.000000
8.000000
9.000000
2.000000
10.000000
cc -std=gnu11 -Wno-abi -fsigned-char -fno-tree-sra -fno-ipa-cp-clone -g mir.c mir-gen.c mir-tests/run-test.c -o test && ./test -i mir-tests/test8.mir
Hello 42 != 24, 4.2 != 2.4
cc -std=gnu11 -Wno-abi -fsigned-char -fno-tree-sra -fno-ipa-cp-clone -g mir.c mir-gen.c mir-tests/run-test.c -o test && ./test -i mir-tests/test9.mir
int 42
double 4.2
int 43
double 4.3
cc -std=gnu11 -Wno-abi -fsigned-char -fno-tree-sra -fno-ipa-cp-clone -g mir.c mir-gen.c mir-tests/run-test.c -o test && ./test -i mir-tests/test10.mir
result = 6
cc -std=gnu11 -Wno-abi -fsigned-char -fno-tree-sra -fno-ipa-cp-clone -g mir.c mir-gen.c mir-tests/run-test.c -o test && ./test -i mir-tests/test11.mir
10.56: double = 1.0560000000000000497379915E+01, long double = 1.0560000000000000000381639E+01
10.0E400: double = INF, long double = 1.000000E+402
add: 1.3860000000000000000000000E+11
sub: 7.2600000000000000000000000E+10
mul: 3.4848000000000000000000000E+21
div: 3.2000000000000001776356839E+00
Aborted (core dumped)
Makefile:133: recipe for target 'interp-test11' failed
make: *** [interp-test11] Error 134

Problem
car should be 6.
$ ./c2m c-tests/lacc/vararg.c -ei
sum: 70
car: 62
$ ./c2m c-tests/lacc/vararg.c -ei
sum: 70
car: -145
$ ./c2m c-tests/lacc/vararg.c -eg
sum: 70
car: 85
$ ./c2m c-tests/lacc/vararg.c -eg
sum: 70
car: -11
$ ./c2m c-tests/lacc/vararg.c -el
sum: 70
car: 149
$ ./c2m c-tests/lacc/vararg.c -el
sum: 70
car: 181

Thanks in advance.

If you know it already, please forgive me.
I think this project is great, so I am very excited on it.

Thank you for your kind words and reporting this problem.
Actually I never worked on any Windows port of MIR.  logzero has been working on Windows port.  I never started this work myself (I am less experienced with Windows and did not do any development under Windows for many years).  But I'd like to make a Windows environment of part of the first release which I plan to do at the very end of this year.  So I have to start Windows work sometime soon and your report will be useful.  Thank you again for reporting this.

WSL1 implements Linux API/ABI on top of Windows. WSL2 runs a virtualized Linux kernel instance from my understanding. So it should behave like Linux I guess.
I am not using it, so can't say what is going on there.

Many thanks, @vnmakarov and @logzero.
Yes I also feel this is a Linux issue, but I don't know what differences are between Linux and WSL.
So I will try to see into the source code and will report if I find something wrong.
Anyway, it works fine with MSVC on actual Windows so far.
Thanks a lot.

As I mentioned by #138, I feel the problem is caused when the struct is passed by blk or not.
This is just a comment.
I will investigate this problem again.
Thanks in advance.

That is ok.  I like your courage to solve the problem.  Parameter passing is very complicated area.  The model was developed by several iterations to implement C ABIs on different targets and still provides portability of MIR code generated from C from one target to another (not fully achieved yet for multiple return values).
I can not look at this problem right now as I am quite busy with another project.  But I will be less busy after Nov15 and look at this problem too.
Thank you for your efforts.

Thanks for your kind words.
If I've got some updates, I'll let you know.

This is update of this issue.
Maybe it is caused by the mismatch between va_arg for struct and an argument type.
On the code below shows that a vectorizaton(?) is used when n_qwords is not zero in the function of target_add_call_arg_op at the line 360. And n_qwords is set by the function of classify_arg.

https://github.com/vnmakarov/mir/blob/master/c2mir/x86_64/cx86_64-ABI-code.c

va_arg for struct always assumes that the value can be got by MIR_VA_STACK_ARG for BLK transfer, but MIR_VA_ARG is needed instead of MIR_VA_STACK_ARG just when n_qwords is not zero.
Therefore, according to my understanding, it will be resolved by removing the line from 48 to 88, and putting just return 0 instead there.


No Icon on Thunderbird 102.9

Am I missing something?   There is no icon in the toolbar, and none available from the customize menu.   Using Dark/Black theme (v102.0)

Hey, I'm still on 102.8.0 but according to the change-log for 102.9 nothing in this regard has been changed.
This is where the icon is placed, perhaps you are searching in the wrong place?

Thank You.  I hadn't looked in the "Spaces Toolbar" and normally keep it collapsed.
Thanks for pointing it out, and for taking the time for this extension.  Closing ticket


Optimize PNG images losslessly: 349’600 → 203’624 bytes (−42 %)

I'm -1 here, the current size if very manageable.

@saghul, okay, just proposing.

I'm not really opposed. Is there any downside?

@bnoordhuis, I, personally, don’t see any 😄

It slightly increases the size of the git history (by ~200kb), and doesn't really seem likely to improve or solve anything though


Add GPT-4-Turbo/Vision + Updated GPT-3.5-Turbo models

In addition to the models, I'd love to see the "response_format" and "seed" properties added to the ChatCompletionCreateRequest class in order to use these new features. That may require some conditional code to allow it only for those models that support it if that is the case.

I've added the response_format and seed properties to ChatCompletionCreateRequest but will need a bit of time to look into which models support these, as I can't find a clear answer yet in the docs. May require some testing on my part.

I've added the response_format and seed properties to ChatCompletionCreateRequest but will need a bit of time to look into which models support these, as I can't find a clear answer yet in the docs. May require some testing on my part.

Cool. I'll do some digging to see if I can help.

Looks like response_format is only compatible with Gpt_4_1106_preview and Gpt_3_5_Turbo_1106 from my testing. seed however is compatible with all GPT models.
I will look into implementing conditional logic for incompatible models in both cases.. Would the preferred approach to be throw an exception informing the user that the model is incompatible with this property?
I also added a ResponseFormat class for convenience so that the usage would be like so:
		var completionTask = openAiService.ChatCompletion.CreateCompletion(new ChatCompletionCreateRequest {
			Messages = new List<ChatMessage> {
				ChatMessage.FromSystem(systemMessage),
				ChatMessage.FromUser(prompt)
			},
			Model = model,
			Temperature = temperature,
			ResponseFormat = new ResponseFormat { Type = "json_object" }
		}, null, cancellationToken);

Looks like response_format is only compatible with Gpt_4_1106_preview and Gpt_3_5_Turbo_1106 from my testing. seed however is compatible with all GPT models.
Incompatible models return an Invalid parameter: 'response_format' of type 'json_object' is not supported with this model. message as the response.
Is conditional logic still necessary in this case? If so, would the preferred approach be to throw an exception informing the user that the model is incompatible with this property?
I've also added a ResponseFormat class for convenience so that the usage would be like so:
var completionTask = openAiService.ChatCompletion.CreateCompletion(new ChatCompletionCreateRequest {
	Messages = new List<ChatMessage> {
		ChatMessage.FromSystem(systemMessage),
		ChatMessage.FromUser(prompt)
	},
	Model = Models.Gpt_4_1106_preview,
	Temperature = 0.8f,
	ResponseFormat = new ResponseFormat { Type = "json_object" }
}, null, cancellationToken);

I mean, the FunctionCall property in ChatMessage is always defined too and throws a exception if it's null, which is literally all of the time except when GPT is calling a function, which is the property's sole reason for existing, so I don't see why doing it in an different way, the library mainly uses defined properties that throw an exception if it's not needed unless the sole existence of the property makes difficulties

ResponseFormat { Type = "json_object" }

Why not make this an enum with two values:
Unspecified (default)
JsonObject
My reasoning is there is likely to be additional format types in the future.

I made some changes, if everyone is happy I will merge this tomorrow.

I messed up a bit with resolving merge conflicts (actually, I blame Visual Studio). Please let me know if you see something odd.

Hi, is there a workaround for response_format until this gets into the master branch?


Allow to change branch for downloading huggingface models

close #116

For example, setting like the following figure to use this branch：https://huggingface.co/kakaobrain/kogpt/tree/KoGPT6B-ryan1.5b

Fixed in: 22d6fcc

will take another look - just saw a strange error

It works now, might have been an issue with HF.
Please double check though - thx!

I checked and this worked : https://huggingface.co/openlm-research/open_llama_3b
But this does not: https://huggingface.co/EleutherAI/pythia-1b
File "/home/haqishen/src/h2o-llmstudio-my/llm_studio/src/datasets/text_utils.py", line 36, in get_tokenizer
tokenizer = AutoTokenizer.from_pretrained(
File "/home/haqishen/.local/share/virtualenvs/h2o-llmstudio-my-TDadbQEF/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py", line 688, in from_pretrained
raise ValueError(
ValueError: Tokenizer class GPTNeoXTokenizer does not exist or is not currently imported.

Have you got this before?

Yes, enable Fast Tokenizer

I don't see merge button anywhere, maybe I don't have the privilege?

This branch is out-of-date with the base branch
Merge the latest changes from main into this branch.

Merged main to this branch. But still don't see merge button ↑

should work now


Added support for other custom models

This escape hatch allows to use models currently in beta like gpt-4 or gpt-4-32k-0314, for example.

Does this add support for a model that I have fine tuned, or is there support for that already? Thanks for patience to any ignorance in my question.

@kyleisuncool I believe it would, unless there are other differences with using fine tuned models


bot stopped and not restarting

i placed bot on pythonanywhere.
he worked for 3 days with non-critical different errors, but today he finally stopped.
I have a lot of errors (timeout), and today i got [Errno 104].
2017-07-08  18:03:20 Error: <urlopen error timed out> Requesting returnActiveLoans
2017-07-08  17:57:36 Error: <urlopen error timed out> Requesting returnActiveLoans
2017-07-08  17:52:03 Error: <urlopen error timed out> Requesting returnActiveLoans
2017-07-08  17:46:30 Error: <urlopen error timed out> Requesting returnActiveLoans
2017-07-08  17:40:27 Error: <urlopen error timed out> Requesting returnActiveLoans
2017-07-08  17:34:26 Error: <urlopen error timed out> Requesting returnActiveLoans
!!!!!!!!!!2017-07-08  17:28:56 Error: <urlopen error [Errno 104] Connection reset by peer>
  Requesting returnActiveLoans**
2017-07-08  17:23:28 Error: <urlopen error timed out> Requesting returnActiveLoans
2017-07-08  13:26:50 Error: <urlopen error timed out> Requesting
  returnAvailableAccountBalances
2017-07-08  13:10:00 Error: <urlopen error timed out> Requesting returnActiveLoans
2017-07-08  13:04:22 Error: <urlopen error timed out> Requesting returnTicker
2017-07-08  12:38:02 Error: <urlopen error timed out> Requesting
  returnAvailableAccountBalances
2017-07-08  10:30:04 Error: Connection timed out. Please try again. Requesting
  returnOpenLoanOffers
2017-07-08  07:30:46 Error: <urlopen error timed out> Requesting returnTicker
2017-07-08  06:53:27 Error: Connection timed out. Please try again. Requesting
  returnAvailableAccountBalances
2017-07-08  05:34:34 Error: Connection timed out. Please try again. Requesting
  returnBalances
2017-07-08  04:10:27 Error: Connection timed out. Please try again. Requesting
  returnBalances
2017-07-08  03:43:49 Error: Connection timed out. Please try again. Requesting
  returnActiveLoans
2017-07-08  03:22:24 Error: <urlopen error timed out> Requesting returnTicker
2017-07-08  03:00:09 Error: Connection timed out. Please try again. Requesting
  returnActiveLoans
2017-07-08  02:27:51 Error: <urlopen error timed out> Requesting returnActiveLoans
2017-07-08  01:55:36 Error: <urlopen error timed out> Requesting returnActiveLoans
2017-07-08  01:07:01 Error: Connection timed out. Please try again. Requesting
  returnAvailableAccountBalances
2017-07-08  01:01:45 Error: Connection timed out. Please try again. Requesting
  returnActiveLoans
2017-07-08  00:56:25 Error: Connection timed out. Please try again. Requesting
  returnActiveLoans
2017-07-08  00:40:46 Error: Connection timed out. Please try again. Requesting
  returnOpenLoanOffers
2017-07-07  23:58:38 Error: <urlopen error timed out> Requesting
  returnAvailableAccountBalances
2017-07-07  23:52:55 Error: <urlopen error timed out> Requesting returnBalances
2017-07-07  23:47:23 Error: Connection timed out. Please try again. Requesting
  returnActiveLoans
2017-07-07  23:41:52 Error: <urlopen error timed out> Requesting returnActiveLoans

I killed process, killed console, restarted it and received:
2017-07-08 22:02:59 Error: <urlopen error timed out> Requesting returnActiveLoans
2017-07-08 22:01:26 Error: <urlopen error timed out> Requesting returnActiveLoans
again and again

how to start bot again? what am I doing wrong?
Thanks for doing this! Sorry, my English is not so good.

Looks like the typical Poloniex-Timeout-Issues. The Bot is working, these Errors are normal for Poloniex.

I setup a telegram notification once an hour about my loans to control the work of the bot. today he stopped sending notifications.
Pay attention to the last errors time. Every 5 minutes the bot trying to connect again and again and can't do this

did you increase your timeout value in config?

i did it right now. i set the timeout value to 60 sec, and i got:
Welcome to Poloniex Lending Bot
2017-07-08 22:53:41 Error: <urlopen error timed out> Requesting returnActiveLoans
Timed out, will retry in 60.0sec
Error during summary notification: <urlopen error timed out> Requesting returnActiveLoans
2017-07-08 22:55:42 Error: <urlopen error timed out> Requesting returnActiveLoans
Timed out, will retry in 60.0sec
Error during new loans notification: <urlopen error timed out> Requesting returnActiveLoans

try 180 seconds

180
Welcome to Poloniex Lending Bot
2017-07-08 23:02:59 Error: <urlopen error [Errno 104] Connection reset by peer> Requesting returnActiveLoans
Caught <urlopen error [Errno 104] Connection reset by peer> Requesting returnActiveLoans from Poloniex, ignoring.
Error during summary notification: <urlopen error timed out> Requesting returnActiveLoans

No connection, status empty, telegram are silent

today I used the default settings from default.cfg.example and generated new API key without all of permits.
2017-07-09 05:14:45 Error: <urlopen error timed out> Requesting returnActiveLoans
Timed out, will retry in 60.0sec
2017-07-09 05:16:16 Error: <urlopen error timed out> Requesting returnActiveLoans
Timed out, will retry in 60.0sec
2017-07-09 05:17:49 Error: <urlopen error timed out> Requesting returnActiveLoans
Timed out, will retry in 60.0sec
2017-07-09 05:19:19 Error: <urlopen error timed out> Requesting returnActiveLoans
Timed out, will retry in 60.0sec

Later I'll try to reinstall the bot

Mine has stopped working too. Please let me know if you find a fix.

maybe the ip of pythonanywhere was banned or there is a dns-issue

tamaskan, very likely the problem is not with the user.
today log: <100 errors (timeout) from 8:00 to 14:00 and 0 any error after 14:00.
i just restarted the bot right now and he works without errors + sends telegram notifications. Any timeout errors are now missing.
CrossyFTW, Is your problem solved?

Sadly not. I get the following when I try to run it via Pyrthonanywhere:
Traceback (most recent call last):   File "lendingbot.py", line 55, in <module>     analysis = MarketAnalysis(Config, api)   File "/home/Bollocks/poloniexlendingbot/modules/MarketAnalysis.py", line 24, in __init__     self.currencies_to_analyse = config.get_currencies_list('analyseCurrencies')   File "/home/Bollocks/poloniexlendingbot/modules/Configuration.py", line 131, in get_currencies_list     cur_list += Data.get_lending_currencies()   File "/home/Bollocks/poloniexlendingbot/modules/Data.py", line 129, in get_lending_currencies     lending_balances = api.return_available_account_balances("lending")['lending']   File "/home/Bollocks/poloniexlendingbot/modules/Poloniex.py", line 168, in return_available_account_balances     balances = self.api_query('returnAvailableAccountBalances', {"account": account})   File "/home/Bollocks/poloniexlendingbot/modules/Poloniex.py", line 43, in new_method     return method(self, *arg, **kws)   File "/home/Bollocks/poloniexlendingbot/modules/Poloniex.py", line 139, in api_query     raise ex urllib2.HTTPError: HTTP Error 502: Bad Gateway

Errors seem to have stopped. Huzzah.
I didn't do anything.

Error is now intermittent, but bot seems functional.

The bot fails and then retries later. i.e. if you only see these errors from time to time this doesn't mean the bot won't manage to place orders.
Just making sure, you updated the 'timeout' in config, right? mine btw is ~90sec.

Yeah I suspected as much. Thanks for your work on this, btw!


x/mobile/cmd/gomobile: init fails

go version
go version devel +3f4d5a5 Thu Jul 23 22:50:40 2015 +0000 darwin/amd64

gomobile init
gomobile: go install -p=8 -pkgdir=/Users/jbd/pkg/gomobile/pkg_android_arm std failed: exit status 2
# runtime
/Users/jbd/go/src/runtime/asm_arm.s:1051 syntax error, last name: runtime·usplitR0
/Users/jbd/go/src/runtime/asm_arm.s:1065 syntax error, last name: R0

cc/ @crawshaw @hyangah

Why do you need to sync to +3f4d5a5?
Last week crawshaw and rsc made some changes.
Please work on the tip or go1.5beta3.

Closing the issue, init is working against the tip. make.bash has failed and I couldn't rebuild Go on my previous attempt.


Please invite me to the community

Name
Ian Cinti
Additional Context
I met him through a colleague through git hub, I would like to be part of it to contribute with what is within my reach

Invitation sent to join the GitHub Organization. Welcome to Infraform 🎉Please check your mail to accept the invitation sent by GitHub! 🤖About usInfraform is a remarkable open-source solution tailored for serverless platforms, aimed at empowering creators to craft their infrastructure solutions. 💻 We're thrilled to welcome you into our vibrant community! ✨ We eagerly anticipate your valuable contributions! 🤓 Don't forget to explore our community on Github and connect with us on LinkedIn 💜 Feel free to spread the word about our community to like-minded individuals interested in development, DevOps, technology, and collaborative contributions. 👉💜👈


go to definition implementation

go to definition implementation
Microsoft Reviewers: Open in CodeFlow

Can we add some tests for the go to def function? It's fine if you'd prefer to add them in a follow-up PR.