Missing data files: lengths_and_offsets.npz, consensus.fasta, and splits.json

Hello,
While trying to run train.py, I noticed that the metadata and ds_train mentioned in lines 164-165 require the three files: lengths_and_offsets.npz, consensus.fasta, and splits.json. However, I couldn't find these files in the data folder or on Uniprot. Could you provide these files or guide me on how to obtain or generate them?
Thank you!

Those are available here: https://zenodo.org/record/6564798 if you unzip
the uniref50.tar.gz file.
On Wed, Oct 4, 2023 at 8:03 AM ZongyingLin @.***> wrote:

Hello,
While trying to run train.py, I noticed that the metadata and ds_train
mentioned in lines 164-165 require the three files:
lengths_and_offsets.npz, consensus.fasta, and splits.json. However, I
couldn't find these files in the data folder or on Uniprot. Could you
provide these files or guide me on how to obtain or generate them?
Thank you!
—
Reply to this email directly, view it on GitHub
https://github.com/microsoft/evodiff/issues/10 or unsubscribe
https://github.com/notifications/unsubscribe-auth/ADEMNWESI2ZSRTTDHJCC2B3X5VGAXBFKMF2HI4TJMJ2XIZLTSOBKK5TBNR2WLJDUOJ2WLJDOMFWWLO3UNBZGKYLEL5YGC4TUNFRWS4DBNZ2F6YLDORUXM2LUPGBKK5TBNR2WLJLJONZXKZNENZQW2ZNLORUHEZLBMRPXI6LQMWBKK5TBNR2WLJDUOJ2WLJDOMFWWLLTXMF2GG2C7MFRXI2LWNF2HTLDTOVRGUZLDORPXI6LQMWSUS43TOVS2M5DPOBUWG44SQKSHI6LQMWVHEZLQN5ZWS5DPOJ42K5TBNR2WLKJVGAYDSNRZGY3TTAVEOR4XAZNFNFZXG5LFUV3GC3DVMWVDCOJSGYYDMMJUHEYKO5DSNFTWOZLSUZRXEZLBORSQ
.
You are receiving this email because you are subscribed to this thread.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub
.

Dear @yangkky,
I am willing to fine tune the 38M parameter OADM model by continuing its training on all sequences that we can find on RCSB database.
I could extract them as a FASTA format.
I guess that you had to download the Uniref50 sequences as a FASTA file as well, but then how did you and your team generated the following two files :
"- 'splits.json': a dict with keys 'train', 'valid', and 'test' mapping to lists of indices

'lengths_and_offsets.npz': byte offsets for the 'consensus.fasta' and sequence lengths" ?

Best,
Loris

Not super elegant, but this is the Snakefile I used to get the consensus sequences, then the lengths and offsets, and then hold out sequences that are similar to things in John Ingraham's CATH test set.
import json
import math
from collections import Counter
import subprocess
from tqdm import tqdm

import numpy as np
import pandas as pd

rule all:
    input:
        "lengths_and_offsets.npz",
        "splits.json"

rule flatten_fasta:
    input:
        "uniref50.fasta"
    output:
        "consensus.fasta"
    run:
        result = subprocess.run(['wc', '-l', input[0]], stdout=subprocess.PIPE)
        length = int(result.stdout.decode('utf-8').split(' ')[0]) // 2
        with tqdm(total=length) as pbar:
            with open(input[0], 'r') as f_in, open(output[0], 'w') as f_out:
                seq = ''
                for line in f_in:
                    if line[0] == '>':
                        if len(seq) > 0:
                            f_out.write(seq + '\n')
                            seq = ''
                            pbar.update(1)
                        f_out.write(line)
                    else:
                        seq += line[:-1]

rule get_offsets:
    input:
        "consensus.fasta"
    output:
        "lengths_and_offsets.npz"
    run:
        results = {}
        results['name_offsets'] = []
        results['seq_offsets'] = []
        results['ells'] = []
        result = subprocess.run(['wc', '-l', input[0]], stdout=subprocess.PIPE)
        length = int(result.stdout.decode('utf-8').split(' ')[0]) // 2
        with tqdm(total=length) as pbar:
            with open(input[0], 'r') as f:
                results['name_offsets'].append(f.tell())
                line = f.readline()
                while line:
                    if line[0] != '>':
                        results['name_offsets'].append(f.tell())
                        results['ells'].append(len(line[:-1]))
                    else:
                        results['seq_offsets'].append(f.tell())
                        pbar.update(1)
                    line = f.readline()
        results['ells'].append(len(line[:-1]))
        results['name_offsets'] = np.array(results['name_offsets'])
        results['seq_offsets'] = np.array(results['seq_offsets'])
        results['ells'] = np.array(results['ells'])
        np.savez_compressed(output[0], **results)

rule make_db:
    input:
        "uniref50.fasta"
    output:
        "db/targetDB"
    shell:
        """
        mmseqs createdb {input} {output} --shuffle false
        """

rule make_index:
    input:
        "db/targetDB"
    output:
        directory("db/target_index")
    shell:
        """
        mmseqs createindex {input} {output}
        """

rule get_ingraham_data:
    output:
        "cath/chain_set.jsonl",
        "cath/chain_set_splits.json"
    shell:
        """
        wget -P cath http://people.csail.mit.edu/ingraham/graph-protein-design/data/cath/chain_set.jsonl
        wget -P cath http://people.csail.mit.edu/ingraham/graph-protein-design/data/cath/chain_set_splits.json
        """

rule make_test_fasta:
    input:
        "cath/chain_set.jsonl",
        "cath/chain_set_splits.json"
    output:
        "cath/test.fasta"
    run:
        with open(input[1]) as f:
            splits = json.load(f)
        test_names = splits['test']
        with tqdm(total=len(test_names)) as pbar:
            with open(input[0]) as f, open(output[0], 'w') as f2:
                for line in f:
                    chain = json.loads(line)
                    if chain['name'] in test_names:
                        f2.write('>' + chain['name'] + '\n')
                        f2.write(chain['seq'] + '\n')
                        pbar.update(1)

rule easy_search:
    input:
        "cath/test.fasta",
        "db/targetDB",
        "db/target_index"
    output:
        "report.m8"
    run:
        subprocess.run(['mmseqs', 'easy-search',
                    input[0],
                    input[1],
                    output[0],
                    input[2],
                    '-s', '1',
                    '--format-output', 'query,target,raw,pident,nident,qlen,alnlen',
                    '--cov-mode', '2',
                    '-c', '0.8'])

rule split:
    input:
        "report.m8",
        "uniref50.fasta"
    output:
        "splits.json"
    run:
        np.random.seed(0)
        # parse through results
        df = pd.read_csv(input[0], header=None, delimiter='\t')[[0, 1]]
        df.columns = ['qname', 'tname']
        all_names = []
        splits = {'train': [], 'test': [], 'valid': [], 'rtest': []}
        print('Getting names...')
        with open(input[1]) as f:
            for line in f:
                if line[0] == '>':
                    all_names.append(line[1:-1].split(' ')[0])
        n = len(all_names)
        print('Splitting...')
        tnames = set(df.tname.values)
        for i in tqdm(range(n)):
            if all_names[i] in tnames:
                splits['test'].append(i)
                tnames.remove(all_names[i])
            elif np.random.random() < 5e-3:
                splits['rtest'].append(i)
            elif np.random.random() < 2e-3:
                splits['valid'].append(i)
            else:
                splits['train'].append(i)
        for k in splits:
            print(k + ': %d sequences' %len(splits[k]))
        with open(output[0], 'w') as f:
            json.dump(splits, f)

@Linzy19 Did you manage to run the train.py file ?


Confirmed or unconfirmed, a Zingo dilemma.

I am using Zingo-Mobile which uses zingolib mob-release-1.3.0-169... and when making a transaction it shows as confirmed, but when checking from the browser, the transaction has no confirmations.

This behavior is not the expected behavior and is not favorable for the user, showing that the transaction was confirmed when it really is not, will generate confusion in the user, especially at the moment he tries to make another transaction and the wallet tells him that he has no balance available and that a transaction is still being confirmed.

I will keep an eye out for retesting when they have fixed this problem. 🦓🍃

This APK is using summaries and we need a field like unconfirmed of list in summaries... or some other mechanism to know if the tx is mined or not.

this lines up with bugs im seeing in zingolib. some has to do with unconfirmed
others, the outrageous fees, is due to duplicate metadata

this lines up with bugs im seeing in zingolib. some has to do with unconfirmed
others, the outrageous fees, is due to duplicate metadata

OK, can you add unconfirmed to ValueTransfers?

I am using Zingo-Mobile which uses zingolib mob-release-1.3.0-169... and when making a transaction it shows as confirmed, but when checking from the browser, the transaction has no confirmations.

This behavior is not the expected behavior and is not favorable for the user, showing that the transaction was confirmed when it really is not, will generate confusion in the user, especially at the moment he tries to make another transaction and the wallet tells him that he has no balance available and that a transaction is still being confirmed.

I will keep an eye out for retesting when they have fixed this problem. 🦓🍃

We have a fix for this, for transparent, in dev that we are currently testing.   Is this bug specific to transparent?  If it's more general than transparent then @Oscar-Pepper will need to fix that ASAP.

This APK is using summaries and we need a field like unconfirmed of list in summaries... or some other mechanism to know if the tx is mined or not.

I asked @fluidvanadium to add unconfirmed to ValueTransfer.

I believe this issue is already fixed, I'm going to send to @Edicksonjga a new APK to test this... ASAP

Can we get specific block heights?   I believe that the confirmation process is correct, and we're seeing a difference reorg buffer lengths, and hence reporting.

The problem persists in the latest tests, Zingo Beta:

@zancas @juanky201271


Choosing the color of stream in #subscriptions behaving weirdly

If we select a color from the right panel or even write a hex code for color and then click outside of the color  selecting pop up. That color is set for the stream. I think instead of selecting that color it should default to whatever color the stream originally had (if the user clicks anywhere else on the screen it should not set that color until the user clicks on the "choose" button).

Hey @aakash-cr7!  We currently actually change the color the very moment you click on it -- there's no save/confirm interface.
Can you explain why you think it would be better to have a confirm/save button here?

(If you open the "more colors" part of the popover where the "choose" button is present, it only saves when you click "choose")

The problem I feel is that if a user selects a color say "green" (default color is say "yellow") from the "more colors" part of the pop over and if the user clicks somewhere else on the screen (not on the choose button or the color selecting pop over), green color is automatically set.
Though the ideal behavior should be that the user needs to click the choose button to set green color for the stream, (if the user clicks somewhere else on the screen we should keep the yellow color)I guess. What do you think?

@aakash-cr7 can you post a short video?  I can't reproduce the problem you're describing.


correction for first time rewards

Note that some date comparisons are failing in the test suite

There are still 3 test failures regarding exact amounts, but I'll merge anyway so we can progress.


Database for replays

We will store replay game data as JSON into a fairly simple PL/pgSQL database, which has a native JSON data type and queries can be written to manipulate JSON data. The most important relationship will be player -> player_game -> game  and most of the relevant data will be in game table. The idea is that when a game ends, the game server will establish a connection to the DB and insert the data using Hibernate framework.

[x] Create DB schema, tables and indexes
[x] Write a few functions to return useful data
[x] Clean up database branch

A new repo has been created for the database, it has been tested to work correctly on the database end. https://github.com/Cardshifter/cardshifter-database


feat: publish each measurement to its own topic

This change implements what was discussed in #11 and should close the ticket. Default is the same behavior as exists now, and config.sample.yml also shows this new feature as being disabled.
I've compiled this and tested it, so I know it is functional
Please do take a look over the code, as I'm new to Go programming, so I don't understand every little detail. For example, I'm not sure why some boolean fields in the config appear to be pointers and other appear to be values. However, since I tested the changes, I expect if any changes are desired, they will be style related, not functional.

Thanks!


Add support for AMD GPUs

Other than my comment on documentation, this looks great!

@mcfadden8 - I updated the docs.


abaplint CLI freezes when using custom dependency repository

Hello everyone,
I have a Z package in the system that uses quite a lot of objects, even standard ones, that abaplint shows as non-existent - which is true, as they come from other packages. So I wanted to solve this problem somehow. I've come across the option to export dependencies for a specific package from the system using the abaplint SCI client. I've installed it in the system, exported dependencies from the system to a repository. It exported all the dependencies that my package uses, which is intended. I don't need all of them, but I can easily remove some of the dependencies from the repo manually.
However, now when I try to run abaplint locally after adding the dependency repo to the config, it freezes on the Global OO types step as shown below. If I remove my repo with custom deps, it works fine. I even left it for about 1 hour to check, but it didn't proceed at all.
abaplint 2.105.16
Using config: C:\Users\username\some-directory\my-repo-name\abaplint.json
100% - 0.2s - Reading files - z_rf_production_rack.para.xml
Clone: https://github.com/abaplint/deps
100% - 0.0s - Reading files - cl_workflow_general_task_def.clas.xml
Clone: https://github.com/my-organization/my-repo-name
Username for 'https://github.com': my-github-usernmae
Password for<EMAIL_ADDRESS>100% - 1.1s - Reading files - zcs_fleet.dtel.xml
100% - 3.0s - Lexing and parsing(v757) - PARA Z_RF_PRODUCTION_RACK
        Total lexing:     736ms
        Total statements: 1503ms
        Total structure:  294ms
1% - 0.1s - Global OO types(pass 1), next pass: 22

abaplint.json:
{
  "global": {
    "files": "/src/**/*.*",
    "exclude": [],
    "noIssues": [],
    "skipGeneratedBOPFInterfaces": false,
    "skipGeneratedFunctionGroups": true,
    "skipGeneratedGatewayClasses": true,
    "skipGeneratedPersistentClasses": true,
    "skipGeneratedProxyClasses": false,
    "skipGeneratedProxyInterfaces": false,
    "useApackDependencies": false,
    "skipIncludesWithoutMain": false
  },
  "dependencies": [
    {
      "url": "https://github.com/abaplint/deps",
      "folder": "/deps",
      "files": "/src/**/*.*"
    },
    {
      "url": "https://github.com/my-organization/my-repo-name",
      "folder": "/my-repo-name",
      "files": "/src/**/*.*"
    }
  ],
  //...
}

The problem is the same when I replace the URL with the SSH one. It just asks me for a passphrase instead of the username and token.

thanks
I've not seen that error before, we need a way to reproduce it, need more information to debug it
SCI client: not sure I'd recommend using it that way

thanks, I can confirm the issue, it freezes, hmm
also when running on just https://gitlab.com/sz3lbi/abaplint_cli_freeze_deps, its a smaller MRE

@sz3lbi try again, 2.105.18 published


Added (failing) test - some partial fixes

Also added a test suite for the generation of a token (currently failing).
Ran the official PHP client software to generate the tokens that should
come out and then built a test case from it.

I am trying to write a test suite based on the Official PHP client. The problem with all the encoding/hashing malarkey is that it is just a pain to debug. I wrote the HMAC-SHA API module for mochiweb:
https://github.com/mochi/mochiweb/blob/master/examples/hmac_api/README
The only way to succeed is to step through the construction of the encrypted thingies step by step.
They are getting closer to each other:
PHP
eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.
eyJzY29wZSI6InNj:b3BlOmNsaWVudDpvdXRnb2luZz9hcHBTaWQ9QVBhYmU3NjUwZjY1NGZjMzQ2NTVmYzgxYWU3MWNhYTNm:
ZiZhcHBQYXJhbXM9IiwiaXNzIjoiQUN4eHh4eHh4eHh4eHh4eHh4eHh4eHh4eHh4eHh4eHh4eCIsImV4:cCI6MTMyODIyMjgzNX0.
CYe3fqtKg1SWPom90ZONfZ8ZobUr7doEWxvA4hgxtWc
Erlang
eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.
eyJzY29wZSI6InNjb3BlOmNsaWVudDpvdXRnb2luZz9hcHBTaWQ9QVBhYmU3NjUwZjY1NGZjMzQ2NTVmYzgxYWU3MWNhYTNmZiZhcHBQYXJhbXM9IiwiaXNzIjoiQUN4eHh4eHh4eHh4eHh4eHh4eHh4eHh4eHh4eHh4eHh4eCIsImV4cCI6IjEzMjgyMjQ0MTIifQ==.
SIFnhYOR+5ZkELAmPAnh6zJrI+8mbNW916KSUx1KQxs=
The third part is the signature so that will always be wrong until the second part works. The encoding of the second part is different in Erlang - notice that the ':' in the PHP token aren't in the Erlang one and the Erlang bits seem to be padded with trailing '=' signs.
I h8 encodings and hashing :(
Will work on it some more.

Thanks!
It looks like you are working off an old version of master.  It might be easier for you to keep your fork's master mirroring my repo by pulling in upstream changes, and work off a separate branch to submit pull requests with.
I added comments to the diff.

OK, will try and get me branches straight.
  This guide is pretty helpful: http://help.github.com/fork-a-repo/ - in particular, pulling in upstream changes and branching.

All we care about is that we are testing against a version that we know generates tokes that Twilio recognises server side. The official PHP version, the official Python version, not bothered...
Getting the JWT to pass test against a reference JWT implementation is a great start....

Completely agree.
Couple things I should mention - I tested the JWT implementation against examples given in the documents at http://self-issued.info/docs/draft-jones-json-web-token.html and http://tools.ietf.org/html/draft-jones-json-web-signature-04 .  I also compared the "scope" data that is one of the JWT claims against the output that python produces - there is a "payload" method that can be called to get this information.  Those also looked good.  I'd love to add unit tests if it makes sense - for jsonjwt it probably does.  Comparing tokens directly won't test if the output is functionally correct, but I can't imagine the implementation will change much if at all, so it probably doesn't matter.  I just want to avoid creating a mess just to get the output to be formatted the same when functionally it doesn't make a difference.  If we can do that, awesome :D.

Ryan
The code is now working - well example 1 of hello_monkey now works - but only if you serve it via a webserver. There is a Twilio library bug that stops it working if you just serve the html off the file system:
http://getsatisfaction.com/twilio/topics/php_client_examples_dont_work
Its been doing me nut in, but now we know the code generates working tokens. I started all the working backwards 'cos the hello_monkey example page wouldn't run :(

Hi Gordon,
I ran into the same thing - it was really frustrating.  I ended up just directly loading the file it was trying to load.
<script type="text/javascript" src="http://static.twilio.com/libs/twiliojs/1.0-74cd52c/twilio.min.js "></script>

I submitted it as a bug to Twilio. You kinda expect the examples to work so it takes a while of pulling your hair out before you start looking at it...
Well it could be worse, it could be the Facebook API and libraries :(

Yeah, hopefully they fix it, definitely would have saved me some time.
On Sunday, February 5, 2012 at 2:51 PM, Gordon Guthrie wrote:

I submitted it as a bug to Twilio. You kinda expect the examples to work so it takes a while of pulling your hair out before you start looking at it...
Well it could be worse, it could be the Facebook API and libraries :(

Reply to this email directly or view it on GitHub:
https://github.com/huffman/twilio_erlang/pull/2#issuecomment-3821553

Awesome! Maybe it was all worth it in the end? :)
On Tuesday, February 7, 2012 at 2:13 PM, Gordon Guthrie wrote:

So I wrote up the bug and all - and found another bug that was giving me gype - now they are going to send me a T-shirt. Yip!

Reply to this email directly or view it on GitHub:
https://github.com/huffman/twilio_erlang/pull/2#issuecomment-3857938


Allow more options for meta config format/name

That is, to allow not just .meta as a config file, but also .meta.json, .meta.yaml, meta property in package.json, etc.

On a side note, https://github.com/mateodelnorte/meta-init/blob/master/bin/meta-init and https://github.com/mateodelnorte/meta-project/blob/master/bin/meta-project-add format .meta without the final newline, so maybe https://github.com/mateodelnorte/get-meta-file should also encapsulate the formatting as an exported function (like meta => JSON.stringify(meta, null, 2) + '\n'), to use it in plugins.

Can you open a second issue for the second comment?
On your first comment, what do you see as the added benefit? Seems like more maintenance footprint.

I want to treat .meta as a normal configuration file (that is, manually created, edited, checked in git), similar to prettier config (which uses cosmiconfig), eslint config (which is still similar to cosmiconfig), etc. And so then it depends on a project how those are presented, some prefer extensionless names, some names with extensions (e.g., my VS Code doesn't recognize .meta as a JSON file without extra configuration), some as package.json property.
So basically out of

name in package.json
.name (JSON or YAML)
.name.json
.name.yaml
.name.yml
.name.js
name.config.js

.meta JSON is one particular way of storing the config, which may not match the conventions of a target repo while using cosmiconfig allows users to choose which one to use, based on their conventions.

Added https://github.com/mateodelnorte/get-meta-file/pull/22 for the second comment.

.meta should already be checked into git. If you want to create it manually, that's totally fine. That said, I'm fine following the lead of these projects. Want to make another PR in get-meta-file for that? Would also be nice to have a README update here, as well as in get-meta-file.
I'd like to figure out an easy way to get the README files of each plugin to be a part of the overall meta docs. I took a swack at using gitbook for that, but it didn't work well due to some inane .gitignore stuff gitbook does.

I gave up on gitbook - they dropped support for legacy version and all their docs are 404s now.
I started using "bookdown" which is an R project, but specifically for making a PDF book.
I've heard good things about Docusaurus

I will take a look. Right now it seems like getFileLocation and format might become redundant, leaving only load (default export one) and save (maybe with optional path), because with cosmiconfig it can be YAML, package.json, etc., something plugins should not handle themselves, only requiring load/save to/from an object (from/to default or custom path).

Well, some plugins need to change the config and cosmiconfig doesn't support saving, only loading, so I'm changing this :sweat_smile:
Still, I think there can be a relatively simple patch for get-meta-file that will allow more formats/names for the config. And it still stands that get-meta-file can provide just load and save and that plugins can interface with the config using only those.
The question is then what names to allow.

Can have more JSON names, .meta as JSON, .meta.json (explicit extension for editors), .metarc as JSON and .metarc.json (ala babel, eslint, prettier, jest), meta.json (ala tslint), meta.config.json (?).
YAML should be possible too, not sure if really needed though.
Probably no meta in package.json support, since it will conflict with npm/yarn formatters (which behave differently from JSON.stringify IINM).
Also not sure about JS, e.g., currently it can be JS in .meta, but project add will reformat it as JSON. Maybe JS config support should be deprecated since generally it is not possible to reformat it.

meta already supports a .meta file in both json and .js formats. If you use .js, you can put additional javascript behavior in it. Correct that meta project add will overwrite.  Absolutely not deprecating the js support, as there are companies that use it – especially in odd cases such as having to use a corporate hosted version of Bitbucket where you aren't allowed to use git+ssh and you have to get the local user's username to determine the https route for each repo.

Yeah, .meta in JSON or JS is the current format, so it is about adding lookup for other names and meta property in package.json (still planning to do a PR eventually btw).
JS configs are fine and practiced, if it is read-only configs, but say I have
// some arbitrary JS code

module.exports = {
  // more JS code, using previous JS code, too
}

here it is not read-only, so meta project add will make it
{
  some JSON after _evaluating_ the module
}

which may not be desired (like JS code and formatting are discarded). Also, if that JS is in .meta.js/meta.config.js/etc. (explicit extension), then it is even more complicated (meta project add should rename the file since it is not JS anymore?).

You can always edit your .meta file manually, and if you're using javascript in your .meta file that's what you'll do. The more code we write, the more we have to maintain. I'm not convinced supporting all these file types with add/remove of projects lends a lot of productivity. Being able to make git branches across many projects at once, see the git status of everything – those increase your productivity.
I would argue that if we support reading from all the different file types, we shouldn't support writing to any of them – but we already have the ability to read json and js, so we should just keep it.

Btw, it's more code to maintain, more code to document, and more documentation to maintain.
Simpler is better.

Oh, right, if .meta is in JS, then the solution is not to use altering commands like meta project add, so that must be fine, though a bit inconsistent.
As for file types, my two reasons were

Somehow VS Code doesn't highlight .meta files by default, JSON or JS, hence the "need" for extensions.
All other configs might already be in a certain format (package.json properties or certain names/extensions), so it is not really about productivity, but unification with other tooling.

For syntax highlighting, just click the change language mode button on the bottom right:

or CMD+Shift+P and select change language mode:

There are plenty of other projects that have non-json and non-js extensions, causing them to not have highlighting. This is not a big deal. If you want highlighting for .meta files, a better idea would be to start a meta VS Code extension. We could put some really powerful commands into it, and it would cover your highlighting.
I don't see a benefit to unifying with other tooling. You're creating a new repo for your meta repo. You don't have to have a package.json in your meta repo. You only would if you want to locally install plugins. And I don't see a reason to shove all your child project repo locations into your package.json.
Shoving many things into fewer files === more merge conflicts. Separate, and simple is better.

FYI: You also set file associations in vscode, eg:
{
 "files.associations": {
    ".meta": "json"
  }
}

FYI: You can also set file associations in vscode, eg:
{
 "files.associations": {
    ".meta": "json"
  }
}


Line 28: 21256 Segmentation fault electron

VSCode Version: Latest version
OS Version: Windows 10

Steps to Reproduce:

Open git bash
Type code

Does this issue occur when all extensions are disabled?: Yes/No
$ code --version
/c/Users/212584997/AppData/Local/Programs/Microsoft VS Code/bin/code: line 28: 21256 Segmentation fault      ELECTRON_RUN_AS_NODE=1 "$ELECTRON" "$CLI" "$@"

Here is a checklist to find out more about the freeze/slow/crash

[ ] it reproduces with extensions disabled (code --disable-extensions from the command line - NOT the integrated terminal of Code)

if it does not reproduce with extensions disabled, you can stop testing and report this!

[ ] it was not happening in the previous stable release
[ ] it reproduces in insiders builds (get it from here)
[ ] there is no suspicious output when running from the command line (code --verbose)
[ ] there is no suspicious output in the window itself (Help | Toggle Developer Tools | Console)
[ ] it reproduces on Windows, Linux and Mac
[ ] it reproduces after deleting <appdata>/User/keybindings.json and <appdata>/User/settings.json (backup first! see below for paths)
[ ] it reproduces when opening empty (code -n from the command line)
[ ] it reproduces opening any folder
[ ] it reproduces opening any file
[ ] it reproduces when only having a single window open
[ ] it reproduces by just using Code without external tools running on the same folder
[ ] it reproduces from a workspace that is not under Git version control
[ ] it reproduces independently if a file is opened or not after startup
[ ] it reproduces when running with GPU disabled (code --disable-gpu)
[ ] it reproduces when being offline
[ ] it reproduces when disabling the file watching (set files.watcherExclude to "**/**": true)
[ ] it reproduces after uninstalling and reinstalling
[ ] it reproduces after deleting the application data directory (backup first! see below for paths)
[ ] I have not played around with permissions or ran Code as administrator
[ ] I am seeing a single CPU process spin high (please share the full command line arguments)
[ ] I am seeing Code consuming lots of memory in a short time

Application Data Directory for VS Code:

Windows: C:\Users\<user>\AppData\Roaming\Code
Mac: /Users/<user>/Library/Application Support/Code
Linux: /home/<user>/.config/Code

Application Data Directory for VS Code Insiders:

Windows: C:\Users\<user>\AppData\Roaming\Code - Insiders
Mac: /Users/<user>/Library/Application Support/Code - Insiders
Linux: /home/<user>/.config/Code - Insiders


Path variables are not enclosed in curly braces

From https://openeo.mundialis.de/api/v0.3/:
{
  "endpoints": [
    {
      "methods": [
        "GET"
      ],
      "path": "/processes/<string:process_id>"
    },
...

From the API spec:

Variables in the paths must be placed in curly braces, e.g. {process_id}

While it doesn't really matter for a human, this is important for the openEO Hub: It can only detect functionalities as being supported when the paths are correctly formatted. The Hub tolerates different parameter names, e.g. your prefix with string: is okay. But the enclosing must follow the spec. Otherwise the functionality will be incorrectly reported as non-supported.
BTW your GET //collections/<string:name> endpoint has two leading slashes, probably a typo?

I just tried to use the endpoint and encountered the same problems. Would be great to get this solved.

I'm not sure what it's supposed to look like.
Does that only apply to the results of https://openeo.mundialis.de/api/v0.3/ ?
Or is the call https://openeo.mundialis.de/api/v0.3/collections/nc_spm_08.PERMANENT.vector.elev_lidrural_mrptsft wrong and there are missing the curly braces?

It only applies to the results of the / endpoint.
Taking the example from my initial issue, the correct version would look like this:
{
  "endpoints": [
    {
      "methods": [
        "GET"
      ],
      "path": "/processes/{string:process_id}"
    },
...

I.e. just replace

< with {
> with }

That's it.
The call https://openeo.mundialis.de/api/v0.3/collections/nc_spm_08.PERMANENT.vector.elev_lidrural_mrptsft is correct; the identifier must not be enclosed in the actual URL.
I had a quick look at your commit: I think it fully fixes this issue.

Okay, thank you very much.

Changes are now deployed: https://openeo.mundialis.de/api/v0.3/ . Please test @christophfriedrich

Thanks, I'd love to test it, but I'm being asked for credentials which I don't know. The "openEO back-end instances" Google Doc says one needs "none" username/password. Please update.

Due to the password protection I didn't test it with the Hub, but it looks fine :ok_hand:

Minor thing that I spotted: All path variables are named xy_id, e.g. process_id. BUT what would be collection_id is called name:
{
      "methods": [
        "GET"
      ],
      "path": "/collections/{name}"
    },

That's fine, as backends are allowed to call these variables whatever they want, but for the sake of consistency you may want to unify that nevertheless.

As per https://open-eo.github.io/openeo-api/v/0.3.0/guidelines-clients/#scope-file-api-category it is name. In v0.4 it will be changed to collection_id.

The single source of truth is the API reference, not the client guidelines. Thanks for the changes.
I'm facing the same problem than Christoph, I can't connect as authorization is requested. How can we authorize? Authorization shouldn't be in place for the discovery parts...

Okay but it's the same in the API reference: https://open-eo.github.io/openeo-api/v/0.3.1/apireference/#tag/EO-Data-Discovery/paths/~1collections~1{name}/get

Yes, it is. Just want to make sure you are not relying on the wrong source. ;-)


Conversion to Awkward with local files should be lazy

Make sure this is lazy load - when we have lots of data, it isn't good to have it all in memory at once!

Should we offload this question to dask-awkward?


Adding cheat-sheet of Intellij

By submitting this pull request I confirm I've read and complied with the below requirements.

[X] I have read the Contribution guidelines and I am confident that my PR reflects them.
[X] I have followed the coding guidelines for this project.
[X] My code follows the skeleton code structure.
[X] This pull request has a descriptive title. For example, Added {Algorithm/DS name} [{Language}], not Update README.md or Added new code.

It would be nice to having a cheat-sheet for using Intellij for a beginner.

Isn't really helpful?
If not then remove this PR.
I think it would be great to code in IntelliJ and this IDE is not so hard to comfortable.
So it would be more helpful to having cheat-sheet.

Need to take down this PR.
Haven't merged and any respose.


SIL: Refactor SILFunctionType::substGenericArgs to tolerate substitutions to non-polymorphic function types.

This can come up when functions are lowered in contexts where there are contextual generic parameters, but their genericity has been same-typed away, such as in extensions to specific instantiations of generic types. Fixes rdar://problem/32182121.

@swift-ci Please smoke test

@DougGregor How's this look?

You don't think it would be better to fix the callers? I don't really care strongly either way; if we go with your approach, we could simplify some existing call sites that already handle this directly.

Sure, we should eventually fix up the call sites, but this assertion has covering up other issues while trying to build stuff with an asserts-enabled compiler. It seems reasonably expedient to disable it for now, since any real inconsistency between generic contexts and substitution lists should be covered by assertions elsewhere.

@swift-ci Please smoke test Linux

Yeah, that makes sense. I admit I don't remember seeing that assertion firing anywhere anyway, and if every call site ends up having to deal with the all-params-concrete case, it makes sense to just deal with it directly. Kind of like messaging nil in Objective-C :-)


1x3 vertical

Hi Guys. I have a problem with the1x3 portrait mode setup. Sometimes one stream disappears and comes back again after couple of seconds. Has anyone tips for optimization?
Rasp pi4 2gb
display rotation in /boot/config.txt
600mb gpu
all 3 streams are 1080p
config
windows=(window0 window1 window2)
window_positions=(""0 0 1080 640" "0 640 1080 1280" "0 1280 1080 1920"")
camera_names=(X1 X4 X2)
camera_feeds=("rtsp://<IP_ADDRESS>/x/1" "rtsp://<IP_ADDRESS>/x/4" "rtsp://<IP_ADDRESS>/x/2")

I would use much smaller resolution feeds than 1080p. All three of those feeds are being downscaled to display...bad juju.
The windows positions should have one less pixel in each dimension (e.g., "0 0 1079 639")...this is a very minor issue but can cause problems if your feeds are exactly 1080 wide or 640 high, and the one additional pixel forces upscaling.


Wip/synthetic data sampler

Fix enum utterance generation error when no canonical is provided

Add a unit test example with enum please.


[flake8-async] Update ASYNC109 to match upstream

Summary
Update the name of ASYNC109 to match upstream.
Also update to the functionality to match upstream by supporting additional context managers from asyncio and anyio. This doesn't change any of the detection functionality, but recommends additional context managers from asyncio and anyio depending on context.
Part of https://github.com/astral-sh/ruff/issues/12039.
Test Plan
Added fixture for asyncio recommendation

Ok I restricted the rule to trio only unless preview is enabled

I expanded the PR summary to make things a little clearer.


The experience is bad using dotnet test with net35 because all tests are silently skipped

This is very similar to https://github.com/microsoft/vstest/issues/1850, but for net35 instead of net40.
The SDK is failing to set <IsTestProject>true</IsTestProject>. This is something that should probably be set in a buildMultitargeting .props file so that it gets set for the project no matter what the target framework is.
The fact that VSTest only supports running tests on net40 and up does not mean that it's okay to silently skip all tests. IsTestProject should still be defined, and VSTest should still print out the warning that "For projects targeting .Net Framework 3.5, test will run in CLR 4.0 compatibility mode," and it should still go ahead and run the tests.
This resulted in tests not running in CI for a while, unnoticed.

@jnm2 At the moment we are supporting net452 and newer, and we are looking for was to lift that further because supporting older frameworks is a big maintenance burden. There are no plans to add support for net35. Sorry.


Error in CPU optimization

21/11/2022 07:29:41 PM [ INFO ] Running Nebullvm optimization on CPU
21/11/2022 07:29:43 PM [ WARNING ] Missing Frameworks: tensorflow.
 Please install them to include them in the optimization pipeline.
21/11/2022 07:29:43 PM [ WARNING ] Missing Compilers: openvino.
 Please install them to include them in the optimization pipeline.
21/11/2022 07:29:43 PM [ WARNING ] Not enough data for splitting the DataManager. You should provide at least 100 data samples to allow a good split between train and test sets. Compression, calibration and precision checks will use the same data.
21/11/2022 07:29:44 PM [ INFO ] Converting the torch model to onnx
21/11/2022 07:30:29 PM [ INFO ] Benchmark performance of original model
21/11/2022 07:31:00 PM [ INFO ] Original model latency: 0.27246932983398436 sec/iter
21/11/2022 07:31:00 PM [ INFO ] Running pipeline: pytorch_pipeline
21/11/2022 07:31:00 PM [ INFO ] Running step: no_compression
21/11/2022 07:31:00 PM [ INFO ] Running step: optimizer_step
21/11/2022 07:31:00 PM [ INFO ] Optimizations: ('torchscript', 'deepsparse', 'intel_neural_compressor')
21/11/2022 07:31:00 PM [ INFO ] Optimizing output of compressor 1/1: no_compression
21/11/2022 07:31:00 PM [ INFO ] [ OPTIMIZER 1/3 ]
21/11/2022 07:31:00 PM [ INFO ] Optimizing with PytorchBackendOptimizer and q_type: None.
21/11/2022 07:31:29 PM [ INFO ] Optimized model latency: 0.23684096336364746 sec/iter
21/11/2022 07:31:29 PM [ INFO ] [ OPTIMIZER 2/3 ]
21/11/2022 07:31:29 PM [ INFO ] Optimizing with DeepSparseOptimizer and q_type: None.
DeepSparse Engine, Copyright 2021-present / Neuralmagic, Inc. version: 1.2.0 COMMUNITY EDITION | (45d54d49) (release) (optimized) (system=avx2, binary=avx2)
[7fcfbcaa8000 >ERROR< validate src/lib/engine/compute/primitive/stacked_gemm.cpp:104] Bias width does not match the number of output columns. Bias: 1,9604,1,1,1, B_matrix: 64,4,1,32,49
DeepSparse Engine, Copyright 2021-present / Neuralmagic, Inc. version: 1.2.0 (45d54d49) (release) (optimized) (system=avx2, binary=avx2)
Date: 11-21-2022 @ 19:32:22 +03
OS: Linux isgursoy-VORKE 5.15.0-54-generic #60-Ubuntu SMP Mon Nov 14 13:48:30 UTC 2022
Arch: x86_64
ISA: x86_64-avx2-32-64-16-64-xbyak
CPU: GenuineIntel
Vendor: Intel
Cores/sockets/threads: [4, 1, 8]
Available cores/sockets/threads: [4, 1, 8]
L1 cache size data/instruction: 32k/32k
L2 cache size: 0.25Mb
L3 cache size: 6Mb
Total memory: 17.5404G
Free memory: 1.51531G

Assertion at ./src/include/wand/engine/debug.hpp:233

Backtrace:
 0# wand::detail::abort_prefix(std::ostream&, char const*, char const*, int, bool, bool, unsigned long) in /opt/projects/akil/classification-engine/venv/lib/python3.10/site-packages/deepsparse/avx2/libonnxruntime.so.1.12.0
 1# 0x00007FCE7C9A05D4 in /opt/projects/akil/classification-engine/venv/lib/python3.10/site-packages/deepsparse/avx2/libonnxruntime.so.1.12.0
 2# 0x00007FCE7C9A1092 in /opt/projects/akil/classification-engine/venv/lib/python3.10/site-packages/deepsparse/avx2/libonnxruntime.so.1.12.0
 3# 0x00007FCE7C643993 in /opt/projects/akil/classification-engine/venv/lib/python3.10/site-packages/deepsparse/avx2/libonnxruntime.so.1.12.0
 4# 0x00007FCE7C643CA2 in /opt/projects/akil/classification-engine/venv/lib/python3.10/site-packages/deepsparse/avx2/libonnxruntime.so.1.12.0
 5# 0x00007FCE7C64A64A in /opt/projects/akil/classification-engine/venv/lib/python3.10/site-packages/deepsparse/avx2/libonnxruntime.so.1.12.0
 6# 0x00007FCE7C64A6C0 in /opt/projects/akil/classification-engine/venv/lib/python3.10/site-packages/deepsparse/avx2/libonnxruntime.so.1.12.0
 7# 0x00007FCE7BA7A0F7 in /opt/projects/akil/classification-engine/venv/lib/python3.10/site-packages/deepsparse/avx2/libonnxruntime.so.1.12.0
 8# 0x00007FCE7BA7A5EF in /opt/projects/akil/classification-engine/venv/lib/python3.10/site-packages/deepsparse/avx2/libonnxruntime.so.1.12.0
 9# 0x00007FCE7B9EEB35 in /opt/projects/akil/classification-engine/venv/lib/python3.10/site-packages/deepsparse/avx2/libonnxruntime.so.1.12.0
10# 0x00007FCE7B9DE609 in /opt/projects/akil/classification-engine/venv/lib/python3.10/site-packages/deepsparse/avx2/libonnxruntime.so.1.12.0
11# 0x00007FCE7B9DF8E1 in /opt/projects/akil/classification-engine/venv/lib/python3.10/site-packages/deepsparse/avx2/libonnxruntime.so.1.12.0
12# 0x00007FCE7C144590 in /opt/projects/akil/classification-engine/venv/lib/python3.10/site-packages/deepsparse/avx2/libonnxruntime.so.1.12.0
13# 0x00007FCE7C1499CE in /opt/projects/akil/classification-engine/venv/lib/python3.10/site-packages/deepsparse/avx2/libonnxruntime.so.1.12.0
14# 0x00007FCE7C14C527 in /opt/projects/akil/classification-engine/venv/lib/python3.10/site-packages/deepsparse/avx2/libonnxruntime.so.1.12.0
15# 0x00007FCE7C14C954 in /opt/projects/akil/classification-engine/venv/lib/python3.10/site-packages/deepsparse/avx2/libonnxruntime.so.1.12.0
16# 0x00007FCE7B9BC75E in /opt/projects/akil/classification-engine/venv/lib/python3.10/site-packages/deepsparse/avx2/libonnxruntime.so.1.12.0
17# 0x00007FCE7B9C434D in /opt/projects/akil/classification-engine/venv/lib/python3.10/site-packages/deepsparse/avx2/libonnxruntime.so.1.12.0
18# 0x00007FCE7B95C6ED in /opt/projects/akil/classification-engine/venv/lib/python3.10/site-packages/deepsparse/avx2/libonnxruntime.so.1.12.0
19# 0x00007FCE7B968E15 in /opt/projects/akil/classification-engine/venv/lib/python3.10/site-packages/deepsparse/avx2/libonnxruntime.so.1.12.0
20# deepsparse::ort_engine::init(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, int, std::shared_ptr<wand::parallel::scheduler_factory_t>) in /opt/projects/akil/classification-engine/venv/lib/python3.10/site-packages/deepsparse/avx2/libdeepsparse.so
21# 0x00007FCE7E6B4433 in /opt/projects/akil/classification-engine/venv/lib/python3.10/site-packages/deepsparse/avx2/deepsparse_engine.so
22# 0x00007FCE7E6F06B9 in /opt/projects/akil/classification-engine/venv/lib/python3.10/site-packages/deepsparse/avx2/deepsparse_engine.so
23# 0x00007FCE7E6C1FFE in /opt/projects/akil/classification-engine/venv/lib/python3.10/site-packages/deepsparse/avx2/deepsparse_engine.so

Please email a copy of this stack trace and any additional information to<EMAIL_ADDRESS>
Process finished with exit code 134 (interrupted by signal 6: SIGABRT)

pip git installation. Ubuntu 22.04.

This is strange, I think that also here the cause is python 3.10, but it shouldn't crash like that. I'll investigate as soon as I can, for now you can set ignore_compilers=["deepsparse"] to avoid its usage.


Preview: Border radius not respected while animating

Summary
If an animation is applied to an element with a border radius, the border radius is not respected in the story preview while animating:
https://images.zenhubusercontent.com/235435637/05894e6c-4e79-4668-a462-a854fa8fc94d/balldropanimation.mov
Successful completion of this ticket
Border radius of elements in preview should be maintained while animating

@csossi the PR linked has a helpful video of what to expect here if you need any clarification.

Verified in QA


Add missing section from index

Related to #563

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.


6.0: [TypeLowering] Return pseudogeneric @autoreleasing.

Explanation: Fix a leak in certain Swift extensions of pseudogeneric ObjC types.
Given a pseudogeneric Objective-C type
@interface PG<T>
@end

it's permitted to write an extension in Swift which returns the pseudogeneric parameter
extension PG {
  func get() -> T {...}
}

which can be called from ObjC.  To match Objective-C conventions, these methods should return values autoreleased.
Previously, these methods returned values unowned.  The result was a memory leak and a corresponding SIL verification error.
Here, this is fixed by using the @autoreleased convention in such cases.
Scope: Affects extensions of pseudogeneric ObjC types.
Issue: rdar://64375208
Original PR: https://github.com/apple/swift/pull/74072
Risk: Low.
Testing: Enabled SIL verification in existing test.
Reviewer: Andrew Trick ( @atrick )

@swift-ci please test


favicon.ico spelled incorrectly in index.html

Thanks!

If you have ideas on improving the wording please don't hesitate to send a PR.

https://github.com/facebookincubator/create-react-app/pull/1636


Downloading models fail with timeouts, retry is not enabled.

When downloading a number of models (clearly from Hugging Face), I get the following error every time, seemingly at exactly the same point as well for each respective model that I have tried, even very small ones.
ERROR: Error downloading model: HTTPSConnectionPool(host='cdn-lfs.huggingface.co', port=443): Read timed out.
I think the code needs to be modified to include retries.
It would also be helpful if the documentation described how we can download models manually from within the pod.

Hello, you can add DOWNLOAD_DEFAULT_MODEL: False to skip the auto download, and manually download to /app/models in the pod, you are right about the documentation, will be update when I have time.

Since the pod does not have curl, wget, etc.  how do you suggest we manually download the file?

Maybe an init container which downloads the models is a option.


Question: Image stitching

Hello,
I am getting video from drone and I know georeference where to put this image on map.
I want to make ORTHOPHOTO MOSAIC from real time video.
So I need fast image stitching.
Below is my tested code.
Problem1: If I give multiple images in to stitcher it takes a lot of time to process it.
Problem2: If I always give to stitcher only 2 images (first one is already stitched from all previous images) I see that I am loosing quality on the image (all previous stitched images are blured)
Any suggestions how to do this?
Here is my code:
private void Update(int imgCount)
{
	IEnumerable<Mat> images = SelectStitchingImages(imgCount);
	Stitcher stitcher = Stitcher.Create(true);
	stitcher.RegistrationResol = 0.2;
	stitcher.WaveCorrection = false;
	//stitcher.CompositingResol = -0.5; //default -1
	//stitcher.PanoConfidenceThresh = 0.5; //default 1
	//stitcher.RegistrationResol = 0.2; //default 0.6
	//stitcher.SeamEstimationResol = 0.05; //default 0.1
	//stitcher.WaveCorrection = false; //default true

	Stitcher.Status status = stitcher.EstimateTransform(images);
	if (status != Stitcher.Status.OK)
	{
		Console.WriteLine("Can't stitch images, error code = " + (int)status);
		return;
	}

	var panoMat = new Mat();
	Stitcher.Status status1 = stitcher.ComposePanorama(images, panoMat);
	if (status1 != Stitcher.Status.OK)
	{
		Console.WriteLine("Can't stitch images, error code = " + (int)status1);
		return;
	}

	stitcher.Dispose();
	foreach (Mat mat in images)
		mat.Dispose();

	panoMat.SaveImage("c:\\Downloads\\Slike\\merged_Update_" + imgCount + ".JPG");
	panoMat.Dispose();
}

private Mat[] SelectStitchingImages(int imgCount)
{
	var mats = new List<Mat>();
	string[] files = Directory.GetFiles("c:\\Downloads\\Slike\\", "DSC*.JPG", SearchOption.AllDirectories);
	for (var i = 0; i < files.Length; i++)
	{
		Mat source = new Bitmap(files[i]).ToMat();
		mats.Add(source);
		if (i == imgCount)
		{
			//Console.WriteLine("Update files[" + i + "]: " + files[i]);
			break;
		}
	}
	return mats.ToArray();
}

Something like example: https://github.com/zdzhaoyong/Map2DFusion

No suggestions?


Integration with OSS-Fuzz

Hello pygments people,
I've started to fuzz a bit pygments, and found a couple of DoS. I've automated the process by integrating pygments into OSS-Fuzz: I just need an email address to throw the issues at, since there is no integration with github (for now).
Thanks

I've set up fire-bot, so you can send emails to pygments-reports/fire.fundersclub.com and they should show up here as issues.

Thanks for the effort, btw, we appreciate it a lot!

How can we access the now reported bugs? I get "Permission denied" when I use the link, e.g. bugs.chromium.org/p/oss-fuzz/issues/detail?id=28605

It seems that you need to provide a Google account for the email address.

Does the address have to be associated with the account?

Unfortunately, it seems so, yes

ok, then please change the address to<EMAIL_ADDRESS>the Google account name is georg.brandl - I will create the issues manually.

As I'm taking a couple of days off, feel free to send a pull-request on your own, the relevant file being https://github.com/google/oss-fuzz/blob/master/projects/pygments/project.yaml
Or wait until I come back :)

Ok, thanks. I made a PR (https://github.com/google/oss-fuzz/pull/4856) but I won't sign a CLA just for that.

So I've fixed the first two issues from there already :+1:
What I've noticed, though, is that in the fuzz target you do str(bytes) to get the input: this will always end up with an input in the form b'...' or b"...", so in many languages it only lexes as a single string.
It would probably be better to use .decode('latin1') or .decode('utf8') with a fallback to latin1. What do you think?

I'm unsure it's worth falling back to latin1, woudn't .decode('utf-8', 'ignore') be enough?

Sure, although I don't know if the fuzzer likes that whole stretches of bytes are completely ignored?  Will it "learn" to produce valid UTF-8, or just mostly produce ASCII?

Nice! One more question, is it possible to record which lexer was chosen for the highlight? It will speed up local reproduction with the test case, since I'm not sure that guessing is 100% reproducible.

You can throw the "Minimized Testcase" at something like this:
import sys
import pygments
import pygments.formatters
import pygments.lexers

with open(sys.argv[1]) as f:
  data = f.read().decode('utf-8')

lexer = pygments.lexers.guess_lexer(data)
print('lexer: %s' % lexer)
pygments.highlight(data, lexer, pygments.formatters.HtmlFormatter())

Sure, but as I said, I'm not sure that this will always result in the same guess for some given input.  I should check that myself, however :)

You mean that the lexer guessing isn't deterministic? If it's the case, we should make it dedterministic by hooking whatever randomness there is there, and hook it up the fuzzer's input.

Yep. There's a few of dictionaries involved :) But maybe the fuzzer already disables Python hash randomization?
Anyway, I will check this carefully and get back to you.

In the meantime: how can I reproduce the effect of ConsumeUnicode?  Can you give me an explanation of how to turn the downloaded testcases into what the lexer sees?
Slightly related: instead of guessing, should the input data just be lexed with all available lexers?  This will make fuzzing more useful, since some lexers don't have any useful "guessing" routine, and so will never be utilized.

In the meantime: how can I reproduce the effect of ConsumeUnicode?  Can you give me an explanation of how to turn the downloaded testcases into what the lexer sees?
Slightly related: instead of guessing, should the input data just be lexed with all available lexers?  This will make fuzzing more useful, since some lexers don't have any useful "guessing" routine, and so will never be utilized.

For ConsumeUnicode, I have nothing better to offer than the implementation.
As for running the input on all available lexers, I'm afraid that it would take too long and timeout. What we can do however, is having a second fuzzer (because we still want to fuzz the guesser, right?) picking a lexer "at random" and throw the input at it. What do you think?

For ConsumeUnicode, I have nothing better to offer than the implementation.
As for running the input on all available lexers, I'm afraid that it would take too long and timeout. What we can do however, is having a second fuzzer (because we still want to fuzz the guesser, right?) picking a lexer "at random" and throw the input at it. What do you think?

Coverage is now around 70%!

Thanks a lot for the fuzzing work! Found quite a few serious issues already, and this is one of those projects where fuzzers tend to find particularly gnarly issues :)

Feel free to add your email address here if you want to get access to all the crashes :)

I think this issue can be closed :)


Update project link in the following files

Update this link https://github.com/Rishabh04-02/Elective-manager-new to https://github.com/Rishabh04-02/Elective-manager in the following files

views/public/public_bugs.php on line 2
README.md on line 2 and line 35
views/public/public_about.php on line 37
views/public/public_contact.php on line 37
views/public/public_credits.php on line 37
views/includes/includes_footer.php on line 13

I would like to work on this.

@psr1919plus21 Thanks for showing your interest in the issue, but I already got a PR for it.


 Please select an Android payload option: 3
[?] Please enter an LHOST value:
[?] Please enter an LPORT value:
[+] Android manifest permission options:
Keep original
Merge with payload and shuffle
[?] Please select an Android manifest permission option: 1
[+] Handle the payload via resource script: msfconsole -r backdoor-apk.rc
[] Decompiling original APK file...done.
[] Locating smali file to hook in original project...done.
[+] Package where RAT smali files will be injected: com/domobile/applock
[+] Smali file to hook RAT payload: com/domobile/applock/AppLockApplication.smali
[] Generating RAT APK file...done.
[] Decompiling RAT APK file...done.
[+] Keeping permissions of original project
[] Injecting helpful Java classes in RAT APK file...done.
[] Creating new directory in original package for RAT smali files...done.
[+] Inject package path: com/domobile/applock/zrwjy
[+] Generated new smali class name for MainBroadcastReceiver.smali: Qrndi
[+] Generated new smali class name for MainService.smali: Ghppp
[+] Generated new smali class name for Payload.smali: Ixkrn
[+] Generated new smali class name for StringObfuscator.smali: Etquf
[+] Generated new smali method name for StringObfuscator.obfuscate method: eogow
[+] Generated new smali method name for StringObfuscator.unobfuscate method: fjdhn
[] Copying RAT smali files to new directories in original project...done.
[] Fixing RAT smali files...done.
[] Obfuscating const-string values in RAT smali files...done.
[] Adding hook in original smali file...done.
[] Adding persistence hook in original project...done.
[] Recompiling original project with backdoor...done.
[!] Failed to recompile original project with backdoor

How can i solve it? I had already try all suggestion

#168


if mosaicflow is used in an environment that also uses visibility to …

…show/hide elements (ie a mega dropdown menu) this ensures that not all columns are removed

Thanks!


clear all favourite items

add an ‘all’ to the remove option on favourite items to remove/wipe all your favourites.

if you have too many favourite items (its capped at 100 now?) it is impossible to view the list of them so you can see what to remove due to it throwing an error. Some people completely locked out of changing their favourites right now

/config user favorite_items reset:True is the command to do this now


Enhancement/team role

Issue #, if available:
Description of changes:
Team role is passed by arn as opposed by IRole and doc changes.
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

/do-e2e-tests


Fix bug with generate script on certain themes using TOML multiline strings

I noticed the generate_docs.py script was breaking in the GH Action after the toucan theme was merged. It turned out it's a bug in the Python toml library breaking because of a multiline string (e.g. """something something""") in the toucan theme's theme.toml file. The bug seems to not be present and the script ran fine locally after upgrading the version of the library.

Thanks!


patch_inplace assumes StringType is std::string

Description
patch_inplace has several instances of get<std::string>, which breaks the build if you're using a custom string.
Reproduction steps

Instantiate a nlohmann::basic_json<> with a custom string type
Attempt to call nlohmann:basic_json<>::patch

Expected vs. actual results
Compilation fails.
Minimal code example
struct MyString;  // some compatible impl

using Value = nlohmann::basic_json<
		std::map,
		std::vector,
		MyString,
		bool,
		std::int64_t,
		std::uint64_t,
		double,

		std::allocator,
		nlohmann::adl_serializer,
		std::vector<std::uint8_t>
>;

Value base, patch;
base.patch(patch);

Error messages
No matching constructor for initialization of 'nlohmann::basic_json<std::map, std::vector, MyString >::json_pointer' (aka 'json_pointer< MyString >')

Compiler and operating system
Apple clang version 14.0.3 (clang-14<IP_ADDRESS>.1), macOS Ventura 13.5.1
Library version
3.11.2
Validation

[X] The bug also occurs if the latest version from the develop branch is used.
[X] I can successfully compile and run the unit tests.

Seems easy enough to fix. If you care to submit a PR, please add a regression test to tests/src/unit-alt-string.cpp.

@tomalakgeretkal Please take a look at #4536.


Failure to execute a proposal ought to close it

Closes #232
Not sure if this feature should be configurable per proposal, or the entire contract.

thanks for the PR! I'm also wondering if it makes sense to just have this be the default behavior vs. making it configurable. Also re: configurability, we usually do this on the module-level rather than the proposal-level

So it's better to make enabled by default, but reconfigurable later?

Actually, re (2) here no idea what to do about it. Seems extremely unlikely that this will ever happen and if someone gets to that point they're hosed anyway. Ignore that one. :)

Codecov Report

Merging #385 (6dc92d9) into main (5b96182) will increase coverage by 0.00%.
The diff coverage is 100.00%.

:exclamation: Current head 6dc92d9 differs from pull request most recent head 49cd010. Consider uploading reports for the commit 49cd010 to get more accurate results

@@           Coverage Diff           @@
##             main     #385   +/-   ##
=======================================
  Coverage   95.39%   95.39%
=======================================
  Files          33       33
  Lines        4950     4954    +4
=======================================
+ Hits         4722     4726    +4
  Misses        228      228

Impacted Files
Coverage Δ

packages/voting/src/deposit.rs
100.00% <ø> (ø)

contracts/cw-proposal-multiple/src/contract.rs
95.45% <100.00%> (+0.02%)
:arrow_up:

contracts/cw-proposal-single/src/contract.rs
92.01% <100.00%> (+0.05%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5b96182...49cd010. Read the comment docs.


414 Request-URI Too Large bug solved on 2.20.0 sentry-cli

Environment
sentry-dart-plugin v1.5.0
Doctor summary (to see all details, run flutter doctor -v):
[!] Flutter (Channel stable, 3.10.6, on macOS 13.3 22E252 darwin-arm64, locale en-ES)
    ! Warning: `dart` on your path resolves to /opt/homebrew/Cellar/dart/2.19.1/libexec/bin/dart, which is not inside your current Flutter SDK checkout at /Users/guido/fvm/versions/3.10.6. Consider adding /Users/guido/fvm/versions/3.10.6/bin to the front of your path.
[✓] Android toolchain - develop for Android devices (Android SDK version 31.0.0-rc5)
[✓] Xcode - develop for iOS and macOS (Xcode 14.3.1)
[✓] Chrome - develop for the web
[✓] Android Studio (version 2022.1)
[✓] Connected device (2 available)
    ! Error: Guido’s iPhone is busy: Waiting to connect and unlock the device. Xcode will continue when Guido’s iPhone is finished. (code -10)
[✓] Network resources

Steps to Reproduce

flutter run build
flutter packages pub run sentry_dart_plugin

Expected Result
Upload source maps without error
Actual Result
Sentry it's responding with a 414 error. Due to this bug in sentry-cli https://github.com/getsentry/sentry-cli/issues/1657 that was solved with this PR https://github.com/getsentry/sentry-cli/pull/1680 that landend on sentry-cli 2.20.0 and this plugin uses 2.19.4
Please bump the version to last sentry-cli version.

The plugin is now on version 1.6.0 which uses cli 2.20.6. let us know if you have any further questions!

I am on sentry-cli version 2.21.1 and am getting the same issue, although it worked last week. Is there a workaround?


zoomProgress occasionally returns a nil value

[ERROR] addons/acf-sweps/lua/weapons/weapon_acf_base/cl_init.lua:304: attempt to perform arithmetic on field 'zoomProgress' (a nil value)

func - addons/acf-sweps/lua/weapons/weapon_acf_base/cl_init.lua:304
unknown - gamemodes/base/gamemode/cl_init.lua:552

Reference to zoomProgress removed, and expected to be reinstated properly later


gem bump work with "*_rb" suffix

We've been writing some gems that need to have "*_rb" at the end for the gem name
Ex.
# gem name is task_rb
lib/task/version.rb

It would be great if gem bump worked on this as well

I believe this was implemented in your PR https://github.com/svenfuchs/gem-release/pull/53, and has now been ported to v2 in https://github.com/svenfuchs/gem-release/pull/64/commits/4dff9f18ff1d93b9a46b90a4de4a99a8a9b04ea9
Closing this here for now. Please let me know if I'm mistaken!


Plugin [id: 'com.github.blindpirate.gogradle', version: '0.11.4'] was not found in any of the following sources:

Plugin [id: 'com.github.blindpirate.gogradle', version: '0.11.4'] was not found in any of the following sources:

Is there anyone here?

Just released: https://plugins.gradle.org/plugin/com.github.blindpirate.gogradle
Thanks for bringing it up.


Disable inspections while also having "Lint after Reformat" active

Personally I don't like ktlint violations showing up as inspections (with a highlighted background etc), it can be rather distracting, especially with big multi-line ranges being highlighted. As far as I can tell, "Disable ktlint", which disables this, also disables everything else. However, I still want to have "Lint after Reformat" enabled.
My use case is basically just "format on save" - I have "Reformat Code" assigned to Ctrl+S which I press every so often while writing code to fix the formatting. That allows me to write code without being distracted by getting the formatting details right manually. Well, unless those formatting issues distract me via inspections. :)
So far I've been using the IntelliJ formatter config generated by ktlint, but unfortunately there's some edge cases where ktlint -F and the IntelliJ formatter behave differently, so this plugin seems to be exactly what I'm looking for.

Glad to hear that the plugin is providing value to you! Maybe a good solution could be a dropdown where the user can select a severity level, or "None" in your case? 😃

Sure, that sounds like it should do the trick. 👍

Consider it done! It will be out with the next release sometime around this weekend 🤞

Just tested the new release, seems to work great. :)


Cannot access dhcp socket

When trying to create a macvlan network with dhcp enabled, I run into the error below:
WARN[0000] cannot access dhcp socket "/run/cni/dhcp.sock" (hint: try running with `dhcp daemon --socketpath=/run/cni/dhcp.sock &` in CNI_PATH to launch the dhcp daemon)

After manually running ./dhcp daemon --socketpath=/run/cni/dhcp.sock & from /nerdctl_full/libexec/cni creating the network succeeds without warning.
Need to automate this and put the socket under a less common path (a path specific to ubernerd).

Perhaps -hostprefix is useful as described here.

Feature request for nerdctl: https://github.com/containerd/nerdctl/issues/2465.


AMBARI-24874 : Storm Service Check fail with 'The TGT found is not renewal'

What changes were proposed in this pull request?
In kerberos env service check failed with TGT can not be renewed, in this PR we are doing kinit with service principal keytab and using the client jass instead of service jaas which dont have renewal attribue, more details can be found on JIRA.
How was this patch tested?
the patch was tested on both the secure/unsecure env and able to work as desired.
Please review Ambari Contributing Guide before opening a pull request.

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/Ambari-Github-PullRequest-Builder/4601/
Test PASSed.

@swagle / @u39kun Can some one please review this and merge into branch?
Customer needs a hotfix for this and will create separate BUG for back porting.

Please create a patch for trunk, since there are no planned releases from branch2.7


Godot 4.2-stable-mono Crashed on a fresh installed Linux Mint 21.2 (in a VirtualBox machine)

Godot version
4.2 stable mono
System information
Linux Mint 22.1 (Cinnamon Edition - on a VirtualBox Machine)
Issue description
I have created a new VirtualBox instance and installed a fresh LinuxMint 22.1 (Ubuntu 22.04), after installed the latest Dotnet 7.0 Sdk from the official Ubuntu repositories, after Download and run Godot 4.2-stable-mono, create a new project and CRASH... before showing the editor.
Following is the screenshot of the crash running Godot from console...

I tried many times, always same results.
Steps to reproduce
I suggest to:

create a new VirtualBox instance
install a fresh LinuxMint 22.1 (I used the Cinnamon edition)
installed the latest dotnet 7.0 sdk from the official Ubuntu repositories (sudo apt install dotnet-7.0-sdk)
download and run Godot 4.2-stable-mono
create a new project
try to open the Godot Editor

Minimal reproduction project
See previous steps.

Changing the rendering to "Compatibility" works fine (also "Mobile Render" cause the CRASH)


Finish vocabularies list admin view

pagination, sorting & search does not yet work

will be fixed as well in https://github.com/inveniosoftware/invenio-vocabularies/pull/310


Crash when entering the nether.

installed mods
Fabric Loader 0.11.3
Atmosfera 1.4.0+mc1.16.5
Cloth Config v4 4.11.26
Fabric API 0.36.0+1.16
launcher
MutiMC5 0.6.12-1540(java 16.0.1)
crash log
https://paste.ee/p/nxJ03

It's been fixed and now it doesn't crash anymore.
Thank you for the hasty correction.

I updated the server and client versions to 1.17.1, and the same error occurred again.
The error message appears to be the same.
The log is below.
https://paste.ee/p/2uzPS

Try using 1.4.2 version, the code as is should not under any circumstance even get there where it went if your crash is true

I used atmosfera1.4.2 and the error was resolved.
Thanks a lot!


Qps scenarios

Depends on #4918 . The only relevant file in this commit is qps-sweep.sh , which now spells out useful scenarios for testing

Can one of the admins verify this patch?

Can one of the admins verify this patch?

LGTM, please rebase before merging.

At some point it would be good to also integrate at least some scenarios with tools/jenkins/run_performance.sh so that we are running more tests on our GCE worker as well.

Rather than rebasing, I'll just make a clean PR with just this file in final form. Coming soon.

This is cleaned up in #4949


Would you accept some documentation?

Heya, I've been using dicebot for a while and loving it, but I've been forced to gradually discover the functionality from usage, as there is effectively no documentation for the project. I write specs for a living, and would be happy to write up some docs for the syntaxes - would you accept a PR to your README?

Sure - would likely make sense to have a README.md in https://github.com/arkie/hackyslack2/tree/master/dicebot/roll although having a bit more info on https://dice-b.appspot.com would probably also make sense 😄

Dunno where the appspot text is generated from, but I'd be happy to write for that as well, or you can extract from my PR in a bit.

https://github.com/arkie/hackyslack2/blob/master/dicebot/template/index.html#L23 Generated is a strong word (and sounds good)

Forgot to link the PR (#28) with this issue in the commit message, but obviously we can close this once it merges. ^_^

Awesome, thanks!


Protection against JS injection/XSS/CSRF

Reading through some Thymeleaf documentation stumbled me on something that is just not allowed there.
<button th:text="${'forceReload(' + somevaluefrombackend + ')'}" >Hello</button> is allowed
<button th:onclick="${'forceReload(' + somevaluefrombackend + ')'}" >Hello</button> is not allowed
In short, they basically allow no strings directly in JS executable code.
It is frustrating to work with and a rough solution, imo, but the reasoning behind it is not bad: the easier you make the jump from backend to frontend, the easier it essentially becomes to input user data directly into the frontend - potentially getting that user data loaded into JS and executing scripts.
We'll want to do a review to see if we are exposing ourselves to this and how we can protect ourselves against it.

Ran a basic Arachni scan. Issue found was no clickjacking protection.
https://cheatsheetseries.owasp.org/cheatsheets/Clickjacking_Defense_Cheat_Sheet.html#best-for-now-legacy-browser-frame-breaking-script

Encrypted Communications: Use the wss:// protocol (WebSockets over TLS) instead of ws://.
Origin header: Since the origin header is designed to protect the server against attacker-initiated cross-site connections of victim browsers, make sure to verify the Origin header.
Randomized tokens: Use session-individual random tokens on the handshake request and verify them on the server.
Use of rate limiting based on IP will help solve this issue.

CSRF support was added with custom login page. Just add <input type="hidden" name="_csrf" value="{{_csrf}}"/> and it will be replaced.


Change drop-downs of less than 10 finite options to not be searchable

Issue: If a drop-down has less then 10 finite options, it should not be searchable (not typeable at the top)
Resolution:  Make all drop-down non-searchable unless it has more then 10 finite options or user can add more (like namespace)

Verified fixed.


Drag threshold is too high on wide screens

I'm playing around with the carousel.  When you drag the current slide, it bounces back. You have to drag really far in order for the slide to progress. Is there a way to set a smaller drag distance? Even on dragFree mode, it'll bounce back without a large amount of dragging.
I had a look at the options and as far as I can see there's no way to change this, unless I've missed something?

Hi @jordie23,
Do you want to pursue this?
Kindly
David

Closing this due to lack of response. Feel free to re-open this issue if you want to pursue this @jordie23.
Best
David

Solution will be a min/max drag threshold limit:

Discussed here and here

To be released with v8.0.0-rc01.

@jordie23 and @silllli a fix for this has been released with v8.0.0-rc01.

@jordie23 and @silllli a fix for this has been released with v8.0.0-rc01.

Thank you @davidjerleke!


How to Import Older Mentions?

According to the Help, Bridgy only looks at my 50 most recent Tweets (I'm unclear how the GitHub provider works, the code doesn't seem to indicate a number).
Since a lot of my blog posts are quite old, I have a lot of empty mentions. Is there a way to import all of my older tweets and GitHub comments?
Also, is it possible to also include tweets or GitHub comments from third parties and not just my personal account?
I'm using webmentions.io and have setup anchor links to social media on my home page only (not sure if I should add meta tags to each blog post page also).

hey, yes! you can enter the URL for one of your old tweets, or blog posts if they have syndication links, into the Resend for post box on your Bridgy user page, and it should try to discover and send mentions.
you have to do this for each post, though. #917 tracks a feature to backfill all of your past posts, which is a great idea, but a very big project, so i don't have plans to implement it any time soon.

Also, is it possible to also include tweets or GitHub comments from third parties and not just my personal account?

if the tweets link to your web site, sure! Bridgy already does that automatically.

If I've understood this correctly, syntication links to Twitter would be links on my blog post to Tweets. I'm trying to retrofit webmentions, so I don't have that.
I guess I'm looking for a tool that takes all the URL's for my site (via a sitemap.xml, rss.xml or even list a list of links), then searches on Twitter for those and pulls any Tweets containing the link.

right! understood. for any tweet that links to any page on your site, you can enter the tweet's URL into the Resend for post box on your Bridgy user page, and Bridgy should send mention(s) for it.
#917 tracks the feature request to do that for all tweets, instead of one by one.

I've tried to use the 'Resend for post' feature for this blog post:
https://rehansaeed.com/what-dotnet-new-could-be/
However, I get an error message saying:

Failed to fetch rehansaeed.com/what-dotnet-ne... or find a Twitter syndication link.

When I search Twitter with the above URL, there should be some Tweets that get picked up as web mentions:
https://twitter.com/search?q=https%3A%2F%2Frehansaeed.com%2Fwhat-dotnet-new-could-be%2F&src=typed_query
Have I configured something incorrectly?

heh, yes. as mentioned, if your post doesn't have a syndication URL, put each tweet URL into Resend for post.
i tried it with https://twitter.com/BryanWilhite/status/1212842573535989760 just now, and https://brid.gy/twitter/RehanSaeedUK shows that it sent successfully.

Ah, I feel silly now for not thinking of doing the reverse. I'm now seeing some new 'link' mention types which I've not seen before.
Final question. Why am I not getting any mentions for this tweet of mine which also clearly has the link to my post in it?
https://twitter.com/RehanSaeedUK/status/1212050257867137027

Final question. Why am I not getting any mentions for this tweet of mine which also clearly has the link to my post in it?
https://twitter.com/RehanSaeedUK/status/1212050257867137027

just because it was old. i plugged it into Resend for post, and all of its responses got sent.

I looks to me like brid.gy is ignoring tweets that are themselves replies to other tweets. I tried another old tweet that was not a reply and it went through. Is that a bug?

i'm confused. you're right that the tweet you mentioned, https://twitter.com/RehanSaeedUK/status/1212050257867137027 , is a reply. it was too old for Bridgy to pick up automatically, but when i plugged it into Resend for post, all of its responses got sent, as expected.
were you talking about a different reply tweet? or other webmentions you think should have been sent?

This tweet of mine has a lot of likes and retweets, should these not be turned into web mentions? I'm getting zero being pushed into webmention.io.

https://webmention.io/api/mentions?page=0&per-page=999&target=https://rehansaeed.com/what-dotnet-new-could-be/&sort-by=published&sort-dir=up

ah, true! sorry about that, not sure why yet. will look.

as a data point, other tweet replies do get backfed likes and retweets, so i suspect the issue here is the Resend for post feature, or something related.

I tried another tweet which was a reply yesterday and the likes and retweets on it also didn't get through. Hard to say without more data points as you say but perhaps it's something to do with it being a reply maybe?

bridgy definitely backfeeds likes and retweets to replies in general. here's an example: https://aaronparecki.com/2020/06/05/31/
so as mentioned, in this case, i expect it's a problem with Resend for post. maybe combined with the fact that these are replies; maybe something else entirely.

Obsolete, Bridgy Twitter is dead. https://github.com/snarfed/bridgy/issues/1410#issuecomment-1497763725


fix recognizer packages to 1.1.0 and add bignumber

@johnataylor I think as a workaround you can instead npm install bignumber.js in the root's package.json. That worker for me while testing this locally.

@johnataylor I'm going to close out this PR as a dupe of #457.


Install npm on Windows

Description:
On a windows-latest instance, I'm getting an error saying npm and npm.exe are not found.
Action version:
actions/setup-node@v3
Platform:

[ ] Windows

Runner type:

[ ] Hosted

Tools version:

Using node-version with version 16.
Repro steps:
A description with steps to reproduce the issue. If you have a public example or repo to share, please provide the link.
See .github/workflows/ci.yml, and, for example, these runs:

https://github.com/plfa/plfa.github.io/runs/6966436575?check_suite_focus=true#step:8:10819
https://github.com/plfa/plfa.github.io/runs/6955810660?check_suite_focus=true#step:8:10819

Expected behavior:
I expect npm.exe and npx.exe to be on the path.
Actual behavior:
For example:
npx.exe: createProcess: does not exist (No such file or directory)

Hello @wenkokke. Thank you for your report. I've tried to reproduce the issue with pure yml file but it works as expected. Npm and npx are available.
    steps:
    - name: Checkout repository
      uses: actions/checkout@v3
    - name: Setup Node
      uses: actions/setup-node@v3
      with:
        node-version: 16
    - run: |
        npm --version
        npx --version

Hello @wenkokke. For now I'm going to close the issue because npm and npx are installed and added to PATH. If you have any additional information feel free to ping us.

I'm having this issue. Here's the failed build:
https://github.com/lume/element/actions/runs/8865892376/job/24342663670?pr=13
with this error
node:internal/modules/cjs/loader:1205
  throw err;
  ^

Error: Cannot find module 'C:\npm\prefix\node_modules\npm\bin\npm-cli.js'
    at Module._resolveFilename (node:internal/modules/cjs/loader:1202:15)
    at Module._load (node:internal/modules/cjs/loader:102[7](https://github.com/lume/element/actions/runs/8865892376/job/24342663670?pr=13#step:4:8):27)
    at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:1[8](https://github.com/lume/element/actions/runs/8865892376/job/24342663670?pr=13#step:4:9)7:14)
    at node:internal/main/run_main_module:28:4[9](https://github.com/lume/element/actions/runs/8865892376/job/24342663670?pr=13#step:4:10) {
  code: 'MODULE_NOT_FOUND',
  requireStack: []
}

Here's my yml file:
name: Build and Test

on: [push]

jobs:
    build:
        runs-on: ${{ matrix.operating-system }}

        strategy:
            matrix:
                operating-system: [ubuntu-latest, macos-latest, windows-latest]

        steps:
            - uses: actions/checkout@v1
            - name: Use Node.js latest
              uses: actions/setup-node@v3
              with:
                  node-version: latest
            - name: install
              run: |
                  npm i
                  npx playwright install
            - name: check formatting
              run: |
                  npm run prettier:check
            - name: build
              run: |
                  npm run clean
                  npm run build
            - name: test
              run: |
                  npm test
            - name: check repo is clean
              # skip this check in windows for now, as the build outputs may get slightly modified in Windows, which we want to fix.
              if: runner.os != 'Windows'
              run: |
                  git add . && git diff --quiet && git diff --cached --quiet
              env:
                  CI: true

Updated to actions/setup-node@v4, same issue.

This person has the same exact issue:

https://github.com/nodejs/node/issues/52682


if for free threaded?

Maybe we should have a if.free-threaded? Maybe a envvar too?

This is what I'm thinking: we add a if.abi-flags. This would then allow if.abi-flags = "t" for free-threaded. '^[^t]*$' would be the inverse. The flags would be a sorted list of characters.


Can't find STATUS_CODES

package.json:
{
  "dependencies": {
    ....
    "tls-client": "^0.0.5",
  }
}

npm -v

9.6.5

node -v

v16.17.1

I am on macOS 10.13.6
I am trying to build project npm run build
"STATUS_CODES" is not exported by "__vite-browser-external", imported by "node_modules/tls-client/dist/esm/response.js".
file: /Users/ishandutta2007/Documents/Projects/GrandGPT/node_modules/tls-client/dist/esm/response.js:2:9
1: import { TLSClientException } from "./exceptions";
2: import { STATUS_CODES } from "http";
            ^
3: class Response {
4:     url;
error during build:
RollupError: "STATUS_CODES" is not exported by "__vite-browser-external", imported by "node_modules/tls-client/dist/esm/response.js".

tried this didnt work

well this worked . https://stackoverflow.com/a/70666018/865220
We have to add this to vie.config.ts:
  resolve: {
    alias: {
      http: 'rollup-plugin-node-polyfills/polyfills/http',
    }
  }


Support for HD wallets? BIP32/44

Does insight support bip32/bip44 addresses like blockchain.info recently does?
https://blockchain.info/xpub/xpub6CUGRUonZSQ4TWtTMmzXdrXDtypWKiKrhko4egpiMZbpiaQL2jkwSB1icqYh2cfDfVxdx4df189oLKnC5fSwqPfgyP3hooxujYzAu3fDVmz
Is this planned at some point?

just discovered this https://github.com/bitpay/insight-api/issues/288

duplicate

sorry, my bad. This issue is for insight (frontend)

well would be nice for both frontend and api...

Related: https://github.com/bitpay/insight-api/issues/288


Added ability to change library name in gds file

This gives ability to change library name of the gds file.
Since certain software like Beamer require library name to be set as "Layout_Engine.db".

Thank you Vivswan!


function interrupted or called by multiple threads

Godot version
3.4.4
System information
Windows 10, GLES2 and GLES3
Issue description
I have a simple scene which calls a function whenever a button is pressed.
The same function is called when a key is pressed on the keyboard.
When I quickly press the button followed by pressing a key board key I expect:
-the function is called twice
-the first call of the function completes before the function is called again
However the callback function does not complete its execution before being called a second time.
Which means that the function call is either interrupted or a second thread calls the function.
Is this the expected behavior? How can one ensure thread-safety?
Steps to reproduce
Create a project and a scene (Node2D).
Add another Node2D and some children to it. Create a button and add it to the newly created Node2D.
Connect your scene to the "pressed" event of the button.
Implement the "_unhandled_input" function in the same scene and call the same callback function.
The callback function has some loop iterating over the children of the Node2D.
When the scene is run and the button is pressed followed by quickly pressing a key, the callback function is called twice.
However the callback function no longer completes its execution before being called a second time.
Minimal reproduction project
project.zip

Why close immediately after reporting?

Just had to retest sth.

Ok, I've checked it out and it seems like hiding a button (child.visible = !child.visible) which is currently considered by the Viewport as the one being focused by the mouse (it is hovered) triggers sending an unpress mouse button event which results in triggering button's pressed signal (if button is setup to emit it on mouse release). Something like that.
So no threading is involved here, hiding the button in such specific setup triggers its pressed signal to be emitted (and hence your callback is called in the middle of the previous one).
As a workaround for now changing button's action_mode from ACTION_MODE_BUTTON_RELEASE to ACTION_MODE_BUTTON_PRESS might work.

My bad. Thank you for the clarification.


Broken links in documentation (README.md)

Hello everyone, I am trying to get myself familiar with the project and observed two links in README.md are broken.
They are both links to API and contributing guidelines.

An API to manage the data sets the platform
handles.

Our contributing guidelines

Can I go ahead to fix it to get a better understanding of the practice?

Yes, of course. Go for it


I have a chart with Apexchart and I am getting this error(Cannot read properties of undefined (reading 'filter')) why?

There is a code structure as seen on this site, and while working on this site without any problems, I am getting this error on my own computer, why?
Uncaught TypeError: Cannot read properties of undefined (reading 'filter')
https://codepen.io/Gahzee/pen/OJzezPm
There is such an error in the console.
I explained the problem in more detail here and the codes are also here.(https://stackoverflow.com/questions/72033165/item-selected-from-dropdown-item-not-opening-on-first-click)

As tested on v3.54.1, this is no longer an issue.


[iOS][Theming] In iOS 13, native components reflect background color of OS-level theme

Platform
What platform is your issue or question related to? (Delete other platforms).

iOS

Author or host
Host on Webex Teams
Version of SDK
<EMAIL_ADDRESS>Details
On iOS 13, the backgroundColor of native components reflects the OS-level theme (light or dark) regardless of what's passed into the HostConfig. For most of these components, it can be overridden in a custom renderer, but the default color should align with the rest of the card (i.e. white or similar).  There are some components where this isn't changeable because they cannot be overridden with custom renderers (ACRPickerView and ACRCellForCompactMode are two examples where this can't be changed).  Since not all of these components are able to be overridden with custom renderers, this causes conflicts with our current app's theme.
Example of what it looks like out of the box when the OS theme is set to Dark using this template card:

Root Cause
I believe the reason for this is the use of default for the background colors.  There isn't much documentation around what default maps to, but I believe in iOS 13 it takes on the systemBackground value.  In ACRChoiceSetViewDataSourceCompactStyle, the backgrounds for each cell are also set to groupTableViewBackgroundColor which maps to systemGroupedBackgroundColor  in iOS 13. There may be other colors as well that I missed.

Thanks for filing the detailed issue report @JohnnyKehr ! @jwoo-msft can you comment when you get a chance please? Thanks!

@JohnnyKehr
I wished I could've responded sooner. I was super occupied with Templating work until now.
While I'm working on providing customization option through custom rendering, have you thought about using .xibs? You can customize ACRCellForCompactMode and ACRPickerView through ACRCellForCompactMode.xib and ACRPickerView.xib. More detail here

You can access ACRPickerView, by casting the UIView that's returned from the render method of ACRInputDateRenderer, then the ACRPickerView is accessible through inputView accessor, e.g. ((ACRDateTextField *) view).inputView.
If you want to override choice set input's style, you have to override its delegate, and have the delegate to return a customized cell.
For example,
UIView *view = [choiceSetRenderer render:viewGroup ...
UITableView *tableView = (UITableView *)view;
tableView.dataSource = customDataSource;

As for customData source, you can subclass ACRChoiceSetViewDataSourceCompactStyle class, and override - (UITableViewCell *)tableView:(UITableView *)tableView cellForRowAtIndexPath:(NSIndexPath *)indexPath method, and add your custom styling code to there.

@jwoo-msft what is the work here on the SDK side and is that landing for 1.2.9? I'd rather include it in the next patch for now since I'd like to lock down the release/1.2 branch for this week soon.

closed as this is configurable from client's application.


🐛 [Translate Text in Firestore] It stop working when a new version is available.

[READ] Step 1: Are you in the right place?
Issues filed here should be about bugs for a specific extension in this repository.
If you have a general question, need help debugging, or fall into some
other category use one of these other channels:

For general technical questions, post a question on StackOverflow
with the firebase tag.
For general Firebase discussion, use the firebase-talk
google group.
To file a bug against the Firebase Extensions platform, or for an issue affecting multiple extensions, please reach out to
Firebase support directly.

 Sometimes I see that they do not translate the fields and when I check it, I see that there a i new version available. When I upgrade , then it works again. It happened to me 2 times.
Since as I cannot ask my customers to update their document again, it would be good that it update automatically or at least does not stop working.
Steps to reproduce:
What happened? How can we make the problem occur?
This could be a description, log/console output, etc.
Expected result
Actual result

Hi @amin79 is this issue still occurring? is it the same issue as https://github.com/firebase/extensions/issues/2054 ?

Hi @cabljac I'm not sure about this one. I need to check it again when a new version of the extension available is.


jest.setTimeout.Error when setting header "accept: application/pdf" in POST request

By performing a unit test of a controller as proposed in the Nest.js Documentation I found a really strange behavior when trying to set the header { accept: "application/pdf" } which triggers a jest.setTimeout.Error.
It is curious because I have another test, which is theoretically the same but the difference is { accept: "application/xml" } and this one does not trigger the above mentioned error.
These are the two Test code snippets
describe('GaebManager', () => {
	let app: INestApplication;
	const mockedOfferTextsService = {
		getXmlOffer: (): string => 'Retrieved XML Offers',
		createXmlOffers: (): string => 'Created XML Offers',
		createPdfOffers: (): PDFKit.PDFDocument => {
			return new PDFDocument();
		},
	};
	beforeAll(async () => {
		const moduleRef = await Test.createTestingModule({
			controllers: [OfferTextsController],
			providers: [OfferTextsService],
		})
			.overrideProvider(OfferTextsService)
			.useValue(mockedOfferTextsService)
			.compile();
		app = moduleRef.createNestApplication();
		await app.init();
	});

	describe('createXmlOfferTexts', () => {
		it('should response with 200 and set application/pdf header', async () => {
			await request(app.getHttpServer())
				.post('/xml-offers')
				.set('accept', 'application/pdf')
				.expect(HttpStatus.OK)
				.expect('content-type', /pdf/);
		});
	});

	describe('createXmlOfferTexts', () => {
		it('should response with 200 and set application/xml header', async () => {
			await request(app.getHttpServer())
				.post('/xml-offers')
				.set('accept', 'application/xml')
				.expect(HttpStatus.OK)
				.expect('content-type', /xml/);
		});
	});

	afterAll(async () => await app.close());
});

jest.setTimeout.Error log response
: Timeout - Async callback was not invoked within the 5000ms timeout specified by jest
.setTimeout.Timeout - Async callback was not invoked within the 5000ms timeout specified b
y jest.setTimeout.Error:

      37 |
      38 |      describe('createXmlOfferTexts', () => {
    > 39 |              it('should response with 200 and set application/pdf header', async () => {
         |              ^
      40 |                      await request(app.getHttpServer())
      41 |                              .post('/xml-offers')
      42 |                              .set('accept', 'application/pdf')

      at new Spec (../node_modules/jest-jasmine2/build/jasmine/Spec.js:116:22)
      at Suite.<anonymous> (offerTexts/offerTexts.controller.spec.ts:39:3)
      at Suite.<anonymous> (offerTexts/offerTexts.controller.spec.ts:38:2)
      at Object.<anonymous> (offerTexts/offerTexts.controller.spec.ts:8:1)

Facing the same issue while setting the below as headers
set('testParam', appConfig.test.testKey)

@heypran @rlugo14 Same here. The request works fine when .set() is not used. When I use .set() for a header, it times out with the 5000ms timeout error. Were you able to figure this out?

@Kluskey , in my case I was passing params in the asyc callback, but I was not using .each() so I removed it and it worked fine

@heypran Ah good to know, thank you.
My mistake: Turns out my HTTP route was working correctly, but the db connection was silently failing in the background, so it just resulted in the 5000ms timeout :)


[patch] Add support for stackable API methods + cleaning up in types definitions

What:
Add support for following API methods:
https://docs.voucherify.io/reference/validate-stacked-discounts-1
https://docs.voucherify.io/reference/validate-stackable-discounts-client-side
https://docs.voucherify.io/reference/redeem-stacked-discounts
https://docs.voucherify.io/reference/redeem-stackable-discounts-client-side
https://docs.voucherify.io/reference/rollback-stackable-redemptions

@awilczek could you please review once again?


Set graphql dependency version to exactly 0.13.0

Issue #, if available:
Fixes: #761
Description of changes:
Set graphql dependency version to exactly 0.13.0
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Codecov Report

Merging #800 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #800   +/-   ##
=======================================
  Coverage   87.72%   87.72%
=======================================
  Files          75       75
  Lines        3593     3593
  Branches      683      683
=======================================
  Hits         3152     3152
  Misses        419      419
  Partials       22       22

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5a8069d...46b2d1b. Read the comment docs.

This also fixes the problem with graphql loaded twice 💯


iOS 16 support

Is there a specific reason why targeting iOS 17+ only, like unsupported API for iOS 16 or anything?

Ahh, @Observable.