how to compile/self compile bug

this is maybe not a real bug (maybe i'm dumb) if someone read m issue from yesterday, i fixed something myself and the game crashed with "java.lang.IllegalAccessError: tried to access field net.minecraft.item.ItemHoe.field_185072_b from class epicsquid.roots.item.runed.ItemRunedHoe" so how to compile this mod corectly?

I'm not sure what you mean by this. Can you provide some more context?
Is this error occurring in-game? Is this happening when you try to compile the mod yourself? Is this happening with another mod installed?

If I compile the mod myself even if change nothing on the source (3.1.5) on starting Minecraft (just roots and it's dependencies) I get the error from top
I compile with jdk 8 and:
call gradlew.bat build

If I use the precompiled ones from curse this doesn't happen

Ah, the current release is 3.1.4. There might be an issue with 3.1.5. I'll look into it some time today, as I've been asked to do the 3.1.5 release.

Oh okay I'll try again I already have wondered why the 3.1.5 also is named 3.1.4


Errors in Text Classification with Bert

I am following this link to build simple text classifier model. Using the similar data format as given in example, even the classes are same 'a' and 'b'. Just data volume is increased and getting the error.
Code for data
data, classtags = [], []
for rowid, row in tqdm(df.iterrows()):
    if len(str(row['text']).strip())>=3:
        data.append(str(row['text']).lower().split())
        if "BLOCKED" in str(row['class']):
            classtags.append('a')
        else:
            classtags.append('b')
    if rowid > 10000:
        break

Code for Bert model load
from kashgari.embeddings import BERTEmbedding
bert_embed = BERTEmbedding('/Users/xyz/Downloads/bert_models/multi_cased_L-12_H-768_A-12/',
                           task=kashgari.CLASSIFICATION,
                           sequence_length=100)

Code for training
import kashgari
from kashgari.tasks.classification import BiGRU_Model

train_x = data[:8000] #[['Hello', 'world'], ['Hello', 'Kashgari']]
train_y = classtags[:8000] #['a', 'b']

valid_x, valid_y = data[8000:9000], classtags[8000:9000]
test_x, test_y = data[9000:10000], classtags[9000:10000]

model = BiGRU_Model(bert_embed)
model.fit(train_x, train_y, valid_x, valid_y)

I am getting following error
Epoch 1/5
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-9-03c99f7ddfae> in <module>
      9
     10 model = BiGRU_Model(bert_embed)
---> 11 model.fit(train_x, train_y, valid_x, valid_y)

~/Documents/anaconda3/anaconda3/lib/python3.7/site-packages/kashgari/tasks/base_model.py in fit(self, x_train, y_train, x_validate, y_validate, batch_size, epochs, callbacks, fit_kwargs)
    291                                                validation_steps=validation_steps,
    292                                                callbacks=callbacks,
--> 293                                                **fit_kwargs)
    294
    295     def fit_without_generator(self,

~/Documents/anaconda3/anaconda3/lib/python3.7/site-packages/tensorflow/python/keras/engine/training.py in fit_generator(self, generator, steps_per_epoch, epochs, verbose, callbacks, validation_data, validation_steps, class_weight, max_queue_size, workers, use_multiprocessing, shuffle, initial_epoch)
   1424         use_multiprocessing=use_multiprocessing,
   1425         shuffle=shuffle,
-> 1426         initial_epoch=initial_epoch)
   1427
   1428   def evaluate_generator(self,

~/Documents/anaconda3/anaconda3/lib/python3.7/site-packages/tensorflow/python/keras/engine/training_generator.py in model_iteration(model, data, steps_per_epoch, epochs, verbose, callbacks, validation_data, validation_steps, class_weight, max_queue_size, workers, use_multiprocessing, shuffle, initial_epoch, mode, batch_size, **kwargs)
    189       progbar.on_batch_begin(step, batch_logs)
    190
--> 191       batch_outs = batch_function(*batch_data)
    192       if not isinstance(batch_outs, list):
    193         batch_outs = [batch_outs]

~/Documents/anaconda3/anaconda3/lib/python3.7/site-packages/tensorflow/python/keras/engine/training.py in train_on_batch(self, x, y, sample_weight, class_weight, reset_metrics)
   1173     # Validate and standardize user data.
   1174     x, y, sample_weights = self._standardize_user_data(
-> 1175         x, y, sample_weight=sample_weight, class_weight=class_weight)
   1176
   1177     if self.run_eagerly:

~/Documents/anaconda3/anaconda3/lib/python3.7/site-packages/tensorflow/python/keras/engine/training.py in _standardize_user_data(self, x, y, sample_weight, class_weight, batch_size, check_steps, steps_name, steps, validation_split, shuffle)
   2438           # Additional checks to avoid users mistakenly using improper loss fns.
   2439           training_utils.check_loss_and_target_compatibility(
-> 2440               y, self._feed_loss_fns, feed_output_shapes)
   2441     else:
   2442       y = []

~/Documents/anaconda3/anaconda3/lib/python3.7/site-packages/tensorflow/python/keras/engine/training_utils.py in check_loss_and_target_compatibility(targets, loss_fns, output_shapes)
    491       if y.shape[-1] == 1:
    492         raise ValueError('You are passing a target array of shape ' + str(
--> 493             y.shape) + ' while using as loss `categorical_crossentropy`. '
    494                          '`categorical_crossentropy` expects '
    495                          'targets to be binary matrices (1s and 0s) '

ValueError: You are passing a target array of shape (64, 1) while using as loss `categorical_crossentropy`. `categorical_crossentropy` expects targets to be binary matrices (1s and 0s) of shape (samples, classes). If your targets are integer classes, you can convert them to the expected format via:
`
from keras.utils import to_categorical
y_binary = to_categorical(y_int)
`

Alternatively, you can use the loss function `sparse_categorical_crossentropy` instead, which does expect integer targets.

Please change the last line of the code and paste the result.
model = BiGRU_Model(bert_embed)
model.build_model(train_x, train_y, valid_x, valid_y)
print(model.label2idx)

It prints {'a': 0} ... not sure why b index is not there.
But when I print this ->
print(train_y.count('a'))
print(train_y.count('b'))
print(valid_y.count('a'))
print(valid_y.count('b'))

Output is
569
7431
64
936

It is wired, it should have two labels in this dict. try print(set(train_y))

print(set(train_y)) ==> {'a', 'b'}
Can I set it myself and then run ?

Yep, try:
model = BiGRU_Model(bert_embed)
model.build_model(train_x, train_y, valid_x, valid_y)
model.label2idx = {'a': 0, 'b': 1}
model.fit(train_x, train_y, valid_x, valid_y)

Throws me error
---------------------------------------------------------------------------
AttributeError                            Traceback (most recent call last)
<ipython-input-26-8694b184413c> in <module>
     10 model = BiGRU_Model(bert_embed)
     11 model.build_model(train_x, train_y, valid_x, valid_y)
---> 12 model.label2idx = {'a': 0, 'b': 1}
     13 model.fit(train_x, train_y, valid_x, valid_y)

AttributeError: can't set attribute

Also I tried this
import kashgari
from kashgari.tasks.classification import BiGRU_Model

train_x = [['Hello', 'world'], ['Hello', 'Kashgari']]
train_y = ['a', 'b']

valid_x, valid_y = train_x, train_y
test_x, test_y = train_x, train_y
model = BiGRU_Model(bert_embed)
model.build_model(train_x, train_y, valid_x, valid_y)
print(model.label2idx)
print(set(train_y))

It also print this ->
{'a': 0}
{'a', 'b'}

Wow ... there is some wodo thing happening ...
I restarted my jupyter and now everything is working !!!
Do you have any idea how this is possible ??
Please do answer and close this question.

Actually, I have no idea. Maybe it is just an error of Jupiter....

ok ... I had to do build and then fit for some reason. Only fit doesn't work in my case at-least. But thanks for replaying so fast as always.

I have encountered the same problem. In the end, I found out that there is only one category in train_y. Modify train_y to make it contain multiple categories and it will work.
I hope that I can help people who have the same problem.


Upgrade to Helm 3.x

Cluster setup should install the latest Helm version. Quite a lot changed from 2.x => 3.x so this may not be super straighforward.

This was done a little while ago


Delete character issue

When deleting a character it appears that it does not update the character list on your screen till you reload it, this should automatically happen after deleting the char, I believe this is the cause for a few players accidently deleting chars they didn't mean to, in an attempt to delete the character that appears to stay on the char list.

I "fixed" this iussue whit a simple trick, when delete a char force a disconnect.. and player have to login again and see correct list,,

found this packet information
https://docs.polserver.com/packets/index.php?Packet=0x86
Packet Name: Resend Characters After Delete
Last Modified: 2009-03-02 07:48:32
Modified By: Turley
Packet: 0x86
Sent By: Server
Size: 304 Bytes
Packet Build
BYTE[1] cmd
BYTE[2] blockSize
BYTE[1] # of characters
Following repeated 5 times
BYTE[30] character name
BYTE[30] character password

Party occur there:
https://github.com/Sphereserver/Source-X/blob/a09d665f3d384fe9584d2db3f66396faf5a9094f/src/game/clients/CClientMsg.cpp#L2844-L2848
The packet should update the list but apparently not...

Should be fix in #883

I Confirm it is fixed

so this can be closed? Lets do it.

Yup seems fixed!


failed npm install on Ubuntu

Hi,
I was trying to npm install it from source, but failed to due to missing biased opener dependency. I fixed it by adding it to list of dependencies>
npm install biased-opener --save

I received a different error from npm install on Ubuntu 16.04.
41419 verbose pkgid<EMAIL_ADDRESS>41420 verbose cwd /home/shawn/cardano/git/daedalus
41421 verbose Linux 4.4.0-97-generic
41422 verbose argv "/home/shawn/.nvm/versions/node/v8.9.1/bin/node" "/home/shawn/.nvm/versions/node/v8.9.1/bin/npm" "install"
41423 verbose node v8.9.1
41424 verbose npm  v5.5.1
41425 error code ELIFECYCLE
41426 error errno 1
41427 error<EMAIL_ADDRESS>install: `node-pre-gyp install --fallback-to-build`
41427 error Exit status 1
41428 error Failed at the<EMAIL_ADDRESS>install script.

I've attached the full npm install log file in case it is helpful.
2017-11-10T18_09_18_733Z-debug.log

Oops, just noticed I was signed in with brooks-ideas-admin account. This is my usual account.
I'm happy to test any Daedalus on Linux builds.
Shawn

Please follow https://github.com/input-output-hk/daedalus/issues/492 for official linux support


Download an unsafe file

Hi!
So, in my deployed function the scripts are not loading. I wonder if anyone has ever had anything like it.

I have the static configuration to use the cloudfront.
My next.config
{
 assetPrefix: 'https://myhostcloud.cloudfront.net',
 target: 'serverless'
}

When I download the unsafe scripts all pages works

Https solved that!


Improvements for the documentation

While reading through niivue's documentation, I've come up with a few improvements.
As these are relatively short, I've grouped them into this 1 issue.

saveScene: the filename parameter has a default value of "". This default value is not mentioned in the documentation.
setMeshThicknessOn2D: The sentence "Use Infinity to show entire mesh or 0.0 to hide mesh." should be in the description of the meshThicknessOn2D parameter, not in the description of the function.
the example given for setSliceMosaicString has a typo: it should say niivue.setSliceMosaicString("A 0 20 C 30 S 42") instead of niivue.setMeshThicknessOn2D("A 0 20 C 30 S 42")
setSliceMM: The descriptions of the isSliceMM parameter and the setSliceMM function should be switched for clarity purposes.
loadDrawingFromUrl: the 2nd parameter, isBinarize, is not mentioned in the documentation
drawOtsu: The description for this function would benefit from having a little more detail. For example, "Use the Otsu thresholding algorithm to separate pixels into multiple different classes."
setPenValue: the first parameter, penValue, is listed as having type boolean. However, in the example, penValue is given an integer value (1). Also, the default value of isFilledPen = false is not listed in the documentation.
removeHaze: The default values of the arguments (level = 5, volIndex = 0) are not mentioned in the documentation.
saveImage: The default value of isSaveDrawing = false is not mentioned in the documentation. Also, the live demo page linked does not exist (the linked demo should be https://niivue.github.io/niivue/features/draw.ui.html instead).
removeVolumeByIndex: This function is defined 3 times in the niivue.js. This makes it show up 3 times in the documentation. It should only show once.
setDrawOpacity: there is a typo in the description. tansparent should be transparent
loadConnectome: the documentation states that the the json parameter is of type string. From reading the code, it looks like it should be an Object.
setMeshShader: default value of meshShaderNameOrNumber=2 is not stated in the documentation
setCustomMeshShader: default values of fragmentShaderText = "", name = "Custom" are not stated in the documentation. Also, the description for this function is wrong.
setModulationImage: Parameters 1 and 2 are incorrectly named in the documentation. They should be listed as idTarget and idModulation. Also, the default value of modulateAlpha = false is not stated in the documentation.
binarize: the example needs to be updated

@AnthonyAndroulakis , could you work on implementing these suggestions to the documentation as a new PR?

@hanayik my attempt to resolve these submitted as a PR and committed. It would be great if we could publish the updated documentation and have @AnthonyAndroulakis review everything and close this issue if he is happy with my solutions.

@neurolabusc , It should have published via the last PR that was merged in a few min ago. I needed to fix some of the JSdoc comments to show default argument values correctly.

@AnthonyAndroulakis , could you work on implementing these suggestions to the documentation as a new PR?

Sorry I did not see this comment in time. I'll take a look at the PR @neurolabusc committed.

@hanayik Apologies, did not see this thread earlier. @neurolabusc This all looks good. Thank you for implementing these suggestions.


termux error line 2: python: command not found

Checkboxes

[ ] Updated fsociety
[ ] Issue does not already exist
[x ] fsociety issue, not a tool issue

Expected Result
fsociety launch

Actual Result
$ fsociety
/data/data/com.termux/files/usr/bin/fsociety: line 2: python: command not found

Sounds good. I'll take a look in a bit.

This seems to be on your device... Are you sure python is installed?

please open if it is.


Running eas init from CI/CD getting "Error: Input is required, but stdin is not readable"

I'm running eas init from CI/CD getting "Error: Input is required, but stdin is not readable".
I'm guessing eas init is a relatively new requirement.
Is there no way to run eas init non-interactively?

I'm having the same error on GitLab CICD when running eas secret:create

I got around having to run eas init at all by add this to app.json:
"extra": {
  "eas": {
    "projectId": "project-id-listed-on-expo"
  }
}

I'm not really sure why its complaining about the stdin issue.  I should be able to run all eas commands from the CLI non-interactively.  :/

I started having this issue since<EMAIL_ADDRESS>My pipeline worked just fine with<EMAIL_ADDRESS>

Hi guys,
You should never need to run eas init in CI. This command should be executed only once locally. Remember to commit the changes it made to the repo.

@dsokal I want to clarify what I did. I didn't run eas init but eas secret:create --name $name --value $value --force.
I had to change it to eas secret:create --name $name --value $value --force --non-interactive --type string
I expect eas<EMAIL_ADDRESS>to work the same as<EMAIL_ADDRESS>Or if the required options are added to this command, I wish an error message to be clear instead of Error: Input is required, but stdin is not readable.
I know it is easy to fix even with the current error message, but how do I know what to do right away with the current message?

It's always recommended to use fixed tools versions in CI environments. Thanks to that you're never surprised by breaking changes in 3rd party tools. With fixed versions, nothing is upgraded without your knowledge.
In this particular case, we didn't follow the semver conventions with the 2.2.0 release. Sorry about this inconvenience. We'll try to avoid similar mistakes in the future. Sorry again 🙇

I have the exact same issue and it started with<EMAIL_ADDRESS>also. For me it is when running eas build using the following command:
npx eas-cli build --profile=test --non-interactive --platform=all
What's the fix??

i am getting this error as well

I'm getting this error as well, running eas build --platform android --profile preview

Coming over from https://github.com/expo/eas-cli/issues/1470 - I get the same error running a build via GitHub Actions.

I'm also coming from #1470 and have the issue when running a build with Github Actions.

I manually set a git safe dir in my Github Actions workflow and it solved the issue with eas build for me.
steps:
  - name: 📦 Checkout project repo
    uses: actions/checkout@v4
    with:
      fetch-depth: 0

  # Checkout action doesn't set safe dir for some reason
  - name: 📝 Configure Git safe directory
    run: git config --global --add safe.directory $GITHUB_WORKSPACE

  # ... your `expo prebuild` and `eas build` steps ...

Hi, none of these solutions worked for me unfortunately.
I even tried to define the required variables as ENV variables (since this works locally for me) with the following YAML Github Action:
- name: Trigger EAS Build
        run: eas build --profile ${{ github.event.inputs.branch || github.ref_name }} --platform android --message "Build ${{ github.event.inputs.branch || github.sha }}"
        shell: bash
        env:
          ANDROID_KEYSTORE_FILE: android/app/my-release-key.keystore
          ANDROID_KEYSTORE_PASSWORD: ${{ secrets.ANDROID_KEYSTORE_PASSWORD }}
          ANDROID_KEYSTORE_ALIAS: ${{ secrets.ANDROID_KEYSTORE_ALIAS }}
          ANDROID_KEYSTORE_KEY_PASSWORD: ${{ secrets.ANDROID_KEYSTORE_KEY_PASSWORD }}

However I'm still getting an error:
EAS Build will use the value found in the native code.
✔ Using remote Android credentials (Expo server)
Input is required, but stdin is not readable. Failed to display prompt: Generate a new Android Keystore?
    Error: build command failed.
Error: Process completed with exit code 1.```

I manually set a git safe dir in my Github Actions workflow and it solved the issue with eas build for me.
steps:
  - name: 📦 Checkout project repo
    uses: actions/checkout@v4
    with:
      fetch-depth: 0

  # Checkout action doesn't set safe dir for some reason
  - name: 📝 Configure Git safe directory
    run: git config --global --add safe.directory $GITHUB_WORKSPACE

  # ... your `expo prebuild` and `eas build` steps ...

@TonyBobins - will you please provide additional details regarding what you added to your $GITHUB_WORKSPACE. Thanks!

Hello some help with this workflow
`
name: Build and Distribute Android to Firebase
on:
workflow_call:
inputs:
build_variant:
description: 'The build variant to assemble and distribute'
required: true
type: string
default: 'Release'
jobs:
build-and-distribute:
runs-on: ubuntu-latest
steps:
  - name: Checkout repository
    uses: actions/checkout@v4

  - name: Set up Node.js 20
    uses: actions/setup-node@v4
    with:
      node-version: '20.x'
      cache: 'yarn'

  - name: Setup Expo
    uses: expo/expo-github-action@v8
    with:
      expo-version: latest
      eas-version: lastest
      token:

  - name: Install dependencies
    run: yarn ci

  - name: Build Android app
    # run: expo publish --non-interactive --release-channel pr-${{github.event.number}}
    # run: eas build --platform android --non-interactive
    run: eas build --platform android --local`

    The last job keeps failing to build with EAS

It is frustrating that there is no expo documentation to auto answer for questions like which Google Service Account Key do you want to use?
Bc due to this inquriy during remote credentials and eas build, unless I run it with the non-interactive mode it will complain I cannot answer the question.
However I get an error saying that I cannot use non-interactive mode while trying to use remote creds for expo to read the Google Svc Account Key. I wish there was a flag for naming that key it would solve the entire issue.

It is frustrating that there is no expo documentation to explain how to automate the answer for questions like which Google Service Account Key do you want to use? Bc due to this inquriy during remote credentials and eas build, unless I run it with the non-interactive mode it will complain I cannot answer the question. However I get an error saying that I cannot use non-interactive mode while trying to use remote creds for expo to read the Google Svc Account Key. I wish there was a flag for naming that key it would solve the entire issue.

I was able to figure it out yesterday. Expo requires you to run build locally which will create this key and catch it for future run on GitHub VM

It is frustrating that there is no expo documentation to explain how to automate the answer for questions like which Google Service Account Key do you want to use? Bc due to this inquriy during remote credentials and eas build, unless I run it with the non-interactive mode it will complain I cannot answer the question. However I get an error saying that I cannot use non-interactive mode while trying to use remote creds for expo to read the Google Svc Account Key. I wish there was a flag for naming that key it would solve the entire issue.

I was able to figure it out yesterday. Expo requires you to run build locally which will create this key and catch it for future run on GitHub VM

Problem is for local build it need linux machine


Generated too large parser.c ~ 83M

With all PRs merged, tree-sitter will generate a very large parser.c file (about 83M).  And it takes about 1 min to load the parser by tree-sitter python binding.
Unfortunately I don't have an idea at the moment on how to reduce its size 😭
@m-novikov Have you ever encountered a similar problem, or have any suggestions for optimization?

I think we can generate the parser.c when building this project

Yeah, there doesn't seem to be redundant code here, nor particularly complex rules, but still a very large parser is generated.
With compared to the tree-sitter-python parser, the size of the grammar.js file 2x larger (1833 lines vs 967 lines).
But the generated parser.c is almost 64x larger (83M vs 1.3M) than the one in tree-sitter-python.
I don't have an idea on this yet 😭

There is related issue in https://github.com/tree-sitter/tree-sitter/issues/1041
While removing parser from the repo is a good stop-gap solution, we would need to investigate the cause, generation times also getting progressively longer.

There is related issue in tree-sitter/tree-sitter#1041 While removing parser from the repo is a good stop-gap solution, we would need to investigate the cause, generation times also getting progressively longer.

@m-novikov Yes, I've seen this similar issue too.  But there is not much useful information here.
By remove the generated code from the repo, we just ignore this issue.
On the other hand, when a user using tree-sitter-sql, for example, using it in Python code via the tree-sitter python package. The user use it by the following steps:

Build language (for tree-sitter-sql) by the tree-sitter package, it will look for the parser.c and scanner.cc files in the src dir and compiles them;
Create a new tree-sitter.Parser instance and set language to the language built in step 1;
The src/node-types.json and src/grammar.json can also be loaded and used by users;

If we remove the src dir from the repo, the users still need to generate it by themselves. It will take 40s+ to generate this files (for PR#58). Also the size of parser.c is large (83M+), this leads to a long time (about 1min) to build language (the step 1).
So, to solve the problem, we need to do something to reduce the size of generated code. By now, I did some investigations on this.

Collect generated files size for each commit to see which commit increased the size too much. The following are the top commits:

hexsha
commit_message
grammar.js
grammar.json
node-types.json
parser.c

8d09bf6af0ba81c799e05d839263ec3b3c49d1e2
Support CTE, CASE, etc.          New supportings:       - CTEs syntax;       - DELETE statement;       - ALTER TABLE RENAME COLUMN;       - Conditional expressions;       - LIMIT clause;       - AT TIME ZONE expression;          Improvements:       - The ORDER BY clause;       - The JOIN clause;       - The select_subexpression;       - The UPDATE statement;       - Array type;       - $.type: multi-words types   (VARYING, PRECISION, WITH/WITHOUT TIME ZONE);       - The $.field_access expression to   $.json_access expression;
0.02M, +0.0M, +2.46%
0.14M, +0.0M, +2.21%
0.11M, +0.01M, +10.77%
3.95M, +1.59M, +67.12%

f1a4b8c896cfd4041ac2283c9f4b6d814a7c0c5d
Improve create function statement & support create trigger   statement
0.03M, +0.0M, +19.18%
0.18M, +0.04M, +30.48%
0.12M, +0.01M, +13.91%
11.89M, +7.94M, +200.86%

bf3ea7293f436b1d226e6d5179a064f4344aa65f
Improve function call to support aggregate expressions
0.03M, -0.0M, -0.48%
0.28M, +0.0M, +1.69%
0.15M, +0.0M, +0.82%
21.78M, +2.82M, +14.88%

1cdb6abb48a4013dd7256b064e6e83574e3d0cee
Support window definitions & window function calls
0.04M, +0.0M, +4.05%
0.29M, +0.01M, +4.06%
0.16M, +0.01M, +4.31%
25.25M, +3.47M, +15.91%

d68da8ace84b5c9b66dcd9243afbb5dade795909
Improved the FROM clause to make it more general
0.04M, +0.0M, +3.28%
0.3M, +0.01M, +3.5%
0.16M, +0.01M, +5.24%
34.1M, +8.85M, +35.07%

84cedb178c6a94952f1feb3083bd4e7ef54c69d8
Improve the ALTER TABLE statement
0.05M, +0.01M, +21.2%
0.38M, +0.06M, +19.64%
0.22M, +0.04M, +19.67%
38.05M, +2.45M, +6.88%

33a6c85ad3a26ac3d6ab0a7c54a5b2fb2e9e495c
Improve the INSERT statement
0.05M, +0.0M, +1.97%
0.38M, +0.01M, +1.84%
0.22M, +0.01M, +2.39%
54.43M, +16.26M, +42.61%

42f750d88408fee9b990c917b907a88e96ac0111
Support more comparison predicates          1. BETWEEN...AND expression;     2. ISNULL and NOTNULL;     3. IS UNKNOWN and IS NOT UNKNOWN;
0.05M, +0.0M, +1.14%
0.39M, +0.0M, +0.78%
0.24M, +0.02M, +10.1%
61.25M, +6.33M, +11.53%

2660004c3495889ed947e1fb7979c17522f7a23f
Support composite values & resolve syntax conflicts
0.05M, +0.0M, +1.15%
0.39M, +0.0M, +1.03%
0.25M, +0.01M, +3.89%
62.51M, +1.26M, +2.05%

87107e91e5b09b8d235f61e5135016d08fccd129
Support combining queries, JSON comparison operators and type cast as   column default
0.05M, +0.0M, +2.02%
0.4M, +0.01M, +1.29%
0.25M, +0.0M, +0.47%
79.69M, +17.18M, +27.48%

5574bf3ca47507e87e3524f38783a21f0d33841d
Support VACUUM statement & improve alias
0.05M, +0.0M, +2.28%
0.41M, +0.01M, +3.04%
0.25M, +0.0M, +0.69%
82.5M, +2.81M, +3.53%

Then I checked changes of grammar.js for these top commits, and tried simply comment out  some rules or clauses to see the effect. Following are the modifications and result sizes I've tried:

>>>>>>>>>> Sizes in the latest version

-rw-r--r--  1 tim  staff   421K Jul  8 21:49 grammar.json
-rw-r--r--  1 tim  staff    13K Jun 13 10:36 grammar.json.rej
-rw-r--r--  1 tim  staff   264K Jul  8 21:50 node-types.json
-rw-r--r--  1 tim  staff    17K Jun 13 10:36 node-types.json.rej
-rw-r--r--  1 tim  staff    83M Jul  8 21:50 parser.c
-rw-r--r--  1 tim  staff   5.5M Jun 13 10:36 parser.c.rej
-rw-r--r--  1 tim  staff   4.2K Jul  6 01:59 scanner.cc
drwxr-xr-x  3 tim  staff    96B May 31 18:20 tree_sitter

>>>>>>>>>> With the select statement modified

1. Removed select_statement
-rw-r--r--  1 tim  staff   413K Jul  8 21:39 grammar.json
-rw-r--r--  1 tim  staff    13K Jun 13 10:36 grammar.json.rej
-rw-r--r--  1 tim  staff   257K Jul  8 21:39 node-types.json
-rw-r--r--  1 tim  staff    17K Jun 13 10:36 node-types.json.rej
-rw-r--r--  1 tim  staff    29M Jul  8 21:39 parser.c
-rw-r--r--  1 tim  staff   5.5M Jun 13 10:36 parser.c.rej
-rw-r--r--  1 tim  staff   4.2K Jul  6 01:59 scanner.cc
drwxr-xr-x  3 tim  staff    96B May 31 18:20 tree_sitter

2. Removed window_clause in select_statement
-rw-r--r--  1 tim  staff   420K Jul  8 21:42 grammar.json
-rw-r--r--  1 tim  staff    13K Jun 13 10:36 grammar.json.rej
-rw-r--r--  1 tim  staff   263K Jul  8 21:42 node-types.json
-rw-r--r--  1 tim  staff    17K Jun 13 10:36 node-types.json.rej
-rw-r--r--  1 tim  staff    82M Jul  8 21:42 parser.c
-rw-r--r--  1 tim  staff   5.5M Jun 13 10:36 parser.c.rej
-rw-r--r--  1 tim  staff   4.2K Jul  6 01:59 scanner.cc
drwxr-xr-x  3 tim  staff    96B May 31 18:20 tree_sitter

3. Removed from_clause in select_statement
-rw-r--r--  1 tim  staff   421K Jul  8 21:44 grammar.json
-rw-r--r--  1 tim  staff    13K Jun 13 10:36 grammar.json.rej
-rw-r--r--  1 tim  staff   264K Jul  8 21:45 node-types.json
-rw-r--r--  1 tim  staff    17K Jun 13 10:36 node-types.json.rej
-rw-r--r--  1 tim  staff    62M Jul  8 21:45 parser.c
-rw-r--r--  1 tim  staff   5.5M Jun 13 10:36 parser.c.rej
-rw-r--r--  1 tim  staff   4.2K Jul  6 01:59 scanner.cc
drwxr-xr-x  3 tim  staff    96B May 31 18:20 tree_sitter

4. Removed group_by_clause in select_statement
-rw-r--r--  1 tim  staff   421K Jul  8 21:51 grammar.json
-rw-r--r--  1 tim  staff    13K Jun 13 10:36 grammar.json.rej
-rw-r--r--  1 tim  staff   263K Jul  8 21:51 node-types.json
-rw-r--r--  1 tim  staff    17K Jun 13 10:36 node-types.json.rej
-rw-r--r--  1 tim  staff    75M Jul  8 21:51 parser.c
-rw-r--r--  1 tim  staff   5.5M Jun 13 10:36 parser.c.rej
-rw-r--r--  1 tim  staff   4.2K Jul  6 01:59 scanner.cc
drwxr-xr-x  3 tim  staff    96B May 31 18:20 tree_sitter

5. Removed window_clause, from_clause, group_by_clause from select_statement
-rw-r--r--  1 tim  staff   420K Jul  8 21:53 grammar.json
-rw-r--r--  1 tim  staff    13K Jun 13 10:36 grammar.json.rej
-rw-r--r--  1 tim  staff   263K Jul  8 21:53 node-types.json
-rw-r--r--  1 tim  staff    17K Jun 13 10:36 node-types.json.rej
-rw-r--r--  1 tim  staff    53M Jul  8 21:53 parser.c
-rw-r--r--  1 tim  staff   5.5M Jun 13 10:36 parser.c.rej
-rw-r--r--  1 tim  staff   4.2K Jul  6 01:59 scanner.cc
drwxr-xr-x  3 tim  staff    96B May 31 18:20 tree_sitter

>>>>>>>> With expressions modified

1. Removed select_subexpression from _simple_expression
-rw-r--r--  1 tim  staff   421K Jul  8 22:00 grammar.json
-rw-r--r--  1 tim  staff    13K Jun 13 10:36 grammar.json.rej
-rw-r--r--  1 tim  staff   259K Jul  8 22:00 node-types.json
-rw-r--r--  1 tim  staff    17K Jun 13 10:36 node-types.json.rej
-rw-r--r--  1 tim  staff    83M Jul  8 22:00 parser.c
-rw-r--r--  1 tim  staff   5.5M Jun 13 10:36 parser.c.rej
-rw-r--r--  1 tim  staff   4.2K Jul  6 01:59 scanner.cc
drwxr-xr-x  3 tim  staff    96B May 31 18:20 tree_sitter

2. Removed select_subexpression from all rules
-rw-r--r--  1 tim  staff   420K Jul  8 22:07 grammar.json
-rw-r--r--  1 tim  staff    13K Jun 13 10:36 grammar.json.rej
-rw-r--r--  1 tim  staff   259K Jul  8 22:07 node-types.json
-rw-r--r--  1 tim  staff    17K Jun 13 10:36 node-types.json.rej
-rw-r--r--  1 tim  staff    78M Jul  8 22:07 parser.c
-rw-r--r--  1 tim  staff   5.5M Jun 13 10:36 parser.c.rej
-rw-r--r--  1 tim  staff   4.2K Jul  6 01:59 scanner.cc
drwxr-xr-x  3 tim  staff    96B May 31 18:20 tree_sitter

From the above data, we can see that the SELECT statement introduced a large amount of size.
Unfortunately , on how to optimize it, I still have no good idea. Could you guys give me some suggestion?

parser.c is generated file, but scanner.cc is not. Use in python implies that user run tree-sitter generate before. You can see it in #63 binding.gyp in this PR has a step to generate files required.


Resource Query Language

Hey guys, i wrote a library to perform the same tasks but with one difference, allowing multiple targets (currently only Doctrine ORM i think that the community can put more data processors).
See the library here:
https://github.com/cekurte/resource-query-language
If you are interested in help me with more ideias and more or in merge it in this repository feel free.
Thanks for your attention.
I appreciate your suggestions.

My first look at your library shows it does not support AndX and OrX which in turn show a weakness wherein you only support and or or?  https://github.com/cekurte/resource-query-language/blob/master/src/Processor/DoctrineOrmProcessor.php#L62
Being able to mix queries like
$val1 or ($val2 and $val3)

is quite important.
You don't have a way to support Inner Join https://github.com/API-Skeletons/zf-doctrine-querybuilder/blob/master/src/Filter/ORM/InnerJoin.php
Some may find controversy in supporting such an operation but because you're not building for the Doctrine Query Builder and rather for a more generic 'resource' you don't have resource specific functionality.
I think the developer will look for the specialty tool over the generic 'resource' tool.  I think the 'resource' idea is not without merit but in my programming I go for the specialty designed tool to work with the specialty tools (Doctrine) I've already selected.  I would much rather see a library for each resource you with to support rather than trying to add more resources to a query engine which doesn't specialize.

Hm, my apologies on the delay in getting back to you.
Well, the expression:
$val1 or ($val2 and $val3)

Really make sense, and i will implement this feature.
Your comments about the specialist versus generic resource tool is interesting too, but in same cases i prefer to use the generic tools to make the portability of a set of libraries that are available to perform the same tasks, such the Doctrine or Eloquent (laravel) by example. Where both, are used to perform database queries and why not create a generic tool that abstract the differences of these libraries? On other hand, the library can not be used to perform specific tasks (this is a negative point) like the InnerJoin (do not make sense to a xml document by example).
I am trying to think a way to add specific use cases and put the specialist class to perform the database queries without losing the flexibility of the generic tool, do you have any ideia to share with me?
Thanks for your comments @TomHAnderson

Mr. @TomHAnderson, i worked with the feature that i talked yesterday.. see at:
https://github.com/cekurte/resource-query-language/tree/feature/orx-andx
Feel free to comment this modification.


Custom dataloader for scvi-tools

Hi, as discussed in our recent meeting, we can work with custom dataloaders within scvi-tools. It requires being a torch DataModule that loads dictionaries of keyword arguments for each mini batch. We have a working example for CELLXGENE census: https://github.com/chanzuckerberg/cellxgene-census/blob/ebezzi/census-scvi-datamodule/api/python/notebooks/experimental/pytorch_loader_scvi.ipynb (see imports to find the actual datamodule code). You will find that the notebook requires custom code to load and save models. We have built on top of this solution and changed the scvi-tools code to work without an registered AnnData object. I'm setting up a Colab notebook currently with our code and will update here.
Next steps would be feedback to our setup_registry function that takes a datamodule and populates all fields within an scvi-tools model. We currently only support scvi and would like to support more models. I expect that this will be joint effort as things might break outside of scvi-tools (for sure things will not work for multimodal - totalVI or multiVI models).

@jkobject Concerning scDataloader, it is currently setup for BERT like loading using a max_len argument. I assume it loads for every cell the 1000 most expressed genes. This structure is not allowed for scvi-tools (we expect the same genes being represented for all cells). Can you provide some help about the how argument?

Thanks for opening the issue, here!
Can you confirm the objective? By leveraging MappedCollection (or its scdataloader wrapper), you'd like to be more flexible regarding the storage backend so that you don't necessarily rely on a gigantic tiledbsoma but could also train on a collection of h5ads or parquets.
If so, can you help clarify what exactly is needed from MappedCollection so that you could run scvi on it? Is below everything you want from us as an interface for MappedCollection?

It requires being a torch DataModule that loads dictionaries of keyword arguments for each mini batch.

@canergen if we integrate the underlying MappedCollection, that should not be a problem. MappedCollection can return all genes (outer or inner join).

Hello All, I will get back to you in a week about this and potential updates to scDataLoader to make it fully in line with scvi-tools. I have already made a PR on the scverse community packages https://github.com/scverse/ecosystem-packages/pull/195 so maybe this discussion will find a better place in this PR?
scDataloader is setup to work in multiple ways to adapt to the new geneformer, scGPT and scPRINT models out there which don't always get the same set of genes. U However it also works if choosing always the same set of genes. how is a parameter for the Collator and is defined in its documentation here:
https://github.com/jkobject/scDataLoader/blob/main/scdataloader/collator.py
you can use "some" to only use a predefined set of genes, "most expr" to only use the most expr genes per cell, "random exp" to only use some randomly expr genes per cell.
If you know which genes you want to use you can use "some" and pass a list of genes, e.g.
from scdataloader import DataModule
import tqdm

datamodule = DataModule(
    collection_name=NAME,
    organisms=["NCBITaxon:9606"], #organism that we will work on
    how="some", # for the collator (most expr genes in the full dataset only will be selected)
    genelist=most_variable_genes_in_data, #not recommended (as it will highlight batch effects)
    batch_size=64,
    num_workers=1,
    validation_split=0.1,
    test_split=0)

Can you confirm the objective? I understand that by leveraging MappedCollection (or its scdataloader wrapper), you'd like to be more flexible regarding the storage backend so that you don't necessarily rely on a gigantic tiledbsoma but could also train on a collection of h5ads or parquets.

The current comparison is to a huge h5ad file, which doesn't scale to more than 100 million cells (and is already more expensive below these numbers). While we have support for CELLXGENE census we don't support all tiledbsoma databases and CxG census is restrictive in extending it to the whole scvi-tools library..
I assume both dataloaders are in line with our requirements (providing a pipeline of dictionary values). My take is that MappedCollection can provide a dictionary with categorical/integer/float values for every obs column in the underlying AnnData object. However, there are some details.
Missing pieces: We won't provide any validation for custom dataloader (like is the data really count data, is the list of celltype labels or categories in line with the registry). This is not strictly required in our perspective but if you want this feature handling it in the underlying data format can be much better optimized than across formats.
We require a dictionary of celltype labels/batches to integer categorical codes that needs to be stored with the dataloader. The scvi-tools model only take the integer values not the categories (setup_datamodule function within https://colab.research.google.com/drive/10sXec_TicMKtLA6hMcgfkado-FgoNKxw#scrollTo=jiksMKJdlGdK - it doesn't install correctly yet as I have issues with the typing of the CZI code).
Is there support of MuData within MappedCollection. How would you support multimodal (ATAC+RNA+protein data). Currently, we are restricted in terms of input data to the CELLXGENE census with obviously no multimodal collections. I assume large-scale models in the coming year will contain multimodal data.

I am not sure I understand everything, but you seem to say that scdataloader is already in line with scvi-tools, but we need to enforce that its other elements in the output dictionary, e.g., class / batch... are categoricals encoded with integers. The function is already there, and in my example and current use case, everything is transformed so that the encoding is available via the "decoders" property of the datamodule or the "encoder" property of the pytorch datasets.
Given how the mapped collection is implemented, multimodal data is quite straightforward. It just amounts to accessing another field of the underlying H5ad format. For the user, it would receive an 'X_rna', 'X_atac', ... in the output dictionary of tensors instead of just the 'X'.

We now have an example of how to use MappedCollection with scvi-tools-based models here https://lamin.ai/laminlabs/cellxgene/transform/d1kl7wobCO1H0005

Nice, any reason to not use scDataLoader. For us tests with it are not going smoothely and the CZI dataloader are not maintained - see current failing tests at https://github.com/scverse/scvi-tools/actions/runs/12492962614/job/34860858978?pr=2932. How to you plan to distribute the code? Do you mind us copy-pasting it to our tests? The changes in that PR hopefully allow saving/loading/arches-mapping with dataloaders.

@falexwolf how do we want to distribute an scvi-compatible datamodule from https://lamin.ai/laminlabs/cellxgene/transform/d1kl7wobCO1H0005 ? It requires pytorch-lightning , so we shouldn't include it into lamindb. Also it is not really  production-ready code, just an ad-hoc example of usage.
@canergen

How do I get a list of gene names sorted similarly as the output of collection.mapped (AnnData's adata.vars)?
They are in .var_joint.

Yeah, let's discuss distribution in the upcoming days -- ideas are welcome. Copy-pasting is a good interim solution but of course I hope we can get to something more robust.

Hi, I had to write an inference Dataloader that also executes on_before_batch_transfer (not sure how you handle it in scGen but scvi-tools models don't use lightning for inference but iterate over the dataloader). This part is working now. ScArches and reloading models with AnnData is working as well. In the long run, it would make sense to sync scGen to the underlying changes in scvi-tools. You can find the rewritten DataLoader in https://github.com/scverse/scvi-tools/blob/9767b8c5a4ea59aee7c742c09187158963ea8ace/tests/dataloaders/test_custom_dataloader.py#L22.
From my side, we would hope to create a tutorial on how to set up a CustomDataLoader. We could have the code in scvi-tools/data (maybe _utils.py maybe it's own file) but the core idea was to have CustomDataloader within external packages.
There are some missing pieces still:

ScANVI requires to see all entries of the cell-type column (ad.obs[LABEL_KEY]). What's the most efficient way to get an obs column from the MappedCollection joint object? My understanding of the unlabeled column in collection.mapped is that you assign a value of -1. ScANVI and similar models expect a value of n_labels (last integer) for these entries. Do you have any preference on how to adjust it (likely in the on_before_batch_transfer call?
We need a smaller file than the current one for testing, currently ln.Collection.get(name="covid_normal_lung. Additionally, we need access to count data outside of adata.raw.X. Could you create a public artifact (it can be the COVID data subset to 10k cells and with count data in layers.counts.
Figuring out how to best set up a validation dataloader is still open.

ScANVI requires to see all entries of the cell-type column (ad.obs[LABEL_KEY]). What's the most efficient way to get an obs column from the MappedCollection joint object?

Do you need the full column, not only categories? If yes, then it can be done via .get_merged_labels(LABEL_KEY).

My understanding of the unlabeled column in collection.mapped is that you assign a value of -1. ScANVI and similar models expect a value of n_labels (last integer) for these entries. Do you have any preference on how to adjust it (likely in the on_before_batch_transfer call?

Whatever works i think.

We need a smaller file than the current one for testing, currently ln.Collection.get(name="covid_normal_lung. Additionally, we need access to count data outside of adata.raw.X.

Hm, MappedCollection can't actually access .raw for now, only .X, .layers and .obsm. Yes, we can make a smaller collection of anndata files for testing.


No response
Which package or tool is having this issue?
Hydrogen
What version of that package or tool are you using?
2024.7.9
What version of Remix are you using?
2.10.1
Steps to Reproduce

Create a new Hydrogen project
Install the dependencies
Check ESLint version

Expected Behavior
The Skeleton template should use ESLint 9.
Actual Behavior
The Skeleton template is using ESLint 8.x which is end of life since October 5, 2024.
https://eslint.org/blog/2024/09/eslint-v8-eol-version-support/

@wizardlyhel Thank you for the response!
I think @remix-run/eslint-config is deprecated :

https://github.com/remix-run/remix/discussions/10054
https://github.com/remix-run/remix/issues/7056
https://github.com/remix-run/remix/pull/7597

Why does it work in scaffold but not in skeleton?
Even though there seems to be no difference between the versions.
It makes the development experience very bad as I can't focus on the essential things.


[BUG] rmorphan removes ISDB global PIDs

Bug description:
The rmorphan processing plugin seems to remove global PIDs that are unique to ISDB.
How to reproduce:
Using AAB.ts from the stream repository:
$ tsp --verbose --japan -I file AAB.ts -P rmorphan -O file AAB_rmorphan.ts
* rmorphan: PID 0 (0x0000) is referenced
* rmorphan: PID 1 (0x0001) is referenced
* rmorphan: PID 2 (0x0002) is referenced
* rmorphan: PID 8191 (0x1FFF) is referenced
* rmorphan: PID 16 (0x0010) is referenced
* rmorphan: PID 17 (0x0011) is referenced
* rmorphan: PID 18 (0x0012) is referenced
* rmorphan: PID 19 (0x0013) is referenced
* rmorphan: PID 20 (0x0014) is referenced
* rmorphan: PID 21 (0x0015) is referenced
* rmorphan: PID 22 (0x0016) is referenced
* rmorphan: PID 28 (0x001C) is referenced
* rmorphan: PID 29 (0x001D) is referenced
* rmorphan: PID 30 (0x001E) is referenced
* rmorphan: PID 31 (0x001F) is referenced
* file: initial input bitrate is 17,267,628 b/s
* rmorphan: PID 257 (0x0101) is referenced
* rmorphan: PID 258 (0x0102) is referenced
* rmorphan: PID 259 (0x0103) is referenced
* rmorphan: PID 8136 (0x1FC8) is referenced
* rmorphan: PID 768 (0x0300) is referenced
* rmorphan: PID 785 (0x0311) is referenced
* rmorphan: PID 786 (0x0312) is referenced
* rmorphan: PID 788 (0x0314) is referenced
* rmorphan: PID 6960 (0x1B30) is referenced
* rmorphan: PID 6969 (0x1B39) is referenced
* rmorphan: PID 6970 (0x1B3A) is referenced
* rmorphan: PID 6971 (0x1B3B) is referenced
* rmorphan: PID 96 (0x0060) is referenced
* rmorphan: PID 256 (0x0100) is referenced
* rmorphan: PID 273 (0x0111) is referenced
* rmorphan: PID 274 (0x0112) is referenced
* rmorphan: PID 276 (0x0114) is referenced
* rmorphan: PID 277 (0x0115) is referenced
* rmorphan: PID 6912 (0x1B00) is referenced
* rmorphan: PID 6913 (0x1B01) is referenced
* rmorphan: PID 6914 (0x1B02) is referenced
* rmorphan: PID 6915 (0x1B03) is referenced
* rmorphan: PID 6916 (0x1B04) is referenced
* rmorphan: PID 6917 (0x1B05) is referenced
* rmorphan: PID 6918 (0x1B06) is referenced

Expected behavior:
I don't think these global PIDs should be removed. Other Global PIDs are not removed.
Errors and logs:
tsanalyze of original file from stream repository (global PIDs section only):
|=============================================================================|
|  Global PID's                                                               |
|  TS packets: 35,743, PID's: 13 (clear: 13, scrambled: 0)                    |
|-----------------------------------------------------------------------------|
|     PID  Usage                                     Access          Bitrate  |
|   Total  Global PID's ................................. C      842,105 b/s  |
|   Subt.  Global PSI/SI PID's (0x00-0x1F) .............. C      104,394 b/s  |
|  0x0000  PAT .......................................... C       15,054 b/s  |
|  0x0001  CAT .......................................... C          141 b/s  |
|  0x0010  NIT .......................................... C        1,507 b/s  |
|  0x0011  SDT/BAT ...................................... C          753 b/s  |
|  0x0012  EIT .......................................... C       86,630 b/s  |
|  0x0014  TDT/TOT ...................................... C          306 b/s  |
|  0x0023  ISDB SDTT .................................... C          259 b/s  |
|  0x0024  ISDB BIT ..................................... C        1,484 b/s  |
|  0x0027  ISDB EIT ..................................... C        9,047 b/s  |
|  0x0028  ISDB SDTT .................................... C           47 b/s  |
|  0x0029  ISDB CDT ..................................... C           23 b/s  |
|  0x0071  ARIB Content Protection EMM (ISDB) ........... C       55,978 b/s  |
|  0x1FFF  Stuffing ..................................... C      670,871 b/s  |
|=============================================================================|

Processed file (global PIDs section only):
|=============================================================================|
|  Global PID's                                                               |
|  TS packets: 32,906, PID's: 7 (clear: 7, scrambled: 0)                      |
|-----------------------------------------------------------------------------|
|     PID  Usage                                     Access          Bitrate  |
|   Total  Global PID's ................................. C      775,719 b/s  |
|   Subt.  Global PSI/SI PID's (0x00-0x1F) .............. C      104,455 b/s  |
|  0x0000  PAT .......................................... C       15,064 b/s  |
|  0x0001  CAT .......................................... C          141 b/s  |
|  0x0010  NIT .......................................... C        1,509 b/s  |
|  0x0011  SDT/BAT ...................................... C          754 b/s  |
|  0x0012  EIT .......................................... C       86,681 b/s  |
|  0x0014  TDT/TOT ...................................... C          306 b/s  |
|  0x0071  ARIB Content Protection EMM (ISDB) ........... C            0 b/s  |
|  0x1FFF  Stuffing ..................................... C      671,263 b/s  |
|=============================================================================|

Environment:

OS: Linux
OS version: Gentoo
TSDuck full version: 3.30-2700
Installation type: built from source

Hi @APTX
This is fixed. ISDB and ATSC predefined PID's are now correctly considered as referenced when the corresponding options such as --isdb, --japan, --atsc, --usa and the like are specified, either as tsp level or at rmorphan level.

Hi @lelegard
I can confirm the issue is fixed. The ISDB global PID's are no longer removed.
Current tsanalyze output for global PID's:
|=============================================================================|
|  Global PID's                                                               |
|  TS packets: 33,367, PID's: 12 (clear: 12, scrambled: 0)                    |
|-----------------------------------------------------------------------------|
|     PID  Usage                                     Access          Bitrate  |
|   Total  Global PID's ................................. C      786,586 b/s  |
|   Subt.  Global PSI/SI PID's (0x00-0x1F) .............. C      104,455 b/s  |
|  0x0000  PAT .......................................... C       15,064 b/s  |
|  0x0001  CAT .......................................... C          141 b/s  |
|  0x0010  NIT .......................................... C        1,509 b/s  |
|  0x0011  SDT/BAT ...................................... C          754 b/s  |
|  0x0012  EIT .......................................... C       86,681 b/s  |
|  0x0014  TDT/TOT ...................................... C          306 b/s  |
|  0x0023  ISDB SDTT .................................... C          259 b/s  |
|  0x0024  ISDB BIT ..................................... C        1,485 b/s  |
|  0x0027  ISDB EIT ..................................... C        9,052 b/s  |
|  0x0028  ISDB SDTT .................................... C           47 b/s  |
|  0x0029  ISDB CDT ..................................... C           24 b/s  |
|  0x0071  ARIB Content Protection EMM (ISDB) ........... C            0 b/s  |
|  0x1FFF  Stuffing ..................................... C      671,263 b/s  |
|=============================================================================|


chore: update d3

FX-3710
Description
This pull request updates all the d3 packages. Some of the tests fail due to way ESM modules are supported in Jest (https://jestjs.io/docs/ecmascript-modules). In order to fix this, updated ESM packages were added to the transformIgnorePatterns setting (https://jestjs.io/docs/configuration#transformignorepatterns-arraystring) instead of enabling experimental features.
Tested on node v12 and v14.
How to test

All checks should pass

Development checks

[x] Add changeset according to guidelines (if needed)
[N/A] Read CONTRIBUTING.md and Component API principles
[N/A] Make sure that additions and changes on design follow Toptal's BASE design, and it's been already discussed with designers at #-base-core
[N/A] Annotate all props in component with documentation
[N/A] Create examples for component
[N/A] Ensure that deployed demo has expected results and good examples
[N/A] Ensure the changed/created components have not caused accessibility issues. How to use accessibility plugin in storybook.
[x] Self reviewed
[N/A] Covered with tests

Breaking change

[N/A] codemod is created and showcased in the changeset
[N/A] test alpha package of Picasso in StaffPortal

All development checks should be done and set checked to pass the
GitHub Bot: TODOLess action

PR commands

List of available commands:

@toptal-bot run package:alpha-release - Release alpha version
@toptal-anvil ping reviewers - Ping FX team for review

PR Review Guidelines

When to approve? ✅
You are OK with merging this PR and

You have no extra requests.
You have optional requests.

Add nit: to your comment. (ex. nit: I'd rename this variable from makeCircle to getCircle)

When to request changes? ❌
You are not OK with merging this PR because

Something is broken after the changes.
Acceptance criteria is not reached.
Code is dirty.

When to comment (neither ✅ nor ❌)
You want your comments to be addressed before merging this PR in cases like:

There are leftovers like unnecessary logs, comments, etc.
You have an opinionated comment regarding the code that requires a discussion.
You have questions.

How to handle the comments?

An owner of a comment is the only one who can resolve it.
An owner of a comment must resolve it when it's addressed.
A PR owner must reply with ✅ when a comment is addressed.

@toptal-bot run package:alpha-release


replace jquery-minicolors with coloris

Get rid of one more jQuery dependant and have a nicer color picker as well.
Now there is only a single global color picker init because that is all that's necessary because the elements are present on the page when the init code runs. The init is slightly weird because the module only takes a selector instead of DOM elements directly.
The label modals now also perform form validation because previously it was possible to trigger a 500 error Color cannot be empty. by clearing out the color value on labels.

I think the CSS can be trimmed down a bit more. It still has quite a bit of unnecessary stuff.

CSS is stripped down, so I'd say this is ready to review.

public/assets/img/webpack is removed as well. The only purpose of that folder was to serve the PNG from jQuery-minicolors, which is now gone.


fix: hotfixed tab content parsing (need refactoring)

:tada: This PR is included in version 1.1.0-alpha.4 :tada:
The release is available on:

npm package (@alpha dist-tag)
GitHub release

Your semantic-release bot :package::rocket:

:tada: This PR is included in version 1.2.2 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


A-Frame inspector style bug

Some bootstrap classes are conflicting causing the A-Frame inspector to break a bit.

Yeah I've encountered this before. Currently you can detect the inspector being open but it requires a bunch of hacky checks to do this.


Revert "Add support for publishing REST from root path"

This reverts commit d964cd4166ce374168c06f561eb22c4f15bdfb1b.

alluxio-bot, merge this please


Add resource cache prewarm

What are you trying to accomplish with this PR?
Resolve https://github.com/Shopify/kubernetes-deploy/issues/591
Warm up the resource cache before running resource.sync by populating it with various kinds that we know we'll need.
How is this accomplished?

Similar to the suggestion in the linked issue, use_or_populate_cache(kind) on each kind before the sync step.
I came up with which kinds to prefetch and when by looking at each sync method. There's a chance I overlooked something so let me know.
I tested it by assuring the method that does the warming was making kubectl calls to both a resource (deployment) and its listed prefetch kinds (in this case, pods).

What could go wrong?

I might have missed something
This doesn't improve things how we/I thought it would

Rebase done. At a glance it looks like it went well, that wasn't too bad at all.
Thanks @dturn good shout. Done 👍
@KnVerey ready for 👀


📁-> 📁 Merge Korral-Interactions and Korral-JS

This merges Korral-Interactions and Korral-JS into one project. This PR will also will include changes to improve UX of the users. Planned changes are listed below:
General

[x] Updating props and methods to use discord.js props/methods
[x] Bring necessary files from Korral-Interactions to this repo
[x] Maintain support for Slash commands
[x] Maintain support for buttons
[x] Maintain support for Text-Based commands
[x] Bot boots without errors
[x] Maintain support for /deepsea command and the fetching of the data
[x] Add CTX Commands
[x] Add Quote Message CTX command to quote messages and send them to a channel

Tickets

[x] Maintain support for tickets
[x] Update tickets to not auto-delete Thread Created message until ticket has been closed
[x] Persist open ticket status when bot reboots
[x] Detect manually deleted tickets and release the open ticket state
[x] Improve UX for closing tickets
[x] Improve UX for helping in tickets
[x] Disallow opening multiple Support Tickets
[x] Allow sending custom message on ticket close
[x] Add cooldown option
[x] Add option to prompt before opening ticket

Final

[x] Test slash commands
[x] Test CTX commands
[x] Test buttons
[x] Test tickets
[x] Test data storage

Note: This list is not final as this PR is not ready for production use and it's still heavily a WIP.

hope all of this works

I do too. I really do.


SVD support

https://www.keil.com/pack/doc/CMSIS/SVD/html/index.html

RgGen supports registers which are assigned to the same address.
https://github.com/rggen/rggen-sample/blob/ebed8c251d31a3bed4e148168aa6b6e25283d74a/block_0.yml#L121
https://github.com/rggen/rggen-sample/blob/ebed8c251d31a3bed4e148168aa6b6e25283d74a/uart_csr.yml#L6
I'm not sure how to describe such registers in the SVD file.


Review yaml files and update for ease of use

Context
Overview
Out of Scope:
Related issues/Dependencies:
Acceptance Criteria

[ ] Update AWS documentation in microsite

Tech Tasks

[ ] Run Changesets, bump any packages that have been updated/changed
[ ] Did you make changes to the client, api or cli package? If so, considering updating the create-app templates.

Tech Notes
Review Tasks

[ ] eg. specific QA details, update methodology, or update microsite

I reviewed this, updated the yaml files and also added some additional context in the AWS instructions: https://www.cloudcarbonfootprint.org/docs/aws/
I also replied to the Google Group thread about this, with detailed instructions.


Sequence index must be integer

Keep getting this errors:
Traceback (most recent call last):
  File "worker.py", line 129, in run
    self.main()
  File "worker.py", line 170, in main
    map_objects = response_dict['responses'].get('GET_MAP_OBJECTS', {})
TypeError: sequence index must be integer, not 'str'

Any quick fix for this?

I keep getting the same on 2 new accounts. Running on latest forts branch

i found this error message when i scrolled up a bit above the error: ERROR][L  88] Could not retrieve token: As a security measure, your account has been disabled for 15 minutes because you have failed to log in correctly too many times. Please come back and try again in 15 minutes.
go and see if you are having problem loging in with the accounts you are using. if this is so, make sure you have the right password defined in config.py

I turned on debug logging and have been going through the log. Looks like they might be related to an account login/activation issue. I've been going through and figuring out what accounts are having issues so I can fix them. Once I have all the accounts sorted out, I'll see if it still gives the save error.

Update: After correcting the issues with the problem accounts (activation, valid accounts, etc), the error does not show up anymore.


fix: avoid /extended/v1/tx/<txid> request that must follow redirects

Adjust a network request to /extended/v1/tx/<txid> to use a 0x prefix. This lets the fetch avoid needing to follow a redirect.

:tada: This PR is included in version 1.2.1 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


"Multiple" option can't be truly disabled

The "multiple" option's behavior is counterintuitive -- it only affects whether or not you can select more than one file in the file dialog, but you can still add more than one file to the queue by dragging and dropping or by opening the file dialog more than once.

Hey there @XaserAcheron, could you explain what you want to happen, and a use case? This is currently working as intended, but would like to get some clarity on what you're asking for.

I think more generically, what I'm looking for is some way to cap the queue length.
The way the "multiple" option is phrased, it looks as if it means "cap queue length to 1", when that isn't the case. It may be worth adding some clarification to the docs that it only affects the file dialog.

Ahh, this multiple is applying directly to the input tag, so nothing happens with the queue.
I'd be interested in to see what use cases there may be for queue configuration. I'm struggling to see what use cases there may be, though. But that may be due to the apps that I've worked on.

A quick n' easy use case: GitHub avatars. We each only have one, and it's better UX if the user is explicitly only able to queue one image for upload rather than having the server just choose one from the queue.
[My own real-world use case is pretty much exactly this, for the record.]

That use case is already supported with the queues as-is. I can understand limiting the queue, but if a user decides to upload a different photo, they probably intend to replace the one that's currently being uploaded. Your server probably shouldn't choose something from the queue directly. Events from the addon try to push you in a direction to handle files through lifecycle events provided by the user:

onfileadd

An action handler that would resolve in a single property would be:
import Ember from 'ember';

export default Ember.Route.extend({
  actions: {
    uploadAvatar(file) {
      // 👋 Lots of hand waving here for the api response, etc. 👋
      file.upload('/api/avatars').then(function (avatar) {
        set(this, 'currentUser.avatar', avatar);
      });
    }
  }
});

Maybe I should clarify something: the image uploader exists next to a small (~3-field) form, and the intent is for the image upload to not actually occur until the "Save" button is pressed. I'm trying to avoid uploading immediately during onfileadd since that makes things a lot more complex (well, a little bit on the implementation side, a lot more on the people side; I'm trying to avoid playing a game of twenty questions with the folks that run the server).
I'm already using onfileadd to store the file for later upload; trouble is I have to manually de-queue old items, which is a bit ugly and results in a short "blip" where 2 files briefly exist in the queue, causing the UI to flash (though I suppose I can add an additional custom workaround there).

I'm doing this exact thing without much trouble:
See: https://github.com/tim-evans/queertangoclub/blob/master/app/components/photo-field/template.hbs
I store the file from the onchange event and the component renders out a preview of the file.

So, effectively you're bypassing the queue altogether.  :/
I guess I'm not sure what to do now aside from spending a bunch of time explaining my "not actually as simple as I've made it out to be" real-world use case to back a suggestion that really didn't require any additional clarification.

I think there's a good use case here under all this:
If multiple is false, any other files could be removed from the queue -or- cancelled if they are in-flight. It's a semi-reasonable default for uploads. There needs to be a way to clean up after, though... hrrmmm. That makes it a bit trickier.

Righto -- to throw another chip into the pot, there may be an odd use case where someone can only upload, say, a maximum of 3 images at a time to the server and wishes for the UI to follow suit.
[Apologies for being a grumpy sort about all this. If it helps, I'm frustrated at my lack of explaining things clearly more than anything else.]

@tim-evans Has there been any progress on this?

Sorry, there hasn't. I've been busy on other projects. I would be happy guiding folks to a solution for this

I can take a look hopefully this weekend if time permits. Thanks for your response.

Let me try to summarize the discussion: An option should be added to the queue that sets a limit of files that could be added. If the limit is reached and additional file is added, existing files on the queue should be removed and if already uploaded they should be canceled. The default value of that limit should be unlimited as today. Often it will be set to 1 to prevent multiple uploads.
Actually I'm not sure if it's that simple. What if the consumer wants to enforce a limit but don't want to remove existing ones if the limit is reaced but prevent adding new ones? Should this be allowed by another option?
I think we should start with a more low-level API that makes it easier. Maybe an onFileAdd event of the queue that makes it easier to implement such a limit on user land? Would be also more inline with API changes proposed in #316 if I got @gilest motivation right.

I think you're on the right track.
Rather than adding endless configuration options we should make it easy to hook in and add logic like this.


511 - When custom symbol selected in Icon Options, clicking OK does not close Set Symbol window

Steps to repro:

Configure the Info Summary widget with at least one data layer.
Click the edit button for that layer to open the Set Symbol dialog.
Select the "Upload Custom Icon" option under Icon Options.
Upload a custom icon.
Click OK on the Set Symbol dialog.  Note that clicking OK does nothing.  You must set the Icon Option back to "Use Symbol as Icon" in order to click OK and dismiss the Set Symbol window.

@lindsayking ready to be verified in the WAB repo

Verified with the WAB repo.


Can't connect to the add-on

Every time I try to add the integration to HA I keep getting error 'Can't connect to the add-on.'

Any help appreciated.

Hey Si1956,
Do you have the bacnet add-on installed by any chance?


Validate a field after it is focussed & blurred

Currently, all the form fields are validated after a first change in the very first text field.
It could be a better UX to validate each field on their blur.
Example: Signup.tsx

It can be visited after the Formik issue #512 is closed: https://github.com/formium/formik/issues/512


[tool_crash] FileSystemException: Creation failed, OS Error: No such file or directory, errno = 2

Command
flutter --no-color pub get

Steps to Reproduce

...
...
...

Logs
FileSystemException: Creation failed, OS Error: No such file or directory, errno = 2
#0      _Directory.createSync (dart:io/directory_impl.dart:129:7)
#1      ForwardingDirectory.createSync (package:file/src/forwarding/forwarding_directory.dart:20:16)
#2      ErrorHandlingDirectory.createSync.<anonymous closure> (package:flutter_tools/src/base/error_handling_io.dart:428:22)
#3      _runSync (package:flutter_tools/src/base/error_handling_io.dart:590:14)
#4      ErrorHandlingDirectory.createSync (package:flutter_tools/src/base/error_handling_io.dart:427:12)
#5      EngineCachedArtifact.updateInner (package:flutter_tools/src/cache.dart:916:19)
<asynchronous suspension>
#6      CachedArtifact.update (package:flutter_tools/src/cache.dart:810:5)
<asynchronous suspension>
#7      Cache.updateAll (package:flutter_tools/src/cache.dart:677:9)
<asynchronous suspension>
#8      FlutterCommand.verifyThenRunCommand (package:flutter_tools/src/runner/flutter_command.dart:1518:7)
<asynchronous suspension>
#9      FlutterCommand.run.<anonymous closure> (package:flutter_tools/src/runner/flutter_command.dart:1336:27)
<asynchronous suspension>
#10     AppContext.run.<anonymous closure> (package:flutter_tools/src/base/context.dart:150:19)
<asynchronous suspension>
#11     CommandRunner.runCommand (package:args/command_runner.dart:212:13)
<asynchronous suspension>
#12     FlutterCommandRunner.runCommand.<anonymous closure> (package:flutter_tools/src/runner/flutter_command_runner.dart:296:9)
<asynchronous suspension>
#13     AppContext.run.<anonymous closure> (package:flutter_tools/src/base/context.dart:150:19)
<asynchronous suspension>
#14     FlutterCommandRunner.runCommand (package:flutter_tools/src/runner/flutter_command_runner.dart:244:5)
<asynchronous suspension>

[✓] Flutter (Channel stable, 3.10.6, on macOS 12.6.3 21G419 darwin-arm64, locale en-VN)
    • Flutter version 3.10.6 on channel stable at /Users/tinh.nguyen.ngoc/Library/flutter
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision f468f3366c (4 weeks ago), 2023-07-12 15:19:05 -0700
    • Engine revision cdbeda788a
    • Dart version 3.0.6
    • DevTools version 2.23.1

[!] Android toolchain - develop for Android devices (Android SDK version 33.0.2)
    • Android SDK at /Users/tinh.nguyen.ngoc/Library/Android/sdk
    ✗ cmdline-tools component is missing
      Run `path/to/sdkmanager --install "cmdline-tools;latest"`
      See https://developer.android.com/studio/command-line for more details.
    ✗ Android license status unknown.
      Run `flutter doctor --android-licenses` to accept the SDK licenses.
      See https://flutter.dev/docs/get-started/install/macos#android-setup for more details.

[✓] Xcode - develop for iOS and macOS (Xcode 14.2)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Build 14C18
    • CocoaPods version 1.12.1

[✓] Chrome - develop for the web
    • Chrome at /Applications/Google Chrome.app/Contents/MacOS/Google Chrome

[✓] Android Studio (version 2022.1)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 11.0.15+0-b2043.56-8887301)

[✓] VS Code (version 1.76.1)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension can be installed from:
      🔨 https://marketplace.visualstudio.com/items?itemName=Dart-Code.flutter

[✓] Connected device (2 available)
    • macOS (desktop) • macos  • darwin-arm64   • macOS 12.6.3 21G419 darwin-arm64
    • Chrome (web)    • chrome • web-javascript • Google Chrome 103.0.5060.114

[✓] Network resources
    • All expected network resources are available.

! Doctor found issues in 1 category.

Flutter Application Metadata
Type: app
Version: 1.0.0+1
Material: true
Android X: false
Module: false
Plugin: false
Android package: null
iOS bundle identifier: null
Creation channel: stable
Creation framework version: 2ad6cd72c040113b47ee9055e722606a490ef0da
Plugins
connectivity_plus-3.0.6
fluttertoast-8.2.2
path_provider-2.1.0
path_provider_android-2.1.0
path_provider_foundation-2.3.0
path_provider_linux-2.2.0
path_provider_windows-2.2.0
shared_preferences-2.2.0
shared_preferences_android-2.2.0
shared_preferences_foundation-2.3.2
shared_preferences_linux-2.3.0
shared_preferences_web-2.2.0
shared_preferences_windows-2.3.0
sqflite-2.2.8+4

Closing as duplicate of https://github.com/flutter/flutter/issues/65242


Map properties between GSC checklist and sample spreadsheet

Description of the issue
In order to understand if the metadata provided by the Microbe partners matches the GSC MixS soil checklist (ERC000022), I would like to map the fields provided by both the checklist and the spreadsheet.

Comparison between checklist and sample spreadsheet fields

Action Items

[x] Create a list that directly compares fields and maps them
[x] Create a list of exclusive GSC fields
[x] Create a list of exclusive Spreadsheet fields
[x] Discuss how we want to treat the exclusive spreadsheet fields (E.g. should we include them anyways?)
[ ] Create a ticket to start filling out the spreadsheet based on the mappings above

We decided to include the extra fields, as they don't interfere with the checklist.
We're going to go with this mapping for the submission of the 6 + 2 samples and the other lists of samples


updating to tfjs 1.1.2 ==> example checking

Hi there!
I'm currently working through the update to tfjs 1.0.2 1.1.2
Here is a running list of checks:
Update: here's a list of examples that have been checked
ml5-examples/javascript

[X] No issues with image classification using MobileNet
[ ] Issue with image classification using feature extractor ==> works in chrome but not firefox
[x] No issues with webcam classification using MobileNet.
[x] No issues with PoseNet
[x] No issues with StyleTransfer

ml5-examples/p5js

[x] CVAE/ ==> needs to be updated to tf1.0; DONE!
[X] CharRNN:

[X] CharRNN_Interactive/
[X] CharRNN_Text/
[X] CharRNN_Text_Stateful/

[x] FeatureExtractor

[X] FeatureExtractor_Image_Classification/
[X] FeatureExtractor_Image_Regression/

[X] ImageClassification

[X] /ImageClassification/
[X] ImageClassification_MultipleImages/
[X] ImageClassification_Video/
[X] ImageClassification_VideoScavengerHunt/
[X] ImageClassification_VideoSound/
[ ] ImageClassification_VideoSoundTranslate/ ==> needs api key

[X] KNNClassification: Fixed with https://github.com/ml5js/ml5-library/pull/366

[X] KNNClassification_PoseNet/
[X] KNNClassification_Video/: Mobilenet.js:374 Uncaught TypeError: this.mobilenet.infer is not a function
[X] KNNClassification_VideoSound/: Mobilenet.js:374 Uncaught TypeError: this.mobilenet.infer is not a function
[X] KNNClassification_VideoSquare : Mobilenet.js:374 Uncaught TypeError: this.mobilenet.infer is not a function

[x] PitchDetection
[ ] Pix2Pix:

[X] callbacks
[ ] promises ==> broken: https://github.com/ml5js/ml5-examples/issues/139

[x] PoseNet
[X] Sentiment ==> needs to be updated to tf1.0; DONE!
[X] SketchRNN: ==> DONE!
[x] StyleTransfer_Image: ✅
[X] StyleTransfer_Video: Works in Chrome ==> ^^ maybe a problem with the image handling
[X] UNET ==> needs to be updated to TFJS 1.0; DONE!
[x] Word2Vec
[X] YOLO: DONE

@shiffman @yining1023 @AshleyJaneLewis - As our current development branch is working for all of our examples now (save for some browser compatibility issues and the broken pix2pix promises example), let's plan to do a release soon - next week?
@WenheLI and I will do some improvements to mobilenet, but otherwise things are working! ✨

Things are working ya'll! Closing this for now. Thanks for all the effort!


Missing link to postman collection (SharePoint Online Indexer)

In the video Azure Cognitive Search : SharePoint Online Indexer (4:12) a postman collection is used to run some Azure Cognitive Search REST API's.
Is it public and where can I find the link to this collection ?
f.e. Azure Search Postman

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 0b22c4bf-c908-0f27-a6aa-a82a44c39aca
Version Independent ID: 6c306b8f-90e4-1f76-3562-a6c3bced6133
Content: SharePoint indexer (preview) - Azure Cognitive Search
Content Source: articles/search/search-howto-index-sharepoint-online.md
Service: cognitive-search
GitHub Login: @gmndrg
Microsoft Alias: gimondra

@Abderahman88
Thanks for your feedback! We will investigate and update as appropriate.

Hi @Abderahman88 unfortunately that is not a public collection, but it was the Program Manager's at the time. This was set just for demonstration purposes and not available any longer.

#please-close


No bid price for go plugin to httpinterface

Hi,
I use go to do the bid, but it's not working, the bid price printed out as empty using this package: https://github.com/machinalis/bidderd
Any idea or suggestions?
Thanks
Rob

You reported a problem in the wrong project. rtbkit hasn't got anything to do with the bidder agent in that repository. I suggest you open an issue in the right repository https://github.com/machinalis/bidderd/issues and with a bit more detail on what you are doing.

Hi, Ale;
I moved it to https://github.com/machinalis/bidderd/issues/1
Now I belong to the right project, what you say?
Rob
ᐧ
On Wed, Aug 3, 2016 at 8:45 PM, Alejandro Peralta<EMAIL_ADDRESS>wrote:

You reported a problem in the wrong project. rtbkit hasn't got anything to
do with the bidder agent in that repository. I suggest you open an issue in
the right repository https://github.com/machinalis/bidderd/issues and
with a bit more detail on what you are doing.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/rtbkit/rtbkit/issues/295#issuecomment-237444853, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AT3I1XQ4muCuTf20ygoNmJNx2iMPCkyDks5qcWA9gaJpZM4JcLRq
.

Hi Ale,
Any fix for it?
Thanks,
Tob
ᐧ
On Wed, Aug 3, 2016 at 9:50 PM, Robert Pepper<EMAIL_ADDRESS>wrote:

Hi, Ale;
I moved it to https://github.com/machinalis/bidderd/issues/1
Now I belong to the right project, what you say?
Rob
ᐧ
On Wed, Aug 3, 2016 at 8:45 PM, Alejandro Peralta <
<EMAIL_ADDRESS>wrote:

You reported a problem in the wrong project. rtbkit hasn't got anything
to do with the bidder agent in that repository. I suggest you open an issue
in the right repository https://github.com/machinalis/bidderd/issues and
with a bit more detail on what you are doing.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/rtbkit/rtbkit/issues/295#issuecomment-237444853, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AT3I1XQ4muCuTf20ygoNmJNx2iMPCkyDks5qcWA9gaJpZM4JcLRq
.


Additionally the classes are removed on destroy

close this pull request due to combined pull request on base repository


v0.1.5: Restoring syntax fix for javascript and added typescript

This should be a fix for issue #1.
I looked at how it was done in the Vue extension and adapted it.

@laosb could you check this and merge it? Your plugin has been broken since the 4.0 update, and this PR fixes it

@laosb could you check this and merge it? Your plugin has been broken since the 4.0 update, and this PR fixes it


TheRock exchange does not work

zenbot.sh trade therock.BTC-USD --debug --period=5s --neurons_1=5 --depth=3 --min_periods=100 --min_predict=10 --momentum=0 --decay=0 --threads=8 --learns=100 -reset_profit --paper
(node:18718) UnhandledPromiseRejectionWarning: Unhandled promise rejection (rejection id: 1): TypeError: Cannot read property 'page' of null
(node:18718) [DEP0018] DeprecationWarning: Unhandled promise rejections are deprecated. In the future, promise rejections that are not handled will terminate the Node.js process with a non-zero exit code.
System information

**OS Platform - Linux Ubuntu 16.04
**Zenbot version - latest commit
**NodeJS version - 8.9.1
**Python version
Exact command to reproduce:

This issue was moved to highvelocityspace/zenbot#37

This issue was moved to highvelocityspace/zenbot#67


Add EMCPy as a submodule

Description
PR related to Issue #57. Currently, I have added EMCPy as a submodule and updated setup.py so that eva will build.
eva imports still work, however, when trying to point to any emcpy modules, some issues arise. The first being issues with __init__.py files from emcpy.

I would have expected to see all the EMCpy code being removed. Is the plan for a two-step process here?

I have figured out how to add EMCPy to download with EVA. I tried to use git submodules, however it proved to be really difficult. Adding it as an install requirement pointing at a specific git commit sets everything up so we can import emcpy modules instead of eva for plotting.
I am not sure why the eva applications tests are failing.

@danholdaway yeah, I told @kevindougherty-noaa it would be easier to review if we do this in 2 steps so we can ensure the dependency is installed properly first, and then change the code. Is that okay with you?
The test failures is interesting. Perhaps the install isn't working properly?

@danholdaway Cory suggested we have this PR just change the setup.py and then follow with a PR to change all the code.

Thanks for working on this @kevindougherty-noaa. This solution actually seems more elegant to me than Git submodules. Just let Pip handle things for you! I'll try to fix the CI. It doesn't have anything to do with your PR


Deselect

I just click on a tag and I redirect it to another page. How can I get the tag deselected when I come back?

@bcsezer You have to control the selection state youself.
For example, when you first page viewWillAppear you can deselecte the tag.
By the way, all the selection state should be stored in your own data.

Thank you


problem in alignment

When I run alignment,I encounter some problems as follow:
 warnings.warn('Matplotlib is building the font cache using fc-list. This may take a moment.') fatal: ambiguous argument 'HEAD': unknown revision or path not in the working tree. Use '--' to separate paths from revisions, like this: 'git <command> [<revision>...] -- [<file>...]' fatal: ambiguous argument 'HEAD': unknown revision or path not in the working tree. Use '--' to separate paths from revisions, like this: 'git <command> [<revision>...] -- [<file>...]' Traceback (most recent call last):   File "align_dataset.py", line 113, in <module>     main(parse_arguments(sys.argv[1:]))   File "align_dataset.py", line 42, in main     img = misc.imread(image_path) AttributeError: 'module' object has no attribute 'imread'
So what's reason of the problem?

Scipy is used to read images and my guess is that this library is not installed on your system.

I have installed scipy and other necessary dependent packages.

I install pillow package and finally it works.


Dump pipe command outputs to a file

Dump the output from the service that runs commands from the pipe into a file, so that it's easier to debug if there are any issues.

Closing this in favor of #91.


Papyrus] Add palette entries on Composite Structure Diagram

Issue and tracking information
Add missing palette entries on the structure diagram.
Developer's time Estimated effort to fix (hours):
3 days
Developer's Actual time spent on fix (hours)
Issue reporter to provide a detailed description of the issue in the space below

Committed to Papyrus branch


WIP: Fontbakery CI

WARNING: still super wip, don't use yet.
I recently pushed some fonts to google/fonts which were faulty. I had too much faith and should've rerun the fonts through FB. Imo, this still isn't enough. To stop this from happening in the future, we must hook FB up as a CI tool. It needs to stop PRs from being merged if any FAILS occur.
I've hooked this wip up to my fork of google/fonts and it's going in the right direction, https://travis-ci.org/m4rc1e/fonts
I still need to do the following:

Install OTS, Ms Font Val, ftxvalidator
Remove any false positive tests AvgCharWidth

In the not too distant future, we need do the following:

Drop QAing in dispatcher. It should only be done here.
Add diffbrowsers and visual regression checks

The .travis file and shell script must be able to run on all upstream font projects and any fork of google/fonts.
I have not included the files in the Lib dir since these are templates which should be added to other projects.
Totally open to any suggestions.

Drop QAing in dispatcher. It should only be done here

I'm not sure, why?
I see no problem on having fb run early and often

Drop QAing in dispatcher. It should only be done here

I'm not sure, why?

The Dispatcher Will only QA and produce diff images for the first push of a PR. If a dev pushes more commits to a PR, it doesn't regen the reports. It's far easier to do this with CI.

Thanks, @m4rc1e !
Here are a few comments from our private chat earlier this morning:
I think there might be corner cases where only a license file is changed on a PR and then you should make Font Bakery run on the whole family once more. Or a DESCRIPTION.html file. Or any relevant non-TTF file. It should trigger running Font Bakery on the complete family.
Also, if you change one TTF, the Font Bakery command-line shuld run on *.ttf instead of only on that single changed TTF. Otherwise, family checks would not run properly. So the shell script should really identify which families were changed, based on the list of changed files on a PR, and act on the complete family.
(I am not sure yet how we'll handle sibling families such as small-caps - FontBakery still does not deal with them yet, but that's a goal for a future release)

I will leave this PR open for a while until @m4rc1e feels happy about it and asks me to review & merge.

Also, this PR seems a bit related to this issue: https://github.com/googlefonts/fontbakery/issues/1794

We'll need Travis to use OS X so we can run ftxvalidator. It's Xcode only.

I believe getting Travis to run ftxvalidator requires some curl cookies
login magic, in order to log into the Apple Developers site using a login
that is kept secure, and download the installer package.

a fontbakery running as git pre-commit hook sounds cool. However IMO git repos should only contain sources, not binary files that are built from those, and fb AFAIK runs on font binaries primarily.
I never liked that GF github repositories contain the TTF files as well the sources (sorry I’m digressing)

@anthrotype It should/will be flexible enough to run on tagged ttf releases.

But Marc, cosimo objects to binaries in the git repo master branch commit
stream at all; he sees the /releases page (pypi wheels, etc) as the
suitable place for ttf files, and git repos master branch should only have
source files.
Which is formally correct, but not practical for the typical level of
sophistication in our community imho

You could have some gftools script that uses the GitHub api to upload TTFs to GitHub Releases, using e.g. https://github.com/j0057/github-release

Or even easier, one could create a new github release (or pre release) directly from the website and drag and drop the built TTF binaries generates locally with Glyphs.app or whatever tool, that’s even easier than doing git push

We have a UFOs-only policy and have an internal CI build the fonts and tug them away on a release-archive upon tagging something. People do that more often than building the fonts locally (maybe because things are more complicated than just exporting them). So it is possible, although Git remains a complicated tool.

I suppose source checks then make most sense when done from inside a font editor, at least in the short to medium term.

I will leave this PR open for a while until @m4rc1e feels happy about it and asks me to review & merge.

@m4rc1e do you have anything else to add here?

There's a few more things I need to do tbh. My time is limited for this task but I will fit it in eventually.

There's a few more things I need to do tbh. My time is limited for this task but I will fit it in eventually.

Cool, thanks for the update!


Color CC: Add RGBW value ID

What do we need for this?

We need to which format the hex string should have. OZW concatenates a bunch of HEX digits:
https://github.com/OpenZWave/open-zwave/blob/master/cpp/src/command_classes/Color.cpp#L210
I'm not sure if its worth going past RRGGBB with this, since it is standard and everything else is missing discoverability.
Basically what needs to be done is:

Probably during the interview, metadata for this value ID should be created
When a color report is received, the new value of this string must be figured out (from existing values and the new value) and also written
When this value is set (via the SET_VALUE API) it must be split into its parts to call the set method.

When a color report is received, the new value of this string must be figured out (from existing values and the new value) and also written

And reported to the user by an event :)

And reported to the user by an event :)

That happens when you set a value in the value DB


Internal error for models with new for replace property

In  Swashbuckle.AspNetCore.SwaggerGen\Generator\ApiParameterDescriptionExtensions.cs
If the model inherit from other class and have replaced property (with new) the follow method raise error with internal server (500) result
… code:
        private static bool TryGetPropertyInfo(
            this ApiParameterDescription parameterDescription,
            out PropertyInfo propertyInfo)
        {
            var modelMetadata = parameterDescription.ModelMetadata;

            propertyInfo = (modelMetadata?.ContainerType != null)
                ? **modelMetadata.ContainerType.GetProperty(modelMetadata.PropertyName)**
                : null;

            return (propertyInfo != null);
        }

I suggest to replace with:
**modelMetadata.ContainerType.GetProperties().Where(p => p.Name==modelMetadata.PropertyName).LastOrDefault()**

Interested in submitting fix as a PR?

@DanielS4n - I can't repro this. Could you please provide exact repro steps with sample code? Thanks.

Closing due to inactivity


Relation to DAX

DAX is another Excel-like Language of MSFT, used in Power BI.
How do these two Languages relate to each other? Please document this
Maybe a list of all Power-Platform / BI Languages and their scope would be helpful as well.

DAX is specific to queries on data in tables and columns in tabular data models. From the Power Fx documentation it seems the functions and expressions that are DAX are in Power Fx where it interacts with those types and models. It would be nice if the documentation and implementation were explicit in this carry-over though.


refactor: Whitespace removal from all .gd files

As Godot 3.4.2 automatically removes whitespace from gd files when the project is run, this PR is to fix all files.
After whitespace removal and testing the demo, Godot changed 2 files again, so these were recommitted. No further changes occurred after opening every room in the demo.

I would have preferred a rebase instead of merging HEAD into this branch so that the PR doesn't hold code that's already in the target branch.

I would have preferred a rebase instead of merging HEAD into this branch so that the PR doesn't hold code that's already in the target branch.

Agreed as well. Can you maybe rebase it on develop?

@StraToN @dploeger @BHSDuncan should be good now.

lgtm


Replace OpenGLCanvas Runnable's to JavaFX styled Event

JavaFX Node class commonly uses events like so:
public final void setOnMouseClicked( EventHandler<? super MouseEvent> value) {
    onMouseClickedProperty().set(value);
}

public final EventHandler<? super MouseEvent> getOnMouseClicked() {
    return (eventHandlerProperties == null) ? null : eventHandlerProperties.getOnMouseClicked();
}

It would be more in the spirit of JavaFX if OpenGLCanvas used a similar style for:

onRender
onUpdate
onReshape
onInitialize
onDispose

An example of this could be...
openGLCanvas.setOnRenderEvent((event)->{
    System.out.println(event.getFPS())
})

Names and meaning
The main reason why the methods are called that way and why there are so many of them is JOGL.
Initially the project was based on it. And to make the transition from Swing/SWT JOGL smoother, I left the methods roughly the same.
Default JOGL event listener includes:

display(GLAutoDrawable drawable)
init(GLAutoDrawable drawable)
reshape(GLAutoDrawable drawable, int x, int y, int width, int height)
dispose(GLAutoDrawable drawable)

GLAutoDrawable drawable that used to call GL functions, in my library (with lwjgl) is redudant
So they transformes to:

onDisplay
onInitialize
onReshape
onDispose
onUpdate - an addition that comes from LibGDX/Slick2D. There all logic should be processed

Why onReshape/onRender
Also comes from JOGL, listeners may be more than one for each event. So, set***** will be incorrect.
P.S.
The library was planned simply as an add-on to JavaFX, which displays OpenGL separately. The goal was not to fully integrate with Property or Events

I created a proof-of-concept that wraps around your OpenGLCanvas class.
https://github.com/orange451/OpenGLFX-Ext/blob/master/src/main/java/com/huskerdev/openglfx/ext/OpenGLPane.java
Benefit to using JavaFX events, is I can easily pass in internal parameters. For example in the RenderEvent I can pass in the current timers delta time.

I added Events. But not properties. You can test them.

Repaint event includes Delta and FPS
Reshape event includes width and height
Init event includes nothing

I think at the moment the event syntax has come as close as possible to the example. Therefore, I will close the issue.
If there are any questions, then you can reopen.